2023-08-27T11:01:17.964 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-27T11:01:17.965 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532 --verbose --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} --owner scheduled_rishabh@teuthology --name rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532/orig.config.yaml 2023-08-27T11:01:18.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T11:01:18.100 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532 branch: wip-rishabh-xiubo-wip-57154 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} email: null first_in_suite: false job_id: '7381532' kernel: client: branch: testing flavor: default kdb: true sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-xiubo-wip-57154 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - \(MDS_INSUFFICIENT_STANDBY\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_DAMAGE\) - \(FS_DEGRADED\) sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: disabled: true install: ceph: flavor: default sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-xiubo-wip-57154 sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-xiubo-wip-57154 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1da267a3afa9ab8f9b1d164359066f8bd682ffd8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_failover teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-26_02:16:12 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1553 2023-08-27T11:01:18.101 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1da267a3afa9ab8f9b1d164359066f8bd682ffd8/qa; will attempt to use it 2023-08-27T11:01:18.101 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1da267a3afa9ab8f9b1d164359066f8bd682ffd8/qa/tasks 2023-08-27T11:01:18.102 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-27T11:01:18.104 INFO:teuthology.task.internal:Checking packages... 2023-08-27T11:01:18.131 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '1da267a3afa9ab8f9b1d164359066f8bd682ffd8' 2023-08-27T11:01:18.131 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-27T11:01:18.132 INFO:teuthology.packaging:ref: None 2023-08-27T11:01:18.132 INFO:teuthology.packaging:tag: None 2023-08-27T11:01:18.132 INFO:teuthology.packaging:branch: wip-rishabh-xiubo-wip-57154 2023-08-27T11:01:18.132 INFO:teuthology.packaging:sha1: 1da267a3afa9ab8f9b1d164359066f8bd682ffd8 2023-08-27T11:01:18.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-xiubo-wip-57154 2023-08-27T11:01:18.278 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5707.g1da267a3 2023-08-27T11:01:18.282 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-27T11:01:18.288 INFO:teuthology.task.internal:no buildpackages task found 2023-08-27T11:01:18.289 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-27T11:01:18.332 INFO:teuthology.task.internal:Saving configuration 2023-08-27T11:01:18.350 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-27T11:01:18.358 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T11:01:18.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 10:56:07.312849', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-27T11:01:18.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 10:56:07.314239', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-27T11:01:18.399 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-27T11:01:18.405 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-08-27T11:01:18.405 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-08-27T11:01:18.405 INFO:teuthology.run_tasks:Running task console_log... 2023-08-27T11:01:18.496 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdfca2f3820>, signals=[15]) 2023-08-27T11:01:18.498 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-27T11:01:18.509 INFO:teuthology.task.internal:Opening connections... 2023-08-27T11:01:18.509 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:01:18.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:01:18.582 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:01:18.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:01:18.653 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-27T11:01:18.660 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-08-27T11:01:18.681 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-08-27T11:01:18.682 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-08-27T11:01:18.741 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-08-27T11:01:18.741 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-08-27T11:01:18.741 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-08-27T11:01:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-08-27T11:01:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-08-27T11:01:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-08-27T11:01:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-27T11:01:18.742 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-08-27T11:01:18.743 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-27T11:01:18.743 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-08-27T11:01:18.743 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-27T11:01:18.743 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T11:01:18.743 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:01:18.744 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-27T11:01:18.744 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-27T11:01:18.744 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-27T11:01:18.744 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-27T11:01:18.745 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-08-27T11:01:18.773 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-08-27T11:01:18.793 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-08-27T11:01:18.794 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-08-27T11:01:18.853 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2023-08-27T11:01:18.853 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2023-08-27T11:01:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2023-08-27T11:01:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2023-08-27T11:01:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2023-08-27T11:01:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-08-27T11:01:18.854 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-27T11:01:18.855 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-08-27T11:01:18.855 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-27T11:01:18.855 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2023-08-27T11:01:18.855 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-27T11:01:18.855 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T11:01:18.856 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:01:18.856 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-27T11:01:18.856 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-27T11:01:18.856 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-27T11:01:18.856 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-27T11:01:18.857 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-08-27T11:01:18.890 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-27T11:01:18.901 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-27T11:01:18.944 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-27T11:01:18.945 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2023-08-27T11:01:18.948 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-08-27T11:01:18.968 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-27T11:01:18.974 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-27T11:01:18.974 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2023-08-27T11:01:19.008 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-08-27T11:01:19.054 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-27T11:01:19.105 INFO:teuthology.run_tasks:Running task kernel... 2023-08-27T11:01:19.121 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'} 2023-08-27T11:01:19.122 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-08-27T11:01:19.122 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-27T11:01:19.122 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-27T11:01:19.123 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-27T11:01:19.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:01:19.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-27T11:01:19.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:01:19.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-27T11:01:19.365 DEBUG:teuthology.task.kernel:sha1 for client.0 is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:19.365 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-27T11:01:19.365 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2023-08-27T11:01:19.373 DEBUG:teuthology.task.kernel:sha1 for client.1 is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:19.373 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-27T11:01:19.374 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-08-27T11:01:19.386 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-27T11:01:19.387 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:19.387 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-27T11:01:19.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum upgrade -y linux-firmware 2023-08-27T11:01:19.394 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-27T11:01:19.394 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:19.395 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-27T11:01:19.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum upgrade -y linux-firmware 2023-08-27T11:01:20.596 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-08-27T11:01:20.596 INFO:teuthology.orchestra.run.smithi057.stdout:Unable to read consumer identity 2023-08-27T11:01:20.623 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-08-27T11:01:20.624 INFO:teuthology.orchestra.run.smithi043.stdout:Unable to read consumer identity 2023-08-27T11:01:22.040 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-27T11:01:22.107 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-08-27T11:01:22.722 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2023-08-27T11:01:22.966 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-08-27T11:01:26.431 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 427 kB/s | 24 kB 00:00 2023-08-27T11:01:26.683 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 294 kB/s | 24 kB 00:00 2023-08-27T11:01:27.211 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-08-27T11:01:27.212 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2023-08-27T11:01:27.213 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-08-27T11:01:27.354 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-27T11:01:27.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:27.476 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-08-27T11:01:27.477 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-08-27T11:01:27.477 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-08-27T11:01:27.579 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ 2023-08-27T11:01:27.580 DEBUG:teuthology.orchestra.run.smithi043:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-27T11:01:27.583 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi043.front.sepia.ceph.com to complete... 2023-08-27T11:01:27.593 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.1... 2023-08-27T11:01:27.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-27T11:01:27.829 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ 2023-08-27T11:01:27.830 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-27T11:01:27.833 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2023-08-27T11:01:44.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27 11:01:44 URL:https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm [380759896/380759896] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-27T11:01:44.905 INFO:teuthology.orchestra.run.smithi043.stderr:FINISHED --2023-08-27 11:01:44-- 2023-08-27T11:01:44.905 INFO:teuthology.orchestra.run.smithi043.stderr:Total wall clock time: 17s 2023-08-27T11:01:44.905 INFO:teuthology.orchestra.run.smithi043.stderr:Downloaded: 1 files, 363M in 17s (21.4 MB/s) 2023-08-27T11:01:44.907 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-27T11:01:44.907 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-27T11:01:46.565 INFO:teuthology.orchestra.run.smithi043.stdout:Verifying... ######################################## 2023-08-27T11:01:46.625 INFO:teuthology.orchestra.run.smithi043.stdout:Preparing... ######################################## 2023-08-27T11:01:46.725 INFO:teuthology.orchestra.run.smithi043.stdout:Updating / installing... 2023-08-27T11:02:20.787 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27 11:02:20 URL:https://3.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_ga6a696707610-1.x86_64.rpm [380759896/380759896] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-27T11:02:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2023-08-27 11:02:20-- 2023-08-27T11:02:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 53s 2023-08-27T11:02:20.788 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 363M in 53s (6.89 MB/s) 2023-08-27T11:02:20.789 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.1... 2023-08-27T11:02:20.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-27T11:02:22.490 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying... ######################################## 2023-08-27T11:02:22.548 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing... ######################################## 2023-08-27T11:02:22.637 INFO:teuthology.orchestra.run.smithi057.stdout:Updating / installing... 2023-08-27T11:02:27.534 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-6.5.0_rc7_ga6a696707610-1 ######################################## 2023-08-27T11:02:52.654 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-27T11:02:52.655 DEBUG:teuthology.orchestra.run.smithi043:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-27T11:02:52.718 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-27T11:02:52.718 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/config-6.5.0-rc7-ga6a696707610 2023-08-27T11:02:52.719 INFO:teuthology.orchestra.run.smithi043.stdout:/boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-27T11:02:52.719 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610 2023-08-27T11:02:52.719 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel 2023-08-27T11:02:52.719 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch 2023-08-27T11:02:52.719 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86 2023-08-27T11:02:52.720 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto 2023-08-27T11:02:52.720 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-27T11:02:52.720 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-27T11:02:52.720 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-27T11:02:52.720 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-27T11:02:52.721 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-27T11:02:52.722 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-27T11:02:52.722 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-27T11:02:52.722 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-27T11:02:52.722 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-27T11:02:52.722 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-27T11:02:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-27T11:02:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-27T11:02:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-27T11:02:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-27T11:02:52.723 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-27T11:02:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel 2023-08-27T11:02:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu 2023-08-27T11:02:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce 2023-08-27T11:02:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-27T11:02:52.724 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-27T11:02:52.725 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-27T11:02:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-27T11:02:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx 2023-08-27T11:02:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-27T11:02:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-27T11:02:52.726 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-27T11:02:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-27T11:02:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-27T11:02:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-27T11:02:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-27T11:02:52.727 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-27T11:02:52.728 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-27T11:02:52.728 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-27T11:02:52.728 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-27T11:02:52.728 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-27T11:02:52.728 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-27T11:02:52.729 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-27T11:02:52.730 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-27T11:02:52.730 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-27T11:02:52.730 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-27T11:02:52.730 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-27T11:02:52.730 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-27T11:02:52.731 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-27T11:02:52.731 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-27T11:02:52.731 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-27T11:02:52.731 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-27T11:02:52.731 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-27T11:02:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-27T11:02:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-27T11:02:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-27T11:02:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-27T11:02:52.732 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-27T11:02:52.733 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-27T11:02:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-27T11:02:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-27T11:02:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-27T11:02:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-27T11:02:52.734 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-27T11:02:52.735 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-27T11:02:52.735 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-27T11:02:52.735 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-27T11:02:52.735 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-27T11:02:52.735 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-27T11:02:52.736 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers 2023-08-27T11:02:52.736 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi 2023-08-27T11:02:52.736 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-27T11:02:52.736 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-27T11:02:52.736 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/custom_method.ko 2023-08-27T11:02:52.737 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-27T11:02:52.737 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-27T11:02:52.737 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-27T11:02:52.737 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-27T11:02:52.737 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ata_generic.ko 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-27T11:02:52.738 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-27T11:02:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-27T11:02:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-27T11:02:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-27T11:02:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-27T11:02:52.739 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-27T11:02:52.740 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-27T11:02:52.740 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-27T11:02:52.740 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-27T11:02:52.740 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-27T11:02:52.741 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-27T11:02:52.741 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-27T11:02:52.741 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-27T11:02:52.741 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-27T11:02:52.741 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-27T11:02:52.742 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-27T11:02:52.742 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-27T11:02:52.742 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-27T11:02:52.742 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-27T11:02:52.742 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-27T11:02:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-27T11:02:52.744 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-27T11:02:52.744 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-27T11:02:52.744 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-27T11:02:52.744 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-27T11:02:52.744 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sis.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-27T11:02:52.745 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-27T11:02:52.746 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-27T11:02:52.746 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-27T11:02:52.746 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-27T11:02:52.746 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-27T11:02:52.746 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-27T11:02:52.747 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-27T11:02:52.747 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-27T11:02:52.747 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-27T11:02:52.747 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-27T11:02:52.747 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-27T11:02:52.748 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay 2023-08-27T11:02:52.749 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-27T11:02:52.749 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base 2023-08-27T11:02:52.749 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap 2023-08-27T11:02:52.749 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-27T11:02:52.749 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-27T11:02:52.750 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma 2023-08-27T11:02:52.750 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-27T11:02:52.750 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block 2023-08-27T11:02:52.750 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe 2023-08-27T11:02:52.750 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/brd.ko 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/loop.ko 2023-08-27T11:02:52.751 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx 2023-08-27T11:02:52.752 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-27T11:02:52.752 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-27T11:02:52.752 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk 2023-08-27T11:02:52.752 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-27T11:02:52.752 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-27T11:02:52.753 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-27T11:02:52.753 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/virtio_blk.ko 2023-08-27T11:02:52.753 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback 2023-08-27T11:02:52.753 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-27T11:02:52.753 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkfront.ko 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random 2023-08-27T11:02:52.754 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi 2023-08-27T11:02:52.755 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-27T11:02:52.756 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-27T11:02:52.756 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-27T11:02:52.756 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-27T11:02:52.756 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-27T11:02:52.756 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-27T11:02:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-27T11:02:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave 2023-08-27T11:02:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-27T11:02:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-27T11:02:52.757 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-27T11:02:52.758 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm 2023-08-27T11:02:52.758 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm.ko 2023-08-27T11:02:52.758 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-27T11:02:52.758 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-27T11:02:52.759 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-27T11:02:52.759 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-27T11:02:52.759 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-27T11:02:52.759 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/uv_mmtimer.ko 2023-08-27T11:02:52.759 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/virtio_console.ko 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-27T11:02:52.760 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-27T11:02:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-27T11:02:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto 2023-08-27T11:02:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp 2023-08-27T11:02:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-27T11:02:52.761 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-27T11:02:52.762 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel 2023-08-27T11:02:52.762 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat 2023-08-27T11:02:52.762 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common 2023-08-27T11:02:52.762 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-27T11:02:52.762 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-27T11:02:52.763 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca 2023-08-27T11:02:52.764 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-27T11:02:52.764 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq 2023-08-27T11:02:52.764 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-27T11:02:52.764 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma 2023-08-27T11:02:52.764 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw 2023-08-27T11:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-27T11:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat 2023-08-27T11:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-27T11:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac 2023-08-27T11:02:52.765 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-27T11:02:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-27T11:02:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-27T11:02:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-27T11:02:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-27T11:02:52.766 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-27T11:02:52.767 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-27T11:02:52.768 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-27T11:02:52.768 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware 2023-08-27T11:02:52.768 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/edd.ko 2023-08-27T11:02:52.768 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-27T11:02:52.768 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-27T11:02:52.769 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-27T11:02:52.770 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-27T11:02:52.770 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-27T11:02:52.770 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-27T11:02:52.770 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-27T11:02:52.770 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-27T11:02:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-27T11:02:52.772 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-27T11:02:52.772 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-27T11:02:52.772 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-27T11:02:52.772 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-27T11:02:52.772 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-27T11:02:52.773 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-27T11:02:52.774 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-27T11:02:52.774 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-27T11:02:52.774 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-27T11:02:52.774 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-27T11:02:52.774 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-27T11:02:52.775 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-27T11:02:52.775 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-27T11:02:52.775 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-27T11:02:52.775 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-27T11:02:52.775 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-27T11:02:52.776 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-27T11:02:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-27T11:02:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-27T11:02:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-27T11:02:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-27T11:02:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-27T11:02:52.778 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-27T11:02:52.778 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-27T11:02:52.778 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-27T11:02:52.778 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-27T11:02:52.778 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-27T11:02:52.779 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-27T11:02:52.780 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-27T11:02:52.780 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-27T11:02:52.780 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-27T11:02:52.780 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-27T11:02:52.780 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-27T11:02:52.781 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-27T11:02:52.781 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-27T11:02:52.781 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv 2023-08-27T11:02:52.781 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-27T11:02:52.781 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-27T11:02:52.782 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-27T11:02:52.782 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon 2023-08-27T11:02:52.782 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-27T11:02:52.782 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-27T11:02:52.782 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-27T11:02:52.783 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-27T11:02:52.784 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-27T11:02:52.784 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-27T11:02:52.784 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-27T11:02:52.784 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-27T11:02:52.784 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-27T11:02:52.785 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-27T11:02:52.785 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-27T11:02:52.785 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-27T11:02:52.785 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-27T11:02:52.785 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-27T11:02:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-27T11:02:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-27T11:02:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-27T11:02:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-27T11:02:52.786 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-27T11:02:52.787 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-27T11:02:52.787 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-27T11:02:52.787 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-27T11:02:52.787 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-27T11:02:52.787 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-27T11:02:52.788 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-27T11:02:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-27T11:02:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-27T11:02:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-27T11:02:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-27T11:02:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-27T11:02:52.790 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-27T11:02:52.790 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-27T11:02:52.790 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-27T11:02:52.790 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-27T11:02:52.790 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-27T11:02:52.791 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-27T11:02:52.792 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-27T11:02:52.792 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-27T11:02:52.792 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-27T11:02:52.792 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-27T11:02:52.792 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-27T11:02:52.793 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-27T11:02:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-27T11:02:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-27T11:02:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-27T11:02:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-27T11:02:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-27T11:02:52.795 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-27T11:02:52.795 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-27T11:02:52.795 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-27T11:02:52.795 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-27T11:02:52.795 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-27T11:02:52.796 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-27T11:02:52.796 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-27T11:02:52.796 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-27T11:02:52.796 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-27T11:02:52.796 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-27T11:02:52.797 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-27T11:02:52.798 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-27T11:02:52.798 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-27T11:02:52.798 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-27T11:02:52.798 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-27T11:02:52.798 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-27T11:02:52.799 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus 2023-08-27T11:02:52.799 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-27T11:02:52.799 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-27T11:02:52.799 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-27T11:02:52.799 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-27T11:02:52.800 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-27T11:02:52.801 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-27T11:02:52.801 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-27T11:02:52.801 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-27T11:02:52.801 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-27T11:02:52.801 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-27T11:02:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-27T11:02:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-27T11:02:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-27T11:02:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-27T11:02:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-27T11:02:52.803 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-27T11:02:52.803 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-27T11:02:52.803 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-27T11:02:52.803 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-27T11:02:52.803 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-27T11:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-27T11:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-27T11:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-27T11:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-27T11:02:52.804 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-27T11:02:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-27T11:02:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-27T11:02:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-27T11:02:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-27T11:02:52.805 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-27T11:02:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-27T11:02:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-27T11:02:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-27T11:02:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-27T11:02:52.806 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-27T11:02:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-27T11:02:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c 2023-08-27T11:02:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos 2023-08-27T11:02:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-27T11:02:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-27T11:02:52.808 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-27T11:02:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-27T11:02:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-27T11:02:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-27T11:02:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-27T11:02:52.809 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-27T11:02:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-27T11:02:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-27T11:02:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-27T11:02:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-27T11:02:52.810 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-27T11:02:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-27T11:02:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-27T11:02:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-27T11:02:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-27T11:02:52.811 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-dev.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-27T11:02:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-27T11:02:52.813 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-27T11:02:52.813 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-27T11:02:52.813 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband 2023-08-27T11:02:52.813 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core 2023-08-27T11:02:52.813 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-27T11:02:52.814 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-27T11:02:52.814 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-27T11:02:52.814 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-27T11:02:52.814 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-27T11:02:52.814 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4 2023-08-27T11:02:52.815 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp 2023-08-27T11:02:52.816 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib 2023-08-27T11:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-27T11:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser 2023-08-27T11:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-27T11:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert 2023-08-27T11:02:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-27T11:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp 2023-08-27T11:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-27T11:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt 2023-08-27T11:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-27T11:02:52.818 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-27T11:02:52.819 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-27T11:02:52.820 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-27T11:02:52.820 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard 2023-08-27T11:02:52.820 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-27T11:02:52.820 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse 2023-08-27T11:02:52.820 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-27T11:02:52.821 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-27T11:02:52.822 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-27T11:02:52.822 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4 2023-08-27T11:02:52.822 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-27T11:02:52.822 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio 2023-08-27T11:02:52.822 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-27T11:02:52.823 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-27T11:02:52.823 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-27T11:02:52.823 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-27T11:02:52.823 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-27T11:02:52.823 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-27T11:02:52.824 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-27T11:02:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-27T11:02:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger 2023-08-27T11:02:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-27T11:02:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-27T11:02:52.825 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-27T11:02:52.826 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md 2023-08-27T11:02:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache 2023-08-27T11:02:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-27T11:02:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-27T11:02:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-27T11:02:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-27T11:02:52.828 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-27T11:02:52.829 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-27T11:02:52.829 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-27T11:02:52.829 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-27T11:02:52.829 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-27T11:02:52.829 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-27T11:02:52.830 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-27T11:02:52.830 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-27T11:02:52.830 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-27T11:02:52.830 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-27T11:02:52.830 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-27T11:02:52.831 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message 2023-08-27T11:02:52.832 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion 2023-08-27T11:02:52.832 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-27T11:02:52.832 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-27T11:02:52.832 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-27T11:02:52.832 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-27T11:02:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-27T11:02:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mfd-core.ko 2023-08-27T11:02:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-27T11:02:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-27T11:02:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-27T11:02:52.834 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-27T11:02:52.835 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-27T11:02:52.836 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710 2023-08-27T11:02:52.836 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-27T11:02:52.836 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom 2023-08-27T11:02:52.836 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-27T11:02:52.836 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-27T11:02:52.837 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-27T11:02:52.837 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-27T11:02:52.837 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-27T11:02:52.837 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-27T11:02:52.837 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-27T11:02:52.838 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-27T11:02:52.838 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d 2023-08-27T11:02:52.838 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-27T11:02:52.838 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-27T11:02:52.838 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-27T11:02:52.839 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp 2023-08-27T11:02:52.840 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-27T11:02:52.840 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-27T11:02:52.840 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-27T11:02:52.840 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-27T11:02:52.840 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-27T11:02:52.841 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-27T11:02:52.841 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-27T11:02:52.841 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci 2023-08-27T11:02:52.841 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-27T11:02:52.841 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-27T11:02:52.842 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-27T11:02:52.843 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-27T11:02:52.843 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx 2023-08-27T11:02:52.843 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-27T11:02:52.843 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-27T11:02:52.843 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-27T11:02:52.844 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet 2023-08-27T11:02:52.844 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com 2023-08-27T11:02:52.844 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-27T11:02:52.844 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-27T11:02:52.844 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-27T11:02:52.845 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-27T11:02:52.845 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390 2023-08-27T11:02:52.845 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-27T11:02:52.845 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-27T11:02:52.845 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-27T11:02:52.846 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon 2023-08-27T11:02:52.847 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-27T11:02:52.847 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera 2023-08-27T11:02:52.847 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-27T11:02:52.847 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd 2023-08-27T11:02:52.847 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-27T11:02:52.848 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-27T11:02:52.848 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-27T11:02:52.848 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros 2023-08-27T11:02:52.848 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx 2023-08-27T11:02:52.848 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx 2023-08-27T11:02:52.849 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-27T11:02:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-27T11:02:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom 2023-08-27T11:02:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-27T11:02:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-27T11:02:52.850 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-27T11:02:52.851 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-27T11:02:52.851 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-27T11:02:52.851 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet 2023-08-27T11:02:52.851 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-27T11:02:52.851 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-27T11:02:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade 2023-08-27T11:02:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna 2023-08-27T11:02:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-27T11:02:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio 2023-08-27T11:02:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-27T11:02:52.853 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-27T11:02:52.853 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-27T11:02:52.853 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-27T11:02:52.853 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-27T11:02:52.857 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-27T11:02:52.858 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-27T11:02:52.858 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-27T11:02:52.858 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-27T11:02:52.858 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-27T11:02:52.858 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco 2023-08-27T11:02:52.859 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic 2023-08-27T11:02:52.859 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-27T11:02:52.859 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec 2023-08-27T11:02:52.859 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip 2023-08-27T11:02:52.859 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-27T11:02:52.860 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink 2023-08-27T11:02:52.861 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-27T11:02:52.861 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-27T11:02:52.861 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-27T11:02:52.861 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex 2023-08-27T11:02:52.861 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet 2023-08-27T11:02:52.862 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-27T11:02:52.862 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-27T11:02:52.862 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-27T11:02:52.862 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel 2023-08-27T11:02:52.862 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-27T11:02:52.863 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000 2023-08-27T11:02:52.863 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-27T11:02:52.863 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e 2023-08-27T11:02:52.863 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-27T11:02:52.863 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-27T11:02:52.864 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb 2023-08-27T11:02:52.865 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-27T11:02:52.865 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf 2023-08-27T11:02:52.865 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-27T11:02:52.865 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-27T11:02:52.865 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-27T11:02:52.866 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-27T11:02:52.866 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-27T11:02:52.866 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-27T11:02:52.866 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell 2023-08-27T11:02:52.866 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-27T11:02:52.867 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-27T11:02:52.868 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-27T11:02:52.868 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-27T11:02:52.868 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-27T11:02:52.868 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel 2023-08-27T11:02:52.868 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-27T11:02:52.869 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-27T11:02:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion 2023-08-27T11:02:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-27T11:02:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia 2023-08-27T11:02:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-27T11:02:52.870 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines 2023-08-27T11:02:52.871 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-27T11:02:52.871 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-27T11:02:52.871 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic 2023-08-27T11:02:52.871 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-27T11:02:52.871 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-27T11:02:52.872 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-27T11:02:52.872 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-27T11:02:52.872 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-27T11:02:52.872 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc 2023-08-27T11:02:52.872 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-27T11:02:52.873 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker 2023-08-27T11:02:52.874 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-27T11:02:52.874 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc 2023-08-27T11:02:52.874 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-27T11:02:52.874 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan 2023-08-27T11:02:52.874 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-27T11:02:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis 2023-08-27T11:02:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-27T11:02:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-27T11:02:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc 2023-08-27T11:02:52.875 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-27T11:02:52.876 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-27T11:02:52.876 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-27T11:02:52.876 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-27T11:02:52.876 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro 2023-08-27T11:02:52.876 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-27T11:02:52.877 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-27T11:02:52.878 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via 2023-08-27T11:02:52.879 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-27T11:02:52.879 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-27T11:02:52.879 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet 2023-08-27T11:02:52.879 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-27T11:02:52.879 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-27T11:02:52.880 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154 2023-08-27T11:02:52.881 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-27T11:02:52.881 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-27T11:02:52.881 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan 2023-08-27T11:02:52.881 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-27T11:02:52.881 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-27T11:02:52.882 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-27T11:02:52.883 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-27T11:02:52.883 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/net_failover.ko 2023-08-27T11:02:52.883 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-27T11:02:52.883 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-27T11:02:52.883 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-27T11:02:52.884 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-27T11:02:52.885 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-27T11:02:52.885 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-27T11:02:52.885 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-27T11:02:52.885 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-27T11:02:52.885 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-27T11:02:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/dp83640.ko 2023-08-27T11:02:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-27T11:02:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-27T11:02:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-27T11:02:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-27T11:02:52.887 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-27T11:02:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-27T11:02:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-27T11:02:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp 2023-08-27T11:02:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-27T11:02:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-27T11:02:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-27T11:02:52.890 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-27T11:02:52.890 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip 2023-08-27T11:02:52.890 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slhc.ko 2023-08-27T11:02:52.890 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-27T11:02:52.890 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-27T11:02:52.891 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tun.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/virtio_net.ko 2023-08-27T11:02:52.892 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3 2023-08-27T11:02:52.893 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-27T11:02:52.893 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan 2023-08-27T11:02:52.893 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-27T11:02:52.893 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback 2023-08-27T11:02:52.893 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netfront.ko 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host 2023-08-27T11:02:52.894 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-27T11:02:52.895 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-27T11:02:52.895 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport 2023-08-27T11:02:52.895 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-27T11:02:52.895 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-27T11:02:52.895 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie 2023-08-27T11:02:52.896 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-27T11:02:52.897 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-27T11:02:52.897 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia 2023-08-27T11:02:52.897 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-27T11:02:52.897 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-27T11:02:52.897 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86 2023-08-27T11:02:52.898 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-27T11:02:52.899 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-27T11:02:52.900 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-27T11:02:52.900 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-27T11:02:52.900 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-27T11:02:52.900 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-27T11:02:52.900 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-27T11:02:52.901 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-27T11:02:52.902 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-27T11:02:52.902 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-27T11:02:52.902 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-27T11:02:52.902 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-27T11:02:52.902 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-27T11:02:52.903 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-27T11:02:52.904 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp 2023-08-27T11:02:52.905 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-27T11:02:52.905 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-27T11:02:52.905 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc 2023-08-27T11:02:52.905 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-27T11:02:52.905 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-27T11:02:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-27T11:02:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-27T11:02:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-27T11:02:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-27T11:02:52.906 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-27T11:02:52.907 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-27T11:02:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-27T11:02:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-27T11:02:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-27T11:02:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-27T11:02:52.908 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-27T11:02:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-27T11:02:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-27T11:02:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-27T11:02:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-27T11:02:52.909 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-27T11:02:52.910 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-27T11:02:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-27T11:02:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-27T11:02:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-27T11:02:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi 2023-08-27T11:02:52.911 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-27T11:02:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-27T11:02:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-27T11:02:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-27T11:02:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-27T11:02:52.912 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-27T11:02:52.913 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-27T11:02:52.914 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa 2023-08-27T11:02:52.915 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-27T11:02:52.915 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc 2023-08-27T11:02:52.915 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-27T11:02:52.915 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i 2023-08-27T11:02:52.915 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-27T11:02:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-27T11:02:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor 2023-08-27T11:02:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-27T11:02:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi 2023-08-27T11:02:52.916 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-27T11:02:52.917 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler 2023-08-27T11:02:52.918 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-27T11:02:52.918 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-27T11:02:52.918 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-27T11:02:52.918 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-27T11:02:52.918 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-27T11:02:52.919 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-27T11:02:52.920 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-27T11:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-27T11:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-27T11:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci 2023-08-27T11:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-27T11:02:52.921 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-27T11:02:52.922 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas 2023-08-27T11:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-27T11:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc 2023-08-27T11:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-27T11:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid 2023-08-27T11:02:52.923 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-27T11:02:52.924 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas 2023-08-27T11:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-27T11:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-27T11:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001 2023-08-27T11:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-27T11:02:52.925 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-27T11:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-27T11:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx 2023-08-27T11:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-27T11:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-27T11:02:52.926 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-27T11:02:52.927 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-27T11:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-27T11:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-27T11:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-27T11:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-27T11:02:52.928 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-27T11:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2 2023-08-27T11:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-27T11:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-27T11:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-27T11:02:52.929 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-27T11:02:52.930 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-27T11:02:52.931 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-27T11:02:52.932 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc 2023-08-27T11:02:52.932 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-27T11:02:52.932 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal 2023-08-27T11:02:52.932 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel 2023-08-27T11:02:52.932 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-27T11:02:52.933 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-27T11:02:52.934 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-27T11:02:52.934 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-27T11:02:52.934 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-27T11:02:52.934 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-27T11:02:52.934 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty 2023-08-27T11:02:52.935 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial 2023-08-27T11:02:52.936 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250 2023-08-27T11:02:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-27T11:02:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-27T11:02:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm 2023-08-27T11:02:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-27T11:02:52.937 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-27T11:02:52.938 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-27T11:02:52.939 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb 2023-08-27T11:02:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class 2023-08-27T11:02:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-27T11:02:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-27T11:02:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-27T11:02:52.940 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-27T11:02:52.941 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc 2023-08-27T11:02:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-27T11:02:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-27T11:02:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-27T11:02:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-27T11:02:52.942 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-27T11:02:52.943 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga 2023-08-27T11:02:52.944 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-27T11:02:52.944 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-27T11:02:53.229 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-27T11:02:53.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-27T11:02:53.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-27T11:02:53.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-27T11:02:53.230 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-27T11:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy 2023-08-27T11:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-27T11:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial 2023-08-27T11:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-27T11:02:53.231 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-27T11:02:53.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-27T11:02:53.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-27T11:02:53.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-27T11:02:53.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-27T11:02:53.232 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-27T11:02:53.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-27T11:02:53.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-27T11:02:53.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-27T11:02:53.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-27T11:02:53.233 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-27T11:02:53.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-27T11:02:53.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-27T11:02:53.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-27T11:02:53.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-27T11:02:53.234 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-27T11:02:53.235 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-27T11:02:53.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-27T11:02:53.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-27T11:02:53.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-27T11:02:53.236 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-27T11:02:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-27T11:02:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-27T11:02:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-27T11:02:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-27T11:02:53.237 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-27T11:02:53.238 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-27T11:02:53.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-27T11:02:53.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-27T11:02:53.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-27T11:02:53.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-27T11:02:53.239 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-27T11:02:53.240 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-27T11:02:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-27T11:02:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-27T11:02:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-27T11:02:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-27T11:02:53.241 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-27T11:02:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-27T11:02:53.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-27T11:02:53.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip 2023-08-27T11:02:53.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-27T11:02:53.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-27T11:02:53.243 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-27T11:02:53.244 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-27T11:02:53.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost 2023-08-27T11:02:53.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-27T11:02:53.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-27T11:02:53.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-27T11:02:53.245 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-27T11:02:53.246 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio 2023-08-27T11:02:53.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio.ko 2023-08-27T11:02:53.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_balloon.ko 2023-08-27T11:02:53.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_mmio.ko 2023-08-27T11:02:53.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci.ko 2023-08-27T11:02:53.247 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_ring.ko 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-27T11:02:53.248 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-27T11:02:53.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves 2023-08-27T11:02:53.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-27T11:02:53.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-27T11:02:53.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-27T11:02:53.249 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-27T11:02:53.250 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-27T11:02:53.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-27T11:02:53.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-27T11:02:53.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog 2023-08-27T11:02:53.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-27T11:02:53.251 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-27T11:02:53.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-27T11:02:53.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-27T11:02:53.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-27T11:02:53.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-27T11:02:53.252 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-27T11:02:53.253 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-27T11:02:53.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-27T11:02:53.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-27T11:02:53.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-27T11:02:53.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-27T11:02:53.254 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-27T11:02:53.255 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-27T11:02:53.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-27T11:02:53.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-27T11:02:53.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen 2023-08-27T11:02:53.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-27T11:02:53.256 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-27T11:02:53.257 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs 2023-08-27T11:02:53.258 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-27T11:02:53.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs 2023-08-27T11:02:53.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-27T11:02:53.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-27T11:02:53.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs 2023-08-27T11:02:53.259 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda 2023-08-27T11:02:53.260 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-27T11:02:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs 2023-08-27T11:02:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-27T11:02:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm 2023-08-27T11:02:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-27T11:02:53.261 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/fat.ko 2023-08-27T11:02:53.262 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-27T11:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/vfat.ko 2023-08-27T11:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache 2023-08-27T11:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-27T11:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse 2023-08-27T11:02:53.263 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/fuse.ko 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-27T11:02:53.264 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus 2023-08-27T11:02:53.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-27T11:02:53.265 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs 2023-08-27T11:02:53.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-27T11:02:53.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs 2023-08-27T11:02:53.268 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs 2023-08-27T11:02:53.269 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-27T11:02:53.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs 2023-08-27T11:02:53.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout 2023-08-27T11:02:53.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-27T11:02:53.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout 2023-08-27T11:02:53.270 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-27T11:02:53.271 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common 2023-08-27T11:02:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-27T11:02:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-27T11:02:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd 2023-08-27T11:02:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-27T11:02:53.272 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-27T11:02:53.273 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-27T11:02:53.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-27T11:02:53.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-27T11:02:53.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-27T11:02:53.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-27T11:02:53.274 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-27T11:02:53.275 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-27T11:02:53.276 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-27T11:02:53.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-27T11:02:53.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-27T11:02:53.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-27T11:02:53.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-27T11:02:53.277 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-27T11:02:53.278 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-27T11:02:53.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-27T11:02:53.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-27T11:02:53.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-27T11:02:53.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-27T11:02:53.279 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-27T11:02:53.280 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-27T11:02:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-27T11:02:53.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2 2023-08-27T11:02:53.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster 2023-08-27T11:02:53.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-27T11:02:53.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm 2023-08-27T11:02:53.282 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-27T11:02:53.283 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-27T11:02:53.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs 2023-08-27T11:02:53.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-27T11:02:53.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore 2023-08-27T11:02:53.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-27T11:02:53.284 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client 2023-08-27T11:02:53.285 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-27T11:02:53.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common 2023-08-27T11:02:53.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-27T11:02:53.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-27T11:02:53.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs 2023-08-27T11:02:53.286 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs 2023-08-27T11:02:53.287 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu/rcutorture.ko 2023-08-27T11:02:53.288 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-27T11:02:53.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace 2023-08-27T11:02:53.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-27T11:02:53.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib 2023-08-27T11:02:53.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/asn1_encoder.ko 2023-08-27T11:02:53.289 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-27T11:02:53.290 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-27T11:02:53.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4 2023-08-27T11:02:53.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-27T11:02:53.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-27T11:02:53.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math 2023-08-27T11:02:53.291 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-27T11:02:53.292 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-27T11:02:53.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-27T11:02:53.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd 2023-08-27T11:02:53.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd/zstd_compress.ko 2023-08-27T11:02:53.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm 2023-08-27T11:02:53.293 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-27T11:02:53.294 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802 2023-08-27T11:02:53.295 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-27T11:02:53.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-27T11:02:53.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-27T11:02:53.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-27T11:02:53.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-27T11:02:53.296 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q 2023-08-27T11:02:53.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-27T11:02:53.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p 2023-08-27T11:02:53.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-27T11:02:53.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-27T11:02:53.297 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-27T11:02:53.298 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-27T11:02:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter 2023-08-27T11:02:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-27T11:02:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-27T11:02:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-27T11:02:53.299 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-27T11:02:53.300 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-27T11:02:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-27T11:02:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-27T11:02:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-27T11:02:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-27T11:02:53.301 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-27T11:02:53.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-27T11:02:53.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-27T11:02:53.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-27T11:02:53.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-27T11:02:53.302 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-27T11:02:53.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-27T11:02:53.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-27T11:02:53.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-27T11:02:53.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-27T11:02:53.303 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/failover.ko 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp 2023-08-27T11:02:53.304 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-27T11:02:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-27T11:02:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-27T11:02:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-27T11:02:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver 2023-08-27T11:02:53.305 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver/dns_resolver.ko 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-27T11:02:53.306 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-27T11:02:53.307 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4 2023-08-27T11:02:53.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-27T11:02:53.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-27T11:02:53.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-27T11:02:53.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-27T11:02:53.308 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-27T11:02:53.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-27T11:02:53.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-27T11:02:53.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-27T11:02:53.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-27T11:02:53.309 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-27T11:02:53.310 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-27T11:02:53.311 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-27T11:02:53.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-27T11:02:53.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-27T11:02:53.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-27T11:02:53.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-27T11:02:53.312 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-27T11:02:53.313 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-27T11:02:53.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-27T11:02:53.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-27T11:02:53.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-27T11:02:53.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-27T11:02:53.314 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-27T11:02:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-27T11:02:53.316 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6 2023-08-27T11:02:53.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-27T11:02:53.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-27T11:02:53.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-27T11:02:53.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-27T11:02:53.317 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-27T11:02:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-27T11:02:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-27T11:02:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter 2023-08-27T11:02:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-27T11:02:53.318 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-27T11:02:53.319 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-27T11:02:53.320 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-27T11:02:53.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-27T11:02:53.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-27T11:02:53.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-27T11:02:53.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-27T11:02:53.321 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-27T11:02:53.322 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-27T11:02:53.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-27T11:02:53.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-27T11:02:53.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key 2023-08-27T11:02:53.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-27T11:02:53.323 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-27T11:02:53.324 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-27T11:02:53.325 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls 2023-08-27T11:02:53.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-27T11:02:53.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter 2023-08-27T11:02:53.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset 2023-08-27T11:02:53.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-27T11:02:53.326 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-27T11:02:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-27T11:02:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-27T11:02:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-27T11:02:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-27T11:02:53.327 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-27T11:02:53.328 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-27T11:02:53.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-27T11:02:53.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-27T11:02:53.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-27T11:02:53.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs 2023-08-27T11:02:53.329 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-27T11:02:53.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-27T11:02:53.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-27T11:02:53.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-27T11:02:53.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-27T11:02:53.330 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-27T11:02:53.331 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-27T11:02:53.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-27T11:02:53.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-27T11:02:53.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-27T11:02:53.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-27T11:02:53.332 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-27T11:02:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-27T11:02:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-27T11:02:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-27T11:02:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-27T11:02:53.333 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-27T11:02:53.334 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-27T11:02:53.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-27T11:02:53.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-27T11:02:53.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-27T11:02:53.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-27T11:02:53.335 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-27T11:02:53.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-27T11:02:53.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-27T11:02:53.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-27T11:02:53.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-27T11:02:53.336 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-27T11:02:53.337 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-27T11:02:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-27T11:02:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-27T11:02:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-27T11:02:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-27T11:02:53.338 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-27T11:02:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_quota.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-27T11:02:53.340 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-27T11:02:53.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-27T11:02:53.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-27T11:02:53.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tunnel.ko 2023-08-27T11:02:53.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-27T11:02:53.341 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-27T11:02:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-27T11:02:53.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-27T11:02:53.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-27T11:02:53.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-27T11:02:53.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-27T11:02:53.343 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-27T11:02:53.344 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-27T11:02:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-27T11:02:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-27T11:02:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-27T11:02:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-27T11:02:53.345 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-27T11:02:53.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-27T11:02:53.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-27T11:02:53.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-27T11:02:53.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-27T11:02:53.346 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-27T11:02:53.347 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-27T11:02:53.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-27T11:02:53.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-27T11:02:53.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-27T11:02:53.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-27T11:02:53.348 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-27T11:02:53.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-27T11:02:53.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-27T11:02:53.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-27T11:02:53.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-27T11:02:53.349 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-27T11:02:53.350 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-27T11:02:53.351 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-27T11:02:53.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-27T11:02:53.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-27T11:02:53.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-27T11:02:53.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-27T11:02:53.352 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-27T11:02:53.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-27T11:02:53.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-27T11:02:53.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-27T11:02:53.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-27T11:02:53.353 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink 2023-08-27T11:02:53.354 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-27T11:02:53.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh 2023-08-27T11:02:53.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-27T11:02:53.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch 2023-08-27T11:02:53.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-27T11:02:53.355 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds 2023-08-27T11:02:53.356 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-27T11:02:53.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-27T11:02:53.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-27T11:02:53.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched 2023-08-27T11:02:53.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-27T11:02:53.357 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-27T11:02:53.358 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-27T11:02:53.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-27T11:02:53.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-27T11:02:53.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-27T11:02:53.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-27T11:02:53.359 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-27T11:02:53.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-27T11:02:53.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-27T11:02:53.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-27T11:02:53.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-27T11:02:53.360 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-27T11:02:53.361 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-27T11:02:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-27T11:02:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-27T11:02:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-27T11:02:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-27T11:02:53.362 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-27T11:02:53.363 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-27T11:02:53.364 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-27T11:02:53.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-27T11:02:53.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-27T11:02:53.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-27T11:02:53.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp 2023-08-27T11:02:53.365 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-27T11:02:53.366 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-27T11:02:53.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma 2023-08-27T11:02:53.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-27T11:02:53.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc 2023-08-27T11:02:53.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-27T11:02:53.367 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-27T11:02:53.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix 2023-08-27T11:02:53.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-27T11:02:53.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock 2023-08-27T11:02:53.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-27T11:02:53.368 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-27T11:02:53.369 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security 2023-08-27T11:02:53.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys 2023-08-27T11:02:53.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys 2023-08-27T11:02:53.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-27T11:02:53.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys 2023-08-27T11:02:53.370 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys/trusted.ko 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-27T11:02:53.371 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-27T11:02:53.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-27T11:02:53.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-27T11:02:53.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-27T11:02:53.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-27T11:02:53.372 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-27T11:02:53.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-27T11:02:53.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-27T11:02:53.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-27T11:02:53.373 INFO:teuthology.orchestra.run.smithi043.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-27T11:02:53.374 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-27T11:02:53.374 DEBUG:teuthology.orchestra.run.smithi043:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-27T11:02:53.402 INFO:teuthology.orchestra.run.smithi043.stdout:postinstall scriptlet (using /bin/sh): 2023-08-27T11:02:53.402 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-ga6a696707610 -a -r /boot/System.map-6.5.0-rc7-ga6a696707610 ]; then 2023-08-27T11:02:53.403 INFO:teuthology.orchestra.run.smithi043.stdout:cp /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:02:53.403 INFO:teuthology.orchestra.run.smithi043.stdout:cp /boot/System.map-6.5.0-rc7-ga6a696707610 /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:02:53.403 INFO:teuthology.orchestra.run.smithi043.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-27T11:02:53.403 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/installkernel 6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:02:53.403 INFO:teuthology.orchestra.run.smithi043.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:02:53.404 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2023-08-27T11:02:53.404 INFO:teuthology.orchestra.run.smithi043.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-27T11:02:53.404 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-27T11:02:53.404 INFO:teuthology.orchestra.run.smithi043.stdout:new-kernel-pkg --remove 6.5.0-rc7-ga6a696707610 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-ga6a696707610.img 2023-08-27T11:02:53.404 INFO:teuthology.orchestra.run.smithi043.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-27T11:02:53.405 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-install remove 6.5.0-rc7-ga6a696707610 2023-08-27T11:02:53.405 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2023-08-27T11:02:53.405 INFO:teuthology.orchestra.run.smithi043.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-27T11:02:53.405 INFO:teuthology.orchestra.run.smithi043.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-27T11:02:53.405 INFO:teuthology.orchestra.run.smithi043.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-ga6a696707610 2023-08-27T11:02:53.406 INFO:teuthology.orchestra.run.smithi043.stdout:fi 2023-08-27T11:02:53.406 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2023-08-27T11:02:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2023-08-27T11:02:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2023-08-27T11:02:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.02 2023-08-27T11:02:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 123.el8 2023-08-27T11:02:53.486 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2023-08-27T11:02:53.487 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-27T11:02:53.487 INFO:teuthology.orchestra.run.smithi043.stdout:Group : System Environment/Base 2023-08-27T11:02:53.487 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 9265450 2023-08-27T11:02:53.487 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2023-08-27T11:02:53.487 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-27T11:02:53.488 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-27T11:02:53.488 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-27T11:02:53.488 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-27T11:02:53.488 INFO:teuthology.orchestra.run.smithi043.stdout:Relocations : (not relocatable) 2023-08-27T11:02:53.488 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : Red Hat, Inc. 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : Red Hat, Inc. 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:02:53.489 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-27T11:02:53.490 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-27T11:02:53.490 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-27T11:02:53.490 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2023-08-27T11:02:53.490 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:02:53.490 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2023-08-27T11:02:53.491 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-27T11:02:53.493 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 6.5.0-rc7-ga6a696707610 2023-08-27T11:02:53.493 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-27T11:02:56.287 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2023-08-27T11:02:58.422 INFO:teuthology.orchestra.run.smithi043.stderr:done 2023-08-27T11:02:58.424 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2023-08-27T11:02:58.448 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.kaiuEZk0MF 2023-08-27T11:02:58.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kaiuEZk0MF 2023-08-27T11:02:58.520 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.kaiuEZk0MF 2023-08-27T11:02:58.664 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.kaiuEZk0MF is 6KB 2023-08-27T11:02:58.718 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.kaiuEZk0MF 2023-08-27T11:02:58.738 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2023-08-27T11:02:58.819 INFO:teuthology.orchestra.run.smithi043.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-27T11:02:58.820 INFO:teuthology.orchestra.run.smithi043.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-27T11:02:58.820 INFO:teuthology.orchestra.run.smithi043.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-ga6a696707610.conf 2023-08-27T11:02:58.821 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-ga6a696707610 2023-08-27T11:02:58.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2023-08-27T11:03:03.304 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-6.5.0_rc7_ga6a696707610-1 ######################################## 2023-08-27T11:03:27.703 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-27T11:03:27.703 DEBUG:teuthology.orchestra.run.smithi057:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-27T11:03:27.759 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-27T11:03:27.759 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/config-6.5.0-rc7-ga6a696707610 2023-08-27T11:03:27.759 INFO:teuthology.orchestra.run.smithi057.stdout:/boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-27T11:03:27.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610 2023-08-27T11:03:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel 2023-08-27T11:03:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch 2023-08-27T11:03:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86 2023-08-27T11:03:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto 2023-08-27T11:03:27.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-27T11:03:27.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-27T11:03:27.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-27T11:03:27.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-27T11:03:27.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-27T11:03:27.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-27T11:03:27.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-27T11:03:27.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-27T11:03:27.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-27T11:03:27.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-27T11:03:27.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-27T11:03:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-27T11:03:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-27T11:03:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-27T11:03:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-27T11:03:27.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-27T11:03:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-27T11:03:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-27T11:03:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-27T11:03:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-27T11:03:27.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel 2023-08-27T11:03:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu 2023-08-27T11:03:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce 2023-08-27T11:03:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-27T11:03:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm 2023-08-27T11:03:27.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-27T11:03:27.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-27T11:03:27.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-27T11:03:27.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto 2023-08-27T11:03:27.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-27T11:03:27.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-27T11:03:27.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-27T11:03:27.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx 2023-08-27T11:03:27.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-27T11:03:27.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-27T11:03:27.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-27T11:03:27.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-27T11:03:27.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-27T11:03:27.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-27T11:03:27.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-27T11:03:27.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-27T11:03:27.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-27T11:03:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-27T11:03:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-27T11:03:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-27T11:03:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-27T11:03:27.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-27T11:03:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-27T11:03:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-27T11:03:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-27T11:03:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-27T11:03:27.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-27T11:03:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-27T11:03:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-27T11:03:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-27T11:03:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-27T11:03:27.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-27T11:03:27.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-27T11:03:27.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-27T11:03:27.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-27T11:03:27.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-27T11:03:27.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-27T11:03:27.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-27T11:03:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-27T11:03:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-27T11:03:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-27T11:03:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-27T11:03:27.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/custom_method.ko 2023-08-27T11:03:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-27T11:03:27.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-27T11:03:27.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-27T11:03:27.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-27T11:03:27.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-27T11:03:27.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata 2023-08-27T11:03:27.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-27T11:03:27.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-27T11:03:27.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ata_generic.ko 2023-08-27T11:03:27.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-27T11:03:27.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-27T11:03:27.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-27T11:03:27.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-27T11:03:27.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-27T11:03:27.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-27T11:03:27.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-27T11:03:27.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-27T11:03:27.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-27T11:03:27.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-27T11:03:27.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-27T11:03:27.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-27T11:03:27.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-27T11:03:27.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-27T11:03:27.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-27T11:03:27.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-27T11:03:27.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-27T11:03:27.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-27T11:03:27.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-27T11:03:27.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-27T11:03:27.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-27T11:03:27.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-27T11:03:27.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-27T11:03:27.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-27T11:03:27.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-27T11:03:27.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sis.ko 2023-08-27T11:03:27.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-27T11:03:27.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-27T11:03:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-27T11:03:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-27T11:03:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-27T11:03:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-27T11:03:27.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-27T11:03:27.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-27T11:03:27.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-27T11:03:27.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-27T11:03:27.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-27T11:03:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-27T11:03:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-27T11:03:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-27T11:03:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-27T11:03:27.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-27T11:03:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-27T11:03:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay 2023-08-27T11:03:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-27T11:03:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base 2023-08-27T11:03:27.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap 2023-08-27T11:03:27.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-27T11:03:27.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-27T11:03:27.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma 2023-08-27T11:03:27.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-27T11:03:27.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block 2023-08-27T11:03:27.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe 2023-08-27T11:03:27.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-27T11:03:27.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/brd.ko 2023-08-27T11:03:27.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd 2023-08-27T11:03:27.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/loop.ko 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-27T11:03:27.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk 2023-08-27T11:03:27.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-27T11:03:27.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-27T11:03:27.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-27T11:03:27.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/virtio_blk.ko 2023-08-27T11:03:27.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback 2023-08-27T11:03:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-27T11:03:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkfront.ko 2023-08-27T11:03:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram 2023-08-27T11:03:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-27T11:03:27.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-27T11:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-27T11:03:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-27T11:03:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi 2023-08-27T11:03:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-27T11:03:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-27T11:03:27.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-27T11:03:27.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-27T11:03:27.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-27T11:03:27.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-27T11:03:27.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-27T11:03:27.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave 2023-08-27T11:03:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-27T11:03:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-27T11:03:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-27T11:03:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm 2023-08-27T11:03:27.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm.ko 2023-08-27T11:03:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-27T11:03:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-27T11:03:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-27T11:03:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-27T11:03:27.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/uv_mmtimer.ko 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/virtio_console.ko 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-27T11:03:27.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-27T11:03:27.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-27T11:03:27.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-27T11:03:27.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-27T11:03:27.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto 2023-08-27T11:03:27.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp 2023-08-27T11:03:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-27T11:03:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-27T11:03:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel 2023-08-27T11:03:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat 2023-08-27T11:03:27.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-27T11:03:27.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio 2023-08-27T11:03:27.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-27T11:03:27.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca 2023-08-27T11:03:27.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-27T11:03:27.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq 2023-08-27T11:03:27.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-27T11:03:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma 2023-08-27T11:03:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw 2023-08-27T11:03:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-27T11:03:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat 2023-08-27T11:03:27.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-27T11:03:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac 2023-08-27T11:03:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-27T11:03:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-27T11:03:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-27T11:03:27.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-27T11:03:27.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-27T11:03:27.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-27T11:03:27.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-27T11:03:27.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-27T11:03:27.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware 2023-08-27T11:03:27.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/edd.ko 2023-08-27T11:03:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-27T11:03:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio 2023-08-27T11:03:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-27T11:03:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-27T11:03:27.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid 2023-08-27T11:03:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-27T11:03:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-27T11:03:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-27T11:03:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-27T11:03:27.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-27T11:03:27.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-27T11:03:27.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-27T11:03:27.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-27T11:03:27.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-27T11:03:27.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-27T11:03:27.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-27T11:03:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-27T11:03:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-27T11:03:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-27T11:03:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-27T11:03:27.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-27T11:03:27.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-27T11:03:27.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-27T11:03:27.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-27T11:03:27.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-27T11:03:27.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-27T11:03:27.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-27T11:03:27.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-27T11:03:27.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-27T11:03:27.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-27T11:03:27.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-27T11:03:27.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-27T11:03:27.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-27T11:03:27.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-27T11:03:27.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-27T11:03:27.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-27T11:03:27.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-27T11:03:27.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-27T11:03:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-27T11:03:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-27T11:03:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-27T11:03:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-27T11:03:27.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-27T11:03:27.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-27T11:03:27.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-27T11:03:27.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-27T11:03:27.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-27T11:03:27.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-27T11:03:27.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-27T11:03:27.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv 2023-08-27T11:03:27.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-27T11:03:27.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-27T11:03:27.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-27T11:03:27.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon 2023-08-27T11:03:27.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-27T11:03:27.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-27T11:03:27.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-27T11:03:27.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-27T11:03:27.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-27T11:03:27.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-27T11:03:27.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-27T11:03:27.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-27T11:03:27.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-27T11:03:27.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-27T11:03:27.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-27T11:03:27.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-27T11:03:27.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-27T11:03:27.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-27T11:03:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-27T11:03:27.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-27T11:03:27.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-27T11:03:27.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-27T11:03:27.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-27T11:03:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-27T11:03:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-27T11:03:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-27T11:03:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-27T11:03:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-27T11:03:27.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-27T11:03:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-27T11:03:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-27T11:03:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-27T11:03:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-27T11:03:27.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-27T11:03:27.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-27T11:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-27T11:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-27T11:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-27T11:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-27T11:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-27T11:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-27T11:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-27T11:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-27T11:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-27T11:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-27T11:03:27.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-27T11:03:27.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-27T11:03:27.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-27T11:03:27.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-27T11:03:27.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-27T11:03:27.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-27T11:03:27.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-27T11:03:27.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-27T11:03:27.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-27T11:03:27.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-27T11:03:27.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-27T11:03:27.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-27T11:03:27.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-27T11:03:27.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-27T11:03:27.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-27T11:03:27.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-27T11:03:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-27T11:03:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-27T11:03:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-27T11:03:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-27T11:03:27.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-27T11:03:27.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-27T11:03:27.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus 2023-08-27T11:03:27.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-27T11:03:27.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-27T11:03:27.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-27T11:03:27.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-27T11:03:27.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-27T11:03:27.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-27T11:03:27.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-27T11:03:27.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-27T11:03:27.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-27T11:03:27.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-27T11:03:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-27T11:03:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-27T11:03:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-27T11:03:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-27T11:03:27.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-27T11:03:27.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-27T11:03:27.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-27T11:03:27.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-27T11:03:27.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-27T11:03:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-27T11:03:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-27T11:03:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-27T11:03:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-27T11:03:27.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-27T11:03:27.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-27T11:03:27.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-27T11:03:27.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-27T11:03:27.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-27T11:03:27.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-27T11:03:27.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-27T11:03:27.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-27T11:03:27.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c 2023-08-27T11:03:27.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos 2023-08-27T11:03:27.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-27T11:03:27.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-27T11:03:27.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses 2023-08-27T11:03:27.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-27T11:03:27.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-27T11:03:27.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-27T11:03:27.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-27T11:03:27.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-27T11:03:27.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-27T11:03:27.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-27T11:03:27.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-27T11:03:27.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-27T11:03:27.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-27T11:03:27.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-27T11:03:27.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-27T11:03:27.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-27T11:03:27.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-27T11:03:27.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-27T11:03:27.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-27T11:03:27.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-27T11:03:27.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-27T11:03:27.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-27T11:03:27.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-27T11:03:27.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-27T11:03:27.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-27T11:03:27.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-27T11:03:27.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-dev.ko 2023-08-27T11:03:27.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-27T11:03:27.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-27T11:03:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-27T11:03:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-27T11:03:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband 2023-08-27T11:03:27.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core 2023-08-27T11:03:27.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-27T11:03:27.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-27T11:03:27.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-27T11:03:27.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-27T11:03:27.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-27T11:03:27.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-27T11:03:27.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-27T11:03:27.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw 2023-08-27T11:03:27.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4 2023-08-27T11:03:27.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-27T11:03:27.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4 2023-08-27T11:03:27.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-27T11:03:27.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5 2023-08-27T11:03:27.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-27T11:03:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser 2023-08-27T11:03:27.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-27T11:03:27.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert 2023-08-27T11:03:27.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-27T11:03:27.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp 2023-08-27T11:03:27.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-27T11:03:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt 2023-08-27T11:03:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-27T11:03:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input 2023-08-27T11:03:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport 2023-08-27T11:03:27.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-27T11:03:27.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard 2023-08-27T11:03:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-27T11:03:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse 2023-08-27T11:03:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-27T11:03:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-27T11:03:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-27T11:03:27.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-27T11:03:27.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-27T11:03:27.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-27T11:03:27.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-27T11:03:27.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-27T11:03:27.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-27T11:03:27.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-27T11:03:27.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-27T11:03:27.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu 2023-08-27T11:03:27.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd 2023-08-27T11:03:27.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-27T11:03:27.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds 2023-08-27T11:03:27.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-27T11:03:27.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-27T11:03:27.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-27T11:03:27.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-27T11:03:27.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger 2023-08-27T11:03:27.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-27T11:03:27.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-27T11:03:27.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-27T11:03:27.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md 2023-08-27T11:03:27.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache 2023-08-27T11:03:27.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-27T11:03:27.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-27T11:03:27.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-27T11:03:27.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-27T11:03:27.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-27T11:03:27.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-27T11:03:27.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-27T11:03:27.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-27T11:03:27.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-27T11:03:27.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-27T11:03:27.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-27T11:03:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-27T11:03:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-27T11:03:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-27T11:03:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data 2023-08-27T11:03:27.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-27T11:03:27.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-27T11:03:27.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-27T11:03:27.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-27T11:03:27.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-27T11:03:27.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message 2023-08-27T11:03:27.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion 2023-08-27T11:03:27.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-27T11:03:27.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-27T11:03:27.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-27T11:03:27.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-27T11:03:27.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-27T11:03:27.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-27T11:03:27.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-27T11:03:27.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd 2023-08-27T11:03:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-27T11:03:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-27T11:03:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mfd-core.ko 2023-08-27T11:03:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-27T11:03:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-27T11:03:27.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-27T11:03:27.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-27T11:03:27.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc 2023-08-27T11:03:27.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl 2023-08-27T11:03:27.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-27T11:03:27.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-27T11:03:27.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-27T11:03:27.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-27T11:03:27.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710 2023-08-27T11:03:27.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-27T11:03:27.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom 2023-08-27T11:03:27.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-27T11:03:27.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-27T11:03:27.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-27T11:03:27.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-27T11:03:27.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-27T11:03:27.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-27T11:03:27.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-27T11:03:27.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-27T11:03:27.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d 2023-08-27T11:03:27.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-27T11:03:27.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-27T11:03:27.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei 2023-08-27T11:03:27.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-27T11:03:27.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-27T11:03:27.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-27T11:03:27.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru 2023-08-27T11:03:27.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-27T11:03:27.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp 2023-08-27T11:03:27.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-27T11:03:27.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-27T11:03:27.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-27T11:03:27.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-27T11:03:27.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net 2023-08-27T11:03:27.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding 2023-08-27T11:03:27.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-27T11:03:27.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa 2023-08-27T11:03:27.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53 2023-08-27T11:03:27.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-27T11:03:27.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-27T11:03:27.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-27T11:03:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx 2023-08-27T11:03:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-27T11:03:27.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-27T11:03:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-27T11:03:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet 2023-08-27T11:03:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com 2023-08-27T11:03:27.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-27T11:03:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-27T11:03:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-27T11:03:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-27T11:03:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390 2023-08-27T11:03:27.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-27T11:03:27.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-27T11:03:27.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-27T11:03:27.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-27T11:03:27.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec 2023-08-27T11:03:27.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-27T11:03:27.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere 2023-08-27T11:03:27.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-27T11:03:27.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon 2023-08-27T11:03:27.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-27T11:03:27.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera 2023-08-27T11:03:27.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-27T11:03:27.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd 2023-08-27T11:03:27.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-27T11:03:27.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-27T11:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-27T11:03:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-27T11:03:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-27T11:03:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx 2023-08-27T11:03:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-27T11:03:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-27T11:03:27.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom 2023-08-27T11:03:27.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-27T11:03:27.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-27T11:03:27.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-27T11:03:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-27T11:03:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-27T11:03:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet 2023-08-27T11:03:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-27T11:03:27.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-27T11:03:27.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade 2023-08-27T11:03:27.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna 2023-08-27T11:03:27.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-27T11:03:27.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio 2023-08-27T11:03:27.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-27T11:03:27.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-27T11:03:27.905 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-27T11:03:27.905 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-27T11:03:27.905 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-27T11:03:27.905 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco 2023-08-27T11:03:27.905 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic 2023-08-27T11:03:27.906 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-27T11:03:27.906 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec 2023-08-27T11:03:27.906 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip 2023-08-27T11:03:27.906 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-27T11:03:27.906 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-27T11:03:27.907 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-27T11:03:27.907 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-27T11:03:27.907 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-27T11:03:27.907 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-27T11:03:27.907 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink 2023-08-27T11:03:27.908 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-27T11:03:27.908 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-27T11:03:27.908 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-27T11:03:27.908 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex 2023-08-27T11:03:27.908 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet 2023-08-27T11:03:27.909 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-27T11:03:27.909 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-27T11:03:27.909 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-27T11:03:27.909 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel 2023-08-27T11:03:27.909 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-27T11:03:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000 2023-08-27T11:03:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-27T11:03:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e 2023-08-27T11:03:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-27T11:03:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k 2023-08-27T11:03:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-27T11:03:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e 2023-08-27T11:03:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-27T11:03:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf 2023-08-27T11:03:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-27T11:03:27.912 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb 2023-08-27T11:03:27.912 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-27T11:03:27.912 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf 2023-08-27T11:03:27.912 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-27T11:03:27.913 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-27T11:03:27.913 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-27T11:03:27.913 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-27T11:03:27.913 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-27T11:03:27.913 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-27T11:03:27.914 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell 2023-08-27T11:03:27.914 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-27T11:03:27.914 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-27T11:03:27.914 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-27T11:03:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox 2023-08-27T11:03:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-27T11:03:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-27T11:03:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-27T11:03:27.915 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-27T11:03:27.916 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-27T11:03:27.916 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-27T11:03:27.916 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel 2023-08-27T11:03:27.916 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-27T11:03:27.917 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom 2023-08-27T11:03:27.917 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-27T11:03:27.917 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-27T11:03:27.917 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi 2023-08-27T11:03:27.917 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-27T11:03:27.918 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-27T11:03:27.918 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion 2023-08-27T11:03:27.918 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-27T11:03:27.918 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia 2023-08-27T11:03:27.919 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-27T11:03:27.919 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines 2023-08-27T11:03:27.919 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-27T11:03:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-27T11:03:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic 2023-08-27T11:03:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-27T11:03:27.920 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-27T11:03:27.921 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-27T11:03:27.921 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-27T11:03:27.921 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-27T11:03:27.921 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc 2023-08-27T11:03:27.922 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-27T11:03:27.922 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek 2023-08-27T11:03:27.922 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-27T11:03:27.922 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-27T11:03:27.923 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-27T11:03:27.923 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-27T11:03:27.923 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker 2023-08-27T11:03:27.923 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-27T11:03:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc 2023-08-27T11:03:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-27T11:03:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan 2023-08-27T11:03:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-27T11:03:27.925 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis 2023-08-27T11:03:27.925 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-27T11:03:27.925 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-27T11:03:27.925 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc 2023-08-27T11:03:27.926 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-27T11:03:27.926 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-27T11:03:27.926 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-27T11:03:27.927 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-27T11:03:27.927 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro 2023-08-27T11:03:27.927 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-27T11:03:27.927 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-27T11:03:27.927 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-27T11:03:27.928 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun 2023-08-27T11:03:27.928 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-27T11:03:27.928 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-27T11:03:27.928 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-27T11:03:27.928 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-27T11:03:27.929 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti 2023-08-27T11:03:27.929 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-27T11:03:27.929 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti 2023-08-27T11:03:27.929 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-27T11:03:27.930 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via 2023-08-27T11:03:27.930 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-27T11:03:27.930 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-27T11:03:27.930 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet 2023-08-27T11:03:27.930 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-27T11:03:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-27T11:03:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom 2023-08-27T11:03:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-27T11:03:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-27T11:03:27.931 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv 2023-08-27T11:03:27.932 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-27T11:03:27.932 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154 2023-08-27T11:03:27.932 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-27T11:03:27.932 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-27T11:03:27.932 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan 2023-08-27T11:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-27T11:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-27T11:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-27T11:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio 2023-08-27T11:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-27T11:03:27.934 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-27T11:03:27.934 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-27T11:03:27.934 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-27T11:03:27.934 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-27T11:03:27.934 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/net_failover.ko 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-27T11:03:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy 2023-08-27T11:03:27.936 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-27T11:03:27.936 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-27T11:03:27.936 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-27T11:03:27.936 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/dp83640.ko 2023-08-27T11:03:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-27T11:03:27.938 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-27T11:03:27.938 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-27T11:03:27.938 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-27T11:03:27.938 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-27T11:03:27.938 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-27T11:03:27.939 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-27T11:03:27.939 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-27T11:03:27.939 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-27T11:03:27.939 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-27T11:03:27.939 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-27T11:03:27.940 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-27T11:03:27.941 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-27T11:03:27.941 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-27T11:03:27.941 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-27T11:03:27.941 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-27T11:03:27.941 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-27T11:03:27.942 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip 2023-08-27T11:03:27.942 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slhc.ko 2023-08-27T11:03:27.942 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-27T11:03:27.942 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-27T11:03:27.942 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-27T11:03:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team 2023-08-27T11:03:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-27T11:03:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-27T11:03:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-27T11:03:27.943 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-27T11:03:27.944 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-27T11:03:27.944 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-27T11:03:27.944 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tun.ko 2023-08-27T11:03:27.944 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-27T11:03:27.944 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/virtio_net.ko 2023-08-27T11:03:27.945 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3 2023-08-27T11:03:27.945 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-27T11:03:27.945 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan 2023-08-27T11:03:27.945 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-27T11:03:27.945 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback 2023-08-27T11:03:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-27T11:03:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netfront.ko 2023-08-27T11:03:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb 2023-08-27T11:03:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-27T11:03:27.946 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme 2023-08-27T11:03:27.947 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host 2023-08-27T11:03:27.947 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-27T11:03:27.947 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-27T11:03:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport 2023-08-27T11:03:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-27T11:03:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-27T11:03:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-27T11:03:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-27T11:03:27.949 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci 2023-08-27T11:03:27.949 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug 2023-08-27T11:03:27.949 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-27T11:03:27.949 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie 2023-08-27T11:03:27.950 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-27T11:03:27.950 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-27T11:03:27.950 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia 2023-08-27T11:03:27.950 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-27T11:03:27.950 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-27T11:03:27.951 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-27T11:03:27.951 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl 2023-08-27T11:03:27.951 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel 2023-08-27T11:03:27.951 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-27T11:03:27.952 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform 2023-08-27T11:03:27.952 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86 2023-08-27T11:03:27.952 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-27T11:03:27.952 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-27T11:03:27.953 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-27T11:03:27.953 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-27T11:03:27.953 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-27T11:03:27.953 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-27T11:03:27.954 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-27T11:03:27.954 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-27T11:03:27.954 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-27T11:03:27.954 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-27T11:03:27.955 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-27T11:03:27.955 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-27T11:03:27.955 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel 2023-08-27T11:03:27.955 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-27T11:03:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-27T11:03:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-27T11:03:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-27T11:03:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-27T11:03:27.957 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-27T11:03:27.957 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-27T11:03:27.957 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-27T11:03:27.957 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-27T11:03:27.958 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-27T11:03:27.958 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-27T11:03:27.958 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-27T11:03:27.958 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap 2023-08-27T11:03:27.959 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-27T11:03:27.959 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-27T11:03:27.959 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps 2023-08-27T11:03:27.959 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients 2023-08-27T11:03:27.960 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-27T11:03:27.960 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-27T11:03:27.960 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-27T11:03:27.960 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-27T11:03:27.961 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp 2023-08-27T11:03:27.961 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-27T11:03:27.961 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-27T11:03:27.961 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc 2023-08-27T11:03:27.962 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-27T11:03:27.962 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-27T11:03:27.962 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-27T11:03:27.962 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-27T11:03:27.962 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-27T11:03:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-27T11:03:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-27T11:03:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-27T11:03:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-27T11:03:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-27T11:03:27.964 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-27T11:03:27.964 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-27T11:03:27.964 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-27T11:03:27.964 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-27T11:03:27.964 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-27T11:03:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-27T11:03:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-27T11:03:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-27T11:03:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-27T11:03:27.965 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-27T11:03:27.966 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-27T11:03:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-27T11:03:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-27T11:03:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-27T11:03:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-27T11:03:27.967 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-27T11:03:27.968 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-27T11:03:27.968 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi 2023-08-27T11:03:27.968 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-27T11:03:27.968 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-27T11:03:27.968 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-27T11:03:27.969 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-27T11:03:27.969 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-27T11:03:27.969 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid 2023-08-27T11:03:27.969 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-27T11:03:27.969 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr 2023-08-27T11:03:27.970 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-27T11:03:27.971 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-27T11:03:27.971 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi 2023-08-27T11:03:27.971 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-27T11:03:27.971 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa 2023-08-27T11:03:27.971 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-27T11:03:27.972 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc 2023-08-27T11:03:27.972 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-27T11:03:27.972 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i 2023-08-27T11:03:27.972 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-27T11:03:27.972 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-27T11:03:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor 2023-08-27T11:03:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-27T11:03:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi 2023-08-27T11:03:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-27T11:03:27.973 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-27T11:03:27.974 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-27T11:03:27.974 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-27T11:03:27.974 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-27T11:03:27.974 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-27T11:03:27.974 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-27T11:03:27.975 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r 2023-08-27T11:03:27.976 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-27T11:03:27.976 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-27T11:03:27.976 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe 2023-08-27T11:03:27.976 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-27T11:03:27.976 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-27T11:03:27.977 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic 2023-08-27T11:03:27.977 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-27T11:03:27.977 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-27T11:03:27.977 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-27T11:03:27.977 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-27T11:03:27.978 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-27T11:03:27.979 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-27T11:03:27.979 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc 2023-08-27T11:03:27.979 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-27T11:03:27.979 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-27T11:03:27.980 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid 2023-08-27T11:03:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-27T11:03:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-27T11:03:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-27T11:03:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-27T11:03:27.981 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas 2023-08-27T11:03:27.982 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-27T11:03:27.982 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas 2023-08-27T11:03:27.982 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-27T11:03:27.982 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-27T11:03:27.982 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001 2023-08-27T11:03:27.983 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-27T11:03:27.983 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-27T11:03:27.983 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-27T11:03:27.983 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx 2023-08-27T11:03:27.984 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-27T11:03:27.984 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-27T11:03:27.984 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx 2023-08-27T11:03:27.984 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-27T11:03:27.984 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-27T11:03:27.985 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-27T11:03:27.985 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-27T11:03:27.985 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-27T11:03:27.985 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-27T11:03:27.986 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-27T11:03:27.986 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-27T11:03:27.986 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-27T11:03:27.986 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-27T11:03:27.987 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-27T11:03:27.987 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2 2023-08-27T11:03:27.987 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-27T11:03:27.987 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-27T11:03:27.988 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-27T11:03:27.988 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-27T11:03:27.988 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb 2023-08-27T11:03:27.988 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-27T11:03:27.989 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target 2023-08-27T11:03:27.989 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi 2023-08-27T11:03:27.989 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-27T11:03:27.989 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback 2023-08-27T11:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-27T11:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-27T11:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-27T11:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-27T11:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-27T11:03:27.991 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-27T11:03:27.991 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc 2023-08-27T11:03:27.991 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-27T11:03:27.991 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal 2023-08-27T11:03:27.992 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel 2023-08-27T11:03:27.992 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal 2023-08-27T11:03:27.992 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-27T11:03:27.992 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-27T11:03:27.993 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-27T11:03:27.993 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-27T11:03:27.993 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-27T11:03:27.994 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-27T11:03:27.994 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-27T11:03:27.994 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-27T11:03:27.994 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-27T11:03:27.995 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-27T11:03:27.995 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-27T11:03:27.995 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-27T11:03:27.995 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-27T11:03:27.996 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-27T11:03:27.996 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-27T11:03:27.996 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty 2023-08-27T11:03:27.996 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless 2023-08-27T11:03:27.997 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-27T11:03:27.997 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-27T11:03:27.997 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-27T11:03:27.997 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-27T11:03:27.998 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial 2023-08-27T11:03:27.998 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250 2023-08-27T11:03:27.998 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-27T11:03:27.998 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-27T11:03:27.998 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm 2023-08-27T11:03:27.999 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-27T11:03:27.999 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-27T11:03:27.999 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs 2023-08-27T11:03:27.999 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core 2023-08-27T11:03:27.999 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-27T11:03:28.000 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-27T11:03:28.001 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-27T11:03:28.001 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-27T11:03:28.001 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb 2023-08-27T11:03:28.001 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class 2023-08-27T11:03:28.001 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-27T11:03:28.002 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-27T11:03:28.002 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-27T11:03:28.002 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-27T11:03:28.002 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host 2023-08-27T11:03:28.002 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-27T11:03:28.003 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image 2023-08-27T11:03:28.003 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-27T11:03:28.003 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-27T11:03:28.003 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc 2023-08-27T11:03:28.003 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-27T11:03:28.004 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-27T11:03:28.005 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-27T11:03:28.005 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-27T11:03:28.005 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-27T11:03:28.005 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga 2023-08-27T11:03:28.005 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-27T11:03:28.006 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-27T11:03:28.006 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-27T11:03:28.006 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-27T11:03:28.006 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-27T11:03:28.006 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-27T11:03:28.007 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-27T11:03:28.007 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy 2023-08-27T11:03:28.007 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-27T11:03:28.007 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial 2023-08-27T11:03:28.007 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-27T11:03:28.008 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-27T11:03:28.008 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-27T11:03:28.008 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-27T11:03:28.008 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-27T11:03:28.008 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-27T11:03:28.009 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-27T11:03:28.009 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-27T11:03:28.009 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-27T11:03:28.009 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-27T11:03:28.009 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-27T11:03:28.010 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-27T11:03:28.010 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-27T11:03:28.010 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-27T11:03:28.010 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-27T11:03:28.010 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-27T11:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-27T11:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-27T11:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-27T11:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-27T11:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-27T11:03:28.012 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-27T11:03:28.012 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-27T11:03:28.012 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-27T11:03:28.012 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-27T11:03:28.012 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-27T11:03:28.013 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-27T11:03:28.013 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-27T11:03:28.013 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-27T11:03:28.013 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-27T11:03:28.013 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-27T11:03:28.014 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-27T11:03:28.014 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-27T11:03:28.014 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-27T11:03:28.014 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-27T11:03:28.014 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-27T11:03:28.015 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-27T11:03:28.015 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-27T11:03:28.015 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-27T11:03:28.015 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-27T11:03:28.015 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-27T11:03:28.016 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-27T11:03:28.016 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-27T11:03:28.016 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-27T11:03:28.016 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-27T11:03:28.017 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage 2023-08-27T11:03:28.017 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-27T11:03:28.017 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-27T11:03:28.017 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-27T11:03:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-27T11:03:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-27T11:03:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-27T11:03:28.018 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-27T11:03:28.019 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-27T11:03:28.019 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-27T11:03:28.019 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-27T11:03:28.019 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-27T11:03:28.020 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-27T11:03:28.020 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-27T11:03:28.020 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-27T11:03:28.020 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-27T11:03:28.021 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip 2023-08-27T11:03:28.021 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-27T11:03:28.021 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-27T11:03:28.022 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-27T11:03:28.022 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio 2023-08-27T11:03:28.022 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci 2023-08-27T11:03:28.022 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-27T11:03:28.022 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-27T11:03:28.023 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-27T11:03:28.023 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-27T11:03:28.023 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost 2023-08-27T11:03:28.023 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-27T11:03:28.024 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-27T11:03:28.024 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-27T11:03:28.024 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-27T11:03:28.024 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video 2023-08-27T11:03:28.025 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight 2023-08-27T11:03:28.025 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-27T11:03:28.025 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-27T11:03:28.025 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-27T11:03:28.026 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio 2023-08-27T11:03:28.026 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio.ko 2023-08-27T11:03:28.026 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_balloon.ko 2023-08-27T11:03:28.026 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_mmio.ko 2023-08-27T11:03:28.027 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci.ko 2023-08-27T11:03:28.027 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-27T11:03:28.027 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-27T11:03:28.027 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/virtio/virtio_ring.ko 2023-08-27T11:03:28.028 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1 2023-08-27T11:03:28.028 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters 2023-08-27T11:03:28.028 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-27T11:03:28.028 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-27T11:03:28.029 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves 2023-08-27T11:03:28.029 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-27T11:03:28.029 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-27T11:03:28.030 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-27T11:03:28.030 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-27T11:03:28.030 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-27T11:03:28.030 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-27T11:03:28.031 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-27T11:03:28.031 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-27T11:03:28.031 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-27T11:03:28.031 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-27T11:03:28.031 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-27T11:03:28.032 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-27T11:03:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-27T11:03:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-27T11:03:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-27T11:03:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-27T11:03:28.033 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-27T11:03:28.034 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-27T11:03:28.034 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-27T11:03:28.034 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-27T11:03:28.034 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-27T11:03:28.034 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-27T11:03:28.035 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-27T11:03:28.035 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-27T11:03:28.035 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-27T11:03:28.035 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-27T11:03:28.035 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-27T11:03:28.036 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-27T11:03:28.036 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-27T11:03:28.036 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-27T11:03:28.036 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-27T11:03:28.036 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-27T11:03:28.037 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-27T11:03:28.037 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-27T11:03:28.037 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen 2023-08-27T11:03:28.037 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-27T11:03:28.037 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-27T11:03:28.038 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs 2023-08-27T11:03:28.039 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-27T11:03:28.039 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs 2023-08-27T11:03:28.039 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p 2023-08-27T11:03:28.039 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-27T11:03:28.040 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs 2023-08-27T11:03:28.040 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-27T11:03:28.040 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs 2023-08-27T11:03:28.040 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-27T11:03:28.040 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph 2023-08-27T11:03:28.041 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-27T11:03:28.042 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda 2023-08-27T11:03:28.042 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-27T11:03:28.042 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs 2023-08-27T11:03:28.042 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-27T11:03:28.042 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm 2023-08-27T11:03:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-27T11:03:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs 2023-08-27T11:03:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-27T11:03:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs 2023-08-27T11:03:28.043 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-27T11:03:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat 2023-08-27T11:03:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/fat.ko 2023-08-27T11:03:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-27T11:03:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/vfat.ko 2023-08-27T11:03:28.044 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache 2023-08-27T11:03:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-27T11:03:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse 2023-08-27T11:03:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-27T11:03:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/fuse.ko 2023-08-27T11:03:28.045 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2 2023-08-27T11:03:28.046 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-27T11:03:28.046 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs 2023-08-27T11:03:28.046 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-27T11:03:28.046 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus 2023-08-27T11:03:28.046 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd 2023-08-27T11:03:28.047 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-27T11:03:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix 2023-08-27T11:03:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-27T11:03:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs 2023-08-27T11:03:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-27T11:03:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs 2023-08-27T11:03:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout 2023-08-27T11:03:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-27T11:03:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout 2023-08-27T11:03:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-27T11:03:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout 2023-08-27T11:03:28.050 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-27T11:03:28.050 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-27T11:03:28.050 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-27T11:03:28.050 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-27T11:03:28.051 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common 2023-08-27T11:03:28.051 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-27T11:03:28.051 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-27T11:03:28.051 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd 2023-08-27T11:03:28.051 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-27T11:03:28.052 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-27T11:03:28.053 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-27T11:03:28.053 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-27T11:03:28.053 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-27T11:03:28.053 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-27T11:03:28.054 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-27T11:03:28.055 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-27T11:03:28.055 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-27T11:03:28.055 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-27T11:03:28.055 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-27T11:03:28.056 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-27T11:03:28.056 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-27T11:03:28.056 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-27T11:03:28.056 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-27T11:03:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-27T11:03:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-27T11:03:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-27T11:03:28.057 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-27T11:03:28.058 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-27T11:03:28.058 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-27T11:03:28.058 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-27T11:03:28.058 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-27T11:03:28.058 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-27T11:03:28.059 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-27T11:03:28.059 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-27T11:03:28.059 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-27T11:03:28.060 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-27T11:03:28.060 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-27T11:03:28.060 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-27T11:03:28.060 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-27T11:03:28.061 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-27T11:03:28.061 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-27T11:03:28.061 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-27T11:03:28.061 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-27T11:03:28.062 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-27T11:03:28.062 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-27T11:03:28.062 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-27T11:03:28.062 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-27T11:03:28.063 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-27T11:03:28.063 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-27T11:03:28.063 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-27T11:03:28.064 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-27T11:03:28.064 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2 2023-08-27T11:03:28.064 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster 2023-08-27T11:03:28.064 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-27T11:03:28.065 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm 2023-08-27T11:03:28.065 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-27T11:03:28.065 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs 2023-08-27T11:03:28.065 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-27T11:03:28.066 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-27T11:03:28.066 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-27T11:03:28.066 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-27T11:03:28.066 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-27T11:03:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs 2023-08-27T11:03:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-27T11:03:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore 2023-08-27T11:03:28.067 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-27T11:03:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs 2023-08-27T11:03:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-27T11:03:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs 2023-08-27T11:03:28.068 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-27T11:03:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb 2023-08-27T11:03:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client 2023-08-27T11:03:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-27T11:03:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common 2023-08-27T11:03:28.069 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-27T11:03:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-27T11:03:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs 2023-08-27T11:03:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-27T11:03:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv 2023-08-27T11:03:28.070 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs 2023-08-27T11:03:28.071 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-27T11:03:28.072 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel 2023-08-27T11:03:28.072 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu 2023-08-27T11:03:28.072 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/rcu/rcutorture.ko 2023-08-27T11:03:28.072 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-27T11:03:28.072 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace 2023-08-27T11:03:28.073 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-27T11:03:28.073 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib 2023-08-27T11:03:28.073 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/asn1_encoder.ko 2023-08-27T11:03:28.073 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-27T11:03:28.073 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-27T11:03:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4 2023-08-27T11:03:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-27T11:03:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-27T11:03:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math 2023-08-27T11:03:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-27T11:03:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-27T11:03:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-27T11:03:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd 2023-08-27T11:03:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/zstd/zstd_compress.ko 2023-08-27T11:03:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm 2023-08-27T11:03:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-27T11:03:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net 2023-08-27T11:03:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan 2023-08-27T11:03:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-27T11:03:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-27T11:03:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-27T11:03:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-27T11:03:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-27T11:03:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-27T11:03:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-27T11:03:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-27T11:03:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-27T11:03:28.080 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q 2023-08-27T11:03:28.081 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-27T11:03:28.081 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p 2023-08-27T11:03:28.081 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-27T11:03:28.081 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-27T11:03:28.081 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-27T11:03:28.082 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-27T11:03:28.082 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv 2023-08-27T11:03:28.082 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-27T11:03:28.082 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge 2023-08-27T11:03:28.082 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-27T11:03:28.083 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-27T11:03:28.084 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-27T11:03:28.084 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-27T11:03:28.084 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-27T11:03:28.084 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-27T11:03:28.084 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-27T11:03:28.085 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-27T11:03:28.085 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-27T11:03:28.085 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-27T11:03:28.085 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-27T11:03:28.086 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-27T11:03:28.086 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-27T11:03:28.086 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-27T11:03:28.086 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-27T11:03:28.087 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-27T11:03:28.087 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-27T11:03:28.087 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-27T11:03:28.087 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-27T11:03:28.087 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-27T11:03:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-27T11:03:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-27T11:03:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph 2023-08-27T11:03:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-27T11:03:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core 2023-08-27T11:03:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/failover.ko 2023-08-27T11:03:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-27T11:03:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp 2023-08-27T11:03:28.090 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-27T11:03:28.090 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-27T11:03:28.090 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-27T11:03:28.090 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-27T11:03:28.091 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver 2023-08-27T11:03:28.091 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dns_resolver/dns_resolver.ko 2023-08-27T11:03:28.091 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa 2023-08-27T11:03:28.091 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-27T11:03:28.092 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-27T11:03:28.092 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-27T11:03:28.092 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-27T11:03:28.092 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-27T11:03:28.093 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154 2023-08-27T11:03:28.093 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan 2023-08-27T11:03:28.093 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-27T11:03:28.093 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-27T11:03:28.094 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-27T11:03:28.094 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4 2023-08-27T11:03:28.094 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-27T11:03:28.094 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-27T11:03:28.095 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-27T11:03:28.095 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-27T11:03:28.095 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-27T11:03:28.095 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-27T11:03:28.096 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-27T11:03:28.096 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-27T11:03:28.096 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-27T11:03:28.096 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-27T11:03:28.097 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter 2023-08-27T11:03:28.097 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-27T11:03:28.097 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-27T11:03:28.097 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-27T11:03:28.098 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-27T11:03:28.098 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-27T11:03:28.098 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-27T11:03:28.098 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-27T11:03:28.099 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-27T11:03:28.099 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-27T11:03:28.099 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-27T11:03:28.099 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-27T11:03:28.100 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-27T11:03:28.100 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-27T11:03:28.100 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-27T11:03:28.100 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-27T11:03:28.101 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-27T11:03:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-27T11:03:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-27T11:03:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-27T11:03:28.104 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-27T11:03:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-27T11:03:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-27T11:03:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-27T11:03:28.105 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-27T11:03:28.106 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-27T11:03:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-27T11:03:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-27T11:03:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-27T11:03:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-27T11:03:28.107 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-27T11:03:28.108 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-27T11:03:28.109 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-27T11:03:28.109 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-27T11:03:28.109 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-27T11:03:28.109 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-27T11:03:28.109 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-27T11:03:28.110 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter 2023-08-27T11:03:28.110 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-27T11:03:28.110 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-27T11:03:28.110 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-27T11:03:28.110 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-27T11:03:28.111 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-27T11:03:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-27T11:03:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-27T11:03:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-27T11:03:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-27T11:03:28.112 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-27T11:03:28.113 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-27T11:03:28.113 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-27T11:03:28.113 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-27T11:03:28.113 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-27T11:03:28.113 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-27T11:03:28.114 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-27T11:03:28.115 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-27T11:03:28.115 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key 2023-08-27T11:03:28.115 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-27T11:03:28.115 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp 2023-08-27T11:03:28.115 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-27T11:03:28.116 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-27T11:03:28.117 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc 2023-08-27T11:03:28.117 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-27T11:03:28.117 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154 2023-08-27T11:03:28.117 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-27T11:03:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls 2023-08-27T11:03:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-27T11:03:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter 2023-08-27T11:03:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset 2023-08-27T11:03:28.118 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-27T11:03:28.119 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-27T11:03:28.119 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-27T11:03:28.119 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-27T11:03:28.119 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-27T11:03:28.119 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-27T11:03:28.120 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-27T11:03:28.120 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-27T11:03:28.120 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-27T11:03:28.120 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-27T11:03:28.121 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-27T11:03:28.121 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-27T11:03:28.121 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-27T11:03:28.121 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-27T11:03:28.121 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-27T11:03:28.122 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-27T11:03:28.122 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs 2023-08-27T11:03:28.122 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-27T11:03:28.122 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-27T11:03:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-27T11:03:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-27T11:03:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-27T11:03:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-27T11:03:28.123 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-27T11:03:28.124 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-27T11:03:28.124 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-27T11:03:28.124 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-27T11:03:28.124 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-27T11:03:28.125 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-27T11:03:28.125 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-27T11:03:28.125 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-27T11:03:28.125 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-27T11:03:28.126 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-27T11:03:28.126 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-27T11:03:28.126 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-27T11:03:28.126 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-27T11:03:28.126 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-27T11:03:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-27T11:03:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-27T11:03:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-27T11:03:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-27T11:03:28.127 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-27T11:03:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-27T11:03:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-27T11:03:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-27T11:03:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-27T11:03:28.128 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-27T11:03:28.129 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-27T11:03:28.129 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-27T11:03:28.129 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-27T11:03:28.129 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-27T11:03:28.130 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-27T11:03:28.130 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-27T11:03:28.130 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-27T11:03:28.130 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-27T11:03:28.131 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-27T11:03:28.131 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-27T11:03:28.131 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-27T11:03:28.132 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-27T11:03:28.132 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-27T11:03:28.132 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-27T11:03:28.132 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-27T11:03:28.133 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-27T11:03:28.133 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-27T11:03:28.133 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-27T11:03:28.133 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-27T11:03:28.134 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-27T11:03:28.134 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-27T11:03:28.134 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-27T11:03:28.134 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-27T11:03:28.135 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-27T11:03:28.135 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-27T11:03:28.135 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-27T11:03:28.135 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-27T11:03:28.136 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-27T11:03:28.136 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_quota.ko 2023-08-27T11:03:28.136 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-27T11:03:28.136 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-27T11:03:28.137 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-27T11:03:28.137 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-27T11:03:28.137 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tunnel.ko 2023-08-27T11:03:28.137 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-27T11:03:28.137 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-27T11:03:28.138 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-27T11:03:28.139 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-27T11:03:28.139 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-27T11:03:28.139 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-27T11:03:28.139 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-27T11:03:28.139 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-27T11:03:28.140 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-27T11:03:28.141 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-27T11:03:28.141 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-27T11:03:28.141 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-27T11:03:28.141 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-27T11:03:28.141 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-27T11:03:28.142 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-27T11:03:28.142 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-27T11:03:28.142 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-27T11:03:28.142 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-27T11:03:28.142 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-27T11:03:28.143 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-27T11:03:28.143 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-27T11:03:28.143 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-27T11:03:28.143 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-27T11:03:28.143 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-27T11:03:28.144 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-27T11:03:28.145 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-27T11:03:28.145 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-27T11:03:28.145 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-27T11:03:28.145 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-27T11:03:28.145 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-27T11:03:28.146 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-27T11:03:28.146 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-27T11:03:28.146 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-27T11:03:28.146 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-27T11:03:28.146 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-27T11:03:28.147 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-27T11:03:28.147 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-27T11:03:28.147 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-27T11:03:28.147 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-27T11:03:28.148 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-27T11:03:28.149 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-27T11:03:28.149 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-27T11:03:28.149 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-27T11:03:28.149 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-27T11:03:28.150 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-27T11:03:28.150 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-27T11:03:28.150 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-27T11:03:28.150 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-27T11:03:28.150 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-27T11:03:28.151 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-27T11:03:28.151 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-27T11:03:28.151 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink 2023-08-27T11:03:28.151 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-27T11:03:28.151 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-27T11:03:28.152 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-27T11:03:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet 2023-08-27T11:03:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-27T11:03:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds 2023-08-27T11:03:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-27T11:03:28.153 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-27T11:03:28.154 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-27T11:03:28.154 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched 2023-08-27T11:03:28.154 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-27T11:03:28.154 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-27T11:03:28.154 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-27T11:03:28.155 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-27T11:03:28.155 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-27T11:03:28.155 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-27T11:03:28.155 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-27T11:03:28.155 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-27T11:03:28.156 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-27T11:03:28.156 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-27T11:03:28.156 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-27T11:03:28.156 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-27T11:03:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-27T11:03:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-27T11:03:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-27T11:03:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-27T11:03:28.157 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-27T11:03:28.158 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-27T11:03:28.158 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-27T11:03:28.158 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-27T11:03:28.158 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-27T11:03:28.158 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-27T11:03:28.159 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-27T11:03:28.159 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-27T11:03:28.159 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-27T11:03:28.159 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-27T11:03:28.160 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-27T11:03:28.160 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-27T11:03:28.160 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-27T11:03:28.160 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-27T11:03:28.161 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-27T11:03:28.161 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-27T11:03:28.161 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-27T11:03:28.161 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-27T11:03:28.162 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-27T11:03:28.162 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-27T11:03:28.162 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-27T11:03:28.162 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-27T11:03:28.163 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-27T11:03:28.163 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-27T11:03:28.163 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-27T11:03:28.163 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-27T11:03:28.164 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-27T11:03:28.164 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-27T11:03:28.164 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp 2023-08-27T11:03:28.164 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-27T11:03:28.165 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-27T11:03:28.165 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc 2023-08-27T11:03:28.165 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss 2023-08-27T11:03:28.165 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-27T11:03:28.166 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-27T11:03:28.166 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-27T11:03:28.166 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma 2023-08-27T11:03:28.166 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-27T11:03:28.167 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc 2023-08-27T11:03:28.167 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-27T11:03:28.167 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-27T11:03:28.167 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix 2023-08-27T11:03:28.168 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-27T11:03:28.168 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock 2023-08-27T11:03:28.168 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-27T11:03:28.168 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-27T11:03:28.169 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-27T11:03:28.169 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-27T11:03:28.169 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-27T11:03:28.169 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm 2023-08-27T11:03:28.170 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-27T11:03:28.170 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security 2023-08-27T11:03:28.170 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys 2023-08-27T11:03:28.170 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys 2023-08-27T11:03:28.171 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-27T11:03:28.171 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys 2023-08-27T11:03:28.171 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/security/keys/trusted-keys/trusted.ko 2023-08-27T11:03:28.171 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt 2023-08-27T11:03:28.171 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib 2023-08-27T11:03:28.172 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-27T11:03:28.172 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-27T11:03:28.172 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-27T11:03:28.172 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-27T11:03:28.172 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-27T11:03:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-27T11:03:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-27T11:03:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-27T11:03:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-27T11:03:28.173 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-27T11:03:28.174 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-27T11:03:28.174 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-27T11:03:28.174 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-27T11:03:28.175 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-27T11:03:28.175 DEBUG:teuthology.orchestra.run.smithi057:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-27T11:03:28.203 INFO:teuthology.orchestra.run.smithi057.stdout:postinstall scriptlet (using /bin/sh): 2023-08-27T11:03:28.204 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-ga6a696707610 -a -r /boot/System.map-6.5.0-rc7-ga6a696707610 ]; then 2023-08-27T11:03:28.204 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:03:28.204 INFO:teuthology.orchestra.run.smithi057.stdout:cp /boot/System.map-6.5.0-rc7-ga6a696707610 /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:03:28.204 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-ga6a696707610 /boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-27T11:03:28.205 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/installkernel 6.5.0-rc7-ga6a696707610 /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:03:28.205 INFO:teuthology.orchestra.run.smithi057.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-ga6a696707610-rpm /boot/.System.map-6.5.0-rc7-ga6a696707610-rpm 2023-08-27T11:03:28.205 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-08-27T11:03:28.205 INFO:teuthology.orchestra.run.smithi057.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-27T11:03:28.205 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-27T11:03:28.206 INFO:teuthology.orchestra.run.smithi057.stdout:new-kernel-pkg --remove 6.5.0-rc7-ga6a696707610 --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-ga6a696707610.img 2023-08-27T11:03:28.206 INFO:teuthology.orchestra.run.smithi057.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-27T11:03:28.206 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-install remove 6.5.0-rc7-ga6a696707610 2023-08-27T11:03:28.206 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-08-27T11:03:28.206 INFO:teuthology.orchestra.run.smithi057.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-27T11:03:28.207 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-27T11:03:28.207 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-ga6a696707610 2023-08-27T11:03:28.207 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2023-08-27T11:03:28.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2023-08-27T11:03:28.290 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2023-08-27T11:03:28.290 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.02 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 123.el8 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Group : System Environment/Base 2023-08-27T11:03:28.291 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 9265450 2023-08-27T11:03:28.292 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2023-08-27T11:03:28.292 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-08-27T11:03:28.293 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-08-27T11:03:28.293 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-08-27T11:03:28.293 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-08-27T11:03:28.293 INFO:teuthology.orchestra.run.smithi057.stdout:Relocations : (not relocatable) 2023-08-27T11:03:28.293 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : Red Hat, Inc. 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : Red Hat, Inc. 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:03:28.294 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-27T11:03:28.295 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-27T11:03:28.295 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-27T11:03:28.295 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2023-08-27T11:03:28.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:03:28.295 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2023-08-27T11:03:28.297 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-27T11:03:28.297 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 6.5.0-rc7-ga6a696707610 2023-08-27T11:03:28.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-27T11:03:28.975 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-27T11:03:28.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:03:28.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:03:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2023-08-27T11:03:35.158 INFO:teuthology.orchestra.run.smithi057.stderr:done 2023-08-27T11:03:35.159 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2023-08-27T11:03:35.177 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.f3xdCCXSze 2023-08-27T11:03:35.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f3xdCCXSze 2023-08-27T11:03:35.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.f3xdCCXSze 2023-08-27T11:03:35.400 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.f3xdCCXSze is 6KB 2023-08-27T11:03:35.449 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.f3xdCCXSze 2023-08-27T11:03:35.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2023-08-27T11:03:35.530 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-08-27T11:03:35.531 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-08-27T11:03:35.531 INFO:teuthology.orchestra.run.smithi057.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-ga6a696707610.conf 2023-08-27T11:03:35.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-ga6a696707610 2023-08-27T11:03:35.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2023-08-27T11:03:47.465 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-08-27T11:03:56.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:03:56.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:04:05.699 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-27T11:04:05.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:04:05.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:04:24.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-08-27T11:04:33.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:04:33.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:04:36.137 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-08-27T11:04:48.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:04:48.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:04:56.481 DEBUG:teuthology.orchestra.remote:timed out 2023-08-27T11:05:08.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:05:08.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:05:08.863 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-08-27T11:05:09.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:05:09.320 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-ga6a696707610"... 2023-08-27T11:05:09.321 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2023-08-27T11:05:09.364 INFO:teuthology.orchestra.run.smithi043.stdout:6.5.0-rc7-ga6a696707610 2023-08-27T11:05:09.364 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-27T11:05:09.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-27T11:05:09.365 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-27T11:05:10.366 DEBUG:teuthology.parallel:result is None 2023-08-27T11:05:48.152 DEBUG:teuthology.orchestra.remote:timed out 2023-08-27T11:06:03.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:06:03.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:06:03.503 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-08-27T11:06:03.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:06:03.930 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-ga6a696707610"... 2023-08-27T11:06:03.930 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-08-27T11:06:03.973 INFO:teuthology.orchestra.run.smithi057.stdout:6.5.0-rc7-ga6a696707610 2023-08-27T11:06:03.974 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-27T11:06:03.974 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-27T11:06:03.976 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-08-27T11:06:04.976 DEBUG:teuthology.parallel:result is None 2023-08-27T11:06:04.977 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-27T11:06:04.986 INFO:teuthology.task.internal:Creating test directory... 2023-08-27T11:06:04.986 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-27T11:06:04.992 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-27T11:06:05.039 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-27T11:06:05.050 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-27T11:06:05.086 INFO:teuthology.task.internal:Creating archive directory... 2023-08-27T11:06:05.086 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-27T11:06:05.091 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-27T11:06:05.160 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-27T11:06:05.171 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-27T11:06:05.171 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-27T11:06:05.176 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-27T11:06:05.296 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-27T11:06:05.327 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-27T11:06:05.331 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-27T11:06:05.360 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-27T11:06:05.364 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-27T11:06:05.373 INFO:teuthology.task.internal:Configuring sudo... 2023-08-27T11:06:05.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-27T11:06:05.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-27T11:06:05.447 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-27T11:06:05.513 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-27T11:06:05.513 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-27T11:06:05.520 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-27T11:06:05.563 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-27T11:06:05.680 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-27T11:06:05.783 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-27T11:06:05.855 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-27T11:06:05.941 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:06:05.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-27T11:06:06.017 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-27T11:06:06.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-27T11:06:06.167 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-27T11:06:06.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-27T11:06:06.323 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:06:06.323 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-27T11:06:06.392 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2023-08-27T11:06:06.397 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-08-27T11:06:06.506 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-27T11:06:06.553 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-27T11:06:06.977 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-27T11:06:06.985 INFO:teuthology.task.internal:Starting timer... 2023-08-27T11:06:06.986 INFO:teuthology.run_tasks:Running task pcp... 2023-08-27T11:06:07.040 INFO:teuthology.run_tasks:Running task selinux... 2023-08-27T11:06:07.085 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-27T11:06:07.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2023-08-27T11:06:07.210 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2023-08-27T11:06:07.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2023-08-27T11:06:07.336 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2023-08-27T11:06:07.339 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-27T11:06:07.340 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2023-08-27T11:06:07.390 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2023-08-27T11:06:07.390 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2023-08-27T11:06:07.438 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2023-08-27T11:06:07.438 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive'} 2023-08-27T11:06:07.439 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-27T11:06:07.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:06:07.512 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-27T11:06:07.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:06:07.591 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-27T11:06:07.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2023-08-27T11:06:07.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2023-08-27T11:06:07.736 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-27T11:06:07.747 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-27T11:06:07.776 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-27T11:06:07.904 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-27T11:06:07.925 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-27T11:06:07.926 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi057.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-27T11:18:57.332 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com')] 2023-08-27T11:18:57.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:18:57.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:18:57.453 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-08-27T11:18:57.567 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-08-27T11:18:57.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:18:57.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T11:18:57.658 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-08-27T11:18:57.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-08-27T11:18:57.774 INFO:teuthology.run_tasks:Running task clock... 2023-08-27T11:18:57.785 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-27T11:18:57.786 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-27T11:18:57.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-27T11:18:57.791 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-27T11:18:57.792 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-27T11:18:57.865 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-27T11:18:57.889 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-27T11:18:57.901 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-27T11:18:57.924 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-27T11:18:57.999 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2023-08-27T11:18:58.018 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2023-08-27T11:18:58.030 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2023-08-27T11:18:58.049 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2023-08-27T11:18:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-27T11:18:58.085 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-27T11:18:58.099 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-27T11:18:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-27T11:18:58.186 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2023-08-27T11:18:58.194 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-27T11:18:58.195 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2023-08-27T11:18:58.195 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.195 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.195 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.195 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.209 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2023-08-27T11:18:58.216 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-27T11:18:58.217 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-08-27T11:18:58.217 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.217 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.217 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.217 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-27T11:18:58.218 INFO:teuthology.run_tasks:Running task install... 2023-08-27T11:18:58.233 DEBUG:teuthology.task.install:project ceph 2023-08-27T11:18:58.234 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'}} 2023-08-27T11:18:58.234 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'} 2023-08-27T11:18:58.234 INFO:teuthology.task.install:Using flavor: default 2023-08-27T11:18:58.241 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-27T11:18:58.241 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-27T11:18:58.242 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8', 'tag': None, 'wait_for_package': False} 2023-08-27T11:18:58.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1da267a3afa9ab8f9b1d164359066f8bd682ffd8 2023-08-27T11:18:58.244 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8', 'tag': None, 'wait_for_package': False} 2023-08-27T11:18:58.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1da267a3afa9ab8f9b1d164359066f8bd682ffd8 2023-08-27T11:18:58.390 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/ 2023-08-27T11:18:58.390 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5707.g1da267a3 2023-08-27T11:18:58.465 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/ 2023-08-27T11:18:58.466 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5707.g1da267a3 2023-08-27T11:18:58.570 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-27T11:18:58.570 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:18:58.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-27T11:18:58.641 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-27T11:18:58.641 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-27T11:18:58.649 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-xiubo-wip-57154/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-27T11:18:58.650 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:18:58.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-27T11:18:58.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-27T11:18:58.722 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1da267a3afa9ab8f9b1d164359066f8bd682ffd8/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-27T11:18:58.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-27T11:18:58.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-27T11:18:58.850 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-27T11:18:58.919 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2023-08-27T11:18:58.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2023-08-27T11:18:58.930 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-27T11:18:59.000 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2023-08-27T11:18:59.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2023-08-27T11:18:59.405 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-08-27T11:18:59.482 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-08-27T11:18:59.746 INFO:teuthology.orchestra.run.smithi043.stdout:44 files removed 2023-08-27T11:18:59.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-27T11:18:59.829 INFO:teuthology.orchestra.run.smithi057.stdout:44 files removed 2023-08-27T11:18:59.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-27T11:19:00.279 INFO:teuthology.orchestra.run.smithi043.stdout:Updating Subscription Management repositories. 2023-08-27T11:19:00.364 INFO:teuthology.orchestra.run.smithi057.stdout:Updating Subscription Management repositories. 2023-08-27T11:19:01.128 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 257 kB/s | 81 kB 00:00 2023-08-27T11:19:01.149 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 205 kB/s | 81 kB 00:00 2023-08-27T11:19:01.450 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 36 kB/s | 9.4 kB 00:00 2023-08-27T11:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-08-27T11:19:01.743 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-08-27T11:19:01.902 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-08-27T11:19:02.039 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2023-08-27T11:19:02.190 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-27T11:19:04.040 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2023-08-27T11:19:04.050 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-08-27T11:19:08.278 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 407 kB/s | 24 kB 00:00 2023-08-27T11:19:08.290 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 393 kB/s | 24 kB 00:00 2023-08-27T11:19:09.446 INFO:teuthology.orchestra.run.smithi043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 MB/s | 47 MB 00:01 2023-08-27T11:19:09.491 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-08-27T11:19:18.672 INFO:teuthology.orchestra.run.smithi043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 53 MB 00:01 2023-08-27T11:19:18.767 INFO:teuthology.orchestra.run.smithi057.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 47 MB 00:01 2023-08-27T11:19:30.976 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-27T11:19:30.977 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-27T11:19:30.993 INFO:teuthology.orchestra.run.smithi043.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-27T11:19:30.994 INFO:teuthology.orchestra.run.smithi043.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-27T11:19:30.995 INFO:teuthology.orchestra.run.smithi043.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-27T11:19:30.996 INFO:teuthology.orchestra.run.smithi043.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-27T11:19:30.999 INFO:teuthology.orchestra.run.smithi043.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-27T11:19:31.002 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-27T11:19:31.003 INFO:teuthology.orchestra.run.smithi043.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-27T11:19:31.156 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2023-08-27T11:19:31.169 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-08-27T11:19:31.170 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2023-08-27T11:19:31.170 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-08-27T11:19:31.170 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2023-08-27T11:19:31.170 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-27T11:19:31.170 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-27T11:19:31.171 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 6.4 k 2023-08-27T11:19:31.171 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 5.4 M 2023-08-27T11:19:31.171 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 867 k 2023-08-27T11:19:31.171 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 167 k 2023-08-27T11:19:31.171 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 1.6 M 2023-08-27T11:19:31.172 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 132 k 2023-08-27T11:19:31.172 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 1.7 M 2023-08-27T11:19:31.172 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 7.4 M 2023-08-27T11:19:31.172 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 47 k 2023-08-27T11:19:31.172 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 14 M 2023-08-27T11:19:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 48 M 2023-08-27T11:19:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 261 k 2023-08-27T11:19:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 171 k 2023-08-27T11:19:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 260 k 2023-08-27T11:19:31.173 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 18 k 2023-08-27T11:19:31.174 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-27T11:19:31.174 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-27T11:19:31.174 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-27T11:19:31.174 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 31 k 2023-08-27T11:19:31.174 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 789 k 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 139 k 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-27T11:19:31.175 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-27T11:19:31.176 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-27T11:19:31.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 197 k 2023-08-27T11:19:31.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 371 k 2023-08-27T11:19:31.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 364 k 2023-08-27T11:19:31.176 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 107 k 2023-08-27T11:19:31.177 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 94 k 2023-08-27T11:19:31.177 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.5 M 2023-08-27T11:19:31.177 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 179 k 2023-08-27T11:19:31.177 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-27T11:19:31.177 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2023-08-27T11:19:31.178 INFO:teuthology.orchestra.run.smithi043.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-27T11:19:31.178 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.7 M 2023-08-27T11:19:31.178 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.6 M 2023-08-27T11:19:31.178 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2023-08-27T11:19:31.178 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 22 M 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 23 k 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 2.3 M 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 242 k 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 4.6 M 2023-08-27T11:19:31.179 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 18 M 2023-08-27T11:19:31.180 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 15 k 2023-08-27T11:19:31.180 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 24 k 2023-08-27T11:19:31.180 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-27T11:19:31.180 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-27T11:19:31.180 INFO:teuthology.orchestra.run.smithi043.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-27T11:19:31.181 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-27T11:19:31.181 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-27T11:19:31.181 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 139 k 2023-08-27T11:19:31.181 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-27T11:19:31.181 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-27T11:19:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-27T11:19:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-27T11:19:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-27T11:19:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-27T11:19:31.182 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 473 k 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 6.8 M 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-27T11:19:31.183 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-27T11:19:31.184 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-27T11:19:31.184 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-27T11:19:31.184 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-27T11:19:31.184 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-27T11:19:31.185 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-27T11:19:31.185 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-27T11:19:31.185 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-27T11:19:31.185 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-27T11:19:31.186 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-27T11:19:31.186 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-27T11:19:31.186 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-27T11:19:31.186 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-27T11:19:31.186 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 45 k 2023-08-27T11:19:31.187 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 126 k 2023-08-27T11:19:31.187 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-27T11:19:31.187 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-27T11:19:31.187 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-27T11:19:31.187 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-27T11:19:31.188 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-27T11:19:31.188 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-27T11:19:31.188 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-27T11:19:31.188 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-27T11:19:31.188 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-27T11:19:31.189 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-27T11:19:31.190 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-27T11:19:31.190 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-27T11:19:31.190 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-27T11:19:31.190 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-27T11:19:31.190 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-27T11:19:31.191 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-27T11:19:31.192 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-27T11:19:31.192 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-27T11:19:31.192 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-27T11:19:31.192 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-27T11:19:31.192 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-27T11:19:31.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-27T11:19:31.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-27T11:19:31.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-27T11:19:31.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-27T11:19:31.193 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-27T11:19:31.194 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-27T11:19:31.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-27T11:19:31.195 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-27T11:19:31.195 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-27T11:19:31.195 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-27T11:19:31.195 INFO:teuthology.orchestra.run.smithi043.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout:Enabling module streams: 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql 10 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:19:31.196 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2023-08-27T11:19:31.197 INFO:teuthology.orchestra.run.smithi043.stdout:=========================================================================================================================== 2023-08-27T11:19:31.197 INFO:teuthology.orchestra.run.smithi043.stdout:Install 128 Packages 2023-08-27T11:19:31.197 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 3 Packages 2023-08-27T11:19:31.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:19:31.198 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-27T11:19:31.198 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-27T11:19:31.199 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 206 M 2023-08-27T11:19:31.199 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2023-08-27T11:19:31.203 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-27T11:19:31.204 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-27T11:19:31.205 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-27T11:19:31.206 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-27T11:19:31.209 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-27T11:19:31.212 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-27T11:19:31.213 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-27T11:19:31.363 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-08-27T11:19:31.376 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-08-27T11:19:31.377 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-08-27T11:19:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-08-27T11:19:31.377 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-08-27T11:19:31.377 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-27T11:19:31.378 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-27T11:19:31.378 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 6.4 k 2023-08-27T11:19:31.378 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 5.4 M 2023-08-27T11:19:31.378 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 867 k 2023-08-27T11:19:31.378 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 167 k 2023-08-27T11:19:31.379 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 1.6 M 2023-08-27T11:19:31.379 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 132 k 2023-08-27T11:19:31.379 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 1.7 M 2023-08-27T11:19:31.379 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 7.4 M 2023-08-27T11:19:31.379 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 47 k 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 14 M 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 48 M 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 261 k 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 171 k 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 260 k 2023-08-27T11:19:31.380 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 18 k 2023-08-27T11:19:31.381 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-27T11:19:31.381 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-27T11:19:31.382 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-27T11:19:31.382 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 31 k 2023-08-27T11:19:31.382 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 789 k 2023-08-27T11:19:31.382 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 139 k 2023-08-27T11:19:31.383 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-27T11:19:31.383 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-27T11:19:31.384 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-27T11:19:31.384 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-27T11:19:31.384 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-27T11:19:31.384 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-27T11:19:31.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 197 k 2023-08-27T11:19:31.385 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 371 k 2023-08-27T11:19:31.385 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 364 k 2023-08-27T11:19:31.385 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 107 k 2023-08-27T11:19:31.385 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 94 k 2023-08-27T11:19:31.385 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.5 M 2023-08-27T11:19:31.386 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 179 k 2023-08-27T11:19:31.386 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-27T11:19:31.386 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-08-27T11:19:31.386 INFO:teuthology.orchestra.run.smithi057.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-27T11:19:31.386 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.7 M 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 3.6 M 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 22 M 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 23 k 2023-08-27T11:19:31.387 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 2.3 M 2023-08-27T11:19:31.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 242 k 2023-08-27T11:19:31.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 4.6 M 2023-08-27T11:19:31.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 18 M 2023-08-27T11:19:31.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5707.g1da267a3.el8 ceph-noarch 15 k 2023-08-27T11:19:31.388 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 24 k 2023-08-27T11:19:31.389 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-27T11:19:31.389 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-27T11:19:31.389 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-27T11:19:31.389 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-27T11:19:31.389 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-27T11:19:31.390 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 139 k 2023-08-27T11:19:31.390 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-27T11:19:31.390 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-27T11:19:31.390 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-27T11:19:31.390 INFO:teuthology.orchestra.run.smithi057.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 473 k 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 6.8 M 2023-08-27T11:19:31.391 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-27T11:19:31.392 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-27T11:19:31.392 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-27T11:19:31.392 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-27T11:19:31.392 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-27T11:19:31.392 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-27T11:19:31.393 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-27T11:19:31.394 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-27T11:19:31.394 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-27T11:19:31.394 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-27T11:19:31.394 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-27T11:19:31.394 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 45 k 2023-08-27T11:19:31.395 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:18.0.0-5707.g1da267a3.el8 ceph 126 k 2023-08-27T11:19:31.395 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-27T11:19:31.397 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-27T11:19:31.397 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-27T11:19:31.397 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-27T11:19:31.397 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-27T11:19:31.398 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-27T11:19:31.398 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-27T11:19:31.398 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-27T11:19:31.398 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-27T11:19:31.398 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-27T11:19:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-27T11:19:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-27T11:19:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-27T11:19:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-27T11:19:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-27T11:19:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-27T11:19:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-27T11:19:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-27T11:19:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-27T11:19:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-27T11:19:31.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-27T11:19:31.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-27T11:19:31.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-27T11:19:31.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-27T11:19:31.401 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-27T11:19:31.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-27T11:19:31.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-27T11:19:31.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-27T11:19:31.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-27T11:19:31.402 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-27T11:19:31.403 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-27T11:19:31.403 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-27T11:19:31.403 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-27T11:19:31.403 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-27T11:19:31.404 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-27T11:19:31.404 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-27T11:19:31.404 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-27T11:19:31.404 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-27T11:19:31.405 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-27T11:19:31.405 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-27T11:19:31.405 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-27T11:19:31.405 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-27T11:19:31.406 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-27T11:19:31.406 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-27T11:19:31.406 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-27T11:19:31.406 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-27T11:19:31.406 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:Enabling module streams: 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql 10 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:19:31.407 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-08-27T11:19:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:=========================================================================================================================== 2023-08-27T11:19:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:Install 128 Packages 2023-08-27T11:19:31.408 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 3 Packages 2023-08-27T11:19:31.408 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:19:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 206 M 2023-08-27T11:19:31.409 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-08-27T11:19:31.416 INFO:teuthology.orchestra.run.smithi043.stdout:(1/131): ceph-18.0.0-5707.g1da267a3.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2023-08-27T11:19:31.559 INFO:teuthology.orchestra.run.smithi057.stdout:(1/131): ceph-18.0.0-5707.g1da267a3.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2023-08-27T11:19:31.768 INFO:teuthology.orchestra.run.smithi057.stdout:(2/131): ceph-fuse-18.0.0-5707.g1da267a3.el8.x8 4.1 MB/s | 867 kB 00:00 2023-08-27T11:19:31.818 INFO:teuthology.orchestra.run.smithi057.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 3.3 MB/s | 167 kB 00:00 2023-08-27T11:19:31.991 INFO:teuthology.orchestra.run.smithi043.stdout:(2/131): ceph-fuse-18.0.0-5707.g1da267a3.el8.x8 1.5 MB/s | 867 kB 00:00 2023-08-27T11:19:32.083 INFO:teuthology.orchestra.run.smithi043.stdout:(3/131): ceph-immutable-object-cache-18.0.0-570 1.8 MB/s | 167 kB 00:00 2023-08-27T11:19:32.102 INFO:teuthology.orchestra.run.smithi057.stdout:(4/131): ceph-mds-18.0.0-5707.g1da267a3.el8.x86 8.0 MB/s | 2.3 MB 00:00 2023-08-27T11:19:32.427 INFO:teuthology.orchestra.run.smithi057.stdout:(5/131): ceph-mgr-18.0.0-5707.g1da267a3.el8.x86 4.8 MB/s | 1.6 MB 00:00 2023-08-27T11:19:32.853 INFO:teuthology.orchestra.run.smithi057.stdout:(6/131): ceph-base-18.0.0-5707.g1da267a3.el8.x8 3.8 MB/s | 5.4 MB 00:01 2023-08-27T11:19:32.910 INFO:teuthology.orchestra.run.smithi043.stdout:(4/131): ceph-mds-18.0.0-5707.g1da267a3.el8.x86 2.7 MB/s | 2.3 MB 00:00 2023-08-27T11:19:33.042 INFO:teuthology.orchestra.run.smithi043.stdout:(5/131): ceph-base-18.0.0-5707.g1da267a3.el8.x8 3.0 MB/s | 5.4 MB 00:01 2023-08-27T11:19:33.149 INFO:teuthology.orchestra.run.smithi057.stdout:(7/131): ceph-mon-18.0.0-5707.g1da267a3.el8.x86 6.4 MB/s | 4.6 MB 00:00 2023-08-27T11:19:33.493 INFO:teuthology.orchestra.run.smithi043.stdout:(6/131): ceph-mgr-18.0.0-5707.g1da267a3.el8.x86 2.7 MB/s | 1.6 MB 00:00 2023-08-27T11:19:34.018 INFO:teuthology.orchestra.run.smithi043.stdout:(7/131): ceph-mon-18.0.0-5707.g1da267a3.el8.x86 4.7 MB/s | 4.6 MB 00:00 2023-08-27T11:19:35.052 INFO:teuthology.orchestra.run.smithi057.stdout:(8/131): ceph-radosgw-18.0.0-5707.g1da267a3.el8 7.1 MB/s | 14 MB 00:01 2023-08-27T11:19:35.111 INFO:teuthology.orchestra.run.smithi057.stdout:(9/131): ceph-selinux-18.0.0-5707.g1da267a3.el8 420 kB/s | 24 kB 00:00 2023-08-27T11:19:35.260 INFO:teuthology.orchestra.run.smithi043.stdout:(8/131): ceph-common-18.0.0-5707.g1da267a3.el8. 5.6 MB/s | 22 MB 00:03 2023-08-27T11:19:35.376 INFO:teuthology.orchestra.run.smithi043.stdout:(9/131): ceph-selinux-18.0.0-5707.g1da267a3.el8 209 kB/s | 24 kB 00:00 2023-08-27T11:19:35.603 INFO:teuthology.orchestra.run.smithi057.stdout:(10/131): ceph-common-18.0.0-5707.g1da267a3.el8 5.3 MB/s | 22 MB 00:04 2023-08-27T11:19:35.711 INFO:teuthology.orchestra.run.smithi057.stdout:(11/131): cephfs-mirror-18.0.0-5707.g1da267a3.e 2.4 MB/s | 260 kB 00:00 2023-08-27T11:19:35.820 INFO:teuthology.orchestra.run.smithi057.stdout:(12/131): libcephfs-devel-18.0.0-5707.g1da267a3 287 kB/s | 31 kB 00:00 2023-08-27T11:19:36.103 INFO:teuthology.orchestra.run.smithi057.stdout:(13/131): libcephfs2-18.0.0-5707.g1da267a3.el8. 2.7 MB/s | 789 kB 00:00 2023-08-27T11:19:36.212 INFO:teuthology.orchestra.run.smithi057.stdout:(14/131): libcephsqlite-18.0.0-5707.g1da267a3.e 1.3 MB/s | 139 kB 00:00 2023-08-27T11:19:36.329 INFO:teuthology.orchestra.run.smithi057.stdout:(15/131): librados-devel-18.0.0-5707.g1da267a3. 1.2 MB/s | 139 kB 00:00 2023-08-27T11:19:36.454 INFO:teuthology.orchestra.run.smithi057.stdout:(16/131): libradosstriper1-18.0.0-5707.g1da267a 3.7 MB/s | 473 kB 00:00 2023-08-27T11:19:36.535 INFO:teuthology.orchestra.run.smithi043.stdout:(10/131): ceph-radosgw-18.0.0-5707.g1da267a3.el 5.4 MB/s | 14 MB 00:02 2023-08-27T11:19:36.652 INFO:teuthology.orchestra.run.smithi043.stdout:(11/131): cephfs-mirror-18.0.0-5707.g1da267a3.e 2.2 MB/s | 260 kB 00:00 2023-08-27T11:19:36.848 INFO:teuthology.orchestra.run.smithi043.stdout:(12/131): libcephfs-devel-18.0.0-5707.g1da267a3 159 kB/s | 31 kB 00:00 2023-08-27T11:19:37.061 INFO:teuthology.orchestra.run.smithi043.stdout:(13/131): libcephfs2-18.0.0-5707.g1da267a3.el8. 3.6 MB/s | 789 kB 00:00 2023-08-27T11:19:37.161 INFO:teuthology.orchestra.run.smithi043.stdout:(14/131): libcephsqlite-18.0.0-5707.g1da267a3.e 1.4 MB/s | 139 kB 00:00 2023-08-27T11:19:37.253 INFO:teuthology.orchestra.run.smithi043.stdout:(15/131): librados-devel-18.0.0-5707.g1da267a3. 1.5 MB/s | 139 kB 00:00 2023-08-27T11:19:37.370 INFO:teuthology.orchestra.run.smithi043.stdout:(16/131): libradosstriper1-18.0.0-5707.g1da267a 4.0 MB/s | 473 kB 00:00 2023-08-27T11:19:37.665 INFO:teuthology.orchestra.run.smithi057.stdout:(17/131): librgw2-18.0.0-5707.g1da267a3.el8.x86 5.6 MB/s | 6.8 MB 00:01 2023-08-27T11:19:37.763 INFO:teuthology.orchestra.run.smithi057.stdout:(18/131): python3-ceph-argparse-18.0.0-5707.g1d 460 kB/s | 45 kB 00:00 2023-08-27T11:19:37.847 INFO:teuthology.orchestra.run.smithi057.stdout:(19/131): python3-ceph-common-18.0.0-5707.g1da2 1.5 MB/s | 126 kB 00:00 2023-08-27T11:19:37.912 INFO:teuthology.orchestra.run.smithi043.stdout:(17/131): ceph-osd-18.0.0-5707.g1da267a3.el8.x8 4.0 MB/s | 18 MB 00:04 2023-08-27T11:19:37.930 INFO:teuthology.orchestra.run.smithi057.stdout:(20/131): python3-cephfs-18.0.0-5707.g1da267a3. 2.3 MB/s | 197 kB 00:00 2023-08-27T11:19:37.987 INFO:teuthology.orchestra.run.smithi043.stdout:(18/131): python3-ceph-argparse-18.0.0-5707.g1d 600 kB/s | 45 kB 00:00 2023-08-27T11:19:38.069 INFO:teuthology.orchestra.run.smithi057.stdout:(21/131): python3-rados-18.0.0-5707.g1da267a3.e 2.6 MB/s | 371 kB 00:00 2023-08-27T11:19:38.096 INFO:teuthology.orchestra.run.smithi043.stdout:(19/131): python3-ceph-common-18.0.0-5707.g1da2 1.1 MB/s | 126 kB 00:00 2023-08-27T11:19:38.173 INFO:teuthology.orchestra.run.smithi057.stdout:(22/131): python3-rbd-18.0.0-5707.g1da267a3.el8 3.4 MB/s | 364 kB 00:00 2023-08-27T11:19:38.197 INFO:teuthology.orchestra.run.smithi043.stdout:(20/131): python3-cephfs-18.0.0-5707.g1da267a3. 1.9 MB/s | 197 kB 00:00 2023-08-27T11:19:38.256 INFO:teuthology.orchestra.run.smithi057.stdout:(23/131): python3-rgw-18.0.0-5707.g1da267a3.el8 1.3 MB/s | 107 kB 00:00 2023-08-27T11:19:38.339 INFO:teuthology.orchestra.run.smithi043.stdout:(21/131): python3-rados-18.0.0-5707.g1da267a3.e 2.6 MB/s | 371 kB 00:00 2023-08-27T11:19:38.357 INFO:teuthology.orchestra.run.smithi057.stdout:(24/131): rbd-fuse-18.0.0-5707.g1da267a3.el8.x8 935 kB/s | 94 kB 00:00 2023-08-27T11:19:38.481 INFO:teuthology.orchestra.run.smithi043.stdout:(22/131): librgw2-18.0.0-5707.g1da267a3.el8.x86 6.1 MB/s | 6.8 MB 00:01 2023-08-27T11:19:38.514 INFO:teuthology.orchestra.run.smithi043.stdout:(23/131): python3-rbd-18.0.0-5707.g1da267a3.el8 2.0 MB/s | 364 kB 00:00 2023-08-27T11:19:38.564 INFO:teuthology.orchestra.run.smithi043.stdout:(24/131): python3-rgw-18.0.0-5707.g1da267a3.el8 1.2 MB/s | 107 kB 00:00 2023-08-27T11:19:38.590 INFO:teuthology.orchestra.run.smithi043.stdout:(25/131): rbd-fuse-18.0.0-5707.g1da267a3.el8.x8 1.2 MB/s | 94 kB 00:00 2023-08-27T11:19:38.690 INFO:teuthology.orchestra.run.smithi043.stdout:(26/131): rbd-nbd-18.0.0-5707.g1da267a3.el8.x86 1.7 MB/s | 179 kB 00:00 2023-08-27T11:19:38.774 INFO:teuthology.orchestra.run.smithi043.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5707.g 277 kB/s | 23 kB 00:00 2023-08-27T11:19:38.874 INFO:teuthology.orchestra.run.smithi043.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5707.g1da267a 1.3 MB/s | 132 kB 00:00 2023-08-27T11:19:39.049 INFO:teuthology.orchestra.run.smithi057.stdout:(25/131): rbd-mirror-18.0.0-5707.g1da267a3.el8. 5.1 MB/s | 3.5 MB 00:00 2023-08-27T11:19:39.157 INFO:teuthology.orchestra.run.smithi057.stdout:(26/131): rbd-nbd-18.0.0-5707.g1da267a3.el8.x86 1.6 MB/s | 179 kB 00:00 2023-08-27T11:19:39.199 INFO:teuthology.orchestra.run.smithi043.stdout:(29/131): rbd-mirror-18.0.0-5707.g1da267a3.el8. 5.6 MB/s | 3.5 MB 00:00 2023-08-27T11:19:39.232 INFO:teuthology.orchestra.run.smithi057.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5707.g 308 kB/s | 23 kB 00:00 2023-08-27T11:19:39.341 INFO:teuthology.orchestra.run.smithi057.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5707.g1da267a 1.2 MB/s | 132 kB 00:00 2023-08-27T11:19:39.399 INFO:teuthology.orchestra.run.smithi043.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5707.g1da26 3.3 MB/s | 1.7 MB 00:00 2023-08-27T11:19:39.508 INFO:teuthology.orchestra.run.smithi043.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5707.g1d 2.2 MB/s | 242 kB 00:00 2023-08-27T11:19:39.600 INFO:teuthology.orchestra.run.smithi043.stdout:(32/131): ceph-mgr-rook-18.0.0-5707.g1da267a3.e 518 kB/s | 47 kB 00:00 2023-08-27T11:19:39.684 INFO:teuthology.orchestra.run.smithi043.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5707.g1 175 kB/s | 15 kB 00:00 2023-08-27T11:19:39.741 INFO:teuthology.orchestra.run.smithi057.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5707.g1da26 4.4 MB/s | 1.7 MB 00:00 2023-08-27T11:19:39.838 INFO:teuthology.orchestra.run.smithi043.stdout:(34/131): ceph-volume-18.0.0-5707.g1da267a3.el8 1.6 MB/s | 261 kB 00:00 2023-08-27T11:19:39.942 INFO:teuthology.orchestra.run.smithi043.stdout:(35/131): cephadm-18.0.0-5707.g1da267a3.el8.noa 1.6 MB/s | 171 kB 00:00 2023-08-27T11:19:40.043 INFO:teuthology.orchestra.run.smithi043.stdout:(36/131): cephfs-top-18.0.0-5707.g1da267a3.el8. 179 kB/s | 18 kB 00:00 2023-08-27T11:19:40.452 INFO:teuthology.orchestra.run.smithi043.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 5.9 MB/s | 7.4 MB 00:01 2023-08-27T11:19:40.585 INFO:teuthology.orchestra.run.smithi043.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 565 kB/s | 306 kB 00:00 2023-08-27T11:19:40.710 INFO:teuthology.orchestra.run.smithi043.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-08-27T11:19:40.811 INFO:teuthology.orchestra.run.smithi043.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2023-08-27T11:19:40.894 INFO:teuthology.orchestra.run.smithi043.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-08-27T11:19:40.925 INFO:teuthology.orchestra.run.smithi057.stdout:(30/131): ceph-test-18.0.0-5707.g1da267a3.el8.x 8.2 MB/s | 48 MB 00:05 2023-08-27T11:19:40.945 INFO:teuthology.orchestra.run.smithi043.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 326 kB/s | 44 kB 00:00 2023-08-27T11:19:41.003 INFO:teuthology.orchestra.run.smithi043.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-08-27T11:19:41.042 INFO:teuthology.orchestra.run.smithi057.stdout:(31/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-08-27T11:19:41.067 INFO:teuthology.orchestra.run.smithi057.stdout:(32/131): ceph-mgr-modules-core-18.0.0-5707.g1d 1.7 MB/s | 242 kB 00:00 2023-08-27T11:19:41.070 INFO:teuthology.orchestra.run.smithi043.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-08-27T11:19:41.094 INFO:teuthology.orchestra.run.smithi057.stdout:(33/131): ceph-mgr-rook-18.0.0-5707.g1da267a3.e 951 kB/s | 47 kB 00:00 2023-08-27T11:19:41.104 INFO:teuthology.orchestra.run.smithi043.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-08-27T11:19:41.109 INFO:teuthology.orchestra.run.smithi057.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5707.g1 346 kB/s | 15 kB 00:00 2023-08-27T11:19:41.143 INFO:teuthology.orchestra.run.smithi057.stdout:(35/131): ceph-volume-18.0.0-5707.g1da267a3.el8 5.1 MB/s | 261 kB 00:00 2023-08-27T11:19:41.176 INFO:teuthology.orchestra.run.smithi057.stdout:(36/131): cephadm-18.0.0-5707.g1da267a3.el8.noa 2.5 MB/s | 171 kB 00:00 2023-08-27T11:19:41.202 INFO:teuthology.orchestra.run.smithi057.stdout:(37/131): cephfs-top-18.0.0-5707.g1da267a3.el8. 307 kB/s | 18 kB 00:00 2023-08-27T11:19:41.238 INFO:teuthology.orchestra.run.smithi043.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-08-27T11:19:41.322 INFO:teuthology.orchestra.run.smithi043.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 688 kB/s | 173 kB 00:00 2023-08-27T11:19:41.340 INFO:teuthology.orchestra.run.smithi043.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 810 kB/s | 81 kB 00:00 2023-08-27T11:19:41.422 INFO:teuthology.orchestra.run.smithi043.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-08-27T11:19:41.427 INFO:teuthology.orchestra.run.smithi057.stdout:(38/131): ceph-osd-18.0.0-5707.g1da267a3.el8.x8 2.1 MB/s | 18 MB 00:08 2023-08-27T11:19:41.447 INFO:teuthology.orchestra.run.smithi043.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-08-27T11:19:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 186 kB/s | 59 kB 00:00 2023-08-27T11:19:41.548 INFO:teuthology.orchestra.run.smithi043.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 488 kB/s | 49 kB 00:00 2023-08-27T11:19:41.570 INFO:teuthology.orchestra.run.smithi057.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 780 kB/s | 306 kB 00:00 2023-08-27T11:19:41.614 INFO:teuthology.orchestra.run.smithi057.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 406 kB/s | 75 kB 00:00 2023-08-27T11:19:41.645 INFO:teuthology.orchestra.run.smithi057.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-08-27T11:19:41.678 INFO:teuthology.orchestra.run.smithi057.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2023-08-27T11:19:41.704 INFO:teuthology.orchestra.run.smithi057.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 566 kB/s | 33 kB 00:00 2023-08-27T11:19:41.729 INFO:teuthology.orchestra.run.smithi057.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-08-27T11:19:41.754 INFO:teuthology.orchestra.run.smithi057.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-08-27T11:19:41.780 INFO:teuthology.orchestra.run.smithi057.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-08-27T11:19:41.805 INFO:teuthology.orchestra.run.smithi057.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-08-27T11:19:41.830 INFO:teuthology.orchestra.run.smithi057.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-08-27T11:19:41.855 INFO:teuthology.orchestra.run.smithi057.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-08-27T11:19:41.889 INFO:teuthology.orchestra.run.smithi057.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-08-27T11:19:41.914 INFO:teuthology.orchestra.run.smithi057.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 834 kB/s | 49 kB 00:00 2023-08-27T11:19:41.940 INFO:teuthology.orchestra.run.smithi057.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-08-27T11:19:41.966 INFO:teuthology.orchestra.run.smithi057.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-08-27T11:19:42.032 INFO:teuthology.orchestra.run.smithi057.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-08-27T11:19:42.057 INFO:teuthology.orchestra.run.smithi057.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-08-27T11:19:42.083 INFO:teuthology.orchestra.run.smithi057.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 672 kB/s | 34 kB 00:00 2023-08-27T11:19:42.116 INFO:teuthology.orchestra.run.smithi057.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-08-27T11:19:42.141 INFO:teuthology.orchestra.run.smithi057.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-08-27T11:19:42.167 INFO:teuthology.orchestra.run.smithi057.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-08-27T11:19:42.192 INFO:teuthology.orchestra.run.smithi057.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-08-27T11:19:42.198 INFO:teuthology.orchestra.run.smithi043.stdout:(52/131): ceph-test-18.0.0-5707.g1da267a3.el8.x 7.0 MB/s | 48 MB 00:06 2023-08-27T11:19:42.254 INFO:teuthology.orchestra.run.smithi043.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 83 kB/s | 59 kB 00:00 2023-08-27T11:19:42.292 INFO:teuthology.orchestra.run.smithi057.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 234 kB/s | 29 kB 00:00 2023-08-27T11:19:42.299 INFO:teuthology.orchestra.run.smithi043.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 1.3 MB/s | 1.2 MB 00:00 2023-08-27T11:19:42.318 INFO:teuthology.orchestra.run.smithi057.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-08-27T11:19:42.375 INFO:teuthology.orchestra.run.smithi043.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2023-08-27T11:19:42.389 INFO:teuthology.orchestra.run.smithi057.stdout:(64/131): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2023-08-27T11:19:42.399 INFO:teuthology.orchestra.run.smithi043.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-08-27T11:19:42.433 INFO:teuthology.orchestra.run.smithi057.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-08-27T11:19:42.456 INFO:teuthology.orchestra.run.smithi057.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 983 kB/s | 61 kB 00:00 2023-08-27T11:19:42.474 INFO:teuthology.orchestra.run.smithi043.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 337 kB/s | 34 kB 00:00 2023-08-27T11:19:42.477 INFO:teuthology.orchestra.run.smithi057.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.5 MB/s | 251 kB 00:00 2023-08-27T11:19:42.502 INFO:teuthology.orchestra.run.smithi057.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-08-27T11:19:42.508 INFO:teuthology.orchestra.run.smithi043.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-08-27T11:19:42.522 INFO:teuthology.orchestra.run.smithi057.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-08-27T11:19:42.553 INFO:teuthology.orchestra.run.smithi057.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-08-27T11:19:42.567 INFO:teuthology.orchestra.run.smithi043.stdout:(59/131): python3-natsort-7.1.1-2.el8.noarch.rp 164 kB/s | 60 kB 00:00 2023-08-27T11:19:42.594 INFO:teuthology.orchestra.run.smithi043.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 548 kB/s | 64 kB 00:00 2023-08-27T11:19:42.612 INFO:teuthology.orchestra.run.smithi057.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 511 kB/s | 47 kB 00:00 2023-08-27T11:19:42.617 INFO:teuthology.orchestra.run.smithi043.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2023-08-27T11:19:42.655 INFO:teuthology.orchestra.run.smithi057.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-08-27T11:19:42.671 INFO:teuthology.orchestra.run.smithi057.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 730 kB/s | 43 kB 00:00 2023-08-27T11:19:42.684 INFO:teuthology.orchestra.run.smithi043.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2023-08-27T11:19:42.704 INFO:teuthology.orchestra.run.smithi057.stdout:(74/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-08-27T11:19:42.721 INFO:teuthology.orchestra.run.smithi057.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-08-27T11:19:42.732 INFO:teuthology.orchestra.run.smithi043.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 210 kB/s | 29 kB 00:00 2023-08-27T11:19:42.760 INFO:teuthology.orchestra.run.smithi043.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 193 kB/s | 27 kB 00:00 2023-08-27T11:19:42.777 INFO:teuthology.orchestra.run.smithi057.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-08-27T11:19:42.797 INFO:teuthology.orchestra.run.smithi057.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 567 kB/s | 43 kB 00:00 2023-08-27T11:19:42.822 INFO:teuthology.orchestra.run.smithi057.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 743 kB/s | 87 kB 00:00 2023-08-27T11:19:42.847 INFO:teuthology.orchestra.run.smithi057.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.5 MB/s | 109 kB 00:00 2023-08-27T11:19:42.852 INFO:teuthology.orchestra.run.smithi043.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-08-27T11:19:42.872 INFO:teuthology.orchestra.run.smithi057.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-08-27T11:19:42.877 INFO:teuthology.orchestra.run.smithi043.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 525 kB/s | 61 kB 00:00 2023-08-27T11:19:42.898 INFO:teuthology.orchestra.run.smithi057.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-08-27T11:19:42.931 INFO:teuthology.orchestra.run.smithi057.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-08-27T11:19:42.953 INFO:teuthology.orchestra.run.smithi043.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 855 kB/s | 85 kB 00:00 2023-08-27T11:19:42.965 INFO:teuthology.orchestra.run.smithi057.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-08-27T11:19:42.980 INFO:teuthology.orchestra.run.smithi043.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-08-27T11:19:42.999 INFO:teuthology.orchestra.run.smithi057.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 267 kB/s | 18 kB 00:00 2023-08-27T11:19:43.003 INFO:teuthology.orchestra.run.smithi043.stdout:(69/131): python3-waitress-1.4.3-1.el8.noarch.r 802 kB/s | 255 kB 00:00 2023-08-27T11:19:43.028 INFO:teuthology.orchestra.run.smithi043.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-08-27T11:19:43.032 INFO:teuthology.orchestra.run.smithi057.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-08-27T11:19:43.066 INFO:teuthology.orchestra.run.smithi057.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-08-27T11:19:43.096 INFO:teuthology.orchestra.run.smithi043.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-08-27T11:19:43.099 INFO:teuthology.orchestra.run.smithi057.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-08-27T11:19:43.125 INFO:teuthology.orchestra.run.smithi057.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-08-27T11:19:43.137 INFO:teuthology.orchestra.run.smithi043.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-08-27T11:19:43.175 INFO:teuthology.orchestra.run.smithi057.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-08-27T11:19:43.188 INFO:teuthology.orchestra.run.smithi043.stdout:(73/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-08-27T11:19:43.200 INFO:teuthology.orchestra.run.smithi057.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 799 kB/s | 60 kB 00:00 2023-08-27T11:19:43.217 INFO:teuthology.orchestra.run.smithi057.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-08-27T11:19:43.246 INFO:teuthology.orchestra.run.smithi043.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-08-27T11:19:43.251 INFO:teuthology.orchestra.run.smithi057.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-08-27T11:19:43.276 INFO:teuthology.orchestra.run.smithi057.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 660 kB/s | 39 kB 00:00 2023-08-27T11:19:43.305 INFO:teuthology.orchestra.run.smithi043.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-08-27T11:19:43.322 INFO:teuthology.orchestra.run.smithi043.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 583 kB/s | 39 kB 00:00 2023-08-27T11:19:43.335 INFO:teuthology.orchestra.run.smithi057.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-08-27T11:19:43.360 INFO:teuthology.orchestra.run.smithi057.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-08-27T11:19:43.364 INFO:teuthology.orchestra.run.smithi043.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-08-27T11:19:43.385 INFO:teuthology.orchestra.run.smithi057.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-08-27T11:19:43.398 INFO:teuthology.orchestra.run.smithi043.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-08-27T11:19:43.423 INFO:teuthology.orchestra.run.smithi043.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-27T11:19:43.436 INFO:teuthology.orchestra.run.smithi057.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.8 MB/s | 2.3 MB 00:00 2023-08-27T11:19:43.457 INFO:teuthology.orchestra.run.smithi043.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-08-27T11:19:43.461 INFO:teuthology.orchestra.run.smithi057.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-08-27T11:19:43.486 INFO:teuthology.orchestra.run.smithi057.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-08-27T11:19:43.507 INFO:teuthology.orchestra.run.smithi043.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-08-27T11:19:43.549 INFO:teuthology.orchestra.run.smithi057.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.9 MB/s | 259 kB 00:00 2023-08-27T11:19:43.549 INFO:teuthology.orchestra.run.smithi043.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 636 kB/s | 27 kB 00:00 2023-08-27T11:19:43.587 INFO:teuthology.orchestra.run.smithi057.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-08-27T11:19:43.599 INFO:teuthology.orchestra.run.smithi043.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-08-27T11:19:43.612 INFO:teuthology.orchestra.run.smithi057.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 616 kB/s | 39 kB 00:00 2023-08-27T11:19:43.633 INFO:teuthology.orchestra.run.smithi043.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-08-27T11:19:43.662 INFO:teuthology.orchestra.run.smithi057.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 9.0 MB/s | 688 kB 00:00 2023-08-27T11:19:43.705 INFO:teuthology.orchestra.run.smithi057.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-08-27T11:19:43.738 INFO:teuthology.orchestra.run.smithi057.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-08-27T11:19:43.771 INFO:teuthology.orchestra.run.smithi057.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-08-27T11:19:43.775 INFO:teuthology.orchestra.run.smithi043.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-08-27T11:19:43.822 INFO:teuthology.orchestra.run.smithi057.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 8.4 MB/s | 713 kB 00:00 2023-08-27T11:19:43.833 INFO:teuthology.orchestra.run.smithi043.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-08-27T11:19:43.863 INFO:teuthology.orchestra.run.smithi057.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 642 kB/s | 27 kB 00:00 2023-08-27T11:19:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-08-27T11:19:43.934 INFO:teuthology.orchestra.run.smithi043.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-08-27T11:19:43.936 INFO:teuthology.orchestra.run.smithi057.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 4.4 MB/s | 320 kB 00:00 2023-08-27T11:19:43.959 INFO:teuthology.orchestra.run.smithi043.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-08-27T11:19:43.981 INFO:teuthology.orchestra.run.smithi057.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 962 kB/s | 44 kB 00:00 2023-08-27T11:19:43.984 INFO:teuthology.orchestra.run.smithi043.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-08-27T11:19:44.010 INFO:teuthology.orchestra.run.smithi043.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-08-27T11:19:44.036 INFO:teuthology.orchestra.run.smithi043.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-08-27T11:19:44.077 INFO:teuthology.orchestra.run.smithi043.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-08-27T11:19:44.119 INFO:teuthology.orchestra.run.smithi043.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-08-27T11:19:44.139 INFO:teuthology.orchestra.run.smithi057.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-08-27T11:19:44.190 INFO:teuthology.orchestra.run.smithi057.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-08-27T11:19:44.257 INFO:teuthology.orchestra.run.smithi057.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-08-27T11:19:44.286 INFO:teuthology.orchestra.run.smithi043.stdout:(95/131): python3-scipy-1.0.0-21.module+el8.5.0 11 MB/s | 14 MB 00:01 2023-08-27T11:19:44.321 INFO:teuthology.orchestra.run.smithi057.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 1.7 MB/s | 225 kB 00:00 2023-08-27T11:19:44.329 INFO:teuthology.orchestra.run.smithi043.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-27T11:19:44.358 INFO:teuthology.orchestra.run.smithi057.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 636 kB/s | 64 kB 00:00 2023-08-27T11:19:44.378 INFO:teuthology.orchestra.run.smithi043.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.0 MB/s | 354 kB 00:00 2023-08-27T11:19:44.383 INFO:teuthology.orchestra.run.smithi057.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.0 MB/s | 126 kB 00:00 2023-08-27T11:19:44.411 INFO:teuthology.orchestra.run.smithi057.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-08-27T11:19:44.433 INFO:teuthology.orchestra.run.smithi057.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-08-27T11:19:44.483 INFO:teuthology.orchestra.run.smithi057.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-08-27T11:19:44.504 INFO:teuthology.orchestra.run.smithi043.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2023-08-27T11:19:44.525 INFO:teuthology.orchestra.run.smithi057.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-08-27T11:19:44.605 INFO:teuthology.orchestra.run.smithi043.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 9.8 MB/s | 4.7 MB 00:00 2023-08-27T11:19:44.672 INFO:teuthology.orchestra.run.smithi043.stdout:(100/131): postgresql-contrib-10.21-2.module+el 4.7 MB/s | 808 kB 00:00 2023-08-27T11:19:44.714 INFO:teuthology.orchestra.run.smithi043.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-08-27T11:19:44.756 INFO:teuthology.orchestra.run.smithi043.stdout:(102/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-08-27T11:19:44.784 INFO:teuthology.orchestra.run.smithi057.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 9.6 MB/s | 14 MB 00:01 2023-08-27T11:19:44.789 INFO:teuthology.orchestra.run.smithi043.stdout:(103/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-08-27T11:19:44.806 INFO:teuthology.orchestra.run.smithi043.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-08-27T11:19:44.827 INFO:teuthology.orchestra.run.smithi057.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-27T11:19:44.840 INFO:teuthology.orchestra.run.smithi043.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-27T11:19:44.857 INFO:teuthology.orchestra.run.smithi043.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-08-27T11:19:44.883 INFO:teuthology.orchestra.run.smithi043.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-08-27T11:19:44.901 INFO:teuthology.orchestra.run.smithi057.stdout:(123/131): openblas-threads-0.3.15-3.el8.x86_64 10 MB/s | 4.9 MB 00:00 2023-08-27T11:19:44.907 INFO:teuthology.orchestra.run.smithi043.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 853 kB/s | 43 kB 00:00 2023-08-27T11:19:44.933 INFO:teuthology.orchestra.run.smithi043.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-08-27T11:19:44.935 INFO:teuthology.orchestra.run.smithi057.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-08-27T11:19:44.966 INFO:teuthology.orchestra.run.smithi043.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-08-27T11:19:45.027 INFO:teuthology.orchestra.run.smithi057.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 9.4 MB/s | 4.7 MB 00:00 2023-08-27T11:19:45.033 INFO:teuthology.orchestra.run.smithi043.stdout:(111/131): postgresql-server-10.21-2.module+el8 7.7 MB/s | 5.1 MB 00:00 2023-08-27T11:19:45.058 INFO:teuthology.orchestra.run.smithi043.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-08-27T11:19:45.068 INFO:teuthology.orchestra.run.smithi057.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-08-27T11:19:45.075 INFO:teuthology.orchestra.run.smithi043.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-08-27T11:19:45.109 INFO:teuthology.orchestra.run.smithi043.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-08-27T11:19:45.158 INFO:teuthology.orchestra.run.smithi043.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 218 kB/s | 18 kB 00:00 2023-08-27T11:19:45.169 INFO:teuthology.orchestra.run.smithi057.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-08-27T11:19:45.201 INFO:teuthology.orchestra.run.smithi043.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-08-27T11:19:45.236 INFO:teuthology.orchestra.run.smithi043.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.0 MB/s | 238 kB 00:00 2023-08-27T11:19:45.260 INFO:teuthology.orchestra.run.smithi043.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.9 MB/s | 605 kB 00:00 2023-08-27T11:19:45.277 INFO:teuthology.orchestra.run.smithi057.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-08-27T11:19:45.285 INFO:teuthology.orchestra.run.smithi043.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-08-27T11:19:45.311 INFO:teuthology.orchestra.run.smithi043.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-27T11:19:45.336 INFO:teuthology.orchestra.run.smithi043.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-08-27T11:19:45.344 INFO:teuthology.orchestra.run.smithi057.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-08-27T11:19:45.361 INFO:teuthology.orchestra.run.smithi043.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-08-27T11:19:45.386 INFO:teuthology.orchestra.run.smithi043.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-08-27T11:19:45.412 INFO:teuthology.orchestra.run.smithi043.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-08-27T11:19:45.462 INFO:teuthology.orchestra.run.smithi043.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 8.3 MB/s | 644 kB 00:00 2023-08-27T11:19:45.504 INFO:teuthology.orchestra.run.smithi043.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.8 MB/s | 171 kB 00:00 2023-08-27T11:19:45.521 INFO:teuthology.orchestra.run.smithi057.stdout:(130/131): librados2-18.0.0-5707.g1da267a3.el8. 8.2 MB/s | 3.7 MB 00:00 2023-08-27T11:19:45.529 INFO:teuthology.orchestra.run.smithi043.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.0 MB/s | 138 kB 00:00 2023-08-27T11:19:45.596 INFO:teuthology.orchestra.run.smithi043.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-08-27T11:19:45.672 INFO:teuthology.orchestra.run.smithi043.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-08-27T11:19:46.048 INFO:teuthology.orchestra.run.smithi043.stdout:(130/131): librados2-18.0.0-5707.g1da267a3.el8. 6.9 MB/s | 3.7 MB 00:00 2023-08-27T11:19:46.127 INFO:teuthology.orchestra.run.smithi043.stdout:(131/131): librbd1-18.0.0-5707.g1da267a3.el8.x8 6.1 MB/s | 3.6 MB 00:00 2023-08-27T11:19:46.130 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2023-08-27T11:19:46.130 INFO:teuthology.orchestra.run.smithi043.stdout:Total 14 MB/s | 206 MB 00:14 2023-08-27T11:19:46.220 INFO:teuthology.orchestra.run.smithi057.stdout:(131/131): librbd1-18.0.0-5707.g1da267a3.el8.x8 3.5 MB/s | 3.6 MB 00:01 2023-08-27T11:19:46.224 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-08-27T11:19:46.224 INFO:teuthology.orchestra.run.smithi057.stdout:Total 14 MB/s | 206 MB 00:14 2023-08-27T11:19:47.816 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2023-08-27T11:19:47.891 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-08-27T11:19:47.962 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2023-08-27T11:19:47.963 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2023-08-27T11:19:48.037 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-08-27T11:19:48.037 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-08-27T11:19:49.786 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2023-08-27T11:19:49.791 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2023-08-27T11:19:49.848 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-08-27T11:19:49.854 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-08-27T11:19:54.965 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2023-08-27T11:19:55.134 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-27T11:19:55.188 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-08-27T11:19:55.296 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-27T11:19:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-27T11:19:55.539 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-08-27T11:19:55.575 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-27T11:19:55.710 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-27T11:19:55.756 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-27T11:19:55.864 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-08-27T11:19:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-27T11:19:56.126 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-27T11:19:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-27T11:19:56.626 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-08-27T11:19:56.730 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-27T11:19:56.876 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:19:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 5/134 2023-08-27T11:19:57.377 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:19:57.504 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 5/134 2023-08-27T11:19:57.585 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:19:57.745 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:19:57.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 8/134 2023-08-27T11:19:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:19:58.070 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 8/134 2023-08-27T11:19:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:19:58.274 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 9/134 2023-08-27T11:19:58.355 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:19:58.475 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:19:58.554 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-27T11:19:58.687 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 8/134 2023-08-27T11:19:58.757 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-27T11:19:58.889 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-27T11:19:59.194 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-27T11:19:59.243 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-27T11:19:59.405 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-27T11:19:59.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-27T11:19:59.692 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 14/134 2023-08-27T11:19:59.816 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 14/134 2023-08-27T11:19:59.915 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-27T11:19:59.993 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 15/134 2023-08-27T11:20:00.093 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 15/134 2023-08-27T11:20:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-27T11:20:00.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-27T11:20:00.380 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 14/134 2023-08-27T11:20:00.413 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-08-27T11:20:00.514 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 14/134 2023-08-27T11:20:00.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-27T11:20:00.697 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 15/134 2023-08-27T11:20:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 15/134 2023-08-27T11:20:01.112 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-27T11:20:01.273 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-08-27T11:20:01.290 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-27T11:20:01.434 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-27T11:20:01.479 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-27T11:20:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-27T11:20:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-27T11:20:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-27T11:20:02.151 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-08-27T11:20:02.559 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-08-27T11:20:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-27T11:20:03.130 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-27T11:20:03.454 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-08-27T11:20:03.759 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-08-27T11:20:03.857 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-27T11:20:04.000 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-08-27T11:20:04.038 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-27T11:20:04.250 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-08-27T11:20:04.410 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-08-27T11:20:04.650 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-08-27T11:20:04.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-27T11:20:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-27T11:20:05.083 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:18.0.0-5707.g1da267a3.el8. 26/134 2023-08-27T11:20:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-27T11:20:05.264 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el 27/134 2023-08-27T11:20:05.453 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-27T11:20:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-27T11:20:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:18.0.0-5707.g1da267a3.el8. 26/134 2023-08-27T11:20:06.076 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el 27/134 2023-08-27T11:20:06.321 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_6 28/134 2023-08-27T11:20:06.339 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_6 28/134 2023-08-27T11:20:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-27T11:20:06.714 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-08-27T11:20:06.995 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-08-27T11:20:07.331 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-08-27T11:20:07.600 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-27T11:20:08.759 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-27T11:20:09.803 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-08-27T11:20:10.002 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-27T11:20:10.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-08-27T11:20:10.373 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-27T11:20:10.388 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-27T11:20:10.615 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-27T11:20:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-27T11:20:10.791 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 36/134 2023-08-27T11:20:10.895 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-27T11:20:10.992 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_6 37/134 2023-08-27T11:20:11.165 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-08-27T11:20:11.169 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-27T11:20:11.354 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-08-27T11:20:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-27T11:20:11.553 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-08-27T11:20:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 36/134 2023-08-27T11:20:11.699 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-08-27T11:20:11.838 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_6 37/134 2023-08-27T11:20:11.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-08-27T11:20:12.005 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-27T11:20:12.151 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-08-27T11:20:12.209 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-27T11:20:12.394 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-27T11:20:12.486 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-27T11:20:12.557 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-08-27T11:20:12.776 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-27T11:20:12.824 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-08-27T11:20:13.049 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-08-27T11:20:13.053 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-27T11:20:13.203 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-27T11:20:13.291 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-08-27T11:20:13.339 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-27T11:20:13.553 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-08-27T11:20:13.559 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-27T11:20:13.767 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-27T11:20:13.883 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-08-27T11:20:13.949 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-27T11:20:14.158 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-27T11:20:14.159 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-08-27T11:20:14.323 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-27T11:20:14.344 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-08-27T11:20:14.511 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-27T11:20:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-08-27T11:20:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-27T11:20:14.777 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-08-27T11:20:14.989 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-08-27T11:20:15.000 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-27T11:20:15.331 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-08-27T11:20:15.407 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-27T11:20:15.651 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-08-27T11:20:15.745 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-27T11:20:15.959 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-08-27T11:20:15.986 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-27T11:20:16.215 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-08-27T11:20:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-27T11:20:16.433 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-08-27T11:20:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-27T11:20:16.620 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-08-27T11:20:16.790 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-08-27T11:20:16.868 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-27T11:20:16.906 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-08-27T11:20:17.096 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-27T11:20:17.168 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-08-27T11:20:17.307 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-27T11:20:17.381 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-08-27T11:20:17.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-27T11:20:17.524 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-27T11:20:17.607 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-08-27T11:20:17.729 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-27T11:20:17.885 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-08-27T11:20:17.901 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-27T11:20:18.068 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-08-27T11:20:18.234 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-27T11:20:18.257 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-27T11:20:18.484 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-27T11:20:18.576 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-27T11:20:18.757 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-27T11:20:18.896 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-27T11:20:18.991 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-27T11:20:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-27T11:20:19.154 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-27T11:20:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-27T11:20:19.330 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-27T11:20:19.535 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-27T11:20:19.545 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-27T11:20:19.735 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-27T11:20:19.817 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-27T11:20:19.967 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-27T11:20:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-27T11:20:20.135 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-27T11:20:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-27T11:20:20.314 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-27T11:20:20.434 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-27T11:20:20.536 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-27T11:20:20.681 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-27T11:20:20.781 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-27T11:20:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-27T11:20:20.955 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-27T11:20:21.123 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-27T11:20:21.246 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-27T11:20:21.265 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-27T11:20:21.444 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-27T11:20:21.491 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-27T11:20:21.701 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-27T11:20:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-27T11:20:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-27T11:20:21.935 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-27T11:20:22.151 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-27T11:20:22.446 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-27T11:20:22.729 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-27T11:20:22.942 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-27T11:20:23.202 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-27T11:20:23.305 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-27T11:20:23.578 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-27T11:20:23.846 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-27T11:20:24.170 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-27T11:20:24.450 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-27T11:20:24.656 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-27T11:20:24.659 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-27T11:20:24.975 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-27T11:20:25.209 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-27T11:20:25.547 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-27T11:20:25.549 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-27T11:20:25.755 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 92/134 2023-08-27T11:20:25.835 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 92/134 2023-08-27T11:20:25.866 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-27T11:20:25.989 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 93/134 2023-08-27T11:20:26.097 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-27T11:20:26.970 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-27T11:20:27.168 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 92/134 2023-08-27T11:20:27.262 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 92/134 2023-08-27T11:20:27.418 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 93/134 2023-08-27T11:20:31.298 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:32.283 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:32.612 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 95/134 2023-08-27T11:20:32.746 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 95/134 2023-08-27T11:20:32.887 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:32.895 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 96/134 2023-08-27T11:20:33.109 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:33.846 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 94/134 2023-08-27T11:20:35.374 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 95/134 2023-08-27T11:20:35.515 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 95/134 2023-08-27T11:20:35.658 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 96/134 2023-08-27T11:20:53.998 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 96/134 2023-08-27T11:20:53.998 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2023-08-27T11:20:53.998 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2023-08-27T11:20:53.999 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-08-27T11:20:53.999 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /run 2023-08-27T11:20:53.999 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2023-08-27T11:20:53.999 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2023-08-27T11:20:54.000 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2023-08-27T11:20:54.000 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2023-08-27T11:20:54.000 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2023-08-27T11:20:54.000 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:20:54.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 97/134 2023-08-27T11:20:56.280 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 97/134 2023-08-27T11:20:56.475 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 98/134 2023-08-27T11:20:56.743 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 96/134 2023-08-27T11:20:56.743 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2023-08-27T11:20:56.744 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2023-08-27T11:20:56.744 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-08-27T11:20:56.744 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2023-08-27T11:20:56.744 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2023-08-27T11:20:56.744 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2023-08-27T11:20:56.745 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2023-08-27T11:20:56.745 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2023-08-27T11:20:56.745 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-08-27T11:20:56.745 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:20:56.756 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 98/134 2023-08-27T11:20:56.925 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 99/134 2023-08-27T11:20:57.197 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 97/134 2023-08-27T11:20:57.484 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 99/134 2023-08-27T11:20:57.692 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 100/134 2023-08-27T11:20:57.735 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 100/134 2023-08-27T11:20:59.081 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 97/134 2023-08-27T11:20:59.253 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 98/134 2023-08-27T11:20:59.533 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 98/134 2023-08-27T11:20:59.696 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 99/134 2023-08-27T11:21:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 99/134 2023-08-27T11:21:00.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 100/134 2023-08-27T11:21:00.496 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 100/134 2023-08-27T11:21:00.673 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 101/134 2023-08-27T11:21:00.860 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 101/134 2023-08-27T11:21:01.008 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.e 102/134 2023-08-27T11:21:01.250 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3. 103/134 2023-08-27T11:21:01.416 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 104/134 2023-08-27T11:21:01.694 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 104/134 2023-08-27T11:21:01.881 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 105/134 2023-08-27T11:21:03.070 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 105/134 2023-08-27T11:21:03.257 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 106/134 2023-08-27T11:21:03.392 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 106/134 2023-08-27T11:21:03.430 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 101/134 2023-08-27T11:21:03.639 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 101/134 2023-08-27T11:21:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.e 102/134 2023-08-27T11:21:03.818 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el 107/134 2023-08-27T11:21:03.990 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 108/134 2023-08-27T11:21:04.030 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3. 103/134 2023-08-27T11:21:04.057 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 108/134 2023-08-27T11:21:04.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 104/134 2023-08-27T11:21:04.224 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 109/134 2023-08-27T11:21:04.253 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 109/134 2023-08-27T11:21:04.501 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 104/134 2023-08-27T11:21:04.733 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 105/134 2023-08-27T11:21:05.763 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 110/134 2023-08-27T11:21:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 105/134 2023-08-27T11:21:06.042 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 111/134 2023-08-27T11:21:06.103 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 106/134 2023-08-27T11:21:06.105 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 111/134 2023-08-27T11:21:06.240 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 106/134 2023-08-27T11:21:06.249 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5707.g1da26 112/134 2023-08-27T11:21:06.323 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5707.g1da26 112/134 2023-08-27T11:21:06.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 113/134 2023-08-27T11:21:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el 107/134 2023-08-27T11:21:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 108/134 2023-08-27T11:21:06.881 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 108/134 2023-08-27T11:21:06.943 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 113/134 2023-08-27T11:21:07.100 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 114/134 2023-08-27T11:21:07.111 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 109/134 2023-08-27T11:21:07.140 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 109/134 2023-08-27T11:21:08.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 110/134 2023-08-27T11:21:08.866 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 111/134 2023-08-27T11:21:08.928 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 111/134 2023-08-27T11:21:09.088 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5707.g1da26 112/134 2023-08-27T11:21:09.160 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5707.g1da26 112/134 2023-08-27T11:21:09.345 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 113/134 2023-08-27T11:21:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 113/134 2023-08-27T11:21:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 114/134 2023-08-27T11:21:12.455 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 114/134 2023-08-27T11:21:12.771 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 115/134 2023-08-27T11:21:12.931 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-08-27T11:21:13.196 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-08-27T11:21:14.515 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-08-27T11:21:14.867 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-08-27T11:21:15.035 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 119/134 2023-08-27T11:21:15.253 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-27T11:21:15.299 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 114/134 2023-08-27T11:21:15.428 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_ 121/134 2023-08-27T11:21:15.607 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-27T11:21:16.649 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 115/134 2023-08-27T11:21:17.013 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-27T11:21:17.237 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 117/134 2023-08-27T11:21:17.462 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-27T11:21:17.651 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-27T11:21:17.924 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-27T11:21:18.190 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-27T11:21:18.407 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_ 121/134 2023-08-27T11:21:18.569 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-27T11:21:19.112 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:19.364 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:19.402 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:19.649 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 124/134 2023-08-27T11:21:19.849 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 125/134 2023-08-27T11:21:20.218 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 126/134 2023-08-27T11:21:20.474 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-27T11:21:20.656 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-27T11:21:20.678 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-27T11:21:20.892 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-08-27T11:21:21.096 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-08-27T11:21:21.211 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-08-27T11:21:21.405 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-08-27T11:21:21.434 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-08-27T11:21:21.434 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:21.661 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:21.662 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-27T11:21:21.921 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-27T11:21:22.098 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:22.113 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:22.376 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:22.377 INFO:teuthology.orchestra.run.smithi043.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-27T11:21:22.377 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:22.410 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:22.449 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-27T11:21:22.694 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 124/134 2023-08-27T11:21:22.879 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 125/134 2023-08-27T11:21:23.006 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 1/134 2023-08-27T11:21:23.006 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 2/134 2023-08-27T11:21:23.006 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 3/134 2023-08-27T11:21:23.006 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 4/134 2023-08-27T11:21:23.006 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5707.g1da26 5/134 2023-08-27T11:21:23.007 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:21:23.007 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:21:23.007 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 8/134 2023-08-27T11:21:23.007 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 9/134 2023-08-27T11:21:23.007 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 10/134 2023-08-27T11:21:23.008 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 11/134 2023-08-27T11:21:23.008 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 12/134 2023-08-27T11:21:23.008 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 13/134 2023-08-27T11:21:23.009 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_ 14/134 2023-08-27T11:21:23.009 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 15/134 2023-08-27T11:21:23.009 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 16/134 2023-08-27T11:21:23.009 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_6 17/134 2023-08-27T11:21:23.009 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 18/134 2023-08-27T11:21:23.010 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 19/134 2023-08-27T11:21:23.010 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el 20/134 2023-08-27T11:21:23.010 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:18.0.0-5707.g1da267a3.el8. 21/134 2023-08-27T11:21:23.010 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_6 22/134 2023-08-27T11:21:23.010 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 23/134 2023-08-27T11:21:23.011 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 24/134 2023-08-27T11:21:23.011 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 25/134 2023-08-27T11:21:23.020 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 26/134 2023-08-27T11:21:23.020 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 27/134 2023-08-27T11:21:23.020 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 28/134 2023-08-27T11:21:23.021 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3. 29/134 2023-08-27T11:21:23.021 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 30/134 2023-08-27T11:21:23.021 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 31/134 2023-08-27T11:21:23.021 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 32/134 2023-08-27T11:21:23.021 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el 33/134 2023-08-27T11:21:23.022 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 34/134 2023-08-27T11:21:23.022 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.e 35/134 2023-08-27T11:21:23.022 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 36/134 2023-08-27T11:21:23.022 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 37/134 2023-08-27T11:21:23.022 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 38/134 2023-08-27T11:21:23.023 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-27T11:21:23.023 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-27T11:21:23.023 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-27T11:21:23.023 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-27T11:21:23.023 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-27T11:21:23.024 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-27T11:21:23.025 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-27T11:21:23.025 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-27T11:21:23.025 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-27T11:21:23.025 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-27T11:21:23.025 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-27T11:21:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-27T11:21:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-27T11:21:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-27T11:21:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-27T11:21:23.026 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-27T11:21:23.027 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-27T11:21:23.028 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-27T11:21:23.028 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-27T11:21:23.028 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-27T11:21:23.028 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-27T11:21:23.028 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-27T11:21:23.029 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-27T11:21:23.029 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-08-27T11:21:23.029 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-08-27T11:21:23.029 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-08-27T11:21:23.029 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-08-27T11:21:23.030 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-08-27T11:21:23.030 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-08-27T11:21:23.030 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-08-27T11:21:23.030 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-08-27T11:21:23.030 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-08-27T11:21:23.031 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-08-27T11:21:23.032 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-08-27T11:21:23.032 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-08-27T11:21:23.032 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-08-27T11:21:23.032 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-08-27T11:21:23.032 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-08-27T11:21:23.033 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-08-27T11:21:23.033 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-08-27T11:21:23.033 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-08-27T11:21:23.033 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-08-27T11:21:23.033 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-08-27T11:21:23.034 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-08-27T11:21:23.035 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-08-27T11:21:23.035 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-08-27T11:21:23.035 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-08-27T11:21:23.035 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-08-27T11:21:23.035 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-08-27T11:21:23.036 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-08-27T11:21:23.036 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-08-27T11:21:23.036 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-08-27T11:21:23.036 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-08-27T11:21:23.036 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-08-27T11:21:23.037 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-08-27T11:21:23.038 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-08-27T11:21:23.038 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-08-27T11:21:23.038 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-08-27T11:21:23.038 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-27T11:21:23.038 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-08-27T11:21:23.039 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-08-27T11:21:23.039 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-08-27T11:21:23.039 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-08-27T11:21:23.039 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-08-27T11:21:23.039 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-08-27T11:21:23.040 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 129/134 2023-08-27T11:21:23.040 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-27T11:21:23.040 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 131/134 2023-08-27T11:21:23.040 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:23.040 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-27T11:21:23.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 126/134 2023-08-27T11:21:23.592 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-27T11:21:23.792 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-27T11:21:23.903 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-27T11:21:24.126 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-27T11:21:24.154 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-27T11:21:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-27T11:21:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-27T11:21:24.596 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-27T11:21:24.596 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:24.816 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:24.816 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-27T11:21:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-27T11:21:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:25.612 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:25.613 INFO:teuthology.orchestra.run.smithi057.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-27T11:21:25.613 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:25.786 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:25.787 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:07 ago on Sun 27 Aug 2023 11:19:18 AM UTC. 2023-08-27T11:21:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 1/134 2023-08-27T11:21:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 2/134 2023-08-27T11:21:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 3/134 2023-08-27T11:21:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 4/134 2023-08-27T11:21:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5707.g1da26 5/134 2023-08-27T11:21:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 6/134 2023-08-27T11:21:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 7/134 2023-08-27T11:21:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 8/134 2023-08-27T11:21:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 9/134 2023-08-27T11:21:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 10/134 2023-08-27T11:21:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 11/134 2023-08-27T11:21:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 12/134 2023-08-27T11:21:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 13/134 2023-08-27T11:21:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_ 14/134 2023-08-27T11:21:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 15/134 2023-08-27T11:21:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 16/134 2023-08-27T11:21:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_6 17/134 2023-08-27T11:21:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86 18/134 2023-08-27T11:21:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 19/134 2023-08-27T11:21:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el 20/134 2023-08-27T11:21:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:18.0.0-5707.g1da267a3.el8. 21/134 2023-08-27T11:21:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_6 22/134 2023-08-27T11:21:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 23/134 2023-08-27T11:21:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 24/134 2023-08-27T11:21:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 25/134 2023-08-27T11:21:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 26/134 2023-08-27T11:21:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 27/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 28/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3. 29/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noa 30/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.n 31/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da 32/134 2023-08-27T11:21:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el 33/134 2023-08-27T11:21:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 34/134 2023-08-27T11:21:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.e 35/134 2023-08-27T11:21:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 36/134 2023-08-27T11:21:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 37/134 2023-08-27T11:21:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 38/134 2023-08-27T11:21:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-27T11:21:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-27T11:21:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-27T11:21:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-27T11:21:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-27T11:21:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-27T11:21:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-27T11:21:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-27T11:21:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-27T11:21:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-27T11:21:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-27T11:21:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-27T11:21:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-27T11:21:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-27T11:21:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-27T11:21:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-27T11:21:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-27T11:21:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-27T11:21:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-27T11:21:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-27T11:21:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-27T11:21:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-27T11:21:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-27T11:21:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-27T11:21:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-27T11:21:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-27T11:21:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-27T11:21:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-27T11:21:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-27T11:21:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-27T11:21:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-27T11:21:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-27T11:21:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-27T11:21:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-27T11:21:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-27T11:21:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-27T11:21:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-27T11:21:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-27T11:21:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-27T11:21:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-27T11:21:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-27T11:21:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-27T11:21:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-27T11:21:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-27T11:21:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-27T11:21:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-27T11:21:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-27T11:21:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-27T11:21:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-27T11:21:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-27T11:21:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-27T11:21:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-27T11:21:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-27T11:21:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-27T11:21:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-27T11:21:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-27T11:21:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-27T11:21:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-27T11:21:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-27T11:21:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-27T11:21:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-27T11:21:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-27T11:21:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-27T11:21:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-27T11:21:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-27T11:21:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-27T11:21:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-27T11:21:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-27T11:21:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-27T11:21:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-27T11:21:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-27T11:21:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-27T11:21:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-27T11:21:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-27T11:21:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-27T11:21:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-27T11:21:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-27T11:21:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-27T11:21:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-27T11:21:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-27T11:21:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 129/134 2023-08-27T11:21:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-27T11:21:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 131/134 2023-08-27T11:21:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-27T11:21:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-27T11:21:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-27T11:21:29.148 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:11 ago on Sun 27 Aug 2023 11:19:18 AM UTC. 2023-08-27T11:21:29.469 INFO:teuthology.orchestra.run.smithi043.stdout:Installed products updated. 2023-08-27T11:21:29.712 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:29.712 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2023-08-27T11:21:29.713 INFO:teuthology.orchestra.run.smithi043.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-27T11:21:29.713 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.713 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.713 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2023-08-27T11:21:29.713 INFO:teuthology.orchestra.run.smithi043.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-27T11:21:29.714 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.1-7.el8.noarch 2023-08-27T11:21:29.714 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.0.4-10.el8.x86_64 2023-08-27T11:21:29.714 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.714 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.714 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.715 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.715 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.715 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.715 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.715 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.716 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.716 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.716 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.716 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.716 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.717 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.717 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.717 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.717 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.718 INFO:teuthology.orchestra.run.smithi043.stdout: cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:29.719 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-27T11:21:29.719 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.1-9.el8.x86_64 2023-08-27T11:21:29.719 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-27T11:21:29.719 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-27T11:21:29.719 INFO:teuthology.orchestra.run.smithi043.stdout: jq-1.6-3.el8.x86_64 2023-08-27T11:21:29.720 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-27T11:21:29.720 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-27T11:21:29.720 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-27T11:21:29.720 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.720 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.721 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.721 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-27T11:21:29.721 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-27T11:21:29.721 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-27T11:21:29.721 INFO:teuthology.orchestra.run.smithi043.stdout: libpq-13.5-1.el8.x86_64 2023-08-27T11:21:29.722 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-27T11:21:29.722 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-27T11:21:29.722 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.722 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.722 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-27T11:21:29.723 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-27T11:21:29.724 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-27T11:21:29.724 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-27T11:21:29.724 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-27T11:21:29.724 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-27T11:21:29.724 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-27T11:21:29.725 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-27T11:21:29.725 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-27T11:21:29.725 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-27T11:21:29.725 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-27T11:21:29.725 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:29.726 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:29.726 INFO:teuthology.orchestra.run.smithi043.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:29.726 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-27T11:21:29.726 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-27T11:21:29.726 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-27T11:21:29.727 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-27T11:21:29.727 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-27T11:21:29.727 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-27T11:21:29.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-27T11:21:29.728 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-27T11:21:29.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-27T11:21:29.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-27T11:21:29.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-27T11:21:29.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-27T11:21:29.729 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-27T11:21:29.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-27T11:21:29.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-27T11:21:29.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-27T11:21:29.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-27T11:21:29.730 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-27T11:21:29.731 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-27T11:21:29.731 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-27T11:21:29.731 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-27T11:21:29.731 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-27T11:21:29.731 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-27T11:21:29.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-27T11:21:29.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-27T11:21:29.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-27T11:21:29.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-27T11:21:29.732 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-2.6-1.el8.noarch 2023-08-27T11:21:29.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-27T11:21:29.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-27T11:21:29.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-27T11:21:29.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-27T11:21:29.733 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-27T11:21:29.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-27T11:21:29.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-27T11:21:29.734 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-27T11:21:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-27T11:21:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-27T11:21:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-27T11:21:29.735 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-27T11:21:29.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-27T11:21:29.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-27T11:21:29.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-27T11:21:29.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-27T11:21:29.736 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-27T11:21:29.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-27T11:21:29.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-27T11:21:29.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-27T11:21:29.737 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-27T11:21:29.737 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-27T11:21:29.738 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-27T11:21:29.739 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-27T11:21:29.739 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-27T11:21:29.739 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:29.740 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2023-08-27T11:21:30.014 DEBUG:teuthology.parallel:result is None 2023-08-27T11:21:36.135 INFO:teuthology.orchestra.run.smithi057.stdout:Installed products updated. 2023-08-27T11:21:36.396 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:36.396 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-08-27T11:21:36.396 INFO:teuthology.orchestra.run.smithi057.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-27T11:21:36.397 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.397 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.397 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-08-27T11:21:36.397 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-27T11:21:36.397 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.1-7.el8.noarch 2023-08-27T11:21:36.398 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.0.4-10.el8.x86_64 2023-08-27T11:21:36.398 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.398 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.398 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.399 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.400 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.400 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.400 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.400 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.400 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.401 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.401 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.401 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.401 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.402 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.402 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.402 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.402 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:18.0.0-5707.g1da267a3.el8.noarch 2023-08-27T11:21:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-27T11:21:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.1-9.el8.x86_64 2023-08-27T11:21:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-27T11:21:36.403 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-3.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.404 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.405 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.405 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-27T11:21:36.405 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-27T11:21:36.405 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-27T11:21:36.405 INFO:teuthology.orchestra.run.smithi057.stdout: libpq-13.5-1.el8.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-27T11:21:36.406 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.407 INFO:teuthology.orchestra.run.smithi057.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-27T11:21:36.407 INFO:teuthology.orchestra.run.smithi057.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-27T11:21:36.407 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-27T11:21:36.407 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-27T11:21:36.407 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-27T11:21:36.408 INFO:teuthology.orchestra.run.smithi057.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-27T11:21:36.408 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-27T11:21:36.408 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-27T11:21:36.408 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-27T11:21:36.408 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:36.409 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:36.410 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-27T11:21:36.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-27T11:21:36.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-27T11:21:36.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-27T11:21:36.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-27T11:21:36.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-27T11:21:36.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-27T11:21:36.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-27T11:21:36.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-27T11:21:36.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-27T11:21:36.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-27T11:21:36.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-27T11:21:36.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-27T11:21:36.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-27T11:21:36.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-27T11:21:36.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-27T11:21:36.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2023-08-27T11:21:36.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-27T11:21:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-27T11:21:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-27T11:21:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-27T11:21:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-27T11:21:36.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-27T11:21:36.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-27T11:21:36.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-27T11:21:36.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-27T11:21:36.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-27T11:21:36.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-27T11:21:36.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-27T11:21:36.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-27T11:21:36.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-27T11:21:36.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:18.0.0-5707.g1da267a3.el8.x86_64 2023-08-27T11:21:36.420 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-27T11:21:36.421 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-27T11:21:36.421 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-27T11:21:36.421 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-27T11:21:36.421 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-27T11:21:36.422 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-27T11:21:36.422 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:36.422 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-08-27T11:21:36.737 DEBUG:teuthology.parallel:result is None 2023-08-27T11:21:36.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1da267a3afa9ab8f9b1d164359066f8bd682ffd8 2023-08-27T11:21:36.955 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-27T11:21:37.011 INFO:teuthology.orchestra.run.smithi043.stdout:18.0.0-5707.g1da267a3.el8 2023-08-27T11:21:37.012 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5707.g1da267a3.el8 2023-08-27T11:21:37.012 INFO:teuthology.task.install:The correct ceph version 18.0.0-5707.g1da267a3 is installed. 2023-08-27T11:21:37.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1da267a3afa9ab8f9b1d164359066f8bd682ffd8 2023-08-27T11:21:37.236 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-27T11:21:37.290 INFO:teuthology.orchestra.run.smithi057.stdout:18.0.0-5707.g1da267a3.el8 2023-08-27T11:21:37.291 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5707.g1da267a3.el8 2023-08-27T11:21:37.291 INFO:teuthology.task.install:The correct ceph version 18.0.0-5707.g1da267a3 is installed. 2023-08-27T11:21:37.291 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-27T11:21:37.292 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:37.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-27T11:21:37.388 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:37.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-27T11:21:37.483 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-27T11:21:37.484 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:37.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2023-08-27T11:21:37.555 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-27T11:21:37.697 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:37.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-08-27T11:21:37.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-27T11:21:37.889 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-27T11:21:37.890 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:37.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-27T11:21:37.961 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-27T11:21:38.077 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:38.077 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-27T11:21:38.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-27T11:21:38.267 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-27T11:21:38.269 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:38.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2023-08-27T11:21:38.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-27T11:21:38.464 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:38.465 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2023-08-27T11:21:38.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-27T11:21:38.656 INFO:teuthology.run_tasks:Running task ceph... 2023-08-27T11:21:38.729 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-27T11:21:38.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2023-08-27T11:21:38.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-08-27T11:21:38.810 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-27T11:21:38.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-27T11:21:38.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-27T11:21:38.885 INFO:tasks.ceph:Creating extra log directories... 2023-08-27T11:21:38.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-27T11:21:38.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-27T11:21:38.991 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-27T11:21:38.992 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-27T11:21:38.992 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-27T11:21:38.993 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:38.993 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-27T11:21:39.035 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-27T11:21:39.255 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-27T11:21:39.330 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:39.330 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-27T11:21:39.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-27T11:21:39.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-27T11:21:39.688 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-27T11:21:39.689 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-27T11:21:39.689 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381532', 'branch': 'wip-rishabh-xiubo-wip-57154', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover}', 'email': None, 'first_in_suite': False, 'job_id': '7381532', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-xiubo-wip-57154'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', '\\(MDS_INSUFFICIENT_STANDBY\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_DAMAGE\\)', '\\(FS_DEGRADED\\)'], 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'disabled': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-xiubo-wip-57154', 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-xiubo-wip-57154', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1da267a3afa9ab8f9b1d164359066f8bd682ffd8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi043.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi057.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1da267a3afa9ab8f9b1d164359066f8bd682ffd8'}}, {'ceph': None}, {'kclient': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_failover']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-26_02:16:12', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1553'} 2023-08-27T11:21:39.690 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-27T11:21:39.696 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-27T11:21:39.741 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2023-08-27T11:21:39.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-08-27T11:21:39.851 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:39.851 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2023-08-27T11:21:39.895 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-27T11:21:39.895 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2023-08-27T11:21:39.981 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-27T11:21:39.982 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:39.982 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-08-27T11:21:39.982 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:39.982 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:39.982 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-08-27 11:21:22.510112071 +0000 2023-08-27T11:21:39.983 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-08-27 11:18:15.323096240 +0000 2023-08-27T11:21:39.983 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-08-27 11:18:15.323096240 +0000 2023-08-27T11:21:39.983 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2023-08-27 11:18:15.299096521 +0000 2023-08-27T11:21:39.983 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-27T11:21:40.091 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-08-27T11:21:40.091 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-08-27T11:21:40.092 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000222161 s, 2.3 MB/s 2023-08-27T11:21:40.094 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-27T11:21:40.141 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2023-08-27T11:21:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-27T11:21:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:40.229 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-08-27T11:21:40.229 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:40.229 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:40.229 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-08-27 11:21:22.510112071 +0000 2023-08-27T11:21:40.230 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-08-27 11:18:16.287084953 +0000 2023-08-27T11:21:40.230 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-08-27 11:18:16.287084953 +0000 2023-08-27T11:21:40.230 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2023-08-27 11:18:16.263085234 +0000 2023-08-27T11:21:40.231 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-27T11:21:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-08-27T11:21:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-08-27T11:21:40.336 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000189125 s, 2.7 MB/s 2023-08-27T11:21:40.338 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-27T11:21:40.386 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2023-08-27T11:21:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-27T11:21:40.472 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:40.472 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-08-27T11:21:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-08-27 11:21:22.510112071 +0000 2023-08-27T11:21:40.473 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-08-27 11:18:17.120075200 +0000 2023-08-27T11:21:40.474 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-08-27 11:18:17.120075200 +0000 2023-08-27T11:21:40.474 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2023-08-27 11:18:17.099075446 +0000 2023-08-27T11:21:40.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-27T11:21:40.583 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-08-27T11:21:40.584 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-08-27T11:21:40.584 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000172812 s, 3.0 MB/s 2023-08-27T11:21:40.587 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-27T11:21:40.638 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2023-08-27T11:21:40.683 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-27T11:21:40.683 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:40.683 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-08-27T11:21:40.683 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:40.684 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:40.684 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2023-08-27 11:21:22.510112071 +0000 2023-08-27T11:21:40.684 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2023-08-27 11:18:17.953065446 +0000 2023-08-27T11:21:40.684 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2023-08-27 11:18:17.953065446 +0000 2023-08-27T11:21:40.685 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2023-08-27 11:18:17.932065692 +0000 2023-08-27T11:21:40.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-27T11:21:40.791 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2023-08-27T11:21:40.792 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2023-08-27T11:21:40.792 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000173275 s, 3.0 MB/s 2023-08-27T11:21:40.794 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-27T11:21:40.840 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:40.841 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:40.841 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-08-27T11:21:40.885 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-27T11:21:40.886 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-08-27T11:21:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-27T11:21:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:40.975 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-08-27T11:21:40.975 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:40.975 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:40.975 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-08-27 11:21:25.737578878 +0000 2023-08-27T11:21:40.975 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-08-27 11:18:11.401441526 +0000 2023-08-27T11:21:40.976 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-08-27 11:18:11.401441526 +0000 2023-08-27T11:21:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-08-27 11:18:11.372441929 +0000 2023-08-27T11:21:40.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-27T11:21:41.044 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-08-27T11:21:41.044 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-08-27T11:21:41.045 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000375936 s, 1.4 MB/s 2023-08-27T11:21:41.046 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-27T11:21:41.092 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-08-27T11:21:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-27T11:21:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:41.178 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-08-27T11:21:41.178 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:41.178 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:41.178 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-08-27 11:21:25.737578878 +0000 2023-08-27T11:21:41.178 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-08-27 11:18:12.232429980 +0000 2023-08-27T11:21:41.179 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-08-27 11:18:12.232429980 +0000 2023-08-27T11:21:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-08-27 11:18:12.202430397 +0000 2023-08-27T11:21:41.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-27T11:21:41.283 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-08-27T11:21:41.284 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-08-27T11:21:41.284 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.00037427 s, 1.4 MB/s 2023-08-27T11:21:41.286 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-27T11:21:41.331 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-08-27T11:21:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-27T11:21:41.416 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:41.417 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-08-27T11:21:41.417 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:41.417 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:41.417 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-08-27 11:21:25.737578878 +0000 2023-08-27T11:21:41.417 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-08-27 11:18:13.068418364 +0000 2023-08-27T11:21:41.418 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-08-27 11:18:13.068418364 +0000 2023-08-27T11:21:41.418 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-08-27 11:18:13.035418823 +0000 2023-08-27T11:21:41.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-27T11:21:41.521 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-08-27T11:21:41.522 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-08-27T11:21:41.522 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.0003582 s, 1.4 MB/s 2023-08-27T11:21:41.524 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-27T11:21:41.569 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-08-27T11:21:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-27T11:21:41.653 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-27T11:21:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-08-27T11:21:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-27T11:21:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-08-27T11:21:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-08-27 11:21:25.737578878 +0000 2023-08-27T11:21:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-08-27 11:18:13.904406749 +0000 2023-08-27T11:21:41.655 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-08-27 11:18:13.904406749 +0000 2023-08-27T11:21:41.655 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2023-08-27 11:18:13.873407179 +0000 2023-08-27T11:21:41.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-27T11:21:41.759 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-08-27T11:21:41.760 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-08-27T11:21:41.760 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000557899 s, 918 kB/s 2023-08-27T11:21:41.762 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-27T11:21:41.807 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:41.808 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-27T11:21:41.808 INFO:tasks.ceph:Generating config... 2023-08-27T11:21:41.809 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-27T11:21:41.810 INFO:tasks.ceph:[client] debug client = 20 2023-08-27T11:21:41.810 INFO:tasks.ceph:[client] debug ms = 1 2023-08-27T11:21:41.810 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-27T11:21:41.810 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-27T11:21:41.811 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-27T11:21:41.811 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-27T11:21:41.811 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-27T11:21:41.812 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-27T11:21:41.812 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-27T11:21:41.812 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-27T11:21:41.812 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-27T11:21:41.813 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-27T11:21:41.813 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-27T11:21:41.813 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-27T11:21:41.814 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-27T11:21:41.814 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-27T11:21:41.814 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-27T11:21:41.814 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-27T11:21:41.815 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-27T11:21:41.815 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-27T11:21:41.815 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-27T11:21:41.816 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-27T11:21:41.816 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-27T11:21:41.816 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-27T11:21:41.816 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-27T11:21:41.817 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-27T11:21:41.817 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-27T11:21:41.817 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-27T11:21:41.817 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-27T11:21:41.818 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-27T11:21:41.818 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-27T11:21:41.818 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-27T11:21:41.818 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-27T11:21:41.819 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-27T11:21:41.819 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-27T11:21:41.819 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-27T11:21:41.819 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-27T11:21:41.820 INFO:tasks.ceph:Setting up mon.a... 2023-08-27T11:21:41.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-27T11:21:41.965 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2023-08-27T11:21:41.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-27T11:21:42.076 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-27T11:21:42.146 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '172.21.15.57'), ('mon.c', '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]')] 2023-08-27T11:21:42.147 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-27T11:21:42.148 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:42.148 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-27T11:21:42.193 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --add b 172.21.15.57 --addv c '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:42.327 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:42.327 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid c8d00e24-104f-4e9c-b4f0-07b3a6bec064 2023-08-27T11:21:42.327 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = pacific 2023-08-27T11:21:42.328 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2023-08-27T11:21:42.328 INFO:teuthology.orchestra.run.smithi043.stdout:fsid c8d00e24-104f-4e9c-b4f0-07b3a6bec064 2023-08-27T11:21:42.328 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2023-08-27T11:21:42.327042+0000 2023-08-27T11:21:42.328 INFO:teuthology.orchestra.run.smithi043.stdout:created 2023-08-27T11:21:42.327042+0000 2023-08-27T11:21:42.328 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 16 (pacific) 2023-08-27T11:21:42.329 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2023-08-27T11:21:42.329 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2023-08-27T11:21:42.329 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.b 2023-08-27T11:21:42.329 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] mon.c 2023-08-27T11:21:42.329 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-27T11:21:42.331 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-27T11:21:42.374 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8d00e24-104f-4e9c-b4f0-07b3a6bec064... 2023-08-27T11:21:42.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-27T11:21:42.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-27T11:21:42.540 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2023-08-27T11:21:42.540 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2023-08-27T11:21:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-27T11:21:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2023-08-27T11:21:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2023-08-27T11:21:42.541 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2023-08-27T11:21:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2023-08-27T11:21:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2023-08-27T11:21:42.542 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2023-08-27T11:21:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2023-08-27T11:21:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.543 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-27T11:21:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2023-08-27T11:21:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2023-08-27T11:21:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-27T11:21:42.544 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2023-08-27T11:21:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2023-08-27T11:21:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2023-08-27T11:21:42.545 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2023-08-27T11:21:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2023-08-27T11:21:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2023-08-27T11:21:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2023-08-27T11:21:42.546 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2023-08-27T11:21:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-27T11:21:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-27T11:21:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2023-08-27T11:21:42.547 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-27T11:21:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2023-08-27T11:21:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.548 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2023-08-27T11:21:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2023-08-27T11:21:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2023-08-27T11:21:42.549 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2023-08-27T11:21:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790]" 2023-08-27T11:21:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on skipped message = False 2023-08-27T11:21:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = c8d00e24-104f-4e9c-b4f0-07b3a6bec064 2023-08-27T11:21:42.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.551 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2023-08-27T11:21:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2023-08-27T11:21:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.551 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2023-08-27T11:21:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2023-08-27T11:21:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2023-08-27T11:21:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.552 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2023-08-27T11:21:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2023-08-27T11:21:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2023-08-27T11:21:42.553 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2023-08-27T11:21:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2023-08-27T11:21:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2023-08-27T11:21:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2023-08-27T11:21:42.554 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2023-08-27T11:21:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2023-08-27T11:21:42.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2023-08-27T11:21:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2023-08-27T11:21:42.556 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2023-08-27T11:21:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2023-08-27T11:21:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2023-08-27T11:21:42.557 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2023-08-27T11:21:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2023-08-27T11:21:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2023-08-27T11:21:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2023-08-27T11:21:42.558 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2023-08-27T11:21:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2023-08-27T11:21:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2023-08-27T11:21:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-08-27T11:21:42.559 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2023-08-27T11:21:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2023-08-27T11:21:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2023-08-27T11:21:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2023-08-27T11:21:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2023-08-27T11:21:42.560 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2023-08-27T11:21:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2023-08-27T11:21:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2023-08-27T11:21:42.561 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.561 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2023-08-27T11:21:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-08-27T11:21:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2023-08-27T11:21:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2023-08-27T11:21:42.562 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2023-08-27T11:21:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2023-08-27T11:21:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2023-08-27T11:21:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2023-08-27T11:21:42.563 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.563 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2023-08-27T11:21:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-08-27T11:21:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2023-08-27T11:21:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2023-08-27T11:21:42.564 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2023-08-27T11:21:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2023-08-27T11:21:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2023-08-27T11:21:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2023-08-27T11:21:42.565 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2023-08-27T11:21:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2023-08-27T11:21:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2023-08-27T11:21:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.566 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-27T11:21:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2023-08-27T11:21:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2023-08-27T11:21:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2023-08-27T11:21:42.567 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-27T11:21:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-27T11:21:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2023-08-27T11:21:42.568 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2023-08-27T11:21:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2023-08-27T11:21:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: mon op complaint time = 120 2023-08-27T11:21:42.569 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:21:42.570 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2023-08-27T11:21:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2023-08-27T11:21:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2023-08-27T11:21:42.570 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2023-08-27T11:21:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-27T11:21:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-27T11:21:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: client mount timeout = 600 2023-08-27T11:21:42.571 INFO:teuthology.orchestra.run.smithi043.stdout: debug client = 20 2023-08-27T11:21:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-08-27T11:21:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2023-08-27T11:21:42.572 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2023-08-27T11:21:42.572 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2023-08-27T11:21:42.573 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2023-08-27T11:21:42.573 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2023-08-27T11:21:42.573 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2023-08-27T11:21:42.573 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2023-08-27T11:21:42.574 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2023-08-27T11:21:42.574 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2023-08-27T11:21:42.574 INFO:teuthology.orchestra.run.smithi043.stdout:[mds] 2023-08-27T11:21:42.574 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds = 20 2023-08-27T11:21:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: debug mds balancer = 20 2023-08-27T11:21:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2023-08-27T11:21:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug frag = True 2023-08-27T11:21:42.575 INFO:teuthology.orchestra.run.smithi043.stdout: mds debug scatterstat = True 2023-08-27T11:21:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: mds op complaint time = 180 2023-08-27T11:21:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: mds verify scatter = True 2023-08-27T11:21:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: osd op complaint time = 180 2023-08-27T11:21:42.576 INFO:teuthology.orchestra.run.smithi043.stdout: rados mon op timeout = 900 2023-08-27T11:21:42.577 INFO:teuthology.orchestra.run.smithi043.stdout: rados osd op timeout = 900 2023-08-27T11:21:42.577 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-08-27T11:21:42.578 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-08-27T11:21:42.578 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-27T11:21:42.578 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-08-27T11:21:42.578 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.578 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-08-27T11:21:42.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.579 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-08-27T11:21:42.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.579 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-08-27T11:21:42.580 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-08-27T11:21:42.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.580 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-08-27T11:21:42.580 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-08-27T11:21:42.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-27T11:21:42.581 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-08-27T11:21:42.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.581 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-08-27T11:21:42.581 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-27T11:21:42.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.582 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-08-27T11:21:42.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-08-27T11:21:42.582 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-08-27T11:21:42.583 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-08-27T11:21:42.583 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-08-27T11:21:42.583 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-08-27T11:21:42.583 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-08-27T11:21:42.583 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-27T11:21:42.584 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.585 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-08-27T11:21:42.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.585 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-08-27T11:21:42.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.585 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-08-27T11:21:42.586 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-08-27T11:21:42.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-08-27T11:21:42.586 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.43,172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790]" 2023-08-27T11:21:42.586 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on skipped message = False 2023-08-27T11:21:42.586 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = c8d00e24-104f-4e9c-b4f0-07b3a6bec064 2023-08-27T11:21:42.587 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.587 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-08-27T11:21:42.587 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-08-27T11:21:42.587 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.587 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-08-27T11:21:42.588 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-08-27T11:21:42.588 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2023-08-27T11:21:42.588 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.588 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-08-27T11:21:42.588 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-08-27T11:21:42.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.589 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-08-27T11:21:42.589 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-08-27T11:21:42.589 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-08-27T11:21:42.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.590 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-08-27T11:21:42.591 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.591 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-08-27T11:21:42.591 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.591 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-08-27T11:21:42.591 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-08-27T11:21:42.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.592 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-08-27T11:21:42.592 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-08-27T11:21:42.592 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-08-27T11:21:42.592 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-08-27T11:21:42.593 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2023-08-27T11:21:42.593 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-08-27T11:21:42.593 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-08-27T11:21:42.593 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-08-27T11:21:42.593 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-08-27T11:21:42.594 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-08-27T11:21:42.595 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-08-27T11:21:42.595 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-08-27T11:21:42.595 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-08-27T11:21:42.595 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.595 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-08-27T11:21:42.596 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-08-27T11:21:42.597 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-08-27T11:21:42.597 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.597 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-08-27T11:21:42.597 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-08-27T11:21:42.597 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-08-27T11:21:42.598 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-08-27T11:21:42.598 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-08-27T11:21:42.598 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-08-27T11:21:42.598 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-08-27T11:21:42.598 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-08-27T11:21:42.599 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-08-27T11:21:42.599 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-08-27T11:21:42.599 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-08-27T11:21:42.599 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.599 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-27T11:21:42.600 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-08-27T11:21:42.600 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-08-27T11:21:42.600 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.600 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-08-27T11:21:42.601 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-27T11:21:42.601 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-27T11:21:42.601 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.601 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2023-08-27T11:21:42.602 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2023-08-27T11:21:42.602 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.602 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2023-08-27T11:21:42.602 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2023-08-27T11:21:42.603 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-08-27T11:21:42.603 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-08-27T11:21:42.603 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-08-27T11:21:42.603 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-08-27T11:21:42.604 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-08-27T11:21:42.604 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-27T11:21:42.604 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-27T11:21:42.604 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2023-08-27T11:21:42.605 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2023-08-27T11:21:42.605 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-08-27T11:21:42.605 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-08-27T11:21:42.605 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-08-27T11:21:42.606 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-08-27T11:21:42.606 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-08-27T11:21:42.606 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-08-27T11:21:42.606 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-08-27T11:21:42.607 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-08-27T11:21:42.607 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-08-27T11:21:42.607 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-08-27T11:21:42.607 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2023-08-27T11:21:42.607 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2023-08-27T11:21:42.608 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2023-08-27T11:21:42.608 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-08-27T11:21:42.608 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2023-08-27T11:21:42.608 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2023-08-27T11:21:42.609 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2023-08-27T11:21:42.609 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2023-08-27T11:21:42.609 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2023-08-27T11:21:42.609 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2023-08-27T11:21:42.610 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2023-08-27T11:21:42.612 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-27T11:21:42.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-27T11:21:42.728 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-27T11:21:42.729 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:42.729 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-27T11:21:42.773 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:42.774 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-27T11:21:42.857 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:21:42.858 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:42.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-27T11:21:42.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-27T11:21:42.999 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:21:43.001 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:43.086 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:21:43.086 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:43.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-27T11:21:43.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-27T11:21:43.184 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:21:43.185 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:43.270 INFO:tasks.ceph:Setting up mon nodes... 2023-08-27T11:21:43.271 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-27T11:21:43.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-27T11:21:43.404 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-27T11:21:43.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-27T11:21:43.548 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-27T11:21:43.555 INFO:tasks.ceph:Setting up mds nodes... 2023-08-27T11:21:43.556 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-27T11:21:43.689 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-27T11:21:43.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-27T11:21:43.768 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-27T11:21:43.900 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-27T11:21:43.906 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-27T11:21:43.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-27T11:21:44.114 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-27T11:21:44.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-27T11:21:44.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-27T11:21:44.326 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-27T11:21:44.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-27T11:21:44.406 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-27T11:21:44.407 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-27T11:21:44.517 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-27T11:21:44.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-27T11:21:44.690 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-27T11:21:44.724 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-27T11:21:44.724 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-27T11:21:44.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-27T11:21:44.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:44.797 INFO:tasks.ceph:role: osd.0 2023-08-27T11:21:44.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:21:44.798 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-27T11:21:44.867 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:21:44.868 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:21:44.868 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:21:44.868 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:21:44.869 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:21:44.869 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:21:44.869 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:21:44.869 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:21:44.870 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:21:44.870 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:21:44.891 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-08-27T11:21:45.186 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-08-27T11:21:45.186 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-27T11:21:45.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-27T11:21:45.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-27T11:21:45.450 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:45.450 INFO:tasks.ceph:role: osd.1 2023-08-27T11:21:45.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:21:45.451 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-27T11:21:45.522 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:21:45.522 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:21:45.523 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:21:45.523 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:21:45.523 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:21:45.523 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:21:45.524 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:21:45.524 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:21:45.524 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:21:45.525 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:21:45.546 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-08-27T11:21:45.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-08-27T11:21:45.551 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-27T11:21:45.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-27T11:21:45.742 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-27T11:21:45.814 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:45.815 INFO:tasks.ceph:role: osd.2 2023-08-27T11:21:45.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:21:45.816 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-27T11:21:45.885 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:21:45.886 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:21:45.886 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:21:45.886 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:21:45.886 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:21:45.887 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:21:45.887 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:21:45.887 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:21:45.888 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:21:45.888 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:21:45.909 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-08-27T11:21:45.913 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-08-27T11:21:45.913 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-27T11:21:46.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-27T11:21:46.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-27T11:21:46.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:46.170 INFO:tasks.ceph:role: osd.3 2023-08-27T11:21:46.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:21:46.171 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-27T11:21:46.240 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:21:46.240 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:21:46.240 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:21:46.241 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:21:46.241 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:21:46.241 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:21:46.241 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:21:46.242 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:21:46.242 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:21:46.242 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:21:46.264 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2023-08-27T11:21:46.269 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2023-08-27T11:21:46.269 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-27T11:21:46.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-27T11:21:46.455 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:46.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.576+0000 7fd94d973640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-27T11:21:46.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.576+0000 7fd94d973640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-27T11:21:46.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.576+0000 7fd94d973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-27T11:21:46.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.576+0000 7fd94d973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-27T11:21:46.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.576+0000 7fd94d973640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-27T11:21:46.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:46.578+0000 7fd94d973640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-27T11:21:49.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-27T11:21:49.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:49.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.710+0000 7f15bfbec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-27T11:21:49.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.710+0000 7f15bfbec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-27T11:21:49.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.710+0000 7f15bfbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-27T11:21:49.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.710+0000 7f15bfbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-27T11:21:49.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.710+0000 7f15bfbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-27T11:21:49.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:49.712+0000 7f15bfbec640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-27T11:21:52.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-27T11:21:52.733 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:52.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.845+0000 7f020b829640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-27T11:21:52.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.845+0000 7f020b829640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-27T11:21:52.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.846+0000 7f020b829640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-27T11:21:52.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.846+0000 7f020b829640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-27T11:21:52.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.846+0000 7f020b829640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-27T11:21:52.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:52.847+0000 7f020b829640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-27T11:21:55.790 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-27T11:21:55.860 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:21:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.967+0000 7f9c87c99640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-27T11:21:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.967+0000 7f9c87c99640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-27T11:21:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.967+0000 7f9c87c99640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-27T11:21:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.967+0000 7f9c87c99640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-27T11:21:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.967+0000 7f9c87c99640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-27T11:21:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:21:55.969+0000 7f9c87c99640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-27T11:21:58.925 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-27T11:21:59.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-27T11:21:59.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-27T11:21:59.074 INFO:tasks.ceph:role: osd.4 2023-08-27T11:21:59.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:21:59.075 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-27T11:21:59.173 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:21:59.173 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:21:59.173 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:21:59.173 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:21:59.174 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:21:59.174 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:21:59.174 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:21:59.174 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:21:59.174 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:21:59.175 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:22:00.468 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-08-27T11:22:00.472 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-08-27T11:22:00.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-27T11:22:00.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-27T11:22:00.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-27T11:22:00.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-27T11:22:00.735 INFO:tasks.ceph:role: osd.5 2023-08-27T11:22:00.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:22:00.736 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-27T11:22:00.837 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:22:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:22:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:22:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:22:00.838 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:22:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:22:00.838 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:22:00.839 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:22:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:22:00.839 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:22:02.131 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-08-27T11:22:02.136 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-08-27T11:22:02.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-27T11:22:02.249 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-27T11:22:02.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-27T11:22:02.401 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-27T11:22:02.401 INFO:tasks.ceph:role: osd.6 2023-08-27T11:22:02.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:22:02.402 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-27T11:22:02.501 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:22:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:22:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:22:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:22:02.502 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:22:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:22:02.504 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:22:02.504 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:22:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:22:02.505 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:22:03.809 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-08-27T11:22:03.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-08-27T11:22:03.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-27T11:22:03.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-27T11:22:04.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-27T11:22:04.080 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-27T11:22:04.080 INFO:tasks.ceph:role: osd.7 2023-08-27T11:22:04.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:22:04.081 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-27T11:22:04.179 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-27T11:22:04.179 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-27T11:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-27T11:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-27T11:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-27T11:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-08-27T11:22:04.180 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-27T11:22:04.181 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-27T11:22:04.181 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-27T11:22:04.181 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-27T11:22:05.484 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-08-27T11:22:05.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-08-27T11:22:05.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-27T11:22:05.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-27T11:22:05.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:05.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.802+0000 7f9ec769a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-27T11:22:05.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.802+0000 7f9ec769a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-27T11:22:05.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.802+0000 7f9ec769a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-27T11:22:05.804 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.802+0000 7f9ec769a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-27T11:22:05.805 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.802+0000 7f9ec769a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-27T11:22:05.806 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:05.805+0000 7f9ec769a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-27T11:22:08.770 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-27T11:22:08.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:08.949 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.947+0000 7f956d2b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-27T11:22:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.947+0000 7f956d2b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-27T11:22:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.947+0000 7f956d2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-27T11:22:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.947+0000 7f956d2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-27T11:22:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.947+0000 7f956d2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-27T11:22:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:08.948+0000 7f956d2b6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-27T11:22:09.692 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:22:09.698 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:22:11.905 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-27T11:22:11.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:12.086 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.085+0000 7fae812cb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-27T11:22:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.086+0000 7fae812cb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-27T11:22:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.086+0000 7fae812cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-27T11:22:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.086+0000 7fae812cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-27T11:22:12.088 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.086+0000 7fae812cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-27T11:22:12.089 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:12.087+0000 7fae812cb640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-27T11:22:15.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-27T11:22:15.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:15.225 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.224+0000 7f163ad14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-27T11:22:15.226 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.225+0000 7f163ad14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-27T11:22:15.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.225+0000 7f163ad14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-27T11:22:15.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.225+0000 7f163ad14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-27T11:22:15.227 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.225+0000 7f163ad14640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-27T11:22:15.228 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:15.227+0000 7f163ad14640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-27T11:22:18.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-27T11:22:18.211 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-27T11:22:18.211 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-27T11:22:18.289 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-27T11:22:18.400 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-27T11:22:18.510 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-27T11:22:18.619 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.619 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-27T11:22:18.727 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.727 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-27T11:22:18.835 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:18.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-27T11:22:18.944 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:18.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-27T11:22:19.020 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-27T11:22:19.132 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-27T11:22:19.240 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-27T11:22:19.348 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-27T11:22:19.457 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-27T11:22:19.565 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-27T11:22:19.673 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:19.673 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-27T11:22:19.720 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:19.721 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-27T11:22:19.763 INFO:tasks.ceph:Adding keys to all mons... 2023-08-27T11:22:19.764 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-27T11:22:19.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-27T11:22:19.834 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2023-08-27T11:22:19.834 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w== 2023-08-27T11:22:19.835 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2023-08-27T11:22:19.835 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw== 2023-08-27T11:22:19.835 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.c] 2023-08-27T11:22:19.836 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg== 2023-08-27T11:22:19.836 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2023-08-27T11:22:19.836 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig== 2023-08-27T11:22:19.836 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2023-08-27T11:22:19.836 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw== 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w== 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ== 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2023-08-27T11:22:19.837 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A== 2023-08-27T11:22:19.838 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.b] 2023-08-27T11:22:19.838 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w== 2023-08-27T11:22:19.838 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.d] 2023-08-27T11:22:19.839 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA== 2023-08-27T11:22:19.839 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.4] 2023-08-27T11:22:19.840 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q== 2023-08-27T11:22:19.840 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.5] 2023-08-27T11:22:19.840 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA== 2023-08-27T11:22:19.840 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.6] 2023-08-27T11:22:19.840 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw== 2023-08-27T11:22:19.841 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.7] 2023-08-27T11:22:19.841 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg== 2023-08-27T11:22:19.841 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:22:19.841 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:22:19.841 INFO:teuthology.orchestra.run.smithi043.stdout:[client.1] 2023-08-27T11:22:19.842 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g== 2023-08-27T11:22:19.868 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-08-27T11:22:19.869 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w== 2023-08-27T11:22:19.869 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2023-08-27T11:22:19.869 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw== 2023-08-27T11:22:19.869 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2023-08-27T11:22:19.870 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg== 2023-08-27T11:22:19.870 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-08-27T11:22:19.870 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig== 2023-08-27T11:22:19.870 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-08-27T11:22:19.870 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw== 2023-08-27T11:22:19.871 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-08-27T11:22:19.871 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w== 2023-08-27T11:22:19.871 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-08-27T11:22:19.871 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ== 2023-08-27T11:22:19.871 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-08-27T11:22:19.872 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A== 2023-08-27T11:22:19.872 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2023-08-27T11:22:19.872 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w== 2023-08-27T11:22:19.872 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2023-08-27T11:22:19.872 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA== 2023-08-27T11:22:19.873 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-08-27T11:22:19.873 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q== 2023-08-27T11:22:19.873 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-08-27T11:22:19.873 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA== 2023-08-27T11:22:19.873 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-08-27T11:22:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw== 2023-08-27T11:22:19.874 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-08-27T11:22:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg== 2023-08-27T11:22:19.874 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-08-27T11:22:19.874 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:22:19.875 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2023-08-27T11:22:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g== 2023-08-27T11:22:19.876 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-27T11:22:19.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-27T11:22:20.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.144 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.609 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:20.719 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-27T11:22:20.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-27T11:22:20.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:20.956 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-27T11:22:21.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.418 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-27T11:22:21.530 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-27T11:22:21.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-27T11:22:21.648 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-27T11:22:21.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-27T11:22:21.765 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-27T11:22:21.766 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-27T11:22:21.834 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-27T11:22:21.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-27T11:22:22.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-27T11:22:22.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-27T11:22:22.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-27T11:22:22.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-27T11:22:22.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-27T11:22:22.512 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-27T11:22:22.581 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:22.586 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-27T11:22:22.628 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-27T11:22:22.629 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-27T11:22:22.630 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-27T11:22:22.672 INFO:tasks.ceph.mon.a:Started 2023-08-27T11:22:22.672 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-27T11:22:22.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-27T11:22:22.677 INFO:tasks.ceph.mon.b:Started 2023-08-27T11:22:22.677 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-27T11:22:22.678 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-27T11:22:22.682 INFO:tasks.ceph.mon.c:Started 2023-08-27T11:22:22.682 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-27T11:22:22.682 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-27T11:22:22.683 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-27T11:22:22.687 INFO:tasks.ceph.mgr.y:Started 2023-08-27T11:22:22.687 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-27T11:22:22.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-27T11:22:22.692 INFO:tasks.ceph.mgr.x:Started 2023-08-27T11:22:22.692 INFO:tasks.ceph:Setting crush tunables to default 2023-08-27T11:22:22.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2023-08-27T11:22:22.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.893+0000 7f94187ff700 1 Processor -- start 2023-08-27T11:22:22.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.893+0000 7f94187ff700 1 -- start start 2023-08-27T11:22:22.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f94187ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:22.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f94187ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 0x7f94100aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:22.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f94187ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941006d700 con 0x7f94100ab040 2023-08-27T11:22:22.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f94187ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94101530b0 con 0x7f94100c51a0 2023-08-27T11:22:22.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f94187ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941014c860 con 0x7f941006ca60 2023-08-27T11:22:22.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:22.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55434/0 (socket says 172.21.15.43:55434) 2023-08-27T11:22:22.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 -- 172.21.15.43:0/2543095423 learned_addr learned my addr 172.21.15.43:0/2543095423 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:22.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 0x7f94100aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:22.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 msgr2=0x7f941006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-27T11:22:22.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 msgr2=0x7f941006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-27T11:22:22.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.894+0000 7f941659b700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-27T11:22:22.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.895+0000 7f9415d9a700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 msgr2=0x7f94100aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-27T11:22:22.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.895+0000 7f9415d9a700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 msgr2=0x7f94100aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-27T11:22:22.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.895+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 0x7f94100aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-27T11:22:22.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.895+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 0x7f94100aab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-27T11:22:22.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:22.895+0000 7f941659b700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-27T11:22:23.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.074+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768030651 0 0) 0x7f941006d700 con 0x7f94100ab040 2023-08-27T11:22:23.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.074+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc0035b0 con 0x7f94100ab040 2023-08-27T11:22:23.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344543846 0 0) 0x7f93fc0035b0 con 0x7f94100ab040 2023-08-27T11:22:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 msgr2=0x7f94100aab00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.57:3300/0 conn(0x7f941006ca60 0x7f94100aab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 msgr2=0x7f941006d1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 --2- 172.21.15.43:0/2543095423 >> v2:172.21.15.43:3300/0 conn(0x7f94100c51a0 0x7f941006d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410152430 con 0x7f94100ab040 2023-08-27T11:22:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f94080019f0 con 0x7f94100ab040 2023-08-27T11:22:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 >> v1:172.21.15.57:6789/0 conn(0x7f94100ab040 legacy=0x7f9410155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93fc003a80 0x7f93fc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 0x7f93fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc005260 0x7f93fc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94101530b0 con 0x7f93fc003a80 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941014c860 con 0x7f93fc004850 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.077+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00c230 con 0x7f93fc005260 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 0x7f93fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f941659b700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93fc003a80 0x7f93fc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9416d9c700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc005260 0x7f93fc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 -- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc005260 msgr2=0x7f93fc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc005260 0x7f93fc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 -- 172.21.15.43:0/2543095423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93fc003a80 msgr2=0x7f93fc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93fc003a80 0x7f93fc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 -- 172.21.15.43:0/2543095423 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0035b0 con 0x7f93fc004850 2023-08-27T11:22:23.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9416d9c700 1 -- 172.21.15.43:0/2543095423 reap_dead start 2023-08-27T11:22:23.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.078+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 0x7f93fc004cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9400009860 tx=0x7f93fc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb041c5029b02dcb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:23.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.080+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000c070 con 0x7f93fc004850 2023-08-27T11:22:23.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.080+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400004020 con 0x7f93fc004850 2023-08-27T11:22:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.080+0000 7f9415599700 1 -- 172.21.15.43:0/2543095423 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000043d0 con 0x7f93fc004850 2023-08-27T11:22:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 -- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 msgr2=0x7f93fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 0x7f93fc004cd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9400009860 tx=0x7f93fc005880 comp rx=0 tx=0).stop 2023-08-27T11:22:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 -- 172.21.15.43:0/2543095423 shutdown_connections 2023-08-27T11:22:23.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 --2- 172.21.15.43:0/2543095423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93fc004850 0x7f93fc004cd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 -- 172.21.15.43:0/2543095423 >> 172.21.15.43:0/2543095423 conn(0x7f941006aa50 msgr2=0x7f94100c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:23.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 -- 172.21.15.43:0/2543095423 shutdown_connections 2023-08-27T11:22:23.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.081+0000 7f94187ff700 1 -- 172.21.15.43:0/2543095423 wait complete. 2023-08-27T11:22:23.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.083+0000 7f94187ff700 1 Processor -- start 2023-08-27T11:22:23.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.083+0000 7f94187ff700 1 -- start start 2023-08-27T11:22:23.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 0x7f94101e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 0x7f941014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941014af20 0x7f94101e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:23.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410155160 con 0x7f94101e5d00 2023-08-27T11:22:23.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94101521b0 con 0x7f941014af20 2023-08-27T11:22:23.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f94187ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9410143c70 con 0x7f93fc004850 2023-08-27T11:22:23.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f941659b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 0x7f94101e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f941659b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 0x7f94101e57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:43742/0 (socket says 172.21.15.43:43742) 2023-08-27T11:22:23.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f941659b700 1 -- 172.21.15.43:0/2436426463 learned_addr learned my addr 172.21.15.43:0/2436426463 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:23.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 0x7f941014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.085+0000 7f9416d9c700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941014af20 0x7f94101e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:23.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 -- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 msgr2=0x7f94101e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:23.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 0x7f94101e57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 -- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941014af20 msgr2=0x7f94101e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941014af20 0x7f94101e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 -- 172.21.15.43:0/2436426463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410154c30 con 0x7f94101e5d00 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.086+0000 7f9415d9a700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 0x7f941014a9e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9400017000 tx=0x7f94000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.087+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94000045c0 con 0x7f94101e5d00 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.087+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94000038b0 con 0x7f94101e5d00 2023-08-27T11:22:23.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.087+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400003c60 con 0x7f94101e5d00 2023-08-27T11:22:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.087+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94100bf530 con 0x7f94101e5d00 2023-08-27T11:22:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.087+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9410151ed0 con 0x7f94101e5d00 2023-08-27T11:22:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.088+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941004ee70 con 0x7f94101e5d00 2023-08-27T11:22:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.089+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9400005d20 con 0x7f94101e5d00 2023-08-27T11:22:23.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.089+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f940001c480 con 0x7f94101e5d00 2023-08-27T11:22:23.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.092+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f940002c020 con 0x7f94101e5d00 2023-08-27T11:22:23.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.171+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f94101e8550 con 0x7f94101e5d00 2023-08-27T11:22:23.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.174+0000 7f9406ffd700 1 -- 172.21.15.43:0/2436426463 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9400017030 con 0x7f94101e5d00 2023-08-27T11:22:23.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 msgr2=0x7f941014a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:23.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 0x7f941014a9e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9400017000 tx=0x7f94000047c0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 shutdown_connections 2023-08-27T11:22:23.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f941014af20 0x7f94101e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93fc004850 0x7f94101e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 --2- 172.21.15.43:0/2436426463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94101e5d00 0x7f941014a9e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:23.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 >> 172.21.15.43:0/2436426463 conn(0x7f941006aa50 msgr2=0x7f94100c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:23.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 shutdown_connections 2023-08-27T11:22:23.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:23.175+0000 7f94187ff700 1 -- 172.21.15.43:0/2436426463 wait complete. 2023-08-27T11:22:23.179 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2023-08-27T11:22:23.195 INFO:tasks.ceph:check_enable_crimson: False 2023-08-27T11:22:23.195 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-27T11:22:23.196 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:23.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-27T11:22:23.235 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:23.234+0000 7f3987705200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-27T11:22:23.240 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:23.239+0000 7f579c667200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-27T11:22:23.265 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:23.266 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-27T11:22:23.322 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:23.321+0000 7f3987705200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-27T11:22:23.329 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:23.328+0000 7f579c667200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-27T11:22:23.374 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:23.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-27T11:22:23.422 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:23.421+0000 7f3987705200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-27T11:22:23.433 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:23.432+0000 7f579c667200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-27T11:22:23.484 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:22:23.484 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-27T11:22:23.525 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:23.524+0000 7f3987705200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-27T11:22:23.542 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:23.541+0000 7f579c667200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-27T11:22:23.593 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:23.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-27T11:22:23.664 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:23.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-27T11:22:23.716 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:23.715+0000 7f3987705200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-27T11:22:23.733 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:23.732+0000 7f579c667200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-27T11:22:23.773 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:23.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-27T11:22:23.882 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:22:23.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-27T11:22:23.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 466034ad-5a2f-424b-bcd4-61eae789d16e 0 2023-08-27T11:22:24.217 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:24.216+0000 7f579c667200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-27T11:22:24.220 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:24.219+0000 7f3987705200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-27T11:22:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.236+0000 7fb2ac7ff700 1 Processor -- start 2023-08-27T11:22:24.237 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.236+0000 7fb2ac7ff700 1 -- start start 2023-08-27T11:22:24.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2ac7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2a4151b20 0x7fb2a40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2ac7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a406c450 con 0x7fb2a40c4630 2023-08-27T11:22:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2ac7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4154760 con 0x7fb2a40c4ae0 2023-08-27T11:22:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2ac7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4151f00 con 0x7fb2a4151b20 2023-08-27T11:22:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2aa59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2a4151b20 0x7fb2a40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.242 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2aa59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2a4151b20 0x7fb2a40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.57:33876/0 (socket says 172.21.15.57:33876) 2023-08-27T11:22:24.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.237+0000 7fb2aa59b700 1 -- 172.21.15.57:0/1009732691 learned_addr learned my addr 172.21.15.57:0/1009732691 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:24.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2aa59b700 1 -- 172.21.15.57:0/1009732691 >> v1:172.21.15.57:6789/0 conn(0x7fb2a40c4ae0 legacy=0x7fb2a406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:24.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2aa59b700 1 -- 172.21.15.57:0/1009732691 >> v1:172.21.15.43:6789/0 conn(0x7fb2a40c4630 legacy=0x7fb2a406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2aa59b700 1 -- 172.21.15.57:0/1009732691 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4154a40 con 0x7fb2a4151b20 2023-08-27T11:22:24.243 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2aa59b700 1 --2- 172.21.15.57:0/1009732691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a40c7bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00098f0 tx=0x7fb2a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c35f23302bd2d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2a9599700 1 -- 172.21.15.57:0/1009732691 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0004230 con 0x7fb2a4151b20 2023-08-27T11:22:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2a9599700 1 -- 172.21.15.57:0/1009732691 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a0004390 con 0x7fb2a4151b20 2023-08-27T11:22:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.238+0000 7fb2a9599700 1 -- 172.21.15.57:0/1009732691 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00036a0 con 0x7fb2a4151b20 2023-08-27T11:22:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/1009732691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 msgr2=0x7fb2a40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.244 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/1009732691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a40c7bb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00098f0 tx=0x7fb2a0009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:24.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/1009732691 shutdown_connections 2023-08-27T11:22:24.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/1009732691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a40c7bb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/1009732691 >> 172.21.15.57:0/1009732691 conn(0x7fb2a40ab820 msgr2=0x7fb2a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/1009732691 shutdown_connections 2023-08-27T11:22:24.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.239+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/1009732691 wait complete. 2023-08-27T11:22:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.241+0000 7fb2ac7ff700 1 Processor -- start 2023-08-27T11:22:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.241+0000 7fb2ac7ff700 1 -- start start 2023-08-27T11:22:24.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2a40c4ae0 0x7fb2a41e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a41502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414c9b0 con 0x7fb2a4151b20 2023-08-27T11:22:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414dce0 con 0x7fb2a40c4630 2023-08-27T11:22:24.253 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2ac7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41e7700 con 0x7fb2a40c4ae0 2023-08-27T11:22:24.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2aa59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2aa59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35838/0 (socket says 172.21.15.57:35838) 2023-08-27T11:22:24.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2aa59b700 1 -- 172.21.15.57:0/3250141409 learned_addr learned my addr 172.21.15.57:0/3250141409 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:24.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2a9d9a700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2a40c4ae0 0x7fb2a41e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.242+0000 7fb2aad9c700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a41502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 -- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2a40c4ae0 msgr2=0x7fb2a41e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2a40c4ae0 0x7fb2a41e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 -- 172.21.15.57:0/3250141409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 msgr2=0x7fb2a41502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a41502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 -- 172.21.15.57:0/3250141409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0009550 con 0x7fb2a40c4630 2023-08-27T11:22:24.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aad9c700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a41502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2aa59b700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ac6e0 tx=0x7fb2a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000b660 con 0x7fb2a40c4630 2023-08-27T11:22:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a000b7e0 con 0x7fb2a40c4630 2023-08-27T11:22:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a000bb90 con 0x7fb2a40c4630 2023-08-27T11:22:24.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.243+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a414bf60 con 0x7fb2a40c4630 2023-08-27T11:22:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.244+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a414c520 con 0x7fb2a40c4630 2023-08-27T11:22:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.244+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb2a0021070 con 0x7fb2a40c4630 2023-08-27T11:22:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.244+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb2a001a460 con 0x7fb2a40c4630 2023-08-27T11:22:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.245+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a4155290 con 0x7fb2a40c4630 2023-08-27T11:22:24.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.247+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb2a0044b00 con 0x7fb2a40c4630 2023-08-27T11:22:24.337 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.336+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "466034ad-5a2f-424b-bcd4-61eae789d16e", "id": 0} v 0) v1 -- 0x7fb2a4152280 con 0x7fb2a40c4630 2023-08-27T11:22:24.342 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.341+0000 7fb29affd700 1 -- 172.21.15.57:0/3250141409 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "466034ad-5a2f-424b-bcd4-61eae789d16e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb2a0033070 con 0x7fb2a40c4630 2023-08-27T11:22:24.343 INFO:teuthology.orchestra.run.smithi057.stdout:0 2023-08-27T11:22:24.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 msgr2=0x7fb2a41ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40ac6e0 tx=0x7fb2a0004750 comp rx=0 tx=0).stop 2023-08-27T11:22:24.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 shutdown_connections 2023-08-27T11:22:24.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2a4151b20 0x7fb2a41502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2a40c4630 0x7fb2a41ea4c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 --2- 172.21.15.57:0/3250141409 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2a40c4ae0 0x7fb2a41e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.342+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 >> 172.21.15.57:0/3250141409 conn(0x7fb2a40ab820 msgr2=0x7fb2a4152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.343+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 shutdown_connections 2023-08-27T11:22:24.345 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.343+0000 7fb2ac7ff700 1 -- 172.21.15.57:0/3250141409 wait complete. 2023-08-27T11:22:24.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new d69f5a34-2fbe-46df-a360-8a2b61d89873 1 2023-08-27T11:22:24.370 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:24.369+0000 7f579c667200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-27T11:22:24.373 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:24.372+0000 7f3987705200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-27T11:22:24.486 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:24.485+0000 7f3987705200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-27T11:22:24.487 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:24.485+0000 7f579c667200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-27T11:22:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.555+0000 7fefac1ff700 1 Processor -- start 2023-08-27T11:22:24.557 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.556+0000 7fefac1ff700 1 -- start start 2023-08-27T11:22:24.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefac1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fefa40c4ae0 0x7fefa406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.558 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefac1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa40c82c0 con 0x7fefa40c4630 2023-08-27T11:22:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefac1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa406c450 con 0x7fefa4151b20 2023-08-27T11:22:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefac1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa4151f00 con 0x7fefa40c4ae0 2023-08-27T11:22:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefaa79c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fefa40c4ae0 0x7fefa406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefa9f9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fefa4151b20 0x7fefa40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37970/0 (socket says 172.21.15.57:37970) 2023-08-27T11:22:24.559 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefa9f9b700 1 -- 172.21.15.57:0/2931300274 learned_addr learned my addr 172.21.15.57:0/2931300274 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-08-27T11:22:24.560 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.557+0000 7fefa979a700 1 --1- 172.21.15.57:0/2931300274 >> v1:172.21.15.43:6789/0 conn(0x7fefa40c4630 0x7fefa406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.57:53156/0 (socket says 172.21.15.57:53156) 2023-08-27T11:22:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefaa79c700 1 -- 172.21.15.57:0/2931300274 >> v1:172.21.15.57:6789/0 conn(0x7fefa4151b20 legacy=0x7fefa40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefaa79c700 1 -- 172.21.15.57:0/2931300274 >> v1:172.21.15.43:6789/0 conn(0x7fefa40c4630 legacy=0x7fefa406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefa8f99700 1 -- 172.21.15.57:0/2931300274 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360895711 0 0) 0x7fefa40c82c0 con 0x7fefa40c4630 2023-08-27T11:22:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefaa79c700 1 -- 172.21.15.57:0/2931300274 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa4154760 con 0x7fefa40c4ae0 2023-08-27T11:22:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefaa79c700 1 --2- 172.21.15.57:0/2931300274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa40c4ae0 0x7fefa406b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd5765adf44e3db4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefa8f99700 1 -- 172.21.15.57:0/2931300274 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00e070 con 0x7fefa40c4ae0 2023-08-27T11:22:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefa8f99700 1 -- 172.21.15.57:0/2931300274 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c00bbd0 con 0x7fefa40c4ae0 2023-08-27T11:22:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.558+0000 7fefa8f99700 1 -- 172.21.15.57:0/2931300274 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c012430 con 0x7fefa40c4ae0 2023-08-27T11:22:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 -- 172.21.15.57:0/2931300274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa40c4ae0 msgr2=0x7fefa406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 --2- 172.21.15.57:0/2931300274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa40c4ae0 0x7fefa406b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 -- 172.21.15.57:0/2931300274 shutdown_connections 2023-08-27T11:22:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 --2- 172.21.15.57:0/2931300274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa40c4ae0 0x7fefa406b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 -- 172.21.15.57:0/2931300274 >> 172.21.15.57:0/2931300274 conn(0x7fefa40ab820 msgr2=0x7fefa40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 -- 172.21.15.57:0/2931300274 shutdown_connections 2023-08-27T11:22:24.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.559+0000 7fefac1ff700 1 -- 172.21.15.57:0/2931300274 wait complete. 2023-08-27T11:22:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.561+0000 7fefac1ff700 1 Processor -- start 2023-08-27T11:22:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.561+0000 7fefac1ff700 1 -- start start 2023-08-27T11:22:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 0x7fefa40c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 0x7fefa40c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41e9f40 con 0x7fefa40c4ae0 2023-08-27T11:22:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41e9630 con 0x7fefa4151b20 2023-08-27T11:22:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefac1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41ecd40 con 0x7fefa40c4630 2023-08-27T11:22:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefaa79c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 0x7fefa40c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa979a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 0x7fefa40c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:52828/0 (socket says 172.21.15.57:52828) 2023-08-27T11:22:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 -- 172.21.15.57:0/971794869 learned_addr learned my addr 172.21.15.57:0/971794869 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefaa79c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 0x7fefa40c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35858/0 (socket says 172.21.15.57:35858) 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 -- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 msgr2=0x7fefa40c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 0x7fefa40c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 -- 172.21.15.57:0/971794869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 msgr2=0x7fefa40c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.562+0000 7fefa9f9b700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 0x7fefa40c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fefa9f9b700 1 -- 172.21.15.57:0/971794869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c009a70 con 0x7fefa40c4630 2023-08-27T11:22:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fefa979a700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 0x7fefa40c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fefa9f9b700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefa000c490 tx=0x7fefa000c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cea0 con 0x7fefa40c4630 2023-08-27T11:22:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0005d70 con 0x7fefa40c4630 2023-08-27T11:22:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa00072f0 con 0x7fefa40c4630 2023-08-27T11:22:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa41e98f0 con 0x7fefa40c4630 2023-08-27T11:22:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa40ab3d0 con 0x7fefa40c4630 2023-08-27T11:22:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.563+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fefa001c440 con 0x7fefa40c4630 2023-08-27T11:22:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.564+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fefa00127b0 con 0x7fefa40c4630 2023-08-27T11:22:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.564+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa404ee70 con 0x7fefa40c4630 2023-08-27T11:22:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.567+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fefa0017070 con 0x7fefa40c4630 2023-08-27T11:22:24.592 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:24.591+0000 7f579c667200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-27T11:22:24.597 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:24.596+0000 7f3987705200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-27T11:22:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.655+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d69f5a34-2fbe-46df-a360-8a2b61d89873", "id": 1} v 0) v1 -- 0x7fefa4154cf0 con 0x7fefa40c4630 2023-08-27T11:22:24.661 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.660+0000 7fef9a7fc700 1 -- 172.21.15.57:0/971794869 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d69f5a34-2fbe-46df-a360-8a2b61d89873", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefa0012970 con 0x7fefa40c4630 2023-08-27T11:22:24.661 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-08-27T11:22:24.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 msgr2=0x7fefa40aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fefa000c490 tx=0x7fefa000c7a0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 shutdown_connections 2023-08-27T11:22:24.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fefa4151b20 0x7fefa40c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fefa40c4630 0x7fefa40aae90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 --2- 172.21.15.57:0/971794869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fefa40c4ae0 0x7fefa40c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.663 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 >> 172.21.15.57:0/971794869 conn(0x7fefa40ab820 msgr2=0x7fefa40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:24.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 shutdown_connections 2023-08-27T11:22:24.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.661+0000 7fefac1ff700 1 -- 172.21.15.57:0/971794869 wait complete. 2023-08-27T11:22:24.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new ae349b3a-0b81-43e1-aec9-35388a5be28b 2 2023-08-27T11:22:24.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.916+0000 7fdf6bdff700 1 Processor -- start 2023-08-27T11:22:24.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.916+0000 7fdf6bdff700 1 -- start start 2023-08-27T11:22:24.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf64151b20 0x7fdf640c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 0x7fdf6406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf64151f00 con 0x7fdf64151b20 2023-08-27T11:22:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6406c450 con 0x7fdf6406ad70 2023-08-27T11:22:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6bdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64154760 con 0x7fdf640c4630 2023-08-27T11:22:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6939a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6a39c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 0x7fdf6406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6939a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:52844/0 (socket says 172.21.15.57:52844) 2023-08-27T11:22:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf69b9b700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.43:3300/0 conn(0x7fdf64151b20 0x7fdf640c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.917+0000 7fdf6939a700 1 -- 172.21.15.57:0/119313682 learned_addr learned my addr 172.21.15.57:0/119313682 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:24.921 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 -- 172.21.15.57:0/119313682 >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 msgr2=0x7fdf6406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 0x7fdf6406b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 -- 172.21.15.57:0/119313682 >> v2:172.21.15.43:3300/0 conn(0x7fdf64151b20 msgr2=0x7fdf640c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.43:3300/0 conn(0x7fdf64151b20 0x7fdf640c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 -- 172.21.15.57:0/119313682 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64154a40 con 0x7fdf640c4630 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6a39c700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 0x7fdf6406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf6939a700 1 --2- 172.21.15.57:0/119313682 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf640a9720 tx=0x7fdf54009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e087820e426e7c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf68b99700 1 -- 172.21.15.57:0/119313682 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005e30 con 0x7fdf640c4630 2023-08-27T11:22:24.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf68b99700 1 -- 172.21.15.57:0/119313682 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54004030 con 0x7fdf640c4630 2023-08-27T11:22:24.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.918+0000 7fdf68b99700 1 -- 172.21.15.57:0/119313682 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540043e0 con 0x7fdf640c4630 2023-08-27T11:22:24.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 -- 172.21.15.57:0/119313682 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 msgr2=0x7fdf640c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/119313682 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf640a9720 tx=0x7fdf54009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 -- 172.21.15.57:0/119313682 shutdown_connections 2023-08-27T11:22:24.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.57:3300/0 conn(0x7fdf6406ad70 0x7fdf6406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.925 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/119313682 >> v2:172.21.15.43:3300/0 conn(0x7fdf64151b20 0x7fdf640c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/119313682 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf640c4ab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 -- 172.21.15.57:0/119313682 >> 172.21.15.57:0/119313682 conn(0x7fdf640ab820 msgr2=0x7fdf640abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:24.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 -- 172.21.15.57:0/119313682 shutdown_connections 2023-08-27T11:22:24.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.919+0000 7fdf6bdff700 1 -- 172.21.15.57:0/119313682 wait complete. 2023-08-27T11:22:24.926 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.922+0000 7fdf6bdff700 1 Processor -- start 2023-08-27T11:22:24.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.922+0000 7fdf6bdff700 1 -- start start 2023-08-27T11:22:24.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6406ad70 0x7fdf641422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf641427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:24.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf641eccb0 con 0x7fdf6406ad70 2023-08-27T11:22:24.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf641eac50 con 0x7fdf64151b20 2023-08-27T11:22:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6bdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf641eaf30 con 0x7fdf640c4630 2023-08-27T11:22:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6939a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf641427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35874/0 (socket says 172.21.15.57:35874) 2023-08-27T11:22:24.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 -- 172.21.15.57:0/3379779592 learned_addr learned my addr 172.21.15.57:0/3379779592 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:24.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf69b9b700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6406ad70 0x7fdf641422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:24.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 -- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 msgr2=0x7fdf641427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf641427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 -- 172.21.15.57:0/3379779592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6406ad70 msgr2=0x7fdf641422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:24.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6406ad70 0x7fdf641422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.924+0000 7fdf6a39c700 1 -- 172.21.15.57:0/3379779592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009a70 con 0x7fdf64151b20 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf6a39c700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00efc0 tx=0x7fdf5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00cb40 con 0x7fdf64151b20 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00f040 con 0x7fdf64151b20 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf54009500 con 0x7fdf64151b20 2023-08-27T11:22:24.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c003a20 con 0x7fdf64151b20 2023-08-27T11:22:24.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf641eb4f0 con 0x7fdf64151b20 2023-08-27T11:22:24.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.925+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf5c004020 con 0x7fdf64151b20 2023-08-27T11:22:24.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.926+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdf5c0046f0 con 0x7fdf64151b20 2023-08-27T11:22:24.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.926+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf641eb6e0 con 0x7fdf64151b20 2023-08-27T11:22:24.934 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:24.929+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdf5c018030 con 0x7fdf64151b20 2023-08-27T11:22:25.018 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.017+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae349b3a-0b81-43e1-aec9-35388a5be28b", "id": 2} v 0) v1 -- 0x7fdf6404ee70 con 0x7fdf64151b20 2023-08-27T11:22:25.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.022+0000 7fdf5a7fc700 1 -- 172.21.15.57:0/3379779592 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae349b3a-0b81-43e1-aec9-35388a5be28b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf5c0042d0 con 0x7fdf64151b20 2023-08-27T11:22:25.023 INFO:teuthology.orchestra.run.smithi057.stdout:2 2023-08-27T11:22:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 msgr2=0x7fdf641ecf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.024 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00efc0 tx=0x7fdf5c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 shutdown_connections 2023-08-27T11:22:25.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf64151b20 0x7fdf641ecf50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf6406ad70 0x7fdf641422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 --2- 172.21.15.57:0/3379779592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdf640c4630 0x7fdf641427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 >> 172.21.15.57:0/3379779592 conn(0x7fdf640ab820 msgr2=0x7fdf64152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 shutdown_connections 2023-08-27T11:22:25.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.023+0000 7fdf6bdff700 1 -- 172.21.15.57:0/3379779592 wait complete. 2023-08-27T11:22:25.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 702c4b2b-6ace-4df9-80d0-ce832acfcf28 3 2023-08-27T11:22:25.131 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:25.129+0000 7f579c667200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-27T11:22:25.159 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:25.158+0000 7f3987705200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-27T11:22:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.240+0000 7fa2d61ff700 1 Processor -- start 2023-08-27T11:22:25.241 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.240+0000 7fa2d61ff700 1 -- start start 2023-08-27T11:22:25.245 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2d61ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 0x7fa2d00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2d61ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2d00c4630 0x7fa2d00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2d61ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d006c450 con 0x7fa2d006ad70 2023-08-27T11:22:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2d61ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0151f00 con 0x7fa2d00c4630 2023-08-27T11:22:25.246 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2d61ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0154760 con 0x7fa2d0151b20 2023-08-27T11:22:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.241+0000 7fa2ceffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2d00c4630 0x7fa2d00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2d00c4630 0x7fa2d00c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35882/0 (socket says 172.21.15.57:35882) 2023-08-27T11:22:25.247 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 0x7fa2d00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 -- 172.21.15.57:0/85789763 learned_addr learned my addr 172.21.15.57:0/85789763 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 -- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 msgr2=0x7fa2d00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 0x7fa2d00c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.248 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 -- 172.21.15.57:0/85789763 >> v1:172.21.15.43:6789/0 conn(0x7fa2d006ad70 legacy=0x7fa2d006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 -- 172.21.15.57:0/85789763 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0154a40 con 0x7fa2d00c4630 2023-08-27T11:22:25.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2cf7fe700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 0x7fa2d00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:25.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.242+0000 7fa2ceffd700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d00c4630 0x7fa2d00c4ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098e0 tx=0x7fa2c4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99362bc0820e8fd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2ce7fc700 1 -- 172.21.15.57:0/85789763 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4011830 con 0x7fa2d00c4630 2023-08-27T11:22:25.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2ce7fc700 1 -- 172.21.15.57:0/85789763 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4011990 con 0x7fa2d00c4630 2023-08-27T11:22:25.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2ce7fc700 1 -- 172.21.15.57:0/85789763 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4011d40 con 0x7fa2d00c4630 2023-08-27T11:22:25.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 -- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d00c4630 msgr2=0x7fa2d00c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d00c4630 0x7fa2d00c4ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098e0 tx=0x7fa2c4009bf0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 -- 172.21.15.57:0/85789763 shutdown_connections 2023-08-27T11:22:25.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d0151b20 0x7fa2d00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/85789763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d00c4630 0x7fa2d00c4ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 -- 172.21.15.57:0/85789763 >> 172.21.15.57:0/85789763 conn(0x7fa2d00ab820 msgr2=0x7fa2d00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.243+0000 7fa2d61ff700 1 -- 172.21.15.57:0/85789763 shutdown_connections 2023-08-27T11:22:25.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.244+0000 7fa2d61ff700 1 -- 172.21.15.57:0/85789763 wait complete. 2023-08-27T11:22:25.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.245+0000 7fa2d61ff700 1 Processor -- start 2023-08-27T11:22:25.254 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.245+0000 7fa2d61ff700 1 -- start start 2023-08-27T11:22:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2d00c4630 0x7fa2d013fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d0151b20 0x7fa2d01402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00c1fa0 con 0x7fa2d00c4630 2023-08-27T11:22:25.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d014fb10 con 0x7fa2d0151b20 2023-08-27T11:22:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.246+0000 7fa2d61ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d014fdb0 con 0x7fa2d006ad70 2023-08-27T11:22:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:52882/0 (socket says 172.21.15.57:52882) 2023-08-27T11:22:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 -- 172.21.15.57:0/2054277101 learned_addr learned my addr 172.21.15.57:0/2054277101 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:25.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cffff700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d0151b20 0x7fa2d01402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2ceffd700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2d00c4630 0x7fa2d013fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 -- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d0151b20 msgr2=0x7fa2d01402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d0151b20 0x7fa2d01402b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 -- 172.21.15.57:0/2054277101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2d00c4630 msgr2=0x7fa2d013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2d00c4630 0x7fa2d013fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 -- 172.21.15.57:0/2054277101 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c00094a0 con 0x7fa2d006ad70 2023-08-27T11:22:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.247+0000 7fa2cf7fe700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000ec10 tx=0x7fa2c000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0009760 con 0x7fa2d006ad70 2023-08-27T11:22:25.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000c850 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000cbe0 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c40094f0 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d014f730 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa2c0005a20 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.248+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa2c0005cd0 con 0x7fa2d006ad70 2023-08-27T11:22:25.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.249+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d0154d00 con 0x7fa2d006ad70 2023-08-27T11:22:25.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.254+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa2d0154d00 con 0x7fa2d006ad70 2023-08-27T11:22:25.344 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.343+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "702c4b2b-6ace-4df9-80d0-ce832acfcf28", "id": 3} v 0) v1 -- 0x7fa2d006c670 con 0x7fa2d006ad70 2023-08-27T11:22:25.349 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.348+0000 7fa2b7fff700 1 -- 172.21.15.57:0/2054277101 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "702c4b2b-6ace-4df9-80d0-ce832acfcf28", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2c0029020 con 0x7fa2d006ad70 2023-08-27T11:22:25.349 INFO:teuthology.orchestra.run.smithi057.stdout:3 2023-08-27T11:22:25.351 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 msgr2=0x7fa2d0152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000ec10 tx=0x7fa2c000ef20 comp rx=0 tx=0).stop 2023-08-27T11:22:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 shutdown_connections 2023-08-27T11:22:25.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2d0151b20 0x7fa2d01402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2d006ad70 0x7fa2d0152ca0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 --2- 172.21.15.57:0/2054277101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2d00c4630 0x7fa2d013fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 >> 172.21.15.57:0/2054277101 conn(0x7fa2d00ab820 msgr2=0x7fa2d00c8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 shutdown_connections 2023-08-27T11:22:25.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.349+0000 7fa2d61ff700 1 -- 172.21.15.57:0/2054277101 wait complete. 2023-08-27T11:22:25.367 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 64a32ef9-c07f-43c8-8b95-8b8aadf93ab5 4 2023-08-27T11:22:25.561 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.560+0000 7f29f79ff700 1 Processor -- start 2023-08-27T11:22:25.562 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.560+0000 7f29f79ff700 1 -- start start 2023-08-27T11:22:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.561+0000 7f29f79ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29f0151b20 0x7f29f00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.561+0000 7f29f79ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f006c450 con 0x7f29f00c4ae0 2023-08-27T11:22:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.561+0000 7f29f79ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f0154760 con 0x7f29f00c4630 2023-08-27T11:22:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.561+0000 7f29f79ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f0151f00 con 0x7f29f0151b20 2023-08-27T11:22:25.563 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29f0151b20 0x7f29f00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29f0151b20 0x7f29f00c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35894/0 (socket says 172.21.15.57:35894) 2023-08-27T11:22:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f4f9a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29f00c4630 0x7f29f006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37986/0 (socket says 172.21.15.57:37986) 2023-08-27T11:22:25.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 -- 172.21.15.57:0/3050429523 learned_addr learned my addr 172.21.15.57:0/3050429523 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 -- 172.21.15.57:0/3050429523 >> v1:172.21.15.57:6789/0 conn(0x7f29f00c4630 legacy=0x7f29f006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 -- 172.21.15.57:0/3050429523 >> v1:172.21.15.43:6789/0 conn(0x7f29f00c4ae0 legacy=0x7f29f006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 -- 172.21.15.57:0/3050429523 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f0154a40 con 0x7f29f0151b20 2023-08-27T11:22:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.562+0000 7f29f579b700 1 --2- 172.21.15.57:0/3050429523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f0151b20 0x7f29f00c7bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127312abb7d1be4c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29e7fff700 1 -- 172.21.15.57:0/3050429523 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00b8a0 con 0x7f29f0151b20 2023-08-27T11:22:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29e7fff700 1 -- 172.21.15.57:0/3050429523 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec00ba00 con 0x7f29f0151b20 2023-08-27T11:22:25.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29e7fff700 1 -- 172.21.15.57:0/3050429523 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00bd90 con 0x7f29f0151b20 2023-08-27T11:22:25.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 -- 172.21.15.57:0/3050429523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f0151b20 msgr2=0x7f29f00c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 --2- 172.21.15.57:0/3050429523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f0151b20 0x7f29f00c7bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:25.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 -- 172.21.15.57:0/3050429523 shutdown_connections 2023-08-27T11:22:25.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 --2- 172.21.15.57:0/3050429523 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f0151b20 0x7f29f00c7bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 -- 172.21.15.57:0/3050429523 >> 172.21.15.57:0/3050429523 conn(0x7f29f00ab820 msgr2=0x7f29f00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 -- 172.21.15.57:0/3050429523 shutdown_connections 2023-08-27T11:22:25.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.563+0000 7f29f79ff700 1 -- 172.21.15.57:0/3050429523 wait complete. 2023-08-27T11:22:25.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.565+0000 7f29f79ff700 1 Processor -- start 2023-08-27T11:22:25.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.565+0000 7f29f79ff700 1 -- start start 2023-08-27T11:22:25.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f00c4630 0x7f29f00bc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 0x7f29f014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01565e0 con 0x7f29f00c4630 2023-08-27T11:22:25.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f01ee1b0 con 0x7f29f00c4ae0 2023-08-27T11:22:25.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f79ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0157fe0 con 0x7f29f0151b20 2023-08-27T11:22:25.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f4f9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f4f9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35910/0 (socket says 172.21.15.57:35910) 2023-08-27T11:22:25.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f4f9a700 1 -- 172.21.15.57:0/1346672428 learned_addr learned my addr 172.21.15.57:0/1346672428 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:25.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f579b700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f00c4630 0x7f29f00bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.574 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.566+0000 7f29f5f9c700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 0x7f29f014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 -- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 msgr2=0x7f29f0155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 -- 172.21.15.57:0/1346672428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f00c4630 msgr2=0x7f29f00bc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f00c4630 0x7f29f00bc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 -- 172.21.15.57:0/1346672428 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009550 con 0x7f29f0151b20 2023-08-27T11:22:25.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f4f9a700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:25.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f5f9c700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 0x7f29f014f2d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29e800cb90 tx=0x7f29e800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e8003c00 con 0x7f29f0151b20 2023-08-27T11:22:25.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e8003d60 con 0x7f29f0151b20 2023-08-27T11:22:25.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800aa80 con 0x7f29f0151b20 2023-08-27T11:22:25.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f01582c0 con 0x7f29f0151b20 2023-08-27T11:22:25.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.567+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f014f810 con 0x7f29f0151b20 2023-08-27T11:22:25.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.568+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29e80050d0 con 0x7f29f0151b20 2023-08-27T11:22:25.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.568+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f29e8005890 con 0x7f29f0151b20 2023-08-27T11:22:25.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.568+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f01ee3f0 con 0x7f29f0151b20 2023-08-27T11:22:25.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.571+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f29e8005380 con 0x7f29f0151b20 2023-08-27T11:22:25.662 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.661+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "64a32ef9-c07f-43c8-8b95-8b8aadf93ab5", "id": 4} v 0) v1 -- 0x7f29f006c670 con 0x7f29f0151b20 2023-08-27T11:22:25.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.667+0000 7f29e5ffb700 1 -- 172.21.15.57:0/1346672428 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64a32ef9-c07f-43c8-8b95-8b8aadf93ab5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29e8005520 con 0x7f29f0151b20 2023-08-27T11:22:25.669 INFO:teuthology.orchestra.run.smithi057.stdout:4 2023-08-27T11:22:25.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.668+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 msgr2=0x7f29f014f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.668+0000 7f29f79ff700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 0x7f29f014f2d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29e800cb90 tx=0x7f29e800cea0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 shutdown_connections 2023-08-27T11:22:25.673 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f29f0151b20 0x7f29f014f2d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f29f00c4630 0x7f29f00bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 --2- 172.21.15.57:0/1346672428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29f00c4ae0 0x7f29f0155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.674 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 >> 172.21.15.57:0/1346672428 conn(0x7f29f00ab820 msgr2=0x7f29f006ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 shutdown_connections 2023-08-27T11:22:25.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.669+0000 7f29f79ff700 1 -- 172.21.15.57:0/1346672428 wait complete. 2023-08-27T11:22:25.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b 5 2023-08-27T11:22:25.916 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.915+0000 7f51e0bff700 1 Processor -- start 2023-08-27T11:22:25.917 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.915+0000 7f51e0bff700 1 -- start start 2023-08-27T11:22:25.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.916+0000 7f51e0bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 0x7f51dc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.918 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.916+0000 7f51e0bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc06c450 con 0x7f51dc0c4ab0 2023-08-27T11:22:25.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.916+0000 7f51e0bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc154760 con 0x7f51dc0c4630 2023-08-27T11:22:25.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.916+0000 7f51e0bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0c4f00 con 0x7f51dc151b20 2023-08-27T11:22:25.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51da59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 0x7f51dc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51d9d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f51dc0c4630 0x7f51dc06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37990/0 (socket says 172.21.15.57:37990) 2023-08-27T11:22:25.919 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51d9d9b700 1 -- 172.21.15.57:0/3645218239 learned_addr learned my addr 172.21.15.57:0/3645218239 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-08-27T11:22:25.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51da59c700 1 -- 172.21.15.57:0/3645218239 >> v1:172.21.15.57:6789/0 conn(0x7f51dc0c4630 legacy=0x7f51dc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51da59c700 1 -- 172.21.15.57:0/3645218239 >> v1:172.21.15.43:6789/0 conn(0x7f51dc0c4ab0 legacy=0x7f51dc06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51d959a700 1 -- 172.21.15.57:0/3645218239 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219592517 0 0) 0x7f51dc154760 con 0x7f51dc0c4630 2023-08-27T11:22:25.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51da59c700 1 -- 172.21.15.57:0/3645218239 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc154a40 con 0x7f51dc151b20 2023-08-27T11:22:25.920 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.917+0000 7f51da59c700 1 --2- 172.21.15.57:0/3645218239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 0x7f51dc0c7bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009870 tx=0x7f51cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d219f8e205e0ff54 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51d959a700 1 -- 172.21.15.57:0/3645218239 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011830 con 0x7f51dc151b20 2023-08-27T11:22:25.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51d959a700 1 -- 172.21.15.57:0/3645218239 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc011990 con 0x7f51dc151b20 2023-08-27T11:22:25.922 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51d959a700 1 -- 172.21.15.57:0/3645218239 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011d20 con 0x7f51dc151b20 2023-08-27T11:22:25.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51e0bff700 1 -- 172.21.15.57:0/3645218239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 msgr2=0x7f51dc0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51e0bff700 1 --2- 172.21.15.57:0/3645218239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 0x7f51dc0c7bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009870 tx=0x7f51cc009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:25.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51e0bff700 1 -- 172.21.15.57:0/3645218239 shutdown_connections 2023-08-27T11:22:25.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51e0bff700 1 --2- 172.21.15.57:0/3645218239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc151b20 0x7f51dc0c7bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.923 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.918+0000 7f51e0bff700 1 -- 172.21.15.57:0/3645218239 >> 172.21.15.57:0/3645218239 conn(0x7f51dc0ab820 msgr2=0x7f51dc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:25.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.919+0000 7f51e0bff700 1 -- 172.21.15.57:0/3645218239 shutdown_connections 2023-08-27T11:22:25.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.919+0000 7f51e0bff700 1 -- 172.21.15.57:0/3645218239 wait complete. 2023-08-27T11:22:25.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.920+0000 7f51e0bff700 1 Processor -- start 2023-08-27T11:22:25.924 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.920+0000 7f51e0bff700 1 -- start start 2023-08-27T11:22:25.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 0x7f51dc0c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51dc151b20 0x7f51dc1e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:25.927 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1e9ba0 con 0x7f51dc151b20 2023-08-27T11:22:25.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0bdd40 con 0x7f51dc0c4630 2023-08-27T11:22:25.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.921+0000 7f51e0bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1ea3e0 con 0x7f51dc0c4ab0 2023-08-27T11:22:25.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.928 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51d9d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 0x7f51dc0c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35916/0 (socket says 172.21.15.57:35916) 2023-08-27T11:22:25.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 -- 172.21.15.57:0/2832715837 learned_addr learned my addr 172.21.15.57:0/2832715837 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:25.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51dad9d700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51dc151b20 0x7f51dc1e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:25.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 -- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 msgr2=0x7f51dc0c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.929 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 0x7f51dc0c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 -- 172.21.15.57:0/2832715837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51dc151b20 msgr2=0x7f51dc1e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51dc151b20 0x7f51dc1e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 -- 172.21.15.57:0/2832715837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0094a0 con 0x7f51dc0c4630 2023-08-27T11:22:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51d9d9b700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 0x7f51dc0c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:25.930 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.922+0000 7f51da59c700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0097c0 tx=0x7f51cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0044c0 con 0x7f51dc0c4630 2023-08-27T11:22:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc01f070 con 0x7f51dc0c4630 2023-08-27T11:22:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0c0390 con 0x7f51dc0c4630 2023-08-27T11:22:25.931 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc0038e0 con 0x7f51dc0c4630 2023-08-27T11:22:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc1ea070 con 0x7f51dc0c4630 2023-08-27T11:22:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f51cc021030 con 0x7f51dc0c4630 2023-08-27T11:22:25.932 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.923+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f51cc003d40 con 0x7f51dc0c4630 2023-08-27T11:22:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.924+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc154fe0 con 0x7f51dc0c4630 2023-08-27T11:22:25.933 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:25.928+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f51dc154fe0 con 0x7f51dc0c4630 2023-08-27T11:22:25.951 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:25.950+0000 7f579c667200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-27T11:22:25.997 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:25.996+0000 7f3987705200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-27T11:22:26.020 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.018+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b", "id": 5} v 0) v1 -- 0x7f51dc04ee70 con 0x7f51dc0c4630 2023-08-27T11:22:26.023 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.022+0000 7f51caffd700 1 -- 172.21.15.57:0/2832715837 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f51cc033020 con 0x7f51dc0c4630 2023-08-27T11:22:26.024 INFO:teuthology.orchestra.run.smithi057.stdout:5 2023-08-27T11:22:26.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.023+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 msgr2=0x7f51dc0c2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.023+0000 7f51e0bff700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0097c0 tx=0x7f51cc004750 comp rx=0 tx=0).stop 2023-08-27T11:22:26.025 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 shutdown_connections 2023-08-27T11:22:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51dc151b20 0x7f51dc1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51dc0c4630 0x7f51dc0c2b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 --2- 172.21.15.57:0/2832715837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51dc0c4ab0 0x7f51dc0c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 >> 172.21.15.57:0/2832715837 conn(0x7f51dc0ab820 msgr2=0x7f51dc153c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 shutdown_connections 2023-08-27T11:22:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.024+0000 7f51e0bff700 1 -- 172.21.15.57:0/2832715837 wait complete. 2023-08-27T11:22:26.041 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:26.040+0000 7f579c667200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-27T11:22:26.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f 6 2023-08-27T11:22:26.097 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:26.096+0000 7f3987705200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-27T11:22:26.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.248+0000 7faa45bff700 1 Processor -- start 2023-08-27T11:22:26.249 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.248+0000 7faa45bff700 1 -- start start 2023-08-27T11:22:26.250 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa45bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faa4006ca60 0x7faa4006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa45bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4006d700 con 0x7faa400c51a0 2023-08-27T11:22:26.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa45bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa40152430 con 0x7faa40155910 2023-08-27T11:22:26.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa45bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa401530b0 con 0x7faa4006ca60 2023-08-27T11:22:26.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa3ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faa40155910 0x7faa40155d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38000/0 (socket says 172.21.15.57:38000) 2023-08-27T11:22:26.251 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa3ffff700 1 -- 172.21.15.57:0/3331956842 learned_addr learned my addr 172.21.15.57:0/3331956842 (peer_addr_for_me v1:172.21.15.57:0/0) 2023-08-27T11:22:26.252 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.249+0000 7faa3effd700 1 --2- 172.21.15.57:0/3331956842 >> v2:172.21.15.43:3300/0 conn(0x7faa4006ca60 0x7faa4006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703000020 0 0) 0x7faa40152430 con 0x7faa40155910 2023-08-27T11:22:26.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa280035b0 con 0x7faa40155910 2023-08-27T11:22:26.255 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137448307 0 0) 0x7faa4006d700 con 0x7faa400c51a0 2023-08-27T11:22:26.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa40152430 con 0x7faa400c51a0 2023-08-27T11:22:26.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3effd700 1 -- 172.21.15.57:0/3331956842 >> v1:172.21.15.57:6789/0 conn(0x7faa40155910 legacy=0x7faa40155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.256 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3effd700 1 -- 172.21.15.57:0/3331956842 >> v1:172.21.15.43:6789/0 conn(0x7faa400c51a0 legacy=0x7faa400aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3effd700 1 -- 172.21.15.57:0/3331956842 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40152710 con 0x7faa4006ca60 2023-08-27T11:22:26.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.250+0000 7faa3effd700 1 --2- 172.21.15.57:0/3331956842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa4006d1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa34009840 tx=0x7faa34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e8599c4508cc24 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:26.257 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011830 con 0x7faa4006ca60 2023-08-27T11:22:26.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa34011990 con 0x7faa4006ca60 2023-08-27T11:22:26.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa3e7fc700 1 -- 172.21.15.57:0/3331956842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa34011d20 con 0x7faa4006ca60 2023-08-27T11:22:26.258 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 -- 172.21.15.57:0/3331956842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 msgr2=0x7faa4006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 --2- 172.21.15.57:0/3331956842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa4006d1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faa34009840 tx=0x7faa34009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:26.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 -- 172.21.15.57:0/3331956842 shutdown_connections 2023-08-27T11:22:26.259 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 --2- 172.21.15.57:0/3331956842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa4006d1c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 -- 172.21.15.57:0/3331956842 >> 172.21.15.57:0/3331956842 conn(0x7faa4006aa50 msgr2=0x7faa400c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:26.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.251+0000 7faa45bff700 1 -- 172.21.15.57:0/3331956842 shutdown_connections 2023-08-27T11:22:26.260 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.252+0000 7faa45bff700 1 -- 172.21.15.57:0/3331956842 wait complete. 2023-08-27T11:22:26.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.253+0000 7faa45bff700 1 Processor -- start 2023-08-27T11:22:26.261 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.253+0000 7faa45bff700 1 -- start start 2023-08-27T11:22:26.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa400c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.264 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa40155910 0x7faa400a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa400bbb90 con 0x7faa4006ca60 2023-08-27T11:22:26.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401edc90 con 0x7faa400c51a0 2023-08-27T11:22:26.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa45bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa401ed760 con 0x7faa40155910 2023-08-27T11:22:26.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.265 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa3effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35932/0 (socket says 172.21.15.57:35932) 2023-08-27T11:22:26.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa3effd700 1 -- 172.21.15.57:0/1204482594 learned_addr learned my addr 172.21.15.57:0/1204482594 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:26.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa3f7fe700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa400c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.254+0000 7faa3ffff700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa40155910 0x7faa400a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 -- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa40155910 msgr2=0x7faa400a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.266 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa40155910 0x7faa400a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 -- 172.21.15.57:0/1204482594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 msgr2=0x7faa400c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa400c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 -- 172.21.15.57:0/1204482594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa340094a0 con 0x7faa400c51a0 2023-08-27T11:22:26.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa3effd700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa34009fd0 tx=0x7faa34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:26.267 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.255+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3401a8f0 con 0x7faa400c51a0 2023-08-27T11:22:26.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3401aa50 con 0x7faa400c51a0 2023-08-27T11:22:26.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400bc480 con 0x7faa400c51a0 2023-08-27T11:22:26.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3401adc0 con 0x7faa400c51a0 2023-08-27T11:22:26.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400c5f60 con 0x7faa400c51a0 2023-08-27T11:22:26.268 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa3402d6f0 con 0x7faa400c51a0 2023-08-27T11:22:26.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.256+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7faa34024620 con 0x7faa400c51a0 2023-08-27T11:22:26.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.257+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa400bb8f0 con 0x7faa400c51a0 2023-08-27T11:22:26.269 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.259+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faa400bb8f0 con 0x7faa400c51a0 2023-08-27T11:22:26.348 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.347+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f", "id": 6} v 0) v1 -- 0x7faa400bbcd0 con 0x7faa400c51a0 2023-08-27T11:22:26.352 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.351+0000 7faa27fff700 1 -- 172.21.15.57:0/1204482594 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa400bbcd0 con 0x7faa400c51a0 2023-08-27T11:22:26.352 INFO:teuthology.orchestra.run.smithi057.stdout:6 2023-08-27T11:22:26.353 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 msgr2=0x7faa400a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa34009fd0 tx=0x7faa34004750 comp rx=0 tx=0).stop 2023-08-27T11:22:26.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 shutdown_connections 2023-08-27T11:22:26.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faa40155910 0x7faa400a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faa4006ca60 0x7faa400c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.354 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 --2- 172.21.15.57:0/1204482594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa400c51a0 0x7faa400a6a50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 >> 172.21.15.57:0/1204482594 conn(0x7faa4006aa50 msgr2=0x7faa401dc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:26.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 shutdown_connections 2023-08-27T11:22:26.355 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.352+0000 7faa45bff700 1 -- 172.21.15.57:0/1204482594 wait complete. 2023-08-27T11:22:26.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 04163af4-2000-4db5-ab19-c6c00e55174f 7 2023-08-27T11:22:26.564 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.563+0000 7f2f7abff700 1 Processor -- start 2023-08-27T11:22:26.565 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.563+0000 7f2f7abff700 1 -- start start 2023-08-27T11:22:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.564+0000 7f2f7abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f740c4630 0x7f2f740c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7abff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7406ad70 0x7f2f7406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.566 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7abff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f740c82c0 con 0x7f2f74151b20 2023-08-27T11:22:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7abff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f74151f00 con 0x7f2f7406ad70 2023-08-27T11:22:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7406c450 con 0x7f2f740c4630 2023-08-27T11:22:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7406ad70 0x7f2f7406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f740c4630 0x7f2f740c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.567 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f7406ad70 0x7f2f7406b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35942/0 (socket says 172.21.15.57:35942) 2023-08-27T11:22:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7899b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2f74151b20 0x7f2f740c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38008/0 (socket says 172.21.15.57:38008) 2023-08-27T11:22:26.568 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 -- 172.21.15.57:0/4027764720 learned_addr learned my addr 172.21.15.57:0/4027764720 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 -- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f740c4630 msgr2=0x7f2f740c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 --2- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f740c4630 0x7f2f740c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 -- 172.21.15.57:0/4027764720 >> v1:172.21.15.57:6789/0 conn(0x7f2f74151b20 legacy=0x7f2f740c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.570 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.565+0000 7f2f7919c700 1 -- 172.21.15.57:0/4027764720 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74154760 con 0x7f2f7406ad70 2023-08-27T11:22:26.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f7919c700 1 --2- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7406ad70 0x7f2f7406b1c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009e50 tx=0x7f2f6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=def2f3e3450b5f71 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:26.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f737fe700 1 -- 172.21.15.57:0/4027764720 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00e070 con 0x7f2f7406ad70 2023-08-27T11:22:26.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f737fe700 1 -- 172.21.15.57:0/4027764720 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00b910 con 0x7f2f7406ad70 2023-08-27T11:22:26.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f737fe700 1 -- 172.21.15.57:0/4027764720 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00bcc0 con 0x7f2f7406ad70 2023-08-27T11:22:26.571 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f7abff700 1 -- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7406ad70 msgr2=0x7f2f7406b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.566+0000 7f2f7abff700 1 --2- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7406ad70 0x7f2f7406b1c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009e50 tx=0x7f2f6c00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 -- 172.21.15.57:0/4027764720 shutdown_connections 2023-08-27T11:22:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 --2- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7406ad70 0x7f2f7406b1c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 --2- 172.21.15.57:0/4027764720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f740c4630 0x7f2f740c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.572 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 -- 172.21.15.57:0/4027764720 >> 172.21.15.57:0/4027764720 conn(0x7f2f740ab820 msgr2=0x7f2f740abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:26.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 -- 172.21.15.57:0/4027764720 shutdown_connections 2023-08-27T11:22:26.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.567+0000 7f2f7abff700 1 -- 172.21.15.57:0/4027764720 wait complete. 2023-08-27T11:22:26.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.568+0000 7f2f7abff700 1 Processor -- start 2023-08-27T11:22:26.573 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 -- start start 2023-08-27T11:22:26.575 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f7406ad70 0x7f2f740c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 0x7f2f741eb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740c0d80 con 0x7f2f7406ad70 2023-08-27T11:22:26.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740c3aa0 con 0x7f2f740c4630 2023-08-27T11:22:26.576 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.569+0000 7f2f7abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740c0fd0 con 0x7f2f74151b20 2023-08-27T11:22:26.577 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35958/0 (socket says 172.21.15.57:35958) 2023-08-27T11:22:26.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f7919c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 0x7f2f741eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 -- 172.21.15.57:0/917818279 learned_addr learned my addr 172.21.15.57:0/917818279 (peer_addr_for_me v2:172.21.15.57:0/0) 2023-08-27T11:22:26.578 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f7899b700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f7406ad70 0x7f2f740c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 -- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 msgr2=0x7f2f741eb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 0x7f2f741eb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 -- 172.21.15.57:0/917818279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f7406ad70 msgr2=0x7f2f740c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f7406ad70 0x7f2f740c1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.579 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 -- 172.21.15.57:0/917818279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009b30 con 0x7f2f740c4630 2023-08-27T11:22:26.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f7919c700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 0x7f2f741eb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:26.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.570+0000 7f2f73fff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000e990 tx=0x7f2f6000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:26.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f600096f0 con 0x7f2f740c4630 2023-08-27T11:22:26.580 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000c690 con 0x7f2f740c4630 2023-08-27T11:22:26.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000ca00 con 0x7f2f740c4630 2023-08-27T11:22:26.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f740c12b0 con 0x7f2f740c4630 2023-08-27T11:22:26.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f740c6fd0 con 0x7f2f740c4630 2023-08-27T11:22:26.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f60013470 con 0x7f2f740c4630 2023-08-27T11:22:26.581 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.571+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2f60013d80 con 0x7f2f740c4630 2023-08-27T11:22:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.572+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f741eb030 con 0x7f2f740c4630 2023-08-27T11:22:26.582 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.574+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2f741eb030 con 0x7f2f740c4630 2023-08-27T11:22:26.664 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.663+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04163af4-2000-4db5-ab19-c6c00e55174f", "id": 7} v 0) v1 -- 0x7f2f7404ee70 con 0x7f2f740c4630 2023-08-27T11:22:26.669 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.668+0000 7f2f717fa700 1 -- 172.21.15.57:0/917818279 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04163af4-2000-4db5-ab19-c6c00e55174f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f6002a020 con 0x7f2f740c4630 2023-08-27T11:22:26.670 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-08-27T11:22:26.670 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 msgr2=0x7f2f741eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:26.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000e990 tx=0x7f2f6000eca0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.671 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 shutdown_connections 2023-08-27T11:22:26.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f74151b20 0x7f2f741eb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.675 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2f7406ad70 0x7f2f740c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 --2- 172.21.15.57:0/917818279 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f740c4630 0x7f2f741eb310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:26.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 >> 172.21.15.57:0/917818279 conn(0x7f2f740ab820 msgr2=0x7f2f7406b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:26.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 shutdown_connections 2023-08-27T11:22:26.676 INFO:teuthology.orchestra.run.smithi057.stderr:2023-08-27T11:22:26.669+0000 7f2f7abff700 1 -- 172.21.15.57:0/917818279 wait complete. 2023-08-27T11:22:26.688 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-27T11:22:26.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-27T11:22:26.693 INFO:tasks.ceph.osd.0:Started 2023-08-27T11:22:26.694 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-27T11:22:26.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-27T11:22:26.701 INFO:tasks.ceph.osd.1:Started 2023-08-27T11:22:26.701 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-27T11:22:26.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-27T11:22:26.706 INFO:tasks.ceph.osd.2:Started 2023-08-27T11:22:26.706 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-27T11:22:26.707 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-27T11:22:26.712 INFO:tasks.ceph.osd.3:Started 2023-08-27T11:22:26.713 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-27T11:22:26.713 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-27T11:22:26.719 INFO:tasks.ceph.osd.4:Started 2023-08-27T11:22:26.719 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-27T11:22:26.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-27T11:22:26.726 INFO:tasks.ceph.osd.5:Started 2023-08-27T11:22:26.726 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-27T11:22:26.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-27T11:22:26.732 INFO:tasks.ceph.osd.6:Started 2023-08-27T11:22:26.733 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-27T11:22:26.733 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-27T11:22:26.739 INFO:tasks.ceph.osd.7:Started 2023-08-27T11:22:26.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:26.977 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:26.975+0000 7f579c667200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-27T11:22:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.995+0000 7f9535dff700 1 Processor -- start 2023-08-27T11:22:26.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.996+0000 7f9535dff700 1 -- start start 2023-08-27T11:22:26.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9535dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95300c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9535dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f95300c4630 0x7f95300c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9535dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953006c4e0 con 0x7f953006ad70 2023-08-27T11:22:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9535dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9530155370 con 0x7f95300c4630 2023-08-27T11:22:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9535dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9530151e70 con 0x7f9530151a90 2023-08-27T11:22:26.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f952ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f953006ad70 0x7f953006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41780/0 (socket says 172.21.15.43:41780) 2023-08-27T11:22:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f9527fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f95300c4630 0x7f95300c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f952ffff700 1 -- 172.21.15.43:0/4166548999 learned_addr learned my addr 172.21.15.43:0/4166548999 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:27.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.997+0000 7f952f7fe700 1 --2- 172.21.15.43:0/4166548999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95300c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:27.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952effd700 1 -- 172.21.15.43:0/4166548999 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894287737 0 0) 0x7f953006c4e0 con 0x7f953006ad70 2023-08-27T11:22:27.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952f7fe700 1 -- 172.21.15.43:0/4166548999 >> v2:172.21.15.43:3300/0 conn(0x7f95300c4630 msgr2=0x7f95300c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:27.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952f7fe700 1 --2- 172.21.15.43:0/4166548999 >> v2:172.21.15.43:3300/0 conn(0x7f95300c4630 0x7f95300c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952f7fe700 1 -- 172.21.15.43:0/4166548999 >> v1:172.21.15.43:6789/0 conn(0x7f953006ad70 legacy=0x7f953006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952f7fe700 1 -- 172.21.15.43:0/4166548999 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530154480 con 0x7f9530151a90 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952f7fe700 1 --2- 172.21.15.43:0/4166548999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95300c7bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9520009840 tx=0x7f9520009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431c2bcb508ed51d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952effd700 1 -- 172.21.15.43:0/4166548999 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011830 con 0x7f9530151a90 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952effd700 1 -- 172.21.15.43:0/4166548999 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520011990 con 0x7f9530151a90 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.998+0000 7f952effd700 1 -- 172.21.15.43:0/4166548999 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520011d20 con 0x7f9530151a90 2023-08-27T11:22:27.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 -- 172.21.15.43:0/4166548999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 msgr2=0x7f95300c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:27.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 --2- 172.21.15.43:0/4166548999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95300c7bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9520009840 tx=0x7f9520009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:27.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 -- 172.21.15.43:0/4166548999 shutdown_connections 2023-08-27T11:22:27.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 --2- 172.21.15.43:0/4166548999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95300c7bb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 --2- 172.21.15.43:0/4166548999 >> v2:172.21.15.43:3300/0 conn(0x7f95300c4630 0x7f95300c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 -- 172.21.15.43:0/4166548999 >> 172.21.15.43:0/4166548999 conn(0x7f95300ab820 msgr2=0x7f95300abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 -- 172.21.15.43:0/4166548999 shutdown_connections 2023-08-27T11:22:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:26.999+0000 7f9535dff700 1 -- 172.21.15.43:0/4166548999 wait complete. 2023-08-27T11:22:27.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.001+0000 7f9535dff700 1 Processor -- start 2023-08-27T11:22:27.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.002+0000 7f9535dff700 1 -- start start 2023-08-27T11:22:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95300c4630 0x7f95300aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:27.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95301535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9530150900 con 0x7f95300c4630 2023-08-27T11:22:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300ab480 con 0x7f953006ad70 2023-08-27T11:22:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9535dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9530147410 con 0x7f9530151a90 2023-08-27T11:22:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:27.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f952f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:39524/0 (socket says 172.21.15.43:39524) 2023-08-27T11:22:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f952f7fe700 1 -- 172.21.15.43:0/3214156693 learned_addr learned my addr 172.21.15.43:0/3214156693 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f9527fff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95300c4630 0x7f95300aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.003+0000 7f952ffff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95301535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 -- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 msgr2=0x7f95301535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95301535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 -- 172.21.15.43:0/3214156693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95300c4630 msgr2=0x7f95300aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95300c4630 0x7f95300aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 -- 172.21.15.43:0/3214156693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95200094a0 con 0x7f953006ad70 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952f7fe700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200036a0 con 0x7f953006ad70 2023-08-27T11:22:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952001f070 con 0x7f953006ad70 2023-08-27T11:22:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520003a60 con 0x7f953006ad70 2023-08-27T11:22:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.004+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95300ab1a0 con 0x7f953006ad70 2023-08-27T11:22:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.005+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95301edbb0 con 0x7f953006ad70 2023-08-27T11:22:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.005+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9520026480 con 0x7f953006ad70 2023-08-27T11:22:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.005+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9520021070 con 0x7f953006ad70 2023-08-27T11:22:27.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.005+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953004ee70 con 0x7f953006ad70 2023-08-27T11:22:27.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.008+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9520046b00 con 0x7f953006ad70 2023-08-27T11:22:27.026 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:27.025+0000 7f3987705200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-27T11:22:27.084 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:27.082+0000 7f579c667200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-27T11:22:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.085+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95300c4e90 con 0x7f953006ad70 2023-08-27T11:22:27.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.086+0000 7f952cff9700 1 -- 172.21.15.43:0/3214156693 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9520035030 con 0x7f953006ad70 2023-08-27T11:22:27.087 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:27.087 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:26.665533+0000","last_up_change":"0.000000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 msgr2=0x7f95300bd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:27.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9520009fd0 tx=0x7f9520004750 comp rx=0 tx=0).stop 2023-08-27T11:22:27.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 shutdown_connections 2023-08-27T11:22:27.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9530151a90 0x7f95301535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f953006ad70 0x7f95300bd7e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 --2- 172.21.15.43:0/3214156693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95300c4630 0x7f95300aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 >> 172.21.15.43:0/3214156693 conn(0x7f95300ab820 msgr2=0x7f953014e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 shutdown_connections 2023-08-27T11:22:27.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:27.087+0000 7f9535dff700 1 -- 172.21.15.43:0/3214156693 wait complete. 2023-08-27T11:22:27.115 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-27T11:22:27.115 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-27T11:22:27.132 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:27.131+0000 7f3987705200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-27T11:22:27.279 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:27.278+0000 7f579c667200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-27T11:22:27.319 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:27.318+0000 7f3987705200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-27T11:22:27.429 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-08-27T11:22:27.428+0000 7fcd61d7b640 -1 Falling back to public interface 2023-08-27T11:22:27.431 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-08-27T11:22:27.430+0000 7ff4cd287640 -1 Falling back to public interface 2023-08-27T11:22:27.431 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-08-27T11:22:27.430+0000 7f3ad4ab9640 -1 Falling back to public interface 2023-08-27T11:22:27.432 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-08-27T11:22:27.430+0000 7f3ac69fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-08-27T11:22:27.432 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-08-27T11:22:27.431+0000 7f717caf7640 -1 Falling back to public interface 2023-08-27T11:22:27.443 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-08-27T11:22:27.442+0000 7f54a4e90640 -1 Falling back to public interface 2023-08-27T11:22:27.445 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-08-27T11:22:27.444+0000 7fb85692e640 -1 Falling back to public interface 2023-08-27T11:22:27.447 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-08-27T11:22:27.446+0000 7f8d6c08b640 -1 Falling back to public interface 2023-08-27T11:22:27.468 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-08-27T11:22:27.467+0000 7ff7fe73d640 -1 Falling back to public interface 2023-08-27T11:22:27.597 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:27.596+0000 7f579c667200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-27T11:22:27.636 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:27.635+0000 7f3987705200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-27T11:22:27.857 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:27.856+0000 7f579c667200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-27T11:22:27.898 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:27.897+0000 7f3987705200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-27T11:22:27.922 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:28.033 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:28.032+0000 7f579c667200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-27T11:22:28.073 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:28.072+0000 7f3987705200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-27T11:22:28.101 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.099+0000 7f7bdb3ff700 1 Processor -- start 2023-08-27T11:22:28.101 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.099+0000 7f7bdb3ff700 1 -- start start 2023-08-27T11:22:28.101 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.100+0000 7f7bdb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 0x7f7bd40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:28.103 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bdb3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40c80f0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.103 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bdb3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40c9b10 con 0x7f7bd40c5480 2023-08-27T11:22:28.104 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bdb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd406b330 con 0x7f7bd4151e00 2023-08-27T11:22:28.104 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd999c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7bd40c5b40 0x7f7bd406a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41790/0 (socket says 172.21.15.43:41790) 2023-08-27T11:22:28.104 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd999c700 1 -- 172.21.15.43:0/2952331054 learned_addr learned my addr 172.21.15.43:0/2952331054 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:28.104 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd919b700 1 --2- 172.21.15.43:0/2952331054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 0x7f7bd40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:28.105 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38646900 0 0) 0x7f7bd40c80f0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.105 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc00035b0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.105 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698648143 0 0) 0x7f7bc4001110 con 0x7f7bd40c5480 2023-08-27T11:22:28.105 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd919b700 1 -- 172.21.15.43:0/2952331054 >> v1:172.21.15.57:6789/0 conn(0x7f7bd40c5480 legacy=0x7f7bd40c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.105 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd919b700 1 -- 172.21.15.43:0/2952331054 >> v1:172.21.15.43:6789/0 conn(0x7f7bd40c5b40 legacy=0x7f7bd406a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.106 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.101+0000 7f7bd919b700 1 -- 172.21.15.43:0/2952331054 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40c6070 con 0x7f7bd4151e00 2023-08-27T11:22:28.106 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.102+0000 7f7bd919b700 1 --2- 172.21.15.43:0/2952331054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 0x7f7bd40c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009870 tx=0x7f7bd0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb98617333ee1a19 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:28.106 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.102+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0011830 con 0x7f7bd4151e00 2023-08-27T11:22:28.106 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.102+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd0011990 con 0x7f7bd4151e00 2023-08-27T11:22:28.106 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.102+0000 7f7bcbfff700 1 -- 172.21.15.43:0/2952331054 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0011d20 con 0x7f7bd4151e00 2023-08-27T11:22:28.109 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/2952331054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 msgr2=0x7f7bd40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.109 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/2952331054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 0x7f7bd40c7bb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009870 tx=0x7f7bd0009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:28.110 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/2952331054 shutdown_connections 2023-08-27T11:22:28.110 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/2952331054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4151e00 0x7f7bd40c7bb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.110 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/2952331054 >> 172.21.15.43:0/2952331054 conn(0x7f7bd40ab7a0 msgr2=0x7f7bd40abbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:28.110 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/2952331054 shutdown_connections 2023-08-27T11:22:28.110 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.103+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/2952331054 wait complete. 2023-08-27T11:22:28.111 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.105+0000 7f7bdb3ff700 1 Processor -- start 2023-08-27T11:22:28.111 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.105+0000 7f7bdb3ff700 1 -- start start 2023-08-27T11:22:28.111 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:28.111 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 0x7f7bd40c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:28.111 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4151e00 0x7f7bd414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:28.112 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c1b50 con 0x7f7bd40c5480 2023-08-27T11:22:28.112 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c1790 con 0x7f7bd4151e00 2023-08-27T11:22:28.112 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bdb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c2ea0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.112 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:28.112 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 0x7f7bd40c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55512/0 (socket says 172.21.15.43:55512) 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd999c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4151e00 0x7f7bd414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd919b700 1 -- 172.21.15.43:0/4187576391 learned_addr learned my addr 172.21.15.43:0/4187576391 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 -- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4151e00 msgr2=0x7f7bd414aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4151e00 0x7f7bd414aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.113 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 -- 172.21.15.43:0/4187576391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 msgr2=0x7f7bd4155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.114 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.114 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd899a700 1 -- 172.21.15.43:0/4187576391 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00094a0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.114 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.106+0000 7f7bd919b700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:28.114 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bd899a700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 0x7f7bd40c1f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40c5900 tx=0x7f7bc400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:28.114 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40054e0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.115 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4003680 con 0x7f7bd40c5b40 2023-08-27T11:22:28.115 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4003a30 con 0x7f7bd40c5b40 2023-08-27T11:22:28.115 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd40c3180 con 0x7f7bd40c5b40 2023-08-27T11:22:28.115 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd41547c0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.115 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7bc401c440 con 0x7f7bd40c5b40 2023-08-27T11:22:28.116 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.107+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7bc401cdc0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.116 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.108+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd404ee70 con 0x7f7bd40c5b40 2023-08-27T11:22:28.116 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.111+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7bc4017070 con 0x7f7bd40c5b40 2023-08-27T11:22:28.187 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.185+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd40c18d0 con 0x7f7bd40c5b40 2023-08-27T11:22:28.187 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.186+0000 7f7bc9ffb700 1 -- 172.21.15.43:0/4187576391 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7bd40c9b10 con 0x7f7bd40c5b40 2023-08-27T11:22:28.188 INFO:teuthology.misc.health.smithi043.stdout: 2023-08-27T11:22:28.188 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":10,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:26.665533+0000","last_up_change":"0.000000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:28.189 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 msgr2=0x7f7bd40c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:28.189 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 0x7f7bd40c1f70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40c5900 tx=0x7f7bc400ca30 comp rx=0 tx=0).stop 2023-08-27T11:22:28.190 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 shutdown_connections 2023-08-27T11:22:28.190 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd4151e00 0x7f7bd414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.190 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd40c5480 0x7f7bd4155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.190 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 --2- 172.21.15.43:0/4187576391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd40c5b40 0x7f7bd40c1f70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:28.190 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.187+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 >> 172.21.15.43:0/4187576391 conn(0x7f7bd40ab7a0 msgr2=0x7f7bd40aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:28.191 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.188+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 shutdown_connections 2023-08-27T11:22:28.191 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:28.188+0000 7f7bdb3ff700 1 -- 172.21.15.43:0/4187576391 wait complete. 2023-08-27T11:22:28.203 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-27T11:22:28.332 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:28.331+0000 7f579c667200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-27T11:22:28.364 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:28.363+0000 7f3987705200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-27T11:22:28.539 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:28.538+0000 7f579c667200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-27T11:22:28.574 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:28.572+0000 7f3987705200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-27T11:22:28.691 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:28.690+0000 7f579c667200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-27T11:22:28.729 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:28.728+0000 7f3987705200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-27T11:22:29.089 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:29.087+0000 7f579c667200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-27T11:22:29.128 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:29.127+0000 7f3987705200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-27T11:22:29.219 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:29.217+0000 7f579c667200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-27T11:22:29.260 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:29.259+0000 7f3987705200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-27T11:22:29.461 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:29.460+0000 7f579c667200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-27T11:22:29.505 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:29.503+0000 7f3987705200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-27T11:22:30.296 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:30.295+0000 7f579c667200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-27T11:22:30.355 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-08-27T11:22:30.353+0000 7f3987705200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-27T11:22:31.005 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-08-27T11:22:31.004+0000 7f8d6c08b640 -1 osd.3 0 log_to_monitors true 2023-08-27T11:22:31.015 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-08-27T11:22:31.013+0000 7ff4cd287640 -1 osd.4 0 log_to_monitors true 2023-08-27T11:22:31.048 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-08-27T11:22:31.047+0000 7fb85692e640 -1 osd.5 0 log_to_monitors true 2023-08-27T11:22:31.096 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-08-27T11:22:31.094+0000 7ff7fe73d640 -1 osd.7 0 log_to_monitors true 2023-08-27T11:22:31.268 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-08-27T11:22:31.267+0000 7fcd61d7b640 -1 osd.0 0 log_to_monitors true 2023-08-27T11:22:31.272 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-08-27T11:22:31.271+0000 7f717caf7640 -1 osd.1 0 log_to_monitors true 2023-08-27T11:22:31.278 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-08-27T11:22:31.277+0000 7f54a4e90640 -1 osd.2 0 log_to_monitors true 2023-08-27T11:22:31.281 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-08-27T11:22:31.280+0000 7f3ad4ab9640 -1 osd.6 0 log_to_monitors true 2023-08-27T11:22:31.315 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:31.314+0000 7f574fffa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-27T11:22:31.316 INFO:tasks.ceph.mgr.y.smithi043.stderr:2023-08-27T11:22:31.315+0000 7f574fffa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-27T11:22:33.861 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-08-27T11:22:33.860+0000 7fcd503f6700 -1 osd.0 0 waiting for initial osdmap 2023-08-27T11:22:33.887 INFO:tasks.ceph.osd.0.smithi043.stderr:2023-08-27T11:22:33.885+0000 7fcd483fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:33.904 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-08-27T11:22:33.902+0000 7f54935f6700 -1 osd.2 0 waiting for initial osdmap 2023-08-27T11:22:33.920 INFO:tasks.ceph.osd.2.smithi043.stderr:2023-08-27T11:22:33.919+0000 7f548b5fb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:33.938 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-08-27T11:22:33.937+0000 7f8d5a7f6700 -1 osd.3 0 waiting for initial osdmap 2023-08-27T11:22:33.944 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-08-27T11:22:33.943+0000 7f716b1f6700 -1 osd.1 0 waiting for initial osdmap 2023-08-27T11:22:33.954 INFO:tasks.ceph.osd.3.smithi043.stderr:2023-08-27T11:22:33.953+0000 7f8d527fb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:33.959 INFO:tasks.ceph.osd.1.smithi043.stderr:2023-08-27T11:22:33.958+0000 7f71631fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:34.417 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-08-27T11:22:34.416+0000 7ff7ecdf6700 -1 osd.7 0 waiting for initial osdmap 2023-08-27T11:22:34.428 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-08-27T11:22:34.427+0000 7fb844ff6700 -1 osd.5 0 waiting for initial osdmap 2023-08-27T11:22:34.443 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-08-27T11:22:34.441+0000 7ff4bb9f6700 -1 osd.4 0 waiting for initial osdmap 2023-08-27T11:22:34.450 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-08-27T11:22:34.449+0000 7ff7e4dfb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:34.454 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-08-27T11:22:34.453+0000 7fb83cffb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:34.462 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-08-27T11:22:34.461+0000 7f3ac31f6700 -1 osd.6 0 waiting for initial osdmap 2023-08-27T11:22:34.468 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-08-27T11:22:34.467+0000 7ff4b39fb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:34.479 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-08-27T11:22:34.478+0000 7f3abb1fb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-27T11:22:35.011 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:35.196 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.194+0000 7fb4523ff700 1 Processor -- start 2023-08-27T11:22:35.196 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.195+0000 7fb4523ff700 1 -- start start 2023-08-27T11:22:35.199 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb4523ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb44c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.200 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb4523ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0c4f80 con 0x7fb44c0c7d40 2023-08-27T11:22:35.200 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb4523ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c154ba0 con 0x7fb44c0c4710 2023-08-27T11:22:35.200 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb4523ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c158a30 con 0x7fb44c0c4af0 2023-08-27T11:22:35.200 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb44b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb44c0c7d40 0x7fb44c154490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45998/0 (socket says 172.21.15.43:45998) 2023-08-27T11:22:35.200 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb44b7fe700 1 -- 172.21.15.43:0/1800537782 learned_addr learned my addr 172.21.15.43:0/1800537782 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:35.201 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.196+0000 7fb45099c700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb44c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.201 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892459660 0 0) 0x7fb440001110 con 0x7fb44c0c7d40 2023-08-27T11:22:35.201 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4340035b0 con 0x7fb44c0c7d40 2023-08-27T11:22:35.201 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952524171 0 0) 0x7fb44c154ba0 con 0x7fb44c0c4710 2023-08-27T11:22:35.201 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440001110 con 0x7fb44c0c4710 2023-08-27T11:22:35.202 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768402520 0 0) 0x7fb4340035b0 con 0x7fb44c0c7d40 2023-08-27T11:22:35.202 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 msgr2=0x7fb44c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:35.202 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb44c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.202 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 >> v1:172.21.15.57:6789/0 conn(0x7fb44c0c4710 legacy=0x7fb44c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.202 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c154e00 con 0x7fb44c0c7d40 2023-08-27T11:22:35.203 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb440001800 con 0x7fb44c0c7d40 2023-08-27T11:22:35.203 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 >> v1:172.21.15.43:6789/0 conn(0x7fb44c0c7d40 legacy=0x7fb44c154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.203 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb434003bc0 0x7fb434003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.203 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb434004850 0x7fb434004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.203 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb434005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.204 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c158a30 con 0x7fb434003bc0 2023-08-27T11:22:35.205 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400bba0 con 0x7fb434004850 2023-08-27T11:22:35.205 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43400bd30 con 0x7fb44c0c4af0 2023-08-27T11:22:35.205 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.197+0000 7fb44bfff700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb434003bc0 0x7fb434003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.205 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44b7fe700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb434004850 0x7fb434004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.206 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb45099c700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb434005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.206 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 -- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 msgr2=0x7fb434005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:35.206 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb44c0c4af0 0x7fb434005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.206 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 -- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb434004850 msgr2=0x7fb434004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:35.206 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb434004850 0x7fb434004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.207 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 -- 172.21.15.43:0/1800537782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4340035b0 con 0x7fb434003bc0 2023-08-27T11:22:35.207 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44bfff700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb434003bc0 0x7fb434003fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0019b0 tx=0x7fb434005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a689bd889fd2269 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.207 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c001470 con 0x7fb434003bc0 2023-08-27T11:22:35.207 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0052d0 con 0x7fb434003bc0 2023-08-27T11:22:35.207 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.198+0000 7fb44affd700 1 -- 172.21.15.43:0/1800537782 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c003680 con 0x7fb434003bc0 2023-08-27T11:22:35.211 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 -- 172.21.15.43:0/1800537782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb434003bc0 msgr2=0x7fb434003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.212 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 --2- 172.21.15.43:0/1800537782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb434003bc0 0x7fb434003fc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0019b0 tx=0x7fb434005880 comp rx=0 tx=0).stop 2023-08-27T11:22:35.213 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb45099c700 1 -- 172.21.15.43:0/1800537782 reap_dead start 2023-08-27T11:22:35.213 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 -- 172.21.15.43:0/1800537782 shutdown_connections 2023-08-27T11:22:35.213 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 -- 172.21.15.43:0/1800537782 >> 172.21.15.43:0/1800537782 conn(0x7fb44c071970 msgr2=0x7fb44c071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:35.213 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 -- 172.21.15.43:0/1800537782 shutdown_connections 2023-08-27T11:22:35.213 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.199+0000 7fb4523ff700 1 -- 172.21.15.43:0/1800537782 wait complete. 2023-08-27T11:22:35.214 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.201+0000 7fb4523ff700 1 Processor -- start 2023-08-27T11:22:35.214 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.201+0000 7fb4523ff700 1 -- start start 2023-08-27T11:22:35.214 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb434003bc0 0x7fb44c0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.214 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c14a270 0x7fb44c1ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.214 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.215 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c1eb8a0 con 0x7fb44c1eaed0 2023-08-27T11:22:35.215 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c2dd0 con 0x7fb44c14a270 2023-08-27T11:22:35.215 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.202+0000 7fb4523ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c156e30 con 0x7fb434003bc0 2023-08-27T11:22:35.215 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.215 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb44b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c14a270 0x7fb44c1ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.216 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44076/0 (socket says 172.21.15.43:44076) 2023-08-27T11:22:35.216 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 -- 172.21.15.43:0/3346554056 learned_addr learned my addr 172.21.15.43:0/3346554056 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:35.216 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb44bfff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb434003bc0 0x7fb44c0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.216 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 -- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb434003bc0 msgr2=0x7fb44c0c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.216 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb434003bc0 0x7fb44c0c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.217 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 -- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c14a270 msgr2=0x7fb44c1ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.217 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c14a270 0x7fb44c1ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.217 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 -- 172.21.15.43:0/3346554056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c1eda10 con 0x7fb44c1eaed0 2023-08-27T11:22:35.217 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb45099c700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb44c157a50 tx=0x7fb444011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.217 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400e040 con 0x7fb44c1eaed0 2023-08-27T11:22:35.218 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400f040 con 0x7fb44c1eaed0 2023-08-27T11:22:35.218 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1edcf0 con 0x7fb44c1eaed0 2023-08-27T11:22:35.218 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.203+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400fe40 con 0x7fb44c1eaed0 2023-08-27T11:22:35.218 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.204+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c1ed710 con 0x7fb44c1eaed0 2023-08-27T11:22:35.218 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.205+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0c5b70 con 0x7fb44c1eaed0 2023-08-27T11:22:35.219 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.205+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fb444015430 con 0x7fb44c1eaed0 2023-08-27T11:22:35.219 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.206+0000 7fb448ff9700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 0x7fb43806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.219 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.206+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb4440886a0 con 0x7fb44c1eaed0 2023-08-27T11:22:35.219 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.207+0000 7fb44bfff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 0x7fb43806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.219 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.207+0000 7fb44bfff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 0x7fb43806c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0c0600 tx=0x7fb43c00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.220 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.211+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb444054490 con 0x7fb44c1eaed0 2023-08-27T11:22:35.422 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.421+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44c1ede80 con 0x7fb44c1eaed0 2023-08-27T11:22:35.423 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.422+0000 7fb448ff9700 1 -- 172.21.15.43:0/3346554056 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7fb444057ab0 con 0x7fb44c1eaed0 2023-08-27T11:22:35.423 INFO:teuthology.misc.health.smithi043.stdout: 2023-08-27T11:22:35.424 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":13,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:34.862571+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:35.425 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 msgr2=0x7fb43806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.426 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 0x7fb43806c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0c0600 tx=0x7fb43c00a000 comp rx=0 tx=0).stop 2023-08-27T11:22:35.426 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 msgr2=0x7fb44c1eb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.426 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb44c157a50 tx=0x7fb444011f60 comp rx=0 tx=0).stop 2023-08-27T11:22:35.426 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 shutdown_connections 2023-08-27T11:22:35.426 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb43806a050 0x7fb43806c510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.427 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb44c1eaed0 0x7fb44c1eb360 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.427 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb434003bc0 0x7fb44c0c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.427 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 --2- 172.21.15.43:0/3346554056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb44c14a270 0x7fb44c1ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.427 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 >> 172.21.15.43:0/3346554056 conn(0x7fb44c071970 msgr2=0x7fb44c0c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:35.428 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 shutdown_connections 2023-08-27T11:22:35.428 INFO:teuthology.misc.health.smithi043.stderr:2023-08-27T11:22:35.424+0000 7fb4523ff700 1 -- 172.21.15.43:0/3346554056 wait complete. 2023-08-27T11:22:35.442 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-27T11:22:35.442 INFO:tasks.ceph:Creating RBD pool 2023-08-27T11:22:35.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-27T11:22:35.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.636+0000 7fdd863ff700 1 Processor -- start 2023-08-27T11:22:35.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.636+0000 7fdd863ff700 1 -- start start 2023-08-27T11:22:35.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd863ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdd80151d20 0x7fdd800c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd8006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd863ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd80154660 con 0x7fdd800c7c00 2023-08-27T11:22:35.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd863ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd800c5750 con 0x7fdd80151d20 2023-08-27T11:22:35.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd863ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd80154940 con 0x7fdd8006a8e0 2023-08-27T11:22:35.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd7ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdd80151d20 0x7fdd800c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd7f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdd800c7c00 0x7fdd800ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46012/0 (socket says 172.21.15.43:46012) 2023-08-27T11:22:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.637+0000 7fdd7f7fe700 1 -- 172.21.15.43:0/2021453651 learned_addr learned my addr 172.21.15.43:0/2021453651 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd8499c700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd8006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7ffff700 1 -- 172.21.15.43:0/2021453651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 msgr2=0x7fdd8006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:35.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7ffff700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd8006ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7ffff700 1 -- 172.21.15.43:0/2021453651 >> v1:172.21.15.43:6789/0 conn(0x7fdd800c7c00 legacy=0x7fdd800ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7ffff700 1 -- 172.21.15.43:0/2021453651 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80154c20 con 0x7fdd80151d20 2023-08-27T11:22:35.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7effd700 1 -- 172.21.15.43:0/2021453651 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33263377 0 0) 0x7fdd80154660 con 0x7fdd800c7c00 2023-08-27T11:22:35.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7ffff700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd800c8110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009840 tx=0x7fdd70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0d95b2c389563a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7effd700 1 -- 172.21.15.43:0/2021453651 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70011830 con 0x7fdd80151d20 2023-08-27T11:22:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7effd700 1 -- 172.21.15.43:0/2021453651 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70011990 con 0x7fdd80151d20 2023-08-27T11:22:35.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.638+0000 7fdd7effd700 1 -- 172.21.15.43:0/2021453651 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70011d20 con 0x7fdd80151d20 2023-08-27T11:22:35.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 -- 172.21.15.43:0/2021453651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 msgr2=0x7fdd800c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd800c8110 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009840 tx=0x7fdd70009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:35.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 -- 172.21.15.43:0/2021453651 shutdown_connections 2023-08-27T11:22:35.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd8006ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 --2- 172.21.15.43:0/2021453651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd800c8110 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 -- 172.21.15.43:0/2021453651 >> 172.21.15.43:0/2021453651 conn(0x7fdd800c9d00 msgr2=0x7fdd800ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:35.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 -- 172.21.15.43:0/2021453651 shutdown_connections 2023-08-27T11:22:35.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.639+0000 7fdd863ff700 1 -- 172.21.15.43:0/2021453651 wait complete. 2023-08-27T11:22:35.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.641+0000 7fdd863ff700 1 Processor -- start 2023-08-27T11:22:35.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.641+0000 7fdd863ff700 1 -- start start 2023-08-27T11:22:35.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd80158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 0x7fdd800c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800c2b00 con 0x7fdd80151d20 2023-08-27T11:22:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd801e9a50 con 0x7fdd800c7c00 2023-08-27T11:22:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd863ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8014ce90 con 0x7fdd8006a8e0 2023-08-27T11:22:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd8499c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd8499c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44082/0 (socket says 172.21.15.43:44082) 2023-08-27T11:22:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd8499c700 1 -- 172.21.15.43:0/7322573 learned_addr learned my addr 172.21.15.43:0/7322573 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd7ffff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd80158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.642+0000 7fdd7f7fe700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 0x7fdd800c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 -- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 msgr2=0x7fdd80158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd80158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 -- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 msgr2=0x7fdd800c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 0x7fdd800c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 -- 172.21.15.43:0/7322573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700094a0 con 0x7fdd80151d20 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd7f7fe700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 0x7fdd800c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd8499c700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd78007e40 tx=0x7fdd7800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800ede0 con 0x7fdd80151d20 2023-08-27T11:22:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78014420 con 0x7fdd80151d20 2023-08-27T11:22:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd800c3810 con 0x7fdd80151d20 2023-08-27T11:22:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780147d0 con 0x7fdd80151d20 2023-08-27T11:22:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.643+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd801e9670 con 0x7fdd80151d20 2023-08-27T11:22:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.644+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd801e9c00 con 0x7fdd80151d20 2023-08-27T11:22:35.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.645+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fdd78014930 con 0x7fdd80151d20 2023-08-27T11:22:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.646+0000 7fdd7cff9700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 0x7fdd6c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.646+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fdd780885e0 con 0x7fdd80151d20 2023-08-27T11:22:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.647+0000 7fdd7ffff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 0x7fdd6c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.647+0000 7fdd7ffff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 0x7fdd6c06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd700090b0 tx=0x7fdd7001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.651+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdd78054340 con 0x7fdd80151d20 2023-08-27T11:22:35.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.863+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fdd8004ee70 con 0x7fdd80151d20 2023-08-27T11:22:35.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.911+0000 7fdd7cff9700 1 -- 172.21.15.43:0/7322573 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fdd78057960 con 0x7fdd80151d20 2023-08-27T11:22:35.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 msgr2=0x7fdd6c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 0x7fdd6c06c510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd700090b0 tx=0x7fdd7001c040 comp rx=0 tx=0).stop 2023-08-27T11:22:35.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 msgr2=0x7fdd8014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd78007e40 tx=0x7fdd7800e3c0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 shutdown_connections 2023-08-27T11:22:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdd6c06a050 0x7fdd6c06c510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdd80151d20 0x7fdd8014c950 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdd8006a8e0 0x7fdd80158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 --2- 172.21.15.43:0/7322573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdd800c7c00 0x7fdd800c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 >> 172.21.15.43:0/7322573 conn(0x7fdd800c9d00 msgr2=0x7fdd800c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.913+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 shutdown_connections 2023-08-27T11:22:35.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:35.914+0000 7fdd863ff700 1 -- 172.21.15.43:0/7322573 wait complete. 2023-08-27T11:22:35.918 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2023-08-27T11:22:35.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-27T11:22:36.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.131+0000 7f257efff700 1 Processor -- start 2023-08-27T11:22:36.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.131+0000 7f257efff700 1 -- start start 2023-08-27T11:22:36.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257efff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2578151a40 0x7f25780c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257efff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f257806b780 0x7f257806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257efff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578154730 con 0x7f25780c81c0 2023-08-27T11:22:36.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257efff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2578154520 con 0x7f257806b780 2023-08-27T11:22:36.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257efff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2578154a10 con 0x7f2578151a40 2023-08-27T11:22:36.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f2577fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f25780c81c0 0x7f25780c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46016/0 (socket says 172.21.15.43:46016) 2023-08-27T11:22:36.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f2577fff700 1 -- 172.21.15.43:0/2535325149 learned_addr learned my addr 172.21.15.43:0/2535325149 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:36.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.132+0000 7f257d59c700 1 --2- 172.21.15.43:0/2535325149 >> v2:172.21.15.43:3300/0 conn(0x7f257806b780 0x7f257806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257cd9b700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2578151a40 0x7f25780c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f25777fe700 1 -- 172.21.15.43:0/2535325149 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300604429 0 0) 0x7f2578154730 con 0x7f25780c81c0 2023-08-27T11:22:36.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f25777fe700 1 -- 172.21.15.43:0/2535325149 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25680035b0 con 0x7f25780c81c0 2023-08-27T11:22:36.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257d59c700 1 -- 172.21.15.43:0/2535325149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2578151a40 msgr2=0x7f25780c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:36.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257d59c700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2578151a40 0x7f25780c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257d59c700 1 -- 172.21.15.43:0/2535325149 >> v1:172.21.15.43:6789/0 conn(0x7f25780c81c0 legacy=0x7f25780c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257d59c700 1 -- 172.21.15.43:0/2535325149 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578154cf0 con 0x7f257806b780 2023-08-27T11:22:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f257d59c700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257806bbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2570009d90 tx=0x7f257000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60c6318764cf682 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f25777fe700 1 -- 172.21.15.43:0/2535325149 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000e070 con 0x7f257806b780 2023-08-27T11:22:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f25777fe700 1 -- 172.21.15.43:0/2535325149 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000bb20 con 0x7f257806b780 2023-08-27T11:22:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.133+0000 7f25777fe700 1 -- 172.21.15.43:0/2535325149 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2570012430 con 0x7f257806b780 2023-08-27T11:22:36.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 -- 172.21.15.43:0/2535325149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 msgr2=0x7f257806bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257806bbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2570009d90 tx=0x7f257000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 -- 172.21.15.43:0/2535325149 shutdown_connections 2023-08-27T11:22:36.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257806bbf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 --2- 172.21.15.43:0/2535325149 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2578151a40 0x7f25780c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 -- 172.21.15.43:0/2535325149 >> 172.21.15.43:0/2535325149 conn(0x7f25780ab890 msgr2=0x7f25780abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 -- 172.21.15.43:0/2535325149 shutdown_connections 2023-08-27T11:22:36.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.134+0000 7f257efff700 1 -- 172.21.15.43:0/2535325149 wait complete. 2023-08-27T11:22:36.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.136+0000 7f257efff700 1 Processor -- start 2023-08-27T11:22:36.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.137+0000 7f257efff700 1 -- start start 2023-08-27T11:22:36.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 0x7f257814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2578151a40 0x7f25780c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257814d420 con 0x7f257806b780 2023-08-27T11:22:36.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c3e40 con 0x7f2578151a40 2023-08-27T11:22:36.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257efff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25780c1060 con 0x7f25780c81c0 2023-08-27T11:22:36.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44100/0 (socket says 172.21.15.43:44100) 2023-08-27T11:22:36.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 -- 172.21.15.43:0/3747865332 learned_addr learned my addr 172.21.15.43:0/3747865332 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:36.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f2577fff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 0x7f257814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257d59c700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2578151a40 0x7f25780c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 -- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 msgr2=0x7f257814c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 0x7f257814c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 -- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2578151a40 msgr2=0x7f25780c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2578151a40 0x7f25780c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f257cd9b700 1 -- 172.21.15.43:0/3747865332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009a70 con 0x7f257806b780 2023-08-27T11:22:36.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.138+0000 7f2577fff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 0x7f257814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f257cd9b700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f256c00d830 tx=0x7f256c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0125f0 con 0x7f257806b780 2023-08-27T11:22:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c012750 con 0x7f257806b780 2023-08-27T11:22:36.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257814d140 con 0x7f257806b780 2023-08-27T11:22:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c012b00 con 0x7f257806b780 2023-08-27T11:22:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.139+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257814dc90 con 0x7f257806b780 2023-08-27T11:22:36.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.140+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257804ee70 con 0x7f257806b780 2023-08-27T11:22:36.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.142+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f256c012c60 con 0x7f257806b780 2023-08-27T11:22:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.143+0000 7f25757fa700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 0x7f255c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.144+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4813+0+0 (secure 0 0 0) 0x7f256c088dd0 con 0x7f257806b780 2023-08-27T11:22:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.144+0000 7f2577fff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 0x7f255c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:36.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.144+0000 7f2577fff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 0x7f255c06c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25781e70b0 tx=0x7f2564009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.147+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f256c054a70 con 0x7f257806b780 2023-08-27T11:22:36.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.364+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f257806cc80 con 0x7f257806b780 2023-08-27T11:22:36.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.916+0000 7f25757fa700 1 -- 172.21.15.43:0/3747865332 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f256c058090 con 0x7f257806b780 2023-08-27T11:22:36.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.920+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 msgr2=0x7f255c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.920+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 0x7f255c06c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f25781e70b0 tx=0x7f2564009040 comp rx=0 tx=0).stop 2023-08-27T11:22:36.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.920+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 msgr2=0x7f257814f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:36.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.920+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f256c00d830 tx=0x7f256c00db40 comp rx=0 tx=0).stop 2023-08-27T11:22:36.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 shutdown_connections 2023-08-27T11:22:36.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f255c06a050 0x7f255c06c510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2578151a40 0x7f25780c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f257806b780 0x7f257814f160 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f256c00d830 tx=0x7f256c00db40 comp rx=0 tx=0).stop 2023-08-27T11:22:36.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 --2- 172.21.15.43:0/3747865332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25780c81c0 0x7f257814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:36.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 >> 172.21.15.43:0/3747865332 conn(0x7f25780ab890 msgr2=0x7f257814b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:36.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 shutdown_connections 2023-08-27T11:22:36.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:36.921+0000 7f257efff700 1 -- 172.21.15.43:0/3747865332 wait complete. 2023-08-27T11:22:36.925 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-27T11:22:36.945 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-27T11:22:36.948 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:22:36.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:22:36.953 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:22:36.954 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:22:36.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:22:36.958 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:22:36.959 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:22:36.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:22:36.964 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:22:36.965 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:22:36.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:22:36.971 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:22:36.972 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-27T11:22:36.972 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:37.113 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:22:37.113 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:22:37.120 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:22:37.128 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:22:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.185+0000 7fd8d11ff700 1 Processor -- start 2023-08-27T11:22:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.186+0000 7fd8d11ff700 1 -- start start 2023-08-27T11:22:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 0x7fd8cc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc06c4e0 con 0x7fd8cc0c4630 2023-08-27T11:22:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc155370 con 0x7fd8cc151a90 2023-08-27T11:22:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.187+0000 7fd8d11ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc151e70 con 0x7fd8cc06ad70 2023-08-27T11:22:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44142/0 (socket says 172.21.15.43:44142) 2023-08-27T11:22:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 -- 172.21.15.43:0/2360531501 learned_addr learned my addr 172.21.15.43:0/2360531501 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8cad9d700 1 --2- 172.21.15.43:0/2360531501 >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 0x7fd8cc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8cb59e700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 -- 172.21.15.43:0/2360531501 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 msgr2=0x7fd8cc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 -- 172.21.15.43:0/2360531501 >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 msgr2=0x7fd8cc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/2360531501 >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 0x7fd8cc0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 -- 172.21.15.43:0/2360531501 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc154480 con 0x7fd8cc0c4630 2023-08-27T11:22:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8cad9d700 1 --2- 172.21.15.43:0/2360531501 >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 0x7fd8cc0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.188+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc067710 tx=0x7fd8c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c46093022f3ef2e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8c9d9b700 1 -- 172.21.15.43:0/2360531501 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011830 con 0x7fd8cc0c4630 2023-08-27T11:22:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8c9d9b700 1 -- 172.21.15.43:0/2360531501 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c0011990 con 0x7fd8cc0c4630 2023-08-27T11:22:37.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8c9d9b700 1 -- 172.21.15.43:0/2360531501 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0011d20 con 0x7fd8cc0c4630 2023-08-27T11:22:37.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 -- 172.21.15.43:0/2360531501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 msgr2=0x7fd8cc0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc067710 tx=0x7fd8c0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 -- 172.21.15.43:0/2360531501 shutdown_connections 2023-08-27T11:22:37.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/2360531501 >> v2:172.21.15.57:3300/0 conn(0x7fd8cc151a90 0x7fd8cc0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/2360531501 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0c4a90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 -- 172.21.15.43:0/2360531501 >> 172.21.15.43:0/2360531501 conn(0x7fd8cc0ab820 msgr2=0x7fd8cc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 -- 172.21.15.43:0/2360531501 shutdown_connections 2023-08-27T11:22:37.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.189+0000 7fd8d11ff700 1 -- 172.21.15.43:0/2360531501 wait complete. 2023-08-27T11:22:37.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.191+0000 7fd8d11ff700 1 Processor -- start 2023-08-27T11:22:37.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.191+0000 7fd8d11ff700 1 -- start start 2023-08-27T11:22:37.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8cc151a90 0x7fd8cc152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c16b0 con 0x7fd8cc0c4630 2023-08-27T11:22:37.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c3b20 con 0x7fd8cc151a90 2023-08-27T11:22:37.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8d11ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc0c10f0 con 0x7fd8cc06ad70 2023-08-27T11:22:37.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8ca59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8ca59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44148/0 (socket says 172.21.15.43:44148) 2023-08-27T11:22:37.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.192+0000 7fd8ca59c700 1 -- 172.21.15.43:0/65606849 learned_addr learned my addr 172.21.15.43:0/65606849 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:37.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8cb59e700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8cc151a90 0x7fd8cc152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8cad9d700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 -- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 msgr2=0x7fd8cc0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 -- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8cc151a90 msgr2=0x7fd8cc152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8cc151a90 0x7fd8cc152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 -- 172.21.15.43:0/65606849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0094a0 con 0x7fd8cc0c4630 2023-08-27T11:22:37.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8ca59c700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0004240 con 0x7fd8cc0c4630 2023-08-27T11:22:37.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c001f070 con 0x7fd8cc0c4630 2023-08-27T11:22:37.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c0009550 con 0x7fd8cc0c4630 2023-08-27T11:22:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.193+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00036a0 con 0x7fd8cc0c4630 2023-08-27T11:22:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.194+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc152420 con 0x7fd8cc0c4630 2023-08-27T11:22:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.195+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc152280 con 0x7fd8cc0c4630 2023-08-27T11:22:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.196+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fd8c0021030 con 0x7fd8cc0c4630 2023-08-27T11:22:37.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.196+0000 7fd8b37fe700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 0x7fd8b806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.196+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fd8c00891d0 con 0x7fd8cc0c4630 2023-08-27T11:22:37.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.197+0000 7fd8cad9d700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 0x7fd8b806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.197+0000 7fd8cad9d700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 0x7fd8b806c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009c50 tx=0x7fd8bc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.201+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd8cc152280 con 0x7fd8cc0c4630 2023-08-27T11:22:37.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.412+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8cc152280 con 0x7fd8cc0c4630 2023-08-27T11:22:37.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.413+0000 7fd8b37fe700 1 -- 172.21.15.43:0/65606849 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14537 (secure 0 0 0) 0x7fd8cc152280 con 0x7fd8cc0c4630 2023-08-27T11:22:37.415 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:37.415 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:36.910085+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 msgr2=0x7fd8b806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 0x7fd8b806c510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009c50 tx=0x7fd8bc009210 comp rx=0 tx=0).stop 2023-08-27T11:22:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 msgr2=0x7fd8cc0aade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0000c00 tx=0x7fd8c0004750 comp rx=0 tx=0).stop 2023-08-27T11:22:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 shutdown_connections 2023-08-27T11:22:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd8b806a050 0x7fd8b806c510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8cc151a90 0x7fd8cc152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd8cc06ad70 0x7fd8cc0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 --2- 172.21.15.43:0/65606849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8cc0c4630 0x7fd8cc0aade0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 >> 172.21.15.43:0/65606849 conn(0x7fd8cc0ab820 msgr2=0x7fd8cc06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:37.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 shutdown_connections 2023-08-27T11:22:37.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.416+0000 7fd8d11ff700 1 -- 172.21.15.43:0/65606849 wait complete. 2023-08-27T11:22:37.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:22:37.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:22:37.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.638+0000 7f30575ff700 1 Processor -- start 2023-08-27T11:22:37.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.638+0000 7f30575ff700 1 -- start start 2023-08-27T11:22:37.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f30575ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 0x7f30500c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f30575ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3050154660 con 0x7f3050151d20 2023-08-27T11:22:37.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f30575ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3050154940 con 0x7f30500c7c00 2023-08-27T11:22:37.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f30575ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c5750 con 0x7f305006aff0 2023-08-27T11:22:37.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f305539b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3050151d20 0x7f30500ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46040/0 (socket says 172.21.15.43:46040) 2023-08-27T11:22:37.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.639+0000 7f305539b700 1 -- 172.21.15.43:0/3857196138 learned_addr learned my addr 172.21.15.43:0/3857196138 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:37.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672741272 0 0) 0x7f3050154660 con 0x7f3050151d20 2023-08-27T11:22:37.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3055b9c700 1 --2- 172.21.15.43:0/3857196138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 0x7f30500c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c0035b0 con 0x7f3050151d20 2023-08-27T11:22:37.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751208301 0 0) 0x7f3050154940 con 0x7f30500c7c00 2023-08-27T11:22:37.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050154660 con 0x7f30500c7c00 2023-08-27T11:22:37.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610512419 0 0) 0x7f303c0035b0 con 0x7f3050151d20 2023-08-27T11:22:37.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3055b9c700 1 -- 172.21.15.43:0/3857196138 >> v1:172.21.15.57:6789/0 conn(0x7f30500c7c00 legacy=0x7f305006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3055b9c700 1 -- 172.21.15.43:0/3857196138 >> v1:172.21.15.43:6789/0 conn(0x7f3050151d20 legacy=0x7f30500ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.640+0000 7f3055b9c700 1 -- 172.21.15.43:0/3857196138 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050154c20 con 0x7f305006aff0 2023-08-27T11:22:37.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f3055b9c700 1 --2- 172.21.15.43:0/3857196138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 0x7f30500c8110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3048009dc0 tx=0x7f304800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda9f6016c074462 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800e070 con 0x7f305006aff0 2023-08-27T11:22:37.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048003a70 con 0x7f305006aff0 2023-08-27T11:22:37.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f3047fff700 1 -- 172.21.15.43:0/3857196138 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0015f0 con 0x7f305006aff0 2023-08-27T11:22:37.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f30575ff700 1 -- 172.21.15.43:0/3857196138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 msgr2=0x7f30500c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f30575ff700 1 --2- 172.21.15.43:0/3857196138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 0x7f30500c8110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3048009dc0 tx=0x7f304800b330 comp rx=0 tx=0).stop 2023-08-27T11:22:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f30575ff700 1 -- 172.21.15.43:0/3857196138 shutdown_connections 2023-08-27T11:22:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f30575ff700 1 --2- 172.21.15.43:0/3857196138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f305006aff0 0x7f30500c8110 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.641+0000 7f30575ff700 1 -- 172.21.15.43:0/3857196138 >> 172.21.15.43:0/3857196138 conn(0x7f30500c9d00 msgr2=0x7f30500ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:37.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.642+0000 7f30575ff700 1 -- 172.21.15.43:0/3857196138 shutdown_connections 2023-08-27T11:22:37.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.642+0000 7f30575ff700 1 -- 172.21.15.43:0/3857196138 wait complete. 2023-08-27T11:22:37.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.643+0000 7f30575ff700 1 Processor -- start 2023-08-27T11:22:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.643+0000 7f30575ff700 1 -- start start 2023-08-27T11:22:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f305006aff0 0x7f30500c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30500c7c00 0x7f305014af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305014b9a0 con 0x7f3050151d20 2023-08-27T11:22:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050156bd0 con 0x7f305006aff0 2023-08-27T11:22:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f30575ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3050158540 con 0x7f30500c7c00 2023-08-27T11:22:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.644+0000 7f3055b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44154/0 (socket says 172.21.15.43:44154) 2023-08-27T11:22:37.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f305539b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f305006aff0 0x7f30500c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 -- 172.21.15.43:0/3292613618 learned_addr learned my addr 172.21.15.43:0/3292613618 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:37.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3054b9a700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30500c7c00 0x7f305014af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 -- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30500c7c00 msgr2=0x7f305014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30500c7c00 0x7f305014af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 -- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f305006aff0 msgr2=0x7f30500c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f305006aff0 0x7f30500c0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 -- 172.21.15.43:0/3292613618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048009a70 con 0x7f3050151d20 2023-08-27T11:22:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3055b9c700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f304800b370 tx=0x7f3048004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480044c0 con 0x7f3050151d20 2023-08-27T11:22:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048004640 con 0x7f3050151d20 2023-08-27T11:22:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304801d470 con 0x7f3050151d20 2023-08-27T11:22:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.645+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3050158820 con 0x7f3050151d20 2023-08-27T11:22:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.646+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500c0970 con 0x7f3050151d20 2023-08-27T11:22:37.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.647+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30501566c0 con 0x7f3050151d20 2023-08-27T11:22:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.648+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f304801d5d0 con 0x7f3050151d20 2023-08-27T11:22:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.648+0000 7f3045ffb700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 0x7f303406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.649+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f3048089d30 con 0x7f3050151d20 2023-08-27T11:22:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.649+0000 7f305539b700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 0x7f303406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:37.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.649+0000 7f305539b700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 0x7f303406c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f304c001200 tx=0x7f304c001190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:37.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.653+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f30501566c0 con 0x7f3050151d20 2023-08-27T11:22:37.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.862+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30501566c0 con 0x7f3050151d20 2023-08-27T11:22:37.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.862+0000 7f3045ffb700 1 -- 172.21.15.43:0/3292613618 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30501566c0 con 0x7f3050151d20 2023-08-27T11:22:37.864 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:22:37.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 msgr2=0x7f303406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 0x7f303406c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f304c001200 tx=0x7f304c001190 comp rx=0 tx=0).stop 2023-08-27T11:22:37.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 msgr2=0x7f305014b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:37.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f304800b370 tx=0x7f3048004b20 comp rx=0 tx=0).stop 2023-08-27T11:22:37.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 shutdown_connections 2023-08-27T11:22:37.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.864+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f303406a050 0x7f303406c510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3050151d20 0x7f305014b460 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f305006aff0 0x7f30500c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 --2- 172.21.15.43:0/3292613618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30500c7c00 0x7f305014af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:37.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 >> 172.21.15.43:0/3292613618 conn(0x7f30500c9d00 msgr2=0x7f30500bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:37.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 shutdown_connections 2023-08-27T11:22:37.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:37.865+0000 7f30575ff700 1 -- 172.21.15.43:0/3292613618 wait complete. 2023-08-27T11:22:37.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:22:38.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.107+0000 7fdeea9ff700 1 Processor -- start 2023-08-27T11:22:38.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.107+0000 7fdeea9ff700 1 -- start start 2023-08-27T11:22:38.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdeea9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee4154660 con 0x7fdee406a8e0 2023-08-27T11:22:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdeea9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee4154940 con 0x7fdee40c7c00 2023-08-27T11:22:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40c5750 con 0x7fdee4151d20 2023-08-27T11:22:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdee8f9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdee406a8e0 0x7fdee406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46050/0 (socket says 172.21.15.43:46050) 2023-08-27T11:22:38.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.108+0000 7fdee8f9c700 1 -- 172.21.15.43:0/2865905453 learned_addr learned my addr 172.21.15.43:0/2865905453 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:38.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee3fff700 1 --2- 172.21.15.43:0/2865905453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987952808 0 0) 0x7fdee4154660 con 0x7fdee406a8e0 2023-08-27T11:22:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0035b0 con 0x7fdee406a8e0 2023-08-27T11:22:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909377912 0 0) 0x7fdee4154940 con 0x7fdee40c7c00 2023-08-27T11:22:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee4154660 con 0x7fdee40c7c00 2023-08-27T11:22:38.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee3fff700 1 -- 172.21.15.43:0/2865905453 >> v1:172.21.15.57:6789/0 conn(0x7fdee40c7c00 legacy=0x7fdee40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee3fff700 1 -- 172.21.15.43:0/2865905453 >> v1:172.21.15.43:6789/0 conn(0x7fdee406a8e0 legacy=0x7fdee406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356038193 0 0) 0x7fdecc0035b0 con 0x7fdee406a8e0 2023-08-27T11:22:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee3fff700 1 -- 172.21.15.43:0/2865905453 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4154c20 con 0x7fdee4151d20 2023-08-27T11:22:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.109+0000 7fdee3fff700 1 --2- 172.21.15.43:0/2865905453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee40c8110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fded4009870 tx=0x7fded4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a2fe355d365a0e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc001a40 con 0x7fdee4151d20 2023-08-27T11:22:38.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded4004030 con 0x7fdee4151d20 2023-08-27T11:22:38.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdee2ffd700 1 -- 172.21.15.43:0/2865905453 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40043c0 con 0x7fdee4151d20 2023-08-27T11:22:38.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 -- 172.21.15.43:0/2865905453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 msgr2=0x7fdee40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/2865905453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee40c8110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fded4009870 tx=0x7fded4009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:38.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 -- 172.21.15.43:0/2865905453 shutdown_connections 2023-08-27T11:22:38.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/2865905453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee40c8110 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 -- 172.21.15.43:0/2865905453 >> 172.21.15.43:0/2865905453 conn(0x7fdee40c9d00 msgr2=0x7fdee40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:38.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 -- 172.21.15.43:0/2865905453 shutdown_connections 2023-08-27T11:22:38.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.110+0000 7fdeea9ff700 1 -- 172.21.15.43:0/2865905453 wait complete. 2023-08-27T11:22:38.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.112+0000 7fdeea9ff700 1 Processor -- start 2023-08-27T11:22:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.112+0000 7fdeea9ff700 1 -- start start 2023-08-27T11:22:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 0x7fdee41563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4157890 con 0x7fdee40c7c00 2023-08-27T11:22:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee414a820 con 0x7fdee406a8e0 2023-08-27T11:22:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdeea9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4155c70 con 0x7fdee4151d20 2023-08-27T11:22:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 0x7fdee41563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44176/0 (socket says 172.21.15.43:44176) 2023-08-27T11:22:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 0x7fdee41563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:46058/0 (socket says 172.21.15.43:46058) 2023-08-27T11:22:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee37fe700 1 -- 172.21.15.43:0/1606773956 learned_addr learned my addr 172.21.15.43:0/1606773956 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.113+0000 7fdee8f9c700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 -- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 msgr2=0x7fdee4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 -- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 msgr2=0x7fdee41563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 0x7fdee41563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 -- 172.21.15.43:0/1606773956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded40094a0 con 0x7fdee40c7c00 2023-08-27T11:22:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee37fe700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fded800c550 tx=0x7fded800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80052d0 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8005430 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee41ea510 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80038c0 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.114+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee4158580 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.115+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee404ee70 con 0x7fdee40c7c00 2023-08-27T11:22:38.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.117+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fded8003a20 con 0x7fdee40c7c00 2023-08-27T11:22:38.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.118+0000 7fdee0ff9700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 0x7fded006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.118+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fded8087470 con 0x7fdee40c7c00 2023-08-27T11:22:38.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.118+0000 7fdee3fff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 0x7fded006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.119+0000 7fdee3fff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 0x7fded006c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fded40097c0 tx=0x7fded4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.123+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fded8053020 con 0x7fdee40c7c00 2023-08-27T11:22:38.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.353+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdee40ac650 con 0x7fdee40c7c00 2023-08-27T11:22:38.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.353+0000 7fdee0ff9700 1 -- 172.21.15.43:0/1606773956 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fded8056640 con 0x7fdee40c7c00 2023-08-27T11:22:38.355 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:22:38.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.355+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 msgr2=0x7fded006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.355+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 0x7fded006c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fded40097c0 tx=0x7fded4008030 comp rx=0 tx=0).stop 2023-08-27T11:22:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.355+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 msgr2=0x7fdee4152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.355+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fded800c550 tx=0x7fded800c860 comp rx=0 tx=0).stop 2023-08-27T11:22:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 shutdown_connections 2023-08-27T11:22:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fded006a050 0x7fded006c510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdee4151d20 0x7fdee4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdee406a8e0 0x7fdee41563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 --2- 172.21.15.43:0/1606773956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdee40c7c00 0x7fdee4152ad0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 >> 172.21.15.43:0/1606773956 conn(0x7fdee40c9d00 msgr2=0x7fdee40c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 shutdown_connections 2023-08-27T11:22:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.356+0000 7fdeea9ff700 1 -- 172.21.15.43:0/1606773956 wait complete. 2023-08-27T11:22:38.375 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:22:38.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.581+0000 7fa4145ff700 1 Processor -- start 2023-08-27T11:22:38.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.581+0000 7fa4145ff700 1 -- start start 2023-08-27T11:22:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.582+0000 7fa4145ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 0x7fa40c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.582+0000 7fa4145ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c06c4e0 con 0x7fa40c0c4a90 2023-08-27T11:22:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa4145ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa40c155370 con 0x7fa40c0c4630 2023-08-27T11:22:38.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa4145ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c151e70 con 0x7fa40c151a90 2023-08-27T11:22:38.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa412b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa40c0c4a90 0x7fa40c06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46056/0 (socket says 172.21.15.43:46056) 2023-08-27T11:22:38.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa412b9c700 1 -- 172.21.15.43:0/1298299080 learned_addr learned my addr 172.21.15.43:0/1298299080 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa41239b700 1 --2- 172.21.15.43:0/1298299080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 0x7fa40c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544239181 0 0) 0x7fa40c06c4e0 con 0x7fa40c0c4a90 2023-08-27T11:22:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f80035b0 con 0x7fa40c0c4a90 2023-08-27T11:22:38.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243573084 0 0) 0x7fa40c155370 con 0x7fa40c0c4630 2023-08-27T11:22:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.583+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa40c06c4e0 con 0x7fa40c0c4630 2023-08-27T11:22:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa41239b700 1 -- 172.21.15.43:0/1298299080 >> v1:172.21.15.57:6789/0 conn(0x7fa40c0c4630 legacy=0x7fa40c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611630350 0 0) 0x7fa3f80035b0 con 0x7fa40c0c4a90 2023-08-27T11:22:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa41239b700 1 -- 172.21.15.43:0/1298299080 >> v1:172.21.15.43:6789/0 conn(0x7fa40c0c4a90 legacy=0x7fa40c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa41239b700 1 -- 172.21.15.43:0/1298299080 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40c154480 con 0x7fa40c151a90 2023-08-27T11:22:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa41239b700 1 --2- 172.21.15.43:0/1298299080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 0x7fa40c0c7bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa408009870 tx=0x7fa408009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77ae9da0f35841f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040019f0 con 0x7fa40c151a90 2023-08-27T11:22:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408004030 con 0x7fa40c151a90 2023-08-27T11:22:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.584+0000 7fa411399700 1 -- 172.21.15.43:0/1298299080 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4080043c0 con 0x7fa40c151a90 2023-08-27T11:22:38.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 -- 172.21.15.43:0/1298299080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 msgr2=0x7fa40c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 --2- 172.21.15.43:0/1298299080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 0x7fa40c0c7bb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa408009870 tx=0x7fa408009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 -- 172.21.15.43:0/1298299080 shutdown_connections 2023-08-27T11:22:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 --2- 172.21.15.43:0/1298299080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c151a90 0x7fa40c0c7bb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 -- 172.21.15.43:0/1298299080 >> 172.21.15.43:0/1298299080 conn(0x7fa40c0ab820 msgr2=0x7fa40c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:38.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 -- 172.21.15.43:0/1298299080 shutdown_connections 2023-08-27T11:22:38.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.585+0000 7fa4145ff700 1 -- 172.21.15.43:0/1298299080 wait complete. 2023-08-27T11:22:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.587+0000 7fa4145ff700 1 Processor -- start 2023-08-27T11:22:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.587+0000 7fa4145ff700 1 -- start start 2023-08-27T11:22:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c0c4630 0x7fa40c0c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 0x7fa40c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0bcf70 con 0x7fa40c151a90 2023-08-27T11:22:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c1542c0 con 0x7fa40c0c4a90 2023-08-27T11:22:38.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa4145ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c153d00 con 0x7fa40c0c4630 2023-08-27T11:22:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa412b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa412b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44190/0 (socket says 172.21.15.43:44190) 2023-08-27T11:22:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa412b9c700 1 -- 172.21.15.43:0/4065852051 learned_addr learned my addr 172.21.15.43:0/4065852051 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa411b9a700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 0x7fa40c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.588+0000 7fa41239b700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c0c4630 0x7fa40c0c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 -- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c0c4630 msgr2=0x7fa40c0c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c0c4630 0x7fa40c0c2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 -- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 msgr2=0x7fa40c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 0x7fa40c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 -- 172.21.15.43:0/4065852051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080094a0 con 0x7fa40c151a90 2023-08-27T11:22:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa411b9a700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 0x7fa40c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa412b9c700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4040017f0 tx=0x7fa40400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400ac20 con 0x7fa40c151a90 2023-08-27T11:22:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400ada0 con 0x7fa40c151a90 2023-08-27T11:22:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c153fe0 con 0x7fa40c151a90 2023-08-27T11:22:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404007310 con 0x7fa40c151a90 2023-08-27T11:22:38.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.589+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c149480 con 0x7fa40c151a90 2023-08-27T11:22:38.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.590+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c1528b0 con 0x7fa40c151a90 2023-08-27T11:22:38.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.591+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fa404007470 con 0x7fa40c151a90 2023-08-27T11:22:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.592+0000 7fa402ffd700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 0x7fa3f006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.593+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa404087ff0 con 0x7fa40c151a90 2023-08-27T11:22:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.593+0000 7fa41239b700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 0x7fa3f006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.593+0000 7fa41239b700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 0x7fa3f006c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097c0 tx=0x7fa408008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.597+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4040ba990 con 0x7fa40c151a90 2023-08-27T11:22:38.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.859+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa40c04ee70 con 0x7fa40c151a90 2023-08-27T11:22:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.859+0000 7fa402ffd700 1 -- 172.21.15.43:0/4065852051 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fa404018090 con 0x7fa40c151a90 2023-08-27T11:22:38.861 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:38.861 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4302,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-27T11:22:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 msgr2=0x7fa3f006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 0x7fa3f006c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097c0 tx=0x7fa408008030 comp rx=0 tx=0).stop 2023-08-27T11:22:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 msgr2=0x7fa40c152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa4040017f0 tx=0x7fa40400a060 comp rx=0 tx=0).stop 2023-08-27T11:22:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 shutdown_connections 2023-08-27T11:22:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3f006a050 0x7fa3f006c510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa40c151a90 0x7fa40c152b90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa40c0c4630 0x7fa40c0c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 --2- 172.21.15.43:0/4065852051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa40c0c4a90 0x7fa40c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 >> 172.21.15.43:0/4065852051 conn(0x7fa40c0ab820 msgr2=0x7fa40c14f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 shutdown_connections 2023-08-27T11:22:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:38.862+0000 7fa4145ff700 1 -- 172.21.15.43:0/4065852051 wait complete. 2023-08-27T11:22:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 3 2023-08-27T11:22:38.881 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.086+0000 7eff769ff700 1 Processor -- start 2023-08-27T11:22:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.086+0000 7eff769ff700 1 -- start start 2023-08-27T11:22:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff769ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7eff7006ca60 0x7eff7006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff769ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff769ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7006d700 con 0x7eff700c51a0 2023-08-27T11:22:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff769ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff701530b0 con 0x7eff7006ca60 2023-08-27T11:22:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff769ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7014c860 con 0x7eff70155910 2023-08-27T11:22:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff6f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7eff7006ca60 0x7eff7006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff6ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7eff700c51a0 0x7eff700aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:52426/0 (socket says 172.21.15.43:52426) 2023-08-27T11:22:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff6ffff700 1 -- 172.21.15.43:0/3916004803 learned_addr learned my addr 172.21.15.43:0/3916004803 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.087+0000 7eff74f9c700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6f7fe700 1 -- 172.21.15.43:0/3916004803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 msgr2=0x7eff70155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6f7fe700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6f7fe700 1 -- 172.21.15.43:0/3916004803 >> v1:172.21.15.57:6789/0 conn(0x7eff700c51a0 legacy=0x7eff700aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6f7fe700 1 -- 172.21.15.43:0/3916004803 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70152430 con 0x7eff7006ca60 2023-08-27T11:22:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6effd700 1 -- 172.21.15.43:0/3916004803 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533109143 0 0) 0x7eff7006d700 con 0x7eff700c51a0 2023-08-27T11:22:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6f7fe700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff7006d1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff64009870 tx=0x7eff64009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2368546d9f5d17c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6effd700 1 -- 172.21.15.43:0/3916004803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64011830 con 0x7eff7006ca60 2023-08-27T11:22:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6effd700 1 -- 172.21.15.43:0/3916004803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64011990 con 0x7eff7006ca60 2023-08-27T11:22:39.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.088+0000 7eff6effd700 1 -- 172.21.15.43:0/3916004803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64011d20 con 0x7eff7006ca60 2023-08-27T11:22:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 -- 172.21.15.43:0/3916004803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 msgr2=0x7eff7006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff7006d1c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7eff64009870 tx=0x7eff64009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 -- 172.21.15.43:0/3916004803 shutdown_connections 2023-08-27T11:22:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 --2- 172.21.15.43:0/3916004803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff7006d1c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 -- 172.21.15.43:0/3916004803 >> 172.21.15.43:0/3916004803 conn(0x7eff7006aa50 msgr2=0x7eff700c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 -- 172.21.15.43:0/3916004803 shutdown_connections 2023-08-27T11:22:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.089+0000 7eff769ff700 1 -- 172.21.15.43:0/3916004803 wait complete. 2023-08-27T11:22:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.091+0000 7eff769ff700 1 Processor -- start 2023-08-27T11:22:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.091+0000 7eff769ff700 1 -- start start 2023-08-27T11:22:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff700c51a0 0x7eff701e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700717e0 con 0x7eff7006ca60 2023-08-27T11:22:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701ebb60 con 0x7eff700c51a0 2023-08-27T11:22:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff769ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70071fd0 con 0x7eff70155910 2023-08-27T11:22:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff700c51a0 0x7eff701e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33096/0 (socket says 172.21.15.43:33096) 2023-08-27T11:22:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 -- 172.21.15.43:0/1714609936 learned_addr learned my addr 172.21.15.43:0/1714609936 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff74f9c700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 -- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 msgr2=0x7eff70154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 -- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff700c51a0 msgr2=0x7eff701e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff700c51a0 0x7eff701e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 -- 172.21.15.43:0/1714609936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640094a0 con 0x7eff7006ca60 2023-08-27T11:22:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.092+0000 7eff6ffff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff600011e0 tx=0x7eff6000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.093+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60004c80 con 0x7eff7006ca60 2023-08-27T11:22:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.093+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff60004e00 con 0x7eff7006ca60 2023-08-27T11:22:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.093+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700722b0 con 0x7eff7006ca60 2023-08-27T11:22:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.093+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60007310 con 0x7eff7006ca60 2023-08-27T11:22:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.093+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7006f580 con 0x7eff7006ca60 2023-08-27T11:22:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.094+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff70070360 con 0x7eff7006ca60 2023-08-27T11:22:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.095+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7eff60007470 con 0x7eff7006ca60 2023-08-27T11:22:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.096+0000 7eff6cff9700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 0x7eff5c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.096+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7eff60087dd0 con 0x7eff7006ca60 2023-08-27T11:22:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.096+0000 7eff6f7fe700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 0x7eff5c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.096+0000 7eff6f7fe700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 0x7eff5c06c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff64008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.100+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7eff600538e0 con 0x7eff7006ca60 2023-08-27T11:22:39.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.263+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff60053cb0 con 0x7eff7006ca60 2023-08-27T11:22:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.316+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff70072440 con 0x7eff7006ca60 2023-08-27T11:22:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.317+0000 7eff6cff9700 1 -- 172.21.15.43:0/1714609936 <== mon.0 v2:172.21.15.43:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14519 (secure 0 0 0) 0x7eff60057370 con 0x7eff7006ca60 2023-08-27T11:22:39.318 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:39.318 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:38.916759+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 msgr2=0x7eff5c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 0x7eff5c06c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff64008030 comp rx=0 tx=0).stop 2023-08-27T11:22:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 msgr2=0x7eff70070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff600011e0 tx=0x7eff6000ca30 comp rx=0 tx=0).stop 2023-08-27T11:22:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 shutdown_connections 2023-08-27T11:22:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7eff5c06a050 0x7eff5c06c510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff70155910 0x7eff70154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7eff7006ca60 0x7eff70070510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 --2- 172.21.15.43:0/1714609936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff700c51a0 0x7eff701e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 >> 172.21.15.43:0/1714609936 conn(0x7eff7006aa50 msgr2=0x7eff701509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.319+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 shutdown_connections 2023-08-27T11:22:39.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.320+0000 7eff769ff700 1 -- 172.21.15.43:0/1714609936 wait complete. 2023-08-27T11:22:39.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:22:39.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:22:39.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.544+0000 7f743afff700 1 Processor -- start 2023-08-27T11:22:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.544+0000 7f743afff700 1 -- start start 2023-08-27T11:22:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.545+0000 7f743afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74340c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.545+0000 7f743afff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f743406a8e0 0x7f743406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.545+0000 7f743afff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7434154660 con 0x7f7434151d20 2023-08-27T11:22:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.545+0000 7f743afff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74340c5750 con 0x7f743406a8e0 2023-08-27T11:22:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.545+0000 7f743afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7434154940 con 0x7f74340c7c00 2023-08-27T11:22:39.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f743406a8e0 0x7f743406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f7433fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74340c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f743406a8e0 0x7f743406ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45140/0 (socket says 172.21.15.43:45140) 2023-08-27T11:22:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 -- 172.21.15.43:0/30622378 learned_addr learned my addr 172.21.15.43:0/30622378 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 -- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 msgr2=0x7f74340c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 --2- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74340c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 -- 172.21.15.43:0/30622378 >> v1:172.21.15.57:6789/0 conn(0x7f7434151d20 legacy=0x7f74340ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.546+0000 7f743959c700 1 -- 172.21.15.43:0/30622378 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434154c20 con 0x7f743406a8e0 2023-08-27T11:22:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743959c700 1 --2- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743406ad50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f742c009e50 tx=0x7f742c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241d143351be9815 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f74337fe700 1 -- 172.21.15.43:0/30622378 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00e070 con 0x7f743406a8e0 2023-08-27T11:22:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f74337fe700 1 -- 172.21.15.43:0/30622378 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00b910 con 0x7f743406a8e0 2023-08-27T11:22:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f74337fe700 1 -- 172.21.15.43:0/30622378 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00bcc0 con 0x7f743406a8e0 2023-08-27T11:22:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 -- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 msgr2=0x7f743406ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 --2- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743406ad50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f742c009e50 tx=0x7f742c00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 -- 172.21.15.43:0/30622378 shutdown_connections 2023-08-27T11:22:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 --2- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743406ad50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 --2- 172.21.15.43:0/30622378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74340c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.547+0000 7f743afff700 1 -- 172.21.15.43:0/30622378 >> 172.21.15.43:0/30622378 conn(0x7f74340c9d00 msgr2=0x7f74340ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.548+0000 7f743afff700 1 -- 172.21.15.43:0/30622378 shutdown_connections 2023-08-27T11:22:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.548+0000 7f743afff700 1 -- 172.21.15.43:0/30622378 wait complete. 2023-08-27T11:22:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.549+0000 7f743afff700 1 Processor -- start 2023-08-27T11:22:39.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.549+0000 7f743afff700 1 -- start start 2023-08-27T11:22:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74341ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 0x7f74340aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74341ead80 con 0x7f7434151d20 2023-08-27T11:22:39.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74341edd80 con 0x7f743406a8e0 2023-08-27T11:22:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.550+0000 7f743afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743414e5a0 con 0x7f74340c7c00 2023-08-27T11:22:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f743959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 0x7f74340aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45148/0 (socket says 172.21.15.43:45148) 2023-08-27T11:22:39.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 -- 172.21.15.43:0/2757062901 learned_addr learned my addr 172.21.15.43:0/2757062901 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7433fff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74341ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 -- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 msgr2=0x7f74341ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74341ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 -- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 msgr2=0x7f74340aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 0x7f74340aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 -- 172.21.15.43:0/2757062901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009b30 con 0x7f743406a8e0 2023-08-27T11:22:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f743959c700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 0x7f74340aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.551+0000 7f7438d9b700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f742800c450 tx=0x7f742800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.552+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280052d0 con 0x7f743406a8e0 2023-08-27T11:22:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.552+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428005430 con 0x7f743406a8e0 2023-08-27T11:22:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.552+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280038c0 con 0x7f743406a8e0 2023-08-27T11:22:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.552+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743414e880 con 0x7f743406a8e0 2023-08-27T11:22:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.552+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74341eb2b0 con 0x7f743406a8e0 2023-08-27T11:22:39.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.553+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743414ea70 con 0x7f743406a8e0 2023-08-27T11:22:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.554+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7428003a20 con 0x7f743406a8e0 2023-08-27T11:22:39.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.555+0000 7f74317fa700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 0x7f741806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.555+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7428087720 con 0x7f743406a8e0 2023-08-27T11:22:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.555+0000 7f7433fff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 0x7f741806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.556+0000 7f7433fff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 0x7f741806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74340ca530 tx=0x7f7420009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:39.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.560+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7428053030 con 0x7f743406a8e0 2023-08-27T11:22:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.770+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f743404ee70 con 0x7f743406a8e0 2023-08-27T11:22:39.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.771+0000 7f74317fa700 1 -- 172.21.15.43:0/2757062901 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74280170a0 con 0x7f743406a8e0 2023-08-27T11:22:39.855 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:22:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 msgr2=0x7f741806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 0x7f741806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74340ca530 tx=0x7f7420009210 comp rx=0 tx=0).stop 2023-08-27T11:22:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 msgr2=0x7f743414dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f742800c450 tx=0x7f742800c760 comp rx=0 tx=0).stop 2023-08-27T11:22:39.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 shutdown_connections 2023-08-27T11:22:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f741806a0e0 0x7f741806c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7434151d20 0x7f74340aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f743406a8e0 0x7f743414dfc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 --2- 172.21.15.43:0/2757062901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74340c7c00 0x7f74341ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 >> 172.21.15.43:0/2757062901 conn(0x7f74340c9d00 msgr2=0x7f74340c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:39.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 shutdown_connections 2023-08-27T11:22:39.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:39.773+0000 7f743afff700 1 -- 172.21.15.43:0/2757062901 wait complete. 2023-08-27T11:22:39.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:22:39.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:22:39.872 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:22:40.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.073+0000 7fd4cd5ff700 1 Processor -- start 2023-08-27T11:22:40.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.073+0000 7fd4cd5ff700 1 -- start start 2023-08-27T11:22:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4cd5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd4c80c49f0 0x7fd4c8151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4cd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 0x7fd4c80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4cd5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c80c80c0 con 0x7fd4c80ac410 2023-08-27T11:22:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4cd5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80c9bd0 con 0x7fd4c80c49f0 2023-08-27T11:22:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4cd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c81555a0 con 0x7fd4c8151cd0 2023-08-27T11:22:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4c6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd4c80c49f0 0x7fd4c8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4c77fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd4c80ac410 0x7fd4c80c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49412/0 (socket says 172.21.15.43:49412) 2023-08-27T11:22:40.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.074+0000 7fd4c77fe700 1 -- 172.21.15.43:0/1434731729 learned_addr learned my addr 172.21.15.43:0/1434731729 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c67fc700 1 --2- 172.21.15.43:0/1434731729 >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 0x7fd4c80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/1434731729 >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 msgr2=0x7fd4c80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c6ffd700 1 --2- 172.21.15.43:0/1434731729 >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 0x7fd4c80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/1434731729 >> v1:172.21.15.43:6789/0 conn(0x7fd4c80ac410 legacy=0x7fd4c80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/1434731729 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c81552c0 con 0x7fd4c80c49f0 2023-08-27T11:22:40.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c67fc700 1 --2- 172.21.15.43:0/1434731729 >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 0x7fd4c80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c5ffb700 1 -- 172.21.15.43:0/1434731729 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873767302 0 0) 0x7fd4c80c80c0 con 0x7fd4c80ac410 2023-08-27T11:22:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c6ffd700 1 --2- 172.21.15.43:0/1434731729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80c49f0 0x7fd4c8151790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8072830 tx=0x7fd4b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c71a17b5e7dcf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c5ffb700 1 -- 172.21.15.43:0/1434731729 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011830 con 0x7fd4c80c49f0 2023-08-27T11:22:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c5ffb700 1 -- 172.21.15.43:0/1434731729 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8011990 con 0x7fd4c80c49f0 2023-08-27T11:22:40.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.075+0000 7fd4c5ffb700 1 -- 172.21.15.43:0/1434731729 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011d20 con 0x7fd4c80c49f0 2023-08-27T11:22:40.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/1434731729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80c49f0 msgr2=0x7fd4c8151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/1434731729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80c49f0 0x7fd4c8151790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8072830 tx=0x7fd4b8009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:40.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/1434731729 shutdown_connections 2023-08-27T11:22:40.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/1434731729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80c49f0 0x7fd4c8151790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/1434731729 >> v2:172.21.15.57:3300/0 conn(0x7fd4c8151cd0 0x7fd4c80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/1434731729 >> 172.21.15.43:0/1434731729 conn(0x7fd4c80ab8f0 msgr2=0x7fd4c80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/1434731729 shutdown_connections 2023-08-27T11:22:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.076+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/1434731729 wait complete. 2023-08-27T11:22:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.078+0000 7fd4cd5ff700 1 Processor -- start 2023-08-27T11:22:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.079+0000 7fd4cd5ff700 1 -- start start 2023-08-27T11:22:40.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4c80c49f0 0x7fd4c806b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4c8151cd0 0x7fd4c814bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81ead30 con 0x7fd4c80ac410 2023-08-27T11:22:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81eafd0 con 0x7fd4c80c49f0 2023-08-27T11:22:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4cd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81eb2b0 con 0x7fd4c8151cd0 2023-08-27T11:22:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33148/0 (socket says 172.21.15.43:33148) 2023-08-27T11:22:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/91962882 learned_addr learned my addr 172.21.15.43:0/91962882 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c77fe700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4c8151cd0 0x7fd4c814bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c67fc700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4c80c49f0 0x7fd4c806b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4c8151cd0 msgr2=0x7fd4c814bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4c8151cd0 0x7fd4c814bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4c80c49f0 msgr2=0x7fd4c806b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4c80c49f0 0x7fd4c806b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.080+0000 7fd4c6ffd700 1 -- 172.21.15.43:0/91962882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80094a0 con 0x7fd4c80ac410 2023-08-27T11:22:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4c6ffd700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80097c0 tx=0x7fd4b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80036a0 con 0x7fd4c80ac410 2023-08-27T11:22:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b801f070 con 0x7fd4c80ac410 2023-08-27T11:22:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c81eb590 con 0x7fd4c80ac410 2023-08-27T11:22:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8003a60 con 0x7fd4c80ac410 2023-08-27T11:22:40.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.081+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c806b8d0 con 0x7fd4c80ac410 2023-08-27T11:22:40.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.082+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c80c8340 con 0x7fd4c80ac410 2023-08-27T11:22:40.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.083+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd4b8003bc0 con 0x7fd4c80ac410 2023-08-27T11:22:40.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.084+0000 7fd4af7fe700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 0x7fd4b406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.084+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd4b8021070 con 0x7fd4c80ac410 2023-08-27T11:22:40.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.085+0000 7fd4c67fc700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 0x7fd4b406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.085+0000 7fd4c67fc700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 0x7fd4b406c5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80a9e90 tx=0x7fd4bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.089+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd4c80c8340 con 0x7fd4c80ac410 2023-08-27T11:22:40.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.299+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4c80c8340 con 0x7fd4c80ac410 2023-08-27T11:22:40.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.299+0000 7fd4af7fe700 1 -- 172.21.15.43:0/91962882 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4c80c8340 con 0x7fd4c80ac410 2023-08-27T11:22:40.301 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:22:40.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 msgr2=0x7fd4b406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 0x7fd4b406c5d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80a9e90 tx=0x7fd4bc008040 comp rx=0 tx=0).stop 2023-08-27T11:22:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 msgr2=0x7fd4c81573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80097c0 tx=0x7fd4b8004750 comp rx=0 tx=0).stop 2023-08-27T11:22:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 shutdown_connections 2023-08-27T11:22:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4b406a110 0x7fd4b406c5d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4c8151cd0 0x7fd4c814bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4c80ac410 0x7fd4c81573b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 --2- 172.21.15.43:0/91962882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd4c80c49f0 0x7fd4c806b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 >> 172.21.15.43:0/91962882 conn(0x7fd4c80ab8f0 msgr2=0x7fd4c80abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 shutdown_connections 2023-08-27T11:22:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.302+0000 7fd4cd5ff700 1 -- 172.21.15.43:0/91962882 wait complete. 2023-08-27T11:22:40.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:22:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.532+0000 7f5076bff700 1 Processor -- start 2023-08-27T11:22:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.532+0000 7f5076bff700 1 -- start start 2023-08-27T11:22:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.533+0000 7f5076bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.533+0000 7f5076bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507006c4e0 con 0x7f5070151a90 2023-08-27T11:22:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.533+0000 7f5076bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5070155370 con 0x7f507006ad70 2023-08-27T11:22:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.533+0000 7f5076bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700c82c0 con 0x7f50700c4630 2023-08-27T11:22:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f507499b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5070151a90 0x7f50700c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49426/0 (socket says 172.21.15.43:49426) 2023-08-27T11:22:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f507499b700 1 -- 172.21.15.43:0/1268263313 learned_addr learned my addr 172.21.15.43:0/1268263313 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506ffff700 1 --2- 172.21.15.43:0/1268263313 >> v2:172.21.15.57:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22308011 0 0) 0x7f507006c4e0 con 0x7f5070151a90 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50600035b0 con 0x7f5070151a90 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119416143 0 0) 0x7f50600035b0 con 0x7f5070151a90 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 >> v2:172.21.15.57:3300/0 conn(0x7f50700c4630 msgr2=0x7f50700c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 --2- 172.21.15.43:0/1268263313 >> v2:172.21.15.57:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 >> v1:172.21.15.57:6789/0 conn(0x7f507006ad70 legacy=0x7f507006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070151e70 con 0x7f5070151a90 2023-08-27T11:22:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f5064001670 con 0x7f5070151a90 2023-08-27T11:22:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 >> v1:172.21.15.43:6789/0 conn(0x7f5070151a90 legacy=0x7f50700c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.534+0000 7f506f7fe700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5060003a50 0x7f5060003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506f7fe700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060004850 0x7f5060004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506f7fe700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 0x7f506000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700c82c0 con 0x7f5060005260 2023-08-27T11:22:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506000c1b0 con 0x7f5060004850 2023-08-27T11:22:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506000c370 con 0x7f5060003a50 2023-08-27T11:22:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 0x7f506000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507499b700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5060003a50 0x7f5060003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f506ffff700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060004850 0x7f5060004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 -- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5060003a50 msgr2=0x7f5060003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5060003a50 0x7f5060003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 -- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060004850 msgr2=0x7f5060004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060004850 0x7f5060004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 -- 172.21.15.43:0/1268263313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50600035b0 con 0x7f5060005260 2023-08-27T11:22:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.535+0000 7f507519c700 1 -- 172.21.15.43:0/1268263313 reap_dead start 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f507519c700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 0x7f506000ba10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f506800c160 tx=0x7f5060005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8a1c0158444d97 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068001db0 con 0x7f5060005260 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800ccc0 con 0x7f5060005260 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f506f7fe700 1 -- 172.21.15.43:0/1268263313 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068003c40 con 0x7f5060005260 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 -- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 msgr2=0x7f506000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 0x7f506000ba10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f506800c160 tx=0x7f5060005880 comp rx=0 tx=0).stop 2023-08-27T11:22:40.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 -- 172.21.15.43:0/1268263313 shutdown_connections 2023-08-27T11:22:40.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 --2- 172.21.15.43:0/1268263313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5060005260 0x7f506000ba10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 -- 172.21.15.43:0/1268263313 >> 172.21.15.43:0/1268263313 conn(0x7f50700ab820 msgr2=0x7f50700abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:40.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 -- 172.21.15.43:0/1268263313 shutdown_connections 2023-08-27T11:22:40.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.536+0000 7f5076bff700 1 -- 172.21.15.43:0/1268263313 wait complete. 2023-08-27T11:22:40.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.538+0000 7f5076bff700 1 Processor -- start 2023-08-27T11:22:40.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.538+0000 7f5076bff700 1 -- start start 2023-08-27T11:22:40.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060005260 0x7f5070149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f507014a490 0x7f50700c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507014e3c0 con 0x7f50700c34a0 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700c2aa0 con 0x7f5060005260 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f5076bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507014a910 con 0x7f507014a490 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f507519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f507519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33164/0 (socket says 172.21.15.43:33164) 2023-08-27T11:22:40.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.539+0000 7f507519c700 1 -- 172.21.15.43:0/3680514973 learned_addr learned my addr 172.21.15.43:0/3680514973 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:40.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f506ffff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f507014a490 0x7f50700c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507499b700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060005260 0x7f5070149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 -- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f507014a490 msgr2=0x7f50700c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f507014a490 0x7f50700c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 -- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060005260 msgr2=0x7f5070149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060005260 0x7f5070149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 -- 172.21.15.43:0/3680514973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700c3920 con 0x7f50700c34a0 2023-08-27T11:22:40.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f507519c700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f50700c3ef0 tx=0x7f50680014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680052d0 con 0x7f50700c34a0 2023-08-27T11:22:40.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068005430 con 0x7f50700c34a0 2023-08-27T11:22:40.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700bdb30 con 0x7f50700c34a0 2023-08-27T11:22:40.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.540+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680057a0 con 0x7f50700c34a0 2023-08-27T11:22:40.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.541+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700c1960 con 0x7f50700c34a0 2023-08-27T11:22:40.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.542+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50700c2c80 con 0x7f50700c34a0 2023-08-27T11:22:40.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.542+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f506801c470 con 0x7f50700c34a0 2023-08-27T11:22:40.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.544+0000 7f506d7fa700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 0x7f505406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.544+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5068088e10 con 0x7f50700c34a0 2023-08-27T11:22:40.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.544+0000 7f507499b700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 0x7f505406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.544+0000 7f507499b700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 0x7f505406c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5064000c00 tx=0x7f5064000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.548+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50700c2c80 con 0x7f50700c34a0 2023-08-27T11:22:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.757+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f507004ee70 con 0x7f50700c34a0 2023-08-27T11:22:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.758+0000 7f506d7fa700 1 -- 172.21.15.43:0/3680514973 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f506808c030 con 0x7f50700c34a0 2023-08-27T11:22:40.760 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:40.760 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:22:40.760 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:22:40.760 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:22:40.761 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:22:40.761 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:22:40.761 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:22:40.761 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:22:40.762 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:22:40.762 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:22:40.762 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:22:40.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 msgr2=0x7f505406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 0x7f505406c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5064000c00 tx=0x7f5064000ed0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 msgr2=0x7f50701ed100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f50700c3ef0 tx=0x7f50680014a0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 shutdown_connections 2023-08-27T11:22:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505406a0e0 0x7f505406c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c34a0 0x7f50701ed100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5060005260 0x7f5070149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 --2- 172.21.15.43:0/3680514973 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f507014a490 0x7f50700c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.760+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 >> 172.21.15.43:0/3680514973 conn(0x7f50700ab820 msgr2=0x7f5070150bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.761+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 shutdown_connections 2023-08-27T11:22:40.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.761+0000 7f5076bff700 1 -- 172.21.15.43:0/3680514973 wait complete. 2023-08-27T11:22:40.779 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:22:40.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:22:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.989+0000 7f00a15ff700 1 Processor -- start 2023-08-27T11:22:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.990+0000 7f00a15ff700 1 -- start start 2023-08-27T11:22:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f00a15ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f009c0c4700 0x7f009c0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f00a15ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f00a15ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c154730 con 0x7f009c151a40 2023-08-27T11:22:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f00a15ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c154520 con 0x7f009c0c4700 2023-08-27T11:22:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f00a15ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c154a10 con 0x7f009c06b780 2023-08-27T11:22:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f009b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f009a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f009c0c4700 0x7f009c0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f009b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:40522/0 (socket says 172.21.15.43:40522) 2023-08-27T11:22:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f009b7fe700 1 -- 172.21.15.43:0/1300772830 learned_addr learned my addr 172.21.15.43:0/1300772830 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.991+0000 7f009affd700 1 --1- 172.21.15.43:0/1300772830 >> v1:172.21.15.57:6789/0 conn(0x7f009c151a40 0x7f009c0c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:52466/0 (socket says 172.21.15.43:52466) 2023-08-27T11:22:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f009b7fe700 1 -- 172.21.15.43:0/1300772830 >> v2:172.21.15.57:3300/0 conn(0x7f009c0c4700 msgr2=0x7f009c0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f009b7fe700 1 --2- 172.21.15.43:0/1300772830 >> v2:172.21.15.57:3300/0 conn(0x7f009c0c4700 0x7f009c0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f009b7fe700 1 -- 172.21.15.43:0/1300772830 >> v1:172.21.15.57:6789/0 conn(0x7f009c151a40 legacy=0x7f009c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f009b7fe700 1 -- 172.21.15.43:0/1300772830 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c154cf0 con 0x7f009c06b780 2023-08-27T11:22:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f009b7fe700 1 --2- 172.21.15.43:0/1300772830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0094009e50 tx=0x7f009400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21d640366af2558 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f0099ffb700 1 -- 172.21.15.43:0/1300772830 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400e070 con 0x7f009c06b780 2023-08-27T11:22:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f0099ffb700 1 -- 172.21.15.43:0/1300772830 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009400b910 con 0x7f009c06b780 2023-08-27T11:22:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.992+0000 7f0099ffb700 1 -- 172.21.15.43:0/1300772830 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009400bcc0 con 0x7f009c06b780 2023-08-27T11:22:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 -- 172.21.15.43:0/1300772830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 msgr2=0x7f009c06bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 --2- 172.21.15.43:0/1300772830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0094009e50 tx=0x7f009400b330 comp rx=0 tx=0).stop 2023-08-27T11:22:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 -- 172.21.15.43:0/1300772830 shutdown_connections 2023-08-27T11:22:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 --2- 172.21.15.43:0/1300772830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c06b780 0x7f009c06bbd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 --2- 172.21.15.43:0/1300772830 >> v2:172.21.15.57:3300/0 conn(0x7f009c0c4700 0x7f009c0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 -- 172.21.15.43:0/1300772830 >> 172.21.15.43:0/1300772830 conn(0x7f009c0ab890 msgr2=0x7f009c0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 -- 172.21.15.43:0/1300772830 shutdown_connections 2023-08-27T11:22:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.993+0000 7f00a15ff700 1 -- 172.21.15.43:0/1300772830 wait complete. 2023-08-27T11:22:41.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.995+0000 7f00a15ff700 1 Processor -- start 2023-08-27T11:22:41.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.995+0000 7f00a15ff700 1 -- start start 2023-08-27T11:22:41.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:41.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c0c4700 0x7f009c1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:41.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f009c151a40 0x7f009c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:41.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c14ecd0 con 0x7f009c06b780 2023-08-27T11:22:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c14bda0 con 0x7f009c151a40 2023-08-27T11:22:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f00a15ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c14c040 con 0x7f009c0c4700 2023-08-27T11:22:41.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:41.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33176/0 (socket says 172.21.15.43:33176) 2023-08-27T11:22:41.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 -- 172.21.15.43:0/3728505504 learned_addr learned my addr 172.21.15.43:0/3728505504 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:41.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009a7fc700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c0c4700 0x7f009c1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:41.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009b7fe700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f009c151a40 0x7f009c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:41.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 -- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c0c4700 msgr2=0x7f009c1467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:41.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c0c4700 0x7f009c1467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 -- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f009c151a40 msgr2=0x7f009c146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f009c151a40 0x7f009c146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.996+0000 7f009affd700 1 -- 172.21.15.43:0/3728505504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094009b30 con 0x7f009c06b780 2023-08-27T11:22:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f009affd700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c500 tx=0x7f008c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:41.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c005cb0 con 0x7f009c06b780 2023-08-27T11:22:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c005e10 con 0x7f009c06b780 2023-08-27T11:22:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c0072d0 con 0x7f009c06b780 2023-08-27T11:22:41.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c14e680 con 0x7f009c06b780 2023-08-27T11:22:41.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.997+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c0c37d0 con 0x7f009c06b780 2023-08-27T11:22:41.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.998+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c04ee70 con 0x7f009c06b780 2023-08-27T11:22:41.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:40.999+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f008c007430 con 0x7f009c06b780 2023-08-27T11:22:41.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.000+0000 7f00837fe700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 0x7f008806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:41.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.000+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f008c087360 con 0x7f009c06b780 2023-08-27T11:22:41.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.000+0000 7f009a7fc700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 0x7f008806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:41.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.001+0000 7f009a7fc700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 0x7f008806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f009c157e50 tx=0x7f0090009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:41.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.004+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f008c052ee0 con 0x7f009c06b780 2023-08-27T11:22:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.216+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f009c146600 con 0x7f009c06b780 2023-08-27T11:22:41.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.942+0000 7f00837fe700 1 -- 172.21.15.43:0/3728505504 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f008c056500 con 0x7f009c06b780 2023-08-27T11:22:41.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 msgr2=0x7f008806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:41.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 0x7f008806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f009c157e50 tx=0x7f0090009210 comp rx=0 tx=0).stop 2023-08-27T11:22:41.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 msgr2=0x7f009c0c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:41.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c500 tx=0x7f008c00c810 comp rx=0 tx=0).stop 2023-08-27T11:22:41.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 shutdown_connections 2023-08-27T11:22:41.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f008806a0e0 0x7f008806c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f009c151a40 0x7f009c146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f009c06b780 0x7f009c0c3290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 --2- 172.21.15.43:0/3728505504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f009c0c4700 0x7f009c1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:41.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.947+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 >> 172.21.15.43:0/3728505504 conn(0x7f009c0ab890 msgr2=0x7f009c0c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:41.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.948+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 shutdown_connections 2023-08-27T11:22:41.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:41.950+0000 7f00a15ff700 1 -- 172.21.15.43:0/3728505504 wait complete. 2023-08-27T11:22:41.953 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:22:41.974 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:22:42.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.186+0000 7fa8081ff700 1 Processor -- start 2023-08-27T11:22:42.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.186+0000 7fa8081ff700 1 -- start start 2023-08-27T11:22:42.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa8081ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa8000c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa8081ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa8081ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000ac7e0 con 0x7fa800151d20 2023-08-27T11:22:42.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa8081ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000c86a0 con 0x7fa8000c4c50 2023-08-27T11:22:42.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa8081ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80006abd0 con 0x7fa80006a790 2023-08-27T11:22:42.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa80679c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa80579a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa8000c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa80679c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45254/0 (socket says 172.21.15.43:45254) 2023-08-27T11:22:42.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa805f9b700 1 --1- 172.21.15.43:0/3869308854 >> v1:172.21.15.57:6789/0 conn(0x7fa800151d20 0x7fa8000c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:52472/0 (socket says 172.21.15.43:52472) 2023-08-27T11:22:42.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.187+0000 7fa80679c700 1 -- 172.21.15.43:0/3869308854 learned_addr learned my addr 172.21.15.43:0/3869308854 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:42.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80579a700 1 -- 172.21.15.43:0/3869308854 >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 msgr2=0x7fa80015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:42.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80579a700 1 --2- 172.21.15.43:0/3869308854 >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80579a700 1 -- 172.21.15.43:0/3869308854 >> v1:172.21.15.57:6789/0 conn(0x7fa800151d20 legacy=0x7fa8000c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80579a700 1 -- 172.21.15.43:0/3869308854 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000c99f0 con 0x7fa80006a790 2023-08-27T11:22:42.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80679c700 1 --2- 172.21.15.43:0/3869308854 >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:42.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa80579a700 1 --2- 172.21.15.43:0/3869308854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa8000c4710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009840 tx=0x7fa7f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1d5087a6aeeed1b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:42.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.188+0000 7fa804f99700 1 -- 172.21.15.43:0/3869308854 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0004230 con 0x7fa80006a790 2023-08-27T11:22:42.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa804f99700 1 -- 172.21.15.43:0/3869308854 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0004390 con 0x7fa80006a790 2023-08-27T11:22:42.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa804f99700 1 -- 172.21.15.43:0/3869308854 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00036a0 con 0x7fa80006a790 2023-08-27T11:22:42.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 -- 172.21.15.43:0/3869308854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 msgr2=0x7fa8000c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 --2- 172.21.15.43:0/3869308854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa8000c4710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009840 tx=0x7fa7f0009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:42.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 -- 172.21.15.43:0/3869308854 shutdown_connections 2023-08-27T11:22:42.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 --2- 172.21.15.43:0/3869308854 >> v2:172.21.15.57:3300/0 conn(0x7fa8000c4c50 0x7fa80015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 --2- 172.21.15.43:0/3869308854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa8000c4710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 -- 172.21.15.43:0/3869308854 >> 172.21.15.43:0/3869308854 conn(0x7fa8000ab880 msgr2=0x7fa8000abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:42.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 -- 172.21.15.43:0/3869308854 shutdown_connections 2023-08-27T11:22:42.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.189+0000 7fa8081ff700 1 -- 172.21.15.43:0/3869308854 wait complete. 2023-08-27T11:22:42.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.191+0000 7fa8081ff700 1 Processor -- start 2023-08-27T11:22:42.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.191+0000 7fa8081ff700 1 -- start start 2023-08-27T11:22:42.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa800157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8000c4c50 0x7fa8000c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800158bd0 con 0x7fa800151d20 2023-08-27T11:22:42.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80014a880 con 0x7fa8000c4c50 2023-08-27T11:22:42.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa8081ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80014af70 con 0x7fa80006a790 2023-08-27T11:22:42.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa80679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa80679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33184/0 (socket says 172.21.15.43:33184) 2023-08-27T11:22:42.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa80679c700 1 -- 172.21.15.43:0/2119794504 learned_addr learned my addr 172.21.15.43:0/2119794504 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:42.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa80579a700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8000c4c50 0x7fa8000c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.192+0000 7fa805f9b700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa800157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 -- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 msgr2=0x7fa800157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa800157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 -- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8000c4c50 msgr2=0x7fa8000c05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8000c4c50 0x7fa8000c05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 -- 172.21.15.43:0/2119794504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009b30 con 0x7fa800151d20 2023-08-27T11:22:42.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa80679c700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800efc0 tx=0x7fa7f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:42.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8018070 con 0x7fa800151d20 2023-08-27T11:22:42.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800f040 con 0x7fa800151d20 2023-08-27T11:22:42.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00094a0 con 0x7fa800151d20 2023-08-27T11:22:42.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003c20 con 0x7fa800151d20 2023-08-27T11:22:42.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.193+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000c3c10 con 0x7fa800151d20 2023-08-27T11:22:42.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.194+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80014ad10 con 0x7fa800151d20 2023-08-27T11:22:42.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.195+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7f800c880 con 0x7fa800151d20 2023-08-27T11:22:42.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.196+0000 7fa7f67fc700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:42.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.196+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa7f8088510 con 0x7fa800151d20 2023-08-27T11:22:42.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.197+0000 7fa805f9b700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:42.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.197+0000 7fa805f9b700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000f60 tx=0x7fa7fc004a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:42.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.201+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7f8053dd0 con 0x7fa800151d20 2023-08-27T11:22:42.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.411+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa8000c3da0 con 0x7fa800151d20 2023-08-27T11:22:42.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.949+0000 7fa7f67fc700 1 -- 172.21.15.43:0/2119794504 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7f80573f0 con 0x7fa800151d20 2023-08-27T11:22:42.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 msgr2=0x7fa7e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000f60 tx=0x7fa7fc004a50 comp rx=0 tx=0).stop 2023-08-27T11:22:42.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 msgr2=0x7fa800153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800efc0 tx=0x7fa7f800c3a0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 shutdown_connections 2023-08-27T11:22:42.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa800151d20 0x7fa800153d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa80006a790 0x7fa800157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 --2- 172.21.15.43:0/2119794504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8000c4c50 0x7fa8000c05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.955+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 >> 172.21.15.43:0/2119794504 conn(0x7fa8000ab880 msgr2=0x7fa8000c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:42.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.956+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 shutdown_connections 2023-08-27T11:22:42.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:42.958+0000 7fa8081ff700 1 -- 172.21.15.43:0/2119794504 wait complete. 2023-08-27T11:22:42.968 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:22:42.992 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:22:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.197+0000 7f19383ff700 1 Processor -- start 2023-08-27T11:22:43.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.198+0000 7f19383ff700 1 -- start start 2023-08-27T11:22:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f19383ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19300c7c00 0x7f19300c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f19383ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1930154660 con 0x7f193006a8e0 2023-08-27T11:22:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f19383ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1930154940 con 0x7f1930151d20 2023-08-27T11:22:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f19383ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300c5750 con 0x7f19300c7c00 2023-08-27T11:22:43.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f193599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f19300c7c00 0x7f19300c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f193699c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f193006a8e0 0x7f193006acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49436/0 (socket says 172.21.15.43:49436) 2023-08-27T11:22:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f193699c700 1 -- 172.21.15.43:0/2728080164 learned_addr learned my addr 172.21.15.43:0/2728080164 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f193599a700 1 -- 172.21.15.43:0/2728080164 >> v1:172.21.15.57:6789/0 conn(0x7f1930151d20 legacy=0x7f19300ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.199+0000 7f193599a700 1 -- 172.21.15.43:0/2728080164 >> v1:172.21.15.43:6789/0 conn(0x7f193006a8e0 legacy=0x7f193006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.200+0000 7f193599a700 1 -- 172.21.15.43:0/2728080164 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930154c20 con 0x7f19300c7c00 2023-08-27T11:22:43.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.200+0000 7f193599a700 1 --2- 172.21.15.43:0/2728080164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19300c7c00 0x7f19300c8110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1930152140 tx=0x7f1920009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6688c26ba067c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:43.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.200+0000 7f1935199700 1 -- 172.21.15.43:0/2728080164 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920004020 con 0x7f19300c7c00 2023-08-27T11:22:43.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.200+0000 7f1935199700 1 -- 172.21.15.43:0/2728080164 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920004180 con 0x7f19300c7c00 2023-08-27T11:22:43.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.200+0000 7f1935199700 1 -- 172.21.15.43:0/2728080164 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920004530 con 0x7f19300c7c00 2023-08-27T11:22:43.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 -- 172.21.15.43:0/2728080164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19300c7c00 msgr2=0x7f19300c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 --2- 172.21.15.43:0/2728080164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19300c7c00 0x7f19300c8110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1930152140 tx=0x7f1920009b20 comp rx=0 tx=0).stop 2023-08-27T11:22:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 -- 172.21.15.43:0/2728080164 shutdown_connections 2023-08-27T11:22:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 --2- 172.21.15.43:0/2728080164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19300c7c00 0x7f19300c8110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 -- 172.21.15.43:0/2728080164 >> 172.21.15.43:0/2728080164 conn(0x7f19300c9d00 msgr2=0x7f19300ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:43.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 -- 172.21.15.43:0/2728080164 shutdown_connections 2023-08-27T11:22:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.201+0000 7f19383ff700 1 -- 172.21.15.43:0/2728080164 wait complete. 2023-08-27T11:22:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.202+0000 7f19383ff700 1 Processor -- start 2023-08-27T11:22:43.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 -- start start 2023-08-27T11:22:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 0x7f1930156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 0x7f19300bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:43.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300c2b20 con 0x7f193006a8e0 2023-08-27T11:22:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19301ea510 con 0x7f19300c7c00 2023-08-27T11:22:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.203+0000 7f19383ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19301ea7f0 con 0x7f1930151d20 2023-08-27T11:22:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33204/0 (socket says 172.21.15.43:33204) 2023-08-27T11:22:43.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 -- 172.21.15.43:0/436828093 learned_addr learned my addr 172.21.15.43:0/436828093 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:43.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193599a700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 0x7f1930156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:43.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193699c700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 0x7f19300bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:43.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 -- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 msgr2=0x7f19300bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 0x7f19300bfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 -- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 msgr2=0x7f1930156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 0x7f1930156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 -- 172.21.15.43:0/436828093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200094a0 con 0x7f193006a8e0 2023-08-27T11:22:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193599a700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 0x7f1930156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193699c700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 0x7f19300bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:43.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f193619b700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0052d0 con 0x7f193006a8e0 2023-08-27T11:22:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c005430 con 0x7f193006a8e0 2023-08-27T11:22:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0038c0 con 0x7f193006a8e0 2023-08-27T11:22:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.204+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19300c2d70 con 0x7f193006a8e0 2023-08-27T11:22:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.205+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1930157050 con 0x7f193006a8e0 2023-08-27T11:22:43.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.206+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193004ee70 con 0x7f193006a8e0 2023-08-27T11:22:43.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.207+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f192c003a20 con 0x7f193006a8e0 2023-08-27T11:22:43.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.208+0000 7f1926ffd700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:43.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.208+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f192c087810 con 0x7f193006a8e0 2023-08-27T11:22:43.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.208+0000 7f193599a700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:43.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.208+0000 7f193599a700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 0x7f191406c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1930152140 tx=0x7f1920008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:43.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.213+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f192c052ff0 con 0x7f193006a8e0 2023-08-27T11:22:43.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.469+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f19300ac650 con 0x7f193006a8e0 2023-08-27T11:22:43.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.952+0000 7f1926ffd700 1 -- 172.21.15.43:0/436828093 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f192c056610 con 0x7f193006a8e0 2023-08-27T11:22:43.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.958+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 msgr2=0x7f191406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.958+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 0x7f191406c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1930152140 tx=0x7f1920008030 comp rx=0 tx=0).stop 2023-08-27T11:22:43.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.958+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 msgr2=0x7f19301586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:43.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.958+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c450 tx=0x7f192c00c810 comp rx=0 tx=0).stop 2023-08-27T11:22:43.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 shutdown_connections 2023-08-27T11:22:43.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f191406a0e0 0x7f191406c5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1930151d20 0x7f19300bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f193006a8e0 0x7f19301586f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 --2- 172.21.15.43:0/436828093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19300c7c00 0x7f1930156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:43.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.959+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 >> 172.21.15.43:0/436828093 conn(0x7f19300c9d00 msgr2=0x7f19301523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:43.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.963+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 shutdown_connections 2023-08-27T11:22:43.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:43.963+0000 7f19383ff700 1 -- 172.21.15.43:0/436828093 wait complete. 2023-08-27T11:22:43.973 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 3 and data pool 4 2023-08-27T11:22:44.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:44.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.211+0000 7efe9f1ff700 1 Processor -- start 2023-08-27T11:22:44.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.211+0000 7efe9f1ff700 1 -- start start 2023-08-27T11:22:44.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe98151a90 0x7efe980c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 0x7efe980c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe9806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9806c4e0 con 0x7efe98151a90 2023-08-27T11:22:44.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe98155370 con 0x7efe980c4630 2023-08-27T11:22:44.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98151e70 con 0x7efe9806ad70 2023-08-27T11:22:44.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9cf9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe98151a90 0x7efe980c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9cf9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe98151a90 0x7efe980c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33206/0 (socket says 172.21.15.43:33206) 2023-08-27T11:22:44.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9cf9b700 1 -- 172.21.15.43:0/2240583697 learned_addr learned my addr 172.21.15.43:0/2240583697 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:44.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe97fff700 1 --2- 172.21.15.43:0/2240583697 >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 0x7efe980c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.212+0000 7efe9d79c700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe9806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 -- 172.21.15.43:0/2240583697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 msgr2=0x7efe9806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:44.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe9806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 -- 172.21.15.43:0/2240583697 >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 msgr2=0x7efe980c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:44.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2240583697 >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 0x7efe980c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 -- 172.21.15.43:0/2240583697 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe98154480 con 0x7efe98151a90 2023-08-27T11:22:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe97fff700 1 --2- 172.21.15.43:0/2240583697 >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 0x7efe980c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9d79c700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe9806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe980c7bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe980c7740 tx=0x7efe8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b82bfd3bc2da77 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe977fe700 1 -- 172.21.15.43:0/2240583697 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00b870 con 0x7efe98151a90 2023-08-27T11:22:44.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe977fe700 1 -- 172.21.15.43:0/2240583697 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c00b9d0 con 0x7efe98151a90 2023-08-27T11:22:44.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.213+0000 7efe977fe700 1 -- 172.21.15.43:0/2240583697 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00bd60 con 0x7efe98151a90 2023-08-27T11:22:44.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2240583697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 msgr2=0x7efe980c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe980c7bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe980c7740 tx=0x7efe8c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2240583697 shutdown_connections 2023-08-27T11:22:44.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe9806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2240583697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe980c7bb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2240583697 >> v2:172.21.15.57:3300/0 conn(0x7efe980c4630 0x7efe980c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2240583697 >> 172.21.15.43:0/2240583697 conn(0x7efe980ab820 msgr2=0x7efe980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:44.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2240583697 shutdown_connections 2023-08-27T11:22:44.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.214+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2240583697 wait complete. 2023-08-27T11:22:44.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.216+0000 7efe9f1ff700 1 Processor -- start 2023-08-27T11:22:44.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.216+0000 7efe9f1ff700 1 -- start start 2023-08-27T11:22:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe980c4630 0x7efe980c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe9814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98156170 con 0x7efe98151a90 2023-08-27T11:22:44.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98154270 con 0x7efe980c4630 2023-08-27T11:22:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c34b0 con 0x7efe9806ad70 2023-08-27T11:22:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9cf9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe9814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9cf9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:40570/0 (socket says 172.21.15.43:40570) 2023-08-27T11:22:44.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9cf9b700 1 -- 172.21.15.43:0/2024097558 learned_addr learned my addr 172.21.15.43:0/2024097558 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:44.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe97fff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe980c4630 0x7efe980c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 -- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 msgr2=0x7efe980c0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 -- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe980c4630 msgr2=0x7efe980c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe980c4630 0x7efe980c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9d79c700 1 -- 172.21.15.43:0/2024097558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c009550 con 0x7efe98151a90 2023-08-27T11:22:44.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.217+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:44.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe9d79c700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe9814d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe90007db0 tx=0x7efe9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000dcc0 con 0x7efe98151a90 2023-08-27T11:22:44.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9000f040 con 0x7efe98151a90 2023-08-27T11:22:44.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90015600 con 0x7efe98151a90 2023-08-27T11:22:44.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe980c3cc0 con 0x7efe98151a90 2023-08-27T11:22:44.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.218+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980c39e0 con 0x7efe98151a90 2023-08-27T11:22:44.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.219+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98140a70 con 0x7efe98151a90 2023-08-27T11:22:44.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.220+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe9001e3b0 con 0x7efe98151a90 2023-08-27T11:22:44.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.221+0000 7efe957fa700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 0x7efe7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.221+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe900883f0 con 0x7efe98151a90 2023-08-27T11:22:44.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.221+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 0x7efe7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.222+0000 7efe9cf9b700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 0x7efe7c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009c10 tx=0x7efe8c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.226+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efe90053b80 con 0x7efe98151a90 2023-08-27T11:22:44.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.438+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe98154a10 con 0x7efe98151a90 2023-08-27T11:22:44.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.440+0000 7efe957fa700 1 -- 172.21.15.43:0/2024097558 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7efe900571a0 con 0x7efe98151a90 2023-08-27T11:22:44.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:44.442 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":20,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:43.471264+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:44.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 msgr2=0x7efe7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 0x7efe7c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009c10 tx=0x7efe8c008030 comp rx=0 tx=0).stop 2023-08-27T11:22:44.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 msgr2=0x7efe9814d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe9814d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe90007db0 tx=0x7efe9000d3b0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 shutdown_connections 2023-08-27T11:22:44.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe7c06a0e0 0x7efe7c06c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe98151a90 0x7efe9814d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe9806ad70 0x7efe980c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 --2- 172.21.15.43:0/2024097558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe980c4630 0x7efe980c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 >> 172.21.15.43:0/2024097558 conn(0x7efe980ab820 msgr2=0x7efe980c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:44.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.442+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 shutdown_connections 2023-08-27T11:22:44.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.443+0000 7efe9f1ff700 1 -- 172.21.15.43:0/2024097558 wait complete. 2023-08-27T11:22:44.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:44.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.662+0000 7fa1297ff700 1 Processor -- start 2023-08-27T11:22:44.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.662+0000 7fa1297ff700 1 -- start start 2023-08-27T11:22:44.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1297ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa124151a90 0x7fa1240c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1297ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1240c4a90 0x7fa12406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1297ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12406c4e0 con 0x7fa1240c4630 2023-08-27T11:22:44.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1297ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa124155370 con 0x7fa124151a90 2023-08-27T11:22:44.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1297ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa124151e70 con 0x7fa1240c4a90 2023-08-27T11:22:44.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa122ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa124151a90 0x7fa1240c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa122ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa124151a90 0x7fa1240c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33228/0 (socket says 172.21.15.43:33228) 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa122ffd700 1 -- 172.21.15.43:0/1423308122 learned_addr learned my addr 172.21.15.43:0/1423308122 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.663+0000 7fa1237fe700 1 --2- 172.21.15.43:0/1423308122 >> v2:172.21.15.57:3300/0 conn(0x7fa1240c4a90 0x7fa12406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa122ffd700 1 -- 172.21.15.43:0/1423308122 >> v2:172.21.15.57:3300/0 conn(0x7fa1240c4a90 msgr2=0x7fa12406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa122ffd700 1 --2- 172.21.15.43:0/1423308122 >> v2:172.21.15.57:3300/0 conn(0x7fa1240c4a90 0x7fa12406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa122ffd700 1 -- 172.21.15.43:0/1423308122 >> v1:172.21.15.57:6789/0 conn(0x7fa1240c4630 legacy=0x7fa12406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa122ffd700 1 -- 172.21.15.43:0/1423308122 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124154480 con 0x7fa124151a90 2023-08-27T11:22:44.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa122ffd700 1 --2- 172.21.15.43:0/1423308122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa124151a90 0x7fa1240c7bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1240c4270 tx=0x7fa114009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabd8c3f7994662 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa121ffb700 1 -- 172.21.15.43:0/1423308122 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400b870 con 0x7fa124151a90 2023-08-27T11:22:44.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa121ffb700 1 -- 172.21.15.43:0/1423308122 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11400b9d0 con 0x7fa124151a90 2023-08-27T11:22:44.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.664+0000 7fa121ffb700 1 -- 172.21.15.43:0/1423308122 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11400bd60 con 0x7fa124151a90 2023-08-27T11:22:44.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 -- 172.21.15.43:0/1423308122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa124151a90 msgr2=0x7fa1240c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 --2- 172.21.15.43:0/1423308122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa124151a90 0x7fa1240c7bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1240c4270 tx=0x7fa114009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 -- 172.21.15.43:0/1423308122 shutdown_connections 2023-08-27T11:22:44.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 --2- 172.21.15.43:0/1423308122 >> v2:172.21.15.57:3300/0 conn(0x7fa1240c4a90 0x7fa12406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 --2- 172.21.15.43:0/1423308122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa124151a90 0x7fa1240c7bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 -- 172.21.15.43:0/1423308122 >> 172.21.15.43:0/1423308122 conn(0x7fa1240ab820 msgr2=0x7fa1240abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:44.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 -- 172.21.15.43:0/1423308122 shutdown_connections 2023-08-27T11:22:44.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.665+0000 7fa1297ff700 1 -- 172.21.15.43:0/1423308122 wait complete. 2023-08-27T11:22:44.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.667+0000 7fa1297ff700 1 Processor -- start 2023-08-27T11:22:44.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.667+0000 7fa1297ff700 1 -- start start 2023-08-27T11:22:44.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1240c4630 0x7fa1241ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa124151a90 0x7fa1241ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1240c1720 con 0x7fa1240c4a90 2023-08-27T11:22:44.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414e1b0 con 0x7fa1240c4630 2023-08-27T11:22:44.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1297ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12414dd20 con 0x7fa124151a90 2023-08-27T11:22:44.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33230/0 (socket says 172.21.15.43:33230) 2023-08-27T11:22:44.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 -- 172.21.15.43:0/3902794711 learned_addr learned my addr 172.21.15.43:0/3902794711 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:44.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa122ffd700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1240c4630 0x7fa1241ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1237fe700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa124151a90 0x7fa1241ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 -- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa124151a90 msgr2=0x7fa1241ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa124151a90 0x7fa1241ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 -- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1240c4630 msgr2=0x7fa1241ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1240c4630 0x7fa1241ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.668+0000 7fa1227fc700 1 -- 172.21.15.43:0/3902794711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa114009550 con 0x7fa1240c4a90 2023-08-27T11:22:44.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa1227fc700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c540 tx=0x7fa11800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180052d0 con 0x7fa1240c4a90 2023-08-27T11:22:44.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa118005430 con 0x7fa1240c4a90 2023-08-27T11:22:44.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12414d3f0 con 0x7fa1240c4a90 2023-08-27T11:22:44.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180038c0 con 0x7fa1240c4a90 2023-08-27T11:22:44.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.669+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12414d9b0 con 0x7fa1240c4a90 2023-08-27T11:22:44.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.670+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12404ee70 con 0x7fa1240c4a90 2023-08-27T11:22:44.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.671+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa118003a20 con 0x7fa1240c4a90 2023-08-27T11:22:44.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.672+0000 7fa10b7fe700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 0x7fa11006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:44.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.672+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1180878f0 con 0x7fa1240c4a90 2023-08-27T11:22:44.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.672+0000 7fa122ffd700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 0x7fa11006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:44.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.673+0000 7fa122ffd700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 0x7fa11006c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa114014040 tx=0x7fa114008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:44.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.676+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa118052fd0 con 0x7fa1240c4a90 2023-08-27T11:22:44.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.888+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa12414de60 con 0x7fa1240c4a90 2023-08-27T11:22:44.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.889+0000 7fa10b7fe700 1 -- 172.21.15.43:0/3902794711 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18174 (secure 0 0 0) 0x7fa1180565f0 con 0x7fa1240c4a90 2023-08-27T11:22:44.891 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:44.891 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":20,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:43.471264+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:44.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 msgr2=0x7fa11006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 0x7fa11006c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa114014040 tx=0x7fa114008030 comp rx=0 tx=0).stop 2023-08-27T11:22:44.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 msgr2=0x7fa1240aaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:44.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c540 tx=0x7fa11800c850 comp rx=0 tx=0).stop 2023-08-27T11:22:44.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 shutdown_connections 2023-08-27T11:22:44.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa11006a0e0 0x7fa11006c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.891+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa124151a90 0x7fa1241ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.892+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1240c4630 0x7fa1241ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.892+0000 7fa1297ff700 1 --2- 172.21.15.43:0/3902794711 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1240c4a90 0x7fa1240aaaf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:44.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.892+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 >> 172.21.15.43:0/3902794711 conn(0x7fa1240ab820 msgr2=0x7fa1240c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:44.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.892+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 shutdown_connections 2023-08-27T11:22:44.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:44.892+0000 7fa1297ff700 1 -- 172.21.15.43:0/3902794711 wait complete. 2023-08-27T11:22:44.912 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:22:45.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.117+0000 7f30f81ff700 1 Processor -- start 2023-08-27T11:22:45.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.117+0000 7f30f81ff700 1 -- start start 2023-08-27T11:22:45.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.118+0000 7f30f81ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f30f0151d20 0x7f30f00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f81ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f006a8e0 0x7f30f006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f81ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f0154660 con 0x7f30f00c7c00 2023-08-27T11:22:45.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f81ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f00c5750 con 0x7f30f0151d20 2023-08-27T11:22:45.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f81ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0154940 con 0x7f30f006a8e0 2023-08-27T11:22:45.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f579a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f30f00c7c00 0x7f30f00ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49448/0 (socket says 172.21.15.43:49448) 2023-08-27T11:22:45.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f579a700 1 -- 172.21.15.43:0/2262604713 learned_addr learned my addr 172.21.15.43:0/2262604713 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:45.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/2262604713 >> v2:172.21.15.57:3300/0 conn(0x7f30f0151d20 0x7f30f00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f679c700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f006a8e0 0x7f30f006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971608810 0 0) 0x7f30f0154660 con 0x7f30f00c7c00 2023-08-27T11:22:45.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.119+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30dc0035b0 con 0x7f30f00c7c00 2023-08-27T11:22:45.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f5f9b700 1 -- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f006a8e0 msgr2=0x7f30f006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:45.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f006a8e0 0x7f30f006ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558586490 0 0) 0x7f30dc0035b0 con 0x7f30f00c7c00 2023-08-27T11:22:45.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f5f9b700 1 -- 172.21.15.43:0/2262604713 >> v1:172.21.15.43:6789/0 conn(0x7f30f00c7c00 legacy=0x7f30f00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f5f9b700 1 -- 172.21.15.43:0/2262604713 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0154c20 con 0x7f30f0151d20 2023-08-27T11:22:45.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f0151d20 0x7f30f00c8110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009840 tx=0x7f30ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2c2a082a47e30d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:45.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0001670 con 0x7f30f0151d20 2023-08-27T11:22:45.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec004030 con 0x7f30f0151d20 2023-08-27T11:22:45.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.120+0000 7f30f4f99700 1 -- 172.21.15.43:0/2262604713 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0043c0 con 0x7f30f0151d20 2023-08-27T11:22:45.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 -- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f0151d20 msgr2=0x7f30f00c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f0151d20 0x7f30f00c8110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009840 tx=0x7f30ec009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:45.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 -- 172.21.15.43:0/2262604713 shutdown_connections 2023-08-27T11:22:45.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f006a8e0 0x7f30f006ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 --2- 172.21.15.43:0/2262604713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f0151d20 0x7f30f00c8110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 -- 172.21.15.43:0/2262604713 >> 172.21.15.43:0/2262604713 conn(0x7f30f00c9d00 msgr2=0x7f30f00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:45.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 -- 172.21.15.43:0/2262604713 shutdown_connections 2023-08-27T11:22:45.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.121+0000 7f30f81ff700 1 -- 172.21.15.43:0/2262604713 wait complete. 2023-08-27T11:22:45.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.123+0000 7f30f81ff700 1 Processor -- start 2023-08-27T11:22:45.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.123+0000 7f30f81ff700 1 -- start start 2023-08-27T11:22:45.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 0x7f30f014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f0151d20 0x7f30f00c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0158a50 con 0x7f30f00c7c00 2023-08-27T11:22:45.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0150460 con 0x7f30f006a8e0 2023-08-27T11:22:45.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f81ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0158400 con 0x7f30f0151d20 2023-08-27T11:22:45.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33246/0 (socket says 172.21.15.43:33246) 2023-08-27T11:22:45.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 -- 172.21.15.43:0/1931768321 learned_addr learned my addr 172.21.15.43:0/1931768321 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:45.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 0x7f30f014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f679c700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f0151d20 0x7f30f00c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 -- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f0151d20 msgr2=0x7f30f00c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f0151d20 0x7f30f00c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 -- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 msgr2=0x7f30f014ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 0x7f30f014ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f579a700 1 -- 172.21.15.43:0/1931768321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0094a0 con 0x7f30f00c7c00 2023-08-27T11:22:45.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.124+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 0x7f30f014ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:45.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30f579a700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30e00011e0 tx=0x7f30e000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:45.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0004c80 con 0x7f30f00c7c00 2023-08-27T11:22:45.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0004e00 con 0x7f30f00c7c00 2023-08-27T11:22:45.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0007310 con 0x7f30f00c7c00 2023-08-27T11:22:45.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f01586e0 con 0x7f30f00c7c00 2023-08-27T11:22:45.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.125+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f00c0a80 con 0x7f30f00c7c00 2023-08-27T11:22:45.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.126+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f00c1750 con 0x7f30f00c7c00 2023-08-27T11:22:45.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.127+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f30e0007470 con 0x7f30f00c7c00 2023-08-27T11:22:45.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.128+0000 7f30e67fc700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 0x7f30d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:45.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.128+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30e0088330 con 0x7f30f00c7c00 2023-08-27T11:22:45.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.128+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 0x7f30d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:45.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.129+0000 7f30f5f9b700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 0x7f30d406c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:45.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.132+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f30f00c1750 con 0x7f30f00c7c00 2023-08-27T11:22:45.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.392+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f30f00c1750 con 0x7f30f00c7c00 2023-08-27T11:22:45.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.990+0000 7f30e67fc700 1 -- 172.21.15.43:0/1931768321 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30f00c1750 con 0x7f30f00c7c00 2023-08-27T11:22:45.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 msgr2=0x7f30d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 0x7f30d406c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec013040 comp rx=0 tx=0).stop 2023-08-27T11:22:45.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 msgr2=0x7f30f00c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:45.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30e00011e0 tx=0x7f30e000ca90 comp rx=0 tx=0).stop 2023-08-27T11:22:45.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 shutdown_connections 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f30d406a0e0 0x7f30d406c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30f0151d20 0x7f30f00c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30f006a8e0 0x7f30f014ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 --2- 172.21.15.43:0/1931768321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f30f00c7c00 0x7f30f00c2cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 >> 172.21.15.43:0/1931768321 conn(0x7f30f00c9d00 msgr2=0x7f30f00c6710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:45.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 shutdown_connections 2023-08-27T11:22:45.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:45.993+0000 7f30f81ff700 1 -- 172.21.15.43:0/1931768321 wait complete. 2023-08-27T11:22:46.015 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:22:46.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:22:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.223+0000 7f3c4b9ff700 1 Processor -- start 2023-08-27T11:22:46.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.223+0000 7f3c4b9ff700 1 -- start start 2023-08-27T11:22:46.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 0x7f3c440c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4b9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44154660 con 0x7f3c44151d20 2023-08-27T11:22:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4b9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44154940 con 0x7f3c440c7c00 2023-08-27T11:22:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440c5750 con 0x7f3c4406aff0 2023-08-27T11:22:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4979b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3c44151d20 0x7f3c440ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49462/0 (socket says 172.21.15.43:49462) 2023-08-27T11:22:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c4979b700 1 -- 172.21.15.43:0/1872708095 learned_addr learned my addr 172.21.15.43:0/1872708095 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.224+0000 7f3c49f9c700 1 --2- 172.21.15.43:0/1872708095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 0x7f3c440c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899076881 0 0) 0x7f3c44154660 con 0x7f3c44151d20 2023-08-27T11:22:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c300035b0 con 0x7f3c44151d20 2023-08-27T11:22:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698853456 0 0) 0x7f3c44154940 con 0x7f3c440c7c00 2023-08-27T11:22:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44154660 con 0x7f3c440c7c00 2023-08-27T11:22:46.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c49f9c700 1 -- 172.21.15.43:0/1872708095 >> v1:172.21.15.57:6789/0 conn(0x7f3c440c7c00 legacy=0x7f3c4406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:46.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c49f9c700 1 -- 172.21.15.43:0/1872708095 >> v1:172.21.15.43:6789/0 conn(0x7f3c44151d20 legacy=0x7f3c440ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:46.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c49f9c700 1 -- 172.21.15.43:0/1872708095 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44154c20 con 0x7f3c4406aff0 2023-08-27T11:22:46.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c49f9c700 1 --2- 172.21.15.43:0/1872708095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 0x7f3c440c8110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009dc0 tx=0x7f3c3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d77e029cc5c685ea server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:46.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c4406aff0 2023-08-27T11:22:46.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00bb20 con 0x7f3c4406aff0 2023-08-27T11:22:46.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.225+0000 7f3c3bfff700 1 -- 172.21.15.43:0/1872708095 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012430 con 0x7f3c4406aff0 2023-08-27T11:22:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/1872708095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 msgr2=0x7f3c440c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/1872708095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 0x7f3c440c8110 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009dc0 tx=0x7f3c3c00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/1872708095 shutdown_connections 2023-08-27T11:22:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/1872708095 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c4406aff0 0x7f3c440c8110 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/1872708095 >> 172.21.15.43:0/1872708095 conn(0x7f3c440c9d00 msgr2=0x7f3c440ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/1872708095 shutdown_connections 2023-08-27T11:22:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.226+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/1872708095 wait complete. 2023-08-27T11:22:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.228+0000 7f3c4b9ff700 1 Processor -- start 2023-08-27T11:22:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.228+0000 7f3c4b9ff700 1 -- start start 2023-08-27T11:22:46.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:46.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c440c7c00 0x7f3c4414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:46.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c44151d20 0x7f3c4414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:46.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441ecc30 con 0x7f3c4406aff0 2023-08-27T11:22:46.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440bd780 con 0x7f3c44151d20 2023-08-27T11:22:46.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440be2c0 con 0x7f3c440c7c00 2023-08-27T11:22:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4979b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4979b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33250/0 (socket says 172.21.15.43:33250) 2023-08-27T11:22:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c4979b700 1 -- 172.21.15.43:0/3745461822 learned_addr learned my addr 172.21.15.43:0/3745461822 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c48f9a700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c440c7c00 0x7f3c4414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.229+0000 7f3c49f9c700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c44151d20 0x7f3c4414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 -- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c440c7c00 msgr2=0x7f3c4414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c440c7c00 0x7f3c4414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 -- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c44151d20 msgr2=0x7f3c4414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c44151d20 0x7f3c4414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 -- 172.21.15.43:0/3745461822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009a70 con 0x7f3c4406aff0 2023-08-27T11:22:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4979b700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c40001eb0 tx=0x7f3c4000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40005d70 con 0x7f3c4406aff0 2023-08-27T11:22:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400070d0 con 0x7f3c4406aff0 2023-08-27T11:22:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c440bd990 con 0x7f3c4406aff0 2023-08-27T11:22:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007440 con 0x7f3c4406aff0 2023-08-27T11:22:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.230+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c441e9650 con 0x7f3c4406aff0 2023-08-27T11:22:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.231+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4404ee70 con 0x7f3c4406aff0 2023-08-27T11:22:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.232+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c400075a0 con 0x7f3c4406aff0 2023-08-27T11:22:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.234+0000 7f3c39ffb700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 0x7f3c2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:46.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.234+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c400877f0 con 0x7f3c4406aff0 2023-08-27T11:22:46.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.234+0000 7f3c48f9a700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 0x7f3c2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:46.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.235+0000 7f3c48f9a700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 0x7f3c2806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c34001220 tx=0x7f3c34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:46.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.238+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c40052f80 con 0x7f3c4406aff0 2023-08-27T11:22:46.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.502+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c440ac650 con 0x7f3c4406aff0 2023-08-27T11:22:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:46.998+0000 7f3c39ffb700 1 -- 172.21.15.43:0/3745461822 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c400565a0 con 0x7f3c4406aff0 2023-08-27T11:22:47.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 msgr2=0x7f3c2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 0x7f3c2806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3c34001220 tx=0x7f3c34009040 comp rx=0 tx=0).stop 2023-08-27T11:22:47.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 msgr2=0x7f3c4414d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c40001eb0 tx=0x7f3c4000c7b0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 shutdown_connections 2023-08-27T11:22:47.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2806a0e0 0x7f3c2806c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c44151d20 0x7f3c4414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c4406aff0 0x7f3c4414d660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 --2- 172.21.15.43:0/3745461822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c440c7c00 0x7f3c4414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 >> 172.21.15.43:0/3745461822 conn(0x7f3c440c9d00 msgr2=0x7f3c440c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:47.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 shutdown_connections 2023-08-27T11:22:47.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.001+0000 7f3c4b9ff700 1 -- 172.21.15.43:0/3745461822 wait complete. 2023-08-27T11:22:47.025 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:22:47.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:22:47.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.229+0000 7f6fcb3ff700 1 Processor -- start 2023-08-27T11:22:47.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.230+0000 7f6fcb3ff700 1 -- start start 2023-08-27T11:22:47.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fcb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fcb3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6fc40c4a90 0x7f6fc406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fcb3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc406c4e0 con 0x7f6fc40c4630 2023-08-27T11:22:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fcb3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc4155370 con 0x7f6fc40c4a90 2023-08-27T11:22:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fcb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4151e70 con 0x7f6fc4151a90 2023-08-27T11:22:47.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fc899a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6fc40c4630 0x7f6fc406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49476/0 (socket says 172.21.15.43:49476) 2023-08-27T11:22:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fc899a700 1 -- 172.21.15.43:0/3284814893 learned_addr learned my addr 172.21.15.43:0/3284814893 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fc919b700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.231+0000 7f6fc999c700 1 --2- 172.21.15.43:0/3284814893 >> v2:172.21.15.57:3300/0 conn(0x7f6fc40c4a90 0x7f6fc406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fbbfff700 1 -- 172.21.15.43:0/3284814893 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585655414 0 0) 0x7f6fc406c4e0 con 0x7f6fc40c4630 2023-08-27T11:22:47.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fbbfff700 1 -- 172.21.15.43:0/3284814893 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb00035b0 con 0x7f6fc40c4630 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc999c700 1 -- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 msgr2=0x7f6fc40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc999c700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc999c700 1 -- 172.21.15.43:0/3284814893 >> v1:172.21.15.43:6789/0 conn(0x7f6fc40c4630 legacy=0x7f6fc406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc999c700 1 -- 172.21.15.43:0/3284814893 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4154480 con 0x7f6fc40c4a90 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc919b700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:47.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fc999c700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4a90 0x7f6fc406b480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009d90 tx=0x7f6fbc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8be2002f15a38ae server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fbbfff700 1 -- 172.21.15.43:0/3284814893 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00e070 con 0x7f6fc40c4a90 2023-08-27T11:22:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fbbfff700 1 -- 172.21.15.43:0/3284814893 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc00bb20 con 0x7f6fc40c4a90 2023-08-27T11:22:47.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.232+0000 7f6fbbfff700 1 -- 172.21.15.43:0/3284814893 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc012430 con 0x7f6fc40c4a90 2023-08-27T11:22:47.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4a90 msgr2=0x7f6fc406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4a90 0x7f6fc406b480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009d90 tx=0x7f6fbc00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:47.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3284814893 shutdown_connections 2023-08-27T11:22:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4a90 0x7f6fc406b480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3284814893 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3284814893 >> 172.21.15.43:0/3284814893 conn(0x7f6fc40ab820 msgr2=0x7f6fc40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3284814893 shutdown_connections 2023-08-27T11:22:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.233+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3284814893 wait complete. 2023-08-27T11:22:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.235+0000 7f6fcb3ff700 1 Processor -- start 2023-08-27T11:22:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.236+0000 7f6fcb3ff700 1 -- start start 2023-08-27T11:22:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4630 0x7f6fc41ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41528b0 con 0x7f6fc40c4a90 2023-08-27T11:22:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41e9bf0 con 0x7f6fc40c4630 2023-08-27T11:22:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fcb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41447d0 con 0x7f6fc4151a90 2023-08-27T11:22:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fc899a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fc899a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33254/0 (socket says 172.21.15.43:33254) 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fc899a700 1 -- 172.21.15.43:0/3240648885 learned_addr learned my addr 172.21.15.43:0/3240648885 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fc919b700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4630 0x7f6fc41ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.237+0000 7f6fc999c700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 -- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 msgr2=0x7f6fc40a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 -- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4630 msgr2=0x7f6fc41ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4630 0x7f6fc41ea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 -- 172.21.15.43:0/3240648885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc00094a0 con 0x7f6fc40c4a90 2023-08-27T11:22:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fc899a700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c730 tx=0x7f6fb400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4005d70 con 0x7f6fc40c4a90 2023-08-27T11:22:47.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb40070d0 con 0x7f6fc40c4a90 2023-08-27T11:22:47.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc009a70 con 0x7f6fc40c4a90 2023-08-27T11:22:47.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4007440 con 0x7f6fc40c4a90 2023-08-27T11:22:47.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.238+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc40aaf10 con 0x7f6fc40c4a90 2023-08-27T11:22:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.239+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc404ee70 con 0x7f6fc40c4a90 2023-08-27T11:22:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.240+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6fb40075a0 con 0x7f6fc40c4a90 2023-08-27T11:22:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.241+0000 7f6fb9ffb700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 0x7f6fa806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.241+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fb4087910 con 0x7f6fc40c4a90 2023-08-27T11:22:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.242+0000 7f6fc919b700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 0x7f6fa806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.242+0000 7f6fc919b700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 0x7f6fa806c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009cd0 tx=0x7f6fc0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.246+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6fb4053020 con 0x7f6fc40c4a90 2023-08-27T11:22:47.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.499+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fc406c130 con 0x7f6fc40c4a90 2023-08-27T11:22:47.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.500+0000 7f6fb9ffb700 1 -- 172.21.15.43:0/3240648885 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f6fb4056640 con 0x7f6fc40c4a90 2023-08-27T11:22:47.502 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:47.502 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:22:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 msgr2=0x7f6fa806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 0x7f6fa806c5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009cd0 tx=0x7f6fc0009210 comp rx=0 tx=0).stop 2023-08-27T11:22:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 msgr2=0x7f6fc4148e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c730 tx=0x7f6fb400ca40 comp rx=0 tx=0).stop 2023-08-27T11:22:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 shutdown_connections 2023-08-27T11:22:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6fa806a110 0x7f6fa806c5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6fc4151a90 0x7f6fc40a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6fc40c4630 0x7f6fc41ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 --2- 172.21.15.43:0/3240648885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fc40c4a90 0x7f6fc4148e90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 >> 172.21.15.43:0/3240648885 conn(0x7f6fc40ab820 msgr2=0x7f6fc40c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 shutdown_connections 2023-08-27T11:22:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.503+0000 7f6fcb3ff700 1 -- 172.21.15.43:0/3240648885 wait complete. 2023-08-27T11:22:47.507 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:22:47.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:47.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.721+0000 7f7a4dbff700 1 Processor -- start 2023-08-27T11:22:47.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.721+0000 7f7a4dbff700 1 -- start start 2023-08-27T11:22:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7a48151a90 0x7f7a480c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 0x7f7a480c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 0x7f7a4806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4806c4e0 con 0x7f7a48151a90 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a48155370 con 0x7f7a480c4630 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.722+0000 7f7a4dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a48151e70 con 0x7f7a4806ad70 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7a48151a90 0x7f7a480c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7a48151a90 0x7f7a480c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33260/0 (socket says 172.21.15.43:33260) 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 -- 172.21.15.43:0/4052816751 learned_addr learned my addr 172.21.15.43:0/4052816751 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:47.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a46ffd700 1 --2- 172.21.15.43:0/4052816751 >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 0x7f7a480c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a47fff700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 0x7f7a4806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 -- 172.21.15.43:0/4052816751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 msgr2=0x7f7a4806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 0x7f7a4806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 -- 172.21.15.43:0/4052816751 >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 msgr2=0x7f7a480c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:47.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 --2- 172.21.15.43:0/4052816751 >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 0x7f7a480c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 -- 172.21.15.43:0/4052816751 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48154480 con 0x7f7a48151a90 2023-08-27T11:22:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a46ffd700 1 --2- 172.21.15.43:0/4052816751 >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 0x7f7a480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a47fff700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 0x7f7a4806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a477fe700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a480c7bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a480c7740 tx=0x7f7a38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4523c0634ca14 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a467fc700 1 -- 172.21.15.43:0/4052816751 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800b870 con 0x7f7a48151a90 2023-08-27T11:22:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.723+0000 7f7a467fc700 1 -- 172.21.15.43:0/4052816751 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800b9d0 con 0x7f7a48151a90 2023-08-27T11:22:47.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a467fc700 1 -- 172.21.15.43:0/4052816751 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3800bd60 con 0x7f7a48151a90 2023-08-27T11:22:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 -- 172.21.15.43:0/4052816751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 msgr2=0x7f7a480c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a480c7bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a480c7740 tx=0x7f7a38009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 -- 172.21.15.43:0/4052816751 shutdown_connections 2023-08-27T11:22:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a4806ad70 0x7f7a4806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/4052816751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a480c7bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/4052816751 >> v2:172.21.15.57:3300/0 conn(0x7f7a480c4630 0x7f7a480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 -- 172.21.15.43:0/4052816751 >> 172.21.15.43:0/4052816751 conn(0x7f7a480ab820 msgr2=0x7f7a480abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 -- 172.21.15.43:0/4052816751 shutdown_connections 2023-08-27T11:22:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.724+0000 7f7a4dbff700 1 -- 172.21.15.43:0/4052816751 wait complete. 2023-08-27T11:22:47.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.726+0000 7f7a4dbff700 1 Processor -- start 2023-08-27T11:22:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.727+0000 7f7a4dbff700 1 -- start start 2023-08-27T11:22:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4806ad70 0x7f7a4814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a480c4630 0x7f7a48153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814c490 con 0x7f7a48151a90 2023-08-27T11:22:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a481e9690 con 0x7f7a4806ad70 2023-08-27T11:22:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a4dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814bdd0 con 0x7f7a480c4630 2023-08-27T11:22:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33272/0 (socket says 172.21.15.43:33272) 2023-08-27T11:22:47.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a47fff700 1 -- 172.21.15.43:0/2226864006 learned_addr learned my addr 172.21.15.43:0/2226864006 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.728+0000 7f7a46ffd700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a480c4630 0x7f7a48153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a477fe700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4806ad70 0x7f7a4814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 -- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a480c4630 msgr2=0x7f7a48153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a480c4630 0x7f7a48153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 -- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4806ad70 msgr2=0x7f7a4814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4806ad70 0x7f7a4814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 -- 172.21.15.43:0/2226864006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a38009550 con 0x7f7a48151a90 2023-08-27T11:22:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a47fff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cef0 tx=0x7f7a4000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000ae50 con 0x7f7a48151a90 2023-08-27T11:22:47.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a40015440 con 0x7f7a48151a90 2023-08-27T11:22:47.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4814c0b0 con 0x7f7a48151a90 2023-08-27T11:22:47.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a400157f0 con 0x7f7a48151a90 2023-08-27T11:22:47.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.729+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a481541d0 con 0x7f7a48151a90 2023-08-27T11:22:47.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.730+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4804ee70 con 0x7f7a48151a90 2023-08-27T11:22:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.731+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a4000d430 con 0x7f7a48151a90 2023-08-27T11:22:47.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.732+0000 7f7a2ffff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 0x7f7a3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.732+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a40088bf0 con 0x7f7a48151a90 2023-08-27T11:22:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.733+0000 7f7a477fe700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 0x7f7a3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.733+0000 7f7a477fe700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 0x7f7a3406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a38014040 tx=0x7f7a38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:47.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.737+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7a40054240 con 0x7f7a48151a90 2023-08-27T11:22:47.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.953+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a48154cf0 con 0x7f7a48151a90 2023-08-27T11:22:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.954+0000 7f7a2ffff700 1 -- 172.21.15.43:0/2226864006 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f7a4001a090 con 0x7f7a48151a90 2023-08-27T11:22:47.956 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:47.956 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:47.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 msgr2=0x7f7a3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 0x7f7a3406c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a38014040 tx=0x7f7a38008030 comp rx=0 tx=0).stop 2023-08-27T11:22:47.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 msgr2=0x7f7a48144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:47.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000cef0 tx=0x7f7a4000a340 comp rx=0 tx=0).stop 2023-08-27T11:22:47.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 shutdown_connections 2023-08-27T11:22:47.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7a3406a0e0 0x7f7a3406c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7a48151a90 0x7f7a48144dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a4806ad70 0x7f7a4814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 --2- 172.21.15.43:0/2226864006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7a480c4630 0x7f7a48153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:47.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 >> 172.21.15.43:0/2226864006 conn(0x7f7a480ab820 msgr2=0x7f7a48150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:47.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 shutdown_connections 2023-08-27T11:22:47.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:47.957+0000 7f7a4dbff700 1 -- 172.21.15.43:0/2226864006 wait complete. 2023-08-27T11:22:47.976 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:22:47.977 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:22:48.133 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:22:48.132+0000 7f21473f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:22:48.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.176+0000 7fc3587ff700 1 Processor -- start 2023-08-27T11:22:48.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.176+0000 7fc3587ff700 1 -- start start 2023-08-27T11:22:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.177+0000 7fc3587ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3500c4640 0x7fc3500c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc3587ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc3501547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc3587ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35006cf60 con 0x7fc3500bd350 2023-08-27T11:22:48.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc3587ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3500c5910 con 0x7fc3500c4640 2023-08-27T11:22:48.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc3587ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3501579c0 con 0x7fc350154330 2023-08-27T11:22:48.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc3500bd350 0x7fc3500c7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:49488/0 (socket says 172.21.15.43:49488) 2023-08-27T11:22:48.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355d9a700 1 -- 172.21.15.43:0/1349599803 learned_addr learned my addr 172.21.15.43:0/1349599803 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:48.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc35659b700 1 --2- 172.21.15.43:0/1349599803 >> v2:172.21.15.57:3300/0 conn(0x7fc3500c4640 0x7fc3500c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc356d9c700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc3501547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883493442 0 0) 0x7fc35006cf60 con 0x7fc3500bd350 2023-08-27T11:22:48.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33c0035b0 con 0x7fc3500bd350 2023-08-27T11:22:48.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480742152 0 0) 0x7fc33c0035b0 con 0x7fc3500bd350 2023-08-27T11:22:48.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 msgr2=0x7fc3501547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:48.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.178+0000 7fc355599700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc3501547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 >> v2:172.21.15.57:3300/0 conn(0x7fc3500c4640 msgr2=0x7fc3500c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:48.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 --2- 172.21.15.43:0/1349599803 >> v2:172.21.15.57:3300/0 conn(0x7fc3500c4640 0x7fc3500c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350157c60 con 0x7fc3500bd350 2023-08-27T11:22:48.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fc340001670 con 0x7fc3500bd350 2023-08-27T11:22:48.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 >> v1:172.21.15.43:6789/0 conn(0x7fc3500bd350 legacy=0x7fc3500c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc33c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c004850 0x7fc33c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc33c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3501579c0 con 0x7fc33c003a00 2023-08-27T11:22:48.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c00ba10 con 0x7fc33c004850 2023-08-27T11:22:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c00bb50 con 0x7fc350154330 2023-08-27T11:22:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc33c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc356d9c700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc33c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc355d9a700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c004850 0x7fc33c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 -- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 msgr2=0x7fc33c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc33c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 -- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c004850 msgr2=0x7fc33c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c004850 0x7fc33c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc35659b700 1 -- 172.21.15.43:0/1349599803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0035b0 con 0x7fc33c003a00 2023-08-27T11:22:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.179+0000 7fc356d9c700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc350154330 0x7fc33c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc35659b700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc33c003e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009b90 tx=0x7fc33c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b543461dd269e32 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00e6c0 con 0x7fc33c003a00 2023-08-27T11:22:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00e820 con 0x7fc33c003a00 2023-08-27T11:22:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc355599700 1 -- 172.21.15.43:0/1349599803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00eb90 con 0x7fc33c003a00 2023-08-27T11:22:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc3587ff700 1 -- 172.21.15.43:0/1349599803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 msgr2=0x7fc33c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc3587ff700 1 --2- 172.21.15.43:0/1349599803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc33c003e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009b90 tx=0x7fc33c005880 comp rx=0 tx=0).stop 2023-08-27T11:22:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc356d9c700 1 -- 172.21.15.43:0/1349599803 reap_dead start 2023-08-27T11:22:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc3587ff700 1 -- 172.21.15.43:0/1349599803 shutdown_connections 2023-08-27T11:22:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc3587ff700 1 -- 172.21.15.43:0/1349599803 >> 172.21.15.43:0/1349599803 conn(0x7fc3500c9cc0 msgr2=0x7fc3500ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.180+0000 7fc3587ff700 1 -- 172.21.15.43:0/1349599803 shutdown_connections 2023-08-27T11:22:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.181+0000 7fc3587ff700 1 -- 172.21.15.43:0/1349599803 wait complete. 2023-08-27T11:22:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.182+0000 7fc3587ff700 1 Processor -- start 2023-08-27T11:22:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.182+0000 7fc3587ff700 1 -- start start 2023-08-27T11:22:48.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3500c2c70 0x7fc35014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3500ae890 0x7fc35014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3500acaf0 con 0x7fc33c003a00 2023-08-27T11:22:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3501e9b30 con 0x7fc3500ae890 2023-08-27T11:22:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc3587ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3501e9e10 con 0x7fc3500c2c70 2023-08-27T11:22:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc35659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc35659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33282/0 (socket says 172.21.15.43:33282) 2023-08-27T11:22:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.183+0000 7fc35659b700 1 -- 172.21.15.43:0/3534948224 learned_addr learned my addr 172.21.15.43:0/3534948224 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc355d9a700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3500c2c70 0x7fc35014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc356d9c700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3500ae890 0x7fc35014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 -- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3500c2c70 msgr2=0x7fc35014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3500c2c70 0x7fc35014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 -- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3500ae890 msgr2=0x7fc35014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3500ae890 0x7fc35014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 -- 172.21.15.43:0/3534948224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500c3120 con 0x7fc33c003a00 2023-08-27T11:22:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc35659b700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0090b0 tx=0x7fc34c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.184+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c021070 con 0x7fc33c003a00 2023-08-27T11:22:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.185+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c0043f0 con 0x7fc33c003a00 2023-08-27T11:22:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.185+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35014d760 con 0x7fc33c003a00 2023-08-27T11:22:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.185+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00e6c0 con 0x7fc33c003a00 2023-08-27T11:22:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.185+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3500c0d00 con 0x7fc33c003a00 2023-08-27T11:22:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.186+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3501e9fd0 con 0x7fc33c003a00 2023-08-27T11:22:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.187+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc34c025070 con 0x7fc33c003a00 2023-08-27T11:22:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.187+0000 7fc346ffd700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 0x7fc33406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.187+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc34c089600 con 0x7fc33c003a00 2023-08-27T11:22:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.188+0000 7fc355d9a700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 0x7fc33406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.188+0000 7fc355d9a700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 0x7fc33406c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3500c3050 tx=0x7fc340007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.192+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc3501e9fd0 con 0x7fc33c003a00 2023-08-27T11:22:48.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.398+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3500c96e0 con 0x7fc33406a0e0 2023-08-27T11:22:48.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.410+0000 7fc346ffd700 1 -- 172.21.15.43:0/3534948224 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286939 (secure 0 0 0) 0x7fc3500c96e0 con 0x7fc33406a0e0 2023-08-27T11:22:48.417 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:48.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 msgr2=0x7fc33406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 0x7fc33406c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3500c3050 tx=0x7fc340007040 comp rx=0 tx=0).stop 2023-08-27T11:22:48.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 msgr2=0x7fc3500c2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0090b0 tx=0x7fc34c0047c0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 shutdown_connections 2023-08-27T11:22:48.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc33406a0e0 0x7fc33406c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3500ae890 0x7fc35014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33c003a00 0x7fc3500c2730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 --2- 172.21.15.43:0/3534948224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3500c2c70 0x7fc35014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 >> 172.21.15.43:0/3534948224 conn(0x7fc3500c9cc0 msgr2=0x7fc3501535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:48.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 shutdown_connections 2023-08-27T11:22:48.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.414+0000 7fc3587ff700 1 -- 172.21.15.43:0/3534948224 wait complete. 2023-08-27T11:22:48.425 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:22:48.434 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-27T11:22:48.314997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2844,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2912256,"data_stored":1784027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001060"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.966554+0000","last_change":"2023-08-27T11:22:43.962060+0000","last_active":"2023-08-27T11:22:43.966554+0000","last_peered":"2023-08-27T11:22:43.966554+0000","last_clean":"2023-08-27T11:22:43.966554+0000","last_became_active":"2023-08-27T11:22:43.961142+0000","last_became_peered":"2023-08-27T11:22:43.961142+0000","last_unstale":"2023-08-27T11:22:43.966554+0000","last_undegraded":"2023-08-27T11:22:43.966554+0000","last_fullsized":"2023-08-27T11:22:43.966554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:29:22.358593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955284+0000","last_change":"2023-08-27T11:22:43.982097+0000","last_active":"2023-08-27T11:22:44.955284+0000","last_peered":"2023-08-27T11:22:44.955284+0000","last_clean":"2023-08-27T11:22:44.955284+0000","last_became_active":"2023-08-27T11:22:43.981793+0000","last_became_peered":"2023-08-27T11:22:43.981793+0000","last_unstale":"2023-08-27T11:22:44.955284+0000","last_undegraded":"2023-08-27T11:22:44.955284+0000","last_fullsized":"2023-08-27T11:22:44.955284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956587+0000","last_change":"2023-08-27T11:22:43.990716+0000","last_active":"2023-08-27T11:22:44.956587+0000","last_peered":"2023-08-27T11:22:44.956587+0000","last_clean":"2023-08-27T11:22:44.956587+0000","last_became_active":"2023-08-27T11:22:43.990370+0000","last_became_peered":"2023-08-27T11:22:43.990370+0000","last_unstale":"2023-08-27T11:22:44.956587+0000","last_undegraded":"2023-08-27T11:22:44.956587+0000","last_fullsized":"2023-08-27T11:22:44.956587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:30.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993016+0000","last_change":"2023-08-27T11:22:43.985032+0000","last_active":"2023-08-27T11:22:43.993016+0000","last_peered":"2023-08-27T11:22:43.993016+0000","last_clean":"2023-08-27T11:22:43.993016+0000","last_became_active":"2023-08-27T11:22:43.984657+0000","last_became_peered":"2023-08-27T11:22:43.984657+0000","last_unstale":"2023-08-27T11:22:43.993016+0000","last_undegraded":"2023-08-27T11:22:43.993016+0000","last_fullsized":"2023-08-27T11:22:43.993016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993467+0000","last_change":"2023-08-27T11:22:43.990182+0000","last_active":"2023-08-27T11:22:43.993467+0000","last_peered":"2023-08-27T11:22:43.993467+0000","last_clean":"2023-08-27T11:22:43.993467+0000","last_became_active":"2023-08-27T11:22:43.989876+0000","last_became_peered":"2023-08-27T11:22:43.989876+0000","last_unstale":"2023-08-27T11:22:43.993467+0000","last_undegraded":"2023-08-27T11:22:43.993467+0000","last_fullsized":"2023-08-27T11:22:43.993467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956031+0000","last_change":"2023-08-27T11:22:43.991876+0000","last_active":"2023-08-27T11:22:44.956031+0000","last_peered":"2023-08-27T11:22:44.956031+0000","last_clean":"2023-08-27T11:22:44.956031+0000","last_became_active":"2023-08-27T11:22:43.991420+0000","last_became_peered":"2023-08-27T11:22:43.991420+0000","last_unstale":"2023-08-27T11:22:44.956031+0000","last_undegraded":"2023-08-27T11:22:44.956031+0000","last_fullsized":"2023-08-27T11:22:44.956031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:44.277673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994268+0000","last_change":"2023-08-27T11:22:43.985414+0000","last_active":"2023-08-27T11:22:43.994268+0000","last_peered":"2023-08-27T11:22:43.994268+0000","last_clean":"2023-08-27T11:22:43.994268+0000","last_became_active":"2023-08-27T11:22:43.985076+0000","last_became_peered":"2023-08-27T11:22:43.985076+0000","last_unstale":"2023-08-27T11:22:43.994268+0000","last_undegraded":"2023-08-27T11:22:43.994268+0000","last_fullsized":"2023-08-27T11:22:43.994268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955019+0000","last_change":"2023-08-27T11:22:43.990228+0000","last_active":"2023-08-27T11:22:44.955019+0000","last_peered":"2023-08-27T11:22:44.955019+0000","last_clean":"2023-08-27T11:22:44.955019+0000","last_became_active":"2023-08-27T11:22:43.989893+0000","last_became_peered":"2023-08-27T11:22:43.989893+0000","last_unstale":"2023-08-27T11:22:44.955019+0000","last_undegraded":"2023-08-27T11:22:44.955019+0000","last_fullsized":"2023-08-27T11:22:44.955019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993585+0000","last_change":"2023-08-27T11:22:43.991007+0000","last_active":"2023-08-27T11:22:43.993585+0000","last_peered":"2023-08-27T11:22:43.993585+0000","last_clean":"2023-08-27T11:22:43.993585+0000","last_became_active":"2023-08-27T11:22:43.990457+0000","last_became_peered":"2023-08-27T11:22:43.990457+0000","last_unstale":"2023-08-27T11:22:43.993585+0000","last_undegraded":"2023-08-27T11:22:43.993585+0000","last_fullsized":"2023-08-27T11:22:43.993585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:15.513008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955768+0000","last_change":"2023-08-27T11:22:43.994376+0000","last_active":"2023-08-27T11:22:44.955768+0000","last_peered":"2023-08-27T11:22:44.955768+0000","last_clean":"2023-08-27T11:22:44.955768+0000","last_became_active":"2023-08-27T11:22:43.994066+0000","last_became_peered":"2023-08-27T11:22:43.994066+0000","last_unstale":"2023-08-27T11:22:44.955768+0000","last_undegraded":"2023-08-27T11:22:44.955768+0000","last_fullsized":"2023-08-27T11:22:44.955768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956745+0000","last_change":"2023-08-27T11:22:43.990918+0000","last_active":"2023-08-27T11:22:44.956745+0000","last_peered":"2023-08-27T11:22:44.956745+0000","last_clean":"2023-08-27T11:22:44.956745+0000","last_became_active":"2023-08-27T11:22:43.989615+0000","last_became_peered":"2023-08-27T11:22:43.989615+0000","last_unstale":"2023-08-27T11:22:44.956745+0000","last_undegraded":"2023-08-27T11:22:44.956745+0000","last_fullsized":"2023-08-27T11:22:44.956745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:35.401057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.997360+0000","last_change":"2023-08-27T11:22:43.995954+0000","last_active":"2023-08-27T11:22:43.997360+0000","last_peered":"2023-08-27T11:22:43.997360+0000","last_clean":"2023-08-27T11:22:43.997360+0000","last_became_active":"2023-08-27T11:22:43.995638+0000","last_became_peered":"2023-08-27T11:22:43.995638+0000","last_unstale":"2023-08-27T11:22:43.997360+0000","last_undegraded":"2023-08-27T11:22:43.997360+0000","last_fullsized":"2023-08-27T11:22:43.997360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:32.177544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.966619+0000","last_change":"2023-08-27T11:22:43.961542+0000","last_active":"2023-08-27T11:22:43.966619+0000","last_peered":"2023-08-27T11:22:43.966619+0000","last_clean":"2023-08-27T11:22:43.966619+0000","last_became_active":"2023-08-27T11:22:43.961210+0000","last_became_peered":"2023-08-27T11:22:43.961210+0000","last_unstale":"2023-08-27T11:22:43.966619+0000","last_undegraded":"2023-08-27T11:22:43.966619+0000","last_fullsized":"2023-08-27T11:22:43.966619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:55:33.404139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955409+0000","last_change":"2023-08-27T11:22:43.980009+0000","last_active":"2023-08-27T11:22:44.955409+0000","last_peered":"2023-08-27T11:22:44.955409+0000","last_clean":"2023-08-27T11:22:44.955409+0000","last_became_active":"2023-08-27T11:22:43.979689+0000","last_became_peered":"2023-08-27T11:22:43.979689+0000","last_unstale":"2023-08-27T11:22:44.955409+0000","last_undegraded":"2023-08-27T11:22:44.955409+0000","last_fullsized":"2023-08-27T11:22:44.955409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.996627+0000","last_change":"2023-08-27T11:22:43.990477+0000","last_active":"2023-08-27T11:22:43.996627+0000","last_peered":"2023-08-27T11:22:43.996627+0000","last_clean":"2023-08-27T11:22:43.996627+0000","last_became_active":"2023-08-27T11:22:43.990256+0000","last_became_peered":"2023-08-27T11:22:43.990256+0000","last_unstale":"2023-08-27T11:22:43.996627+0000","last_undegraded":"2023-08-27T11:22:43.996627+0000","last_fullsized":"2023-08-27T11:22:43.996627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955734+0000","last_change":"2023-08-27T11:22:43.989809+0000","last_active":"2023-08-27T11:22:44.955734+0000","last_peered":"2023-08-27T11:22:44.955734+0000","last_clean":"2023-08-27T11:22:44.955734+0000","last_became_active":"2023-08-27T11:22:43.989481+0000","last_became_peered":"2023-08-27T11:22:43.989481+0000","last_unstale":"2023-08-27T11:22:44.955734+0000","last_undegraded":"2023-08-27T11:22:44.955734+0000","last_fullsized":"2023-08-27T11:22:44.955734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993565+0000","last_change":"2023-08-27T11:22:43.990813+0000","last_active":"2023-08-27T11:22:43.993565+0000","last_peered":"2023-08-27T11:22:43.993565+0000","last_clean":"2023-08-27T11:22:43.993565+0000","last_became_active":"2023-08-27T11:22:43.990012+0000","last_became_peered":"2023-08-27T11:22:43.990012+0000","last_unstale":"2023-08-27T11:22:43.993565+0000","last_undegraded":"2023-08-27T11:22:43.993565+0000","last_fullsized":"2023-08-27T11:22:43.993565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:58.025866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956749+0000","last_change":"2023-08-27T11:22:43.989807+0000","last_active":"2023-08-27T11:22:44.956749+0000","last_peered":"2023-08-27T11:22:44.956749+0000","last_clean":"2023-08-27T11:22:44.956749+0000","last_became_active":"2023-08-27T11:22:43.989516+0000","last_became_peered":"2023-08-27T11:22:43.989516+0000","last_unstale":"2023-08-27T11:22:44.956749+0000","last_undegraded":"2023-08-27T11:22:44.956749+0000","last_fullsized":"2023-08-27T11:22:44.956749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:59:37.553187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.970054+0000","last_change":"2023-08-27T11:22:43.963140+0000","last_active":"2023-08-27T11:22:43.970054+0000","last_peered":"2023-08-27T11:22:43.970054+0000","last_clean":"2023-08-27T11:22:43.970054+0000","last_became_active":"2023-08-27T11:22:43.962832+0000","last_became_peered":"2023-08-27T11:22:43.962832+0000","last_unstale":"2023-08-27T11:22:43.970054+0000","last_undegraded":"2023-08-27T11:22:43.970054+0000","last_fullsized":"2023-08-27T11:22:43.970054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:03:48.535595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956266+0000","last_change":"2023-08-27T11:22:43.993602+0000","last_active":"2023-08-27T11:22:44.956266+0000","last_peered":"2023-08-27T11:22:44.956266+0000","last_clean":"2023-08-27T11:22:44.956266+0000","last_became_active":"2023-08-27T11:22:43.993131+0000","last_became_peered":"2023-08-27T11:22:43.993131+0000","last_unstale":"2023-08-27T11:22:44.956266+0000","last_undegraded":"2023-08-27T11:22:44.956266+0000","last_fullsized":"2023-08-27T11:22:44.956266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:11.915278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994336+0000","last_change":"2023-08-27T11:22:43.987371+0000","last_active":"2023-08-27T11:22:43.994336+0000","last_peered":"2023-08-27T11:22:43.994336+0000","last_clean":"2023-08-27T11:22:43.994336+0000","last_became_active":"2023-08-27T11:22:43.987102+0000","last_became_peered":"2023-08-27T11:22:43.987102+0000","last_unstale":"2023-08-27T11:22:43.994336+0000","last_undegraded":"2023-08-27T11:22:43.994336+0000","last_fullsized":"2023-08-27T11:22:43.994336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:54.726096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992516+0000","last_change":"2023-08-27T11:22:43.983074+0000","last_active":"2023-08-27T11:22:43.992516+0000","last_peered":"2023-08-27T11:22:43.992516+0000","last_clean":"2023-08-27T11:22:43.992516+0000","last_became_active":"2023-08-27T11:22:43.982752+0000","last_became_peered":"2023-08-27T11:22:43.982752+0000","last_unstale":"2023-08-27T11:22:43.992516+0000","last_undegraded":"2023-08-27T11:22:43.992516+0000","last_fullsized":"2023-08-27T11:22:43.992516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:47.556646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953805+0000","last_change":"2023-08-27T11:22:43.987652+0000","last_active":"2023-08-27T11:22:44.953805+0000","last_peered":"2023-08-27T11:22:44.953805+0000","last_clean":"2023-08-27T11:22:44.953805+0000","last_became_active":"2023-08-27T11:22:43.987417+0000","last_became_peered":"2023-08-27T11:22:43.987417+0000","last_unstale":"2023-08-27T11:22:44.953805+0000","last_undegraded":"2023-08-27T11:22:44.953805+0000","last_fullsized":"2023-08-27T11:22:44.953805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994394+0000","last_change":"2023-08-27T11:22:43.987462+0000","last_active":"2023-08-27T11:22:43.994394+0000","last_peered":"2023-08-27T11:22:43.994394+0000","last_clean":"2023-08-27T11:22:43.994394+0000","last_became_active":"2023-08-27T11:22:43.987145+0000","last_became_peered":"2023-08-27T11:22:43.987145+0000","last_unstale":"2023-08-27T11:22:43.994394+0000","last_undegraded":"2023-08-27T11:22:43.994394+0000","last_fullsized":"2023-08-27T11:22:43.994394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:01:35.654939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993873+0000","last_change":"2023-08-27T11:22:43.990261+0000","last_active":"2023-08-27T11:22:43.993873+0000","last_peered":"2023-08-27T11:22:43.993873+0000","last_clean":"2023-08-27T11:22:43.993873+0000","last_became_active":"2023-08-27T11:22:43.989491+0000","last_became_peered":"2023-08-27T11:22:43.989491+0000","last_unstale":"2023-08-27T11:22:43.993873+0000","last_undegraded":"2023-08-27T11:22:43.993873+0000","last_fullsized":"2023-08-27T11:22:43.993873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.980984+0000","last_change":"2023-08-27T11:22:43.977096+0000","last_active":"2023-08-27T11:22:43.980984+0000","last_peered":"2023-08-27T11:22:43.980984+0000","last_clean":"2023-08-27T11:22:43.980984+0000","last_became_active":"2023-08-27T11:22:43.976613+0000","last_became_peered":"2023-08-27T11:22:43.976613+0000","last_unstale":"2023-08-27T11:22:43.980984+0000","last_undegraded":"2023-08-27T11:22:43.980984+0000","last_fullsized":"2023-08-27T11:22:43.980984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:12.998008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955237+0000","last_change":"2023-08-27T11:22:43.983414+0000","last_active":"2023-08-27T11:22:44.955237+0000","last_peered":"2023-08-27T11:22:44.955237+0000","last_clean":"2023-08-27T11:22:44.955237+0000","last_became_active":"2023-08-27T11:22:43.983020+0000","last_became_peered":"2023-08-27T11:22:43.983020+0000","last_unstale":"2023-08-27T11:22:44.955237+0000","last_undegraded":"2023-08-27T11:22:44.955237+0000","last_fullsized":"2023-08-27T11:22:44.955237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956174+0000","last_change":"2023-08-27T11:22:42.974209+0000","last_active":"2023-08-27T11:22:44.956174+0000","last_peered":"2023-08-27T11:22:44.956174+0000","last_clean":"2023-08-27T11:22:44.956174+0000","last_became_active":"2023-08-27T11:22:42.973852+0000","last_became_peered":"2023-08-27T11:22:42.973852+0000","last_unstale":"2023-08-27T11:22:44.956174+0000","last_undegraded":"2023-08-27T11:22:44.956174+0000","last_fullsized":"2023-08-27T11:22:44.956174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954249+0000","last_change":"2023-08-27T11:22:43.978095+0000","last_active":"2023-08-27T11:22:44.954249+0000","last_peered":"2023-08-27T11:22:44.954249+0000","last_clean":"2023-08-27T11:22:44.954249+0000","last_became_active":"2023-08-27T11:22:43.977791+0000","last_became_peered":"2023-08-27T11:22:43.977791+0000","last_unstale":"2023-08-27T11:22:44.954249+0000","last_undegraded":"2023-08-27T11:22:44.954249+0000","last_fullsized":"2023-08-27T11:22:44.954249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.972004+0000","last_change":"2023-08-27T11:22:42.973723+0000","last_active":"2023-08-27T11:22:43.972004+0000","last_peered":"2023-08-27T11:22:43.972004+0000","last_clean":"2023-08-27T11:22:43.972004+0000","last_became_active":"2023-08-27T11:22:42.973421+0000","last_became_peered":"2023-08-27T11:22:42.973421+0000","last_unstale":"2023-08-27T11:22:43.972004+0000","last_undegraded":"2023-08-27T11:22:43.972004+0000","last_fullsized":"2023-08-27T11:22:43.972004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993539+0000","last_change":"2023-08-27T11:22:43.987909+0000","last_active":"2023-08-27T11:22:43.993539+0000","last_peered":"2023-08-27T11:22:43.993539+0000","last_clean":"2023-08-27T11:22:43.993539+0000","last_became_active":"2023-08-27T11:22:43.984494+0000","last_became_peered":"2023-08-27T11:22:43.984494+0000","last_unstale":"2023-08-27T11:22:43.993539+0000","last_undegraded":"2023-08-27T11:22:43.993539+0000","last_fullsized":"2023-08-27T11:22:43.993539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:47.897783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953952+0000","last_change":"2023-08-27T11:22:42.972365+0000","last_active":"2023-08-27T11:22:44.953952+0000","last_peered":"2023-08-27T11:22:44.953952+0000","last_clean":"2023-08-27T11:22:44.953952+0000","last_became_active":"2023-08-27T11:22:42.972038+0000","last_became_peered":"2023-08-27T11:22:42.972038+0000","last_unstale":"2023-08-27T11:22:44.953952+0000","last_undegraded":"2023-08-27T11:22:44.953952+0000","last_fullsized":"2023-08-27T11:22:44.953952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993039+0000","last_change":"2023-08-27T11:22:43.983047+0000","last_active":"2023-08-27T11:22:43.993039+0000","last_peered":"2023-08-27T11:22:43.993039+0000","last_clean":"2023-08-27T11:22:43.993039+0000","last_became_active":"2023-08-27T11:22:43.982721+0000","last_became_peered":"2023-08-27T11:22:43.982721+0000","last_unstale":"2023-08-27T11:22:43.993039+0000","last_undegraded":"2023-08-27T11:22:43.993039+0000","last_fullsized":"2023-08-27T11:22:43.993039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.967854+0000","last_change":"2023-08-27T11:22:42.977813+0000","last_active":"2023-08-27T11:22:43.967854+0000","last_peered":"2023-08-27T11:22:43.967854+0000","last_clean":"2023-08-27T11:22:43.967854+0000","last_became_active":"2023-08-27T11:22:42.976651+0000","last_became_peered":"2023-08-27T11:22:42.976651+0000","last_unstale":"2023-08-27T11:22:43.967854+0000","last_undegraded":"2023-08-27T11:22:43.967854+0000","last_fullsized":"2023-08-27T11:22:43.967854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:07.115635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953881+0000","last_change":"2023-08-27T11:22:43.978397+0000","last_active":"2023-08-27T11:22:44.953881+0000","last_peered":"2023-08-27T11:22:44.953881+0000","last_clean":"2023-08-27T11:22:44.953881+0000","last_became_active":"2023-08-27T11:22:43.977904+0000","last_became_peered":"2023-08-27T11:22:43.977904+0000","last_unstale":"2023-08-27T11:22:44.953881+0000","last_undegraded":"2023-08-27T11:22:44.953881+0000","last_fullsized":"2023-08-27T11:22:44.953881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955485+0000","last_change":"2023-08-27T11:22:42.968091+0000","last_active":"2023-08-27T11:22:44.955485+0000","last_peered":"2023-08-27T11:22:44.955485+0000","last_clean":"2023-08-27T11:22:44.955485+0000","last_became_active":"2023-08-27T11:22:42.967703+0000","last_became_peered":"2023-08-27T11:22:42.967703+0000","last_unstale":"2023-08-27T11:22:44.955485+0000","last_undegraded":"2023-08-27T11:22:44.955485+0000","last_fullsized":"2023-08-27T11:22:44.955485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954032+0000","last_change":"2023-08-27T11:22:43.982808+0000","last_active":"2023-08-27T11:22:44.954032+0000","last_peered":"2023-08-27T11:22:44.954032+0000","last_clean":"2023-08-27T11:22:44.954032+0000","last_became_active":"2023-08-27T11:22:43.982483+0000","last_became_peered":"2023-08-27T11:22:43.982483+0000","last_unstale":"2023-08-27T11:22:44.954032+0000","last_undegraded":"2023-08-27T11:22:44.954032+0000","last_fullsized":"2023-08-27T11:22:44.954032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.989250+0000","last_change":"2023-08-27T11:22:42.975018+0000","last_active":"2023-08-27T11:22:43.989250+0000","last_peered":"2023-08-27T11:22:43.989250+0000","last_clean":"2023-08-27T11:22:43.989250+0000","last_became_active":"2023-08-27T11:22:42.974781+0000","last_became_peered":"2023-08-27T11:22:42.974781+0000","last_unstale":"2023-08-27T11:22:43.989250+0000","last_undegraded":"2023-08-27T11:22:43.989250+0000","last_fullsized":"2023-08-27T11:22:43.989250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:00.060523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994689+0000","last_change":"2023-08-27T11:22:43.989795+0000","last_active":"2023-08-27T11:22:43.994689+0000","last_peered":"2023-08-27T11:22:43.994689+0000","last_clean":"2023-08-27T11:22:43.994689+0000","last_became_active":"2023-08-27T11:22:43.989463+0000","last_became_peered":"2023-08-27T11:22:43.989463+0000","last_unstale":"2023-08-27T11:22:43.994689+0000","last_undegraded":"2023-08-27T11:22:43.994689+0000","last_fullsized":"2023-08-27T11:22:43.994689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:08.123051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956476+0000","last_change":"2023-08-27T11:22:42.969337+0000","last_active":"2023-08-27T11:22:44.956476+0000","last_peered":"2023-08-27T11:22:44.956476+0000","last_clean":"2023-08-27T11:22:44.956476+0000","last_became_active":"2023-08-27T11:22:42.967568+0000","last_became_peered":"2023-08-27T11:22:42.967568+0000","last_unstale":"2023-08-27T11:22:44.956476+0000","last_undegraded":"2023-08-27T11:22:44.956476+0000","last_fullsized":"2023-08-27T11:22:44.956476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956732+0000","last_change":"2023-08-27T11:22:43.989937+0000","last_active":"2023-08-27T11:22:44.956732+0000","last_peered":"2023-08-27T11:22:44.956732+0000","last_clean":"2023-08-27T11:22:44.956732+0000","last_became_active":"2023-08-27T11:22:43.989210+0000","last_became_peered":"2023-08-27T11:22:43.989210+0000","last_unstale":"2023-08-27T11:22:44.956732+0000","last_undegraded":"2023-08-27T11:22:44.956732+0000","last_fullsized":"2023-08-27T11:22:44.956732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995305+0000","last_change":"2023-08-27T11:22:42.976288+0000","last_active":"2023-08-27T11:22:43.995305+0000","last_peered":"2023-08-27T11:22:43.995305+0000","last_clean":"2023-08-27T11:22:43.995305+0000","last_became_active":"2023-08-27T11:22:42.975626+0000","last_became_peered":"2023-08-27T11:22:42.975626+0000","last_unstale":"2023-08-27T11:22:43.995305+0000","last_undegraded":"2023-08-27T11:22:43.995305+0000","last_fullsized":"2023-08-27T11:22:43.995305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954234+0000","last_change":"2023-08-27T11:22:43.981780+0000","last_active":"2023-08-27T11:22:44.954234+0000","last_peered":"2023-08-27T11:22:44.954234+0000","last_clean":"2023-08-27T11:22:44.954234+0000","last_became_active":"2023-08-27T11:22:43.980808+0000","last_became_peered":"2023-08-27T11:22:43.980808+0000","last_unstale":"2023-08-27T11:22:44.954234+0000","last_undegraded":"2023-08-27T11:22:44.954234+0000","last_fullsized":"2023-08-27T11:22:44.954234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971645+0000","last_change":"2023-08-27T11:22:42.979381+0000","last_active":"2023-08-27T11:22:43.971645+0000","last_peered":"2023-08-27T11:22:43.971645+0000","last_clean":"2023-08-27T11:22:43.971645+0000","last_became_active":"2023-08-27T11:22:42.979013+0000","last_became_peered":"2023-08-27T11:22:42.979013+0000","last_unstale":"2023-08-27T11:22:43.971645+0000","last_undegraded":"2023-08-27T11:22:43.971645+0000","last_fullsized":"2023-08-27T11:22:43.971645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:01.025348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955479+0000","last_change":"2023-08-27T11:22:43.983263+0000","last_active":"2023-08-27T11:22:44.955479+0000","last_peered":"2023-08-27T11:22:44.955479+0000","last_clean":"2023-08-27T11:22:44.955479+0000","last_became_active":"2023-08-27T11:22:43.982671+0000","last_became_peered":"2023-08-27T11:22:43.982671+0000","last_unstale":"2023-08-27T11:22:44.955479+0000","last_undegraded":"2023-08-27T11:22:44.955479+0000","last_fullsized":"2023-08-27T11:22:44.955479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.977795+0000","last_change":"2023-08-27T11:22:42.973411+0000","last_active":"2023-08-27T11:22:43.977795+0000","last_peered":"2023-08-27T11:22:43.977795+0000","last_clean":"2023-08-27T11:22:43.977795+0000","last_became_active":"2023-08-27T11:22:42.973006+0000","last_became_peered":"2023-08-27T11:22:42.973006+0000","last_unstale":"2023-08-27T11:22:43.977795+0000","last_undegraded":"2023-08-27T11:22:43.977795+0000","last_fullsized":"2023-08-27T11:22:43.977795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:32.202757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993560+0000","last_change":"2023-08-27T11:22:43.988160+0000","last_active":"2023-08-27T11:22:43.993560+0000","last_peered":"2023-08-27T11:22:43.993560+0000","last_clean":"2023-08-27T11:22:43.993560+0000","last_became_active":"2023-08-27T11:22:43.985877+0000","last_became_peered":"2023-08-27T11:22:43.985877+0000","last_unstale":"2023-08-27T11:22:43.993560+0000","last_undegraded":"2023-08-27T11:22:43.993560+0000","last_fullsized":"2023-08-27T11:22:43.993560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:38:01.545972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.985723+0000","last_change":"2023-08-27T11:22:42.967442+0000","last_active":"2023-08-27T11:22:43.985723+0000","last_peered":"2023-08-27T11:22:43.985723+0000","last_clean":"2023-08-27T11:22:43.985723+0000","last_became_active":"2023-08-27T11:22:42.967161+0000","last_became_peered":"2023-08-27T11:22:42.967161+0000","last_unstale":"2023-08-27T11:22:43.985723+0000","last_undegraded":"2023-08-27T11:22:43.985723+0000","last_fullsized":"2023-08-27T11:22:43.985723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954449+0000","last_change":"2023-08-27T11:22:43.983069+0000","last_active":"2023-08-27T11:22:44.954449+0000","last_peered":"2023-08-27T11:22:44.954449+0000","last_clean":"2023-08-27T11:22:44.954449+0000","last_became_active":"2023-08-27T11:22:43.982751+0000","last_became_peered":"2023-08-27T11:22:43.982751+0000","last_unstale":"2023-08-27T11:22:44.954449+0000","last_undegraded":"2023-08-27T11:22:44.954449+0000","last_fullsized":"2023-08-27T11:22:44.954449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:18.462257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995307+0000","last_change":"2023-08-27T11:22:42.973476+0000","last_active":"2023-08-27T11:22:43.995307+0000","last_peered":"2023-08-27T11:22:43.995307+0000","last_clean":"2023-08-27T11:22:43.995307+0000","last_became_active":"2023-08-27T11:22:42.973240+0000","last_became_peered":"2023-08-27T11:22:42.973240+0000","last_unstale":"2023-08-27T11:22:43.995307+0000","last_undegraded":"2023-08-27T11:22:43.995307+0000","last_fullsized":"2023-08-27T11:22:43.995307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:51.423177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955122+0000","last_change":"2023-08-27T11:22:43.981699+0000","last_active":"2023-08-27T11:22:44.955122+0000","last_peered":"2023-08-27T11:22:44.955122+0000","last_clean":"2023-08-27T11:22:44.955122+0000","last_became_active":"2023-08-27T11:22:43.981386+0000","last_became_peered":"2023-08-27T11:22:43.981386+0000","last_unstale":"2023-08-27T11:22:44.955122+0000","last_undegraded":"2023-08-27T11:22:44.955122+0000","last_fullsized":"2023-08-27T11:22:44.955122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995275+0000","last_change":"2023-08-27T11:22:42.974214+0000","last_active":"2023-08-27T11:22:43.995275+0000","last_peered":"2023-08-27T11:22:43.995275+0000","last_clean":"2023-08-27T11:22:43.995275+0000","last_became_active":"2023-08-27T11:22:42.973985+0000","last_became_peered":"2023-08-27T11:22:42.973985+0000","last_unstale":"2023-08-27T11:22:43.995275+0000","last_undegraded":"2023-08-27T11:22:43.995275+0000","last_fullsized":"2023-08-27T11:22:43.995275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955831+0000","last_change":"2023-08-27T11:22:43.992116+0000","last_active":"2023-08-27T11:22:44.955831+0000","last_peered":"2023-08-27T11:22:44.955831+0000","last_clean":"2023-08-27T11:22:44.955831+0000","last_became_active":"2023-08-27T11:22:43.990772+0000","last_became_peered":"2023-08-27T11:22:43.990772+0000","last_unstale":"2023-08-27T11:22:44.955831+0000","last_undegraded":"2023-08-27T11:22:44.955831+0000","last_fullsized":"2023-08-27T11:22:44.955831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.983015+0000","last_change":"2023-08-27T11:22:42.975882+0000","last_active":"2023-08-27T11:22:43.983015+0000","last_peered":"2023-08-27T11:22:43.983015+0000","last_clean":"2023-08-27T11:22:43.983015+0000","last_became_active":"2023-08-27T11:22:42.975464+0000","last_became_peered":"2023-08-27T11:22:42.975464+0000","last_unstale":"2023-08-27T11:22:43.983015+0000","last_undegraded":"2023-08-27T11:22:43.983015+0000","last_fullsized":"2023-08-27T11:22:43.983015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:58.746701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993082+0000","last_change":"2023-08-27T11:22:43.984717+0000","last_active":"2023-08-27T11:22:43.993082+0000","last_peered":"2023-08-27T11:22:43.993082+0000","last_clean":"2023-08-27T11:22:43.993082+0000","last_became_active":"2023-08-27T11:22:43.984130+0000","last_became_peered":"2023-08-27T11:22:43.984130+0000","last_unstale":"2023-08-27T11:22:43.993082+0000","last_undegraded":"2023-08-27T11:22:43.993082+0000","last_fullsized":"2023-08-27T11:22:43.993082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955583+0000","last_change":"2023-08-27T11:22:42.970752+0000","last_active":"2023-08-27T11:22:44.955583+0000","last_peered":"2023-08-27T11:22:44.955583+0000","last_clean":"2023-08-27T11:22:44.955583+0000","last_became_active":"2023-08-27T11:22:42.970459+0000","last_became_peered":"2023-08-27T11:22:42.970459+0000","last_unstale":"2023-08-27T11:22:44.955583+0000","last_undegraded":"2023-08-27T11:22:44.955583+0000","last_fullsized":"2023-08-27T11:22:44.955583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992576+0000","last_change":"2023-08-27T11:22:43.983613+0000","last_active":"2023-08-27T11:22:43.992576+0000","last_peered":"2023-08-27T11:22:43.992576+0000","last_clean":"2023-08-27T11:22:43.992576+0000","last_became_active":"2023-08-27T11:22:43.982933+0000","last_became_peered":"2023-08-27T11:22:43.982933+0000","last_unstale":"2023-08-27T11:22:43.992576+0000","last_undegraded":"2023-08-27T11:22:43.992576+0000","last_fullsized":"2023-08-27T11:22:43.992576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954373+0000","last_change":"2023-08-27T11:22:42.981320+0000","last_active":"2023-08-27T11:22:44.954373+0000","last_peered":"2023-08-27T11:22:44.954373+0000","last_clean":"2023-08-27T11:22:44.954373+0000","last_became_active":"2023-08-27T11:22:42.980963+0000","last_became_peered":"2023-08-27T11:22:42.980963+0000","last_unstale":"2023-08-27T11:22:44.954373+0000","last_undegraded":"2023-08-27T11:22:44.954373+0000","last_fullsized":"2023-08-27T11:22:44.954373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956231+0000","last_change":"2023-08-27T11:22:43.993427+0000","last_active":"2023-08-27T11:22:44.956231+0000","last_peered":"2023-08-27T11:22:44.956231+0000","last_clean":"2023-08-27T11:22:44.956231+0000","last_became_active":"2023-08-27T11:22:43.992811+0000","last_became_peered":"2023-08-27T11:22:43.992811+0000","last_unstale":"2023-08-27T11:22:44.956231+0000","last_undegraded":"2023-08-27T11:22:44.956231+0000","last_fullsized":"2023-08-27T11:22:44.956231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.958613+0000","last_change":"2023-08-27T11:22:42.972531+0000","last_active":"2023-08-27T11:22:43.958613+0000","last_peered":"2023-08-27T11:22:43.958613+0000","last_clean":"2023-08-27T11:22:43.958613+0000","last_became_active":"2023-08-27T11:22:42.972138+0000","last_became_peered":"2023-08-27T11:22:42.972138+0000","last_unstale":"2023-08-27T11:22:43.958613+0000","last_undegraded":"2023-08-27T11:22:43.958613+0000","last_fullsized":"2023-08-27T11:22:43.958613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:01.025348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956856+0000","last_change":"2023-08-27T11:22:43.989896+0000","last_active":"2023-08-27T11:22:44.956856+0000","last_peered":"2023-08-27T11:22:44.956856+0000","last_clean":"2023-08-27T11:22:44.956856+0000","last_became_active":"2023-08-27T11:22:43.989230+0000","last_became_peered":"2023-08-27T11:22:43.989230+0000","last_unstale":"2023-08-27T11:22:44.956856+0000","last_undegraded":"2023-08-27T11:22:44.956856+0000","last_fullsized":"2023-08-27T11:22:44.956856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:51.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956010+0000","last_change":"2023-08-27T11:22:42.958843+0000","last_active":"2023-08-27T11:22:44.956010+0000","last_peered":"2023-08-27T11:22:44.956010+0000","last_clean":"2023-08-27T11:22:44.956010+0000","last_became_active":"2023-08-27T11:22:42.958485+0000","last_became_peered":"2023-08-27T11:22:42.958485+0000","last_unstale":"2023-08-27T11:22:44.956010+0000","last_undegraded":"2023-08-27T11:22:44.956010+0000","last_fullsized":"2023-08-27T11:22:44.956010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:58.733476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956871+0000","last_change":"2023-08-27T11:22:43.989191+0000","last_active":"2023-08-27T11:22:44.956871+0000","last_peered":"2023-08-27T11:22:44.956871+0000","last_clean":"2023-08-27T11:22:44.956871+0000","last_became_active":"2023-08-27T11:22:43.988840+0000","last_became_peered":"2023-08-27T11:22:43.988840+0000","last_unstale":"2023-08-27T11:22:44.956871+0000","last_undegraded":"2023-08-27T11:22:44.956871+0000","last_fullsized":"2023-08-27T11:22:44.956871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.642446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953825+0000","last_change":"2023-08-27T11:22:42.976094+0000","last_active":"2023-08-27T11:22:44.953825+0000","last_peered":"2023-08-27T11:22:44.953825+0000","last_clean":"2023-08-27T11:22:44.953825+0000","last_became_active":"2023-08-27T11:22:42.975763+0000","last_became_peered":"2023-08-27T11:22:42.975763+0000","last_unstale":"2023-08-27T11:22:44.953825+0000","last_undegraded":"2023-08-27T11:22:44.953825+0000","last_fullsized":"2023-08-27T11:22:44.953825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992831+0000","last_change":"2023-08-27T11:22:43.986813+0000","last_active":"2023-08-27T11:22:43.992831+0000","last_peered":"2023-08-27T11:22:43.992831+0000","last_clean":"2023-08-27T11:22:43.992831+0000","last_became_active":"2023-08-27T11:22:43.986301+0000","last_became_peered":"2023-08-27T11:22:43.986301+0000","last_unstale":"2023-08-27T11:22:43.992831+0000","last_undegraded":"2023-08-27T11:22:43.992831+0000","last_fullsized":"2023-08-27T11:22:43.992831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954367+0000","last_change":"2023-08-27T11:22:42.970688+0000","last_active":"2023-08-27T11:22:44.954367+0000","last_peered":"2023-08-27T11:22:44.954367+0000","last_clean":"2023-08-27T11:22:44.954367+0000","last_became_active":"2023-08-27T11:22:42.970294+0000","last_became_peered":"2023-08-27T11:22:42.970294+0000","last_unstale":"2023-08-27T11:22:44.954367+0000","last_undegraded":"2023-08-27T11:22:44.954367+0000","last_fullsized":"2023-08-27T11:22:44.954367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:29.778808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956655+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:22:44.956655+0000","last_peered":"2023-08-27T11:22:44.956655+0000","last_clean":"2023-08-27T11:22:44.956655+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:22:44.956655+0000","last_undegraded":"2023-08-27T11:22:44.956655+0000","last_fullsized":"2023-08-27T11:22:44.956655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:11.427186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953730+0000","last_change":"2023-08-27T11:22:43.982339+0000","last_active":"2023-08-27T11:22:44.953730+0000","last_peered":"2023-08-27T11:22:44.953730+0000","last_clean":"2023-08-27T11:22:44.953730+0000","last_became_active":"2023-08-27T11:22:43.982008+0000","last_became_peered":"2023-08-27T11:22:43.982008+0000","last_unstale":"2023-08-27T11:22:44.953730+0000","last_undegraded":"2023-08-27T11:22:44.953730+0000","last_fullsized":"2023-08-27T11:22:44.953730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954148+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:22:44.954148+0000","last_peered":"2023-08-27T11:22:44.954148+0000","last_clean":"2023-08-27T11:22:44.954148+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:22:44.954148+0000","last_undegraded":"2023-08-27T11:22:44.954148+0000","last_fullsized":"2023-08-27T11:22:44.954148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:04.880208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.968626+0000","last_change":"2023-08-27T11:22:42.980391+0000","last_active":"2023-08-27T11:22:43.968626+0000","last_peered":"2023-08-27T11:22:43.968626+0000","last_clean":"2023-08-27T11:22:43.968626+0000","last_became_active":"2023-08-27T11:22:42.979955+0000","last_became_peered":"2023-08-27T11:22:42.979955+0000","last_unstale":"2023-08-27T11:22:43.968626+0000","last_undegraded":"2023-08-27T11:22:43.968626+0000","last_fullsized":"2023-08-27T11:22:43.968626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:29.083383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955978+0000","last_change":"2023-08-27T11:22:43.990732+0000","last_active":"2023-08-27T11:22:44.955978+0000","last_peered":"2023-08-27T11:22:44.955978+0000","last_clean":"2023-08-27T11:22:44.955978+0000","last_became_active":"2023-08-27T11:22:43.990460+0000","last_became_peered":"2023-08-27T11:22:43.990460+0000","last_unstale":"2023-08-27T11:22:44.955978+0000","last_undegraded":"2023-08-27T11:22:44.955978+0000","last_fullsized":"2023-08-27T11:22:44.955978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971333+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:22:43.971333+0000","last_peered":"2023-08-27T11:22:43.971333+0000","last_clean":"2023-08-27T11:22:43.971333+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:22:43.971333+0000","last_undegraded":"2023-08-27T11:22:43.971333+0000","last_fullsized":"2023-08-27T11:22:43.971333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:36:54.997694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.976253+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:22:43.976253+0000","last_peered":"2023-08-27T11:22:43.976253+0000","last_clean":"2023-08-27T11:22:43.976253+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:22:43.976253+0000","last_undegraded":"2023-08-27T11:22:43.976253+0000","last_fullsized":"2023-08-27T11:22:43.976253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:42.974365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.972375+0000","last_change":"2023-08-27T11:22:42.978246+0000","last_active":"2023-08-27T11:22:43.972375+0000","last_peered":"2023-08-27T11:22:43.972375+0000","last_clean":"2023-08-27T11:22:43.972375+0000","last_became_active":"2023-08-27T11:22:42.976711+0000","last_became_peered":"2023-08-27T11:22:42.976711+0000","last_unstale":"2023-08-27T11:22:43.972375+0000","last_undegraded":"2023-08-27T11:22:43.972375+0000","last_fullsized":"2023-08-27T11:22:43.972375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993519+0000","last_change":"2023-08-27T11:22:43.987923+0000","last_active":"2023-08-27T11:22:43.993519+0000","last_peered":"2023-08-27T11:22:43.993519+0000","last_clean":"2023-08-27T11:22:43.993519+0000","last_became_active":"2023-08-27T11:22:43.985057+0000","last_became_peered":"2023-08-27T11:22:43.985057+0000","last_unstale":"2023-08-27T11:22:43.993519+0000","last_undegraded":"2023-08-27T11:22:43.993519+0000","last_fullsized":"2023-08-27T11:22:43.993519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.974882+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:22:43.974882+0000","last_peered":"2023-08-27T11:22:43.974882+0000","last_clean":"2023-08-27T11:22:43.974882+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:22:43.974882+0000","last_undegraded":"2023-08-27T11:22:43.974882+0000","last_fullsized":"2023-08-27T11:22:43.974882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:17:25.355087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.970843+0000","last_change":"2023-08-27T11:22:42.974293+0000","last_active":"2023-08-27T11:22:43.970843+0000","last_peered":"2023-08-27T11:22:43.970843+0000","last_clean":"2023-08-27T11:22:43.970843+0000","last_became_active":"2023-08-27T11:22:42.973989+0000","last_became_peered":"2023-08-27T11:22:42.973989+0000","last_unstale":"2023-08-27T11:22:43.970843+0000","last_undegraded":"2023-08-27T11:22:43.970843+0000","last_fullsized":"2023-08-27T11:22:43.970843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:46.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.988627+0000","last_change":"2023-08-27T11:22:43.979605+0000","last_active":"2023-08-27T11:22:43.988627+0000","last_peered":"2023-08-27T11:22:43.988627+0000","last_clean":"2023-08-27T11:22:43.988627+0000","last_became_active":"2023-08-27T11:22:43.979323+0000","last_became_peered":"2023-08-27T11:22:43.979323+0000","last_unstale":"2023-08-27T11:22:43.988627+0000","last_undegraded":"2023-08-27T11:22:43.988627+0000","last_fullsized":"2023-08-27T11:22:43.988627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.974616+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:22:43.974616+0000","last_peered":"2023-08-27T11:22:43.974616+0000","last_clean":"2023-08-27T11:22:43.974616+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:22:43.974616+0000","last_undegraded":"2023-08-27T11:22:43.974616+0000","last_fullsized":"2023-08-27T11:22:43.974616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:45.496869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953924+0000","last_change":"2023-08-27T11:22:42.970697+0000","last_active":"2023-08-27T11:22:44.953924+0000","last_peered":"2023-08-27T11:22:44.953924+0000","last_clean":"2023-08-27T11:22:44.953924+0000","last_became_active":"2023-08-27T11:22:42.970380+0000","last_became_peered":"2023-08-27T11:22:42.970380+0000","last_unstale":"2023-08-27T11:22:44.953924+0000","last_undegraded":"2023-08-27T11:22:44.953924+0000","last_fullsized":"2023-08-27T11:22:44.953924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993977+0000","last_change":"2023-08-27T11:22:43.992399+0000","last_active":"2023-08-27T11:22:43.993977+0000","last_peered":"2023-08-27T11:22:43.993977+0000","last_clean":"2023-08-27T11:22:43.993977+0000","last_became_active":"2023-08-27T11:22:43.991762+0000","last_became_peered":"2023-08-27T11:22:43.991762+0000","last_unstale":"2023-08-27T11:22:43.993977+0000","last_undegraded":"2023-08-27T11:22:43.993977+0000","last_fullsized":"2023-08-27T11:22:43.993977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:47.556646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955449+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:22:44.955449+0000","last_peered":"2023-08-27T11:22:44.955449+0000","last_clean":"2023-08-27T11:22:44.955449+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:22:44.955449+0000","last_undegraded":"2023-08-27T11:22:44.955449+0000","last_fullsized":"2023-08-27T11:22:44.955449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956560+0000","last_change":"2023-08-27T11:22:42.981231+0000","last_active":"2023-08-27T11:22:44.956560+0000","last_peered":"2023-08-27T11:22:44.956560+0000","last_clean":"2023-08-27T11:22:44.956560+0000","last_became_active":"2023-08-27T11:22:42.980906+0000","last_became_peered":"2023-08-27T11:22:42.980906+0000","last_unstale":"2023-08-27T11:22:44.956560+0000","last_undegraded":"2023-08-27T11:22:44.956560+0000","last_fullsized":"2023-08-27T11:22:44.956560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:16.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.991007+0000","last_change":"2023-08-27T11:22:43.980912+0000","last_active":"2023-08-27T11:22:43.991007+0000","last_peered":"2023-08-27T11:22:43.991007+0000","last_clean":"2023-08-27T11:22:43.991007+0000","last_became_active":"2023-08-27T11:22:43.980561+0000","last_became_peered":"2023-08-27T11:22:43.980561+0000","last_unstale":"2023-08-27T11:22:43.991007+0000","last_undegraded":"2023-08-27T11:22:43.991007+0000","last_fullsized":"2023-08-27T11:22:43.991007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:38:01.545972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.959478+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:22:43.959478+0000","last_peered":"2023-08-27T11:22:43.959478+0000","last_clean":"2023-08-27T11:22:43.959478+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:22:43.959478+0000","last_undegraded":"2023-08-27T11:22:43.959478+0000","last_fullsized":"2023-08-27T11:22:43.959478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:17:25.355087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971423+0000","last_change":"2023-08-27T11:22:42.974572+0000","last_active":"2023-08-27T11:22:43.971423+0000","last_peered":"2023-08-27T11:22:43.971423+0000","last_clean":"2023-08-27T11:22:43.971423+0000","last_became_active":"2023-08-27T11:22:42.973936+0000","last_became_peered":"2023-08-27T11:22:42.973936+0000","last_unstale":"2023-08-27T11:22:43.971423+0000","last_undegraded":"2023-08-27T11:22:43.971423+0000","last_fullsized":"2023-08-27T11:22:43.971423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992597+0000","last_change":"2023-08-27T11:22:43.983828+0000","last_active":"2023-08-27T11:22:43.992597+0000","last_peered":"2023-08-27T11:22:43.992597+0000","last_clean":"2023-08-27T11:22:43.992597+0000","last_became_active":"2023-08-27T11:22:43.983297+0000","last_became_peered":"2023-08-27T11:22:43.983297+0000","last_unstale":"2023-08-27T11:22:43.992597+0000","last_undegraded":"2023-08-27T11:22:43.992597+0000","last_fullsized":"2023-08-27T11:22:43.992597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.959460+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:22:43.959460+0000","last_peered":"2023-08-27T11:22:43.959460+0000","last_clean":"2023-08-27T11:22:43.959460+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:22:43.959460+0000","last_undegraded":"2023-08-27T11:22:43.959460+0000","last_fullsized":"2023-08-27T11:22:43.959460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:06.148133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956090+0000","last_change":"2023-08-27T11:22:42.970931+0000","last_active":"2023-08-27T11:22:44.956090+0000","last_peered":"2023-08-27T11:22:44.956090+0000","last_clean":"2023-08-27T11:22:44.956090+0000","last_became_active":"2023-08-27T11:22:42.970639+0000","last_became_peered":"2023-08-27T11:22:42.970639+0000","last_unstale":"2023-08-27T11:22:44.956090+0000","last_undegraded":"2023-08-27T11:22:44.956090+0000","last_fullsized":"2023-08-27T11:22:44.956090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.988585+0000","last_change":"2023-08-27T11:22:43.978747+0000","last_active":"2023-08-27T11:22:43.988585+0000","last_peered":"2023-08-27T11:22:43.988585+0000","last_clean":"2023-08-27T11:22:43.988585+0000","last_became_active":"2023-08-27T11:22:43.978452+0000","last_became_peered":"2023-08-27T11:22:43.978452+0000","last_unstale":"2023-08-27T11:22:43.988585+0000","last_undegraded":"2023-08-27T11:22:43.988585+0000","last_fullsized":"2023-08-27T11:22:43.988585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.996457+0000","last_change":"2023-08-27T11:22:42.978613+0000","last_active":"2023-08-27T11:22:43.996457+0000","last_peered":"2023-08-27T11:22:43.996457+0000","last_clean":"2023-08-27T11:22:43.996457+0000","last_became_active":"2023-08-27T11:22:42.978242+0000","last_became_peered":"2023-08-27T11:22:42.978242+0000","last_unstale":"2023-08-27T11:22:43.996457+0000","last_undegraded":"2023-08-27T11:22:43.996457+0000","last_fullsized":"2023-08-27T11:22:43.996457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.984664+0000","last_change":"2023-08-27T11:22:43.979802+0000","last_active":"2023-08-27T11:22:43.984664+0000","last_peered":"2023-08-27T11:22:43.984664+0000","last_clean":"2023-08-27T11:22:43.984664+0000","last_became_active":"2023-08-27T11:22:43.979457+0000","last_became_peered":"2023-08-27T11:22:43.979457+0000","last_unstale":"2023-08-27T11:22:43.984664+0000","last_undegraded":"2023-08-27T11:22:43.984664+0000","last_fullsized":"2023-08-27T11:22:43.984664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:04.187421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955380+0000","last_change":"2023-08-27T11:22:42.970531+0000","last_active":"2023-08-27T11:22:44.955380+0000","last_peered":"2023-08-27T11:22:44.955380+0000","last_clean":"2023-08-27T11:22:44.955380+0000","last_became_active":"2023-08-27T11:22:42.970063+0000","last_became_peered":"2023-08-27T11:22:42.970063+0000","last_unstale":"2023-08-27T11:22:44.955380+0000","last_undegraded":"2023-08-27T11:22:44.955380+0000","last_fullsized":"2023-08-27T11:22:44.955380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956373+0000","last_change":"2023-08-27T11:22:43.990179+0000","last_active":"2023-08-27T11:22:44.956373+0000","last_peered":"2023-08-27T11:22:44.956373+0000","last_clean":"2023-08-27T11:22:44.956373+0000","last_became_active":"2023-08-27T11:22:43.989642+0000","last_became_peered":"2023-08-27T11:22:43.989642+0000","last_unstale":"2023-08-27T11:22:44.956373+0000","last_undegraded":"2023-08-27T11:22:44.956373+0000","last_fullsized":"2023-08-27T11:22:44.956373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955879+0000","last_change":"2023-08-27T11:22:42.966238+0000","last_active":"2023-08-27T11:22:44.955879+0000","last_peered":"2023-08-27T11:22:44.955879+0000","last_clean":"2023-08-27T11:22:44.955879+0000","last_became_active":"2023-08-27T11:22:42.965938+0000","last_became_peered":"2023-08-27T11:22:42.965938+0000","last_unstale":"2023-08-27T11:22:44.955879+0000","last_undegraded":"2023-08-27T11:22:44.955879+0000","last_fullsized":"2023-08-27T11:22:44.955879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956394+0000","last_change":"2023-08-27T11:22:43.991696+0000","last_active":"2023-08-27T11:22:44.956394+0000","last_peered":"2023-08-27T11:22:44.956394+0000","last_clean":"2023-08-27T11:22:44.956394+0000","last_became_active":"2023-08-27T11:22:43.991150+0000","last_became_peered":"2023-08-27T11:22:43.991150+0000","last_unstale":"2023-08-27T11:22:44.956394+0000","last_undegraded":"2023-08-27T11:22:44.956394+0000","last_fullsized":"2023-08-27T11:22:44.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953861+0000","last_change":"2023-08-27T11:22:42.970669+0000","last_active":"2023-08-27T11:22:44.953861+0000","last_peered":"2023-08-27T11:22:44.953861+0000","last_clean":"2023-08-27T11:22:44.953861+0000","last_became_active":"2023-08-27T11:22:42.970385+0000","last_became_peered":"2023-08-27T11:22:42.970385+0000","last_unstale":"2023-08-27T11:22:44.953861+0000","last_undegraded":"2023-08-27T11:22:44.953861+0000","last_fullsized":"2023-08-27T11:22:44.953861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953966+0000","last_change":"2023-08-27T11:22:43.964703+0000","last_active":"2023-08-27T11:22:44.953966+0000","last_peered":"2023-08-27T11:22:44.953966+0000","last_clean":"2023-08-27T11:22:44.953966+0000","last_became_active":"2023-08-27T11:22:43.964343+0000","last_became_peered":"2023-08-27T11:22:43.964343+0000","last_unstale":"2023-08-27T11:22:44.953966+0000","last_undegraded":"2023-08-27T11:22:44.953966+0000","last_fullsized":"2023-08-27T11:22:44.953966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.984581+0000","last_change":"2023-08-27T11:22:42.977833+0000","last_active":"2023-08-27T11:22:43.984581+0000","last_peered":"2023-08-27T11:22:43.984581+0000","last_clean":"2023-08-27T11:22:43.984581+0000","last_became_active":"2023-08-27T11:22:42.977061+0000","last_became_peered":"2023-08-27T11:22:42.977061+0000","last_unstale":"2023-08-27T11:22:43.984581+0000","last_undegraded":"2023-08-27T11:22:43.984581+0000","last_fullsized":"2023-08-27T11:22:43.984581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:11.990592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955674+0000","last_change":"2023-08-27T11:22:43.989253+0000","last_active":"2023-08-27T11:22:44.955674+0000","last_peered":"2023-08-27T11:22:44.955674+0000","last_clean":"2023-08-27T11:22:44.955674+0000","last_became_active":"2023-08-27T11:22:43.988860+0000","last_became_peered":"2023-08-27T11:22:43.988860+0000","last_unstale":"2023-08-27T11:22:44.955674+0000","last_undegraded":"2023-08-27T11:22:44.955674+0000","last_fullsized":"2023-08-27T11:22:44.955674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.965574+0000","last_change":"2023-08-27T11:22:43.962222+0000","last_active":"2023-08-27T11:22:43.965574+0000","last_peered":"2023-08-27T11:22:43.965574+0000","last_clean":"2023-08-27T11:22:43.965574+0000","last_became_active":"2023-08-27T11:22:43.961880+0000","last_became_peered":"2023-08-27T11:22:43.961880+0000","last_unstale":"2023-08-27T11:22:43.965574+0000","last_undegraded":"2023-08-27T11:22:43.965574+0000","last_fullsized":"2023-08-27T11:22:43.965574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:30.090799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953872+0000","last_change":"2023-08-27T11:22:43.983558+0000","last_active":"2023-08-27T11:22:44.953872+0000","last_peered":"2023-08-27T11:22:44.953872+0000","last_clean":"2023-08-27T11:22:44.953872+0000","last_became_active":"2023-08-27T11:22:43.981569+0000","last_became_peered":"2023-08-27T11:22:43.981569+0000","last_unstale":"2023-08-27T11:22:44.953872+0000","last_undegraded":"2023-08-27T11:22:44.953872+0000","last_fullsized":"2023-08-27T11:22:44.953872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956171+0000","last_change":"2023-08-27T11:22:43.995288+0000","last_active":"2023-08-27T11:22:44.956171+0000","last_peered":"2023-08-27T11:22:44.956171+0000","last_clean":"2023-08-27T11:22:44.956171+0000","last_became_active":"2023-08-27T11:22:43.995014+0000","last_became_peered":"2023-08-27T11:22:43.995014+0000","last_unstale":"2023-08-27T11:22:44.956171+0000","last_undegraded":"2023-08-27T11:22:44.956171+0000","last_fullsized":"2023-08-27T11:22:44.956171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954375+0000","last_change":"2023-08-27T11:22:43.983608+0000","last_active":"2023-08-27T11:22:44.954375+0000","last_peered":"2023-08-27T11:22:44.954375+0000","last_clean":"2023-08-27T11:22:44.954375+0000","last_became_active":"2023-08-27T11:22:43.983327+0000","last_became_peered":"2023-08-27T11:22:43.983327+0000","last_unstale":"2023-08-27T11:22:44.954375+0000","last_undegraded":"2023-08-27T11:22:44.954375+0000","last_fullsized":"2023-08-27T11:22:44.954375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992629+0000","last_change":"2023-08-27T11:22:43.984397+0000","last_active":"2023-08-27T11:22:43.992629+0000","last_peered":"2023-08-27T11:22:43.992629+0000","last_clean":"2023-08-27T11:22:43.992629+0000","last_became_active":"2023-08-27T11:22:43.984028+0000","last_became_peered":"2023-08-27T11:22:43.984028+0000","last_unstale":"2023-08-27T11:22:43.992629+0000","last_undegraded":"2023-08-27T11:22:43.992629+0000","last_fullsized":"2023-08-27T11:22:43.992629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:30.090799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":665003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":663175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:22:48.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:22:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.673+0000 7f064c1ff700 1 Processor -- start 2023-08-27T11:22:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.673+0000 7f064c1ff700 1 -- start start 2023-08-27T11:22:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064c1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0644151a90 0x7f06440c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064c1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06440c4630 0x7f06440c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064c1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064406c4e0 con 0x7f064406ad70 2023-08-27T11:22:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064c1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0644155370 con 0x7f06440c4630 2023-08-27T11:22:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064c1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0644151e70 con 0x7f0644151a90 2023-08-27T11:22:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064979a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06440c4630 0x7f06440c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064979a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06440c4630 0x7f06440c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33294/0 (socket says 172.21.15.43:33294) 2023-08-27T11:22:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f064979a700 1 -- 172.21.15.43:0/1734774723 learned_addr learned my addr 172.21.15.43:0/1734774723 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.674+0000 7f0649f9b700 1 --2- 172.21.15.43:0/1734774723 >> v2:172.21.15.57:3300/0 conn(0x7f0644151a90 0x7f06440c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f064979a700 1 -- 172.21.15.43:0/1734774723 >> v2:172.21.15.57:3300/0 conn(0x7f0644151a90 msgr2=0x7f06440c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:48.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f064979a700 1 --2- 172.21.15.43:0/1734774723 >> v2:172.21.15.57:3300/0 conn(0x7f0644151a90 0x7f06440c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f064979a700 1 -- 172.21.15.43:0/1734774723 >> v1:172.21.15.57:6789/0 conn(0x7f064406ad70 legacy=0x7f064406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f064979a700 1 -- 172.21.15.43:0/1734774723 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644154480 con 0x7f06440c4630 2023-08-27T11:22:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f064979a700 1 --2- 172.21.15.43:0/1734774723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06440c4630 0x7f06440c4a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0644067710 tx=0x7f0634009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ab72bf3f47e435 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f0648f99700 1 -- 172.21.15.43:0/1734774723 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011830 con 0x7f06440c4630 2023-08-27T11:22:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f0648f99700 1 -- 172.21.15.43:0/1734774723 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634011990 con 0x7f06440c4630 2023-08-27T11:22:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.675+0000 7f0648f99700 1 -- 172.21.15.43:0/1734774723 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634011d20 con 0x7f06440c4630 2023-08-27T11:22:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 -- 172.21.15.43:0/1734774723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06440c4630 msgr2=0x7f06440c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 --2- 172.21.15.43:0/1734774723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06440c4630 0x7f06440c4a90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0644067710 tx=0x7f0634009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 -- 172.21.15.43:0/1734774723 shutdown_connections 2023-08-27T11:22:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 --2- 172.21.15.43:0/1734774723 >> v2:172.21.15.57:3300/0 conn(0x7f0644151a90 0x7f06440c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 --2- 172.21.15.43:0/1734774723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06440c4630 0x7f06440c4a90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 -- 172.21.15.43:0/1734774723 >> 172.21.15.43:0/1734774723 conn(0x7f06440ab820 msgr2=0x7f06440abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 -- 172.21.15.43:0/1734774723 shutdown_connections 2023-08-27T11:22:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.676+0000 7f064c1ff700 1 -- 172.21.15.43:0/1734774723 wait complete. 2023-08-27T11:22:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.678+0000 7f064c1ff700 1 Processor -- start 2023-08-27T11:22:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.678+0000 7f064c1ff700 1 -- start start 2023-08-27T11:22:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f06440c4630 0x7f064414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 0x7f06440bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440aa600 con 0x7f064406ad70 2023-08-27T11:22:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440ab100 con 0x7f0644151a90 2023-08-27T11:22:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064c1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440aab40 con 0x7f06440c4630 2023-08-27T11:22:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f0649f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f0649f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33300/0 (socket says 172.21.15.43:33300) 2023-08-27T11:22:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f0649f9b700 1 -- 172.21.15.43:0/518399453 learned_addr learned my addr 172.21.15.43:0/518399453 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064979a700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f06440c4630 0x7f064414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.679+0000 7f064a79c700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 0x7f06440bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 -- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f06440c4630 msgr2=0x7f064414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f06440c4630 0x7f064414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 -- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 msgr2=0x7f06440bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 0x7f06440bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 -- 172.21.15.43:0/518399453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009550 con 0x7f064406ad70 2023-08-27T11:22:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f064a79c700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 0x7f06440bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f0649f9b700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f064000e870 tx=0x7f064000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0640009590 con 0x7f064406ad70 2023-08-27T11:22:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0640013680 con 0x7f064406ad70 2023-08-27T11:22:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400139f0 con 0x7f064406ad70 2023-08-27T11:22:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06440aae20 con 0x7f064406ad70 2023-08-27T11:22:48.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.680+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064414d630 con 0x7f064406ad70 2023-08-27T11:22:48.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.681+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06440bf070 con 0x7f064406ad70 2023-08-27T11:22:48.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.682+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0640013b50 con 0x7f064406ad70 2023-08-27T11:22:48.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.683+0000 7f063a7fc700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 0x7f062806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:48.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.683+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0640088470 con 0x7f064406ad70 2023-08-27T11:22:48.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.683+0000 7f064979a700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 0x7f062806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:48.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.684+0000 7f064979a700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 0x7f062806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0634009c10 tx=0x7f0634008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:48.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.688+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0640053b50 con 0x7f064406ad70 2023-08-27T11:22:48.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.894+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06440aacb0 con 0x7f062806a0e0 2023-08-27T11:22:48.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.904+0000 7f063a7fc700 1 -- 172.21.15.43:0/518399453 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286939 (secure 0 0 0) 0x7f06440aacb0 con 0x7f062806a0e0 2023-08-27T11:22:48.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:48.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 msgr2=0x7f062806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 0x7f062806c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0634009c10 tx=0x7f0634008030 comp rx=0 tx=0).stop 2023-08-27T11:22:48.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 msgr2=0x7f06440a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:48.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f064000e870 tx=0x7f064000eb80 comp rx=0 tx=0).stop 2023-08-27T11:22:48.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 shutdown_connections 2023-08-27T11:22:48.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f062806a0e0 0x7f062806c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0644151a90 0x7f06440bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f064406ad70 0x7f06440a9ff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 --2- 172.21.15.43:0/518399453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f06440c4630 0x7f064414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:48.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 >> 172.21.15.43:0/518399453 conn(0x7f06440ab820 msgr2=0x7f06440c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:48.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 shutdown_connections 2023-08-27T11:22:48.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:48.908+0000 7f064c1ff700 1 -- 172.21.15.43:0/518399453 wait complete. 2023-08-27T11:22:48.914 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:22:48.927 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-27T11:22:48.314997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2844,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2912256,"data_stored":1784027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001060"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.966554+0000","last_change":"2023-08-27T11:22:43.962060+0000","last_active":"2023-08-27T11:22:43.966554+0000","last_peered":"2023-08-27T11:22:43.966554+0000","last_clean":"2023-08-27T11:22:43.966554+0000","last_became_active":"2023-08-27T11:22:43.961142+0000","last_became_peered":"2023-08-27T11:22:43.961142+0000","last_unstale":"2023-08-27T11:22:43.966554+0000","last_undegraded":"2023-08-27T11:22:43.966554+0000","last_fullsized":"2023-08-27T11:22:43.966554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:29:22.358593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955284+0000","last_change":"2023-08-27T11:22:43.982097+0000","last_active":"2023-08-27T11:22:44.955284+0000","last_peered":"2023-08-27T11:22:44.955284+0000","last_clean":"2023-08-27T11:22:44.955284+0000","last_became_active":"2023-08-27T11:22:43.981793+0000","last_became_peered":"2023-08-27T11:22:43.981793+0000","last_unstale":"2023-08-27T11:22:44.955284+0000","last_undegraded":"2023-08-27T11:22:44.955284+0000","last_fullsized":"2023-08-27T11:22:44.955284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956587+0000","last_change":"2023-08-27T11:22:43.990716+0000","last_active":"2023-08-27T11:22:44.956587+0000","last_peered":"2023-08-27T11:22:44.956587+0000","last_clean":"2023-08-27T11:22:44.956587+0000","last_became_active":"2023-08-27T11:22:43.990370+0000","last_became_peered":"2023-08-27T11:22:43.990370+0000","last_unstale":"2023-08-27T11:22:44.956587+0000","last_undegraded":"2023-08-27T11:22:44.956587+0000","last_fullsized":"2023-08-27T11:22:44.956587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:30.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993016+0000","last_change":"2023-08-27T11:22:43.985032+0000","last_active":"2023-08-27T11:22:43.993016+0000","last_peered":"2023-08-27T11:22:43.993016+0000","last_clean":"2023-08-27T11:22:43.993016+0000","last_became_active":"2023-08-27T11:22:43.984657+0000","last_became_peered":"2023-08-27T11:22:43.984657+0000","last_unstale":"2023-08-27T11:22:43.993016+0000","last_undegraded":"2023-08-27T11:22:43.993016+0000","last_fullsized":"2023-08-27T11:22:43.993016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993467+0000","last_change":"2023-08-27T11:22:43.990182+0000","last_active":"2023-08-27T11:22:43.993467+0000","last_peered":"2023-08-27T11:22:43.993467+0000","last_clean":"2023-08-27T11:22:43.993467+0000","last_became_active":"2023-08-27T11:22:43.989876+0000","last_became_peered":"2023-08-27T11:22:43.989876+0000","last_unstale":"2023-08-27T11:22:43.993467+0000","last_undegraded":"2023-08-27T11:22:43.993467+0000","last_fullsized":"2023-08-27T11:22:43.993467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956031+0000","last_change":"2023-08-27T11:22:43.991876+0000","last_active":"2023-08-27T11:22:44.956031+0000","last_peered":"2023-08-27T11:22:44.956031+0000","last_clean":"2023-08-27T11:22:44.956031+0000","last_became_active":"2023-08-27T11:22:43.991420+0000","last_became_peered":"2023-08-27T11:22:43.991420+0000","last_unstale":"2023-08-27T11:22:44.956031+0000","last_undegraded":"2023-08-27T11:22:44.956031+0000","last_fullsized":"2023-08-27T11:22:44.956031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:44.277673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994268+0000","last_change":"2023-08-27T11:22:43.985414+0000","last_active":"2023-08-27T11:22:43.994268+0000","last_peered":"2023-08-27T11:22:43.994268+0000","last_clean":"2023-08-27T11:22:43.994268+0000","last_became_active":"2023-08-27T11:22:43.985076+0000","last_became_peered":"2023-08-27T11:22:43.985076+0000","last_unstale":"2023-08-27T11:22:43.994268+0000","last_undegraded":"2023-08-27T11:22:43.994268+0000","last_fullsized":"2023-08-27T11:22:43.994268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955019+0000","last_change":"2023-08-27T11:22:43.990228+0000","last_active":"2023-08-27T11:22:44.955019+0000","last_peered":"2023-08-27T11:22:44.955019+0000","last_clean":"2023-08-27T11:22:44.955019+0000","last_became_active":"2023-08-27T11:22:43.989893+0000","last_became_peered":"2023-08-27T11:22:43.989893+0000","last_unstale":"2023-08-27T11:22:44.955019+0000","last_undegraded":"2023-08-27T11:22:44.955019+0000","last_fullsized":"2023-08-27T11:22:44.955019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993585+0000","last_change":"2023-08-27T11:22:43.991007+0000","last_active":"2023-08-27T11:22:43.993585+0000","last_peered":"2023-08-27T11:22:43.993585+0000","last_clean":"2023-08-27T11:22:43.993585+0000","last_became_active":"2023-08-27T11:22:43.990457+0000","last_became_peered":"2023-08-27T11:22:43.990457+0000","last_unstale":"2023-08-27T11:22:43.993585+0000","last_undegraded":"2023-08-27T11:22:43.993585+0000","last_fullsized":"2023-08-27T11:22:43.993585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:15.513008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955768+0000","last_change":"2023-08-27T11:22:43.994376+0000","last_active":"2023-08-27T11:22:44.955768+0000","last_peered":"2023-08-27T11:22:44.955768+0000","last_clean":"2023-08-27T11:22:44.955768+0000","last_became_active":"2023-08-27T11:22:43.994066+0000","last_became_peered":"2023-08-27T11:22:43.994066+0000","last_unstale":"2023-08-27T11:22:44.955768+0000","last_undegraded":"2023-08-27T11:22:44.955768+0000","last_fullsized":"2023-08-27T11:22:44.955768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956745+0000","last_change":"2023-08-27T11:22:43.990918+0000","last_active":"2023-08-27T11:22:44.956745+0000","last_peered":"2023-08-27T11:22:44.956745+0000","last_clean":"2023-08-27T11:22:44.956745+0000","last_became_active":"2023-08-27T11:22:43.989615+0000","last_became_peered":"2023-08-27T11:22:43.989615+0000","last_unstale":"2023-08-27T11:22:44.956745+0000","last_undegraded":"2023-08-27T11:22:44.956745+0000","last_fullsized":"2023-08-27T11:22:44.956745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:35.401057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.997360+0000","last_change":"2023-08-27T11:22:43.995954+0000","last_active":"2023-08-27T11:22:43.997360+0000","last_peered":"2023-08-27T11:22:43.997360+0000","last_clean":"2023-08-27T11:22:43.997360+0000","last_became_active":"2023-08-27T11:22:43.995638+0000","last_became_peered":"2023-08-27T11:22:43.995638+0000","last_unstale":"2023-08-27T11:22:43.997360+0000","last_undegraded":"2023-08-27T11:22:43.997360+0000","last_fullsized":"2023-08-27T11:22:43.997360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:32.177544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.966619+0000","last_change":"2023-08-27T11:22:43.961542+0000","last_active":"2023-08-27T11:22:43.966619+0000","last_peered":"2023-08-27T11:22:43.966619+0000","last_clean":"2023-08-27T11:22:43.966619+0000","last_became_active":"2023-08-27T11:22:43.961210+0000","last_became_peered":"2023-08-27T11:22:43.961210+0000","last_unstale":"2023-08-27T11:22:43.966619+0000","last_undegraded":"2023-08-27T11:22:43.966619+0000","last_fullsized":"2023-08-27T11:22:43.966619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:55:33.404139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955409+0000","last_change":"2023-08-27T11:22:43.980009+0000","last_active":"2023-08-27T11:22:44.955409+0000","last_peered":"2023-08-27T11:22:44.955409+0000","last_clean":"2023-08-27T11:22:44.955409+0000","last_became_active":"2023-08-27T11:22:43.979689+0000","last_became_peered":"2023-08-27T11:22:43.979689+0000","last_unstale":"2023-08-27T11:22:44.955409+0000","last_undegraded":"2023-08-27T11:22:44.955409+0000","last_fullsized":"2023-08-27T11:22:44.955409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.996627+0000","last_change":"2023-08-27T11:22:43.990477+0000","last_active":"2023-08-27T11:22:43.996627+0000","last_peered":"2023-08-27T11:22:43.996627+0000","last_clean":"2023-08-27T11:22:43.996627+0000","last_became_active":"2023-08-27T11:22:43.990256+0000","last_became_peered":"2023-08-27T11:22:43.990256+0000","last_unstale":"2023-08-27T11:22:43.996627+0000","last_undegraded":"2023-08-27T11:22:43.996627+0000","last_fullsized":"2023-08-27T11:22:43.996627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955734+0000","last_change":"2023-08-27T11:22:43.989809+0000","last_active":"2023-08-27T11:22:44.955734+0000","last_peered":"2023-08-27T11:22:44.955734+0000","last_clean":"2023-08-27T11:22:44.955734+0000","last_became_active":"2023-08-27T11:22:43.989481+0000","last_became_peered":"2023-08-27T11:22:43.989481+0000","last_unstale":"2023-08-27T11:22:44.955734+0000","last_undegraded":"2023-08-27T11:22:44.955734+0000","last_fullsized":"2023-08-27T11:22:44.955734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993565+0000","last_change":"2023-08-27T11:22:43.990813+0000","last_active":"2023-08-27T11:22:43.993565+0000","last_peered":"2023-08-27T11:22:43.993565+0000","last_clean":"2023-08-27T11:22:43.993565+0000","last_became_active":"2023-08-27T11:22:43.990012+0000","last_became_peered":"2023-08-27T11:22:43.990012+0000","last_unstale":"2023-08-27T11:22:43.993565+0000","last_undegraded":"2023-08-27T11:22:43.993565+0000","last_fullsized":"2023-08-27T11:22:43.993565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:58.025866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956749+0000","last_change":"2023-08-27T11:22:43.989807+0000","last_active":"2023-08-27T11:22:44.956749+0000","last_peered":"2023-08-27T11:22:44.956749+0000","last_clean":"2023-08-27T11:22:44.956749+0000","last_became_active":"2023-08-27T11:22:43.989516+0000","last_became_peered":"2023-08-27T11:22:43.989516+0000","last_unstale":"2023-08-27T11:22:44.956749+0000","last_undegraded":"2023-08-27T11:22:44.956749+0000","last_fullsized":"2023-08-27T11:22:44.956749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:59:37.553187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.970054+0000","last_change":"2023-08-27T11:22:43.963140+0000","last_active":"2023-08-27T11:22:43.970054+0000","last_peered":"2023-08-27T11:22:43.970054+0000","last_clean":"2023-08-27T11:22:43.970054+0000","last_became_active":"2023-08-27T11:22:43.962832+0000","last_became_peered":"2023-08-27T11:22:43.962832+0000","last_unstale":"2023-08-27T11:22:43.970054+0000","last_undegraded":"2023-08-27T11:22:43.970054+0000","last_fullsized":"2023-08-27T11:22:43.970054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:03:48.535595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956266+0000","last_change":"2023-08-27T11:22:43.993602+0000","last_active":"2023-08-27T11:22:44.956266+0000","last_peered":"2023-08-27T11:22:44.956266+0000","last_clean":"2023-08-27T11:22:44.956266+0000","last_became_active":"2023-08-27T11:22:43.993131+0000","last_became_peered":"2023-08-27T11:22:43.993131+0000","last_unstale":"2023-08-27T11:22:44.956266+0000","last_undegraded":"2023-08-27T11:22:44.956266+0000","last_fullsized":"2023-08-27T11:22:44.956266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:11.915278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994336+0000","last_change":"2023-08-27T11:22:43.987371+0000","last_active":"2023-08-27T11:22:43.994336+0000","last_peered":"2023-08-27T11:22:43.994336+0000","last_clean":"2023-08-27T11:22:43.994336+0000","last_became_active":"2023-08-27T11:22:43.987102+0000","last_became_peered":"2023-08-27T11:22:43.987102+0000","last_unstale":"2023-08-27T11:22:43.994336+0000","last_undegraded":"2023-08-27T11:22:43.994336+0000","last_fullsized":"2023-08-27T11:22:43.994336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:54.726096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992516+0000","last_change":"2023-08-27T11:22:43.983074+0000","last_active":"2023-08-27T11:22:43.992516+0000","last_peered":"2023-08-27T11:22:43.992516+0000","last_clean":"2023-08-27T11:22:43.992516+0000","last_became_active":"2023-08-27T11:22:43.982752+0000","last_became_peered":"2023-08-27T11:22:43.982752+0000","last_unstale":"2023-08-27T11:22:43.992516+0000","last_undegraded":"2023-08-27T11:22:43.992516+0000","last_fullsized":"2023-08-27T11:22:43.992516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:47.556646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953805+0000","last_change":"2023-08-27T11:22:43.987652+0000","last_active":"2023-08-27T11:22:44.953805+0000","last_peered":"2023-08-27T11:22:44.953805+0000","last_clean":"2023-08-27T11:22:44.953805+0000","last_became_active":"2023-08-27T11:22:43.987417+0000","last_became_peered":"2023-08-27T11:22:43.987417+0000","last_unstale":"2023-08-27T11:22:44.953805+0000","last_undegraded":"2023-08-27T11:22:44.953805+0000","last_fullsized":"2023-08-27T11:22:44.953805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994394+0000","last_change":"2023-08-27T11:22:43.987462+0000","last_active":"2023-08-27T11:22:43.994394+0000","last_peered":"2023-08-27T11:22:43.994394+0000","last_clean":"2023-08-27T11:22:43.994394+0000","last_became_active":"2023-08-27T11:22:43.987145+0000","last_became_peered":"2023-08-27T11:22:43.987145+0000","last_unstale":"2023-08-27T11:22:43.994394+0000","last_undegraded":"2023-08-27T11:22:43.994394+0000","last_fullsized":"2023-08-27T11:22:43.994394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:01:35.654939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993873+0000","last_change":"2023-08-27T11:22:43.990261+0000","last_active":"2023-08-27T11:22:43.993873+0000","last_peered":"2023-08-27T11:22:43.993873+0000","last_clean":"2023-08-27T11:22:43.993873+0000","last_became_active":"2023-08-27T11:22:43.989491+0000","last_became_peered":"2023-08-27T11:22:43.989491+0000","last_unstale":"2023-08-27T11:22:43.993873+0000","last_undegraded":"2023-08-27T11:22:43.993873+0000","last_fullsized":"2023-08-27T11:22:43.993873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.980984+0000","last_change":"2023-08-27T11:22:43.977096+0000","last_active":"2023-08-27T11:22:43.980984+0000","last_peered":"2023-08-27T11:22:43.980984+0000","last_clean":"2023-08-27T11:22:43.980984+0000","last_became_active":"2023-08-27T11:22:43.976613+0000","last_became_peered":"2023-08-27T11:22:43.976613+0000","last_unstale":"2023-08-27T11:22:43.980984+0000","last_undegraded":"2023-08-27T11:22:43.980984+0000","last_fullsized":"2023-08-27T11:22:43.980984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:12.998008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955237+0000","last_change":"2023-08-27T11:22:43.983414+0000","last_active":"2023-08-27T11:22:44.955237+0000","last_peered":"2023-08-27T11:22:44.955237+0000","last_clean":"2023-08-27T11:22:44.955237+0000","last_became_active":"2023-08-27T11:22:43.983020+0000","last_became_peered":"2023-08-27T11:22:43.983020+0000","last_unstale":"2023-08-27T11:22:44.955237+0000","last_undegraded":"2023-08-27T11:22:44.955237+0000","last_fullsized":"2023-08-27T11:22:44.955237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956174+0000","last_change":"2023-08-27T11:22:42.974209+0000","last_active":"2023-08-27T11:22:44.956174+0000","last_peered":"2023-08-27T11:22:44.956174+0000","last_clean":"2023-08-27T11:22:44.956174+0000","last_became_active":"2023-08-27T11:22:42.973852+0000","last_became_peered":"2023-08-27T11:22:42.973852+0000","last_unstale":"2023-08-27T11:22:44.956174+0000","last_undegraded":"2023-08-27T11:22:44.956174+0000","last_fullsized":"2023-08-27T11:22:44.956174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954249+0000","last_change":"2023-08-27T11:22:43.978095+0000","last_active":"2023-08-27T11:22:44.954249+0000","last_peered":"2023-08-27T11:22:44.954249+0000","last_clean":"2023-08-27T11:22:44.954249+0000","last_became_active":"2023-08-27T11:22:43.977791+0000","last_became_peered":"2023-08-27T11:22:43.977791+0000","last_unstale":"2023-08-27T11:22:44.954249+0000","last_undegraded":"2023-08-27T11:22:44.954249+0000","last_fullsized":"2023-08-27T11:22:44.954249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.972004+0000","last_change":"2023-08-27T11:22:42.973723+0000","last_active":"2023-08-27T11:22:43.972004+0000","last_peered":"2023-08-27T11:22:43.972004+0000","last_clean":"2023-08-27T11:22:43.972004+0000","last_became_active":"2023-08-27T11:22:42.973421+0000","last_became_peered":"2023-08-27T11:22:42.973421+0000","last_unstale":"2023-08-27T11:22:43.972004+0000","last_undegraded":"2023-08-27T11:22:43.972004+0000","last_fullsized":"2023-08-27T11:22:43.972004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993539+0000","last_change":"2023-08-27T11:22:43.987909+0000","last_active":"2023-08-27T11:22:43.993539+0000","last_peered":"2023-08-27T11:22:43.993539+0000","last_clean":"2023-08-27T11:22:43.993539+0000","last_became_active":"2023-08-27T11:22:43.984494+0000","last_became_peered":"2023-08-27T11:22:43.984494+0000","last_unstale":"2023-08-27T11:22:43.993539+0000","last_undegraded":"2023-08-27T11:22:43.993539+0000","last_fullsized":"2023-08-27T11:22:43.993539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:47.897783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953952+0000","last_change":"2023-08-27T11:22:42.972365+0000","last_active":"2023-08-27T11:22:44.953952+0000","last_peered":"2023-08-27T11:22:44.953952+0000","last_clean":"2023-08-27T11:22:44.953952+0000","last_became_active":"2023-08-27T11:22:42.972038+0000","last_became_peered":"2023-08-27T11:22:42.972038+0000","last_unstale":"2023-08-27T11:22:44.953952+0000","last_undegraded":"2023-08-27T11:22:44.953952+0000","last_fullsized":"2023-08-27T11:22:44.953952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993039+0000","last_change":"2023-08-27T11:22:43.983047+0000","last_active":"2023-08-27T11:22:43.993039+0000","last_peered":"2023-08-27T11:22:43.993039+0000","last_clean":"2023-08-27T11:22:43.993039+0000","last_became_active":"2023-08-27T11:22:43.982721+0000","last_became_peered":"2023-08-27T11:22:43.982721+0000","last_unstale":"2023-08-27T11:22:43.993039+0000","last_undegraded":"2023-08-27T11:22:43.993039+0000","last_fullsized":"2023-08-27T11:22:43.993039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.967854+0000","last_change":"2023-08-27T11:22:42.977813+0000","last_active":"2023-08-27T11:22:43.967854+0000","last_peered":"2023-08-27T11:22:43.967854+0000","last_clean":"2023-08-27T11:22:43.967854+0000","last_became_active":"2023-08-27T11:22:42.976651+0000","last_became_peered":"2023-08-27T11:22:42.976651+0000","last_unstale":"2023-08-27T11:22:43.967854+0000","last_undegraded":"2023-08-27T11:22:43.967854+0000","last_fullsized":"2023-08-27T11:22:43.967854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:07.115635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953881+0000","last_change":"2023-08-27T11:22:43.978397+0000","last_active":"2023-08-27T11:22:44.953881+0000","last_peered":"2023-08-27T11:22:44.953881+0000","last_clean":"2023-08-27T11:22:44.953881+0000","last_became_active":"2023-08-27T11:22:43.977904+0000","last_became_peered":"2023-08-27T11:22:43.977904+0000","last_unstale":"2023-08-27T11:22:44.953881+0000","last_undegraded":"2023-08-27T11:22:44.953881+0000","last_fullsized":"2023-08-27T11:22:44.953881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955485+0000","last_change":"2023-08-27T11:22:42.968091+0000","last_active":"2023-08-27T11:22:44.955485+0000","last_peered":"2023-08-27T11:22:44.955485+0000","last_clean":"2023-08-27T11:22:44.955485+0000","last_became_active":"2023-08-27T11:22:42.967703+0000","last_became_peered":"2023-08-27T11:22:42.967703+0000","last_unstale":"2023-08-27T11:22:44.955485+0000","last_undegraded":"2023-08-27T11:22:44.955485+0000","last_fullsized":"2023-08-27T11:22:44.955485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954032+0000","last_change":"2023-08-27T11:22:43.982808+0000","last_active":"2023-08-27T11:22:44.954032+0000","last_peered":"2023-08-27T11:22:44.954032+0000","last_clean":"2023-08-27T11:22:44.954032+0000","last_became_active":"2023-08-27T11:22:43.982483+0000","last_became_peered":"2023-08-27T11:22:43.982483+0000","last_unstale":"2023-08-27T11:22:44.954032+0000","last_undegraded":"2023-08-27T11:22:44.954032+0000","last_fullsized":"2023-08-27T11:22:44.954032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.989250+0000","last_change":"2023-08-27T11:22:42.975018+0000","last_active":"2023-08-27T11:22:43.989250+0000","last_peered":"2023-08-27T11:22:43.989250+0000","last_clean":"2023-08-27T11:22:43.989250+0000","last_became_active":"2023-08-27T11:22:42.974781+0000","last_became_peered":"2023-08-27T11:22:42.974781+0000","last_unstale":"2023-08-27T11:22:43.989250+0000","last_undegraded":"2023-08-27T11:22:43.989250+0000","last_fullsized":"2023-08-27T11:22:43.989250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:00.060523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.994689+0000","last_change":"2023-08-27T11:22:43.989795+0000","last_active":"2023-08-27T11:22:43.994689+0000","last_peered":"2023-08-27T11:22:43.994689+0000","last_clean":"2023-08-27T11:22:43.994689+0000","last_became_active":"2023-08-27T11:22:43.989463+0000","last_became_peered":"2023-08-27T11:22:43.989463+0000","last_unstale":"2023-08-27T11:22:43.994689+0000","last_undegraded":"2023-08-27T11:22:43.994689+0000","last_fullsized":"2023-08-27T11:22:43.994689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:08.123051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956476+0000","last_change":"2023-08-27T11:22:42.969337+0000","last_active":"2023-08-27T11:22:44.956476+0000","last_peered":"2023-08-27T11:22:44.956476+0000","last_clean":"2023-08-27T11:22:44.956476+0000","last_became_active":"2023-08-27T11:22:42.967568+0000","last_became_peered":"2023-08-27T11:22:42.967568+0000","last_unstale":"2023-08-27T11:22:44.956476+0000","last_undegraded":"2023-08-27T11:22:44.956476+0000","last_fullsized":"2023-08-27T11:22:44.956476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956732+0000","last_change":"2023-08-27T11:22:43.989937+0000","last_active":"2023-08-27T11:22:44.956732+0000","last_peered":"2023-08-27T11:22:44.956732+0000","last_clean":"2023-08-27T11:22:44.956732+0000","last_became_active":"2023-08-27T11:22:43.989210+0000","last_became_peered":"2023-08-27T11:22:43.989210+0000","last_unstale":"2023-08-27T11:22:44.956732+0000","last_undegraded":"2023-08-27T11:22:44.956732+0000","last_fullsized":"2023-08-27T11:22:44.956732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995305+0000","last_change":"2023-08-27T11:22:42.976288+0000","last_active":"2023-08-27T11:22:43.995305+0000","last_peered":"2023-08-27T11:22:43.995305+0000","last_clean":"2023-08-27T11:22:43.995305+0000","last_became_active":"2023-08-27T11:22:42.975626+0000","last_became_peered":"2023-08-27T11:22:42.975626+0000","last_unstale":"2023-08-27T11:22:43.995305+0000","last_undegraded":"2023-08-27T11:22:43.995305+0000","last_fullsized":"2023-08-27T11:22:43.995305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954234+0000","last_change":"2023-08-27T11:22:43.981780+0000","last_active":"2023-08-27T11:22:44.954234+0000","last_peered":"2023-08-27T11:22:44.954234+0000","last_clean":"2023-08-27T11:22:44.954234+0000","last_became_active":"2023-08-27T11:22:43.980808+0000","last_became_peered":"2023-08-27T11:22:43.980808+0000","last_unstale":"2023-08-27T11:22:44.954234+0000","last_undegraded":"2023-08-27T11:22:44.954234+0000","last_fullsized":"2023-08-27T11:22:44.954234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971645+0000","last_change":"2023-08-27T11:22:42.979381+0000","last_active":"2023-08-27T11:22:43.971645+0000","last_peered":"2023-08-27T11:22:43.971645+0000","last_clean":"2023-08-27T11:22:43.971645+0000","last_became_active":"2023-08-27T11:22:42.979013+0000","last_became_peered":"2023-08-27T11:22:42.979013+0000","last_unstale":"2023-08-27T11:22:43.971645+0000","last_undegraded":"2023-08-27T11:22:43.971645+0000","last_fullsized":"2023-08-27T11:22:43.971645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:01.025348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955479+0000","last_change":"2023-08-27T11:22:43.983263+0000","last_active":"2023-08-27T11:22:44.955479+0000","last_peered":"2023-08-27T11:22:44.955479+0000","last_clean":"2023-08-27T11:22:44.955479+0000","last_became_active":"2023-08-27T11:22:43.982671+0000","last_became_peered":"2023-08-27T11:22:43.982671+0000","last_unstale":"2023-08-27T11:22:44.955479+0000","last_undegraded":"2023-08-27T11:22:44.955479+0000","last_fullsized":"2023-08-27T11:22:44.955479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.977795+0000","last_change":"2023-08-27T11:22:42.973411+0000","last_active":"2023-08-27T11:22:43.977795+0000","last_peered":"2023-08-27T11:22:43.977795+0000","last_clean":"2023-08-27T11:22:43.977795+0000","last_became_active":"2023-08-27T11:22:42.973006+0000","last_became_peered":"2023-08-27T11:22:42.973006+0000","last_unstale":"2023-08-27T11:22:43.977795+0000","last_undegraded":"2023-08-27T11:22:43.977795+0000","last_fullsized":"2023-08-27T11:22:43.977795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:32.202757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993560+0000","last_change":"2023-08-27T11:22:43.988160+0000","last_active":"2023-08-27T11:22:43.993560+0000","last_peered":"2023-08-27T11:22:43.993560+0000","last_clean":"2023-08-27T11:22:43.993560+0000","last_became_active":"2023-08-27T11:22:43.985877+0000","last_became_peered":"2023-08-27T11:22:43.985877+0000","last_unstale":"2023-08-27T11:22:43.993560+0000","last_undegraded":"2023-08-27T11:22:43.993560+0000","last_fullsized":"2023-08-27T11:22:43.993560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:38:01.545972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.985723+0000","last_change":"2023-08-27T11:22:42.967442+0000","last_active":"2023-08-27T11:22:43.985723+0000","last_peered":"2023-08-27T11:22:43.985723+0000","last_clean":"2023-08-27T11:22:43.985723+0000","last_became_active":"2023-08-27T11:22:42.967161+0000","last_became_peered":"2023-08-27T11:22:42.967161+0000","last_unstale":"2023-08-27T11:22:43.985723+0000","last_undegraded":"2023-08-27T11:22:43.985723+0000","last_fullsized":"2023-08-27T11:22:43.985723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954449+0000","last_change":"2023-08-27T11:22:43.983069+0000","last_active":"2023-08-27T11:22:44.954449+0000","last_peered":"2023-08-27T11:22:44.954449+0000","last_clean":"2023-08-27T11:22:44.954449+0000","last_became_active":"2023-08-27T11:22:43.982751+0000","last_became_peered":"2023-08-27T11:22:43.982751+0000","last_unstale":"2023-08-27T11:22:44.954449+0000","last_undegraded":"2023-08-27T11:22:44.954449+0000","last_fullsized":"2023-08-27T11:22:44.954449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:18.462257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995307+0000","last_change":"2023-08-27T11:22:42.973476+0000","last_active":"2023-08-27T11:22:43.995307+0000","last_peered":"2023-08-27T11:22:43.995307+0000","last_clean":"2023-08-27T11:22:43.995307+0000","last_became_active":"2023-08-27T11:22:42.973240+0000","last_became_peered":"2023-08-27T11:22:42.973240+0000","last_unstale":"2023-08-27T11:22:43.995307+0000","last_undegraded":"2023-08-27T11:22:43.995307+0000","last_fullsized":"2023-08-27T11:22:43.995307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:51.423177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955122+0000","last_change":"2023-08-27T11:22:43.981699+0000","last_active":"2023-08-27T11:22:44.955122+0000","last_peered":"2023-08-27T11:22:44.955122+0000","last_clean":"2023-08-27T11:22:44.955122+0000","last_became_active":"2023-08-27T11:22:43.981386+0000","last_became_peered":"2023-08-27T11:22:43.981386+0000","last_unstale":"2023-08-27T11:22:44.955122+0000","last_undegraded":"2023-08-27T11:22:44.955122+0000","last_fullsized":"2023-08-27T11:22:44.955122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.995275+0000","last_change":"2023-08-27T11:22:42.974214+0000","last_active":"2023-08-27T11:22:43.995275+0000","last_peered":"2023-08-27T11:22:43.995275+0000","last_clean":"2023-08-27T11:22:43.995275+0000","last_became_active":"2023-08-27T11:22:42.973985+0000","last_became_peered":"2023-08-27T11:22:42.973985+0000","last_unstale":"2023-08-27T11:22:43.995275+0000","last_undegraded":"2023-08-27T11:22:43.995275+0000","last_fullsized":"2023-08-27T11:22:43.995275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955831+0000","last_change":"2023-08-27T11:22:43.992116+0000","last_active":"2023-08-27T11:22:44.955831+0000","last_peered":"2023-08-27T11:22:44.955831+0000","last_clean":"2023-08-27T11:22:44.955831+0000","last_became_active":"2023-08-27T11:22:43.990772+0000","last_became_peered":"2023-08-27T11:22:43.990772+0000","last_unstale":"2023-08-27T11:22:44.955831+0000","last_undegraded":"2023-08-27T11:22:44.955831+0000","last_fullsized":"2023-08-27T11:22:44.955831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.983015+0000","last_change":"2023-08-27T11:22:42.975882+0000","last_active":"2023-08-27T11:22:43.983015+0000","last_peered":"2023-08-27T11:22:43.983015+0000","last_clean":"2023-08-27T11:22:43.983015+0000","last_became_active":"2023-08-27T11:22:42.975464+0000","last_became_peered":"2023-08-27T11:22:42.975464+0000","last_unstale":"2023-08-27T11:22:43.983015+0000","last_undegraded":"2023-08-27T11:22:43.983015+0000","last_fullsized":"2023-08-27T11:22:43.983015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:58.746701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993082+0000","last_change":"2023-08-27T11:22:43.984717+0000","last_active":"2023-08-27T11:22:43.993082+0000","last_peered":"2023-08-27T11:22:43.993082+0000","last_clean":"2023-08-27T11:22:43.993082+0000","last_became_active":"2023-08-27T11:22:43.984130+0000","last_became_peered":"2023-08-27T11:22:43.984130+0000","last_unstale":"2023-08-27T11:22:43.993082+0000","last_undegraded":"2023-08-27T11:22:43.993082+0000","last_fullsized":"2023-08-27T11:22:43.993082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955583+0000","last_change":"2023-08-27T11:22:42.970752+0000","last_active":"2023-08-27T11:22:44.955583+0000","last_peered":"2023-08-27T11:22:44.955583+0000","last_clean":"2023-08-27T11:22:44.955583+0000","last_became_active":"2023-08-27T11:22:42.970459+0000","last_became_peered":"2023-08-27T11:22:42.970459+0000","last_unstale":"2023-08-27T11:22:44.955583+0000","last_undegraded":"2023-08-27T11:22:44.955583+0000","last_fullsized":"2023-08-27T11:22:44.955583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992576+0000","last_change":"2023-08-27T11:22:43.983613+0000","last_active":"2023-08-27T11:22:43.992576+0000","last_peered":"2023-08-27T11:22:43.992576+0000","last_clean":"2023-08-27T11:22:43.992576+0000","last_became_active":"2023-08-27T11:22:43.982933+0000","last_became_peered":"2023-08-27T11:22:43.982933+0000","last_unstale":"2023-08-27T11:22:43.992576+0000","last_undegraded":"2023-08-27T11:22:43.992576+0000","last_fullsized":"2023-08-27T11:22:43.992576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954373+0000","last_change":"2023-08-27T11:22:42.981320+0000","last_active":"2023-08-27T11:22:44.954373+0000","last_peered":"2023-08-27T11:22:44.954373+0000","last_clean":"2023-08-27T11:22:44.954373+0000","last_became_active":"2023-08-27T11:22:42.980963+0000","last_became_peered":"2023-08-27T11:22:42.980963+0000","last_unstale":"2023-08-27T11:22:44.954373+0000","last_undegraded":"2023-08-27T11:22:44.954373+0000","last_fullsized":"2023-08-27T11:22:44.954373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956231+0000","last_change":"2023-08-27T11:22:43.993427+0000","last_active":"2023-08-27T11:22:44.956231+0000","last_peered":"2023-08-27T11:22:44.956231+0000","last_clean":"2023-08-27T11:22:44.956231+0000","last_became_active":"2023-08-27T11:22:43.992811+0000","last_became_peered":"2023-08-27T11:22:43.992811+0000","last_unstale":"2023-08-27T11:22:44.956231+0000","last_undegraded":"2023-08-27T11:22:44.956231+0000","last_fullsized":"2023-08-27T11:22:44.956231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.958613+0000","last_change":"2023-08-27T11:22:42.972531+0000","last_active":"2023-08-27T11:22:43.958613+0000","last_peered":"2023-08-27T11:22:43.958613+0000","last_clean":"2023-08-27T11:22:43.958613+0000","last_became_active":"2023-08-27T11:22:42.972138+0000","last_became_peered":"2023-08-27T11:22:42.972138+0000","last_unstale":"2023-08-27T11:22:43.958613+0000","last_undegraded":"2023-08-27T11:22:43.958613+0000","last_fullsized":"2023-08-27T11:22:43.958613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:01.025348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956856+0000","last_change":"2023-08-27T11:22:43.989896+0000","last_active":"2023-08-27T11:22:44.956856+0000","last_peered":"2023-08-27T11:22:44.956856+0000","last_clean":"2023-08-27T11:22:44.956856+0000","last_became_active":"2023-08-27T11:22:43.989230+0000","last_became_peered":"2023-08-27T11:22:43.989230+0000","last_unstale":"2023-08-27T11:22:44.956856+0000","last_undegraded":"2023-08-27T11:22:44.956856+0000","last_fullsized":"2023-08-27T11:22:44.956856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:51.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956010+0000","last_change":"2023-08-27T11:22:42.958843+0000","last_active":"2023-08-27T11:22:44.956010+0000","last_peered":"2023-08-27T11:22:44.956010+0000","last_clean":"2023-08-27T11:22:44.956010+0000","last_became_active":"2023-08-27T11:22:42.958485+0000","last_became_peered":"2023-08-27T11:22:42.958485+0000","last_unstale":"2023-08-27T11:22:44.956010+0000","last_undegraded":"2023-08-27T11:22:44.956010+0000","last_fullsized":"2023-08-27T11:22:44.956010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:58.733476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956871+0000","last_change":"2023-08-27T11:22:43.989191+0000","last_active":"2023-08-27T11:22:44.956871+0000","last_peered":"2023-08-27T11:22:44.956871+0000","last_clean":"2023-08-27T11:22:44.956871+0000","last_became_active":"2023-08-27T11:22:43.988840+0000","last_became_peered":"2023-08-27T11:22:43.988840+0000","last_unstale":"2023-08-27T11:22:44.956871+0000","last_undegraded":"2023-08-27T11:22:44.956871+0000","last_fullsized":"2023-08-27T11:22:44.956871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.642446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953825+0000","last_change":"2023-08-27T11:22:42.976094+0000","last_active":"2023-08-27T11:22:44.953825+0000","last_peered":"2023-08-27T11:22:44.953825+0000","last_clean":"2023-08-27T11:22:44.953825+0000","last_became_active":"2023-08-27T11:22:42.975763+0000","last_became_peered":"2023-08-27T11:22:42.975763+0000","last_unstale":"2023-08-27T11:22:44.953825+0000","last_undegraded":"2023-08-27T11:22:44.953825+0000","last_fullsized":"2023-08-27T11:22:44.953825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992831+0000","last_change":"2023-08-27T11:22:43.986813+0000","last_active":"2023-08-27T11:22:43.992831+0000","last_peered":"2023-08-27T11:22:43.992831+0000","last_clean":"2023-08-27T11:22:43.992831+0000","last_became_active":"2023-08-27T11:22:43.986301+0000","last_became_peered":"2023-08-27T11:22:43.986301+0000","last_unstale":"2023-08-27T11:22:43.992831+0000","last_undegraded":"2023-08-27T11:22:43.992831+0000","last_fullsized":"2023-08-27T11:22:43.992831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:26.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954367+0000","last_change":"2023-08-27T11:22:42.970688+0000","last_active":"2023-08-27T11:22:44.954367+0000","last_peered":"2023-08-27T11:22:44.954367+0000","last_clean":"2023-08-27T11:22:44.954367+0000","last_became_active":"2023-08-27T11:22:42.970294+0000","last_became_peered":"2023-08-27T11:22:42.970294+0000","last_unstale":"2023-08-27T11:22:44.954367+0000","last_undegraded":"2023-08-27T11:22:44.954367+0000","last_fullsized":"2023-08-27T11:22:44.954367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:29.778808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956655+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:22:44.956655+0000","last_peered":"2023-08-27T11:22:44.956655+0000","last_clean":"2023-08-27T11:22:44.956655+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:22:44.956655+0000","last_undegraded":"2023-08-27T11:22:44.956655+0000","last_fullsized":"2023-08-27T11:22:44.956655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:11.427186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953730+0000","last_change":"2023-08-27T11:22:43.982339+0000","last_active":"2023-08-27T11:22:44.953730+0000","last_peered":"2023-08-27T11:22:44.953730+0000","last_clean":"2023-08-27T11:22:44.953730+0000","last_became_active":"2023-08-27T11:22:43.982008+0000","last_became_peered":"2023-08-27T11:22:43.982008+0000","last_unstale":"2023-08-27T11:22:44.953730+0000","last_undegraded":"2023-08-27T11:22:44.953730+0000","last_fullsized":"2023-08-27T11:22:44.953730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954148+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:22:44.954148+0000","last_peered":"2023-08-27T11:22:44.954148+0000","last_clean":"2023-08-27T11:22:44.954148+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:22:44.954148+0000","last_undegraded":"2023-08-27T11:22:44.954148+0000","last_fullsized":"2023-08-27T11:22:44.954148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:04.880208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.968626+0000","last_change":"2023-08-27T11:22:42.980391+0000","last_active":"2023-08-27T11:22:43.968626+0000","last_peered":"2023-08-27T11:22:43.968626+0000","last_clean":"2023-08-27T11:22:43.968626+0000","last_became_active":"2023-08-27T11:22:42.979955+0000","last_became_peered":"2023-08-27T11:22:42.979955+0000","last_unstale":"2023-08-27T11:22:43.968626+0000","last_undegraded":"2023-08-27T11:22:43.968626+0000","last_fullsized":"2023-08-27T11:22:43.968626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:29.083383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955978+0000","last_change":"2023-08-27T11:22:43.990732+0000","last_active":"2023-08-27T11:22:44.955978+0000","last_peered":"2023-08-27T11:22:44.955978+0000","last_clean":"2023-08-27T11:22:44.955978+0000","last_became_active":"2023-08-27T11:22:43.990460+0000","last_became_peered":"2023-08-27T11:22:43.990460+0000","last_unstale":"2023-08-27T11:22:44.955978+0000","last_undegraded":"2023-08-27T11:22:44.955978+0000","last_fullsized":"2023-08-27T11:22:44.955978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971333+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:22:43.971333+0000","last_peered":"2023-08-27T11:22:43.971333+0000","last_clean":"2023-08-27T11:22:43.971333+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:22:43.971333+0000","last_undegraded":"2023-08-27T11:22:43.971333+0000","last_fullsized":"2023-08-27T11:22:43.971333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:36:54.997694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.976253+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:22:43.976253+0000","last_peered":"2023-08-27T11:22:43.976253+0000","last_clean":"2023-08-27T11:22:43.976253+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:22:43.976253+0000","last_undegraded":"2023-08-27T11:22:43.976253+0000","last_fullsized":"2023-08-27T11:22:43.976253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:42.974365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.972375+0000","last_change":"2023-08-27T11:22:42.978246+0000","last_active":"2023-08-27T11:22:43.972375+0000","last_peered":"2023-08-27T11:22:43.972375+0000","last_clean":"2023-08-27T11:22:43.972375+0000","last_became_active":"2023-08-27T11:22:42.976711+0000","last_became_peered":"2023-08-27T11:22:42.976711+0000","last_unstale":"2023-08-27T11:22:43.972375+0000","last_undegraded":"2023-08-27T11:22:43.972375+0000","last_fullsized":"2023-08-27T11:22:43.972375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:12.175787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993519+0000","last_change":"2023-08-27T11:22:43.987923+0000","last_active":"2023-08-27T11:22:43.993519+0000","last_peered":"2023-08-27T11:22:43.993519+0000","last_clean":"2023-08-27T11:22:43.993519+0000","last_became_active":"2023-08-27T11:22:43.985057+0000","last_became_peered":"2023-08-27T11:22:43.985057+0000","last_unstale":"2023-08-27T11:22:43.993519+0000","last_undegraded":"2023-08-27T11:22:43.993519+0000","last_fullsized":"2023-08-27T11:22:43.993519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.974882+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:22:43.974882+0000","last_peered":"2023-08-27T11:22:43.974882+0000","last_clean":"2023-08-27T11:22:43.974882+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:22:43.974882+0000","last_undegraded":"2023-08-27T11:22:43.974882+0000","last_fullsized":"2023-08-27T11:22:43.974882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:17:25.355087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.970843+0000","last_change":"2023-08-27T11:22:42.974293+0000","last_active":"2023-08-27T11:22:43.970843+0000","last_peered":"2023-08-27T11:22:43.970843+0000","last_clean":"2023-08-27T11:22:43.970843+0000","last_became_active":"2023-08-27T11:22:42.973989+0000","last_became_peered":"2023-08-27T11:22:42.973989+0000","last_unstale":"2023-08-27T11:22:43.970843+0000","last_undegraded":"2023-08-27T11:22:43.970843+0000","last_fullsized":"2023-08-27T11:22:43.970843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:46.549230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.988627+0000","last_change":"2023-08-27T11:22:43.979605+0000","last_active":"2023-08-27T11:22:43.988627+0000","last_peered":"2023-08-27T11:22:43.988627+0000","last_clean":"2023-08-27T11:22:43.988627+0000","last_became_active":"2023-08-27T11:22:43.979323+0000","last_became_peered":"2023-08-27T11:22:43.979323+0000","last_unstale":"2023-08-27T11:22:43.988627+0000","last_undegraded":"2023-08-27T11:22:43.988627+0000","last_fullsized":"2023-08-27T11:22:43.988627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:07.411952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.974616+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:22:43.974616+0000","last_peered":"2023-08-27T11:22:43.974616+0000","last_clean":"2023-08-27T11:22:43.974616+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:22:43.974616+0000","last_undegraded":"2023-08-27T11:22:43.974616+0000","last_fullsized":"2023-08-27T11:22:43.974616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:45.496869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953924+0000","last_change":"2023-08-27T11:22:42.970697+0000","last_active":"2023-08-27T11:22:44.953924+0000","last_peered":"2023-08-27T11:22:44.953924+0000","last_clean":"2023-08-27T11:22:44.953924+0000","last_became_active":"2023-08-27T11:22:42.970380+0000","last_became_peered":"2023-08-27T11:22:42.970380+0000","last_unstale":"2023-08-27T11:22:44.953924+0000","last_undegraded":"2023-08-27T11:22:44.953924+0000","last_fullsized":"2023-08-27T11:22:44.953924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.993977+0000","last_change":"2023-08-27T11:22:43.992399+0000","last_active":"2023-08-27T11:22:43.993977+0000","last_peered":"2023-08-27T11:22:43.993977+0000","last_clean":"2023-08-27T11:22:43.993977+0000","last_became_active":"2023-08-27T11:22:43.991762+0000","last_became_peered":"2023-08-27T11:22:43.991762+0000","last_unstale":"2023-08-27T11:22:43.993977+0000","last_undegraded":"2023-08-27T11:22:43.993977+0000","last_fullsized":"2023-08-27T11:22:43.993977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:47.556646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955449+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:22:44.955449+0000","last_peered":"2023-08-27T11:22:44.955449+0000","last_clean":"2023-08-27T11:22:44.955449+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:22:44.955449+0000","last_undegraded":"2023-08-27T11:22:44.955449+0000","last_fullsized":"2023-08-27T11:22:44.955449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956560+0000","last_change":"2023-08-27T11:22:42.981231+0000","last_active":"2023-08-27T11:22:44.956560+0000","last_peered":"2023-08-27T11:22:44.956560+0000","last_clean":"2023-08-27T11:22:44.956560+0000","last_became_active":"2023-08-27T11:22:42.980906+0000","last_became_peered":"2023-08-27T11:22:42.980906+0000","last_unstale":"2023-08-27T11:22:44.956560+0000","last_undegraded":"2023-08-27T11:22:44.956560+0000","last_fullsized":"2023-08-27T11:22:44.956560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:16.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.991007+0000","last_change":"2023-08-27T11:22:43.980912+0000","last_active":"2023-08-27T11:22:43.991007+0000","last_peered":"2023-08-27T11:22:43.991007+0000","last_clean":"2023-08-27T11:22:43.991007+0000","last_became_active":"2023-08-27T11:22:43.980561+0000","last_became_peered":"2023-08-27T11:22:43.980561+0000","last_unstale":"2023-08-27T11:22:43.991007+0000","last_undegraded":"2023-08-27T11:22:43.991007+0000","last_fullsized":"2023-08-27T11:22:43.991007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:38:01.545972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.959478+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:22:43.959478+0000","last_peered":"2023-08-27T11:22:43.959478+0000","last_clean":"2023-08-27T11:22:43.959478+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:22:43.959478+0000","last_undegraded":"2023-08-27T11:22:43.959478+0000","last_fullsized":"2023-08-27T11:22:43.959478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:17:25.355087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.971423+0000","last_change":"2023-08-27T11:22:42.974572+0000","last_active":"2023-08-27T11:22:43.971423+0000","last_peered":"2023-08-27T11:22:43.971423+0000","last_clean":"2023-08-27T11:22:43.971423+0000","last_became_active":"2023-08-27T11:22:42.973936+0000","last_became_peered":"2023-08-27T11:22:42.973936+0000","last_unstale":"2023-08-27T11:22:43.971423+0000","last_undegraded":"2023-08-27T11:22:43.971423+0000","last_fullsized":"2023-08-27T11:22:43.971423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992597+0000","last_change":"2023-08-27T11:22:43.983828+0000","last_active":"2023-08-27T11:22:43.992597+0000","last_peered":"2023-08-27T11:22:43.992597+0000","last_clean":"2023-08-27T11:22:43.992597+0000","last_became_active":"2023-08-27T11:22:43.983297+0000","last_became_peered":"2023-08-27T11:22:43.983297+0000","last_unstale":"2023-08-27T11:22:43.992597+0000","last_undegraded":"2023-08-27T11:22:43.992597+0000","last_fullsized":"2023-08-27T11:22:43.992597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:30.884635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.959460+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:22:43.959460+0000","last_peered":"2023-08-27T11:22:43.959460+0000","last_clean":"2023-08-27T11:22:43.959460+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:22:43.959460+0000","last_undegraded":"2023-08-27T11:22:43.959460+0000","last_fullsized":"2023-08-27T11:22:43.959460+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:06.148133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956090+0000","last_change":"2023-08-27T11:22:42.970931+0000","last_active":"2023-08-27T11:22:44.956090+0000","last_peered":"2023-08-27T11:22:44.956090+0000","last_clean":"2023-08-27T11:22:44.956090+0000","last_became_active":"2023-08-27T11:22:42.970639+0000","last_became_peered":"2023-08-27T11:22:42.970639+0000","last_unstale":"2023-08-27T11:22:44.956090+0000","last_undegraded":"2023-08-27T11:22:44.956090+0000","last_fullsized":"2023-08-27T11:22:44.956090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.988585+0000","last_change":"2023-08-27T11:22:43.978747+0000","last_active":"2023-08-27T11:22:43.988585+0000","last_peered":"2023-08-27T11:22:43.988585+0000","last_clean":"2023-08-27T11:22:43.988585+0000","last_became_active":"2023-08-27T11:22:43.978452+0000","last_became_peered":"2023-08-27T11:22:43.978452+0000","last_unstale":"2023-08-27T11:22:43.988585+0000","last_undegraded":"2023-08-27T11:22:43.988585+0000","last_fullsized":"2023-08-27T11:22:43.988585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.996457+0000","last_change":"2023-08-27T11:22:42.978613+0000","last_active":"2023-08-27T11:22:43.996457+0000","last_peered":"2023-08-27T11:22:43.996457+0000","last_clean":"2023-08-27T11:22:43.996457+0000","last_became_active":"2023-08-27T11:22:42.978242+0000","last_became_peered":"2023-08-27T11:22:42.978242+0000","last_unstale":"2023-08-27T11:22:43.996457+0000","last_undegraded":"2023-08-27T11:22:43.996457+0000","last_fullsized":"2023-08-27T11:22:43.996457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:51.524523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.984664+0000","last_change":"2023-08-27T11:22:43.979802+0000","last_active":"2023-08-27T11:22:43.984664+0000","last_peered":"2023-08-27T11:22:43.984664+0000","last_clean":"2023-08-27T11:22:43.984664+0000","last_became_active":"2023-08-27T11:22:43.979457+0000","last_became_peered":"2023-08-27T11:22:43.979457+0000","last_unstale":"2023-08-27T11:22:43.984664+0000","last_undegraded":"2023-08-27T11:22:43.984664+0000","last_fullsized":"2023-08-27T11:22:43.984664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:04.187421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955380+0000","last_change":"2023-08-27T11:22:42.970531+0000","last_active":"2023-08-27T11:22:44.955380+0000","last_peered":"2023-08-27T11:22:44.955380+0000","last_clean":"2023-08-27T11:22:44.955380+0000","last_became_active":"2023-08-27T11:22:42.970063+0000","last_became_peered":"2023-08-27T11:22:42.970063+0000","last_unstale":"2023-08-27T11:22:44.955380+0000","last_undegraded":"2023-08-27T11:22:44.955380+0000","last_fullsized":"2023-08-27T11:22:44.955380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956373+0000","last_change":"2023-08-27T11:22:43.990179+0000","last_active":"2023-08-27T11:22:44.956373+0000","last_peered":"2023-08-27T11:22:44.956373+0000","last_clean":"2023-08-27T11:22:44.956373+0000","last_became_active":"2023-08-27T11:22:43.989642+0000","last_became_peered":"2023-08-27T11:22:43.989642+0000","last_unstale":"2023-08-27T11:22:44.956373+0000","last_undegraded":"2023-08-27T11:22:44.956373+0000","last_fullsized":"2023-08-27T11:22:44.956373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955879+0000","last_change":"2023-08-27T11:22:42.966238+0000","last_active":"2023-08-27T11:22:44.955879+0000","last_peered":"2023-08-27T11:22:44.955879+0000","last_clean":"2023-08-27T11:22:44.955879+0000","last_became_active":"2023-08-27T11:22:42.965938+0000","last_became_peered":"2023-08-27T11:22:42.965938+0000","last_unstale":"2023-08-27T11:22:44.955879+0000","last_undegraded":"2023-08-27T11:22:44.955879+0000","last_fullsized":"2023-08-27T11:22:44.955879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956394+0000","last_change":"2023-08-27T11:22:43.991696+0000","last_active":"2023-08-27T11:22:44.956394+0000","last_peered":"2023-08-27T11:22:44.956394+0000","last_clean":"2023-08-27T11:22:44.956394+0000","last_became_active":"2023-08-27T11:22:43.991150+0000","last_became_peered":"2023-08-27T11:22:43.991150+0000","last_unstale":"2023-08-27T11:22:44.956394+0000","last_undegraded":"2023-08-27T11:22:44.956394+0000","last_fullsized":"2023-08-27T11:22:44.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953861+0000","last_change":"2023-08-27T11:22:42.970669+0000","last_active":"2023-08-27T11:22:44.953861+0000","last_peered":"2023-08-27T11:22:44.953861+0000","last_clean":"2023-08-27T11:22:44.953861+0000","last_became_active":"2023-08-27T11:22:42.970385+0000","last_became_peered":"2023-08-27T11:22:42.970385+0000","last_unstale":"2023-08-27T11:22:44.953861+0000","last_undegraded":"2023-08-27T11:22:44.953861+0000","last_fullsized":"2023-08-27T11:22:44.953861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953966+0000","last_change":"2023-08-27T11:22:43.964703+0000","last_active":"2023-08-27T11:22:44.953966+0000","last_peered":"2023-08-27T11:22:44.953966+0000","last_clean":"2023-08-27T11:22:44.953966+0000","last_became_active":"2023-08-27T11:22:43.964343+0000","last_became_peered":"2023-08-27T11:22:43.964343+0000","last_unstale":"2023-08-27T11:22:44.953966+0000","last_undegraded":"2023-08-27T11:22:44.953966+0000","last_fullsized":"2023-08-27T11:22:44.953966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.984581+0000","last_change":"2023-08-27T11:22:42.977833+0000","last_active":"2023-08-27T11:22:43.984581+0000","last_peered":"2023-08-27T11:22:43.984581+0000","last_clean":"2023-08-27T11:22:43.984581+0000","last_became_active":"2023-08-27T11:22:42.977061+0000","last_became_peered":"2023-08-27T11:22:42.977061+0000","last_unstale":"2023-08-27T11:22:43.984581+0000","last_undegraded":"2023-08-27T11:22:43.984581+0000","last_fullsized":"2023-08-27T11:22:43.984581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:11.990592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955674+0000","last_change":"2023-08-27T11:22:43.989253+0000","last_active":"2023-08-27T11:22:44.955674+0000","last_peered":"2023-08-27T11:22:44.955674+0000","last_clean":"2023-08-27T11:22:44.955674+0000","last_became_active":"2023-08-27T11:22:43.988860+0000","last_became_peered":"2023-08-27T11:22:43.988860+0000","last_unstale":"2023-08-27T11:22:44.955674+0000","last_undegraded":"2023-08-27T11:22:44.955674+0000","last_fullsized":"2023-08-27T11:22:44.955674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.965574+0000","last_change":"2023-08-27T11:22:43.962222+0000","last_active":"2023-08-27T11:22:43.965574+0000","last_peered":"2023-08-27T11:22:43.965574+0000","last_clean":"2023-08-27T11:22:43.965574+0000","last_became_active":"2023-08-27T11:22:43.961880+0000","last_became_peered":"2023-08-27T11:22:43.961880+0000","last_unstale":"2023-08-27T11:22:43.965574+0000","last_undegraded":"2023-08-27T11:22:43.965574+0000","last_fullsized":"2023-08-27T11:22:43.965574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:30.090799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953872+0000","last_change":"2023-08-27T11:22:43.983558+0000","last_active":"2023-08-27T11:22:44.953872+0000","last_peered":"2023-08-27T11:22:44.953872+0000","last_clean":"2023-08-27T11:22:44.953872+0000","last_became_active":"2023-08-27T11:22:43.981569+0000","last_became_peered":"2023-08-27T11:22:43.981569+0000","last_unstale":"2023-08-27T11:22:44.953872+0000","last_undegraded":"2023-08-27T11:22:44.953872+0000","last_fullsized":"2023-08-27T11:22:44.953872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956171+0000","last_change":"2023-08-27T11:22:43.995288+0000","last_active":"2023-08-27T11:22:44.956171+0000","last_peered":"2023-08-27T11:22:44.956171+0000","last_clean":"2023-08-27T11:22:44.956171+0000","last_became_active":"2023-08-27T11:22:43.995014+0000","last_became_peered":"2023-08-27T11:22:43.995014+0000","last_unstale":"2023-08-27T11:22:44.956171+0000","last_undegraded":"2023-08-27T11:22:44.956171+0000","last_fullsized":"2023-08-27T11:22:44.956171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954375+0000","last_change":"2023-08-27T11:22:43.983608+0000","last_active":"2023-08-27T11:22:44.954375+0000","last_peered":"2023-08-27T11:22:44.954375+0000","last_clean":"2023-08-27T11:22:44.954375+0000","last_became_active":"2023-08-27T11:22:43.983327+0000","last_became_peered":"2023-08-27T11:22:43.983327+0000","last_unstale":"2023-08-27T11:22:44.954375+0000","last_undegraded":"2023-08-27T11:22:44.954375+0000","last_fullsized":"2023-08-27T11:22:44.954375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-08-27T11:22:43.992629+0000","last_change":"2023-08-27T11:22:43.984397+0000","last_active":"2023-08-27T11:22:43.992629+0000","last_peered":"2023-08-27T11:22:43.992629+0000","last_clean":"2023-08-27T11:22:43.992629+0000","last_became_active":"2023-08-27T11:22:43.984028+0000","last_became_peered":"2023-08-27T11:22:43.984028+0000","last_unstale":"2023-08-27T11:22:43.992629+0000","last_undegraded":"2023-08-27T11:22:43.992629+0000","last_fullsized":"2023-08-27T11:22:43.992629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:30.090799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":665003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":71821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":663175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":72807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:22:48.933 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:22:48.934 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-27T11:22:48.934 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-27T11:22:48.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-27T11:22:48.935 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-27T11:22:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.166+0000 7fa2881ff700 1 Processor -- start 2023-08-27T11:22:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.166+0000 7fa2881ff700 1 -- start start 2023-08-27T11:22:49.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa2881ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa280151a90 0x7fa2800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa2881ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2800c4a90 0x7fa28006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa2881ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28006c4e0 con 0x7fa2800c4630 2023-08-27T11:22:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa2881ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa280155370 con 0x7fa2800c4a90 2023-08-27T11:22:49.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa2881ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280151e70 con 0x7fa280151a90 2023-08-27T11:22:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa28679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2800c4a90 0x7fa28006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa28679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2800c4a90 0x7fa28006b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40446/0 (socket says 172.21.15.43:40446) 2023-08-27T11:22:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa28679c700 1 -- 172.21.15.43:0/3340888338 learned_addr learned my addr 172.21.15.43:0/3340888338 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.167+0000 7fa285f9b700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa280151a90 0x7fa2800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa28679c700 1 -- 172.21.15.43:0/3340888338 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa280151a90 msgr2=0x7fa2800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa28679c700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa280151a90 0x7fa2800c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa28679c700 1 -- 172.21.15.43:0/3340888338 >> v1:172.21.15.57:6789/0 conn(0x7fa2800c4630 legacy=0x7fa28006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa28679c700 1 -- 172.21.15.43:0/3340888338 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280154480 con 0x7fa2800c4a90 2023-08-27T11:22:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa28679c700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2800c4a90 0x7fa28006b480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa278009e50 tx=0x7fa27800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21d0bff398caec8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa284f99700 1 -- 172.21.15.43:0/3340888338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800e070 con 0x7fa2800c4a90 2023-08-27T11:22:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa284f99700 1 -- 172.21.15.43:0/3340888338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b9c0 con 0x7fa2800c4a90 2023-08-27T11:22:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.168+0000 7fa284f99700 1 -- 172.21.15.43:0/3340888338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800bd70 con 0x7fa2800c4a90 2023-08-27T11:22:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 -- 172.21.15.43:0/3340888338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2800c4a90 msgr2=0x7fa28006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2800c4a90 0x7fa28006b480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa278009e50 tx=0x7fa27800b330 comp rx=0 tx=0).stop 2023-08-27T11:22:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 -- 172.21.15.43:0/3340888338 shutdown_connections 2023-08-27T11:22:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2800c4a90 0x7fa28006b480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 --2- 172.21.15.43:0/3340888338 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa280151a90 0x7fa2800c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 -- 172.21.15.43:0/3340888338 >> 172.21.15.43:0/3340888338 conn(0x7fa2800ab820 msgr2=0x7fa2800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:49.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 -- 172.21.15.43:0/3340888338 shutdown_connections 2023-08-27T11:22:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.169+0000 7fa2881ff700 1 -- 172.21.15.43:0/3340888338 wait complete. 2023-08-27T11:22:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.171+0000 7fa2881ff700 1 Processor -- start 2023-08-27T11:22:49.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.171+0000 7fa2881ff700 1 -- start start 2023-08-27T11:22:49.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2800c4630 0x7fa280152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2800c4a90 0x7fa2800c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800c19c0 con 0x7fa280151a90 2023-08-27T11:22:49.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280153ce0 con 0x7fa2800c4630 2023-08-27T11:22:49.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa2881ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280153fc0 con 0x7fa2800c4a90 2023-08-27T11:22:49.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa28679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa28679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40458/0 (socket says 172.21.15.43:40458) 2023-08-27T11:22:49.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa28679c700 1 -- 172.21.15.43:0/1065293304 learned_addr learned my addr 172.21.15.43:0/1065293304 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:49.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa285f9b700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2800c4630 0x7fa280152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.172+0000 7fa28579a700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2800c4a90 0x7fa2800c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 -- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2800c4a90 msgr2=0x7fa2800c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2800c4a90 0x7fa2800c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 -- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2800c4630 msgr2=0x7fa280152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2800c4630 0x7fa280152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 -- 172.21.15.43:0/1065293304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009b30 con 0x7fa280151a90 2023-08-27T11:22:49.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa28679c700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ac6e0 tx=0x7fa278004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278004800 con 0x7fa280151a90 2023-08-27T11:22:49.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa278004960 con 0x7fa280151a90 2023-08-27T11:22:49.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27801c680 con 0x7fa280151a90 2023-08-27T11:22:49.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2800c1c30 con 0x7fa280151a90 2023-08-27T11:22:49.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.173+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2801531d0 con 0x7fa280151a90 2023-08-27T11:22:49.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.174+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280154180 con 0x7fa280151a90 2023-08-27T11:22:49.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.175+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa27801c7e0 con 0x7fa280151a90 2023-08-27T11:22:49.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.177+0000 7fa2767fc700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 0x7fa26406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.177+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa27808a100 con 0x7fa280151a90 2023-08-27T11:22:49.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.177+0000 7fa285f9b700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 0x7fa26406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.178+0000 7fa285f9b700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 0x7fa26406c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006b20 tx=0x7fa27c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.181+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2780557e0 con 0x7fa280151a90 2023-08-27T11:22:49.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.448+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa2800c20f0 con 0x7fa280151a90 2023-08-27T11:22:49.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.451+0000 7fa2767fc700 1 -- 172.21.15.43:0/1065293304 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169492 (secure 0 0 0) 0x7fa278058e00 con 0x7fa280151a90 2023-08-27T11:22:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:49.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 msgr2=0x7fa26406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 0x7fa26406c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006b20 tx=0x7fa27c008040 comp rx=0 tx=0).stop 2023-08-27T11:22:49.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 msgr2=0x7fa280148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa2800ac6e0 tx=0x7fa278004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 shutdown_connections 2023-08-27T11:22:49.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa26406a0e0 0x7fa26406c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa280151a90 0x7fa280148fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2800c4630 0x7fa280152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 --2- 172.21.15.43:0/1065293304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2800c4a90 0x7fa2800c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.454+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 >> 172.21.15.43:0/1065293304 conn(0x7fa2800ab820 msgr2=0x7fa28014a480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:49.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.455+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 shutdown_connections 2023-08-27T11:22:49.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.455+0000 7fa2881ff700 1 -- 172.21.15.43:0/1065293304 wait complete. 2023-08-27T11:22:49.474 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6832","nonce":2364062298},{"type":"v1","addr":"172.21.15.43:6833","nonce":2364062298}]},"active_addr":"172.21.15.43:6833/2364062298","active_change":"2023-08-27T11:22:30.298469+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2607222825}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3041797380}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1913764410}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1810778463}]}]} 2023-08-27T11:22:49.481 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-27T11:22:49.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-27T11:22:49.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:49.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.682+0000 7fbf919ff700 1 Processor -- start 2023-08-27T11:22:49.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.683+0000 7fbf919ff700 1 -- start start 2023-08-27T11:22:49.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 0x7fbf8c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 0x7fbf8c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c06c4e0 con 0x7fbf8c0c4630 2023-08-27T11:22:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c155370 con 0x7fbf8c151a90 2023-08-27T11:22:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf919ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c151e70 con 0x7fbf8c06ad70 2023-08-27T11:22:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40474/0 (socket says 172.21.15.43:40474) 2023-08-27T11:22:49.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/323070412 learned_addr learned my addr 172.21.15.43:0/323070412 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:49.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8b7fe700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 0x7fbf8c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8affd700 1 --2- 172.21.15.43:0/323070412 >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 0x7fbf8c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/323070412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 msgr2=0x7fbf8c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:49.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 0x7fbf8c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/323070412 >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 msgr2=0x7fbf8c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/323070412 >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 0x7fbf8c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/323070412 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c154480 con 0x7fbf8c0c4630 2023-08-27T11:22:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8b7fe700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 0x7fbf8c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.684+0000 7fbf8affd700 1 --2- 172.21.15.43:0/323070412 >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 0x7fbf8c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.685+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c067710 tx=0x7fbf80009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6986106c1b29b7b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.685+0000 7fbf89ffb700 1 -- 172.21.15.43:0/323070412 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000b870 con 0x7fbf8c0c4630 2023-08-27T11:22:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.685+0000 7fbf89ffb700 1 -- 172.21.15.43:0/323070412 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000b9d0 con 0x7fbf8c0c4630 2023-08-27T11:22:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.685+0000 7fbf89ffb700 1 -- 172.21.15.43:0/323070412 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000bd60 con 0x7fbf8c0c4630 2023-08-27T11:22:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 -- 172.21.15.43:0/323070412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 msgr2=0x7fbf8c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c067710 tx=0x7fbf80009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 -- 172.21.15.43:0/323070412 shutdown_connections 2023-08-27T11:22:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c06ad70 0x7fbf8c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 --2- 172.21.15.43:0/323070412 >> v2:172.21.15.57:3300/0 conn(0x7fbf8c151a90 0x7fbf8c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 --2- 172.21.15.43:0/323070412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c0c4a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 -- 172.21.15.43:0/323070412 >> 172.21.15.43:0/323070412 conn(0x7fbf8c0ab820 msgr2=0x7fbf8c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:49.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 -- 172.21.15.43:0/323070412 shutdown_connections 2023-08-27T11:22:49.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.686+0000 7fbf919ff700 1 -- 172.21.15.43:0/323070412 wait complete. 2023-08-27T11:22:49.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.687+0000 7fbf919ff700 1 Processor -- start 2023-08-27T11:22:49.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.688+0000 7fbf919ff700 1 -- start start 2023-08-27T11:22:49.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.688+0000 7fbf919ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c06ad70 0x7fbf8c156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.688+0000 7fbf919ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf919ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c151a90 0x7fbf8c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf919ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c1e9530 con 0x7fbf8c0c4630 2023-08-27T11:22:49.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf919ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c1ed990 con 0x7fbf8c06ad70 2023-08-27T11:22:49.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf919ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c14ce80 con 0x7fbf8c151a90 2023-08-27T11:22:49.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c06ad70 0x7fbf8c156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40476/0 (socket says 172.21.15.43:40476) 2023-08-27T11:22:49.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/418520743 learned_addr learned my addr 172.21.15.43:0/418520743 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:49.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8b7fe700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c151a90 0x7fbf8c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c151a90 msgr2=0x7fbf8c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c151a90 0x7fbf8c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c06ad70 msgr2=0x7fbf8c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c06ad70 0x7fbf8c156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 -- 172.21.15.43:0/418520743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009550 con 0x7fbf8c0c4630 2023-08-27T11:22:49.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.689+0000 7fbf8a7fc700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf80000c00 tx=0x7fbf80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.690+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80004480 con 0x7fbf8c0c4630 2023-08-27T11:22:49.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.690+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800045e0 con 0x7fbf8c0c4630 2023-08-27T11:22:49.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.690+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800038e0 con 0x7fbf8c0c4630 2023-08-27T11:22:49.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.690+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c14d160 con 0x7fbf8c0c4630 2023-08-27T11:22:49.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.690+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c14d720 con 0x7fbf8c0c4630 2023-08-27T11:22:49.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.691+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c04ee70 con 0x7fbf8c0c4630 2023-08-27T11:22:49.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.692+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf80021070 con 0x7fbf8c0c4630 2023-08-27T11:22:49.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.693+0000 7fbf73fff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:49.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.693+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf80089b60 con 0x7fbf8c0c4630 2023-08-27T11:22:49.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.693+0000 7fbf8affd700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:49.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.693+0000 7fbf8affd700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c006f10 tx=0x7fbf7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:49.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.697+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf80055240 con 0x7fbf8c0c4630 2023-08-27T11:22:49.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.910+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf8c14d8e0 con 0x7fbf8c0c4630 2023-08-27T11:22:49.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.911+0000 7fbf73fff700 1 -- 172.21.15.43:0/418520743 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fbf80015090 con 0x7fbf8c0c4630 2023-08-27T11:22:49.913 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:49.914 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 msgr2=0x7fbf7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c006f10 tx=0x7fbf7c008040 comp rx=0 tx=0).stop 2023-08-27T11:22:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 msgr2=0x7fbf8c1ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf80000c00 tx=0x7fbf80004750 comp rx=0 tx=0).stop 2023-08-27T11:22:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 shutdown_connections 2023-08-27T11:22:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbf7806a0e0 0x7fbf7806c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf8c151a90 0x7fbf8c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf8c06ad70 0x7fbf8c156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 --2- 172.21.15.43:0/418520743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbf8c0c4630 0x7fbf8c1ed450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 >> 172.21.15.43:0/418520743 conn(0x7fbf8c0ab820 msgr2=0x7fbf8c0c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 shutdown_connections 2023-08-27T11:22:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:49.914+0000 7fbf919ff700 1 -- 172.21.15.43:0/418520743 wait complete. 2023-08-27T11:22:49.934 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-27T11:22:49.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:50.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.135+0000 7fa0d37ff700 1 Processor -- start 2023-08-27T11:22:50.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.135+0000 7fa0d37ff700 1 -- start start 2023-08-27T11:22:50.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d37ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0cc151a90 0x7fa0cc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d37ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0cc0c4a90 0x7fa0cc06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d37ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc06c4e0 con 0x7fa0cc0c4630 2023-08-27T11:22:50.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d37ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc155370 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d37ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc151e70 con 0x7fa0cc151a90 2023-08-27T11:22:50.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d1d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0cc0c4a90 0x7fa0cc06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d1d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0cc0c4a90 0x7fa0cc06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40482/0 (socket says 172.21.15.43:40482) 2023-08-27T11:22:50.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d1d9c700 1 -- 172.21.15.43:0/2835035530 learned_addr learned my addr 172.21.15.43:0/2835035530 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d159b700 1 --2- 172.21.15.43:0/2835035530 >> v2:172.21.15.57:3300/0 conn(0x7fa0cc151a90 0x7fa0cc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d1d9c700 1 -- 172.21.15.43:0/2835035530 >> v2:172.21.15.57:3300/0 conn(0x7fa0cc151a90 msgr2=0x7fa0cc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.136+0000 7fa0d1d9c700 1 --2- 172.21.15.43:0/2835035530 >> v2:172.21.15.57:3300/0 conn(0x7fa0cc151a90 0x7fa0cc0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0d1d9c700 1 -- 172.21.15.43:0/2835035530 >> v1:172.21.15.57:6789/0 conn(0x7fa0cc0c4630 legacy=0x7fa0cc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0d1d9c700 1 -- 172.21.15.43:0/2835035530 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc154480 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0d1d9c700 1 --2- 172.21.15.43:0/2835035530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4a90 0x7fa0cc06b480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc067710 tx=0x7fa0c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722e83fb4efd9691 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0c3fff700 1 -- 172.21.15.43:0/2835035530 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c400e070 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0c3fff700 1 -- 172.21.15.43:0/2835035530 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4003a20 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.137+0000 7fa0c3fff700 1 -- 172.21.15.43:0/2835035530 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4003dd0 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2835035530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4a90 msgr2=0x7fa0cc06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2835035530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4a90 0x7fa0cc06b480 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc067710 tx=0x7fa0c400b330 comp rx=0 tx=0).stop 2023-08-27T11:22:50.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2835035530 shutdown_connections 2023-08-27T11:22:50.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2835035530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4a90 0x7fa0cc06b480 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2835035530 >> v2:172.21.15.57:3300/0 conn(0x7fa0cc151a90 0x7fa0cc0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2835035530 >> 172.21.15.43:0/2835035530 conn(0x7fa0cc0ab820 msgr2=0x7fa0cc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2835035530 shutdown_connections 2023-08-27T11:22:50.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.138+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2835035530 wait complete. 2023-08-27T11:22:50.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.140+0000 7fa0d37ff700 1 Processor -- start 2023-08-27T11:22:50.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.140+0000 7fa0d37ff700 1 -- start start 2023-08-27T11:22:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.141+0000 7fa0d37ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.141+0000 7fa0d37ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0cc0c4a90 0x7fa0cc1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d37ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc151a90 0x7fa0cc1ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d37ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14e2e0 con 0x7fa0cc0c4630 2023-08-27T11:22:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d37ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0c7c60 con 0x7fa0cc151a90 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d37ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc1503a0 con 0x7fa0cc0c4a90 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40484/0 (socket says 172.21.15.43:40484) 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 -- 172.21.15.43:0/2333974509 learned_addr learned my addr 172.21.15.43:0/2333974509 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d0d9a700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0cc0c4a90 0x7fa0cc1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d1d9c700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc151a90 0x7fa0cc1ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 -- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0cc0c4a90 msgr2=0x7fa0cc1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0cc0c4a90 0x7fa0cc1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 -- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc151a90 msgr2=0x7fa0cc1ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc151a90 0x7fa0cc1ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.142+0000 7fa0d159b700 1 -- 172.21.15.43:0/2333974509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4009b30 con 0x7fa0cc0c4630 2023-08-27T11:22:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0d159b700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d800 tx=0x7fa0c800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80125f0 con 0x7fa0cc0c4630 2023-08-27T11:22:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8012750 con 0x7fa0cc0c4630 2023-08-27T11:22:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc1eda30 con 0x7fa0cc0c4630 2023-08-27T11:22:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8012b00 con 0x7fa0cc0c4630 2023-08-27T11:22:50.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.143+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc150920 con 0x7fa0cc0c4630 2023-08-27T11:22:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.144+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc04ee70 con 0x7fa0cc0c4630 2023-08-27T11:22:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.145+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0c8012c60 con 0x7fa0cc0c4630 2023-08-27T11:22:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.146+0000 7fa0c1ffb700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 0x7fa0b006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.146+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0c80884d0 con 0x7fa0cc0c4630 2023-08-27T11:22:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.146+0000 7fa0d0d9a700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 0x7fa0b006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.147+0000 7fa0d0d9a700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 0x7fa0b006c5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc14b120 tx=0x7fa0bc007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.151+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa0c8053c30 con 0x7fa0cc0c4630 2023-08-27T11:22:50.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.361+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0cc06c130 con 0x7fa0cc0c4630 2023-08-27T11:22:50.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.362+0000 7fa0c1ffb700 1 -- 172.21.15.43:0/2333974509 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fa0c8057250 con 0x7fa0cc0c4630 2023-08-27T11:22:50.364 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:50.364 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:50.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 msgr2=0x7fa0b006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 0x7fa0b006c5f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc14b120 tx=0x7fa0bc007ec0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 msgr2=0x7fa0cc14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800d800 tx=0x7fa0c800db10 comp rx=0 tx=0).stop 2023-08-27T11:22:50.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 shutdown_connections 2023-08-27T11:22:50.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0b006a130 0x7fa0b006c5f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0cc151a90 0x7fa0cc1ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0cc0c4630 0x7fa0cc14fe60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 --2- 172.21.15.43:0/2333974509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0cc0c4a90 0x7fa0cc1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 >> 172.21.15.43:0/2333974509 conn(0x7fa0cc0ab820 msgr2=0x7fa0cc14a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 shutdown_connections 2023-08-27T11:22:50.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.365+0000 7fa0d37ff700 1 -- 172.21.15.43:0/2333974509 wait complete. 2023-08-27T11:22:50.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-27T11:22:50.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-27T11:22:50.386 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-27T11:22:50.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-27T11:22:50.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-27T11:22:50.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-27T11:22:50.388 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-27T11:22:50.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-27T11:22:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.750+0000 7f421e3ff700 1 Processor -- start 2023-08-27T11:22:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.750+0000 7f421e3ff700 1 -- start start 2023-08-27T11:22:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7f421e3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42180c2320 0x7f4218154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7f421e3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42180c4e40 0x7f42180c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7f421e3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4218154bd0 con 0x7f42180c0860 2023-08-27T11:22:50.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7f421e3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218151430 con 0x7f42180c4e40 2023-08-27T11:22:50.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7f421e3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218150820 con 0x7f42180c2320 2023-08-27T11:22:50.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7fc8d47ff700 1 Processor -- start 2023-08-27T11:22:50.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.752+0000 7fc8d47ff700 1 -- start start 2023-08-27T11:22:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.754+0000 7f4217fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42180c2320 0x7f4218154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.754+0000 7f4217fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42180c2320 0x7f4218154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60714/0 (socket says 172.21.15.43:60714) 2023-08-27T11:22:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.754+0000 7f4217fff700 1 -- 172.21.15.43:0/1651113037 learned_addr learned my addr 172.21.15.43:0/1651113037 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.754+0000 7fc8d47ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc8cc0a76f0 0x7fc8cc153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.754+0000 7fc8d47ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc8cc0bad90 0x7fc8cc150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7f4217fff700 1 -- 172.21.15.43:0/1651113037 >> v2:172.21.15.43:3300/0 conn(0x7f42180c4e40 msgr2=0x7f42180c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7f4217fff700 1 --2- 172.21.15.43:0/1651113037 >> v2:172.21.15.43:3300/0 conn(0x7f42180c4e40 0x7f42180c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7f4217fff700 1 -- 172.21.15.43:0/1651113037 >> v1:172.21.15.43:6789/0 conn(0x7f42180c0860 legacy=0x7f42180a7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7f4217fff700 1 -- 172.21.15.43:0/1651113037 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218150b00 con 0x7f42180c2320 2023-08-27T11:22:50.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7fc8d47ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc154d20 con 0x7fc8cc151480 2023-08-27T11:22:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7fc8d47ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc0c3ec0 con 0x7fc8cc0a76f0 2023-08-27T11:22:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7fc8d47ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc154480 con 0x7fc8cc0bad90 2023-08-27T11:22:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7fc8d1d9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc8cc0bad90 0x7fc8cc150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7f4217fff700 1 --2- 172.21.15.43:0/1651113037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c2320 0x7f4218154690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4218066a70 tx=0x7f420c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d827193ffd3c7ab5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.755+0000 7fc8d1d9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc8cc0bad90 0x7fc8cc150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60728/0 (socket says 172.21.15.43:60728) 2023-08-27T11:22:50.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/2833840605 learned_addr learned my addr 172.21.15.43:0/2833840605 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7f4216ffd700 1 -- 172.21.15.43:0/1651113037 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c004230 con 0x7f42180c2320 2023-08-27T11:22:50.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7f4216ffd700 1 -- 172.21.15.43:0/1651113037 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c004390 con 0x7f42180c2320 2023-08-27T11:22:50.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7f4216ffd700 1 -- 172.21.15.43:0/1651113037 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c0036a0 con 0x7f42180c2320 2023-08-27T11:22:50.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/2833840605 >> v2:172.21.15.43:3300/0 conn(0x7fc8cc0a76f0 msgr2=0x7fc8cc153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 --2- 172.21.15.43:0/2833840605 >> v2:172.21.15.43:3300/0 conn(0x7fc8cc0a76f0 0x7fc8cc153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/2833840605 >> v1:172.21.15.57:6789/0 conn(0x7fc8cc151480 legacy=0x7fc8cc0bb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/2833840605 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc154760 con 0x7fc8cc0bad90 2023-08-27T11:22:50.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.756+0000 7fc8d1d9a700 1 --2- 172.21.15.43:0/2833840605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0bad90 0x7fc8cc150f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06d7a0 tx=0x7fc8c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3742540eece61f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7fc8d1599700 1 -- 172.21.15.43:0/2833840605 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400e070 con 0x7fc8cc0bad90 2023-08-27T11:22:50.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7fc8d1599700 1 -- 172.21.15.43:0/2833840605 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c400b9c0 con 0x7fc8cc0bad90 2023-08-27T11:22:50.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7fc8d1599700 1 -- 172.21.15.43:0/2833840605 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c400bd70 con 0x7fc8cc0bad90 2023-08-27T11:22:50.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 -- 172.21.15.43:0/1651113037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c2320 msgr2=0x7f4218154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 --2- 172.21.15.43:0/1651113037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c2320 0x7f4218154690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4218066a70 tx=0x7f420c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 -- 172.21.15.43:0/1651113037 shutdown_connections 2023-08-27T11:22:50.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 --2- 172.21.15.43:0/1651113037 >> v2:172.21.15.43:3300/0 conn(0x7f42180c4e40 0x7f42180c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 --2- 172.21.15.43:0/1651113037 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c2320 0x7f4218154690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.757+0000 7f421e3ff700 1 -- 172.21.15.43:0/1651113037 >> 172.21.15.43:0/1651113037 conn(0x7f421806a730 msgr2=0x7f421806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.758+0000 7f421e3ff700 1 -- 172.21.15.43:0/1651113037 shutdown_connections 2023-08-27T11:22:50.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.758+0000 7fc8d47ff700 1 -- 172.21.15.43:0/2833840605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0bad90 msgr2=0x7fc8cc150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.758+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/2833840605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0bad90 0x7fc8cc150f40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06d7a0 tx=0x7fc8c400b330 comp rx=0 tx=0).stop 2023-08-27T11:22:50.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.761+0000 7fc8d47ff700 1 -- 172.21.15.43:0/2833840605 shutdown_connections 2023-08-27T11:22:50.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.761+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/2833840605 >> v2:172.21.15.43:3300/0 conn(0x7fc8cc0a76f0 0x7fc8cc153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.761+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/2833840605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0bad90 0x7fc8cc150f40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.761+0000 7fc8d47ff700 1 -- 172.21.15.43:0/2833840605 >> 172.21.15.43:0/2833840605 conn(0x7fc8cc06aa50 msgr2=0x7fc8cc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.762+0000 7fc8d47ff700 1 -- 172.21.15.43:0/2833840605 shutdown_connections 2023-08-27T11:22:50.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.762+0000 7f421e3ff700 1 -- 172.21.15.43:0/1651113037 wait complete. 2023-08-27T11:22:50.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.762+0000 7fc8d47ff700 1 -- 172.21.15.43:0/2833840605 wait complete. 2023-08-27T11:22:50.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.764+0000 7f421e3ff700 1 Processor -- start 2023-08-27T11:22:50.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7fc8d47ff700 1 Processor -- start 2023-08-27T11:22:50.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7f421e3ff700 1 -- start start 2023-08-27T11:22:50.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c0860 0x7f42181f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42180c2320 0x7f42181f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 0x7f4218147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ab0d0 con 0x7f42180c4e40 2023-08-27T11:22:50.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180aa7c0 con 0x7f42180c0860 2023-08-27T11:22:50.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f421e3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42181f18b0 con 0x7f42180c2320 2023-08-27T11:22:50.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.763+0000 7f0aef9ff700 1 Processor -- start 2023-08-27T11:22:50.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.763+0000 7f0aef9ff700 1 -- start start 2023-08-27T11:22:50.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7f0aef9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0ae80bd230 0x7f0ae815be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7f0aef9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae80c7bb0 con 0x7f0ae806b160 2023-08-27T11:22:50.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7f0aef9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae806bcc0 con 0x7f0ae8155fd0 2023-08-27T11:22:50.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7f0aef9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae806ad40 con 0x7f0ae80bd230 2023-08-27T11:22:50.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f0aedf9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0ae806b160 0x7f0ae806b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44822/0 (socket says 172.21.15.43:44822) 2023-08-27T11:22:50.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.766+0000 7f0aedf9c700 1 -- 172.21.15.43:0/17942367 learned_addr learned my addr 172.21.15.43:0/17942367 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:50.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7f421c99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 0x7f4218147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7f421c99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 0x7f4218147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40520/0 (socket says 172.21.15.43:40520) 2023-08-27T11:22:50.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7f421c99c700 1 -- 172.21.15.43:0/3799269842 learned_addr learned my addr 172.21.15.43:0/3799269842 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/17942367 >> v2:172.21.15.43:3300/0 conn(0x7f0ae80bd230 0x7f0ae815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 -- 172.21.15.43:0/3799269842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42180c2320 msgr2=0x7f42181f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42180c2320 0x7f42181f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 -- 172.21.15.43:0/3799269842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c0860 msgr2=0x7f42181f0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42180c0860 0x7f42181f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 -- 172.21.15.43:0/3799269842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009550 con 0x7f42180c4e40 2023-08-27T11:22:50.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.765+0000 7fc8d47ff700 1 -- start start 2023-08-27T11:22:50.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0a76f0 0x7fc8cc0bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8cc0bad90 0x7fc8cc0bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8cc151480 0x7fc8cc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0bd5f0 con 0x7fc8cc151480 2023-08-27T11:22:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0be440 con 0x7fc8cc0a76f0 2023-08-27T11:22:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.767+0000 7fc8d47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc0bd930 con 0x7fc8cc0bad90 2023-08-27T11:22:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f421c99c700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 0x7f4218147c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f420800b550 tx=0x7f420800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7fc8d1d9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8cc0bad90 0x7fc8cc0bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7fc8d259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0a76f0 0x7fc8cc0bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7fc8d2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8cc151480 0x7fc8cc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7fc8d2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8cc151480 0x7fc8cc071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40530/0 (socket says 172.21.15.43:40530) 2023-08-27T11:22:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7fc8d2d9c700 1 -- 172.21.15.43:0/138744380 learned_addr learned my addr 172.21.15.43:0/138744380 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f02e1dff700 1 Processor -- start 2023-08-27T11:22:50.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f02e1dff700 1 -- start start 2023-08-27T11:22:50.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208011830 con 0x7f42180c4e40 2023-08-27T11:22:50.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080119b0 con 0x7f42180c4e40 2023-08-27T11:22:50.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208011d60 con 0x7f42180c4e40 2023-08-27T11:22:50.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/138744380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0a76f0 msgr2=0x7fc8cc0bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc8cc0a76f0 0x7fc8cc0bc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8cc151480 msgr2=0x7fc8cc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc8cc151480 0x7fc8cc071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 -- 172.21.15.43:0/138744380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4009b30 con 0x7fc8cc0bad90 2023-08-27T11:22:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600360249 0 0) 0x7f0ae80c7bb0 con 0x7f0ae806b160 2023-08-27T11:22:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad40035b0 con 0x7f0ae806b160 2023-08-27T11:22:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1323948581 0 0) 0x7f0ad40035b0 con 0x7f0ae806b160 2023-08-27T11:22:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 >> v2:172.21.15.43:3300/0 conn(0x7f0ae80bd230 msgr2=0x7f0ae815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 --2- 172.21.15.43:0/17942367 >> v2:172.21.15.43:3300/0 conn(0x7f0ae80bd230 0x7f0ae815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 >> v1:172.21.15.57:6789/0 conn(0x7f0ae8155fd0 legacy=0x7f0ae80c4630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-27T11:22:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae815cd80 con 0x7f0ae806b160 2023-08-27T11:22:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f0ae00019f0 con 0x7f0ae806b160 2023-08-27T11:22:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 >> v1:172.21.15.43:6789/0 conn(0x7f0ae806b160 legacy=0x7f0ae806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.768+0000 7f0adbfff700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad4003a00 0x7f0ad4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0adbfff700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad4004850 0x7f0ad4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0adbfff700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ad400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae806ad40 con 0x7f0ad4005280 2023-08-27T11:22:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad400c1e0 con 0x7f0ad4003a00 2023-08-27T11:22:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad400c3a0 con 0x7f0ad4004850 2023-08-27T11:22:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad4004850 0x7f0ad4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.769+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ad400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 -- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad4004850 msgr2=0x7f0ad4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad4004850 0x7f0ad4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 -- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad4003a00 msgr2=0x7f0ad4003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad4003a00 0x7f0ad4003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 -- 172.21.15.43:0/17942367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae815cd80 con 0x7f0ad4005280 2023-08-27T11:22:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 -- 172.21.15.43:0/17942367 reap_dead start 2023-08-27T11:22:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad4004850 0x7f0ad4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:50.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42180aaa80 con 0x7f42180c4e40 2023-08-27T11:22:50.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421815d580 con 0x7f42180c4e40 2023-08-27T11:22:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ad400ba10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a8b0 tx=0x7f0ad4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1447b46b8e0d8007 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.770+0000 7fc8d1d9a700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8cc0bad90 0x7fc8cc0bf4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4015000 tx=0x7fc8c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0012600 con 0x7f0ad4005280 2023-08-27T11:22:50.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0012780 con 0x7f0ad4005280 2023-08-27T11:22:50.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7f0adbfff700 1 -- 172.21.15.43:0/17942367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0012b30 con 0x7f0ad4005280 2023-08-27T11:22:50.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4004970 con 0x7fc8cc0bad90 2023-08-27T11:22:50.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c40099b0 con 0x7fc8cc0bad90 2023-08-27T11:22:50.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c401c660 con 0x7fc8cc0bad90 2023-08-27T11:22:50.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.771+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc0aaf80 con 0x7fc8cc0bad90 2023-08-27T11:22:50.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.772+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc1f6c60 con 0x7fc8cc0bad90 2023-08-27T11:22:50.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.772+0000 7f0aef9ff700 1 -- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 msgr2=0x7f0ad400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.772+0000 7f0aef9ff700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ad400ba10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000a8b0 tx=0x7f0ad4005880 comp rx=0 tx=0).stop 2023-08-27T11:22:50.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.773+0000 7f0aef9ff700 1 -- 172.21.15.43:0/17942367 shutdown_connections 2023-08-27T11:22:50.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.773+0000 7f0aef9ff700 1 --2- 172.21.15.43:0/17942367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ad400ba10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.773+0000 7f0aef9ff700 1 -- 172.21.15.43:0/17942367 >> 172.21.15.43:0/17942367 conn(0x7f0ae80ab820 msgr2=0x7f0ae80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.774+0000 7f02e1dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02dc0c4b60 0x7f02dc0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.774+0000 7f02e1dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0c0220 con 0x7f02dc15c140 2023-08-27T11:22:50.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.774+0000 7f02e1dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0c0da0 con 0x7f02dc156160 2023-08-27T11:22:50.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.774+0000 7f02e1dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0c5530 con 0x7f02dc0c4b60 2023-08-27T11:22:50.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.773+0000 7f0aef9ff700 1 -- 172.21.15.43:0/17942367 shutdown_connections 2023-08-27T11:22:50.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.773+0000 7f0aef9ff700 1 -- 172.21.15.43:0/17942367 wait complete. 2023-08-27T11:22:50.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.775+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f420801a400 con 0x7f42180c4e40 2023-08-27T11:22:50.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.776+0000 7f0aef9ff700 1 Processor -- start 2023-08-27T11:22:50.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.776+0000 7f4214ff9700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f420006a310 0x7f420006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.777+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4208088520 con 0x7f42180c4e40 2023-08-27T11:22:50.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.776+0000 7f0aef9ff700 1 -- start start 2023-08-27T11:22:50.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f421e3ff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] conn(0x7f41f40015e0 0x7f41f4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 --> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41f4006bd0 con 0x7f41f40015e0 2023-08-27T11:22:50.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f4217fff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f420006a310 0x7f420006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ae80bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ae80bbed0 0x7f0ae80bc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ae80bc890 0x7f0ae80c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8153d80 con 0x7f0ad4005280 2023-08-27T11:22:50.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8143a00 con 0x7f0ae80bc890 2023-08-27T11:22:50.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aef9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae80c1420 con 0x7f0ae80bbed0 2023-08-27T11:22:50.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f02db7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f02dc156160 0x7f02dc0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:38932/0 (socket says 172.21.15.43:38932) 2023-08-27T11:22:50.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f02db7fe700 1 -- 172.21.15.43:0/1739630592 learned_addr learned my addr 172.21.15.43:0/1739630592 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:50.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f42177fe700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] conn(0x7f41f40015e0 0x7f41f4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7f0aed79b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ae80bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ae80bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40566/0 (socket says 172.21.15.43:40566) 2023-08-27T11:22:50.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 -- 172.21.15.43:0/3511971320 learned_addr learned my addr 172.21.15.43:0/3511971320 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ae80bbed0 0x7f0ae80bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203441424 0 0) 0x7f02dc0c0da0 con 0x7f02dc156160 2023-08-27T11:22:50.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c40035b0 con 0x7f02dc156160 2023-08-27T11:22:50.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f42177fe700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] conn(0x7f41f40015e0 0x7f41f4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 -- 172.21.15.43:0/3511971320 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ae80bbed0 msgr2=0x7f0ae80bc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ae80bbed0 0x7f0ae80bc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 -- 172.21.15.43:0/3511971320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ae80bc890 msgr2=0x7f0ae80c2aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-27T11:22:50.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ae80bc890 0x7f0ae80c2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7f0aed79b700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80c1ce0 con 0x7f0ad4005280 2023-08-27T11:22:50.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f0aed79b700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ae80bf970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00b3c0 tx=0x7f0adc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.1 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103551185 0 0) 0x7f02c40035b0 con 0x7f02dc156160 2023-08-27T11:22:50.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 >> v2:172.21.15.43:3300/0 conn(0x7f02dc0c4b60 msgr2=0x7f02dc0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 --2- 172.21.15.43:0/1739630592 >> v2:172.21.15.43:3300/0 conn(0x7f02dc0c4b60 0x7f02dc0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 >> v1:172.21.15.43:6789/0 conn(0x7f02dc15c140 legacy=0x7f02dc15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0c0470 con 0x7f02dc156160 2023-08-27T11:22:50.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.1 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f02cc001670 con 0x7f02dc156160 2023-08-27T11:22:50.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 >> v1:172.21.15.57:6789/0 conn(0x7f02dc156160 legacy=0x7f02dc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 0x7f02c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02c4004850 0x7f02c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4005410 0x7f02c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0c5530 con 0x7f02c4005410 2023-08-27T11:22:50.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c400c2b0 con 0x7f02c4004850 2023-08-27T11:22:50.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.780+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c400c470 con 0x7f02c4003a00 2023-08-27T11:22:50.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011620 con 0x7f0ad4005280 2023-08-27T11:22:50.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc011780 con 0x7f0ad4005280 2023-08-27T11:22:50.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc011b30 con 0x7f0ad4005280 2023-08-27T11:22:50.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f4217fff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f420006a310 0x7f420006c7d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f421815de40 tx=0x7f420c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.778+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc8c401c7c0 con 0x7fc8cc0bad90 2023-08-27T11:22:50.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7fc8c2ffd700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc8b806a2f0 0x7fc8b806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.779+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8c4089ed0 con 0x7fc8cc0bad90 2023-08-27T11:22:50.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7fc8d259b700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc8b806a2f0 0x7fc8b806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae80c1fc0 con 0x7f0ad4005280 2023-08-27T11:22:50.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae80c2580 con 0x7f0ad4005280 2023-08-27T11:22:50.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== osd.0 v2:172.21.15.43:6800/1854749393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f41f4006bd0 con 0x7f41f40015e0 2023-08-27T11:22:50.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f02daffd700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02c4004850 0x7f02c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.781+0000 7f02db7fe700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 0x7f02c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.782+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] conn(0x7fc8b40015e0 0x7fc8b4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.782+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 --> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc8b4006bd0 con 0x7fc8b40015e0 2023-08-27T11:22:50.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.782+0000 7fc8d2d9c700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] conn(0x7fc8b40015e0 0x7fc8b4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.782+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ae815c7c0 con 0x7f0ad4005280 2023-08-27T11:22:50.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 -- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02c4004850 msgr2=0x7f02c4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02c4004850 0x7f02c4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 -- 172.21.15.43:0/1739630592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4005410 msgr2=0x7f02c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4005410 0x7f02c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 -- 172.21.15.43:0/1739630592 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0c0470 con 0x7f02c4003a00 2023-08-27T11:22:50.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02dbfff700 1 -- 172.21.15.43:0/1739630592 reap_dead start 2023-08-27T11:22:50.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.782+0000 7f17ce9ff700 1 Processor -- start 2023-08-27T11:22:50.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7fc8d2d9c700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] conn(0x7fc8b40015e0 0x7fc8b4003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.784+0000 7fc8d259b700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc8b806a2f0 0x7fc8b806c7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009a10 tx=0x7fc8c8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== osd.1 v2:172.21.15.43:6808/2369916833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc8b4006bd0 con 0x7fc8b40015e0 2023-08-27T11:22:50.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f02db7fe700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 0x7f02c4003e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c370 tx=0x7f02c4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40db82b3135833d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.783+0000 7f17ce9ff700 1 -- start start 2023-08-27T11:22:50.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c80a76f0 0x7f17c80c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f17c80c51a0 0x7f17c8159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 0x7f17c80c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c815ce50 con 0x7f17c80c51a0 2023-08-27T11:22:50.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80c0f60 con 0x7f17c81597b0 2023-08-27T11:22:50.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f17ce9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80c5620 con 0x7f17c80a76f0 2023-08-27T11:22:50.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.784+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc005960 con 0x7f02c4003a00 2023-08-27T11:22:50.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.784+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc005ac0 con 0x7f02c4003a00 2023-08-27T11:22:50.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.784+0000 7f02da7fc700 1 -- 172.21.15.43:0/1739630592 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc005e70 con 0x7f02c4003a00 2023-08-27T11:22:50.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f02e1dff700 1 -- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 msgr2=0x7f02c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.785+0000 7f02e1dff700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 0x7f02c4003e00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c370 tx=0x7f02c4005880 comp rx=0 tx=0).stop 2023-08-27T11:22:50.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.786+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0adc011c90 con 0x7f0ad4005280 2023-08-27T11:22:50.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.786+0000 7f02e1dff700 1 -- 172.21.15.43:0/1739630592 shutdown_connections 2023-08-27T11:22:50.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.786+0000 7f02e1dff700 1 --2- 172.21.15.43:0/1739630592 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02c4003a00 0x7f02c4003e00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.786+0000 7f02e1dff700 1 -- 172.21.15.43:0/1739630592 >> 172.21.15.43:0/1739630592 conn(0x7f02dc06a730 msgr2=0x7f02dc06ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.787+0000 7f02e1dff700 1 -- 172.21.15.43:0/1739630592 shutdown_connections 2023-08-27T11:22:50.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.787+0000 7f17c7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c80a76f0 0x7f17c80c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.787+0000 7f9d899ff700 1 Processor -- start 2023-08-27T11:22:50.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.788+0000 7f0ad9ffb700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0acc06a1b0 0x7f0acc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.788+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0adc088870 con 0x7f0ad4005280 2023-08-27T11:22:50.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.788+0000 7f0ad9ffb700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] conn(0x7f0acc072a70 0x7f0acc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.788+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0acc075540 con 0x7f0acc072a70 2023-08-27T11:22:50.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.788+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0adc088c20 con 0x7f0ad4005280 2023-08-27T11:22:50.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.789+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] conn(0x7f0acc072a70 0x7f0acc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.787+0000 7f9d899ff700 1 -- start start 2023-08-27T11:22:50.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.789+0000 7f9d899ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9d840a76f0 0x7f9d840c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.789+0000 7f9d899ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840c5650 con 0x7f9d84159980 2023-08-27T11:22:50.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.789+0000 7f9d899ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8415c1d0 con 0x7f9d840c51a0 2023-08-27T11:22:50.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.789+0000 7f9d899ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8415ce50 con 0x7f9d840a76f0 2023-08-27T11:22:50.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.787+0000 7f02e1dff700 1 -- 172.21.15.43:0/1739630592 wait complete. 2023-08-27T11:22:50.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f02e1dff700 1 Processor -- start 2023-08-27T11:22:50.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f0aedf9c700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] conn(0x7f0acc072a70 0x7f0acc074e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f9d837fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9d84159980 0x7f9d840c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44832/0 (socket says 172.21.15.43:44832) 2023-08-27T11:22:50.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f9d837fe700 1 -- 172.21.15.43:0/2483552571 learned_addr learned my addr 172.21.15.43:0/2483552571 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:50.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f02e1dff700 1 -- start start 2023-08-27T11:22:50.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.791+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272323188 0 0) 0x7f9d840c5650 con 0x7f9d84159980 2023-08-27T11:22:50.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.791+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d700035b0 con 0x7f9d84159980 2023-08-27T11:22:50.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.790+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0acc06a1b0 0x7f0acc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.791+0000 7f0aecf9a700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0acc06a1b0 0x7f0acc06c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ab230 tx=0x7f0ae4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.791+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== osd.2 v2:172.21.15.43:6816/513400440 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0acc075540 con 0x7f0acc072a70 2023-08-27T11:22:50.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.791+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932454098 0 0) 0x7f9d700035b0 con 0x7f9d84159980 2023-08-27T11:22:50.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 >> v2:172.21.15.57:3300/0 conn(0x7f9d840a76f0 msgr2=0x7f9d840c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d82ffd700 1 --2- 172.21.15.43:0/2483552571 >> v2:172.21.15.57:3300/0 conn(0x7f9d840a76f0 0x7f9d840c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 --2- 172.21.15.43:0/2483552571 >> v2:172.21.15.57:3300/0 conn(0x7f9d840a76f0 0x7f9d840c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 >> v1:172.21.15.57:6789/0 conn(0x7f9d840c51a0 legacy=0x7f9d84159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8415c4b0 con 0x7f9d84159980 2023-08-27T11:22:50.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f9d7c001670 con 0x7f9d84159980 2023-08-27T11:22:50.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 >> v1:172.21.15.43:6789/0 conn(0x7f9d84159980 legacy=0x7f9d840c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70003a50 0x7f9d70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d70005410 0x7f9d7000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8415ce50 con 0x7f9d70005410 2023-08-27T11:22:50.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c330 con 0x7f9d70003a50 2023-08-27T11:22:50.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7000c4f0 con 0x7f9d70004850 2023-08-27T11:22:50.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 0x7f02dc0bae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02dc0bb360 0x7f02dc155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02dc1f1720 0x7f02dc155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc1f1cc0 con 0x7f02c4003a00 2023-08-27T11:22:50.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d82ffd700 1 --2- 172.21.15.43:0/2483552571 >> v2:172.21.15.57:3300/0 conn(0x7f9d840a76f0 0x7f9d840c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:50.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc157c00 con 0x7f02dc1f1720 2023-08-27T11:22:50.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.792+0000 7f02e1dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0aaae0 con 0x7f02dc0bb360 2023-08-27T11:22:50.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d82ffd700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70003a50 0x7f9d70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f0a89bff700 1 Processor -- start 2023-08-27T11:22:50.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f17ccf9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 0x7f17c80c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f17ccf9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 0x7f17c80c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60768/0 (socket says 172.21.15.43:60768) 2023-08-27T11:22:50.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f17ccf9c700 1 -- 172.21.15.43:0/3602539759 learned_addr learned my addr 172.21.15.43:0/3602539759 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 -- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70003a50 msgr2=0x7f9d70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70003a50 0x7f9d70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 -- 172.21.15.43:0/2483552571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d70005410 msgr2=0x7f9d7000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d70005410 0x7f9d7000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 -- 172.21.15.43:0/2483552571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d700035b0 con 0x7f9d70004850 2023-08-27T11:22:50.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d837fe700 1 -- 172.21.15.43:0/2483552571 reap_dead start 2023-08-27T11:22:50.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c003eb0 tx=0x7f9d70005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2206b43f442cfd69 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 0x7f02dc0bae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 0x7f02dc0bae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40596/0 (socket says 172.21.15.43:40596) 2023-08-27T11:22:50.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02db7fe700 1 -- 172.21.15.43:0/3129497325 learned_addr learned my addr 172.21.15.43:0/3129497325 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02dbfff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02dc1f1720 0x7f02dc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02daffd700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02dc0bb360 0x7f02dc155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02db7fe700 1 -- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02dc0bb360 msgr2=0x7f02dc155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.793+0000 7f02db7fe700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02dc0bb360 0x7f02dc155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f02db7fe700 1 -- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02dc1f1720 msgr2=0x7f02dc155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f02db7fe700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02dc1f1720 0x7f02dc155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f02db7fe700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0aadc0 con 0x7f02c4003a00 2023-08-27T11:22:50.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c016070 con 0x7f9d70004850 2023-08-27T11:22:50.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c006860 con 0x7f9d70004850 2023-08-27T11:22:50.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f9d827fc700 1 -- 172.21.15.43:0/2483552571 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c006c10 con 0x7f9d70004850 2023-08-27T11:22:50.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f02db7fe700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 0x7f02dc0bae20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02cc000c00 tx=0x7f02cc001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/3602539759 >> v2:172.21.15.43:3300/0 conn(0x7f17c80c51a0 0x7f17c8159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc001bf0 con 0x7f02c4003a00 2023-08-27T11:22:50.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc001630 con 0x7f02c4003a00 2023-08-27T11:22:50.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc004a70 con 0x7f02c4003a00 2023-08-27T11:22:50.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f9d899ff700 1 -- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 msgr2=0x7f9d70004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f9d899ff700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c003eb0 tx=0x7f9d70005880 comp rx=0 tx=0).stop 2023-08-27T11:22:50.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 -- 172.21.15.43:0/3602539759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c80a76f0 msgr2=0x7f17c80c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/3602539759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c80a76f0 0x7f17c80c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 -- 172.21.15.43:0/3602539759 >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 msgr2=0x7f17c80c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/3602539759 >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 0x7f17c80c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f17bf7fe700 1 -- 172.21.15.43:0/3602539759 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c815c1d0 con 0x7f17c80c51a0 2023-08-27T11:22:50.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/3602539759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 0x7f17c8159270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f17c806db80 tx=0x7f17b8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b4a483946940c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f9d899ff700 1 -- 172.21.15.43:0/2483552571 shutdown_connections 2023-08-27T11:22:50.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f9d899ff700 1 --2- 172.21.15.43:0/2483552571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d70004850 0x7f9d70004cd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.795+0000 7f9d899ff700 1 -- 172.21.15.43:0/2483552571 >> 172.21.15.43:0/2483552571 conn(0x7f9d8406aa50 msgr2=0x7f9d840c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f9d899ff700 1 -- 172.21.15.43:0/2483552571 shutdown_connections 2023-08-27T11:22:50.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f17c77fe700 1 -- 172.21.15.43:0/3602539759 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011830 con 0x7f17c80c51a0 2023-08-27T11:22:50.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f17c77fe700 1 -- 172.21.15.43:0/3602539759 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8011990 con 0x7f17c80c51a0 2023-08-27T11:22:50.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f17c77fe700 1 -- 172.21.15.43:0/3602539759 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8011d20 con 0x7f17c80c51a0 2023-08-27T11:22:50.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f9d899ff700 1 -- 172.21.15.43:0/2483552571 wait complete. 2023-08-27T11:22:50.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.794+0000 7f0a89bff700 1 -- start start 2023-08-27T11:22:50.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a840a76f0 0x7f0a840c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a84159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a841597b0 0x7f0a840c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8415ce50 con 0x7f0a840a76f0 2023-08-27T11:22:50.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840c0f60 con 0x7f0a841597b0 2023-08-27T11:22:50.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.796+0000 7f0a89bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840c5620 con 0x7f0a840c51a0 2023-08-27T11:22:50.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a840a76f0 0x7f0a840c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a840a76f0 0x7f0a840c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40608/0 (socket says 172.21.15.43:40608) 2023-08-27T11:22:50.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 -- 172.21.15.43:0/1776433977 learned_addr learned my addr 172.21.15.43:0/1776433977 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a82ffd700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a84159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a83fff700 1 --2- 172.21.15.43:0/1776433977 >> v2:172.21.15.57:3300/0 conn(0x7f0a841597b0 0x7f0a840c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 -- 172.21.15.43:0/1776433977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 msgr2=0x7f0a84159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a84159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 -- 172.21.15.43:0/1776433977 >> v2:172.21.15.57:3300/0 conn(0x7f0a841597b0 msgr2=0x7f0a840c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 --2- 172.21.15.43:0/1776433977 >> v2:172.21.15.57:3300/0 conn(0x7f0a841597b0 0x7f0a840c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f0a837fe700 1 -- 172.21.15.43:0/1776433977 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8415c1d0 con 0x7f0a840a76f0 2023-08-27T11:22:50.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f17ce9ff700 1 -- 172.21.15.43:0/3602539759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 msgr2=0x7f17c8159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.797+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/3602539759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 0x7f17c8159270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f17c806db80 tx=0x7f17b8009b20 comp rx=0 tx=0).stop 2023-08-27T11:22:50.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f0a82ffd700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a84159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:50.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 -- 172.21.15.43:0/3602539759 shutdown_connections 2023-08-27T11:22:50.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/3602539759 >> v2:172.21.15.57:3300/0 conn(0x7f17c81597b0 0x7f17c80c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/3602539759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c80a76f0 0x7f17c80c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/3602539759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 0x7f17c8159270 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 -- 172.21.15.43:0/3602539759 >> 172.21.15.43:0/3602539759 conn(0x7f17c806aa50 msgr2=0x7f17c80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f0a837fe700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a840a76f0 0x7f0a840c4c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a8406db80 tx=0x7f0a74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d802c9e5e1650 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 -- 172.21.15.43:0/3602539759 shutdown_connections 2023-08-27T11:22:50.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f1a2f9ff700 1 Processor -- start 2023-08-27T11:22:50.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f9d899ff700 1 Processor -- start 2023-08-27T11:22:50.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f9d899ff700 1 -- start start 2023-08-27T11:22:50.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70004850 0x7f9d840bd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d84151360 0x7f9d84156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d840a9df0 0x7f9d841506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840ab100 con 0x7f9d840a9df0 2023-08-27T11:22:50.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840bf990 con 0x7f9d70004850 2023-08-27T11:22:50.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f1a2f9ff700 1 -- start start 2023-08-27T11:22:50.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f9d899ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840bf3d0 con 0x7f9d84151360 2023-08-27T11:22:50.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2f9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a280c4630 0x7f1a280c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2f9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2f9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280c82c0 con 0x7f1a28151b20 2023-08-27T11:22:50.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2f9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a28151f00 con 0x7f1a280c4630 2023-08-27T11:22:50.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2f9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2806c450 con 0x7f1a2806ad70 2023-08-27T11:22:50.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0ab0a0 con 0x7f02c4003a00 2023-08-27T11:22:50.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0a9cd0 con 0x7f02c4003a00 2023-08-27T11:22:50.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f0a827fc700 1 -- 172.21.15.43:0/1776433977 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011830 con 0x7f0a840a76f0 2023-08-27T11:22:50.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f0a827fc700 1 -- 172.21.15.43:0/1776433977 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74011990 con 0x7f0a840a76f0 2023-08-27T11:22:50.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.799+0000 7f0a827fc700 1 -- 172.21.15.43:0/1776433977 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011d20 con 0x7f0a840a76f0 2023-08-27T11:22:50.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f0a89bff700 1 -- 172.21.15.43:0/1776433977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a840a76f0 msgr2=0x7f0a840c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.800+0000 7f0a89bff700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a840a76f0 0x7f0a840c4c60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a8406db80 tx=0x7f0a74009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 -- 172.21.15.43:0/1776433977 shutdown_connections 2023-08-27T11:22:50.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 --2- 172.21.15.43:0/1776433977 >> v2:172.21.15.57:3300/0 conn(0x7f0a841597b0 0x7f0a840c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a840a76f0 0x7f0a840c4c60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 --2- 172.21.15.43:0/1776433977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a84159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 -- 172.21.15.43:0/1776433977 >> 172.21.15.43:0/1776433977 conn(0x7f0a8406aa50 msgr2=0x7f0a840c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f1a2cf9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a280c4630 0x7f1a280c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f0a89bff700 1 -- 172.21.15.43:0/1776433977 shutdown_connections 2023-08-27T11:22:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f9d82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70004850 0x7f9d840bd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f9d82ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70004850 0x7f9d840bd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60822/0 (socket says 172.21.15.43:60822) 2023-08-27T11:22:50.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f9d82ffd700 1 -- 172.21.15.43:0/664691041 learned_addr learned my addr 172.21.15.43:0/664691041 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f9d837fe700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d840a9df0 0x7f9d841506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02dc0c0a30 con 0x7f02c4003a00 2023-08-27T11:22:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48102/0 (socket says 172.21.15.43:48102) 2023-08-27T11:22:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 -- 172.21.15.43:0/1207191023 learned_addr learned my addr 172.21.15.43:0/1207191023 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d84151360 0x7f9d84156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f9d837fe700 1 -- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d84151360 msgr2=0x7f9d84156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f9d837fe700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d84151360 0x7f9d84156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f9d837fe700 1 -- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70004850 msgr2=0x7f9d840bd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f9d837fe700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d70004850 0x7f9d840bd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.803+0000 7f9d837fe700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840bf6b0 con 0x7f9d840a9df0 2023-08-27T11:22:50.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a1ffff700 1 -- 172.21.15.43:0/1207191023 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032876154 0 0) 0x7f1a280c82c0 con 0x7f1a28151b20 2023-08-27T11:22:50.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a1ffff700 1 -- 172.21.15.43:0/1207191023 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a140035b0 con 0x7f1a28151b20 2023-08-27T11:22:50.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 -- 172.21.15.43:0/1207191023 >> v2:172.21.15.57:3300/0 conn(0x7f1a280c4630 msgr2=0x7f1a280c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:50.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 --2- 172.21.15.43:0/1207191023 >> v2:172.21.15.57:3300/0 conn(0x7f1a280c4630 0x7f1a280c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 -- 172.21.15.43:0/1207191023 >> v1:172.21.15.57:6789/0 conn(0x7f1a28151b20 legacy=0x7f1a280c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.802+0000 7f1a2df9c700 1 -- 172.21.15.43:0/1207191023 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28154760 con 0x7f1a2806ad70 2023-08-27T11:22:50.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.803+0000 7f1a2df9c700 1 --2- 172.21.15.43:0/1207191023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e50 tx=0x7f1a2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3196d5ec85129207 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.803+0000 7f9d837fe700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d840a9df0 0x7f9d841506a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d84072b00 tx=0x7f9d7c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.798+0000 7f17ce9ff700 1 -- 172.21.15.43:0/3602539759 wait complete. 2023-08-27T11:22:50.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.801+0000 7f17ce9ff700 1 Processor -- start 2023-08-27T11:22:50.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.804+0000 7f1a1ffff700 1 -- 172.21.15.43:0/1207191023 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000e070 con 0x7f1a2806ad70 2023-08-27T11:22:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.804+0000 7f1a1ffff700 1 -- 172.21.15.43:0/1207191023 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a20003a20 con 0x7f1a2806ad70 2023-08-27T11:22:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.804+0000 7f1a1ffff700 1 -- 172.21.15.43:0/1207191023 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20003dd0 con 0x7f1a2806ad70 2023-08-27T11:22:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/1207191023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 msgr2=0x7f1a2806b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/1207191023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009e50 tx=0x7f1a2000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c004a70 con 0x7f9d840a9df0 2023-08-27T11:22:50.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c004bd0 con 0x7f9d840a9df0 2023-08-27T11:22:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c007070 con 0x7f9d840a9df0 2023-08-27T11:22:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/1207191023 shutdown_connections 2023-08-27T11:22:50.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/1207191023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a2806b1e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/1207191023 >> v2:172.21.15.57:3300/0 conn(0x7f1a280c4630 0x7f1a280c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/1207191023 >> 172.21.15.43:0/1207191023 conn(0x7f1a280ab820 msgr2=0x7f1a280abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.804+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f02cc004bd0 con 0x7f02c4003a00 2023-08-27T11:22:50.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.803+0000 7f0a89bff700 1 -- 172.21.15.43:0/1776433977 wait complete. 2023-08-27T11:22:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f0a89bff700 1 Processor -- start 2023-08-27T11:22:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f02c3fff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f02c806a130 0x7f02c806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02cc08a500 con 0x7f02c4003a00 2023-08-27T11:22:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f02c3fff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] conn(0x7f02c80729f0 0x7f02c8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f02c80754c0 con 0x7f02c80729f0 2023-08-27T11:22:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc08a870 con 0x7f02c4003a00 2023-08-27T11:22:50.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f02dbfff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] conn(0x7f02c80729f0 0x7f02c8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f02daffd700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f02c806a130 0x7f02c806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f02dbfff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] conn(0x7f02c80729f0 0x7f02c8074e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f0a89bff700 1 -- start start 2023-08-27T11:22:50.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a840a76f0 0x7f0a841588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a841574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 0x7f0a841579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840a9430 con 0x7f0a841597b0 2023-08-27T11:22:50.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84157f30 con 0x7f0a840a76f0 2023-08-27T11:22:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f0a89bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a84158e30 con 0x7f0a840c51a0 2023-08-27T11:22:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f17ce9ff700 1 -- start start 2023-08-27T11:22:50.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 0x7f17c80c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 0x7f17c8071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8070e60 0x7f17c8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8157830 con 0x7f17c80c51a0 2023-08-27T11:22:50.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c806f6b0 con 0x7f17c81597b0 2023-08-27T11:22:50.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.807+0000 7f17ce9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c806f990 con 0x7f17c8070e60 2023-08-27T11:22:50.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f17bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 0x7f17c8071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f17bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 0x7f17c8071870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60832/0 (socket says 172.21.15.43:60832) 2023-08-27T11:22:50.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f17bf7fe700 1 -- 172.21.15.43:0/113379391 learned_addr learned my addr 172.21.15.43:0/113379391 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.805+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d840aad20 con 0x7f9d840a9df0 2023-08-27T11:22:50.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840bb9e0 con 0x7f9d840a9df0 2023-08-27T11:22:50.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d8415c790 con 0x7f9d840a9df0 2023-08-27T11:22:50.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.806+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/1207191023 shutdown_connections 2023-08-27T11:22:50.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f02daffd700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f02c806a130 0x7f02c806c5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0aa8d0 tx=0x7f02d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f17ccf9c700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8070e60 0x7f17c8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f17bf7fe700 1 -- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8070e60 msgr2=0x7f17c8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.809+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8070e60 0x7f17c8071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.809+0000 7f17bf7fe700 1 -- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 msgr2=0x7f17c80c5a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-27T11:22:50.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.809+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c80c51a0 0x7f17c80c5a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.809+0000 7f17bf7fe700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80094a0 con 0x7f17c81597b0 2023-08-27T11:22:50.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.809+0000 7f17bf7fe700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 0x7f17c8071870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009fd0 tx=0x7f17b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.810+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== osd.3 v2:172.21.15.43:6819/1647660877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f02c80754c0 con 0x7f02c80729f0 2023-08-27T11:22:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.808+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/1207191023 wait complete. 2023-08-27T11:22:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f1a2f9ff700 1 Processor -- start 2023-08-27T11:22:50.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80036a0 con 0x7f17c81597b0 2023-08-27T11:22:50.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b801f070 con 0x7f17c81597b0 2023-08-27T11:22:50.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8003a80 con 0x7f17c81597b0 2023-08-27T11:22:50.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f0a83fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 0x7f0a841579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f0a83fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 0x7f0a841579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40624/0 (socket says 172.21.15.43:40624) 2023-08-27T11:22:50.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f0a83fff700 1 -- 172.21.15.43:0/2229256834 learned_addr learned my addr 172.21.15.43:0/2229256834 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a82ffd700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a841574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a837fe700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a840a76f0 0x7f0a841588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a83fff700 1 -- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 msgr2=0x7f0a841574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a83fff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a840c51a0 0x7f0a841574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a83fff700 1 -- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a840a76f0 msgr2=0x7f0a841588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a83fff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a840a76f0 0x7f0a841588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.812+0000 7f0a83fff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780094a0 con 0x7f0a841597b0 2023-08-27T11:22:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f0a83fff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 0x7f0a841579f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00efc0 tx=0x7f0a7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00cd40 con 0x7f0a841597b0 2023-08-27T11:22:50.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c00f040 con 0x7f0a841597b0 2023-08-27T11:22:50.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0146c0 con 0x7f0a841597b0 2023-08-27T11:22:50.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.811+0000 7f1a2f9ff700 1 -- start start 2023-08-27T11:22:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a28146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a28151b20 0x7f1a280c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a281f17c0 0x7f1a280c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280c2ab0 con 0x7f1a281f17c0 2023-08-27T11:22:50.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281ef1b0 con 0x7f1a28151b20 2023-08-27T11:22:50.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.813+0000 7f1a2f9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281ee630 con 0x7f1a2806ad70 2023-08-27T11:22:50.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f1a2d79b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a28146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f1a2d79b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a28146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48142/0 (socket says 172.21.15.43:48142) 2023-08-27T11:22:50.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.814+0000 7f1a2d79b700 1 -- 172.21.15.43:0/2763695412 learned_addr learned my addr 172.21.15.43:0/2763695412 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:50.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2df9c700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a281f17c0 0x7f1a280c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 -- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a28151b20 msgr2=0x7f1a280c2030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-27T11:22:50.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a28151b20 0x7f1a280c2030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 -- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a281f17c0 msgr2=0x7f1a280c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a281f17c0 0x7f1a280c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009b30 con 0x7f1a2806ad70 2023-08-27T11:22:50.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f1a2d79b700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a28146650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c450 tx=0x7f1a1800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180054e0 con 0x7f1a2806ad70 2023-08-27T11:22:50.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18003680 con 0x7f1a2806ad70 2023-08-27T11:22:50.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18003a30 con 0x7f1a2806ad70 2023-08-27T11:22:50.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.815+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d7c0071d0 con 0x7f9d840a9df0 2023-08-27T11:22:50.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a281ee910 con 0x7f1a2806ad70 2023-08-27T11:22:50.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a281eeed0 con 0x7f1a2806ad70 2023-08-27T11:22:50.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 --> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ae813e250 con 0x7f0acc072a70 2023-08-27T11:22:50.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f9d80ff9700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d6406a1e0 0x7f9d6406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d7c088090 con 0x7f9d840a9df0 2023-08-27T11:22:50.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f9d80ff9700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] conn(0x7f9d64072aa0 0x7f9d64074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d64075570 con 0x7f9d64072aa0 2023-08-27T11:22:50.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d7c088440 con 0x7f9d840a9df0 2023-08-27T11:22:50.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c806fc70 con 0x7f17c81597b0 2023-08-27T11:22:50.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c806ffe0 con 0x7f17c81597b0 2023-08-27T11:22:50.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f9d82ffd700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d6406a1e0 0x7f9d6406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a28154d20 con 0x7f1a2806ad70 2023-08-27T11:22:50.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.817+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f17c815c790 con 0x7f17c81597b0 2023-08-27T11:22:50.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74009550 con 0x7f0a841597b0 2023-08-27T11:22:50.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.816+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a840a8890 con 0x7f0a841597b0 2023-08-27T11:22:50.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.818+0000 7f0ad9ffb700 1 -- 172.21.15.43:0/3511971320 <== osd.2 v2:172.21.15.43:6816/513400440 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ae813e250 con 0x7f0acc072a70 2023-08-27T11:22:50.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.818+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] conn(0x7f9d64072aa0 0x7f9d64074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.818+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a8415c790 con 0x7f0a841597b0 2023-08-27T11:22:50.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] conn(0x7f0acc072a70 msgr2=0x7f0acc074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6816/513400440,v1:172.21.15.43:6817/513400440] conn(0x7f0acc072a70 0x7f0acc074e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f9d82ffd700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d6406a1e0 0x7f9d6406c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400d510 tx=0x7f9d74010040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 --> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f41f4005cb0 con 0x7f41f40015e0 2023-08-27T11:22:50.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0acc06a1b0 msgr2=0x7f0acc06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0acc06a1b0 0x7f0acc06c670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ab230 tx=0x7f0ae4008040 comp rx=0 tx=0).stop 2023-08-27T11:22:50.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 msgr2=0x7f0ae80bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 --2- 172.21.15.43:0/3511971320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0ad4005280 0x7f0ae80bf970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00b3c0 tx=0x7f0adc00b780 comp rx=0 tx=0).stop 2023-08-27T11:22:50.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f9d7a7fc700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] conn(0x7f9d64072aa0 0x7f9d64074ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aedf9c700 1 -- 172.21.15.43:0/3511971320 reap_dead start 2023-08-27T11:22:50.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 shutdown_connections 2023-08-27T11:22:50.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.819+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 >> 172.21.15.43:0/3511971320 conn(0x7f0ae80ab820 msgr2=0x7f0ae81653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.820+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 shutdown_connections 2023-08-27T11:22:50.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.820+0000 7f0aef9ff700 1 -- 172.21.15.43:0/3511971320 wait complete. 2023-08-27T11:22:50.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.820+0000 7f4214ff9700 1 -- 172.21.15.43:0/3799269842 <== osd.0 v2:172.21.15.43:6800/1854749393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f41f4005cb0 con 0x7f41f40015e0 2023-08-27T11:22:50.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.821+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== osd.6 v2:172.21.15.57:6802/2206759897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9d64075570 con 0x7f9d64072aa0 2023-08-27T11:22:50.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.822+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a18003b90 con 0x7f1a2806ad70 2023-08-27T11:22:50.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.822+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a7c014820 con 0x7f0a841597b0 2023-08-27T11:22:50.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.823+0000 7f0a6bfff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0a7006a1b0 0x7f0a7006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.823+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a7c089580 con 0x7f0a841597b0 2023-08-27T11:22:50.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f0a6bfff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] conn(0x7f0a70072a70 0x7f0a70074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a70075540 con 0x7f0a70072a70 2023-08-27T11:22:50.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a7c089930 con 0x7f0a841597b0 2023-08-27T11:22:50.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.822+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f17b8003be0 con 0x7f17c81597b0 2023-08-27T11:22:50.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.823+0000 7f17c57fa700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17a806a1b0 0x7f17a806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.823+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17b8021070 con 0x7f17c81597b0 2023-08-27T11:22:50.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f17c57fa700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] conn(0x7f17a8072a70 0x7f17a8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17a8075540 con 0x7f17a8072a70 2023-08-27T11:22:50.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17b808a730 con 0x7f17c81597b0 2023-08-27T11:22:50.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f1a1dffb700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a1e0 0x7f1a0c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a180883d0 con 0x7f1a2806ad70 2023-08-27T11:22:50.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f1a1dffb700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] conn(0x7f1a0c072aa0 0x7f1a0c074ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:50.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a0c075570 con 0x7f1a0c072aa0 2023-08-27T11:22:50.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a18088780 con 0x7f1a2806ad70 2023-08-27T11:22:50.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.825+0000 7f17c7fff700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17a806a1b0 0x7f17a806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.824+0000 7f0a837fe700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0a7006a1b0 0x7f0a7006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.825+0000 7f0a82ffd700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] conn(0x7f0a70072a70 0x7f0a70074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.825+0000 7f17ccf9c700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] conn(0x7f17a8072a70 0x7f17a8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.825+0000 7f1a2cf9a700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a1e0 0x7f1a0c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f0a82ffd700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] conn(0x7f0a70072a70 0x7f0a70074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f0a837fe700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0a7006a1b0 0x7f0a7006c670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a74014040 tx=0x7f0a74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f1a2df9c700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] conn(0x7f1a0c072aa0 0x7f1a0c074ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f17c7fff700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17a806a1b0 0x7f17a806c670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17c80c4840 tx=0x7f17b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f1a2cf9a700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a1e0 0x7f1a0c06c6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a28071a10 tx=0x7f1a24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.826+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] conn(0x7f41f40015e0 msgr2=0x7f41f4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6800/1854749393,v1:172.21.15.43:6801/1854749393] conn(0x7f41f40015e0 0x7f41f4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== osd.4 v2:172.21.15.57:6800/3346818821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0a70075540 con 0x7f0a70072a70 2023-08-27T11:22:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f420006a310 msgr2=0x7f420006c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f420006a310 0x7f420006c7d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f421815de40 tx=0x7f420c010000 comp rx=0 tx=0).stop 2023-08-27T11:22:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 msgr2=0x7f4218147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 --2- 172.21.15.43:0/3799269842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42180c4e40 0x7f4218147c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f420800b550 tx=0x7f420800b910 comp rx=0 tx=0).stop 2023-08-27T11:22:50.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421c99c700 1 -- 172.21.15.43:0/3799269842 reap_dead start 2023-08-27T11:22:50.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 shutdown_connections 2023-08-27T11:22:50.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 >> 172.21.15.43:0/3799269842 conn(0x7f421806a730 msgr2=0x7f42180bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f1a2df9c700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] conn(0x7f1a0c072aa0 0x7f1a0c074ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7f17ccf9c700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] conn(0x7f17a8072a70 0x7f17a8074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:50.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.827+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 --> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc8b4005cb0 con 0x7fc8b40015e0 2023-08-27T11:22:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.828+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 shutdown_connections 2023-08-27T11:22:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.828+0000 7f421e3ff700 1 -- 172.21.15.43:0/3799269842 wait complete. 2023-08-27T11:22:50.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.828+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== osd.7 v2:172.21.15.57:6824/1288318472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1a0c075570 con 0x7f1a0c072aa0 2023-08-27T11:22:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.829+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== osd.5 v2:172.21.15.57:6816/638765256 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f17a8075540 con 0x7f17a8072a70 2023-08-27T11:22:50.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.829+0000 7fc8c2ffd700 1 -- 172.21.15.43:0/138744380 <== osd.1 v2:172.21.15.43:6808/2369916833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc8b4005cb0 con 0x7fc8b40015e0 2023-08-27T11:22:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.830+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] conn(0x7fc8b40015e0 msgr2=0x7fc8b4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.830+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6808/2369916833,v1:172.21.15.43:6809/2369916833] conn(0x7fc8b40015e0 0x7fc8b4003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc8b806a2f0 msgr2=0x7fc8b806c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc8b806a2f0 0x7fc8b806c7b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009a10 tx=0x7fc8c8009190 comp rx=0 tx=0).stop 2023-08-27T11:22:50.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8cc0bad90 msgr2=0x7fc8cc0bf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 --2- 172.21.15.43:0/138744380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8cc0bad90 0x7fc8cc0bf4a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4015000 tx=0x7fc8c4004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d2d9c700 1 -- 172.21.15.43:0/138744380 reap_dead start 2023-08-27T11:22:50.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 shutdown_connections 2023-08-27T11:22:50.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.833+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 >> 172.21.15.43:0/138744380 conn(0x7fc8cc06aa50 msgr2=0x7fc8cc0c2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.958 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:50.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-27T11:22:50.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.841+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 shutdown_connections 2023-08-27T11:22:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.841+0000 7fc8d47ff700 1 -- 172.21.15.43:0/138744380 wait complete. 2023-08-27T11:22:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.848+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 --> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f02dc0c0750 con 0x7f02c80729f0 2023-08-27T11:22:50.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.850+0000 7f02c3fff700 1 -- 172.21.15.43:0/3129497325 <== osd.3 v2:172.21.15.43:6819/1647660877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f02d4004e00 con 0x7f02c80729f0 2023-08-27T11:22:50.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.850+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] conn(0x7f02c80729f0 msgr2=0x7f02c8074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.850+0000 7f02e1dff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6819/1647660877,v1:172.21.15.43:6821/1647660877] conn(0x7f02c80729f0 0x7f02c8074e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.851+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f02c806a130 msgr2=0x7f02c806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.851+0000 7f02e1dff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f02c806a130 0x7f02c806c5f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0aa8d0 tx=0x7f02d0008040 comp rx=0 tx=0).stop 2023-08-27T11:22:50.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.851+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 msgr2=0x7f02dc0bae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.851+0000 7f02e1dff700 1 --2- 172.21.15.43:0/3129497325 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02c4003a00 0x7f02dc0bae20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02cc000c00 tx=0x7f02cc001930 comp rx=0 tx=0).stop 2023-08-27T11:22:50.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.851+0000 7f02dbfff700 1 -- 172.21.15.43:0/3129497325 reap_dead start 2023-08-27T11:22:50.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.852+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 shutdown_connections 2023-08-27T11:22:50.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.852+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 >> 172.21.15.43:0/3129497325 conn(0x7f02dc06a730 msgr2=0x7f02dc15a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.853+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 shutdown_connections 2023-08-27T11:22:50.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.854+0000 7f02e1dff700 1 -- 172.21.15.43:0/3129497325 wait complete. 2023-08-27T11:22:50.964 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:50.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-27T11:22:50.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.857+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 --> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d84159db0 con 0x7f9d64072aa0 2023-08-27T11:22:50.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.858+0000 7f9d80ff9700 1 -- 172.21.15.43:0/664691041 <== osd.6 v2:172.21.15.57:6802/2206759897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d6c012700 con 0x7f9d64072aa0 2023-08-27T11:22:50.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] conn(0x7f9d64072aa0 msgr2=0x7f9d64074ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.57:6802/2206759897,v1:172.21.15.57:6804/2206759897] conn(0x7f9d64072aa0 0x7f9d64074ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d6406a1e0 msgr2=0x7f9d6406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d6406a1e0 0x7f9d6406c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400d510 tx=0x7f9d74010040 comp rx=0 tx=0).stop 2023-08-27T11:22:50.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d840a9df0 msgr2=0x7f9d841506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f9d899ff700 1 --2- 172.21.15.43:0/664691041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d840a9df0 0x7f9d841506a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d84072b00 tx=0x7f9d7c00c730 comp rx=0 tx=0).stop 2023-08-27T11:22:50.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.859+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 --> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a28154a40 con 0x7f1a0c072aa0 2023-08-27T11:22:50.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.860+0000 7f9d837fe700 1 -- 172.21.15.43:0/664691041 reap_dead start 2023-08-27T11:22:50.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.860+0000 7f1a1dffb700 1 -- 172.21.15.43:0/2763695412 <== osd.7 v2:172.21.15.57:6824/1288318472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a200094d0 con 0x7f1a0c072aa0 2023-08-27T11:22:50.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 shutdown_connections 2023-08-27T11:22:50.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 >> 172.21.15.43:0/664691041 conn(0x7f9d8406aa50 msgr2=0x7f9d840c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 shutdown_connections 2023-08-27T11:22:50.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f9d899ff700 1 -- 172.21.15.43:0/664691041 wait complete. 2023-08-27T11:22:50.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] conn(0x7f1a0c072aa0 msgr2=0x7f1a0c074ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:6824/1288318472,v1:172.21.15.57:6825/1288318472] conn(0x7f1a0c072aa0 0x7f1a0c074ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a1e0 msgr2=0x7f1a0c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a1e0 0x7f1a0c06c6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a28071a10 tx=0x7f1a24008040 comp rx=0 tx=0).stop 2023-08-27T11:22:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 msgr2=0x7f1a28146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 --2- 172.21.15.43:0/2763695412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a2806ad70 0x7f1a28146650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c450 tx=0x7f1a1800c810 comp rx=0 tx=0).stop 2023-08-27T11:22:50.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2df9c700 1 -- 172.21.15.43:0/2763695412 reap_dead start 2023-08-27T11:22:50.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.861+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 shutdown_connections 2023-08-27T11:22:50.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.862+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 >> 172.21.15.43:0/2763695412 conn(0x7f1a280ab820 msgr2=0x7f1a2806b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.862+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 shutdown_connections 2023-08-27T11:22:50.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.862+0000 7f1a2f9ff700 1 -- 172.21.15.43:0/2763695412 wait complete. 2023-08-27T11:22:50.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.862+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 --> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a8415c4b0 con 0x7f0a70072a70 2023-08-27T11:22:50.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.863+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 --> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f17c815c4b0 con 0x7f17a8072a70 2023-08-27T11:22:50.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.863+0000 7f0a6bfff700 1 -- 172.21.15.43:0/2229256834 <== osd.4 v2:172.21.15.57:6800/3346818821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a780098f0 con 0x7f0a70072a70 2023-08-27T11:22:50.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.863+0000 7f17c57fa700 1 -- 172.21.15.43:0/113379391 <== osd.5 v2:172.21.15.57:6816/638765256 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f17c0009840 con 0x7f17a8072a70 2023-08-27T11:22:50.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] conn(0x7f0a70072a70 msgr2=0x7f0a70074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.57:6800/3346818821,v1:172.21.15.57:6801/3346818821] conn(0x7f0a70072a70 0x7f0a70074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0a7006a1b0 msgr2=0x7f0a7006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0a7006a1b0 0x7f0a7006c670 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0a74014040 tx=0x7f0a74008030 comp rx=0 tx=0).stop 2023-08-27T11:22:50.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 msgr2=0x7f0a841579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 --2- 172.21.15.43:0/2229256834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a841597b0 0x7f0a841579f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00efc0 tx=0x7f0a7c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a83fff700 1 -- 172.21.15.43:0/2229256834 reap_dead start 2023-08-27T11:22:50.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 shutdown_connections 2023-08-27T11:22:50.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 >> 172.21.15.43:0/2229256834 conn(0x7f0a8406aa50 msgr2=0x7f0a840c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.864+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 shutdown_connections 2023-08-27T11:22:50.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.865+0000 7f0a89bff700 1 -- 172.21.15.43:0/2229256834 wait complete. 2023-08-27T11:22:50.978 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-08-27T11:22:50.978 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-27T11:22:50.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] conn(0x7f17a8072a70 msgr2=0x7f17a8074e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:6816/638765256,v1:172.21.15.57:6817/638765256] conn(0x7f17a8072a70 0x7f17a8074e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:50.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17a806a1b0 msgr2=0x7f17a806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17a806a1b0 0x7f17a806c670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17c80c4840 tx=0x7f17b0008040 comp rx=0 tx=0).stop 2023-08-27T11:22:50.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 msgr2=0x7f17c8071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:50.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ce9ff700 1 --2- 172.21.15.43:0/113379391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c81597b0 0x7f17c8071870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009fd0 tx=0x7f17b8004750 comp rx=0 tx=0).stop 2023-08-27T11:22:50.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.867+0000 7f17ccf9c700 1 -- 172.21.15.43:0/113379391 reap_dead start 2023-08-27T11:22:50.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.869+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 shutdown_connections 2023-08-27T11:22:50.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.869+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 >> 172.21.15.43:0/113379391 conn(0x7f17c806aa50 msgr2=0x7f17c80a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:50.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.869+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 shutdown_connections 2023-08-27T11:22:50.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:50.869+0000 7f17ce9ff700 1 -- 172.21.15.43:0/113379391 wait complete. 2023-08-27T11:22:50.982 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:50.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-27T11:22:50.983 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:50.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-27T11:22:50.985 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-08-27T11:22:50.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-27T11:22:50.986 INFO:teuthology.orchestra.run.smithi043.stdout:55834574853 2023-08-27T11:22:50.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-27T11:22:50.987 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:50.988 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-27T11:22:51.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.353+0000 7fb23d1ff700 1 Processor -- start 2023-08-27T11:22:51.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.353+0000 7fb23d1ff700 1 -- start start 2023-08-27T11:22:51.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.355+0000 7fb23d1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2380a76f0 0x7fb238154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.355+0000 7fb23d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380bae40 0x7fb2380bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.355+0000 7fb23d1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb238154bd0 con 0x7fb2380c0860 2023-08-27T11:22:51.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.355+0000 7fb23d1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb238151430 con 0x7fb2380a76f0 2023-08-27T11:22:51.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.355+0000 7fb23d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb238150820 con 0x7fb2380bae40 2023-08-27T11:22:51.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.356+0000 7fb236d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2380a76f0 0x7fb238154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2380a76f0 0x7fb238154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60848/0 (socket says 172.21.15.43:60848) 2023-08-27T11:22:51.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 -- 172.21.15.43:0/2905966428 learned_addr learned my addr 172.21.15.43:0/2905966428 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 -- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380bae40 msgr2=0x7fb2380bb2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-27T11:22:51.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 --2- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380bae40 0x7fb2380bb2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 -- 172.21.15.43:0/2905966428 >> v1:172.21.15.57:6789/0 conn(0x7fb2380c0860 legacy=0x7fb2380c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.357+0000 7fb236d9d700 1 -- 172.21.15.43:0/2905966428 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238150b00 con 0x7fb2380a76f0 2023-08-27T11:22:51.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.358+0000 7fb236d9d700 1 --2- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380a76f0 0x7fb238154690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bb90 tx=0x7fb22800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3773d7dd4ef37ab5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.359+0000 7fb235d9b700 1 -- 172.21.15.43:0/2905966428 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800dc00 con 0x7fb2380a76f0 2023-08-27T11:22:51.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.359+0000 7fb235d9b700 1 -- 172.21.15.43:0/2905966428 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800dd60 con 0x7fb2380a76f0 2023-08-27T11:22:51.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.359+0000 7fb235d9b700 1 -- 172.21.15.43:0/2905966428 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228004270 con 0x7fb2380a76f0 2023-08-27T11:22:51.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.360+0000 7fb23d1ff700 1 -- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380a76f0 msgr2=0x7fb238154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.360+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380a76f0 0x7fb238154690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bb90 tx=0x7fb22800bea0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 -- 172.21.15.43:0/2905966428 shutdown_connections 2023-08-27T11:22:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380bae40 0x7fb2380bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/2905966428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380a76f0 0x7fb238154690 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 -- 172.21.15.43:0/2905966428 >> 172.21.15.43:0/2905966428 conn(0x7fb23806a730 msgr2=0x7fb23806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 -- 172.21.15.43:0/2905966428 shutdown_connections 2023-08-27T11:22:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.361+0000 7fb23d1ff700 1 -- 172.21.15.43:0/2905966428 wait complete. 2023-08-27T11:22:51.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.366+0000 7fb23d1ff700 1 Processor -- start 2023-08-27T11:22:51.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.366+0000 7fb23d1ff700 1 -- start start 2023-08-27T11:22:51.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.367+0000 7fb23d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380a76f0 0x7fb238152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.367+0000 7fb23d1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.367+0000 7fb23d1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380c0860 0x7fb2381e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.367+0000 7fb23d1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380be1c0 con 0x7fb2380bae40 2023-08-27T11:22:51.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.368+0000 7fb23d1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2381e5260 con 0x7fb2380c0860 2023-08-27T11:22:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.368+0000 7fb23d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2380bd180 con 0x7fb2380a76f0 2023-08-27T11:22:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.368+0000 7fb23659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.368+0000 7fb23659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40644/0 (socket says 172.21.15.43:40644) 2023-08-27T11:22:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.368+0000 7fb23659c700 1 -- 172.21.15.43:0/58421596 learned_addr learned my addr 172.21.15.43:0/58421596 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb236d9d700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380a76f0 0x7fb238152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb23659c700 1 -- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380a76f0 msgr2=0x7fb238152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb23659c700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380a76f0 0x7fb238152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb23659c700 1 -- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380c0860 msgr2=0x7fb2381e5c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-27T11:22:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb23659c700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380c0860 0x7fb2381e5c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.369+0000 7fb23659c700 1 -- 172.21.15.43:0/58421596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22800b7f0 con 0x7fb2380bae40 2023-08-27T11:22:51.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.370+0000 7fb23659c700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb23000cc20 tx=0x7fb23000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.371+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23000ac20 con 0x7fb2380bae40 2023-08-27T11:22:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.371+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23000ad80 con 0x7fb2380bae40 2023-08-27T11:22:51.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.371+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230012660 con 0x7fb2380bae40 2023-08-27T11:22:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.371+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2380bd460 con 0x7fb2380bae40 2023-08-27T11:22:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.371+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380bda20 con 0x7fb2380bae40 2023-08-27T11:22:51.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.372+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2381e53f0 con 0x7fb2380bae40 2023-08-27T11:22:51.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.375+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2300127c0 con 0x7fb2380bae40 2023-08-27T11:22:51.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.376+0000 7fb21f7fe700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 0x7fb22406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.377+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb230088d10 con 0x7fb2380bae40 2023-08-27T11:22:51.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.378+0000 7fb236d9d700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 0x7fb22406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.379+0000 7fb236d9d700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 0x7fb22406c670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bee0 tx=0x7fb228014000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.379+0000 7fbfd8fff700 1 Processor -- start 2023-08-27T11:22:51.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.380+0000 7fbfd8fff700 1 -- start start 2023-08-27T11:22:51.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.382+0000 7fbfd8fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfd4156160 0x7fbfd40a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.382+0000 7fbfd8fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbfd40a79c0 0x7fbfd40c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.382+0000 7fbfd8fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40c0220 con 0x7fbfd40c50a0 2023-08-27T11:22:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.382+0000 7fbfd8fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40c5530 con 0x7fbfd40a79c0 2023-08-27T11:22:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.382+0000 7fbfd8fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40c0da0 con 0x7fbfd4156160 2023-08-27T11:22:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbfd40a79c0 0x7fbfd40c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbfd40a79c0 0x7fbfd40c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40650/0 (socket says 172.21.15.43:40650) 2023-08-27T11:22:51.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2264705187 learned_addr learned my addr 172.21.15.43:0/2264705187 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd259c700 1 --2- 172.21.15.43:0/2264705187 >> v2:172.21.15.57:3300/0 conn(0x7fbfd4156160 0x7fbfd40a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2264705187 >> v2:172.21.15.57:3300/0 conn(0x7fbfd4156160 msgr2=0x7fbfd40a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 --2- 172.21.15.43:0/2264705187 >> v2:172.21.15.57:3300/0 conn(0x7fbfd4156160 0x7fbfd40a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2264705187 >> v1:172.21.15.57:6789/0 conn(0x7fbfd40c50a0 legacy=0x7fbfd415c140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:51.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2264705187 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40c0470 con 0x7fbfd40a79c0 2023-08-27T11:22:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.384+0000 7fbfd1d9b700 1 --2- 172.21.15.43:0/2264705187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd40a79c0 0x7fbfd40c4b60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfd406d7a0 tx=0x7fbfc8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80e09bba30d7274 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7f1c365ff700 1 Processor -- start 2023-08-27T11:22:51.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.383+0000 7f1c365ff700 1 -- start start 2023-08-27T11:22:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7f1c365ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1c300c4b60 0x7f1c300c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7f1c365ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300c0220 con 0x7f1c30156160 2023-08-27T11:22:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7f1c365ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300c0da0 con 0x7f1c3015c140 2023-08-27T11:22:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7f1c365ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300c5530 con 0x7f1c300c4b60 2023-08-27T11:22:51.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7f1c34b9c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c3015c140 0x7f1c3015c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:38966/0 (socket says 172.21.15.43:38966) 2023-08-27T11:22:51.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7f1c34b9c700 1 -- 172.21.15.43:0/1538912193 learned_addr learned my addr 172.21.15.43:0/1538912193 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:51.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb230054470 con 0x7fb2380bae40 2023-08-27T11:22:51.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440146213 0 0) 0x7f1c300c0da0 con 0x7f1c3015c140 2023-08-27T11:22:51.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c180035b0 con 0x7f1c3015c140 2023-08-27T11:22:51.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7fbfd159a700 1 -- 172.21.15.43:0/2264705187 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8004230 con 0x7fbfd40a79c0 2023-08-27T11:22:51.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7fbfd159a700 1 -- 172.21.15.43:0/2264705187 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8004390 con 0x7fbfd40a79c0 2023-08-27T11:22:51.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.386+0000 7fbfd159a700 1 -- 172.21.15.43:0/2264705187 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80036a0 con 0x7fbfd40a79c0 2023-08-27T11:22:51.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2264705187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd40a79c0 msgr2=0x7fbfd40c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.387+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2264705187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd40a79c0 0x7fbfd40c4b60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbfd406d7a0 tx=0x7fbfc8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2264705187 shutdown_connections 2023-08-27T11:22:51.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2264705187 >> v2:172.21.15.57:3300/0 conn(0x7fbfd4156160 0x7fbfd40a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2264705187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd40a79c0 0x7fbfd40c4b60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2264705187 >> 172.21.15.43:0/2264705187 conn(0x7fbfd406a730 msgr2=0x7fbfd406ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.1 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956884414 0 0) 0x7f1c180035b0 con 0x7f1c3015c140 2023-08-27T11:22:51.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 >> v2:172.21.15.43:3300/0 conn(0x7f1c300c4b60 msgr2=0x7f1c300c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 --2- 172.21.15.43:0/1538912193 >> v2:172.21.15.43:3300/0 conn(0x7f1c300c4b60 0x7f1c300c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 >> v1:172.21.15.43:6789/0 conn(0x7f1c30156160 legacy=0x7f1c300a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300c0470 con 0x7f1c3015c140 2023-08-27T11:22:51.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.1 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f1c280019f0 con 0x7f1c3015c140 2023-08-27T11:22:51.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 >> v1:172.21.15.57:6789/0 conn(0x7f1c3015c140 legacy=0x7f1c3015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c18005410 0x7f1c1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c5530 con 0x7f1c18005410 2023-08-27T11:22:51.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800c2b0 con 0x7f1c18004850 2023-08-27T11:22:51.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.388+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1800c470 con 0x7f1c18003a00 2023-08-27T11:22:51.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2264705187 shutdown_connections 2023-08-27T11:22:51.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c34b9c700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c18005410 0x7f1c1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2264705187 wait complete. 2023-08-27T11:22:51.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7fde5d5ff700 1 Processor -- start 2023-08-27T11:22:51.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c18004850 msgr2=0x7f1c18004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1538912193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c18005410 msgr2=0x7f1c1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c18005410 0x7f1c1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.389+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1538912193 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300c0470 con 0x7f1c18003a00 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7f1c34b9c700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c18005410 0x7f1c1800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7f1c34b9c700 1 -- 172.21.15.43:0/1538912193 reap_dead start 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c18004850 0x7f1c18004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c18003e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c20003eb0 tx=0x7f1c18005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2db8d1a8ceba97 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.391+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20016070 con 0x7f1c18003a00 2023-08-27T11:22:51.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.391+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20006860 con 0x7f1c18003a00 2023-08-27T11:22:51.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.391+0000 7f1c2effd700 1 -- 172.21.15.43:0/1538912193 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20003950 con 0x7f1c18003a00 2023-08-27T11:22:51.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.391+0000 7fee06fff700 1 Processor -- start 2023-08-27T11:22:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 -- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 msgr2=0x7f1c18003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c18003e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c20003eb0 tx=0x7f1c18005880 comp rx=0 tx=0).stop 2023-08-27T11:22:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 -- 172.21.15.43:0/1538912193 shutdown_connections 2023-08-27T11:22:51.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1538912193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c18003e00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 -- 172.21.15.43:0/1538912193 >> 172.21.15.43:0/1538912193 conn(0x7f1c3006a730 msgr2=0x7f1c3006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fbfd8fff700 1 Processor -- start 2023-08-27T11:22:51.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fbfd8fff700 1 -- start start 2023-08-27T11:22:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fee06fff700 1 -- start start 2023-08-27T11:22:51.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7f1c365ff700 1 -- 172.21.15.43:0/1538912193 shutdown_connections 2023-08-27T11:22:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.390+0000 7fde5d5ff700 1 -- start start 2023-08-27T11:22:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fde5d5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 0x7fde58154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fde5d5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde580bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fde5d5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde58154bd0 con 0x7fde580a76f0 2023-08-27T11:22:51.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fde5d5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde58151430 con 0x7fde580c0860 2023-08-27T11:22:51.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.392+0000 7fde5d5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde58150820 con 0x7fde580bae40 2023-08-27T11:22:51.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.393+0000 7fde56ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fde580a76f0 0x7fde580c4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:38982/0 (socket says 172.21.15.43:38982) 2023-08-27T11:22:51.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.393+0000 7fde56ffd700 1 -- 172.21.15.43:0/882757096 learned_addr learned my addr 172.21.15.43:0/882757096 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:51.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfd40a79c0 0x7fbfd4144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd4156160 0x7fbfd40a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4155cc0 con 0x7fbfd4156160 2023-08-27T11:22:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415ab20 con 0x7fbfd40a79c0 2023-08-27T11:22:51.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd8fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415ae00 con 0x7fbfd40c50a0 2023-08-27T11:22:51.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fde577fe700 1 --2- 172.21.15.43:0/882757096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde580bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.393+0000 7f1c365ff700 1 -- 172.21.15.43:0/1538912193 wait complete. 2023-08-27T11:22:51.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fbfd259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfd40a79c0 0x7fbfd4144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fde567fc700 1 --2- 172.21.15.43:0/882757096 >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 0x7fde58154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7f944899d700 1 Processor -- start 2023-08-27T11:22:51.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee06fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 0x7fee00154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee06fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 0x7fee000c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee06fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee00154bd0 con 0x7fee000c0860 2023-08-27T11:22:51.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee06fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee00151430 con 0x7fee000c2320 2023-08-27T11:22:51.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee06fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00150b00 con 0x7fee000c4e40 2023-08-27T11:22:51.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.394+0000 7fee04d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 0x7fee00154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fee04d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 0x7fee00154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60888/0 (socket says 172.21.15.43:60888) 2023-08-27T11:22:51.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fee04d9b700 1 -- 172.21.15.43:0/4032422951 learned_addr learned my addr 172.21.15.43:0/4032422951 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7f944899d700 1 -- start start 2023-08-27T11:22:51.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fee0559c700 1 --2- 172.21.15.43:0/4032422951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 0x7fee000c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fde577fe700 1 -- 172.21.15.43:0/882757096 >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 msgr2=0x7fde58154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fde577fe700 1 --2- 172.21.15.43:0/882757096 >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 0x7fde58154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fde577fe700 1 -- 172.21.15.43:0/882757096 >> v1:172.21.15.57:6789/0 conn(0x7fde580a76f0 legacy=0x7fde580c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fde577fe700 1 -- 172.21.15.43:0/882757096 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58150b00 con 0x7fde580bae40 2023-08-27T11:22:51.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7f1c365ff700 1 Processor -- start 2023-08-27T11:22:51.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fee0559c700 1 -- 172.21.15.43:0/4032422951 >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 msgr2=0x7fee00154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fee0559c700 1 --2- 172.21.15.43:0/4032422951 >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 0x7fee00154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fee0559c700 1 -- 172.21.15.43:0/4032422951 >> v1:172.21.15.57:6789/0 conn(0x7fee000c0860 legacy=0x7fee000a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fee0559c700 1 -- 172.21.15.43:0/4032422951 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00150de0 con 0x7fee000c4e40 2023-08-27T11:22:51.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7f1c365ff700 1 -- start start 2023-08-27T11:22:51.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7fee0559c700 1 --2- 172.21.15.43:0/4032422951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 0x7fee000c52b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009d90 tx=0x7fedf800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb9cb6b5ecd83d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fbfd1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48176/0 (socket says 172.21.15.43:48176) 2023-08-27T11:22:51.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2026891180 learned_addr learned my addr 172.21.15.43:0/2026891180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.395+0000 7fbfd2d9d700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd4156160 0x7fbfd40a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfd40a79c0 msgr2=0x7fbfd4144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfd40a79c0 0x7fbfd4144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd4156160 msgr2=0x7fbfd40a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd4156160 0x7fbfd40a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 -- 172.21.15.43:0/2026891180 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8009550 con 0x7fbfd40c50a0 2023-08-27T11:22:51.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.396+0000 7fbfd1d9b700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbfd406d970 tx=0x7fbfc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7fedff7fe700 1 -- 172.21.15.43:0/4032422951 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800e070 con 0x7fee000c4e40 2023-08-27T11:22:51.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7fedff7fe700 1 -- 172.21.15.43:0/4032422951 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800bae0 con 0x7fee000c4e40 2023-08-27T11:22:51.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7fedff7fe700 1 -- 172.21.15.43:0/4032422951 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800be90 con 0x7fee000c4e40 2023-08-27T11:22:51.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7fde567fc700 1 --2- 172.21.15.43:0/882757096 >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 0x7fde58154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:51.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 0x7f1c301e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 0x7f1c301f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c301e3c40 con 0x7f1c3014ff00 2023-08-27T11:22:51.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300ab810 con 0x7f1c301e2200 2023-08-27T11:22:51.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.397+0000 7f1c365ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300a72d0 con 0x7f1c18003a00 2023-08-27T11:22:51.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9444151aa0 0x7f94440c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94440bf610 0x7f9444154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94440c0100 0x7f9444154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9444155310 con 0x7f94440bf610 2023-08-27T11:22:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94440bfa80 con 0x7f9444151aa0 2023-08-27T11:22:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f944899d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94441543e0 con 0x7f94440c0100 2023-08-27T11:22:51.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c2ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c2ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48184/0 (socket says 172.21.15.43:48184) 2023-08-27T11:22:51.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1955111027 learned_addr learned my addr 172.21.15.43:0/1955111027 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 -- 172.21.15.43:0/4032422951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 msgr2=0x7fee000c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 --2- 172.21.15.43:0/4032422951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 0x7fee000c52b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009d90 tx=0x7fedf800b330 comp rx=0 tx=0).stop 2023-08-27T11:22:51.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 msgr2=0x7f1c301f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c34b9c700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 0x7f1c301f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 0x7f1c301e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 -- 172.21.15.43:0/4032422951 shutdown_connections 2023-08-27T11:22:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 --2- 172.21.15.43:0/4032422951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c4e40 0x7fee000c52b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 --2- 172.21.15.43:0/4032422951 >> v2:172.21.15.57:3300/0 conn(0x7fee000c2320 0x7fee00154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7fee06fff700 1 -- 172.21.15.43:0/4032422951 >> 172.21.15.43:0/4032422951 conn(0x7fee0006a730 msgr2=0x7fee0006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f9442ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94440bf610 0x7f9444154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f9442ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f94440bf610 0x7f9444154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40706/0 (socket says 172.21.15.43:40706) 2023-08-27T11:22:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.398+0000 7f9442ffd700 1 -- 172.21.15.43:0/793567510 learned_addr learned my addr 172.21.15.43:0/793567510 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fde577fe700 1 --2- 172.21.15.43:0/882757096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde580bb2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fde4c008840 tx=0x7fde4c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5fc6eb3c7a0e3e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 0x7f1c301f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 msgr2=0x7f1c301e1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 0x7f1c301e1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2ffff700 1 -- 172.21.15.43:0/1955111027 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c301e4090 con 0x7f1c18003a00 2023-08-27T11:22:51.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f94437fe700 1 --2- 172.21.15.43:0/793567510 >> v2:172.21.15.57:3300/0 conn(0x7f9444151aa0 0x7f94440c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fee06fff700 1 -- 172.21.15.43:0/4032422951 shutdown_connections 2023-08-27T11:22:51.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 0x7f1c301e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:51.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c34b9c700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 0x7f1c301f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:51.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fee06fff700 1 -- 172.21.15.43:0/4032422951 wait complete. 2023-08-27T11:22:51.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f9442ffd700 1 -- 172.21.15.43:0/793567510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94440c0100 msgr2=0x7f9444154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f9442ffd700 1 --2- 172.21.15.43:0/793567510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94440c0100 0x7f9444154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f9442ffd700 1 -- 172.21.15.43:0/793567510 >> v2:172.21.15.57:3300/0 conn(0x7f9444151aa0 msgr2=0x7f94440c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f9442ffd700 1 --2- 172.21.15.43:0/793567510 >> v2:172.21.15.57:3300/0 conn(0x7f9444151aa0 0x7f94440c2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f9442ffd700 1 -- 172.21.15.43:0/793567510 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944406d090 con 0x7f94440bf610 2023-08-27T11:22:51.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003e20 con 0x7fbfd40c50a0 2023-08-27T11:22:51.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8011630 con 0x7fbfd40c50a0 2023-08-27T11:22:51.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80119e0 con 0x7fbfd40c50a0 2023-08-27T11:22:51.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.399+0000 7f1c2ffff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c600 tx=0x7f1c20003780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7f9442ffd700 1 --2- 172.21.15.43:0/793567510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440bf610 0x7f9444154890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f944406ae40 tx=0x7f9434009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6c7296fffdcb13 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20016040 con 0x7f1c18003a00 2023-08-27T11:22:51.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c20007510 con 0x7f1c18003a00 2023-08-27T11:22:51.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c200078c0 con 0x7f1c18003a00 2023-08-27T11:22:51.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40a5d70 con 0x7fbfd40c50a0 2023-08-27T11:22:51.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40a96c0 con 0x7fbfd40c50a0 2023-08-27T11:22:51.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.401+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40a6290 con 0x7fbfd40c50a0 2023-08-27T11:22:51.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7fee06fff700 1 Processor -- start 2023-08-27T11:22:51.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.400+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c301e3710 con 0x7f1c18003a00 2023-08-27T11:22:51.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.401+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c300ab530 con 0x7f1c18003a00 2023-08-27T11:22:51.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7fde55ffb700 1 -- 172.21.15.43:0/882757096 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c010070 con 0x7fde580bae40 2023-08-27T11:22:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7fde55ffb700 1 -- 172.21.15.43:0/882757096 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c004030 con 0x7fde580bae40 2023-08-27T11:22:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7fde55ffb700 1 -- 172.21.15.43:0/882757096 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0043c0 con 0x7fde580bae40 2023-08-27T11:22:51.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7f8eaf1ff700 1 Processor -- start 2023-08-27T11:22:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7f94427fc700 1 -- 172.21.15.43:0/793567510 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400b870 con 0x7f94440bf610 2023-08-27T11:22:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7f94427fc700 1 -- 172.21.15.43:0/793567510 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400b9d0 con 0x7f94440bf610 2023-08-27T11:22:51.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7f94427fc700 1 -- 172.21.15.43:0/793567510 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400bd40 con 0x7f94440bf610 2023-08-27T11:22:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.402+0000 7f8eaf1ff700 1 -- start start 2023-08-27T11:22:51.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fee06fff700 1 -- start start 2023-08-27T11:22:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 -- 172.21.15.43:0/882757096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 msgr2=0x7fde580bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/882757096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde580bb2b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fde4c008840 tx=0x7fde4c00d330 comp rx=0 tx=0).stop 2023-08-27T11:22:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 -- 172.21.15.43:0/882757096 shutdown_connections 2023-08-27T11:22:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/882757096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde580bb2b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/882757096 >> v2:172.21.15.43:3300/0 conn(0x7fde580c0860 0x7fde58154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7fde5d5ff700 1 -- 172.21.15.43:0/882757096 >> 172.21.15.43:0/882757096 conn(0x7fde5806a730 msgr2=0x7fde5806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7f944899d700 1 -- 172.21.15.43:0/793567510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440bf610 msgr2=0x7f9444154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.403+0000 7f944899d700 1 --2- 172.21.15.43:0/793567510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440bf610 0x7f9444154890 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f944406ae40 tx=0x7f9434009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f944899d700 1 -- 172.21.15.43:0/793567510 shutdown_connections 2023-08-27T11:22:51.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f944899d700 1 --2- 172.21.15.43:0/793567510 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94440c0100 0x7f9444154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f944899d700 1 --2- 172.21.15.43:0/793567510 >> v2:172.21.15.57:3300/0 conn(0x7f9444151aa0 0x7f94440c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f944899d700 1 --2- 172.21.15.43:0/793567510 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440bf610 0x7f9444154890 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f944899d700 1 -- 172.21.15.43:0/793567510 >> 172.21.15.43:0/793567510 conn(0x7f9444066610 msgr2=0x7f944406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee000c2320 0x7fee000a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee000c4e40 0x7fee00142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0013e060 con 0x7fee000c2320 2023-08-27T11:22:51.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0013e590 con 0x7fee000c4e40 2023-08-27T11:22:51.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7fee06fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000ab230 con 0x7fee000c0860 2023-08-27T11:22:51.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c100052f0 con 0x7f1c18003a00 2023-08-27T11:22:51.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f8eaf1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ea80c2320 0x7f8ea8154690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f8eaf1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8ea80c0860 0x7f8ea80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f8eaf1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea8154bd0 con 0x7f8ea80a79c0 2023-08-27T11:22:51.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f8eaf1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8151430 con 0x7f8ea80c2320 2023-08-27T11:22:51.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.404+0000 7f8eaf1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea8150b00 con 0x7f8ea80c0860 2023-08-27T11:22:51.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7f944899d700 1 -- 172.21.15.43:0/793567510 shutdown_connections 2023-08-27T11:22:51.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7fde5d5ff700 1 -- 172.21.15.43:0/882757096 shutdown_connections 2023-08-27T11:22:51.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7fee04d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48202/0 (socket says 172.21.15.43:48202) 2023-08-27T11:22:51.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 -- 172.21.15.43:0/3876944877 learned_addr learned my addr 172.21.15.43:0/3876944877 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 -- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee000c4e40 msgr2=0x7fee00142310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-27T11:22:51.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee000c4e40 0x7fee00142310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 -- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee000c2320 msgr2=0x7fee000a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee000c2320 0x7fee000a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fee04d9b700 1 -- 172.21.15.43:0/3876944877 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8009a70 con 0x7fee000c0860 2023-08-27T11:22:51.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.407+0000 7fee04d9b700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedf000e910 tx=0x7fedf000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7fde5d5ff700 1 -- 172.21.15.43:0/882757096 wait complete. 2023-08-27T11:22:51.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7f944899d700 1 -- 172.21.15.43:0/793567510 wait complete. 2023-08-27T11:22:51.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7f944899d700 1 Processor -- start 2023-08-27T11:22:51.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7f8eacf9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ea80c2320 0x7f8ea8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7f8eacf9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ea80c2320 0x7f8ea8154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40710/0 (socket says 172.21.15.43:40710) 2023-08-27T11:22:51.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.405+0000 7f8eacf9b700 1 -- 172.21.15.43:0/431820300 learned_addr learned my addr 172.21.15.43:0/431820300 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7f8eacf9b700 1 -- 172.21.15.43:0/431820300 >> v2:172.21.15.57:3300/0 conn(0x7f8ea80c0860 msgr2=0x7f8ea80a7480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:51.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7f8eacf9b700 1 --2- 172.21.15.43:0/431820300 >> v2:172.21.15.57:3300/0 conn(0x7f8ea80c0860 0x7f8ea80a7480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7f8eacf9b700 1 -- 172.21.15.43:0/431820300 >> v1:172.21.15.57:6789/0 conn(0x7f8ea80a79c0 legacy=0x7f8ea80c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7f8eacf9b700 1 -- 172.21.15.43:0/431820300 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea8150de0 con 0x7f8ea80c2320 2023-08-27T11:22:51.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.407+0000 7f8eacf9b700 1 --2- 172.21.15.43:0/431820300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c2320 0x7f8ea8154690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ea806d850 tx=0x7f8e9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b366752b4d46e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7fde5d5ff700 1 Processor -- start 2023-08-27T11:22:51.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.406+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfc8022070 con 0x7fbfd40c50a0 2023-08-27T11:22:51.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7fbfc2ffd700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 0x7fbfb406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc8089f00 con 0x7fbfd40c50a0 2023-08-27T11:22:51.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.409+0000 7fbfd259c700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 0x7fbfb406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.409+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000c850 con 0x7fee000c0860 2023-08-27T11:22:51.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.409+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf000c9b0 con 0x7fee000c0860 2023-08-27T11:22:51.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.409+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000cd20 con 0x7fee000c0860 2023-08-27T11:22:51.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.409+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0013e2b0 con 0x7fee000c0860 2023-08-27T11:22:51.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee000ab7b0 con 0x7fee000c0860 2023-08-27T11:22:51.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7f944899d700 1 -- start start 2023-08-27T11:22:51.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 0x7f94440bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 0x7f944414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440bcd30 con 0x7f94440c0100 2023-08-27T11:22:51.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440be6e0 con 0x7f94440bf610 2023-08-27T11:22:51.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7f944899d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9444072730 con 0x7f9444151aa0 2023-08-27T11:22:51.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00052f0 con 0x7fee000c0860 2023-08-27T11:22:51.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.408+0000 7fde5d5ff700 1 -- start start 2023-08-27T11:22:51.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde580a76f0 0x7fde581f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde580c0860 0x7fde580bf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde58071830 con 0x7fde580a76f0 2023-08-27T11:22:51.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5814fe60 con 0x7fde580c0860 2023-08-27T11:22:51.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.410+0000 7fde5d5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580ab6c0 con 0x7fde580bae40 2023-08-27T11:22:51.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7fde567fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7fde577fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde580c0860 0x7fde580bf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f8ea77fe700 1 -- 172.21.15.43:0/431820300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00b870 con 0x7f8ea80c2320 2023-08-27T11:22:51.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f8ea77fe700 1 -- 172.21.15.43:0/431820300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c00b9d0 con 0x7f8ea80c2320 2023-08-27T11:22:51.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f8ea77fe700 1 -- 172.21.15.43:0/431820300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00bd60 con 0x7f8ea80c2320 2023-08-27T11:22:51.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c2002e440 con 0x7f1c18003a00 2023-08-27T11:22:51.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f94437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f9443fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 0x7f944414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f94437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60924/0 (socket says 172.21.15.43:60924) 2023-08-27T11:22:51.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7f94437fe700 1 -- 172.21.15.43:0/3981748548 learned_addr learned my addr 172.21.15.43:0/3981748548 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f9442ffd700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 0x7f94440bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbfc8055660 con 0x7fbfd40c50a0 2023-08-27T11:22:51.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fbfd259c700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 0x7fbfb406c670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfd41642a0 tx=0x7fbfcc007710 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7fde567fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48224/0 (socket says 172.21.15.43:48224) 2023-08-27T11:22:51.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.411+0000 7fde567fc700 1 -- 172.21.15.43:0/782880989 learned_addr learned my addr 172.21.15.43:0/782880989 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde56ffd700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde580a76f0 0x7fde581f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 -- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde580c0860 msgr2=0x7fde580bf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f94437fe700 1 -- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 msgr2=0x7f944414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f94437fe700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 0x7f944414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f94437fe700 1 -- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 msgr2=0x7f94440bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f94437fe700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 0x7f94440bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f94437fe700 1 -- 172.21.15.43:0/3981748548 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009550 con 0x7f94440bf610 2023-08-27T11:22:51.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f9443fff700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 0x7f944414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:22:51.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f9442ffd700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 0x7f94440bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:51.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde580c0860 0x7fde580bf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 -- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde580a76f0 msgr2=0x7fde581f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde580a76f0 0x7fde581f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 -- 172.21.15.43:0/782880989 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c008520 con 0x7fde580bae40 2023-08-27T11:22:51.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7fde567fc700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e810 tx=0x7fde4800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f94437fe700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f943800c820 tx=0x7f943800cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/431820300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c2320 msgr2=0x7f8ea8154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.412+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/431820300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c2320 0x7f8ea8154690 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ea806d850 tx=0x7f8e9c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/431820300 shutdown_connections 2023-08-27T11:22:51.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/431820300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c2320 0x7f8ea8154690 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/431820300 >> v2:172.21.15.57:3300/0 conn(0x7f8ea80c0860 0x7f8ea80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/431820300 >> 172.21.15.43:0/431820300 conn(0x7f8ea806a730 msgr2=0x7f8ea806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011800 con 0x7f94440bf610 2023-08-27T11:22:51.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438011960 con 0x7f94440bf610 2023-08-27T11:22:51.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438011cf0 con 0x7f94440bf610 2023-08-27T11:22:51.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f1c2cff9700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 0x7f1c1c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.413+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c20089540 con 0x7f1c18003a00 2023-08-27T11:22:51.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.414+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 0x7f1c1c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.414+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/431820300 shutdown_connections 2023-08-27T11:22:51.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.414+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/431820300 wait complete. 2023-08-27T11:22:51.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.415+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9444071e90 con 0x7f94440bf610 2023-08-27T11:22:51.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.415+0000 7f1c2f7fe700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 0x7f1c1c06c5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c30072af0 tx=0x7f1c24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.415+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9444072450 con 0x7f94440bf610 2023-08-27T11:22:51.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.415+0000 7f9cd33ff700 1 Processor -- start 2023-08-27T11:22:51.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.416+0000 7f9cd33ff700 1 -- start start 2023-08-27T11:22:51.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.416+0000 7f8eaf1ff700 1 Processor -- start 2023-08-27T11:22:51.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.416+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48013610 con 0x7fde580bae40 2023-08-27T11:22:51.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.416+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94440679e0 con 0x7f94440bf610 2023-08-27T11:22:51.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.417+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48013770 con 0x7fde580bae40 2023-08-27T11:22:51.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.417+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48013b00 con 0x7fde580bae40 2023-08-27T11:22:51.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.417+0000 7f8eaf1ff700 1 -- start start 2023-08-27T11:22:51.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.417+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580ab100 con 0x7fde580bae40 2023-08-27T11:22:51.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.417+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580721c0 con 0x7fde580bae40 2023-08-27T11:22:51.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580719a0 con 0x7fde580bae40 2023-08-27T11:22:51.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c0860 0x7f8ea80ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ea80c2320 0x7f8ea8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8151bd0 con 0x7f8ea80c0860 2023-08-27T11:22:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8152d40 con 0x7f8ea80c2320 2023-08-27T11:22:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f8eaf1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8153020 con 0x7f8ea80a79c0 2023-08-27T11:22:51.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48228/0 (socket says 172.21.15.43:48228) 2023-08-27T11:22:51.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 -- 172.21.15.43:0/2911564106 learned_addr learned my addr 172.21.15.43:0/2911564106 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f9cd33ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ccc151a90 0x7f9ccc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f9cd33ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f9cd33ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc06c4e0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f9cd33ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ccc155370 con 0x7f9ccc151a90 2023-08-27T11:22:51.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7f9cd33ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc151e70 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f9cd099a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ccc0c4630 0x7f9ccc06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:39020/0 (socket says 172.21.15.43:39020) 2023-08-27T11:22:51.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f9cd099a700 1 -- 172.21.15.43:0/3328420040 learned_addr learned my addr 172.21.15.43:0/3328420040 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:51.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8ea7fff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c0860 0x7f8ea80ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8ead79c700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ea80c2320 0x7f8ea8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 -- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ea80c2320 msgr2=0x7f8ea8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ea80c2320 0x7f8ea8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 -- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c0860 msgr2=0x7f8ea80ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c0860 0x7f8ea80ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.419+0000 7f8eacf9b700 1 -- 172.21.15.43:0/2911564106 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009550 con 0x7f8ea80a79c0 2023-08-27T11:22:51.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.420+0000 7f9cd119b700 1 --2- 172.21.15.43:0/3328420040 >> v2:172.21.15.57:3300/0 conn(0x7f9ccc151a90 0x7f9ccc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.420+0000 7f8eacf9b700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80c2db0 tx=0x7f8e9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.418+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedf0013470 con 0x7fee000c0860 2023-08-27T11:22:51.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.420+0000 7fedfd7fa700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 0x7fedec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.420+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fedf0088d50 con 0x7fee000c0860 2023-08-27T11:22:51.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.420+0000 7f9cd199c700 1 --2- 172.21.15.43:0/3328420040 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f9cd199c700 1 -- 172.21.15.43:0/3328420040 >> v2:172.21.15.57:3300/0 conn(0x7f9ccc151a90 msgr2=0x7f9ccc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:51.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f9cd199c700 1 --2- 172.21.15.43:0/3328420040 >> v2:172.21.15.57:3300/0 conn(0x7f9ccc151a90 0x7f9ccc0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f9cd199c700 1 -- 172.21.15.43:0/3328420040 >> v1:172.21.15.57:6789/0 conn(0x7f9ccc0c4630 legacy=0x7f9ccc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f9cd199c700 1 -- 172.21.15.43:0/3328420040 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc154480 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f943801a450 con 0x7f94440bf610 2023-08-27T11:22:51.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7fedfffff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 0x7fedec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1c20058850 con 0x7f1c18003a00 2023-08-27T11:22:51.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7f9cd199c700 1 --2- 172.21.15.43:0/3328420040 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc06b480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009d90 tx=0x7f9cc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8149a0280c3f13b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.421+0000 7fedfffff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 0x7fedec06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee000a5980 tx=0x7fedf4006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.422+0000 7f9cc3fff700 1 -- 172.21.15.43:0/3328420040 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc400e070 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.422+0000 7f942bfff700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 0x7f943006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c004220 con 0x7f8ea80a79c0 2023-08-27T11:22:51.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c004380 con 0x7f8ea80a79c0 2023-08-27T11:22:51.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c01b780 con 0x7f8ea80a79c0 2023-08-27T11:22:51.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9438088a30 con 0x7f94440bf610 2023-08-27T11:22:51.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.422+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fedf0054420 con 0x7fee000c0860 2023-08-27T11:22:51.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f9442ffd700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 0x7f943006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.424+0000 7f9442ffd700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 0x7f943006c670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f9434008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.424+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fde48013c60 con 0x7fde580bae40 2023-08-27T11:22:51.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea8153300 con 0x7f8ea80a79c0 2023-08-27T11:22:51.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.423+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea80726a0 con 0x7f8ea80a79c0 2023-08-27T11:22:51.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.424+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8072920 con 0x7f8ea80a79c0 2023-08-27T11:22:51.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.425+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9438057b90 con 0x7f94440bf610 2023-08-27T11:22:51.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.426+0000 7fde3f7fe700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 0x7fde4406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.426+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde480884f0 con 0x7fde580bae40 2023-08-27T11:22:51.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.427+0000 7f9cc3fff700 1 -- 172.21.15.43:0/3328420040 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc400bbd0 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.427+0000 7f9cc3fff700 1 -- 172.21.15.43:0/3328420040 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4012430 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.427+0000 7fde56ffd700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 0x7fde4406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7fde56ffd700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 0x7fde4406c670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde580724f0 tx=0x7fde50001b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fde48053bc0 con 0x7fde580bae40 2023-08-27T11:22:51.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.430+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e9c01b8e0 con 0x7f8ea80a79c0 2023-08-27T11:22:51.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.432+0000 7f8ea57fa700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 0x7f8e8c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.432+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e9c08a080 con 0x7f8ea80a79c0 2023-08-27T11:22:51.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.433+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e9c0557e0 con 0x7f8ea80a79c0 2023-08-27T11:22:51.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 -- 172.21.15.43:0/3328420040 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 msgr2=0x7f9ccc06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/3328420040 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc06b480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009d90 tx=0x7f9cc400b330 comp rx=0 tx=0).stop 2023-08-27T11:22:51.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 -- 172.21.15.43:0/3328420040 shutdown_connections 2023-08-27T11:22:51.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/3328420040 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc06b480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/3328420040 >> v2:172.21.15.57:3300/0 conn(0x7f9ccc151a90 0x7f9ccc0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.428+0000 7f9cd33ff700 1 -- 172.21.15.43:0/3328420040 >> 172.21.15.43:0/3328420040 conn(0x7f9ccc0ab820 msgr2=0x7f9ccc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.429+0000 7f9cd33ff700 1 -- 172.21.15.43:0/3328420040 shutdown_connections 2023-08-27T11:22:51.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.429+0000 7f9cd33ff700 1 -- 172.21.15.43:0/3328420040 wait complete. 2023-08-27T11:22:51.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.432+0000 7f9cd33ff700 1 Processor -- start 2023-08-27T11:22:51.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.433+0000 7f9cd33ff700 1 -- start start 2023-08-27T11:22:51.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ccc151a90 0x7f9ccc0bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1ee140 con 0x7f9ccc0c4630 2023-08-27T11:22:51.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1f2160 con 0x7f9ccc151a90 2023-08-27T11:22:51.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.434+0000 7f9cd33ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1f2440 con 0x7f9ccc0c4a90 2023-08-27T11:22:51.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.436+0000 7f9cd119b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.436+0000 7f9cd119b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40736/0 (socket says 172.21.15.43:40736) 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.436+0000 7f9cd119b700 1 -- 172.21.15.43:0/1459779507 learned_addr learned my addr 172.21.15.43:0/1459779507 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.437+0000 7f9cd119b700 1 -- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 msgr2=0x7f9ccc1ee850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.437+0000 7f9cd119b700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc1ee850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.437+0000 7f9cd119b700 1 -- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ccc151a90 msgr2=0x7f9ccc0bcbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-27T11:22:51.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.437+0000 7f9cd119b700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ccc151a90 0x7f9ccc0bcbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.437+0000 7f9cd119b700 1 -- 172.21.15.43:0/1459779507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4009a70 con 0x7f9ccc0c4630 2023-08-27T11:22:51.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.438+0000 7f9cd119b700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800d800 tx=0x7f9cc800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.438+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc80125f0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.438+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc8012750 con 0x7f9ccc0c4630 2023-08-27T11:22:51.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.438+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8012ae0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.438+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc1ee330 con 0x7f9ccc0c4630 2023-08-27T11:22:51.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.439+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc0c20c0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.443+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9cc8012c40 con 0x7f9ccc0c4630 2023-08-27T11:22:51.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.445+0000 7f9cc1ffb700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 0x7f9cb006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:51.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.445+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9cc8088930 con 0x7f9ccc0c4630 2023-08-27T11:22:51.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.447+0000 7f8ea7fff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 0x7f8e8c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.448+0000 7f8ea7fff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 0x7f8e8c06c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8154560 tx=0x7f8e94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.457+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac0052f0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.461+0000 7f9cd099a700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 0x7f9cb006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:51.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.462+0000 7f9cd099a700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 0x7f9cb006c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc14aaf0 tx=0x7f9cbc007ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:51.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.468+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9cc8054000 con 0x7f9ccc0c4630 2023-08-27T11:22:51.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.857+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb23804ee70 con 0x7fb2380bae40 2023-08-27T11:22:51.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.858+0000 7fb21f7fe700 1 -- 172.21.15.43:0/58421596 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb230016070 con 0x7fb2380bae40 2023-08-27T11:22:51.863 INFO:teuthology.orchestra.run.smithi043.stdout:55834574852 2023-08-27T11:22:51.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.862+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 msgr2=0x7fb22406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.862+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 0x7fb22406c670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bee0 tx=0x7fb228014000 comp rx=0 tx=0).stop 2023-08-27T11:22:51.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.862+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 msgr2=0x7fb2381e56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.862+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb23000cc20 tx=0x7fb23000a060 comp rx=0 tx=0).stop 2023-08-27T11:22:51.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 shutdown_connections 2023-08-27T11:22:51.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb22406a1b0 0x7fb22406c670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2380c0860 0x7fb2381e5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2380a76f0 0x7fb238152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 --2- 172.21.15.43:0/58421596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2380bae40 0x7fb2381e56f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 >> 172.21.15.43:0/58421596 conn(0x7fb23806a730 msgr2=0x7fb23814fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.864+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 shutdown_connections 2023-08-27T11:22:51.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.865+0000 7fb23d1ff700 1 -- 172.21.15.43:0/58421596 wait complete. 2023-08-27T11:22:51.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.880+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbfd40a6290 con 0x7fbfd40c50a0 2023-08-27T11:22:51.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.882+0000 7fbfc2ffd700 1 -- 172.21.15.43:0/2026891180 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfd40a6290 con 0x7fbfd40c50a0 2023-08-27T11:22:51.887 INFO:teuthology.orchestra.run.smithi043.stdout:55834574852 2023-08-27T11:22:51.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.886+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 msgr2=0x7fbfb406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.886+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 0x7fbfb406c670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbfd41642a0 tx=0x7fbfcc007710 comp rx=0 tx=0).stop 2023-08-27T11:22:51.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.886+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 msgr2=0x7fbfd41379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.886+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbfd406d970 tx=0x7fbfc8004750 comp rx=0 tx=0).stop 2023-08-27T11:22:51.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde580719a0 con 0x7fde580bae40 2023-08-27T11:22:51.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 shutdown_connections 2023-08-27T11:22:51.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfb406a1b0 0x7fbfb406c670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfd4156160 0x7fbfd40a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfd40a79c0 0x7fbfd4144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 --2- 172.21.15.43:0/2026891180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfd40c50a0 0x7fbfd41379c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 >> 172.21.15.43:0/2026891180 conn(0x7fbfd406a730 msgr2=0x7fbfd40c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 shutdown_connections 2023-08-27T11:22:51.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fbfd8fff700 1 -- 172.21.15.43:0/2026891180 wait complete. 2023-08-27T11:22:51.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.887+0000 7fde3f7fe700 1 -- 172.21.15.43:0/782880989 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde580719a0 con 0x7fde580bae40 2023-08-27T11:22:51.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.889+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fede0005870 con 0x7fee000c0860 2023-08-27T11:22:51.893 INFO:teuthology.orchestra.run.smithi043.stdout:55834574852 2023-08-27T11:22:51.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.890+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9444072900 con 0x7f94440bf610 2023-08-27T11:22:51.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.891+0000 7f942bfff700 1 -- 172.21.15.43:0/3981748548 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9438057720 con 0x7f94440bf610 2023-08-27T11:22:51.894 INFO:teuthology.orchestra.run.smithi043.stdout:55834574851 2023-08-27T11:22:51.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.891+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 msgr2=0x7fde4406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.891+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 0x7fde4406c670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde580724f0 tx=0x7fde50001b70 comp rx=0 tx=0).stop 2023-08-27T11:22:51.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.892+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 msgr2=0x7fde58071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.892+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e810 tx=0x7fde4800eb20 comp rx=0 tx=0).stop 2023-08-27T11:22:51.895 INFO:teuthology.orchestra.run.smithi043.stdout:55834574853 2023-08-27T11:22:51.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.891+0000 7fedfd7fa700 1 -- 172.21.15.43:0/3876944877 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedf0017090 con 0x7fee000c0860 2023-08-27T11:22:51.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 shutdown_connections 2023-08-27T11:22:51.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4406a1b0 0x7fde4406c670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde580c0860 0x7fde580bf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde580a76f0 0x7fde581f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 --2- 172.21.15.43:0/782880989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde580bae40 0x7fde58071c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 >> 172.21.15.43:0/782880989 conn(0x7fde5806a730 msgr2=0x7fde581517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 shutdown_connections 2023-08-27T11:22:51.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7fde5d5ff700 1 -- 172.21.15.43:0/782880989 wait complete. 2023-08-27T11:22:51.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 msgr2=0x7f943006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 0x7f943006c670 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f9434008030 comp rx=0 tx=0).stop 2023-08-27T11:22:51.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 msgr2=0x7f944415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f943800c820 tx=0x7f943800cb30 comp rx=0 tx=0).stop 2023-08-27T11:22:51.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 shutdown_connections 2023-08-27T11:22:51.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f943006a1b0 0x7f943006c670 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9444151aa0 0x7f944414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f94440bf610 0x7f944415d710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 --2- 172.21.15.43:0/3981748548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f94440c0100 0x7f94440bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.895+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 >> 172.21.15.43:0/3981748548 conn(0x7f9444066610 msgr2=0x7f9444156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1c10005870 con 0x7f1c18003a00 2023-08-27T11:22:51.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2023-08-27T11:22:51.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 shutdown_connections 2023-08-27T11:22:51.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7f944899d700 1 -- 172.21.15.43:0/3981748548 wait complete. 2023-08-27T11:22:51.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7f1c2cff9700 1 -- 172.21.15.43:0/1955111027 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c200583e0 con 0x7f1c18003a00 2023-08-27T11:22:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 msgr2=0x7fedec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 0x7fedec06c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee000a5980 tx=0x7fedf4006c50 comp rx=0 tx=0).stop 2023-08-27T11:22:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 msgr2=0x7fee000a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.896+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedf000e910 tx=0x7fedf000ecd0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.905 INFO:teuthology.orchestra.run.smithi043.stdout:55834574853 2023-08-27T11:22:51.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 shutdown_connections 2023-08-27T11:22:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedec06a0e0 0x7fedec06c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee000c4e40 0x7fee00142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee000c0860 0x7fee000a68b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 --2- 172.21.15.43:0/3876944877 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee000c2320 0x7fee000a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 >> 172.21.15.43:0/3876944877 conn(0x7fee0006a730 msgr2=0x7fee0006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 shutdown_connections 2023-08-27T11:22:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.897+0000 7fee06fff700 1 -- 172.21.15.43:0/3876944877 wait complete. 2023-08-27T11:22:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8ea8153160 con 0x7f8ea80a79c0 2023-08-27T11:22:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 msgr2=0x7f1c1c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 0x7f1c1c06c5f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c30072af0 tx=0x7f1c24008040 comp rx=0 tx=0).stop 2023-08-27T11:22:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 msgr2=0x7f1c300a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c600 tx=0x7f1c20003780 comp rx=0 tx=0).stop 2023-08-27T11:22:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 shutdown_connections 2023-08-27T11:22:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1c1c06a130 0x7f1c1c06c5f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c301e2200 0x7f1c301f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c18003a00 0x7f1c300a8a60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 --2- 172.21.15.43:0/1955111027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1c3014ff00 0x7f1c301e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.901+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 >> 172.21.15.43:0/1955111027 conn(0x7f1c3006a730 msgr2=0x7f1c300ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.902+0000 7f8ea57fa700 1 -- 172.21.15.43:0/2911564106 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ea8153160 con 0x7f8ea80a79c0 2023-08-27T11:22:51.911 INFO:teuthology.orchestra.run.smithi043.stdout:55834574852 2023-08-27T11:22:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.902+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 shutdown_connections 2023-08-27T11:22:51.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.902+0000 7f1c365ff700 1 -- 172.21.15.43:0/1955111027 wait complete. 2023-08-27T11:22:51.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 msgr2=0x7f8e8c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 0x7f8e8c06c670 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8154560 tx=0x7f8e94008040 comp rx=0 tx=0).stop 2023-08-27T11:22:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 msgr2=0x7f8ea806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80c2db0 tx=0x7f8e9c004750 comp rx=0 tx=0).stop 2023-08-27T11:22:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 shutdown_connections 2023-08-27T11:22:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e8c06a1b0 0x7f8e8c06c670 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ea80c2320 0x7f8ea8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ea80a79c0 0x7f8ea806f580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 --2- 172.21.15.43:0/2911564106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ea80c0860 0x7f8ea80ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.908+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 >> 172.21.15.43:0/2911564106 conn(0x7f8ea806a730 msgr2=0x7f8ea80a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.909+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 shutdown_connections 2023-08-27T11:22:51.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.909+0000 7f8eaf1ff700 1 -- 172.21.15.43:0/2911564106 wait complete. 2023-08-27T11:22:51.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2023-08-27T11:22:51.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2023-08-27T11:22:51.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.928+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9cac0055a0 con 0x7f9ccc0c4630 2023-08-27T11:22:51.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.928+0000 7f9cc1ffb700 1 -- 172.21.15.43:0/1459779507 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9cc8057620 con 0x7f9ccc0c4630 2023-08-27T11:22:51.929 INFO:teuthology.orchestra.run.smithi043.stdout:55834574852 2023-08-27T11:22:51.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.931+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 msgr2=0x7f9cb006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.931+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 0x7f9cb006c670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc14aaf0 tx=0x7f9cbc007ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.931+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 msgr2=0x7f9ccc14d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:51.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.931+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800d800 tx=0x7f9cc800dbc0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2023-08-27T11:22:51.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 shutdown_connections 2023-08-27T11:22:51.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cb006a1b0 0x7f9cb006c670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ccc151a90 0x7f9ccc0bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ccc0c4630 0x7f9ccc14d0f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 --2- 172.21.15.43:0/1459779507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ccc0c4a90 0x7f9ccc1ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:51.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.932+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 >> 172.21.15.43:0/1459779507 conn(0x7f9ccc0ab820 msgr2=0x7f9ccc14b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:51.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.933+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 shutdown_connections 2023-08-27T11:22:51.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:51.933+0000 7f9cd33ff700 1 -- 172.21.15.43:0/1459779507 wait complete. 2023-08-27T11:22:51.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2023-08-27T11:22:51.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2023-08-27T11:22:51.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2023-08-27T11:22:51.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2023-08-27T11:22:52.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-27T11:22:52.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-27T11:22:52.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-27T11:22:52.935 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-27T11:22:52.938 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-27T11:22:52.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-27T11:22:52.941 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-27T11:22:52.955 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-27T11:22:53.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.236+0000 7fbee9b9d700 1 Processor -- start 2023-08-27T11:22:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.236+0000 7fbee9b9d700 1 -- start start 2023-08-27T11:22:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.239+0000 7fbee9b9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40aa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.239+0000 7fbee9b9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbee40a86f0 0x7fbee40aa690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.239+0000 7fbee9b9d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee406d640 con 0x7fbee415be40 2023-08-27T11:22:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.239+0000 7fbee9b9d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee406cbe0 con 0x7fbee40a86f0 2023-08-27T11:22:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.239+0000 7fbee9b9d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee4159250 con 0x7fbee4152860 2023-08-27T11:22:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.240+0000 7fbee3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbee40a86f0 0x7fbee40aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.240+0000 7fbee3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbee40a86f0 0x7fbee40aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40738/0 (socket says 172.21.15.43:40738) 2023-08-27T11:22:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.240+0000 7fbee3fff700 1 -- 172.21.15.43:0/4009603600 learned_addr learned my addr 172.21.15.43:0/4009603600 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee8b9b700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee3fff700 1 -- 172.21.15.43:0/4009603600 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 msgr2=0x7fbee40aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee3fff700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee3fff700 1 -- 172.21.15.43:0/4009603600 >> v1:172.21.15.57:6789/0 conn(0x7fbee415be40 legacy=0x7fbee415c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:53.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee3fff700 1 -- 172.21.15.43:0/4009603600 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4159530 con 0x7fbee40a86f0 2023-08-27T11:22:53.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.241+0000 7fbee3fff700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40aa690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098f0 tx=0x7fbed4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c8331ce6080013 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.242+0000 7fbee8b9b700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:53.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.243+0000 7fbee37fe700 1 -- 172.21.15.43:0/4009603600 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4004230 con 0x7fbee40a86f0 2023-08-27T11:22:53.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.243+0000 7fbee37fe700 1 -- 172.21.15.43:0/4009603600 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4004390 con 0x7fbee40a86f0 2023-08-27T11:22:53.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.243+0000 7fbee37fe700 1 -- 172.21.15.43:0/4009603600 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40036a0 con 0x7fbee40a86f0 2023-08-27T11:22:53.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.244+0000 7fbee9b9d700 1 -- 172.21.15.43:0/4009603600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 msgr2=0x7fbee40aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.244+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40aa690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098f0 tx=0x7fbed4009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:53.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 -- 172.21.15.43:0/4009603600 shutdown_connections 2023-08-27T11:22:53.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/4009603600 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40aa690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 -- 172.21.15.43:0/4009603600 >> 172.21.15.43:0/4009603600 conn(0x7fbee4066610 msgr2=0x7fbee406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 -- 172.21.15.43:0/4009603600 shutdown_connections 2023-08-27T11:22:53.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.246+0000 7fbee9b9d700 1 -- 172.21.15.43:0/4009603600 wait complete. 2023-08-27T11:22:53.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.249+0000 7fbee9b9d700 1 Processor -- start 2023-08-27T11:22:53.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.250+0000 7fbee9b9d700 1 -- start start 2023-08-27T11:22:53.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbee415be40 0x7fbee4071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40bb390 con 0x7fbee40a86f0 2023-08-27T11:22:53.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee406f5b0 con 0x7fbee415be40 2023-08-27T11:22:53.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.251+0000 7fbee9b9d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee406f870 con 0x7fbee4152860 2023-08-27T11:22:53.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.252+0000 7fbee8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.252+0000 7fbee8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40740/0 (socket says 172.21.15.43:40740) 2023-08-27T11:22:53.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.252+0000 7fbee8b9b700 1 -- 172.21.15.43:0/2211787571 learned_addr learned my addr 172.21.15.43:0/2211787571 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee939c700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbee415be40 0x7fbee4071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee3fff700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee8b9b700 1 -- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 msgr2=0x7fbee40717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee8b9b700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee8b9b700 1 -- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbee415be40 msgr2=0x7fbee4071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee8b9b700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbee415be40 0x7fbee4071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.253+0000 7fbee8b9b700 1 -- 172.21.15.43:0/2211787571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009550 con 0x7fbee40a86f0 2023-08-27T11:22:53.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.254+0000 7fbee8b9b700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00ce00 tx=0x7fbedc00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.257+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00f480 con 0x7fbee40a86f0 2023-08-27T11:22:53.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.257+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00f5e0 con 0x7fbee40a86f0 2023-08-27T11:22:53.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.257+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00f970 con 0x7fbee40a86f0 2023-08-27T11:22:53.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.257+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee406fb50 con 0x7fbee40a86f0 2023-08-27T11:22:53.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.257+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee4163d80 con 0x7fbee40a86f0 2023-08-27T11:22:53.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.263+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbedc00b040 con 0x7fbee40a86f0 2023-08-27T11:22:53.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.264+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec00052f0 con 0x7fbee40a86f0 2023-08-27T11:22:53.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.265+0000 7fbee17fa700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 0x7fbec806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.265+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbedc088cf0 con 0x7fbee40a86f0 2023-08-27T11:22:53.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.266+0000 7fbee3fff700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 0x7fbec806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.267+0000 7fbee3fff700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 0x7fbec806c640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000c00 tx=0x7fbed4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.276+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbedc054450 con 0x7fbee40a86f0 2023-08-27T11:22:53.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.314+0000 7f2be15ff700 1 Processor -- start 2023-08-27T11:22:53.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.314+0000 7f2be15ff700 1 -- start start 2023-08-27T11:22:53.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.316+0000 7f2be15ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2bdc156160 0x7f2bdc0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.316+0000 7f2be15ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0c0220 con 0x7f2bdc0c5270 2023-08-27T11:22:53.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.316+0000 7f2be15ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0c0da0 con 0x7f2bdc0a79c0 2023-08-27T11:22:53.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.316+0000 7f2be15ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c0470 con 0x7f2bdc156160 2023-08-27T11:22:53.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.318+0000 7f2bdb7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2bdc0c5270 0x7f2bdc15c140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44846/0 (socket says 172.21.15.43:44846) 2023-08-27T11:22:53.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.318+0000 7f2bdb7fe700 1 -- 172.21.15.43:0/1789301849 learned_addr learned my addr 172.21.15.43:0/1789301849 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:53.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.319+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/1789301849 >> v2:172.21.15.43:3300/0 conn(0x7f2bdc156160 0x7f2bdc0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.319+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014934261 0 0) 0x7f2bdc0c0220 con 0x7f2bdc0c5270 2023-08-27T11:22:53.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.319+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc40035b0 con 0x7f2bdc0c5270 2023-08-27T11:22:53.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620213142 0 0) 0x7f2bc40035b0 con 0x7f2bdc0c5270 2023-08-27T11:22:53.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 >> v2:172.21.15.43:3300/0 conn(0x7f2bdc156160 msgr2=0x7f2bdc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 --2- 172.21.15.43:0/1789301849 >> v2:172.21.15.43:3300/0 conn(0x7f2bdc156160 0x7f2bdc0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 >> v1:172.21.15.57:6789/0 conn(0x7f2bdc0a79c0 legacy=0x7f2bdc0c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0c0750 con 0x7f2bdc0c5270 2023-08-27T11:22:53.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f2bd40019f0 con 0x7f2bdc0c5270 2023-08-27T11:22:53.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 >> v1:172.21.15.43:6789/0 conn(0x7f2bdc0c5270 legacy=0x7f2bdc15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bc4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bc4004850 0x7f2bc4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bc4005330 0x7f2bc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c0470 con 0x7f2bc4003a00 2023-08-27T11:22:53.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc400c200 con 0x7f2bc4004850 2023-08-27T11:22:53.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.320+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc400c3c0 con 0x7f2bc4005330 2023-08-27T11:22:53.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.321+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bc4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.321+0000 7f2bda7fc700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bc4004850 0x7f2bc4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 -- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bc4005330 msgr2=0x7f2bc400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-27T11:22:53.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bc4005330 0x7f2bc400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 -- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bc4004850 msgr2=0x7f2bc4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bc4004850 0x7f2bc4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 -- 172.21.15.43:0/1789301849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0c0750 con 0x7f2bc4003a00 2023-08-27T11:22:53.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.322+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bc4003e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009850 tx=0x7f2bc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be81be6275f04093 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.323+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00c070 con 0x7f2bc4003a00 2023-08-27T11:22:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.323+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc013610 con 0x7f2bc4003a00 2023-08-27T11:22:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.323+0000 7f2bd9ffb700 1 -- 172.21.15.43:0/1789301849 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0139c0 con 0x7f2bc4003a00 2023-08-27T11:22:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.324+0000 7f2bdb7fe700 1 -- 172.21.15.43:0/1789301849 reap_dead start 2023-08-27T11:22:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.324+0000 7f2be15ff700 1 -- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 msgr2=0x7f2bc4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.324+0000 7f2be15ff700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bc4003e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009850 tx=0x7f2bc4005880 comp rx=0 tx=0).stop 2023-08-27T11:22:53.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.326+0000 7fea66b9d700 1 Processor -- start 2023-08-27T11:22:53.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.326+0000 7f2be15ff700 1 -- 172.21.15.43:0/1789301849 shutdown_connections 2023-08-27T11:22:53.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.326+0000 7f2be15ff700 1 --2- 172.21.15.43:0/1789301849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bc4003e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.326+0000 7f2be15ff700 1 -- 172.21.15.43:0/1789301849 >> 172.21.15.43:0/1789301849 conn(0x7f2bdc06a730 msgr2=0x7f2bdc06ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.327+0000 7f2be15ff700 1 -- 172.21.15.43:0/1789301849 shutdown_connections 2023-08-27T11:22:53.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.327+0000 7f2be15ff700 1 -- 172.21.15.43:0/1789301849 wait complete. 2023-08-27T11:22:53.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fba941ff700 1 Processor -- start 2023-08-27T11:22:53.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.326+0000 7fea66b9d700 1 -- start start 2023-08-27T11:22:53.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.328+0000 7fea66b9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.328+0000 7fea66b9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea600c5710 0x7fea600c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.330+0000 7fba941ff700 1 -- start start 2023-08-27T11:22:53.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.331+0000 7fba941ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 0x7fba8c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea66b9d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea60151790 con 0x7fea600bf8c0 2023-08-27T11:22:53.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea66b9d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600aa460 con 0x7fea600c5710 2023-08-27T11:22:53.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea66b9d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600aac10 con 0x7fea6014daf0 2023-08-27T11:22:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba941ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0c5620 con 0x7fba8c0c51a0 2023-08-27T11:22:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba941ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c15c1d0 con 0x7fba8c159980 2023-08-27T11:22:53.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba941ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c15ce50 con 0x7fba8c0a76f0 2023-08-27T11:22:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea65b9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea65b9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48296/0 (socket says 172.21.15.43:48296) 2023-08-27T11:22:53.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.329+0000 7fea65b9b700 1 -- 172.21.15.43:0/2253064058 learned_addr learned my addr 172.21.15.43:0/2253064058 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fea6639c700 1 --2- 172.21.15.43:0/2253064058 >> v2:172.21.15.57:3300/0 conn(0x7fea600c5710 0x7fea600c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba9279c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fba8c159980 0x7fba8c0c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:39050/0 (socket says 172.21.15.43:39050) 2023-08-27T11:22:53.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba9279c700 1 -- 172.21.15.43:0/755800603 learned_addr learned my addr 172.21.15.43:0/755800603 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:53.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7fba91f9b700 1 --2- 172.21.15.43:0/755800603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 0x7fba8c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fba90f99700 1 -- 172.21.15.43:0/755800603 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990413362 0 0) 0x7fba8c15c1d0 con 0x7fba8c159980 2023-08-27T11:22:53.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fba90f99700 1 -- 172.21.15.43:0/755800603 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba780035b0 con 0x7fba8c159980 2023-08-27T11:22:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fea65b9b700 1 -- 172.21.15.43:0/2253064058 >> v2:172.21.15.57:3300/0 conn(0x7fea600c5710 msgr2=0x7fea600c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fea65b9b700 1 --2- 172.21.15.43:0/2253064058 >> v2:172.21.15.57:3300/0 conn(0x7fea600c5710 0x7fea600c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fea65b9b700 1 -- 172.21.15.43:0/2253064058 >> v1:172.21.15.57:6789/0 conn(0x7fea600bf8c0 legacy=0x7fea600a86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fea65b9b700 1 -- 172.21.15.43:0/2253064058 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600aa650 con 0x7fea6014daf0 2023-08-27T11:22:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7fba91f9b700 1 -- 172.21.15.43:0/755800603 >> v1:172.21.15.57:6789/0 conn(0x7fba8c159980 legacy=0x7fba8c0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7fba91f9b700 1 -- 172.21.15.43:0/755800603 >> v1:172.21.15.43:6789/0 conn(0x7fba8c0c51a0 legacy=0x7fba8c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7fba91f9b700 1 -- 172.21.15.43:0/755800603 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c15c4b0 con 0x7fba8c0a76f0 2023-08-27T11:22:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.330+0000 7f2be15ff700 1 Processor -- start 2023-08-27T11:22:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.330+0000 7f2be15ff700 1 -- start start 2023-08-27T11:22:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7fea65b9b700 1 --2- 172.21.15.43:0/2253064058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00dd10 tx=0x7fea5c00f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94c31c12d7f83c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2be15ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bdc1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2be15ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 0x7f2bdc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2be15ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 0x7f2bdc1f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2be15ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1f98b0 con 0x7f2bc4003a00 2023-08-27T11:22:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2be15ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0a6e50 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7f2be15ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1f9b20 con 0x7f2bdc15a290 2023-08-27T11:22:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7f2bda7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 0x7f2bdc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.332+0000 7f2bdaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bdc1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7f2bda7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 0x7f2bdc1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48310/0 (socket says 172.21.15.43:48310) 2023-08-27T11:22:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.334+0000 7f2bda7fc700 1 -- 172.21.15.43:0/4287897360 learned_addr learned my addr 172.21.15.43:0/4287897360 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.333+0000 7f2bdb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 0x7f2bdc1f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7fea64b99700 1 -- 172.21.15.43:0/2253064058 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c012070 con 0x7fea6014daf0 2023-08-27T11:22:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7fea64b99700 1 -- 172.21.15.43:0/2253064058 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c00d2e0 con 0x7fea6014daf0 2023-08-27T11:22:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7fea64b99700 1 -- 172.21.15.43:0/2253064058 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c00fbc0 con 0x7fea6014daf0 2023-08-27T11:22:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7f2bdb7fe700 1 -- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 msgr2=0x7f2bdc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7f2bdb7fe700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 0x7f2bdc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7f2bdb7fe700 1 -- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 msgr2=0x7f2bdc1f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7f2bdb7fe700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bdc1f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.335+0000 7f2bdb7fe700 1 -- 172.21.15.43:0/4287897360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc15b3d0 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7f2bdb7fe700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 0x7f2bdc1f35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc072b20 tx=0x7f2bd400cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400a990 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400ab10 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400aec0 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7fea66b9d700 1 -- 172.21.15.43:0/2253064058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 msgr2=0x7fea60150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.336+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2253064058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00dd10 tx=0x7fea5c00f330 comp rx=0 tx=0).stop 2023-08-27T11:22:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fba91f9b700 1 --2- 172.21.15.43:0/755800603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 0x7fba8c0c4c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba84009dc0 tx=0x7fba8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0454c324a461b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 -- 172.21.15.43:0/2253064058 shutdown_connections 2023-08-27T11:22:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2253064058 >> v2:172.21.15.57:3300/0 conn(0x7fea600c5710 0x7fea600c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2253064058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60150d30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 -- 172.21.15.43:0/2253064058 >> 172.21.15.43:0/2253064058 conn(0x7fea60066610 msgr2=0x7fea6006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 -- 172.21.15.43:0/2253064058 shutdown_connections 2023-08-27T11:22:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fea66b9d700 1 -- 172.21.15.43:0/2253064058 wait complete. 2023-08-27T11:22:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fba90f99700 1 -- 172.21.15.43:0/755800603 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400e070 con 0x7fba8c0a76f0 2023-08-27T11:22:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fba90f99700 1 -- 172.21.15.43:0/755800603 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400bb20 con 0x7fba8c0a76f0 2023-08-27T11:22:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7fba90f99700 1 -- 172.21.15.43:0/755800603 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84012430 con 0x7fba8c0a76f0 2023-08-27T11:22:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc15b0f0 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc0a6b70 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.337+0000 7f5f6359d700 1 Processor -- start 2023-08-27T11:22:53.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.338+0000 7f5f6359d700 1 -- start start 2023-08-27T11:22:53.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.338+0000 7f787a3ff700 1 Processor -- start 2023-08-27T11:22:53.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.339+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc04ee70 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.339+0000 7fba941ff700 1 -- 172.21.15.43:0/755800603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 msgr2=0x7fba8c0c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.339+0000 7fba941ff700 1 --2- 172.21.15.43:0/755800603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 0x7fba8c0c4c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fba84009dc0 tx=0x7fba8400b330 comp rx=0 tx=0).stop 2023-08-27T11:22:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7fea66b9d700 1 Processor -- start 2023-08-27T11:22:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f5f6359d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f5f6359d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f540d8820 0x7f5f540e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f5f6359d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f54031580 con 0x7f5f540d5990 2023-08-27T11:22:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f5f6359d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5400b780 con 0x7f5f540d8820 2023-08-27T11:22:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f5f6359d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54046b80 con 0x7f5f5400ad80 2023-08-27T11:22:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7f787a3ff700 1 -- start start 2023-08-27T11:22:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.340+0000 7fea66b9d700 1 -- start start 2023-08-27T11:22:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea600bf8c0 0x7fea601e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 0x7fea6014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600bf020 con 0x7fea600bf8c0 2023-08-27T11:22:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600bf300 con 0x7fea600c5710 2023-08-27T11:22:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.341+0000 7fea66b9d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600a6f40 con 0x7fea6014daf0 2023-08-27T11:22:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2bd4007030 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7fea6539a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 0x7fea6014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7fea6639c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7fea6539a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 0x7fea6014ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60978/0 (socket says 172.21.15.43:60978) 2023-08-27T11:22:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7fea6539a700 1 -- 172.21.15.43:0/2013281162 learned_addr learned my addr 172.21.15.43:0/2013281162 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea65b9b700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea600bf8c0 0x7fea601e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f5f61d9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f5f61d9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48322/0 (socket says 172.21.15.43:48322) 2023-08-27T11:22:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f5f61d9a700 1 -- 172.21.15.43:0/850455328 learned_addr learned my addr 172.21.15.43:0/850455328 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f787a3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78740a76f0 0x7f78740c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f787a3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7874159980 0x7f78740c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f787a3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740c5650 con 0x7f78740c51a0 2023-08-27T11:22:53.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f787a3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787415ce50 con 0x7f78740a76f0 2023-08-27T11:22:53.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.342+0000 7f787a3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78740c0f60 con 0x7f7874159980 2023-08-27T11:22:53.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f786b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f78740c51a0 0x7f7874159270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:39066/0 (socket says 172.21.15.43:39066) 2023-08-27T11:22:53.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f786b7fe700 1 -- 172.21.15.43:0/184817015 learned_addr learned my addr 172.21.15.43:0/184817015 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:53.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f787899c700 1 --2- 172.21.15.43:0/184817015 >> v2:172.21.15.57:3300/0 conn(0x7f7874159980 0x7f78740c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f7873fff700 1 --2- 172.21.15.43:0/184817015 >> v2:172.21.15.43:3300/0 conn(0x7f78740a76f0 0x7f78740c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea6639c700 1 -- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 msgr2=0x7fea6014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea6639c700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 0x7fea6014ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea6639c700 1 -- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea600bf8c0 msgr2=0x7fea601e88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea6639c700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea600bf8c0 0x7fea601e88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7fea6639c700 1 -- 172.21.15.43:0/2013281162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c00d9f0 con 0x7fea6014daf0 2023-08-27T11:22:53.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.343+0000 7f2bc37fe700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 0x7f2bc806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bd4088580 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f62d9c700 1 --2- 172.21.15.43:0/850455328 >> v2:172.21.15.43:3300/0 conn(0x7f5f540d8820 0x7f5f540e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f61d9a700 1 -- 172.21.15.43:0/850455328 >> v2:172.21.15.43:3300/0 conn(0x7f5f540d8820 msgr2=0x7f5f540e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f61d9a700 1 --2- 172.21.15.43:0/850455328 >> v2:172.21.15.43:3300/0 conn(0x7f5f540d8820 0x7f5f540e2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f61d9a700 1 -- 172.21.15.43:0/850455328 >> v1:172.21.15.57:6789/0 conn(0x7f5f540d5990 legacy=0x7f5f54006f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f61d9a700 1 -- 172.21.15.43:0/850455328 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540d5d70 con 0x7f5f5400ad80 2023-08-27T11:22:53.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7fba941ff700 1 -- 172.21.15.43:0/755800603 shutdown_connections 2023-08-27T11:22:53.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7fba941ff700 1 --2- 172.21.15.43:0/755800603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0a76f0 0x7fba8c0c4c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7fba941ff700 1 -- 172.21.15.43:0/755800603 >> 172.21.15.43:0/755800603 conn(0x7fba8c06aa50 msgr2=0x7fba8c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 0x7f2bc806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7fba941ff700 1 -- 172.21.15.43:0/755800603 shutdown_connections 2023-08-27T11:22:53.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f787899c700 1 -- 172.21.15.43:0/184817015 >> v2:172.21.15.43:3300/0 conn(0x7f78740a76f0 msgr2=0x7f78740c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f787899c700 1 --2- 172.21.15.43:0/184817015 >> v2:172.21.15.43:3300/0 conn(0x7f78740a76f0 0x7f78740c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f787899c700 1 -- 172.21.15.43:0/184817015 >> v1:172.21.15.57:6789/0 conn(0x7f78740c51a0 legacy=0x7f7874159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f787899c700 1 -- 172.21.15.43:0/184817015 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787415c1d0 con 0x7f7874159980 2023-08-27T11:22:53.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7f5f61d9a700 1 --2- 172.21.15.43:0/850455328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098f0 tx=0x7f5f58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd310d4ce9ffa239 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7f5f61599700 1 -- 172.21.15.43:0/850455328 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800b8a0 con 0x7f5f5400ad80 2023-08-27T11:22:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7f5f61599700 1 -- 172.21.15.43:0/850455328 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800ba00 con 0x7f5f5400ad80 2023-08-27T11:22:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7f5f61599700 1 -- 172.21.15.43:0/850455328 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800bd90 con 0x7f5f5400ad80 2023-08-27T11:22:53.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.344+0000 7fba941ff700 1 -- 172.21.15.43:0/755800603 wait complete. 2023-08-27T11:22:53.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7f787899c700 1 --2- 172.21.15.43:0/184817015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740c37a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78740bc5b0 tx=0x7f786c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f47538e0a617b06 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7f2bdaffd700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 0x7f2bc806c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc016040 tx=0x7f2bcc01e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.347+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2bd4053ce0 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7fea6639c700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60070970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea58007d90 tx=0x7fea5800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.345+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58018070 con 0x7fea6014daf0 2023-08-27T11:22:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800eb30 con 0x7fea6014daf0 2023-08-27T11:22:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58003a70 con 0x7fea6014daf0 2023-08-27T11:22:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea601525b0 con 0x7fea6014daf0 2023-08-27T11:22:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600ba660 con 0x7fea6014daf0 2023-08-27T11:22:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7fba941ff700 1 Processor -- start 2023-08-27T11:22:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.347+0000 7fba941ff700 1 -- start start 2023-08-27T11:22:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 -- 172.21.15.43:0/850455328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 msgr2=0x7f5f540d82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 --2- 172.21.15.43:0/850455328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5f580098f0 tx=0x7f5f58009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 -- 172.21.15.43:0/850455328 shutdown_connections 2023-08-27T11:22:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 --2- 172.21.15.43:0/850455328 >> v2:172.21.15.43:3300/0 conn(0x7f5f540d8820 0x7f5f540e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 --2- 172.21.15.43:0/850455328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f5400ad80 0x7f5f540d82e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 -- 172.21.15.43:0/850455328 >> 172.21.15.43:0/850455328 conn(0x7f5f540483d0 msgr2=0x7f5f540487e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 -- 172.21.15.43:0/850455328 shutdown_connections 2023-08-27T11:22:53.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.346+0000 7f5f6359d700 1 -- 172.21.15.43:0/850455328 wait complete. 2023-08-27T11:22:53.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 0x7fba8c0bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 0x7fba8c0bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba8c159980 0x7fba8c06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c159df0 con 0x7fba8c159980 2023-08-27T11:22:53.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c157090 con 0x7fba8c0a76f0 2023-08-27T11:22:53.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.348+0000 7fba941ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c070750 con 0x7fba8c0c51a0 2023-08-27T11:22:53.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7f5f6359d700 1 Processor -- start 2023-08-27T11:22:53.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7fba9179a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 0x7fba8c0bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7fba9179a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 0x7fba8c0bf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48334/0 (socket says 172.21.15.43:48334) 2023-08-27T11:22:53.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7fba9179a700 1 -- 172.21.15.43:0/3364120949 learned_addr learned my addr 172.21.15.43:0/3364120949 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7fba91f9b700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 0x7fba8c0bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7f78737fe700 1 -- 172.21.15.43:0/184817015 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00e070 con 0x7f7874159980 2023-08-27T11:22:53.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7f78737fe700 1 -- 172.21.15.43:0/184817015 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00bb20 con 0x7f7874159980 2023-08-27T11:22:53.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7f78737fe700 1 -- 172.21.15.43:0/184817015 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c012430 con 0x7f7874159980 2023-08-27T11:22:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba9279c700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba8c159980 0x7fba8c06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba91f9b700 1 -- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 msgr2=0x7fba8c0bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba91f9b700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 0x7fba8c0bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba91f9b700 1 -- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba8c159980 msgr2=0x7fba8c06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba91f9b700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba8c159980 0x7fba8c06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.350+0000 7fba91f9b700 1 -- 172.21.15.43:0/3364120949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009a70 con 0x7fba8c0a76f0 2023-08-27T11:22:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 -- 172.21.15.43:0/184817015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 msgr2=0x7f78740c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 --2- 172.21.15.43:0/184817015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740c37a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78740bc5b0 tx=0x7f786c00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 -- 172.21.15.43:0/184817015 shutdown_connections 2023-08-27T11:22:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 --2- 172.21.15.43:0/184817015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740c37a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 --2- 172.21.15.43:0/184817015 >> v2:172.21.15.43:3300/0 conn(0x7f78740a76f0 0x7f78740c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f787a3ff700 1 -- 172.21.15.43:0/184817015 >> 172.21.15.43:0/184817015 conn(0x7f787406aa50 msgr2=0x7f78740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7fba91f9b700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 0x7fba8c0bc8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06d850 tx=0x7fba84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7f5f6359d700 1 -- start start 2023-08-27T11:22:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f5400ad80 0x7f5f540d2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f540d8820 0x7f5f5403f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f787a3ff700 1 -- 172.21.15.43:0/184817015 shutdown_connections 2023-08-27T11:22:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540d0380 con 0x7f5f5400ad80 2023-08-27T11:22:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540d11e0 con 0x7f5f540d5990 2023-08-27T11:22:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.351+0000 7f5f6359d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540d2b10 con 0x7f5f540d8820 2023-08-27T11:22:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba840048b0 con 0x7fba8c0a76f0 2023-08-27T11:22:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84020070 con 0x7fba8c0a76f0 2023-08-27T11:22:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba840276c0 con 0x7fba8c0a76f0 2023-08-27T11:22:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:32776/0 (socket says 172.21.15.43:32776) 2023-08-27T11:22:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 -- 172.21.15.43:0/1320084023 learned_addr learned my addr 172.21.15.43:0/1320084023 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f62d9c700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f540d8820 0x7f5f5403f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f6259b700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f5400ad80 0x7f5f540d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 -- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f540d8820 msgr2=0x7f5f5403f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f540d8820 0x7f5f5403f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 -- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f5400ad80 msgr2=0x7f5f540d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f5400ad80 0x7f5f540d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f5f61d9a700 1 -- 172.21.15.43:0/1320084023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58009550 con 0x7f5f540d5990 2023-08-27T11:22:53.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c1ee650 con 0x7fba8c0a76f0 2023-08-27T11:22:53.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c1ee340 con 0x7fba8c0a76f0 2023-08-27T11:22:53.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f61d9a700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f58013000 tx=0x7f5f58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58004550 con 0x7f5f540d5990 2023-08-27T11:22:53.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f580036a0 con 0x7f5f540d5990 2023-08-27T11:22:53.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f540d9640 con 0x7f5f540d5990 2023-08-27T11:22:53.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f58003a50 con 0x7f5f540d5990 2023-08-27T11:22:53.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.353+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f540d08b0 con 0x7f5f540d5990 2023-08-27T11:22:53.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.352+0000 7f787a3ff700 1 -- 172.21.15.43:0/184817015 wait complete. 2023-08-27T11:22:53.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.355+0000 7f787a3ff700 1 Processor -- start 2023-08-27T11:22:53.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.355+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f540d1350 con 0x7f5f540d5990 2023-08-27T11:22:53.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.356+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba84012430 con 0x7fba8c0a76f0 2023-08-27T11:22:53.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.358+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5f58003bb0 con 0x7f5f540d5990 2023-08-27T11:22:53.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba740052f0 con 0x7fba8c0a76f0 2023-08-27T11:22:53.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7fba827fc700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 0x7fba7006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.358+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba84022070 con 0x7fba8c0a76f0 2023-08-27T11:22:53.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.355+0000 7f787a3ff700 1 -- start start 2023-08-27T11:22:53.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78740c51a0 0x7f78740be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740ab520 con 0x7f78740a76f0 2023-08-27T11:22:53.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.349+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea60070690 con 0x7fea6014daf0 2023-08-27T11:22:53.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740a70f0 con 0x7f7874159980 2023-08-27T11:22:53.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.357+0000 7f787a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7874158620 con 0x7f78740c51a0 2023-08-27T11:22:53.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.358+0000 7f7873fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.358+0000 7f7873fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40824/0 (socket says 172.21.15.43:40824) 2023-08-27T11:22:53.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.358+0000 7f7873fff700 1 -- 172.21.15.43:0/3029227486 learned_addr learned my addr 172.21.15.43:0/3029227486 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f786b7fe700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78740c51a0 0x7f78740be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f787899c700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 -- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78740c51a0 msgr2=0x7f78740be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78740c51a0 0x7f78740be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 -- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 msgr2=0x7f78740beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 -- 172.21.15.43:0/3029227486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009a70 con 0x7f78740a76f0 2023-08-27T11:22:53.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f5f52ffd700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 0x7f5f4006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f58089ab0 con 0x7f5f540d5990 2023-08-27T11:22:53.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.359+0000 7f7873fff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.360+0000 7f5f6259b700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 0x7f5f4006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.360+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea58014420 con 0x7fea6014daf0 2023-08-27T11:22:53.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.360+0000 7f52e0dff700 1 Processor -- start 2023-08-27T11:22:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f52e0dff700 1 -- start start 2023-08-27T11:22:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7fea567fc700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 0x7fea4406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea58088410 con 0x7fea6014daf0 2023-08-27T11:22:53.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f5f6259b700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 0x7f5f4006c5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000f60 tx=0x7f5f4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7fba9179a700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 0x7fba7006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7fba9179a700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 0x7fba7006c5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba8c070b90 tx=0x7fba7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7f52e0dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f52dc0bd230 0x7f52dc15be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7f52e0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0c7bb0 con 0x7f52dc06b160 2023-08-27T11:22:53.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7f52e0dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc06bcc0 con 0x7f52dc155fd0 2023-08-27T11:22:53.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.362+0000 7f52e0dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc06ad40 con 0x7f52dc0bd230 2023-08-27T11:22:53.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.363+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5f58055330 con 0x7f5f540d5990 2023-08-27T11:22:53.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.364+0000 7f52dad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f52dc06b160 0x7f52dc06b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44870/0 (socket says 172.21.15.43:44870) 2023-08-27T11:22:53.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.364+0000 7f52dad9d700 1 -- 172.21.15.43:0/2474143394 learned_addr learned my addr 172.21.15.43:0/2474143394 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:53.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864009590 con 0x7f78740a76f0 2023-08-27T11:22:53.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400eea0 con 0x7f78740a76f0 2023-08-27T11:22:53.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400ca50 con 0x7f78740a76f0 2023-08-27T11:22:53.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78740bf410 con 0x7f78740a76f0 2023-08-27T11:22:53.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.361+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78740a6e10 con 0x7f78740a76f0 2023-08-27T11:22:53.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.364+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78580052f0 con 0x7f78740a76f0 2023-08-27T11:22:53.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.364+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/2474143394 >> v2:172.21.15.43:3300/0 conn(0x7f52dc0bd230 0x7f52dc15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.364+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134065249 0 0) 0x7f52dc0c7bb0 con 0x7f52dc06b160 2023-08-27T11:22:53.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c40035b0 con 0x7f52dc06b160 2023-08-27T11:22:53.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867231756 0 0) 0x7f52c40035b0 con 0x7f52dc06b160 2023-08-27T11:22:53.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 >> v2:172.21.15.43:3300/0 conn(0x7f52dc0bd230 msgr2=0x7f52dc15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 --2- 172.21.15.43:0/2474143394 >> v2:172.21.15.43:3300/0 conn(0x7f52dc0bd230 0x7f52dc15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 >> v1:172.21.15.57:6789/0 conn(0x7f52dc155fd0 legacy=0x7f52dc0c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc15cd80 con 0x7f52dc06b160 2023-08-27T11:22:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f52d0001670 con 0x7f52dc06b160 2023-08-27T11:22:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 >> v1:172.21.15.43:6789/0 conn(0x7f52dc06b160 legacy=0x7f52dc06b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52c4005410 0x7f52c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc06ad40 con 0x7f52c4003a00 2023-08-27T11:22:53.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400c2a0 con 0x7f52c4004850 2023-08-27T11:22:53.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400c460 con 0x7f52c4005410 2023-08-27T11:22:53.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.365+0000 7fea65b9b700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 0x7fea4406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.366+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.366+0000 7f52da59c700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7f52d9d9b700 1 -- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52c4005410 msgr2=0x7f52c400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-27T11:22:53.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52c4005410 0x7f52c400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7f52d9d9b700 1 -- 172.21.15.43:0/2474143394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52c4003a00 msgr2=0x7f52c4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52c4003a00 0x7f52c4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7f52d9d9b700 1 -- 172.21.15.43:0/2474143394 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc15cd80 con 0x7f52c4004850 2023-08-27T11:22:53.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.366+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f786400cbb0 con 0x7f78740a76f0 2023-08-27T11:22:53.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.367+0000 7fea65b9b700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 0x7fea4406c5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000c00 tx=0x7fea5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fea60070690 con 0x7fea6014daf0 2023-08-27T11:22:53.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba84056050 con 0x7fba8c0a76f0 2023-08-27T11:22:53.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7f52dad9d700 1 -- 172.21.15.43:0/2474143394 reap_dead start 2023-08-27T11:22:53.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52c4004cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009880 tx=0x7f52c4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b06cd28aaf5615b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7f78717fa700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 0x7f785406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.368+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78640884e0 con 0x7f78740a76f0 2023-08-27T11:22:53.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.369+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00c070 con 0x7f52c4004850 2023-08-27T11:22:53.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.369+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc005c20 con 0x7f52c4004850 2023-08-27T11:22:53.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.369+0000 7f52d959a700 1 -- 172.21.15.43:0/2474143394 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc006050 con 0x7f52c4004850 2023-08-27T11:22:53.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f52e0dff700 1 -- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 msgr2=0x7f52c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f52e0dff700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52c4004cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f52cc009880 tx=0x7f52c4005880 comp rx=0 tx=0).stop 2023-08-27T11:22:53.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.369+0000 7f786b7fe700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 0x7f785406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f786b7fe700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 0x7f785406c670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78740bba30 tx=0x7f785c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f52e0dff700 1 -- 172.21.15.43:0/2474143394 shutdown_connections 2023-08-27T11:22:53.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f52e0dff700 1 --2- 172.21.15.43:0/2474143394 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52c4004cd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.370+0000 7f52e0dff700 1 -- 172.21.15.43:0/2474143394 >> 172.21.15.43:0/2474143394 conn(0x7f52dc0ab820 msgr2=0x7f52dc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.371+0000 7f52e0dff700 1 -- 172.21.15.43:0/2474143394 shutdown_connections 2023-08-27T11:22:53.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.371+0000 7f52e0dff700 1 -- 172.21.15.43:0/2474143394 wait complete. 2023-08-27T11:22:53.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.374+0000 7f52e0dff700 1 Processor -- start 2023-08-27T11:22:53.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.374+0000 7f52e0dff700 1 -- start start 2023-08-27T11:22:53.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52dc1e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52dc15abf0 0x7f52dc150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 0x7f52dc151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc155950 con 0x7f52dc15abf0 2023-08-27T11:22:53.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0c3ce0 con 0x7f52c4004850 2023-08-27T11:22:53.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.376+0000 7f52e0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc155670 con 0x7f52dc0c33f0 2023-08-27T11:22:53.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.377+0000 7f52dad9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 0x7f52dc151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.377+0000 7f52da59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52dc1e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.377+0000 7f52dad9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 0x7f52dc151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48376/0 (socket says 172.21.15.43:48376) 2023-08-27T11:22:53.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.378+0000 7f52dad9d700 1 -- 172.21.15.43:0/3868924854 learned_addr learned my addr 172.21.15.43:0/3868924854 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.378+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52dc15abf0 0x7f52dc150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.379+0000 7f52da59c700 1 -- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 msgr2=0x7f52dc151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.379+0000 7f52da59c700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 0x7f52dc151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.379+0000 7f52da59c700 1 -- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52dc15abf0 msgr2=0x7f52dc150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.379+0000 7f52da59c700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52dc15abf0 0x7f52dc150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.379+0000 7f52da59c700 1 -- 172.21.15.43:0/3868924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc155250 con 0x7f52c4004850 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.380+0000 7f52da59c700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52dc1e8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52dc1599a0 tx=0x7f52d400d150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.380+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4003c30 con 0x7f52c4004850 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.380+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d4003d90 con 0x7f52c4004850 2023-08-27T11:22:53.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.380+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400d9e0 con 0x7f52c4004850 2023-08-27T11:22:53.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.381+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc0c0f20 con 0x7f52c4004850 2023-08-27T11:22:53.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.381+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc1f9bb0 con 0x7f52c4004850 2023-08-27T11:22:53.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.383+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc0c0d60 con 0x7f52c4004850 2023-08-27T11:22:53.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.382+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7864057640 con 0x7f78740a76f0 2023-08-27T11:22:53.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.385+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f52d400db40 con 0x7f52c4004850 2023-08-27T11:22:53.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.387+0000 7f52caffd700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 0x7f52bc06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.387+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52d4088650 con 0x7f52c4004850 2023-08-27T11:22:53.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.388+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 0x7f52bc06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.389+0000 7f52d9d9b700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 0x7f52bc06c670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52cc008010 tx=0x7f52cc01f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.391+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f52d4053db0 con 0x7f52c4004850 2023-08-27T11:22:53.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.407+0000 7fca36dff700 1 Processor -- start 2023-08-27T11:22:53.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.407+0000 7fca36dff700 1 -- start start 2023-08-27T11:22:53.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.409+0000 7fca36dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca3008a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.409+0000 7fca36dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca300ba880 0x7fca301619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.409+0000 7fca36dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300c06a0 con 0x7fca300c0220 2023-08-27T11:22:53.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.410+0000 7fca36dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300c5600 con 0x7fca300ba880 2023-08-27T11:22:53.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.410+0000 7fca36dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca300c0900 con 0x7fca300c29b0 2023-08-27T11:22:53.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.411+0000 7fca3539c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca300ba880 0x7fca301619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.411+0000 7fca3539c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca300ba880 0x7fca301619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40854/0 (socket says 172.21.15.43:40854) 2023-08-27T11:22:53.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.411+0000 7fca3539c700 1 -- 172.21.15.43:0/764006434 learned_addr learned my addr 172.21.15.43:0/764006434 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.411+0000 7fca34b9b700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca3008a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.413+0000 7fca3539c700 1 -- 172.21.15.43:0/764006434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 msgr2=0x7fca3008a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.413+0000 7fca3539c700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca3008a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.413+0000 7fca3539c700 1 -- 172.21.15.43:0/764006434 >> v1:172.21.15.57:6789/0 conn(0x7fca300c0220 legacy=0x7fca300c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:53.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.413+0000 7fca3539c700 1 -- 172.21.15.43:0/764006434 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300c0be0 con 0x7fca300ba880 2023-08-27T11:22:53.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.413+0000 7fca3539c700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301619d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca20008370 tx=0x7fca20008680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d267876a4c3c0c99 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.416+0000 7fca2f7fe700 1 -- 172.21.15.43:0/764006434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20008cd0 con 0x7fca300ba880 2023-08-27T11:22:53.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.416+0000 7fca2f7fe700 1 -- 172.21.15.43:0/764006434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20008e30 con 0x7fca300ba880 2023-08-27T11:22:53.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.416+0000 7fca2f7fe700 1 -- 172.21.15.43:0/764006434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20004230 con 0x7fca300ba880 2023-08-27T11:22:53.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.417+0000 7fca36dff700 1 -- 172.21.15.43:0/764006434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 msgr2=0x7fca301619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.417+0000 7fca36dff700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301619d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fca20008370 tx=0x7fca20008680 comp rx=0 tx=0).stop 2023-08-27T11:22:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.418+0000 7fca36dff700 1 -- 172.21.15.43:0/764006434 shutdown_connections 2023-08-27T11:22:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.418+0000 7fca36dff700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301619d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.418+0000 7fca36dff700 1 --2- 172.21.15.43:0/764006434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca3008a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.418+0000 7fca36dff700 1 -- 172.21.15.43:0/764006434 >> 172.21.15.43:0/764006434 conn(0x7fca3006a730 msgr2=0x7fca3006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.419+0000 7fca36dff700 1 -- 172.21.15.43:0/764006434 shutdown_connections 2023-08-27T11:22:53.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.419+0000 7fca36dff700 1 -- 172.21.15.43:0/764006434 wait complete. 2023-08-27T11:22:53.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.422+0000 7fca36dff700 1 Processor -- start 2023-08-27T11:22:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.422+0000 7fca36dff700 1 -- start start 2023-08-27T11:22:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca300c0220 0x7fca301ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca300bd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301e6950 con 0x7fca300ba880 2023-08-27T11:22:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca301eabb0 con 0x7fca300c0220 2023-08-27T11:22:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.424+0000 7fca36dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca301e8570 con 0x7fca300c29b0 2023-08-27T11:22:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.425+0000 7fca34b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.425+0000 7fca34b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40866/0 (socket says 172.21.15.43:40866) 2023-08-27T11:22:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.425+0000 7fca34b9b700 1 -- 172.21.15.43:0/1930113640 learned_addr learned my addr 172.21.15.43:0/1930113640 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.426+0000 7fca34b9b700 1 -- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 msgr2=0x7fca300bd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.426+0000 7fca34b9b700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca300bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.426+0000 7fca34b9b700 1 -- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca300c0220 msgr2=0x7fca301ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.426+0000 7fca34b9b700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca300c0220 0x7fca301ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.426+0000 7fca34b9b700 1 -- 172.21.15.43:0/1930113640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20008050 con 0x7fca300ba880 2023-08-27T11:22:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.427+0000 7fca34b9b700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca280071f0 tx=0x7fca2800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.430+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28011070 con 0x7fca300ba880 2023-08-27T11:22:53.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.430+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800ba80 con 0x7fca300ba880 2023-08-27T11:22:53.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.430+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800be30 con 0x7fca300ba880 2023-08-27T11:22:53.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.430+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca301e8290 con 0x7fca300ba880 2023-08-27T11:22:53.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.431+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca301e9020 con 0x7fca300ba880 2023-08-27T11:22:53.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.436+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca28008040 con 0x7fca300ba880 2023-08-27T11:22:53.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.438+0000 7fca2d7fa700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 0x7fca1c06c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:53.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.438+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca28087f60 con 0x7fca300ba880 2023-08-27T11:22:53.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.439+0000 7fca2ffff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 0x7fca1c06c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:53.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.440+0000 7fca2ffff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 0x7fca1c06c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca24003df0 tx=0x7fca24007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:53.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.441+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca100052f0 con 0x7fca300ba880 2023-08-27T11:22:53.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.452+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fca280b4990 con 0x7fca300ba880 2023-08-27T11:22:53.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.733+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbec00055a0 con 0x7fbee40a86f0 2023-08-27T11:22:53.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.734+0000 7fbee17fa700 1 -- 172.21.15.43:0/2211787571 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbedc057a70 con 0x7fbee40a86f0 2023-08-27T11:22:53.739 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:53.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.738+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 msgr2=0x7fbec806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.738+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 0x7fbec806c640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbed4000c00 tx=0x7fbed4008030 comp rx=0 tx=0).stop 2023-08-27T11:22:53.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.738+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 msgr2=0x7fbee40ba880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.738+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00ce00 tx=0x7fbedc00a560 comp rx=0 tx=0).stop 2023-08-27T11:22:53.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 shutdown_connections 2023-08-27T11:22:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbec806a180 0x7fbec806c640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbee415be40 0x7fbee4071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbee40a86f0 0x7fbee40ba880 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 --2- 172.21.15.43:0/2211787571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbee4152860 0x7fbee40717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.739+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 >> 172.21.15.43:0/2211787571 conn(0x7fbee4066610 msgr2=0x7fbee415c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.740+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 shutdown_connections 2023-08-27T11:22:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.740+0000 7fbee9b9d700 1 -- 172.21.15.43:0/2211787571 wait complete. 2023-08-27T11:22:53.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-08-27T11:22:53.774 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.797+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba740055a0 con 0x7fba8c0a76f0 2023-08-27T11:22:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.798+0000 7fba827fc700 1 -- 172.21.15.43:0/3364120949 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba84059670 con 0x7fba8c0a76f0 2023-08-27T11:22:53.800 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-08-27T11:22:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 msgr2=0x7fba7006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 0x7fba7006c5f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba8c070b90 tx=0x7fba7c009040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 msgr2=0x7fba8c0bc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 0x7fba8c0bc8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba8c06d850 tx=0x7fba84004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 shutdown_connections 2023-08-27T11:22:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba7006a130 0x7fba7006c5f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba8c159980 0x7fba8c06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba8c0a76f0 0x7fba8c0bc8e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 --2- 172.21.15.43:0/3364120949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba8c0c51a0 0x7fba8c0bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.801+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 >> 172.21.15.43:0/3364120949 conn(0x7fba8c06aa50 msgr2=0x7fba8c0c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.802+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 shutdown_connections 2023-08-27T11:22:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.802+0000 7fba941ff700 1 -- 172.21.15.43:0/3364120949 wait complete. 2023-08-27T11:22:53.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.818+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2bdc1f9c60 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.819+0000 7f2bc37fe700 1 -- 172.21.15.43:0/4287897360 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bd4057300 con 0x7f2bdc1f9fb0 2023-08-27T11:22:53.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-08-27T11:22:53.822 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:53.822 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 msgr2=0x7f2bc806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 0x7f2bc806c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc016040 tx=0x7f2bcc01e040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 msgr2=0x7f2bdc1f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 0x7f2bdc1f35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc072b20 tx=0x7f2bd400cf20 comp rx=0 tx=0).stop 2023-08-27T11:22:53.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 shutdown_connections 2023-08-27T11:22:53.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2bc806a1b0 0x7f2bc806c670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bdc1f9fb0 0x7f2bdc1f35e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bc4003a00 0x7f2bdc1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 --2- 172.21.15.43:0/4287897360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bdc15a290 0x7f2bdc1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 >> 172.21.15.43:0/4287897360 conn(0x7f2bdc06a730 msgr2=0x7f2bdc154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 shutdown_connections 2023-08-27T11:22:53.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.823+0000 7f2be15ff700 1 -- 172.21.15.43:0/4287897360 wait complete. 2023-08-27T11:22:53.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.830+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea60070690 con 0x7fea6014daf0 2023-08-27T11:22:53.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.831+0000 7fea567fc700 1 -- 172.21.15.43:0/2013281162 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea60070690 con 0x7fea6014daf0 2023-08-27T11:22:53.834 INFO:teuthology.orchestra.run.smithi043.stdout:55834574853 2023-08-27T11:22:53.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.833+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f540d1570 con 0x7f5f540d5990 2023-08-27T11:22:53.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 msgr2=0x7fea4406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 0x7fea4406c5f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000c00 tx=0x7fea5c008040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7f5f52ffd700 1 -- 172.21.15.43:0/1320084023 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f58015020 con 0x7f5f540d5990 2023-08-27T11:22:53.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 msgr2=0x7fea60070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60070970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fea58007d90 tx=0x7fea5800e3c0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 shutdown_connections 2023-08-27T11:22:53.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea4406a130 0x7fea4406c5f0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000c00 tx=0x7fea5c008040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea6014daf0 0x7fea60070970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea600bf8c0 0x7fea601e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 --2- 172.21.15.43:0/2013281162 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea600c5710 0x7fea6014ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.834+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 >> 172.21.15.43:0/2013281162 conn(0x7fea60066610 msgr2=0x7fea600a86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.838 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:53.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.835+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 shutdown_connections 2023-08-27T11:22:53.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.835+0000 7fea66b9d700 1 -- 172.21.15.43:0/2013281162 wait complete. 2023-08-27T11:22:53.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 msgr2=0x7f5f4006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 0x7f5f4006c5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c000f60 tx=0x7f5f4c009040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 msgr2=0x7f5f540d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f58013000 tx=0x7f5f58004750 comp rx=0 tx=0).stop 2023-08-27T11:22:53.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 shutdown_connections 2023-08-27T11:22:53.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f4006a130 0x7f5f4006c5f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f540d8820 0x7f5f5403f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f5400ad80 0x7f5f540d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 --2- 172.21.15.43:0/1320084023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f540d5990 0x7f5f540d25d0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f58013000 tx=0x7f5f58004750 comp rx=0 tx=0).stop 2023-08-27T11:22:53.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.838+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 >> 172.21.15.43:0/1320084023 conn(0x7f5f540483d0 msgr2=0x7f5f540471f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.840+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 shutdown_connections 2023-08-27T11:22:53.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.840+0000 7f5f6359d700 1 -- 172.21.15.43:0/1320084023 wait complete. 2023-08-27T11:22:53.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.845+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f52dc06bcc0 con 0x7f52c4004850 2023-08-27T11:22:53.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.846+0000 7f52caffd700 1 -- 172.21.15.43:0/3868924854 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52dc06bcc0 con 0x7f52c4004850 2023-08-27T11:22:53.848 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:53.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f78580055a0 con 0x7f78740a76f0 2023-08-27T11:22:53.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 msgr2=0x7f52bc06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 0x7f52bc06c670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52cc008010 tx=0x7f52cc01f040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 msgr2=0x7f52dc1e8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52dc1e8be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f52dc1599a0 tx=0x7f52d400d150 comp rx=0 tx=0).stop 2023-08-27T11:22:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 shutdown_connections 2023-08-27T11:22:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.850+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a1b0 0x7f52bc06c670 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52dc0c33f0 0x7f52dc151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52c4004850 0x7f52dc1e8be0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 --2- 172.21.15.43:0/3868924854 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52dc15abf0 0x7f52dc150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 >> 172.21.15.43:0/3868924854 conn(0x7f52dc0ab820 msgr2=0x7f52dc0a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f78717fa700 1 -- 172.21.15.43:0/3029227486 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78640571d0 con 0x7f78740a76f0 2023-08-27T11:22:53.854 INFO:teuthology.orchestra.run.smithi043.stdout:55834574855 2023-08-27T11:22:53.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 shutdown_connections 2023-08-27T11:22:53.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.851+0000 7f52e0dff700 1 -- 172.21.15.43:0/3868924854 wait complete. 2023-08-27T11:22:53.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-08-27T11:22:53.857 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 msgr2=0x7f785406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 0x7f785406c670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78740bba30 tx=0x7f785c009040 comp rx=0 tx=0).stop 2023-08-27T11:22:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 msgr2=0x7f78741e3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f786400e8a0 tx=0x7f786400ec60 comp rx=0 tx=0).stop 2023-08-27T11:22:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 shutdown_connections 2023-08-27T11:22:53.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f785406a1b0 0x7f785406c670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7874159980 0x7f78740beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78740a76f0 0x7f78741e3470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 --2- 172.21.15.43:0/3029227486 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78740c51a0 0x7f78740be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 >> 172.21.15.43:0/3029227486 conn(0x7f787406aa50 msgr2=0x7f78740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 shutdown_connections 2023-08-27T11:22:53.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.855+0000 7f787a3ff700 1 -- 172.21.15.43:0/3029227486 wait complete. 2023-08-27T11:22:53.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-08-27T11:22:53.862 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-08-27T11:22:53.869 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-08-27T11:22:53.874 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-08-27T11:22:53.887 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.898+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fca100055a0 con 0x7fca300ba880 2023-08-27T11:22:53.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.898+0000 7fca2d7fa700 1 -- 172.21.15.43:0/1930113640 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca2801a080 con 0x7fca300ba880 2023-08-27T11:22:53.900 INFO:teuthology.orchestra.run.smithi043.stdout:55834574854 2023-08-27T11:22:53.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 msgr2=0x7fca1c06c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 0x7fca1c06c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fca24003df0 tx=0x7fca24007a40 comp rx=0 tx=0).stop 2023-08-27T11:22:53.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 msgr2=0x7fca301ea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca280071f0 tx=0x7fca2800cd70 comp rx=0 tx=0).stop 2023-08-27T11:22:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 shutdown_connections 2023-08-27T11:22:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.900+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca1c06a1b0 0x7fca1c06c670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca300c29b0 0x7fca300bd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca300ba880 0x7fca301ea100 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 --2- 172.21.15.43:0/1930113640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca300c0220 0x7fca301ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:53.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 >> 172.21.15.43:0/1930113640 conn(0x7fca3006a730 msgr2=0x7fca300bbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:53.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 shutdown_connections 2023-08-27T11:22:53.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:53.901+0000 7fca36dff700 1 -- 172.21.15.43:0/1930113640 wait complete. 2023-08-27T11:22:53.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-08-27T11:22:53.920 DEBUG:teuthology.parallel:result is None 2023-08-27T11:22:53.921 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-27T11:22:53.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:22:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.160+0000 7f916f3ff700 1 Processor -- start 2023-08-27T11:22:54.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.160+0000 7f916f3ff700 1 -- start start 2023-08-27T11:22:54.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.161+0000 7f916f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 0x7f91680c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916f3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f916806ad70 0x7f916806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916f3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916806c4e0 con 0x7f9168151a90 2023-08-27T11:22:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916f3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9168155370 con 0x7f916806ad70 2023-08-27T11:22:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680c82c0 con 0x7f91680c4630 2023-08-27T11:22:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f916806ad70 0x7f916806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916c99a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 0x7f91680c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f916806ad70 0x7f916806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40874/0 (socket says 172.21.15.43:40874) 2023-08-27T11:22:54.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 -- 172.21.15.43:0/1179762878 learned_addr learned my addr 172.21.15.43:0/1179762878 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:54.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916c99a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 0x7f91680c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48402/0 (socket says 172.21.15.43:48402) 2023-08-27T11:22:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 -- 172.21.15.43:0/1179762878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 msgr2=0x7f91680c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 --2- 172.21.15.43:0/1179762878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 0x7f91680c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 -- 172.21.15.43:0/1179762878 >> v1:172.21.15.57:6789/0 conn(0x7f9168151a90 legacy=0x7f91680c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.162+0000 7f916d99c700 1 -- 172.21.15.43:0/1179762878 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9168151e70 con 0x7f916806ad70 2023-08-27T11:22:54.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f916d99c700 1 --2- 172.21.15.43:0/1179762878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f916806b200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9160009e50 tx=0x7f916000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d44065064e5b680 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f915ffff700 1 -- 172.21.15.43:0/1179762878 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000e070 con 0x7f916806ad70 2023-08-27T11:22:54.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f915ffff700 1 -- 172.21.15.43:0/1179762878 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000b910 con 0x7f916806ad70 2023-08-27T11:22:54.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f915ffff700 1 -- 172.21.15.43:0/1179762878 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000bcc0 con 0x7f916806ad70 2023-08-27T11:22:54.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f916f3ff700 1 -- 172.21.15.43:0/1179762878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 msgr2=0x7f916806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.163+0000 7f916f3ff700 1 --2- 172.21.15.43:0/1179762878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f916806b200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9160009e50 tx=0x7f916000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:54.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 -- 172.21.15.43:0/1179762878 shutdown_connections 2023-08-27T11:22:54.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 --2- 172.21.15.43:0/1179762878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f916806b200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 --2- 172.21.15.43:0/1179762878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91680c4630 0x7f91680c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 -- 172.21.15.43:0/1179762878 >> 172.21.15.43:0/1179762878 conn(0x7f91680ab820 msgr2=0x7f91680abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:54.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 -- 172.21.15.43:0/1179762878 shutdown_connections 2023-08-27T11:22:54.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.164+0000 7f916f3ff700 1 -- 172.21.15.43:0/1179762878 wait complete. 2023-08-27T11:22:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.165+0000 7f916f3ff700 1 Processor -- start 2023-08-27T11:22:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.165+0000 7f916f3ff700 1 -- start start 2023-08-27T11:22:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 0x7f9168152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9168151a90 0x7f91681529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680aa0c0 con 0x7f916806ad70 2023-08-27T11:22:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916814cab0 con 0x7f91680c4630 2023-08-27T11:22:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.166+0000 7f916f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9168152f10 con 0x7f9168151a90 2023-08-27T11:22:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40878/0 (socket says 172.21.15.43:40878) 2023-08-27T11:22:54.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 -- 172.21.15.43:0/2171745382 learned_addr learned my addr 172.21.15.43:0/2171745382 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:54.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916c99a700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 0x7f9168152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d99c700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9168151a90 0x7f91681529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 -- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9168151a90 msgr2=0x7f91681529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9168151a90 0x7f91681529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 -- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 msgr2=0x7f9168152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 0x7f9168152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 -- 172.21.15.43:0/2171745382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009b30 con 0x7f916806ad70 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916c99a700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 0x7f9168152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f916d19b700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f916400c450 tx=0x7f916400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.167+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640052d0 con 0x7f916806ad70 2023-08-27T11:22:54.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.168+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164005430 con 0x7f916806ad70 2023-08-27T11:22:54.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.168+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91680aa550 con 0x7f916806ad70 2023-08-27T11:22:54.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.168+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640038c0 con 0x7f916806ad70 2023-08-27T11:22:54.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.168+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91680a9a70 con 0x7f916806ad70 2023-08-27T11:22:54.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.169+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916804ee70 con 0x7f916806ad70 2023-08-27T11:22:54.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.170+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9164003a20 con 0x7f916806ad70 2023-08-27T11:22:54.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.171+0000 7f915dffb700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 0x7f914c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.171+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9164087950 con 0x7f916806ad70 2023-08-27T11:22:54.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.171+0000 7f916c99a700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 0x7f914c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.171+0000 7f916c99a700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 0x7f914c06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9158009c30 tx=0x7f9158008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.175+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9164053030 con 0x7f916806ad70 2023-08-27T11:22:54.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.380+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9168154760 con 0x7f914c06a0e0 2023-08-27T11:22:54.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.390+0000 7f915dffb700 1 -- 172.21.15.43:0/2171745382 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286904 (secure 0 0 0) 0x7f9158004030 con 0x7f914c06a0e0 2023-08-27T11:22:54.395 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:54.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 msgr2=0x7f914c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 0x7f914c06c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9158009c30 tx=0x7f9158008040 comp rx=0 tx=0).stop 2023-08-27T11:22:54.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 msgr2=0x7f9168150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f916400c450 tx=0x7f916400c760 comp rx=0 tx=0).stop 2023-08-27T11:22:54.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 shutdown_connections 2023-08-27T11:22:54.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f914c06a0e0 0x7f914c06c5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9168151a90 0x7f91681529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f916806ad70 0x7f9168150580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 --2- 172.21.15.43:0/2171745382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91680c4630 0x7f9168152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 >> 172.21.15.43:0/2171745382 conn(0x7f91680ab820 msgr2=0x7f9168073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:54.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 shutdown_connections 2023-08-27T11:22:54.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.394+0000 7f916f3ff700 1 -- 172.21.15.43:0/2171745382 wait complete. 2023-08-27T11:22:54.400 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:22:54.414 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-27T11:22:54.316408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219092,"kb_used_data":2904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755628,"statfs":{"total":773094113280,"available":772869763072,"internally_reserved":0,"allocated":2973696,"data_stored":1817292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423095+0000","last_change":"2023-08-27T11:22:43.962060+0000","last_active":"2023-08-27T11:22:45.423095+0000","last_peered":"2023-08-27T11:22:45.423095+0000","last_clean":"2023-08-27T11:22:45.423095+0000","last_became_active":"2023-08-27T11:22:43.961142+0000","last_became_peered":"2023-08-27T11:22:43.961142+0000","last_unstale":"2023-08-27T11:22:45.423095+0000","last_undegraded":"2023-08-27T11:22:45.423095+0000","last_fullsized":"2023-08-27T11:22:45.423095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955284+0000","last_change":"2023-08-27T11:22:43.982097+0000","last_active":"2023-08-27T11:22:44.955284+0000","last_peered":"2023-08-27T11:22:44.955284+0000","last_clean":"2023-08-27T11:22:44.955284+0000","last_became_active":"2023-08-27T11:22:43.981793+0000","last_became_peered":"2023-08-27T11:22:43.981793+0000","last_unstale":"2023-08-27T11:22:44.955284+0000","last_undegraded":"2023-08-27T11:22:44.955284+0000","last_fullsized":"2023-08-27T11:22:44.955284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956587+0000","last_change":"2023-08-27T11:22:43.990716+0000","last_active":"2023-08-27T11:22:44.956587+0000","last_peered":"2023-08-27T11:22:44.956587+0000","last_clean":"2023-08-27T11:22:44.956587+0000","last_became_active":"2023-08-27T11:22:43.990370+0000","last_became_peered":"2023-08-27T11:22:43.990370+0000","last_unstale":"2023-08-27T11:22:44.956587+0000","last_undegraded":"2023-08-27T11:22:44.956587+0000","last_fullsized":"2023-08-27T11:22:44.956587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:30.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191934+0000","last_change":"2023-08-27T11:22:43.985032+0000","last_active":"2023-08-27T11:22:46.191934+0000","last_peered":"2023-08-27T11:22:46.191934+0000","last_clean":"2023-08-27T11:22:46.191934+0000","last_became_active":"2023-08-27T11:22:43.984657+0000","last_became_peered":"2023-08-27T11:22:43.984657+0000","last_unstale":"2023-08-27T11:22:46.191934+0000","last_undegraded":"2023-08-27T11:22:46.191934+0000","last_fullsized":"2023-08-27T11:22:46.191934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289220+0000","last_change":"2023-08-27T11:22:43.990182+0000","last_active":"2023-08-27T11:22:46.289220+0000","last_peered":"2023-08-27T11:22:46.289220+0000","last_clean":"2023-08-27T11:22:46.289220+0000","last_became_active":"2023-08-27T11:22:43.989876+0000","last_became_peered":"2023-08-27T11:22:43.989876+0000","last_unstale":"2023-08-27T11:22:46.289220+0000","last_undegraded":"2023-08-27T11:22:46.289220+0000","last_fullsized":"2023-08-27T11:22:46.289220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956031+0000","last_change":"2023-08-27T11:22:43.991876+0000","last_active":"2023-08-27T11:22:44.956031+0000","last_peered":"2023-08-27T11:22:44.956031+0000","last_clean":"2023-08-27T11:22:44.956031+0000","last_became_active":"2023-08-27T11:22:43.991420+0000","last_became_peered":"2023-08-27T11:22:43.991420+0000","last_unstale":"2023-08-27T11:22:44.956031+0000","last_undegraded":"2023-08-27T11:22:44.956031+0000","last_fullsized":"2023-08-27T11:22:44.956031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:44.277673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289573+0000","last_change":"2023-08-27T11:22:43.985414+0000","last_active":"2023-08-27T11:22:46.289573+0000","last_peered":"2023-08-27T11:22:46.289573+0000","last_clean":"2023-08-27T11:22:46.289573+0000","last_became_active":"2023-08-27T11:22:43.985076+0000","last_became_peered":"2023-08-27T11:22:43.985076+0000","last_unstale":"2023-08-27T11:22:46.289573+0000","last_undegraded":"2023-08-27T11:22:46.289573+0000","last_fullsized":"2023-08-27T11:22:46.289573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955019+0000","last_change":"2023-08-27T11:22:43.990228+0000","last_active":"2023-08-27T11:22:44.955019+0000","last_peered":"2023-08-27T11:22:44.955019+0000","last_clean":"2023-08-27T11:22:44.955019+0000","last_became_active":"2023-08-27T11:22:43.989893+0000","last_became_peered":"2023-08-27T11:22:43.989893+0000","last_unstale":"2023-08-27T11:22:44.955019+0000","last_undegraded":"2023-08-27T11:22:44.955019+0000","last_fullsized":"2023-08-27T11:22:44.955019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289668+0000","last_change":"2023-08-27T11:22:43.991007+0000","last_active":"2023-08-27T11:22:46.289668+0000","last_peered":"2023-08-27T11:22:46.289668+0000","last_clean":"2023-08-27T11:22:46.289668+0000","last_became_active":"2023-08-27T11:22:43.990457+0000","last_became_peered":"2023-08-27T11:22:43.990457+0000","last_unstale":"2023-08-27T11:22:46.289668+0000","last_undegraded":"2023-08-27T11:22:46.289668+0000","last_fullsized":"2023-08-27T11:22:46.289668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955768+0000","last_change":"2023-08-27T11:22:43.994376+0000","last_active":"2023-08-27T11:22:44.955768+0000","last_peered":"2023-08-27T11:22:44.955768+0000","last_clean":"2023-08-27T11:22:44.955768+0000","last_became_active":"2023-08-27T11:22:43.994066+0000","last_became_peered":"2023-08-27T11:22:43.994066+0000","last_unstale":"2023-08-27T11:22:44.955768+0000","last_undegraded":"2023-08-27T11:22:44.955768+0000","last_fullsized":"2023-08-27T11:22:44.955768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956745+0000","last_change":"2023-08-27T11:22:43.990918+0000","last_active":"2023-08-27T11:22:44.956745+0000","last_peered":"2023-08-27T11:22:44.956745+0000","last_clean":"2023-08-27T11:22:44.956745+0000","last_became_active":"2023-08-27T11:22:43.989615+0000","last_became_peered":"2023-08-27T11:22:43.989615+0000","last_unstale":"2023-08-27T11:22:44.956745+0000","last_undegraded":"2023-08-27T11:22:44.956745+0000","last_fullsized":"2023-08-27T11:22:44.956745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:35.401057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423161+0000","last_change":"2023-08-27T11:22:43.995954+0000","last_active":"2023-08-27T11:22:45.423161+0000","last_peered":"2023-08-27T11:22:45.423161+0000","last_clean":"2023-08-27T11:22:45.423161+0000","last_became_active":"2023-08-27T11:22:43.995638+0000","last_became_peered":"2023-08-27T11:22:43.995638+0000","last_unstale":"2023-08-27T11:22:45.423161+0000","last_undegraded":"2023-08-27T11:22:45.423161+0000","last_fullsized":"2023-08-27T11:22:45.423161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:12.998008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.422934+0000","last_change":"2023-08-27T11:22:43.961542+0000","last_active":"2023-08-27T11:22:45.422934+0000","last_peered":"2023-08-27T11:22:45.422934+0000","last_clean":"2023-08-27T11:22:45.422934+0000","last_became_active":"2023-08-27T11:22:43.961210+0000","last_became_peered":"2023-08-27T11:22:43.961210+0000","last_unstale":"2023-08-27T11:22:45.422934+0000","last_undegraded":"2023-08-27T11:22:45.422934+0000","last_fullsized":"2023-08-27T11:22:45.422934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:47.897783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955409+0000","last_change":"2023-08-27T11:22:43.980009+0000","last_active":"2023-08-27T11:22:44.955409+0000","last_peered":"2023-08-27T11:22:44.955409+0000","last_clean":"2023-08-27T11:22:44.955409+0000","last_became_active":"2023-08-27T11:22:43.979689+0000","last_became_peered":"2023-08-27T11:22:43.979689+0000","last_unstale":"2023-08-27T11:22:44.955409+0000","last_undegraded":"2023-08-27T11:22:44.955409+0000","last_fullsized":"2023-08-27T11:22:44.955409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289823+0000","last_change":"2023-08-27T11:22:43.990477+0000","last_active":"2023-08-27T11:22:46.289823+0000","last_peered":"2023-08-27T11:22:46.289823+0000","last_clean":"2023-08-27T11:22:46.289823+0000","last_became_active":"2023-08-27T11:22:43.990256+0000","last_became_peered":"2023-08-27T11:22:43.990256+0000","last_unstale":"2023-08-27T11:22:46.289823+0000","last_undegraded":"2023-08-27T11:22:46.289823+0000","last_fullsized":"2023-08-27T11:22:46.289823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955734+0000","last_change":"2023-08-27T11:22:43.989809+0000","last_active":"2023-08-27T11:22:44.955734+0000","last_peered":"2023-08-27T11:22:44.955734+0000","last_clean":"2023-08-27T11:22:44.955734+0000","last_became_active":"2023-08-27T11:22:43.989481+0000","last_became_peered":"2023-08-27T11:22:43.989481+0000","last_unstale":"2023-08-27T11:22:44.955734+0000","last_undegraded":"2023-08-27T11:22:44.955734+0000","last_fullsized":"2023-08-27T11:22:44.955734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289752+0000","last_change":"2023-08-27T11:22:43.990813+0000","last_active":"2023-08-27T11:22:46.289752+0000","last_peered":"2023-08-27T11:22:46.289752+0000","last_clean":"2023-08-27T11:22:46.289752+0000","last_became_active":"2023-08-27T11:22:43.990012+0000","last_became_peered":"2023-08-27T11:22:43.990012+0000","last_unstale":"2023-08-27T11:22:46.289752+0000","last_undegraded":"2023-08-27T11:22:46.289752+0000","last_fullsized":"2023-08-27T11:22:46.289752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956749+0000","last_change":"2023-08-27T11:22:43.989807+0000","last_active":"2023-08-27T11:22:44.956749+0000","last_peered":"2023-08-27T11:22:44.956749+0000","last_clean":"2023-08-27T11:22:44.956749+0000","last_became_active":"2023-08-27T11:22:43.989516+0000","last_became_peered":"2023-08-27T11:22:43.989516+0000","last_unstale":"2023-08-27T11:22:44.956749+0000","last_undegraded":"2023-08-27T11:22:44.956749+0000","last_fullsized":"2023-08-27T11:22:44.956749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:59:37.553187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423039+0000","last_change":"2023-08-27T11:22:43.963140+0000","last_active":"2023-08-27T11:22:45.423039+0000","last_peered":"2023-08-27T11:22:45.423039+0000","last_clean":"2023-08-27T11:22:45.423039+0000","last_became_active":"2023-08-27T11:22:43.962832+0000","last_became_peered":"2023-08-27T11:22:43.962832+0000","last_unstale":"2023-08-27T11:22:45.423039+0000","last_undegraded":"2023-08-27T11:22:45.423039+0000","last_fullsized":"2023-08-27T11:22:45.423039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:15.513008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956266+0000","last_change":"2023-08-27T11:22:43.993602+0000","last_active":"2023-08-27T11:22:44.956266+0000","last_peered":"2023-08-27T11:22:44.956266+0000","last_clean":"2023-08-27T11:22:44.956266+0000","last_became_active":"2023-08-27T11:22:43.993131+0000","last_became_peered":"2023-08-27T11:22:43.993131+0000","last_unstale":"2023-08-27T11:22:44.956266+0000","last_undegraded":"2023-08-27T11:22:44.956266+0000","last_fullsized":"2023-08-27T11:22:44.956266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:11.915278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289711+0000","last_change":"2023-08-27T11:22:43.987371+0000","last_active":"2023-08-27T11:22:46.289711+0000","last_peered":"2023-08-27T11:22:46.289711+0000","last_clean":"2023-08-27T11:22:46.289711+0000","last_became_active":"2023-08-27T11:22:43.987102+0000","last_became_peered":"2023-08-27T11:22:43.987102+0000","last_unstale":"2023-08-27T11:22:46.289711+0000","last_undegraded":"2023-08-27T11:22:46.289711+0000","last_fullsized":"2023-08-27T11:22:46.289711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289229+0000","last_change":"2023-08-27T11:22:43.983074+0000","last_active":"2023-08-27T11:22:46.289229+0000","last_peered":"2023-08-27T11:22:46.289229+0000","last_clean":"2023-08-27T11:22:46.289229+0000","last_became_active":"2023-08-27T11:22:43.982752+0000","last_became_peered":"2023-08-27T11:22:43.982752+0000","last_unstale":"2023-08-27T11:22:46.289229+0000","last_undegraded":"2023-08-27T11:22:46.289229+0000","last_fullsized":"2023-08-27T11:22:46.289229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953805+0000","last_change":"2023-08-27T11:22:43.987652+0000","last_active":"2023-08-27T11:22:44.953805+0000","last_peered":"2023-08-27T11:22:44.953805+0000","last_clean":"2023-08-27T11:22:44.953805+0000","last_became_active":"2023-08-27T11:22:43.987417+0000","last_became_peered":"2023-08-27T11:22:43.987417+0000","last_unstale":"2023-08-27T11:22:44.953805+0000","last_undegraded":"2023-08-27T11:22:44.953805+0000","last_fullsized":"2023-08-27T11:22:44.953805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289855+0000","last_change":"2023-08-27T11:22:43.987462+0000","last_active":"2023-08-27T11:22:46.289855+0000","last_peered":"2023-08-27T11:22:46.289855+0000","last_clean":"2023-08-27T11:22:46.289855+0000","last_became_active":"2023-08-27T11:22:43.987145+0000","last_became_peered":"2023-08-27T11:22:43.987145+0000","last_unstale":"2023-08-27T11:22:46.289855+0000","last_undegraded":"2023-08-27T11:22:46.289855+0000","last_fullsized":"2023-08-27T11:22:46.289855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289131+0000","last_change":"2023-08-27T11:22:43.990261+0000","last_active":"2023-08-27T11:22:46.289131+0000","last_peered":"2023-08-27T11:22:46.289131+0000","last_clean":"2023-08-27T11:22:46.289131+0000","last_became_active":"2023-08-27T11:22:43.989491+0000","last_became_peered":"2023-08-27T11:22:43.989491+0000","last_unstale":"2023-08-27T11:22:46.289131+0000","last_undegraded":"2023-08-27T11:22:46.289131+0000","last_fullsized":"2023-08-27T11:22:46.289131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289808+0000","last_change":"2023-08-27T11:22:43.977096+0000","last_active":"2023-08-27T11:22:46.289808+0000","last_peered":"2023-08-27T11:22:46.289808+0000","last_clean":"2023-08-27T11:22:46.289808+0000","last_became_active":"2023-08-27T11:22:43.976613+0000","last_became_peered":"2023-08-27T11:22:43.976613+0000","last_unstale":"2023-08-27T11:22:46.289808+0000","last_undegraded":"2023-08-27T11:22:46.289808+0000","last_fullsized":"2023-08-27T11:22:46.289808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955237+0000","last_change":"2023-08-27T11:22:43.983414+0000","last_active":"2023-08-27T11:22:44.955237+0000","last_peered":"2023-08-27T11:22:44.955237+0000","last_clean":"2023-08-27T11:22:44.955237+0000","last_became_active":"2023-08-27T11:22:43.983020+0000","last_became_peered":"2023-08-27T11:22:43.983020+0000","last_unstale":"2023-08-27T11:22:44.955237+0000","last_undegraded":"2023-08-27T11:22:44.955237+0000","last_fullsized":"2023-08-27T11:22:44.955237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956174+0000","last_change":"2023-08-27T11:22:42.974209+0000","last_active":"2023-08-27T11:22:44.956174+0000","last_peered":"2023-08-27T11:22:44.956174+0000","last_clean":"2023-08-27T11:22:44.956174+0000","last_became_active":"2023-08-27T11:22:42.973852+0000","last_became_peered":"2023-08-27T11:22:42.973852+0000","last_unstale":"2023-08-27T11:22:44.956174+0000","last_undegraded":"2023-08-27T11:22:44.956174+0000","last_fullsized":"2023-08-27T11:22:44.956174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954249+0000","last_change":"2023-08-27T11:22:43.978095+0000","last_active":"2023-08-27T11:22:44.954249+0000","last_peered":"2023-08-27T11:22:44.954249+0000","last_clean":"2023-08-27T11:22:44.954249+0000","last_became_active":"2023-08-27T11:22:43.977791+0000","last_became_peered":"2023-08-27T11:22:43.977791+0000","last_unstale":"2023-08-27T11:22:44.954249+0000","last_undegraded":"2023-08-27T11:22:44.954249+0000","last_fullsized":"2023-08-27T11:22:44.954249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289089+0000","last_change":"2023-08-27T11:22:42.973723+0000","last_active":"2023-08-27T11:22:46.289089+0000","last_peered":"2023-08-27T11:22:46.289089+0000","last_clean":"2023-08-27T11:22:46.289089+0000","last_became_active":"2023-08-27T11:22:42.973421+0000","last_became_peered":"2023-08-27T11:22:42.973421+0000","last_unstale":"2023-08-27T11:22:46.289089+0000","last_undegraded":"2023-08-27T11:22:46.289089+0000","last_fullsized":"2023-08-27T11:22:46.289089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:58.746701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289380+0000","last_change":"2023-08-27T11:22:43.987909+0000","last_active":"2023-08-27T11:22:46.289380+0000","last_peered":"2023-08-27T11:22:46.289380+0000","last_clean":"2023-08-27T11:22:46.289380+0000","last_became_active":"2023-08-27T11:22:43.984494+0000","last_became_peered":"2023-08-27T11:22:43.984494+0000","last_unstale":"2023-08-27T11:22:46.289380+0000","last_undegraded":"2023-08-27T11:22:46.289380+0000","last_fullsized":"2023-08-27T11:22:46.289380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953952+0000","last_change":"2023-08-27T11:22:42.972365+0000","last_active":"2023-08-27T11:22:44.953952+0000","last_peered":"2023-08-27T11:22:44.953952+0000","last_clean":"2023-08-27T11:22:44.953952+0000","last_became_active":"2023-08-27T11:22:42.972038+0000","last_became_peered":"2023-08-27T11:22:42.972038+0000","last_unstale":"2023-08-27T11:22:44.953952+0000","last_undegraded":"2023-08-27T11:22:44.953952+0000","last_fullsized":"2023-08-27T11:22:44.953952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192249+0000","last_change":"2023-08-27T11:22:43.983047+0000","last_active":"2023-08-27T11:22:46.192249+0000","last_peered":"2023-08-27T11:22:46.192249+0000","last_clean":"2023-08-27T11:22:46.192249+0000","last_became_active":"2023-08-27T11:22:43.982721+0000","last_became_peered":"2023-08-27T11:22:43.982721+0000","last_unstale":"2023-08-27T11:22:46.192249+0000","last_undegraded":"2023-08-27T11:22:46.192249+0000","last_fullsized":"2023-08-27T11:22:46.192249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289847+0000","last_change":"2023-08-27T11:22:42.977813+0000","last_active":"2023-08-27T11:22:46.289847+0000","last_peered":"2023-08-27T11:22:46.289847+0000","last_clean":"2023-08-27T11:22:46.289847+0000","last_became_active":"2023-08-27T11:22:42.976651+0000","last_became_peered":"2023-08-27T11:22:42.976651+0000","last_unstale":"2023-08-27T11:22:46.289847+0000","last_undegraded":"2023-08-27T11:22:46.289847+0000","last_fullsized":"2023-08-27T11:22:46.289847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953881+0000","last_change":"2023-08-27T11:22:43.978397+0000","last_active":"2023-08-27T11:22:44.953881+0000","last_peered":"2023-08-27T11:22:44.953881+0000","last_clean":"2023-08-27T11:22:44.953881+0000","last_became_active":"2023-08-27T11:22:43.977904+0000","last_became_peered":"2023-08-27T11:22:43.977904+0000","last_unstale":"2023-08-27T11:22:44.953881+0000","last_undegraded":"2023-08-27T11:22:44.953881+0000","last_fullsized":"2023-08-27T11:22:44.953881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955485+0000","last_change":"2023-08-27T11:22:42.968091+0000","last_active":"2023-08-27T11:22:44.955485+0000","last_peered":"2023-08-27T11:22:44.955485+0000","last_clean":"2023-08-27T11:22:44.955485+0000","last_became_active":"2023-08-27T11:22:42.967703+0000","last_became_peered":"2023-08-27T11:22:42.967703+0000","last_unstale":"2023-08-27T11:22:44.955485+0000","last_undegraded":"2023-08-27T11:22:44.955485+0000","last_fullsized":"2023-08-27T11:22:44.955485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954032+0000","last_change":"2023-08-27T11:22:43.982808+0000","last_active":"2023-08-27T11:22:44.954032+0000","last_peered":"2023-08-27T11:22:44.954032+0000","last_clean":"2023-08-27T11:22:44.954032+0000","last_became_active":"2023-08-27T11:22:43.982483+0000","last_became_peered":"2023-08-27T11:22:43.982483+0000","last_unstale":"2023-08-27T11:22:44.954032+0000","last_undegraded":"2023-08-27T11:22:44.954032+0000","last_fullsized":"2023-08-27T11:22:44.954032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289997+0000","last_change":"2023-08-27T11:22:42.975018+0000","last_active":"2023-08-27T11:22:46.289997+0000","last_peered":"2023-08-27T11:22:46.289997+0000","last_clean":"2023-08-27T11:22:46.289997+0000","last_became_active":"2023-08-27T11:22:42.974781+0000","last_became_peered":"2023-08-27T11:22:42.974781+0000","last_unstale":"2023-08-27T11:22:46.289997+0000","last_undegraded":"2023-08-27T11:22:46.289997+0000","last_fullsized":"2023-08-27T11:22:46.289997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:34.393641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289495+0000","last_change":"2023-08-27T11:22:43.989795+0000","last_active":"2023-08-27T11:22:46.289495+0000","last_peered":"2023-08-27T11:22:46.289495+0000","last_clean":"2023-08-27T11:22:46.289495+0000","last_became_active":"2023-08-27T11:22:43.989463+0000","last_became_peered":"2023-08-27T11:22:43.989463+0000","last_unstale":"2023-08-27T11:22:46.289495+0000","last_undegraded":"2023-08-27T11:22:46.289495+0000","last_fullsized":"2023-08-27T11:22:46.289495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956476+0000","last_change":"2023-08-27T11:22:42.969337+0000","last_active":"2023-08-27T11:22:44.956476+0000","last_peered":"2023-08-27T11:22:44.956476+0000","last_clean":"2023-08-27T11:22:44.956476+0000","last_became_active":"2023-08-27T11:22:42.967568+0000","last_became_peered":"2023-08-27T11:22:42.967568+0000","last_unstale":"2023-08-27T11:22:44.956476+0000","last_undegraded":"2023-08-27T11:22:44.956476+0000","last_fullsized":"2023-08-27T11:22:44.956476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956732+0000","last_change":"2023-08-27T11:22:43.989937+0000","last_active":"2023-08-27T11:22:44.956732+0000","last_peered":"2023-08-27T11:22:44.956732+0000","last_clean":"2023-08-27T11:22:44.956732+0000","last_became_active":"2023-08-27T11:22:43.989210+0000","last_became_peered":"2023-08-27T11:22:43.989210+0000","last_unstale":"2023-08-27T11:22:44.956732+0000","last_undegraded":"2023-08-27T11:22:44.956732+0000","last_fullsized":"2023-08-27T11:22:44.956732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289446+0000","last_change":"2023-08-27T11:22:42.976288+0000","last_active":"2023-08-27T11:22:46.289446+0000","last_peered":"2023-08-27T11:22:46.289446+0000","last_clean":"2023-08-27T11:22:46.289446+0000","last_became_active":"2023-08-27T11:22:42.975626+0000","last_became_peered":"2023-08-27T11:22:42.975626+0000","last_unstale":"2023-08-27T11:22:46.289446+0000","last_undegraded":"2023-08-27T11:22:46.289446+0000","last_fullsized":"2023-08-27T11:22:46.289446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:10.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954234+0000","last_change":"2023-08-27T11:22:43.981780+0000","last_active":"2023-08-27T11:22:44.954234+0000","last_peered":"2023-08-27T11:22:44.954234+0000","last_clean":"2023-08-27T11:22:44.954234+0000","last_became_active":"2023-08-27T11:22:43.980808+0000","last_became_peered":"2023-08-27T11:22:43.980808+0000","last_unstale":"2023-08-27T11:22:44.954234+0000","last_undegraded":"2023-08-27T11:22:44.954234+0000","last_fullsized":"2023-08-27T11:22:44.954234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289365+0000","last_change":"2023-08-27T11:22:42.979381+0000","last_active":"2023-08-27T11:22:46.289365+0000","last_peered":"2023-08-27T11:22:46.289365+0000","last_clean":"2023-08-27T11:22:46.289365+0000","last_became_active":"2023-08-27T11:22:42.979013+0000","last_became_peered":"2023-08-27T11:22:42.979013+0000","last_unstale":"2023-08-27T11:22:46.289365+0000","last_undegraded":"2023-08-27T11:22:46.289365+0000","last_fullsized":"2023-08-27T11:22:46.289365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955479+0000","last_change":"2023-08-27T11:22:43.983263+0000","last_active":"2023-08-27T11:22:44.955479+0000","last_peered":"2023-08-27T11:22:44.955479+0000","last_clean":"2023-08-27T11:22:44.955479+0000","last_became_active":"2023-08-27T11:22:43.982671+0000","last_became_peered":"2023-08-27T11:22:43.982671+0000","last_unstale":"2023-08-27T11:22:44.955479+0000","last_undegraded":"2023-08-27T11:22:44.955479+0000","last_fullsized":"2023-08-27T11:22:44.955479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289558+0000","last_change":"2023-08-27T11:22:42.973411+0000","last_active":"2023-08-27T11:22:46.289558+0000","last_peered":"2023-08-27T11:22:46.289558+0000","last_clean":"2023-08-27T11:22:46.289558+0000","last_became_active":"2023-08-27T11:22:42.973006+0000","last_became_peered":"2023-08-27T11:22:42.973006+0000","last_unstale":"2023-08-27T11:22:46.289558+0000","last_undegraded":"2023-08-27T11:22:46.289558+0000","last_fullsized":"2023-08-27T11:22:46.289558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289027+0000","last_change":"2023-08-27T11:22:43.988160+0000","last_active":"2023-08-27T11:22:46.289027+0000","last_peered":"2023-08-27T11:22:46.289027+0000","last_clean":"2023-08-27T11:22:46.289027+0000","last_became_active":"2023-08-27T11:22:43.985877+0000","last_became_peered":"2023-08-27T11:22:43.985877+0000","last_unstale":"2023-08-27T11:22:46.289027+0000","last_undegraded":"2023-08-27T11:22:46.289027+0000","last_fullsized":"2023-08-27T11:22:46.289027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:54.726096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191882+0000","last_change":"2023-08-27T11:22:42.967442+0000","last_active":"2023-08-27T11:22:46.191882+0000","last_peered":"2023-08-27T11:22:46.191882+0000","last_clean":"2023-08-27T11:22:46.191882+0000","last_became_active":"2023-08-27T11:22:42.967161+0000","last_became_peered":"2023-08-27T11:22:42.967161+0000","last_unstale":"2023-08-27T11:22:46.191882+0000","last_undegraded":"2023-08-27T11:22:46.191882+0000","last_fullsized":"2023-08-27T11:22:46.191882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:47.998679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954449+0000","last_change":"2023-08-27T11:22:43.983069+0000","last_active":"2023-08-27T11:22:44.954449+0000","last_peered":"2023-08-27T11:22:44.954449+0000","last_clean":"2023-08-27T11:22:44.954449+0000","last_became_active":"2023-08-27T11:22:43.982751+0000","last_became_peered":"2023-08-27T11:22:43.982751+0000","last_unstale":"2023-08-27T11:22:44.954449+0000","last_undegraded":"2023-08-27T11:22:44.954449+0000","last_fullsized":"2023-08-27T11:22:44.954449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:18.462257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289880+0000","last_change":"2023-08-27T11:22:42.973476+0000","last_active":"2023-08-27T11:22:46.289880+0000","last_peered":"2023-08-27T11:22:46.289880+0000","last_clean":"2023-08-27T11:22:46.289880+0000","last_became_active":"2023-08-27T11:22:42.973240+0000","last_became_peered":"2023-08-27T11:22:42.973240+0000","last_unstale":"2023-08-27T11:22:46.289880+0000","last_undegraded":"2023-08-27T11:22:46.289880+0000","last_fullsized":"2023-08-27T11:22:46.289880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:17.454841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955122+0000","last_change":"2023-08-27T11:22:43.981699+0000","last_active":"2023-08-27T11:22:44.955122+0000","last_peered":"2023-08-27T11:22:44.955122+0000","last_clean":"2023-08-27T11:22:44.955122+0000","last_became_active":"2023-08-27T11:22:43.981386+0000","last_became_peered":"2023-08-27T11:22:43.981386+0000","last_unstale":"2023-08-27T11:22:44.955122+0000","last_undegraded":"2023-08-27T11:22:44.955122+0000","last_fullsized":"2023-08-27T11:22:44.955122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289777+0000","last_change":"2023-08-27T11:22:42.974214+0000","last_active":"2023-08-27T11:22:46.289777+0000","last_peered":"2023-08-27T11:22:46.289777+0000","last_clean":"2023-08-27T11:22:46.289777+0000","last_became_active":"2023-08-27T11:22:42.973985+0000","last_became_peered":"2023-08-27T11:22:42.973985+0000","last_unstale":"2023-08-27T11:22:46.289777+0000","last_undegraded":"2023-08-27T11:22:46.289777+0000","last_fullsized":"2023-08-27T11:22:46.289777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955831+0000","last_change":"2023-08-27T11:22:43.992116+0000","last_active":"2023-08-27T11:22:44.955831+0000","last_peered":"2023-08-27T11:22:44.955831+0000","last_clean":"2023-08-27T11:22:44.955831+0000","last_became_active":"2023-08-27T11:22:43.990772+0000","last_became_peered":"2023-08-27T11:22:43.990772+0000","last_unstale":"2023-08-27T11:22:44.955831+0000","last_undegraded":"2023-08-27T11:22:44.955831+0000","last_fullsized":"2023-08-27T11:22:44.955831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289700+0000","last_change":"2023-08-27T11:22:42.975882+0000","last_active":"2023-08-27T11:22:46.289700+0000","last_peered":"2023-08-27T11:22:46.289700+0000","last_clean":"2023-08-27T11:22:46.289700+0000","last_became_active":"2023-08-27T11:22:42.975464+0000","last_became_peered":"2023-08-27T11:22:42.975464+0000","last_unstale":"2023-08-27T11:22:46.289700+0000","last_undegraded":"2023-08-27T11:22:46.289700+0000","last_fullsized":"2023-08-27T11:22:46.289700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:45.897644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192064+0000","last_change":"2023-08-27T11:22:43.984717+0000","last_active":"2023-08-27T11:22:46.192064+0000","last_peered":"2023-08-27T11:22:46.192064+0000","last_clean":"2023-08-27T11:22:46.192064+0000","last_became_active":"2023-08-27T11:22:43.984130+0000","last_became_peered":"2023-08-27T11:22:43.984130+0000","last_unstale":"2023-08-27T11:22:46.192064+0000","last_undegraded":"2023-08-27T11:22:46.192064+0000","last_fullsized":"2023-08-27T11:22:46.192064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955583+0000","last_change":"2023-08-27T11:22:42.970752+0000","last_active":"2023-08-27T11:22:44.955583+0000","last_peered":"2023-08-27T11:22:44.955583+0000","last_clean":"2023-08-27T11:22:44.955583+0000","last_became_active":"2023-08-27T11:22:42.970459+0000","last_became_peered":"2023-08-27T11:22:42.970459+0000","last_unstale":"2023-08-27T11:22:44.955583+0000","last_undegraded":"2023-08-27T11:22:44.955583+0000","last_fullsized":"2023-08-27T11:22:44.955583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289465+0000","last_change":"2023-08-27T11:22:43.983613+0000","last_active":"2023-08-27T11:22:46.289465+0000","last_peered":"2023-08-27T11:22:46.289465+0000","last_clean":"2023-08-27T11:22:46.289465+0000","last_became_active":"2023-08-27T11:22:43.982933+0000","last_became_peered":"2023-08-27T11:22:43.982933+0000","last_unstale":"2023-08-27T11:22:46.289465+0000","last_undegraded":"2023-08-27T11:22:46.289465+0000","last_fullsized":"2023-08-27T11:22:46.289465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954373+0000","last_change":"2023-08-27T11:22:42.981320+0000","last_active":"2023-08-27T11:22:44.954373+0000","last_peered":"2023-08-27T11:22:44.954373+0000","last_clean":"2023-08-27T11:22:44.954373+0000","last_became_active":"2023-08-27T11:22:42.980963+0000","last_became_peered":"2023-08-27T11:22:42.980963+0000","last_unstale":"2023-08-27T11:22:44.954373+0000","last_undegraded":"2023-08-27T11:22:44.954373+0000","last_fullsized":"2023-08-27T11:22:44.954373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956231+0000","last_change":"2023-08-27T11:22:43.993427+0000","last_active":"2023-08-27T11:22:44.956231+0000","last_peered":"2023-08-27T11:22:44.956231+0000","last_clean":"2023-08-27T11:22:44.956231+0000","last_became_active":"2023-08-27T11:22:43.992811+0000","last_became_peered":"2023-08-27T11:22:43.992811+0000","last_unstale":"2023-08-27T11:22:44.956231+0000","last_undegraded":"2023-08-27T11:22:44.956231+0000","last_fullsized":"2023-08-27T11:22:44.956231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192145+0000","last_change":"2023-08-27T11:22:42.972531+0000","last_active":"2023-08-27T11:22:46.192145+0000","last_peered":"2023-08-27T11:22:46.192145+0000","last_clean":"2023-08-27T11:22:46.192145+0000","last_became_active":"2023-08-27T11:22:42.972138+0000","last_became_peered":"2023-08-27T11:22:42.972138+0000","last_unstale":"2023-08-27T11:22:46.192145+0000","last_undegraded":"2023-08-27T11:22:46.192145+0000","last_fullsized":"2023-08-27T11:22:46.192145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:51.423177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956856+0000","last_change":"2023-08-27T11:22:43.989896+0000","last_active":"2023-08-27T11:22:44.956856+0000","last_peered":"2023-08-27T11:22:44.956856+0000","last_clean":"2023-08-27T11:22:44.956856+0000","last_became_active":"2023-08-27T11:22:43.989230+0000","last_became_peered":"2023-08-27T11:22:43.989230+0000","last_unstale":"2023-08-27T11:22:44.956856+0000","last_undegraded":"2023-08-27T11:22:44.956856+0000","last_fullsized":"2023-08-27T11:22:44.956856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:51.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956010+0000","last_change":"2023-08-27T11:22:42.958843+0000","last_active":"2023-08-27T11:22:44.956010+0000","last_peered":"2023-08-27T11:22:44.956010+0000","last_clean":"2023-08-27T11:22:44.956010+0000","last_became_active":"2023-08-27T11:22:42.958485+0000","last_became_peered":"2023-08-27T11:22:42.958485+0000","last_unstale":"2023-08-27T11:22:44.956010+0000","last_undegraded":"2023-08-27T11:22:44.956010+0000","last_fullsized":"2023-08-27T11:22:44.956010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:58.733476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956871+0000","last_change":"2023-08-27T11:22:43.989191+0000","last_active":"2023-08-27T11:22:44.956871+0000","last_peered":"2023-08-27T11:22:44.956871+0000","last_clean":"2023-08-27T11:22:44.956871+0000","last_became_active":"2023-08-27T11:22:43.988840+0000","last_became_peered":"2023-08-27T11:22:43.988840+0000","last_unstale":"2023-08-27T11:22:44.956871+0000","last_undegraded":"2023-08-27T11:22:44.956871+0000","last_fullsized":"2023-08-27T11:22:44.956871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.642446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953825+0000","last_change":"2023-08-27T11:22:42.976094+0000","last_active":"2023-08-27T11:22:44.953825+0000","last_peered":"2023-08-27T11:22:44.953825+0000","last_clean":"2023-08-27T11:22:44.953825+0000","last_became_active":"2023-08-27T11:22:42.975763+0000","last_became_peered":"2023-08-27T11:22:42.975763+0000","last_unstale":"2023-08-27T11:22:44.953825+0000","last_undegraded":"2023-08-27T11:22:44.953825+0000","last_fullsized":"2023-08-27T11:22:44.953825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289408+0000","last_change":"2023-08-27T11:22:43.986813+0000","last_active":"2023-08-27T11:22:46.289408+0000","last_peered":"2023-08-27T11:22:46.289408+0000","last_clean":"2023-08-27T11:22:46.289408+0000","last_became_active":"2023-08-27T11:22:43.986301+0000","last_became_peered":"2023-08-27T11:22:43.986301+0000","last_unstale":"2023-08-27T11:22:46.289408+0000","last_undegraded":"2023-08-27T11:22:46.289408+0000","last_fullsized":"2023-08-27T11:22:46.289408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954367+0000","last_change":"2023-08-27T11:22:42.970688+0000","last_active":"2023-08-27T11:22:44.954367+0000","last_peered":"2023-08-27T11:22:44.954367+0000","last_clean":"2023-08-27T11:22:44.954367+0000","last_became_active":"2023-08-27T11:22:42.970294+0000","last_became_peered":"2023-08-27T11:22:42.970294+0000","last_unstale":"2023-08-27T11:22:44.954367+0000","last_undegraded":"2023-08-27T11:22:44.954367+0000","last_fullsized":"2023-08-27T11:22:44.954367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:29.778808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956655+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:22:44.956655+0000","last_peered":"2023-08-27T11:22:44.956655+0000","last_clean":"2023-08-27T11:22:44.956655+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:22:44.956655+0000","last_undegraded":"2023-08-27T11:22:44.956655+0000","last_fullsized":"2023-08-27T11:22:44.956655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:11.427186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953730+0000","last_change":"2023-08-27T11:22:43.982339+0000","last_active":"2023-08-27T11:22:44.953730+0000","last_peered":"2023-08-27T11:22:44.953730+0000","last_clean":"2023-08-27T11:22:44.953730+0000","last_became_active":"2023-08-27T11:22:43.982008+0000","last_became_peered":"2023-08-27T11:22:43.982008+0000","last_unstale":"2023-08-27T11:22:44.953730+0000","last_undegraded":"2023-08-27T11:22:44.953730+0000","last_fullsized":"2023-08-27T11:22:44.953730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954148+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:22:44.954148+0000","last_peered":"2023-08-27T11:22:44.954148+0000","last_clean":"2023-08-27T11:22:44.954148+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:22:44.954148+0000","last_undegraded":"2023-08-27T11:22:44.954148+0000","last_fullsized":"2023-08-27T11:22:44.954148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:04.880208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289540+0000","last_change":"2023-08-27T11:22:42.980391+0000","last_active":"2023-08-27T11:22:46.289540+0000","last_peered":"2023-08-27T11:22:46.289540+0000","last_clean":"2023-08-27T11:22:46.289540+0000","last_became_active":"2023-08-27T11:22:42.979955+0000","last_became_peered":"2023-08-27T11:22:42.979955+0000","last_unstale":"2023-08-27T11:22:46.289540+0000","last_undegraded":"2023-08-27T11:22:46.289540+0000","last_fullsized":"2023-08-27T11:22:46.289540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955978+0000","last_change":"2023-08-27T11:22:43.990732+0000","last_active":"2023-08-27T11:22:44.955978+0000","last_peered":"2023-08-27T11:22:44.955978+0000","last_clean":"2023-08-27T11:22:44.955978+0000","last_became_active":"2023-08-27T11:22:43.990460+0000","last_became_peered":"2023-08-27T11:22:43.990460+0000","last_unstale":"2023-08-27T11:22:44.955978+0000","last_undegraded":"2023-08-27T11:22:44.955978+0000","last_fullsized":"2023-08-27T11:22:44.955978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288960+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:22:46.288960+0000","last_peered":"2023-08-27T11:22:46.288960+0000","last_clean":"2023-08-27T11:22:46.288960+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:22:46.288960+0000","last_undegraded":"2023-08-27T11:22:46.288960+0000","last_fullsized":"2023-08-27T11:22:46.288960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:47.691026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289882+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:22:46.289882+0000","last_peered":"2023-08-27T11:22:46.289882+0000","last_clean":"2023-08-27T11:22:46.289882+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:22:46.289882+0000","last_undegraded":"2023-08-27T11:22:46.289882+0000","last_fullsized":"2023-08-27T11:22:46.289882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:24.754495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288976+0000","last_change":"2023-08-27T11:22:42.978246+0000","last_active":"2023-08-27T11:22:46.288976+0000","last_peered":"2023-08-27T11:22:46.288976+0000","last_clean":"2023-08-27T11:22:46.288976+0000","last_became_active":"2023-08-27T11:22:42.976711+0000","last_became_peered":"2023-08-27T11:22:42.976711+0000","last_unstale":"2023-08-27T11:22:46.288976+0000","last_undegraded":"2023-08-27T11:22:46.288976+0000","last_fullsized":"2023-08-27T11:22:46.288976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289176+0000","last_change":"2023-08-27T11:22:43.987923+0000","last_active":"2023-08-27T11:22:46.289176+0000","last_peered":"2023-08-27T11:22:46.289176+0000","last_clean":"2023-08-27T11:22:46.289176+0000","last_became_active":"2023-08-27T11:22:43.985057+0000","last_became_peered":"2023-08-27T11:22:43.985057+0000","last_unstale":"2023-08-27T11:22:46.289176+0000","last_undegraded":"2023-08-27T11:22:46.289176+0000","last_fullsized":"2023-08-27T11:22:46.289176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289777+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:22:46.289777+0000","last_peered":"2023-08-27T11:22:46.289777+0000","last_clean":"2023-08-27T11:22:46.289777+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:22:46.289777+0000","last_undegraded":"2023-08-27T11:22:46.289777+0000","last_fullsized":"2023-08-27T11:22:46.289777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:22.843008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288702+0000","last_change":"2023-08-27T11:22:42.974293+0000","last_active":"2023-08-27T11:22:46.288702+0000","last_peered":"2023-08-27T11:22:46.288702+0000","last_clean":"2023-08-27T11:22:46.288702+0000","last_became_active":"2023-08-27T11:22:42.973989+0000","last_became_peered":"2023-08-27T11:22:42.973989+0000","last_unstale":"2023-08-27T11:22:46.288702+0000","last_undegraded":"2023-08-27T11:22:46.288702+0000","last_fullsized":"2023-08-27T11:22:46.288702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289268+0000","last_change":"2023-08-27T11:22:43.979605+0000","last_active":"2023-08-27T11:22:46.289268+0000","last_peered":"2023-08-27T11:22:46.289268+0000","last_clean":"2023-08-27T11:22:46.289268+0000","last_became_active":"2023-08-27T11:22:43.979323+0000","last_became_peered":"2023-08-27T11:22:43.979323+0000","last_unstale":"2023-08-27T11:22:46.289268+0000","last_undegraded":"2023-08-27T11:22:46.289268+0000","last_fullsized":"2023-08-27T11:22:46.289268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289375+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:22:46.289375+0000","last_peered":"2023-08-27T11:22:46.289375+0000","last_clean":"2023-08-27T11:22:46.289375+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:22:46.289375+0000","last_undegraded":"2023-08-27T11:22:46.289375+0000","last_fullsized":"2023-08-27T11:22:46.289375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:37.242602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953924+0000","last_change":"2023-08-27T11:22:42.970697+0000","last_active":"2023-08-27T11:22:44.953924+0000","last_peered":"2023-08-27T11:22:44.953924+0000","last_clean":"2023-08-27T11:22:44.953924+0000","last_became_active":"2023-08-27T11:22:42.970380+0000","last_became_peered":"2023-08-27T11:22:42.970380+0000","last_unstale":"2023-08-27T11:22:44.953924+0000","last_undegraded":"2023-08-27T11:22:44.953924+0000","last_fullsized":"2023-08-27T11:22:44.953924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192146+0000","last_change":"2023-08-27T11:22:43.992399+0000","last_active":"2023-08-27T11:22:46.192146+0000","last_peered":"2023-08-27T11:22:46.192146+0000","last_clean":"2023-08-27T11:22:46.192146+0000","last_became_active":"2023-08-27T11:22:43.991762+0000","last_became_peered":"2023-08-27T11:22:43.991762+0000","last_unstale":"2023-08-27T11:22:46.192146+0000","last_undegraded":"2023-08-27T11:22:46.192146+0000","last_fullsized":"2023-08-27T11:22:46.192146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955449+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:22:44.955449+0000","last_peered":"2023-08-27T11:22:44.955449+0000","last_clean":"2023-08-27T11:22:44.955449+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:22:44.955449+0000","last_undegraded":"2023-08-27T11:22:44.955449+0000","last_fullsized":"2023-08-27T11:22:44.955449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956560+0000","last_change":"2023-08-27T11:22:42.981231+0000","last_active":"2023-08-27T11:22:44.956560+0000","last_peered":"2023-08-27T11:22:44.956560+0000","last_clean":"2023-08-27T11:22:44.956560+0000","last_became_active":"2023-08-27T11:22:42.980906+0000","last_became_peered":"2023-08-27T11:22:42.980906+0000","last_unstale":"2023-08-27T11:22:44.956560+0000","last_undegraded":"2023-08-27T11:22:44.956560+0000","last_fullsized":"2023-08-27T11:22:44.956560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:16.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289728+0000","last_change":"2023-08-27T11:22:43.980912+0000","last_active":"2023-08-27T11:22:46.289728+0000","last_peered":"2023-08-27T11:22:46.289728+0000","last_clean":"2023-08-27T11:22:46.289728+0000","last_became_active":"2023-08-27T11:22:43.980561+0000","last_became_peered":"2023-08-27T11:22:43.980561+0000","last_unstale":"2023-08-27T11:22:46.289728+0000","last_undegraded":"2023-08-27T11:22:46.289728+0000","last_fullsized":"2023-08-27T11:22:46.289728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192249+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:22:46.192249+0000","last_peered":"2023-08-27T11:22:46.192249+0000","last_clean":"2023-08-27T11:22:46.192249+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:22:46.192249+0000","last_undegraded":"2023-08-27T11:22:46.192249+0000","last_fullsized":"2023-08-27T11:22:46.192249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289581+0000","last_change":"2023-08-27T11:22:42.974572+0000","last_active":"2023-08-27T11:22:46.289581+0000","last_peered":"2023-08-27T11:22:46.289581+0000","last_clean":"2023-08-27T11:22:46.289581+0000","last_became_active":"2023-08-27T11:22:42.973936+0000","last_became_peered":"2023-08-27T11:22:42.973936+0000","last_unstale":"2023-08-27T11:22:46.289581+0000","last_undegraded":"2023-08-27T11:22:46.289581+0000","last_fullsized":"2023-08-27T11:22:46.289581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:32.202757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289238+0000","last_change":"2023-08-27T11:22:43.983828+0000","last_active":"2023-08-27T11:22:46.289238+0000","last_peered":"2023-08-27T11:22:46.289238+0000","last_clean":"2023-08-27T11:22:46.289238+0000","last_became_active":"2023-08-27T11:22:43.983297+0000","last_became_peered":"2023-08-27T11:22:43.983297+0000","last_unstale":"2023-08-27T11:22:46.289238+0000","last_undegraded":"2023-08-27T11:22:46.289238+0000","last_fullsized":"2023-08-27T11:22:46.289238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192128+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:22:46.192128+0000","last_peered":"2023-08-27T11:22:46.192128+0000","last_clean":"2023-08-27T11:22:46.192128+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:22:46.192128+0000","last_undegraded":"2023-08-27T11:22:46.192128+0000","last_fullsized":"2023-08-27T11:22:46.192128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:26.175102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956090+0000","last_change":"2023-08-27T11:22:42.970931+0000","last_active":"2023-08-27T11:22:44.956090+0000","last_peered":"2023-08-27T11:22:44.956090+0000","last_clean":"2023-08-27T11:22:44.956090+0000","last_became_active":"2023-08-27T11:22:42.970639+0000","last_became_peered":"2023-08-27T11:22:42.970639+0000","last_unstale":"2023-08-27T11:22:44.956090+0000","last_undegraded":"2023-08-27T11:22:44.956090+0000","last_fullsized":"2023-08-27T11:22:44.956090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289671+0000","last_change":"2023-08-27T11:22:43.978747+0000","last_active":"2023-08-27T11:22:46.289671+0000","last_peered":"2023-08-27T11:22:46.289671+0000","last_clean":"2023-08-27T11:22:46.289671+0000","last_became_active":"2023-08-27T11:22:43.978452+0000","last_became_peered":"2023-08-27T11:22:43.978452+0000","last_unstale":"2023-08-27T11:22:46.289671+0000","last_undegraded":"2023-08-27T11:22:46.289671+0000","last_fullsized":"2023-08-27T11:22:46.289671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289680+0000","last_change":"2023-08-27T11:22:42.978613+0000","last_active":"2023-08-27T11:22:46.289680+0000","last_peered":"2023-08-27T11:22:46.289680+0000","last_clean":"2023-08-27T11:22:46.289680+0000","last_became_active":"2023-08-27T11:22:42.978242+0000","last_became_peered":"2023-08-27T11:22:42.978242+0000","last_unstale":"2023-08-27T11:22:46.289680+0000","last_undegraded":"2023-08-27T11:22:46.289680+0000","last_fullsized":"2023-08-27T11:22:46.289680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:21.438467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423097+0000","last_change":"2023-08-27T11:22:43.979802+0000","last_active":"2023-08-27T11:22:45.423097+0000","last_peered":"2023-08-27T11:22:45.423097+0000","last_clean":"2023-08-27T11:22:45.423097+0000","last_became_active":"2023-08-27T11:22:43.979457+0000","last_became_peered":"2023-08-27T11:22:43.979457+0000","last_unstale":"2023-08-27T11:22:45.423097+0000","last_undegraded":"2023-08-27T11:22:45.423097+0000","last_fullsized":"2023-08-27T11:22:45.423097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:08.123051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955380+0000","last_change":"2023-08-27T11:22:42.970531+0000","last_active":"2023-08-27T11:22:44.955380+0000","last_peered":"2023-08-27T11:22:44.955380+0000","last_clean":"2023-08-27T11:22:44.955380+0000","last_became_active":"2023-08-27T11:22:42.970063+0000","last_became_peered":"2023-08-27T11:22:42.970063+0000","last_unstale":"2023-08-27T11:22:44.955380+0000","last_undegraded":"2023-08-27T11:22:44.955380+0000","last_fullsized":"2023-08-27T11:22:44.955380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956373+0000","last_change":"2023-08-27T11:22:43.990179+0000","last_active":"2023-08-27T11:22:44.956373+0000","last_peered":"2023-08-27T11:22:44.956373+0000","last_clean":"2023-08-27T11:22:44.956373+0000","last_became_active":"2023-08-27T11:22:43.989642+0000","last_became_peered":"2023-08-27T11:22:43.989642+0000","last_unstale":"2023-08-27T11:22:44.956373+0000","last_undegraded":"2023-08-27T11:22:44.956373+0000","last_fullsized":"2023-08-27T11:22:44.956373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955879+0000","last_change":"2023-08-27T11:22:42.966238+0000","last_active":"2023-08-27T11:22:44.955879+0000","last_peered":"2023-08-27T11:22:44.955879+0000","last_clean":"2023-08-27T11:22:44.955879+0000","last_became_active":"2023-08-27T11:22:42.965938+0000","last_became_peered":"2023-08-27T11:22:42.965938+0000","last_unstale":"2023-08-27T11:22:44.955879+0000","last_undegraded":"2023-08-27T11:22:44.955879+0000","last_fullsized":"2023-08-27T11:22:44.955879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956394+0000","last_change":"2023-08-27T11:22:43.991696+0000","last_active":"2023-08-27T11:22:44.956394+0000","last_peered":"2023-08-27T11:22:44.956394+0000","last_clean":"2023-08-27T11:22:44.956394+0000","last_became_active":"2023-08-27T11:22:43.991150+0000","last_became_peered":"2023-08-27T11:22:43.991150+0000","last_unstale":"2023-08-27T11:22:44.956394+0000","last_undegraded":"2023-08-27T11:22:44.956394+0000","last_fullsized":"2023-08-27T11:22:44.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953861+0000","last_change":"2023-08-27T11:22:42.970669+0000","last_active":"2023-08-27T11:22:44.953861+0000","last_peered":"2023-08-27T11:22:44.953861+0000","last_clean":"2023-08-27T11:22:44.953861+0000","last_became_active":"2023-08-27T11:22:42.970385+0000","last_became_peered":"2023-08-27T11:22:42.970385+0000","last_unstale":"2023-08-27T11:22:44.953861+0000","last_undegraded":"2023-08-27T11:22:44.953861+0000","last_fullsized":"2023-08-27T11:22:44.953861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953966+0000","last_change":"2023-08-27T11:22:43.964703+0000","last_active":"2023-08-27T11:22:44.953966+0000","last_peered":"2023-08-27T11:22:44.953966+0000","last_clean":"2023-08-27T11:22:44.953966+0000","last_became_active":"2023-08-27T11:22:43.964343+0000","last_became_peered":"2023-08-27T11:22:43.964343+0000","last_unstale":"2023-08-27T11:22:44.953966+0000","last_undegraded":"2023-08-27T11:22:44.953966+0000","last_fullsized":"2023-08-27T11:22:44.953966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289846+0000","last_change":"2023-08-27T11:22:42.977833+0000","last_active":"2023-08-27T11:22:46.289846+0000","last_peered":"2023-08-27T11:22:46.289846+0000","last_clean":"2023-08-27T11:22:46.289846+0000","last_became_active":"2023-08-27T11:22:42.977061+0000","last_became_peered":"2023-08-27T11:22:42.977061+0000","last_unstale":"2023-08-27T11:22:46.289846+0000","last_undegraded":"2023-08-27T11:22:46.289846+0000","last_fullsized":"2023-08-27T11:22:46.289846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955674+0000","last_change":"2023-08-27T11:22:43.989253+0000","last_active":"2023-08-27T11:22:44.955674+0000","last_peered":"2023-08-27T11:22:44.955674+0000","last_clean":"2023-08-27T11:22:44.955674+0000","last_became_active":"2023-08-27T11:22:43.988860+0000","last_became_peered":"2023-08-27T11:22:43.988860+0000","last_unstale":"2023-08-27T11:22:44.955674+0000","last_undegraded":"2023-08-27T11:22:44.955674+0000","last_fullsized":"2023-08-27T11:22:44.955674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191791+0000","last_change":"2023-08-27T11:22:43.962222+0000","last_active":"2023-08-27T11:22:46.191791+0000","last_peered":"2023-08-27T11:22:46.191791+0000","last_clean":"2023-08-27T11:22:46.191791+0000","last_became_active":"2023-08-27T11:22:43.961880+0000","last_became_peered":"2023-08-27T11:22:43.961880+0000","last_unstale":"2023-08-27T11:22:46.191791+0000","last_undegraded":"2023-08-27T11:22:46.191791+0000","last_fullsized":"2023-08-27T11:22:46.191791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953872+0000","last_change":"2023-08-27T11:22:43.983558+0000","last_active":"2023-08-27T11:22:44.953872+0000","last_peered":"2023-08-27T11:22:44.953872+0000","last_clean":"2023-08-27T11:22:44.953872+0000","last_became_active":"2023-08-27T11:22:43.981569+0000","last_became_peered":"2023-08-27T11:22:43.981569+0000","last_unstale":"2023-08-27T11:22:44.953872+0000","last_undegraded":"2023-08-27T11:22:44.953872+0000","last_fullsized":"2023-08-27T11:22:44.953872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956171+0000","last_change":"2023-08-27T11:22:43.995288+0000","last_active":"2023-08-27T11:22:44.956171+0000","last_peered":"2023-08-27T11:22:44.956171+0000","last_clean":"2023-08-27T11:22:44.956171+0000","last_became_active":"2023-08-27T11:22:43.995014+0000","last_became_peered":"2023-08-27T11:22:43.995014+0000","last_unstale":"2023-08-27T11:22:44.956171+0000","last_undegraded":"2023-08-27T11:22:44.956171+0000","last_fullsized":"2023-08-27T11:22:44.956171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954375+0000","last_change":"2023-08-27T11:22:43.983608+0000","last_active":"2023-08-27T11:22:44.954375+0000","last_peered":"2023-08-27T11:22:44.954375+0000","last_clean":"2023-08-27T11:22:44.954375+0000","last_became_active":"2023-08-27T11:22:43.983327+0000","last_became_peered":"2023-08-27T11:22:43.983327+0000","last_unstale":"2023-08-27T11:22:44.954375+0000","last_undegraded":"2023-08-27T11:22:44.954375+0000","last_fullsized":"2023-08-27T11:22:44.954375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289431+0000","last_change":"2023-08-27T11:22:43.984397+0000","last_active":"2023-08-27T11:22:46.289431+0000","last_peered":"2023-08-27T11:22:46.289431+0000","last_clean":"2023-08-27T11:22:46.289431+0000","last_became_active":"2023-08-27T11:22:43.984028+0000","last_became_peered":"2023-08-27T11:22:43.984028+0000","last_unstale":"2023-08-27T11:22:46.289431+0000","last_undegraded":"2023-08-27T11:22:46.289431+0000","last_fullsized":"2023-08-27T11:22:46.289431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4249999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.928000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:22:54.420 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:22:54.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.653+0000 7f766d9ff700 1 Processor -- start 2023-08-27T11:22:54.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.654+0000 7f766d9ff700 1 -- start start 2023-08-27T11:22:54.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806b320 0x7f766814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f766806c690 0x7f766814e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76680c4600 0x7f76680c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76681546f0 con 0x7f76680c4600 2023-08-27T11:22:54.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76680c4bb0 con 0x7f766806c690 2023-08-27T11:22:54.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f766d9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680c4e90 con 0x7f766806b320 2023-08-27T11:22:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76680c4600 0x7f76680c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76680c4600 0x7f76680c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40884/0 (socket says 172.21.15.43:40884) 2023-08-27T11:22:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 -- 172.21.15.43:0/332879937 learned_addr learned my addr 172.21.15.43:0/332879937 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76667fc700 1 --2- 172.21.15.43:0/332879937 >> v2:172.21.15.57:3300/0 conn(0x7f766806c690 0x7f766814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f7666ffd700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806b320 0x7f766814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 -- 172.21.15.43:0/332879937 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806b320 msgr2=0x7f766814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:54.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806b320 0x7f766814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 -- 172.21.15.43:0/332879937 >> v2:172.21.15.57:3300/0 conn(0x7f766806c690 msgr2=0x7f766814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:54.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 --2- 172.21.15.43:0/332879937 >> v2:172.21.15.57:3300/0 conn(0x7f766806c690 0x7f766814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.655+0000 7f76677fe700 1 -- 172.21.15.43:0/332879937 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680c5170 con 0x7f76680c4600 2023-08-27T11:22:54.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f76677fe700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680c5970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76680c9be0 tx=0x7f766000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ff42301ca80703 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f7665ffb700 1 -- 172.21.15.43:0/332879937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000e070 con 0x7f76680c4600 2023-08-27T11:22:54.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f7665ffb700 1 -- 172.21.15.43:0/332879937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766000b9c0 con 0x7f76680c4600 2023-08-27T11:22:54.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f7665ffb700 1 -- 172.21.15.43:0/332879937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766000bd70 con 0x7f76680c4600 2023-08-27T11:22:54.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f766d9ff700 1 -- 172.21.15.43:0/332879937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 msgr2=0x7f76680c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.656+0000 7f766d9ff700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680c5970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76680c9be0 tx=0x7f766000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 -- 172.21.15.43:0/332879937 shutdown_connections 2023-08-27T11:22:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680c5970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 --2- 172.21.15.43:0/332879937 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806b320 0x7f766814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 --2- 172.21.15.43:0/332879937 >> v2:172.21.15.57:3300/0 conn(0x7f766806c690 0x7f766814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 -- 172.21.15.43:0/332879937 >> 172.21.15.43:0/332879937 conn(0x7f76680c9c80 msgr2=0x7f76680ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 -- 172.21.15.43:0/332879937 shutdown_connections 2023-08-27T11:22:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.657+0000 7f766d9ff700 1 -- 172.21.15.43:0/332879937 wait complete. 2023-08-27T11:22:54.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.659+0000 7f766d9ff700 1 Processor -- start 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.659+0000 7f766d9ff700 1 -- start start 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f766806b320 0x7f76681e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806c690 0x7f76680ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7668157220 con 0x7f76680c4600 2023-08-27T11:22:54.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76680acf80 con 0x7f766806b320 2023-08-27T11:22:54.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.660+0000 7f766d9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76680ad260 con 0x7f766806c690 2023-08-27T11:22:54.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40896/0 (socket says 172.21.15.43:40896) 2023-08-27T11:22:54.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 -- 172.21.15.43:0/2633412339 learned_addr learned my addr 172.21.15.43:0/2633412339 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:54.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f7666ffd700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f766806b320 0x7f76681e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76667fc700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806c690 0x7f76680ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 -- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806c690 msgr2=0x7f76680ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806c690 0x7f76680ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 -- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f766806b320 msgr2=0x7f76681e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f766806b320 0x7f76681e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 -- 172.21.15.43:0/2633412339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660009b30 con 0x7f76680c4600 2023-08-27T11:22:54.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.661+0000 7f76677fe700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7668067670 tx=0x7f7660004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.662+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600092e0 con 0x7f76680c4600 2023-08-27T11:22:54.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.662+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660004250 con 0x7f76680c4600 2023-08-27T11:22:54.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.662+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76680ad540 con 0x7f76680c4600 2023-08-27T11:22:54.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.662+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660004620 con 0x7f76680c4600 2023-08-27T11:22:54.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.662+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76681573f0 con 0x7f76680c4600 2023-08-27T11:22:54.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.663+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766804ee70 con 0x7f76680c4600 2023-08-27T11:22:54.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.664+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7660004780 con 0x7f76680c4600 2023-08-27T11:22:54.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.665+0000 7f764ffff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 0x7f765406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:54.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.665+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7660089a10 con 0x7f76680c4600 2023-08-27T11:22:54.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.665+0000 7f7666ffd700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 0x7f765406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:54.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.665+0000 7f7666ffd700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 0x7f765406c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7658006b20 tx=0x7f7658008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:54.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.669+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7660058b80 con 0x7f76680c4600 2023-08-27T11:22:54.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.875+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76681543a0 con 0x7f765406a0e0 2023-08-27T11:22:54.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.885+0000 7f764ffff700 1 -- 172.21.15.43:0/2633412339 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286904 (secure 0 0 0) 0x7f76580076b0 con 0x7f765406a0e0 2023-08-27T11:22:54.890 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 msgr2=0x7f765406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 0x7f765406c5a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7658006b20 tx=0x7f7658008040 comp rx=0 tx=0).stop 2023-08-27T11:22:54.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 msgr2=0x7f76680ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:54.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7668067670 tx=0x7f7660004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 shutdown_connections 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f765406a0e0 0x7f765406c5a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76680c4600 0x7f76680ade40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f766806b320 0x7f76681e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 --2- 172.21.15.43:0/2633412339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f766806c690 0x7f76680ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:54.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 >> 172.21.15.43:0/2633412339 conn(0x7f76680c9c80 msgr2=0x7f766814bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:54.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 shutdown_connections 2023-08-27T11:22:54.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:54.889+0000 7f766d9ff700 1 -- 172.21.15.43:0/2633412339 wait complete. 2023-08-27T11:22:54.895 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:22:54.909 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-27T11:22:54.316408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219092,"kb_used_data":2904,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755628,"statfs":{"total":773094113280,"available":772869763072,"internally_reserved":0,"allocated":2973696,"data_stored":1817292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423095+0000","last_change":"2023-08-27T11:22:43.962060+0000","last_active":"2023-08-27T11:22:45.423095+0000","last_peered":"2023-08-27T11:22:45.423095+0000","last_clean":"2023-08-27T11:22:45.423095+0000","last_became_active":"2023-08-27T11:22:43.961142+0000","last_became_peered":"2023-08-27T11:22:43.961142+0000","last_unstale":"2023-08-27T11:22:45.423095+0000","last_undegraded":"2023-08-27T11:22:45.423095+0000","last_fullsized":"2023-08-27T11:22:45.423095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:17.327178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955284+0000","last_change":"2023-08-27T11:22:43.982097+0000","last_active":"2023-08-27T11:22:44.955284+0000","last_peered":"2023-08-27T11:22:44.955284+0000","last_clean":"2023-08-27T11:22:44.955284+0000","last_became_active":"2023-08-27T11:22:43.981793+0000","last_became_peered":"2023-08-27T11:22:43.981793+0000","last_unstale":"2023-08-27T11:22:44.955284+0000","last_undegraded":"2023-08-27T11:22:44.955284+0000","last_fullsized":"2023-08-27T11:22:44.955284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956587+0000","last_change":"2023-08-27T11:22:43.990716+0000","last_active":"2023-08-27T11:22:44.956587+0000","last_peered":"2023-08-27T11:22:44.956587+0000","last_clean":"2023-08-27T11:22:44.956587+0000","last_became_active":"2023-08-27T11:22:43.990370+0000","last_became_peered":"2023-08-27T11:22:43.990370+0000","last_unstale":"2023-08-27T11:22:44.956587+0000","last_undegraded":"2023-08-27T11:22:44.956587+0000","last_fullsized":"2023-08-27T11:22:44.956587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:30.786225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191934+0000","last_change":"2023-08-27T11:22:43.985032+0000","last_active":"2023-08-27T11:22:46.191934+0000","last_peered":"2023-08-27T11:22:46.191934+0000","last_clean":"2023-08-27T11:22:46.191934+0000","last_became_active":"2023-08-27T11:22:43.984657+0000","last_became_peered":"2023-08-27T11:22:43.984657+0000","last_unstale":"2023-08-27T11:22:46.191934+0000","last_undegraded":"2023-08-27T11:22:46.191934+0000","last_fullsized":"2023-08-27T11:22:46.191934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289220+0000","last_change":"2023-08-27T11:22:43.990182+0000","last_active":"2023-08-27T11:22:46.289220+0000","last_peered":"2023-08-27T11:22:46.289220+0000","last_clean":"2023-08-27T11:22:46.289220+0000","last_became_active":"2023-08-27T11:22:43.989876+0000","last_became_peered":"2023-08-27T11:22:43.989876+0000","last_unstale":"2023-08-27T11:22:46.289220+0000","last_undegraded":"2023-08-27T11:22:46.289220+0000","last_fullsized":"2023-08-27T11:22:46.289220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956031+0000","last_change":"2023-08-27T11:22:43.991876+0000","last_active":"2023-08-27T11:22:44.956031+0000","last_peered":"2023-08-27T11:22:44.956031+0000","last_clean":"2023-08-27T11:22:44.956031+0000","last_became_active":"2023-08-27T11:22:43.991420+0000","last_became_peered":"2023-08-27T11:22:43.991420+0000","last_unstale":"2023-08-27T11:22:44.956031+0000","last_undegraded":"2023-08-27T11:22:44.956031+0000","last_fullsized":"2023-08-27T11:22:44.956031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:44.277673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289573+0000","last_change":"2023-08-27T11:22:43.985414+0000","last_active":"2023-08-27T11:22:46.289573+0000","last_peered":"2023-08-27T11:22:46.289573+0000","last_clean":"2023-08-27T11:22:46.289573+0000","last_became_active":"2023-08-27T11:22:43.985076+0000","last_became_peered":"2023-08-27T11:22:43.985076+0000","last_unstale":"2023-08-27T11:22:46.289573+0000","last_undegraded":"2023-08-27T11:22:46.289573+0000","last_fullsized":"2023-08-27T11:22:46.289573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955019+0000","last_change":"2023-08-27T11:22:43.990228+0000","last_active":"2023-08-27T11:22:44.955019+0000","last_peered":"2023-08-27T11:22:44.955019+0000","last_clean":"2023-08-27T11:22:44.955019+0000","last_became_active":"2023-08-27T11:22:43.989893+0000","last_became_peered":"2023-08-27T11:22:43.989893+0000","last_unstale":"2023-08-27T11:22:44.955019+0000","last_undegraded":"2023-08-27T11:22:44.955019+0000","last_fullsized":"2023-08-27T11:22:44.955019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289668+0000","last_change":"2023-08-27T11:22:43.991007+0000","last_active":"2023-08-27T11:22:46.289668+0000","last_peered":"2023-08-27T11:22:46.289668+0000","last_clean":"2023-08-27T11:22:46.289668+0000","last_became_active":"2023-08-27T11:22:43.990457+0000","last_became_peered":"2023-08-27T11:22:43.990457+0000","last_unstale":"2023-08-27T11:22:46.289668+0000","last_undegraded":"2023-08-27T11:22:46.289668+0000","last_fullsized":"2023-08-27T11:22:46.289668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955768+0000","last_change":"2023-08-27T11:22:43.994376+0000","last_active":"2023-08-27T11:22:44.955768+0000","last_peered":"2023-08-27T11:22:44.955768+0000","last_clean":"2023-08-27T11:22:44.955768+0000","last_became_active":"2023-08-27T11:22:43.994066+0000","last_became_peered":"2023-08-27T11:22:43.994066+0000","last_unstale":"2023-08-27T11:22:44.955768+0000","last_undegraded":"2023-08-27T11:22:44.955768+0000","last_fullsized":"2023-08-27T11:22:44.955768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956745+0000","last_change":"2023-08-27T11:22:43.990918+0000","last_active":"2023-08-27T11:22:44.956745+0000","last_peered":"2023-08-27T11:22:44.956745+0000","last_clean":"2023-08-27T11:22:44.956745+0000","last_became_active":"2023-08-27T11:22:43.989615+0000","last_became_peered":"2023-08-27T11:22:43.989615+0000","last_unstale":"2023-08-27T11:22:44.956745+0000","last_undegraded":"2023-08-27T11:22:44.956745+0000","last_fullsized":"2023-08-27T11:22:44.956745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:35.401057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423161+0000","last_change":"2023-08-27T11:22:43.995954+0000","last_active":"2023-08-27T11:22:45.423161+0000","last_peered":"2023-08-27T11:22:45.423161+0000","last_clean":"2023-08-27T11:22:45.423161+0000","last_became_active":"2023-08-27T11:22:43.995638+0000","last_became_peered":"2023-08-27T11:22:43.995638+0000","last_unstale":"2023-08-27T11:22:45.423161+0000","last_undegraded":"2023-08-27T11:22:45.423161+0000","last_fullsized":"2023-08-27T11:22:45.423161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:42:12.998008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.422934+0000","last_change":"2023-08-27T11:22:43.961542+0000","last_active":"2023-08-27T11:22:45.422934+0000","last_peered":"2023-08-27T11:22:45.422934+0000","last_clean":"2023-08-27T11:22:45.422934+0000","last_became_active":"2023-08-27T11:22:43.961210+0000","last_became_peered":"2023-08-27T11:22:43.961210+0000","last_unstale":"2023-08-27T11:22:45.422934+0000","last_undegraded":"2023-08-27T11:22:45.422934+0000","last_fullsized":"2023-08-27T11:22:45.422934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:47.897783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955409+0000","last_change":"2023-08-27T11:22:43.980009+0000","last_active":"2023-08-27T11:22:44.955409+0000","last_peered":"2023-08-27T11:22:44.955409+0000","last_clean":"2023-08-27T11:22:44.955409+0000","last_became_active":"2023-08-27T11:22:43.979689+0000","last_became_peered":"2023-08-27T11:22:43.979689+0000","last_unstale":"2023-08-27T11:22:44.955409+0000","last_undegraded":"2023-08-27T11:22:44.955409+0000","last_fullsized":"2023-08-27T11:22:44.955409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289823+0000","last_change":"2023-08-27T11:22:43.990477+0000","last_active":"2023-08-27T11:22:46.289823+0000","last_peered":"2023-08-27T11:22:46.289823+0000","last_clean":"2023-08-27T11:22:46.289823+0000","last_became_active":"2023-08-27T11:22:43.990256+0000","last_became_peered":"2023-08-27T11:22:43.990256+0000","last_unstale":"2023-08-27T11:22:46.289823+0000","last_undegraded":"2023-08-27T11:22:46.289823+0000","last_fullsized":"2023-08-27T11:22:46.289823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955734+0000","last_change":"2023-08-27T11:22:43.989809+0000","last_active":"2023-08-27T11:22:44.955734+0000","last_peered":"2023-08-27T11:22:44.955734+0000","last_clean":"2023-08-27T11:22:44.955734+0000","last_became_active":"2023-08-27T11:22:43.989481+0000","last_became_peered":"2023-08-27T11:22:43.989481+0000","last_unstale":"2023-08-27T11:22:44.955734+0000","last_undegraded":"2023-08-27T11:22:44.955734+0000","last_fullsized":"2023-08-27T11:22:44.955734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289752+0000","last_change":"2023-08-27T11:22:43.990813+0000","last_active":"2023-08-27T11:22:46.289752+0000","last_peered":"2023-08-27T11:22:46.289752+0000","last_clean":"2023-08-27T11:22:46.289752+0000","last_became_active":"2023-08-27T11:22:43.990012+0000","last_became_peered":"2023-08-27T11:22:43.990012+0000","last_unstale":"2023-08-27T11:22:46.289752+0000","last_undegraded":"2023-08-27T11:22:46.289752+0000","last_fullsized":"2023-08-27T11:22:46.289752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956749+0000","last_change":"2023-08-27T11:22:43.989807+0000","last_active":"2023-08-27T11:22:44.956749+0000","last_peered":"2023-08-27T11:22:44.956749+0000","last_clean":"2023-08-27T11:22:44.956749+0000","last_became_active":"2023-08-27T11:22:43.989516+0000","last_became_peered":"2023-08-27T11:22:43.989516+0000","last_unstale":"2023-08-27T11:22:44.956749+0000","last_undegraded":"2023-08-27T11:22:44.956749+0000","last_fullsized":"2023-08-27T11:22:44.956749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:59:37.553187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423039+0000","last_change":"2023-08-27T11:22:43.963140+0000","last_active":"2023-08-27T11:22:45.423039+0000","last_peered":"2023-08-27T11:22:45.423039+0000","last_clean":"2023-08-27T11:22:45.423039+0000","last_became_active":"2023-08-27T11:22:43.962832+0000","last_became_peered":"2023-08-27T11:22:43.962832+0000","last_unstale":"2023-08-27T11:22:45.423039+0000","last_undegraded":"2023-08-27T11:22:45.423039+0000","last_fullsized":"2023-08-27T11:22:45.423039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:32:15.513008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956266+0000","last_change":"2023-08-27T11:22:43.993602+0000","last_active":"2023-08-27T11:22:44.956266+0000","last_peered":"2023-08-27T11:22:44.956266+0000","last_clean":"2023-08-27T11:22:44.956266+0000","last_became_active":"2023-08-27T11:22:43.993131+0000","last_became_peered":"2023-08-27T11:22:43.993131+0000","last_unstale":"2023-08-27T11:22:44.956266+0000","last_undegraded":"2023-08-27T11:22:44.956266+0000","last_fullsized":"2023-08-27T11:22:44.956266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:11.915278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289711+0000","last_change":"2023-08-27T11:22:43.987371+0000","last_active":"2023-08-27T11:22:46.289711+0000","last_peered":"2023-08-27T11:22:46.289711+0000","last_clean":"2023-08-27T11:22:46.289711+0000","last_became_active":"2023-08-27T11:22:43.987102+0000","last_became_peered":"2023-08-27T11:22:43.987102+0000","last_unstale":"2023-08-27T11:22:46.289711+0000","last_undegraded":"2023-08-27T11:22:46.289711+0000","last_fullsized":"2023-08-27T11:22:46.289711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289229+0000","last_change":"2023-08-27T11:22:43.983074+0000","last_active":"2023-08-27T11:22:46.289229+0000","last_peered":"2023-08-27T11:22:46.289229+0000","last_clean":"2023-08-27T11:22:46.289229+0000","last_became_active":"2023-08-27T11:22:43.982752+0000","last_became_peered":"2023-08-27T11:22:43.982752+0000","last_unstale":"2023-08-27T11:22:46.289229+0000","last_undegraded":"2023-08-27T11:22:46.289229+0000","last_fullsized":"2023-08-27T11:22:46.289229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953805+0000","last_change":"2023-08-27T11:22:43.987652+0000","last_active":"2023-08-27T11:22:44.953805+0000","last_peered":"2023-08-27T11:22:44.953805+0000","last_clean":"2023-08-27T11:22:44.953805+0000","last_became_active":"2023-08-27T11:22:43.987417+0000","last_became_peered":"2023-08-27T11:22:43.987417+0000","last_unstale":"2023-08-27T11:22:44.953805+0000","last_undegraded":"2023-08-27T11:22:44.953805+0000","last_fullsized":"2023-08-27T11:22:44.953805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289855+0000","last_change":"2023-08-27T11:22:43.987462+0000","last_active":"2023-08-27T11:22:46.289855+0000","last_peered":"2023-08-27T11:22:46.289855+0000","last_clean":"2023-08-27T11:22:46.289855+0000","last_became_active":"2023-08-27T11:22:43.987145+0000","last_became_peered":"2023-08-27T11:22:43.987145+0000","last_unstale":"2023-08-27T11:22:46.289855+0000","last_undegraded":"2023-08-27T11:22:46.289855+0000","last_fullsized":"2023-08-27T11:22:46.289855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289131+0000","last_change":"2023-08-27T11:22:43.990261+0000","last_active":"2023-08-27T11:22:46.289131+0000","last_peered":"2023-08-27T11:22:46.289131+0000","last_clean":"2023-08-27T11:22:46.289131+0000","last_became_active":"2023-08-27T11:22:43.989491+0000","last_became_peered":"2023-08-27T11:22:43.989491+0000","last_unstale":"2023-08-27T11:22:46.289131+0000","last_undegraded":"2023-08-27T11:22:46.289131+0000","last_fullsized":"2023-08-27T11:22:46.289131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289808+0000","last_change":"2023-08-27T11:22:43.977096+0000","last_active":"2023-08-27T11:22:46.289808+0000","last_peered":"2023-08-27T11:22:46.289808+0000","last_clean":"2023-08-27T11:22:46.289808+0000","last_became_active":"2023-08-27T11:22:43.976613+0000","last_became_peered":"2023-08-27T11:22:43.976613+0000","last_unstale":"2023-08-27T11:22:46.289808+0000","last_undegraded":"2023-08-27T11:22:46.289808+0000","last_fullsized":"2023-08-27T11:22:46.289808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955237+0000","last_change":"2023-08-27T11:22:43.983414+0000","last_active":"2023-08-27T11:22:44.955237+0000","last_peered":"2023-08-27T11:22:44.955237+0000","last_clean":"2023-08-27T11:22:44.955237+0000","last_became_active":"2023-08-27T11:22:43.983020+0000","last_became_peered":"2023-08-27T11:22:43.983020+0000","last_unstale":"2023-08-27T11:22:44.955237+0000","last_undegraded":"2023-08-27T11:22:44.955237+0000","last_fullsized":"2023-08-27T11:22:44.955237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956174+0000","last_change":"2023-08-27T11:22:42.974209+0000","last_active":"2023-08-27T11:22:44.956174+0000","last_peered":"2023-08-27T11:22:44.956174+0000","last_clean":"2023-08-27T11:22:44.956174+0000","last_became_active":"2023-08-27T11:22:42.973852+0000","last_became_peered":"2023-08-27T11:22:42.973852+0000","last_unstale":"2023-08-27T11:22:44.956174+0000","last_undegraded":"2023-08-27T11:22:44.956174+0000","last_fullsized":"2023-08-27T11:22:44.956174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954249+0000","last_change":"2023-08-27T11:22:43.978095+0000","last_active":"2023-08-27T11:22:44.954249+0000","last_peered":"2023-08-27T11:22:44.954249+0000","last_clean":"2023-08-27T11:22:44.954249+0000","last_became_active":"2023-08-27T11:22:43.977791+0000","last_became_peered":"2023-08-27T11:22:43.977791+0000","last_unstale":"2023-08-27T11:22:44.954249+0000","last_undegraded":"2023-08-27T11:22:44.954249+0000","last_fullsized":"2023-08-27T11:22:44.954249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289089+0000","last_change":"2023-08-27T11:22:42.973723+0000","last_active":"2023-08-27T11:22:46.289089+0000","last_peered":"2023-08-27T11:22:46.289089+0000","last_clean":"2023-08-27T11:22:46.289089+0000","last_became_active":"2023-08-27T11:22:42.973421+0000","last_became_peered":"2023-08-27T11:22:42.973421+0000","last_unstale":"2023-08-27T11:22:46.289089+0000","last_undegraded":"2023-08-27T11:22:46.289089+0000","last_fullsized":"2023-08-27T11:22:46.289089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:58.746701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289380+0000","last_change":"2023-08-27T11:22:43.987909+0000","last_active":"2023-08-27T11:22:46.289380+0000","last_peered":"2023-08-27T11:22:46.289380+0000","last_clean":"2023-08-27T11:22:46.289380+0000","last_became_active":"2023-08-27T11:22:43.984494+0000","last_became_peered":"2023-08-27T11:22:43.984494+0000","last_unstale":"2023-08-27T11:22:46.289380+0000","last_undegraded":"2023-08-27T11:22:46.289380+0000","last_fullsized":"2023-08-27T11:22:46.289380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953952+0000","last_change":"2023-08-27T11:22:42.972365+0000","last_active":"2023-08-27T11:22:44.953952+0000","last_peered":"2023-08-27T11:22:44.953952+0000","last_clean":"2023-08-27T11:22:44.953952+0000","last_became_active":"2023-08-27T11:22:42.972038+0000","last_became_peered":"2023-08-27T11:22:42.972038+0000","last_unstale":"2023-08-27T11:22:44.953952+0000","last_undegraded":"2023-08-27T11:22:44.953952+0000","last_fullsized":"2023-08-27T11:22:44.953952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192249+0000","last_change":"2023-08-27T11:22:43.983047+0000","last_active":"2023-08-27T11:22:46.192249+0000","last_peered":"2023-08-27T11:22:46.192249+0000","last_clean":"2023-08-27T11:22:46.192249+0000","last_became_active":"2023-08-27T11:22:43.982721+0000","last_became_peered":"2023-08-27T11:22:43.982721+0000","last_unstale":"2023-08-27T11:22:46.192249+0000","last_undegraded":"2023-08-27T11:22:46.192249+0000","last_fullsized":"2023-08-27T11:22:46.192249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289847+0000","last_change":"2023-08-27T11:22:42.977813+0000","last_active":"2023-08-27T11:22:46.289847+0000","last_peered":"2023-08-27T11:22:46.289847+0000","last_clean":"2023-08-27T11:22:46.289847+0000","last_became_active":"2023-08-27T11:22:42.976651+0000","last_became_peered":"2023-08-27T11:22:42.976651+0000","last_unstale":"2023-08-27T11:22:46.289847+0000","last_undegraded":"2023-08-27T11:22:46.289847+0000","last_fullsized":"2023-08-27T11:22:46.289847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953881+0000","last_change":"2023-08-27T11:22:43.978397+0000","last_active":"2023-08-27T11:22:44.953881+0000","last_peered":"2023-08-27T11:22:44.953881+0000","last_clean":"2023-08-27T11:22:44.953881+0000","last_became_active":"2023-08-27T11:22:43.977904+0000","last_became_peered":"2023-08-27T11:22:43.977904+0000","last_unstale":"2023-08-27T11:22:44.953881+0000","last_undegraded":"2023-08-27T11:22:44.953881+0000","last_fullsized":"2023-08-27T11:22:44.953881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:59.740892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955485+0000","last_change":"2023-08-27T11:22:42.968091+0000","last_active":"2023-08-27T11:22:44.955485+0000","last_peered":"2023-08-27T11:22:44.955485+0000","last_clean":"2023-08-27T11:22:44.955485+0000","last_became_active":"2023-08-27T11:22:42.967703+0000","last_became_peered":"2023-08-27T11:22:42.967703+0000","last_unstale":"2023-08-27T11:22:44.955485+0000","last_undegraded":"2023-08-27T11:22:44.955485+0000","last_fullsized":"2023-08-27T11:22:44.955485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954032+0000","last_change":"2023-08-27T11:22:43.982808+0000","last_active":"2023-08-27T11:22:44.954032+0000","last_peered":"2023-08-27T11:22:44.954032+0000","last_clean":"2023-08-27T11:22:44.954032+0000","last_became_active":"2023-08-27T11:22:43.982483+0000","last_became_peered":"2023-08-27T11:22:43.982483+0000","last_unstale":"2023-08-27T11:22:44.954032+0000","last_undegraded":"2023-08-27T11:22:44.954032+0000","last_fullsized":"2023-08-27T11:22:44.954032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289997+0000","last_change":"2023-08-27T11:22:42.975018+0000","last_active":"2023-08-27T11:22:46.289997+0000","last_peered":"2023-08-27T11:22:46.289997+0000","last_clean":"2023-08-27T11:22:46.289997+0000","last_became_active":"2023-08-27T11:22:42.974781+0000","last_became_peered":"2023-08-27T11:22:42.974781+0000","last_unstale":"2023-08-27T11:22:46.289997+0000","last_undegraded":"2023-08-27T11:22:46.289997+0000","last_fullsized":"2023-08-27T11:22:46.289997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:34.393641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289495+0000","last_change":"2023-08-27T11:22:43.989795+0000","last_active":"2023-08-27T11:22:46.289495+0000","last_peered":"2023-08-27T11:22:46.289495+0000","last_clean":"2023-08-27T11:22:46.289495+0000","last_became_active":"2023-08-27T11:22:43.989463+0000","last_became_peered":"2023-08-27T11:22:43.989463+0000","last_unstale":"2023-08-27T11:22:46.289495+0000","last_undegraded":"2023-08-27T11:22:46.289495+0000","last_fullsized":"2023-08-27T11:22:46.289495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956476+0000","last_change":"2023-08-27T11:22:42.969337+0000","last_active":"2023-08-27T11:22:44.956476+0000","last_peered":"2023-08-27T11:22:44.956476+0000","last_clean":"2023-08-27T11:22:44.956476+0000","last_became_active":"2023-08-27T11:22:42.967568+0000","last_became_peered":"2023-08-27T11:22:42.967568+0000","last_unstale":"2023-08-27T11:22:44.956476+0000","last_undegraded":"2023-08-27T11:22:44.956476+0000","last_fullsized":"2023-08-27T11:22:44.956476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956732+0000","last_change":"2023-08-27T11:22:43.989937+0000","last_active":"2023-08-27T11:22:44.956732+0000","last_peered":"2023-08-27T11:22:44.956732+0000","last_clean":"2023-08-27T11:22:44.956732+0000","last_became_active":"2023-08-27T11:22:43.989210+0000","last_became_peered":"2023-08-27T11:22:43.989210+0000","last_unstale":"2023-08-27T11:22:44.956732+0000","last_undegraded":"2023-08-27T11:22:44.956732+0000","last_fullsized":"2023-08-27T11:22:44.956732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:41.497181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289446+0000","last_change":"2023-08-27T11:22:42.976288+0000","last_active":"2023-08-27T11:22:46.289446+0000","last_peered":"2023-08-27T11:22:46.289446+0000","last_clean":"2023-08-27T11:22:46.289446+0000","last_became_active":"2023-08-27T11:22:42.975626+0000","last_became_peered":"2023-08-27T11:22:42.975626+0000","last_unstale":"2023-08-27T11:22:46.289446+0000","last_undegraded":"2023-08-27T11:22:46.289446+0000","last_fullsized":"2023-08-27T11:22:46.289446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:10.907862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954234+0000","last_change":"2023-08-27T11:22:43.981780+0000","last_active":"2023-08-27T11:22:44.954234+0000","last_peered":"2023-08-27T11:22:44.954234+0000","last_clean":"2023-08-27T11:22:44.954234+0000","last_became_active":"2023-08-27T11:22:43.980808+0000","last_became_peered":"2023-08-27T11:22:43.980808+0000","last_unstale":"2023-08-27T11:22:44.954234+0000","last_undegraded":"2023-08-27T11:22:44.954234+0000","last_fullsized":"2023-08-27T11:22:44.954234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289365+0000","last_change":"2023-08-27T11:22:42.979381+0000","last_active":"2023-08-27T11:22:46.289365+0000","last_peered":"2023-08-27T11:22:46.289365+0000","last_clean":"2023-08-27T11:22:46.289365+0000","last_became_active":"2023-08-27T11:22:42.979013+0000","last_became_peered":"2023-08-27T11:22:42.979013+0000","last_unstale":"2023-08-27T11:22:46.289365+0000","last_undegraded":"2023-08-27T11:22:46.289365+0000","last_fullsized":"2023-08-27T11:22:46.289365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955479+0000","last_change":"2023-08-27T11:22:43.983263+0000","last_active":"2023-08-27T11:22:44.955479+0000","last_peered":"2023-08-27T11:22:44.955479+0000","last_clean":"2023-08-27T11:22:44.955479+0000","last_became_active":"2023-08-27T11:22:43.982671+0000","last_became_peered":"2023-08-27T11:22:43.982671+0000","last_unstale":"2023-08-27T11:22:44.955479+0000","last_undegraded":"2023-08-27T11:22:44.955479+0000","last_fullsized":"2023-08-27T11:22:44.955479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289558+0000","last_change":"2023-08-27T11:22:42.973411+0000","last_active":"2023-08-27T11:22:46.289558+0000","last_peered":"2023-08-27T11:22:46.289558+0000","last_clean":"2023-08-27T11:22:46.289558+0000","last_became_active":"2023-08-27T11:22:42.973006+0000","last_became_peered":"2023-08-27T11:22:42.973006+0000","last_unstale":"2023-08-27T11:22:46.289558+0000","last_undegraded":"2023-08-27T11:22:46.289558+0000","last_fullsized":"2023-08-27T11:22:46.289558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289027+0000","last_change":"2023-08-27T11:22:43.988160+0000","last_active":"2023-08-27T11:22:46.289027+0000","last_peered":"2023-08-27T11:22:46.289027+0000","last_clean":"2023-08-27T11:22:46.289027+0000","last_became_active":"2023-08-27T11:22:43.985877+0000","last_became_peered":"2023-08-27T11:22:43.985877+0000","last_unstale":"2023-08-27T11:22:46.289027+0000","last_undegraded":"2023-08-27T11:22:46.289027+0000","last_fullsized":"2023-08-27T11:22:46.289027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:54.726096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191882+0000","last_change":"2023-08-27T11:22:42.967442+0000","last_active":"2023-08-27T11:22:46.191882+0000","last_peered":"2023-08-27T11:22:46.191882+0000","last_clean":"2023-08-27T11:22:46.191882+0000","last_became_active":"2023-08-27T11:22:42.967161+0000","last_became_peered":"2023-08-27T11:22:42.967161+0000","last_unstale":"2023-08-27T11:22:46.191882+0000","last_undegraded":"2023-08-27T11:22:46.191882+0000","last_fullsized":"2023-08-27T11:22:46.191882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:47.998679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954449+0000","last_change":"2023-08-27T11:22:43.983069+0000","last_active":"2023-08-27T11:22:44.954449+0000","last_peered":"2023-08-27T11:22:44.954449+0000","last_clean":"2023-08-27T11:22:44.954449+0000","last_became_active":"2023-08-27T11:22:43.982751+0000","last_became_peered":"2023-08-27T11:22:43.982751+0000","last_unstale":"2023-08-27T11:22:44.954449+0000","last_undegraded":"2023-08-27T11:22:44.954449+0000","last_fullsized":"2023-08-27T11:22:44.954449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:18.462257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289880+0000","last_change":"2023-08-27T11:22:42.973476+0000","last_active":"2023-08-27T11:22:46.289880+0000","last_peered":"2023-08-27T11:22:46.289880+0000","last_clean":"2023-08-27T11:22:46.289880+0000","last_became_active":"2023-08-27T11:22:42.973240+0000","last_became_peered":"2023-08-27T11:22:42.973240+0000","last_unstale":"2023-08-27T11:22:46.289880+0000","last_undegraded":"2023-08-27T11:22:46.289880+0000","last_fullsized":"2023-08-27T11:22:46.289880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:17.454841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955122+0000","last_change":"2023-08-27T11:22:43.981699+0000","last_active":"2023-08-27T11:22:44.955122+0000","last_peered":"2023-08-27T11:22:44.955122+0000","last_clean":"2023-08-27T11:22:44.955122+0000","last_became_active":"2023-08-27T11:22:43.981386+0000","last_became_peered":"2023-08-27T11:22:43.981386+0000","last_unstale":"2023-08-27T11:22:44.955122+0000","last_undegraded":"2023-08-27T11:22:44.955122+0000","last_fullsized":"2023-08-27T11:22:44.955122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289777+0000","last_change":"2023-08-27T11:22:42.974214+0000","last_active":"2023-08-27T11:22:46.289777+0000","last_peered":"2023-08-27T11:22:46.289777+0000","last_clean":"2023-08-27T11:22:46.289777+0000","last_became_active":"2023-08-27T11:22:42.973985+0000","last_became_peered":"2023-08-27T11:22:42.973985+0000","last_unstale":"2023-08-27T11:22:46.289777+0000","last_undegraded":"2023-08-27T11:22:46.289777+0000","last_fullsized":"2023-08-27T11:22:46.289777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955831+0000","last_change":"2023-08-27T11:22:43.992116+0000","last_active":"2023-08-27T11:22:44.955831+0000","last_peered":"2023-08-27T11:22:44.955831+0000","last_clean":"2023-08-27T11:22:44.955831+0000","last_became_active":"2023-08-27T11:22:43.990772+0000","last_became_peered":"2023-08-27T11:22:43.990772+0000","last_unstale":"2023-08-27T11:22:44.955831+0000","last_undegraded":"2023-08-27T11:22:44.955831+0000","last_fullsized":"2023-08-27T11:22:44.955831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289700+0000","last_change":"2023-08-27T11:22:42.975882+0000","last_active":"2023-08-27T11:22:46.289700+0000","last_peered":"2023-08-27T11:22:46.289700+0000","last_clean":"2023-08-27T11:22:46.289700+0000","last_became_active":"2023-08-27T11:22:42.975464+0000","last_became_peered":"2023-08-27T11:22:42.975464+0000","last_unstale":"2023-08-27T11:22:46.289700+0000","last_undegraded":"2023-08-27T11:22:46.289700+0000","last_fullsized":"2023-08-27T11:22:46.289700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:45.897644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192064+0000","last_change":"2023-08-27T11:22:43.984717+0000","last_active":"2023-08-27T11:22:46.192064+0000","last_peered":"2023-08-27T11:22:46.192064+0000","last_clean":"2023-08-27T11:22:46.192064+0000","last_became_active":"2023-08-27T11:22:43.984130+0000","last_became_peered":"2023-08-27T11:22:43.984130+0000","last_unstale":"2023-08-27T11:22:46.192064+0000","last_undegraded":"2023-08-27T11:22:46.192064+0000","last_fullsized":"2023-08-27T11:22:46.192064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955583+0000","last_change":"2023-08-27T11:22:42.970752+0000","last_active":"2023-08-27T11:22:44.955583+0000","last_peered":"2023-08-27T11:22:44.955583+0000","last_clean":"2023-08-27T11:22:44.955583+0000","last_became_active":"2023-08-27T11:22:42.970459+0000","last_became_peered":"2023-08-27T11:22:42.970459+0000","last_unstale":"2023-08-27T11:22:44.955583+0000","last_undegraded":"2023-08-27T11:22:44.955583+0000","last_fullsized":"2023-08-27T11:22:44.955583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289465+0000","last_change":"2023-08-27T11:22:43.983613+0000","last_active":"2023-08-27T11:22:46.289465+0000","last_peered":"2023-08-27T11:22:46.289465+0000","last_clean":"2023-08-27T11:22:46.289465+0000","last_became_active":"2023-08-27T11:22:43.982933+0000","last_became_peered":"2023-08-27T11:22:43.982933+0000","last_unstale":"2023-08-27T11:22:46.289465+0000","last_undegraded":"2023-08-27T11:22:46.289465+0000","last_fullsized":"2023-08-27T11:22:46.289465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954373+0000","last_change":"2023-08-27T11:22:42.981320+0000","last_active":"2023-08-27T11:22:44.954373+0000","last_peered":"2023-08-27T11:22:44.954373+0000","last_clean":"2023-08-27T11:22:44.954373+0000","last_became_active":"2023-08-27T11:22:42.980963+0000","last_became_peered":"2023-08-27T11:22:42.980963+0000","last_unstale":"2023-08-27T11:22:44.954373+0000","last_undegraded":"2023-08-27T11:22:44.954373+0000","last_fullsized":"2023-08-27T11:22:44.954373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:24:29.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956231+0000","last_change":"2023-08-27T11:22:43.993427+0000","last_active":"2023-08-27T11:22:44.956231+0000","last_peered":"2023-08-27T11:22:44.956231+0000","last_clean":"2023-08-27T11:22:44.956231+0000","last_became_active":"2023-08-27T11:22:43.992811+0000","last_became_peered":"2023-08-27T11:22:43.992811+0000","last_unstale":"2023-08-27T11:22:44.956231+0000","last_undegraded":"2023-08-27T11:22:44.956231+0000","last_fullsized":"2023-08-27T11:22:44.956231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:16.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192145+0000","last_change":"2023-08-27T11:22:42.972531+0000","last_active":"2023-08-27T11:22:46.192145+0000","last_peered":"2023-08-27T11:22:46.192145+0000","last_clean":"2023-08-27T11:22:46.192145+0000","last_became_active":"2023-08-27T11:22:42.972138+0000","last_became_peered":"2023-08-27T11:22:42.972138+0000","last_unstale":"2023-08-27T11:22:46.192145+0000","last_undegraded":"2023-08-27T11:22:46.192145+0000","last_fullsized":"2023-08-27T11:22:46.192145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:51.423177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956856+0000","last_change":"2023-08-27T11:22:43.989896+0000","last_active":"2023-08-27T11:22:44.956856+0000","last_peered":"2023-08-27T11:22:44.956856+0000","last_clean":"2023-08-27T11:22:44.956856+0000","last_became_active":"2023-08-27T11:22:43.989230+0000","last_became_peered":"2023-08-27T11:22:43.989230+0000","last_unstale":"2023-08-27T11:22:44.956856+0000","last_undegraded":"2023-08-27T11:22:44.956856+0000","last_fullsized":"2023-08-27T11:22:44.956856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:51.087286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956010+0000","last_change":"2023-08-27T11:22:42.958843+0000","last_active":"2023-08-27T11:22:44.956010+0000","last_peered":"2023-08-27T11:22:44.956010+0000","last_clean":"2023-08-27T11:22:44.956010+0000","last_became_active":"2023-08-27T11:22:42.958485+0000","last_became_peered":"2023-08-27T11:22:42.958485+0000","last_unstale":"2023-08-27T11:22:44.956010+0000","last_undegraded":"2023-08-27T11:22:44.956010+0000","last_fullsized":"2023-08-27T11:22:44.956010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:58.733476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956871+0000","last_change":"2023-08-27T11:22:43.989191+0000","last_active":"2023-08-27T11:22:44.956871+0000","last_peered":"2023-08-27T11:22:44.956871+0000","last_clean":"2023-08-27T11:22:44.956871+0000","last_became_active":"2023-08-27T11:22:43.988840+0000","last_became_peered":"2023-08-27T11:22:43.988840+0000","last_unstale":"2023-08-27T11:22:44.956871+0000","last_undegraded":"2023-08-27T11:22:44.956871+0000","last_fullsized":"2023-08-27T11:22:44.956871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.642446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953825+0000","last_change":"2023-08-27T11:22:42.976094+0000","last_active":"2023-08-27T11:22:44.953825+0000","last_peered":"2023-08-27T11:22:44.953825+0000","last_clean":"2023-08-27T11:22:44.953825+0000","last_became_active":"2023-08-27T11:22:42.975763+0000","last_became_peered":"2023-08-27T11:22:42.975763+0000","last_unstale":"2023-08-27T11:22:44.953825+0000","last_undegraded":"2023-08-27T11:22:44.953825+0000","last_fullsized":"2023-08-27T11:22:44.953825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289408+0000","last_change":"2023-08-27T11:22:43.986813+0000","last_active":"2023-08-27T11:22:46.289408+0000","last_peered":"2023-08-27T11:22:46.289408+0000","last_clean":"2023-08-27T11:22:46.289408+0000","last_became_active":"2023-08-27T11:22:43.986301+0000","last_became_peered":"2023-08-27T11:22:43.986301+0000","last_unstale":"2023-08-27T11:22:46.289408+0000","last_undegraded":"2023-08-27T11:22:46.289408+0000","last_fullsized":"2023-08-27T11:22:46.289408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954367+0000","last_change":"2023-08-27T11:22:42.970688+0000","last_active":"2023-08-27T11:22:44.954367+0000","last_peered":"2023-08-27T11:22:44.954367+0000","last_clean":"2023-08-27T11:22:44.954367+0000","last_became_active":"2023-08-27T11:22:42.970294+0000","last_became_peered":"2023-08-27T11:22:42.970294+0000","last_unstale":"2023-08-27T11:22:44.954367+0000","last_undegraded":"2023-08-27T11:22:44.954367+0000","last_fullsized":"2023-08-27T11:22:44.954367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:29.778808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956655+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:22:44.956655+0000","last_peered":"2023-08-27T11:22:44.956655+0000","last_clean":"2023-08-27T11:22:44.956655+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:22:44.956655+0000","last_undegraded":"2023-08-27T11:22:44.956655+0000","last_fullsized":"2023-08-27T11:22:44.956655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:45:11.427186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953730+0000","last_change":"2023-08-27T11:22:43.982339+0000","last_active":"2023-08-27T11:22:44.953730+0000","last_peered":"2023-08-27T11:22:44.953730+0000","last_clean":"2023-08-27T11:22:44.953730+0000","last_became_active":"2023-08-27T11:22:43.982008+0000","last_became_peered":"2023-08-27T11:22:43.982008+0000","last_unstale":"2023-08-27T11:22:44.953730+0000","last_undegraded":"2023-08-27T11:22:44.953730+0000","last_fullsized":"2023-08-27T11:22:44.953730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:52.430593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954148+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:22:44.954148+0000","last_peered":"2023-08-27T11:22:44.954148+0000","last_clean":"2023-08-27T11:22:44.954148+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:22:44.954148+0000","last_undegraded":"2023-08-27T11:22:44.954148+0000","last_fullsized":"2023-08-27T11:22:44.954148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:04.880208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289540+0000","last_change":"2023-08-27T11:22:42.980391+0000","last_active":"2023-08-27T11:22:46.289540+0000","last_peered":"2023-08-27T11:22:46.289540+0000","last_clean":"2023-08-27T11:22:46.289540+0000","last_became_active":"2023-08-27T11:22:42.979955+0000","last_became_peered":"2023-08-27T11:22:42.979955+0000","last_unstale":"2023-08-27T11:22:46.289540+0000","last_undegraded":"2023-08-27T11:22:46.289540+0000","last_fullsized":"2023-08-27T11:22:46.289540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:08.271131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955978+0000","last_change":"2023-08-27T11:22:43.990732+0000","last_active":"2023-08-27T11:22:44.955978+0000","last_peered":"2023-08-27T11:22:44.955978+0000","last_clean":"2023-08-27T11:22:44.955978+0000","last_became_active":"2023-08-27T11:22:43.990460+0000","last_became_peered":"2023-08-27T11:22:43.990460+0000","last_unstale":"2023-08-27T11:22:44.955978+0000","last_undegraded":"2023-08-27T11:22:44.955978+0000","last_fullsized":"2023-08-27T11:22:44.955978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288960+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:22:46.288960+0000","last_peered":"2023-08-27T11:22:46.288960+0000","last_clean":"2023-08-27T11:22:46.288960+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:22:46.288960+0000","last_undegraded":"2023-08-27T11:22:46.288960+0000","last_fullsized":"2023-08-27T11:22:46.288960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:47.691026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289882+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:22:46.289882+0000","last_peered":"2023-08-27T11:22:46.289882+0000","last_clean":"2023-08-27T11:22:46.289882+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:22:46.289882+0000","last_undegraded":"2023-08-27T11:22:46.289882+0000","last_fullsized":"2023-08-27T11:22:46.289882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:24.754495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288976+0000","last_change":"2023-08-27T11:22:42.978246+0000","last_active":"2023-08-27T11:22:46.288976+0000","last_peered":"2023-08-27T11:22:46.288976+0000","last_clean":"2023-08-27T11:22:46.288976+0000","last_became_active":"2023-08-27T11:22:42.976711+0000","last_became_peered":"2023-08-27T11:22:42.976711+0000","last_unstale":"2023-08-27T11:22:46.288976+0000","last_undegraded":"2023-08-27T11:22:46.288976+0000","last_fullsized":"2023-08-27T11:22:46.288976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289176+0000","last_change":"2023-08-27T11:22:43.987923+0000","last_active":"2023-08-27T11:22:46.289176+0000","last_peered":"2023-08-27T11:22:46.289176+0000","last_clean":"2023-08-27T11:22:46.289176+0000","last_became_active":"2023-08-27T11:22:43.985057+0000","last_became_peered":"2023-08-27T11:22:43.985057+0000","last_unstale":"2023-08-27T11:22:46.289176+0000","last_undegraded":"2023-08-27T11:22:46.289176+0000","last_fullsized":"2023-08-27T11:22:46.289176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:59.754118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289777+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:22:46.289777+0000","last_peered":"2023-08-27T11:22:46.289777+0000","last_clean":"2023-08-27T11:22:46.289777+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:22:46.289777+0000","last_undegraded":"2023-08-27T11:22:46.289777+0000","last_fullsized":"2023-08-27T11:22:46.289777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:22.843008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.288702+0000","last_change":"2023-08-27T11:22:42.974293+0000","last_active":"2023-08-27T11:22:46.288702+0000","last_peered":"2023-08-27T11:22:46.288702+0000","last_clean":"2023-08-27T11:22:46.288702+0000","last_became_active":"2023-08-27T11:22:42.973989+0000","last_became_peered":"2023-08-27T11:22:42.973989+0000","last_unstale":"2023-08-27T11:22:46.288702+0000","last_undegraded":"2023-08-27T11:22:46.288702+0000","last_fullsized":"2023-08-27T11:22:46.288702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:51.516724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289268+0000","last_change":"2023-08-27T11:22:43.979605+0000","last_active":"2023-08-27T11:22:46.289268+0000","last_peered":"2023-08-27T11:22:46.289268+0000","last_clean":"2023-08-27T11:22:46.289268+0000","last_became_active":"2023-08-27T11:22:43.979323+0000","last_became_peered":"2023-08-27T11:22:43.979323+0000","last_unstale":"2023-08-27T11:22:46.289268+0000","last_undegraded":"2023-08-27T11:22:46.289268+0000","last_fullsized":"2023-08-27T11:22:46.289268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:20:49.006095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289375+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:22:46.289375+0000","last_peered":"2023-08-27T11:22:46.289375+0000","last_clean":"2023-08-27T11:22:46.289375+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:22:46.289375+0000","last_undegraded":"2023-08-27T11:22:46.289375+0000","last_fullsized":"2023-08-27T11:22:46.289375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:37.242602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953924+0000","last_change":"2023-08-27T11:22:42.970697+0000","last_active":"2023-08-27T11:22:44.953924+0000","last_peered":"2023-08-27T11:22:44.953924+0000","last_clean":"2023-08-27T11:22:44.953924+0000","last_became_active":"2023-08-27T11:22:42.970380+0000","last_became_peered":"2023-08-27T11:22:42.970380+0000","last_unstale":"2023-08-27T11:22:44.953924+0000","last_undegraded":"2023-08-27T11:22:44.953924+0000","last_fullsized":"2023-08-27T11:22:44.953924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192146+0000","last_change":"2023-08-27T11:22:43.992399+0000","last_active":"2023-08-27T11:22:46.192146+0000","last_peered":"2023-08-27T11:22:46.192146+0000","last_clean":"2023-08-27T11:22:46.192146+0000","last_became_active":"2023-08-27T11:22:43.991762+0000","last_became_peered":"2023-08-27T11:22:43.991762+0000","last_unstale":"2023-08-27T11:22:46.192146+0000","last_undegraded":"2023-08-27T11:22:46.192146+0000","last_fullsized":"2023-08-27T11:22:46.192146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955449+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:22:44.955449+0000","last_peered":"2023-08-27T11:22:44.955449+0000","last_clean":"2023-08-27T11:22:44.955449+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:22:44.955449+0000","last_undegraded":"2023-08-27T11:22:44.955449+0000","last_fullsized":"2023-08-27T11:22:44.955449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956560+0000","last_change":"2023-08-27T11:22:42.981231+0000","last_active":"2023-08-27T11:22:44.956560+0000","last_peered":"2023-08-27T11:22:44.956560+0000","last_clean":"2023-08-27T11:22:44.956560+0000","last_became_active":"2023-08-27T11:22:42.980906+0000","last_became_peered":"2023-08-27T11:22:42.980906+0000","last_unstale":"2023-08-27T11:22:44.956560+0000","last_undegraded":"2023-08-27T11:22:44.956560+0000","last_fullsized":"2023-08-27T11:22:44.956560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:16.019627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289728+0000","last_change":"2023-08-27T11:22:43.980912+0000","last_active":"2023-08-27T11:22:46.289728+0000","last_peered":"2023-08-27T11:22:46.289728+0000","last_clean":"2023-08-27T11:22:46.289728+0000","last_became_active":"2023-08-27T11:22:43.980561+0000","last_became_peered":"2023-08-27T11:22:43.980561+0000","last_unstale":"2023-08-27T11:22:46.289728+0000","last_undegraded":"2023-08-27T11:22:46.289728+0000","last_fullsized":"2023-08-27T11:22:46.289728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:31.847372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192249+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:22:46.192249+0000","last_peered":"2023-08-27T11:22:46.192249+0000","last_clean":"2023-08-27T11:22:46.192249+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:22:46.192249+0000","last_undegraded":"2023-08-27T11:22:46.192249+0000","last_fullsized":"2023-08-27T11:22:46.192249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:15.410812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289581+0000","last_change":"2023-08-27T11:22:42.974572+0000","last_active":"2023-08-27T11:22:46.289581+0000","last_peered":"2023-08-27T11:22:46.289581+0000","last_clean":"2023-08-27T11:22:46.289581+0000","last_became_active":"2023-08-27T11:22:42.973936+0000","last_became_peered":"2023-08-27T11:22:42.973936+0000","last_unstale":"2023-08-27T11:22:46.289581+0000","last_undegraded":"2023-08-27T11:22:46.289581+0000","last_fullsized":"2023-08-27T11:22:46.289581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:32.202757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289238+0000","last_change":"2023-08-27T11:22:43.983828+0000","last_active":"2023-08-27T11:22:46.289238+0000","last_peered":"2023-08-27T11:22:46.289238+0000","last_clean":"2023-08-27T11:22:46.289238+0000","last_became_active":"2023-08-27T11:22:43.983297+0000","last_became_peered":"2023-08-27T11:22:43.983297+0000","last_unstale":"2023-08-27T11:22:46.289238+0000","last_undegraded":"2023-08-27T11:22:46.289238+0000","last_fullsized":"2023-08-27T11:22:46.289238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:11.964567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.192128+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:22:46.192128+0000","last_peered":"2023-08-27T11:22:46.192128+0000","last_clean":"2023-08-27T11:22:46.192128+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:22:46.192128+0000","last_undegraded":"2023-08-27T11:22:46.192128+0000","last_fullsized":"2023-08-27T11:22:46.192128+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:26.175102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956090+0000","last_change":"2023-08-27T11:22:42.970931+0000","last_active":"2023-08-27T11:22:44.956090+0000","last_peered":"2023-08-27T11:22:44.956090+0000","last_clean":"2023-08-27T11:22:44.956090+0000","last_became_active":"2023-08-27T11:22:42.970639+0000","last_became_peered":"2023-08-27T11:22:42.970639+0000","last_unstale":"2023-08-27T11:22:44.956090+0000","last_undegraded":"2023-08-27T11:22:44.956090+0000","last_fullsized":"2023-08-27T11:22:44.956090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:36.522498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289671+0000","last_change":"2023-08-27T11:22:43.978747+0000","last_active":"2023-08-27T11:22:46.289671+0000","last_peered":"2023-08-27T11:22:46.289671+0000","last_clean":"2023-08-27T11:22:46.289671+0000","last_became_active":"2023-08-27T11:22:43.978452+0000","last_became_peered":"2023-08-27T11:22:43.978452+0000","last_unstale":"2023-08-27T11:22:46.289671+0000","last_undegraded":"2023-08-27T11:22:46.289671+0000","last_fullsized":"2023-08-27T11:22:46.289671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:09.278547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289680+0000","last_change":"2023-08-27T11:22:42.978613+0000","last_active":"2023-08-27T11:22:46.289680+0000","last_peered":"2023-08-27T11:22:46.289680+0000","last_clean":"2023-08-27T11:22:46.289680+0000","last_became_active":"2023-08-27T11:22:42.978242+0000","last_became_peered":"2023-08-27T11:22:42.978242+0000","last_unstale":"2023-08-27T11:22:46.289680+0000","last_undegraded":"2023-08-27T11:22:46.289680+0000","last_fullsized":"2023-08-27T11:22:46.289680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:21.438467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:45.423097+0000","last_change":"2023-08-27T11:22:43.979802+0000","last_active":"2023-08-27T11:22:45.423097+0000","last_peered":"2023-08-27T11:22:45.423097+0000","last_clean":"2023-08-27T11:22:45.423097+0000","last_became_active":"2023-08-27T11:22:43.979457+0000","last_became_peered":"2023-08-27T11:22:43.979457+0000","last_unstale":"2023-08-27T11:22:45.423097+0000","last_undegraded":"2023-08-27T11:22:45.423097+0000","last_fullsized":"2023-08-27T11:22:45.423097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:08.123051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955380+0000","last_change":"2023-08-27T11:22:42.970531+0000","last_active":"2023-08-27T11:22:44.955380+0000","last_peered":"2023-08-27T11:22:44.955380+0000","last_clean":"2023-08-27T11:22:44.955380+0000","last_became_active":"2023-08-27T11:22:42.970063+0000","last_became_peered":"2023-08-27T11:22:42.970063+0000","last_unstale":"2023-08-27T11:22:44.955380+0000","last_undegraded":"2023-08-27T11:22:44.955380+0000","last_fullsized":"2023-08-27T11:22:44.955380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.677370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956373+0000","last_change":"2023-08-27T11:22:43.990179+0000","last_active":"2023-08-27T11:22:44.956373+0000","last_peered":"2023-08-27T11:22:44.956373+0000","last_clean":"2023-08-27T11:22:44.956373+0000","last_became_active":"2023-08-27T11:22:43.989642+0000","last_became_peered":"2023-08-27T11:22:43.989642+0000","last_unstale":"2023-08-27T11:22:44.956373+0000","last_undegraded":"2023-08-27T11:22:44.956373+0000","last_fullsized":"2023-08-27T11:22:44.956373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:47:29.878078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955879+0000","last_change":"2023-08-27T11:22:42.966238+0000","last_active":"2023-08-27T11:22:44.955879+0000","last_peered":"2023-08-27T11:22:44.955879+0000","last_clean":"2023-08-27T11:22:44.955879+0000","last_became_active":"2023-08-27T11:22:42.965938+0000","last_became_peered":"2023-08-27T11:22:42.965938+0000","last_unstale":"2023-08-27T11:22:44.955879+0000","last_undegraded":"2023-08-27T11:22:44.955879+0000","last_fullsized":"2023-08-27T11:22:44.955879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956394+0000","last_change":"2023-08-27T11:22:43.991696+0000","last_active":"2023-08-27T11:22:44.956394+0000","last_peered":"2023-08-27T11:22:44.956394+0000","last_clean":"2023-08-27T11:22:44.956394+0000","last_became_active":"2023-08-27T11:22:43.991150+0000","last_became_peered":"2023-08-27T11:22:43.991150+0000","last_unstale":"2023-08-27T11:22:44.956394+0000","last_undegraded":"2023-08-27T11:22:44.956394+0000","last_fullsized":"2023-08-27T11:22:44.956394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:46.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953861+0000","last_change":"2023-08-27T11:22:42.970669+0000","last_active":"2023-08-27T11:22:44.953861+0000","last_peered":"2023-08-27T11:22:44.953861+0000","last_clean":"2023-08-27T11:22:44.953861+0000","last_became_active":"2023-08-27T11:22:42.970385+0000","last_became_peered":"2023-08-27T11:22:42.970385+0000","last_unstale":"2023-08-27T11:22:44.953861+0000","last_undegraded":"2023-08-27T11:22:44.953861+0000","last_fullsized":"2023-08-27T11:22:44.953861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:30.839956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953966+0000","last_change":"2023-08-27T11:22:43.964703+0000","last_active":"2023-08-27T11:22:44.953966+0000","last_peered":"2023-08-27T11:22:44.953966+0000","last_clean":"2023-08-27T11:22:44.953966+0000","last_became_active":"2023-08-27T11:22:43.964343+0000","last_became_peered":"2023-08-27T11:22:43.964343+0000","last_unstale":"2023-08-27T11:22:44.953966+0000","last_undegraded":"2023-08-27T11:22:44.953966+0000","last_fullsized":"2023-08-27T11:22:44.953966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289846+0000","last_change":"2023-08-27T11:22:42.977833+0000","last_active":"2023-08-27T11:22:46.289846+0000","last_peered":"2023-08-27T11:22:46.289846+0000","last_clean":"2023-08-27T11:22:46.289846+0000","last_became_active":"2023-08-27T11:22:42.977061+0000","last_became_peered":"2023-08-27T11:22:42.977061+0000","last_unstale":"2023-08-27T11:22:46.289846+0000","last_undegraded":"2023-08-27T11:22:46.289846+0000","last_fullsized":"2023-08-27T11:22:46.289846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:41.934398+0000","last_clean_scrub_stamp":"2023-08-27T11:22:41.934398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.270257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.955674+0000","last_change":"2023-08-27T11:22:43.989253+0000","last_active":"2023-08-27T11:22:44.955674+0000","last_peered":"2023-08-27T11:22:44.955674+0000","last_clean":"2023-08-27T11:22:44.955674+0000","last_became_active":"2023-08-27T11:22:43.988860+0000","last_became_peered":"2023-08-27T11:22:43.988860+0000","last_unstale":"2023-08-27T11:22:44.955674+0000","last_undegraded":"2023-08-27T11:22:44.955674+0000","last_fullsized":"2023-08-27T11:22:44.955674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:33.210173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.191791+0000","last_change":"2023-08-27T11:22:43.962222+0000","last_active":"2023-08-27T11:22:46.191791+0000","last_peered":"2023-08-27T11:22:46.191791+0000","last_clean":"2023-08-27T11:22:46.191791+0000","last_became_active":"2023-08-27T11:22:43.961880+0000","last_became_peered":"2023-08-27T11:22:43.961880+0000","last_unstale":"2023-08-27T11:22:46.191791+0000","last_undegraded":"2023-08-27T11:22:46.191791+0000","last_fullsized":"2023-08-27T11:22:46.191791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:16:01.067939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.953872+0000","last_change":"2023-08-27T11:22:43.983558+0000","last_active":"2023-08-27T11:22:44.953872+0000","last_peered":"2023-08-27T11:22:44.953872+0000","last_clean":"2023-08-27T11:22:44.953872+0000","last_became_active":"2023-08-27T11:22:43.981569+0000","last_became_peered":"2023-08-27T11:22:43.981569+0000","last_unstale":"2023-08-27T11:22:44.953872+0000","last_undegraded":"2023-08-27T11:22:44.953872+0000","last_fullsized":"2023-08-27T11:22:44.953872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:22.445883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.956171+0000","last_change":"2023-08-27T11:22:43.995288+0000","last_active":"2023-08-27T11:22:44.956171+0000","last_peered":"2023-08-27T11:22:44.956171+0000","last_clean":"2023-08-27T11:22:44.956171+0000","last_became_active":"2023-08-27T11:22:43.995014+0000","last_became_peered":"2023-08-27T11:22:43.995014+0000","last_unstale":"2023-08-27T11:22:44.956171+0000","last_undegraded":"2023-08-27T11:22:44.956171+0000","last_fullsized":"2023-08-27T11:22:44.956171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:04.696841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:44.954375+0000","last_change":"2023-08-27T11:22:43.983608+0000","last_active":"2023-08-27T11:22:44.954375+0000","last_peered":"2023-08-27T11:22:44.954375+0000","last_clean":"2023-08-27T11:22:44.954375+0000","last_became_active":"2023-08-27T11:22:43.983327+0000","last_became_peered":"2023-08-27T11:22:43.983327+0000","last_unstale":"2023-08-27T11:22:44.954375+0000","last_undegraded":"2023-08-27T11:22:44.954375+0000","last_fullsized":"2023-08-27T11:22:44.954375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:17.027043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-27T11:22:46.289431+0000","last_change":"2023-08-27T11:22:43.984397+0000","last_active":"2023-08-27T11:22:46.289431+0000","last_peered":"2023-08-27T11:22:46.289431+0000","last_clean":"2023-08-27T11:22:46.289431+0000","last_became_active":"2023-08-27T11:22:43.984028+0000","last_became_peered":"2023-08-27T11:22:43.984028+0000","last_unstale":"2023-08-27T11:22:46.289431+0000","last_undegraded":"2023-08-27T11:22:46.289431+0000","last_fullsized":"2023-08-27T11:22:46.289431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:42.941814+0000","last_clean_scrub_stamp":"2023-08-27T11:22:42.941814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:03.684787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":671656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":78474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":669828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":79460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":78564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4249999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.928000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9390000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":79126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:22:54.915 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-27T11:22:54.916 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-27T11:22:54.916 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-27T11:22:54.917 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-27T11:22:55.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.148+0000 7f9e0b7ff700 1 Processor -- start 2023-08-27T11:22:55.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.148+0000 7f9e0b7ff700 1 -- start start 2023-08-27T11:22:55.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e0b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 0x7f9e040c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e0b7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e041546f0 con 0x7f9e0406c690 2023-08-27T11:22:55.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e0b7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e040c4bb0 con 0x7f9e0406b320 2023-08-27T11:22:55.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e0b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040c65c0 con 0x7f9e040c4600 2023-08-27T11:22:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e08d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9e0406c690 0x7f9e040c5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44882/0 (socket says 172.21.15.43:44882) 2023-08-27T11:22:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.149+0000 7f9e08d9a700 1 -- 172.21.15.43:0/1469143025 learned_addr learned my addr 172.21.15.43:0/1469143025 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9e09d9c700 1 --2- 172.21.15.43:0/1469143025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 0x7f9e040c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160636467 0 0) 0x7f9e041546f0 con 0x7f9e0406c690 2023-08-27T11:22:55.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df00035b0 con 0x7f9e0406c690 2023-08-27T11:22:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352662504 0 0) 0x7f9e040c4bb0 con 0x7f9e0406b320 2023-08-27T11:22:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e041546f0 con 0x7f9e0406b320 2023-08-27T11:22:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9e09d9c700 1 -- 172.21.15.43:0/1469143025 >> v1:172.21.15.57:6789/0 conn(0x7f9e0406b320 legacy=0x7f9e0414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9e09d9c700 1 -- 172.21.15.43:0/1469143025 >> v1:172.21.15.43:6789/0 conn(0x7f9e0406c690 legacy=0x7f9e040c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838782869 0 0) 0x7f9df00035b0 con 0x7f9e0406c690 2023-08-27T11:22:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9e09d9c700 1 -- 172.21.15.43:0/1469143025 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040c4e90 con 0x7f9e040c4600 2023-08-27T11:22:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.150+0000 7f9e09d9c700 1 --2- 172.21.15.43:0/1469143025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 0x7f9e040c6080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009dc0 tx=0x7f9dfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b6f3f15bb8d846 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00e070 con 0x7f9e040c4600 2023-08-27T11:22:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc003a20 con 0x7f9e040c4600 2023-08-27T11:22:55.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9dfbfff700 1 -- 172.21.15.43:0/1469143025 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4001670 con 0x7f9e040c4600 2023-08-27T11:22:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/1469143025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 msgr2=0x7f9e040c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/1469143025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 0x7f9e040c6080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009dc0 tx=0x7f9dfc00b330 comp rx=0 tx=0).stop 2023-08-27T11:22:55.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/1469143025 shutdown_connections 2023-08-27T11:22:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/1469143025 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e040c4600 0x7f9e040c6080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/1469143025 >> 172.21.15.43:0/1469143025 conn(0x7f9e040c9c80 msgr2=0x7f9e040ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.151+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/1469143025 shutdown_connections 2023-08-27T11:22:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.152+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/1469143025 wait complete. 2023-08-27T11:22:55.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.153+0000 7f9e0b7ff700 1 Processor -- start 2023-08-27T11:22:55.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.153+0000 7f9e0b7ff700 1 -- start start 2023-08-27T11:22:55.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e0406b320 0x7f9e04155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e0406c690 0x7f9e040aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040ac880 con 0x7f9e040c4600 2023-08-27T11:22:55.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040acad0 con 0x7f9e0406c690 2023-08-27T11:22:55.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.154+0000 7f9e0b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e040acdb0 con 0x7f9e0406b320 2023-08-27T11:22:55.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40912/0 (socket says 172.21.15.43:40912) 2023-08-27T11:22:55.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 -- 172.21.15.43:0/2528095594 learned_addr learned my addr 172.21.15.43:0/2528095594 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:55.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e0959b700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e0406b320 0x7f9e04155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e08d9a700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e0406c690 0x7f9e040aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 -- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e0406b320 msgr2=0x7f9e04155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e0406b320 0x7f9e04155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 -- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e0406c690 msgr2=0x7f9e040aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e0406c690 0x7f9e040aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 -- 172.21.15.43:0/2528095594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc009a70 con 0x7f9e040c4600 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9e09d9c700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc004000 tx=0x7f9dfc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.155+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc004440 con 0x7f9e040c4600 2023-08-27T11:22:55.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.156+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dfc0045c0 con 0x7f9e040c4600 2023-08-27T11:22:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.156+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e040ad090 con 0x7f9e040c4600 2023-08-27T11:22:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.156+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc004970 con 0x7f9e040c4600 2023-08-27T11:22:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.156+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e040ad650 con 0x7f9e040c4600 2023-08-27T11:22:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.157+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e040ad840 con 0x7f9e040c4600 2023-08-27T11:22:55.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.158+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9dfc01d470 con 0x7f9e040c4600 2023-08-27T11:22:55.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.158+0000 7f9df9ffb700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 0x7f9de806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.159+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dfc089a90 con 0x7f9e040c4600 2023-08-27T11:22:55.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.159+0000 7f9e0959b700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 0x7f9de806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.159+0000 7f9e0959b700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 0x7f9de806c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e000011e0 tx=0x7f9e00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.163+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9dfc058ca0 con 0x7f9e040c4600 2023-08-27T11:22:55.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.420+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9e04154320 con 0x7f9e040c4600 2023-08-27T11:22:55.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.420+0000 7f9df9ffb700 1 -- 172.21.15.43:0/2528095594 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9dfc058830 con 0x7f9e040c4600 2023-08-27T11:22:55.422 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:55.422 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-27T11:22:55.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 msgr2=0x7f9de806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 0x7f9de806c5a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e000011e0 tx=0x7f9e00009040 comp rx=0 tx=0).stop 2023-08-27T11:22:55.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 msgr2=0x7f9e040adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc004000 tx=0x7f9dfc004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 shutdown_connections 2023-08-27T11:22:55.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9de806a0e0 0x7f9de806c5a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e040c4600 0x7f9e040adb70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e0406b320 0x7f9e04155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 --2- 172.21.15.43:0/2528095594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e0406c690 0x7f9e040aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 >> 172.21.15.43:0/2528095594 conn(0x7f9e040c9c80 msgr2=0x7f9e04149bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:55.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 shutdown_connections 2023-08-27T11:22:55.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.423+0000 7f9e0b7ff700 1 -- 172.21.15.43:0/2528095594 wait complete. 2023-08-27T11:22:55.442 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-27T11:22:55.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:55.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.643+0000 7f1140dff700 1 Processor -- start 2023-08-27T11:22:55.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.643+0000 7f1140dff700 1 -- start start 2023-08-27T11:22:55.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1140dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 0x7f113c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1140dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f113c0c4630 0x7f113c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1140dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c06c4e0 con 0x7f113c06ad70 2023-08-27T11:22:55.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1140dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113c155370 con 0x7f113c0c4630 2023-08-27T11:22:55.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1140dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c151e70 con 0x7f113c151a90 2023-08-27T11:22:55.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f113ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f113c06ad70 0x7f113c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44886/0 (socket says 172.21.15.43:44886) 2023-08-27T11:22:55.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f113ad9d700 1 -- 172.21.15.43:0/2974993492 learned_addr learned my addr 172.21.15.43:0/2974993492 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:55.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.644+0000 7f1139d9b700 1 --2- 172.21.15.43:0/2974993492 >> v2:172.21.15.43:3300/0 conn(0x7f113c0c4630 0x7f113c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113a59c700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 0x7f113c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113959a700 1 -- 172.21.15.43:0/2974993492 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66901424 0 0) 0x7f113c06c4e0 con 0x7f113c06ad70 2023-08-27T11:22:55.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f1139d9b700 1 -- 172.21.15.43:0/2974993492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 msgr2=0x7f113c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:55.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f1139d9b700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 0x7f113c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f1139d9b700 1 -- 172.21.15.43:0/2974993492 >> v1:172.21.15.43:6789/0 conn(0x7f113c06ad70 legacy=0x7f113c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f1139d9b700 1 -- 172.21.15.43:0/2974993492 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c154480 con 0x7f113c0c4630 2023-08-27T11:22:55.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113a59c700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 0x7f113c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:55.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f1139d9b700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c0c4a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3022e5c7c72da5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113959a700 1 -- 172.21.15.43:0/2974993492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011830 con 0x7f113c0c4630 2023-08-27T11:22:55.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113959a700 1 -- 172.21.15.43:0/2974993492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130011990 con 0x7f113c0c4630 2023-08-27T11:22:55.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.645+0000 7f113959a700 1 -- 172.21.15.43:0/2974993492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130011d20 con 0x7f113c0c4630 2023-08-27T11:22:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 -- 172.21.15.43:0/2974993492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 msgr2=0x7f113c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c0c4a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1130009840 tx=0x7f1130009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 -- 172.21.15.43:0/2974993492 shutdown_connections 2023-08-27T11:22:55.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c151a90 0x7f113c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 --2- 172.21.15.43:0/2974993492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c0c4a90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 -- 172.21.15.43:0/2974993492 >> 172.21.15.43:0/2974993492 conn(0x7f113c0ab820 msgr2=0x7f113c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 -- 172.21.15.43:0/2974993492 shutdown_connections 2023-08-27T11:22:55.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.646+0000 7f1140dff700 1 -- 172.21.15.43:0/2974993492 wait complete. 2023-08-27T11:22:55.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.648+0000 7f1140dff700 1 Processor -- start 2023-08-27T11:22:55.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.648+0000 7f1140dff700 1 -- start start 2023-08-27T11:22:55.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c06ad70 0x7f113c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 0x7f113c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c0c93c0 con 0x7f113c0c4630 2023-08-27T11:22:55.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c146710 con 0x7f113c151a90 2023-08-27T11:22:55.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1140dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c1ea1c0 con 0x7f113c06ad70 2023-08-27T11:22:55.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1139d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1139d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40926/0 (socket says 172.21.15.43:40926) 2023-08-27T11:22:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f1139d9b700 1 -- 172.21.15.43:0/1587266291 learned_addr learned my addr 172.21.15.43:0/1587266291 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f113a59c700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c06ad70 0x7f113c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.649+0000 7f113ad9d700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 0x7f113c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 -- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c06ad70 msgr2=0x7f113c145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c06ad70 0x7f113c145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 -- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 msgr2=0x7f113c1527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 0x7f113c1527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 -- 172.21.15.43:0/1587266291 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300094a0 con 0x7f113c0c4630 2023-08-27T11:22:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f113ad9d700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 0x7f113c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:55.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1139d9b700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ac6e0 tx=0x7f1130004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300038a0 con 0x7f113c0c4630 2023-08-27T11:22:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113001f070 con 0x7f113c0c4630 2023-08-27T11:22:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c1ea6f0 con 0x7f113c0c4630 2023-08-27T11:22:55.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130003c20 con 0x7f113c0c4630 2023-08-27T11:22:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.650+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c1ea410 con 0x7f113c0c4630 2023-08-27T11:22:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.651+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0c9100 con 0x7f113c0c4630 2023-08-27T11:22:55.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.652+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f113001a430 con 0x7f113c0c4630 2023-08-27T11:22:55.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.653+0000 7f112affd700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:55.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.653+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1130021070 con 0x7f113c0c4630 2023-08-27T11:22:55.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.653+0000 7f113a59c700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:55.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.654+0000 7f113a59c700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 0x7f111c06c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:55.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.657+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1130055690 con 0x7f113c0c4630 2023-08-27T11:22:55.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.870+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113c154cf0 con 0x7f113c0c4630 2023-08-27T11:22:55.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.871+0000 7f112affd700 1 -- 172.21.15.43:0/1587266291 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f113002b090 con 0x7f113c0c4630 2023-08-27T11:22:55.873 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:55.873 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:55.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 msgr2=0x7f111c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 0x7f111c06c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098f0 tx=0x7f112c008040 comp rx=0 tx=0).stop 2023-08-27T11:22:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 msgr2=0x7f113c152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f113c0ac6e0 tx=0x7f1130004750 comp rx=0 tx=0).stop 2023-08-27T11:22:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 shutdown_connections 2023-08-27T11:22:55.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f113c151a90 0x7f113c1527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f113c06ad70 0x7f113c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 --2- 172.21.15.43:0/1587266291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f113c0c4630 0x7f113c152280 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:55.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 >> 172.21.15.43:0/1587266291 conn(0x7f113c0ab820 msgr2=0x7f113c14b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:55.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 shutdown_connections 2023-08-27T11:22:55.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:55.874+0000 7f1140dff700 1 -- 172.21.15.43:0/1587266291 wait complete. 2023-08-27T11:22:55.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:22:55.896 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:22:56.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.099+0000 7fa3709ff700 1 Processor -- start 2023-08-27T11:22:56.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.099+0000 7fa3709ff700 1 -- start start 2023-08-27T11:22:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.100+0000 7fa3709ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa36c0c0020 0x7fa36c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa3709ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa36c151fc0 0x7fa36c0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa3709ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36c157af0 con 0x7fa36c071f70 2023-08-27T11:22:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa3709ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c071e10 con 0x7fa36c0c0020 2023-08-27T11:22:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa3709ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36c158a80 con 0x7fa36c151fc0 2023-08-27T11:22:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa363fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa36c071f70 0x7fa36c1518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44898/0 (socket says 172.21.15.43:44898) 2023-08-27T11:22:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa36c0c0020 0x7fa36c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa363fff700 1 -- 172.21.15.43:0/3810335940 learned_addr learned my addr 172.21.15.43:0/3810335940 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:56.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36ad9d700 1 --2- 172.21.15.43:0/3810335940 >> v2:172.21.15.57:3300/0 conn(0x7fa36c151fc0 0x7fa36c0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa369d9b700 1 -- 172.21.15.43:0/3810335940 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701121742 0 0) 0x7fa36c157af0 con 0x7fa36c071f70 2023-08-27T11:22:56.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa369d9b700 1 -- 172.21.15.43:0/3810335940 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3580035b0 con 0x7fa36c071f70 2023-08-27T11:22:56.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36a59c700 1 -- 172.21.15.43:0/3810335940 >> v2:172.21.15.57:3300/0 conn(0x7fa36c151fc0 msgr2=0x7fa36c0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:56.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36a59c700 1 --2- 172.21.15.43:0/3810335940 >> v2:172.21.15.57:3300/0 conn(0x7fa36c151fc0 0x7fa36c0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36a59c700 1 -- 172.21.15.43:0/3810335940 >> v1:172.21.15.43:6789/0 conn(0x7fa36c071f70 legacy=0x7fa36c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.101+0000 7fa36a59c700 1 -- 172.21.15.43:0/3810335940 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c0a6040 con 0x7fa36c0c0020 2023-08-27T11:22:56.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa36a59c700 1 --2- 172.21.15.43:0/3810335940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c0c0020 0x7fa36c158540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0a97b0 tx=0x7fa35c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d37c5c71c90725 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa369d9b700 1 -- 172.21.15.43:0/3810335940 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011830 con 0x7fa36c0c0020 2023-08-27T11:22:56.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa369d9b700 1 -- 172.21.15.43:0/3810335940 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c011990 con 0x7fa36c0c0020 2023-08-27T11:22:56.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa369d9b700 1 -- 172.21.15.43:0/3810335940 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011d20 con 0x7fa36c0c0020 2023-08-27T11:22:56.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 -- 172.21.15.43:0/3810335940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c0c0020 msgr2=0x7fa36c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 --2- 172.21.15.43:0/3810335940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c0c0020 0x7fa36c158540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0a97b0 tx=0x7fa35c009b20 comp rx=0 tx=0).stop 2023-08-27T11:22:56.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 -- 172.21.15.43:0/3810335940 shutdown_connections 2023-08-27T11:22:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 --2- 172.21.15.43:0/3810335940 >> v2:172.21.15.57:3300/0 conn(0x7fa36c151fc0 0x7fa36c0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 --2- 172.21.15.43:0/3810335940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c0c0020 0x7fa36c158540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.102+0000 7fa3709ff700 1 -- 172.21.15.43:0/3810335940 >> 172.21.15.43:0/3810335940 conn(0x7fa36c0c6a40 msgr2=0x7fa36c0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:56.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.103+0000 7fa3709ff700 1 -- 172.21.15.43:0/3810335940 shutdown_connections 2023-08-27T11:22:56.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.103+0000 7fa3709ff700 1 -- 172.21.15.43:0/3810335940 wait complete. 2023-08-27T11:22:56.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.105+0000 7fa3709ff700 1 Processor -- start 2023-08-27T11:22:56.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.105+0000 7fa3709ff700 1 -- start start 2023-08-27T11:22:56.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 0x7fa36c1ec730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 0x7fa36c1ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c1ed3e0 con 0x7fa36c071f70 2023-08-27T11:22:56.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c1573a0 con 0x7fa36c151fc0 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa3709ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c153ce0 con 0x7fa36c0c0020 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.106+0000 7fa36a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40952/0 (socket says 172.21.15.43:40952) 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 -- 172.21.15.43:0/1176286171 learned_addr learned my addr 172.21.15.43:0/1176286171 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa363fff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 0x7fa36c1ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 -- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 msgr2=0x7fa36c1ec730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36ad9d700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 0x7fa36c1ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 0x7fa36c1ec730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 -- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 msgr2=0x7fa36c1ecc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 0x7fa36c1ecc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 -- 172.21.15.43:0/1176286171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094a0 con 0x7fa36c071f70 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa363fff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 0x7fa36c1ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36ad9d700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 0x7fa36c1ecc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa36a59c700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000c00 tx=0x7fa35c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c0036a0 con 0x7fa36c071f70 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c01f070 con 0x7fa36c071f70 2023-08-27T11:22:56.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c157a80 con 0x7fa36c071f70 2023-08-27T11:22:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.107+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c003a40 con 0x7fa36c071f70 2023-08-27T11:22:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.108+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c1577a0 con 0x7fa36c071f70 2023-08-27T11:22:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.109+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c0c4af0 con 0x7fa36c071f70 2023-08-27T11:22:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.109+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa35c003ba0 con 0x7fa36c071f70 2023-08-27T11:22:56.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.110+0000 7fa362ffd700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 0x7fa34c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.110+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa35c021070 con 0x7fa36c071f70 2023-08-27T11:22:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.111+0000 7fa363fff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 0x7fa34c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.111+0000 7fa363fff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 0x7fa34c06c5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0aa160 tx=0x7fa354009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.115+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa35c055450 con 0x7fa36c071f70 2023-08-27T11:22:56.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.324+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa36c04ee70 con 0x7fa36c071f70 2023-08-27T11:22:56.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.324+0000 7fa362ffd700 1 -- 172.21.15.43:0/1176286171 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa35c02b020 con 0x7fa36c071f70 2023-08-27T11:22:56.326 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:22:56.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.326+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 msgr2=0x7fa34c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.326+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 0x7fa34c06c5d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0aa160 tx=0x7fa354009040 comp rx=0 tx=0).stop 2023-08-27T11:22:56.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.326+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 msgr2=0x7fa36c14dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.326+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000c00 tx=0x7fa35c004750 comp rx=0 tx=0).stop 2023-08-27T11:22:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 shutdown_connections 2023-08-27T11:22:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa34c06a110 0x7fa34c06c5d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa36c151fc0 0x7fa36c1ecc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa36c071f70 0x7fa36c14dd10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 --2- 172.21.15.43:0/1176286171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa36c0c0020 0x7fa36c1ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 >> 172.21.15.43:0/1176286171 conn(0x7fa36c0c6a40 msgr2=0x7fa36c0c4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:56.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 shutdown_connections 2023-08-27T11:22:56.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.327+0000 7fa3709ff700 1 -- 172.21.15.43:0/1176286171 wait complete. 2023-08-27T11:22:56.346 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:22:56.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.548+0000 7f1f011ff700 1 Processor -- start 2023-08-27T11:22:56.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.548+0000 7f1f011ff700 1 -- start start 2023-08-27T11:22:56.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1f011ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1efc0c49f0 0x7f1efc151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1f011ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 0x7f1efc0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1f011ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0c80c0 con 0x7f1efc0ac410 2023-08-27T11:22:56.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1f011ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0c9bd0 con 0x7f1efc0c49f0 2023-08-27T11:22:56.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1f011ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc1555a0 con 0x7f1efc151cd0 2023-08-27T11:22:56.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.549+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 0x7f1efc0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1efc0c49f0 0x7f1efc151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 0x7f1efc0c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48498/0 (socket says 172.21.15.43:48498) 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1efc0c49f0 0x7f1efc151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:32866/0 (socket says 172.21.15.43:32866) 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1ef3fff700 1 -- 172.21.15.43:0/3994359421 learned_addr learned my addr 172.21.15.43:0/3994359421 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 -- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 msgr2=0x7f1efc0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 --2- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 0x7f1efc0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 -- 172.21.15.43:0/3994359421 >> v1:172.21.15.57:6789/0 conn(0x7f1efc0ac410 legacy=0x7f1efc0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 -- 172.21.15.43:0/3994359421 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc1552c0 con 0x7f1efc0c49f0 2023-08-27T11:22:56.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efa59c700 1 -- 172.21.15.43:0/3994359421 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790615225 0 0) 0x7f1efc0c80c0 con 0x7f1efc0ac410 2023-08-27T11:22:56.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.550+0000 7f1efad9d700 1 --2- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc151790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009870 tx=0x7f1eec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a14519cefc5e96 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1efa59c700 1 -- 172.21.15.43:0/3994359421 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec011830 con 0x7f1efc0c49f0 2023-08-27T11:22:56.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1efa59c700 1 -- 172.21.15.43:0/3994359421 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec011990 con 0x7f1efc0c49f0 2023-08-27T11:22:56.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1efa59c700 1 -- 172.21.15.43:0/3994359421 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eec011d20 con 0x7f1efc0c49f0 2023-08-27T11:22:56.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 -- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 msgr2=0x7f1efc151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 --2- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc151790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009870 tx=0x7f1eec009b80 comp rx=0 tx=0).stop 2023-08-27T11:22:56.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 -- 172.21.15.43:0/3994359421 shutdown_connections 2023-08-27T11:22:56.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 --2- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc151790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 --2- 172.21.15.43:0/3994359421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc151cd0 0x7f1efc0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 -- 172.21.15.43:0/3994359421 >> 172.21.15.43:0/3994359421 conn(0x7f1efc0ab8f0 msgr2=0x7f1efc0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:56.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 -- 172.21.15.43:0/3994359421 shutdown_connections 2023-08-27T11:22:56.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.551+0000 7f1f011ff700 1 -- 172.21.15.43:0/3994359421 wait complete. 2023-08-27T11:22:56.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.553+0000 7f1f011ff700 1 Processor -- start 2023-08-27T11:22:56.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.553+0000 7f1f011ff700 1 -- start start 2023-08-27T11:22:56.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc0ac410 0x7f1efc0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0ace70 con 0x7f1efc151cd0 2023-08-27T11:22:56.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0ad9f0 con 0x7f1efc0c49f0 2023-08-27T11:22:56.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1f011ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc1585a0 con 0x7f1efc0ac410 2023-08-27T11:22:56.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1efb59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1efb59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40964/0 (socket says 172.21.15.43:40964) 2023-08-27T11:22:56.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1efb59e700 1 -- 172.21.15.43:0/2052592420 learned_addr learned my addr 172.21.15.43:0/2052592420 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1ef3fff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.554+0000 7f1efad9d700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc0ac410 0x7f1efc0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 -- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc0ac410 msgr2=0x7f1efc0ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc0ac410 0x7f1efc0ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 -- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 msgr2=0x7f1efc14f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc14f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 -- 172.21.15.43:0/2052592420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0094a0 con 0x7f1efc151cd0 2023-08-27T11:22:56.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1efb59e700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4001560 tx=0x7f1ef400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4003e30 con 0x7f1efc151cd0 2023-08-27T11:22:56.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4005070 con 0x7f1efc151cd0 2023-08-27T11:22:56.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4005420 con 0x7f1efc151cd0 2023-08-27T11:22:56.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc158880 con 0x7f1efc151cd0 2023-08-27T11:22:56.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.555+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc14f780 con 0x7f1efc151cd0 2023-08-27T11:22:56.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.556+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc158ac0 con 0x7f1efc151cd0 2023-08-27T11:22:56.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.557+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ef4005580 con 0x7f1efc151cd0 2023-08-27T11:22:56.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.558+0000 7f1ef37fe700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 0x7f1edc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:56.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.558+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ef4087bf0 con 0x7f1efc151cd0 2023-08-27T11:22:56.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.558+0000 7f1efad9d700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 0x7f1edc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:56.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.559+0000 7f1efad9d700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 0x7f1edc06c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0097c0 tx=0x7f1eec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:56.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.562+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1efc158ac0 con 0x7f1efc151cd0 2023-08-27T11:22:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.772+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1efc0c8340 con 0x7f1efc151cd0 2023-08-27T11:22:56.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.773+0000 7f1ef37fe700 1 -- 172.21.15.43:0/2052592420 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1efc0c8340 con 0x7f1efc151cd0 2023-08-27T11:22:56.776 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:22:56.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 msgr2=0x7f1edc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 0x7f1edc06c5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0097c0 tx=0x7f1eec008030 comp rx=0 tx=0).stop 2023-08-27T11:22:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 msgr2=0x7f1efc0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4001560 tx=0x7f1ef400cb50 comp rx=0 tx=0).stop 2023-08-27T11:22:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 shutdown_connections 2023-08-27T11:22:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1edc06a0e0 0x7f1edc06c5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1efc151cd0 0x7f1efc0af710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1efc0ac410 0x7f1efc0ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 --2- 172.21.15.43:0/2052592420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1efc0c49f0 0x7f1efc14f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 >> 172.21.15.43:0/2052592420 conn(0x7f1efc0ab8f0 msgr2=0x7f1efc0c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 shutdown_connections 2023-08-27T11:22:56.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.775+0000 7f1f011ff700 1 -- 172.21.15.43:0/2052592420 wait complete. 2023-08-27T11:22:56.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:22:56.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.997+0000 7faf6e3ff700 1 Processor -- start 2023-08-27T11:22:57.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.997+0000 7faf6e3ff700 1 -- start start 2023-08-27T11:22:57.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.998+0000 7faf6e3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 0x7faf680c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.998+0000 7faf6e3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf680c7c00 0x7faf680ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.998+0000 7faf6e3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf68154660 con 0x7faf680abcc0 2023-08-27T11:22:57.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.998+0000 7faf6e3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680c5750 con 0x7faf680c7c00 2023-08-27T11:22:57.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.998+0000 7faf6e3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf68154940 con 0x7faf68151d20 2023-08-27T11:22:57.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf67fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 0x7faf680c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf680c7c00 0x7faf680ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf680c7c00 0x7faf680ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:32874/0 (socket says 172.21.15.43:32874) 2023-08-27T11:22:57.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 -- 172.21.15.43:0/2077441569 learned_addr learned my addr 172.21.15.43:0/2077441569 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:57.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf67fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 0x7faf680c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48508/0 (socket says 172.21.15.43:48508) 2023-08-27T11:22:57.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 -- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 msgr2=0x7faf680c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:57.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 --2- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 0x7faf680c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 -- 172.21.15.43:0/2077441569 >> v1:172.21.15.57:6789/0 conn(0x7faf680abcc0 legacy=0x7faf6806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:56.999+0000 7faf677fe700 1 -- 172.21.15.43:0/2077441569 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68154c20 con 0x7faf680c7c00 2023-08-27T11:22:57.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf677fe700 1 --2- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680c7c00 0x7faf680ab780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0098f0 tx=0x7faf5c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e289513e4047f06d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf66ffd700 1 -- 172.21.15.43:0/2077441569 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011830 con 0x7faf680c7c00 2023-08-27T11:22:57.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf66ffd700 1 -- 172.21.15.43:0/2077441569 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c011990 con 0x7faf680c7c00 2023-08-27T11:22:57.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf66ffd700 1 -- 172.21.15.43:0/2077441569 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011d20 con 0x7faf680c7c00 2023-08-27T11:22:57.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 -- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680c7c00 msgr2=0x7faf680ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680c7c00 0x7faf680ab780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0098f0 tx=0x7faf5c009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:57.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 -- 172.21.15.43:0/2077441569 shutdown_connections 2023-08-27T11:22:57.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf68151d20 0x7faf680c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/2077441569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680c7c00 0x7faf680ab780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.000+0000 7faf6e3ff700 1 -- 172.21.15.43:0/2077441569 >> 172.21.15.43:0/2077441569 conn(0x7faf680c9d00 msgr2=0x7faf680ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:57.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.001+0000 7faf6e3ff700 1 -- 172.21.15.43:0/2077441569 shutdown_connections 2023-08-27T11:22:57.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.001+0000 7faf6e3ff700 1 -- 172.21.15.43:0/2077441569 wait complete. 2023-08-27T11:22:57.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.002+0000 7faf6e3ff700 1 Processor -- start 2023-08-27T11:22:57.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.002+0000 7faf6e3ff700 1 -- start start 2023-08-27T11:22:57.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680abcc0 0x7faf681586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf680c7c00 0x7faf68156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf681ece30 con 0x7faf68151d20 2023-08-27T11:22:57.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c84a0 con 0x7faf680abcc0 2023-08-27T11:22:57.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.003+0000 7faf6e3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680c07b0 con 0x7faf680c7c00 2023-08-27T11:22:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40974/0 (socket says 172.21.15.43:40974) 2023-08-27T11:22:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 -- 172.21.15.43:0/3857660385 learned_addr learned my addr 172.21.15.43:0/3857660385 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf677fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf680c7c00 0x7faf68156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf67fff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680abcc0 0x7faf681586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 -- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf680c7c00 msgr2=0x7faf68156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf680c7c00 0x7faf68156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 -- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680abcc0 msgr2=0x7faf681586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680abcc0 0x7faf681586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 -- 172.21.15.43:0/3857660385 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009550 con 0x7faf68151d20 2023-08-27T11:22:57.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.004+0000 7faf6c99c700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf6000cb90 tx=0x7faf6000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.005+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60003c50 con 0x7faf68151d20 2023-08-27T11:22:57.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.005+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf60003dd0 con 0x7faf68151d20 2023-08-27T11:22:57.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.005+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6000aae0 con 0x7faf68151d20 2023-08-27T11:22:57.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.005+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680c04d0 con 0x7faf68151d20 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.005+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf680c29f0 con 0x7faf68151d20 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.006+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6804ee70 con 0x7faf68151d20 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.007+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf6000ac40 con 0x7faf68151d20 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.008+0000 7faf64ff9700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 0x7faf5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.008+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf600884c0 con 0x7faf68151d20 2023-08-27T11:22:57.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.008+0000 7faf67fff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 0x7faf5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.009+0000 7faf67fff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 0x7faf5406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf58009b40 tx=0x7faf58009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.012+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf60053c40 con 0x7faf68151d20 2023-08-27T11:22:57.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.223+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf680ac650 con 0x7faf68151d20 2023-08-27T11:22:57.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.223+0000 7faf64ff9700 1 -- 172.21.15.43:0/3857660385 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf60057260 con 0x7faf68151d20 2023-08-27T11:22:57.226 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:22:57.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 msgr2=0x7faf5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 0x7faf5406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf58009b40 tx=0x7faf58009210 comp rx=0 tx=0).stop 2023-08-27T11:22:57.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 msgr2=0x7faf681ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf6000cb90 tx=0x7faf6000cea0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 shutdown_connections 2023-08-27T11:22:57.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf5406a0e0 0x7faf5406c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf68151d20 0x7faf681ed540 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf680abcc0 0x7faf681586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 --2- 172.21.15.43:0/3857660385 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf680c7c00 0x7faf68156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 >> 172.21.15.43:0/3857660385 conn(0x7faf680c9d00 msgr2=0x7faf6814e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:57.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 shutdown_connections 2023-08-27T11:22:57.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.226+0000 7faf6e3ff700 1 -- 172.21.15.43:0/3857660385 wait complete. 2023-08-27T11:22:57.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:22:57.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.447+0000 7f497d3ff700 1 Processor -- start 2023-08-27T11:22:57.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.447+0000 7f497d3ff700 1 -- start start 2023-08-27T11:22:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f497d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f49780c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f497d3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f497806a8e0 0x7f497806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f497d3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4978154660 con 0x7f4978151d20 2023-08-27T11:22:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f497d3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780c5750 con 0x7f497806a8e0 2023-08-27T11:22:57.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f497d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4978154940 con 0x7f49780c7c00 2023-08-27T11:22:57.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f4976ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4978151d20 0x7f49780ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44906/0 (socket says 172.21.15.43:44906) 2023-08-27T11:22:57.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.448+0000 7f4976ffd700 1 -- 172.21.15.43:0/503846983 learned_addr learned my addr 172.21.15.43:0/503846983 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:57.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 --2- 172.21.15.43:0/503846983 >> v2:172.21.15.57:3300/0 conn(0x7f497806a8e0 0x7f497806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49767fc700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f49780c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f4975ffb700 1 -- 172.21.15.43:0/503846983 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284832586 0 0) 0x7f4978154660 con 0x7f4978151d20 2023-08-27T11:22:57.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f4975ffb700 1 -- 172.21.15.43:0/503846983 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49600035b0 con 0x7f4978151d20 2023-08-27T11:22:57.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 -- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 msgr2=0x7f49780c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f49780c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 -- 172.21.15.43:0/503846983 >> v1:172.21.15.43:6789/0 conn(0x7f4978151d20 legacy=0x7f49780ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 -- 172.21.15.43:0/503846983 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4978154c20 con 0x7f497806a8e0 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.449+0000 7f49777fe700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497806a8e0 0x7f497806ad50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d90 tx=0x7f497000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5f3608ac2cfad4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f4975ffb700 1 -- 172.21.15.43:0/503846983 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000e070 con 0x7f497806a8e0 2023-08-27T11:22:57.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f4975ffb700 1 -- 172.21.15.43:0/503846983 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000bb20 con 0x7f497806a8e0 2023-08-27T11:22:57.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f4975ffb700 1 -- 172.21.15.43:0/503846983 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970012430 con 0x7f497806a8e0 2023-08-27T11:22:57.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 -- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497806a8e0 msgr2=0x7f497806ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497806a8e0 0x7f497806ad50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4970009d90 tx=0x7f497000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:57.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 -- 172.21.15.43:0/503846983 shutdown_connections 2023-08-27T11:22:57.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497806a8e0 0x7f497806ad50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 --2- 172.21.15.43:0/503846983 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f49780c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 -- 172.21.15.43:0/503846983 >> 172.21.15.43:0/503846983 conn(0x7f49780c9d00 msgr2=0x7f49780ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:57.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 -- 172.21.15.43:0/503846983 shutdown_connections 2023-08-27T11:22:57.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.450+0000 7f497d3ff700 1 -- 172.21.15.43:0/503846983 wait complete. 2023-08-27T11:22:57.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.453+0000 7f497d3ff700 1 Processor -- start 2023-08-27T11:22:57.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.453+0000 7f497d3ff700 1 -- start start 2023-08-27T11:22:57.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f4978153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4978151d20 0x7f49780bd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780bf540 con 0x7f497806a8e0 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781ed920 con 0x7f4978151d20 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f497d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49781ecd10 con 0x7f49780c7c00 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f4976ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f4976ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40976/0 (socket says 172.21.15.43:40976) 2023-08-27T11:22:57.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f4976ffd700 1 -- 172.21.15.43:0/2370481015 learned_addr learned my addr 172.21.15.43:0/2370481015 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f49767fc700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f4978153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.454+0000 7f49777fe700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4978151d20 0x7f49780bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 -- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 msgr2=0x7f4978153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f4978153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 -- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4978151d20 msgr2=0x7f49780bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4978151d20 0x7f49780bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 -- 172.21.15.43:0/2370481015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970009a70 con 0x7f497806a8e0 2023-08-27T11:22:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f4976ffd700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f496800c420 tx=0x7f496800c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968005d70 con 0x7f497806a8e0 2023-08-27T11:22:57.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800ce30 con 0x7f497806a8e0 2023-08-27T11:22:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49781ecff0 con 0x7f497806a8e0 2023-08-27T11:22:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49680072d0 con 0x7f497806a8e0 2023-08-27T11:22:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.455+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49781ed5b0 con 0x7f497806a8e0 2023-08-27T11:22:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.456+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497804ee70 con 0x7f497806a8e0 2023-08-27T11:22:57.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.457+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4968007430 con 0x7f497806a8e0 2023-08-27T11:22:57.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.458+0000 7f495f7fe700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 0x7f496406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.458+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4968087750 con 0x7f497806a8e0 2023-08-27T11:22:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.458+0000 7f49767fc700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 0x7f496406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.459+0000 7f49767fc700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 0x7f496406c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f496c009be0 tx=0x7f496c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.462+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4968052ee0 con 0x7f497806a8e0 2023-08-27T11:22:57.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.672+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49780ac650 con 0x7f497806a8e0 2023-08-27T11:22:57.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.672+0000 7f495f7fe700 1 -- 172.21.15.43:0/2370481015 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4968056500 con 0x7f497806a8e0 2023-08-27T11:22:57.675 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:22:57.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.674+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 msgr2=0x7f496406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.674+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 0x7f496406c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f496c009be0 tx=0x7f496c009210 comp rx=0 tx=0).stop 2023-08-27T11:22:57.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 msgr2=0x7f49780c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f496800c420 tx=0x7f496800c730 comp rx=0 tx=0).stop 2023-08-27T11:22:57.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 shutdown_connections 2023-08-27T11:22:57.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496406a0e0 0x7f496406c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4978151d20 0x7f49780bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497806a8e0 0x7f49780c0350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 --2- 172.21.15.43:0/2370481015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49780c7c00 0x7f4978153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 >> 172.21.15.43:0/2370481015 conn(0x7f49780c9d00 msgr2=0x7f497814d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:57.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 shutdown_connections 2023-08-27T11:22:57.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.675+0000 7f497d3ff700 1 -- 172.21.15.43:0/2370481015 wait complete. 2023-08-27T11:22:57.695 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:22:57.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.894+0000 7f266ffff700 1 Processor -- start 2023-08-27T11:22:57.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.894+0000 7f266ffff700 1 -- start start 2023-08-27T11:22:57.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26680c4630 0x7f26680c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f266806ad70 0x7f266806b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680c82c0 con 0x7f2668151b20 2023-08-27T11:22:57.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266ffff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2668151f00 con 0x7f266806ad70 2023-08-27T11:22:57.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266ffff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266806c450 con 0x7f26680c4630 2023-08-27T11:22:57.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f266806ad70 0x7f266806b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f266806ad70 0x7f266806b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40990/0 (socket says 172.21.15.43:40990) 2023-08-27T11:22:57.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.895+0000 7f266e59c700 1 -- 172.21.15.43:0/890218664 learned_addr learned my addr 172.21.15.43:0/890218664 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:57.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266d59a700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26680c4630 0x7f26680c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266e59c700 1 -- 172.21.15.43:0/890218664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26680c4630 msgr2=0x7f26680c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:57.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266e59c700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26680c4630 0x7f26680c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266e59c700 1 -- 172.21.15.43:0/890218664 >> v1:172.21.15.57:6789/0 conn(0x7f2668151b20 legacy=0x7f26680c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266e59c700 1 -- 172.21.15.43:0/890218664 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668154760 con 0x7f266806ad70 2023-08-27T11:22:57.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266e59c700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266806ad70 0x7f266806b1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2660009e50 tx=0x7f266000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf7ee5b6aa78c84 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266cd99700 1 -- 172.21.15.43:0/890218664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000e070 con 0x7f266806ad70 2023-08-27T11:22:57.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266cd99700 1 -- 172.21.15.43:0/890218664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266000b9c0 con 0x7f266806ad70 2023-08-27T11:22:57.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.896+0000 7f266cd99700 1 -- 172.21.15.43:0/890218664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000bd70 con 0x7f266806ad70 2023-08-27T11:22:57.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 -- 172.21.15.43:0/890218664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266806ad70 msgr2=0x7f266806b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266806ad70 0x7f266806b1c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2660009e50 tx=0x7f266000b330 comp rx=0 tx=0).stop 2023-08-27T11:22:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 -- 172.21.15.43:0/890218664 shutdown_connections 2023-08-27T11:22:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f266806ad70 0x7f266806b1c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 --2- 172.21.15.43:0/890218664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26680c4630 0x7f26680c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 -- 172.21.15.43:0/890218664 >> 172.21.15.43:0/890218664 conn(0x7f26680ab820 msgr2=0x7f26680abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:57.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 -- 172.21.15.43:0/890218664 shutdown_connections 2023-08-27T11:22:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.897+0000 7f266ffff700 1 -- 172.21.15.43:0/890218664 wait complete. 2023-08-27T11:22:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.899+0000 7f266ffff700 1 Processor -- start 2023-08-27T11:22:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.899+0000 7f266ffff700 1 -- start start 2023-08-27T11:22:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f26680aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 0x7f26681576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680c2710 con 0x7f2668151b20 2023-08-27T11:22:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26681558a0 con 0x7f26680c4630 2023-08-27T11:22:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266ffff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2668155b40 con 0x7f266806ad70 2023-08-27T11:22:57.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41002/0 (socket says 172.21.15.43:41002) 2023-08-27T11:22:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.900+0000 7f266e59c700 1 -- 172.21.15.43:0/1460603927 learned_addr learned my addr 172.21.15.43:0/1460603927 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266d59a700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 0x7f26681576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 -- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 msgr2=0x7f26680aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266dd9b700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f26680aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f26680aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 -- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 msgr2=0x7f26681576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:57.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 0x7f26681576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:57.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 -- 172.21.15.43:0/1460603927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660009b30 con 0x7f2668151b20 2023-08-27T11:22:57.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266d59a700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 0x7f26681576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266dd9b700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f26680aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266e59c700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26680ac6e0 tx=0x7f2660004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660004960 con 0x7f2668151b20 2023-08-27T11:22:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600099b0 con 0x7f2668151b20 2023-08-27T11:22:57.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266ffff700 1 -- 172.21.15.43:0/1460603927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2668155e20 con 0x7f2668151b20 2023-08-27T11:22:57.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266001c680 con 0x7f2668151b20 2023-08-27T11:22:57.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.901+0000 7f266ffff700 1 -- 172.21.15.43:0/1460603927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26681563e0 con 0x7f2668151b20 2023-08-27T11:22:57.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.902+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26440052f0 con 0x7f2668151b20 2023-08-27T11:22:57.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.903+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f266001c7e0 con 0x7f2668151b20 2023-08-27T11:22:57.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.904+0000 7f265e7fc700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:57.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.904+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f266008a260 con 0x7f2668151b20 2023-08-27T11:22:57.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.904+0000 7f266dd9b700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:57.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.905+0000 7f266dd9b700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2664000f60 tx=0x7f2664009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:57.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:57.909+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2660055940 con 0x7f2668151b20 2023-08-27T11:22:58.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.176+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2644005b20 con 0x7f2668151b20 2023-08-27T11:22:58.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.176+0000 7f265e7fc700 1 -- 172.21.15.43:0/1460603927 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f2660058f60 con 0x7f2668151b20 2023-08-27T11:22:58.179 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:58.179 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:22:58.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 msgr2=0x7f264c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2664000f60 tx=0x7f2664009040 comp rx=0 tx=0).stop 2023-08-27T11:22:58.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 msgr2=0x7f2668157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26680ac6e0 tx=0x7f2660004ad0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 shutdown_connections 2023-08-27T11:22:58.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2668151b20 0x7f2668157c00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f26680aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 --2- 172.21.15.43:0/1460603927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26680c4630 0x7f26681576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 >> 172.21.15.43:0/1460603927 conn(0x7f26680ab820 msgr2=0x7f2668073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:58.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 shutdown_connections 2023-08-27T11:22:58.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.179+0000 7f264bfff700 1 -- 172.21.15.43:0/1460603927 wait complete. 2023-08-27T11:22:58.184 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:22:58.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:22:58.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.398+0000 7f2784dff700 1 Processor -- start 2023-08-27T11:22:58.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.398+0000 7f2784dff700 1 -- start start 2023-08-27T11:22:58.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.399+0000 7f2784dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2780151a90 0x7f27800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.399+0000 7f2784dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f27800c4630 0x7f27800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2784dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278006c4e0 con 0x7f278006ad70 2023-08-27T11:22:58.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2784dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2780155370 con 0x7f27800c4630 2023-08-27T11:22:58.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2784dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2780151e70 con 0x7f2780151a90 2023-08-27T11:22:58.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f27800c4630 0x7f27800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f277ed9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f278006ad70 0x7f278006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44922/0 (socket says 172.21.15.43:44922) 2023-08-27T11:22:58.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f277ed9d700 1 -- 172.21.15.43:0/120099133 learned_addr learned my addr 172.21.15.43:0/120099133 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:58.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f277e59c700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2780151a90 0x7f27800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 -- 172.21.15.43:0/120099133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2780151a90 msgr2=0x7f27800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:58.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2780151a90 0x7f27800c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 -- 172.21.15.43:0/120099133 >> v1:172.21.15.43:6789/0 conn(0x7f278006ad70 legacy=0x7f278006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 -- 172.21.15.43:0/120099133 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780154480 con 0x7f27800c4630 2023-08-27T11:22:58.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.400+0000 7f2777fff700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800c4630 0x7f27800c4a90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2768009840 tx=0x7f2768009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b99c4ceea45435 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f277dd9b700 1 -- 172.21.15.43:0/120099133 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768011830 con 0x7f27800c4630 2023-08-27T11:22:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f277dd9b700 1 -- 172.21.15.43:0/120099133 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768011990 con 0x7f27800c4630 2023-08-27T11:22:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f277dd9b700 1 -- 172.21.15.43:0/120099133 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768011d20 con 0x7f27800c4630 2023-08-27T11:22:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 -- 172.21.15.43:0/120099133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800c4630 msgr2=0x7f27800c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800c4630 0x7f27800c4a90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2768009840 tx=0x7f2768009b50 comp rx=0 tx=0).stop 2023-08-27T11:22:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 -- 172.21.15.43:0/120099133 shutdown_connections 2023-08-27T11:22:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2780151a90 0x7f27800c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 --2- 172.21.15.43:0/120099133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27800c4630 0x7f27800c4a90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 -- 172.21.15.43:0/120099133 >> 172.21.15.43:0/120099133 conn(0x7f27800ab820 msgr2=0x7f27800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 -- 172.21.15.43:0/120099133 shutdown_connections 2023-08-27T11:22:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.401+0000 7f2784dff700 1 -- 172.21.15.43:0/120099133 wait complete. 2023-08-27T11:22:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.403+0000 7f2784dff700 1 Processor -- start 2023-08-27T11:22:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.403+0000 7f2784dff700 1 -- start start 2023-08-27T11:22:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278006ad70 0x7f27801ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27800c4630 0x7f2780152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2780157440 con 0x7f2780151a90 2023-08-27T11:22:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27801ea160 con 0x7f278006ad70 2023-08-27T11:22:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f2784dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2780156890 con 0x7f27800c4630 2023-08-27T11:22:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.404+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41030/0 (socket says 172.21.15.43:41030) 2023-08-27T11:22:58.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 -- 172.21.15.43:0/3333275189 learned_addr learned my addr 172.21.15.43:0/3333275189 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:58.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277e59c700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278006ad70 0x7f27801ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f2777fff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27800c4630 0x7f2780152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 -- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27800c4630 msgr2=0x7f2780152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27800c4630 0x7f2780152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 -- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278006ad70 msgr2=0x7f27801ed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278006ad70 0x7f27801ed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 -- 172.21.15.43:0/3333275189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27680094a0 con 0x7f2780151a90 2023-08-27T11:22:58.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f277ed9d700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f277800cbc0 tx=0x7f277800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277800a9e0 con 0x7f2780151a90 2023-08-27T11:22:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.405+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277800ab40 con 0x7f2780151a90 2023-08-27T11:22:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.406+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2780156b70 con 0x7f2780151a90 2023-08-27T11:22:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.406+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778012400 con 0x7f2780151a90 2023-08-27T11:22:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.406+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2780153420 con 0x7f2780151a90 2023-08-27T11:22:58.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.407+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278014de90 con 0x7f2780151a90 2023-08-27T11:22:58.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.408+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f277801b3b0 con 0x7f2780151a90 2023-08-27T11:22:58.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.409+0000 7f2776ffd700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.409+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27780880d0 con 0x7f2780151a90 2023-08-27T11:22:58.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.409+0000 7f277e59c700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.409+0000 7f277e59c700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 0x7f276006c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2770009b40 tx=0x7f2770009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.413+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f27780537d0 con 0x7f2780151a90 2023-08-27T11:22:58.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.623+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f278014bea0 con 0x7f2780151a90 2023-08-27T11:22:58.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.624+0000 7f2776ffd700 1 -- 172.21.15.43:0/3333275189 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f2778056df0 con 0x7f2780151a90 2023-08-27T11:22:58.627 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:22:58.627 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:22:58.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 msgr2=0x7f276006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 0x7f276006c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2770009b40 tx=0x7f2770009210 comp rx=0 tx=0).stop 2023-08-27T11:22:58.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 msgr2=0x7f27801ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f277800cbc0 tx=0x7f277800ced0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 shutdown_connections 2023-08-27T11:22:58.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2780151a90 0x7f27801ea5f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f278006ad70 0x7f27801ed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 --2- 172.21.15.43:0/3333275189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27800c4630 0x7f2780152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 >> 172.21.15.43:0/3333275189 conn(0x7f27800ab820 msgr2=0x7f278006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:58.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 shutdown_connections 2023-08-27T11:22:58.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.627+0000 7f2784dff700 1 -- 172.21.15.43:0/3333275189 wait complete. 2023-08-27T11:22:58.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:22:58.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:22:58.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.850+0000 7fbe11dff700 1 Processor -- start 2023-08-27T11:22:58.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.850+0000 7fbe11dff700 1 -- start start 2023-08-27T11:22:58.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe11dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe0c151d20 0x7fbe0c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe11dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe11dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c154660 con 0x7fbe0c0abcc0 2023-08-27T11:22:58.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe11dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c5750 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe11dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c154940 con 0x7fbe0c151d20 2023-08-27T11:22:58.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe0affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe0affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51936/0 (socket says 172.21.15.43:51936) 2023-08-27T11:22:58.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.851+0000 7fbe0affd700 1 -- 172.21.15.43:0/2122570312 learned_addr learned my addr 172.21.15.43:0/2122570312 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:58.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/2122570312 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c151d20 0x7fbe0c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0affd700 1 -- 172.21.15.43:0/2122570312 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c151d20 msgr2=0x7fbe0c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:58.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2122570312 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c151d20 0x7fbe0c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0affd700 1 -- 172.21.15.43:0/2122570312 >> v1:172.21.15.57:6789/0 conn(0x7fbe0c0abcc0 legacy=0x7fbe0c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0affd700 1 -- 172.21.15.43:0/2122570312 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c154c20 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0affd700 1 --2- 172.21.15.43:0/2122570312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cac10 tx=0x7fbe00009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b69567153d3979 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0a7fc700 1 -- 172.21.15.43:0/2122570312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000b870 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0a7fc700 1 -- 172.21.15.43:0/2122570312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000b9d0 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.852+0000 7fbe0a7fc700 1 -- 172.21.15.43:0/2122570312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0000bd60 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 -- 172.21.15.43:0/2122570312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c0c7c00 msgr2=0x7fbe0c0ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 --2- 172.21.15.43:0/2122570312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0cac10 tx=0x7fbe00009bd0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 -- 172.21.15.43:0/2122570312 shutdown_connections 2023-08-27T11:22:58.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 --2- 172.21.15.43:0/2122570312 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c151d20 0x7fbe0c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 --2- 172.21.15.43:0/2122570312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c0ab780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 -- 172.21.15.43:0/2122570312 >> 172.21.15.43:0/2122570312 conn(0x7fbe0c0c9d00 msgr2=0x7fbe0c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 -- 172.21.15.43:0/2122570312 shutdown_connections 2023-08-27T11:22:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.853+0000 7fbe11dff700 1 -- 172.21.15.43:0/2122570312 wait complete. 2023-08-27T11:22:58.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.855+0000 7fbe11dff700 1 Processor -- start 2023-08-27T11:22:58.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.855+0000 7fbe11dff700 1 -- start start 2023-08-27T11:22:58.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0abcc0 0x7fbe0c0a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c3b00 con 0x7fbe0c151d20 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1524c0 con 0x7fbe0c0c7c00 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe11dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c0c3760 con 0x7fbe0c0abcc0 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe0bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe0bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51944/0 (socket says 172.21.15.43:51944) 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe0bfff700 1 -- 172.21.15.43:0/4084294201 learned_addr learned my addr 172.21.15.43:0/4084294201 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:58.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0abcc0 0x7fbe0c0a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.856+0000 7fbe0affd700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 -- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0abcc0 msgr2=0x7fbe0c0a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0abcc0 0x7fbe0c0a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 -- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c7c00 msgr2=0x7fbe0c148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:58.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 -- 172.21.15.43:0/4084294201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009550 con 0x7fbe0c151d20 2023-08-27T11:22:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400cb90 tx=0x7fbe0400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04003c50 con 0x7fbe0c151d20 2023-08-27T11:22:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04003dd0 con 0x7fbe0c151d20 2023-08-27T11:22:58.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400aae0 con 0x7fbe0c151d20 2023-08-27T11:22:58.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c144b90 con 0x7fbe0c151d20 2023-08-27T11:22:58.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.857+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c1edd10 con 0x7fbe0c151d20 2023-08-27T11:22:58.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.858+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c04ee70 con 0x7fbe0c151d20 2023-08-27T11:22:58.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.859+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe0400ac40 con 0x7fbe0c151d20 2023-08-27T11:22:58.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.860+0000 7fbdf3fff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 0x7fbdf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:58.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.860+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe040885f0 con 0x7fbe0c151d20 2023-08-27T11:22:58.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.860+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 0x7fbdf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:58.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.861+0000 7fbe0b7fe700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 0x7fbdf806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006b20 tx=0x7fbdfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:58.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:58.864+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbe04053c40 con 0x7fbe0c151d20 2023-08-27T11:22:59.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.074+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe0c0c3c40 con 0x7fbe0c151d20 2023-08-27T11:22:59.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.074+0000 7fbdf3fff700 1 -- 172.21.15.43:0/4084294201 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe04057260 con 0x7fbe0c151d20 2023-08-27T11:22:59.077 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:22:59.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.076+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 msgr2=0x7fbdf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.076+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 0x7fbdf806c5a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc006b20 tx=0x7fbdfc008040 comp rx=0 tx=0).stop 2023-08-27T11:22:59.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.076+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 msgr2=0x7fbe0c0ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.076+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400cb90 tx=0x7fbe0400cea0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 shutdown_connections 2023-08-27T11:22:59.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf806a0e0 0x7fbdf806c5a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c151d20 0x7fbe0c0ab280 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0abcc0 0x7fbe0c0a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 --2- 172.21.15.43:0/4084294201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c7c00 0x7fbe0c148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 >> 172.21.15.43:0/4084294201 conn(0x7fbe0c0c9d00 msgr2=0x7fbe0c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:59.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 shutdown_connections 2023-08-27T11:22:59.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.077+0000 7fbe11dff700 1 -- 172.21.15.43:0/4084294201 wait complete. 2023-08-27T11:22:59.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:22:59.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.298+0000 7f38d21ff700 1 Processor -- start 2023-08-27T11:22:59.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.298+0000 7f38d21ff700 1 -- start start 2023-08-27T11:22:59.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38d21ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38cc151d20 0x7f38cc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38d21ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 0x7f38cc0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38d21ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc154660 con 0x7f38cc0abcc0 2023-08-27T11:22:59.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38d21ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0c5750 con 0x7f38cc151d20 2023-08-27T11:22:59.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38d21ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc154940 con 0x7f38cc0c7c00 2023-08-27T11:22:59.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38cc151d20 0x7f38cc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f38cc151d20 0x7f38cc0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51950/0 (socket says 172.21.15.43:51950) 2023-08-27T11:22:59.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 -- 172.21.15.43:0/4108751247 learned_addr learned my addr 172.21.15.43:0/4108751247 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:59.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38c3fff700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 0x7f38cc0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 -- 172.21.15.43:0/4108751247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 msgr2=0x7f38cc0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:59.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 0x7f38cc0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 -- 172.21.15.43:0/4108751247 >> v1:172.21.15.57:6789/0 conn(0x7f38cc0abcc0 legacy=0x7f38cc06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38cb7fe700 1 -- 172.21.15.43:0/4108751247 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc154c20 con 0x7f38cc151d20 2023-08-27T11:22:59.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.300+0000 7f38c3fff700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 0x7f38cc0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38cb7fe700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc151d20 0x7f38cc0c8110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098f0 tx=0x7f38bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6e6aef16a4e038 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38caffd700 1 -- 172.21.15.43:0/4108751247 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00b8a0 con 0x7f38cc151d20 2023-08-27T11:22:59.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38caffd700 1 -- 172.21.15.43:0/4108751247 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00ba00 con 0x7f38cc151d20 2023-08-27T11:22:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38caffd700 1 -- 172.21.15.43:0/4108751247 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bd90 con 0x7f38cc151d20 2023-08-27T11:22:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 -- 172.21.15.43:0/4108751247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc151d20 msgr2=0x7f38cc0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc151d20 0x7f38cc0c8110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0098f0 tx=0x7f38bc009c00 comp rx=0 tx=0).stop 2023-08-27T11:22:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 -- 172.21.15.43:0/4108751247 shutdown_connections 2023-08-27T11:22:59.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc151d20 0x7f38cc0c8110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 --2- 172.21.15.43:0/4108751247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc0c7c00 0x7f38cc0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.301+0000 7f38d21ff700 1 -- 172.21.15.43:0/4108751247 >> 172.21.15.43:0/4108751247 conn(0x7f38cc0c9d00 msgr2=0x7f38cc0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:59.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.302+0000 7f38d21ff700 1 -- 172.21.15.43:0/4108751247 shutdown_connections 2023-08-27T11:22:59.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.302+0000 7f38d21ff700 1 -- 172.21.15.43:0/4108751247 wait complete. 2023-08-27T11:22:59.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.303+0000 7f38d21ff700 1 Processor -- start 2023-08-27T11:22:59.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.303+0000 7f38d21ff700 1 -- start start 2023-08-27T11:22:59.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38cc0c7c00 0x7f38cc158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc151d20 0x7f38cc0c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0aa3a0 con 0x7f38cc0abcc0 2023-08-27T11:22:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0a9790 con 0x7f38cc0c7c00 2023-08-27T11:22:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.304+0000 7f38d21ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc0a9a70 con 0x7f38cc151d20 2023-08-27T11:22:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51954/0 (socket says 172.21.15.43:51954) 2023-08-27T11:22:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 -- 172.21.15.43:0/3691512353 learned_addr learned my addr 172.21.15.43:0/3691512353 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38c3fff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38cc0c7c00 0x7f38cc158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cbfff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc151d20 0x7f38cc0c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 -- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc151d20 msgr2=0x7f38cc0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc151d20 0x7f38cc0c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 -- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38cc0c7c00 msgr2=0x7f38cc158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38cc0c7c00 0x7f38cc158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 -- 172.21.15.43:0/3691512353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009550 con 0x7f38cc0abcc0 2023-08-27T11:22:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38cb7fe700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009c40 tx=0x7f38bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.305+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc004590 con 0x7f38cc0abcc0 2023-08-27T11:22:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.306+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc01e070 con 0x7f38cc0abcc0 2023-08-27T11:22:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.306+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0038e0 con 0x7f38cc0abcc0 2023-08-27T11:22:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.306+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc0a9d50 con 0x7f38cc0abcc0 2023-08-27T11:22:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.306+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc153b90 con 0x7f38cc0abcc0 2023-08-27T11:22:59.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.307+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc04ee70 con 0x7f38cc0abcc0 2023-08-27T11:22:59.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.308+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38bc003a40 con 0x7f38cc0abcc0 2023-08-27T11:22:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.308+0000 7f38c8ff9700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 0x7f38ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.309+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38bc020070 con 0x7f38cc0abcc0 2023-08-27T11:22:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.309+0000 7f38c3fff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 0x7f38ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.309+0000 7f38c3fff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 0x7f38ac06c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0bcc20 tx=0x7f38b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.313+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f38bc055170 con 0x7f38cc0abcc0 2023-08-27T11:22:59.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.525+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f38cc06bfe0 con 0x7f38cc0abcc0 2023-08-27T11:22:59.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.526+0000 7f38c8ff9700 1 -- 172.21.15.43:0/3691512353 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f38bc015020 con 0x7f38cc0abcc0 2023-08-27T11:22:59.530 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:22:59.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 msgr2=0x7f38ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 0x7f38ac06c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0bcc20 tx=0x7f38b4008040 comp rx=0 tx=0).stop 2023-08-27T11:22:59.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 msgr2=0x7f38cc153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009c40 tx=0x7f38bc004750 comp rx=0 tx=0).stop 2023-08-27T11:22:59.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 shutdown_connections 2023-08-27T11:22:59.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f38ac06a0e0 0x7f38ac06c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38cc151d20 0x7f38cc0c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f38cc0abcc0 0x7f38cc153650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 --2- 172.21.15.43:0/3691512353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f38cc0c7c00 0x7f38cc158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 >> 172.21.15.43:0/3691512353 conn(0x7f38cc0c9d00 msgr2=0x7f38cc14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:59.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 shutdown_connections 2023-08-27T11:22:59.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.528+0000 7f38d21ff700 1 -- 172.21.15.43:0/3691512353 wait complete. 2023-08-27T11:22:59.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:22:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.752+0000 7f8a097ff700 1 Processor -- start 2023-08-27T11:22:59.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.752+0000 7f8a097ff700 1 -- start start 2023-08-27T11:22:59.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a097ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8a040c7c00 0x7f8a040c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a097ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f8a0406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a097ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a04154660 con 0x7f8a04151d20 2023-08-27T11:22:59.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a097ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a040c5750 con 0x7f8a040c7c00 2023-08-27T11:22:59.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a097ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04154940 con 0x7f8a0406a8e0 2023-08-27T11:22:59.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a02ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a04151d20 0x7f8a040ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33030/0 (socket says 172.21.15.43:33030) 2023-08-27T11:22:59.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a02ffd700 1 -- 172.21.15.43:0/615956226 learned_addr learned my addr 172.21.15.43:0/615956226 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:22:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f89fbfff700 1 --2- 172.21.15.43:0/615956226 >> v2:172.21.15.57:3300/0 conn(0x7f8a040c7c00 0x7f8a040c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a037fe700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f8a0406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538220911 0 0) 0x7f8a04154660 con 0x7f8a04151d20 2023-08-27T11:22:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.753+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f00035b0 con 0x7f8a04151d20 2023-08-27T11:22:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389128993 0 0) 0x7f89f00035b0 con 0x7f8a04151d20 2023-08-27T11:22:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 msgr2=0x7f8a0406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:59.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f8a0406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 >> v2:172.21.15.57:3300/0 conn(0x7f8a040c7c00 msgr2=0x7f8a040c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 --2- 172.21.15.43:0/615956226 >> v2:172.21.15.57:3300/0 conn(0x7f8a040c7c00 0x7f8a040c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04154c20 con 0x7f8a04151d20 2023-08-27T11:22:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f89f4001670 con 0x7f8a04151d20 2023-08-27T11:22:59.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 >> v1:172.21.15.43:6789/0 conn(0x7f8a04151d20 legacy=0x7f8a040ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89f0003a70 0x7f89f0003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f89f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f89f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04154940 con 0x7f89f0004d90 2023-08-27T11:22:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f000ba10 con 0x7f89f0003a70 2023-08-27T11:22:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f000bba0 con 0x7f8a0406a8e0 2023-08-27T11:22:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a037fe700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f89f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f89fbfff700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f89f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a02ffd700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89f0003a70 0x7f89f0003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.754+0000 7f8a037fe700 1 -- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 msgr2=0x7f89f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a037fe700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a0406a8e0 0x7f89f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a037fe700 1 -- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89f0003a70 msgr2=0x7f89f0003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:22:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a037fe700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89f0003a70 0x7f89f0003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a037fe700 1 -- 172.21.15.43:0/615956226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00035b0 con 0x7f89f0004d90 2023-08-27T11:22:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a02ffd700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89f0003a70 0x7f89f0003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:22:59.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a037fe700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f89f0005210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009fc0 tx=0x7f89f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c96ca5ced257b74 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00ec30 con 0x7f89f0004d90 2023-08-27T11:22:59.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00f040 con 0x7f89f0004d90 2023-08-27T11:22:59.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a027fc700 1 -- 172.21.15.43:0/615956226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc014480 con 0x7f89f0004d90 2023-08-27T11:22:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a097ff700 1 -- 172.21.15.43:0/615956226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 msgr2=0x7f89f0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.755+0000 7f8a097ff700 1 --2- 172.21.15.43:0/615956226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f89f0005210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009fc0 tx=0x7f89f0005880 comp rx=0 tx=0).stop 2023-08-27T11:22:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.756+0000 7f8a037fe700 1 -- 172.21.15.43:0/615956226 reap_dead start 2023-08-27T11:22:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.756+0000 7f8a097ff700 1 -- 172.21.15.43:0/615956226 shutdown_connections 2023-08-27T11:22:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.756+0000 7f8a097ff700 1 -- 172.21.15.43:0/615956226 >> 172.21.15.43:0/615956226 conn(0x7f8a040c9d00 msgr2=0x7f8a040ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.756+0000 7f8a097ff700 1 -- 172.21.15.43:0/615956226 shutdown_connections 2023-08-27T11:22:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.756+0000 7f8a097ff700 1 -- 172.21.15.43:0/615956226 wait complete. 2023-08-27T11:22:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.757+0000 7f8a097ff700 1 Processor -- start 2023-08-27T11:22:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 -- start start 2023-08-27T11:22:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 0x7f8a040bd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a04148540 0x7f8a041489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a041ece00 con 0x7f89f0004d90 2023-08-27T11:22:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.758+0000 7f8a097ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a041e9f70 con 0x7f8a0414d7f0 2023-08-27T11:22:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a097ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a041e9920 con 0x7f8a04148540 2023-08-27T11:22:59.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51976/0 (socket says 172.21.15.43:51976) 2023-08-27T11:22:59.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 -- 172.21.15.43:0/2873227328 learned_addr learned my addr 172.21.15.43:0/2873227328 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:22:59.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f89fbfff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 0x7f8a040bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a037fe700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a04148540 0x7f8a041489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 -- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a04148540 msgr2=0x7f8a041489c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a04148540 0x7f8a041489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 -- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 msgr2=0x7f8a040bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 0x7f8a040bd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 -- 172.21.15.43:0/2873227328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a041e9c00 con 0x7f89f0004d90 2023-08-27T11:22:59.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f89fbfff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 0x7f8a040bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:22:59.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f8a02ffd700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001200 tx=0x7f89f400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.759+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4005e70 con 0x7f89f0004d90 2023-08-27T11:22:59.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.760+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f400c7e0 con 0x7f89f0004d90 2023-08-27T11:22:59.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.760+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a040ab660 con 0x7f89f0004d90 2023-08-27T11:22:59.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.760+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f400cb50 con 0x7f89f0004d90 2023-08-27T11:22:59.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.760+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a040aa4a0 con 0x7f89f0004d90 2023-08-27T11:22:59.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.761+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0404ee70 con 0x7f89f0004d90 2023-08-27T11:22:59.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.762+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89f400ccb0 con 0x7f89f0004d90 2023-08-27T11:22:59.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.762+0000 7f89fb7fe700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 0x7f89e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:22:59.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.763+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89f40883a0 con 0x7f89f0004d90 2023-08-27T11:22:59.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.763+0000 7f89fbfff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 0x7f89e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:22:59.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.763+0000 7f89fbfff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 0x7f89e406c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a041e7650 tx=0x7f89ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:22:59.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.767+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f89f4053a80 con 0x7f89f0004d90 2023-08-27T11:22:59.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.982+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a040c0ab0 con 0x7f89f0004d90 2023-08-27T11:22:59.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.982+0000 7f89fb7fe700 1 -- 172.21.15.43:0/2873227328 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f89f40570a0 con 0x7f89f0004d90 2023-08-27T11:22:59.985 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:22:59.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 msgr2=0x7f89e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 0x7f89e406c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a041e7650 tx=0x7f89ec008040 comp rx=0 tx=0).stop 2023-08-27T11:22:59.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 msgr2=0x7f8a041ea400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:22:59.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89f4001200 tx=0x7f89f400ee00 comp rx=0 tx=0).stop 2023-08-27T11:22:59.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 shutdown_connections 2023-08-27T11:22:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f89e406a0e0 0x7f89e406c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a04148540 0x7f8a041489c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89f0004d90 0x7f8a041ea400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 --2- 172.21.15.43:0/2873227328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a0414d7f0 0x7f8a040bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:22:59.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 >> 172.21.15.43:0/2873227328 conn(0x7f8a040c9d00 msgr2=0x7f8a0414e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:22:59.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 shutdown_connections 2023-08-27T11:22:59.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:22:59.985+0000 7f8a097ff700 1 -- 172.21.15.43:0/2873227328 wait complete. 2023-08-27T11:23:00.007 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:00.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.209+0000 7f516b5ff700 1 Processor -- start 2023-08-27T11:23:00.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.209+0000 7f516b5ff700 1 -- start start 2023-08-27T11:23:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516b5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51640c7c00 0x7f51640c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516b5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5164154660 con 0x7f5164151d20 2023-08-27T11:23:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516b5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5164154940 con 0x7f516406a8e0 2023-08-27T11:23:00.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516b5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51640c5750 con 0x7f51640c7c00 2023-08-27T11:23:00.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516939b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5164151d20 0x7f51640ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33042/0 (socket says 172.21.15.43:33042) 2023-08-27T11:23:00.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.210+0000 7f516939b700 1 -- 172.21.15.43:0/3358147332 learned_addr learned my addr 172.21.15.43:0/3358147332 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:00.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f5168b9a700 1 --2- 172.21.15.43:0/3358147332 >> v2:172.21.15.57:3300/0 conn(0x7f51640c7c00 0x7f51640c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105430852 0 0) 0x7f5164154660 con 0x7f5164151d20 2023-08-27T11:23:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51500035b0 con 0x7f5164151d20 2023-08-27T11:23:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f5168b9a700 1 -- 172.21.15.43:0/3358147332 >> v1:172.21.15.57:6789/0 conn(0x7f516406a8e0 legacy=0x7f516406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390773158 0 0) 0x7f5164154940 con 0x7f516406a8e0 2023-08-27T11:23:00.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f5168b9a700 1 -- 172.21.15.43:0/3358147332 >> v1:172.21.15.43:6789/0 conn(0x7f5164151d20 legacy=0x7f51640ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f5168b9a700 1 -- 172.21.15.43:0/3358147332 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5164154c20 con 0x7f51640c7c00 2023-08-27T11:23:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.211+0000 7f5168b9a700 1 --2- 172.21.15.43:0/3358147332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c8110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5164152140 tx=0x7f5154009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ad10f65fb77e30 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154004020 con 0x7f51640c7c00 2023-08-27T11:23:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154004180 con 0x7f51640c7c00 2023-08-27T11:23:00.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f515bfff700 1 -- 172.21.15.43:0/3358147332 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154004530 con 0x7f51640c7c00 2023-08-27T11:23:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 -- 172.21.15.43:0/3358147332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 msgr2=0x7f51640c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 --2- 172.21.15.43:0/3358147332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c8110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5164152140 tx=0x7f5154009b20 comp rx=0 tx=0).stop 2023-08-27T11:23:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 -- 172.21.15.43:0/3358147332 shutdown_connections 2023-08-27T11:23:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 --2- 172.21.15.43:0/3358147332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c8110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 -- 172.21.15.43:0/3358147332 >> 172.21.15.43:0/3358147332 conn(0x7f51640c9d00 msgr2=0x7f51640ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 -- 172.21.15.43:0/3358147332 shutdown_connections 2023-08-27T11:23:00.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.212+0000 7f516b5ff700 1 -- 172.21.15.43:0/3358147332 wait complete. 2023-08-27T11:23:00.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.214+0000 7f516b5ff700 1 Processor -- start 2023-08-27T11:23:00.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.214+0000 7f516b5ff700 1 -- start start 2023-08-27T11:23:00.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f516406a8e0 0x7f51641e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516414e9b0 con 0x7f5164151d20 2023-08-27T11:23:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51640c1de0 con 0x7f51640c7c00 2023-08-27T11:23:00.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f516b5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51640c11d0 con 0x7f516406a8e0 2023-08-27T11:23:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f5169b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f5169b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51984/0 (socket says 172.21.15.43:51984) 2023-08-27T11:23:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.215+0000 7f5169b9c700 1 -- 172.21.15.43:0/2567910934 learned_addr learned my addr 172.21.15.43:0/2567910934 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5168b9a700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f516939b700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f516406a8e0 0x7f51641e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 -- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f516406a8e0 msgr2=0x7f51641e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f516406a8e0 0x7f51641e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 -- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 msgr2=0x7f51640c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 -- 172.21.15.43:0/2567910934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540094a0 con 0x7f5164151d20 2023-08-27T11:23:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5168b9a700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5169b9c700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f515c00cc10 tx=0x7f515c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c003e80 con 0x7f5164151d20 2023-08-27T11:23:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00a7e0 con 0x7f5164151d20 2023-08-27T11:23:00.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00ab90 con 0x7f5164151d20 2023-08-27T11:23:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51640c14b0 con 0x7f5164151d20 2023-08-27T11:23:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.216+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51640c1a70 con 0x7f5164151d20 2023-08-27T11:23:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.218+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51640c1f50 con 0x7f5164151d20 2023-08-27T11:23:00.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.218+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f515c00acf0 con 0x7f5164151d20 2023-08-27T11:23:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.220+0000 7f5159ffb700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 0x7f514806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.220+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f515c0880d0 con 0x7f5164151d20 2023-08-27T11:23:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.221+0000 7f516939b700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 0x7f514806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.221+0000 7f516939b700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 0x7f514806c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5160005910 tx=0x7f5160009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.224+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f515c0537b0 con 0x7f5164151d20 2023-08-27T11:23:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.435+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f516404ee70 con 0x7f5164151d20 2023-08-27T11:23:00.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.435+0000 7f5159ffb700 1 -- 172.21.15.43:0/2567910934 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f515c056dd0 con 0x7f5164151d20 2023-08-27T11:23:00.439 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:00.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 msgr2=0x7f514806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 0x7f514806c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5160005910 tx=0x7f5160009040 comp rx=0 tx=0).stop 2023-08-27T11:23:00.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 msgr2=0x7f51640c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f515c00cc10 tx=0x7f515c00a060 comp rx=0 tx=0).stop 2023-08-27T11:23:00.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 shutdown_connections 2023-08-27T11:23:00.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f514806a0e0 0x7f514806c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5164151d20 0x7f51640c2bc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f516406a8e0 0x7f51641e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 --2- 172.21.15.43:0/2567910934 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51640c7c00 0x7f51640c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 >> 172.21.15.43:0/2567910934 conn(0x7f51640c9d00 msgr2=0x7f51640ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:00.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 shutdown_connections 2023-08-27T11:23:00.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.438+0000 7f516b5ff700 1 -- 172.21.15.43:0/2567910934 wait complete. 2023-08-27T11:23:00.458 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:00.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.658+0000 7f842c3ff700 1 Processor -- start 2023-08-27T11:23:00.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.658+0000 7f842c3ff700 1 -- start start 2023-08-27T11:23:00.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 0x7f84240c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f84240c4630 0x7f84240c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f842406ad70 0x7f842406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842406c4e0 con 0x7f84240c4630 2023-08-27T11:23:00.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8424155370 con 0x7f842406ad70 2023-08-27T11:23:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8424151e70 con 0x7f8424151a90 2023-08-27T11:23:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f84240c4630 0x7f84240c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f84240c4630 0x7f84240c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51994/0 (socket says 172.21.15.43:51994) 2023-08-27T11:23:00.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 -- 172.21.15.43:0/81006098 learned_addr learned my addr 172.21.15.43:0/81006098 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842a99c700 1 --2- 172.21.15.43:0/81006098 >> v2:172.21.15.57:3300/0 conn(0x7f842406ad70 0x7f842406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842a19b700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 0x7f84240c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 -- 172.21.15.43:0/81006098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 msgr2=0x7f84240c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 0x7f84240c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 -- 172.21.15.43:0/81006098 >> v2:172.21.15.57:3300/0 conn(0x7f842406ad70 msgr2=0x7f842406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 --2- 172.21.15.43:0/81006098 >> v2:172.21.15.57:3300/0 conn(0x7f842406ad70 0x7f842406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 -- 172.21.15.43:0/81006098 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424154480 con 0x7f84240c4630 2023-08-27T11:23:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842a19b700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 0x7f84240c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f842999a700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84240c4630 0x7f84240c4a90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84240bd700 tx=0x7f8414009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce41c72647efa8b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f8429199700 1 -- 172.21.15.43:0/81006098 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400b870 con 0x7f84240c4630 2023-08-27T11:23:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f8429199700 1 -- 172.21.15.43:0/81006098 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841400b9d0 con 0x7f84240c4630 2023-08-27T11:23:00.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.659+0000 7f8429199700 1 -- 172.21.15.43:0/81006098 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841400bd60 con 0x7f84240c4630 2023-08-27T11:23:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 -- 172.21.15.43:0/81006098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84240c4630 msgr2=0x7f84240c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84240c4630 0x7f84240c4a90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84240bd700 tx=0x7f8414009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 -- 172.21.15.43:0/81006098 shutdown_connections 2023-08-27T11:23:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 --2- 172.21.15.43:0/81006098 >> v2:172.21.15.57:3300/0 conn(0x7f842406ad70 0x7f842406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8424151a90 0x7f84240c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 --2- 172.21.15.43:0/81006098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84240c4630 0x7f84240c4a90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 -- 172.21.15.43:0/81006098 >> 172.21.15.43:0/81006098 conn(0x7f84240ab820 msgr2=0x7f84240abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:00.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 -- 172.21.15.43:0/81006098 shutdown_connections 2023-08-27T11:23:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.660+0000 7f842c3ff700 1 -- 172.21.15.43:0/81006098 wait complete. 2023-08-27T11:23:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.662+0000 7f842c3ff700 1 Processor -- start 2023-08-27T11:23:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.662+0000 7f842c3ff700 1 -- start start 2023-08-27T11:23:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84240c4630 0x7f8424149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 0x7f84240c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84241eacb0 con 0x7f842406ad70 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84241485a0 con 0x7f8424151a90 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84241483d0 con 0x7f84240c4630 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52002/0 (socket says 172.21.15.43:52002) 2023-08-27T11:23:00.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 -- 172.21.15.43:0/4200871547 learned_addr learned my addr 172.21.15.43:0/4200871547 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:00.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842999a700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84240c4630 0x7f8424149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a99c700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 0x7f84240c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 -- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84240c4630 msgr2=0x7f8424149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84240c4630 0x7f8424149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 -- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 msgr2=0x7f84240c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 0x7f84240c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a19b700 1 -- 172.21.15.43:0/4200871547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009550 con 0x7f842406ad70 2023-08-27T11:23:00.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.663+0000 7f842a99c700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 0x7f84240c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:00.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f842a19b700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f842000c7f0 tx=0x7f842000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011800 con 0x7f842406ad70 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8420011960 con 0x7f842406ad70 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420011cf0 con 0x7f842406ad70 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8424149750 con 0x7f842406ad70 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.664+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84241480f0 con 0x7f842406ad70 2023-08-27T11:23:00.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.665+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842404ee70 con 0x7f842406ad70 2023-08-27T11:23:00.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.666+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8420018360 con 0x7f842406ad70 2023-08-27T11:23:00.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.667+0000 7f841affd700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 0x7f840806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:00.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.668+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84200884d0 con 0x7f842406ad70 2023-08-27T11:23:00.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.668+0000 7f842999a700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 0x7f840806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:00.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.668+0000 7f842999a700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 0x7f840806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8414000c00 tx=0x7f8414008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:00.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.673+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8420053b30 con 0x7f842406ad70 2023-08-27T11:23:00.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.928+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f842414ab80 con 0x7f842406ad70 2023-08-27T11:23:00.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.928+0000 7f841affd700 1 -- 172.21.15.43:0/4200871547 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f8420057150 con 0x7f842406ad70 2023-08-27T11:23:00.931 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:00.931 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:00.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 msgr2=0x7f840806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 0x7f840806c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8414000c00 tx=0x7f8414008030 comp rx=0 tx=0).stop 2023-08-27T11:23:00.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 msgr2=0x7f8424148cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:00.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f842000c7f0 tx=0x7f842000cb00 comp rx=0 tx=0).stop 2023-08-27T11:23:00.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 shutdown_connections 2023-08-27T11:23:00.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f840806a0e0 0x7f840806c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8424151a90 0x7f84240c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f842406ad70 0x7f8424148cd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 --2- 172.21.15.43:0/4200871547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84240c4630 0x7f8424149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:00.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 >> 172.21.15.43:0/4200871547 conn(0x7f84240ab820 msgr2=0x7f842414b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:00.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 shutdown_connections 2023-08-27T11:23:00.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:00.931+0000 7f842c3ff700 1 -- 172.21.15.43:0/4200871547 wait complete. 2023-08-27T11:23:00.936 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:00.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:01.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 Processor -- start 2023-08-27T11:23:01.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 -- start start 2023-08-27T11:23:01.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f508c0c4630 0x7f508c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f508c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c06c4e0 con 0x7f508c151a90 2023-08-27T11:23:01.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c155370 con 0x7f508c0c4630 2023-08-27T11:23:01.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.153+0000 7f50929ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0c82c0 con 0x7f508c06ad70 2023-08-27T11:23:01.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f508c151a90 0x7f508c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33044/0 (socket says 172.21.15.43:33044) 2023-08-27T11:23:01.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508bfff700 1 -- 172.21.15.43:0/2300785171 learned_addr learned my addr 172.21.15.43:0/2300785171 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:01.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508b7fe700 1 --2- 172.21.15.43:0/2300785171 >> v2:172.21.15.57:3300/0 conn(0x7f508c0c4630 0x7f508c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f5090f9c700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f508c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299019379 0 0) 0x7f508c06c4e0 con 0x7f508c151a90 2023-08-27T11:23:01.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50740035b0 con 0x7f508c151a90 2023-08-27T11:23:01.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922356890 0 0) 0x7f50740035b0 con 0x7f508c151a90 2023-08-27T11:23:01.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 msgr2=0x7f508c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f508c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 >> v2:172.21.15.57:3300/0 conn(0x7f508c0c4630 msgr2=0x7f508c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 --2- 172.21.15.43:0/2300785171 >> v2:172.21.15.57:3300/0 conn(0x7f508c0c4630 0x7f508c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c151e70 con 0x7f508c151a90 2023-08-27T11:23:01.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f507c001670 con 0x7f508c151a90 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508b7fe700 1 --2- 172.21.15.43:0/2300785171 >> v2:172.21.15.57:3300/0 conn(0x7f508c0c4630 0x7f508c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 >> v1:172.21.15.43:6789/0 conn(0x7f508c151a90 legacy=0x7f508c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.154+0000 7f508affd700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f5074003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508affd700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5074004850 0x7f5074004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508affd700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f5074005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c155370 con 0x7f5074003a00 2023-08-27T11:23:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0c82c0 con 0x7f5074004850 2023-08-27T11:23:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507400ba40 con 0x7f508c06ad70 2023-08-27T11:23:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f5074003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508b7fe700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5074004850 0x7f5074004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f5090f9c700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f5074005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 -- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 msgr2=0x7f5074005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c06ad70 0x7f5074005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 -- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5074004850 msgr2=0x7f5074004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5074004850 0x7f5074004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 -- 172.21.15.43:0/2300785171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740035b0 con 0x7f5074003a00 2023-08-27T11:23:01.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.156+0000 7f508bfff700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f5074003e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c320 tx=0x7f5074005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a584b296c007e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00ce00 con 0x7f5074003a00 2023-08-27T11:23:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c005960 con 0x7f5074003a00 2023-08-27T11:23:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f508affd700 1 -- 172.21.15.43:0/2300785171 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c005d10 con 0x7f5074003a00 2023-08-27T11:23:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 -- 172.21.15.43:0/2300785171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 msgr2=0x7f5074003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 --2- 172.21.15.43:0/2300785171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f5074003e20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f507c00c320 tx=0x7f5074005880 comp rx=0 tx=0).stop 2023-08-27T11:23:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f5090f9c700 1 -- 172.21.15.43:0/2300785171 reap_dead start 2023-08-27T11:23:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 -- 172.21.15.43:0/2300785171 shutdown_connections 2023-08-27T11:23:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 -- 172.21.15.43:0/2300785171 >> 172.21.15.43:0/2300785171 conn(0x7f508c0ab820 msgr2=0x7f508c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 -- 172.21.15.43:0/2300785171 shutdown_connections 2023-08-27T11:23:01.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.157+0000 7f50929ff700 1 -- 172.21.15.43:0/2300785171 wait complete. 2023-08-27T11:23:01.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.159+0000 7f50929ff700 1 Processor -- start 2023-08-27T11:23:01.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.159+0000 7f50929ff700 1 -- start start 2023-08-27T11:23:01.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c1e94c0 0x7f508c0aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c145df0 0x7f508c146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c14cb70 con 0x7f5074003a00 2023-08-27T11:23:01.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0be480 con 0x7f508c145df0 2023-08-27T11:23:01.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f50929ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c14bf60 con 0x7f508c1e94c0 2023-08-27T11:23:01.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f508bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f508bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52010/0 (socket says 172.21.15.43:52010) 2023-08-27T11:23:01.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f508bfff700 1 -- 172.21.15.43:0/3556247085 learned_addr learned my addr 172.21.15.43:0/3556247085 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:01.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f5090f9c700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c145df0 0x7f508c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.160+0000 7f508b7fe700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c1e94c0 0x7f508c0aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 -- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c1e94c0 msgr2=0x7f508c0aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c1e94c0 0x7f508c0aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 -- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c145df0 msgr2=0x7f508c146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c145df0 0x7f508c146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 -- 172.21.15.43:0/3556247085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c14c240 con 0x7f5074003a00 2023-08-27T11:23:01.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f508bfff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f507c008fd0 tx=0x7f507c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c004870 con 0x7f5074003a00 2023-08-27T11:23:01.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c0049d0 con 0x7f5074003a00 2023-08-27T11:23:01.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c14cb70 con 0x7f5074003a00 2023-08-27T11:23:01.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.161+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c004d80 con 0x7f5074003a00 2023-08-27T11:23:01.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.162+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c14c800 con 0x7f5074003a00 2023-08-27T11:23:01.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.163+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c04ee70 con 0x7f5074003a00 2023-08-27T11:23:01.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.163+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f507c0070d0 con 0x7f5074003a00 2023-08-27T11:23:01.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.164+0000 7f5088ff9700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 0x7f507806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.164+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f507c0899e0 con 0x7f5074003a00 2023-08-27T11:23:01.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.164+0000 7f508b7fe700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 0x7f507806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.165+0000 7f508b7fe700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 0x7f507806c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f508c151160 tx=0x7f5080009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.169+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f507c0552a0 con 0x7f5074003a00 2023-08-27T11:23:01.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.382+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f508c14ce50 con 0x7f5074003a00 2023-08-27T11:23:01.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.383+0000 7f5088ff9700 1 -- 172.21.15.43:0/3556247085 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f507c0588c0 con 0x7f5074003a00 2023-08-27T11:23:01.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:01.385 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:01.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 msgr2=0x7f507806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 0x7f507806c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f508c151160 tx=0x7f5080009210 comp rx=0 tx=0).stop 2023-08-27T11:23:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 msgr2=0x7f508c0bd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f507c008fd0 tx=0x7f507c001a00 comp rx=0 tx=0).stop 2023-08-27T11:23:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 shutdown_connections 2023-08-27T11:23:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f507806a0e0 0x7f507806c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f508c145df0 0x7f508c146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5074003a00 0x7f508c0bd990 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 --2- 172.21.15.43:0/3556247085 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f508c1e94c0 0x7f508c0aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 >> 172.21.15.43:0/3556247085 conn(0x7f508c0ab820 msgr2=0x7f508c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:01.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 shutdown_connections 2023-08-27T11:23:01.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.386+0000 7f50929ff700 1 -- 172.21.15.43:0/3556247085 wait complete. 2023-08-27T11:23:01.406 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:01.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.605+0000 7f0e481ff700 1 Processor -- start 2023-08-27T11:23:01.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.605+0000 7f0e481ff700 1 -- start start 2023-08-27T11:23:01.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e481ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e400c4a90 0x7f0e4006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e481ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4006c4e0 con 0x7f0e400c4630 2023-08-27T11:23:01.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e481ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e40155370 con 0x7f0e40151a90 2023-08-27T11:23:01.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e481ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400c82c0 con 0x7f0e400c4a90 2023-08-27T11:23:01.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4579a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0e400c4630 0x7f0e4006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33050/0 (socket says 172.21.15.43:33050) 2023-08-27T11:23:01.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4579a700 1 -- 172.21.15.43:0/1065626192 learned_addr learned my addr 172.21.15.43:0/1065626192 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:01.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4679c700 1 --2- 172.21.15.43:0/1065626192 >> v2:172.21.15.57:3300/0 conn(0x7f0e400c4a90 0x7f0e4006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e44f99700 1 -- 172.21.15.43:0/1065626192 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180401848 0 0) 0x7f0e4006c4e0 con 0x7f0e400c4630 2023-08-27T11:23:01.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e44f99700 1 -- 172.21.15.43:0/1065626192 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c0035b0 con 0x7f0e400c4630 2023-08-27T11:23:01.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4679c700 1 -- 172.21.15.43:0/1065626192 >> v1:172.21.15.57:6789/0 conn(0x7f0e40151a90 legacy=0x7f0e400c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4679c700 1 -- 172.21.15.43:0/1065626192 >> v1:172.21.15.43:6789/0 conn(0x7f0e400c4630 legacy=0x7f0e4006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.607+0000 7f0e4679c700 1 -- 172.21.15.43:0/1065626192 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e40151e70 con 0x7f0e400c4a90 2023-08-27T11:23:01.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e4679c700 1 --2- 172.21.15.43:0/1065626192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e4006b480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009d90 tx=0x7f0e3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddef572420ca5231 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e44f99700 1 -- 172.21.15.43:0/1065626192 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800e070 con 0x7f0e400c4a90 2023-08-27T11:23:01.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e44f99700 1 -- 172.21.15.43:0/1065626192 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3800bb20 con 0x7f0e400c4a90 2023-08-27T11:23:01.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e44f99700 1 -- 172.21.15.43:0/1065626192 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38012430 con 0x7f0e400c4a90 2023-08-27T11:23:01.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e481ff700 1 -- 172.21.15.43:0/1065626192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 msgr2=0x7f0e4006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.608+0000 7f0e481ff700 1 --2- 172.21.15.43:0/1065626192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e4006b480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009d90 tx=0x7f0e3800b330 comp rx=0 tx=0).stop 2023-08-27T11:23:01.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.609+0000 7f0e481ff700 1 -- 172.21.15.43:0/1065626192 shutdown_connections 2023-08-27T11:23:01.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.609+0000 7f0e481ff700 1 --2- 172.21.15.43:0/1065626192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e4006b480 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.609+0000 7f0e481ff700 1 -- 172.21.15.43:0/1065626192 >> 172.21.15.43:0/1065626192 conn(0x7f0e400ab820 msgr2=0x7f0e400abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:01.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.609+0000 7f0e481ff700 1 -- 172.21.15.43:0/1065626192 shutdown_connections 2023-08-27T11:23:01.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.609+0000 7f0e481ff700 1 -- 172.21.15.43:0/1065626192 wait complete. 2023-08-27T11:23:01.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.610+0000 7f0e481ff700 1 Processor -- start 2023-08-27T11:23:01.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.610+0000 7f0e481ff700 1 -- start start 2023-08-27T11:23:01.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e400c4630 0x7f0e40148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e401ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40154310 con 0x7f0e40151a90 2023-08-27T11:23:01.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40149210 con 0x7f0e400c4a90 2023-08-27T11:23:01.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.611+0000 7f0e481ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e401edb80 con 0x7f0e400c4630 2023-08-27T11:23:01.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52012/0 (socket says 172.21.15.43:52012) 2023-08-27T11:23:01.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 -- 172.21.15.43:0/3413582278 learned_addr learned my addr 172.21.15.43:0/3413582278 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:01.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4579a700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e401ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e45f9b700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e400c4630 0x7f0e40148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 -- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e400c4630 msgr2=0x7f0e40148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e400c4630 0x7f0e40148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 -- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 msgr2=0x7f0e401ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e401ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 -- 172.21.15.43:0/3413582278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38009a70 con 0x7f0e40151a90 2023-08-27T11:23:01.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.612+0000 7f0e4679c700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ac6e0 tx=0x7f0e38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.613+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38012430 con 0x7f0e40151a90 2023-08-27T11:23:01.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.613+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38020070 con 0x7f0e40151a90 2023-08-27T11:23:01.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.613+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e40150e20 con 0x7f0e40151a90 2023-08-27T11:23:01.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.613+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38004280 con 0x7f0e40151a90 2023-08-27T11:23:01.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.613+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e40153d50 con 0x7f0e40151a90 2023-08-27T11:23:01.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.614+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4004ee70 con 0x7f0e40151a90 2023-08-27T11:23:01.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.615+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e380043e0 con 0x7f0e40151a90 2023-08-27T11:23:01.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.615+0000 7f0e367fc700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 0x7f0e2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:01.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.615+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e38022070 con 0x7f0e40151a90 2023-08-27T11:23:01.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.616+0000 7f0e45f9b700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 0x7f0e2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:01.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.616+0000 7f0e45f9b700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 0x7f0e2406c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c007fd0 tx=0x7f0e3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:01.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.620+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e380558a0 con 0x7f0e40151a90 2023-08-27T11:23:01.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.875+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e4014f530 con 0x7f0e40151a90 2023-08-27T11:23:01.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.875+0000 7f0e367fc700 1 -- 172.21.15.43:0/3413582278 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f0e38058ec0 con 0x7f0e40151a90 2023-08-27T11:23:01.877 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:01.877 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:01.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 msgr2=0x7f0e2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 0x7f0e2406c5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c007fd0 tx=0x7f0e3c009040 comp rx=0 tx=0).stop 2023-08-27T11:23:01.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 msgr2=0x7f0e4014cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:01.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ac6e0 tx=0x7f0e38004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 shutdown_connections 2023-08-27T11:23:01.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2406a0e0 0x7f0e2406c5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e40151a90 0x7f0e4014cfb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e400c4630 0x7f0e40148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 --2- 172.21.15.43:0/3413582278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e400c4a90 0x7f0e401ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:01.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 >> 172.21.15.43:0/3413582278 conn(0x7f0e400ab820 msgr2=0x7f0e400c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:01.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 shutdown_connections 2023-08-27T11:23:01.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:01.878+0000 7f0e481ff700 1 -- 172.21.15.43:0/3413582278 wait complete. 2023-08-27T11:23:01.882 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:02.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:22:43.471610+0000', 'modified': '2023-08-27T11:22:46.990039+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1109413426', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 1109413426}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1109413426}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:23:02.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:23:02.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:23:02.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.505+0000 7f8aed3ff700 1 Processor -- start 2023-08-27T11:23:02.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.505+0000 7f8aed3ff700 1 -- start start 2023-08-27T11:23:02.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.506+0000 7f8aed3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 0x7f8ae80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.506+0000 7f8aed3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae806c4e0 con 0x7f8ae80c4a90 2023-08-27T11:23:02.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8aed3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae8155370 con 0x7f8ae80c4630 2023-08-27T11:23:02.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8aed3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8151e70 con 0x7f8ae8151a90 2023-08-27T11:23:02.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae77fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8ae80c4a90 0x7f8ae806b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33062/0 (socket says 172.21.15.43:33062) 2023-08-27T11:23:02.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae77fe700 1 -- 172.21.15.43:0/1479781308 learned_addr learned my addr 172.21.15.43:0/1479781308 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:02.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/1479781308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 0x7f8ae80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078924720 0 0) 0x7f8ae806c4e0 con 0x7f8ae80c4a90 2023-08-27T11:23:02.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad00035b0 con 0x7f8ae80c4a90 2023-08-27T11:23:02.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81355486 0 0) 0x7f8ae8155370 con 0x7f8ae80c4630 2023-08-27T11:23:02.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae806c4e0 con 0x7f8ae80c4630 2023-08-27T11:23:02.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae6ffd700 1 -- 172.21.15.43:0/1479781308 >> v1:172.21.15.57:6789/0 conn(0x7f8ae80c4630 legacy=0x7f8ae806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae6ffd700 1 -- 172.21.15.43:0/1479781308 >> v1:172.21.15.43:6789/0 conn(0x7f8ae80c4a90 legacy=0x7f8ae806b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.507+0000 7f8ae6ffd700 1 -- 172.21.15.43:0/1479781308 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8154480 con 0x7f8ae8151a90 2023-08-27T11:23:02.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/1479781308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 0x7f8ae80c7bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009870 tx=0x7f8ad8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f4e643c0a16def server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8011830 con 0x7f8ae8151a90 2023-08-27T11:23:02.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8011990 con 0x7f8ae8151a90 2023-08-27T11:23:02.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8ae5ffb700 1 -- 172.21.15.43:0/1479781308 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8011d20 con 0x7f8ae8151a90 2023-08-27T11:23:02.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8aed3ff700 1 -- 172.21.15.43:0/1479781308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 msgr2=0x7f8ae80c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.508+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/1479781308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 0x7f8ae80c7bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009870 tx=0x7f8ad8009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:02.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.509+0000 7f8aed3ff700 1 -- 172.21.15.43:0/1479781308 shutdown_connections 2023-08-27T11:23:02.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.509+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/1479781308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae8151a90 0x7f8ae80c7bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.509+0000 7f8aed3ff700 1 -- 172.21.15.43:0/1479781308 >> 172.21.15.43:0/1479781308 conn(0x7f8ae80ab820 msgr2=0x7f8ae80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.509+0000 7f8aed3ff700 1 -- 172.21.15.43:0/1479781308 shutdown_connections 2023-08-27T11:23:02.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.509+0000 7f8aed3ff700 1 -- 172.21.15.43:0/1479781308 wait complete. 2023-08-27T11:23:02.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.510+0000 7f8aed3ff700 1 Processor -- start 2023-08-27T11:23:02.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.510+0000 7f8aed3ff700 1 -- start start 2023-08-27T11:23:02.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 0x7f8ae80c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae80c4a90 0x7f8ae81e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80ab6c0 con 0x7f8ae8151a90 2023-08-27T11:23:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80be160 con 0x7f8ae80c4630 2023-08-27T11:23:02.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8aed3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8152310 con 0x7f8ae80c4a90 2023-08-27T11:23:02.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.511+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52018/0 (socket says 172.21.15.43:52018) 2023-08-27T11:23:02.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 -- 172.21.15.43:0/3646146263 learned_addr learned my addr 172.21.15.43:0/3646146263 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:02.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 0x7f8ae80c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 -- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae80c4a90 msgr2=0x7f8ae81e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae80c4a90 0x7f8ae81e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 -- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 msgr2=0x7f8ae80c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 0x7f8ae80c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 -- 172.21.15.43:0/3646146263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad80094a0 con 0x7f8ae8151a90 2023-08-27T11:23:02.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 0x7f8ae80c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:02.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000cbf0 tx=0x7f8ae000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8acf7fe700 1 -- 172.21.15.43:0/3646146263 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000ab80 con 0x7f8ae8151a90 2023-08-27T11:23:02.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8acf7fe700 1 -- 172.21.15.43:0/3646146263 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000ace0 con 0x7f8ae8151a90 2023-08-27T11:23:02.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8acf7fe700 1 -- 172.21.15.43:0/3646146263 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0012600 con 0x7f8ae8151a90 2023-08-27T11:23:02.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae81ea7a0 con 0x7f8ae8151a90 2023-08-27T11:23:02.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.512+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80be690 con 0x7f8ae8151a90 2023-08-27T11:23:02.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.515+0000 7f8acf7fe700 1 -- 172.21.15.43:0/3646146263 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ae001b3b0 con 0x7f8ae8151a90 2023-08-27T11:23:02.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.515+0000 7f8acf7fe700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 0x7f8ad406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.516+0000 7f8acf7fe700 1 -- 172.21.15.43:0/3646146263 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ae0088230 con 0x7f8ae8151a90 2023-08-27T11:23:02.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.516+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 0x7f8ad406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.516+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 0x7f8ad406c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8000c00 tx=0x7f8ad8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.518+0000 7f8b00c6fb80 1 Processor -- start 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.518+0000 7f8b00c6fb80 1 -- start start 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.518+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b4518e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.518+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.518+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45181f730 con 0x55b4518c7fe0 2023-08-27T11:23:02.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45181d050 con 0x55b4518c1f00 2023-08-27T11:23:02.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b451818940 con 0x55b4518c22e0 2023-08-27T11:23:02.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52020/0 (socket says 172.21.15.43:52020) 2023-08-27T11:23:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2856563300 learned_addr learned my addr 172.21.15.43:0/2856563300 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b4518e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 msgr2=0x55b4518fa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 msgr2=0x55b4518e4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b4518e4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2856563300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4516985e0 con 0x55b4518c7fe0 2023-08-27T11:23:02.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b4518e4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:02.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.519+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0014c0 tx=0x7f8adc0017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c1643cb834608 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8acd7fa700 1 -- 172.21.15.43:0/2856563300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0052d0 con 0x55b4518c7fe0 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8acd7fa700 1 -- 172.21.15.43:0/2856563300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc005450 con 0x55b4518c7fe0 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8acd7fa700 1 -- 172.21.15.43:0/2856563300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0038c0 con 0x55b4518c7fe0 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2856563300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 msgr2=0x55b4518e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0014c0 tx=0x7f8adc0017d0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2856563300 shutdown_connections 2023-08-27T11:23:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b4518e4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2856563300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c7fe0 0x55b4518e52b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2856563300 >> 172.21.15.43:0/2856563300 conn(0x55b451824c30 msgr2=0x55b4518c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2856563300 shutdown_connections 2023-08-27T11:23:02.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.520+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2856563300 wait complete. 2023-08-27T11:23:02.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.521+0000 7f8b00c6fb80 1 -- start start 2023-08-27T11:23:02.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.521+0000 7f8b00c6fb80 1 Processor -- start 2023-08-27T11:23:02.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4519033d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 0x55b451906650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4517b6b60 con 0x55b451906b90 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4517b6860 con 0x55b4518c22e0 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b45169a8d0 con 0x55b4518c1f00 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.522+0000 7f8b00c6fb80 10 client.0 _ll_register_callbacks cb 0x55b4517b4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:02.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52022/0 (socket says 172.21.15.43:52022) 2023-08-27T11:23:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 -- 172.21.15.43:0/238272200 learned_addr learned my addr 172.21.15.43:0/238272200 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 0x55b451906650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4519033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 -- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 msgr2=0x55b4519033d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4519033d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 -- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 msgr2=0x55b451906650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 0x55b451906650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 -- 172.21.15.43:0/238272200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae806c4e0 con 0x55b451906b90 2023-08-27T11:23:02.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 0x55b451906650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000cbc0 tx=0x7f8ae0056e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f655d4b120c1330 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0088070 con 0x55b451906b90 2023-08-27T11:23:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ae005b170 con 0x55b451906b90 2023-08-27T11:23:02.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.523+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4518b94f0 con 0x55b451906b90 2023-08-27T11:23:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ae006ab90 con 0x55b451906b90 2023-08-27T11:23:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 10 client.4674 fetch_fsmap learned FSMap version 8 2023-08-27T11:23:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b451830750 con 0x55b451906b90 2023-08-27T11:23:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0085030 con 0x55b451906b90 2023-08-27T11:23:02.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ae006acf0 con 0x55b451906b90 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 10 client.4674 fetch_fsmap finished waiting for FSMap version 8 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 20 client.4674 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b451912300 0x55b4519126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 4 client.4674 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:23:02.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.524+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 --> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b451811920 con 0x55b451912300 2023-08-27T11:23:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.525+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b451912300 0x55b4519126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.525+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b451912300 0x55b4519126e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df865c89de34d3a9 server_cookie=b5a42c66042fcefe in_seq=0 out_seq=0 2023-08-27T11:23:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.525+0000 7f8ac5ffb700 10 client.4674 ms_handle_connect on v2:172.21.15.57:6834/1109413426 2023-08-27T11:23:02.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.526+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/238272200 <== mds.0 v2:172.21.15.57:6834/1109413426 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b451811920 con 0x55b451912300 2023-08-27T11:23:02.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.526+0000 7f8ac5ffb700 10 client.4674 handle_command_reply: tid=0 2023-08-27T11:23:02.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.526+0000 7f8b00c6fb80 1 client.4674 shutdown 2023-08-27T11:23:02.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 msgr2=0x55b451915ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000cbc0 tx=0x7f8ae0056e50 comp rx=0 tx=0).stop 2023-08-27T11:23:02.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 shutdown_connections 2023-08-27T11:23:02.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b451915ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4519033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b451912300 0x55b4519126e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/238272200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c22e0 0x55b451906650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 >> 172.21.15.43:0/238272200 conn(0x55b451824c30 msgr2=0x55b4518c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8ac5ffb700 0 client.4674 ms_handle_reset on v2:172.21.15.57:6834/1109413426 2023-08-27T11:23:02.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 shutdown_connections 2023-08-27T11:23:02.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/238272200 wait complete. 2023-08-27T11:23:02.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.527+0000 7f8b00c6fb80 20 client.4674 trim_cache size 0 max 16384 2023-08-27T11:23:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.545+0000 7f8b00c6fb80 1 Processor -- start 2023-08-27T11:23:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.545+0000 7f8b00c6fb80 1 -- start start 2023-08-27T11:23:02.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b451901f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4519039b0 con 0x55b451906b90 2023-08-27T11:23:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4519048f0 con 0x55b4518c1f00 2023-08-27T11:23:02.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b451903b20 con 0x55b4518c22e0 2023-08-27T11:23:02.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.546+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52036/0 (socket says 172.21.15.43:52036) 2023-08-27T11:23:02.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 -- 172.21.15.43:0/1445455754 learned_addr learned my addr 172.21.15.43:0/1445455754 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:02.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 -- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 msgr2=0x55b4518fe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b451901f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 -- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 msgr2=0x55b451901f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b451901f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 -- 172.21.15.43:0/1445455754 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae81534c0 con 0x55b451906b90 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b451901f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:02.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0057330 tx=0x7f8ae0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cd3b1bca94db9b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8acdffb700 1 -- 172.21.15.43:0/1445455754 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00571c0 con 0x55b451906b90 2023-08-27T11:23:02.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8acdffb700 1 -- 172.21.15.43:0/1445455754 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae0085070 con 0x55b451906b90 2023-08-27T11:23:02.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.547+0000 7f8acdffb700 1 -- 172.21.15.43:0/1445455754 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae006adb0 con 0x55b451906b90 2023-08-27T11:23:02.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/1445455754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 msgr2=0x55b4518fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0057330 tx=0x7f8ae0059000 comp rx=0 tx=0).stop 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/1445455754 shutdown_connections 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b451906b90 0x55b4518fe9f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b4518c1f00 0x55b451901f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/1445455754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c22e0 0x55b4518fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/1445455754 >> 172.21.15.43:0/1445455754 conn(0x55b451824c30 msgr2=0x55b4518c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/1445455754 shutdown_connections 2023-08-27T11:23:02.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.548+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/1445455754 wait complete. 2023-08-27T11:23:02.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.549+0000 7f8b00c6fb80 1 -- start start 2023-08-27T11:23:02.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.549+0000 7f8b00c6fb80 1 Processor -- start 2023-08-27T11:23:02.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4518c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b451906b90 0x55b4519672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b45196e300 con 0x55b4518c22e0 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4518fede0 con 0x55b451906b90 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4518c0590 con 0x55b4518c1f00 2023-08-27T11:23:02.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8b00c6fb80 10 client.0 _ll_register_callbacks cb 0x55b4517b4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52038/0 (socket says 172.21.15.43:52038) 2023-08-27T11:23:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2022517452 learned_addr learned my addr 172.21.15.43:0/2022517452 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae77fe700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b451906b90 0x55b4519672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4518c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 msgr2=0x55b4518c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4518c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b451906b90 msgr2=0x55b4519672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:02.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b451906b90 0x55b4519672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.550+0000 7f8ae67fc700 1 -- 172.21.15.43:0/2022517452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b451830750 con 0x55b4518c22e0 2023-08-27T11:23:02.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ae67fc700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8adc014040 tx=0x7f8adc001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e577172e45701cb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:02.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:02.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc003dc0 con 0x55b4518c22e0 2023-08-27T11:23:02.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4519008d0 con 0x55b4518c22e0 2023-08-27T11:23:02.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8adc006860 con 0x55b4518c22e0 2023-08-27T11:23:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8adc006a40 con 0x55b4518c22e0 2023-08-27T11:23:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8b00c6fb80 10 client.4680 fetch_fsmap learned FSMap version 8 2023-08-27T11:23:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b451644d90 con 0x55b4518c22e0 2023-08-27T11:23:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.551+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4519008d0 con 0x55b4518c22e0 2023-08-27T11:23:02.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8adc006ba0 con 0x55b4518c22e0 2023-08-27T11:23:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 10 client.4680 fetch_fsmap finished waiting for FSMap version 8 2023-08-27T11:23:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:23:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 20 client.4680 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b4519678f0 0x55b4518f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:02.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 4 client.4680 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-08-27T11:23:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 --> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f8adc005450 con 0x55b4519678f0 2023-08-27T11:23:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b4519678f0 0x55b4518f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.552+0000 7f8ae6ffd700 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b4519678f0 0x55b4518f9e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3a1ae498906cdc server_cookie=f06a52a3e708d34 in_seq=0 out_seq=0 2023-08-27T11:23:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8ac5ffb700 10 client.4680 ms_handle_connect on v2:172.21.15.57:6834/1109413426 2023-08-27T11:23:02.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8ac5ffb700 1 -- 172.21.15.43:0/2022517452 <== mds.0 v2:172.21.15.57:6834/1109413426 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f8adc005450 con 0x55b4519678f0 2023-08-27T11:23:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8ac5ffb700 10 client.4680 handle_command_reply: tid=0 2023-08-27T11:23:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 client.4680 shutdown 2023-08-27T11:23:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 msgr2=0x55b45196d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8adc014040 tx=0x7f8adc001150 comp rx=0 tx=0).stop 2023-08-27T11:23:02.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 shutdown_connections 2023-08-27T11:23:02.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:6834/1109413426,v1:172.21.15.57:6835/1109413426] conn(0x55b4519678f0 0x55b4518f9e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55b451906b90 0x55b4519672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55b4518c1f00 0x55b4518c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 --2- 172.21.15.43:0/2022517452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b4518c22e0 0x55b45196d6c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8ac5ffb700 0 client.4680 ms_handle_reset on v2:172.21.15.57:6834/1109413426 2023-08-27T11:23:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 >> 172.21.15.43:0/2022517452 conn(0x55b451824c30 msgr2=0x55b4518c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 shutdown_connections 2023-08-27T11:23:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 1 -- 172.21.15.43:0/2022517452 wait complete. 2023-08-27T11:23:02.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.553+0000 7f8b00c6fb80 20 client.4680 trim_cache size 0 max 16384 2023-08-27T11:23:02.578 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:23:02.578 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:23:02.578 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:23:02.578 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4302, 2023-08-27T11:23:02.578 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:23:02.579 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:23:02.579 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:23:02.579 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 18.603791063999999, 2023-08-27T11:23:02.579 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 8, 2023-08-27T11:23:02.579 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 21, 2023-08-27T11:23:02.580 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 21, 2023-08-27T11:23:02.580 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 25.421950708000001 2023-08-27T11:23:02.580 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:23:02.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 msgr2=0x7f8ad406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 0x7f8ad406c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8000c00 tx=0x7f8ad8008030 comp rx=0 tx=0).stop 2023-08-27T11:23:02.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 msgr2=0x7f8ae81e7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:02.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ae000cbf0 tx=0x7f8ae000a060 comp rx=0 tx=0).stop 2023-08-27T11:23:02.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 shutdown_connections 2023-08-27T11:23:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad406a0e0 0x7f8ad406c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ae8151a90 0x7f8ae81e7270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ae80c4630 0x7f8ae80c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 --2- 172.21.15.43:0/3646146263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ae80c4a90 0x7f8ae81e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:02.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 >> 172.21.15.43:0/3646146263 conn(0x7f8ae80ab820 msgr2=0x7f8ae806ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 shutdown_connections 2023-08-27T11:23:02.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:02.554+0000 7f8aed3ff700 1 -- 172.21.15.43:0/3646146263 wait complete. 2023-08-27T11:23:02.584 INFO:teuthology.run_tasks:Running task kclient... 2023-08-27T11:23:02.611 INFO:tasks.kclient:Mounting kernel clients... 2023-08-27T11:23:02.612 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-08-27T11:23:02.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:02.612 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-08-27T11:23:02.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:02.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link delete ceph-brx 2023-08-27T11:23:02.768 INFO:teuthology.orchestra.run.smithi043.stderr:Cannot find device "ceph-brx" 2023-08-27T11:23:02.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:23:02.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:02.772 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-08-27T11:23:02.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:02.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2023-08-27T11:23:02.898 INFO:teuthology.orchestra.run.smithi057.stderr:Cannot find device "ceph-brx" 2023-08-27T11:23:02.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-27T11:23:02.902 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-08-27T11:23:02.902 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-27T11:23:02.903 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-27T11:23:02.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-27T11:23:03.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.103+0000 7f853c9ff700 1 Processor -- start 2023-08-27T11:23:03.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.103+0000 7f853c9ff700 1 -- start start 2023-08-27T11:23:03.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853c9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f853814e960 0x7f85380a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85380c50d0 0x7f85380c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853c9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8538154d00 con 0x7f85380a79c0 2023-08-27T11:23:03.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853c9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380baf30 con 0x7f853814e960 2023-08-27T11:23:03.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8538154fe0 con 0x7f85380c50d0 2023-08-27T11:23:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f852ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f85380a79c0 0x7f85380c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33064/0 (socket says 172.21.15.43:33064) 2023-08-27T11:23:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f852ffff700 1 -- 172.21.15.43:0/787370104 learned_addr learned my addr 172.21.15.43:0/787370104 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f853659c700 1 --2- 172.21.15.43:0/787370104 >> v2:172.21.15.57:3300/0 conn(0x7f853814e960 0x7f85380a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214050315 0 0) 0x7f8538154d00 con 0x7f85380a79c0 2023-08-27T11:23:03.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f8536d9d700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85380c50d0 0x7f85380c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.105+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85240057c0 con 0x7f85380a79c0 2023-08-27T11:23:03.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3364316610 0 0) 0x7f85240057c0 con 0x7f85380a79c0 2023-08-27T11:23:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f853659c700 1 -- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85380c50d0 msgr2=0x7f85380c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f853659c700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85380c50d0 0x7f85380c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f853659c700 1 -- 172.21.15.43:0/787370104 >> v1:172.21.15.43:6789/0 conn(0x7f85380a79c0 legacy=0x7f85380c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f853659c700 1 -- 172.21.15.43:0/787370104 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85381552c0 con 0x7f853814e960 2023-08-27T11:23:03.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f853659c700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853814e960 0x7f85380a7480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8528009840 tx=0x7f8528009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee1f1ac73fb558e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:03.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520001670 con 0x7f853814e960 2023-08-27T11:23:03.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528004030 con 0x7f853814e960 2023-08-27T11:23:03.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.106+0000 7f8535d9b700 1 -- 172.21.15.43:0/787370104 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280043c0 con 0x7f853814e960 2023-08-27T11:23:03.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 -- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853814e960 msgr2=0x7f85380a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853814e960 0x7f85380a7480 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8528009840 tx=0x7f8528009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:03.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 -- 172.21.15.43:0/787370104 shutdown_connections 2023-08-27T11:23:03.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85380c50d0 0x7f85380c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 --2- 172.21.15.43:0/787370104 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853814e960 0x7f85380a7480 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 -- 172.21.15.43:0/787370104 >> 172.21.15.43:0/787370104 conn(0x7f853806aa50 msgr2=0x7f85380c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:03.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 -- 172.21.15.43:0/787370104 shutdown_connections 2023-08-27T11:23:03.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.107+0000 7f853c9ff700 1 -- 172.21.15.43:0/787370104 wait complete. 2023-08-27T11:23:03.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.109+0000 7f853c9ff700 1 Processor -- start 2023-08-27T11:23:03.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.109+0000 7f853c9ff700 1 -- start start 2023-08-27T11:23:03.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85380a79c0 0x7f85381513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f853814e960 0x7f8538071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85381edc30 con 0x7f85380c50d0 2023-08-27T11:23:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85381ecda0 con 0x7f85380a79c0 2023-08-27T11:23:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85381ecfb0 con 0x7f853814e960 2023-08-27T11:23:03.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52050/0 (socket says 172.21.15.43:52050) 2023-08-27T11:23:03.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 -- 172.21.15.43:0/685495940 learned_addr learned my addr 172.21.15.43:0/685495940 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:03.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f853659c700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85380a79c0 0x7f85381513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f8536d9d700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f853814e960 0x7f8538071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 -- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f853814e960 msgr2=0x7f8538071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f853814e960 0x7f8538071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 -- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85380a79c0 msgr2=0x7f85381513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85380a79c0 0x7f85381513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.110+0000 7f852ffff700 1 -- 172.21.15.43:0/685495940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280094a0 con 0x7f85380c50d0 2023-08-27T11:23:03.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f852ffff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f852000c750 tx=0x7f852000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:03.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520004c80 con 0x7f85380c50d0 2023-08-27T11:23:03.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520004de0 con 0x7f85380c50d0 2023-08-27T11:23:03.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85200072d0 con 0x7f85380c50d0 2023-08-27T11:23:03.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85381ed290 con 0x7f85380c50d0 2023-08-27T11:23:03.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.111+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85381ed850 con 0x7f85380c50d0 2023-08-27T11:23:03.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.112+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85380bb390 con 0x7f85380c50d0 2023-08-27T11:23:03.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.113+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8520007430 con 0x7f85380c50d0 2023-08-27T11:23:03.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.114+0000 7f852effd700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 0x7f851806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:03.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.114+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85200881f0 con 0x7f85380c50d0 2023-08-27T11:23:03.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.115+0000 7f853659c700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 0x7f851806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:03.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.115+0000 7f853659c700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 0x7f851806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85280090b0 tx=0x7f8528008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:03.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.119+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f85200538d0 con 0x7f85380c50d0 2023-08-27T11:23:03.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.372+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85381eda10 con 0x7f85380c50d0 2023-08-27T11:23:03.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.372+0000 7f852effd700 1 -- 172.21.15.43:0/685495940 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8520056ef0 con 0x7f85380c50d0 2023-08-27T11:23:03.374 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-27T11:23:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 msgr2=0x7f851806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 0x7f851806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85280090b0 tx=0x7f8528008030 comp rx=0 tx=0).stop 2023-08-27T11:23:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 msgr2=0x7f853806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f852000c750 tx=0x7f852000ca60 comp rx=0 tx=0).stop 2023-08-27T11:23:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 shutdown_connections 2023-08-27T11:23:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f851806a0e0 0x7f851806c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f853814e960 0x7f8538071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85380a79c0 0x7f85381513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 --2- 172.21.15.43:0/685495940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85380c50d0 0x7f853806fd00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 >> 172.21.15.43:0/685495940 conn(0x7f853806aa50 msgr2=0x7f85380c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 shutdown_connections 2023-08-27T11:23:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:03.374+0000 7f853c9ff700 1 -- 172.21.15.43:0/685495940 wait complete. 2023-08-27T11:23:03.394 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-27T11:23:03.394 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-27T11:23:03.394 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi043.front.sepia.ceph.com 2023-08-27T11:23:03.394 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-27T11:23:03.395 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-27T11:23:03.395 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-27T11:23:03.395 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-27T11:23:03.395 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-27T11:23:03.396 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-27T11:23:03.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:03.396 DEBUG:teuthology.orchestra.run.smithi043:> ip addr 2023-08-27T11:23:03.443 INFO:teuthology.orchestra.run.smithi043.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-27T11:23:03.443 INFO:teuthology.orchestra.run.smithi043.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: inet 127.0.0.1/8 scope host lo 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 ::1/128 scope host 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:03.444 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9c brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f0 2023-08-27T11:23:03.445 INFO:teuthology.orchestra.run.smithi043.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:6b:fd:9d brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:03.445 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp7s0f1 2023-08-27T11:23:03.445 INFO:teuthology.orchestra.run.smithi043.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-27T11:23:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:58 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f0 2023-08-27T11:23:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: inet 172.21.15.43/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-27T11:23:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft 42093sec preferred_lft 42093sec 2023-08-27T11:23:03.446 INFO:teuthology.orchestra.run.smithi043.stdout: inet6 fe80::ec4:7aff:febd:1358/64 scope link 2023-08-27T11:23:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:03.447 INFO:teuthology.orchestra.run.smithi043.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: link/ether 0c:c4:7a:bd:13:59 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:03.447 INFO:teuthology.orchestra.run.smithi043.stdout: altname enp1s0f1 2023-08-27T11:23:03.448 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-27T11:23:03.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:03.448 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-08-27T11:23:03.449 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-08-27T11:23:03.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add name ceph-brx type bridge 2023-08-27T11:23:03.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr flush dev ceph-brx 2023-08-27T11:23:03.449 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set ceph-brx up 2023-08-27T11:23:03.450 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-27T11:23:03.450 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-08-27T11:23:03.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:03.904 DEBUG:teuthology.orchestra.run.smithi043:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-27T11:23:03.976 INFO:teuthology.orchestra.run.smithi043.stdout:1 2023-08-27T11:23:03.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:03.980 DEBUG:teuthology.orchestra.run.smithi043:> route 2023-08-27T11:23:04.032 INFO:teuthology.orchestra.run.smithi043.stdout:Kernel IP routing table 2023-08-27T11:23:04.033 INFO:teuthology.orchestra.run.smithi043.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-27T11:23:04.033 INFO:teuthology.orchestra.run.smithi043.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-27T11:23:04.033 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-27T11:23:04.033 INFO:teuthology.orchestra.run.smithi043.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-27T11:23:04.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:04.035 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-08-27T11:23:04.036 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-08-27T11:23:04.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-27T11:23:04.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-27T11:23:04.036 DEBUG:teuthology.orchestra.run.smithi043:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-27T11:23:04.037 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-08-27T11:23:04.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:04.754 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list 2023-08-27T11:23:04.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:04.800 DEBUG:teuthology.orchestra.run.smithi043:> ip netns list-id 2023-08-27T11:23:04.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:04.884 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-08-27T11:23:04.884 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-08-27T11:23:04.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-27T11:23:04.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-27T11:23:04.885 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-08-27T11:23:05.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-27T11:23:05.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:05.068 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-08-27T11:23:05.068 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-08-27T11:23:05.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-27T11:23:05.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-27T11:23:05.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-27T11:23:05.069 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-27T11:23:05.070 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-27T11:23:05.070 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-08-27T11:23:05.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:05.343 DEBUG:teuthology.orchestra.run.smithi043:> (cd / && exec bash -c ' 2023-08-27T11:23:05.343 DEBUG:teuthology.orchestra.run.smithi043:> set -e 2023-08-27T11:23:05.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set brx.0 up 2023-08-27T11:23:05.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo ip link set dev brx.0 master ceph-brx 2023-08-27T11:23:05.344 DEBUG:teuthology.orchestra.run.smithi043:> ') 2023-08-27T11:23:05.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-27T11:23:05.520 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-27T11:23:05.564 INFO:teuthology.orchestra.run.smithi043.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-27T11:23:05.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-27T11:23:05.565 DEBUG:teuthology.orchestra.run.smithi043:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-27T11:23:05.646 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-27T11:23:05.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:05.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-27T11:23:05.807 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-27T11:23:05.808 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-27T11:23:05.808 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-08-27T11:23:06.254 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-27T11:23:06.254 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-27T11:23:06.254 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-08-27T11:23:06.254 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.57:3300,172.21.15.57:3301" 2023-08-27T11:23:06.255 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-27T11:23:06.285 INFO:teuthology.orchestra.run.smithi043.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-08-27T11:23:06.285 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-08-27T11:23:06.285 INFO:teuthology.orchestra.run.smithi043.stdout:invalid new device string format 2023-08-27T11:23:06.285 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.57:3300,172.21.15.57:3301" 2023-08-27T11:23:06.286 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-27T11:23:06.286 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.57:6789,172.21.15.57:6790" 2023-08-27T11:23:06.286 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.57:6789,172.21.15.57:6790:/ 2023-08-27T11:23:06.286 INFO:teuthology.orchestra.run.smithi043.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=c8d00e24-104f-4e9c-b4f0-07b3a6bec064" will pass to kernel 2023-08-27T11:23:06.290 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-27T11:23:06.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:06.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-27T11:23:06.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:06.363 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:06.492 INFO:teuthology.orchestra.run.smithi043.stdout:client4689 2023-08-27T11:23:06.492 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:23:06.493 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:06.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:06.536 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:06.683 INFO:teuthology.orchestra.run.smithi043.stdout:client4689 2023-08-27T11:23:06.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:06.684 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:06.788 INFO:teuthology.orchestra.run.smithi043.stdout:client4689 2023-08-27T11:23:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:06.789 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c8d00e24-104f-4e9c-b4f0-07b3a6bec064.client4689/status') 2023-08-27T11:23:06.915 INFO:teuthology.orchestra.run.smithi043.stdout:instance: client.4689 (3)192.168.0.1:0/241396860 2023-08-27T11:23:06.915 INFO:teuthology.orchestra.run.smithi043.stdout:blocklisted: false 2023-08-27T11:23:06.916 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records in 2023-08-27T11:23:06.916 INFO:teuthology.orchestra.run.smithi043.stderr:0+1 records out 2023-08-27T11:23:06.916 INFO:teuthology.orchestra.run.smithi043.stderr:68 bytes copied, 6.3476e-05 s, 1.1 MB/s 2023-08-27T11:23:06.918 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-08-27T11:23:06.918 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-27T11:23:06.919 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-27T11:23:06.919 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-27T11:23:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.121+0000 7fc8137ff700 1 Processor -- start 2023-08-27T11:23:07.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.122+0000 7fc8137ff700 1 -- start start 2023-08-27T11:23:07.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc8137ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 0x7fc80c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc8137ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c06c4e0 con 0x7fc80c0c4630 2023-08-27T11:23:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc8137ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c155370 con 0x7fc80c0c4a90 2023-08-27T11:23:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc8137ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c151e70 con 0x7fc80c151a90 2023-08-27T11:23:07.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc810d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc80c0c4630 0x7fc80c06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33078/0 (socket says 172.21.15.43:33078) 2023-08-27T11:23:07.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc810d9a700 1 -- 172.21.15.43:0/2869357382 learned_addr learned my addr 172.21.15.43:0/2869357382 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:07.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.123+0000 7fc81159b700 1 --2- 172.21.15.43:0/2869357382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 0x7fc80c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557961206 0 0) 0x7fc80c06c4e0 con 0x7fc80c0c4630 2023-08-27T11:23:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f80035b0 con 0x7fc80c0c4630 2023-08-27T11:23:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204886634 0 0) 0x7fc80c155370 con 0x7fc80c0c4a90 2023-08-27T11:23:07.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc80c06c4e0 con 0x7fc80c0c4a90 2023-08-27T11:23:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc81159b700 1 -- 172.21.15.43:0/2869357382 >> v1:172.21.15.57:6789/0 conn(0x7fc80c0c4a90 legacy=0x7fc80c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc81159b700 1 -- 172.21.15.43:0/2869357382 >> v1:172.21.15.43:6789/0 conn(0x7fc80c0c4630 legacy=0x7fc80c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc81159b700 1 -- 172.21.15.43:0/2869357382 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c154480 con 0x7fc80c151a90 2023-08-27T11:23:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc81159b700 1 --2- 172.21.15.43:0/2869357382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 0x7fc80c0c7bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc808009870 tx=0x7fc808009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f664d9f8d77de1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:07.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.124+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011830 con 0x7fc80c151a90 2023-08-27T11:23:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808011990 con 0x7fc80c151a90 2023-08-27T11:23:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc803fff700 1 -- 172.21.15.43:0/2869357382 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011d20 con 0x7fc80c151a90 2023-08-27T11:23:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 -- 172.21.15.43:0/2869357382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 msgr2=0x7fc80c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 --2- 172.21.15.43:0/2869357382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 0x7fc80c0c7bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc808009870 tx=0x7fc808009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 -- 172.21.15.43:0/2869357382 shutdown_connections 2023-08-27T11:23:07.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 --2- 172.21.15.43:0/2869357382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c151a90 0x7fc80c0c7bb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 -- 172.21.15.43:0/2869357382 >> 172.21.15.43:0/2869357382 conn(0x7fc80c0ab820 msgr2=0x7fc80c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 -- 172.21.15.43:0/2869357382 shutdown_connections 2023-08-27T11:23:07.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.125+0000 7fc8137ff700 1 -- 172.21.15.43:0/2869357382 wait complete. 2023-08-27T11:23:07.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.128+0000 7fc8137ff700 1 Processor -- start 2023-08-27T11:23:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.128+0000 7fc8137ff700 1 -- start start 2023-08-27T11:23:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 0x7fc80c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 0x7fc80c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:07.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1588c0 con 0x7fc80c0c4630 2023-08-27T11:23:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1533a0 con 0x7fc80c151a90 2023-08-27T11:23:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc8137ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c153640 con 0x7fc80c0c4a90 2023-08-27T11:23:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc81159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc81159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:52062/0 (socket says 172.21.15.43:52062) 2023-08-27T11:23:07.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc81159b700 1 -- 172.21.15.43:0/3977120547 learned_addr learned my addr 172.21.15.43:0/3977120547 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc810d9a700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 0x7fc80c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.129+0000 7fc811d9c700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 0x7fc80c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 -- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 msgr2=0x7fc80c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 0x7fc80c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 -- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 msgr2=0x7fc80c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 0x7fc80c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 -- 172.21.15.43:0/3977120547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8080094a0 con 0x7fc80c0c4630 2023-08-27T11:23:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc811d9c700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 0x7fc80c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc810d9a700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 0x7fc80c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:07.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc81159b700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8080097c0 tx=0x7fc808004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80801b870 con 0x7fc80c0c4630 2023-08-27T11:23:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80801b9d0 con 0x7fc80c0c4630 2023-08-27T11:23:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c155c10 con 0x7fc80c0c4630 2023-08-27T11:23:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.130+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80801bd80 con 0x7fc80c0c4630 2023-08-27T11:23:07.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.131+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c1585e0 con 0x7fc80c0c4630 2023-08-27T11:23:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.131+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c153920 con 0x7fc80c0c4630 2023-08-27T11:23:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.133+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc808023070 con 0x7fc80c0c4630 2023-08-27T11:23:07.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.133+0000 7fc801ffb700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 0x7fc7f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:07.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.134+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8080893b0 con 0x7fc80c0c4630 2023-08-27T11:23:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.134+0000 7fc810d9a700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 0x7fc7f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.134+0000 7fc810d9a700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 0x7fc7f006c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc80c1561c0 tx=0x7fc7fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:07.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.138+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc808054bb0 con 0x7fc80c0c4630 2023-08-27T11:23:07.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.393+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc80c04ee70 con 0x7fc80c0c4630 2023-08-27T11:23:07.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.393+0000 7fc801ffb700 1 -- 172.21.15.43:0/3977120547 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc8080581d0 con 0x7fc80c0c4630 2023-08-27T11:23:07.395 INFO:teuthology.orchestra.run.smithi043.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-27T11:23:07.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.395+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 msgr2=0x7fc7f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.395+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 0x7fc7f006c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc80c1561c0 tx=0x7fc7fc009040 comp rx=0 tx=0).stop 2023-08-27T11:23:07.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.395+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 msgr2=0x7fc80c0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:07.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.395+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8080097c0 tx=0x7fc808004750 comp rx=0 tx=0).stop 2023-08-27T11:23:07.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 shutdown_connections 2023-08-27T11:23:07.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7f006a0e0 0x7fc7f006c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc80c151a90 0x7fc80c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc80c0c4630 0x7fc80c0a9610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 --2- 172.21.15.43:0/3977120547 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0c4a90 0x7fc80c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:07.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 >> 172.21.15.43:0/3977120547 conn(0x7fc80c0ab820 msgr2=0x7fc80c06ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:07.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 shutdown_connections 2023-08-27T11:23:07.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:07.396+0000 7fc8137ff700 1 -- 172.21.15.43:0/3977120547 wait complete. 2023-08-27T11:23:07.415 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-27T11:23:07.415 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-27T11:23:07.415 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2023-08-27T11:23:07.416 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-27T11:23:07.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-27T11:23:07.416 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-27T11:23:07.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-27T11:23:07.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-27T11:23:07.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-27T11:23:07.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:07.418 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2023-08-27T11:23:07.466 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-27T11:23:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-27T11:23:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2023-08-27T11:23:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2023-08-27T11:23:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:07.468 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2023-08-27T11:23:07.469 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2023-08-27T11:23:07.469 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-27T11:23:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2023-08-27T11:23:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-08-27T11:23:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42141sec preferred_lft 42141sec 2023-08-27T11:23:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link 2023-08-27T11:23:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2023-08-27T11:23:07.471 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-27T11:23:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2023-08-27T11:23:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2023-08-27T11:23:07.473 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-27T11:23:07.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:07.473 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-08-27T11:23:07.474 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-08-27T11:23:07.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2023-08-27T11:23:07.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2023-08-27T11:23:07.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2023-08-27T11:23:07.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-27T11:23:07.475 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-08-27T11:23:07.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:07.919 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-27T11:23:07.996 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-08-27T11:23:08.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:08.000 DEBUG:teuthology.orchestra.run.smithi057:> route 2023-08-27T11:23:08.061 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2023-08-27T11:23:08.062 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-27T11:23:08.062 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-08-27T11:23:08.062 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-08-27T11:23:08.062 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-27T11:23:08.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:08.064 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-08-27T11:23:08.064 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-08-27T11:23:08.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-27T11:23:08.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-27T11:23:08.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-27T11:23:08.065 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-08-27T11:23:08.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:08.801 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2023-08-27T11:23:08.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:08.846 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2023-08-27T11:23:08.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:08.929 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-08-27T11:23:08.929 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-08-27T11:23:08.930 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-27T11:23:08.930 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-27T11:23:08.930 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-08-27T11:23:09.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-27T11:23:09.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:09.113 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-08-27T11:23:09.113 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-08-27T11:23:09.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-27T11:23:09.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-27T11:23:09.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-27T11:23:09.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-27T11:23:09.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-27T11:23:09.115 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-08-27T11:23:09.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:09.392 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec bash -c ' 2023-08-27T11:23:09.393 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2023-08-27T11:23:09.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2023-08-27T11:23:09.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2023-08-27T11:23:09.394 DEBUG:teuthology.orchestra.run.smithi057:> ') 2023-08-27T11:23:09.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-27T11:23:09.567 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-27T11:23:09.610 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-27T11:23:09.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-27T11:23:09.611 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-27T11:23:09.694 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-08-27T11:23:09.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:09.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-27T11:23:09.848 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-27T11:23:09.848 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-27T11:23:09.849 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-08-27T11:23:09.985 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:23:09.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:23:10.332 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-27T11:23:10.332 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-27T11:23:10.333 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-08-27T11:23:10.333 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.57:3300,172.21.15.57:3301" 2023-08-27T11:23:10.333 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-27T11:23:10.356 INFO:teuthology.orchestra.run.smithi057.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-08-27T11:23:10.356 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-08-27T11:23:10.357 INFO:teuthology.orchestra.run.smithi057.stdout:invalid new device string format 2023-08-27T11:23:10.357 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.43:3300,172.21.15.57:3300,172.21.15.57:3301" 2023-08-27T11:23:10.357 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: switching to using v1 address with old syntax 2023-08-27T11:23:10.357 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: resolved to: "172.21.15.43:6789,172.21.15.57:6789,172.21.15.57:6790" 2023-08-27T11:23:10.357 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.43:6789,172.21.15.57:6789,172.21.15.57:6790:/ 2023-08-27T11:23:10.358 INFO:teuthology.orchestra.run.smithi057.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=c8d00e24-104f-4e9c-b4f0-07b3a6bec064" will pass to kernel 2023-08-27T11:23:10.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-27T11:23:10.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:10.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-27T11:23:10.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:10.432 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:10.527 INFO:teuthology.orchestra.run.smithi057.stdout:client4556 2023-08-27T11:23:10.527 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:23:10.528 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:10.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:10.571 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:10.695 INFO:teuthology.orchestra.run.smithi057.stdout:client4556 2023-08-27T11:23:10.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:10.696 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-27T11:23:10.780 INFO:teuthology.orchestra.run.smithi057.stdout:client4556 2023-08-27T11:23:10.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:10.798 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c8d00e24-104f-4e9c-b4f0-07b3a6bec064.client4556/status') 2023-08-27T11:23:10.906 INFO:teuthology.orchestra.run.smithi057.stdout:instance: client.4556 (3)192.168.0.1:0/1076803051 2023-08-27T11:23:10.906 INFO:teuthology.orchestra.run.smithi057.stdout:blocklisted: false 2023-08-27T11:23:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records in 2023-08-27T11:23:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:0+1 records out 2023-08-27T11:23:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:69 bytes copied, 5.176e-05 s, 1.3 MB/s 2023-08-27T11:23:10.910 INFO:teuthology.run_tasks:Running task exec... 2023-08-27T11:23:10.929 INFO:teuthology.task.exec:Executing custom commands... 2023-08-27T11:23:10.930 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:23:10.930 DEBUG:teuthology.orchestra.run.smithi043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-08-27T11:23:11.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.141+0000 7f8afa7ff700 1 Processor -- start 2023-08-27T11:23:11.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.141+0000 7f8afa7ff700 1 -- start start 2023-08-27T11:23:11.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40a4f60 0x7f8af414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8af406b570 0x7f8af414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8af40c3c70 0x7f8af40c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af406bec0 con 0x7f8af406b570 2023-08-27T11:23:11.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af4151280 con 0x7f8af40c3c70 2023-08-27T11:23:11.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8afa7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af406db00 con 0x7f8af40a4f60 2023-08-27T11:23:11.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8af37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8af406b570 0x7f8af414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8af37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8af406b570 0x7f8af414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49346/0 (socket says 172.21.15.43:49346) 2023-08-27T11:23:11.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.142+0000 7f8af37fe700 1 -- 172.21.15.43:0/729112466 learned_addr learned my addr 172.21.15.43:0/729112466 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:11.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af3fff700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40a4f60 0x7f8af414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af8d9c700 1 --2- 172.21.15.43:0/729112466 >> v2:172.21.15.57:3300/0 conn(0x7f8af40c3c70 0x7f8af40c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 -- 172.21.15.43:0/729112466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40a4f60 msgr2=0x7f8af414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:11.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40a4f60 0x7f8af414e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 -- 172.21.15.43:0/729112466 >> v2:172.21.15.57:3300/0 conn(0x7f8af40c3c70 msgr2=0x7f8af40c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:11.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 --2- 172.21.15.43:0/729112466 >> v2:172.21.15.57:3300/0 conn(0x7f8af40c3c70 0x7f8af40c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 -- 172.21.15.43:0/729112466 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4152250 con 0x7f8af406b570 2023-08-27T11:23:11.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af37fe700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af406b570 0x7f8af414eb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c3c00 tx=0x7f8ae8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34df794023a58608 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.143+0000 7f8af2ffd700 1 -- 172.21.15.43:0/729112466 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8011830 con 0x7f8af406b570 2023-08-27T11:23:11.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8af2ffd700 1 -- 172.21.15.43:0/729112466 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8011990 con 0x7f8af406b570 2023-08-27T11:23:11.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8af2ffd700 1 -- 172.21.15.43:0/729112466 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8011d20 con 0x7f8af406b570 2023-08-27T11:23:11.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 -- 172.21.15.43:0/729112466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af406b570 msgr2=0x7f8af414eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af406b570 0x7f8af414eb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8af40c3c00 tx=0x7f8ae8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 -- 172.21.15.43:0/729112466 shutdown_connections 2023-08-27T11:23:11.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/729112466 >> v2:172.21.15.57:3300/0 conn(0x7f8af40c3c70 0x7f8af40c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40a4f60 0x7f8af414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/729112466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af406b570 0x7f8af414eb10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 -- 172.21.15.43:0/729112466 >> 172.21.15.43:0/729112466 conn(0x7f8af40c5b50 msgr2=0x7f8af40c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:11.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 -- 172.21.15.43:0/729112466 shutdown_connections 2023-08-27T11:23:11.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.144+0000 7f8afa7ff700 1 -- 172.21.15.43:0/729112466 wait complete. 2023-08-27T11:23:11.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.146+0000 7f8afa7ff700 1 Processor -- start 2023-08-27T11:23:11.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.146+0000 7f8afa7ff700 1 -- start start 2023-08-27T11:23:11.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af406b570 0x7f8af4150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c3c70 0x7f8af413f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4071a20 con 0x7f8af40a4f60 2023-08-27T11:23:11.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4070b30 con 0x7f8af406b570 2023-08-27T11:23:11.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.147+0000 7f8afa7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4070e10 con 0x7f8af40c3c70 2023-08-27T11:23:11.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49354/0 (socket says 172.21.15.43:49354) 2023-08-27T11:23:11.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 -- 172.21.15.43:0/450693907 learned_addr learned my addr 172.21.15.43:0/450693907 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:11.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af3fff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af406b570 0x7f8af4150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af8d9c700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c3c70 0x7f8af413f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 -- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c3c70 msgr2=0x7f8af413f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c3c70 0x7f8af413f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 -- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af406b570 msgr2=0x7f8af4150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af406b570 0x7f8af4150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 -- 172.21.15.43:0/450693907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8009550 con 0x7f8af40a4f60 2023-08-27T11:23:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.148+0000 7f8af37fe700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009c10 tx=0x7f8ae8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.149+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8004450 con 0x7f8af40a4f60 2023-08-27T11:23:11.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.149+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae801e070 con 0x7f8af40a4f60 2023-08-27T11:23:11.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.149+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80038e0 con 0x7f8af40a4f60 2023-08-27T11:23:11.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.149+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40710f0 con 0x7f8af40a4f60 2023-08-27T11:23:11.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.149+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af40716b0 con 0x7f8af40a4f60 2023-08-27T11:23:11.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.150+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af404e620 con 0x7f8af40a4f60 2023-08-27T11:23:11.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.151+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ae8003a40 con 0x7f8af40a4f60 2023-08-27T11:23:11.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.152+0000 7f8af0ff9700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 0x7f8ae006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.152+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ae80892f0 con 0x7f8af40a4f60 2023-08-27T11:23:11.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.152+0000 7f8af3fff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 0x7f8ae006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.153+0000 7f8af3fff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 0x7f8ae006c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8af40708b0 tx=0x7f8ae4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.157+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8ae80549d0 con 0x7f8af40a4f60 2023-08-27T11:23:11.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.365+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f8af40baed0 con 0x7f8af40a4f60 2023-08-27T11:23:11.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.369+0000 7f8af0ff9700 1 -- 172.21.15.43:0/450693907 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f8ae8057ff0 con 0x7f8af40a4f60 2023-08-27T11:23:11.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 msgr2=0x7f8ae006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 0x7f8ae006c5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8af40708b0 tx=0x7f8ae4009210 comp rx=0 tx=0).stop 2023-08-27T11:23:11.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 msgr2=0x7f8af41448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009c10 tx=0x7f8ae8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:11.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 shutdown_connections 2023-08-27T11:23:11.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ae006a0e0 0x7f8ae006c5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c3c70 0x7f8af413f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af406b570 0x7f8af4150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 --2- 172.21.15.43:0/450693907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40a4f60 0x7f8af41448e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 >> 172.21.15.43:0/450693907 conn(0x7f8af40c5b50 msgr2=0x7f8af40bb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:11.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 shutdown_connections 2023-08-27T11:23:11.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.372+0000 7f8afa7ff700 1 -- 172.21.15.43:0/450693907 wait complete. 2023-08-27T11:23:11.392 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-27T11:23:11.434 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:11.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.638+0000 7f1b383ff700 1 Processor -- start 2023-08-27T11:23:11.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.638+0000 7f1b383ff700 1 -- start start 2023-08-27T11:23:11.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b383ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b300bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b383ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 0x7f1b300bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b383ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b300c17f0 con 0x7f1b3014e0d0 2023-08-27T11:23:11.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b383ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300c21a0 con 0x7f1b300c0390 2023-08-27T11:23:11.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b383ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300c0900 con 0x7f1b300c4c40 2023-08-27T11:23:11.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b3619b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1b3014e0d0 0x7f1b300c4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57304/0 (socket says 172.21.15.43:57304) 2023-08-27T11:23:11.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.639+0000 7f1b3619b700 1 -- 172.21.15.43:0/2397486956 learned_addr learned my addr 172.21.15.43:0/2397486956 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:11.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3699c700 1 --2- 172.21.15.43:0/2397486956 >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 0x7f1b300bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 --2- 172.21.15.43:0/2397486956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b300bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201372438 0 0) 0x7f1b300c17f0 con 0x7f1b3014e0d0 2023-08-27T11:23:11.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1c0057c0 con 0x7f1b3014e0d0 2023-08-27T11:23:11.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3277677871 0 0) 0x7f1b1c0057c0 con 0x7f1b3014e0d0 2023-08-27T11:23:11.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 -- 172.21.15.43:0/2397486956 >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 msgr2=0x7f1b300bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:11.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 --2- 172.21.15.43:0/2397486956 >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 0x7f1b300bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 -- 172.21.15.43:0/2397486956 >> v1:172.21.15.43:6789/0 conn(0x7f1b3014e0d0 legacy=0x7f1b300c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 -- 172.21.15.43:0/2397486956 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300c0be0 con 0x7f1b300c4c40 2023-08-27T11:23:11.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3699c700 1 --2- 172.21.15.43:0/2397486956 >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 0x7f1b300bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:11.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.640+0000 7f1b3599a700 1 --2- 172.21.15.43:0/2397486956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b300bb5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000a8e0 tx=0x7f1b2000abf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9daeb4ff7b217da4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c001670 con 0x7f1b300c4c40 2023-08-27T11:23:11.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20004030 con 0x7f1b300c4c40 2023-08-27T11:23:11.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b35199700 1 -- 172.21.15.43:0/2397486956 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200043c0 con 0x7f1b300c4c40 2023-08-27T11:23:11.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 -- 172.21.15.43:0/2397486956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 msgr2=0x7f1b300bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2397486956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b300bb5c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000a8e0 tx=0x7f1b2000abf0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 -- 172.21.15.43:0/2397486956 shutdown_connections 2023-08-27T11:23:11.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2397486956 >> v2:172.21.15.57:3300/0 conn(0x7f1b300c0390 0x7f1b300bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2397486956 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b300bb5c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 -- 172.21.15.43:0/2397486956 >> 172.21.15.43:0/2397486956 conn(0x7f1b3006aa50 msgr2=0x7f1b300c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:11.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.641+0000 7f1b383ff700 1 -- 172.21.15.43:0/2397486956 shutdown_connections 2023-08-27T11:23:11.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.642+0000 7f1b383ff700 1 -- 172.21.15.43:0/2397486956 wait complete. 2023-08-27T11:23:11.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.644+0000 7f1b383ff700 1 Processor -- start 2023-08-27T11:23:11.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.644+0000 7f1b383ff700 1 -- start start 2023-08-27T11:23:11.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b300c0390 0x7f1b30143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b30143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30149990 con 0x7f1b3014e0d0 2023-08-27T11:23:11.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30148d80 con 0x7f1b300c0390 2023-08-27T11:23:11.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.645+0000 7f1b383ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30149060 con 0x7f1b300c4c40 2023-08-27T11:23:11.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49364/0 (socket says 172.21.15.43:49364) 2023-08-27T11:23:11.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 -- 172.21.15.43:0/2187399666 learned_addr learned my addr 172.21.15.43:0/2187399666 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:11.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3599a700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b30143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3619b700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b300c0390 0x7f1b30143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 -- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 msgr2=0x7f1b30143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b30143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 -- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b300c0390 msgr2=0x7f1b30143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b300c0390 0x7f1b30143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 -- 172.21.15.43:0/2187399666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009a70 con 0x7f1b3014e0d0 2023-08-27T11:23:11.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.646+0000 7f1b3699c700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800efc0 tx=0x7f1b2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.647+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28009d70 con 0x7f1b3014e0d0 2023-08-27T11:23:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.647+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800f040 con 0x7f1b3014e0d0 2023-08-27T11:23:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.647+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2000a550 con 0x7f1b3014e0d0 2023-08-27T11:23:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.647+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800ce00 con 0x7f1b3014e0d0 2023-08-27T11:23:11.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.647+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b30149620 con 0x7f1b3014e0d0 2023-08-27T11:23:11.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.648+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30149b00 con 0x7f1b3014e0d0 2023-08-27T11:23:11.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.649+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1b28014480 con 0x7f1b3014e0d0 2023-08-27T11:23:11.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.650+0000 7f1b26ffd700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 0x7f1b1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:11.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.650+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b28088d00 con 0x7f1b3014e0d0 2023-08-27T11:23:11.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.650+0000 7f1b3619b700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 0x7f1b1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:11.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.651+0000 7f1b3619b700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 0x7f1b1406c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c001eb0 tx=0x7f1b2c001c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:11.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.654+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1b28057e90 con 0x7f1b3014e0d0 2023-08-27T11:23:11.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.867+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3004ee70 con 0x7f1b3014e0d0 2023-08-27T11:23:11.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.868+0000 7f1b26ffd700 1 -- 172.21.15.43:0/2187399666 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f1b28057a20 con 0x7f1b3014e0d0 2023-08-27T11:23:11.871 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:11.872 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:11.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 msgr2=0x7f1b1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 0x7f1b1406c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c001eb0 tx=0x7f1b2c001c40 comp rx=0 tx=0).stop 2023-08-27T11:23:11.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 msgr2=0x7f1b301eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:11.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800efc0 tx=0x7f1b2800c3a0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 shutdown_connections 2023-08-27T11:23:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b1406a0e0 0x7f1b1406c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b3014e0d0 0x7f1b301eccb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b300c0390 0x7f1b30143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 --2- 172.21.15.43:0/2187399666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b300c4c40 0x7f1b30143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:11.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 >> 172.21.15.43:0/2187399666 conn(0x7f1b3006aa50 msgr2=0x7f1b3014c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 shutdown_connections 2023-08-27T11:23:11.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:11.871+0000 7f1b383ff700 1 -- 172.21.15.43:0/2187399666 wait complete. 2023-08-27T11:23:11.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:11.892 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:12.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.097+0000 7f96f3dff700 1 Processor -- start 2023-08-27T11:23:12.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.097+0000 7f96f3dff700 1 -- start start 2023-08-27T11:23:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.098+0000 7f96f3dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96ec151d20 0x7f96ec0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.098+0000 7f96f3dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96ec06a8e0 0x7f96ec06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.098+0000 7f96f3dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec154660 con 0x7f96ec0c7c00 2023-08-27T11:23:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f3dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0c5750 con 0x7f96ec151d20 2023-08-27T11:23:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f3dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec154940 con 0x7f96ec06a8e0 2023-08-27T11:23:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96ec151d20 0x7f96ec0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96ec151d20 0x7f96ec0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49378/0 (socket says 172.21.15.43:49378) 2023-08-27T11:23:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 -- 172.21.15.43:0/1412585191 learned_addr learned my addr 172.21.15.43:0/1412585191 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f239c700 1 --2- 172.21.15.43:0/1412585191 >> v2:172.21.15.57:3300/0 conn(0x7f96ec06a8e0 0x7f96ec06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 -- 172.21.15.43:0/1412585191 >> v2:172.21.15.57:3300/0 conn(0x7f96ec06a8e0 msgr2=0x7f96ec06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 --2- 172.21.15.43:0/1412585191 >> v2:172.21.15.57:3300/0 conn(0x7f96ec06a8e0 0x7f96ec06acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 -- 172.21.15.43:0/1412585191 >> v1:172.21.15.57:6789/0 conn(0x7f96ec0c7c00 legacy=0x7f96ec0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.099+0000 7f96f1b9b700 1 -- 172.21.15.43:0/1412585191 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec154c20 con 0x7f96ec151d20 2023-08-27T11:23:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f1b9b700 1 --2- 172.21.15.43:0/1412585191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec151d20 0x7f96ec0c8110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0c4250 tx=0x7f96e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac1e04431cfa777 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f0b99700 1 -- 172.21.15.43:0/1412585191 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800b870 con 0x7f96ec151d20 2023-08-27T11:23:12.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f0b99700 1 -- 172.21.15.43:0/1412585191 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800b9d0 con 0x7f96ec151d20 2023-08-27T11:23:12.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f0b99700 1 -- 172.21.15.43:0/1412585191 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800bd60 con 0x7f96ec151d20 2023-08-27T11:23:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f3dff700 1 -- 172.21.15.43:0/1412585191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec151d20 msgr2=0x7f96ec0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.100+0000 7f96f3dff700 1 --2- 172.21.15.43:0/1412585191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec151d20 0x7f96ec0c8110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0c4250 tx=0x7f96e8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 -- 172.21.15.43:0/1412585191 shutdown_connections 2023-08-27T11:23:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 --2- 172.21.15.43:0/1412585191 >> v2:172.21.15.57:3300/0 conn(0x7f96ec06a8e0 0x7f96ec06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 --2- 172.21.15.43:0/1412585191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec151d20 0x7f96ec0c8110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 -- 172.21.15.43:0/1412585191 >> 172.21.15.43:0/1412585191 conn(0x7f96ec0c9d00 msgr2=0x7f96ec0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 -- 172.21.15.43:0/1412585191 shutdown_connections 2023-08-27T11:23:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.101+0000 7f96f3dff700 1 -- 172.21.15.43:0/1412585191 wait complete. 2023-08-27T11:23:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.102+0000 7f96f3dff700 1 Processor -- start 2023-08-27T11:23:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.102+0000 7f96f3dff700 1 -- start start 2023-08-27T11:23:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 0x7f96ec0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96ec151d20 0x7f96ec1ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec151320 con 0x7f96ec06a8e0 2023-08-27T11:23:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec153f80 con 0x7f96ec151d20 2023-08-27T11:23:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.103+0000 7f96f3dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec154260 con 0x7f96ec0c7c00 2023-08-27T11:23:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49388/0 (socket says 172.21.15.43:49388) 2023-08-27T11:23:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 -- 172.21.15.43:0/2333825850 learned_addr learned my addr 172.21.15.43:0/2333825850 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f139a700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 0x7f96ec0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f239c700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96ec151d20 0x7f96ec1ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 -- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 msgr2=0x7f96ec0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 0x7f96ec0c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 -- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96ec151d20 msgr2=0x7f96ec1ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96ec151d20 0x7f96ec1ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 -- 172.21.15.43:0/2333825850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009550 con 0x7f96ec06a8e0 2023-08-27T11:23:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f139a700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 0x7f96ec0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:12.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96f1b9b700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8004520 con 0x7f96ec06a8e0 2023-08-27T11:23:12.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.104+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e801e070 con 0x7f96ec06a8e0 2023-08-27T11:23:12.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.105+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec152db0 con 0x7f96ec06a8e0 2023-08-27T11:23:12.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.105+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80038a0 con 0x7f96ec06a8e0 2023-08-27T11:23:12.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.105+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec153370 con 0x7f96ec06a8e0 2023-08-27T11:23:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.106+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec04ee70 con 0x7f96ec06a8e0 2023-08-27T11:23:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.107+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96e8003a00 con 0x7f96ec06a8e0 2023-08-27T11:23:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.108+0000 7f96e27fc700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.108+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96e8020070 con 0x7f96ec06a8e0 2023-08-27T11:23:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.108+0000 7f96f139a700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.109+0000 7f96f139a700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 0x7f96d006c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96ec1edfd0 tx=0x7f96dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.113+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96e80551e0 con 0x7f96ec06a8e0 2023-08-27T11:23:12.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.323+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96ec158970 con 0x7f96ec06a8e0 2023-08-27T11:23:12.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.323+0000 7f96e27fc700 1 -- 172.21.15.43:0/2333825850 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96e80150a0 con 0x7f96ec06a8e0 2023-08-27T11:23:12.326 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:12.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 msgr2=0x7f96d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 0x7f96d006c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96ec1edfd0 tx=0x7f96dc009040 comp rx=0 tx=0).stop 2023-08-27T11:23:12.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 msgr2=0x7f96ec0c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:12.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 shutdown_connections 2023-08-27T11:23:12.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96ec151d20 0x7f96ec1ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96ec06a8e0 0x7f96ec0c3120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 --2- 172.21.15.43:0/2333825850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96ec0c7c00 0x7f96ec0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 >> 172.21.15.43:0/2333825850 conn(0x7f96ec0c9d00 msgr2=0x7f96ec06acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:12.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 shutdown_connections 2023-08-27T11:23:12.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.326+0000 7f96f3dff700 1 -- 172.21.15.43:0/2333825850 wait complete. 2023-08-27T11:23:12.345 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:12.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.549+0000 7efcc89ff700 1 Processor -- start 2023-08-27T11:23:12.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.549+0000 7efcc89ff700 1 -- start start 2023-08-27T11:23:12.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc89ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcc4151d20 0x7efcc40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc89ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 0x7efcc406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc89ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc4154660 con 0x7efcc40c7c00 2023-08-27T11:23:12.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc89ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc40c5750 con 0x7efcc4151d20 2023-08-27T11:23:12.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc89ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc4154940 con 0x7efcc406a8e0 2023-08-27T11:23:12.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcc4151d20 0x7efcc40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcc4151d20 0x7efcc40c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49402/0 (socket says 172.21.15.43:49402) 2023-08-27T11:23:12.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc259c700 1 -- 172.21.15.43:0/1105303356 learned_addr learned my addr 172.21.15.43:0/1105303356 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:12.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.550+0000 7efcc2d9d700 1 --2- 172.21.15.43:0/1105303356 >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 0x7efcc406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc259c700 1 -- 172.21.15.43:0/1105303356 >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 msgr2=0x7efcc406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc259c700 1 --2- 172.21.15.43:0/1105303356 >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 0x7efcc406acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc259c700 1 -- 172.21.15.43:0/1105303356 >> v1:172.21.15.57:6789/0 conn(0x7efcc40c7c00 legacy=0x7efcc40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc259c700 1 -- 172.21.15.43:0/1105303356 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4154c20 con 0x7efcc4151d20 2023-08-27T11:23:12.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc2d9d700 1 --2- 172.21.15.43:0/1105303356 >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 0x7efcc406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:12.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc259c700 1 --2- 172.21.15.43:0/1105303356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc4151d20 0x7efcc40c8110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efcc40c4250 tx=0x7efcb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261fe991d9bfa2f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc1d9b700 1 -- 172.21.15.43:0/1105303356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400b870 con 0x7efcc4151d20 2023-08-27T11:23:12.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc1d9b700 1 -- 172.21.15.43:0/1105303356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400b9d0 con 0x7efcc4151d20 2023-08-27T11:23:12.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.551+0000 7efcc1d9b700 1 -- 172.21.15.43:0/1105303356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400bd60 con 0x7efcc4151d20 2023-08-27T11:23:12.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 -- 172.21.15.43:0/1105303356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc4151d20 msgr2=0x7efcc40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1105303356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc4151d20 0x7efcc40c8110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efcc40c4250 tx=0x7efcb4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 -- 172.21.15.43:0/1105303356 shutdown_connections 2023-08-27T11:23:12.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1105303356 >> v2:172.21.15.57:3300/0 conn(0x7efcc406a8e0 0x7efcc406acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1105303356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc4151d20 0x7efcc40c8110 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 -- 172.21.15.43:0/1105303356 >> 172.21.15.43:0/1105303356 conn(0x7efcc40c9d00 msgr2=0x7efcc40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:12.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 -- 172.21.15.43:0/1105303356 shutdown_connections 2023-08-27T11:23:12.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.552+0000 7efcc89ff700 1 -- 172.21.15.43:0/1105303356 wait complete. 2023-08-27T11:23:12.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.554+0000 7efcc89ff700 1 Processor -- start 2023-08-27T11:23:12.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.554+0000 7efcc89ff700 1 -- start start 2023-08-27T11:23:12.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcc40c7c00 0x7efcc40c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 0x7efcc40c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40c0e70 con 0x7efcc406a8e0 2023-08-27T11:23:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc4153230 con 0x7efcc40c7c00 2023-08-27T11:23:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc41534f0 con 0x7efcc4151d20 2023-08-27T11:23:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49404/0 (socket says 172.21.15.43:49404) 2023-08-27T11:23:12.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 -- 172.21.15.43:0/1311602109 learned_addr learned my addr 172.21.15.43:0/1311602109 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcbbfff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcc40c7c00 0x7efcc40c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc2d9d700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 0x7efcc40c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 -- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 msgr2=0x7efcc40c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 0x7efcc40c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 -- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcc40c7c00 msgr2=0x7efcc40c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcc40c7c00 0x7efcc40c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc259c700 1 -- 172.21.15.43:0/1311602109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009550 con 0x7efcc406a8e0 2023-08-27T11:23:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.555+0000 7efcc2d9d700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 0x7efcc40c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcc259c700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000c00 tx=0x7efcb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4004520 con 0x7efcc406a8e0 2023-08-27T11:23:12.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb401e070 con 0x7efcc406a8e0 2023-08-27T11:23:12.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40038a0 con 0x7efcc406a8e0 2023-08-27T11:23:12.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc41537d0 con 0x7efcc406a8e0 2023-08-27T11:23:12.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.556+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc4152440 con 0x7efcc406a8e0 2023-08-27T11:23:12.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.557+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc40c1110 con 0x7efcc406a8e0 2023-08-27T11:23:12.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.558+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efcb4003a00 con 0x7efcc406a8e0 2023-08-27T11:23:12.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.559+0000 7efcbaffd700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 0x7efca406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:12.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.559+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcb4020070 con 0x7efcc406a8e0 2023-08-27T11:23:12.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.559+0000 7efcbbfff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 0x7efca406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:12.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.560+0000 7efcbbfff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 0x7efca406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcc414c070 tx=0x7efcac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:12.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.564+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efcb40551d0 con 0x7efcc406a8e0 2023-08-27T11:23:12.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.771+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc404ee70 con 0x7efcc406a8e0 2023-08-27T11:23:12.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.771+0000 7efcbaffd700 1 -- 172.21.15.43:0/1311602109 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7efcb402a020 con 0x7efcc406a8e0 2023-08-27T11:23:12.773 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:12.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 msgr2=0x7efca406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 0x7efca406c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcc414c070 tx=0x7efcac009040 comp rx=0 tx=0).stop 2023-08-27T11:23:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 msgr2=0x7efcc41ea360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000c00 tx=0x7efcb4004750 comp rx=0 tx=0).stop 2023-08-27T11:23:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 shutdown_connections 2023-08-27T11:23:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efca406a0e0 0x7efca406c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcc4151d20 0x7efcc40c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcc406a8e0 0x7efcc41ea360 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 --2- 172.21.15.43:0/1311602109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcc40c7c00 0x7efcc40c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:12.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 >> 172.21.15.43:0/1311602109 conn(0x7efcc40c9d00 msgr2=0x7efcc406acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:12.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 shutdown_connections 2023-08-27T11:23:12.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.774+0000 7efcc89ff700 1 -- 172.21.15.43:0/1311602109 wait complete. 2023-08-27T11:23:12.793 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:12.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.997+0000 7f8109dff700 1 Processor -- start 2023-08-27T11:23:12.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.998+0000 7f8109dff700 1 -- start start 2023-08-27T11:23:13.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8109dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8104151d20 0x7f81040c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8109dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8104154660 con 0x7f81040c7c00 2023-08-27T11:23:13.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8109dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8104154940 con 0x7f810406a8e0 2023-08-27T11:23:13.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8109dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81040c5750 con 0x7f8104151d20 2023-08-27T11:23:13.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8102ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f81040c7c00 0x7f81040ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57306/0 (socket says 172.21.15.43:57306) 2023-08-27T11:23:13.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f8102ffd700 1 -- 172.21.15.43:0/1737336794 learned_addr learned my addr 172.21.15.43:0/1737336794 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:13.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:12.999+0000 7f81037fe700 1 --2- 172.21.15.43:0/1737336794 >> v2:172.21.15.57:3300/0 conn(0x7f8104151d20 0x7f81040c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81027fc700 1 -- 172.21.15.43:0/1737336794 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245215834 0 0) 0x7f8104154660 con 0x7f81040c7c00 2023-08-27T11:23:13.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81027fc700 1 -- 172.21.15.43:0/1737336794 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ec0035b0 con 0x7f81040c7c00 2023-08-27T11:23:13.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81037fe700 1 -- 172.21.15.43:0/1737336794 >> v1:172.21.15.57:6789/0 conn(0x7f810406a8e0 legacy=0x7f810406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81037fe700 1 -- 172.21.15.43:0/1737336794 >> v1:172.21.15.43:6789/0 conn(0x7f81040c7c00 legacy=0x7f81040ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81037fe700 1 -- 172.21.15.43:0/1737336794 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8104154c20 con 0x7f8104151d20 2023-08-27T11:23:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81037fe700 1 --2- 172.21.15.43:0/1737336794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8104151d20 0x7f81040c8110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8104152140 tx=0x7f80f4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194b38d14dd1fca8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81027fc700 1 -- 172.21.15.43:0/1737336794 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004020 con 0x7f8104151d20 2023-08-27T11:23:13.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.000+0000 7f81027fc700 1 -- 172.21.15.43:0/1737336794 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4004180 con 0x7f8104151d20 2023-08-27T11:23:13.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f81027fc700 1 -- 172.21.15.43:0/1737336794 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004530 con 0x7f8104151d20 2023-08-27T11:23:13.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 -- 172.21.15.43:0/1737336794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8104151d20 msgr2=0x7f81040c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 --2- 172.21.15.43:0/1737336794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8104151d20 0x7f81040c8110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8104152140 tx=0x7f80f4009b20 comp rx=0 tx=0).stop 2023-08-27T11:23:13.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 -- 172.21.15.43:0/1737336794 shutdown_connections 2023-08-27T11:23:13.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 --2- 172.21.15.43:0/1737336794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8104151d20 0x7f81040c8110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 -- 172.21.15.43:0/1737336794 >> 172.21.15.43:0/1737336794 conn(0x7f81040c9d00 msgr2=0x7f81040ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:13.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 -- 172.21.15.43:0/1737336794 shutdown_connections 2023-08-27T11:23:13.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.001+0000 7f8109dff700 1 -- 172.21.15.43:0/1737336794 wait complete. 2023-08-27T11:23:13.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.003+0000 7f8109dff700 1 Processor -- start 2023-08-27T11:23:13.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.003+0000 7f8109dff700 1 -- start start 2023-08-27T11:23:13.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f810406a8e0 0x7f81040bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8104151d20 0x7f81041ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81040bf110 con 0x7f81040c7c00 2023-08-27T11:23:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81041ea320 con 0x7f810406a8e0 2023-08-27T11:23:13.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8109dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81040c05c0 con 0x7f8104151d20 2023-08-27T11:23:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8102ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8102ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49418/0 (socket says 172.21.15.43:49418) 2023-08-27T11:23:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8102ffd700 1 -- 172.21.15.43:0/1031748695 learned_addr learned my addr 172.21.15.43:0/1031748695 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f81037fe700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f810406a8e0 0x7f81040bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.004+0000 7f8103fff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8104151d20 0x7f81041ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 -- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8104151d20 msgr2=0x7f81041ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8104151d20 0x7f81041ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 -- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f810406a8e0 msgr2=0x7f81040bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f810406a8e0 0x7f81040bff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 -- 172.21.15.43:0/1031748695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40094a0 con 0x7f81040c7c00 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8102ffd700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c700 tx=0x7f80f800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8005d70 con 0x7f81040c7c00 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f80070d0 con 0x7f81040c7c00 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8007460 con 0x7f81040c7c00 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81041e9cd0 con 0x7f81040c7c00 2023-08-27T11:23:13.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.005+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81040aaf40 con 0x7f81040c7c00 2023-08-27T11:23:13.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.007+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810404ee70 con 0x7f81040c7c00 2023-08-27T11:23:13.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.008+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80f80075c0 con 0x7f81040c7c00 2023-08-27T11:23:13.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.008+0000 7f80ebfff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 0x7f80f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.009+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80f8087a00 con 0x7f81040c7c00 2023-08-27T11:23:13.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.009+0000 7f81037fe700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 0x7f80f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.009+0000 7f81037fe700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 0x7f80f006c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80f40090b0 tx=0x7f80f401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.013+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80f8053060 con 0x7f81040c7c00 2023-08-27T11:23:13.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.229+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81040c0ab0 con 0x7f81040c7c00 2023-08-27T11:23:13.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.229+0000 7f80ebfff700 1 -- 172.21.15.43:0/1031748695 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80f8017020 con 0x7f81040c7c00 2023-08-27T11:23:13.231 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.231+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 msgr2=0x7f80f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.231+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 0x7f80f006c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f80f40090b0 tx=0x7f80f401c040 comp rx=0 tx=0).stop 2023-08-27T11:23:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.231+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 msgr2=0x7f81040aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.231+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c700 tx=0x7f80f800ca10 comp rx=0 tx=0).stop 2023-08-27T11:23:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 shutdown_connections 2023-08-27T11:23:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80f006a0e0 0x7f80f006c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8104151d20 0x7f81041ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f810406a8e0 0x7f81040bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 --2- 172.21.15.43:0/1031748695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81040c7c00 0x7f81040aaa00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 >> 172.21.15.43:0/1031748695 conn(0x7f81040c9d00 msgr2=0x7f8104150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:13.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 shutdown_connections 2023-08-27T11:23:13.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.232+0000 7f8109dff700 1 -- 172.21.15.43:0/1031748695 wait complete. 2023-08-27T11:23:13.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.453+0000 7fe62ebff700 1 Processor -- start 2023-08-27T11:23:13.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.453+0000 7fe62ebff700 1 -- start start 2023-08-27T11:23:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280c7c00 0x7fe6280c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62ebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe62806a8e0 0x7fe62806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe628154660 con 0x7fe628151d20 2023-08-27T11:23:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62ebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280c5750 con 0x7fe62806a8e0 2023-08-27T11:23:13.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe628154940 con 0x7fe6280c7c00 2023-08-27T11:23:13.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62c99b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe628151d20 0x7fe6280ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57312/0 (socket says 172.21.15.43:57312) 2023-08-27T11:23:13.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62c99b700 1 -- 172.21.15.43:0/1586658926 learned_addr learned my addr 172.21.15.43:0/1586658926 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:13.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62d19c700 1 --2- 172.21.15.43:0/1586658926 >> v2:172.21.15.43:3300/0 conn(0x7fe62806a8e0 0x7fe62806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe627fff700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280c7c00 0x7fe6280c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe6277fe700 1 -- 172.21.15.43:0/1586658926 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107667813 0 0) 0x7fe628154660 con 0x7fe628151d20 2023-08-27T11:23:13.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe6277fe700 1 -- 172.21.15.43:0/1586658926 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6180035b0 con 0x7fe628151d20 2023-08-27T11:23:13.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62d19c700 1 -- 172.21.15.43:0/1586658926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280c7c00 msgr2=0x7fe6280c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62d19c700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280c7c00 0x7fe6280c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62d19c700 1 -- 172.21.15.43:0/1586658926 >> v1:172.21.15.43:6789/0 conn(0x7fe628151d20 legacy=0x7fe6280ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.455+0000 7fe62d19c700 1 -- 172.21.15.43:0/1586658926 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628154c20 con 0x7fe62806a8e0 2023-08-27T11:23:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62d19c700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe62806a8e0 0x7fe62806ad50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe620009d90 tx=0x7fe62000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f883edc258d112c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe6277fe700 1 -- 172.21.15.43:0/1586658926 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000e070 con 0x7fe62806a8e0 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe6277fe700 1 -- 172.21.15.43:0/1586658926 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000bb20 con 0x7fe62806a8e0 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe6277fe700 1 -- 172.21.15.43:0/1586658926 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620012430 con 0x7fe62806a8e0 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 -- 172.21.15.43:0/1586658926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe62806a8e0 msgr2=0x7fe62806ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe62806a8e0 0x7fe62806ad50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe620009d90 tx=0x7fe62000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 -- 172.21.15.43:0/1586658926 shutdown_connections 2023-08-27T11:23:13.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe62806a8e0 0x7fe62806ad50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 --2- 172.21.15.43:0/1586658926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6280c7c00 0x7fe6280c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.456+0000 7fe62ebff700 1 -- 172.21.15.43:0/1586658926 >> 172.21.15.43:0/1586658926 conn(0x7fe6280c9d00 msgr2=0x7fe6280ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.457+0000 7fe62ebff700 1 -- 172.21.15.43:0/1586658926 shutdown_connections 2023-08-27T11:23:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.457+0000 7fe62ebff700 1 -- 172.21.15.43:0/1586658926 wait complete. 2023-08-27T11:23:13.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.458+0000 7fe62ebff700 1 Processor -- start 2023-08-27T11:23:13.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.458+0000 7fe62ebff700 1 -- start start 2023-08-27T11:23:13.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe62806a8e0 0x7fe62814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe628151d20 0x7fe6281ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628158020 con 0x7fe6280c7c00 2023-08-27T11:23:13.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814eff0 con 0x7fe628151d20 2023-08-27T11:23:13.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.459+0000 7fe62ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62814ea30 con 0x7fe62806a8e0 2023-08-27T11:23:13.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49428/0 (socket says 172.21.15.43:49428) 2023-08-27T11:23:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 -- 172.21.15.43:0/3087656636 learned_addr learned my addr 172.21.15.43:0/3087656636 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe62c99b700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe62806a8e0 0x7fe62814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe62d19c700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe628151d20 0x7fe6281ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 -- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe62806a8e0 msgr2=0x7fe62814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe62806a8e0 0x7fe62814cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 -- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe628151d20 msgr2=0x7fe6281ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe628151d20 0x7fe6281ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 -- 172.21.15.43:0/3087656636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009a70 con 0x7fe6280c7c00 2023-08-27T11:23:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.460+0000 7fe627fff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e810 tx=0x7fe61400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.461+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400c070 con 0x7fe6280c7c00 2023-08-27T11:23:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.461+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614013610 con 0x7fe6280c7c00 2023-08-27T11:23:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.461+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62814ed10 con 0x7fe6280c7c00 2023-08-27T11:23:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.461+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6140139c0 con 0x7fe6280c7c00 2023-08-27T11:23:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.461+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe628154220 con 0x7fe6280c7c00 2023-08-27T11:23:13.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.462+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62804ee70 con 0x7fe6280c7c00 2023-08-27T11:23:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.463+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe614013b20 con 0x7fe6280c7c00 2023-08-27T11:23:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.464+0000 7fe6257fa700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 0x7fe60c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.464+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe614088300 con 0x7fe6280c7c00 2023-08-27T11:23:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.464+0000 7fe62c99b700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 0x7fe60c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.465+0000 7fe62c99b700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 0x7fe60c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe61c007fd0 tx=0x7fe61c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.467+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe614053960 con 0x7fe6280c7c00 2023-08-27T11:23:13.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.675+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6280ac650 con 0x7fe6280c7c00 2023-08-27T11:23:13.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.676+0000 7fe6257fa700 1 -- 172.21.15.43:0/3087656636 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe614056f80 con 0x7fe6280c7c00 2023-08-27T11:23:13.677 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 msgr2=0x7fe60c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 0x7fe60c06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe61c007fd0 tx=0x7fe61c007dc0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 msgr2=0x7fe62814d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe61400e810 tx=0x7fe61400eb20 comp rx=0 tx=0).stop 2023-08-27T11:23:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 shutdown_connections 2023-08-27T11:23:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe60c06a0e0 0x7fe60c06c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe628151d20 0x7fe6281ecc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe62806a8e0 0x7fe62814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 --2- 172.21.15.43:0/3087656636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6280c7c00 0x7fe62814d0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 >> 172.21.15.43:0/3087656636 conn(0x7fe6280c9d00 msgr2=0x7fe628150b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 shutdown_connections 2023-08-27T11:23:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.678+0000 7fe62ebff700 1 -- 172.21.15.43:0/3087656636 wait complete. 2023-08-27T11:23:13.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:13.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.898+0000 7f781b9ff700 1 Processor -- start 2023-08-27T11:23:13.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.898+0000 7f781b9ff700 1 -- start start 2023-08-27T11:23:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781b9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f78140c4630 0x7f78140c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781b9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f781406ad70 0x7f781406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781b9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781406c4e0 con 0x7f7814151a90 2023-08-27T11:23:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781b9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7814155370 con 0x7f781406ad70 2023-08-27T11:23:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781b9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78140c82c0 con 0x7f78140c4630 2023-08-27T11:23:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781979b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7814151a90 0x7f78140c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57322/0 (socket says 172.21.15.43:57322) 2023-08-27T11:23:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f781979b700 1 -- 172.21.15.43:0/2964407953 learned_addr learned my addr 172.21.15.43:0/2964407953 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f7819f9c700 1 --2- 172.21.15.43:0/2964407953 >> v2:172.21.15.43:3300/0 conn(0x7f781406ad70 0x7f781406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f7818f9a700 1 --2- 172.21.15.43:0/2964407953 >> v2:172.21.15.57:3300/0 conn(0x7f78140c4630 0x7f78140c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f780bfff700 1 -- 172.21.15.43:0/2964407953 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055177781 0 0) 0x7f781406c4e0 con 0x7f7814151a90 2023-08-27T11:23:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f780bfff700 1 -- 172.21.15.43:0/2964407953 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000035b0 con 0x7f7814151a90 2023-08-27T11:23:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f7819f9c700 1 -- 172.21.15.43:0/2964407953 >> v2:172.21.15.57:3300/0 conn(0x7f78140c4630 msgr2=0x7f78140c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f7819f9c700 1 --2- 172.21.15.43:0/2964407953 >> v2:172.21.15.57:3300/0 conn(0x7f78140c4630 0x7f78140c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.900+0000 7f7819f9c700 1 -- 172.21.15.43:0/2964407953 >> v1:172.21.15.43:6789/0 conn(0x7f7814151a90 legacy=0x7f78140c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.901+0000 7f7819f9c700 1 -- 172.21.15.43:0/2964407953 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814151e70 con 0x7f781406ad70 2023-08-27T11:23:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.901+0000 7f7819f9c700 1 --2- 172.21.15.43:0/2964407953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f781406ad70 0x7f781406b200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78140c7740 tx=0x7f780c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3eb1ea332a8000a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.901+0000 7f780bfff700 1 -- 172.21.15.43:0/2964407953 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00e070 con 0x7f781406ad70 2023-08-27T11:23:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.901+0000 7f780bfff700 1 -- 172.21.15.43:0/2964407953 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00bb20 con 0x7f781406ad70 2023-08-27T11:23:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.901+0000 7f780bfff700 1 -- 172.21.15.43:0/2964407953 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c012430 con 0x7f781406ad70 2023-08-27T11:23:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 -- 172.21.15.43:0/2964407953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f781406ad70 msgr2=0x7f781406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2964407953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f781406ad70 0x7f781406b200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f78140c7740 tx=0x7f780c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:13.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 -- 172.21.15.43:0/2964407953 shutdown_connections 2023-08-27T11:23:13.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2964407953 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f781406ad70 0x7f781406b200 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2964407953 >> v2:172.21.15.57:3300/0 conn(0x7f78140c4630 0x7f78140c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 -- 172.21.15.43:0/2964407953 >> 172.21.15.43:0/2964407953 conn(0x7f78140ab820 msgr2=0x7f78140abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:13.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 -- 172.21.15.43:0/2964407953 shutdown_connections 2023-08-27T11:23:13.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.902+0000 7f781b9ff700 1 -- 172.21.15.43:0/2964407953 wait complete. 2023-08-27T11:23:13.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.903+0000 7f781b9ff700 1 Processor -- start 2023-08-27T11:23:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.904+0000 7f781b9ff700 1 -- start start 2023-08-27T11:23:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f781406ad70 0x7f78140c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7814151a90 0x7f7814150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141ede20 con 0x7f78140c4630 2023-08-27T11:23:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814156cc0 con 0x7f781406ad70 2023-08-27T11:23:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814156f60 con 0x7f7814151a90 2023-08-27T11:23:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49458/0 (socket says 172.21.15.43:49458) 2023-08-27T11:23:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 -- 172.21.15.43:0/2480014326 learned_addr learned my addr 172.21.15.43:0/2480014326 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7819f9c700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7814151a90 0x7f7814150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f781979b700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f781406ad70 0x7f78140c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 -- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7814151a90 msgr2=0x7f7814150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7814151a90 0x7f7814150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 -- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f781406ad70 msgr2=0x7f78140c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f781406ad70 0x7f78140c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.905+0000 7f7818f9a700 1 -- 172.21.15.43:0/2480014326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c009a70 con 0x7f78140c4630 2023-08-27T11:23:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f7818f9a700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f780400e9b0 tx=0x7f780400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804009710 con 0x7f78140c4630 2023-08-27T11:23:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400ee50 con 0x7f78140c4630 2023-08-27T11:23:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814157240 con 0x7f78140c4630 2023-08-27T11:23:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400ca50 con 0x7f78140c4630 2023-08-27T11:23:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.906+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78140c1440 con 0x7f78140c4630 2023-08-27T11:23:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.907+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814154a20 con 0x7f78140c4630 2023-08-27T11:23:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.908+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f780400cbb0 con 0x7f78140c4630 2023-08-27T11:23:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.909+0000 7f7809ffb700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 0x7f77f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.909+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7804088680 con 0x7f78140c4630 2023-08-27T11:23:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.909+0000 7f781979b700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 0x7f77f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.910+0000 7f781979b700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 0x7f77f806c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7810007fd0 tx=0x7f7810007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:13.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:13.914+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7814154a20 con 0x7f78140c4630 2023-08-27T11:23:14.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.128+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7814154a20 con 0x7f78140c4630 2023-08-27T11:23:14.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.129+0000 7f7809ffb700 1 -- 172.21.15.43:0/2480014326 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f7814154a20 con 0x7f78140c4630 2023-08-27T11:23:14.131 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:14.131 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:14.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 msgr2=0x7f77f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 0x7f77f806c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7810007fd0 tx=0x7f7810007dc0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 msgr2=0x7f78141ed8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f780400e9b0 tx=0x7f780400ecc0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 shutdown_connections 2023-08-27T11:23:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77f806a0e0 0x7f77f806c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7814151a90 0x7f7814150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f781406ad70 0x7f78140c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 --2- 172.21.15.43:0/2480014326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78140c4630 0x7f78141ed8e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 >> 172.21.15.43:0/2480014326 conn(0x7f78140ab820 msgr2=0x7f781414b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 shutdown_connections 2023-08-27T11:23:14.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.132+0000 7f781b9ff700 1 -- 172.21.15.43:0/2480014326 wait complete. 2023-08-27T11:23:14.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:14.153 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:14.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.356+0000 7f23a85ff700 1 Processor -- start 2023-08-27T11:23:14.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.356+0000 7f23a85ff700 1 -- start start 2023-08-27T11:23:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a85ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f23a014e780 0x7f23a01512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a85ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f23a00c5150 0x7f23a014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a85ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00c03e0 con 0x7f23a006a310 2023-08-27T11:23:14.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a85ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a0151900 con 0x7f23a00c5150 2023-08-27T11:23:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a85ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a0151be0 con 0x7f23a014e780 2023-08-27T11:23:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a5b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f23a00c5150 0x7f23a014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a6b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f23a006a310 0x7f23a00c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57324/0 (socket says 172.21.15.43:57324) 2023-08-27T11:23:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a6b9c700 1 -- 172.21.15.43:0/2126848461 learned_addr learned my addr 172.21.15.43:0/2126848461 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:14.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.357+0000 7f23a639b700 1 --2- 172.21.15.43:0/2126848461 >> v2:172.21.15.57:3300/0 conn(0x7f23a014e780 0x7f23a01512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5b9a700 1 -- 172.21.15.43:0/2126848461 >> v2:172.21.15.57:3300/0 conn(0x7f23a014e780 msgr2=0x7f23a01512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5b9a700 1 --2- 172.21.15.43:0/2126848461 >> v2:172.21.15.57:3300/0 conn(0x7f23a014e780 0x7f23a01512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5b9a700 1 -- 172.21.15.43:0/2126848461 >> v1:172.21.15.43:6789/0 conn(0x7f23a006a310 legacy=0x7f23a00c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5399700 1 -- 172.21.15.43:0/2126848461 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554045346 0 0) 0x7f23a00c03e0 con 0x7f23a006a310 2023-08-27T11:23:14.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5b9a700 1 -- 172.21.15.43:0/2126848461 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0151ec0 con 0x7f23a00c5150 2023-08-27T11:23:14.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5b9a700 1 --2- 172.21.15.43:0/2126848461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a014eb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2390009840 tx=0x7f2390009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959da994ed5ca915 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5399700 1 -- 172.21.15.43:0/2126848461 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011830 con 0x7f23a00c5150 2023-08-27T11:23:14.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5399700 1 -- 172.21.15.43:0/2126848461 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390011990 con 0x7f23a00c5150 2023-08-27T11:23:14.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.358+0000 7f23a5399700 1 -- 172.21.15.43:0/2126848461 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011d20 con 0x7f23a00c5150 2023-08-27T11:23:14.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 -- 172.21.15.43:0/2126848461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 msgr2=0x7f23a014eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 --2- 172.21.15.43:0/2126848461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a014eb60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2390009840 tx=0x7f2390009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:14.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 -- 172.21.15.43:0/2126848461 shutdown_connections 2023-08-27T11:23:14.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 --2- 172.21.15.43:0/2126848461 >> v2:172.21.15.57:3300/0 conn(0x7f23a014e780 0x7f23a01512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 --2- 172.21.15.43:0/2126848461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a014eb60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 -- 172.21.15.43:0/2126848461 >> 172.21.15.43:0/2126848461 conn(0x7f23a00c5b10 msgr2=0x7f23a00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:14.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 -- 172.21.15.43:0/2126848461 shutdown_connections 2023-08-27T11:23:14.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.359+0000 7f23a85ff700 1 -- 172.21.15.43:0/2126848461 wait complete. 2023-08-27T11:23:14.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.361+0000 7f23a85ff700 1 Processor -- start 2023-08-27T11:23:14.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.361+0000 7f23a85ff700 1 -- start start 2023-08-27T11:23:14.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a006a310 0x7f23a00bc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23a014e780 0x7f23a015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a015cb60 con 0x7f23a00c5150 2023-08-27T11:23:14.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a015ce00 con 0x7f23a006a310 2023-08-27T11:23:14.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a85ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0147940 con 0x7f23a014e780 2023-08-27T11:23:14.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49488/0 (socket says 172.21.15.43:49488) 2023-08-27T11:23:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 -- 172.21.15.43:0/972770619 learned_addr learned my addr 172.21.15.43:0/972770619 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a639b700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a006a310 0x7f23a00bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a6b9c700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23a014e780 0x7f23a015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 -- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23a014e780 msgr2=0x7f23a015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23a014e780 0x7f23a015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 -- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a006a310 msgr2=0x7f23a00bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a006a310 0x7f23a00bc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.362+0000 7f23a5b9a700 1 -- 172.21.15.43:0/972770619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900094a0 con 0x7f23a00c5150 2023-08-27T11:23:14.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f23a5b9a700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2390009f50 tx=0x7f2390004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900036a0 con 0x7f23a00c5150 2023-08-27T11:23:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239001f070 con 0x7f23a00c5150 2023-08-27T11:23:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390003a60 con 0x7f23a00c5150 2023-08-27T11:23:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a015d940 con 0x7f23a00c5150 2023-08-27T11:23:14.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.363+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00c4c10 con 0x7f23a00c5150 2023-08-27T11:23:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.364+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a015d7a0 con 0x7f23a00c5150 2023-08-27T11:23:14.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.365+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2390003bc0 con 0x7f23a00c5150 2023-08-27T11:23:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.366+0000 7f2396ffd700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 0x7f238406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.367+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2390021070 con 0x7f23a00c5150 2023-08-27T11:23:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.367+0000 7f23a639b700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 0x7f238406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.367+0000 7f23a639b700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 0x7f238406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f239c006b20 tx=0x7f239c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.371+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23a015d7a0 con 0x7f23a00c5150 2023-08-27T11:23:14.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.580+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23a015cfb0 con 0x7f23a00c5150 2023-08-27T11:23:14.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.581+0000 7f2396ffd700 1 -- 172.21.15.43:0/972770619 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23a015cfb0 con 0x7f23a00c5150 2023-08-27T11:23:14.583 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 msgr2=0x7f238406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 0x7f238406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f239c006b20 tx=0x7f239c008040 comp rx=0 tx=0).stop 2023-08-27T11:23:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 msgr2=0x7f23a006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2390009f50 tx=0x7f2390004750 comp rx=0 tx=0).stop 2023-08-27T11:23:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 shutdown_connections 2023-08-27T11:23:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f238406a0e0 0x7f238406c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f23a014e780 0x7f23a015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f23a006a310 0x7f23a00bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 --2- 172.21.15.43:0/972770619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f23a00c5150 0x7f23a006c540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 >> 172.21.15.43:0/972770619 conn(0x7f23a00c5b10 msgr2=0x7f23a00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:14.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 shutdown_connections 2023-08-27T11:23:14.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.583+0000 7f23a85ff700 1 -- 172.21.15.43:0/972770619 wait complete. 2023-08-27T11:23:14.603 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.806+0000 7f7cc07ff700 1 Processor -- start 2023-08-27T11:23:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.806+0000 7f7cc07ff700 1 -- start start 2023-08-27T11:23:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cc07ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cb80c5230 0x7f7cb806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cc07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 0x7f7cb8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cc07ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb81561f0 con 0x7f7cb806c5e0 2023-08-27T11:23:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cc07ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb8152290 con 0x7f7cb80c5230 2023-08-27T11:23:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cc07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806d7a0 con 0x7f7cb8155880 2023-08-27T11:23:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cbe59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cb80c5230 0x7f7cb806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cbe59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cb80c5230 0x7f7cb806d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49496/0 (socket says 172.21.15.43:49496) 2023-08-27T11:23:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.807+0000 7f7cbe59b700 1 -- 172.21.15.43:0/2210199236 learned_addr learned my addr 172.21.15.43:0/2210199236 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbed9c700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 0x7f7cb8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbe59b700 1 -- 172.21.15.43:0/2210199236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 msgr2=0x7f7cb8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 0x7f7cb8155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbe59b700 1 -- 172.21.15.43:0/2210199236 >> v1:172.21.15.57:6789/0 conn(0x7f7cb806c5e0 legacy=0x7f7cb80aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbe59b700 1 -- 172.21.15.43:0/2210199236 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8152550 con 0x7f7cb80c5230 2023-08-27T11:23:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbed9c700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 0x7f7cb8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb80c5230 0x7f7cb806d1c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40098f0 tx=0x7f7cb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab8df7793ce925b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbd599700 1 -- 172.21.15.43:0/2210199236 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400b8a0 con 0x7f7cb80c5230 2023-08-27T11:23:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbd599700 1 -- 172.21.15.43:0/2210199236 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400ba00 con 0x7f7cb80c5230 2023-08-27T11:23:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.808+0000 7f7cbd599700 1 -- 172.21.15.43:0/2210199236 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400bd90 con 0x7f7cb80c5230 2023-08-27T11:23:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 -- 172.21.15.43:0/2210199236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb80c5230 msgr2=0x7f7cb806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb80c5230 0x7f7cb806d1c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40098f0 tx=0x7f7cb4009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:14.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 -- 172.21.15.43:0/2210199236 shutdown_connections 2023-08-27T11:23:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb8155880 0x7f7cb8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/2210199236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb80c5230 0x7f7cb806d1c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 -- 172.21.15.43:0/2210199236 >> 172.21.15.43:0/2210199236 conn(0x7f7cb80c5b10 msgr2=0x7f7cb80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 -- 172.21.15.43:0/2210199236 shutdown_connections 2023-08-27T11:23:14.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.809+0000 7f7cc07ff700 1 -- 172.21.15.43:0/2210199236 wait complete. 2023-08-27T11:23:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.811+0000 7f7cc07ff700 1 Processor -- start 2023-08-27T11:23:14.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.811+0000 7f7cc07ff700 1 -- start start 2023-08-27T11:23:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 0x7f7cb8148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb80c5230 0x7f7cb8146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb814ed10 con 0x7f7cb8155880 2023-08-27T11:23:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8154d20 con 0x7f7cb80c5230 2023-08-27T11:23:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cc07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8153f60 con 0x7f7cb806c5e0 2023-08-27T11:23:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cbed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cbed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49506/0 (socket says 172.21.15.43:49506) 2023-08-27T11:23:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cbed9c700 1 -- 172.21.15.43:0/3315197274 learned_addr learned my addr 172.21.15.43:0/3315197274 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 0x7f7cb8148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.812+0000 7f7cbdd9a700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb80c5230 0x7f7cb8146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 -- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 msgr2=0x7f7cb8148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 0x7f7cb8148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 -- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb80c5230 msgr2=0x7f7cb8146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb80c5230 0x7f7cb8146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 -- 172.21.15.43:0/3315197274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009550 con 0x7f7cb8155880 2023-08-27T11:23:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 0x7f7cb8148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:14.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cbed9c700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007df0 tx=0x7f7cb000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000ddd0 con 0x7f7cb8155880 2023-08-27T11:23:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000f040 con 0x7f7cb8155880 2023-08-27T11:23:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0003c60 con 0x7f7cb8155880 2023-08-27T11:23:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8154970 con 0x7f7cb8155880 2023-08-27T11:23:14.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.813+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8155210 con 0x7f7cb8155880 2023-08-27T11:23:14.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.814+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb804ee70 con 0x7f7cb8155880 2023-08-27T11:23:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.815+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7cb0004030 con 0x7f7cb8155880 2023-08-27T11:23:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.816+0000 7f7caeffd700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 0x7f7c9c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.816+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cb0088510 con 0x7f7cb8155880 2023-08-27T11:23:14.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.816+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 0x7f7c9c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.817+0000 7f7cbe59b700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 0x7f7c9c06c570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009c40 tx=0x7f7cb4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:14.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:14.821+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7cb0053c20 con 0x7f7cb8155880 2023-08-27T11:23:15.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.032+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cb8154970 con 0x7f7cb8155880 2023-08-27T11:23:15.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.032+0000 7f7caeffd700 1 -- 172.21.15.43:0/3315197274 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cb8154970 con 0x7f7cb8155880 2023-08-27T11:23:15.034 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 msgr2=0x7f7c9c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 0x7f7c9c06c570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009c40 tx=0x7f7cb4008030 comp rx=0 tx=0).stop 2023-08-27T11:23:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 msgr2=0x7f7cb8146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0007df0 tx=0x7f7cb000d3b0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 shutdown_connections 2023-08-27T11:23:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c9c06a0b0 0x7f7c9c06c570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cb8155880 0x7f7cb8146c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cb806c5e0 0x7f7cb8148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 --2- 172.21.15.43:0/3315197274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cb80c5230 0x7f7cb8146700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 >> 172.21.15.43:0/3315197274 conn(0x7f7cb80c5b10 msgr2=0x7f7cb80aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 shutdown_connections 2023-08-27T11:23:15.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.035+0000 7f7cc07ff700 1 -- 172.21.15.43:0/3315197274 wait complete. 2023-08-27T11:23:15.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:15.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.259+0000 7fa17afff700 1 Processor -- start 2023-08-27T11:23:15.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.259+0000 7fa17afff700 1 -- start start 2023-08-27T11:23:15.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.260+0000 7fa17afff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1740c7c00 0x7fa1740c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.260+0000 7fa17afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa17406a8e0 0x7fa17406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.260+0000 7fa17afff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa174154660 con 0x7fa174151d20 2023-08-27T11:23:15.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.260+0000 7fa17afff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1740c5750 con 0x7fa1740c7c00 2023-08-27T11:23:15.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.260+0000 7fa17afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa174154940 con 0x7fa17406a8e0 2023-08-27T11:23:15.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1740c7c00 0x7fa1740c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1740c7c00 0x7fa1740c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49522/0 (socket says 172.21.15.43:49522) 2023-08-27T11:23:15.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 -- 172.21.15.43:0/346831433 learned_addr learned my addr 172.21.15.43:0/346831433 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:15.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa17959c700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa17406a8e0 0x7fa17406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 -- 172.21.15.43:0/346831433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa17406a8e0 msgr2=0x7fa17406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:15.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa17406a8e0 0x7fa17406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 -- 172.21.15.43:0/346831433 >> v1:172.21.15.43:6789/0 conn(0x7fa174151d20 legacy=0x7fa1740ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa173fff700 1 -- 172.21.15.43:0/346831433 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174154c20 con 0x7fa1740c7c00 2023-08-27T11:23:15.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.261+0000 7fa1737fe700 1 -- 172.21.15.43:0/346831433 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495864674 0 0) 0x7fa174154660 con 0x7fa174151d20 2023-08-27T11:23:15.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa173fff700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1740c7c00 0x7fa1740c8110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1600098f0 tx=0x7fa160009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27aaadd24e4960b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa1737fe700 1 -- 172.21.15.43:0/346831433 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000b8a0 con 0x7fa1740c7c00 2023-08-27T11:23:15.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa1737fe700 1 -- 172.21.15.43:0/346831433 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000ba00 con 0x7fa1740c7c00 2023-08-27T11:23:15.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa1737fe700 1 -- 172.21.15.43:0/346831433 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000bd90 con 0x7fa1740c7c00 2023-08-27T11:23:15.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 -- 172.21.15.43:0/346831433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1740c7c00 msgr2=0x7fa1740c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1740c7c00 0x7fa1740c8110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1600098f0 tx=0x7fa160009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:15.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 -- 172.21.15.43:0/346831433 shutdown_connections 2023-08-27T11:23:15.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa17406a8e0 0x7fa17406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 --2- 172.21.15.43:0/346831433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1740c7c00 0x7fa1740c8110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.262+0000 7fa17afff700 1 -- 172.21.15.43:0/346831433 >> 172.21.15.43:0/346831433 conn(0x7fa1740c9d00 msgr2=0x7fa1740ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:15.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.263+0000 7fa17afff700 1 -- 172.21.15.43:0/346831433 shutdown_connections 2023-08-27T11:23:15.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.263+0000 7fa17afff700 1 -- 172.21.15.43:0/346831433 wait complete. 2023-08-27T11:23:15.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.264+0000 7fa17afff700 1 Processor -- start 2023-08-27T11:23:15.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.264+0000 7fa17afff700 1 -- start start 2023-08-27T11:23:15.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 0x7fa1740c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1740c7c00 0x7fa1741584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740c0480 con 0x7fa174151d20 2023-08-27T11:23:15.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740bfe70 con 0x7fa17406a8e0 2023-08-27T11:23:15.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa174158a00 con 0x7fa1740c7c00 2023-08-27T11:23:15.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49528/0 (socket says 172.21.15.43:49528) 2023-08-27T11:23:15.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.265+0000 7fa17959c700 1 -- 172.21.15.43:0/361033747 learned_addr learned my addr 172.21.15.43:0/361033747 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:15.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa173fff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1740c7c00 0x7fa1741584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa178d9b700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 0x7fa1740c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 -- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1740c7c00 msgr2=0x7fa1741584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1740c7c00 0x7fa1741584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 -- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 msgr2=0x7fa1740c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 0x7fa1740c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 -- 172.21.15.43:0/361033747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160009550 con 0x7fa174151d20 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa178d9b700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 0x7fa1740c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17959c700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007e40 tx=0x7fa16c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c00eea0 con 0x7fa174151d20 2023-08-27T11:23:15.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c014420 con 0x7fa174151d20 2023-08-27T11:23:15.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0147b0 con 0x7fa174151d20 2023-08-27T11:23:15.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.266+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1740c2940 con 0x7fa174151d20 2023-08-27T11:23:15.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.267+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740c0110 con 0x7fa174151d20 2023-08-27T11:23:15.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.268+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1741577d0 con 0x7fa174151d20 2023-08-27T11:23:15.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.268+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa16c014910 con 0x7fa174151d20 2023-08-27T11:23:15.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.270+0000 7fa1717fa700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.270+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa16c088d40 con 0x7fa174151d20 2023-08-27T11:23:15.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.270+0000 7fa178d9b700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.270+0000 7fa178d9b700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 0x7fa15806c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa168000f60 tx=0x7fa168009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.274+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa1741577d0 con 0x7fa174151d20 2023-08-27T11:23:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.481+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1741577d0 con 0x7fa174151d20 2023-08-27T11:23:15.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.481+0000 7fa1717fa700 1 -- 172.21.15.43:0/361033747 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1741577d0 con 0x7fa174151d20 2023-08-27T11:23:15.483 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:15.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 msgr2=0x7fa15806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 0x7fa15806c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa168000f60 tx=0x7fa168009040 comp rx=0 tx=0).stop 2023-08-27T11:23:15.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 msgr2=0x7fa174153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007e40 tx=0x7fa16c00e3c0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 shutdown_connections 2023-08-27T11:23:15.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa15806a0e0 0x7fa15806c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa174151d20 0x7fa174153d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa17406a8e0 0x7fa1740c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 --2- 172.21.15.43:0/361033747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1740c7c00 0x7fa1741584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 >> 172.21.15.43:0/361033747 conn(0x7fa1740c9d00 msgr2=0x7fa1740bcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:15.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 shutdown_connections 2023-08-27T11:23:15.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.484+0000 7fa17afff700 1 -- 172.21.15.43:0/361033747 wait complete. 2023-08-27T11:23:15.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:15.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.706+0000 7f10095ff700 1 Processor -- start 2023-08-27T11:23:15.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.706+0000 7f10095ff700 1 -- start start 2023-08-27T11:23:15.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10095ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10040c7c00 0x7f10040c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10095ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f100406a8e0 0x7f100406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10095ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1004154660 con 0x7f1004151d20 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10095ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10040c5750 con 0x7f100406a8e0 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10095ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1004154940 con 0x7f10040c7c00 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10037fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f100406a8e0 0x7f100406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f1002ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1004151d20 0x7f10040ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:33900/0 (socket says 172.21.15.43:33900) 2023-08-27T11:23:15.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f1002ffd700 1 -- 172.21.15.43:0/510607808 learned_addr learned my addr 172.21.15.43:0/510607808 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:15.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f0ffbfff700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10040c7c00 0x7f10040c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10037fe700 1 -- 172.21.15.43:0/510607808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10040c7c00 msgr2=0x7f10040c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:15.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10037fe700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10040c7c00 0x7f10040c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10037fe700 1 -- 172.21.15.43:0/510607808 >> v1:172.21.15.57:6789/0 conn(0x7f1004151d20 legacy=0x7f10040ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10037fe700 1 -- 172.21.15.43:0/510607808 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1004154c20 con 0x7f100406a8e0 2023-08-27T11:23:15.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.708+0000 7f10027fc700 1 -- 172.21.15.43:0/510607808 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874321617 0 0) 0x7f1004154660 con 0x7f1004151d20 2023-08-27T11:23:15.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10037fe700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100406a8e0 0x7f100406ad50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009d90 tx=0x7f0ffc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f552ca9a47b4f87 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10027fc700 1 -- 172.21.15.43:0/510607808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e070 con 0x7f100406a8e0 2023-08-27T11:23:15.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10027fc700 1 -- 172.21.15.43:0/510607808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00bb20 con 0x7f100406a8e0 2023-08-27T11:23:15.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10027fc700 1 -- 172.21.15.43:0/510607808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc012430 con 0x7f100406a8e0 2023-08-27T11:23:15.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10095ff700 1 -- 172.21.15.43:0/510607808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100406a8e0 msgr2=0x7f100406ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.709+0000 7f10095ff700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100406a8e0 0x7f100406ad50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009d90 tx=0x7f0ffc00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:15.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 -- 172.21.15.43:0/510607808 shutdown_connections 2023-08-27T11:23:15.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f100406a8e0 0x7f100406ad50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 --2- 172.21.15.43:0/510607808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10040c7c00 0x7f10040c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 -- 172.21.15.43:0/510607808 >> 172.21.15.43:0/510607808 conn(0x7f10040c9d00 msgr2=0x7f10040ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:15.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 -- 172.21.15.43:0/510607808 shutdown_connections 2023-08-27T11:23:15.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.710+0000 7f10095ff700 1 -- 172.21.15.43:0/510607808 wait complete. 2023-08-27T11:23:15.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.711+0000 7f10095ff700 1 Processor -- start 2023-08-27T11:23:15.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.711+0000 7f10095ff700 1 -- start start 2023-08-27T11:23:15.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f100406a8e0 0x7f1004158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1004151d20 0x7f10040c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10041586b0 con 0x7f10040c7c00 2023-08-27T11:23:15.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040c0d40 con 0x7f1004151d20 2023-08-27T11:23:15.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.712+0000 7f10095ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1004158890 con 0x7f100406a8e0 2023-08-27T11:23:15.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49538/0 (socket says 172.21.15.43:49538) 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 -- 172.21.15.43:0/1124281454 learned_addr learned my addr 172.21.15.43:0/1124281454 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f1002ffd700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f100406a8e0 0x7f1004158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f10037fe700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1004151d20 0x7f10040c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 -- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f100406a8e0 msgr2=0x7f1004158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f100406a8e0 0x7f1004158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 -- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1004151d20 msgr2=0x7f10040c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1004151d20 0x7f10040c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 -- 172.21.15.43:0/1124281454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009a70 con 0x7f10040c7c00 2023-08-27T11:23:15.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.713+0000 7f0ffbfff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00e9e0 tx=0x7f0fec00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.714+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec009710 con 0x7f10040c7c00 2023-08-27T11:23:15.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.714+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00ee80 con 0x7f10040c7c00 2023-08-27T11:23:15.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.714+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00ca50 con 0x7f10040c7c00 2023-08-27T11:23:15.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.714+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040c0f90 con 0x7f10040c7c00 2023-08-27T11:23:15.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.714+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10040c1550 con 0x7f10040c7c00 2023-08-27T11:23:15.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.715+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10040c18c0 con 0x7f10040c7c00 2023-08-27T11:23:15.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.716+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0fec00cbb0 con 0x7f10040c7c00 2023-08-27T11:23:15.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.717+0000 7f0ffb7fe700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 0x7f0fe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:15.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.717+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fec088580 con 0x7f10040c7c00 2023-08-27T11:23:15.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.717+0000 7f1002ffd700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 0x7f0fe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:15.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.718+0000 7f1002ffd700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 0x7f0fe406c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4000f60 tx=0x7f0ff4007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:15.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.721+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0fec0576f0 con 0x7f10040c7c00 2023-08-27T11:23:15.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.929+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f100404ee70 con 0x7f10040c7c00 2023-08-27T11:23:15.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.930+0000 7f0ffb7fe700 1 -- 172.21.15.43:0/1124281454 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fec057280 con 0x7f10040c7c00 2023-08-27T11:23:15.932 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 msgr2=0x7f0fe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 0x7f0fe406c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4000f60 tx=0x7f0ff4007e70 comp rx=0 tx=0).stop 2023-08-27T11:23:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 msgr2=0x7f10041507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00e9e0 tx=0x7f0fec00ecf0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 shutdown_connections 2023-08-27T11:23:15.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0fe406a0e0 0x7f0fe406c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1004151d20 0x7f10040c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f100406a8e0 0x7f1004158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 --2- 172.21.15.43:0/1124281454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f10040c7c00 0x7f10041507c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:15.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 >> 172.21.15.43:0/1124281454 conn(0x7f10040c9d00 msgr2=0x7f100414e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:15.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 shutdown_connections 2023-08-27T11:23:15.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:15.932+0000 7f10095ff700 1 -- 172.21.15.43:0/1124281454 wait complete. 2023-08-27T11:23:15.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:16.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.157+0000 7f4570bff700 1 Processor -- start 2023-08-27T11:23:16.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.157+0000 7f4570bff700 1 -- start start 2023-08-27T11:23:16.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.158+0000 7f4570bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f456c151a90 0x7f456c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4570bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f456c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4570bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c06c4e0 con 0x7f456c0c4630 2023-08-27T11:23:16.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4570bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c155370 con 0x7f456c151a90 2023-08-27T11:23:16.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4570bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c151e70 con 0x7f456c0c4a90 2023-08-27T11:23:16.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4563fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f456c0c4630 0x7f456c06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57340/0 (socket says 172.21.15.43:57340) 2023-08-27T11:23:16.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4563fff700 1 -- 172.21.15.43:0/760120790 learned_addr learned my addr 172.21.15.43:0/760120790 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:16.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f456a59c700 1 --2- 172.21.15.43:0/760120790 >> v2:172.21.15.57:3300/0 conn(0x7f456c151a90 0x7f456c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f456ad9d700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f456c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258670515 0 0) 0x7f456c06c4e0 con 0x7f456c0c4630 2023-08-27T11:23:16.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.159+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45580035b0 con 0x7f456c0c4630 2023-08-27T11:23:16.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4160872974 0 0) 0x7f45580035b0 con 0x7f456c0c4630 2023-08-27T11:23:16.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 msgr2=0x7f456c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f456c06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 >> v2:172.21.15.57:3300/0 conn(0x7f456c151a90 msgr2=0x7f456c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 --2- 172.21.15.43:0/760120790 >> v2:172.21.15.57:3300/0 conn(0x7f456c151a90 0x7f456c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c154480 con 0x7f456c0c4630 2023-08-27T11:23:16.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f4554001670 con 0x7f456c0c4630 2023-08-27T11:23:16.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f456a59c700 1 --2- 172.21.15.43:0/760120790 >> v2:172.21.15.57:3300/0 conn(0x7f456c151a90 0x7f456c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:16.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 >> v1:172.21.15.43:6789/0 conn(0x7f456c0c4630 legacy=0x7f456c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558003a00 0x7f4558003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f4558004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4558004d90 0x7f4558005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c155370 con 0x7f4558004d90 2023-08-27T11:23:16.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c151e70 con 0x7f4558003a00 2023-08-27T11:23:16.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455800ba90 con 0x7f456c0c4a90 2023-08-27T11:23:16.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f456ad9d700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4558004d90 0x7f4558005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f4563fff700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f4558004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f456a59c700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558003a00 0x7f4558003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.160+0000 7f456ad9d700 1 -- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 msgr2=0x7f4558004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f456ad9d700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c0c4a90 0x7f4558004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f456ad9d700 1 -- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558003a00 msgr2=0x7f4558003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f456ad9d700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558003a00 0x7f4558003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f456ad9d700 1 -- 172.21.15.43:0/760120790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580035b0 con 0x7f4558004d90 2023-08-27T11:23:16.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f456ad9d700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4558004d90 0x7f4558005210 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4564009fc0 tx=0x7f4558005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d7fae1dfd3faaa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456400ec30 con 0x7f4558004d90 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456400f040 con 0x7f4558004d90 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f4569d9b700 1 -- 172.21.15.43:0/760120790 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564014480 con 0x7f4558004d90 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.161+0000 7f4570bff700 1 -- 172.21.15.43:0/760120790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4558004d90 msgr2=0x7f4558005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f4570bff700 1 --2- 172.21.15.43:0/760120790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4558004d90 0x7f4558005210 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4564009fc0 tx=0x7f4558005880 comp rx=0 tx=0).stop 2023-08-27T11:23:16.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f456ad9d700 1 -- 172.21.15.43:0/760120790 reap_dead start 2023-08-27T11:23:16.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f4570bff700 1 -- 172.21.15.43:0/760120790 shutdown_connections 2023-08-27T11:23:16.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f4570bff700 1 -- 172.21.15.43:0/760120790 >> 172.21.15.43:0/760120790 conn(0x7f456c0ab820 msgr2=0x7f456c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:16.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f4570bff700 1 -- 172.21.15.43:0/760120790 shutdown_connections 2023-08-27T11:23:16.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.162+0000 7f4570bff700 1 -- 172.21.15.43:0/760120790 wait complete. 2023-08-27T11:23:16.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.163+0000 7f4570bff700 1 Processor -- start 2023-08-27T11:23:16.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.164+0000 7f4570bff700 1 -- start start 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.164+0000 7f4570bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558004d90 0x7f456c158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.164+0000 7f4570bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4570bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c153920 0x7f456c0c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4570bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0c2e40 con 0x7f456c152c50 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4570bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0c12f0 con 0x7f4558004d90 2023-08-27T11:23:16.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4570bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0aa700 con 0x7f456c153920 2023-08-27T11:23:16.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49568/0 (socket says 172.21.15.43:49568) 2023-08-27T11:23:16.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 -- 172.21.15.43:0/1887723960 learned_addr learned my addr 172.21.15.43:0/1887723960 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:16.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f456a59c700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558004d90 0x7f456c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 -- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c153920 msgr2=0x7f456c0c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c153920 0x7f456c0c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 -- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558004d90 msgr2=0x7f456c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558004d90 0x7f456c158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 -- 172.21.15.43:0/1887723960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c0aa9e0 con 0x7f456c152c50 2023-08-27T11:23:16.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.165+0000 7f4563fff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4554001050 tx=0x7f45540075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.166+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540077d0 con 0x7f456c152c50 2023-08-27T11:23:16.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.166+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455400f820 con 0x7f456c152c50 2023-08-27T11:23:16.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.166+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455400fbd0 con 0x7f456c152c50 2023-08-27T11:23:16.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.166+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c0aacc0 con 0x7f456c152c50 2023-08-27T11:23:16.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.166+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1530d0 con 0x7f456c152c50 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.167+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c0c1460 con 0x7f456c152c50 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.168+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f455400fd30 con 0x7f456c152c50 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.169+0000 7f4562ffd700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 0x7f454c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.169+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45540885a0 con 0x7f456c152c50 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.169+0000 7f456a59c700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 0x7f454c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.170+0000 7f456a59c700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 0x7f454c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f455c009c90 tx=0x7f455c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.174+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4554053c80 con 0x7f456c152c50 2023-08-27T11:23:16.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.387+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f456c04ee70 con 0x7f456c152c50 2023-08-27T11:23:16.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.389+0000 7f4562ffd700 1 -- 172.21.15.43:0/1887723960 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f45540572a0 con 0x7f456c152c50 2023-08-27T11:23:16.391 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:16.391 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:16.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 msgr2=0x7f454c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 0x7f454c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f455c009c90 tx=0x7f455c008040 comp rx=0 tx=0).stop 2023-08-27T11:23:16.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 msgr2=0x7f456c1533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4554001050 tx=0x7f45540075f0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 shutdown_connections 2023-08-27T11:23:16.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f454c06a0e0 0x7f454c06c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f456c153920 0x7f456c0c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4558004d90 0x7f456c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 --2- 172.21.15.43:0/1887723960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f456c152c50 0x7f456c1533e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 >> 172.21.15.43:0/1887723960 conn(0x7f456c0ab820 msgr2=0x7f456c0c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:16.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 shutdown_connections 2023-08-27T11:23:16.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.391+0000 7f4570bff700 1 -- 172.21.15.43:0/1887723960 wait complete. 2023-08-27T11:23:16.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:16.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.614+0000 7fd5a39ff700 1 Processor -- start 2023-08-27T11:23:16.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.615+0000 7fd5a39ff700 1 -- start start 2023-08-27T11:23:16.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a39ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd59c151d20 0x7fd59c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a39ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59c154660 con 0x7fd59c0abcc0 2023-08-27T11:23:16.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a39ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59c0c5750 con 0x7fd59c151d20 2023-08-27T11:23:16.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c154940 con 0x7fd59c0c7c00 2023-08-27T11:23:16.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a179b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd59c151d20 0x7fd59c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a179b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd59c151d20 0x7fd59c0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49570/0 (socket says 172.21.15.43:49570) 2023-08-27T11:23:16.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a179b700 1 -- 172.21.15.43:0/2766357960 learned_addr learned my addr 172.21.15.43:0/2766357960 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:16.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a0f9a700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.616+0000 7fd5a179b700 1 -- 172.21.15.43:0/2766357960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 msgr2=0x7fd59c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd5a179b700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd5a179b700 1 -- 172.21.15.43:0/2766357960 >> v1:172.21.15.57:6789/0 conn(0x7fd59c0abcc0 legacy=0x7fd59c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:16.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd5a179b700 1 -- 172.21.15.43:0/2766357960 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c154c20 con 0x7fd59c151d20 2023-08-27T11:23:16.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd5a179b700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c0c8110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098f0 tx=0x7fd598009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cc25452215b1ae server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd593fff700 1 -- 172.21.15.43:0/2766357960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598004230 con 0x7fd59c151d20 2023-08-27T11:23:16.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd593fff700 1 -- 172.21.15.43:0/2766357960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd598004390 con 0x7fd59c151d20 2023-08-27T11:23:16.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.617+0000 7fd593fff700 1 -- 172.21.15.43:0/2766357960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980036a0 con 0x7fd59c151d20 2023-08-27T11:23:16.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 -- 172.21.15.43:0/2766357960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 msgr2=0x7fd59c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c0c8110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5980098f0 tx=0x7fd598009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:16.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 -- 172.21.15.43:0/2766357960 shutdown_connections 2023-08-27T11:23:16.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c0c8110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/2766357960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 -- 172.21.15.43:0/2766357960 >> 172.21.15.43:0/2766357960 conn(0x7fd59c0c9d00 msgr2=0x7fd59c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:16.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 -- 172.21.15.43:0/2766357960 shutdown_connections 2023-08-27T11:23:16.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.618+0000 7fd5a39ff700 1 -- 172.21.15.43:0/2766357960 wait complete. 2023-08-27T11:23:16.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.620+0000 7fd5a39ff700 1 Processor -- start 2023-08-27T11:23:16.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.620+0000 7fd5a39ff700 1 -- start start 2023-08-27T11:23:16.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd59c0abcc0 0x7fd59c0aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0c2e30 con 0x7fd59c151d20 2023-08-27T11:23:16.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c0aa5b0 con 0x7fd59c0abcc0 2023-08-27T11:23:16.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c153940 con 0x7fd59c0c7c00 2023-08-27T11:23:16.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49576/0 (socket says 172.21.15.43:49576) 2023-08-27T11:23:16.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 -- 172.21.15.43:0/452638991 learned_addr learned my addr 172.21.15.43:0/452638991 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:16.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a179b700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd59c0abcc0 0x7fd59c0aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a0f9a700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 -- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 msgr2=0x7fd59c0aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 -- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd59c0abcc0 msgr2=0x7fd59c0aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd59c0abcc0 0x7fd59c0aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.621+0000 7fd5a1f9c700 1 -- 172.21.15.43:0/452638991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598009550 con 0x7fd59c151d20 2023-08-27T11:23:16.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd5a1f9c700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cc10 tx=0x7fd59400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594004be0 con 0x7fd59c151d20 2023-08-27T11:23:16.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd594004d40 con 0x7fd59c151d20 2023-08-27T11:23:16.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59400ab90 con 0x7fd59c151d20 2023-08-27T11:23:16.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c153c20 con 0x7fd59c151d20 2023-08-27T11:23:16.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.622+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c0c10c0 con 0x7fd59c151d20 2023-08-27T11:23:16.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.623+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c04ee70 con 0x7fd59c151d20 2023-08-27T11:23:16.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.624+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd59400acf0 con 0x7fd59c151d20 2023-08-27T11:23:16.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.625+0000 7fd591ffb700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 0x7fd58006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:16.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.625+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd594087f10 con 0x7fd59c151d20 2023-08-27T11:23:16.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.625+0000 7fd5a179b700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 0x7fd58006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:16.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.626+0000 7fd5a179b700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 0x7fd58006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd598009130 tx=0x7fd598008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:16.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.629+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd5940535f0 con 0x7fd59c151d20 2023-08-27T11:23:16.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.840+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd59c0ac650 con 0x7fd59c151d20 2023-08-27T11:23:16.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.841+0000 7fd591ffb700 1 -- 172.21.15.43:0/452638991 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd594017070 con 0x7fd59c151d20 2023-08-27T11:23:16.843 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 msgr2=0x7fd58006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 0x7fd58006c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd598009130 tx=0x7fd598008030 comp rx=0 tx=0).stop 2023-08-27T11:23:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 msgr2=0x7fd59c147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:16.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd59400cc10 tx=0x7fd59400cf20 comp rx=0 tx=0).stop 2023-08-27T11:23:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 shutdown_connections 2023-08-27T11:23:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd58006a0e0 0x7fd58006c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd59c151d20 0x7fd59c147ff0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd59c0abcc0 0x7fd59c0aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 --2- 172.21.15.43:0/452638991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59c0c7c00 0x7fd59c0aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 >> 172.21.15.43:0/452638991 conn(0x7fd59c0c9d00 msgr2=0x7fd59c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 shutdown_connections 2023-08-27T11:23:16.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:16.843+0000 7fd5a39ff700 1 -- 172.21.15.43:0/452638991 wait complete. 2023-08-27T11:23:16.863 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:17.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.066+0000 7fbbea1ff700 1 Processor -- start 2023-08-27T11:23:17.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.066+0000 7fbbea1ff700 1 -- start start 2023-08-27T11:23:17.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.067+0000 7fbbea1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbe40c7c00 0x7fbbe40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.067+0000 7fbbea1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 0x7fbbe406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.067+0000 7fbbea1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe4154660 con 0x7fbbe4151d20 2023-08-27T11:23:17.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.067+0000 7fbbea1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40c5750 con 0x7fbbe40c7c00 2023-08-27T11:23:17.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.067+0000 7fbbea1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4154940 con 0x7fbbe406a8e0 2023-08-27T11:23:17.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbe40c7c00 0x7fbbe40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 0x7fbbe406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 0x7fbbe406ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:50800/0 (socket says 172.21.15.43:50800) 2023-08-27T11:23:17.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe3fff700 1 -- 172.21.15.43:0/661398672 learned_addr learned my addr 172.21.15.43:0/661398672 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbbe40c7c00 0x7fbbe40c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:38220/0 (socket says 172.21.15.43:38220) 2023-08-27T11:23:17.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 msgr2=0x7fbbe406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:17.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 --2- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 0x7fbbe406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/661398672 >> v1:172.21.15.57:6789/0 conn(0x7fbbe4151d20 legacy=0x7fbbe40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/661398672 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4154c20 con 0x7fbbe40c7c00 2023-08-27T11:23:17.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.068+0000 7fbbe2ffd700 1 --2- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c8110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009840 tx=0x7fbbd8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c8f0baf745594c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbe27fc700 1 -- 172.21.15.43:0/661398672 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8011830 con 0x7fbbe40c7c00 2023-08-27T11:23:17.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbe27fc700 1 -- 172.21.15.43:0/661398672 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8011990 con 0x7fbbe40c7c00 2023-08-27T11:23:17.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbe27fc700 1 -- 172.21.15.43:0/661398672 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8011d20 con 0x7fbbe40c7c00 2023-08-27T11:23:17.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 -- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe40c7c00 msgr2=0x7fbbe40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c8110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009840 tx=0x7fbbd8009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:17.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 -- 172.21.15.43:0/661398672 shutdown_connections 2023-08-27T11:23:17.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe406a8e0 0x7fbbe406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/661398672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c8110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 -- 172.21.15.43:0/661398672 >> 172.21.15.43:0/661398672 conn(0x7fbbe40c9d00 msgr2=0x7fbbe40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:17.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.069+0000 7fbbea1ff700 1 -- 172.21.15.43:0/661398672 shutdown_connections 2023-08-27T11:23:17.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.070+0000 7fbbea1ff700 1 -- 172.21.15.43:0/661398672 wait complete. 2023-08-27T11:23:17.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.071+0000 7fbbea1ff700 1 Processor -- start 2023-08-27T11:23:17.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.071+0000 7fbbea1ff700 1 -- start start 2023-08-27T11:23:17.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe406a8e0 0x7fbbe41eb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe4151d20 0x7fbbe4140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c1750 con 0x7fbbe40c7c00 2023-08-27T11:23:17.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c1d10 con 0x7fbbe406a8e0 2023-08-27T11:23:17.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.072+0000 7fbbea1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41ebb60 con 0x7fbbe4151d20 2023-08-27T11:23:17.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49588/0 (socket says 172.21.15.43:49588) 2023-08-27T11:23:17.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/2934944110 learned_addr learned my addr 172.21.15.43:0/2934944110 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe3fff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe4151d20 0x7fbbe4140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe37fe700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe406a8e0 0x7fbbe41eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe4151d20 msgr2=0x7fbbe4140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe4151d20 0x7fbbe4140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe406a8e0 msgr2=0x7fbbe41eb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe406a8e0 0x7fbbe41eb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 -- 172.21.15.43:0/2934944110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80094a0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.073+0000 7fbbe2ffd700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000c00 tx=0x7fbbd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.074+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80036a0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.074+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd801f070 con 0x7fbbe40c7c00 2023-08-27T11:23:17.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.074+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8003a60 con 0x7fbbe40c7c00 2023-08-27T11:23:17.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.074+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40c3880 con 0x7fbbe40c7c00 2023-08-27T11:23:17.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.074+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40c19a0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.075+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe404ee70 con 0x7fbbe40c7c00 2023-08-27T11:23:17.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.076+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbd8003bc0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.077+0000 7fbbcbfff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.077+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbd8021070 con 0x7fbbe40c7c00 2023-08-27T11:23:17.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.077+0000 7fbbe37fe700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.077+0000 7fbbe37fe700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007fd0 tx=0x7fbbd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.081+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbbd80553f0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.291+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbe40c1e50 con 0x7fbbe40c7c00 2023-08-27T11:23:17.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.292+0000 7fbbcbfff700 1 -- 172.21.15.43:0/2934944110 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbd802b0a0 con 0x7fbbe40c7c00 2023-08-27T11:23:17.294 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.294+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 msgr2=0x7fbbd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.294+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007fd0 tx=0x7fbbd4009040 comp rx=0 tx=0).stop 2023-08-27T11:23:17.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.294+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 msgr2=0x7fbbe40c21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.294+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8000c00 tx=0x7fbbd8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.294+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 shutdown_connections 2023-08-27T11:23:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbd006a0e0 0x7fbbd006c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbbe4151d20 0x7fbbe4140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbbe406a8e0 0x7fbbe41eb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 --2- 172.21.15.43:0/2934944110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbbe40c7c00 0x7fbbe40c21a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 >> 172.21.15.43:0/2934944110 conn(0x7fbbe40c9d00 msgr2=0x7fbbe414fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 shutdown_connections 2023-08-27T11:23:17.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.295+0000 7fbbea1ff700 1 -- 172.21.15.43:0/2934944110 wait complete. 2023-08-27T11:23:17.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:17.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.516+0000 7f196b9ff700 1 Processor -- start 2023-08-27T11:23:17.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.517+0000 7f196b9ff700 1 -- start start 2023-08-27T11:23:17.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196b9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1964151d20 0x7f19640c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196b9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f196406a8e0 0x7f196406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196b9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1964154660 con 0x7f19640c7c00 2023-08-27T11:23:17.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196b9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640c5750 con 0x7f196406a8e0 2023-08-27T11:23:17.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196b9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1964154940 con 0x7f1964151d20 2023-08-27T11:23:17.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f196406a8e0 0x7f196406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f196406a8e0 0x7f196406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49600/0 (socket says 172.21.15.43:49600) 2023-08-27T11:23:17.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f196979b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1964151d20 0x7f19640c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 -- 172.21.15.43:0/849178153 learned_addr learned my addr 172.21.15.43:0/849178153 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 -- 172.21.15.43:0/849178153 >> v2:172.21.15.57:3300/0 conn(0x7f1964151d20 msgr2=0x7f19640c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:17.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 --2- 172.21.15.43:0/849178153 >> v2:172.21.15.57:3300/0 conn(0x7f1964151d20 0x7f19640c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.518+0000 7f1969f9c700 1 -- 172.21.15.43:0/849178153 >> v1:172.21.15.57:6789/0 conn(0x7f19640c7c00 legacy=0x7f19640ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f1969f9c700 1 -- 172.21.15.43:0/849178153 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964154c20 con 0x7f196406a8e0 2023-08-27T11:23:17.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f1969f9c700 1 --2- 172.21.15.43:0/849178153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406a8e0 0x7f196406acf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19640cac10 tx=0x7f195c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fea132521a8b0f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f195bfff700 1 -- 172.21.15.43:0/849178153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00e070 con 0x7f196406a8e0 2023-08-27T11:23:17.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f195bfff700 1 -- 172.21.15.43:0/849178153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00b910 con 0x7f196406a8e0 2023-08-27T11:23:17.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f195bfff700 1 -- 172.21.15.43:0/849178153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00bcc0 con 0x7f196406a8e0 2023-08-27T11:23:17.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f196b9ff700 1 -- 172.21.15.43:0/849178153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406a8e0 msgr2=0x7f196406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.519+0000 7f196b9ff700 1 --2- 172.21.15.43:0/849178153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406a8e0 0x7f196406acf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19640cac10 tx=0x7f195c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:17.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 -- 172.21.15.43:0/849178153 shutdown_connections 2023-08-27T11:23:17.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 --2- 172.21.15.43:0/849178153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f196406a8e0 0x7f196406acf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 --2- 172.21.15.43:0/849178153 >> v2:172.21.15.57:3300/0 conn(0x7f1964151d20 0x7f19640c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 -- 172.21.15.43:0/849178153 >> 172.21.15.43:0/849178153 conn(0x7f19640c9d00 msgr2=0x7f19640ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:17.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 -- 172.21.15.43:0/849178153 shutdown_connections 2023-08-27T11:23:17.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.520+0000 7f196b9ff700 1 -- 172.21.15.43:0/849178153 wait complete. 2023-08-27T11:23:17.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.521+0000 7f196b9ff700 1 Processor -- start 2023-08-27T11:23:17.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.522+0000 7f196b9ff700 1 -- start start 2023-08-27T11:23:17.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.522+0000 7f196b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f196406a8e0 0x7f1964153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.522+0000 7f196b9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.522+0000 7f196b9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1964151d20 0x7f19641ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f196b9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196414ea30 con 0x7f19640c7c00 2023-08-27T11:23:17.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f196b9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19641e9b20 con 0x7f1964151d20 2023-08-27T11:23:17.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f196b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196414ef60 con 0x7f196406a8e0 2023-08-27T11:23:17.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49602/0 (socket says 172.21.15.43:49602) 2023-08-27T11:23:17.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 -- 172.21.15.43:0/399082003 learned_addr learned my addr 172.21.15.43:0/399082003 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f196979b700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f196406a8e0 0x7f1964153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1969f9c700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1964151d20 0x7f19641ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 -- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f196406a8e0 msgr2=0x7f1964153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f196406a8e0 0x7f1964153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 -- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1964151d20 msgr2=0x7f19641ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1964151d20 0x7f19641ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 -- 172.21.15.43:0/399082003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c009b30 con 0x7f19640c7c00 2023-08-27T11:23:17.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.523+0000 7f1968f9a700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f195400c4e0 tx=0x7f195400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.524+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540052d0 con 0x7f19640c7c00 2023-08-27T11:23:17.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.524+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954005430 con 0x7f19640c7c00 2023-08-27T11:23:17.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.524+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540038c0 con 0x7f19640c7c00 2023-08-27T11:23:17.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.524+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19641edc70 con 0x7f19640c7c00 2023-08-27T11:23:17.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.524+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19641541d0 con 0x7f19640c7c00 2023-08-27T11:23:17.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.525+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196404ee70 con 0x7f19640c7c00 2023-08-27T11:23:17.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.526+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1954003a20 con 0x7f19640c7c00 2023-08-27T11:23:17.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.526+0000 7f1959ffb700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 0x7f194806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.527+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1954087a40 con 0x7f19640c7c00 2023-08-27T11:23:17.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.527+0000 7f196979b700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 0x7f194806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.527+0000 7f196979b700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 0x7f194806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f19640c7190 tx=0x7f1960008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.531+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1954053120 con 0x7f19640c7c00 2023-08-27T11:23:17.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.738+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19640ac650 con 0x7f19640c7c00 2023-08-27T11:23:17.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.738+0000 7f1959ffb700 1 -- 172.21.15.43:0/399082003 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1954056740 con 0x7f19640c7c00 2023-08-27T11:23:17.740 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:17.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.740+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 msgr2=0x7f194806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 0x7f194806c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f19640c7190 tx=0x7f1960008040 comp rx=0 tx=0).stop 2023-08-27T11:23:17.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 msgr2=0x7f19641e9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f195400c4e0 tx=0x7f195400c8a0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 shutdown_connections 2023-08-27T11:23:17.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194806a0e0 0x7f194806c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1964151d20 0x7f19641ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f196406a8e0 0x7f1964153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 --2- 172.21.15.43:0/399082003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f19640c7c00 0x7f19641e9fb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 >> 172.21.15.43:0/399082003 conn(0x7f19640c9d00 msgr2=0x7f19640bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:17.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 shutdown_connections 2023-08-27T11:23:17.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.741+0000 7f196b9ff700 1 -- 172.21.15.43:0/399082003 wait complete. 2023-08-27T11:23:17.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:17.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.964+0000 7fc5b95ff700 1 Processor -- start 2023-08-27T11:23:17.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.964+0000 7fc5b95ff700 1 -- start start 2023-08-27T11:23:17.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.965+0000 7fc5b95ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5b4151d20 0x7fc5b40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.965+0000 7fc5b95ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5b40c7c00 0x7fc5b40ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b95ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b4154660 con 0x7fc5b40abcc0 2023-08-27T11:23:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b95ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40c5750 con 0x7fc5b40c7c00 2023-08-27T11:23:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b95ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b4154940 con 0x7fc5b4151d20 2023-08-27T11:23:17.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5b40c7c00 0x7fc5b40ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5b40c7c00 0x7fc5b40ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49606/0 (socket says 172.21.15.43:49606) 2023-08-27T11:23:17.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 -- 172.21.15.43:0/2827049380 learned_addr learned my addr 172.21.15.43:0/2827049380 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b2ffd700 1 --2- 172.21.15.43:0/2827049380 >> v2:172.21.15.57:3300/0 conn(0x7fc5b4151d20 0x7fc5b40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 -- 172.21.15.43:0/2827049380 >> v2:172.21.15.57:3300/0 conn(0x7fc5b4151d20 msgr2=0x7fc5b40c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:17.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 --2- 172.21.15.43:0/2827049380 >> v2:172.21.15.57:3300/0 conn(0x7fc5b4151d20 0x7fc5b40c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 -- 172.21.15.43:0/2827049380 >> v1:172.21.15.57:6789/0 conn(0x7fc5b40abcc0 legacy=0x7fc5b406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.966+0000 7fc5b27fc700 1 -- 172.21.15.43:0/2827049380 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4154c20 con 0x7fc5b40c7c00 2023-08-27T11:23:17.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b27fc700 1 --2- 172.21.15.43:0/2827049380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b40c7c00 0x7fc5b40ab780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40cac10 tx=0x7fc5a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cb50d7d52451ef server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b1ffb700 1 -- 172.21.15.43:0/2827049380 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011830 con 0x7fc5b40c7c00 2023-08-27T11:23:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b1ffb700 1 -- 172.21.15.43:0/2827049380 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a8011990 con 0x7fc5b40c7c00 2023-08-27T11:23:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b1ffb700 1 -- 172.21.15.43:0/2827049380 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d20 con 0x7fc5b40c7c00 2023-08-27T11:23:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2827049380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b40c7c00 msgr2=0x7fc5b40ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2827049380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b40c7c00 0x7fc5b40ab780 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40cac10 tx=0x7fc5a8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2827049380 shutdown_connections 2023-08-27T11:23:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2827049380 >> v2:172.21.15.57:3300/0 conn(0x7fc5b4151d20 0x7fc5b40c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.967+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2827049380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b40c7c00 0x7fc5b40ab780 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.968+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2827049380 >> 172.21.15.43:0/2827049380 conn(0x7fc5b40c9d00 msgr2=0x7fc5b40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:17.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.968+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2827049380 shutdown_connections 2023-08-27T11:23:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.968+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2827049380 wait complete. 2023-08-27T11:23:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.970+0000 7fc5b95ff700 1 Processor -- start 2023-08-27T11:23:17.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.970+0000 7fc5b95ff700 1 -- start start 2023-08-27T11:23:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5b40abcc0 0x7fc5b414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5b40c7c00 0x7fc5b4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b414db30 con 0x7fc5b4151d20 2023-08-27T11:23:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b4153130 con 0x7fc5b40c7c00 2023-08-27T11:23:17.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.971+0000 7fc5b95ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b41533d0 con 0x7fc5b40abcc0 2023-08-27T11:23:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5b40abcc0 0x7fc5b414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5b40c7c00 0x7fc5b4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49618/0 (socket says 172.21.15.43:49618) 2023-08-27T11:23:17.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 -- 172.21.15.43:0/2940663093 learned_addr learned my addr 172.21.15.43:0/2940663093 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 -- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5b40abcc0 msgr2=0x7fc5b414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5b40abcc0 0x7fc5b414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 -- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5b40c7c00 msgr2=0x7fc5b4152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5b40c7c00 0x7fc5b4152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.972+0000 7fc5b37fe700 1 -- 172.21.15.43:0/2940663093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8009550 con 0x7fc5b4151d20 2023-08-27T11:23:17.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc5b37fe700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00cb90 tx=0x7fc5ac00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac003c50 con 0x7fc5b4151d20 2023-08-27T11:23:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac003dd0 con 0x7fc5b4151d20 2023-08-27T11:23:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b41536b0 con 0x7fc5b4151d20 2023-08-27T11:23:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac00aae0 con 0x7fc5b4151d20 2023-08-27T11:23:17.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.973+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b4153c70 con 0x7fc5b4151d20 2023-08-27T11:23:17.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.974+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b404ee70 con 0x7fc5b4151d20 2023-08-27T11:23:17.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.975+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5ac00ac40 con 0x7fc5b4151d20 2023-08-27T11:23:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.976+0000 7fc59b7fe700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 0x7fc5a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.976+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5ac0885f0 con 0x7fc5b4151d20 2023-08-27T11:23:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.976+0000 7fc5b2ffd700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 0x7fc5a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:17.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.977+0000 7fc5b2ffd700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 0x7fc5a006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009b40 tx=0x7fc5a4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:17.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:17.981+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5ac053c40 con 0x7fc5b4151d20 2023-08-27T11:23:18.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.190+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5b40ac650 con 0x7fc5b4151d20 2023-08-27T11:23:18.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.190+0000 7fc59b7fe700 1 -- 172.21.15.43:0/2940663093 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5ac057260 con 0x7fc5b4151d20 2023-08-27T11:23:18.192 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:18.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.192+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 msgr2=0x7fc5a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.192+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 0x7fc5a006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009b40 tx=0x7fc5a4009210 comp rx=0 tx=0).stop 2023-08-27T11:23:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.192+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 msgr2=0x7fc5b414c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.192+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00cb90 tx=0x7fc5ac00cea0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.192+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 shutdown_connections 2023-08-27T11:23:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc5a006a0e0 0x7fc5a006c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5b4151d20 0x7fc5b414c230 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5b40abcc0 0x7fc5b414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 --2- 172.21.15.43:0/2940663093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5b40c7c00 0x7fc5b4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 >> 172.21.15.43:0/2940663093 conn(0x7fc5b40c9d00 msgr2=0x7fc5b40ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 shutdown_connections 2023-08-27T11:23:18.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.193+0000 7fc5b95ff700 1 -- 172.21.15.43:0/2940663093 wait complete. 2023-08-27T11:23:18.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:18.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.415+0000 7f4df15ff700 1 Processor -- start 2023-08-27T11:23:18.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.415+0000 7f4df15ff700 1 -- start start 2023-08-27T11:23:18.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4df15ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dec0c4a90 0x7f4dec06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4df15ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec06c4e0 con 0x7f4dec0c4630 2023-08-27T11:23:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4df15ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec155370 con 0x7f4dec151a90 2023-08-27T11:23:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4df15ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec0c82c0 con 0x7f4dec0c4a90 2023-08-27T11:23:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4dea7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4dec0c4630 0x7f4dec06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57342/0 (socket says 172.21.15.43:57342) 2023-08-27T11:23:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4dea7fc700 1 -- 172.21.15.43:0/521802302 learned_addr learned my addr 172.21.15.43:0/521802302 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:18.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.416+0000 7f4deb7fe700 1 --2- 172.21.15.43:0/521802302 >> v2:172.21.15.57:3300/0 conn(0x7f4dec0c4a90 0x7f4dec06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77017362 0 0) 0x7f4dec06c4e0 con 0x7f4dec0c4630 2023-08-27T11:23:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd40035b0 con 0x7f4dec0c4630 2023-08-27T11:23:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734630920 0 0) 0x7f4dec155370 con 0x7f4dec151a90 2023-08-27T11:23:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec06c4e0 con 0x7f4dec151a90 2023-08-27T11:23:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2348408313 0 0) 0x7f4dd40035b0 con 0x7f4dec0c4630 2023-08-27T11:23:18.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 >> v2:172.21.15.57:3300/0 conn(0x7f4dec0c4a90 msgr2=0x7f4dec06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 --2- 172.21.15.43:0/521802302 >> v2:172.21.15.57:3300/0 conn(0x7f4dec0c4a90 0x7f4dec06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 >> v1:172.21.15.57:6789/0 conn(0x7f4dec151a90 legacy=0x7f4dec0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec151e70 con 0x7f4dec0c4630 2023-08-27T11:23:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f4de0001670 con 0x7f4dec0c4630 2023-08-27T11:23:18.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4deb7fe700 1 --2- 172.21.15.43:0/521802302 >> v2:172.21.15.57:3300/0 conn(0x7f4dec0c4a90 0x7f4dec06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 >> v1:172.21.15.43:6789/0 conn(0x7f4dec0c4630 legacy=0x7f4dec06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dd4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd4004850 0x7f4dd4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd4005260 0x7f4dd400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec0c82c0 con 0x7f4dd4003be0 2023-08-27T11:23:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400c190 con 0x7f4dd4004850 2023-08-27T11:23:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd400c350 con 0x7f4dd4005260 2023-08-27T11:23:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.417+0000 7f4deaffd700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dd4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 -- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd4005260 msgr2=0x7f4dd400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:18.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd4005260 0x7f4dd400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 -- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd4004850 msgr2=0x7f4dd4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:18.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd4004850 0x7f4dd4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 -- 172.21.15.43:0/521802302 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40035b0 con 0x7f4dd4003be0 2023-08-27T11:23:18.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deb7fe700 1 -- 172.21.15.43:0/521802302 reap_dead start 2023-08-27T11:23:18.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4deaffd700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dd4003fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc001940 tx=0x7f4dd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d222985671f7b48a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc001430 con 0x7f4dd4003be0 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc001d70 con 0x7f4dd4003be0 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.418+0000 7f4de9ffb700 1 -- 172.21.15.43:0/521802302 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005510 con 0x7f4dd4003be0 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 -- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 msgr2=0x7f4dd4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dd4003fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc001940 tx=0x7f4dd4005880 comp rx=0 tx=0).stop 2023-08-27T11:23:18.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 -- 172.21.15.43:0/521802302 shutdown_connections 2023-08-27T11:23:18.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 --2- 172.21.15.43:0/521802302 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dd4003fe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 -- 172.21.15.43:0/521802302 >> 172.21.15.43:0/521802302 conn(0x7f4dec0ab820 msgr2=0x7f4dec0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:18.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 -- 172.21.15.43:0/521802302 shutdown_connections 2023-08-27T11:23:18.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.419+0000 7f4df15ff700 1 -- 172.21.15.43:0/521802302 wait complete. 2023-08-27T11:23:18.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.421+0000 7f4df15ff700 1 Processor -- start 2023-08-27T11:23:18.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.421+0000 7f4df15ff700 1 -- start start 2023-08-27T11:23:18.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec14d9e0 0x7f4dec144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec1453b0 0x7f4dec1ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec14c5c0 con 0x7f4dd4003be0 2023-08-27T11:23:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec144bb0 con 0x7f4dec1453b0 2023-08-27T11:23:18.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4df15ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec153130 con 0x7f4dec14d9e0 2023-08-27T11:23:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49622/0 (socket says 172.21.15.43:49622) 2023-08-27T11:23:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 -- 172.21.15.43:0/3799359671 learned_addr learned my addr 172.21.15.43:0/3799359671 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4dea7fc700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec14d9e0 0x7f4dec144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deb7fe700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec1453b0 0x7f4dec1ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 -- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec14d9e0 msgr2=0x7f4dec144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec14d9e0 0x7f4dec144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 -- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec1453b0 msgr2=0x7f4dec1ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.422+0000 7f4deaffd700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec1453b0 0x7f4dec1ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4deaffd700 1 -- 172.21.15.43:0/3799359671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec14c000 con 0x7f4dd4003be0 2023-08-27T11:23:18.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4deaffd700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c160 tx=0x7f4ddc0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc003a90 con 0x7f4dd4003be0 2023-08-27T11:23:18.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc003bf0 con 0x7f4dd4003be0 2023-08-27T11:23:18.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc00c650 con 0x7f4dd4003be0 2023-08-27T11:23:18.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec14c2e0 con 0x7f4dd4003be0 2023-08-27T11:23:18.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.423+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec1536b0 con 0x7f4dd4003be0 2023-08-27T11:23:18.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.425+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec1edd60 con 0x7f4dd4003be0 2023-08-27T11:23:18.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.425+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ddc019040 con 0x7f4dd4003be0 2023-08-27T11:23:18.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.426+0000 7f4dd37fe700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 0x7f4dd806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.426+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ddc089240 con 0x7f4dd4003be0 2023-08-27T11:23:18.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.427+0000 7f4dea7fc700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 0x7f4dd806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.427+0000 7f4dea7fc700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 0x7f4dd806c5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dec14ebc0 tx=0x7f4de0001570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.431+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4ddc0549c0 con 0x7f4dd4003be0 2023-08-27T11:23:18.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.642+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dec04ee70 con 0x7f4dd4003be0 2023-08-27T11:23:18.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.643+0000 7f4dd37fe700 1 -- 172.21.15.43:0/3799359671 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f4ddc057fe0 con 0x7f4dd4003be0 2023-08-27T11:23:18.645 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:18.645 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:18.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 msgr2=0x7f4dd806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 0x7f4dd806c5d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4dec14ebc0 tx=0x7f4de0001570 comp rx=0 tx=0).stop 2023-08-27T11:23:18.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 msgr2=0x7f4dec153bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c160 tx=0x7f4ddc0012d0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 shutdown_connections 2023-08-27T11:23:18.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dd806a110 0x7f4dd806c5d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec1453b0 0x7f4dec1ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd4003be0 0x7f4dec153bd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 --2- 172.21.15.43:0/3799359671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec14d9e0 0x7f4dec144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 >> 172.21.15.43:0/3799359671 conn(0x7f4dec0ab820 msgr2=0x7f4dec14df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:18.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 shutdown_connections 2023-08-27T11:23:18.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.646+0000 7f4df15ff700 1 -- 172.21.15.43:0/3799359671 wait complete. 2023-08-27T11:23:18.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:18.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:18.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.869+0000 7f6404dff700 1 Processor -- start 2023-08-27T11:23:18.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.869+0000 7f6404dff700 1 -- start start 2023-08-27T11:23:18.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f6404dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6400151d20 0x7f64000c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f6404dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f640006a8e0 0x7f640006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f6404dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6400154660 con 0x7f64000c7c00 2023-08-27T11:23:18.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f6404dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000c5750 con 0x7f640006a8e0 2023-08-27T11:23:18.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f6404dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6400154940 con 0x7f6400151d20 2023-08-27T11:23:18.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.870+0000 7f63fdd9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f64000c7c00 0x7f64000ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60806/0 (socket says 172.21.15.43:60806) 2023-08-27T11:23:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fdd9b700 1 -- 172.21.15.43:0/2515385503 learned_addr learned my addr 172.21.15.43:0/2515385503 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 --2- 172.21.15.43:0/2515385503 >> v2:172.21.15.43:3300/0 conn(0x7f640006a8e0 0x7f640006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fe59c700 1 --2- 172.21.15.43:0/2515385503 >> v2:172.21.15.57:3300/0 conn(0x7f6400151d20 0x7f64000c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fd59a700 1 -- 172.21.15.43:0/2515385503 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66030733 0 0) 0x7f6400154660 con 0x7f64000c7c00 2023-08-27T11:23:18.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fd59a700 1 -- 172.21.15.43:0/2515385503 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63e80035b0 con 0x7f64000c7c00 2023-08-27T11:23:18.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 -- 172.21.15.43:0/2515385503 >> v2:172.21.15.57:3300/0 conn(0x7f6400151d20 msgr2=0x7f64000c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:18.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 --2- 172.21.15.43:0/2515385503 >> v2:172.21.15.57:3300/0 conn(0x7f6400151d20 0x7f64000c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 -- 172.21.15.43:0/2515385503 >> v1:172.21.15.43:6789/0 conn(0x7f64000c7c00 legacy=0x7f64000ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 -- 172.21.15.43:0/2515385503 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6400154c20 con 0x7f640006a8e0 2023-08-27T11:23:18.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.871+0000 7f63fed9d700 1 --2- 172.21.15.43:0/2515385503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f640006a8e0 0x7f640006acf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64000cac10 tx=0x7f63f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd96512338fc7504 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f63fd59a700 1 -- 172.21.15.43:0/2515385503 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f800e070 con 0x7f640006a8e0 2023-08-27T11:23:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f63fd59a700 1 -- 172.21.15.43:0/2515385503 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f800bb20 con 0x7f640006a8e0 2023-08-27T11:23:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f63fd59a700 1 -- 172.21.15.43:0/2515385503 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f8012430 con 0x7f640006a8e0 2023-08-27T11:23:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 -- 172.21.15.43:0/2515385503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f640006a8e0 msgr2=0x7f640006acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 --2- 172.21.15.43:0/2515385503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f640006a8e0 0x7f640006acf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64000cac10 tx=0x7f63f800b330 comp rx=0 tx=0).stop 2023-08-27T11:23:18.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 -- 172.21.15.43:0/2515385503 shutdown_connections 2023-08-27T11:23:18.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 --2- 172.21.15.43:0/2515385503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f640006a8e0 0x7f640006acf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 --2- 172.21.15.43:0/2515385503 >> v2:172.21.15.57:3300/0 conn(0x7f6400151d20 0x7f64000c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 -- 172.21.15.43:0/2515385503 >> 172.21.15.43:0/2515385503 conn(0x7f64000c9d00 msgr2=0x7f64000ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:18.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 -- 172.21.15.43:0/2515385503 shutdown_connections 2023-08-27T11:23:18.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.872+0000 7f6404dff700 1 -- 172.21.15.43:0/2515385503 wait complete. 2023-08-27T11:23:18.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.874+0000 7f6404dff700 1 Processor -- start 2023-08-27T11:23:18.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.874+0000 7f6404dff700 1 -- start start 2023-08-27T11:23:18.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 0x7f64001586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6400151d20 0x7f6400148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64001575f0 con 0x7f64000c7c00 2023-08-27T11:23:18.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000c2960 con 0x7f640006a8e0 2023-08-27T11:23:18.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f6404dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6400157100 con 0x7f6400151d20 2023-08-27T11:23:18.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f63fdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f63fdd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41656/0 (socket says 172.21.15.43:41656) 2023-08-27T11:23:18.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.875+0000 7f63fdd9b700 1 -- 172.21.15.43:0/225380317 learned_addr learned my addr 172.21.15.43:0/225380317 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:18.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 -- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6400151d20 msgr2=0x7f6400148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fe59c700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 0x7f64001586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6400151d20 0x7f6400148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 -- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 msgr2=0x7f64001586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:18.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 0x7f64001586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:18.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 -- 172.21.15.43:0/225380317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8009a70 con 0x7f64000c7c00 2023-08-27T11:23:18.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fe59c700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 0x7f64001586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:18.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63fdd9b700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c700 tx=0x7f63f400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4005d70 con 0x7f64000c7c00 2023-08-27T11:23:18.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40070d0 con 0x7f64000c7c00 2023-08-27T11:23:18.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007460 con 0x7f64000c7c00 2023-08-27T11:23:18.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400156290 con 0x7f64000c7c00 2023-08-27T11:23:18.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.876+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6400155d60 con 0x7f64000c7c00 2023-08-27T11:23:18.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.877+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6400155f20 con 0x7f64000c7c00 2023-08-27T11:23:18.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.878+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f63f40075c0 con 0x7f64000c7c00 2023-08-27T11:23:18.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.879+0000 7f63eeffd700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 0x7f63e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:18.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.879+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63f4087b90 con 0x7f64000c7c00 2023-08-27T11:23:18.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.880+0000 7f63fe59c700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 0x7f63e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:18.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.880+0000 7f63fe59c700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 0x7f63e006c5d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ac0 tx=0x7f63f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:18.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:18.884+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f63f40531f0 con 0x7f64000c7c00 2023-08-27T11:23:19.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.090+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f640004ee70 con 0x7f64000c7c00 2023-08-27T11:23:19.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.091+0000 7f63eeffd700 1 -- 172.21.15.43:0/225380317 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63f4056810 con 0x7f64000c7c00 2023-08-27T11:23:19.092 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:19.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 msgr2=0x7f63e006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 0x7f63e006c5d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ac0 tx=0x7f63f0008040 comp rx=0 tx=0).stop 2023-08-27T11:23:19.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 msgr2=0x7f6400153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c700 tx=0x7f63f400cac0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 shutdown_connections 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f63e006a110 0x7f63e006c5d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6400151d20 0x7f6400148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f640006a8e0 0x7f64001586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 --2- 172.21.15.43:0/225380317 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64000c7c00 0x7f6400153890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 >> 172.21.15.43:0/225380317 conn(0x7f64000c9d00 msgr2=0x7f6400150230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:19.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 shutdown_connections 2023-08-27T11:23:19.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.093+0000 7f6404dff700 1 -- 172.21.15.43:0/225380317 wait complete. 2023-08-27T11:23:19.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.317+0000 7f7e90bff700 1 Processor -- start 2023-08-27T11:23:19.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.317+0000 7f7e90bff700 1 -- start start 2023-08-27T11:23:19.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e90bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e8c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e90bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c154660 con 0x7f7e8c151d20 2023-08-27T11:23:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e90bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c154940 con 0x7f7e8c0c7c00 2023-08-27T11:23:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e90bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0c5750 con 0x7f7e8c06aff0 2023-08-27T11:23:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e8a59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7e8c151d20 0x7f7e8c0ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60820/0 (socket says 172.21.15.43:60820) 2023-08-27T11:23:19.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e8a59c700 1 -- 172.21.15.43:0/3803180115 learned_addr learned my addr 172.21.15.43:0/3803180115 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:19.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.318+0000 7f7e8ad9d700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e8c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479129622 0 0) 0x7f7e8c154660 con 0x7f7e8c151d20 2023-08-27T11:23:19.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e780035b0 con 0x7f7e8c151d20 2023-08-27T11:23:19.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065817239 0 0) 0x7f7e8c154940 con 0x7f7e8c0c7c00 2023-08-27T11:23:19.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8c154660 con 0x7f7e8c0c7c00 2023-08-27T11:23:19.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 775366963 0 0) 0x7f7e780035b0 con 0x7f7e8c151d20 2023-08-27T11:23:19.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 msgr2=0x7f7e8c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e8c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 >> v1:172.21.15.57:6789/0 conn(0x7f7e8c0c7c00 legacy=0x7f7e8c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c154c20 con 0x7f7e8c151d20 2023-08-27T11:23:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f7e7c001670 con 0x7f7e8c151d20 2023-08-27T11:23:19.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 >> v1:172.21.15.43:6789/0 conn(0x7f7e8c151d20 legacy=0x7f7e8c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e78003c30 0x7f7e78004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e78004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e780052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bba0 con 0x7f7e78004850 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bd10 con 0x7f7e78003c30 2023-08-27T11:23:19.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bed0 con 0x7f7e8c06aff0 2023-08-27T11:23:19.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.319+0000 7f7e83fff700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e78004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e8a59c700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e78003c30 0x7f7e78004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e8ad9d700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e780052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 -- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 msgr2=0x7f7e780052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:19.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e780052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 -- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e78003c30 msgr2=0x7f7e78004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:19.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e78003c30 0x7f7e78004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 -- 172.21.15.43:0/3803180115 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780035b0 con 0x7f7e78004850 2023-08-27T11:23:19.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e8ad9d700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c06aff0 0x7f7e780052e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:19.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e83fff700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e78004cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e74001980 tx=0x7f7e78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2640880016ac0d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74001470 con 0x7f7e78004850 2023-08-27T11:23:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e740052d0 con 0x7f7e78004850 2023-08-27T11:23:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.320+0000 7f7e89d9b700 1 -- 172.21.15.43:0/3803180115 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003680 con 0x7f7e78004850 2023-08-27T11:23:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 -- 172.21.15.43:0/3803180115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 msgr2=0x7f7e78004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 --2- 172.21.15.43:0/3803180115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e78004cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e74001980 tx=0x7f7e78005880 comp rx=0 tx=0).stop 2023-08-27T11:23:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e8ad9d700 1 -- 172.21.15.43:0/3803180115 reap_dead start 2023-08-27T11:23:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 -- 172.21.15.43:0/3803180115 shutdown_connections 2023-08-27T11:23:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 -- 172.21.15.43:0/3803180115 >> 172.21.15.43:0/3803180115 conn(0x7f7e8c0c9d00 msgr2=0x7f7e8c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 -- 172.21.15.43:0/3803180115 shutdown_connections 2023-08-27T11:23:19.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.321+0000 7f7e90bff700 1 -- 172.21.15.43:0/3803180115 wait complete. 2023-08-27T11:23:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.323+0000 7f7e90bff700 1 Processor -- start 2023-08-27T11:23:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.323+0000 7f7e90bff700 1 -- start start 2023-08-27T11:23:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 0x7f7e8c153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 0x7f7e8c143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0c3650 con 0x7f7e78004850 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c144420 con 0x7f7e8c143a60 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e90bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c1ea610 con 0x7f7e8c153410 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41664/0 (socket says 172.21.15.43:41664) 2023-08-27T11:23:19.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 -- 172.21.15.43:0/199833363 learned_addr learned my addr 172.21.15.43:0/199833363 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:19.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e83fff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 0x7f7e8c153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 -- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 msgr2=0x7f7e8c153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8ad9d700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 0x7f7e8c143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 0x7f7e8c153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 -- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 msgr2=0x7f7e8c143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 0x7f7e8c143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8a59c700 1 -- 172.21.15.43:0/199833363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0c2740 con 0x7f7e78004850 2023-08-27T11:23:19.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e83fff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 0x7f7e8c153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:19.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.324+0000 7f7e8ad9d700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 0x7f7e8c143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e8a59c700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001750 tx=0x7f7e7c0073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c001010 con 0x7f7e78004850 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c011580 con 0x7f7e78004850 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011910 con 0x7f7e78004850 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c150450 con 0x7f7e78004850 2023-08-27T11:23:19.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.325+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c0abcc0 con 0x7f7e78004850 2023-08-27T11:23:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.326+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c04ee70 con 0x7f7e78004850 2023-08-27T11:23:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.327+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e7c011a70 con 0x7f7e78004850 2023-08-27T11:23:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.328+0000 7f7e82ffd700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 0x7f7e6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.328+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e7c087f00 con 0x7f7e78004850 2023-08-27T11:23:19.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.329+0000 7f7e83fff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 0x7f7e6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.329+0000 7f7e83fff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 0x7f7e6c06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c153eb0 tx=0x7f7e7400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.333+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e7c0535e0 con 0x7f7e78004850 2023-08-27T11:23:19.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.541+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e8c0ac650 con 0x7f7e78004850 2023-08-27T11:23:19.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.542+0000 7f7e82ffd700 1 -- 172.21.15.43:0/199833363 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e7c019070 con 0x7f7e78004850 2023-08-27T11:23:19.544 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 msgr2=0x7f7e6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 0x7f7e6c06c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c153eb0 tx=0x7f7e7400a000 comp rx=0 tx=0).stop 2023-08-27T11:23:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 msgr2=0x7f7e8c1ea0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c001750 tx=0x7f7e7c0073f0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 shutdown_connections 2023-08-27T11:23:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6c06a0e0 0x7f7e6c06c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8c143a60 0x7f7e8c143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e78004850 0x7f7e8c1ea0d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 --2- 172.21.15.43:0/199833363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e8c153410 0x7f7e8c153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 >> 172.21.15.43:0/199833363 conn(0x7f7e8c0c9d00 msgr2=0x7f7e8c06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 shutdown_connections 2023-08-27T11:23:19.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.544+0000 7f7e90bff700 1 -- 172.21.15.43:0/199833363 wait complete. 2023-08-27T11:23:19.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:19.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.766+0000 7f7b37bff700 1 Processor -- start 2023-08-27T11:23:19.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.766+0000 7f7b37bff700 1 -- start start 2023-08-27T11:23:19.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.767+0000 7f7b37bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b300c7c00 0x7f7b300c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.767+0000 7f7b37bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7b3006a8e0 0x7f7b3006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.767+0000 7f7b37bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b30154660 con 0x7f7b30151d20 2023-08-27T11:23:19.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.767+0000 7f7b37bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300c5750 con 0x7f7b3006a8e0 2023-08-27T11:23:19.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.767+0000 7f7b37bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30154940 con 0x7f7b300c7c00 2023-08-27T11:23:19.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3599b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7b30151d20 0x7f7b300ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60836/0 (socket says 172.21.15.43:60836) 2023-08-27T11:23:19.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3599b700 1 -- 172.21.15.43:0/4189856651 learned_addr learned my addr 172.21.15.43:0/4189856651 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:19.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3619c700 1 --2- 172.21.15.43:0/4189856651 >> v2:172.21.15.57:3300/0 conn(0x7f7b3006a8e0 0x7f7b3006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3519a700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b300c7c00 0x7f7b300c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b34999700 1 -- 172.21.15.43:0/4189856651 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401275437 0 0) 0x7f7b30154660 con 0x7f7b30151d20 2023-08-27T11:23:19.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b34999700 1 -- 172.21.15.43:0/4189856651 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b1c0035b0 con 0x7f7b30151d20 2023-08-27T11:23:19.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3619c700 1 -- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b300c7c00 msgr2=0x7f7b300c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:19.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3619c700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b300c7c00 0x7f7b300c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3619c700 1 -- 172.21.15.43:0/4189856651 >> v1:172.21.15.43:6789/0 conn(0x7f7b30151d20 legacy=0x7f7b300ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.768+0000 7f7b3619c700 1 -- 172.21.15.43:0/4189856651 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b30154c20 con 0x7f7b3006a8e0 2023-08-27T11:23:19.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b3619c700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b3006ad50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009d90 tx=0x7f7b2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cf178366e892ba server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b34999700 1 -- 172.21.15.43:0/4189856651 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800e070 con 0x7f7b3006a8e0 2023-08-27T11:23:19.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b34999700 1 -- 172.21.15.43:0/4189856651 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800bb20 con 0x7f7b3006a8e0 2023-08-27T11:23:19.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b34999700 1 -- 172.21.15.43:0/4189856651 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b28012430 con 0x7f7b3006a8e0 2023-08-27T11:23:19.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b37bff700 1 -- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 msgr2=0x7f7b3006ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.769+0000 7f7b37bff700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b3006ad50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b28009d90 tx=0x7f7b2800b330 comp rx=0 tx=0).stop 2023-08-27T11:23:19.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 -- 172.21.15.43:0/4189856651 shutdown_connections 2023-08-27T11:23:19.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b3006ad50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 --2- 172.21.15.43:0/4189856651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b300c7c00 0x7f7b300c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 -- 172.21.15.43:0/4189856651 >> 172.21.15.43:0/4189856651 conn(0x7f7b300c9d00 msgr2=0x7f7b300ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:19.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 -- 172.21.15.43:0/4189856651 shutdown_connections 2023-08-27T11:23:19.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.770+0000 7f7b37bff700 1 -- 172.21.15.43:0/4189856651 wait complete. 2023-08-27T11:23:19.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.771+0000 7f7b37bff700 1 Processor -- start 2023-08-27T11:23:19.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.771+0000 7f7b37bff700 1 -- start start 2023-08-27T11:23:19.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b300c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b30151d20 0x7f7b3014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b30150e60 con 0x7f7b300c7c00 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300c1d70 con 0x7f7b3006a8e0 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.772+0000 7f7b37bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b301ea400 con 0x7f7b30151d20 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41676/0 (socket says 172.21.15.43:41676) 2023-08-27T11:23:19.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 -- 172.21.15.43:0/3045559898 learned_addr learned my addr 172.21.15.43:0/3045559898 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:19.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3599b700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b300c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3619c700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b30151d20 0x7f7b3014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 -- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b30151d20 msgr2=0x7f7b3014b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b30151d20 0x7f7b3014b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 -- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 msgr2=0x7f7b300c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b300c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 -- 172.21.15.43:0/3045559898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b28009a70 con 0x7f7b300c7c00 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.773+0000 7f7b3519a700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9b0 tx=0x7f7b2000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.774+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20009710 con 0x7f7b300c7c00 2023-08-27T11:23:19.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.774+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000c850 con 0x7f7b300c7c00 2023-08-27T11:23:19.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.774+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000cbc0 con 0x7f7b300c7c00 2023-08-27T11:23:19.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.774+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b301ea6e0 con 0x7f7b300c7c00 2023-08-27T11:23:19.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.774+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b300c3ae0 con 0x7f7b300c7c00 2023-08-27T11:23:19.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.775+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3004ee70 con 0x7f7b300c7c00 2023-08-27T11:23:19.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.776+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b2000cd20 con 0x7f7b300c7c00 2023-08-27T11:23:19.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.777+0000 7f7b267fc700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 0x7f7b1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:19.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.777+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b200886f0 con 0x7f7b300c7c00 2023-08-27T11:23:19.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.777+0000 7f7b3599b700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 0x7f7b1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:19.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.778+0000 7f7b3599b700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 0x7f7b1406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0011e0 tx=0x7f7b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:19.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.781+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7b20057860 con 0x7f7b300c7c00 2023-08-27T11:23:19.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.990+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b300ac650 con 0x7f7b300c7c00 2023-08-27T11:23:19.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.991+0000 7f7b267fc700 1 -- 172.21.15.43:0/3045559898 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b200573f0 con 0x7f7b300c7c00 2023-08-27T11:23:19.992 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:19.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 msgr2=0x7f7b1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 0x7f7b1406c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0011e0 tx=0x7f7b2c009040 comp rx=0 tx=0).stop 2023-08-27T11:23:19.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 msgr2=0x7f7b3014aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:19.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9b0 tx=0x7f7b2000ed70 comp rx=0 tx=0).stop 2023-08-27T11:23:19.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 shutdown_connections 2023-08-27T11:23:19.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7b1406a0e0 0x7f7b1406c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7b30151d20 0x7f7b3014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7b3006a8e0 0x7f7b300c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 --2- 172.21.15.43:0/3045559898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7b300c7c00 0x7f7b3014aad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:19.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 >> 172.21.15.43:0/3045559898 conn(0x7f7b300c9d00 msgr2=0x7f7b3014e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:19.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 shutdown_connections 2023-08-27T11:23:19.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:19.993+0000 7f7b37bff700 1 -- 172.21.15.43:0/3045559898 wait complete. 2023-08-27T11:23:20.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:20.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.215+0000 7f67679ff700 1 Processor -- start 2023-08-27T11:23:20.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.215+0000 7f67679ff700 1 -- start start 2023-08-27T11:23:20.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.216+0000 7f67679ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 0x7f67600c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.216+0000 7f67679ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f67679ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6760154660 con 0x7f6760151d20 2023-08-27T11:23:20.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f67679ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67600c5750 con 0x7f676006a8e0 2023-08-27T11:23:20.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f67679ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760154940 con 0x7f67600c7c00 2023-08-27T11:23:20.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f6765f9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f6765f9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:46402/0 (socket says 172.21.15.43:46402) 2023-08-27T11:23:20.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f6764f9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 0x7f67600c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f6765f9c700 1 -- 172.21.15.43:0/1916893840 learned_addr learned my addr 172.21.15.43:0/1916893840 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:20.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.217+0000 7f676579b700 1 --1- 172.21.15.43:0/1916893840 >> v1:172.21.15.57:6789/0 conn(0x7f6760151d20 0x7f67600ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:41378/0 (socket says 172.21.15.43:41378) 2023-08-27T11:23:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6764f9a700 1 -- 172.21.15.43:0/1916893840 >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 msgr2=0x7f676006ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6764f9a700 1 --2- 172.21.15.43:0/1916893840 >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6764f9a700 1 -- 172.21.15.43:0/1916893840 >> v1:172.21.15.57:6789/0 conn(0x7f6760151d20 legacy=0x7f67600ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6764f9a700 1 -- 172.21.15.43:0/1916893840 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760154c20 con 0x7f67600c7c00 2023-08-27T11:23:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6765f9c700 1 --2- 172.21.15.43:0/1916893840 >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6764f9a700 1 --2- 172.21.15.43:0/1916893840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 0x7f67600c8110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6750009840 tx=0x7f6750009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36c4a6c4766d4b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6757fff700 1 -- 172.21.15.43:0/1916893840 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750011830 con 0x7f67600c7c00 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6757fff700 1 -- 172.21.15.43:0/1916893840 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6750011990 con 0x7f67600c7c00 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.218+0000 7f6757fff700 1 -- 172.21.15.43:0/1916893840 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750011d20 con 0x7f67600c7c00 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 -- 172.21.15.43:0/1916893840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 msgr2=0x7f67600c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 --2- 172.21.15.43:0/1916893840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 0x7f67600c8110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6750009840 tx=0x7f6750009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:20.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 -- 172.21.15.43:0/1916893840 shutdown_connections 2023-08-27T11:23:20.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 --2- 172.21.15.43:0/1916893840 >> v2:172.21.15.57:3300/0 conn(0x7f676006a8e0 0x7f676006ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 --2- 172.21.15.43:0/1916893840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67600c7c00 0x7f67600c8110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 -- 172.21.15.43:0/1916893840 >> 172.21.15.43:0/1916893840 conn(0x7f67600c9d00 msgr2=0x7f67600ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:20.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 -- 172.21.15.43:0/1916893840 shutdown_connections 2023-08-27T11:23:20.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.219+0000 7f67679ff700 1 -- 172.21.15.43:0/1916893840 wait complete. 2023-08-27T11:23:20.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.221+0000 7f67679ff700 1 Processor -- start 2023-08-27T11:23:20.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.221+0000 7f67679ff700 1 -- start start 2023-08-27T11:23:20.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67600c7c00 0x7f676014c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6760151d20 0x7f676014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6760158ae0 con 0x7f676006a8e0 2023-08-27T11:23:20.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600c3640 con 0x7f67600c7c00 2023-08-27T11:23:20.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f67679ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676014c270 con 0x7f6760151d20 2023-08-27T11:23:20.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41688/0 (socket says 172.21.15.43:41688) 2023-08-27T11:23:20.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 -- 172.21.15.43:0/591021714 learned_addr learned my addr 172.21.15.43:0/591021714 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:20.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f6765f9c700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6760151d20 0x7f676014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f6764f9a700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67600c7c00 0x7f676014c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 -- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6760151d20 msgr2=0x7f676014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6760151d20 0x7f676014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 -- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67600c7c00 msgr2=0x7f676014c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67600c7c00 0x7f676014c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.222+0000 7f676579b700 1 -- 172.21.15.43:0/591021714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6758009b30 con 0x7f676006a8e0 2023-08-27T11:23:20.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f676579b700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c530 tx=0x7f675c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00cea0 con 0x7f676006a8e0 2023-08-27T11:23:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67500094a0 con 0x7f676006a8e0 2023-08-27T11:23:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c005cb0 con 0x7f676006a8e0 2023-08-27T11:23:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c0072d0 con 0x7f676006a8e0 2023-08-27T11:23:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.223+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67601ea480 con 0x7f676006a8e0 2023-08-27T11:23:20.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.224+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676004ee70 con 0x7f676006a8e0 2023-08-27T11:23:20.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.225+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f675c007430 con 0x7f676006a8e0 2023-08-27T11:23:20.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.226+0000 7f6755ffb700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.226+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f675c087790 con 0x7f676006a8e0 2023-08-27T11:23:20.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.226+0000 7f6764f9a700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.227+0000 7f6764f9a700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 0x7f674406c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6750000c00 tx=0x7f6750008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.230+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f675c052ea0 con 0x7f676006a8e0 2023-08-27T11:23:20.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.442+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67601514a0 con 0x7f676006a8e0 2023-08-27T11:23:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.442+0000 7f6755ffb700 1 -- 172.21.15.43:0/591021714 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f675c0564c0 con 0x7f676006a8e0 2023-08-27T11:23:20.444 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:20.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 msgr2=0x7f674406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 0x7f674406c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6750000c00 tx=0x7f6750008030 comp rx=0 tx=0).stop 2023-08-27T11:23:20.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 msgr2=0x7f67600aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f675c00c530 tx=0x7f675c00c840 comp rx=0 tx=0).stop 2023-08-27T11:23:20.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 shutdown_connections 2023-08-27T11:23:20.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f674406a0e0 0x7f674406c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6760151d20 0x7f676014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f676006a8e0 0x7f67600aa920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 --2- 172.21.15.43:0/591021714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67600c7c00 0x7f676014c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 >> 172.21.15.43:0/591021714 conn(0x7f67600c9d00 msgr2=0x7f676014fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:20.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 shutdown_connections 2023-08-27T11:23:20.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.445+0000 7f67679ff700 1 -- 172.21.15.43:0/591021714 wait complete. 2023-08-27T11:23:20.522 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. 2023-08-27T11:23:20.523 INFO:tasks.cephfs_test_runner:test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:23:20.524 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-08-27T11:23:20.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.725+0000 7f0b47dff700 1 Processor -- start 2023-08-27T11:23:20.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.726+0000 7f0b47dff700 1 -- start start 2023-08-27T11:23:20.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b47dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 0x7f0b400c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b47dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b400c4600 0x7f0b400c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b47dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b401546f0 con 0x7f0b4006b320 2023-08-27T11:23:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b47dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b400c4bb0 con 0x7f0b400c4600 2023-08-27T11:23:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b47dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400c4e90 con 0x7f0b4006c690 2023-08-27T11:23:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b45b9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0b4006b320 0x7f0b4014dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60840/0 (socket says 172.21.15.43:60840) 2023-08-27T11:23:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b45b9b700 1 -- 172.21.15.43:0/2119112268 learned_addr learned my addr 172.21.15.43:0/2119112268 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b4639c700 1 --2- 172.21.15.43:0/2119112268 >> v2:172.21.15.43:3300/0 conn(0x7f0b400c4600 0x7f0b400c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.727+0000 7f0b4539a700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 0x7f0b400c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4639c700 1 -- 172.21.15.43:0/2119112268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 msgr2=0x7f0b400c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4639c700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 0x7f0b400c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4639c700 1 -- 172.21.15.43:0/2119112268 >> v1:172.21.15.43:6789/0 conn(0x7f0b4006b320 legacy=0x7f0b4014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4639c700 1 -- 172.21.15.43:0/2119112268 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b400c5170 con 0x7f0b400c4600 2023-08-27T11:23:20.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b44b99700 1 -- 172.21.15.43:0/2119112268 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790380915 0 0) 0x7f0b401546f0 con 0x7f0b4006b320 2023-08-27T11:23:20.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4539a700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 0x7f0b400c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:20.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b4639c700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b400c4600 0x7f0b400c5eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009d90 tx=0x7f0b3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61597652eb97bce server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b44b99700 1 -- 172.21.15.43:0/2119112268 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800e070 con 0x7f0b400c4600 2023-08-27T11:23:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b44b99700 1 -- 172.21.15.43:0/2119112268 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800bbd0 con 0x7f0b400c4600 2023-08-27T11:23:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.728+0000 7f0b44b99700 1 -- 172.21.15.43:0/2119112268 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38012430 con 0x7f0b400c4600 2023-08-27T11:23:20.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 -- 172.21.15.43:0/2119112268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b400c4600 msgr2=0x7f0b400c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b400c4600 0x7f0b400c5eb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009d90 tx=0x7f0b3800b330 comp rx=0 tx=0).stop 2023-08-27T11:23:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 -- 172.21.15.43:0/2119112268 shutdown_connections 2023-08-27T11:23:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b400c4600 0x7f0b400c5eb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 --2- 172.21.15.43:0/2119112268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006c690 0x7f0b400c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 -- 172.21.15.43:0/2119112268 >> 172.21.15.43:0/2119112268 conn(0x7f0b400c9c80 msgr2=0x7f0b400ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 -- 172.21.15.43:0/2119112268 shutdown_connections 2023-08-27T11:23:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.729+0000 7f0b47dff700 1 -- 172.21.15.43:0/2119112268 wait complete. 2023-08-27T11:23:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.730+0000 7f0b47dff700 1 Processor -- start 2023-08-27T11:23:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.731+0000 7f0b47dff700 1 -- start start 2023-08-27T11:23:20.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.731+0000 7f0b47dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006b320 0x7f0b40158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b47dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b47dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b400c4600 0x7f0b400c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b47dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40157240 con 0x7f0b4006c690 2023-08-27T11:23:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b47dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b400c2a70 con 0x7f0b400c4600 2023-08-27T11:23:20.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b47dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b401576d0 con 0x7f0b4006b320 2023-08-27T11:23:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41712/0 (socket says 172.21.15.43:41712) 2023-08-27T11:23:20.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 -- 172.21.15.43:0/3689224563 learned_addr learned my addr 172.21.15.43:0/3689224563 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:20.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b45b9b700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006b320 0x7f0b40158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4639c700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b400c4600 0x7f0b400c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 -- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006b320 msgr2=0x7f0b40158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006b320 0x7f0b40158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 -- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b400c4600 msgr2=0x7f0b400c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b400c4600 0x7f0b400c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 -- 172.21.15.43:0/3689224563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009a70 con 0x7f0b4006c690 2023-08-27T11:23:20.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.732+0000 7f0b4539a700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000e810 tx=0x7f0b3000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.733+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000c070 con 0x7f0b4006c690 2023-08-27T11:23:20.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.733+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30013610 con 0x7f0b4006c690 2023-08-27T11:23:20.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.733+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300139c0 con 0x7f0b4006c690 2023-08-27T11:23:20.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.733+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b40156630 con 0x7f0b4006c690 2023-08-27T11:23:20.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.733+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b40156bf0 con 0x7f0b4006c690 2023-08-27T11:23:20.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.734+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b401573b0 con 0x7f0b4006c690 2023-08-27T11:23:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.735+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b30013b20 con 0x7f0b4006c690 2023-08-27T11:23:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.736+0000 7f0b367fc700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 0x7f0b2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.736+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b300882e0 con 0x7f0b4006c690 2023-08-27T11:23:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.736+0000 7f0b45b9b700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 0x7f0b2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:20.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.737+0000 7f0b45b9b700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 0x7f0b2406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c007fd0 tx=0x7f0b3c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:20.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:20.740+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b300573d0 con 0x7f0b4006c690 2023-08-27T11:23:21.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.036+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7f0b4004ee70 con 0x7f0b4006c690 2023-08-27T11:23:21.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.103+0000 7f0b367fc700 1 -- 172.21.15.43:0/3689224563 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v51) v1 ==== 146+0+0 (secure 0 0 0) 0x7f0b30056f60 con 0x7f0b4006c690 2023-08-27T11:23:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 msgr2=0x7f0b2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 0x7f0b2406c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c007fd0 tx=0x7f0b3c007de0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 msgr2=0x7f0b400c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000e810 tx=0x7f0b3000eb20 comp rx=0 tx=0).stop 2023-08-27T11:23:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 shutdown_connections 2023-08-27T11:23:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b2406a0e0 0x7f0b2406c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b400c4600 0x7f0b400c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b4006b320 0x7f0b40158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 --2- 172.21.15.43:0/3689224563 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b4006c690 0x7f0b400c2e90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 >> 172.21.15.43:0/3689224563 conn(0x7f0b400c9c80 msgr2=0x7f0b400aafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 shutdown_connections 2023-08-27T11:23:21.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.106+0000 7f0b47dff700 1 -- 172.21.15.43:0/3689224563 wait complete. 2023-08-27T11:23:21.126 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:21.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.326+0000 7f3e789fe700 1 Processor -- start 2023-08-27T11:23:21.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.327+0000 7f3e789fe700 1 -- start start 2023-08-27T11:23:21.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e789fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e74158460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e789fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e74154e50 0x7f3e740c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e789fe700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e741552d0 con 0x7f3e740c7a50 2023-08-27T11:23:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e789fe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740c6aa0 con 0x7f3e74154e50 2023-08-27T11:23:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e789fe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740c6c90 con 0x7f3e74151850 2023-08-27T11:23:21.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e7359e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3e740c7a50 0x7f3e740c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60852/0 (socket says 172.21.15.43:60852) 2023-08-27T11:23:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e7359e700 1 -- 172.21.15.43:0/712651345 learned_addr learned my addr 172.21.15.43:0/712651345 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e7259c700 1 --2- 172.21.15.43:0/712651345 >> v2:172.21.15.57:3300/0 conn(0x7f3e74154e50 0x7f3e740c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.328+0000 7f3e72d9d700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e74158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e71d9b700 1 -- 172.21.15.43:0/712651345 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431944707 0 0) 0x7f3e741552d0 con 0x7f3e740c7a50 2023-08-27T11:23:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e71d9b700 1 -- 172.21.15.43:0/712651345 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e5c0035b0 con 0x7f3e740c7a50 2023-08-27T11:23:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e7259c700 1 -- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 msgr2=0x7f3e74158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e7259c700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e74158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e7259c700 1 -- 172.21.15.43:0/712651345 >> v1:172.21.15.43:6789/0 conn(0x7f3e740c7a50 legacy=0x7f3e740c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e7259c700 1 -- 172.21.15.43:0/712651345 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740c6f70 con 0x7f3e74154e50 2023-08-27T11:23:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e72d9d700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e74158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e7259c700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e74154e50 0x7f3e740c6560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009840 tx=0x7f3e68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5aafb9ba2368ea server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.329+0000 7f3e71d9b700 1 -- 172.21.15.43:0/712651345 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011830 con 0x7f3e74154e50 2023-08-27T11:23:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e71d9b700 1 -- 172.21.15.43:0/712651345 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68011990 con 0x7f3e74154e50 2023-08-27T11:23:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e71d9b700 1 -- 172.21.15.43:0/712651345 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011d00 con 0x7f3e74154e50 2023-08-27T11:23:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 -- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e74154e50 msgr2=0x7f3e740c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e74154e50 0x7f3e740c6560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009840 tx=0x7f3e68009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 -- 172.21.15.43:0/712651345 shutdown_connections 2023-08-27T11:23:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e74158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 --2- 172.21.15.43:0/712651345 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e74154e50 0x7f3e740c6560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 -- 172.21.15.43:0/712651345 >> 172.21.15.43:0/712651345 conn(0x7f3e740ab660 msgr2=0x7f3e740aba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 -- 172.21.15.43:0/712651345 shutdown_connections 2023-08-27T11:23:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.330+0000 7f3e789fe700 1 -- 172.21.15.43:0/712651345 wait complete. 2023-08-27T11:23:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.332+0000 7f3e789fe700 1 Processor -- start 2023-08-27T11:23:21.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.332+0000 7f3e789fe700 1 -- start start 2023-08-27T11:23:21.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e740c7a50 0x7f3e741e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e741567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74154350 con 0x7f3e74154e50 2023-08-27T11:23:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74154630 con 0x7f3e740c7a50 2023-08-27T11:23:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e789fe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741e94e0 con 0x7f3e74151850 2023-08-27T11:23:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e7359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e7359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41720/0 (socket says 172.21.15.43:41720) 2023-08-27T11:23:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e7359e700 1 -- 172.21.15.43:0/3426085891 learned_addr learned my addr 172.21.15.43:0/3426085891 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e72d9d700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e740c7a50 0x7f3e741e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.333+0000 7f3e7259c700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e741567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 -- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 msgr2=0x7f3e741567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e741567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 -- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e740c7a50 msgr2=0x7f3e741e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e740c7a50 0x7f3e741e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 -- 172.21.15.43:0/3426085891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640094a0 con 0x7f3e74154e50 2023-08-27T11:23:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e7359e700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00caa0 tx=0x7f3e6c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00a9e0 con 0x7f3e74154e50 2023-08-27T11:23:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e680094a0 con 0x7f3e74154e50 2023-08-27T11:23:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.334+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e741e9aa0 con 0x7f3e74154e50 2023-08-27T11:23:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.335+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c001b80 con 0x7f3e74154e50 2023-08-27T11:23:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.335+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00ad40 con 0x7f3e74154e50 2023-08-27T11:23:21.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.336+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e540052f0 con 0x7f3e74154e50 2023-08-27T11:23:21.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.337+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e6c01c440 con 0x7f3e74154e50 2023-08-27T11:23:21.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.337+0000 7f3e5b7fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 0x7f3e6006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.338+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e6c0880a0 con 0x7f3e74154e50 2023-08-27T11:23:21.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.338+0000 7f3e72d9d700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 0x7f3e6006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.338+0000 7f3e72d9d700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 0x7f3e6006c5d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e74158970 tx=0x7f3e64009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.342+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3e6c053800 con 0x7f3e74154e50 2023-08-27T11:23:21.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.552+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e540055a0 con 0x7f3e74154e50 2023-08-27T11:23:21.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.553+0000 7f3e5b7fe700 1 -- 172.21.15.43:0/3426085891 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f3e6c056e20 con 0x7f3e74154e50 2023-08-27T11:23:21.555 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:21.555 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:21.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 msgr2=0x7f3e6006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 0x7f3e6006c5d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3e74158970 tx=0x7f3e64009210 comp rx=0 tx=0).stop 2023-08-27T11:23:21.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 msgr2=0x7f3e740a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00caa0 tx=0x7f3e6c00cdb0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 shutdown_connections 2023-08-27T11:23:21.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e6006a110 0x7f3e6006c5d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e74154e50 0x7f3e740a9670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e740c7a50 0x7f3e741e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 --2- 172.21.15.43:0/3426085891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e74151850 0x7f3e741567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 >> 172.21.15.43:0/3426085891 conn(0x7f3e740ab660 msgr2=0x7f3e7414b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 shutdown_connections 2023-08-27T11:23:21.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.556+0000 7f3e789fe700 1 -- 172.21.15.43:0/3426085891 wait complete. 2023-08-27T11:23:21.576 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:21.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.779+0000 7f5ae93ff700 1 Processor -- start 2023-08-27T11:23:21.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.779+0000 7f5ae93ff700 1 -- start start 2023-08-27T11:23:21.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae93ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ae406c5e0 0x7f5ae406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae93ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ae4155880 0x7f5ae4155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae93ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae41561a0 con 0x7f5ae40c5230 2023-08-27T11:23:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae93ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae4152290 con 0x7f5ae406c5e0 2023-08-27T11:23:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae93ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae406d7a0 con 0x7f5ae4155880 2023-08-27T11:23:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ae406c5e0 0x7f5ae406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae2ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5ae40c5230 0x7f5ae40aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60868/0 (socket says 172.21.15.43:60868) 2023-08-27T11:23:21.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.780+0000 7f5ae2ffd700 1 -- 172.21.15.43:0/2235106226 learned_addr learned my addr 172.21.15.43:0/2235106226 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae37fe700 1 --2- 172.21.15.43:0/2235106226 >> v2:172.21.15.57:3300/0 conn(0x7f5ae4155880 0x7f5ae4155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae27fc700 1 -- 172.21.15.43:0/2235106226 >> v2:172.21.15.57:3300/0 conn(0x7f5ae4155880 msgr2=0x7f5ae4155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/2235106226 >> v2:172.21.15.57:3300/0 conn(0x7f5ae4155880 0x7f5ae4155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae1ffb700 1 -- 172.21.15.43:0/2235106226 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191982006 0 0) 0x7f5ae41561a0 con 0x7f5ae40c5230 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae27fc700 1 -- 172.21.15.43:0/2235106226 >> v1:172.21.15.43:6789/0 conn(0x7f5ae40c5230 legacy=0x7f5ae40aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae27fc700 1 -- 172.21.15.43:0/2235106226 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4152550 con 0x7f5ae406c5e0 2023-08-27T11:23:21.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/2235106226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae406d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40ab970 tx=0x7f5ad8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e173bc4f727a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.781+0000 7f5ae1ffb700 1 -- 172.21.15.43:0/2235106226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8011830 con 0x7f5ae406c5e0 2023-08-27T11:23:21.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae1ffb700 1 -- 172.21.15.43:0/2235106226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad8011990 con 0x7f5ae406c5e0 2023-08-27T11:23:21.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae1ffb700 1 -- 172.21.15.43:0/2235106226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8011d20 con 0x7f5ae406c5e0 2023-08-27T11:23:21.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 -- 172.21.15.43:0/2235106226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 msgr2=0x7f5ae406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/2235106226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae406d1c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40ab970 tx=0x7f5ad8009b20 comp rx=0 tx=0).stop 2023-08-27T11:23:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 -- 172.21.15.43:0/2235106226 shutdown_connections 2023-08-27T11:23:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/2235106226 >> v2:172.21.15.57:3300/0 conn(0x7f5ae4155880 0x7f5ae4155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/2235106226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae406d1c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 -- 172.21.15.43:0/2235106226 >> 172.21.15.43:0/2235106226 conn(0x7f5ae40c5b10 msgr2=0x7f5ae40c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:21.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 -- 172.21.15.43:0/2235106226 shutdown_connections 2023-08-27T11:23:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.782+0000 7f5ae93ff700 1 -- 172.21.15.43:0/2235106226 wait complete. 2023-08-27T11:23:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.784+0000 7f5ae93ff700 1 Processor -- start 2023-08-27T11:23:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.784+0000 7f5ae93ff700 1 -- start start 2023-08-27T11:23:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 0x7f5ae40721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae4155880 0x7f5ae40a6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406f6b0 con 0x7f5ae406c5e0 2023-08-27T11:23:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406f950 con 0x7f5ae40c5230 2023-08-27T11:23:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae93ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40713f0 con 0x7f5ae4155880 2023-08-27T11:23:21.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41730/0 (socket says 172.21.15.43:41730) 2023-08-27T11:23:21.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.785+0000 7f5ae2ffd700 1 -- 172.21.15.43:0/1509197652 learned_addr learned my addr 172.21.15.43:0/1509197652 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:21.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 -- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae4155880 msgr2=0x7f5ae40a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae4155880 0x7f5ae40a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 0x7f5ae40721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 -- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 msgr2=0x7f5ae40721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:21.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 0x7f5ae40721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:21.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 -- 172.21.15.43:0/1509197652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80094a0 con 0x7f5ae406c5e0 2023-08-27T11:23:21.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 0x7f5ae40721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:21.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae2ffd700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40011e0 tx=0x7f5ad400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4004c80 con 0x7f5ae406c5e0 2023-08-27T11:23:21.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4004e00 con 0x7f5ae406c5e0 2023-08-27T11:23:21.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4007310 con 0x7f5ae406c5e0 2023-08-27T11:23:21.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae4072700 con 0x7f5ae406c5e0 2023-08-27T11:23:21.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.786+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae4071970 con 0x7f5ae406c5e0 2023-08-27T11:23:21.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.787+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae404ee70 con 0x7f5ae406c5e0 2023-08-27T11:23:21.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.788+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ad4007470 con 0x7f5ae406c5e0 2023-08-27T11:23:21.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.789+0000 7f5acb7fe700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 0x7f5ad006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:21.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.789+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ad4088380 con 0x7f5ae406c5e0 2023-08-27T11:23:21.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.790+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 0x7f5ad006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:21.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.790+0000 7f5ae27fc700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 0x7f5ad006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4151f10 tx=0x7f5ad8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:21.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:21.793+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ad4053a60 con 0x7f5ae406c5e0 2023-08-27T11:23:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.003+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ae406ca80 con 0x7f5ae406c5e0 2023-08-27T11:23:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.003+0000 7f5acb7fe700 1 -- 172.21.15.43:0/1509197652 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ad4057080 con 0x7f5ae406c5e0 2023-08-27T11:23:22.005 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 msgr2=0x7f5ad006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 0x7f5ad006c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4151f10 tx=0x7f5ad8008030 comp rx=0 tx=0).stop 2023-08-27T11:23:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 msgr2=0x7f5ae41ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40011e0 tx=0x7f5ad400cae0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 shutdown_connections 2023-08-27T11:23:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad006a0e0 0x7f5ad006c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae4155880 0x7f5ae40a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ae406c5e0 0x7f5ae41ed5b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 --2- 172.21.15.43:0/1509197652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40c5230 0x7f5ae40721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 >> 172.21.15.43:0/1509197652 conn(0x7f5ae40c5b10 msgr2=0x7f5ae40a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 shutdown_connections 2023-08-27T11:23:22.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.006+0000 7f5ae93ff700 1 -- 172.21.15.43:0/1509197652 wait complete. 2023-08-27T11:23:22.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:22.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.229+0000 7f97595ff700 1 Processor -- start 2023-08-27T11:23:22.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.229+0000 7f97595ff700 1 -- start start 2023-08-27T11:23:22.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97595ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97540c49f0 0x7f9754151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97595ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9754151cd0 0x7f97540c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97595ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540c80c0 con 0x7f97540ac410 2023-08-27T11:23:22.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97595ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97540c9bd0 con 0x7f9754151cd0 2023-08-27T11:23:22.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97595ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97541555a0 con 0x7f97540c49f0 2023-08-27T11:23:22.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97527fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9754151cd0 0x7f97540c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97537fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f97540ac410 0x7f97540c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60884/0 (socket says 172.21.15.43:60884) 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f97537fe700 1 -- 172.21.15.43:0/2243259546 learned_addr learned my addr 172.21.15.43:0/2243259546 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.230+0000 7f9752ffd700 1 --2- 172.21.15.43:0/2243259546 >> v2:172.21.15.57:3300/0 conn(0x7f97540c49f0 0x7f9754151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f97527fc700 1 -- 172.21.15.43:0/2243259546 >> v2:172.21.15.57:3300/0 conn(0x7f97540c49f0 msgr2=0x7f9754151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f97527fc700 1 --2- 172.21.15.43:0/2243259546 >> v2:172.21.15.57:3300/0 conn(0x7f97540c49f0 0x7f9754151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f97527fc700 1 -- 172.21.15.43:0/2243259546 >> v1:172.21.15.43:6789/0 conn(0x7f97540ac410 legacy=0x7f97540c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f9751ffb700 1 -- 172.21.15.43:0/2243259546 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142707036 0 0) 0x7f97540c80c0 con 0x7f97540ac410 2023-08-27T11:23:22.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f97527fc700 1 -- 172.21.15.43:0/2243259546 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97541552c0 con 0x7f9754151cd0 2023-08-27T11:23:22.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f97527fc700 1 --2- 172.21.15.43:0/2243259546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9754151cd0 0x7f97540c8f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9754072a90 tx=0x7f9748009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde4dc1300c82677 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f9751ffb700 1 -- 172.21.15.43:0/2243259546 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748011830 con 0x7f9754151cd0 2023-08-27T11:23:22.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f9751ffb700 1 -- 172.21.15.43:0/2243259546 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748011990 con 0x7f9754151cd0 2023-08-27T11:23:22.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.231+0000 7f9751ffb700 1 -- 172.21.15.43:0/2243259546 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748011d20 con 0x7f9754151cd0 2023-08-27T11:23:22.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 -- 172.21.15.43:0/2243259546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9754151cd0 msgr2=0x7f97540c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 --2- 172.21.15.43:0/2243259546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9754151cd0 0x7f97540c8f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9754072a90 tx=0x7f9748009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:22.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 -- 172.21.15.43:0/2243259546 shutdown_connections 2023-08-27T11:23:22.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 --2- 172.21.15.43:0/2243259546 >> v2:172.21.15.57:3300/0 conn(0x7f97540c49f0 0x7f9754151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 --2- 172.21.15.43:0/2243259546 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9754151cd0 0x7f97540c8f80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 -- 172.21.15.43:0/2243259546 >> 172.21.15.43:0/2243259546 conn(0x7f97540ab8f0 msgr2=0x7f97540abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:22.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 -- 172.21.15.43:0/2243259546 shutdown_connections 2023-08-27T11:23:22.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.232+0000 7f97595ff700 1 -- 172.21.15.43:0/2243259546 wait complete. 2023-08-27T11:23:22.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.234+0000 7f97595ff700 1 Processor -- start 2023-08-27T11:23:22.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.235+0000 7f97595ff700 1 -- start start 2023-08-27T11:23:22.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97540ac410 0x7f97540ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9754151cd0 0x7f97541ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97541edb70 con 0x7f97540c49f0 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540c3830 con 0x7f9754151cd0 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97595ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97540afd40 con 0x7f97540ac410 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41748/0 (socket says 172.21.15.43:41748) 2023-08-27T11:23:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 -- 172.21.15.43:0/3245284416 learned_addr learned my addr 172.21.15.43:0/3245284416 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f9752ffd700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97540ac410 0x7f97540ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97537fe700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9754151cd0 0x7f97541ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 -- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97540ac410 msgr2=0x7f97540ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97540ac410 0x7f97540ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 -- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9754151cd0 msgr2=0x7f97541ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9754151cd0 0x7f97541ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.236+0000 7f97527fc700 1 -- 172.21.15.43:0/3245284416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480094a0 con 0x7f97540c49f0 2023-08-27T11:23:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f97527fc700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97480090b0 tx=0x7f9748004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974801a880 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974801a9e0 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97540af5d0 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974801ad70 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.237+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97540af8b0 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.238+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97540afa40 con 0x7f97540c49f0 2023-08-27T11:23:22.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.239+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f974802a360 con 0x7f97540c49f0 2023-08-27T11:23:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.240+0000 7f973b7fe700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 0x7f974006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.240+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9748089130 con 0x7f97540c49f0 2023-08-27T11:23:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.240+0000 7f9752ffd700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 0x7f974006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.241+0000 7f9752ffd700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 0x7f974006c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9754157430 tx=0x7f9744009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.244+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9748054810 con 0x7f97540c49f0 2023-08-27T11:23:22.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.455+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9754151220 con 0x7f97540c49f0 2023-08-27T11:23:22.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.455+0000 7f973b7fe700 1 -- 172.21.15.43:0/3245284416 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9748057e30 con 0x7f97540c49f0 2023-08-27T11:23:22.457 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:22.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 msgr2=0x7f974006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 0x7f974006c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9754157430 tx=0x7f9744009210 comp rx=0 tx=0).stop 2023-08-27T11:23:22.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 msgr2=0x7f97541ece30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f97480090b0 tx=0x7f9748004750 comp rx=0 tx=0).stop 2023-08-27T11:23:22.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 shutdown_connections 2023-08-27T11:23:22.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f974006a0e0 0x7f974006c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9754151cd0 0x7f97541ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97540ac410 0x7f97540ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 --2- 172.21.15.43:0/3245284416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97540c49f0 0x7f97541ece30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 >> 172.21.15.43:0/3245284416 conn(0x7f97540ab8f0 msgr2=0x7f97540aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:22.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 shutdown_connections 2023-08-27T11:23:22.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.458+0000 7f97595ff700 1 -- 172.21.15.43:0/3245284416 wait complete. 2023-08-27T11:23:22.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:22.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.680+0000 7f81eedff700 1 Processor -- start 2023-08-27T11:23:22.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.680+0000 7f81eedff700 1 -- start start 2023-08-27T11:23:22.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81eedff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 0x7f81e80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81eedff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e8154660 con 0x7f81e806a8e0 2023-08-27T11:23:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81eedff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e8154940 con 0x7f81e8151d20 2023-08-27T11:23:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81eedff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80c5750 con 0x7f81e80c7c00 2023-08-27T11:23:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81ed39c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f81e806a8e0 0x7f81e806ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60892/0 (socket says 172.21.15.43:60892) 2023-08-27T11:23:22.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81ed39c700 1 -- 172.21.15.43:0/832028663 learned_addr learned my addr 172.21.15.43:0/832028663 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:22.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.681+0000 7f81e7fff700 1 --2- 172.21.15.43:0/832028663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 0x7f81e80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288772531 0 0) 0x7f81e8154660 con 0x7f81e806a8e0 2023-08-27T11:23:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d80035b0 con 0x7f81e806a8e0 2023-08-27T11:23:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260429524 0 0) 0x7f81e8154940 con 0x7f81e8151d20 2023-08-27T11:23:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e8154660 con 0x7f81e8151d20 2023-08-27T11:23:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e7fff700 1 -- 172.21.15.43:0/832028663 >> v1:172.21.15.57:6789/0 conn(0x7f81e8151d20 legacy=0x7f81e80ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e7fff700 1 -- 172.21.15.43:0/832028663 >> v1:172.21.15.43:6789/0 conn(0x7f81e806a8e0 legacy=0x7f81e806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e7fff700 1 -- 172.21.15.43:0/832028663 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8154c20 con 0x7f81e80c7c00 2023-08-27T11:23:22.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.682+0000 7f81e7fff700 1 --2- 172.21.15.43:0/832028663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 0x7f81e80c8110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009870 tx=0x7f81d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f2da422be643e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4011830 con 0x7f81e80c7c00 2023-08-27T11:23:22.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4011990 con 0x7f81e80c7c00 2023-08-27T11:23:22.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81e77fe700 1 -- 172.21.15.43:0/832028663 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4011d20 con 0x7f81e80c7c00 2023-08-27T11:23:22.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 -- 172.21.15.43:0/832028663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 msgr2=0x7f81e80c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 --2- 172.21.15.43:0/832028663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 0x7f81e80c8110 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009870 tx=0x7f81d4009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:22.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 -- 172.21.15.43:0/832028663 shutdown_connections 2023-08-27T11:23:22.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 --2- 172.21.15.43:0/832028663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e80c7c00 0x7f81e80c8110 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 -- 172.21.15.43:0/832028663 >> 172.21.15.43:0/832028663 conn(0x7f81e80c9d00 msgr2=0x7f81e80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:22.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 -- 172.21.15.43:0/832028663 shutdown_connections 2023-08-27T11:23:22.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.683+0000 7f81eedff700 1 -- 172.21.15.43:0/832028663 wait complete. 2023-08-27T11:23:22.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.686+0000 7f81eedff700 1 Processor -- start 2023-08-27T11:23:22.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.686+0000 7f81eedff700 1 -- start start 2023-08-27T11:23:22.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e80c7c00 0x7f81e8152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e8151d20 0x7f81e81e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81e9a70 con 0x7f81e806a8e0 2023-08-27T11:23:22.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81ed460 con 0x7f81e80c7c00 2023-08-27T11:23:22.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81eedff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8153150 con 0x7f81e8151d20 2023-08-27T11:23:22.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81ecb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81ecb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41756/0 (socket says 172.21.15.43:41756) 2023-08-27T11:23:22.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.687+0000 7f81ecb9b700 1 -- 172.21.15.43:0/3157675166 learned_addr learned my addr 172.21.15.43:0/3157675166 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:22.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ed39c700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e8151d20 0x7f81e81e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81e7fff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e80c7c00 0x7f81e8152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 -- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e8151d20 msgr2=0x7f81e81e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e8151d20 0x7f81e81e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 -- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e80c7c00 msgr2=0x7f81e8152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e80c7c00 0x7f81e8152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 -- 172.21.15.43:0/3157675166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40094a0 con 0x7f81e806a8e0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81ecb9b700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c500 tx=0x7f81dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0052d0 con 0x7f81e806a8e0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc005450 con 0x7f81e806a8e0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0038c0 con 0x7f81e806a8e0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e81e9440 con 0x7f81e806a8e0 2023-08-27T11:23:22.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.688+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e81e9700 con 0x7f81e806a8e0 2023-08-27T11:23:22.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.689+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e81e9890 con 0x7f81e806a8e0 2023-08-27T11:23:22.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.690+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81dc003a20 con 0x7f81e806a8e0 2023-08-27T11:23:22.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.692+0000 7f81e57fa700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 0x7f81cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:22.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.692+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81dc087990 con 0x7f81e806a8e0 2023-08-27T11:23:22.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.692+0000 7f81e7fff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 0x7f81cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:22.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.692+0000 7f81e7fff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 0x7f81cc06c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d40097c0 tx=0x7f81d401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:22.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.696+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f81dc053110 con 0x7f81e806a8e0 2023-08-27T11:23:22.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.907+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81e804ee70 con 0x7f81e806a8e0 2023-08-27T11:23:22.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.907+0000 7f81e57fa700 1 -- 172.21.15.43:0/3157675166 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81dc056730 con 0x7f81e806a8e0 2023-08-27T11:23:22.909 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:22.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 msgr2=0x7f81cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 0x7f81cc06c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d40097c0 tx=0x7f81d401c040 comp rx=0 tx=0).stop 2023-08-27T11:23:22.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 msgr2=0x7f81e80c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:22.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c500 tx=0x7f81dc00c8c0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 shutdown_connections 2023-08-27T11:23:22.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f81cc06a0e0 0x7f81cc06c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f81e8151d20 0x7f81e81e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f81e806a8e0 0x7f81e80c3750 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.909+0000 7f81eedff700 1 --2- 172.21.15.43:0/3157675166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e80c7c00 0x7f81e8152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:22.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.910+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 >> 172.21.15.43:0/3157675166 conn(0x7f81e80c9d00 msgr2=0x7f81e80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:22.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.910+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 shutdown_connections 2023-08-27T11:23:22.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:22.910+0000 7f81eedff700 1 -- 172.21.15.43:0/3157675166 wait complete. 2023-08-27T11:23:22.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:23.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.135+0000 7f78ca3ff700 1 Processor -- start 2023-08-27T11:23:23.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.135+0000 7f78ca3ff700 1 -- start start 2023-08-27T11:23:23.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.136+0000 7f78ca3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78c40c7c00 0x7f78c40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.136+0000 7f78ca3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c406a8e0 0x7f78c406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.136+0000 7f78ca3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c4154660 con 0x7f78c4151d20 2023-08-27T11:23:23.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.136+0000 7f78ca3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c40c5750 con 0x7f78c40c7c00 2023-08-27T11:23:23.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.136+0000 7f78ca3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4154940 con 0x7f78c406a8e0 2023-08-27T11:23:23.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78c40c7c00 0x7f78c40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f78c40c7c00 0x7f78c40c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41764/0 (socket says 172.21.15.43:41764) 2023-08-27T11:23:23.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 -- 172.21.15.43:0/3403396477 learned_addr learned my addr 172.21.15.43:0/3403396477 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:23.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c899c700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c406a8e0 0x7f78c406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 -- 172.21.15.43:0/3403396477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c406a8e0 msgr2=0x7f78c406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:23.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c406a8e0 0x7f78c406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 -- 172.21.15.43:0/3403396477 >> v1:172.21.15.57:6789/0 conn(0x7f78c4151d20 legacy=0x7f78c40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:23.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 -- 172.21.15.43:0/3403396477 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c4154c20 con 0x7f78c40c7c00 2023-08-27T11:23:23.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.137+0000 7f78c37fe700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c40c7c00 0x7f78c40c8110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc4f4639a003d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78c2ffd700 1 -- 172.21.15.43:0/3403396477 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800b8a0 con 0x7f78c40c7c00 2023-08-27T11:23:23.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78c2ffd700 1 -- 172.21.15.43:0/3403396477 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800ba00 con 0x7f78c40c7c00 2023-08-27T11:23:23.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78c2ffd700 1 -- 172.21.15.43:0/3403396477 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800bd90 con 0x7f78c40c7c00 2023-08-27T11:23:23.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 -- 172.21.15.43:0/3403396477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c40c7c00 msgr2=0x7f78c40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c40c7c00 0x7f78c40c8110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f78b80098f0 tx=0x7f78b8009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:23.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 -- 172.21.15.43:0/3403396477 shutdown_connections 2023-08-27T11:23:23.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c406a8e0 0x7f78c406ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/3403396477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c40c7c00 0x7f78c40c8110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 -- 172.21.15.43:0/3403396477 >> 172.21.15.43:0/3403396477 conn(0x7f78c40c9d00 msgr2=0x7f78c40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:23.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.138+0000 7f78ca3ff700 1 -- 172.21.15.43:0/3403396477 shutdown_connections 2023-08-27T11:23:23.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.139+0000 7f78ca3ff700 1 -- 172.21.15.43:0/3403396477 wait complete. 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.140+0000 7f78ca3ff700 1 Processor -- start 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.140+0000 7f78ca3ff700 1 -- start start 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c40c7c00 0x7f78c40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78c4151d20 0x7f78c4147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41584c0 con 0x7f78c406a8e0 2023-08-27T11:23:23.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414e610 con 0x7f78c4151d20 2023-08-27T11:23:23.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.141+0000 7f78ca3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c414dad0 con 0x7f78c40c7c00 2023-08-27T11:23:23.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41772/0 (socket says 172.21.15.43:41772) 2023-08-27T11:23:23.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 -- 172.21.15.43:0/1108495453 learned_addr learned my addr 172.21.15.43:0/1108495453 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:23.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c37fe700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c40c7c00 0x7f78c40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c899c700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78c4151d20 0x7f78c4147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 -- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c40c7c00 msgr2=0x7f78c40aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c40c7c00 0x7f78c40aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 -- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78c4151d20 msgr2=0x7f78c4147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78c4151d20 0x7f78c4147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 -- 172.21.15.43:0/1108495453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009550 con 0x7f78c406a8e0 2023-08-27T11:23:23.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.142+0000 7f78c3fff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c450 tx=0x7f78b400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.143+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40052d0 con 0x7f78c406a8e0 2023-08-27T11:23:23.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.143+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4005430 con 0x7f78c406a8e0 2023-08-27T11:23:23.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.143+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c41edcd0 con 0x7f78c406a8e0 2023-08-27T11:23:23.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.143+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40038c0 con 0x7f78c406a8e0 2023-08-27T11:23:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.143+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c414eb40 con 0x7f78c406a8e0 2023-08-27T11:23:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.144+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c404ee70 con 0x7f78c406a8e0 2023-08-27T11:23:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.145+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78b4003a20 con 0x7f78c406a8e0 2023-08-27T11:23:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.145+0000 7f78c0ff9700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 0x7f78b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.146+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78b4087790 con 0x7f78c406a8e0 2023-08-27T11:23:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.146+0000 7f78c37fe700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 0x7f78b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.146+0000 7f78c37fe700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 0x7f78b006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009c40 tx=0x7f78b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.150+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f78b4052f10 con 0x7f78c406a8e0 2023-08-27T11:23:23.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.358+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78c40c0b00 con 0x7f78c406a8e0 2023-08-27T11:23:23.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.358+0000 7f78c0ff9700 1 -- 172.21.15.43:0/1108495453 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78b400ce60 con 0x7f78c406a8e0 2023-08-27T11:23:23.360 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:23.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 msgr2=0x7f78b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 0x7f78b006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009c40 tx=0x7f78b8008030 comp rx=0 tx=0).stop 2023-08-27T11:23:23.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 msgr2=0x7f78c41ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c450 tx=0x7f78b400c760 comp rx=0 tx=0).stop 2023-08-27T11:23:23.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 shutdown_connections 2023-08-27T11:23:23.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f78b006a0e0 0x7f78b006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f78c4151d20 0x7f78c4147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78c406a8e0 0x7f78c41ed790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 --2- 172.21.15.43:0/1108495453 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78c40c7c00 0x7f78c40aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 >> 172.21.15.43:0/1108495453 conn(0x7f78c40c9d00 msgr2=0x7f78c4150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:23.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 shutdown_connections 2023-08-27T11:23:23.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.361+0000 7f78ca3ff700 1 -- 172.21.15.43:0/1108495453 wait complete. 2023-08-27T11:23:23.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:23:23.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.582+0000 7f56455ff700 1 Processor -- start 2023-08-27T11:23:23.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.583+0000 7f56455ff700 1 -- start start 2023-08-27T11:23:23.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5640151d20 0x7f56400c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56400c7c00 0x7f56400ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56400abcc0 0x7f564006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400c5750 con 0x7f56400c7c00 2023-08-27T11:23:23.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5640154660 con 0x7f5640151d20 2023-08-27T11:23:23.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f56455ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5640154940 con 0x7f56400abcc0 2023-08-27T11:23:23.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56400c7c00 0x7f56400ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56400c7c00 0x7f56400ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41782/0 (socket says 172.21.15.43:41782) 2023-08-27T11:23:23.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 -- 172.21.15.43:0/2863574399 learned_addr learned my addr 172.21.15.43:0/2863574399 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:23.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f563effd700 1 --2- 172.21.15.43:0/2863574399 >> v2:172.21.15.57:3300/0 conn(0x7f5640151d20 0x7f56400c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f563f7fe700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56400abcc0 0x7f564006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 -- 172.21.15.43:0/2863574399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56400abcc0 msgr2=0x7f564006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:23.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56400abcc0 0x7f564006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 -- 172.21.15.43:0/2863574399 >> v2:172.21.15.57:3300/0 conn(0x7f5640151d20 msgr2=0x7f56400c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:23.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 --2- 172.21.15.43:0/2863574399 >> v2:172.21.15.57:3300/0 conn(0x7f5640151d20 0x7f56400c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.584+0000 7f5637fff700 1 -- 172.21.15.43:0/2863574399 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640154c20 con 0x7f56400c7c00 2023-08-27T11:23:23.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.585+0000 7f5637fff700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400c7c00 0x7f56400ab780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56400cac10 tx=0x7f5628009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386b40813103a71b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.585+0000 7f563e7fc700 1 -- 172.21.15.43:0/2863574399 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628011830 con 0x7f56400c7c00 2023-08-27T11:23:23.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.585+0000 7f563e7fc700 1 -- 172.21.15.43:0/2863574399 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5628011990 con 0x7f56400c7c00 2023-08-27T11:23:23.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.585+0000 7f563e7fc700 1 -- 172.21.15.43:0/2863574399 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628011d20 con 0x7f56400c7c00 2023-08-27T11:23:23.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 -- 172.21.15.43:0/2863574399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400c7c00 msgr2=0x7f56400ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400c7c00 0x7f56400ab780 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56400cac10 tx=0x7f5628009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 -- 172.21.15.43:0/2863574399 shutdown_connections 2023-08-27T11:23:23.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56400abcc0 0x7f564006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 --2- 172.21.15.43:0/2863574399 >> v2:172.21.15.57:3300/0 conn(0x7f5640151d20 0x7f56400c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 --2- 172.21.15.43:0/2863574399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400c7c00 0x7f56400ab780 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 -- 172.21.15.43:0/2863574399 >> 172.21.15.43:0/2863574399 conn(0x7f56400c9d00 msgr2=0x7f56400ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:23.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 -- 172.21.15.43:0/2863574399 shutdown_connections 2023-08-27T11:23:23.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.586+0000 7f56455ff700 1 -- 172.21.15.43:0/2863574399 wait complete. 2023-08-27T11:23:23.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.588+0000 7f56455ff700 1 Processor -- start 2023-08-27T11:23:23.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.588+0000 7f56455ff700 1 -- start start 2023-08-27T11:23:23.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.588+0000 7f56455ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f56455ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 0x7f56400aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f56455ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 0x7f56400c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f56455ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c3630 con 0x7f56400abcc0 2023-08-27T11:23:23.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f56455ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c2a10 con 0x7f56400c7c00 2023-08-27T11:23:23.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f56455ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400c2ea0 con 0x7f5640151d20 2023-08-27T11:23:23.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41790/0 (socket says 172.21.15.43:41790) 2023-08-27T11:23:23.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 -- 172.21.15.43:0/2354944272 learned_addr learned my addr 172.21.15.43:0/2354944272 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:23.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f5637fff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 0x7f56400aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563f7fe700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 0x7f56400c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 -- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 msgr2=0x7f56400c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 0x7f56400c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 -- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 msgr2=0x7f56400aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 0x7f56400aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 -- 172.21.15.43:0/2354944272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009550 con 0x7f56400abcc0 2023-08-27T11:23:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f5637fff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 0x7f56400aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563f7fe700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 0x7f56400c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.589+0000 7f563effd700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f563000e870 tx=0x7f563000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.590+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630009590 con 0x7f56400abcc0 2023-08-27T11:23:23.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.590+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000ee70 con 0x7f56400abcc0 2023-08-27T11:23:23.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.590+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000ca50 con 0x7f56400abcc0 2023-08-27T11:23:23.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.590+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56400c3840 con 0x7f56400abcc0 2023-08-27T11:23:23.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.590+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56400c26a0 con 0x7f56400abcc0 2023-08-27T11:23:23.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.591+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56400c3d60 con 0x7f56400abcc0 2023-08-27T11:23:23.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.592+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f563000cbb0 con 0x7f56400abcc0 2023-08-27T11:23:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.593+0000 7f56377fe700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 0x7f562006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.593+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5630088540 con 0x7f56400abcc0 2023-08-27T11:23:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.593+0000 7f5637fff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 0x7f562006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:23.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.594+0000 7f5637fff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 0x7f562006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5640158c00 tx=0x7f5628008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:23.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.597+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56400c3d60 con 0x7f56400abcc0 2023-08-27T11:23:23.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.811+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f56400c2500 con 0x7f56400abcc0 2023-08-27T11:23:23.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.815+0000 7f56377fe700 1 -- 172.21.15.43:0/2354944272 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56400c2500 con 0x7f56400abcc0 2023-08-27T11:23:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 msgr2=0x7f562006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 0x7f562006c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5640158c00 tx=0x7f5628008030 comp rx=0 tx=0).stop 2023-08-27T11:23:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 msgr2=0x7f56400c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:23.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f563000e870 tx=0x7f563000ec30 comp rx=0 tx=0).stop 2023-08-27T11:23:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 shutdown_connections 2023-08-27T11:23:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f562006a0e0 0x7f562006c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5640151d20 0x7f56400c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56400abcc0 0x7f56400c0350 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 --2- 172.21.15.43:0/2354944272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56400c7c00 0x7f56400aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.817+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 >> 172.21.15.43:0/2354944272 conn(0x7f56400c9d00 msgr2=0x7f564006b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.818+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 shutdown_connections 2023-08-27T11:23:23.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:23.818+0000 7f56455ff700 1 -- 172.21.15.43:0/2354944272 wait complete. 2023-08-27T11:23:23.837 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:23:23.838 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:23:23.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:23:24.059 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:23:24.059 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:23:24.060 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:24.104 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:23:24.105 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:24.187 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:23:24.188 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:24.271 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:24.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.511+0000 7f3f397ff700 1 Processor -- start 2023-08-27T11:23:24.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.511+0000 7f3f397ff700 1 -- start start 2023-08-27T11:23:24.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.512+0000 7f3f397ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.512+0000 7f3f397ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3f34154330 0x7f3f341547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.512+0000 7f3f397ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f3406cf60 con 0x7f3f340bd350 2023-08-27T11:23:24.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.512+0000 7f3f397ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f340c5910 con 0x7f3f34154330 2023-08-27T11:23:24.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.512+0000 7f3f397ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341579c0 con 0x7f3f340c4640 2023-08-27T11:23:24.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3f34154330 0x7f3f341547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3f34154330 0x7f3f341547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41794/0 (socket says 172.21.15.43:41794) 2023-08-27T11:23:24.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 -- 172.21.15.43:0/3628986787 learned_addr learned my addr 172.21.15.43:0/3628986787 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:24.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 -- 172.21.15.43:0/3628986787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 msgr2=0x7f3f340c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:24.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 --2- 172.21.15.43:0/3628986787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 -- 172.21.15.43:0/3628986787 >> v1:172.21.15.57:6789/0 conn(0x7f3f340bd350 legacy=0x7f3f340c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:24.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 -- 172.21.15.43:0/3628986787 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34157c60 con 0x7f3f34154330 2023-08-27T11:23:24.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.513+0000 7f3f337fe700 1 --2- 172.21.15.43:0/3628986787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341547c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009e50 tx=0x7f3f2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a790a06ff1ea6972 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f31ffb700 1 -- 172.21.15.43:0/3628986787 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c00e070 con 0x7f3f34154330 2023-08-27T11:23:24.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f31ffb700 1 -- 172.21.15.43:0/3628986787 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c003a20 con 0x7f3f34154330 2023-08-27T11:23:24.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f31ffb700 1 -- 172.21.15.43:0/3628986787 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c003dd0 con 0x7f3f34154330 2023-08-27T11:23:24.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 -- 172.21.15.43:0/3628986787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 msgr2=0x7f3f341547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3628986787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341547c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009e50 tx=0x7f3f2c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:24.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 -- 172.21.15.43:0/3628986787 shutdown_connections 2023-08-27T11:23:24.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3628986787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341547c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3628986787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 -- 172.21.15.43:0/3628986787 >> 172.21.15.43:0/3628986787 conn(0x7f3f340c9cc0 msgr2=0x7f3f340ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:24.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 -- 172.21.15.43:0/3628986787 shutdown_connections 2023-08-27T11:23:24.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.514+0000 7f3f397ff700 1 -- 172.21.15.43:0/3628986787 wait complete. 2023-08-27T11:23:24.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.516+0000 7f3f397ff700 1 Processor -- start 2023-08-27T11:23:24.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.516+0000 7f3f397ff700 1 -- start start 2023-08-27T11:23:24.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 0x7f3f340be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341edc70 con 0x7f3f34154330 2023-08-27T11:23:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f340a9fc0 con 0x7f3f340bd350 2023-08-27T11:23:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f397ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341ed9b0 con 0x7f3f340c4640 2023-08-27T11:23:24.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f337fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f337fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41798/0 (socket says 172.21.15.43:41798) 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.517+0000 7f3f337fe700 1 -- 172.21.15.43:0/3698068474 learned_addr learned my addr 172.21.15.43:0/3698068474 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f327fc700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f32ffd700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 0x7f3f340be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 -- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 msgr2=0x7f3f340aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 -- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 msgr2=0x7f3f340be470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 0x7f3f340be470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 -- 172.21.15.43:0/3698068474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c009b30 con 0x7f3f34154330 2023-08-27T11:23:24.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f32ffd700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 0x7f3f340be470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:24.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f337fe700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f340cac70 tx=0x7f3f2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c004240 con 0x7f3f34154330 2023-08-27T11:23:24.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0043a0 con 0x7f3f34154330 2023-08-27T11:23:24.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f340aa1d0 con 0x7f3f34154330 2023-08-27T11:23:24.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c004750 con 0x7f3f34154330 2023-08-27T11:23:24.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.518+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f340aaf10 con 0x7f3f34154330 2023-08-27T11:23:24.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.519+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f340ab160 con 0x7f3f34154330 2023-08-27T11:23:24.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.520+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3f2c019070 con 0x7f3f34154330 2023-08-27T11:23:24.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.521+0000 7f3f1b7fe700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 0x7f3f2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.521+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f2c089630 con 0x7f3f34154330 2023-08-27T11:23:24.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.521+0000 7f3f32ffd700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 0x7f3f2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.522+0000 7f3f32ffd700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 0x7f3f2006c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a8f0 tx=0x7f3f24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.525+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3f340ab160 con 0x7f3f34154330 2023-08-27T11:23:24.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.738+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f341584e0 con 0x7f3f34154330 2023-08-27T11:23:24.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.740+0000 7f3f1b7fe700 1 -- 172.21.15.43:0/3698068474 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7f3f341584e0 con 0x7f3f34154330 2023-08-27T11:23:24.742 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:24.742 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:24.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 msgr2=0x7f3f2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 0x7f3f2006c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a8f0 tx=0x7f3f24008040 comp rx=0 tx=0).stop 2023-08-27T11:23:24.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 msgr2=0x7f3f341ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f340cac70 tx=0x7f3f2c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 shutdown_connections 2023-08-27T11:23:24.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f2006a0e0 0x7f3f2006c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3f34154330 0x7f3f341ecf70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f340bd350 0x7f3f340be470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 --2- 172.21.15.43:0/3698068474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f340c4640 0x7f3f340aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 >> 172.21.15.43:0/3698068474 conn(0x7f3f340c9cc0 msgr2=0x7f3f341507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 shutdown_connections 2023-08-27T11:23:24.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.742+0000 7f3f397ff700 1 -- 172.21.15.43:0/3698068474 wait complete. 2023-08-27T11:23:24.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:24.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:24.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.966+0000 7f915fbff700 1 Processor -- start 2023-08-27T11:23:24.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.967+0000 7f915fbff700 1 -- start start 2023-08-27T11:23:24.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915fbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f91580c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915fbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91580c7c00 0x7f91580ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915fbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9158154660 con 0x7f91580abcc0 2023-08-27T11:23:24.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915fbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91580c5750 con 0x7f91580c7c00 2023-08-27T11:23:24.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915fbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9158154940 con 0x7f9158151d20 2023-08-27T11:23:24.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915e19c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f91580abcc0 0x7f915806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60900/0 (socket says 172.21.15.43:60900) 2023-08-27T11:23:24.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915e19c700 1 -- 172.21.15.43:0/3088433391 learned_addr learned my addr 172.21.15.43:0/3088433391 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:24.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915d99b700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f91580c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.968+0000 7f915d19a700 1 --2- 172.21.15.43:0/3088433391 >> v2:172.21.15.57:3300/0 conn(0x7f91580c7c00 0x7f91580ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915c999700 1 -- 172.21.15.43:0/3088433391 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198664903 0 0) 0x7f9158154660 con 0x7f91580abcc0 2023-08-27T11:23:24.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915c999700 1 -- 172.21.15.43:0/3088433391 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91440035b0 con 0x7f91580abcc0 2023-08-27T11:23:24.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d19a700 1 -- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 msgr2=0x7f91580c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:24.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d19a700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f91580c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d19a700 1 -- 172.21.15.43:0/3088433391 >> v1:172.21.15.43:6789/0 conn(0x7f91580abcc0 legacy=0x7f915806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d19a700 1 -- 172.21.15.43:0/3088433391 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158154c20 con 0x7f91580c7c00 2023-08-27T11:23:24.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d99b700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f91580c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:24.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915d19a700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f91580ab780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9148009840 tx=0x7f9148009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f1abb102b73e5d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.969+0000 7f915c999700 1 -- 172.21.15.43:0/3088433391 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148011830 con 0x7f91580c7c00 2023-08-27T11:23:24.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915c999700 1 -- 172.21.15.43:0/3088433391 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148011990 con 0x7f91580c7c00 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915c999700 1 -- 172.21.15.43:0/3088433391 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148011d20 con 0x7f91580c7c00 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 -- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 msgr2=0x7f91580ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f91580ab780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9148009840 tx=0x7f9148009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 -- 172.21.15.43:0/3088433391 shutdown_connections 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f91580c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 --2- 172.21.15.43:0/3088433391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f91580ab780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 -- 172.21.15.43:0/3088433391 >> 172.21.15.43:0/3088433391 conn(0x7f91580c9d00 msgr2=0x7f91580ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:24.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 -- 172.21.15.43:0/3088433391 shutdown_connections 2023-08-27T11:23:24.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.970+0000 7f915fbff700 1 -- 172.21.15.43:0/3088433391 wait complete. 2023-08-27T11:23:24.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.972+0000 7f915fbff700 1 Processor -- start 2023-08-27T11:23:24.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.972+0000 7f915fbff700 1 -- start start 2023-08-27T11:23:24.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f915814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f9158158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158157540 con 0x7f91580abcc0 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580c37a0 con 0x7f91580c7c00 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915fbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915814db00 con 0x7f9158151d20 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915d99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915d99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41806/0 (socket says 172.21.15.43:41806) 2023-08-27T11:23:24.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915d99b700 1 -- 172.21.15.43:0/2614857850 learned_addr learned my addr 172.21.15.43:0/2614857850 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:24.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915d19a700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f915814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915e19c700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f9158158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.973+0000 7f915d99b700 1 -- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 msgr2=0x7f9158158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915d99b700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f9158158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915d99b700 1 -- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 msgr2=0x7f915814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:24.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915d99b700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f915814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:24.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915d99b700 1 -- 172.21.15.43:0/2614857850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540094a0 con 0x7f91580abcc0 2023-08-27T11:23:24.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915e19c700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f9158158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:24.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915d99b700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f915400ebe0 tx=0x7f9154009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400c8b0 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915400ca10 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91480094a0 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915400cda0 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.974+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915814c440 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.975+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915804ee70 con 0x7f91580abcc0 2023-08-27T11:23:24.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.976+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9154013470 con 0x7f91580abcc0 2023-08-27T11:23:24.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.977+0000 7f914e7fc700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 0x7f913c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:24.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.977+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91540885d0 con 0x7f91580abcc0 2023-08-27T11:23:24.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.977+0000 7f915d19a700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 0x7f913c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:24.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.978+0000 7f915d19a700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 0x7f913c06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f9148008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:24.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:24.982+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9154053d50 con 0x7f91580abcc0 2023-08-27T11:23:25.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.194+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91580ac650 con 0x7f91580abcc0 2023-08-27T11:23:25.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.194+0000 7f914e7fc700 1 -- 172.21.15.43:0/2614857850 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9154057370 con 0x7f91580abcc0 2023-08-27T11:23:25.196 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:25.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.196+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 msgr2=0x7f913c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.196+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 0x7f913c06c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9148000c00 tx=0x7f9148008030 comp rx=0 tx=0).stop 2023-08-27T11:23:25.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.196+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 msgr2=0x7f915814b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.196+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f915400ebe0 tx=0x7f9154009e20 comp rx=0 tx=0).stop 2023-08-27T11:23:25.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 shutdown_connections 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f913c06a0e0 0x7f913c06c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9158151d20 0x7f9158158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f91580abcc0 0x7f915814b340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 --2- 172.21.15.43:0/2614857850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91580c7c00 0x7f915814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 >> 172.21.15.43:0/2614857850 conn(0x7f91580c9d00 msgr2=0x7f91580c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:25.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 shutdown_connections 2023-08-27T11:23:25.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.197+0000 7f915fbff700 1 -- 172.21.15.43:0/2614857850 wait complete. 2023-08-27T11:23:25.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:25.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.419+0000 7f2bbb3ff700 1 Processor -- start 2023-08-27T11:23:25.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.419+0000 7f2bbb3ff700 1 -- start start 2023-08-27T11:23:25.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.420+0000 7f2bbb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 0x7f2bb41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.420+0000 7f2bbb3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 0x7f2bb40c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bbb3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb40c03e0 con 0x7f2bb414e780 2023-08-27T11:23:25.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bbb3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb4151900 con 0x7f2bb414eb60 2023-08-27T11:23:25.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bbb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4151be0 con 0x7f2bb40c5150 2023-08-27T11:23:25.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bb919b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2bb414e780 0x7f2bb406a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60908/0 (socket says 172.21.15.43:60908) 2023-08-27T11:23:25.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bb919b700 1 -- 172.21.15.43:0/758805131 learned_addr learned my addr 172.21.15.43:0/758805131 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:25.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bb899a700 1 --2- 172.21.15.43:0/758805131 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 0x7f2bb41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2bb999c700 1 --2- 172.21.15.43:0/758805131 >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 0x7f2bb40c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758491605 0 0) 0x7f2bb40c03e0 con 0x7f2bb414e780 2023-08-27T11:23:25.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.421+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba00035b0 con 0x7f2bb414e780 2023-08-27T11:23:25.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb899a700 1 -- 172.21.15.43:0/758805131 >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 msgr2=0x7f2bb40c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb899a700 1 --2- 172.21.15.43:0/758805131 >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 0x7f2bb40c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb899a700 1 -- 172.21.15.43:0/758805131 >> v1:172.21.15.43:6789/0 conn(0x7f2bb414e780 legacy=0x7f2bb406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697618509 0 0) 0x7f2ba00035b0 con 0x7f2bb414e780 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb899a700 1 -- 172.21.15.43:0/758805131 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4151ec0 con 0x7f2bb40c5150 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb999c700 1 --2- 172.21.15.43:0/758805131 >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 0x7f2bb40c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:25.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2bb899a700 1 --2- 172.21.15.43:0/758805131 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 0x7f2bb41512b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009840 tx=0x7f2ba4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c105a42eaea8976c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4011830 con 0x7f2bb40c5150 2023-08-27T11:23:25.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba4011990 con 0x7f2bb40c5150 2023-08-27T11:23:25.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.422+0000 7f2babfff700 1 -- 172.21.15.43:0/758805131 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4011d20 con 0x7f2bb40c5150 2023-08-27T11:23:25.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/758805131 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 msgr2=0x7f2bb41512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/758805131 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 0x7f2bb41512b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009840 tx=0x7f2ba4009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/758805131 shutdown_connections 2023-08-27T11:23:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/758805131 >> v2:172.21.15.57:3300/0 conn(0x7f2bb414eb60 0x7f2bb40c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/758805131 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb40c5150 0x7f2bb41512b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/758805131 >> 172.21.15.43:0/758805131 conn(0x7f2bb40c5b10 msgr2=0x7f2bb40c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:25.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/758805131 shutdown_connections 2023-08-27T11:23:25.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.423+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/758805131 wait complete. 2023-08-27T11:23:25.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.425+0000 7f2bbb3ff700 1 Processor -- start 2023-08-27T11:23:25.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.425+0000 7f2bbb3ff700 1 -- start start 2023-08-27T11:23:25.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb414e780 0x7f2bb41ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb414eb60 0x7f2bb414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4149c20 con 0x7f2bb40c5150 2023-08-27T11:23:25.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb41deb10 con 0x7f2bb414e780 2023-08-27T11:23:25.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bbb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb41dedf0 con 0x7f2bb414eb60 2023-08-27T11:23:25.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41822/0 (socket says 172.21.15.43:41822) 2023-08-27T11:23:25.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 -- 172.21.15.43:0/1962853499 learned_addr learned my addr 172.21.15.43:0/1962853499 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:25.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb899a700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb414e780 0x7f2bb41ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb999c700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb414eb60 0x7f2bb414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 -- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb414eb60 msgr2=0x7f2bb414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb414eb60 0x7f2bb414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 -- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb414e780 msgr2=0x7f2bb41ddcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb414e780 0x7f2bb41ddcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.426+0000 7f2bb919b700 1 -- 172.21.15.43:0/1962853499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009a70 con 0x7f2bb40c5150 2023-08-27T11:23:25.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2bb919b700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c780 tx=0x7f2bb000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0005d70 con 0x7f2bb40c5150 2023-08-27T11:23:25.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb00070d0 con 0x7f2bb40c5150 2023-08-27T11:23:25.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0007460 con 0x7f2bb40c5150 2023-08-27T11:23:25.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba40094a0 con 0x7f2bb40c5150 2023-08-27T11:23:25.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.427+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb41ecf70 con 0x7f2bb40c5150 2023-08-27T11:23:25.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.428+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb404ee70 con 0x7f2bb40c5150 2023-08-27T11:23:25.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.429+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2bb00075c0 con 0x7f2bb40c5150 2023-08-27T11:23:25.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.430+0000 7f2ba9ffb700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 0x7f2b9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.430+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bb0087ad0 con 0x7f2bb40c5150 2023-08-27T11:23:25.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.430+0000 7f2bb899a700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 0x7f2b9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.431+0000 7f2bb899a700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 0x7f2b9806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.434+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2bb0053130 con 0x7f2bb40c5150 2023-08-27T11:23:25.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.644+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2bb406d1c0 con 0x7f2bb40c5150 2023-08-27T11:23:25.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.644+0000 7f2ba9ffb700 1 -- 172.21.15.43:0/1962853499 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2bb0056750 con 0x7f2bb40c5150 2023-08-27T11:23:25.646 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:25.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.646+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 msgr2=0x7f2b9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.646+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 0x7f2b9806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009fd0 tx=0x7f2ba401c040 comp rx=0 tx=0).stop 2023-08-27T11:23:25.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.646+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 msgr2=0x7f2bb41eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.646+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c780 tx=0x7f2bb000ca90 comp rx=0 tx=0).stop 2023-08-27T11:23:25.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 shutdown_connections 2023-08-27T11:23:25.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2b9806a0e0 0x7f2b9806c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2bb414eb60 0x7f2bb414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2bb40c5150 0x7f2bb41eca30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 --2- 172.21.15.43:0/1962853499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bb414e780 0x7f2bb41ddcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 >> 172.21.15.43:0/1962853499 conn(0x7f2bb40c5b10 msgr2=0x7f2bb40c0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:25.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 shutdown_connections 2023-08-27T11:23:25.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.647+0000 7f2bbb3ff700 1 -- 172.21.15.43:0/1962853499 wait complete. 2023-08-27T11:23:25.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:25.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.869+0000 7fbdffdff700 1 Processor -- start 2023-08-27T11:23:25.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.870+0000 7fbdffdff700 1 -- start start 2023-08-27T11:23:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdffdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 0x7fbdf80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdffdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf8154660 con 0x7fbdf806a8e0 2023-08-27T11:23:25.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdffdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf8154940 con 0x7fbdf8151d20 2023-08-27T11:23:25.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdffdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80c5750 con 0x7fbdf80c7c00 2023-08-27T11:23:25.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdfe39c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbdf806a8e0 0x7fbdf806ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60914/0 (socket says 172.21.15.43:60914) 2023-08-27T11:23:25.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdfe39c700 1 -- 172.21.15.43:0/2114166611 learned_addr learned my addr 172.21.15.43:0/2114166611 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:25.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.871+0000 7fbdfd39a700 1 --2- 172.21.15.43:0/2114166611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 0x7fbdf80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320089151 0 0) 0x7fbdf8154660 con 0x7fbdf806a8e0 2023-08-27T11:23:25.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde40035b0 con 0x7fbdf806a8e0 2023-08-27T11:23:25.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206315141 0 0) 0x7fbdf8154940 con 0x7fbdf8151d20 2023-08-27T11:23:25.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf8154660 con 0x7fbdf8151d20 2023-08-27T11:23:25.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2114166611 >> v1:172.21.15.57:6789/0 conn(0x7fbdf8151d20 legacy=0x7fbdf80ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2114166611 >> v1:172.21.15.43:6789/0 conn(0x7fbdf806a8e0 legacy=0x7fbdf806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2114166611 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8154c20 con 0x7fbdf80c7c00 2023-08-27T11:23:25.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfd39a700 1 --2- 172.21.15.43:0/2114166611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 0x7fbdf80c8110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009870 tx=0x7fbde8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f80ff347de4016b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011830 con 0x7fbdf80c7c00 2023-08-27T11:23:25.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8011990 con 0x7fbdf80c7c00 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.872+0000 7fbdfcb99700 1 -- 172.21.15.43:0/2114166611 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011d20 con 0x7fbdf80c7c00 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 -- 172.21.15.43:0/2114166611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 msgr2=0x7fbdf80c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2114166611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 0x7fbdf80c8110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009870 tx=0x7fbde8009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 -- 172.21.15.43:0/2114166611 shutdown_connections 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2114166611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf80c7c00 0x7fbdf80c8110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 -- 172.21.15.43:0/2114166611 >> 172.21.15.43:0/2114166611 conn(0x7fbdf80c9d00 msgr2=0x7fbdf80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:25.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 -- 172.21.15.43:0/2114166611 shutdown_connections 2023-08-27T11:23:25.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.873+0000 7fbdffdff700 1 -- 172.21.15.43:0/2114166611 wait complete. 2023-08-27T11:23:25.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.875+0000 7fbdffdff700 1 Processor -- start 2023-08-27T11:23:25.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.875+0000 7fbdffdff700 1 -- start start 2023-08-27T11:23:25.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf806a8e0 0x7fbdf80c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf8151d20 0x7fbdf81e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81e9a70 con 0x7fbdf80c7c00 2023-08-27T11:23:25.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81ed460 con 0x7fbdf806a8e0 2023-08-27T11:23:25.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdffdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8153150 con 0x7fbdf8151d20 2023-08-27T11:23:25.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdfd39a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdfd39a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41824/0 (socket says 172.21.15.43:41824) 2023-08-27T11:23:25.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2511162485 learned_addr learned my addr 172.21.15.43:0/2511162485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:25.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdfe39c700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf8151d20 0x7fbdf81e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.876+0000 7fbdfdb9b700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf806a8e0 0x7fbdf80c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf8151d20 msgr2=0x7fbdf81e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf8151d20 0x7fbdf81e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf806a8e0 msgr2=0x7fbdf80c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:25.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf806a8e0 0x7fbdf80c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:25.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 -- 172.21.15.43:0/2511162485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80094a0 con 0x7fbdf80c7c00 2023-08-27T11:23:25.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdfd39a700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbde80090b0 tx=0x7fbde8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde801a6e0 con 0x7fbdf80c7c00 2023-08-27T11:23:25.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde801a840 con 0x7fbdf80c7c00 2023-08-27T11:23:25.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf81e9440 con 0x7fbdf80c7c00 2023-08-27T11:23:25.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde801abb0 con 0x7fbdf80c7c00 2023-08-27T11:23:25.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.877+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf81e9700 con 0x7fbdf80c7c00 2023-08-27T11:23:25.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.878+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf81e9c20 con 0x7fbdf80c7c00 2023-08-27T11:23:25.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.879+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbde8022070 con 0x7fbdf80c7c00 2023-08-27T11:23:25.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.880+0000 7fbdee7fc700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 0x7fbddc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:25.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.880+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde80890c0 con 0x7fbdf80c7c00 2023-08-27T11:23:25.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.880+0000 7fbdfdb9b700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 0x7fbddc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:25.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.881+0000 7fbdfdb9b700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 0x7fbddc06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40011e0 tx=0x7fbdf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:25.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:25.884+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbdf81e9c20 con 0x7fbdf80c7c00 2023-08-27T11:23:26.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.092+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdf804ee70 con 0x7fbdf80c7c00 2023-08-27T11:23:26.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.093+0000 7fbdee7fc700 1 -- 172.21.15.43:0/2511162485 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbde8058380 con 0x7fbdf80c7c00 2023-08-27T11:23:26.095 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:26.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 msgr2=0x7fbddc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 0x7fbddc06c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40011e0 tx=0x7fbdf4009040 comp rx=0 tx=0).stop 2023-08-27T11:23:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 msgr2=0x7fbdf8152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbde80090b0 tx=0x7fbde8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 shutdown_connections 2023-08-27T11:23:26.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbddc06a0e0 0x7fbddc06c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf8151d20 0x7fbdf81e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf806a8e0 0x7fbdf80c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 --2- 172.21.15.43:0/2511162485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf80c7c00 0x7fbdf8152ae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 >> 172.21.15.43:0/2511162485 conn(0x7fbdf80c9d00 msgr2=0x7fbdf80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 shutdown_connections 2023-08-27T11:23:26.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.095+0000 7fbdffdff700 1 -- 172.21.15.43:0/2511162485 wait complete. 2023-08-27T11:23:26.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:26.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.318+0000 7f08f09ff700 1 Processor -- start 2023-08-27T11:23:26.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.318+0000 7f08f09ff700 1 -- start start 2023-08-27T11:23:26.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08ec0c0020 0x7f08ec158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec071f70 0x7f08ec1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08ec0724c0 0x7f08ec151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec157af0 con 0x7f08ec0724c0 2023-08-27T11:23:26.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec158a80 con 0x7f08ec0c0020 2023-08-27T11:23:26.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.319+0000 7f08f09ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0a6040 con 0x7f08ec071f70 2023-08-27T11:23:26.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08ec0724c0 0x7f08ec151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f08ec0724c0 0x7f08ec151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41826/0 (socket says 172.21.15.43:41826) 2023-08-27T11:23:26.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 -- 172.21.15.43:0/3923195342 learned_addr learned my addr 172.21.15.43:0/3923195342 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:26.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08e9d9b700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec071f70 0x7f08ec1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ea59c700 1 --2- 172.21.15.43:0/3923195342 >> v2:172.21.15.57:3300/0 conn(0x7f08ec0c0020 0x7f08ec158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 -- 172.21.15.43:0/3923195342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec071f70 msgr2=0x7f08ec1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:26.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec071f70 0x7f08ec1518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 -- 172.21.15.43:0/3923195342 >> v2:172.21.15.57:3300/0 conn(0x7f08ec0c0020 msgr2=0x7f08ec158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:26.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 --2- 172.21.15.43:0/3923195342 >> v2:172.21.15.57:3300/0 conn(0x7f08ec0c0020 0x7f08ec158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.320+0000 7f08ead9d700 1 -- 172.21.15.43:0/3923195342 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0a6320 con 0x7f08ec0724c0 2023-08-27T11:23:26.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08ead9d700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec0724c0 0x7f08ec151df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c1060 tx=0x7f08e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb1c82e4ed77f4e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08e959a700 1 -- 172.21.15.43:0/3923195342 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400e070 con 0x7f08ec0724c0 2023-08-27T11:23:26.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08e959a700 1 -- 172.21.15.43:0/3923195342 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e400b9c0 con 0x7f08ec0724c0 2023-08-27T11:23:26.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08e959a700 1 -- 172.21.15.43:0/3923195342 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400bd70 con 0x7f08ec0724c0 2023-08-27T11:23:26.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 -- 172.21.15.43:0/3923195342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec0724c0 msgr2=0x7f08ec151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec0724c0 0x7f08ec151df0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c1060 tx=0x7f08e400b330 comp rx=0 tx=0).stop 2023-08-27T11:23:26.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 -- 172.21.15.43:0/3923195342 shutdown_connections 2023-08-27T11:23:26.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec0724c0 0x7f08ec151df0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 --2- 172.21.15.43:0/3923195342 >> v2:172.21.15.57:3300/0 conn(0x7f08ec0c0020 0x7f08ec158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 --2- 172.21.15.43:0/3923195342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec071f70 0x7f08ec1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.321+0000 7f08f09ff700 1 -- 172.21.15.43:0/3923195342 >> 172.21.15.43:0/3923195342 conn(0x7f08ec0c6a40 msgr2=0x7f08ec0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:26.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.322+0000 7f08f09ff700 1 -- 172.21.15.43:0/3923195342 shutdown_connections 2023-08-27T11:23:26.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.322+0000 7f08f09ff700 1 -- 172.21.15.43:0/3923195342 wait complete. 2023-08-27T11:23:26.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.323+0000 7f08f09ff700 1 Processor -- start 2023-08-27T11:23:26.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.323+0000 7f08f09ff700 1 -- start start 2023-08-27T11:23:26.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08ec0724c0 0x7f08ec0ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 0x7f08ec153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec1564f0 con 0x7f08ec071f70 2023-08-27T11:23:26.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0abdc0 con 0x7f08ec0724c0 2023-08-27T11:23:26.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.324+0000 7f08f09ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0aa090 con 0x7f08ec0c0020 2023-08-27T11:23:26.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41832/0 (socket says 172.21.15.43:41832) 2023-08-27T11:23:26.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 -- 172.21.15.43:0/1261278809 learned_addr learned my addr 172.21.15.43:0/1261278809 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:26.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08e9d9b700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08ec0724c0 0x7f08ec0ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ead9d700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 0x7f08ec153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 -- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 msgr2=0x7f08ec153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 0x7f08ec153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 -- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08ec0724c0 msgr2=0x7f08ec0ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08ec0724c0 0x7f08ec0ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 -- 172.21.15.43:0/1261278809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4009b30 con 0x7f08ec071f70 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ead9d700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 0x7f08ec153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.325+0000 7f08ea59c700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00e810 tx=0x7f08dc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.326+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc013610 con 0x7f08ec071f70 2023-08-27T11:23:26.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.326+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc013770 con 0x7f08ec071f70 2023-08-27T11:23:26.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.326+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc013b20 con 0x7f08ec071f70 2023-08-27T11:23:26.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.326+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec156700 con 0x7f08ec071f70 2023-08-27T11:23:26.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.326+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec0a9db0 con 0x7f08ec071f70 2023-08-27T11:23:26.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.327+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec0c4af0 con 0x7f08ec071f70 2023-08-27T11:23:26.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.328+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08dc013c80 con 0x7f08ec071f70 2023-08-27T11:23:26.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.329+0000 7f08daffd700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 0x7f08cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.329+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08dc0881a0 con 0x7f08ec071f70 2023-08-27T11:23:26.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.329+0000 7f08e9d9b700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 0x7f08cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.330+0000 7f08e9d9b700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 0x7f08cc06c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c05e0 tx=0x7f08e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.333+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f08dc057330 con 0x7f08ec071f70 2023-08-27T11:23:26.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.540+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08ec04ee70 con 0x7f08ec071f70 2023-08-27T11:23:26.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.540+0000 7f08daffd700 1 -- 172.21.15.43:0/1261278809 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08dc056ec0 con 0x7f08ec071f70 2023-08-27T11:23:26.542 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.542+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 msgr2=0x7f08cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.542+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 0x7f08cc06c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c05e0 tx=0x7f08e0008040 comp rx=0 tx=0).stop 2023-08-27T11:23:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.542+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 msgr2=0x7f08ec1523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.542+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00e810 tx=0x7f08dc00ebd0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 shutdown_connections 2023-08-27T11:23:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08cc06a0e0 0x7f08cc06c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08ec0c0020 0x7f08ec153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f08ec071f70 0x7f08ec1523f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 --2- 172.21.15.43:0/1261278809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f08ec0724c0 0x7f08ec0ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 >> 172.21.15.43:0/1261278809 conn(0x7f08ec0c6a40 msgr2=0x7f08ec151ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 shutdown_connections 2023-08-27T11:23:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.543+0000 7f08f09ff700 1 -- 172.21.15.43:0/1261278809 wait complete. 2023-08-27T11:23:26.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-27T11:23:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.763+0000 7f95a0dff700 1 Processor -- start 2023-08-27T11:23:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.764+0000 7f95a0dff700 1 -- start start 2023-08-27T11:23:26.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f95a0dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f959c0c4630 0x7f959c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f95a0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c06c4e0 con 0x7f959c06ad70 2023-08-27T11:23:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f95a0dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c155370 con 0x7f959c151a90 2023-08-27T11:23:26.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f95a0dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0c82c0 con 0x7f959c0c4630 2023-08-27T11:23:26.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f9593fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f959c0c4630 0x7f959c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f9593fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f959c0c4630 0x7f959c0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41844/0 (socket says 172.21.15.43:41844) 2023-08-27T11:23:26.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f959ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f959c06ad70 0x7f959c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60922/0 (socket says 172.21.15.43:60922) 2023-08-27T11:23:26.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.765+0000 7f9593fff700 1 -- 172.21.15.43:0/3034362275 learned_addr learned my addr 172.21.15.43:0/3034362275 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9593fff700 1 -- 172.21.15.43:0/3034362275 >> v1:172.21.15.57:6789/0 conn(0x7f959c151a90 legacy=0x7f959c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9593fff700 1 -- 172.21.15.43:0/3034362275 >> v1:172.21.15.43:6789/0 conn(0x7f959c06ad70 legacy=0x7f959c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9593fff700 1 -- 172.21.15.43:0/3034362275 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c151e70 con 0x7f959c0c4630 2023-08-27T11:23:26.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9599d9b700 1 -- 172.21.15.43:0/3034362275 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805799261 0 0) 0x7f959c06c4e0 con 0x7f959c06ad70 2023-08-27T11:23:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9593fff700 1 --2- 172.21.15.43:0/3034362275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0c4630 0x7f959c0c4a90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95840098f0 tx=0x7f9584009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76249070dcb1e71 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9599d9b700 1 -- 172.21.15.43:0/3034362275 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958400b8a0 con 0x7f959c0c4630 2023-08-27T11:23:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9599d9b700 1 -- 172.21.15.43:0/3034362275 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958400ba00 con 0x7f959c0c4630 2023-08-27T11:23:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.766+0000 7f9599d9b700 1 -- 172.21.15.43:0/3034362275 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958400bd90 con 0x7f959c0c4630 2023-08-27T11:23:26.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 -- 172.21.15.43:0/3034362275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0c4630 msgr2=0x7f959c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 --2- 172.21.15.43:0/3034362275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0c4630 0x7f959c0c4a90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95840098f0 tx=0x7f9584009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 -- 172.21.15.43:0/3034362275 shutdown_connections 2023-08-27T11:23:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 --2- 172.21.15.43:0/3034362275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c0c4630 0x7f959c0c4a90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 -- 172.21.15.43:0/3034362275 >> 172.21.15.43:0/3034362275 conn(0x7f959c0ab820 msgr2=0x7f959c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:26.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 -- 172.21.15.43:0/3034362275 shutdown_connections 2023-08-27T11:23:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.767+0000 7f95a0dff700 1 -- 172.21.15.43:0/3034362275 wait complete. 2023-08-27T11:23:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.769+0000 7f95a0dff700 1 Processor -- start 2023-08-27T11:23:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.769+0000 7f95a0dff700 1 -- start start 2023-08-27T11:23:26.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f959c0c4630 0x7f959c145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f959c151a90 0x7f959c146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c152280 con 0x7f959c06ad70 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c146890 con 0x7f959c151a90 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f95a0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c1e9d40 con 0x7f959c0c4630 2023-08-27T11:23:26.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41850/0 (socket says 172.21.15.43:41850) 2023-08-27T11:23:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 -- 172.21.15.43:0/313898715 learned_addr learned my addr 172.21.15.43:0/313898715 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959ad9d700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f959c151a90 0x7f959c146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f9593fff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f959c0c4630 0x7f959c145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 -- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f959c0c4630 msgr2=0x7f959c145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f959c0c4630 0x7f959c145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 -- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f959c151a90 msgr2=0x7f959c146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f959c151a90 0x7f959c146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.770+0000 7f959a59c700 1 -- 172.21.15.43:0/313898715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584009550 con 0x7f959c06ad70 2023-08-27T11:23:26.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f959a59c700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f958c00c450 tx=0x7f958c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0052d0 con 0x7f959c06ad70 2023-08-27T11:23:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c005430 con 0x7f959c06ad70 2023-08-27T11:23:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c1ea020 con 0x7f959c06ad70 2023-08-27T11:23:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0038c0 con 0x7f959c06ad70 2023-08-27T11:23:26.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.771+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1ea5e0 con 0x7f959c06ad70 2023-08-27T11:23:26.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.772+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c1ea770 con 0x7f959c06ad70 2023-08-27T11:23:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.773+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f958c003a20 con 0x7f959c06ad70 2023-08-27T11:23:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.774+0000 7f9592ffd700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 0x7f957c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.774+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f958c0879f0 con 0x7f959c06ad70 2023-08-27T11:23:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.774+0000 7f9593fff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 0x7f957c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:26.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.775+0000 7f9593fff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 0x7f957c06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9584000c00 tx=0x7f9584008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:26.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:26.778+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f958c0530d0 con 0x7f959c06ad70 2023-08-27T11:23:27.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.006+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f959c06a830 con 0x7f959c06ad70 2023-08-27T11:23:27.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.007+0000 7f9592ffd700 1 -- 172.21.15.43:0/313898715 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f958c0566f0 con 0x7f959c06ad70 2023-08-27T11:23:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 msgr2=0x7f957c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 0x7f957c06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9584000c00 tx=0x7f9584008030 comp rx=0 tx=0).stop 2023-08-27T11:23:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 msgr2=0x7f959c148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f958c00c450 tx=0x7f958c00c810 comp rx=0 tx=0).stop 2023-08-27T11:23:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 shutdown_connections 2023-08-27T11:23:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f957c06a0e0 0x7f957c06c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f959c151a90 0x7f959c146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f959c06ad70 0x7f959c148250 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 --2- 172.21.15.43:0/313898715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f959c0c4630 0x7f959c145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 >> 172.21.15.43:0/313898715 conn(0x7f959c0ab820 msgr2=0x7f959c14f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 shutdown_connections 2023-08-27T11:23:27.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.009+0000 7f95a0dff700 1 -- 172.21.15.43:0/313898715 wait complete. 2023-08-27T11:23:27.014 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-08-27T11:23:27.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-27T11:23:27.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:27.029 DEBUG:teuthology.orchestra.run.smithi043:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-27T11:23:27.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi043.front.sepia.ceph.com 2023-08-27T11:23:27.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:27.121 DEBUG:teuthology.orchestra.run.smithi043:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-27T11:23:27.173 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:23:27.174 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:27.222 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:23:27.223 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:27.309 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:23:27.310 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:23:27.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:27.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.593+0000 7fa8b1bff700 1 Processor -- start 2023-08-27T11:23:27.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.593+0000 7fa8b1bff700 1 -- start start 2023-08-27T11:23:27.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.594+0000 7fa8b1bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 0x7fa8ac06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.594+0000 7fa8b1bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8ac06e360 0x7fa8ac157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.594+0000 7fa8b1bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0c4a50 con 0x7fa8ac157fc0 2023-08-27T11:23:27.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.594+0000 7fa8b1bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0c23a0 con 0x7fa8ac06e360 2023-08-27T11:23:27.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.594+0000 7fa8b1bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1548c0 con 0x7fa8ac06a310 2023-08-27T11:23:27.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8abfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa8ac157fc0 0x7fa8ac0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60924/0 (socket says 172.21.15.43:60924) 2023-08-27T11:23:27.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8abfff700 1 -- 172.21.15.43:0/1917300539 learned_addr learned my addr 172.21.15.43:0/1917300539 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/1917300539 >> v2:172.21.15.57:3300/0 conn(0x7fa8ac06e360 0x7fa8ac157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8ab7fe700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 0x7fa8ac06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8aaffd700 1 -- 172.21.15.43:0/1917300539 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690775184 0 0) 0x7fa8ac0c4a50 con 0x7fa8ac157fc0 2023-08-27T11:23:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8aaffd700 1 -- 172.21.15.43:0/1917300539 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8980035b0 con 0x7fa8ac157fc0 2023-08-27T11:23:27.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8a3fff700 1 -- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 msgr2=0x7fa8ac06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:27.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 0x7fa8ac06a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8a3fff700 1 -- 172.21.15.43:0/1917300539 >> v1:172.21.15.43:6789/0 conn(0x7fa8ac157fc0 legacy=0x7fa8ac0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8a3fff700 1 -- 172.21.15.43:0/1917300539 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0c4d30 con 0x7fa8ac06e360 2023-08-27T11:23:27.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.595+0000 7fa8ab7fe700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 0x7fa8ac06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:27.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac157a80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa894009840 tx=0x7fa894009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207e7e6e9f43bc12 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:27.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8aaffd700 1 -- 172.21.15.43:0/1917300539 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011830 con 0x7fa8ac06e360 2023-08-27T11:23:27.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8aaffd700 1 -- 172.21.15.43:0/1917300539 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011990 con 0x7fa8ac06e360 2023-08-27T11:23:27.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8aaffd700 1 -- 172.21.15.43:0/1917300539 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011d20 con 0x7fa8ac06e360 2023-08-27T11:23:27.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8b1bff700 1 -- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 msgr2=0x7fa8ac157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.596+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac157a80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa894009840 tx=0x7fa894009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:27.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 -- 172.21.15.43:0/1917300539 shutdown_connections 2023-08-27T11:23:27.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac06a310 0x7fa8ac06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/1917300539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac157a80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 -- 172.21.15.43:0/1917300539 >> 172.21.15.43:0/1917300539 conn(0x7fa8ac0a85e0 msgr2=0x7fa8ac0a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:27.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 -- 172.21.15.43:0/1917300539 shutdown_connections 2023-08-27T11:23:27.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.597+0000 7fa8b1bff700 1 -- 172.21.15.43:0/1917300539 wait complete. 2023-08-27T11:23:27.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.598+0000 7fa8b1bff700 1 Processor -- start 2023-08-27T11:23:27.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.599+0000 7fa8b1bff700 1 -- start start 2023-08-27T11:23:27.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.599+0000 7fa8b1bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8b1bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8b1bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac157fc0 0x7fa8ac14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8b1bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0aabf0 con 0x7fa8ac06a310 2023-08-27T11:23:27.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8b1bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1544b0 con 0x7fa8ac06e360 2023-08-27T11:23:27.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8b1bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1ea010 con 0x7fa8ac157fc0 2023-08-27T11:23:27.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41856/0 (socket says 172.21.15.43:41856) 2023-08-27T11:23:27.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 -- 172.21.15.43:0/2977182295 learned_addr learned my addr 172.21.15.43:0/2977182295 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:27.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8abfff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac157fc0 0x7fa8ac14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 -- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac157fc0 msgr2=0x7fa8ac14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac157fc0 0x7fa8ac14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 -- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 msgr2=0x7fa8ac071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.600+0000 7fa8ab7fe700 1 -- 172.21.15.43:0/2977182295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0094a0 con 0x7fa8ac06a310 2023-08-27T11:23:27.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8ab7fe700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec10 tx=0x7fa89c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:27.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00c850 con 0x7fa8ac06a310 2023-08-27T11:23:27.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00c9b0 con 0x7fa8ac06a310 2023-08-27T11:23:27.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00cd20 con 0x7fa8ac06a310 2023-08-27T11:23:27.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8940094a0 con 0x7fa8ac06a310 2023-08-27T11:23:27.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.601+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac1541d0 con 0x7fa8ac06a310 2023-08-27T11:23:27.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.602+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac04ee70 con 0x7fa8ac06a310 2023-08-27T11:23:27.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.603+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa89c013470 con 0x7fa8ac06a310 2023-08-27T11:23:27.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.604+0000 7fa8a8ff9700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 0x7fa88c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:27.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.605+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa89c088620 con 0x7fa8ac06a310 2023-08-27T11:23:27.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.605+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 0x7fa88c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:27.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.605+0000 7fa8a3fff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 0x7fa88c06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac06e7a0 tx=0x7fa894008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:27.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.609+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa89c053d00 con 0x7fa8ac06a310 2023-08-27T11:23:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.818+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8ac06d750 con 0x7fa8ac06a310 2023-08-27T11:23:27.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.819+0000 7fa8a8ff9700 1 -- 172.21.15.43:0/2977182295 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18161 (secure 0 0 0) 0x7fa89c057320 con 0x7fa8ac06a310 2023-08-27T11:23:27.822 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:27.822 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":21,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:22:44.949334+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.821+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 msgr2=0x7fa88c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.821+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 0x7fa88c06c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac06e7a0 tx=0x7fa894008030 comp rx=0 tx=0).stop 2023-08-27T11:23:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.821+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 msgr2=0x7fa8ac0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.821+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00ec10 tx=0x7fa89c00ef20 comp rx=0 tx=0).stop 2023-08-27T11:23:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 shutdown_connections 2023-08-27T11:23:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa88c06a0e0 0x7fa88c06c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8ac157fc0 0x7fa8ac14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa8ac06a310 0x7fa8ac0a9610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 --2- 172.21.15.43:0/2977182295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8ac06e360 0x7fa8ac071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 >> 172.21.15.43:0/2977182295 conn(0x7fa8ac0a85e0 msgr2=0x7fa8ac0c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 shutdown_connections 2023-08-27T11:23:27.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:27.822+0000 7fa8b1bff700 1 -- 172.21.15.43:0/2977182295 wait complete. 2023-08-27T11:23:27.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:27.843 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:28.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.045+0000 7f7d63fff700 1 Processor -- start 2023-08-27T11:23:28.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.045+0000 7f7d63fff700 1 -- start start 2023-08-27T11:23:28.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.046+0000 7f7d63fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d5c0c4780 0x7f7d5c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.046+0000 7f7d63fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0c6040 con 0x7f7d5c0c9010 2023-08-27T11:23:28.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.046+0000 7f7d63fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c0c7d00 con 0x7f7d5c151b70 2023-08-27T11:23:28.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d63fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c8510 con 0x7f7d5c0c4780 2023-08-27T11:23:28.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6159a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d5c0c4780 0x7f7d5c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7d5c0c9010 0x7f7d5c0c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60940/0 (socket says 172.21.15.43:60940) 2023-08-27T11:23:28.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6259c700 1 -- 172.21.15.43:0/2308243481 learned_addr learned my addr 172.21.15.43:0/2308243481 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:28.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6159a700 1 -- 172.21.15.43:0/2308243481 >> v1:172.21.15.57:6789/0 conn(0x7f7d5c151b70 legacy=0x7f7d5c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6159a700 1 -- 172.21.15.43:0/2308243481 >> v1:172.21.15.43:6789/0 conn(0x7f7d5c0c9010 legacy=0x7f7d5c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6159a700 1 -- 172.21.15.43:0/2308243481 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0c8b80 con 0x7f7d5c0c4780 2023-08-27T11:23:28.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.047+0000 7f7d6159a700 1 --2- 172.21.15.43:0/2308243481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c0c4780 0x7f7d5c0c4c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009840 tx=0x7f7d4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847d5700efc2fcbc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d60d99700 1 -- 172.21.15.43:0/2308243481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c011830 con 0x7f7d5c0c4780 2023-08-27T11:23:28.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d60d99700 1 -- 172.21.15.43:0/2308243481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c011990 con 0x7f7d5c0c4780 2023-08-27T11:23:28.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d60d99700 1 -- 172.21.15.43:0/2308243481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c011d20 con 0x7f7d5c0c4780 2023-08-27T11:23:28.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 -- 172.21.15.43:0/2308243481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c0c4780 msgr2=0x7f7d5c0c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 --2- 172.21.15.43:0/2308243481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c0c4780 0x7f7d5c0c4c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009840 tx=0x7f7d4c009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:28.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 -- 172.21.15.43:0/2308243481 shutdown_connections 2023-08-27T11:23:28.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 --2- 172.21.15.43:0/2308243481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c0c4780 0x7f7d5c0c4c00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 -- 172.21.15.43:0/2308243481 >> 172.21.15.43:0/2308243481 conn(0x7f7d5c0ab8f0 msgr2=0x7f7d5c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:28.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.048+0000 7f7d63fff700 1 -- 172.21.15.43:0/2308243481 shutdown_connections 2023-08-27T11:23:28.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.049+0000 7f7d63fff700 1 -- 172.21.15.43:0/2308243481 wait complete. 2023-08-27T11:23:28.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.050+0000 7f7d63fff700 1 Processor -- start 2023-08-27T11:23:28.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.050+0000 7f7d63fff700 1 -- start start 2023-08-27T11:23:28.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 0x7f7d5c1e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0c9010 0x7f7d5c0c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c0b60 con 0x7f7d5c151b70 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c0f70 con 0x7f7d5c0c9010 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d63fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0c1210 con 0x7f7d5c0c4780 2023-08-27T11:23:28.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d6259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d6259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41874/0 (socket says 172.21.15.43:41874) 2023-08-27T11:23:28.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.051+0000 7f7d6259c700 1 -- 172.21.15.43:0/1405269089 learned_addr learned my addr 172.21.15.43:0/1405269089 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:28.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6159a700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0c9010 0x7f7d5c0c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d61d9b700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 0x7f7d5c1e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 -- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 msgr2=0x7f7d5c1e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 0x7f7d5c1e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 -- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0c9010 msgr2=0x7f7d5c0c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0c9010 0x7f7d5c0c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 -- 172.21.15.43:0/1405269089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0094a0 con 0x7f7d5c151b70 2023-08-27T11:23:28.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d61d9b700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 0x7f7d5c1e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:28.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d6259c700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400cbc0 tx=0x7f7d5400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400aaa0 con 0x7f7d5c151b70 2023-08-27T11:23:28.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5400ac00 con 0x7f7d5c151b70 2023-08-27T11:23:28.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54012400 con 0x7f7d5c151b70 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.052+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0c14f0 con 0x7f7d5c151b70 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.053+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c0c1ab0 con 0x7f7d5c151b70 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.053+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c0c1ca0 con 0x7f7d5c151b70 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.054+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d5401b3b0 con 0x7f7d5c151b70 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.055+0000 7f7d527fc700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 0x7f7d4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.055+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d54088100 con 0x7f7d5c151b70 2023-08-27T11:23:28.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.056+0000 7f7d61d9b700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 0x7f7d4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.056+0000 7f7d61d9b700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 0x7f7d4006c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000f60 tx=0x7f7d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.060+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d54053890 con 0x7f7d5c151b70 2023-08-27T11:23:28.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.273+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d5c0c0ca0 con 0x7f7d5c151b70 2023-08-27T11:23:28.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.274+0000 7f7d527fc700 1 -- 172.21.15.43:0/1405269089 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d54056eb0 con 0x7f7d5c151b70 2023-08-27T11:23:28.276 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:28.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 msgr2=0x7f7d4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 0x7f7d4006c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000f60 tx=0x7f7d58009040 comp rx=0 tx=0).stop 2023-08-27T11:23:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 msgr2=0x7f7d5c0c3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d5400cbc0 tx=0x7f7d5400ced0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 shutdown_connections 2023-08-27T11:23:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d4006a0e0 0x7f7d4006c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d5c151b70 0x7f7d5c0c3350 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0c4780 0x7f7d5c1e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 --2- 172.21.15.43:0/1405269089 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0c9010 0x7f7d5c0c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 >> 172.21.15.43:0/1405269089 conn(0x7f7d5c0ab8f0 msgr2=0x7f7d5c14fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:28.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 shutdown_connections 2023-08-27T11:23:28.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.277+0000 7f7d63fff700 1 -- 172.21.15.43:0/1405269089 wait complete. 2023-08-27T11:23:28.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:28.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.501+0000 7f28f89ff700 1 Processor -- start 2023-08-27T11:23:28.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.502+0000 7f28f89ff700 1 -- start start 2023-08-27T11:23:28.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f89ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28f4151d20 0x7f28f40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40c7c00 0x7f28f40ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f89ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f4154660 con 0x7f28f40abcc0 2023-08-27T11:23:28.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f89ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40c5750 con 0x7f28f4151d20 2023-08-27T11:23:28.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4154940 con 0x7f28f40c7c00 2023-08-27T11:23:28.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f2d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f28f40abcc0 0x7f28f406a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60956/0 (socket says 172.21.15.43:60956) 2023-08-27T11:23:28.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f28f4151d20 0x7f28f40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28f2d9d700 1 -- 172.21.15.43:0/353622639 learned_addr learned my addr 172.21.15.43:0/353622639 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:28.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.503+0000 7f28ebfff700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40c7c00 0x7f28f40ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f1d9b700 1 -- 172.21.15.43:0/353622639 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928876648 0 0) 0x7f28f4154660 con 0x7f28f40abcc0 2023-08-27T11:23:28.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f1d9b700 1 -- 172.21.15.43:0/353622639 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e00035b0 con 0x7f28f40abcc0 2023-08-27T11:23:28.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f259c700 1 -- 172.21.15.43:0/353622639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40c7c00 msgr2=0x7f28f40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:28.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f259c700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40c7c00 0x7f28f40ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f259c700 1 -- 172.21.15.43:0/353622639 >> v1:172.21.15.43:6789/0 conn(0x7f28f40abcc0 legacy=0x7f28f406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f259c700 1 -- 172.21.15.43:0/353622639 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f4154c20 con 0x7f28f4151d20 2023-08-27T11:23:28.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f259c700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4151d20 0x7f28f40c8110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009840 tx=0x7f28e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539b9977ca84210c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f1d9b700 1 -- 172.21.15.43:0/353622639 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4011830 con 0x7f28f4151d20 2023-08-27T11:23:28.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f1d9b700 1 -- 172.21.15.43:0/353622639 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4011990 con 0x7f28f4151d20 2023-08-27T11:23:28.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.504+0000 7f28f1d9b700 1 -- 172.21.15.43:0/353622639 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4011d20 con 0x7f28f4151d20 2023-08-27T11:23:28.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 -- 172.21.15.43:0/353622639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4151d20 msgr2=0x7f28f40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4151d20 0x7f28f40c8110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009840 tx=0x7f28e4009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:28.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 -- 172.21.15.43:0/353622639 shutdown_connections 2023-08-27T11:23:28.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f4151d20 0x7f28f40c8110 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 --2- 172.21.15.43:0/353622639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40c7c00 0x7f28f40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 -- 172.21.15.43:0/353622639 >> 172.21.15.43:0/353622639 conn(0x7f28f40c9d00 msgr2=0x7f28f40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:28.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 -- 172.21.15.43:0/353622639 shutdown_connections 2023-08-27T11:23:28.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.505+0000 7f28f89ff700 1 -- 172.21.15.43:0/353622639 wait complete. 2023-08-27T11:23:28.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.507+0000 7f28f89ff700 1 Processor -- start 2023-08-27T11:23:28.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.507+0000 7f28f89ff700 1 -- start start 2023-08-27T11:23:28.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 0x7f28f40c1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28f4151d20 0x7f28f414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f41f1830 con 0x7f28f40c7c00 2023-08-27T11:23:28.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f41f2200 con 0x7f28f4151d20 2023-08-27T11:23:28.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c37d0 con 0x7f28f40abcc0 2023-08-27T11:23:28.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41892/0 (socket says 172.21.15.43:41892) 2023-08-27T11:23:28.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 -- 172.21.15.43:0/3008401982 learned_addr learned my addr 172.21.15.43:0/3008401982 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:28.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 -- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 msgr2=0x7f28f40c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f259c700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 0x7f28f40c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f2d9d700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28f4151d20 0x7f28f414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 0x7f28f40c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 -- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28f4151d20 msgr2=0x7f28f414e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28f4151d20 0x7f28f414e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28ebfff700 1 -- 172.21.15.43:0/3008401982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40094a0 con 0x7f28f40c7c00 2023-08-27T11:23:28.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.508+0000 7f28f259c700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 0x7f28f40c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:28.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28ebfff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e9b0 tx=0x7f28dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc009710 con 0x7f28f40c7c00 2023-08-27T11:23:28.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00c850 con 0x7f28f40c7c00 2023-08-27T11:23:28.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00cbc0 con 0x7f28f40c7c00 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40c3ab0 con 0x7f28f40c7c00 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.509+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f414e8e0 con 0x7f28f40c7c00 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.510+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f41f1320 con 0x7f28f40c7c00 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.511+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f28dc00cd20 con 0x7f28f40c7c00 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.512+0000 7f28eaffd700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 0x7f28d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.512+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28dc088690 con 0x7f28f40c7c00 2023-08-27T11:23:28.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.512+0000 7f28f259c700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 0x7f28d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.513+0000 7f28f259c700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 0x7f28d406c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28f414ec80 tx=0x7f28e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.516+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f28f41f1320 con 0x7f28f40c7c00 2023-08-27T11:23:28.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.724+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28f41f19e0 con 0x7f28f40c7c00 2023-08-27T11:23:28.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.724+0000 7f28eaffd700 1 -- 172.21.15.43:0/3008401982 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28f41f19e0 con 0x7f28f40c7c00 2023-08-27T11:23:28.726 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:28.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 msgr2=0x7f28d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 0x7f28d406c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28f414ec80 tx=0x7f28e4008030 comp rx=0 tx=0).stop 2023-08-27T11:23:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 msgr2=0x7f28f41f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e9b0 tx=0x7f28dc00ed70 comp rx=0 tx=0).stop 2023-08-27T11:23:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 shutdown_connections 2023-08-27T11:23:28.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d406a0e0 0x7f28d406c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28f4151d20 0x7f28f414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28f40abcc0 0x7f28f40c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 --2- 172.21.15.43:0/3008401982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28f40c7c00 0x7f28f41f1cc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 >> 172.21.15.43:0/3008401982 conn(0x7f28f40c9d00 msgr2=0x7f28f41507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:28.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 shutdown_connections 2023-08-27T11:23:28.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.727+0000 7f28f89ff700 1 -- 172.21.15.43:0/3008401982 wait complete. 2023-08-27T11:23:28.747 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:28.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.950+0000 7f2af0dff700 1 Processor -- start 2023-08-27T11:23:28.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.950+0000 7f2af0dff700 1 -- start start 2023-08-27T11:23:28.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.951+0000 7f2af0dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2af0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec06ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2af0dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec154660 con 0x7f2aec151d20 2023-08-27T11:23:28.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2af0dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0c5750 con 0x7f2aec0c7c00 2023-08-27T11:23:28.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2af0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec154940 con 0x7f2aec06a8e0 2023-08-27T11:23:28.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2ae3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2aead9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec06ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2ae3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:41192/0 (socket says 172.21.15.43:41192) 2023-08-27T11:23:28.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2ae3fff700 1 -- 172.21.15.43:0/742230908 learned_addr learned my addr 172.21.15.43:0/742230908 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:28.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2aead9d700 1 -- 172.21.15.43:0/742230908 >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 msgr2=0x7f2aec0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:28.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2aead9d700 1 --2- 172.21.15.43:0/742230908 >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2aead9d700 1 -- 172.21.15.43:0/742230908 >> v1:172.21.15.57:6789/0 conn(0x7f2aec151d20 legacy=0x7f2aec0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.952+0000 7f2aead9d700 1 -- 172.21.15.43:0/742230908 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec154c20 con 0x7f2aec06a8e0 2023-08-27T11:23:28.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.953+0000 7f2ae3fff700 1 --2- 172.21.15.43:0/742230908 >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:28.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.953+0000 7f2aead9d700 1 --2- 172.21.15.43:0/742230908 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec06ad30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009d90 tx=0x7f2ae400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=802b22031ee1ace1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.953+0000 7f2ae9d9b700 1 -- 172.21.15.43:0/742230908 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400e070 con 0x7f2aec06a8e0 2023-08-27T11:23:28.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.953+0000 7f2ae9d9b700 1 -- 172.21.15.43:0/742230908 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400bb20 con 0x7f2aec06a8e0 2023-08-27T11:23:28.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.953+0000 7f2ae9d9b700 1 -- 172.21.15.43:0/742230908 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4012430 con 0x7f2aec06a8e0 2023-08-27T11:23:28.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 -- 172.21.15.43:0/742230908 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 msgr2=0x7f2aec06ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 --2- 172.21.15.43:0/742230908 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec06ad30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009d90 tx=0x7f2ae400b330 comp rx=0 tx=0).stop 2023-08-27T11:23:28.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 -- 172.21.15.43:0/742230908 shutdown_connections 2023-08-27T11:23:28.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 --2- 172.21.15.43:0/742230908 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec06ad30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 --2- 172.21.15.43:0/742230908 >> v2:172.21.15.57:3300/0 conn(0x7f2aec0c7c00 0x7f2aec0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 -- 172.21.15.43:0/742230908 >> 172.21.15.43:0/742230908 conn(0x7f2aec0c9d00 msgr2=0x7f2aec0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:28.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 -- 172.21.15.43:0/742230908 shutdown_connections 2023-08-27T11:23:28.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.954+0000 7f2af0dff700 1 -- 172.21.15.43:0/742230908 wait complete. 2023-08-27T11:23:28.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.956+0000 7f2af0dff700 1 Processor -- start 2023-08-27T11:23:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.956+0000 7f2af0dff700 1 -- start start 2023-08-27T11:23:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 0x7f2aec157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c3cb0 con 0x7f2aec151d20 2023-08-27T11:23:28.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec157fe0 con 0x7f2aec0c7c00 2023-08-27T11:23:28.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2af0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1ed9d0 con 0x7f2aec06a8e0 2023-08-27T11:23:28.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2aead9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 0x7f2aec157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2aea59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:41200/0 (socket says 172.21.15.43:41200) 2023-08-27T11:23:28.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2aea59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:34860/0 (socket says 172.21.15.43:34860) 2023-08-27T11:23:28.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 -- 172.21.15.43:0/1249844434 learned_addr learned my addr 172.21.15.43:0/1249844434 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:28.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 -- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 msgr2=0x7f2aec1ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 -- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 msgr2=0x7f2aec157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:28.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 0x7f2aec157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:28.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2ae3fff700 1 -- 172.21.15.43:0/1249844434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009550 con 0x7f2aec0c7c00 2023-08-27T11:23:28.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2aea59c700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:28.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.957+0000 7f2aead9d700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 0x7f2aec157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:28.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2ae3fff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400ebe0 tx=0x7f2ad400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400c850 con 0x7f2aec0c7c00 2023-08-27T11:23:28.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400c9b0 con 0x7f2aec0c7c00 2023-08-27T11:23:28.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400cd40 con 0x7f2aec0c7c00 2023-08-27T11:23:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae4009a70 con 0x7f2aec0c7c00 2023-08-27T11:23:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.958+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec14fbf0 con 0x7f2aec0c7c00 2023-08-27T11:23:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.959+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0c8230 con 0x7f2aec0c7c00 2023-08-27T11:23:28.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.960+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ad4013470 con 0x7f2aec0c7c00 2023-08-27T11:23:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.961+0000 7f2ae2ffd700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 0x7f2acc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:28.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.961+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ad4088620 con 0x7f2aec0c7c00 2023-08-27T11:23:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.961+0000 7f2aea59c700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 0x7f2acc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.962+0000 7f2aea59c700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 0x7f2acc06c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2adc007fd0 tx=0x7f2adc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:28.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:28.966+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2ad4053da0 con 0x7f2aec0c7c00 2023-08-27T11:23:29.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.179+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2aec04ee70 con 0x7f2aec0c7c00 2023-08-27T11:23:29.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.179+0000 7f2ae2ffd700 1 -- 172.21.15.43:0/1249844434 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ad40573c0 con 0x7f2aec0c7c00 2023-08-27T11:23:29.181 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:29.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 msgr2=0x7f2acc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 0x7f2acc06c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2adc007fd0 tx=0x7f2adc009040 comp rx=0 tx=0).stop 2023-08-27T11:23:29.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 msgr2=0x7f2aec157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400ebe0 tx=0x7f2ad400eef0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 shutdown_connections 2023-08-27T11:23:29.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2acc06a0e0 0x7f2acc06c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec151d20 0x7f2aec157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec06a8e0 0x7f2aec1ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 --2- 172.21.15.43:0/1249844434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c7c00 0x7f2aec157560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 >> 172.21.15.43:0/1249844434 conn(0x7f2aec0c9d00 msgr2=0x7f2aec0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:29.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 shutdown_connections 2023-08-27T11:23:29.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.182+0000 7f2af0dff700 1 -- 172.21.15.43:0/1249844434 wait complete. 2023-08-27T11:23:29.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:29.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.405+0000 7f188afff700 1 Processor -- start 2023-08-27T11:23:29.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.405+0000 7f188afff700 1 -- start start 2023-08-27T11:23:29.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f188afff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f188406a580 0x7f18840c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f188afff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f188406b2d0 0x7f18840aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f188afff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840c0ca0 con 0x7f1884152bd0 2023-08-27T11:23:29.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f188afff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1884153150 con 0x7f188406a580 2023-08-27T11:23:29.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f188afff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1884153d50 con 0x7f188406b2d0 2023-08-27T11:23:29.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f1883fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1884152bd0 0x7f1884153640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33794/0 (socket says 172.21.15.43:33794) 2023-08-27T11:23:29.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f1888d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f188406a580 0x7f18840c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.406+0000 7f1883fff700 1 -- 172.21.15.43:0/2364138271 learned_addr learned my addr 172.21.15.43:0/2364138271 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:29.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f188959c700 1 --2- 172.21.15.43:0/2364138271 >> v2:172.21.15.57:3300/0 conn(0x7f188406b2d0 0x7f18840aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f1888d9b700 1 -- 172.21.15.43:0/2364138271 >> v2:172.21.15.57:3300/0 conn(0x7f188406b2d0 msgr2=0x7f18840aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:29.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f1888d9b700 1 --2- 172.21.15.43:0/2364138271 >> v2:172.21.15.57:3300/0 conn(0x7f188406b2d0 0x7f18840aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f1888d9b700 1 -- 172.21.15.43:0/2364138271 >> v1:172.21.15.43:6789/0 conn(0x7f1884152bd0 legacy=0x7f1884153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f18837fe700 1 -- 172.21.15.43:0/2364138271 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067844853 0 0) 0x7f18840c0ca0 con 0x7f1884152bd0 2023-08-27T11:23:29.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f1888d9b700 1 -- 172.21.15.43:0/2364138271 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840c0370 con 0x7f188406a580 2023-08-27T11:23:29.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.407+0000 7f1888d9b700 1 --2- 172.21.15.43:0/2364138271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406a580 0x7f18840c1130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f18840a7e80 tx=0x7f1878009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb67bf02c2feec server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f18837fe700 1 -- 172.21.15.43:0/2364138271 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878011830 con 0x7f188406a580 2023-08-27T11:23:29.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f18837fe700 1 -- 172.21.15.43:0/2364138271 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1878011990 con 0x7f188406a580 2023-08-27T11:23:29.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f18837fe700 1 -- 172.21.15.43:0/2364138271 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878011d20 con 0x7f188406a580 2023-08-27T11:23:29.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 -- 172.21.15.43:0/2364138271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406a580 msgr2=0x7f18840c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 --2- 172.21.15.43:0/2364138271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406a580 0x7f18840c1130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f18840a7e80 tx=0x7f1878009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:29.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 -- 172.21.15.43:0/2364138271 shutdown_connections 2023-08-27T11:23:29.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 --2- 172.21.15.43:0/2364138271 >> v2:172.21.15.57:3300/0 conn(0x7f188406b2d0 0x7f18840aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 --2- 172.21.15.43:0/2364138271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406a580 0x7f18840c1130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 -- 172.21.15.43:0/2364138271 >> 172.21.15.43:0/2364138271 conn(0x7f18840c5850 msgr2=0x7f18840c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 -- 172.21.15.43:0/2364138271 shutdown_connections 2023-08-27T11:23:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.408+0000 7f188afff700 1 -- 172.21.15.43:0/2364138271 wait complete. 2023-08-27T11:23:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.410+0000 7f188afff700 1 Processor -- start 2023-08-27T11:23:29.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.410+0000 7f188afff700 1 -- start start 2023-08-27T11:23:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188406a580 0x7f18841ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1884152bd0 0x7f188414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841ed730 con 0x7f188406b2d0 2023-08-27T11:23:29.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1884071d30 con 0x7f1884152bd0 2023-08-27T11:23:29.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f188afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188414fa80 con 0x7f188406a580 2023-08-27T11:23:29.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f1883fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f1883fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40568/0 (socket says 172.21.15.43:40568) 2023-08-27T11:23:29.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.411+0000 7f1883fff700 1 -- 172.21.15.43:0/3518617482 learned_addr learned my addr 172.21.15.43:0/3518617482 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:29.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1888d9b700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188406a580 0x7f18841ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f188959c700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1884152bd0 0x7f188414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 -- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188406a580 msgr2=0x7f18841ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188406a580 0x7f18841ed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 -- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1884152bd0 msgr2=0x7f188414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1884152bd0 0x7f188414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 -- 172.21.15.43:0/3518617482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780094a0 con 0x7f188406b2d0 2023-08-27T11:23:29.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f1883fff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f187000c570 tx=0x7f187000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870004c80 con 0x7f188406b2d0 2023-08-27T11:23:29.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870004e00 con 0x7f188406b2d0 2023-08-27T11:23:29.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188414ad90 con 0x7f188406b2d0 2023-08-27T11:23:29.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870007310 con 0x7f188406b2d0 2023-08-27T11:23:29.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.412+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188414f7a0 con 0x7f188406b2d0 2023-08-27T11:23:29.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.414+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188414af20 con 0x7f188406b2d0 2023-08-27T11:23:29.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.415+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1870007470 con 0x7f188406b2d0 2023-08-27T11:23:29.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.416+0000 7f18817fa700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 0x7f186806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.416+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1870088380 con 0x7f188406b2d0 2023-08-27T11:23:29.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.416+0000 7f1888d9b700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 0x7f186806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.417+0000 7f1888d9b700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 0x7f186806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.420+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1870053a60 con 0x7f188406b2d0 2023-08-27T11:23:29.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.633+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f188404ee70 con 0x7f188406b2d0 2023-08-27T11:23:29.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.633+0000 7f18817fa700 1 -- 172.21.15.43:0/3518617482 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1870057080 con 0x7f188406b2d0 2023-08-27T11:23:29.635 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:29.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 msgr2=0x7f186806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 0x7f186806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f18780097c0 tx=0x7f187801c040 comp rx=0 tx=0).stop 2023-08-27T11:23:29.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 msgr2=0x7f18840bae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f187000c570 tx=0x7f187000c930 comp rx=0 tx=0).stop 2023-08-27T11:23:29.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 shutdown_connections 2023-08-27T11:23:29.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186806a0e0 0x7f186806c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1884152bd0 0x7f188414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188406a580 0x7f18841ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 --2- 172.21.15.43:0/3518617482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188406b2d0 0x7f18840bae80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 >> 172.21.15.43:0/3518617482 conn(0x7f18840c5850 msgr2=0x7f1884153e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:29.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 shutdown_connections 2023-08-27T11:23:29.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.636+0000 7f188afff700 1 -- 172.21.15.43:0/3518617482 wait complete. 2023-08-27T11:23:29.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-27T11:23:29.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.856+0000 7f48015ff700 1 Processor -- start 2023-08-27T11:23:29.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.856+0000 7f48015ff700 1 -- start start 2023-08-27T11:23:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f47fc151910 0x7f47fc157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 0x7f47fc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc158480 con 0x7f47fc151910 2023-08-27T11:23:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc0c5ae0 con 0x7f47fc0c51a0 2023-08-27T11:23:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f48015ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0c1190 con 0x7f47fc0c15e0 2023-08-27T11:23:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f47faffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f47fc151910 0x7f47fc157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f47faffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f47fc151910 0x7f47fc157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40574/0 (socket says 172.21.15.43:40574) 2023-08-27T11:23:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f47faffd700 1 -- 172.21.15.43:0/3551454724 learned_addr learned my addr 172.21.15.43:0/3551454724 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f47fa7fc700 1 --2- 172.21.15.43:0/3551454724 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 0x7f47fc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.857+0000 7f47fb7fe700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 -- 172.21.15.43:0/3551454724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 msgr2=0x7f47fc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 -- 172.21.15.43:0/3551454724 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 msgr2=0x7f47fc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 --2- 172.21.15.43:0/3551454724 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 0x7f47fc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 -- 172.21.15.43:0/3551454724 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc072900 con 0x7f47fc151910 2023-08-27T11:23:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47fa7fc700 1 --2- 172.21.15.43:0/3551454724 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 0x7f47fc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47faffd700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc157a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0c8ac0 tx=0x7f47ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229470a8f48f70f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47f9ffb700 1 -- 172.21.15.43:0/3551454724 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00b870 con 0x7f47fc151910 2023-08-27T11:23:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47f9ffb700 1 -- 172.21.15.43:0/3551454724 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec00b9d0 con 0x7f47fc151910 2023-08-27T11:23:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.858+0000 7f47f9ffb700 1 -- 172.21.15.43:0/3551454724 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec00bd60 con 0x7f47fc151910 2023-08-27T11:23:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 -- 172.21.15.43:0/3551454724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 msgr2=0x7f47fc157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc157a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0c8ac0 tx=0x7f47ec009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 -- 172.21.15.43:0/3551454724 shutdown_connections 2023-08-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 --2- 172.21.15.43:0/3551454724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc157a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 --2- 172.21.15.43:0/3551454724 >> v2:172.21.15.57:3300/0 conn(0x7f47fc0c51a0 0x7f47fc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 -- 172.21.15.43:0/3551454724 >> 172.21.15.43:0/3551454724 conn(0x7f47fc0a9740 msgr2=0x7f47fc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 -- 172.21.15.43:0/3551454724 shutdown_connections 2023-08-27T11:23:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.859+0000 7f48015ff700 1 -- 172.21.15.43:0/3551454724 wait complete. 2023-08-27T11:23:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.861+0000 7f48015ff700 1 Processor -- start 2023-08-27T11:23:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.861+0000 7f48015ff700 1 -- start start 2023-08-27T11:23:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.861+0000 7f48015ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.861+0000 7f48015ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc0c51a0 0x7f47fc1eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f48015ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f48015ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc1ee150 con 0x7f47fc151910 2023-08-27T11:23:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f48015ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0aa940 con 0x7f47fc0c51a0 2023-08-27T11:23:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f48015ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0aac20 con 0x7f47fc0c15e0 2023-08-27T11:23:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40584/0 (socket says 172.21.15.43:40584) 2023-08-27T11:23:29.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 -- 172.21.15.43:0/4127096232 learned_addr learned my addr 172.21.15.43:0/4127096232 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:29.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fa7fc700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc0c51a0 0x7f47fc1eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47faffd700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 -- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 msgr2=0x7f47fc1ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc1ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 -- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc0c51a0 msgr2=0x7f47fc1eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc0c51a0 0x7f47fc1eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 -- 172.21.15.43:0/4127096232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009550 con 0x7f47fc151910 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.862+0000 7f47fb7fe700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009fd0 tx=0x7f47f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.863+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400ede0 con 0x7f47fc151910 2023-08-27T11:23:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.863+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4014420 con 0x7f47fc151910 2023-08-27T11:23:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.863+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f40147d0 con 0x7f47fc151910 2023-08-27T11:23:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.863+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc0aaf00 con 0x7f47fc151910 2023-08-27T11:23:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.863+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc06d9f0 con 0x7f47fc151910 2023-08-27T11:23:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.864+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc04ee70 con 0x7f47fc151910 2023-08-27T11:23:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.865+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47f4014930 con 0x7f47fc151910 2023-08-27T11:23:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.866+0000 7f47e37fe700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 0x7f47e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.866+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47f4088c80 con 0x7f47fc151910 2023-08-27T11:23:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.866+0000 7f47faffd700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 0x7f47e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.867+0000 7f47faffd700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 0x7f47e806c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47ec014040 tx=0x7f47ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:29.870+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f47f4054360 con 0x7f47fc151910 2023-08-27T11:23:30.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.096+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47fc0c0dc0 con 0x7f47fc151910 2023-08-27T11:23:30.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.096+0000 7f47e37fe700 1 -- 172.21.15.43:0/4127096232 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47f4057980 con 0x7f47fc151910 2023-08-27T11:23:30.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 msgr2=0x7f47e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 0x7f47e806c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f47ec014040 tx=0x7f47ec008030 comp rx=0 tx=0).stop 2023-08-27T11:23:30.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 msgr2=0x7f47fc06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009fd0 tx=0x7f47f400e3c0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 shutdown_connections 2023-08-27T11:23:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f47e806a0e0 0x7f47e806c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f47fc151910 0x7f47fc06c7f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f47fc0c15e0 0x7f47fc1ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 --2- 172.21.15.43:0/4127096232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47fc0c51a0 0x7f47fc1eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 >> 172.21.15.43:0/4127096232 conn(0x7f47fc0a9740 msgr2=0x7f47fc157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:30.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 shutdown_connections 2023-08-27T11:23:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.099+0000 7f48015ff700 1 -- 172.21.15.43:0/4127096232 wait complete. 2023-08-27T11:23:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:listed 0 entries 2023-08-27T11:23:30.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-27T11:23:30.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:30.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-27T11:23:30.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2023-08-27T11:23:30.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-27T11:23:30.232 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-27T11:23:30.298 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:23:30.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:30.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.502+0000 7f11213ff700 1 Processor -- start 2023-08-27T11:23:30.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.502+0000 7f11213ff700 1 -- start start 2023-08-27T11:23:30.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f11213ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f111c151a90 0x7f111c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f11213ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4a90 0x7f111c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f11213ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c06c4e0 con 0x7f111c0c4630 2023-08-27T11:23:30.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f11213ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c155370 con 0x7f111c151a90 2023-08-27T11:23:30.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f11213ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c151e70 con 0x7f111c0c4a90 2023-08-27T11:23:30.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f111a7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f111c0c4630 0x7f111c06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33806/0 (socket says 172.21.15.43:33806) 2023-08-27T11:23:30.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f111a7fc700 1 -- 172.21.15.43:0/2364198862 learned_addr learned my addr 172.21.15.43:0/2364198862 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:30.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f111b7fe700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4a90 0x7f111c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.503+0000 7f111affd700 1 --2- 172.21.15.43:0/2364198862 >> v2:172.21.15.57:3300/0 conn(0x7f111c151a90 0x7f111c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852928386 0 0) 0x7f111c06c4e0 con 0x7f111c0c4630 2023-08-27T11:23:30.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11040035b0 con 0x7f111c0c4630 2023-08-27T11:23:30.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 551709616 0 0) 0x7f11040035b0 con 0x7f111c0c4630 2023-08-27T11:23:30.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f111affd700 1 -- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4a90 msgr2=0x7f111c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:30.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f111affd700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4a90 0x7f111c06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f111affd700 1 -- 172.21.15.43:0/2364198862 >> v1:172.21.15.43:6789/0 conn(0x7f111c0c4630 legacy=0x7f111c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f111affd700 1 -- 172.21.15.43:0/2364198862 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c154480 con 0x7f111c151a90 2023-08-27T11:23:30.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f111affd700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c151a90 0x7f111c0c7bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f110c009840 tx=0x7f110c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a44e1d5b779d04ad server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:30.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110001670 con 0x7f111c151a90 2023-08-27T11:23:30.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c004030 con 0x7f111c151a90 2023-08-27T11:23:30.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.504+0000 7f1119ffb700 1 -- 172.21.15.43:0/2364198862 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0043c0 con 0x7f111c151a90 2023-08-27T11:23:30.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 -- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c151a90 msgr2=0x7f111c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c151a90 0x7f111c0c7bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f110c009840 tx=0x7f110c009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:30.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 -- 172.21.15.43:0/2364198862 shutdown_connections 2023-08-27T11:23:30.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4a90 0x7f111c06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 --2- 172.21.15.43:0/2364198862 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c151a90 0x7f111c0c7bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 -- 172.21.15.43:0/2364198862 >> 172.21.15.43:0/2364198862 conn(0x7f111c0ab820 msgr2=0x7f111c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:30.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 -- 172.21.15.43:0/2364198862 shutdown_connections 2023-08-27T11:23:30.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.505+0000 7f11213ff700 1 -- 172.21.15.43:0/2364198862 wait complete. 2023-08-27T11:23:30.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.507+0000 7f11213ff700 1 Processor -- start 2023-08-27T11:23:30.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.507+0000 7f11213ff700 1 -- start start 2023-08-27T11:23:30.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4630 0x7f111c153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c0c4a90 0x7f111c148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0c9380 con 0x7f111c151a90 2023-08-27T11:23:30.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0c7860 con 0x7f111c0c4a90 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f11213ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c1eddd0 con 0x7f111c0c4630 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f111b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40600/0 (socket says 172.21.15.43:40600) 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f111b7fe700 1 -- 172.21.15.43:0/1214195077 learned_addr learned my addr 172.21.15.43:0/1214195077 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f111a7fc700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c0c4a90 0x7f111c148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.508+0000 7f111affd700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4630 0x7f111c153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 -- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4630 msgr2=0x7f111c153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4630 0x7f111c153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 -- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c0c4a90 msgr2=0x7f111c148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c0c4a90 0x7f111c148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 -- 172.21.15.43:0/1214195077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0094a0 con 0x7f111c151a90 2023-08-27T11:23:30.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f111b7fe700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f111400efc0 tx=0x7f111400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:30.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114009ea0 con 0x7f111c151a90 2023-08-27T11:23:30.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111400f040 con 0x7f111c151a90 2023-08-27T11:23:30.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400ced0 con 0x7f111c151a90 2023-08-27T11:23:30.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c0c2c80 con 0x7f111c151a90 2023-08-27T11:23:30.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.509+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c1edaf0 con 0x7f111c151a90 2023-08-27T11:23:30.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.511+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c0c2e10 con 0x7f111c151a90 2023-08-27T11:23:30.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.511+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1114014480 con 0x7f111c151a90 2023-08-27T11:23:30.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.512+0000 7f11037fe700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.512+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1114089230 con 0x7f111c151a90 2023-08-27T11:23:30.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.513+0000 7f111affd700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:30.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.513+0000 7f111affd700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 0x7f110806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f110c0090b0 tx=0x7f110c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:30.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.516+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1114054880 con 0x7f111c151a90 2023-08-27T11:23:30.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.771+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f111c04ee70 con 0x7f111c151a90 2023-08-27T11:23:30.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.771+0000 7f11037fe700 1 -- 172.21.15.43:0/1214195077 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f1114057ea0 con 0x7f111c151a90 2023-08-27T11:23:30.773 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:30.773 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:30.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 msgr2=0x7f110806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 0x7f110806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f110c0090b0 tx=0x7f110c008030 comp rx=0 tx=0).stop 2023-08-27T11:23:30.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 msgr2=0x7f111c1e6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:30.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f111400efc0 tx=0x7f111400c3a0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 shutdown_connections 2023-08-27T11:23:30.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f110806a0e0 0x7f110806c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f111c151a90 0x7f111c1e6d30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f111c0c4630 0x7f111c153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 --2- 172.21.15.43:0/1214195077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f111c0c4a90 0x7f111c148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 >> 172.21.15.43:0/1214195077 conn(0x7f111c0ab820 msgr2=0x7f111c14cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:30.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 shutdown_connections 2023-08-27T11:23:30.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.774+0000 7f11213ff700 1 -- 172.21.15.43:0/1214195077 wait complete. 2023-08-27T11:23:30.778 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:30.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:30.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.995+0000 7ffa8c7ff700 1 Processor -- start 2023-08-27T11:23:30.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.995+0000 7ffa8c7ff700 1 -- start start 2023-08-27T11:23:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa8c7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffa84151a90 0x7ffa840c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa8c7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8406c4e0 con 0x7ffa840c4630 2023-08-27T11:23:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa8c7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa84155370 con 0x7ffa840c4a90 2023-08-27T11:23:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa8c7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa84151e70 con 0x7ffa84151a90 2023-08-27T11:23:30.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa89d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffa840c4630 0x7ffa8406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33822/0 (socket says 172.21.15.43:33822) 2023-08-27T11:23:30.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.996+0000 7ffa89d9a700 1 -- 172.21.15.43:0/2970973427 learned_addr learned my addr 172.21.15.43:0/2970973427 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/2970973427 >> v2:172.21.15.57:3300/0 conn(0x7ffa84151a90 0x7ffa840c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807722883 0 0) 0x7ffa8406c4e0 con 0x7ffa840c4630 2023-08-27T11:23:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa700035b0 con 0x7ffa840c4630 2023-08-27T11:23:31.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3430085427 0 0) 0x7ffa700035b0 con 0x7ffa840c4630 2023-08-27T11:23:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 >> v2:172.21.15.57:3300/0 conn(0x7ffa84151a90 msgr2=0x7ffa840c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 --2- 172.21.15.43:0/2970973427 >> v2:172.21.15.57:3300/0 conn(0x7ffa84151a90 0x7ffa840c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 >> v1:172.21.15.57:6789/0 conn(0x7ffa840c4a90 legacy=0x7ffa8406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84154480 con 0x7ffa840c4630 2023-08-27T11:23:31.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7ffa74001670 con 0x7ffa840c4630 2023-08-27T11:23:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 >> v1:172.21.15.43:6789/0 conn(0x7ffa840c4630 legacy=0x7ffa8406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 0x7ffa70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.997+0000 7ffa89599700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa70004850 0x7ffa70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89599700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70005260 0x7ffa7000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84151e70 con 0x7ffa70003a50 2023-08-27T11:23:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000c1b0 con 0x7ffa70005260 2023-08-27T11:23:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7000c370 con 0x7ffa70004850 2023-08-27T11:23:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 0x7ffa70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89d9a700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa70004850 0x7ffa70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8ad9c700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70005260 0x7ffa7000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 -- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa70004850 msgr2=0x7ffa70004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa70004850 0x7ffa70004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 -- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70005260 msgr2=0x7ffa7000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70005260 0x7ffa7000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 -- 172.21.15.43:0/2970973427 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa700035b0 con 0x7ffa70003a50 2023-08-27T11:23:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa89d9a700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa70004850 0x7ffa70004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8ad9c700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70005260 0x7ffa7000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8ad9c700 1 -- 172.21.15.43:0/2970973427 reap_dead start 2023-08-27T11:23:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.998+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 0x7ffa70003e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009b30 tx=0x7ffa70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b6673f879001dd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e6c0 con 0x7ffa70003a50 2023-08-27T11:23:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000e820 con 0x7ffa70003a50 2023-08-27T11:23:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa89599700 1 -- 172.21.15.43:0/2970973427 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000eb90 con 0x7ffa70003a50 2023-08-27T11:23:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 msgr2=0x7ffa70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 0x7ffa70003e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009b30 tx=0x7ffa70005880 comp rx=0 tx=0).stop 2023-08-27T11:23:31.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/2970973427 shutdown_connections 2023-08-27T11:23:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/2970973427 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa70003a50 0x7ffa70003e70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/2970973427 >> 172.21.15.43:0/2970973427 conn(0x7ffa840ab820 msgr2=0x7ffa840abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/2970973427 shutdown_connections 2023-08-27T11:23:31.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:30.999+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/2970973427 wait complete. 2023-08-27T11:23:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.001+0000 7ffa8c7ff700 1 Processor -- start 2023-08-27T11:23:31.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.001+0000 7ffa8c7ff700 1 -- start start 2023-08-27T11:23:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 0x7ffa840aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 0x7ffa841e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840be110 con 0x7ffa84153b80 2023-08-27T11:23:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840ab4a0 con 0x7ffa70003a50 2023-08-27T11:23:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa8c7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841ed000 con 0x7ffa840bffe0 2023-08-27T11:23:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.002+0000 7ffa89d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40618/0 (socket says 172.21.15.43:40618) 2023-08-27T11:23:31.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 -- 172.21.15.43:0/3117140978 learned_addr learned my addr 172.21.15.43:0/3117140978 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 0x7ffa840aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8ad9c700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 0x7ffa841e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 -- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 msgr2=0x7ffa841e9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 0x7ffa841e9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 -- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 msgr2=0x7ffa840aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 0x7ffa840aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 -- 172.21.15.43:0/3117140978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa841ed8a0 con 0x7ffa84153b80 2023-08-27T11:23:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 0x7ffa840aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8ad9c700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 0x7ffa841e9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:31.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa89d9a700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e7e0 tx=0x7ffa7400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74012590 con 0x7ffa84153b80 2023-08-27T11:23:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa740126f0 con 0x7ffa84153b80 2023-08-27T11:23:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74012a60 con 0x7ffa84153b80 2023-08-27T11:23:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa841540b0 con 0x7ffa84153b80 2023-08-27T11:23:31.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.003+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa841ed530 con 0x7ffa84153b80 2023-08-27T11:23:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.004+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa841eda30 con 0x7ffa84153b80 2023-08-27T11:23:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.005+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa74012bc0 con 0x7ffa84153b80 2023-08-27T11:23:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.006+0000 7ffa7affd700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 0x7ffa6806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.006+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa740882e0 con 0x7ffa84153b80 2023-08-27T11:23:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.007+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 0x7ffa6806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.007+0000 7ffa8a59b700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 0x7ffa6806c5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa800090b0 tx=0x7ffa80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.011+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffa74057450 con 0x7ffa84153b80 2023-08-27T11:23:31.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.224+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa841ed6f0 con 0x7ffa84153b80 2023-08-27T11:23:31.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.226+0000 7ffa7affd700 1 -- 172.21.15.43:0/3117140978 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18256 (secure 0 0 0) 0x7ffa74056fe0 con 0x7ffa84153b80 2023-08-27T11:23:31.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:31.228 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:31.144061+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 msgr2=0x7ffa6806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 0x7ffa6806c5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa800090b0 tx=0x7ffa80008030 comp rx=0 tx=0).stop 2023-08-27T11:23:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 msgr2=0x7ffa841e9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e7e0 tx=0x7ffa7400eba0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 shutdown_connections 2023-08-27T11:23:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa6806a110 0x7ffa6806c5d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa840bffe0 0x7ffa841e9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa70003a50 0x7ffa840aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 --2- 172.21.15.43:0/3117140978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa84153b80 0x7ffa841e9a90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 >> 172.21.15.43:0/3117140978 conn(0x7ffa840ab820 msgr2=0x7ffa8414d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 shutdown_connections 2023-08-27T11:23:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.228+0000 7ffa8c7ff700 1 -- 172.21.15.43:0/3117140978 wait complete. 2023-08-27T11:23:31.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:22:41.257892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:22:42.453070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:31.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:31.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.451+0000 7fb8b47ff700 1 Processor -- start 2023-08-27T11:23:31.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.452+0000 7fb8b47ff700 1 -- start start 2023-08-27T11:23:31.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b47ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8ac151d20 0x7fb8ac0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b47ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb8ac0c7c00 0x7fb8ac0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b47ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac154660 con 0x7fb8ac0abcc0 2023-08-27T11:23:31.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b47ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac0c5750 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b47ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ac154940 con 0x7fb8ac151d20 2023-08-27T11:23:31.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b1d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb8ac0c7c00 0x7fb8ac0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b2d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb8ac0abcc0 0x7fb8ac06a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33830/0 (socket says 172.21.15.43:33830) 2023-08-27T11:23:31.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b2d9c700 1 -- 172.21.15.43:0/3987411008 learned_addr learned my addr 172.21.15.43:0/3987411008 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:31.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b259b700 1 --2- 172.21.15.43:0/3987411008 >> v2:172.21.15.57:3300/0 conn(0x7fb8ac151d20 0x7fb8ac0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b1599700 1 -- 172.21.15.43:0/3987411008 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124283318 0 0) 0x7fb8ac154660 con 0x7fb8ac0abcc0 2023-08-27T11:23:31.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b1599700 1 -- 172.21.15.43:0/3987411008 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8980035b0 con 0x7fb8ac0abcc0 2023-08-27T11:23:31.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.453+0000 7fb8b1d9a700 1 -- 172.21.15.43:0/3987411008 >> v2:172.21.15.57:3300/0 conn(0x7fb8ac151d20 msgr2=0x7fb8ac0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:31.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1d9a700 1 --2- 172.21.15.43:0/3987411008 >> v2:172.21.15.57:3300/0 conn(0x7fb8ac151d20 0x7fb8ac0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1d9a700 1 -- 172.21.15.43:0/3987411008 >> v1:172.21.15.43:6789/0 conn(0x7fb8ac0abcc0 legacy=0x7fb8ac06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1d9a700 1 -- 172.21.15.43:0/3987411008 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac154c20 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1d9a700 1 --2- 172.21.15.43:0/3987411008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac0c7c00 0x7fb8ac0ab780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0cac10 tx=0x7fb89c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645287f73b70618c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1599700 1 -- 172.21.15.43:0/3987411008 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011830 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1599700 1 -- 172.21.15.43:0/3987411008 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c011990 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.454+0000 7fb8b1599700 1 -- 172.21.15.43:0/3987411008 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c011d20 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 -- 172.21.15.43:0/3987411008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac0c7c00 msgr2=0x7fb8ac0ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/3987411008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac0c7c00 0x7fb8ac0ab780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0cac10 tx=0x7fb89c009b20 comp rx=0 tx=0).stop 2023-08-27T11:23:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 -- 172.21.15.43:0/3987411008 shutdown_connections 2023-08-27T11:23:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/3987411008 >> v2:172.21.15.57:3300/0 conn(0x7fb8ac151d20 0x7fb8ac0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/3987411008 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac0c7c00 0x7fb8ac0ab780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 -- 172.21.15.43:0/3987411008 >> 172.21.15.43:0/3987411008 conn(0x7fb8ac0c9d00 msgr2=0x7fb8ac0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 -- 172.21.15.43:0/3987411008 shutdown_connections 2023-08-27T11:23:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.455+0000 7fb8b47ff700 1 -- 172.21.15.43:0/3987411008 wait complete. 2023-08-27T11:23:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.457+0000 7fb8b47ff700 1 Processor -- start 2023-08-27T11:23:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.457+0000 7fb8b47ff700 1 -- start start 2023-08-27T11:23:31.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 0x7fb8ac0c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8ac0c7c00 0x7fb8ac148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0ab3e0 con 0x7fb8ac151d20 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0c1150 con 0x7fb8ac0abcc0 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac0ab710 con 0x7fb8ac0c7c00 2023-08-27T11:23:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 0x7fb8ac0c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40634/0 (socket says 172.21.15.43:40634) 2023-08-27T11:23:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 -- 172.21.15.43:0/192806206 learned_addr learned my addr 172.21.15.43:0/192806206 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 0x7fb8ac0c15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:41320/0 (socket says 172.21.15.43:41320) 2023-08-27T11:23:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b1d9a700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8ac0c7c00 0x7fb8ac148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 -- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8ac0c7c00 msgr2=0x7fb8ac148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8ac0c7c00 0x7fb8ac148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 -- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 msgr2=0x7fb8ac0c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 0x7fb8ac0c15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.458+0000 7fb8b2d9c700 1 -- 172.21.15.43:0/192806206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0094a0 con 0x7fb8ac151d20 2023-08-27T11:23:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8b2d9c700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400cbb0 tx=0x7fb8a400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400a940 con 0x7fb8ac151d20 2023-08-27T11:23:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400aaa0 con 0x7fb8ac151d20 2023-08-27T11:23:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac0c0de0 con 0x7fb8ac151d20 2023-08-27T11:23:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a400ae30 con 0x7fb8ac151d20 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.459+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac0ab9f0 con 0x7fb8ac151d20 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.460+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac04ee70 con 0x7fb8ac151d20 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.461+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8a4007d50 con 0x7fb8ac151d20 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.462+0000 7fb8a2ffd700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 0x7fb89006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.462+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb8a4087f60 con 0x7fb8ac151d20 2023-08-27T11:23:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.462+0000 7fb8b259b700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 0x7fb89006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.463+0000 7fb8b259b700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 0x7fb89006c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009b40 tx=0x7fb8a8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.466+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb8a4057090 con 0x7fb8ac151d20 2023-08-27T11:23:31.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.679+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb8ac0c1290 con 0x7fb8ac151d20 2023-08-27T11:23:31.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.680+0000 7fb8a2ffd700 1 -- 172.21.15.43:0/192806206 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb8a4017020 con 0x7fb8ac151d20 2023-08-27T11:23:31.682 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 msgr2=0x7fb89006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 0x7fb89006c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009b40 tx=0x7fb8a8009210 comp rx=0 tx=0).stop 2023-08-27T11:23:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 msgr2=0x7fb8ac0c2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400cbb0 tx=0x7fb8a400cec0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 shutdown_connections 2023-08-27T11:23:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb89006a0e0 0x7fb89006c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8ac151d20 0x7fb8ac0c2e80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8ac0abcc0 0x7fb8ac0c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 --2- 172.21.15.43:0/192806206 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8ac0c7c00 0x7fb8ac148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 >> 172.21.15.43:0/192806206 conn(0x7fb8ac0c9d00 msgr2=0x7fb8ac0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:31.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 shutdown_connections 2023-08-27T11:23:31.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.682+0000 7fb8b47ff700 1 -- 172.21.15.43:0/192806206 wait complete. 2023-08-27T11:23:31.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:31.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.905+0000 7fa5965ff700 1 Processor -- start 2023-08-27T11:23:31.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.905+0000 7fa5965ff700 1 -- start start 2023-08-27T11:23:31.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.906+0000 7fa5965ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa590151fc0 0x7fa590158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.906+0000 7fa5965ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 0x7fa5900708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.906+0000 7fa5965ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa590157af0 con 0x7fa5900c0020 2023-08-27T11:23:31.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.906+0000 7fa5965ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590071e10 con 0x7fa590151fc0 2023-08-27T11:23:31.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.906+0000 7fa5965ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa590158a80 con 0x7fa590071f70 2023-08-27T11:23:31.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa590151fc0 0x7fa590158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa594b9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 0x7fa5900708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa590151fc0 0x7fa590158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:41332/0 (socket says 172.21.15.43:41332) 2023-08-27T11:23:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 -- 172.21.15.43:0/3798500724 learned_addr learned my addr 172.21.15.43:0/3798500724 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 -- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 msgr2=0x7fa5900708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 0x7fa5900708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 -- 172.21.15.43:0/3798500724 >> v1:172.21.15.57:6789/0 conn(0x7fa5900c0020 legacy=0x7fa5901518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa58f7fe700 1 -- 172.21.15.43:0/3798500724 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900a6040 con 0x7fa590151fc0 2023-08-27T11:23:31.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.907+0000 7fa594b9c700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 0x7fa5900708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa58f7fe700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa590151fc0 0x7fa590158540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098f0 tx=0x7fa584009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f160392c83161617 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa58effd700 1 -- 172.21.15.43:0/3798500724 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584011830 con 0x7fa590151fc0 2023-08-27T11:23:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa58effd700 1 -- 172.21.15.43:0/3798500724 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa584011990 con 0x7fa590151fc0 2023-08-27T11:23:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa58effd700 1 -- 172.21.15.43:0/3798500724 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa584011d20 con 0x7fa590151fc0 2023-08-27T11:23:31.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa5965ff700 1 -- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa590151fc0 msgr2=0x7fa590158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.908+0000 7fa5965ff700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa590151fc0 0x7fa590158540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa5840098f0 tx=0x7fa584009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:31.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 -- 172.21.15.43:0/3798500724 shutdown_connections 2023-08-27T11:23:31.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590071f70 0x7fa5900708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 --2- 172.21.15.43:0/3798500724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa590151fc0 0x7fa590158540 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 -- 172.21.15.43:0/3798500724 >> 172.21.15.43:0/3798500724 conn(0x7fa5900c6a40 msgr2=0x7fa5900c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:31.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 -- 172.21.15.43:0/3798500724 shutdown_connections 2023-08-27T11:23:31.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.909+0000 7fa5965ff700 1 -- 172.21.15.43:0/3798500724 wait complete. 2023-08-27T11:23:31.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.910+0000 7fa5965ff700 1 Processor -- start 2023-08-27T11:23:31.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.910+0000 7fa5965ff700 1 -- start start 2023-08-27T11:23:31.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5900c0020 0x7fa5901ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590151fc0 0x7fa5901ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590152c90 con 0x7fa590071f70 2023-08-27T11:23:31.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901ec7e0 con 0x7fa5900c0020 2023-08-27T11:23:31.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.911+0000 7fa5965ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901540d0 con 0x7fa590151fc0 2023-08-27T11:23:31.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40642/0 (socket says 172.21.15.43:40642) 2023-08-27T11:23:31.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 -- 172.21.15.43:0/2237884360 learned_addr learned my addr 172.21.15.43:0/2237884360 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:31.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58f7fe700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5900c0020 0x7fa5901ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa594b9c700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590151fc0 0x7fa5901ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 -- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590151fc0 msgr2=0x7fa5901ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590151fc0 0x7fa5901ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 -- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5900c0020 msgr2=0x7fa5901ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:31.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5900c0020 0x7fa5901ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:31.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.912+0000 7fa58ffff700 1 -- 172.21.15.43:0/2237884360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588009a70 con 0x7fa590071f70 2023-08-27T11:23:31.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa58ffff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c4e0 tx=0x7fa58000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800052d0 con 0x7fa590071f70 2023-08-27T11:23:31.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580005430 con 0x7fa590071f70 2023-08-27T11:23:31.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800038c0 con 0x7fa590071f70 2023-08-27T11:23:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa584009550 con 0x7fa590071f70 2023-08-27T11:23:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.913+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5901523f0 con 0x7fa590071f70 2023-08-27T11:23:31.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.914+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5900c4aa0 con 0x7fa590071f70 2023-08-27T11:23:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.915+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa580003a20 con 0x7fa590071f70 2023-08-27T11:23:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.916+0000 7fa58cff9700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 0x7fa57c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.916+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa580087960 con 0x7fa590071f70 2023-08-27T11:23:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.917+0000 7fa58f7fe700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 0x7fa57c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:31.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.917+0000 7fa58f7fe700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 0x7fa57c06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5901523c0 tx=0x7fa584008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:31.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:31.921+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa580053000 con 0x7fa590071f70 2023-08-27T11:23:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.138+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa59004ee70 con 0x7fa590071f70 2023-08-27T11:23:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.138+0000 7fa58cff9700 1 -- 172.21.15.43:0/2237884360 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa580017020 con 0x7fa590071f70 2023-08-27T11:23:32.140 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:32.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 msgr2=0x7fa57c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 0x7fa57c06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5901523c0 tx=0x7fa584008030 comp rx=0 tx=0).stop 2023-08-27T11:23:32.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 msgr2=0x7fa5900a7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa58000c4e0 tx=0x7fa58000c7f0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 shutdown_connections 2023-08-27T11:23:32.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa57c06a0e0 0x7fa57c06c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa590151fc0 0x7fa5901ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa590071f70 0x7fa5900a7c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 --2- 172.21.15.43:0/2237884360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5900c0020 0x7fa5901ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.140+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 >> 172.21.15.43:0/2237884360 conn(0x7fa5900c6a40 msgr2=0x7fa5900708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.141+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 shutdown_connections 2023-08-27T11:23:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.141+0000 7fa5965ff700 1 -- 172.21.15.43:0/2237884360 wait complete. 2023-08-27T11:23:32.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:23:32.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.366+0000 7f5732bff700 1 Processor -- start 2023-08-27T11:23:32.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.366+0000 7f5732bff700 1 -- start start 2023-08-27T11:23:32.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.368+0000 7f5732bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 0x7f572c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.368+0000 7f5732bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f572c06a8e0 0x7f572c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.368+0000 7f5732bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c154660 con 0x7f572c0c7c00 2023-08-27T11:23:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.368+0000 7f5732bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0c5750 con 0x7f572c06a8e0 2023-08-27T11:23:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.368+0000 7f5732bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c154940 con 0x7f572c151d20 2023-08-27T11:23:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f572bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f572c0c7c00 0x7f572c0ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33844/0 (socket says 172.21.15.43:33844) 2023-08-27T11:23:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f572bfff700 1 -- 172.21.15.43:0/406222197 learned_addr learned my addr 172.21.15.43:0/406222197 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:32.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573119c700 1 --2- 172.21.15.43:0/406222197 >> v2:172.21.15.43:3300/0 conn(0x7f572c06a8e0 0x7f572c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573099b700 1 --2- 172.21.15.43:0/406222197 >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 0x7f572c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f572b7fe700 1 -- 172.21.15.43:0/406222197 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015186612 0 0) 0x7f572c154660 con 0x7f572c0c7c00 2023-08-27T11:23:32.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f572b7fe700 1 -- 172.21.15.43:0/406222197 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f571c0035b0 con 0x7f572c0c7c00 2023-08-27T11:23:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573119c700 1 -- 172.21.15.43:0/406222197 >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 msgr2=0x7f572c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573119c700 1 --2- 172.21.15.43:0/406222197 >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 0x7f572c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573119c700 1 -- 172.21.15.43:0/406222197 >> v1:172.21.15.43:6789/0 conn(0x7f572c0c7c00 legacy=0x7f572c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.369+0000 7f573119c700 1 -- 172.21.15.43:0/406222197 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c154c20 con 0x7f572c06a8e0 2023-08-27T11:23:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.370+0000 7f573099b700 1 --2- 172.21.15.43:0/406222197 >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 0x7f572c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.370+0000 7f573119c700 1 --2- 172.21.15.43:0/406222197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c06a8e0 0x7f572c06acf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f572c0cac10 tx=0x7f572400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc2bf1da219b3fb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.370+0000 7f572b7fe700 1 -- 172.21.15.43:0/406222197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400e070 con 0x7f572c06a8e0 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.370+0000 7f572b7fe700 1 -- 172.21.15.43:0/406222197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400bb20 con 0x7f572c06a8e0 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.370+0000 7f572b7fe700 1 -- 172.21.15.43:0/406222197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724012430 con 0x7f572c06a8e0 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 -- 172.21.15.43:0/406222197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c06a8e0 msgr2=0x7f572c06acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 --2- 172.21.15.43:0/406222197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c06a8e0 0x7f572c06acf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f572c0cac10 tx=0x7f572400b330 comp rx=0 tx=0).stop 2023-08-27T11:23:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 -- 172.21.15.43:0/406222197 shutdown_connections 2023-08-27T11:23:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 --2- 172.21.15.43:0/406222197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c06a8e0 0x7f572c06acf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 --2- 172.21.15.43:0/406222197 >> v2:172.21.15.57:3300/0 conn(0x7f572c151d20 0x7f572c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 -- 172.21.15.43:0/406222197 >> 172.21.15.43:0/406222197 conn(0x7f572c0c9d00 msgr2=0x7f572c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 -- 172.21.15.43:0/406222197 shutdown_connections 2023-08-27T11:23:32.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.371+0000 7f5732bff700 1 -- 172.21.15.43:0/406222197 wait complete. 2023-08-27T11:23:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.373+0000 7f5732bff700 1 Processor -- start 2023-08-27T11:23:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.373+0000 7f5732bff700 1 -- start start 2023-08-27T11:23:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f572c06a8e0 0x7f572c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 0x7f572c1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0ab600 con 0x7f572c0c7c00 2023-08-27T11:23:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0ab850 con 0x7f572c151d20 2023-08-27T11:23:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f5732bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1ea320 con 0x7f572c06a8e0 2023-08-27T11:23:32.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f572bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f572bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40652/0 (socket says 172.21.15.43:40652) 2023-08-27T11:23:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f572bfff700 1 -- 172.21.15.43:0/3201696343 learned_addr learned my addr 172.21.15.43:0/3201696343 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.374+0000 7f573119c700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 0x7f572c1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f573099b700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f572c06a8e0 0x7f572c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 -- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f572c06a8e0 msgr2=0x7f572c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f572c06a8e0 0x7f572c1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 -- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 msgr2=0x7f572c1484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 0x7f572c1484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 -- 172.21.15.43:0/3201696343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009a70 con 0x7f572c0c7c00 2023-08-27T11:23:32.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f573119c700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 0x7f572c1484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f572bfff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f571800c700 tx=0x7f571800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718005d70 con 0x7f572c0c7c00 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180070d0 con 0x7f572c0c7c00 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718007460 con 0x7f572c0c7c00 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c1ea600 con 0x7f572c0c7c00 2023-08-27T11:23:32.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.375+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c154310 con 0x7f572c0c7c00 2023-08-27T11:23:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.376+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c1ea180 con 0x7f572c0c7c00 2023-08-27T11:23:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.377+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f57180075c0 con 0x7f572c0c7c00 2023-08-27T11:23:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.379+0000 7f57297fa700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 0x7f571006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.379+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5718087cc0 con 0x7f572c0c7c00 2023-08-27T11:23:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.379+0000 7f573099b700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 0x7f571006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.379+0000 7f573099b700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 0x7f571006c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f572000c900 tx=0x7f5720008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.383+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f572c1ea180 con 0x7f572c0c7c00 2023-08-27T11:23:32.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.592+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f572c1ea180 con 0x7f572c0c7c00 2023-08-27T11:23:32.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.593+0000 7f57297fa700 1 -- 172.21.15.43:0/3201696343 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f572c1ea180 con 0x7f572c0c7c00 2023-08-27T11:23:32.595 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:23:32.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 msgr2=0x7f571006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 0x7f571006c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f572000c900 tx=0x7f5720008040 comp rx=0 tx=0).stop 2023-08-27T11:23:32.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 msgr2=0x7f572c147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f571800c700 tx=0x7f571800cac0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 shutdown_connections 2023-08-27T11:23:32.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f571006a0e0 0x7f571006c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f572c151d20 0x7f572c1484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f572c06a8e0 0x7f572c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 --2- 172.21.15.43:0/3201696343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f572c0c7c00 0x7f572c147f60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 >> 172.21.15.43:0/3201696343 conn(0x7f572c0c9d00 msgr2=0x7f572c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:32.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 shutdown_connections 2023-08-27T11:23:32.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.595+0000 7f5732bff700 1 -- 172.21.15.43:0/3201696343 wait complete. 2023-08-27T11:23:32.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:23:32.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.816+0000 7f56d01ff700 1 Processor -- start 2023-08-27T11:23:32.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.816+0000 7f56d01ff700 1 -- start start 2023-08-27T11:23:32.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56d01ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f56c80c0020 0x7f56c8158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56d01ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56c8071f70 0x7f56c81518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56d01ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c8157af0 con 0x7f56c80724c0 2023-08-27T11:23:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56d01ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c8158a80 con 0x7f56c8071f70 2023-08-27T11:23:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56d01ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c80a6040 con 0x7f56c80c0020 2023-08-27T11:23:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56cd79a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56c8071f70 0x7f56c81518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56cd79a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56c8071f70 0x7f56c81518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40662/0 (socket says 172.21.15.43:40662) 2023-08-27T11:23:32.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.818+0000 7f56cd79a700 1 -- 172.21.15.43:0/4059036070 learned_addr learned my addr 172.21.15.43:0/4059036070 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:32.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cdf9b700 1 --2- 172.21.15.43:0/4059036070 >> v2:172.21.15.57:3300/0 conn(0x7f56c80c0020 0x7f56c8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cd79a700 1 -- 172.21.15.43:0/4059036070 >> v2:172.21.15.57:3300/0 conn(0x7f56c80c0020 msgr2=0x7f56c8158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:32.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cd79a700 1 --2- 172.21.15.43:0/4059036070 >> v2:172.21.15.57:3300/0 conn(0x7f56c80c0020 0x7f56c8158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cd79a700 1 -- 172.21.15.43:0/4059036070 >> v1:172.21.15.57:6789/0 conn(0x7f56c80724c0 legacy=0x7f56c8154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cd79a700 1 -- 172.21.15.43:0/4059036070 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80a6320 con 0x7f56c8071f70 2023-08-27T11:23:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56cd79a700 1 --2- 172.21.15.43:0/4059036070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c8071f70 0x7f56c81518b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56c80c1060 tx=0x7f56b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66259b76c5a93ff server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.819+0000 7f56ccf99700 1 -- 172.21.15.43:0/4059036070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8011830 con 0x7f56c8071f70 2023-08-27T11:23:32.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56ccf99700 1 -- 172.21.15.43:0/4059036070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8011990 con 0x7f56c8071f70 2023-08-27T11:23:32.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56ccf99700 1 -- 172.21.15.43:0/4059036070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8011d20 con 0x7f56c8071f70 2023-08-27T11:23:32.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 -- 172.21.15.43:0/4059036070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c8071f70 msgr2=0x7f56c81518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 --2- 172.21.15.43:0/4059036070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c8071f70 0x7f56c81518b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f56c80c1060 tx=0x7f56b8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 -- 172.21.15.43:0/4059036070 shutdown_connections 2023-08-27T11:23:32.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 --2- 172.21.15.43:0/4059036070 >> v2:172.21.15.57:3300/0 conn(0x7f56c80c0020 0x7f56c8158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 --2- 172.21.15.43:0/4059036070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c8071f70 0x7f56c81518b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 -- 172.21.15.43:0/4059036070 >> 172.21.15.43:0/4059036070 conn(0x7f56c80c6a40 msgr2=0x7f56c80c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:32.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 -- 172.21.15.43:0/4059036070 shutdown_connections 2023-08-27T11:23:32.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.820+0000 7f56d01ff700 1 -- 172.21.15.43:0/4059036070 wait complete. 2023-08-27T11:23:32.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.822+0000 7f56d01ff700 1 Processor -- start 2023-08-27T11:23:32.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.822+0000 7f56d01ff700 1 -- start start 2023-08-27T11:23:32.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56c8071f70 0x7f56c806b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56c80c0020 0x7f56c814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c8147e40 con 0x7f56c80724c0 2023-08-27T11:23:32.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c80aaec0 con 0x7f56c80c0020 2023-08-27T11:23:32.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56d01ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c814d210 con 0x7f56c8071f70 2023-08-27T11:23:32.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56cd79a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56cd79a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40676/0 (socket says 172.21.15.43:40676) 2023-08-27T11:23:32.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56cd79a700 1 -- 172.21.15.43:0/2809145751 learned_addr learned my addr 172.21.15.43:0/2809145751 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:32.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.823+0000 7f56cdf9b700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56c8071f70 0x7f56c806b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56ce79c700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56c80c0020 0x7f56c814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 -- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56c8071f70 msgr2=0x7f56c806b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56c8071f70 0x7f56c806b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 -- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56c80c0020 msgr2=0x7f56c814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:32.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56c80c0020 0x7f56c814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:32.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 -- 172.21.15.43:0/2809145751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8009550 con 0x7f56c80724c0 2023-08-27T11:23:32.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56cd79a700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009130 tx=0x7f56b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8004590 con 0x7f56c80724c0 2023-08-27T11:23:32.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b801e070 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80038a0 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.824+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c80abad0 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.825+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c80ab3b0 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.826+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c80c4af0 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.826+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56b8003a00 con 0x7f56c80724c0 2023-08-27T11:23:32.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.828+0000 7f56be7fc700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 0x7f56ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:32.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.828+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f56b80894c0 con 0x7f56c80724c0 2023-08-27T11:23:32.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.828+0000 7f56cdf9b700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 0x7f56ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:32.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.829+0000 7f56cdf9b700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 0x7f56ac06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009be0 tx=0x7f56c4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:32.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:32.832+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56b8054b60 con 0x7f56c80724c0 2023-08-27T11:23:33.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.045+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56c80c1b10 con 0x7f56c80724c0 2023-08-27T11:23:33.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.046+0000 7f56be7fc700 1 -- 172.21.15.43:0/2809145751 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56b8003cb0 con 0x7f56c80724c0 2023-08-27T11:23:33.047 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:23:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 msgr2=0x7f56ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 0x7f56ac06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009be0 tx=0x7f56c4009210 comp rx=0 tx=0).stop 2023-08-27T11:23:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 msgr2=0x7f56c814c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009130 tx=0x7f56b8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:33.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 shutdown_connections 2023-08-27T11:23:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56ac06a0e0 0x7f56ac06c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56c80c0020 0x7f56c814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56c8071f70 0x7f56c806b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 --2- 172.21.15.43:0/2809145751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56c80724c0 0x7f56c814c790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.048+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 >> 172.21.15.43:0/2809145751 conn(0x7f56c80c6a40 msgr2=0x7f56c8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:33.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.049+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 shutdown_connections 2023-08-27T11:23:33.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.049+0000 7f56d01ff700 1 -- 172.21.15.43:0/2809145751 wait complete. 2023-08-27T11:23:33.068 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:33.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.269+0000 7fceb4dff700 1 Processor -- start 2023-08-27T11:23:33.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.270+0000 7fceb4dff700 1 -- start start 2023-08-27T11:23:33.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceb4dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fceb006ca60 0x7fceb006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceb4dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fceb0155910 0x7fceb0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceb4dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb006d700 con 0x7fceb00c51a0 2023-08-27T11:23:33.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceb4dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb01530b0 con 0x7fceb006ca60 2023-08-27T11:23:33.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceb4dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb014c860 con 0x7fceb0155910 2023-08-27T11:23:33.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceae59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fceb00c51a0 0x7fceb00aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33860/0 (socket says 172.21.15.43:33860) 2023-08-27T11:23:33.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceae59c700 1 -- 172.21.15.43:0/2526469201 learned_addr learned my addr 172.21.15.43:0/2526469201 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:33.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2526469201 >> v2:172.21.15.43:3300/0 conn(0x7fceb006ca60 0x7fceb006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceaed9d700 1 --2- 172.21.15.43:0/2526469201 >> v2:172.21.15.57:3300/0 conn(0x7fceb0155910 0x7fceb0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceadd9b700 1 -- 172.21.15.43:0/2526469201 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206302750 0 0) 0x7fceb006d700 con 0x7fceb00c51a0 2023-08-27T11:23:33.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fceadd9b700 1 -- 172.21.15.43:0/2526469201 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce9c0035b0 con 0x7fceb00c51a0 2023-08-27T11:23:33.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fcea7fff700 1 -- 172.21.15.43:0/2526469201 >> v2:172.21.15.57:3300/0 conn(0x7fceb0155910 msgr2=0x7fceb0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:33.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2526469201 >> v2:172.21.15.57:3300/0 conn(0x7fceb0155910 0x7fceb0155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fcea7fff700 1 -- 172.21.15.43:0/2526469201 >> v1:172.21.15.43:6789/0 conn(0x7fceb00c51a0 legacy=0x7fceb00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.271+0000 7fcea7fff700 1 -- 172.21.15.43:0/2526469201 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0152430 con 0x7fceb006ca60 2023-08-27T11:23:33.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2526469201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb006ca60 0x7fceb006d1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fceb0153440 tx=0x7fce98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8266d3eb502cd43b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fceadd9b700 1 -- 172.21.15.43:0/2526469201 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98011830 con 0x7fceb006ca60 2023-08-27T11:23:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fceadd9b700 1 -- 172.21.15.43:0/2526469201 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98011990 con 0x7fceb006ca60 2023-08-27T11:23:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fceadd9b700 1 -- 172.21.15.43:0/2526469201 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98011d20 con 0x7fceb006ca60 2023-08-27T11:23:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fceb4dff700 1 -- 172.21.15.43:0/2526469201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb006ca60 msgr2=0x7fceb006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.272+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2526469201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb006ca60 0x7fceb006d1c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fceb0153440 tx=0x7fce98009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 -- 172.21.15.43:0/2526469201 shutdown_connections 2023-08-27T11:23:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2526469201 >> v2:172.21.15.57:3300/0 conn(0x7fceb0155910 0x7fceb0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2526469201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb006ca60 0x7fceb006d1c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 -- 172.21.15.43:0/2526469201 >> 172.21.15.43:0/2526469201 conn(0x7fceb006aa50 msgr2=0x7fceb00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:33.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 -- 172.21.15.43:0/2526469201 shutdown_connections 2023-08-27T11:23:33.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.273+0000 7fceb4dff700 1 -- 172.21.15.43:0/2526469201 wait complete. 2023-08-27T11:23:33.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.274+0000 7fceb4dff700 1 Processor -- start 2023-08-27T11:23:33.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 -- start start 2023-08-27T11:23:33.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb006ca60 0x7fceb00bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fceb0155910 0x7fceb0149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb01495d0 con 0x7fceb00c51a0 2023-08-27T11:23:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb01e82f0 con 0x7fceb006ca60 2023-08-27T11:23:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.275+0000 7fceb4dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00a8350 con 0x7fceb0155910 2023-08-27T11:23:33.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40696/0 (socket says 172.21.15.43:40696) 2023-08-27T11:23:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 -- 172.21.15.43:0/2847079322 learned_addr learned my addr 172.21.15.43:0/2847079322 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fceaed9d700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fceb0155910 0x7fceb0149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fceae59c700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb006ca60 0x7fceb00bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 -- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fceb0155910 msgr2=0x7fceb0149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fceb0155910 0x7fceb0149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 -- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb006ca60 msgr2=0x7fceb00bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb006ca60 0x7fceb00bbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 -- 172.21.15.43:0/2847079322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980094a0 con 0x7fceb00c51a0 2023-08-27T11:23:33.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.276+0000 7fcea7fff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce980097c0 tx=0x7fce98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.277+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98004510 con 0x7fceb00c51a0 2023-08-27T11:23:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.277+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9801e070 con 0x7fceb00c51a0 2023-08-27T11:23:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.277+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00a7a60 con 0x7fceb00c51a0 2023-08-27T11:23:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.277+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce980038e0 con 0x7fceb00c51a0 2023-08-27T11:23:33.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.277+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb00a7fe0 con 0x7fceb00c51a0 2023-08-27T11:23:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.278+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb00a64b0 con 0x7fceb00c51a0 2023-08-27T11:23:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.279+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce98003a40 con 0x7fceb00c51a0 2023-08-27T11:23:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.280+0000 7fcea6ffd700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 0x7fce9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.280+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fce98088e80 con 0x7fceb00c51a0 2023-08-27T11:23:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.280+0000 7fceae59c700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 0x7fce9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.280+0000 7fceae59c700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 0x7fce9006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea0007fd0 tx=0x7fcea0007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.285+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fceb00a64b0 con 0x7fceb00c51a0 2023-08-27T11:23:33.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.541+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fceb00a64b0 con 0x7fceb00c51a0 2023-08-27T11:23:33.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.542+0000 7fcea6ffd700 1 -- 172.21.15.43:0/2847079322 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7fceb00a64b0 con 0x7fceb00c51a0 2023-08-27T11:23:33.544 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:33.544 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 msgr2=0x7fce9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 0x7fce9006c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcea0007fd0 tx=0x7fcea0007dc0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 msgr2=0x7fceb0148b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fce980097c0 tx=0x7fce98004750 comp rx=0 tx=0).stop 2023-08-27T11:23:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 shutdown_connections 2023-08-27T11:23:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fce9006a0e0 0x7fce9006c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fceb0155910 0x7fceb0149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fceb006ca60 0x7fceb00bbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 --2- 172.21.15.43:0/2847079322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fceb00c51a0 0x7fceb0148b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 >> 172.21.15.43:0/2847079322 conn(0x7fceb006aa50 msgr2=0x7fceb0154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 shutdown_connections 2023-08-27T11:23:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.544+0000 7fceb4dff700 1 -- 172.21.15.43:0/2847079322 wait complete. 2023-08-27T11:23:33.548 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:33.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:33.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.762+0000 7f8d279ff700 1 Processor -- start 2023-08-27T11:23:33.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.763+0000 7f8d279ff700 1 -- start start 2023-08-27T11:23:33.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d279ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8d20151a90 0x7f8d200c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d279ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8d200c4a90 0x7f8d2006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d279ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2006c4e0 con 0x7f8d200c4630 2023-08-27T11:23:33.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d279ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d20155370 con 0x7f8d20151a90 2023-08-27T11:23:33.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d279ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d20151e70 con 0x7f8d200c4a90 2023-08-27T11:23:33.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d2579b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8d20151a90 0x7f8d200c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d2579b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8d20151a90 0x7f8d200c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40708/0 (socket says 172.21.15.43:40708) 2023-08-27T11:23:33.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d2579b700 1 -- 172.21.15.43:0/2763860199 learned_addr learned my addr 172.21.15.43:0/2763860199 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:33.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d25f9c700 1 --2- 172.21.15.43:0/2763860199 >> v2:172.21.15.57:3300/0 conn(0x7f8d200c4a90 0x7f8d2006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.764+0000 7f8d2579b700 1 -- 172.21.15.43:0/2763860199 >> v2:172.21.15.57:3300/0 conn(0x7f8d200c4a90 msgr2=0x7f8d2006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:33.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d2579b700 1 --2- 172.21.15.43:0/2763860199 >> v2:172.21.15.57:3300/0 conn(0x7f8d200c4a90 0x7f8d2006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d2579b700 1 -- 172.21.15.43:0/2763860199 >> v1:172.21.15.57:6789/0 conn(0x7f8d200c4630 legacy=0x7f8d2006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d2579b700 1 -- 172.21.15.43:0/2763860199 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20154480 con 0x7f8d20151a90 2023-08-27T11:23:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d2579b700 1 --2- 172.21.15.43:0/2763860199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d20151a90 0x7f8d200c7bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8d200c4270 tx=0x7f8d1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1946eeff1acdee4a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d17fff700 1 -- 172.21.15.43:0/2763860199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011830 con 0x7f8d20151a90 2023-08-27T11:23:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d17fff700 1 -- 172.21.15.43:0/2763860199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c011990 con 0x7f8d20151a90 2023-08-27T11:23:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d17fff700 1 -- 172.21.15.43:0/2763860199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c011d20 con 0x7f8d20151a90 2023-08-27T11:23:33.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d279ff700 1 -- 172.21.15.43:0/2763860199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d20151a90 msgr2=0x7f8d200c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.765+0000 7f8d279ff700 1 --2- 172.21.15.43:0/2763860199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d20151a90 0x7f8d200c7bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8d200c4270 tx=0x7f8d1c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 -- 172.21.15.43:0/2763860199 shutdown_connections 2023-08-27T11:23:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 --2- 172.21.15.43:0/2763860199 >> v2:172.21.15.57:3300/0 conn(0x7f8d200c4a90 0x7f8d2006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 --2- 172.21.15.43:0/2763860199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d20151a90 0x7f8d200c7bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 -- 172.21.15.43:0/2763860199 >> 172.21.15.43:0/2763860199 conn(0x7f8d200ab820 msgr2=0x7f8d200abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:33.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 -- 172.21.15.43:0/2763860199 shutdown_connections 2023-08-27T11:23:33.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.766+0000 7f8d279ff700 1 -- 172.21.15.43:0/2763860199 wait complete. 2023-08-27T11:23:33.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.767+0000 7f8d279ff700 1 Processor -- start 2023-08-27T11:23:33.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.767+0000 7f8d279ff700 1 -- start start 2023-08-27T11:23:33.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8d200c4a90 0x7f8d200aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 0x7f8d201ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200c1720 con 0x7f8d200c4630 2023-08-27T11:23:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2014e1b0 con 0x7f8d20151a90 2023-08-27T11:23:33.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.768+0000 7f8d279ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2014dd20 con 0x7f8d200c4a90 2023-08-27T11:23:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40720/0 (socket says 172.21.15.43:40720) 2023-08-27T11:23:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 -- 172.21.15.43:0/1934040284 learned_addr learned my addr 172.21.15.43:0/1934040284 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d25f9c700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 0x7f8d201ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d24f9a700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8d200c4a90 0x7f8d200aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 -- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8d200c4a90 msgr2=0x7f8d200aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8d200c4a90 0x7f8d200aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 -- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 msgr2=0x7f8d201ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 0x7f8d201ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 -- 172.21.15.43:0/1934040284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c009550 con 0x7f8d200c4630 2023-08-27T11:23:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d25f9c700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 0x7f8d201ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d2579b700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ac6e0 tx=0x7f8d1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c0036a0 con 0x7f8d200c4630 2023-08-27T11:23:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.769+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c01e070 con 0x7f8d200c4630 2023-08-27T11:23:33.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.770+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2014d3f0 con 0x7f8d200c4630 2023-08-27T11:23:33.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.770+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c003a60 con 0x7f8d200c4630 2023-08-27T11:23:33.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.770+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2014d9b0 con 0x7f8d200c4630 2023-08-27T11:23:33.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.771+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2004ee70 con 0x7f8d200c4630 2023-08-27T11:23:33.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.772+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8d1c003bc0 con 0x7f8d200c4630 2023-08-27T11:23:33.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.773+0000 7f8d15ffb700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 0x7f8d0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.773+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8d1c089540 con 0x7f8d200c4630 2023-08-27T11:23:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.773+0000 7f8d24f9a700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 0x7f8d0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:33.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.774+0000 7f8d24f9a700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 0x7f8d0406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d20153ed0 tx=0x7f8d10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:33.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.777+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8d1c054be0 con 0x7f8d200c4630 2023-08-27T11:23:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.989+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d200c3c70 con 0x7f8d200c4630 2023-08-27T11:23:33.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.990+0000 7f8d15ffb700 1 -- 172.21.15.43:0/1934040284 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f8d1c058200 con 0x7f8d200c4630 2023-08-27T11:23:33.992 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:33.992 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:32.151522+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 msgr2=0x7f8d0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 0x7f8d0406c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8d20153ed0 tx=0x7f8d10009040 comp rx=0 tx=0).stop 2023-08-27T11:23:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 msgr2=0x7f8d201ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8d200ac6e0 tx=0x7f8d1c004750 comp rx=0 tx=0).stop 2023-08-27T11:23:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 shutdown_connections 2023-08-27T11:23:33.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8d0406a0e0 0x7f8d0406c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d20151a90 0x7f8d201ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8d200c4630 0x7f8d201ea580 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 --2- 172.21.15.43:0/1934040284 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8d200c4a90 0x7f8d200aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:33.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 >> 172.21.15.43:0/1934040284 conn(0x7f8d200ab820 msgr2=0x7f8d200c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:33.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 shutdown_connections 2023-08-27T11:23:33.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:33.992+0000 7f8d279ff700 1 -- 172.21.15.43:0/1934040284 wait complete. 2023-08-27T11:23:34.012 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:23:34.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:34.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.213+0000 7f9ab2bff700 1 Processor -- start 2023-08-27T11:23:34.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.213+0000 7f9ab2bff700 1 -- start start 2023-08-27T11:23:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.214+0000 7f9ab2bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9aac0c50d0 0x7f9aac0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.214+0000 7f9ab2bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac154d00 con 0x7f9aac14e960 2023-08-27T11:23:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.214+0000 7f9ab2bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac154fe0 con 0x7f9aac154740 2023-08-27T11:23:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.214+0000 7f9ab2bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac0baf30 con 0x7f9aac0c50d0 2023-08-27T11:23:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9aabfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9aac0c50d0 0x7f9aac0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9ab099b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9aac14e960 0x7f9aac0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33876/0 (socket says 172.21.15.43:33876) 2023-08-27T11:23:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9ab099b700 1 -- 172.21.15.43:0/849234494 learned_addr learned my addr 172.21.15.43:0/849234494 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9aabfff700 1 -- 172.21.15.43:0/849234494 >> v1:172.21.15.57:6789/0 conn(0x7f9aac154740 legacy=0x7f9aac0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9aabfff700 1 -- 172.21.15.43:0/849234494 >> v1:172.21.15.43:6789/0 conn(0x7f9aac14e960 legacy=0x7f9aac0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9aabfff700 1 -- 172.21.15.43:0/849234494 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac1552c0 con 0x7f9aac0c50d0 2023-08-27T11:23:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.215+0000 7f9aab7fe700 1 -- 172.21.15.43:0/849234494 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235905016 0 0) 0x7f9aac154d00 con 0x7f9aac14e960 2023-08-27T11:23:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9aabfff700 1 --2- 172.21.15.43:0/849234494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac0c3cc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009840 tx=0x7f9a98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a765eecd908f20 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9aab7fe700 1 -- 172.21.15.43:0/849234494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98004230 con 0x7f9aac0c50d0 2023-08-27T11:23:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9aab7fe700 1 -- 172.21.15.43:0/849234494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98004390 con 0x7f9aac0c50d0 2023-08-27T11:23:34.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9aab7fe700 1 -- 172.21.15.43:0/849234494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980036a0 con 0x7f9aac0c50d0 2023-08-27T11:23:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9ab2bff700 1 -- 172.21.15.43:0/849234494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 msgr2=0x7f9aac0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.216+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/849234494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac0c3cc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009840 tx=0x7f9a98009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.217+0000 7f9ab2bff700 1 -- 172.21.15.43:0/849234494 shutdown_connections 2023-08-27T11:23:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.217+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/849234494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac0c3cc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.217+0000 7f9ab2bff700 1 -- 172.21.15.43:0/849234494 >> 172.21.15.43:0/849234494 conn(0x7f9aac06aa50 msgr2=0x7f9aac0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.217+0000 7f9ab2bff700 1 -- 172.21.15.43:0/849234494 shutdown_connections 2023-08-27T11:23:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.217+0000 7f9ab2bff700 1 -- 172.21.15.43:0/849234494 wait complete. 2023-08-27T11:23:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.219+0000 7f9ab2bff700 1 Processor -- start 2023-08-27T11:23:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.219+0000 7f9ab2bff700 1 -- start start 2023-08-27T11:23:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 0x7f9aac0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 0x7f9aac149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0ab900 con 0x7f9aac0c50d0 2023-08-27T11:23:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac14adb0 con 0x7f9aac14e960 2023-08-27T11:23:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.220+0000 7f9ab2bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac14b090 con 0x7f9aac154740 2023-08-27T11:23:34.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40744/0 (socket says 172.21.15.43:40744) 2023-08-27T11:23:34.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 -- 172.21.15.43:0/410577503 learned_addr learned my addr 172.21.15.43:0/410577503 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:34.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9aabfff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 0x7f9aac0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab119c700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 0x7f9aac149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 -- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 msgr2=0x7f9aac149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 0x7f9aac149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 -- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 msgr2=0x7f9aac0aaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 0x7f9aac0aaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 -- 172.21.15.43:0/410577503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980094a0 con 0x7f9aac0c50d0 2023-08-27T11:23:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9aabfff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 0x7f9aac0aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab119c700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 0x7f9aac149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.221+0000 7f9ab099b700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00011e0 tx=0x7f9aa000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.222+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004c80 con 0x7f9aac0c50d0 2023-08-27T11:23:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.222+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac14b370 con 0x7f9aac0c50d0 2023-08-27T11:23:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.222+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0004e00 con 0x7f9aac0c50d0 2023-08-27T11:23:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.222+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007310 con 0x7f9aac0c50d0 2023-08-27T11:23:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.222+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac14b930 con 0x7f9aac0c50d0 2023-08-27T11:23:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.223+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac04ee70 con 0x7f9aac0c50d0 2023-08-27T11:23:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.224+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9aa0007470 con 0x7f9aac0c50d0 2023-08-27T11:23:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.225+0000 7f9aa97fa700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 0x7f9a9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.225+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9aa0088460 con 0x7f9aac0c50d0 2023-08-27T11:23:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.225+0000 7f9aabfff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 0x7f9a9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.226+0000 7f9aabfff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 0x7f9a9006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009840 tx=0x7f9a9801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.229+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9aa00539f0 con 0x7f9aac0c50d0 2023-08-27T11:23:34.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.483+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9aac0bbd00 con 0x7f9aac0c50d0 2023-08-27T11:23:34.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.484+0000 7f9aa97fa700 1 -- 172.21.15.43:0/410577503 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7f9aa0057010 con 0x7f9aac0c50d0 2023-08-27T11:23:34.486 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:34.486 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:34.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 msgr2=0x7f9a9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 0x7f9a9006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009840 tx=0x7f9a9801c040 comp rx=0 tx=0).stop 2023-08-27T11:23:34.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 msgr2=0x7f9aac1e71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00011e0 tx=0x7f9aa000cae0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 shutdown_connections 2023-08-27T11:23:34.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a9006a0e0 0x7f9a9006c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9aac154740 0x7f9aac149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9aac0c50d0 0x7f9aac1e71a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 --2- 172.21.15.43:0/410577503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9aac14e960 0x7f9aac0aaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 >> 172.21.15.43:0/410577503 conn(0x7f9aac06aa50 msgr2=0x7f9aac0c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:34.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 shutdown_connections 2023-08-27T11:23:34.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.487+0000 7f9ab2bff700 1 -- 172.21.15.43:0/410577503 wait complete. 2023-08-27T11:23:34.491 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:34.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:34.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.704+0000 7fe3d0fff700 1 Processor -- start 2023-08-27T11:23:34.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.704+0000 7fe3d0fff700 1 -- start start 2023-08-27T11:23:34.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3d0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3d0fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc06c4e0 con 0x7fe3cc151a90 2023-08-27T11:23:34.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3d0fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc155370 con 0x7fe3cc06ad70 2023-08-27T11:23:34.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3d0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0c82c0 con 0x7fe3cc0c4630 2023-08-27T11:23:34.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3ca59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe3cc151a90 0x7fe3cc0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33878/0 (socket says 172.21.15.43:33878) 2023-08-27T11:23:34.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3ca59c700 1 -- 172.21.15.43:0/1508239658 learned_addr learned my addr 172.21.15.43:0/1508239658 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:34.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3c3fff700 1 --2- 172.21.15.43:0/1508239658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634428138 0 0) 0x7fe3cc06c4e0 con 0x7fe3cc151a90 2023-08-27T11:23:34.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b80035b0 con 0x7fe3cc151a90 2023-08-27T11:23:34.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659972083 0 0) 0x7fe3cc155370 con 0x7fe3cc06ad70 2023-08-27T11:23:34.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.706+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3cc06c4e0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c3fff700 1 -- 172.21.15.43:0/1508239658 >> v1:172.21.15.57:6789/0 conn(0x7fe3cc06ad70 legacy=0x7fe3cc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c3fff700 1 -- 172.21.15.43:0/1508239658 >> v1:172.21.15.43:6789/0 conn(0x7fe3cc151a90 legacy=0x7fe3cc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c3fff700 1 -- 172.21.15.43:0/1508239658 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc151e70 con 0x7fe3cc0c4630 2023-08-27T11:23:34.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c3fff700 1 --2- 172.21.15.43:0/1508239658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc0c4a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009870 tx=0x7fe3b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55048e88e842ac68 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4011830 con 0x7fe3cc0c4630 2023-08-27T11:23:34.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b4011990 con 0x7fe3cc0c4630 2023-08-27T11:23:34.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.707+0000 7fe3c9d9b700 1 -- 172.21.15.43:0/1508239658 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4011d20 con 0x7fe3cc0c4630 2023-08-27T11:23:34.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 -- 172.21.15.43:0/1508239658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 msgr2=0x7fe3cc0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/1508239658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc0c4a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009870 tx=0x7fe3b4009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:34.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 -- 172.21.15.43:0/1508239658 shutdown_connections 2023-08-27T11:23:34.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/1508239658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc0c4a90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 -- 172.21.15.43:0/1508239658 >> 172.21.15.43:0/1508239658 conn(0x7fe3cc0ab820 msgr2=0x7fe3cc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:34.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 -- 172.21.15.43:0/1508239658 shutdown_connections 2023-08-27T11:23:34.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.708+0000 7fe3d0fff700 1 -- 172.21.15.43:0/1508239658 wait complete. 2023-08-27T11:23:34.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.710+0000 7fe3d0fff700 1 Processor -- start 2023-08-27T11:23:34.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.710+0000 7fe3d0fff700 1 -- start start 2023-08-27T11:23:34.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3cc151a90 0x7fe3cc14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc14cd20 con 0x7fe3cc06ad70 2023-08-27T11:23:34.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc14c0a0 con 0x7fe3cc151a90 2023-08-27T11:23:34.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3d0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc14c380 con 0x7fe3cc0c4630 2023-08-27T11:23:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40760/0 (socket says 172.21.15.43:40760) 2023-08-27T11:23:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 -- 172.21.15.43:0/4042853652 learned_addr learned my addr 172.21.15.43:0/4042853652 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3c3fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3cad9d700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3cc151a90 0x7fe3cc14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 -- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 msgr2=0x7fe3cc149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 -- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3cc151a90 msgr2=0x7fe3cc14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3cc151a90 0x7fe3cc14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.712+0000 7fe3ca59c700 1 -- 172.21.15.43:0/4042853652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40094a0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3ca59c700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00c700 tx=0x7fe3bc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc005d70 con 0x7fe3cc06ad70 2023-08-27T11:23:34.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0070d0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc007460 con 0x7fe3cc06ad70 2023-08-27T11:23:34.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc14c660 con 0x7fe3cc06ad70 2023-08-27T11:23:34.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.713+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc14a4c0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.714+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc04ee70 con 0x7fe3cc06ad70 2023-08-27T11:23:34.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.715+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe3bc0075c0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.716+0000 7fe3c2ffd700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 0x7fe3ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:34.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.716+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe3bc087bb0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.716+0000 7fe3c3fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 0x7fe3ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:34.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.717+0000 7fe3c3fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 0x7fe3ac06c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097c0 tx=0x7fe3b401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:34.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.720+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe3bc0531c0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.973+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3cc14cf90 con 0x7fe3cc06ad70 2023-08-27T11:23:34.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.974+0000 7fe3c2ffd700 1 -- 172.21.15.43:0/4042853652 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4869 (secure 0 0 0) 0x7fe3bc0567e0 con 0x7fe3cc06ad70 2023-08-27T11:23:34.976 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:34.976 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/4291203422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":4291203422},{"type":"v1","addr":"172.21.15.43:6837","nonce":4291203422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/3849037931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3849037931},{"type":"v1","addr":"172.21.15.57:6833","nonce":3849037931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2596754698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2596754698},{"type":"v1","addr":"172.21.15.43:6836","nonce":2596754698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:22:43.471610+0000","modified":"2023-08-27T11:22:46.990039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1109413426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":1109413426},{"type":"v1","addr":"172.21.15.57:6835","nonce":1109413426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-27T11:23:34.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 msgr2=0x7fe3ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 0x7fe3ac06c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40097c0 tx=0x7fe3b401c040 comp rx=0 tx=0).stop 2023-08-27T11:23:34.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 msgr2=0x7fe3cc1ea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:34.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00c700 tx=0x7fe3bc00ca10 comp rx=0 tx=0).stop 2023-08-27T11:23:34.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 shutdown_connections 2023-08-27T11:23:34.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3ac06a0e0 0x7fe3ac06c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3cc151a90 0x7fe3cc14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3cc06ad70 0x7fe3cc1ea850 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 --2- 172.21.15.43:0/4042853652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3cc0c4630 0x7fe3cc149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:34.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 >> 172.21.15.43:0/4042853652 conn(0x7fe3cc0ab820 msgr2=0x7fe3cc14eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:34.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 shutdown_connections 2023-08-27T11:23:34.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:34.976+0000 7fe3d0fff700 1 -- 172.21.15.43:0/4042853652 wait complete. 2023-08-27T11:23:34.982 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 8 2023-08-27T11:23:34.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:35.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.197+0000 7f8e38fff700 1 Processor -- start 2023-08-27T11:23:35.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.197+0000 7f8e38fff700 1 -- start start 2023-08-27T11:23:35.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e38fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8e340c4630 0x7f8e340c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e38fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3406c4e0 con 0x7f8e3406ad70 2023-08-27T11:23:35.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e38fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e34155370 con 0x7f8e34151a90 2023-08-27T11:23:35.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e38fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e340c82c0 con 0x7f8e340c4630 2023-08-27T11:23:35.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e2bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8e340c4630 0x7f8e340c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e32d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8e3406ad70 0x7f8e3406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33882/0 (socket says 172.21.15.43:33882) 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e32d9d700 1 -- 172.21.15.43:0/1791898026 learned_addr learned my addr 172.21.15.43:0/1791898026 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e2bfff700 1 -- 172.21.15.43:0/1791898026 >> v1:172.21.15.57:6789/0 conn(0x7f8e34151a90 legacy=0x7f8e340c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e2bfff700 1 -- 172.21.15.43:0/1791898026 >> v1:172.21.15.43:6789/0 conn(0x7f8e3406ad70 legacy=0x7f8e3406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.199+0000 7f8e2bfff700 1 -- 172.21.15.43:0/1791898026 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e34151e70 con 0x7f8e340c4630 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e2bfff700 1 --2- 172.21.15.43:0/1791898026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e340c4a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009840 tx=0x7f8e1c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2db742d6005a00 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e31d9b700 1 -- 172.21.15.43:0/1791898026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011830 con 0x7f8e340c4630 2023-08-27T11:23:35.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e31d9b700 1 -- 172.21.15.43:0/1791898026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c011990 con 0x7f8e340c4630 2023-08-27T11:23:35.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e31d9b700 1 -- 172.21.15.43:0/1791898026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011d20 con 0x7f8e340c4630 2023-08-27T11:23:35.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e38fff700 1 -- 172.21.15.43:0/1791898026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 msgr2=0x7f8e340c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e38fff700 1 --2- 172.21.15.43:0/1791898026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e340c4a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009840 tx=0x7f8e1c009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:35.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e38fff700 1 -- 172.21.15.43:0/1791898026 shutdown_connections 2023-08-27T11:23:35.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.200+0000 7f8e38fff700 1 --2- 172.21.15.43:0/1791898026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e340c4a90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.201+0000 7f8e38fff700 1 -- 172.21.15.43:0/1791898026 >> 172.21.15.43:0/1791898026 conn(0x7f8e340ab820 msgr2=0x7f8e340abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:35.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.201+0000 7f8e38fff700 1 -- 172.21.15.43:0/1791898026 shutdown_connections 2023-08-27T11:23:35.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.201+0000 7f8e38fff700 1 -- 172.21.15.43:0/1791898026 wait complete. 2023-08-27T11:23:35.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.202+0000 7f8e38fff700 1 Processor -- start 2023-08-27T11:23:35.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.202+0000 7f8e38fff700 1 -- start start 2023-08-27T11:23:35.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e3406ad70 0x7f8e341ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e34151a90 0x7f8e341ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e341eaa30 con 0x7f8e340c4630 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e34149090 con 0x7f8e3406ad70 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.203+0000 7f8e38fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340bcf90 con 0x7f8e34151a90 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40770/0 (socket says 172.21.15.43:40770) 2023-08-27T11:23:35.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 -- 172.21.15.43:0/2071710734 learned_addr learned my addr 172.21.15.43:0/2071710734 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:35.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e3259c700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e3406ad70 0x7f8e341ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e32d9d700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e34151a90 0x7f8e341ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 -- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e34151a90 msgr2=0x7f8e341ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e34151a90 0x7f8e341ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 -- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e3406ad70 msgr2=0x7f8e341ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e3406ad70 0x7f8e341ec2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 -- 172.21.15.43:0/2071710734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0094a0 con 0x7f8e340c4630 2023-08-27T11:23:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.204+0000 7f8e2bfff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.205+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0038a0 con 0x7f8e340c4630 2023-08-27T11:23:35.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.205+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c01f070 con 0x7f8e340c4630 2023-08-27T11:23:35.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.205+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e340c0d80 con 0x7f8e340c4630 2023-08-27T11:23:35.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.205+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c003c60 con 0x7f8e340c4630 2023-08-27T11:23:35.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.205+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e341ea040 con 0x7f8e340c4630 2023-08-27T11:23:35.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.206+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3404ee70 con 0x7f8e340c4630 2023-08-27T11:23:35.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.207+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e1c01a430 con 0x7f8e340c4630 2023-08-27T11:23:35.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.208+0000 7f8e2affd700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.208+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8e1c021070 con 0x7f8e340c4630 2023-08-27T11:23:35.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.208+0000 7f8e3259c700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.209+0000 7f8e3259c700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000f60 tx=0x7f8e24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.212+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e1c055770 con 0x7f8e340c4630 2023-08-27T11:23:35.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.425+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e3406c130 con 0x7f8e340c4630 2023-08-27T11:23:35.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.426+0000 7f8e2affd700 1 -- 172.21.15.43:0/2071710734 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f8e1c015020 con 0x7f8e340c4630 2023-08-27T11:23:35.427 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:35.428 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:32.151522+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:22:41.257892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-27T11:22:42.453070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:35.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 msgr2=0x7f8e1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000f60 tx=0x7f8e24009040 comp rx=0 tx=0).stop 2023-08-27T11:23:35.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 msgr2=0x7f8e341539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0090b0 tx=0x7f8e1c004750 comp rx=0 tx=0).stop 2023-08-27T11:23:35.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 shutdown_connections 2023-08-27T11:23:35.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e1406a0e0 0x7f8e1406c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e34151a90 0x7f8e341ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e3406ad70 0x7f8e341ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 --2- 172.21.15.43:0/2071710734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e340c4630 0x7f8e341539a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.428+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 >> 172.21.15.43:0/2071710734 conn(0x7f8e340ab820 msgr2=0x7f8e3406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:35.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.429+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 shutdown_connections 2023-08-27T11:23:35.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.429+0000 7f8e38fff700 1 -- 172.21.15.43:0/2071710734 wait complete. 2023-08-27T11:23:35.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:23:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.648+0000 7f71ecfff700 1 Processor -- start 2023-08-27T11:23:35.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.648+0000 7f71ecfff700 1 -- start start 2023-08-27T11:23:35.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71ecfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71e80c51a0 0x7f71e80c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71ecfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71e80c15e0 0x7f71e80c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71ecfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80c5ae0 con 0x7f71e8151910 2023-08-27T11:23:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71ecfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e80c69f0 con 0x7f71e80c15e0 2023-08-27T11:23:35.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71ecfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e80c1190 con 0x7f71e80c51a0 2023-08-27T11:23:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71e6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71e80c15e0 0x7f71e80c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71e6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71e80c15e0 0x7f71e80c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40780/0 (socket says 172.21.15.43:40780) 2023-08-27T11:23:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71e6d9d700 1 -- 172.21.15.43:0/4069179816 learned_addr learned my addr 172.21.15.43:0/4069179816 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:35.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.649+0000 7f71dffff700 1 --2- 172.21.15.43:0/4069179816 >> v2:172.21.15.57:3300/0 conn(0x7f71e80c51a0 0x7f71e80c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e6d9d700 1 -- 172.21.15.43:0/4069179816 >> v2:172.21.15.57:3300/0 conn(0x7f71e80c51a0 msgr2=0x7f71e80c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:35.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e6d9d700 1 --2- 172.21.15.43:0/4069179816 >> v2:172.21.15.57:3300/0 conn(0x7f71e80c51a0 0x7f71e80c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e6d9d700 1 -- 172.21.15.43:0/4069179816 >> v1:172.21.15.57:6789/0 conn(0x7f71e8151910 legacy=0x7f71e8157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e6d9d700 1 -- 172.21.15.43:0/4069179816 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8072900 con 0x7f71e80c15e0 2023-08-27T11:23:35.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e6d9d700 1 --2- 172.21.15.43:0/4069179816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e80c64b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f71e80c8ac0 tx=0x7f71e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b46584ba1852a12 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e5d9b700 1 -- 172.21.15.43:0/4069179816 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000e070 con 0x7f71e80c15e0 2023-08-27T11:23:35.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e5d9b700 1 -- 172.21.15.43:0/4069179816 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e000b910 con 0x7f71e80c15e0 2023-08-27T11:23:35.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.650+0000 7f71e5d9b700 1 -- 172.21.15.43:0/4069179816 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000bcc0 con 0x7f71e80c15e0 2023-08-27T11:23:35.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 -- 172.21.15.43:0/4069179816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 msgr2=0x7f71e80c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4069179816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e80c64b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f71e80c8ac0 tx=0x7f71e000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:35.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 -- 172.21.15.43:0/4069179816 shutdown_connections 2023-08-27T11:23:35.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4069179816 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e80c64b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4069179816 >> v2:172.21.15.57:3300/0 conn(0x7f71e80c51a0 0x7f71e80c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 -- 172.21.15.43:0/4069179816 >> 172.21.15.43:0/4069179816 conn(0x7f71e80a9740 msgr2=0x7f71e80a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:35.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 -- 172.21.15.43:0/4069179816 shutdown_connections 2023-08-27T11:23:35.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.651+0000 7f71ecfff700 1 -- 172.21.15.43:0/4069179816 wait complete. 2023-08-27T11:23:35.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.653+0000 7f71ecfff700 1 Processor -- start 2023-08-27T11:23:35.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.653+0000 7f71ecfff700 1 -- start start 2023-08-27T11:23:35.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71e80c51a0 0x7f71e81548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 0x7f71e8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e8152280 con 0x7f71e80c15e0 2023-08-27T11:23:35.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81ea860 con 0x7f71e8151910 2023-08-27T11:23:35.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71ecfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e81eab40 con 0x7f71e80c51a0 2023-08-27T11:23:35.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40782/0 (socket says 172.21.15.43:40782) 2023-08-27T11:23:35.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 -- 172.21.15.43:0/4065967050 learned_addr learned my addr 172.21.15.43:0/4065967050 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:35.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71dffff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71e80c51a0 0x7f71e81548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 -- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71e80c51a0 msgr2=0x7f71e81548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71e80c51a0 0x7f71e81548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 -- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 msgr2=0x7f71e8152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e6d9d700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 0x7f71e8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 0x7f71e8152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e659c700 1 -- 172.21.15.43:0/4065967050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0009b30 con 0x7f71e80c15e0 2023-08-27T11:23:35.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.654+0000 7f71e6d9d700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 0x7f71e8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:35.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71e659c700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c450 tx=0x7f71d800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80052d0 con 0x7f71e80c15e0 2023-08-27T11:23:35.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8005430 con 0x7f71e80c15e0 2023-08-27T11:23:35.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e81524d0 con 0x7f71e80c15e0 2023-08-27T11:23:35.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80038c0 con 0x7f71e80c15e0 2023-08-27T11:23:35.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.655+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e814bdf0 con 0x7f71e80c15e0 2023-08-27T11:23:35.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.656+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e804e620 con 0x7f71e80c15e0 2023-08-27T11:23:35.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.657+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f71d8003a20 con 0x7f71e80c15e0 2023-08-27T11:23:35.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.658+0000 7f71deffd700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 0x7f71c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:35.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.658+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71d80879f0 con 0x7f71e80c15e0 2023-08-27T11:23:35.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.658+0000 7f71dffff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 0x7f71c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:35.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.659+0000 7f71dffff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 0x7f71c806c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71e81506c0 tx=0x7f71d0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:35.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.662+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f71d8053000 con 0x7f71e80c15e0 2023-08-27T11:23:35.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.920+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f71e804ee70 con 0x7f71e80c15e0 2023-08-27T11:23:35.922 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:23:35.920+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:23:35.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.925+0000 7f71deffd700 1 -- 172.21.15.43:0/4065967050 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f71d8056620 con 0x7f71e80c15e0 2023-08-27T11:23:35.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 msgr2=0x7f71c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 0x7f71c806c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f71e81506c0 tx=0x7f71d0009210 comp rx=0 tx=0).stop 2023-08-27T11:23:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 msgr2=0x7f71e814b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c450 tx=0x7f71d800c760 comp rx=0 tx=0).stop 2023-08-27T11:23:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 shutdown_connections 2023-08-27T11:23:35.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f71c806a0e0 0x7f71c806c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71e8151910 0x7f71e8152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71e80c15e0 0x7f71e814b8b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 --2- 172.21.15.43:0/4065967050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71e80c51a0 0x7f71e81548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 >> 172.21.15.43:0/4065967050 conn(0x7f71e80a9740 msgr2=0x7f71e81511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:35.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 shutdown_connections 2023-08-27T11:23:35.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:35.928+0000 7f71ecfff700 1 -- 172.21.15.43:0/4065967050 wait complete. 2023-08-27T11:23:35.932 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:23:35.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:23:36.001 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:23:36.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.150+0000 7f1e2a9ff700 1 Processor -- start 2023-08-27T11:23:36.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.150+0000 7f1e2a9ff700 1 -- start start 2023-08-27T11:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e2a9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e240c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e2a9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1e240c4ab0 0x7f1e2406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e2a9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2406c450 con 0x7f1e240c4630 2023-08-27T11:23:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e2a9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240c4f00 con 0x7f1e240c4ab0 2023-08-27T11:23:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e2a9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24151f00 con 0x7f1e24151b20 2023-08-27T11:23:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e237fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1e240c4630 0x7f1e2406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33894/0 (socket says 172.21.15.43:33894) 2023-08-27T11:23:36.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.151+0000 7f1e237fe700 1 -- 172.21.15.43:0/1931467082 learned_addr learned my addr 172.21.15.43:0/1931467082 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 --2- 172.21.15.43:0/1931467082 >> v2:172.21.15.57:3300/0 conn(0x7f1e240c4ab0 0x7f1e2406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e23fff700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e240c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e22ffd700 1 -- 172.21.15.43:0/1931467082 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180373946 0 0) 0x7f1e2406c450 con 0x7f1e240c4630 2023-08-27T11:23:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e22ffd700 1 -- 172.21.15.43:0/1931467082 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c0035b0 con 0x7f1e240c4630 2023-08-27T11:23:36.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 -- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 msgr2=0x7f1e240c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e240c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 -- 172.21.15.43:0/1931467082 >> v1:172.21.15.43:6789/0 conn(0x7f1e240c4630 legacy=0x7f1e2406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 -- 172.21.15.43:0/1931467082 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24154760 con 0x7f1e240c4ab0 2023-08-27T11:23:36.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.152+0000 7f1e28f9c700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4ab0 0x7f1e2406b480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009d90 tx=0x7f1e1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f5334fd2252a7d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e22ffd700 1 -- 172.21.15.43:0/1931467082 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00e070 con 0x7f1e240c4ab0 2023-08-27T11:23:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e22ffd700 1 -- 172.21.15.43:0/1931467082 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00bb20 con 0x7f1e240c4ab0 2023-08-27T11:23:36.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e22ffd700 1 -- 172.21.15.43:0/1931467082 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c012430 con 0x7f1e240c4ab0 2023-08-27T11:23:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4ab0 msgr2=0x7f1e2406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4ab0 0x7f1e2406b480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009d90 tx=0x7f1e1c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/1931467082 shutdown_connections 2023-08-27T11:23:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4ab0 0x7f1e2406b480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/1931467082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e240c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/1931467082 >> 172.21.15.43:0/1931467082 conn(0x7f1e240ab820 msgr2=0x7f1e240abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/1931467082 shutdown_connections 2023-08-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.153+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/1931467082 wait complete. 2023-08-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.155+0000 7f1e2a9ff700 1 Processor -- start 2023-08-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.155+0000 7f1e2a9ff700 1 -- start start 2023-08-27T11:23:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 0x7f1e241e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e241ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24152280 con 0x7f1e240c4ab0 2023-08-27T11:23:36.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e241ea850 con 0x7f1e240c4630 2023-08-27T11:23:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e2a9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24153af0 con 0x7f1e24151b20 2023-08-27T11:23:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40788/0 (socket says 172.21.15.43:40788) 2023-08-27T11:23:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.156+0000 7f1e237fe700 1 -- 172.21.15.43:0/2727473308 learned_addr learned my addr 172.21.15.43:0/2727473308 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:36.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e23fff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 0x7f1e241e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e28f9c700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e241ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 -- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 msgr2=0x7f1e241ebd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e241ebd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 -- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 msgr2=0x7f1e241e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 0x7f1e241e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 -- 172.21.15.43:0/2727473308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009a70 con 0x7f1e240c4ab0 2023-08-27T11:23:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e23fff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 0x7f1e241e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e237fe700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001260 tx=0x7f1e1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180074e0 con 0x7f1e240c4ab0 2023-08-27T11:23:36.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18007640 con 0x7f1e240c4ab0 2023-08-27T11:23:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24153dd0 con 0x7f1e240c4ab0 2023-08-27T11:23:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e18005a50 con 0x7f1e240c4ab0 2023-08-27T11:23:36.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.157+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e24154390 con 0x7f1e240c4ab0 2023-08-27T11:23:36.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.159+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e24154580 con 0x7f1e240c4ab0 2023-08-27T11:23:36.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.160+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e18005bb0 con 0x7f1e240c4ab0 2023-08-27T11:23:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.160+0000 7f1e20ff9700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 0x7f1e1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.161+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f1e18087b80 con 0x7f1e240c4ab0 2023-08-27T11:23:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.161+0000 7f1e23fff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 0x7f1e1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.161+0000 7f1e23fff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 0x7f1e1006c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c30 tx=0x7f1e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:36.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.165+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1e180531d0 con 0x7f1e240c4ab0 2023-08-27T11:23:36.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.422+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1e2404ee70 con 0x7f1e240c4ab0 2023-08-27T11:23:36.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.928+0000 7f1e20ff9700 1 -- 172.21.15.43:0/2727473308 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1e18007e60 con 0x7f1e240c4ab0 2023-08-27T11:23:36.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 msgr2=0x7f1e1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 0x7f1e1006c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009c30 tx=0x7f1e14008040 comp rx=0 tx=0).stop 2023-08-27T11:23:36.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 msgr2=0x7f1e2414d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:36.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1e18001260 tx=0x7f1e1800c860 comp rx=0 tx=0).stop 2023-08-27T11:23:36.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 shutdown_connections 2023-08-27T11:23:36.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1e1006a0e0 0x7f1e1006c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e24151b20 0x7f1e241ebd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e240c4630 0x7f1e241e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 --2- 172.21.15.43:0/2727473308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e240c4ab0 0x7f1e2414d180 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:36.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 >> 172.21.15.43:0/2727473308 conn(0x7f1e240ab820 msgr2=0x7f1e241506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:36.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 shutdown_connections 2023-08-27T11:23:36.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:36.931+0000 7f1e2a9ff700 1 -- 172.21.15.43:0/2727473308 wait complete. 2023-08-27T11:23:36.954 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:23:37.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.164+0000 7f207e1ff700 1 Processor -- start 2023-08-27T11:23:37.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.164+0000 7f207e1ff700 1 -- start start 2023-08-27T11:23:37.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.165+0000 7f207e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f207806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.165+0000 7f207e1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2078154730 con 0x7f20780c4700 2023-08-27T11:23:37.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.165+0000 7f207e1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2078154a10 con 0x7f2078151a40 2023-08-27T11:23:37.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.165+0000 7f207e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20780c4fd0 con 0x7f20780c4b80 2023-08-27T11:23:37.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f2076ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f20780c4700 0x7f207806b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33898/0 (socket says 172.21.15.43:33898) 2023-08-27T11:23:37.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f2076ffd700 1 -- 172.21.15.43:0/3376901362 learned_addr learned my addr 172.21.15.43:0/3376901362 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:37.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f2077fff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f207806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303230053 0 0) 0x7f2078154730 con 0x7f20780c4700 2023-08-27T11:23:37.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20600035b0 con 0x7f20780c4700 2023-08-27T11:23:37.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3322457549 0 0) 0x7f20600035b0 con 0x7f20780c4700 2023-08-27T11:23:37.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 msgr2=0x7f207806be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:37.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f207806be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:37.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 >> v1:172.21.15.57:6789/0 conn(0x7f2078151a40 legacy=0x7f20780c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:37.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078154cf0 con 0x7f20780c4700 2023-08-27T11:23:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f206c001670 con 0x7f20780c4700 2023-08-27T11:23:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 >> v1:172.21.15.43:6789/0 conn(0x7f20780c4700 legacy=0x7f207806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f2060003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004020 0x7f2060004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.166+0000 7f20767fc700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2060004d90 0x7f2060005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20780c4fd0 con 0x7f2060004d90 2023-08-27T11:23:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206000bc00 con 0x7f2060004020 2023-08-27T11:23:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206000bdc0 con 0x7f20780c4b80 2023-08-27T11:23:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2060004d90 0x7f2060005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2076ffd700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004020 0x7f2060004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f20777fe700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f2060003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 -- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 msgr2=0x7f2060003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f20780c4b80 0x7f2060003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 -- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004020 msgr2=0x7f2060004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004020 0x7f2060004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:37.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 -- 172.21.15.43:0/3376901362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600035b0 con 0x7f2060004d90 2023-08-27T11:23:37.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2076ffd700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004020 0x7f2060004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:37.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.167+0000 7f2077fff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2060004d90 0x7f2060005210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2070009fc0 tx=0x7f2060005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd101a1484036a42 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:37.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000ec30 con 0x7f2060004d90 2023-08-27T11:23:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207000f040 con 0x7f2060004d90 2023-08-27T11:23:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f20767fc700 1 -- 172.21.15.43:0/3376901362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070014480 con 0x7f2060004d90 2023-08-27T11:23:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 -- 172.21.15.43:0/3376901362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2060004d90 msgr2=0x7f2060005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 --2- 172.21.15.43:0/3376901362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2060004d90 0x7f2060005210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2070009fc0 tx=0x7f2060005880 comp rx=0 tx=0).stop 2023-08-27T11:23:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f2077fff700 1 -- 172.21.15.43:0/3376901362 reap_dead start 2023-08-27T11:23:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 -- 172.21.15.43:0/3376901362 shutdown_connections 2023-08-27T11:23:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 -- 172.21.15.43:0/3376901362 >> 172.21.15.43:0/3376901362 conn(0x7f20780ab890 msgr2=0x7f20780abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 -- 172.21.15.43:0/3376901362 shutdown_connections 2023-08-27T11:23:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.168+0000 7f207e1ff700 1 -- 172.21.15.43:0/3376901362 wait complete. 2023-08-27T11:23:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.170+0000 7f207e1ff700 1 Processor -- start 2023-08-27T11:23:37.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.170+0000 7f207e1ff700 1 -- start start 2023-08-27T11:23:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004d90 0x7f20781ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f207814e220 0x7f20780c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078156c50 con 0x7f20780c2ef0 2023-08-27T11:23:37.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078158020 con 0x7f2060004d90 2023-08-27T11:23:37.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f207e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20780c3380 con 0x7f207814e220 2023-08-27T11:23:37.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f2077fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f2077fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40808/0 (socket says 172.21.15.43:40808) 2023-08-27T11:23:37.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f2077fff700 1 -- 172.21.15.43:0/212178500 learned_addr learned my addr 172.21.15.43:0/212178500 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:37.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f2076ffd700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f207814e220 0x7f20780c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.171+0000 7f20777fe700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004d90 0x7f20781ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 -- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f207814e220 msgr2=0x7f20780c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:37.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f207814e220 0x7f20780c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:37.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 -- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004d90 msgr2=0x7f20781ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004d90 0x7f20781ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 -- 172.21.15.43:0/212178500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078157c00 con 0x7f20780c2ef0 2023-08-27T11:23:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f2077fff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2070016000 tx=0x7f2070009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070007000 con 0x7f20780c2ef0 2023-08-27T11:23:37.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070003e50 con 0x7f20780c2ef0 2023-08-27T11:23:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070014aa0 con 0x7f20780c2ef0 2023-08-27T11:23:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20781e9850 con 0x7f20780c2ef0 2023-08-27T11:23:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.172+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2078158530 con 0x7f20780c2ef0 2023-08-27T11:23:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.173+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20781e9a70 con 0x7f20780c2ef0 2023-08-27T11:23:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.177+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2070023020 con 0x7f20780c2ef0 2023-08-27T11:23:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.178+0000 7f205ffff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.178+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f2070089df0 con 0x7f20780c2ef0 2023-08-27T11:23:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.178+0000 7f20777fe700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.179+0000 7f20777fe700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 0x7f206406c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f207814b760 tx=0x7f2068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.181+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f20700555e0 con 0x7f20780c2ef0 2023-08-27T11:23:37.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:37.391+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20781e9a70 con 0x7f20780c2ef0 2023-08-27T11:23:38.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.191+0000 7f205ffff700 1 -- 172.21.15.43:0/212178500 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f20781e9a70 con 0x7f20780c2ef0 2023-08-27T11:23:38.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 msgr2=0x7f206406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 0x7f206406c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f207814b760 tx=0x7f2068009040 comp rx=0 tx=0).stop 2023-08-27T11:23:38.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 msgr2=0x7f20781e9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2070016000 tx=0x7f2070009750 comp rx=0 tx=0).stop 2023-08-27T11:23:38.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 shutdown_connections 2023-08-27T11:23:38.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f20780c2ef0 0x7f20781e9d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2060004d90 0x7f20781ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 --2- 172.21.15.43:0/212178500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f207814e220 0x7f20780c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 >> 172.21.15.43:0/212178500 conn(0x7f20780ab890 msgr2=0x7f207806b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:38.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.194+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 shutdown_connections 2023-08-27T11:23:38.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.195+0000 7f207e1ff700 1 -- 172.21.15.43:0/212178500 wait complete. 2023-08-27T11:23:38.200 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:23:38.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:23:38.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.426+0000 7fd49a5ff700 1 Processor -- start 2023-08-27T11:23:38.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.426+0000 7fd49a5ff700 1 -- start start 2023-08-27T11:23:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.427+0000 7fd49a5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd4940c4700 0x7fd4940c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.427+0000 7fd49a5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd494154730 con 0x7fd494151a40 2023-08-27T11:23:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.427+0000 7fd49a5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd494154a10 con 0x7fd49406b780 2023-08-27T11:23:38.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.427+0000 7fd49a5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd494154520 con 0x7fd4940c4700 2023-08-27T11:23:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd4937fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd4940c4700 0x7fd4940c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd493fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd494151a40 0x7fd4940c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33908/0 (socket says 172.21.15.43:33908) 2023-08-27T11:23:38.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd493fff700 1 -- 172.21.15.43:0/1822130543 learned_addr learned my addr 172.21.15.43:0/1822130543 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:38.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd4937fe700 1 -- 172.21.15.43:0/1822130543 >> v1:172.21.15.57:6789/0 conn(0x7fd49406b780 legacy=0x7fd49406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd4937fe700 1 -- 172.21.15.43:0/1822130543 >> v1:172.21.15.43:6789/0 conn(0x7fd494151a40 legacy=0x7fd4940c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd4937fe700 1 -- 172.21.15.43:0/1822130543 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494154cf0 con 0x7fd4940c4700 2023-08-27T11:23:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.428+0000 7fd4937fe700 1 --2- 172.21.15.43:0/1822130543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4940c4700 0x7fd4940c4b80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd488009840 tx=0x7fd488009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ca07f7d07c97cd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd492ffd700 1 -- 172.21.15.43:0/1822130543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011830 con 0x7fd4940c4700 2023-08-27T11:23:38.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd492ffd700 1 -- 172.21.15.43:0/1822130543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488011990 con 0x7fd4940c4700 2023-08-27T11:23:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd492ffd700 1 -- 172.21.15.43:0/1822130543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488011d20 con 0x7fd4940c4700 2023-08-27T11:23:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 -- 172.21.15.43:0/1822130543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4940c4700 msgr2=0x7fd4940c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/1822130543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4940c4700 0x7fd4940c4b80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd488009840 tx=0x7fd488009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 -- 172.21.15.43:0/1822130543 shutdown_connections 2023-08-27T11:23:38.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/1822130543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4940c4700 0x7fd4940c4b80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 -- 172.21.15.43:0/1822130543 >> 172.21.15.43:0/1822130543 conn(0x7fd4940ab890 msgr2=0x7fd4940abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.429+0000 7fd49a5ff700 1 -- 172.21.15.43:0/1822130543 shutdown_connections 2023-08-27T11:23:38.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.430+0000 7fd49a5ff700 1 -- 172.21.15.43:0/1822130543 wait complete. 2023-08-27T11:23:38.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.432+0000 7fd49a5ff700 1 Processor -- start 2023-08-27T11:23:38.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.432+0000 7fd49a5ff700 1 -- start start 2023-08-27T11:23:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49406b780 0x7fd494150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4940c4700 0x7fd4940ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49414ed80 con 0x7fd494151a40 2023-08-27T11:23:38.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941ea620 con 0x7fd49406b780 2023-08-27T11:23:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.433+0000 7fd49a5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941eab50 con 0x7fd4940c4700 2023-08-27T11:23:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:38.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40832/0 (socket says 172.21.15.43:40832) 2023-08-27T11:23:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 -- 172.21.15.43:0/3010433620 learned_addr learned my addr 172.21.15.43:0/3010433620 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:38.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd493fff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49406b780 0x7fd494150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd4937fe700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4940c4700 0x7fd4940ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 -- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4940c4700 msgr2=0x7fd4940ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4940c4700 0x7fd4940ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 -- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49406b780 msgr2=0x7fd494150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49406b780 0x7fd494150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:38.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 -- 172.21.15.43:0/3010433620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880094a0 con 0x7fd494151a40 2023-08-27T11:23:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd498b9c700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cc80 tx=0x7fd48c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:38.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.434+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00ad40 con 0x7fd494151a40 2023-08-27T11:23:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.435+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00ce80 con 0x7fd494151a40 2023-08-27T11:23:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.435+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c00aea0 con 0x7fd494151a40 2023-08-27T11:23:38.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.435+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4941ea870 con 0x7fd494151a40 2023-08-27T11:23:38.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.435+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940acd40 con 0x7fd494151a40 2023-08-27T11:23:38.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.436+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd494154f80 con 0x7fd494151a40 2023-08-27T11:23:38.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.437+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd48c003c40 con 0x7fd494151a40 2023-08-27T11:23:38.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.437+0000 7fd490ff9700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 0x7fd48006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:38.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.438+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fd48c0885d0 con 0x7fd494151a40 2023-08-27T11:23:38.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.438+0000 7fd493fff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 0x7fd48006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:38.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.438+0000 7fd493fff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 0x7fd48006c5d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd484005910 tx=0x7fd484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:38.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.442+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd48c053d40 con 0x7fd494151a40 2023-08-27T11:23:38.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:38.655+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd49404ee70 con 0x7fd494151a40 2023-08-27T11:23:39.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.194+0000 7fd490ff9700 1 -- 172.21.15.43:0/3010433620 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd48c057360 con 0x7fd494151a40 2023-08-27T11:23:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 msgr2=0x7fd48006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 0x7fd48006c5d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd484005910 tx=0x7fd484009040 comp rx=0 tx=0).stop 2023-08-27T11:23:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 msgr2=0x7fd4940aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cc80 tx=0x7fd48c00a340 comp rx=0 tx=0).stop 2023-08-27T11:23:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 shutdown_connections 2023-08-27T11:23:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd48006a110 0x7fd48006c5d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd494151a40 0x7fd4940aeef0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd49406b780 0x7fd494150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 --2- 172.21.15.43:0/3010433620 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd4940c4700 0x7fd4940ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 >> 172.21.15.43:0/3010433620 conn(0x7fd4940ab890 msgr2=0x7fd494152840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 shutdown_connections 2023-08-27T11:23:39.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.198+0000 7fd49a5ff700 1 -- 172.21.15.43:0/3010433620 wait complete. 2023-08-27T11:23:39.202 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:23:39.222 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:23:39.223 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:23:39.223 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:23:39.223 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:23:39.224 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:23:39.224 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:23:39.224 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:23:39.225 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:23:39.225 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:23:39.225 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:23:39.225 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:23:39.226 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:23:39.226 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:23:39.226 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:23:39.227 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:23:39.227 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:23:39.240 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:23:39.240 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:23:39.241 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:23:39.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:23:39.243 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:23:39.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:23:39.245 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:23:39.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:23:39.285 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:23:39.285 DEBUG:teuthology.parallel:result is None 2023-08-27T11:23:39.288 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:23:39.288 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:23:39.288 DEBUG:teuthology.parallel:result is None 2023-08-27T11:23:39.289 DEBUG:teuthology.parallel:result is None 2023-08-27T11:23:39.290 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:23:39.291 DEBUG:teuthology.parallel:result is None 2023-08-27T11:23:39.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:23:39.448 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:23:39.448 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:23:39.458 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:23:39.462 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:23:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.521+0000 7f0028bff700 1 Processor -- start 2023-08-27T11:23:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.522+0000 7f0028bff700 1 -- start start 2023-08-27T11:23:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0028bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 0x7f00240a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0028bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00240c50d0 0x7f00240c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0028bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0024154d00 con 0x7f00240a79c0 2023-08-27T11:23:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0028bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00240baf30 con 0x7f002414e960 2023-08-27T11:23:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0028bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0024154fe0 con 0x7f00240c50d0 2023-08-27T11:23:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f002259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 0x7f00240a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f001bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f00240a79c0 0x7f00240c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45950/0 (socket says 172.21.15.43:45950) 2023-08-27T11:23:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f001bfff700 1 -- 172.21.15.43:0/1255987592 learned_addr learned my addr 172.21.15.43:0/1255987592 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.523+0000 7f0022d9d700 1 --2- 172.21.15.43:0/1255987592 >> v2:172.21.15.57:3300/0 conn(0x7f00240c50d0 0x7f00240c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0022d9d700 1 -- 172.21.15.43:0/1255987592 >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 msgr2=0x7f00240a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0022d9d700 1 --2- 172.21.15.43:0/1255987592 >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 0x7f00240a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0022d9d700 1 -- 172.21.15.43:0/1255987592 >> v1:172.21.15.43:6789/0 conn(0x7f00240a79c0 legacy=0x7f00240c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0022d9d700 1 -- 172.21.15.43:0/1255987592 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00241552c0 con 0x7f00240c50d0 2023-08-27T11:23:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0021d9b700 1 -- 172.21.15.43:0/1255987592 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7844590 0 0) 0x7f0024154d00 con 0x7f00240a79c0 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f002259c700 1 --2- 172.21.15.43:0/1255987592 >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 0x7f00240a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0022d9d700 1 --2- 172.21.15.43:0/1255987592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00240c50d0 0x7f00240c43d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00241521a0 tx=0x7f001c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da67ec76500e6e46 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0021d9b700 1 -- 172.21.15.43:0/1255987592 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c00e070 con 0x7f00240c50d0 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0021d9b700 1 -- 172.21.15.43:0/1255987592 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001c00bb20 con 0x7f00240c50d0 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.524+0000 7f0021d9b700 1 -- 172.21.15.43:0/1255987592 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c012430 con 0x7f00240c50d0 2023-08-27T11:23:39.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 -- 172.21.15.43:0/1255987592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00240c50d0 msgr2=0x7f00240c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 --2- 172.21.15.43:0/1255987592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00240c50d0 0x7f00240c43d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f00241521a0 tx=0x7f001c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 -- 172.21.15.43:0/1255987592 shutdown_connections 2023-08-27T11:23:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 --2- 172.21.15.43:0/1255987592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00240c50d0 0x7f00240c43d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 --2- 172.21.15.43:0/1255987592 >> v2:172.21.15.43:3300/0 conn(0x7f002414e960 0x7f00240a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 -- 172.21.15.43:0/1255987592 >> 172.21.15.43:0/1255987592 conn(0x7f002406aa50 msgr2=0x7f00240c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 -- 172.21.15.43:0/1255987592 shutdown_connections 2023-08-27T11:23:39.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.525+0000 7f0028bff700 1 -- 172.21.15.43:0/1255987592 wait complete. 2023-08-27T11:23:39.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.527+0000 7f0028bff700 1 Processor -- start 2023-08-27T11:23:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.527+0000 7f0028bff700 1 -- start start 2023-08-27T11:23:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00240c50d0 0x7f00240aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f002414e960 0x7f00240aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00241eac50 con 0x7f00240a79c0 2023-08-27T11:23:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240bf750 con 0x7f002414e960 2023-08-27T11:23:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0028bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0024142560 con 0x7f00240c50d0 2023-08-27T11:23:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f002259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f002259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47604/0 (socket says 172.21.15.43:47604) 2023-08-27T11:23:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f002259c700 1 -- 172.21.15.43:0/1272366904 learned_addr learned my addr 172.21.15.43:0/1272366904 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f001bfff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00240c50d0 0x7f00240aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.528+0000 7f0022d9d700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f002414e960 0x7f00240aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 -- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00240c50d0 msgr2=0x7f00240aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00240c50d0 0x7f00240aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 -- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f002414e960 msgr2=0x7f00240aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f002414e960 0x7f00240aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 -- 172.21.15.43:0/1272366904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140094a0 con 0x7f00240a79c0 2023-08-27T11:23:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f002259c700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f001400ec10 tx=0x7f001400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014009760 con 0x7f00240a79c0 2023-08-27T11:23:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400c850 con 0x7f00240a79c0 2023-08-27T11:23:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c009a70 con 0x7f00240a79c0 2023-08-27T11:23:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400cbe0 con 0x7f00240a79c0 2023-08-27T11:23:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.529+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00241eb180 con 0x7f00240a79c0 2023-08-27T11:23:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.530+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00240bb390 con 0x7f00240a79c0 2023-08-27T11:23:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.531+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f001400cd40 con 0x7f00240a79c0 2023-08-27T11:23:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.532+0000 7f001affd700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 0x7f000406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.532+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0014088280 con 0x7f00240a79c0 2023-08-27T11:23:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.533+0000 7f001bfff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 0x7f000406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.533+0000 7f001bfff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 0x7f000406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f000c007fd0 tx=0x7f000c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.537+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0014053c80 con 0x7f00240a79c0 2023-08-27T11:23:39.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:39.762+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f002404ee70 con 0x7f00240a79c0 2023-08-27T11:23:40.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:23:40.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:23:40.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.227+0000 7f001affd700 1 -- 172.21.15.43:0/1272366904 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0014017080 con 0x7f00240a79c0 2023-08-27T11:23:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 msgr2=0x7f000406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 0x7f000406c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f000c007fd0 tx=0x7f000c007de0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 msgr2=0x7f00240a6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f001400ec10 tx=0x7f001400ef20 comp rx=0 tx=0).stop 2023-08-27T11:23:40.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 shutdown_connections 2023-08-27T11:23:40.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f000406a0e0 0x7f000406c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f002414e960 0x7f00240aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f00240a79c0 0x7f00240a6e20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 --2- 172.21.15.43:0/1272366904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00240c50d0 0x7f00240aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.230+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 >> 172.21.15.43:0/1272366904 conn(0x7f002406aa50 msgr2=0x7f0024149400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:40.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.231+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 shutdown_connections 2023-08-27T11:23:40.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.231+0000 7f0028bff700 1 -- 172.21.15.43:0/1272366904 wait complete. 2023-08-27T11:23:40.234 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:23:40.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:23:40.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.457+0000 7f5ff03ff700 1 Processor -- start 2023-08-27T11:23:40.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.457+0000 7f5ff03ff700 1 -- start start 2023-08-27T11:23:40.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.458+0000 7f5ff03ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe8151a90 0x7f5fe80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.458+0000 7f5ff03ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fe80c4630 0x7f5fe80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5ff03ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe806c4e0 con 0x7f5fe806ad70 2023-08-27T11:23:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5ff03ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe8155370 con 0x7f5fe80c4630 2023-08-27T11:23:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5ff03ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8151e70 con 0x7f5fe8151a90 2023-08-27T11:23:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fe80c4630 0x7f5fe80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5fe80c4630 0x7f5fe80c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47616/0 (socket says 172.21.15.43:47616) 2023-08-27T11:23:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 -- 172.21.15.43:0/4203128747 learned_addr learned my addr 172.21.15.43:0/4203128747 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fee19b700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe8151a90 0x7f5fe80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 -- 172.21.15.43:0/4203128747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe8151a90 msgr2=0x7f5fe80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe8151a90 0x7f5fe80c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 -- 172.21.15.43:0/4203128747 >> v1:172.21.15.57:6789/0 conn(0x7f5fe806ad70 legacy=0x7f5fe806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.459+0000 7f5fed99a700 1 -- 172.21.15.43:0/4203128747 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8154480 con 0x7f5fe80c4630 2023-08-27T11:23:40.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5fed99a700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe80c4630 0x7f5fe80c4a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80098f0 tx=0x7f5fd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0fcda608d1273c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:40.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5fed199700 1 -- 172.21.15.43:0/4203128747 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800b8a0 con 0x7f5fe80c4630 2023-08-27T11:23:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5fed199700 1 -- 172.21.15.43:0/4203128747 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800ba00 con 0x7f5fe80c4630 2023-08-27T11:23:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5fed199700 1 -- 172.21.15.43:0/4203128747 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800bd90 con 0x7f5fe80c4630 2023-08-27T11:23:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 -- 172.21.15.43:0/4203128747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe80c4630 msgr2=0x7f5fe80c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe80c4630 0x7f5fe80c4a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80098f0 tx=0x7f5fd8009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 -- 172.21.15.43:0/4203128747 shutdown_connections 2023-08-27T11:23:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe8151a90 0x7f5fe80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/4203128747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe80c4630 0x7f5fe80c4a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.460+0000 7f5ff03ff700 1 -- 172.21.15.43:0/4203128747 >> 172.21.15.43:0/4203128747 conn(0x7f5fe80ab820 msgr2=0x7f5fe80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.461+0000 7f5ff03ff700 1 -- 172.21.15.43:0/4203128747 shutdown_connections 2023-08-27T11:23:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.461+0000 7f5ff03ff700 1 -- 172.21.15.43:0/4203128747 wait complete. 2023-08-27T11:23:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.462+0000 7f5ff03ff700 1 Processor -- start 2023-08-27T11:23:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.462+0000 7f5ff03ff700 1 -- start start 2023-08-27T11:23:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe80c4630 0x7f5fe8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fe8151a90 0x7f5fe81e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81ecd70 con 0x7f5fe806ad70 2023-08-27T11:23:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81ed050 con 0x7f5fe8151a90 2023-08-27T11:23:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5ff03ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81ed330 con 0x7f5fe80c4630 2023-08-27T11:23:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.463+0000 7f5fee19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47632/0 (socket says 172.21.15.43:47632) 2023-08-27T11:23:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 -- 172.21.15.43:0/3589029235 learned_addr learned my addr 172.21.15.43:0/3589029235 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee99c700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fe8151a90 0x7f5fe81e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fed99a700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe80c4630 0x7f5fe8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 -- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe80c4630 msgr2=0x7f5fe8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe80c4630 0x7f5fe8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 -- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fe8151a90 msgr2=0x7f5fe81e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fe8151a90 0x7f5fe81e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 -- 172.21.15.43:0/3589029235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009550 con 0x7f5fe806ad70 2023-08-27T11:23:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fee19b700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400d800 tx=0x7f5fe400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40125f0 con 0x7f5fe806ad70 2023-08-27T11:23:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe4012750 con 0x7f5fe806ad70 2023-08-27T11:23:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4012b00 con 0x7f5fe806ad70 2023-08-27T11:23:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.464+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe81ed610 con 0x7f5fe806ad70 2023-08-27T11:23:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.465+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe80ab4e0 con 0x7f5fe806ad70 2023-08-27T11:23:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.465+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe804ee70 con 0x7f5fe806ad70 2023-08-27T11:23:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.466+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fe4012c60 con 0x7f5fe806ad70 2023-08-27T11:23:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.468+0000 7f5fdeffd700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 0x7f5fcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.468+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fe40885b0 con 0x7f5fe806ad70 2023-08-27T11:23:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.468+0000 7f5fed99a700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 0x7f5fcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.469+0000 7f5fed99a700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 0x7f5fcc06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009c40 tx=0x7f5fd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:40.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.472+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5fe4053fe0 con 0x7f5fe806ad70 2023-08-27T11:23:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.763+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5fe806c130 con 0x7f5fe806ad70 2023-08-27T11:23:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.764+0000 7f5fdeffd700 1 -- 172.21.15.43:0/3589029235 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f5fe4057600 con 0x7f5fe806ad70 2023-08-27T11:23:40.765 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:40.766 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:23:40.766 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:23:40.766 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.766 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:23:40.766 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:23:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:23:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:23:40.767 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.768 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.768 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.768 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.768 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:23:40.768 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:23:40.769 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.769 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.769 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:23:40.769 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:23:40.769 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.770 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.770 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.770 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.770 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:23:40.770 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:23:40.771 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:23:40.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:23:40.771 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:23:40.772 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:23:40.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:23:40.773 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.773 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.774 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:23:40.774 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:23:40.774 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.775 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.775 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.775 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.776 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.777 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.777 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.777 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.777 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.777 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:23:40.778 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:23:40.778 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.778 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.778 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.778 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:23:40.779 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.780 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.780 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.780 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.780 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.781 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.781 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:23:40.781 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:23:40.781 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.781 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.782 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.782 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.782 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.783 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.783 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:23:40.783 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:23:40.783 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.783 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.784 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:23:40.785 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:23:40.785 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.785 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.785 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.785 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.786 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.786 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.786 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.786 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:23:40.786 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:23:40.787 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.787 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:23:40.787 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:23:40.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.787 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.788 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.789 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:23:40.789 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:23:40.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:23:40.789 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.790 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.790 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.790 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:23:40.790 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:23:40.790 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.791 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:23:40.792 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:23:40.792 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:23:40.792 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:23:40.792 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.793 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.793 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:23:40.793 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:23:40.793 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:23:40.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:23:40.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:23:40.794 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.794 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mds", 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkmqvVAxAAUgI7jqgtdi/x4EfWq3gE8Q==", 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mds" 2023-08-27T11:23:40.795 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.796 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-mgr", 2023-08-27T11:23:40.796 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkrLbVAxAABwGlkk/cRH9G6IDz2IV6Pg==", 2023-08-27T11:23:40.796 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-27T11:23:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.797 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-osd", 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkbb/VAxAAvgU8a4O56LrpfyNX+VA/Qw==", 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-osd" 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.798 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.799 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd", 2023-08-27T11:23:40.799 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkasjVAxAARA1up6qfOBHsMX01XEMyDQ==", 2023-08-27T11:23:40.799 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.799 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-27T11:23:40.800 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.800 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.800 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-27T11:23:40.800 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkHNHVAxAARSWtUYgt0h0bub29im5a+Q==", 2023-08-27T11:23:40.801 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.801 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-27T11:23:40.801 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.801 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.bootstrap-rgw", 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDvMetkx9nVAxAAe1i/LGEcKwEiMLFp6qYVzA==", 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.802 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.803 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.803 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:23:40.803 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:23:40.803 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.803 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:40.804 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:23:40.805 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:23:40.805 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:23:40.805 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:23:40.805 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:23:40.805 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:23:40.806 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.806 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:40.806 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:23:40.806 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:23:40.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 msgr2=0x7f5fcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 0x7f5fcc06c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009c40 tx=0x7f5fd8008030 comp rx=0 tx=0).stop 2023-08-27T11:23:40.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 msgr2=0x7f5fe80aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:40.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400d800 tx=0x7f5fe400dbc0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 shutdown_connections 2023-08-27T11:23:40.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fcc06a0e0 0x7f5fcc06c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fe8151a90 0x7f5fe81e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fe806ad70 0x7f5fe80aafa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 --2- 172.21.15.43:0/3589029235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fe80c4630 0x7f5fe8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 >> 172.21.15.43:0/3589029235 conn(0x7f5fe80ab820 msgr2=0x7f5fe806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:40.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 shutdown_connections 2023-08-27T11:23:40.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:40.766+0000 7f5ff03ff700 1 -- 172.21.15.43:0/3589029235 wait complete. 2023-08-27T11:23:40.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-27T11:23:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.012+0000 7fda16bff700 1 Processor -- start 2023-08-27T11:23:41.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.013+0000 7fda16bff700 1 -- start start 2023-08-27T11:23:41.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda10151a90 0x7fda100c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 0x7fda100c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 0x7fda1006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1006c4e0 con 0x7fda10151a90 2023-08-27T11:23:41.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda10155370 con 0x7fda100c4630 2023-08-27T11:23:41.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda16bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda10151e70 con 0x7fda1006ad70 2023-08-27T11:23:41.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda10151a90 0x7fda100c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fda10151a90 0x7fda100c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47642/0 (socket says 172.21.15.43:47642) 2023-08-27T11:23:41.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 -- 172.21.15.43:0/3857721543 learned_addr learned my addr 172.21.15.43:0/3857721543 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:41.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda0ffff700 1 --2- 172.21.15.43:0/3857721543 >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 0x7fda100c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 -- 172.21.15.43:0/3857721543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 msgr2=0x7fda1006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:41.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1519c700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 0x7fda1006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 0x7fda1006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 -- 172.21.15.43:0/3857721543 >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 msgr2=0x7fda100c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:41.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 --2- 172.21.15.43:0/3857721543 >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 0x7fda100c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1499b700 1 -- 172.21.15.43:0/3857721543 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10154480 con 0x7fda10151a90 2023-08-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda0ffff700 1 --2- 172.21.15.43:0/3857721543 >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 0x7fda100c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.014+0000 7fda1519c700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 0x7fda1006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda1499b700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda10151a90 0x7fda100c7bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda100c7740 tx=0x7fda04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c6d69197492fbe server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda0f7fe700 1 -- 172.21.15.43:0/3857721543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400b870 con 0x7fda10151a90 2023-08-27T11:23:41.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda0f7fe700 1 -- 172.21.15.43:0/3857721543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b9d0 con 0x7fda10151a90 2023-08-27T11:23:41.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda0f7fe700 1 -- 172.21.15.43:0/3857721543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400bd60 con 0x7fda10151a90 2023-08-27T11:23:41.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 -- 172.21.15.43:0/3857721543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda10151a90 msgr2=0x7fda100c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda10151a90 0x7fda100c7bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fda100c7740 tx=0x7fda04009bd0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 -- 172.21.15.43:0/3857721543 shutdown_connections 2023-08-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda1006ad70 0x7fda1006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 --2- 172.21.15.43:0/3857721543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda10151a90 0x7fda100c7bb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 --2- 172.21.15.43:0/3857721543 >> v2:172.21.15.57:3300/0 conn(0x7fda100c4630 0x7fda100c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.015+0000 7fda16bff700 1 -- 172.21.15.43:0/3857721543 >> 172.21.15.43:0/3857721543 conn(0x7fda100ab820 msgr2=0x7fda100abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:41.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.016+0000 7fda16bff700 1 -- 172.21.15.43:0/3857721543 shutdown_connections 2023-08-27T11:23:41.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.016+0000 7fda16bff700 1 -- 172.21.15.43:0/3857721543 wait complete. 2023-08-27T11:23:41.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.017+0000 7fda16bff700 1 Processor -- start 2023-08-27T11:23:41.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 -- start start 2023-08-27T11:23:41.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda100c4630 0x7fda10152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda10151a90 0x7fda101e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100c1c90 con 0x7fda1006ad70 2023-08-27T11:23:41.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100c0d80 con 0x7fda100c4630 2023-08-27T11:23:41.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.018+0000 7fda16bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda101ea3d0 con 0x7fda10151a90 2023-08-27T11:23:41.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47658/0 (socket says 172.21.15.43:47658) 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 -- 172.21.15.43:0/2465307949 learned_addr learned my addr 172.21.15.43:0/2465307949 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda0ffff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda100c4630 0x7fda10152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1519c700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda10151a90 0x7fda101e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 -- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda10151a90 msgr2=0x7fda101e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda10151a90 0x7fda101e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 -- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda100c4630 msgr2=0x7fda10152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda100c4630 0x7fda10152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 -- 172.21.15.43:0/2465307949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009550 con 0x7fda1006ad70 2023-08-27T11:23:41.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.019+0000 7fda1499b700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fda04014040 tx=0x7fda04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.020+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04004250 con 0x7fda1006ad70 2023-08-27T11:23:41.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.020+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0401e070 con 0x7fda1006ad70 2023-08-27T11:23:41.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.020+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda040036a0 con 0x7fda1006ad70 2023-08-27T11:23:41.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.020+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda101ea6b0 con 0x7fda1006ad70 2023-08-27T11:23:41.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.020+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1014d630 con 0x7fda1006ad70 2023-08-27T11:23:41.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.021+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda10152640 con 0x7fda1006ad70 2023-08-27T11:23:41.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.022+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda04020030 con 0x7fda1006ad70 2023-08-27T11:23:41.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.023+0000 7fda0d7fa700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 0x7fd9f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.023+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda04089240 con 0x7fda1006ad70 2023-08-27T11:23:41.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.023+0000 7fda0ffff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 0x7fd9f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.024+0000 7fda0ffff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 0x7fd9f406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda101ea300 tx=0x7fd9fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.027+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fda10152640 con 0x7fda1006ad70 2023-08-27T11:23:41.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.327+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fda10152640 con 0x7fda1006ad70 2023-08-27T11:23:41.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.331+0000 7fda0d7fa700 1 -- 172.21.15.43:0/2465307949 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fda10152640 con 0x7fda1006ad70 2023-08-27T11:23:41.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 msgr2=0x7fd9f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 0x7fd9f406c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fda101ea300 tx=0x7fd9fc008040 comp rx=0 tx=0).stop 2023-08-27T11:23:41.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 msgr2=0x7fda1014d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fda04014040 tx=0x7fda04004750 comp rx=0 tx=0).stop 2023-08-27T11:23:41.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 shutdown_connections 2023-08-27T11:23:41.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd9f406a0e0 0x7fd9f406c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda10151a90 0x7fda101e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fda1006ad70 0x7fda1014d0f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 --2- 172.21.15.43:0/2465307949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda100c4630 0x7fda10152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 >> 172.21.15.43:0/2465307949 conn(0x7fda100ab820 msgr2=0x7fda100c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.333+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 shutdown_connections 2023-08-27T11:23:41.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.334+0000 7fda16bff700 1 -- 172.21.15.43:0/2465307949 wait complete. 2023-08-27T11:23:41.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-27T11:23:41.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.553+0000 7f0b761ff700 1 Processor -- start 2023-08-27T11:23:41.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.553+0000 7f0b761ff700 1 -- start start 2023-08-27T11:23:41.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.554+0000 7f0b761ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b70151a90 0x7f0b700c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.554+0000 7f0b761ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b700c4630 0x7f0b700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.554+0000 7f0b761ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7006c4e0 con 0x7f0b7006ad70 2023-08-27T11:23:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.554+0000 7f0b761ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b70155370 con 0x7f0b70151a90 2023-08-27T11:23:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.554+0000 7f0b761ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b70151e70 con 0x7f0b700c4630 2023-08-27T11:23:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b70151a90 0x7f0b700c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0b7006ad70 0x7f0b7006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45954/0 (socket says 172.21.15.43:45954) 2023-08-27T11:23:41.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6ffff700 1 -- 172.21.15.43:0/995838320 learned_addr learned my addr 172.21.15.43:0/995838320 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:41.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6effd700 1 --2- 172.21.15.43:0/995838320 >> v2:172.21.15.57:3300/0 conn(0x7f0b700c4630 0x7f0b700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 -- 172.21.15.43:0/995838320 >> v2:172.21.15.57:3300/0 conn(0x7f0b700c4630 msgr2=0x7f0b700c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:41.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 --2- 172.21.15.43:0/995838320 >> v2:172.21.15.57:3300/0 conn(0x7f0b700c4630 0x7f0b700c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 -- 172.21.15.43:0/995838320 >> v1:172.21.15.43:6789/0 conn(0x7f0b7006ad70 legacy=0x7f0b7006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6e7fc700 1 -- 172.21.15.43:0/995838320 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110679745 0 0) 0x7f0b7006c4e0 con 0x7f0b7006ad70 2023-08-27T11:23:41.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 -- 172.21.15.43:0/995838320 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70154480 con 0x7f0b70151a90 2023-08-27T11:23:41.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.555+0000 7f0b6f7fe700 1 --2- 172.21.15.43:0/995838320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b700c7bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b700c7740 tx=0x7f0b60009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae6f7c9b793d1e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b6e7fc700 1 -- 172.21.15.43:0/995838320 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60011830 con 0x7f0b70151a90 2023-08-27T11:23:41.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b6e7fc700 1 -- 172.21.15.43:0/995838320 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60011990 con 0x7f0b70151a90 2023-08-27T11:23:41.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b6e7fc700 1 -- 172.21.15.43:0/995838320 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60011d20 con 0x7f0b70151a90 2023-08-27T11:23:41.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 -- 172.21.15.43:0/995838320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 msgr2=0x7f0b700c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 --2- 172.21.15.43:0/995838320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b700c7bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0b700c7740 tx=0x7f0b60009b20 comp rx=0 tx=0).stop 2023-08-27T11:23:41.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 -- 172.21.15.43:0/995838320 shutdown_connections 2023-08-27T11:23:41.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 --2- 172.21.15.43:0/995838320 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b700c7bb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 --2- 172.21.15.43:0/995838320 >> v2:172.21.15.57:3300/0 conn(0x7f0b700c4630 0x7f0b700c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 -- 172.21.15.43:0/995838320 >> 172.21.15.43:0/995838320 conn(0x7f0b700ab820 msgr2=0x7f0b700abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:41.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 -- 172.21.15.43:0/995838320 shutdown_connections 2023-08-27T11:23:41.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.556+0000 7f0b761ff700 1 -- 172.21.15.43:0/995838320 wait complete. 2023-08-27T11:23:41.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.558+0000 7f0b761ff700 1 Processor -- start 2023-08-27T11:23:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.558+0000 7f0b761ff700 1 -- start start 2023-08-27T11:23:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b7006ad70 0x7f0b70147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 0x7f0b701ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700c22e0 con 0x7f0b70151a90 2023-08-27T11:23:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b701eda30 con 0x7f0b700c4630 2023-08-27T11:23:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b761ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70149380 con 0x7f0b7006ad70 2023-08-27T11:23:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47682/0 (socket says 172.21.15.43:47682) 2023-08-27T11:23:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.559+0000 7f0b6ffff700 1 -- 172.21.15.43:0/422698701 learned_addr learned my addr 172.21.15.43:0/422698701 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6f7fe700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b7006ad70 0x7f0b70147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6effd700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 0x7f0b701ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 -- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b7006ad70 msgr2=0x7f0b70147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b7006ad70 0x7f0b70147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 -- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 msgr2=0x7f0b701ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 0x7f0b701ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 -- 172.21.15.43:0/422698701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b600094a0 con 0x7f0b70151a90 2023-08-27T11:23:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6effd700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 0x7f0b701ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:41.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b6ffff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b68002230 tx=0x7f0b6800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800ab70 con 0x7f0b70151a90 2023-08-27T11:23:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800acf0 con 0x7f0b70151a90 2023-08-27T11:23:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68007310 con 0x7f0b70151a90 2023-08-27T11:23:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b700c1d20 con 0x7f0b70151a90 2023-08-27T11:23:41.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.560+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b70149890 con 0x7f0b70151a90 2023-08-27T11:23:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.562+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70149ab0 con 0x7f0b70151a90 2023-08-27T11:23:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.562+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b68007470 con 0x7f0b70151a90 2023-08-27T11:23:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.563+0000 7f0b57fff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 0x7f0b5c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:41.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.563+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0b68087c70 con 0x7f0b70151a90 2023-08-27T11:23:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.563+0000 7f0b6f7fe700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 0x7f0b5c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.564+0000 7f0b6f7fe700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 0x7f0b5c06c5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b600090b0 tx=0x7f0b6001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:41.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.567+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b680536a0 con 0x7f0b70151a90 2023-08-27T11:23:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.859+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0b7004ee70 con 0x7f0b70151a90 2023-08-27T11:23:41.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.863+0000 7f0b57fff700 1 -- 172.21.15.43:0/422698701 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0b68018020 con 0x7f0b70151a90 2023-08-27T11:23:41.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.865+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 msgr2=0x7f0b5c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.865+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 0x7f0b5c06c5d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0b600090b0 tx=0x7f0b6001c040 comp rx=0 tx=0).stop 2023-08-27T11:23:41.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.865+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 msgr2=0x7f0b701ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:41.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.865+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0b68002230 tx=0x7f0b6800cf50 comp rx=0 tx=0).stop 2023-08-27T11:23:41.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 shutdown_connections 2023-08-27T11:23:41.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b5c06a110 0x7f0b5c06c5d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b70151a90 0x7f0b701ed4f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b7006ad70 0x7f0b70147b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 --2- 172.21.15.43:0/422698701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b700c4630 0x7f0b701ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:41.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 >> 172.21.15.43:0/422698701 conn(0x7f0b700ab820 msgr2=0x7f0b7014b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:41.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 shutdown_connections 2023-08-27T11:23:41.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:41.866+0000 7f0b761ff700 1 -- 172.21.15.43:0/422698701 wait complete. 2023-08-27T11:23:41.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-27T11:23:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.087+0000 7f5890bff700 1 Processor -- start 2023-08-27T11:23:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.087+0000 7f5890bff700 1 -- start start 2023-08-27T11:23:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.088+0000 7f5890bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.088+0000 7f5890bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c154d00 con 0x7f588c0a79c0 2023-08-27T11:23:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.088+0000 7f5890bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c154fe0 con 0x7f588c0c50d0 2023-08-27T11:23:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.088+0000 7f5890bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0baf30 con 0x7f588c14e960 2023-08-27T11:23:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f5889d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f588c0a79c0 0x7f588c0c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45956/0 (socket says 172.21.15.43:45956) 2023-08-27T11:23:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f5889d9b700 1 -- 172.21.15.43:0/2485771688 learned_addr learned my addr 172.21.15.43:0/2485771688 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:42.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588a59c700 1 --2- 172.21.15.43:0/2485771688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953285691 0 0) 0x7f588c154d00 con 0x7f588c0a79c0 2023-08-27T11:23:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58740035b0 con 0x7f588c0a79c0 2023-08-27T11:23:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588a59c700 1 -- 172.21.15.43:0/2485771688 >> v1:172.21.15.57:6789/0 conn(0x7f588c0c50d0 legacy=0x7f588c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451409129 0 0) 0x7f588c154fe0 con 0x7f588c0c50d0 2023-08-27T11:23:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588a59c700 1 -- 172.21.15.43:0/2485771688 >> v1:172.21.15.43:6789/0 conn(0x7f588c0a79c0 legacy=0x7f588c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.089+0000 7f588a59c700 1 -- 172.21.15.43:0/2485771688 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c1552c0 con 0x7f588c14e960 2023-08-27T11:23:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f588a59c700 1 --2- 172.21.15.43:0/2485771688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c0a7480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8508bd0b6d45dbd4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011830 con 0x7f588c14e960 2023-08-27T11:23:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c011990 con 0x7f588c14e960 2023-08-27T11:23:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f588959a700 1 -- 172.21.15.43:0/2485771688 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c011d20 con 0x7f588c14e960 2023-08-27T11:23:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f5890bff700 1 -- 172.21.15.43:0/2485771688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 msgr2=0x7f588c0a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.090+0000 7f5890bff700 1 --2- 172.21.15.43:0/2485771688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c0a7480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f587c009870 tx=0x7f587c009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.091+0000 7f5890bff700 1 -- 172.21.15.43:0/2485771688 shutdown_connections 2023-08-27T11:23:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.091+0000 7f5890bff700 1 --2- 172.21.15.43:0/2485771688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c0a7480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.091+0000 7f5890bff700 1 -- 172.21.15.43:0/2485771688 >> 172.21.15.43:0/2485771688 conn(0x7f588c06aa50 msgr2=0x7f588c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.091+0000 7f5890bff700 1 -- 172.21.15.43:0/2485771688 shutdown_connections 2023-08-27T11:23:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.091+0000 7f5890bff700 1 -- 172.21.15.43:0/2485771688 wait complete. 2023-08-27T11:23:42.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.092+0000 7f5890bff700 1 Processor -- start 2023-08-27T11:23:42.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.092+0000 7f5890bff700 1 -- start start 2023-08-27T11:23:42.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f588c0a79c0 0x7f588c14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c151be0 con 0x7f588c0c50d0 2023-08-27T11:23:42.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c072740 con 0x7f588c0a79c0 2023-08-27T11:23:42.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5890bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c145520 con 0x7f588c14e960 2023-08-27T11:23:42.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.093+0000 7f5889d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47690/0 (socket says 172.21.15.43:47690) 2023-08-27T11:23:42.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 -- 172.21.15.43:0/1365922226 learned_addr learned my addr 172.21.15.43:0/1365922226 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:42.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f588a59c700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f588c0a79c0 0x7f588c14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f588ad9d700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 -- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 msgr2=0x7f588c144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 -- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f588c0a79c0 msgr2=0x7f588c14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f588c0a79c0 0x7f588c14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 -- 172.21.15.43:0/1365922226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0094a0 con 0x7f588c0c50d0 2023-08-27T11:23:42.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5889d9b700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f588000c4d0 tx=0x7f588000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880005d70 con 0x7f588c0c50d0 2023-08-27T11:23:42.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58800070d0 con 0x7f588c0c50d0 2023-08-27T11:23:42.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c151060 con 0x7f588c0c50d0 2023-08-27T11:23:42.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.094+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880007440 con 0x7f588c0c50d0 2023-08-27T11:23:42.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.095+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c151620 con 0x7f588c0c50d0 2023-08-27T11:23:42.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.096+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c04ee70 con 0x7f588c0c50d0 2023-08-27T11:23:42.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.097+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f58800075a0 con 0x7f588c0c50d0 2023-08-27T11:23:42.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.098+0000 7f587affd700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 0x7f586c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.098+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5880087660 con 0x7f588c0c50d0 2023-08-27T11:23:42.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.098+0000 7f588a59c700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 0x7f586c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.098+0000 7f588a59c700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 0x7f586c06c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f587c0090b0 tx=0x7f587c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.102+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5880053140 con 0x7f588c0c50d0 2023-08-27T11:23:42.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.395+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f588c0c0460 con 0x7f588c0c50d0 2023-08-27T11:23:42.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.399+0000 7f587affd700 1 -- 172.21.15.43:0/1365922226 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5880056760 con 0x7f588c0c50d0 2023-08-27T11:23:42.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 msgr2=0x7f586c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 0x7f586c06c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f587c0090b0 tx=0x7f587c01c040 comp rx=0 tx=0).stop 2023-08-27T11:23:42.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 msgr2=0x7f588c144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f588000c4d0 tx=0x7f588000c890 comp rx=0 tx=0).stop 2023-08-27T11:23:42.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 shutdown_connections 2023-08-27T11:23:42.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f586c06a0e0 0x7f586c06c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f588c14e960 0x7f588c144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f588c0a79c0 0x7f588c14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 --2- 172.21.15.43:0/1365922226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f588c0c50d0 0x7f588c144aa0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 >> 172.21.15.43:0/1365922226 conn(0x7f588c06aa50 msgr2=0x7f588c0a5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:42.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.401+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 shutdown_connections 2023-08-27T11:23:42.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.402+0000 7f5890bff700 1 -- 172.21.15.43:0/1365922226 wait complete. 2023-08-27T11:23:42.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-27T11:23:42.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.622+0000 7f84ca7ff700 1 Processor -- start 2023-08-27T11:23:42.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.623+0000 7f84ca7ff700 1 -- start start 2023-08-27T11:23:42.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84ca7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f84c40c4630 0x7f84c40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84ca7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c406ad70 0x7f84c406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84ca7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c406c4e0 con 0x7f84c4151a90 2023-08-27T11:23:42.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84ca7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c4155370 con 0x7f84c40c4630 2023-08-27T11:23:42.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84ca7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40c82c0 con 0x7f84c406ad70 2023-08-27T11:23:42.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84c3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f84c4151a90 0x7f84c40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45972/0 (socket says 172.21.15.43:45972) 2023-08-27T11:23:42.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84c3fff700 1 -- 172.21.15.43:0/1386678129 learned_addr learned my addr 172.21.15.43:0/1386678129 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:42.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84c37fe700 1 --2- 172.21.15.43:0/1386678129 >> v2:172.21.15.57:3300/0 conn(0x7f84c40c4630 0x7f84c40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.624+0000 7f84c8d9c700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c406ad70 0x7f84c406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c2ffd700 1 -- 172.21.15.43:0/1386678129 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610414641 0 0) 0x7f84c406c4e0 con 0x7f84c4151a90 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c2ffd700 1 -- 172.21.15.43:0/1386678129 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ac0035b0 con 0x7f84c4151a90 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c37fe700 1 -- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c406ad70 msgr2=0x7f84c406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c37fe700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c406ad70 0x7f84c406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c37fe700 1 -- 172.21.15.43:0/1386678129 >> v1:172.21.15.43:6789/0 conn(0x7f84c4151a90 legacy=0x7f84c40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c37fe700 1 -- 172.21.15.43:0/1386678129 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4151e70 con 0x7f84c40c4630 2023-08-27T11:23:42.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c37fe700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c40c4630 0x7f84c40c4a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009840 tx=0x7f84b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9537a2779a3a81a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c2ffd700 1 -- 172.21.15.43:0/1386678129 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011830 con 0x7f84c40c4630 2023-08-27T11:23:42.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c2ffd700 1 -- 172.21.15.43:0/1386678129 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8011990 con 0x7f84c40c4630 2023-08-27T11:23:42.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.625+0000 7f84c2ffd700 1 -- 172.21.15.43:0/1386678129 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011d20 con 0x7f84c40c4630 2023-08-27T11:23:42.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 -- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c40c4630 msgr2=0x7f84c40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c40c4630 0x7f84c40c4a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009840 tx=0x7f84b8009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:42.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 -- 172.21.15.43:0/1386678129 shutdown_connections 2023-08-27T11:23:42.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c406ad70 0x7f84c406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/1386678129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c40c4630 0x7f84c40c4a90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 -- 172.21.15.43:0/1386678129 >> 172.21.15.43:0/1386678129 conn(0x7f84c40ab820 msgr2=0x7f84c40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:42.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 -- 172.21.15.43:0/1386678129 shutdown_connections 2023-08-27T11:23:42.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.626+0000 7f84ca7ff700 1 -- 172.21.15.43:0/1386678129 wait complete. 2023-08-27T11:23:42.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.628+0000 7f84ca7ff700 1 Processor -- start 2023-08-27T11:23:42.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.628+0000 7f84ca7ff700 1 -- start start 2023-08-27T11:23:42.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c406ad70 0x7f84c40c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c4151a90 0x7f84c41502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41ea340 con 0x7f84c40c4630 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41e97c0 con 0x7f84c406ad70 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84ca7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41e9aa0 con 0x7f84c4151a90 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84c37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47692/0 (socket says 172.21.15.43:47692) 2023-08-27T11:23:42.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84c37fe700 1 -- 172.21.15.43:0/4005865197 learned_addr learned my addr 172.21.15.43:0/4005865197 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:42.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.629+0000 7f84c8d9c700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c4151a90 0x7f84c41502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c3fff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c406ad70 0x7f84c40c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 -- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c4151a90 msgr2=0x7f84c41502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c4151a90 0x7f84c41502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 -- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c406ad70 msgr2=0x7f84c40c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c406ad70 0x7f84c40c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 -- 172.21.15.43:0/4005865197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80094a0 con 0x7f84c40c4630 2023-08-27T11:23:42.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c37fe700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f84b80090b0 tx=0x7f84b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80036a0 con 0x7f84c40c4630 2023-08-27T11:23:42.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b801f070 con 0x7f84c40c4630 2023-08-27T11:23:42.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8003a40 con 0x7f84c40c4630 2023-08-27T11:23:42.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c41e9d80 con 0x7f84c40c4630 2023-08-27T11:23:42.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.630+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c41e93e0 con 0x7f84c40c4630 2023-08-27T11:23:42.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.631+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c41e9570 con 0x7f84c40c4630 2023-08-27T11:23:42.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.632+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84b8003ba0 con 0x7f84c40c4630 2023-08-27T11:23:42.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.633+0000 7f84c0ff9700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 0x7f84b006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:42.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.633+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f84b8021070 con 0x7f84c40c4630 2023-08-27T11:23:42.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.633+0000 7f84c3fff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 0x7f84b006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:42.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.634+0000 7f84c3fff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 0x7f84b006c620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b40011e0 tx=0x7f84b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:42.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.637+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84b80554a0 con 0x7f84c40c4630 2023-08-27T11:23:42.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.933+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f84c404ee70 con 0x7f84c40c4630 2023-08-27T11:23:42.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.937+0000 7f84c0ff9700 1 -- 172.21.15.43:0/4005865197 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f84b8058ac0 con 0x7f84c40c4630 2023-08-27T11:23:42.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.939+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 msgr2=0x7f84b006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.939+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 0x7f84b006c620 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84b40011e0 tx=0x7f84b4009040 comp rx=0 tx=0).stop 2023-08-27T11:23:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.939+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 msgr2=0x7f84c414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.939+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f84b80090b0 tx=0x7f84b8004750 comp rx=0 tx=0).stop 2023-08-27T11:23:42.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 shutdown_connections 2023-08-27T11:23:42.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f84b006a160 0x7f84b006c620 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84c4151a90 0x7f84c41502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84c406ad70 0x7f84c40c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 --2- 172.21.15.43:0/4005865197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f84c40c4630 0x7f84c414cf20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:42.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 >> 172.21.15.43:0/4005865197 conn(0x7f84c40ab820 msgr2=0x7f84c40c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:42.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 shutdown_connections 2023-08-27T11:23:42.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:42.940+0000 7f84ca7ff700 1 -- 172.21.15.43:0/4005865197 wait complete. 2023-08-27T11:23:42.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-27T11:23:43.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.161+0000 7f007bdff700 1 Processor -- start 2023-08-27T11:23:43.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.161+0000 7f007bdff700 1 -- start start 2023-08-27T11:23:43.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.162+0000 7f007bdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00740c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.162+0000 7f007bdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074154d00 con 0x7f007414e960 2023-08-27T11:23:43.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.162+0000 7f007bdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0074154fe0 con 0x7f00740c50d0 2023-08-27T11:23:43.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.162+0000 7f007bdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740baf30 con 0x7f0074154740 2023-08-27T11:23:43.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0079b9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f007414e960 0x7f00740a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:45986/0 (socket says 172.21.15.43:45986) 2023-08-27T11:23:43.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0079b9b700 1 -- 172.21.15.43:0/1294819927 learned_addr learned my addr 172.21.15.43:0/1294819927 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:43.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f007a39c700 1 --2- 172.21.15.43:0/1294819927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00740c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019640286 0 0) 0x7f0074154d00 con 0x7f007414e960 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00600035b0 con 0x7f007414e960 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358836115 0 0) 0x7f0074154fe0 con 0x7f00740c50d0 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0074154d00 con 0x7f00740c50d0 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f007a39c700 1 -- 172.21.15.43:0/1294819927 >> v1:172.21.15.57:6789/0 conn(0x7f00740c50d0 legacy=0x7f00740c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f007a39c700 1 -- 172.21.15.43:0/1294819927 >> v1:172.21.15.43:6789/0 conn(0x7f007414e960 legacy=0x7f00740a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.163+0000 7f007a39c700 1 -- 172.21.15.43:0/1294819927 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00741552c0 con 0x7f0074154740 2023-08-27T11:23:43.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f007a39c700 1 --2- 172.21.15.43:0/1294819927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00740c43d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f006c009dc0 tx=0x7f006c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be68284256bf67c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00e070 con 0x7f0074154740 2023-08-27T11:23:43.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00bb20 con 0x7f0074154740 2023-08-27T11:23:43.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f0078b99700 1 -- 172.21.15.43:0/1294819927 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c012430 con 0x7f0074154740 2023-08-27T11:23:43.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f007bdff700 1 -- 172.21.15.43:0/1294819927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 msgr2=0x7f00740c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.164+0000 7f007bdff700 1 --2- 172.21.15.43:0/1294819927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00740c43d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f006c009dc0 tx=0x7f006c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:43.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.165+0000 7f007bdff700 1 -- 172.21.15.43:0/1294819927 shutdown_connections 2023-08-27T11:23:43.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.165+0000 7f007bdff700 1 --2- 172.21.15.43:0/1294819927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00740c43d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.165+0000 7f007bdff700 1 -- 172.21.15.43:0/1294819927 >> 172.21.15.43:0/1294819927 conn(0x7f007406aa50 msgr2=0x7f00740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:43.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.165+0000 7f007bdff700 1 -- 172.21.15.43:0/1294819927 shutdown_connections 2023-08-27T11:23:43.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.165+0000 7f007bdff700 1 -- 172.21.15.43:0/1294819927 wait complete. 2023-08-27T11:23:43.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.166+0000 7f007bdff700 1 Processor -- start 2023-08-27T11:23:43.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.166+0000 7f007bdff700 1 -- start start 2023-08-27T11:23:43.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740c50d0 0x7f00741e5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00741e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00741e85a0 con 0x7f007414e960 2023-08-27T11:23:43.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007414f0a0 con 0x7f00740c50d0 2023-08-27T11:23:43.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.167+0000 7f007bdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007414f380 con 0x7f0074154740 2023-08-27T11:23:43.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47708/0 (socket says 172.21.15.43:47708) 2023-08-27T11:23:43.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 -- 172.21.15.43:0/1270778762 learned_addr learned my addr 172.21.15.43:0/1270778762 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:43.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f0079b9b700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740c50d0 0x7f00741e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007a39c700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00741e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 -- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 msgr2=0x7f00741e8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00741e8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 -- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740c50d0 msgr2=0x7f00741e5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740c50d0 0x7f00741e5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 -- 172.21.15.43:0/1270778762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009a70 con 0x7f007414e960 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.168+0000 7f007939a700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f006400c4f0 tx=0x7f006400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.169+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640052d0 con 0x7f007414e960 2023-08-27T11:23:43.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.169+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064005430 con 0x7f007414e960 2023-08-27T11:23:43.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.169+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064003880 con 0x7f007414e960 2023-08-27T11:23:43.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.169+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007414f660 con 0x7f007414e960 2023-08-27T11:23:43.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.169+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0074152c10 con 0x7f007414e960 2023-08-27T11:23:43.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.170+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007414f8a0 con 0x7f007414e960 2023-08-27T11:23:43.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.171+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f00640039e0 con 0x7f007414e960 2023-08-27T11:23:43.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.172+0000 7f006a7fc700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 0x7f005806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.172+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0064087500 con 0x7f007414e960 2023-08-27T11:23:43.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.172+0000 7f0079b9b700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 0x7f005806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.173+0000 7f0079b9b700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 0x7f005806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0070007fd0 tx=0x7f0070007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.177+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0064052fe0 con 0x7f007414e960 2023-08-27T11:23:43.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.473+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f007404ee70 con 0x7f007414e960 2023-08-27T11:23:43.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.477+0000 7f006a7fc700 1 -- 172.21.15.43:0/1270778762 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0064056600 con 0x7f007414e960 2023-08-27T11:23:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 msgr2=0x7f005806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 0x7f005806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0070007fd0 tx=0x7f0070007dc0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 msgr2=0x7f00741526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f006400c4f0 tx=0x7f006400c800 comp rx=0 tx=0).stop 2023-08-27T11:23:43.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 shutdown_connections 2023-08-27T11:23:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f005806a0e0 0x7f005806c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0074154740 0x7f00741e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740c50d0 0x7f00741e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 --2- 172.21.15.43:0/1270778762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f007414e960 0x7f00741526d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 >> 172.21.15.43:0/1270778762 conn(0x7f007406aa50 msgr2=0x7f00740c0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:43.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 shutdown_connections 2023-08-27T11:23:43.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.479+0000 7f007bdff700 1 -- 172.21.15.43:0/1270778762 wait complete. 2023-08-27T11:23:43.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-27T11:23:43.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.699+0000 7f4186dff700 1 Processor -- start 2023-08-27T11:23:43.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.699+0000 7f4186dff700 1 -- start start 2023-08-27T11:23:43.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41800c51a0 0x7f418006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f418006ca60 0x7f41800aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800ab040 0x7f4180155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41801530b0 con 0x7f41800c51a0 2023-08-27T11:23:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418014c860 con 0x7f418006ca60 2023-08-27T11:23:43.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4186dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418006d700 con 0x7f41800ab040 2023-08-27T11:23:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4184b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41800c51a0 0x7f418006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4184b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f41800c51a0 0x7f418006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47716/0 (socket says 172.21.15.43:47716) 2023-08-27T11:23:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f4184b9b700 1 -- 172.21.15.43:0/2161623046 learned_addr learned my addr 172.21.15.43:0/2161623046 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:43.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f417ffff700 1 --2- 172.21.15.43:0/2161623046 >> v2:172.21.15.57:3300/0 conn(0x7f418006ca60 0x7f41800aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.700+0000 7f418539c700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800ab040 0x7f4180155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 -- 172.21.15.43:0/2161623046 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800ab040 msgr2=0x7f4180155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800ab040 0x7f4180155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 -- 172.21.15.43:0/2161623046 >> v2:172.21.15.57:3300/0 conn(0x7f418006ca60 msgr2=0x7f41800aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:43.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 --2- 172.21.15.43:0/2161623046 >> v2:172.21.15.57:3300/0 conn(0x7f418006ca60 0x7f41800aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 -- 172.21.15.43:0/2161623046 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180152430 con 0x7f41800c51a0 2023-08-27T11:23:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f4184b9b700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41800c51a0 0x7f418006d1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f41800aba70 tx=0x7f4174009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a9e9321772b5b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f417f7fe700 1 -- 172.21.15.43:0/2161623046 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011830 con 0x7f41800c51a0 2023-08-27T11:23:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f417f7fe700 1 -- 172.21.15.43:0/2161623046 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011990 con 0x7f41800c51a0 2023-08-27T11:23:43.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.701+0000 7f417f7fe700 1 -- 172.21.15.43:0/2161623046 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011d20 con 0x7f41800c51a0 2023-08-27T11:23:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 -- 172.21.15.43:0/2161623046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41800c51a0 msgr2=0x7f418006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41800c51a0 0x7f418006d1c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f41800aba70 tx=0x7f4174009c30 comp rx=0 tx=0).stop 2023-08-27T11:23:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 -- 172.21.15.43:0/2161623046 shutdown_connections 2023-08-27T11:23:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800ab040 0x7f4180155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 --2- 172.21.15.43:0/2161623046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f41800c51a0 0x7f418006d1c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 --2- 172.21.15.43:0/2161623046 >> v2:172.21.15.57:3300/0 conn(0x7f418006ca60 0x7f41800aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 -- 172.21.15.43:0/2161623046 >> 172.21.15.43:0/2161623046 conn(0x7f418006aa50 msgr2=0x7f41800c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 -- 172.21.15.43:0/2161623046 shutdown_connections 2023-08-27T11:23:43.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.702+0000 7f4186dff700 1 -- 172.21.15.43:0/2161623046 wait complete. 2023-08-27T11:23:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.703+0000 7f4186dff700 1 Processor -- start 2023-08-27T11:23:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.704+0000 7f4186dff700 1 -- start start 2023-08-27T11:23:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.704+0000 7f4186dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.704+0000 7f4186dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41800ab040 0x7f418014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.704+0000 7f4186dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800c51a0 0x7f418014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4186dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800bf280 con 0x7f418006ca60 2023-08-27T11:23:43.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4186dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800bee60 con 0x7f41800ab040 2023-08-27T11:23:43.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4186dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800bddf0 con 0x7f41800c51a0 2023-08-27T11:23:43.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47720/0 (socket says 172.21.15.43:47720) 2023-08-27T11:23:43.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 -- 172.21.15.43:0/3968124314 learned_addr learned my addr 172.21.15.43:0/3968124314 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:43.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f417ffff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41800ab040 0x7f418014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f418539c700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800c51a0 0x7f418014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 -- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800c51a0 msgr2=0x7f418014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800c51a0 0x7f418014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 -- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41800ab040 msgr2=0x7f418014aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:43.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41800ab040 0x7f418014aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:43.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 -- 172.21.15.43:0/3968124314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4174009550 con 0x7f418006ca60 2023-08-27T11:23:43.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.705+0000 7f4184b9b700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f4174004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.706+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174004450 con 0x7f418006ca60 2023-08-27T11:23:43.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.706+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417401e070 con 0x7f418006ca60 2023-08-27T11:23:43.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.706+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801500a0 con 0x7f418006ca60 2023-08-27T11:23:43.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.706+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740038a0 con 0x7f418006ca60 2023-08-27T11:23:43.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.706+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800c2af0 con 0x7f418006ca60 2023-08-27T11:23:43.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.707+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41801502e0 con 0x7f418006ca60 2023-08-27T11:23:43.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.708+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4174003a00 con 0x7f418006ca60 2023-08-27T11:23:43.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.709+0000 7f417d7fa700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 0x7f416406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:43.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.709+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4174088fa0 con 0x7f418006ca60 2023-08-27T11:23:43.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.709+0000 7f417ffff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 0x7f416406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:43.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.710+0000 7f417ffff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 0x7f416406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f416c009b60 tx=0x7f416c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:43.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:43.713+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f41801502e0 con 0x7f418006ca60 2023-08-27T11:23:44.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.004+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f41801502e0 con 0x7f418006ca60 2023-08-27T11:23:44.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.008+0000 7f417d7fa700 1 -- 172.21.15.43:0/3968124314 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f41801502e0 con 0x7f418006ca60 2023-08-27T11:23:44.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 msgr2=0x7f416406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 0x7f416406c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f416c009b60 tx=0x7f416c009210 comp rx=0 tx=0).stop 2023-08-27T11:23:44.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 msgr2=0x7f41801549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4174000c00 tx=0x7f4174004750 comp rx=0 tx=0).stop 2023-08-27T11:23:44.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 shutdown_connections 2023-08-27T11:23:44.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f416406a0e0 0x7f416406c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f41800c51a0 0x7f418014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f418006ca60 0x7f41801549d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 --2- 172.21.15.43:0/3968124314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41800ab040 0x7f418014aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 >> 172.21.15.43:0/3968124314 conn(0x7f418006aa50 msgr2=0x7f41800733d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:44.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.010+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 shutdown_connections 2023-08-27T11:23:44.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.011+0000 7f4186dff700 1 -- 172.21.15.43:0/3968124314 wait complete. 2023-08-27T11:23:44.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:44.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.230+0000 7fb297fff700 1 Processor -- start 2023-08-27T11:23:44.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.230+0000 7fb297fff700 1 -- start start 2023-08-27T11:23:44.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb297fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb297fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29006c4e0 con 0x7fb29006ad70 2023-08-27T11:23:44.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb297fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb290155370 con 0x7fb2900c4630 2023-08-27T11:23:44.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb297fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb290151e70 con 0x7fb290151a90 2023-08-27T11:23:44.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb295d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.231+0000 7fb29559a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb29559a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:46842/0 (socket says 172.21.15.43:46842) 2023-08-27T11:23:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:46074/0 (socket says 172.21.15.43:46074) 2023-08-27T11:23:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb29559a700 1 -- 172.21.15.43:0/103695574 learned_addr learned my addr 172.21.15.43:0/103695574 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 -- 172.21.15.43:0/103695574 >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 msgr2=0x7fb2900c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:44.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 --2- 172.21.15.43:0/103695574 >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 -- 172.21.15.43:0/103695574 >> v1:172.21.15.57:6789/0 conn(0x7fb29006ad70 legacy=0x7fb29006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 -- 172.21.15.43:0/103695574 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb290154480 con 0x7fb290151a90 2023-08-27T11:23:44.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb29559a700 1 --2- 172.21.15.43:0/103695574 >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:44.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.232+0000 7fb295d9b700 1 --2- 172.21.15.43:0/103695574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009840 tx=0x7fb28c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9179393595534aba server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb294d99700 1 -- 172.21.15.43:0/103695574 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c011830 con 0x7fb290151a90 2023-08-27T11:23:44.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb294d99700 1 -- 172.21.15.43:0/103695574 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c011990 con 0x7fb290151a90 2023-08-27T11:23:44.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb294d99700 1 -- 172.21.15.43:0/103695574 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c011d20 con 0x7fb290151a90 2023-08-27T11:23:44.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 -- 172.21.15.43:0/103695574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 msgr2=0x7fb2900c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 --2- 172.21.15.43:0/103695574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009840 tx=0x7fb28c009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:44.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 -- 172.21.15.43:0/103695574 shutdown_connections 2023-08-27T11:23:44.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 --2- 172.21.15.43:0/103695574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb290151a90 0x7fb2900c7bb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 --2- 172.21.15.43:0/103695574 >> v2:172.21.15.57:3300/0 conn(0x7fb2900c4630 0x7fb2900c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 -- 172.21.15.43:0/103695574 >> 172.21.15.43:0/103695574 conn(0x7fb2900ab820 msgr2=0x7fb2900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 -- 172.21.15.43:0/103695574 shutdown_connections 2023-08-27T11:23:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.233+0000 7fb297fff700 1 -- 172.21.15.43:0/103695574 wait complete. 2023-08-27T11:23:44.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.235+0000 7fb297fff700 1 Processor -- start 2023-08-27T11:23:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.235+0000 7fb297fff700 1 -- start start 2023-08-27T11:23:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2900c4630 0x7fb2901e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 0x7fb2901e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29014fd70 con 0x7fb290151a90 2023-08-27T11:23:44.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb290150e30 con 0x7fb2900c4630 2023-08-27T11:23:44.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.236+0000 7fb297fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb290154320 con 0x7fb29006ad70 2023-08-27T11:23:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb29559a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2900c4630 0x7fb2901e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:46078/0 (socket says 172.21.15.43:46078) 2023-08-27T11:23:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb29659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 0x7fb2901e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 -- 172.21.15.43:0/195975643 learned_addr learned my addr 172.21.15.43:0/195975643 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 -- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2900c4630 msgr2=0x7fb2901e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2900c4630 0x7fb2901e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 -- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 msgr2=0x7fb2901e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 0x7fb2901e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 -- 172.21.15.43:0/195975643 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009550 con 0x7fb29006ad70 2023-08-27T11:23:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb29659c700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 0x7fb2901e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.237+0000 7fb295d9b700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb28c014040 tx=0x7fb28c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.243+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0036a0 con 0x7fb29006ad70 2023-08-27T11:23:44.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.243+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c01f070 con 0x7fb29006ad70 2023-08-27T11:23:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.243+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c003a20 con 0x7fb29006ad70 2023-08-27T11:23:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.243+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28c0094a0 con 0x7fb29006ad70 2023-08-27T11:23:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.243+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2901587e0 con 0x7fb29006ad70 2023-08-27T11:23:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.244+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb290150b70 con 0x7fb29006ad70 2023-08-27T11:23:44.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.245+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb28c003b80 con 0x7fb29006ad70 2023-08-27T11:23:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.246+0000 7fb2867fc700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 0x7fb27406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.246+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb28c021070 con 0x7fb29006ad70 2023-08-27T11:23:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.246+0000 7fb29559a700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 0x7fb27406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.246+0000 7fb29559a700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 0x7fb27406c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb2900bd360 tx=0x7fb2800092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.252+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb28c055400 con 0x7fb29006ad70 2023-08-27T11:23:44.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.465+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb290150f70 con 0x7fb29006ad70 2023-08-27T11:23:44.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.466+0000 7fb2867fc700 1 -- 172.21.15.43:0/195975643 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14521 (secure 0 0 0) 0x7fb28c015090 con 0x7fb29006ad70 2023-08-27T11:23:44.468 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:44.468 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":30,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:40.237617+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:44.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 msgr2=0x7fb27406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 0x7fb27406c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb2900bd360 tx=0x7fb2800092c0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 msgr2=0x7fb290146180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb28c014040 tx=0x7fb28c004750 comp rx=0 tx=0).stop 2023-08-27T11:23:44.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 shutdown_connections 2023-08-27T11:23:44.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb27406a0e0 0x7fb27406c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb290151a90 0x7fb2901e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb29006ad70 0x7fb290146180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 --2- 172.21.15.43:0/195975643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2900c4630 0x7fb2901e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 >> 172.21.15.43:0/195975643 conn(0x7fb2900ab820 msgr2=0x7fb29014e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:44.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 shutdown_connections 2023-08-27T11:23:44.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.469+0000 7fb297fff700 1 -- 172.21.15.43:0/195975643 wait complete. 2023-08-27T11:23:44.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:23:44.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:23:44.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.692+0000 7f83b5dff700 1 Processor -- start 2023-08-27T11:23:44.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.692+0000 7f83b5dff700 1 -- start start 2023-08-27T11:23:44.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.693+0000 7f83b5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.693+0000 7f83b5dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 0x7f83b00ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.693+0000 7f83b5dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b0154660 con 0x7f83b00abcc0 2023-08-27T11:23:44.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.693+0000 7f83b5dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00c5750 con 0x7f83b00c7c00 2023-08-27T11:23:44.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.693+0000 7f83b5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0154940 con 0x7f83b0151d20 2023-08-27T11:23:44.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.694+0000 7f83af7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.694+0000 7f83aeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 0x7f83b00ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.694+0000 7f83affff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f83b00abcc0 0x7f83b006a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:52854/0 (socket says 172.21.15.43:52854) 2023-08-27T11:23:44.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.694+0000 7f83affff700 1 -- 172.21.15.43:0/2273450005 learned_addr learned my addr 172.21.15.43:0/2273450005 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:44.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.694+0000 7f83ae7fc700 1 -- 172.21.15.43:0/2273450005 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648925004 0 0) 0x7f83b0154660 con 0x7f83b00abcc0 2023-08-27T11:23:44.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83ae7fc700 1 -- 172.21.15.43:0/2273450005 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83980035b0 con 0x7f83b00abcc0 2023-08-27T11:23:44.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83af7fe700 1 -- 172.21.15.43:0/2273450005 >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 msgr2=0x7f83b00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:44.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83af7fe700 1 --2- 172.21.15.43:0/2273450005 >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 0x7f83b00ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83af7fe700 1 -- 172.21.15.43:0/2273450005 >> v1:172.21.15.57:6789/0 conn(0x7f83b00abcc0 legacy=0x7f83b006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83af7fe700 1 -- 172.21.15.43:0/2273450005 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0154c20 con 0x7f83b0151d20 2023-08-27T11:23:44.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83aeffd700 1 --2- 172.21.15.43:0/2273450005 >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 0x7f83b00ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:44.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83af7fe700 1 --2- 172.21.15.43:0/2273450005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c8110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009840 tx=0x7f83a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9424b4291acf725a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83ae7fc700 1 -- 172.21.15.43:0/2273450005 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0011830 con 0x7f83b0151d20 2023-08-27T11:23:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83ae7fc700 1 -- 172.21.15.43:0/2273450005 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0011990 con 0x7f83b0151d20 2023-08-27T11:23:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.695+0000 7f83ae7fc700 1 -- 172.21.15.43:0/2273450005 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0011d20 con 0x7f83b0151d20 2023-08-27T11:23:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 -- 172.21.15.43:0/2273450005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 msgr2=0x7f83b00c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 --2- 172.21.15.43:0/2273450005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c8110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009840 tx=0x7f83a0009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:44.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 -- 172.21.15.43:0/2273450005 shutdown_connections 2023-08-27T11:23:44.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 --2- 172.21.15.43:0/2273450005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c8110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 --2- 172.21.15.43:0/2273450005 >> v2:172.21.15.57:3300/0 conn(0x7f83b00c7c00 0x7f83b00ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 -- 172.21.15.43:0/2273450005 >> 172.21.15.43:0/2273450005 conn(0x7f83b00c9d00 msgr2=0x7f83b00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:44.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 -- 172.21.15.43:0/2273450005 shutdown_connections 2023-08-27T11:23:44.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.696+0000 7f83b5dff700 1 -- 172.21.15.43:0/2273450005 wait complete. 2023-08-27T11:23:44.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.698+0000 7f83b5dff700 1 Processor -- start 2023-08-27T11:23:44.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.698+0000 7f83b5dff700 1 -- start start 2023-08-27T11:23:44.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b00c7c00 0x7f83b0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01eded0 con 0x7f83b00abcc0 2023-08-27T11:23:44.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0155a70 con 0x7f83b00c7c00 2023-08-27T11:23:44.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83b5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00aaa20 con 0x7f83b0151d20 2023-08-27T11:23:44.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47736/0 (socket says 172.21.15.43:47736) 2023-08-27T11:23:44.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 -- 172.21.15.43:0/4174386930 learned_addr learned my addr 172.21.15.43:0/4174386930 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:44.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 -- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 msgr2=0x7f83b00c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 -- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b00c7c00 msgr2=0x7f83b0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b00c7c00 0x7f83b0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.699+0000 7f83af7fe700 1 -- 172.21.15.43:0/4174386930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40094a0 con 0x7f83b00abcc0 2023-08-27T11:23:44.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f83af7fe700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83a00090b0 tx=0x7f83a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00036a0 con 0x7f83b00abcc0 2023-08-27T11:23:44.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a001f070 con 0x7f83b00abcc0 2023-08-27T11:23:44.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a00094a0 con 0x7f83b00abcc0 2023-08-27T11:23:44.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0003a00 con 0x7f83b00abcc0 2023-08-27T11:23:44.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.700+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b00aafe0 con 0x7f83b00abcc0 2023-08-27T11:23:44.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.701+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b004ee70 con 0x7f83b00abcc0 2023-08-27T11:23:44.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.702+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f83a0003b60 con 0x7f83b00abcc0 2023-08-27T11:23:44.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.703+0000 7f8397fff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 0x7f839c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:44.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.703+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f83a0021070 con 0x7f83b00abcc0 2023-08-27T11:23:44.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.703+0000 7f83aeffd700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 0x7f839c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:44.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.704+0000 7f83aeffd700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 0x7f839c06c5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006f10 tx=0x7f83a4006e60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:44.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.707+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f83a00554b0 con 0x7f83b00abcc0 2023-08-27T11:23:44.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.921+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83b00ac650 con 0x7f83b00abcc0 2023-08-27T11:23:44.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.922+0000 7f8397fff700 1 -- 172.21.15.43:0/4174386930 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83a0015020 con 0x7f83b00abcc0 2023-08-27T11:23:44.924 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:23:44.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 msgr2=0x7f839c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 0x7f839c06c5d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006f10 tx=0x7f83a4006e60 comp rx=0 tx=0).stop 2023-08-27T11:23:44.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 msgr2=0x7f83b01ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:44.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83a00090b0 tx=0x7f83a0004750 comp rx=0 tx=0).stop 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 shutdown_connections 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f839c06a110 0x7f839c06c5d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83b0151d20 0x7f83b00c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83b00abcc0 0x7f83b01ed8f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 --2- 172.21.15.43:0/4174386930 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f83b00c7c00 0x7f83b0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:44.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 >> 172.21.15.43:0/4174386930 conn(0x7f83b00c9d00 msgr2=0x7f83b00c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:44.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 shutdown_connections 2023-08-27T11:23:44.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:44.924+0000 7f83b5dff700 1 -- 172.21.15.43:0/4174386930 wait complete. 2023-08-27T11:23:44.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:23:45.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.147+0000 7f75c0bff700 1 Processor -- start 2023-08-27T11:23:45.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.147+0000 7f75c0bff700 1 -- start start 2023-08-27T11:23:45.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75c0bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75bc151fc0 0x7f75bc158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75c0bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc157af0 con 0x7f75bc071f70 2023-08-27T11:23:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75c0bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc158a80 con 0x7f75bc0c0020 2023-08-27T11:23:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75c0bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0a6040 con 0x7f75bc151fc0 2023-08-27T11:23:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75b9d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75bc151fc0 0x7f75bc158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.148+0000 7f75bad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f75bc071f70 0x7f75bc0708c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46002/0 (socket says 172.21.15.43:46002) 2023-08-27T11:23:45.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75bad9d700 1 -- 172.21.15.43:0/2014830614 learned_addr learned my addr 172.21.15.43:0/2014830614 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:45.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b9d9b700 1 -- 172.21.15.43:0/2014830614 >> v1:172.21.15.57:6789/0 conn(0x7f75bc0c0020 legacy=0x7f75bc1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b9d9b700 1 -- 172.21.15.43:0/2014830614 >> v1:172.21.15.43:6789/0 conn(0x7f75bc071f70 legacy=0x7f75bc0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b9d9b700 1 -- 172.21.15.43:0/2014830614 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0a6320 con 0x7f75bc151fc0 2023-08-27T11:23:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b959a700 1 -- 172.21.15.43:0/2014830614 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436720179 0 0) 0x7f75bc157af0 con 0x7f75bc071f70 2023-08-27T11:23:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b9d9b700 1 --2- 172.21.15.43:0/2014830614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc151fc0 0x7f75bc158540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009840 tx=0x7f75b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd337d740a2dffe server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b959a700 1 -- 172.21.15.43:0/2014830614 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0011830 con 0x7f75bc151fc0 2023-08-27T11:23:45.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.149+0000 7f75b959a700 1 -- 172.21.15.43:0/2014830614 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b0011990 con 0x7f75bc151fc0 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75b959a700 1 -- 172.21.15.43:0/2014830614 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0011d20 con 0x7f75bc151fc0 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 -- 172.21.15.43:0/2014830614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc151fc0 msgr2=0x7f75bc158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 --2- 172.21.15.43:0/2014830614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc151fc0 0x7f75bc158540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009840 tx=0x7f75b0009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 -- 172.21.15.43:0/2014830614 shutdown_connections 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 --2- 172.21.15.43:0/2014830614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc151fc0 0x7f75bc158540 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 -- 172.21.15.43:0/2014830614 >> 172.21.15.43:0/2014830614 conn(0x7f75bc0c6a40 msgr2=0x7f75bc0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 -- 172.21.15.43:0/2014830614 shutdown_connections 2023-08-27T11:23:45.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.150+0000 7f75c0bff700 1 -- 172.21.15.43:0/2014830614 wait complete. 2023-08-27T11:23:45.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.152+0000 7f75c0bff700 1 Processor -- start 2023-08-27T11:23:45.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.152+0000 7f75c0bff700 1 -- start start 2023-08-27T11:23:45.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 0x7f75bc149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75bc151fc0 0x7f75bc14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1eda10 con 0x7f75bc071f70 2023-08-27T11:23:45.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0abe00 con 0x7f75bc0c0020 2023-08-27T11:23:45.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75c0bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1529b0 con 0x7f75bc151fc0 2023-08-27T11:23:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75ba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75ba59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47752/0 (socket says 172.21.15.43:47752) 2023-08-27T11:23:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.153+0000 7f75ba59c700 1 -- 172.21.15.43:0/4135638609 learned_addr learned my addr 172.21.15.43:0/4135638609 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75b9d9b700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 0x7f75bc149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75bad9d700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75bc151fc0 0x7f75bc14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 -- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75bc151fc0 msgr2=0x7f75bc14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75bc151fc0 0x7f75bc14d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 -- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 msgr2=0x7f75bc149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 0x7f75bc149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 -- 172.21.15.43:0/4135638609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00094a0 con 0x7f75bc071f70 2023-08-27T11:23:45.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75b9d9b700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 0x7f75bc149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:45.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75ba59c700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c4e0 tx=0x7f75ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0052d0 con 0x7f75bc071f70 2023-08-27T11:23:45.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac005430 con 0x7f75bc071f70 2023-08-27T11:23:45.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0038c0 con 0x7f75bc071f70 2023-08-27T11:23:45.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc1ed730 con 0x7f75bc071f70 2023-08-27T11:23:45.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.154+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc152490 con 0x7f75bc071f70 2023-08-27T11:23:45.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.155+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0abfc0 con 0x7f75bc071f70 2023-08-27T11:23:45.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.156+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75ac003a20 con 0x7f75bc071f70 2023-08-27T11:23:45.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.157+0000 7f75aaffd700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.157+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f75ac087660 con 0x7f75bc071f70 2023-08-27T11:23:45.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.157+0000 7f75b9d9b700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.158+0000 7f75b9d9b700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 0x7f759c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75bc1523c0 tx=0x7f75b001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.162+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75ac053130 con 0x7f75bc071f70 2023-08-27T11:23:45.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.371+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75bc0c4af0 con 0x7f75bc071f70 2023-08-27T11:23:45.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.372+0000 7f75aaffd700 1 -- 172.21.15.43:0/4135638609 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75ac056750 con 0x7f75bc071f70 2023-08-27T11:23:45.374 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:23:45.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 msgr2=0x7f759c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 0x7f759c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f75bc1523c0 tx=0x7f75b001c040 comp rx=0 tx=0).stop 2023-08-27T11:23:45.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 msgr2=0x7f75bc149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c4e0 tx=0x7f75ac00c8a0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 shutdown_connections 2023-08-27T11:23:45.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75bc151fc0 0x7f75bc14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75bc071f70 0x7f75bc149830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 --2- 172.21.15.43:0/4135638609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75bc0c0020 0x7f75bc149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 >> 172.21.15.43:0/4135638609 conn(0x7f75bc0c6a40 msgr2=0x7f75bc06dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:45.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 shutdown_connections 2023-08-27T11:23:45.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.374+0000 7f75c0bff700 1 -- 172.21.15.43:0/4135638609 wait complete. 2023-08-27T11:23:45.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:23:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.594+0000 7fb995fff700 1 Processor -- start 2023-08-27T11:23:45.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.594+0000 7fb995fff700 1 -- start start 2023-08-27T11:23:45.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb995fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb990151a90 0x7fb9900c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb995fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9900c4630 0x7fb9900c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb995fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99006c4e0 con 0x7fb99006ad70 2023-08-27T11:23:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb995fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb990155370 con 0x7fb990151a90 2023-08-27T11:23:45.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb995fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990151e70 con 0x7fb9900c4630 2023-08-27T11:23:45.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb98ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb99006ad70 0x7fb99006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46016/0 (socket says 172.21.15.43:46016) 2023-08-27T11:23:45.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb98ffff700 1 -- 172.21.15.43:0/3363692884 learned_addr learned my addr 172.21.15.43:0/3363692884 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:45.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/3363692884 >> v2:172.21.15.57:3300/0 conn(0x7fb990151a90 0x7fb9900c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.595+0000 7fb98effd700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9900c4630 0x7fb9900c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98e7fc700 1 -- 172.21.15.43:0/3363692884 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049659446 0 0) 0x7fb99006c4e0 con 0x7fb99006ad70 2023-08-27T11:23:45.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98e7fc700 1 -- 172.21.15.43:0/3363692884 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9780035b0 con 0x7fb99006ad70 2023-08-27T11:23:45.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98f7fe700 1 -- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9900c4630 msgr2=0x7fb9900c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:45.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9900c4630 0x7fb9900c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98f7fe700 1 -- 172.21.15.43:0/3363692884 >> v1:172.21.15.43:6789/0 conn(0x7fb99006ad70 legacy=0x7fb99006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98f7fe700 1 -- 172.21.15.43:0/3363692884 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990154480 con 0x7fb990151a90 2023-08-27T11:23:45.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.596+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb9900c7bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb980009840 tx=0x7fb980009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92568a1695afcfa7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb98e7fc700 1 -- 172.21.15.43:0/3363692884 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011830 con 0x7fb990151a90 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb98e7fc700 1 -- 172.21.15.43:0/3363692884 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980011990 con 0x7fb990151a90 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb98e7fc700 1 -- 172.21.15.43:0/3363692884 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb980011d20 con 0x7fb990151a90 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 -- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 msgr2=0x7fb9900c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb9900c7bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb980009840 tx=0x7fb980009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:45.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 -- 172.21.15.43:0/3363692884 shutdown_connections 2023-08-27T11:23:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb9900c7bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 --2- 172.21.15.43:0/3363692884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb9900c4630 0x7fb9900c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 -- 172.21.15.43:0/3363692884 >> 172.21.15.43:0/3363692884 conn(0x7fb9900ab820 msgr2=0x7fb9900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 -- 172.21.15.43:0/3363692884 shutdown_connections 2023-08-27T11:23:45.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.597+0000 7fb995fff700 1 -- 172.21.15.43:0/3363692884 wait complete. 2023-08-27T11:23:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.599+0000 7fb995fff700 1 Processor -- start 2023-08-27T11:23:45.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.599+0000 7fb995fff700 1 -- start start 2023-08-27T11:23:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99006ad70 0x7fb9900c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb990145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990144b60 con 0x7fb9900c4630 2023-08-27T11:23:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900c8330 con 0x7fb990151a90 2023-08-27T11:23:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb995fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901ea6c0 con 0x7fb99006ad70 2023-08-27T11:23:45.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb98effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb98effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47754/0 (socket says 172.21.15.43:47754) 2023-08-27T11:23:45.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb98effd700 1 -- 172.21.15.43:0/767809676 learned_addr learned my addr 172.21.15.43:0/767809676 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:45.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99006ad70 0x7fb9900c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.600+0000 7fb98ffff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb990145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 -- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99006ad70 msgr2=0x7fb9900c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99006ad70 0x7fb9900c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 -- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 msgr2=0x7fb990145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb990145680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 -- 172.21.15.43:0/767809676 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800094a0 con 0x7fb9900c4630 2023-08-27T11:23:45.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb98effd700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb98400e9b0 tx=0x7fb98400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984009710 con 0x7fb9900c4630 2023-08-27T11:23:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98400ee50 con 0x7fb9900c4630 2023-08-27T11:23:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9900c7990 con 0x7fb9900c4630 2023-08-27T11:23:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400ca50 con 0x7fb9900c4630 2023-08-27T11:23:45.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.601+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9900c7f50 con 0x7fb9900c4630 2023-08-27T11:23:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.603+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9900c8470 con 0x7fb9900c4630 2023-08-27T11:23:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.603+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb98400cbb0 con 0x7fb9900c4630 2023-08-27T11:23:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.604+0000 7fb977fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 0x7fb97c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.604+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb9840881a0 con 0x7fb9900c4630 2023-08-27T11:23:45.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.605+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 0x7fb97c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:45.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.605+0000 7fb98f7fe700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 0x7fb97c06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb98001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:45.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.609+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb9900c8470 con 0x7fb9900c4630 2023-08-27T11:23:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.823+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb9900c8470 con 0x7fb9900c4630 2023-08-27T11:23:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.824+0000 7fb977fff700 1 -- 172.21.15.43:0/767809676 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb9900c8470 con 0x7fb9900c4630 2023-08-27T11:23:45.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:45.826 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:23:45.826 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:45.826 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:23:45.826 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:23:45.827 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:23:45.827 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:23:45.827 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:23:45.827 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:23:45.828 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:23:45.828 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:23:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 msgr2=0x7fb97c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 0x7fb97c06c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb980000c00 tx=0x7fb98001c040 comp rx=0 tx=0).stop 2023-08-27T11:23:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 msgr2=0x7fb9900aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb98400e9b0 tx=0x7fb98400ecc0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 shutdown_connections 2023-08-27T11:23:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb97c06a0e0 0x7fb97c06c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb990151a90 0x7fb990145680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99006ad70 0x7fb9900c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 --2- 172.21.15.43:0/767809676 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb9900c4630 0x7fb9900aa8d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 >> 172.21.15.43:0/767809676 conn(0x7fb9900ab820 msgr2=0x7fb99006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 shutdown_connections 2023-08-27T11:23:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:45.826+0000 7fb995fff700 1 -- 172.21.15.43:0/767809676 wait complete. 2023-08-27T11:23:45.846 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:23:45.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:23:46.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.050+0000 7fc14a7ff700 1 Processor -- start 2023-08-27T11:23:46.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.050+0000 7fc14a7ff700 1 -- start start 2023-08-27T11:23:46.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.051+0000 7fc14a7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 0x7fc144157af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.051+0000 7fc14a7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1440c35a0 0x7fc1440c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.051+0000 7fc14a7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1440c79c0 con 0x7fc1440a6eb0 2023-08-27T11:23:46.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.051+0000 7fc14a7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc144155540 con 0x7fc1440c35a0 2023-08-27T11:23:46.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.051+0000 7fc14a7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441549a0 con 0x7fc1440c7270 2023-08-27T11:23:46.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1440c35a0 0x7fc1440c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc143fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 0x7fc144157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc1440c35a0 0x7fc1440c42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:46892/0 (socket says 172.21.15.43:46892) 2023-08-27T11:23:46.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 -- 172.21.15.43:0/2982553732 learned_addr learned my addr 172.21.15.43:0/2982553732 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:46.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 -- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 msgr2=0x7fc144157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:46.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 0x7fc144157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:46.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 -- 172.21.15.43:0/2982553732 >> v1:172.21.15.57:6789/0 conn(0x7fc1440a6eb0 legacy=0x7fc144154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:46.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc148d9c700 1 -- 172.21.15.43:0/2982553732 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1440c7650 con 0x7fc1440c35a0 2023-08-27T11:23:46.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.052+0000 7fc143fff700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 0x7fc144157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc148d9c700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1440c42d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009e50 tx=0x7fc13c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=407b93cbe05b2410 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc142ffd700 1 -- 172.21.15.43:0/2982553732 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00e070 con 0x7fc1440c35a0 2023-08-27T11:23:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc142ffd700 1 -- 172.21.15.43:0/2982553732 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c00b910 con 0x7fc1440c35a0 2023-08-27T11:23:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc142ffd700 1 -- 172.21.15.43:0/2982553732 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c00bcc0 con 0x7fc1440c35a0 2023-08-27T11:23:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 -- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 msgr2=0x7fc1440c42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1440c42d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc13c009e50 tx=0x7fc13c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 -- 172.21.15.43:0/2982553732 shutdown_connections 2023-08-27T11:23:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1440c42d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/2982553732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440c7270 0x7fc144157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.053+0000 7fc14a7ff700 1 -- 172.21.15.43:0/2982553732 >> 172.21.15.43:0/2982553732 conn(0x7fc1440a9760 msgr2=0x7fc1440a9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.054+0000 7fc14a7ff700 1 -- 172.21.15.43:0/2982553732 shutdown_connections 2023-08-27T11:23:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.054+0000 7fc14a7ff700 1 -- 172.21.15.43:0/2982553732 wait complete. 2023-08-27T11:23:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.055+0000 7fc14a7ff700 1 Processor -- start 2023-08-27T11:23:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.055+0000 7fc14a7ff700 1 -- start start 2023-08-27T11:23:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 0x7fc1441e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1441ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1440bfc90 con 0x7fc1440c7270 2023-08-27T11:23:46.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1441e9860 con 0x7fc1440c35a0 2023-08-27T11:23:46.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc14a7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc144157ac0 con 0x7fc1440a6eb0 2023-08-27T11:23:46.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.056+0000 7fc148d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47766/0 (socket says 172.21.15.43:47766) 2023-08-27T11:23:46.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 -- 172.21.15.43:0/639475433 learned_addr learned my addr 172.21.15.43:0/639475433 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:46.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc1437fe700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1441ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc143fff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 0x7fc1441e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 -- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 msgr2=0x7fc1441e9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:46.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 0x7fc1441e9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:46.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 -- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 msgr2=0x7fc1441ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:46.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1441ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:46.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 -- 172.21.15.43:0/639475433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340094a0 con 0x7fc1440c7270 2023-08-27T11:23:46.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc143fff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 0x7fc1441e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:46.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc1437fe700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1441ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc148d9c700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00b680 tx=0x7fc13c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.057+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004910 con 0x7fc1440c7270 2023-08-27T11:23:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.058+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0092e0 con 0x7fc1440c7270 2023-08-27T11:23:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.058+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c01c660 con 0x7fc1440c7270 2023-08-27T11:23:46.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.058+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c009b30 con 0x7fc1440c7270 2023-08-27T11:23:46.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.058+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc144157d80 con 0x7fc1440c7270 2023-08-27T11:23:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.059+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1441e9a30 con 0x7fc1440c7270 2023-08-27T11:23:46.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.060+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc13c01c7c0 con 0x7fc1440c7270 2023-08-27T11:23:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.060+0000 7fc140ff9700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 0x7fc13006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.061+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc13c089f50 con 0x7fc1440c7270 2023-08-27T11:23:46.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.061+0000 7fc143fff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 0x7fc13006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.061+0000 7fc143fff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 0x7fc13006c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc134009d20 tx=0x7fc134008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:46.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.065+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc1441e9a30 con 0x7fc1440c7270 2023-08-27T11:23:46.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:46.274+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc1441e9a30 con 0x7fc1440c7270 2023-08-27T11:23:47.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.256+0000 7fc140ff9700 1 -- 172.21.15.43:0/639475433 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc1441e9a30 con 0x7fc1440c7270 2023-08-27T11:23:47.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.261+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 msgr2=0x7fc13006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.261+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 0x7fc13006c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc134009d20 tx=0x7fc134008040 comp rx=0 tx=0).stop 2023-08-27T11:23:47.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.261+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 msgr2=0x7fc1440beeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.261+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00b680 tx=0x7fc13c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 shutdown_connections 2023-08-27T11:23:47.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc13006a0e0 0x7fc13006c5a0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc134009d20 tx=0x7fc134008040 comp rx=0 tx=0).stop 2023-08-27T11:23:47.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1440c7270 0x7fc1440beeb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc1440a6eb0 0x7fc1441e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 --2- 172.21.15.43:0/639475433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc1440c35a0 0x7fc1441ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 >> 172.21.15.43:0/639475433 conn(0x7fc1440a9760 msgr2=0x7fc1440a76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 shutdown_connections 2023-08-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.263+0000 7fc14a7ff700 1 -- 172.21.15.43:0/639475433 wait complete. 2023-08-27T11:23:47.267 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:23:47.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:23:47.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.499+0000 7f3be05ff700 1 Processor -- start 2023-08-27T11:23:47.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.500+0000 7f3be05ff700 1 -- start start 2023-08-27T11:23:47.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3be05ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd8151d20 0x7f3bd806a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3be05ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3bd80c9720 0x7f3bd80c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3be05ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd80ac7e0 con 0x7f3bd80c92e0 2023-08-27T11:23:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3be05ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd80c86a0 con 0x7f3bd80c9720 2023-08-27T11:23:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3be05ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8155030 con 0x7f3bd8151d20 2023-08-27T11:23:47.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3bdeb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3bd80c9720 0x7f3bd80c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3bddb9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3bd80c92e0 0x7f3bd80c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46030/0 (socket says 172.21.15.43:46030) 2023-08-27T11:23:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3bddb9a700 1 -- 172.21.15.43:0/3947683595 learned_addr learned my addr 172.21.15.43:0/3947683595 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.501+0000 7f3bde39b700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd8151d20 0x7f3bd806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/3947683595 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd8151d20 msgr2=0x7f3bd806a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:47.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdeb9c700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd8151d20 0x7f3bd806a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/3947683595 >> v1:172.21.15.43:6789/0 conn(0x7f3bd80c92e0 legacy=0x7f3bd80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/3947683595 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8155220 con 0x7f3bd80c9720 2023-08-27T11:23:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdd399700 1 -- 172.21.15.43:0/3947683595 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205695261 0 0) 0x7f3bd80ac7e0 con 0x7f3bd80c92e0 2023-08-27T11:23:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdeb9c700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd80c9720 0x7f3bd80c4e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009d90 tx=0x7f3bd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dd77bdfc4d8d39 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:47.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdd399700 1 -- 172.21.15.43:0/3947683595 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000e070 con 0x7f3bd80c9720 2023-08-27T11:23:47.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdd399700 1 -- 172.21.15.43:0/3947683595 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd000bbd0 con 0x7f3bd80c9720 2023-08-27T11:23:47.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.502+0000 7f3bdd399700 1 -- 172.21.15.43:0/3947683595 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0012430 con 0x7f3bd80c9720 2023-08-27T11:23:47.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 -- 172.21.15.43:0/3947683595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd80c9720 msgr2=0x7f3bd80c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd80c9720 0x7f3bd80c4e20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009d90 tx=0x7f3bd000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:47.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 -- 172.21.15.43:0/3947683595 shutdown_connections 2023-08-27T11:23:47.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd80c9720 0x7f3bd80c4e20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 --2- 172.21.15.43:0/3947683595 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd8151d20 0x7f3bd806a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 -- 172.21.15.43:0/3947683595 >> 172.21.15.43:0/3947683595 conn(0x7f3bd80ab880 msgr2=0x7f3bd80abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 -- 172.21.15.43:0/3947683595 shutdown_connections 2023-08-27T11:23:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.503+0000 7f3be05ff700 1 -- 172.21.15.43:0/3947683595 wait complete. 2023-08-27T11:23:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.505+0000 7f3be05ff700 1 Processor -- start 2023-08-27T11:23:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.505+0000 7f3be05ff700 1 -- start start 2023-08-27T11:23:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 0x7f3bd80a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd80c9720 0x7f3bd81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8153340 con 0x7f3bd8151d20 2023-08-27T11:23:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd81530a0 con 0x7f3bd80c92e0 2023-08-27T11:23:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3be05ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd8158b40 con 0x7f3bd80c9720 2023-08-27T11:23:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47772/0 (socket says 172.21.15.43:47772) 2023-08-27T11:23:47.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/764761929 learned_addr learned my addr 172.21.15.43:0/764761929 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bddb9a700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd80c9720 0x7f3bd81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bde39b700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 0x7f3bd80a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd80c9720 msgr2=0x7f3bd81566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd80c9720 0x7f3bd81566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 msgr2=0x7f3bd80a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:47.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 0x7f3bd80a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bdeb9c700 1 -- 172.21.15.43:0/764761929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0009a70 con 0x7f3bd8151d20 2023-08-27T11:23:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.506+0000 7f3bde39b700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 0x7f3bd80a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3bdeb9c700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8068880 tx=0x7f3bd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:47.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0012430 con 0x7f3bd8151d20 2023-08-27T11:23:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0020070 con 0x7f3bd8151d20 2023-08-27T11:23:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd81584f0 con 0x7f3bd8151d20 2023-08-27T11:23:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0004280 con 0x7f3bd8151d20 2023-08-27T11:23:47.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.507+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd80c4250 con 0x7f3bd8151d20 2023-08-27T11:23:47.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.508+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd8158350 con 0x7f3bd8151d20 2023-08-27T11:23:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.509+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3bd00043e0 con 0x7f3bd8151d20 2023-08-27T11:23:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.510+0000 7f3bceffd700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 0x7f3bbc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.511+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f3bd0022070 con 0x7f3bd8151d20 2023-08-27T11:23:47.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.511+0000 7f3bde39b700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 0x7f3bbc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.511+0000 7f3bde39b700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 0x7f3bbc06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4007a50 tx=0x7f3bd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:47.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.515+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3bd8158350 con 0x7f3bd8151d20 2023-08-27T11:23:47.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:47.723+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3bd8158350 con 0x7f3bd8151d20 2023-08-27T11:23:48.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.260+0000 7f3bceffd700 1 -- 172.21.15.43:0/764761929 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3bd8158350 con 0x7f3bd8151d20 2023-08-27T11:23:48.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.265+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 msgr2=0x7f3bbc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:48.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.265+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 0x7f3bbc06c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4007a50 tx=0x7f3bd4008040 comp rx=0 tx=0).stop 2023-08-27T11:23:48.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.265+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 msgr2=0x7f3bd81539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:48.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.265+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8068880 tx=0x7f3bd0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 shutdown_connections 2023-08-27T11:23:48.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bbc06a0e0 0x7f3bbc06c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bd8151d20 0x7f3bd81539b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bd80c92e0 0x7f3bd80a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 --2- 172.21.15.43:0/764761929 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bd80c9720 0x7f3bd81566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 >> 172.21.15.43:0/764761929 conn(0x7f3bd80ab880 msgr2=0x7f3bd80abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:48.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 shutdown_connections 2023-08-27T11:23:48.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.266+0000 7f3be05ff700 1 -- 172.21.15.43:0/764761929 wait complete. 2023-08-27T11:23:48.282 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:23:48.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:23:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.506+0000 7f3fbcfff700 1 Processor -- start 2023-08-27T11:23:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.506+0000 7f3fbcfff700 1 -- start start 2023-08-27T11:23:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fbcfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3fb80c5230 0x7f3fb806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fbcfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3fb8155880 0x7f3fb8155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fbcfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb81561a0 con 0x7f3fb806c5e0 2023-08-27T11:23:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fbcfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb8152290 con 0x7f3fb8155880 2023-08-27T11:23:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fbcfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb806d7a0 con 0x7f3fb80c5230 2023-08-27T11:23:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.507+0000 7f3fb6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3fb8155880 0x7f3fb8155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3fb8155880 0x7f3fb8155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47778/0 (socket says 172.21.15.43:47778) 2023-08-27T11:23:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/2148138 learned_addr learned my addr 172.21.15.43:0/2148138 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb659c700 1 --2- 172.21.15.43:0/2148138 >> v2:172.21.15.57:3300/0 conn(0x7f3fb80c5230 0x7f3fb806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/2148138 >> v2:172.21.15.57:3300/0 conn(0x7f3fb80c5230 msgr2=0x7f3fb806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 --2- 172.21.15.43:0/2148138 >> v2:172.21.15.57:3300/0 conn(0x7f3fb80c5230 0x7f3fb806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/2148138 >> v1:172.21.15.57:6789/0 conn(0x7f3fb806c5e0 legacy=0x7f3fb80aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/2148138 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8152550 con 0x7f3fb8155880 2023-08-27T11:23:48.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.508+0000 7f3fb6d9d700 1 --2- 172.21.15.43:0/2148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8155c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806ced0 tx=0x7f3fb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634de7b3121740d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:48.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fb559a700 1 -- 172.21.15.43:0/2148138 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000e070 con 0x7f3fb8155880 2023-08-27T11:23:48.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fb559a700 1 -- 172.21.15.43:0/2148138 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000b9c0 con 0x7f3fb8155880 2023-08-27T11:23:48.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fb559a700 1 -- 172.21.15.43:0/2148138 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000bd70 con 0x7f3fb8155880 2023-08-27T11:23:48.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 -- 172.21.15.43:0/2148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 msgr2=0x7f3fb8155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:48.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/2148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8155c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806ced0 tx=0x7f3fb000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:48.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 -- 172.21.15.43:0/2148138 shutdown_connections 2023-08-27T11:23:48.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/2148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8155c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/2148138 >> v2:172.21.15.57:3300/0 conn(0x7f3fb80c5230 0x7f3fb806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 -- 172.21.15.43:0/2148138 >> 172.21.15.43:0/2148138 conn(0x7f3fb80c5b10 msgr2=0x7f3fb80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:48.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 -- 172.21.15.43:0/2148138 shutdown_connections 2023-08-27T11:23:48.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.509+0000 7f3fbcfff700 1 -- 172.21.15.43:0/2148138 wait complete. 2023-08-27T11:23:48.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.512+0000 7f3fbcfff700 1 Processor -- start 2023-08-27T11:23:48.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.512+0000 7f3fbcfff700 1 -- start start 2023-08-27T11:23:48.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb806c5e0 0x7f3fb8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3fb80c5230 0x7f3fb80ba990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8070d00 con 0x7f3fb8155880 2023-08-27T11:23:48.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80700c0 con 0x7f3fb806c5e0 2023-08-27T11:23:48.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fbcfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8070360 con 0x7f3fb80c5230 2023-08-27T11:23:48.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fb6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fb6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47790/0 (socket says 172.21.15.43:47790) 2023-08-27T11:23:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.513+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/3764399188 learned_addr learned my addr 172.21.15.43:0/3764399188 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb659c700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb806c5e0 0x7f3fb8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb5d9b700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3fb80c5230 0x7f3fb80ba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3fb80c5230 msgr2=0x7f3fb80ba990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3fb80c5230 0x7f3fb80ba990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb806c5e0 msgr2=0x7f3fb8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb806c5e0 0x7f3fb8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 -- 172.21.15.43:0/3764399188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb0009b30 con 0x7f3fb8155880 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fb6d9d700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806dc20 tx=0x7f3fb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb00099b0 con 0x7f3fb8155880 2023-08-27T11:23:48.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb00092e0 con 0x7f3fb8155880 2023-08-27T11:23:48.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8070640 con 0x7f3fb8155880 2023-08-27T11:23:48.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.514+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb001b630 con 0x7f3fb8155880 2023-08-27T11:23:48.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.515+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb8154e80 con 0x7f3fb8155880 2023-08-27T11:23:48.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.516+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb804ee70 con 0x7f3fb8155880 2023-08-27T11:23:48.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.517+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3fb001b790 con 0x7f3fb8155880 2023-08-27T11:23:48.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.518+0000 7f3fa6ffd700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 0x7f3f9806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.518+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3fb0089bb0 con 0x7f3fb8155880 2023-08-27T11:23:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.518+0000 7f3fb659c700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 0x7f3f9806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.518+0000 7f3fb659c700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 0x7f3f9806c5d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009930 tx=0x7f3fa8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.523+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3fb0055270 con 0x7f3fb8155880 2023-08-27T11:23:48.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:48.775+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3fb814a5b0 con 0x7f3fb8155880 2023-08-27T11:23:49.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.310+0000 7f3fa6ffd700 1 -- 172.21.15.43:0/3764399188 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3fb0058890 con 0x7f3fb8155880 2023-08-27T11:23:49.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.317+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 msgr2=0x7f3f9806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.317+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 0x7f3f9806c5d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009930 tx=0x7f3fa8008040 comp rx=0 tx=0).stop 2023-08-27T11:23:49.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.317+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 msgr2=0x7f3fb8071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.317+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806dc20 tx=0x7f3fb0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 shutdown_connections 2023-08-27T11:23:49.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3f9806a110 0x7f3f9806c5d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3fb8155880 0x7f3fb8071330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3fb806c5e0 0x7f3fb8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 --2- 172.21.15.43:0/3764399188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3fb80c5230 0x7f3fb80ba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.318+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 >> 172.21.15.43:0/3764399188 conn(0x7f3fb80c5b10 msgr2=0x7f3fb80a6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:49.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.319+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 shutdown_connections 2023-08-27T11:23:49.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.319+0000 7f3fbcfff700 1 -- 172.21.15.43:0/3764399188 wait complete. 2023-08-27T11:23:49.324 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 5 and data pool 6 2023-08-27T11:23:49.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:49.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.547+0000 7fd75abff700 1 Processor -- start 2023-08-27T11:23:49.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.547+0000 7fd75abff700 1 -- start start 2023-08-27T11:23:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 0x7fd75406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75abff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75406c4e0 con 0x7fd754151a90 2023-08-27T11:23:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75abff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd754155370 con 0x7fd7540c4630 2023-08-27T11:23:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540c82c0 con 0x7fd7540c4a90 2023-08-27T11:23:49.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75899b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd754151a90 0x7fd7540c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42478/0 (socket says 172.21.15.43:42478) 2023-08-27T11:23:49.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.548+0000 7fd75899b700 1 -- 172.21.15.43:0/765487512 learned_addr learned my addr 172.21.15.43:0/765487512 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:49.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd75919c700 1 --2- 172.21.15.43:0/765487512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 0x7fd75406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:49.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093576520 0 0) 0x7fd75406c4e0 con 0x7fd754151a90 2023-08-27T11:23:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7440035b0 con 0x7fd754151a90 2023-08-27T11:23:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636663554 0 0) 0x7fd754155370 con 0x7fd7540c4630 2023-08-27T11:23:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75406c4e0 con 0x7fd7540c4630 2023-08-27T11:23:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd75919c700 1 -- 172.21.15.43:0/765487512 >> v1:172.21.15.57:6789/0 conn(0x7fd7540c4630 legacy=0x7fd75406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd75919c700 1 -- 172.21.15.43:0/765487512 >> v1:172.21.15.43:6789/0 conn(0x7fd754151a90 legacy=0x7fd7540c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.549+0000 7fd75919c700 1 -- 172.21.15.43:0/765487512 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd754151e70 con 0x7fd7540c4a90 2023-08-27T11:23:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75919c700 1 --2- 172.21.15.43:0/765487512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 0x7fd75406b480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009dc0 tx=0x7fd74c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea45cc0f6fc010f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00e070 con 0x7fd7540c4a90 2023-08-27T11:23:49.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c00bb20 con 0x7fd7540c4a90 2023-08-27T11:23:49.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd7537fe700 1 -- 172.21.15.43:0/765487512 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c012430 con 0x7fd7540c4a90 2023-08-27T11:23:49.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 -- 172.21.15.43:0/765487512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 msgr2=0x7fd75406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 --2- 172.21.15.43:0/765487512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 0x7fd75406b480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd74c009dc0 tx=0x7fd74c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:49.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 -- 172.21.15.43:0/765487512 shutdown_connections 2023-08-27T11:23:49.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 --2- 172.21.15.43:0/765487512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7540c4a90 0x7fd75406b480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 -- 172.21.15.43:0/765487512 >> 172.21.15.43:0/765487512 conn(0x7fd7540ab820 msgr2=0x7fd7540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:49.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.550+0000 7fd75abff700 1 -- 172.21.15.43:0/765487512 shutdown_connections 2023-08-27T11:23:49.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.551+0000 7fd75abff700 1 -- 172.21.15.43:0/765487512 wait complete. 2023-08-27T11:23:49.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.552+0000 7fd75abff700 1 Processor -- start 2023-08-27T11:23:49.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.552+0000 7fd75abff700 1 -- start start 2023-08-27T11:23:49.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7540c4a90 0x7fd7541ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd754151a90 0x7fd754144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540ab220 con 0x7fd7540c4630 2023-08-27T11:23:49.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd754146c30 con 0x7fd7540c4a90 2023-08-27T11:23:49.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7540aacf0 con 0x7fd754151a90 2023-08-27T11:23:49.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75899b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:49.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75899b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37040/0 (socket says 172.21.15.43:37040) 2023-08-27T11:23:49.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.553+0000 7fd75899b700 1 -- 172.21.15.43:0/3451870440 learned_addr learned my addr 172.21.15.43:0/3451870440 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:49.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75919c700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd754151a90 0x7fd754144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:49.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd753fff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7540c4a90 0x7fd7541ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:49.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 -- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd754151a90 msgr2=0x7fd754144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd754151a90 0x7fd754144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 -- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7540c4a90 msgr2=0x7fd7541ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7540c4a90 0x7fd7541ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 -- 172.21.15.43:0/3451870440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009a70 con 0x7fd7540c4630 2023-08-27T11:23:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75899b700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd74800c4d0 tx=0x7fd74800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748005d70 con 0x7fd7540c4630 2023-08-27T11:23:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7480070d0 con 0x7fd7540c4630 2023-08-27T11:23:49.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748007460 con 0x7fd7540c4630 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7541ed0c0 con 0x7fd7540c4630 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.554+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7540aaf40 con 0x7fd7540c4630 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.555+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75406c670 con 0x7fd7540c4630 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.556+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7480075c0 con 0x7fd7540c4630 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.558+0000 7fd7517fa700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 0x7fd73806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.558+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd748087a30 con 0x7fd7540c4630 2023-08-27T11:23:49.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.558+0000 7fd753fff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 0x7fd73806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:49.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.558+0000 7fd753fff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 0x7fd73806c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd75414ebd0 tx=0x7fd740009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:49.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.562+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd748053110 con 0x7fd7540c4630 2023-08-27T11:23:49.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.774+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd75404ee70 con 0x7fd7540c4630 2023-08-27T11:23:49.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.775+0000 7fd7517fa700 1 -- 172.21.15.43:0/3451870440 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18246 (secure 0 0 0) 0x7fd748056730 con 0x7fd7540c4630 2023-08-27T11:23:49.777 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:49.778 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":33,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:48.777216+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:49.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 msgr2=0x7fd73806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 0x7fd73806c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd75414ebd0 tx=0x7fd740009040 comp rx=0 tx=0).stop 2023-08-27T11:23:49.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 msgr2=0x7fd754149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:49.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd74800c4d0 tx=0x7fd74800c7e0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 shutdown_connections 2023-08-27T11:23:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd73806a0e0 0x7fd73806c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd754151a90 0x7fd754144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7540c4630 0x7fd754149e50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 --2- 172.21.15.43:0/3451870440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7540c4a90 0x7fd7541ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:49.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 >> 172.21.15.43:0/3451870440 conn(0x7fd7540ab820 msgr2=0x7fd754073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:49.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 shutdown_connections 2023-08-27T11:23:49.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.778+0000 7fd75abff700 1 -- 172.21.15.43:0/3451870440 wait complete. 2023-08-27T11:23:49.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:49.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.996+0000 7f31967ff700 1 Processor -- start 2023-08-27T11:23:49.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.996+0000 7f31967ff700 1 -- start start 2023-08-27T11:23:49.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f31967ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31900c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:49.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f31967ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319006c4e0 con 0x7f319006ad70 2023-08-27T11:23:49.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f31967ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3190155370 con 0x7f3190151a90 2023-08-27T11:23:50.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f31967ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c82c0 con 0x7f31900c4630 2023-08-27T11:23:50.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f3194d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f319006ad70 0x7f319006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42480/0 (socket says 172.21.15.43:42480) 2023-08-27T11:23:50.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f3194d9c700 1 -- 172.21.15.43:0/2974989599 learned_addr learned my addr 172.21.15.43:0/2974989599 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:50.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f318f7fe700 1 --2- 172.21.15.43:0/2974989599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31900c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985887503 0 0) 0x7f319006c4e0 con 0x7f319006ad70 2023-08-27T11:23:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.998+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31780035b0 con 0x7f319006ad70 2023-08-27T11:23:50.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318f7fe700 1 -- 172.21.15.43:0/2974989599 >> v1:172.21.15.57:6789/0 conn(0x7f3190151a90 legacy=0x7f31900c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154329448 0 0) 0x7f3190155370 con 0x7f3190151a90 2023-08-27T11:23:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318f7fe700 1 -- 172.21.15.43:0/2974989599 >> v1:172.21.15.43:6789/0 conn(0x7f319006ad70 legacy=0x7f319006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318f7fe700 1 -- 172.21.15.43:0/2974989599 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190151e70 con 0x7f31900c4630 2023-08-27T11:23:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318f7fe700 1 --2- 172.21.15.43:0/2974989599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31900c4a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f3184009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7965036dc96504 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011830 con 0x7f31900c4630 2023-08-27T11:23:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184011990 con 0x7f31900c4630 2023-08-27T11:23:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:49.999+0000 7f318effd700 1 -- 172.21.15.43:0/2974989599 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184011d20 con 0x7f31900c4630 2023-08-27T11:23:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 -- 172.21.15.43:0/2974989599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 msgr2=0x7f31900c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 --2- 172.21.15.43:0/2974989599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31900c4a90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3184009870 tx=0x7f3184009b80 comp rx=0 tx=0).stop 2023-08-27T11:23:50.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 -- 172.21.15.43:0/2974989599 shutdown_connections 2023-08-27T11:23:50.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 --2- 172.21.15.43:0/2974989599 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31900c4a90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 -- 172.21.15.43:0/2974989599 >> 172.21.15.43:0/2974989599 conn(0x7f31900ab820 msgr2=0x7f31900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:50.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 -- 172.21.15.43:0/2974989599 shutdown_connections 2023-08-27T11:23:50.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.000+0000 7f31967ff700 1 -- 172.21.15.43:0/2974989599 wait complete. 2023-08-27T11:23:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.002+0000 7f31967ff700 1 Processor -- start 2023-08-27T11:23:50.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.002+0000 7f31967ff700 1 -- start start 2023-08-27T11:23:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f319006ad70 0x7f31901e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31901502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190152280 con 0x7f3190151a90 2023-08-27T11:23:50.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319014d920 con 0x7f319006ad70 2023-08-27T11:23:50.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f31967ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31901524d0 con 0x7f31900c4630 2023-08-27T11:23:50.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37054/0 (socket says 172.21.15.43:37054) 2023-08-27T11:23:50.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 -- 172.21.15.43:0/4081922298 learned_addr learned my addr 172.21.15.43:0/4081922298 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:50.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f318f7fe700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31901502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f318ffff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f319006ad70 0x7f31901e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 -- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 msgr2=0x7f31901502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31901502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 -- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f319006ad70 msgr2=0x7f31901e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f319006ad70 0x7f31901e9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.003+0000 7f3194d9c700 1 -- 172.21.15.43:0/4081922298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840094a0 con 0x7f3190151a90 2023-08-27T11:23:50.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f3194d9c700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f318800cb40 tx=0x7f318800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800a9e0 con 0x7f3190151a90 2023-08-27T11:23:50.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800ab40 con 0x7f3190151a90 2023-08-27T11:23:50.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188012400 con 0x7f3190151a90 2023-08-27T11:23:50.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31901527b0 con 0x7f3190151a90 2023-08-27T11:23:50.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.004+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901e98f0 con 0x7f3190151a90 2023-08-27T11:23:50.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.005+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31901e9ae0 con 0x7f3190151a90 2023-08-27T11:23:50.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.006+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f318801b3b0 con 0x7f3190151a90 2023-08-27T11:23:50.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.007+0000 7f318cff9700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 0x7f317c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.007+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3188088120 con 0x7f3190151a90 2023-08-27T11:23:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.007+0000 7f318ffff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 0x7f317c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.008+0000 7f318ffff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 0x7f317c06c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3180000f60 tx=0x7f3180009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.011+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31880538b0 con 0x7f3190151a90 2023-08-27T11:23:50.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.225+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f319004ee70 con 0x7f3190151a90 2023-08-27T11:23:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.226+0000 7f318cff9700 1 -- 172.21.15.43:0/4081922298 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+18246 (secure 0 0 0) 0x7f3188056ed0 con 0x7f3190151a90 2023-08-27T11:23:50.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:50.229 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":33,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:48.777216+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 msgr2=0x7f317c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 0x7f317c06c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3180000f60 tx=0x7f3180009040 comp rx=0 tx=0).stop 2023-08-27T11:23:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 msgr2=0x7f319014bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f318800cb40 tx=0x7f318800ce50 comp rx=0 tx=0).stop 2023-08-27T11:23:50.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 shutdown_connections 2023-08-27T11:23:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f317c06a0e0 0x7f317c06c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3190151a90 0x7f319014bd30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f319006ad70 0x7f31901e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 --2- 172.21.15.43:0/4081922298 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31900c4630 0x7f31901502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 >> 172.21.15.43:0/4081922298 conn(0x7f31900ab820 msgr2=0x7f319014a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 shutdown_connections 2023-08-27T11:23:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.229+0000 7f31967ff700 1 -- 172.21.15.43:0/4081922298 wait complete. 2023-08-27T11:23:50.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:23:50.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.455+0000 7fb0417ff700 1 Processor -- start 2023-08-27T11:23:50.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.455+0000 7fb0417ff700 1 -- start start 2023-08-27T11:23:50.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.456+0000 7fb0417ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb03c151d20 0x7fb03c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.456+0000 7fb0417ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c154660 con 0x7fb03c06a8e0 2023-08-27T11:23:50.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.456+0000 7fb0417ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c154940 con 0x7fb03c0c7c00 2023-08-27T11:23:50.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.456+0000 7fb0417ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0c5750 con 0x7fb03c151d20 2023-08-27T11:23:50.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb03c06a8e0 0x7fb03c06acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42484/0 (socket says 172.21.15.43:42484) 2023-08-27T11:23:50.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03b7fe700 1 -- 172.21.15.43:0/4232988624 learned_addr learned my addr 172.21.15.43:0/4232988624 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:50.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> v2:172.21.15.57:3300/0 conn(0x7fb03c151d20 0x7fb03c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474757064 0 0) 0x7fb03c154660 con 0x7fb03c06a8e0 2023-08-27T11:23:50.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0280035b0 con 0x7fb03c06a8e0 2023-08-27T11:23:50.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953066710 0 0) 0x7fb0280035b0 con 0x7fb03c06a8e0 2023-08-27T11:23:50.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 >> v2:172.21.15.57:3300/0 conn(0x7fb03c151d20 msgr2=0x7fb03c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:50.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.457+0000 7fb03a7fc700 1 --2- 172.21.15.43:0/4232988624 >> v2:172.21.15.57:3300/0 conn(0x7fb03c151d20 0x7fb03c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 >> v1:172.21.15.57:6789/0 conn(0x7fb03c0c7c00 legacy=0x7fb03c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c154c20 con 0x7fb03c06a8e0 2023-08-27T11:23:50.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb034001a40 con 0x7fb03c06a8e0 2023-08-27T11:23:50.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> v2:172.21.15.57:3300/0 conn(0x7fb03c151d20 0x7fb03c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:50.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 >> v1:172.21.15.43:6789/0 conn(0x7fb03c06a8e0 legacy=0x7fb03c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb028003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028004850 0x7fb028004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb028005330 0x7fb02800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02800c1b0 con 0x7fb028004850 2023-08-27T11:23:50.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02800c320 con 0x7fb028003a70 2023-08-27T11:23:50.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02800c4e0 con 0x7fb028005330 2023-08-27T11:23:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb033fff700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028004850 0x7fb028004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb028003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.458+0000 7fb03b7fe700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb028005330 0x7fb02800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 -- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb028005330 msgr2=0x7fb02800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:50.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb028005330 0x7fb02800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 -- 172.21.15.43:0/4232988624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028004850 msgr2=0x7fb028004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:50.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028004850 0x7fb028004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 -- 172.21.15.43:0/4232988624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280035b0 con 0x7fb028003a70 2023-08-27T11:23:50.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb033fff700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb028004850 0x7fb028004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:50.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03b7fe700 1 -- 172.21.15.43:0/4232988624 reap_dead start 2023-08-27T11:23:50.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03affd700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb028003eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009d00 tx=0x7fb028005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306e5f1c7a93c8b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c009e50 con 0x7fb028003a70 2023-08-27T11:23:50.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00e9a0 con 0x7fb028003a70 2023-08-27T11:23:50.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.459+0000 7fb03a7fc700 1 -- 172.21.15.43:0/4232988624 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00ed30 con 0x7fb028003a70 2023-08-27T11:23:50.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 -- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 msgr2=0x7fb028003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb028003eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009d00 tx=0x7fb028005880 comp rx=0 tx=0).stop 2023-08-27T11:23:50.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 -- 172.21.15.43:0/4232988624 shutdown_connections 2023-08-27T11:23:50.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 --2- 172.21.15.43:0/4232988624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb028003eb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 -- 172.21.15.43:0/4232988624 >> 172.21.15.43:0/4232988624 conn(0x7fb03c0c9d00 msgr2=0x7fb03c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:50.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 -- 172.21.15.43:0/4232988624 shutdown_connections 2023-08-27T11:23:50.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.460+0000 7fb0417ff700 1 -- 172.21.15.43:0/4232988624 wait complete. 2023-08-27T11:23:50.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.462+0000 7fb0417ff700 1 Processor -- start 2023-08-27T11:23:50.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.462+0000 7fb0417ff700 1 -- start start 2023-08-27T11:23:50.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb03c1ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb03c14e120 0x7fb03c1ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c149050 con 0x7fb03c1e9810 2023-08-27T11:23:50.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c148bc0 con 0x7fb028003a70 2023-08-27T11:23:50.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb0417ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1eda70 con 0x7fb03c14e120 2023-08-27T11:23:50.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37078/0 (socket says 172.21.15.43:37078) 2023-08-27T11:23:50.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 -- 172.21.15.43:0/3170220266 learned_addr learned my addr 172.21.15.43:0/3170220266 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:50.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03affd700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb03c1ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb033fff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb03c14e120 0x7fb03c1ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 -- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb03c14e120 msgr2=0x7fb03c1ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb03c14e120 0x7fb03c1ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 -- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 msgr2=0x7fb03c1ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb03c1ecff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.463+0000 7fb03b7fe700 1 -- 172.21.15.43:0/3170220266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c14d1e0 con 0x7fb03c1e9810 2023-08-27T11:23:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb03b7fe700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0c3f00 tx=0x7fb03400a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400ad30 con 0x7fb03c1e9810 2023-08-27T11:23:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03400ae90 con 0x7fb03c1e9810 2023-08-27T11:23:50.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c14d4c0 con 0x7fb03c1e9810 2023-08-27T11:23:50.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034013630 con 0x7fb03c1e9810 2023-08-27T11:23:50.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.464+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c148850 con 0x7fb03c1e9810 2023-08-27T11:23:50.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.465+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c148d70 con 0x7fb03c1e9810 2023-08-27T11:23:50.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.466+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb034007d50 con 0x7fb03c1e9810 2023-08-27T11:23:50.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.467+0000 7fb0337fe700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 0x7fb01c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:50.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.467+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb034088bc0 con 0x7fb03c1e9810 2023-08-27T11:23:50.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.467+0000 7fb03affd700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 0x7fb01c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:50.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.468+0000 7fb03affd700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 0x7fb01c06c5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c01e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:50.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.471+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb03c148d70 con 0x7fb03c1e9810 2023-08-27T11:23:50.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:50.731+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb03c148d70 con 0x7fb03c1e9810 2023-08-27T11:23:51.236 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:23:51.235+0000 7f977f5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:23:51.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.316+0000 7fb0337fe700 1 -- 172.21.15.43:0/3170220266 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb03c148d70 con 0x7fb03c1e9810 2023-08-27T11:23:51.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.319+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 msgr2=0x7fb01c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.319+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 0x7fb01c06c5d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb02c000c00 tx=0x7fb02c01e040 comp rx=0 tx=0).stop 2023-08-27T11:23:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.319+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 msgr2=0x7fb03c1e9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.319+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0c3f00 tx=0x7fb03400a5b0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 shutdown_connections 2023-08-27T11:23:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb01c06a110 0x7fb01c06c5d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb03c1e9810 0x7fb03c1e9ca0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb028003a70 0x7fb03c1ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 --2- 172.21.15.43:0/3170220266 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb03c14e120 0x7fb03c1ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 >> 172.21.15.43:0/3170220266 conn(0x7fb03c0c9d00 msgr2=0x7fb03c0c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 shutdown_connections 2023-08-27T11:23:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.320+0000 7fb0417ff700 1 -- 172.21.15.43:0/3170220266 wait complete. 2023-08-27T11:23:51.342 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:23:51.343 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:23:51.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.551+0000 7fbc0e7ff700 1 Processor -- start 2023-08-27T11:23:51.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.551+0000 7fbc0e7ff700 1 -- start start 2023-08-27T11:23:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.552+0000 7fbc0e7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc08154a90 0x7fbc08154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:51.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.552+0000 7fbc0e7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc08154600 con 0x7fbc080c3b30 2023-08-27T11:23:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.552+0000 7fbc0e7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080700a0 con 0x7fbc08157a30 2023-08-27T11:23:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.552+0000 7fbc0e7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080c66c0 con 0x7fbc08154a90 2023-08-27T11:23:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc0cd9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbc08154a90 0x7fbc08154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc07fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbc080c3b30 0x7fbc080a6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42492/0 (socket says 172.21.15.43:42492) 2023-08-27T11:23:51.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc07fff700 1 -- 172.21.15.43:0/126942318 learned_addr learned my addr 172.21.15.43:0/126942318 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:51.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc0cd9c700 1 -- 172.21.15.43:0/126942318 >> v1:172.21.15.57:6789/0 conn(0x7fbc08157a30 legacy=0x7fbc080c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:51.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc0cd9c700 1 -- 172.21.15.43:0/126942318 >> v1:172.21.15.43:6789/0 conn(0x7fbc080c3b30 legacy=0x7fbc080a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc0cd9c700 1 -- 172.21.15.43:0/126942318 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0806f800 con 0x7fbc08154a90 2023-08-27T11:23:51.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc0cd9c700 1 --2- 172.21.15.43:0/126942318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc08154ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009d90 tx=0x7fbc0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738b48702c55ff23 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:51.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.553+0000 7fbc06ffd700 1 -- 172.21.15.43:0/126942318 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000e070 con 0x7fbc08154a90 2023-08-27T11:23:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc06ffd700 1 -- 172.21.15.43:0/126942318 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0000bb90 con 0x7fbc08154a90 2023-08-27T11:23:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc06ffd700 1 -- 172.21.15.43:0/126942318 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00003a20 con 0x7fbc08154a90 2023-08-27T11:23:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/126942318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 msgr2=0x7fbc08154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/126942318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc08154ef0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009d90 tx=0x7fbc0000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/126942318 shutdown_connections 2023-08-27T11:23:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/126942318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc08154ef0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/126942318 >> 172.21.15.43:0/126942318 conn(0x7fbc080a97d0 msgr2=0x7fbc080a9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:51.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/126942318 shutdown_connections 2023-08-27T11:23:51.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.554+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/126942318 wait complete. 2023-08-27T11:23:51.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.556+0000 7fbc0e7ff700 1 Processor -- start 2023-08-27T11:23:51.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.556+0000 7fbc0e7ff700 1 -- start start 2023-08-27T11:23:51.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 0x7fbc080ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:51.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:51.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 0x7fbc08151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:51.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081de770 con 0x7fbc08154a90 2023-08-27T11:23:51.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081df0c0 con 0x7fbc080c3b30 2023-08-27T11:23:51.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081ea1d0 con 0x7fbc08157a30 2023-08-27T11:23:51.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:51.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37094/0 (socket says 172.21.15.43:37094) 2023-08-27T11:23:51.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc077fe700 1 -- 172.21.15.43:0/2774820472 learned_addr learned my addr 172.21.15.43:0/2774820472 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:51.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc07fff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 0x7fbc080ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:51.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.557+0000 7fbc0cd9c700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 0x7fbc08151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:51.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 -- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 msgr2=0x7fbc08151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 0x7fbc08151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 -- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 msgr2=0x7fbc080ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:51.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 0x7fbc080ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:51.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 -- 172.21.15.43:0/2774820472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00009a70 con 0x7fbc08154a90 2023-08-27T11:23:51.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc0cd9c700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 0x7fbc08151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:51.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc07fff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 0x7fbc080ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:51.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc077fe700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00b4a0 tx=0x7fbbfc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:51.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc011830 con 0x7fbc08154a90 2023-08-27T11:23:51.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc011990 con 0x7fbc08154a90 2023-08-27T11:23:51.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc011d40 con 0x7fbc08154a90 2023-08-27T11:23:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc081eb1a0 con 0x7fbc08154a90 2023-08-27T11:23:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.558+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc081ea3e0 con 0x7fbc08154a90 2023-08-27T11:23:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.559+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0804ee70 con 0x7fbc08154a90 2023-08-27T11:23:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.560+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbfc01a400 con 0x7fbc08154a90 2023-08-27T11:23:51.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.561+0000 7fbc04ff9700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 0x7fbbf406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:51.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.561+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbfc088300 con 0x7fbc08154a90 2023-08-27T11:23:51.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.561+0000 7fbc07fff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 0x7fbbf406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.562+0000 7fbc07fff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 0x7fbbf406c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8000f60 tx=0x7fbbf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.565+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbbfc0539e0 con 0x7fbc08154a90 2023-08-27T11:23:51.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:51.822+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbc0806d440 con 0x7fbc08154a90 2023-08-27T11:23:52.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.324+0000 7fbc04ff9700 1 -- 172.21.15.43:0/2774820472 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbbfc057000 con 0x7fbc08154a90 2023-08-27T11:23:52.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 msgr2=0x7fbbf406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 0x7fbbf406c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8000f60 tx=0x7fbbf8009040 comp rx=0 tx=0).stop 2023-08-27T11:23:52.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 msgr2=0x7fbc081517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00b4a0 tx=0x7fbbfc00b860 comp rx=0 tx=0).stop 2023-08-27T11:23:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 shutdown_connections 2023-08-27T11:23:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbbf406a0e0 0x7fbbf406c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbc08157a30 0x7fbc08151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc080c3b30 0x7fbc080ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 --2- 172.21.15.43:0/2774820472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbc08154a90 0x7fbc081517a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 >> 172.21.15.43:0/2774820472 conn(0x7fbc080a97d0 msgr2=0x7fbc081530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 shutdown_connections 2023-08-27T11:23:52.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.328+0000 7fbc0e7ff700 1 -- 172.21.15.43:0/2774820472 wait complete. 2023-08-27T11:23:52.351 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:23:52.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.556+0000 7f96767ff700 1 Processor -- start 2023-08-27T11:23:52.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.557+0000 7f96767ff700 1 -- start start 2023-08-27T11:23:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f96767ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f96700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f96767ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f967006ad70 0x7f967006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f96767ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967006c4e0 con 0x7f9670151a90 2023-08-27T11:23:52.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f96767ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9670155370 con 0x7f967006ad70 2023-08-27T11:23:52.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f96767ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96700c82c0 con 0x7f96700c4630 2023-08-27T11:23:52.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f967006ad70 0x7f967006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f967006ad70 0x7f967006b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37096/0 (socket says 172.21.15.43:37096) 2023-08-27T11:23:52.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 -- 172.21.15.43:0/958311002 learned_addr learned my addr 172.21.15.43:0/958311002 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:52.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f966f7fe700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f96700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 -- 172.21.15.43:0/958311002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 msgr2=0x7f96700c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:52.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f96700c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 -- 172.21.15.43:0/958311002 >> v1:172.21.15.57:6789/0 conn(0x7f9670151a90 legacy=0x7f96700c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.558+0000 7f9674d9c700 1 -- 172.21.15.43:0/958311002 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670151e70 con 0x7f967006ad70 2023-08-27T11:23:52.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f9674d9c700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f967006b200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e50 tx=0x7f966800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408c850890b316c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:52.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f966effd700 1 -- 172.21.15.43:0/958311002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800e070 con 0x7f967006ad70 2023-08-27T11:23:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f966effd700 1 -- 172.21.15.43:0/958311002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966800b910 con 0x7f967006ad70 2023-08-27T11:23:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f966effd700 1 -- 172.21.15.43:0/958311002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966800bcc0 con 0x7f967006ad70 2023-08-27T11:23:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f96767ff700 1 -- 172.21.15.43:0/958311002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 msgr2=0x7f967006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f96767ff700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f967006b200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9668009e50 tx=0x7f966800b330 comp rx=0 tx=0).stop 2023-08-27T11:23:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f96767ff700 1 -- 172.21.15.43:0/958311002 shutdown_connections 2023-08-27T11:23:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.559+0000 7f96767ff700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f967006b200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.560+0000 7f96767ff700 1 --2- 172.21.15.43:0/958311002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f96700c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.560+0000 7f96767ff700 1 -- 172.21.15.43:0/958311002 >> 172.21.15.43:0/958311002 conn(0x7f96700ab820 msgr2=0x7f96700abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.560+0000 7f96767ff700 1 -- 172.21.15.43:0/958311002 shutdown_connections 2023-08-27T11:23:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.560+0000 7f96767ff700 1 -- 172.21.15.43:0/958311002 wait complete. 2023-08-27T11:23:52.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.561+0000 7f96767ff700 1 Processor -- start 2023-08-27T11:23:52.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.561+0000 7f96767ff700 1 -- start start 2023-08-27T11:23:52.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f9670152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 0x7f96701529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96700aa0c0 con 0x7f967006ad70 2023-08-27T11:23:52.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967014cab0 con 0x7f9670151a90 2023-08-27T11:23:52.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.562+0000 7f96767ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9670152f10 con 0x7f96700c4630 2023-08-27T11:23:52.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37100/0 (socket says 172.21.15.43:37100) 2023-08-27T11:23:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 -- 172.21.15.43:0/1255119443 learned_addr learned my addr 172.21.15.43:0/1255119443 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f9674d9c700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 0x7f96701529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966f7fe700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f9670152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 -- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 msgr2=0x7f9670152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f9670152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 -- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 msgr2=0x7f96701529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 0x7f96701529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 -- 172.21.15.43:0/1255119443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9668009b30 con 0x7f967006ad70 2023-08-27T11:23:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f9674d9c700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 0x7f96701529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966f7fe700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f9670152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966ffff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f966000c450 tx=0x7f966000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.563+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600052d0 con 0x7f967006ad70 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.564+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9660005430 con 0x7f967006ad70 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.564+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96700aa550 con 0x7f967006ad70 2023-08-27T11:23:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.564+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600038c0 con 0x7f967006ad70 2023-08-27T11:23:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.564+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96700a9a70 con 0x7f967006ad70 2023-08-27T11:23:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.565+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967004ee70 con 0x7f967006ad70 2023-08-27T11:23:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.566+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9660003a20 con 0x7f967006ad70 2023-08-27T11:23:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.566+0000 7f966cff9700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 0x7f965c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.567+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9660087910 con 0x7f967006ad70 2023-08-27T11:23:52.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.567+0000 7f966f7fe700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 0x7f965c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:52.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.567+0000 7f966f7fe700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 0x7f965c06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9664009c30 tx=0x7f9664008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:52.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.571+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9660052ff0 con 0x7f967006ad70 2023-08-27T11:23:52.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.829+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f967014e750 con 0x7f967006ad70 2023-08-27T11:23:52.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.829+0000 7f966cff9700 1 -- 172.21.15.43:0/1255119443 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4866 (secure 0 0 0) 0x7f9660056610 con 0x7f967006ad70 2023-08-27T11:23:52.832 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:23:52.315776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1831306112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1831306112},{"type":"v1","addr":"172.21.15.43:6836","nonce":1831306112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:23:52.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 msgr2=0x7f965c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 0x7f965c06c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9664009c30 tx=0x7f9664008040 comp rx=0 tx=0).stop 2023-08-27T11:23:52.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 msgr2=0x7f9670150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:52.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f966000c450 tx=0x7f966000c810 comp rx=0 tx=0).stop 2023-08-27T11:23:52.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 shutdown_connections 2023-08-27T11:23:52.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f965c06a0e0 0x7f965c06c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9670151a90 0x7f96701529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f967006ad70 0x7f9670150580 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 --2- 172.21.15.43:0/1255119443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96700c4630 0x7f9670152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 >> 172.21.15.43:0/1255119443 conn(0x7f96700ab820 msgr2=0x7f9670073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 shutdown_connections 2023-08-27T11:23:52.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:52.832+0000 7f96767ff700 1 -- 172.21.15.43:0/1255119443 wait complete. 2023-08-27T11:23:52.840 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-08-27T11:23:52.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:23:53.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.053+0000 7f0e8e9ff700 1 Processor -- start 2023-08-27T11:23:53.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.053+0000 7f0e8e9ff700 1 -- start start 2023-08-27T11:23:53.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.054+0000 7f0e8e9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e880c6080 0x7f0e8806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.054+0000 7f0e8e9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.054+0000 7f0e8e9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8806e6f0 con 0x7f0e8806a850 2023-08-27T11:23:53.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.054+0000 7f0e8e9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e881584f0 con 0x7f0e880c6080 2023-08-27T11:23:53.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.054+0000 7f0e8e9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88158980 con 0x7f0e8806d9c0 2023-08-27T11:23:53.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:45380/0 (socket says 172.21.15.43:45380) 2023-08-27T11:23:53.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 -- 172.21.15.43:0/3657738182 learned_addr learned my addr 172.21.15.43:0/3657738182 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:53.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e87fff700 1 --2- 172.21.15.43:0/3657738182 >> v2:172.21.15.57:3300/0 conn(0x7f0e880c6080 0x7f0e8806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 -- 172.21.15.43:0/3657738182 >> v2:172.21.15.57:3300/0 conn(0x7f0e880c6080 msgr2=0x7f0e8806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:53.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 --2- 172.21.15.43:0/3657738182 >> v2:172.21.15.57:3300/0 conn(0x7f0e880c6080 0x7f0e8806e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 -- 172.21.15.43:0/3657738182 >> v1:172.21.15.57:6789/0 conn(0x7f0e8806a850 legacy=0x7f0e88154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.055+0000 7f0e877fe700 1 -- 172.21.15.43:0/3657738182 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88157bc0 con 0x7f0e8806d9c0 2023-08-27T11:23:53.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e877fe700 1 --2- 172.21.15.43:0/3657738182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0098f0 tx=0x7f0e7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43ec9070b04c9e4a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e86ffd700 1 -- 172.21.15.43:0/3657738182 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011830 con 0x7f0e8806d9c0 2023-08-27T11:23:53.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e86ffd700 1 -- 172.21.15.43:0/3657738182 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c011990 con 0x7f0e8806d9c0 2023-08-27T11:23:53.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e86ffd700 1 -- 172.21.15.43:0/3657738182 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c011d20 con 0x7f0e8806d9c0 2023-08-27T11:23:53.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/3657738182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 msgr2=0x7f0e8806a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/3657738182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c0098f0 tx=0x7f0e7c009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:53.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/3657738182 shutdown_connections 2023-08-27T11:23:53.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/3657738182 >> v2:172.21.15.57:3300/0 conn(0x7f0e880c6080 0x7f0e8806e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/3657738182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e8806a310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.056+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/3657738182 >> 172.21.15.43:0/3657738182 conn(0x7f0e880a85e0 msgr2=0x7f0e880a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:53.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.057+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/3657738182 shutdown_connections 2023-08-27T11:23:53.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.057+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/3657738182 wait complete. 2023-08-27T11:23:53.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.058+0000 7f0e8e9ff700 1 Processor -- start 2023-08-27T11:23:53.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.058+0000 7f0e8e9ff700 1 -- start start 2023-08-27T11:23:53.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e881497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 0x7f0e880c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880bf840 con 0x7f0e8806a850 2023-08-27T11:23:53.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880a6130 con 0x7f0e880c6080 2023-08-27T11:23:53.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.059+0000 7f0e8e9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e880a6410 con 0x7f0e8806d9c0 2023-08-27T11:23:53.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37116/0 (socket says 172.21.15.43:37116) 2023-08-27T11:23:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 -- 172.21.15.43:0/485219277 learned_addr learned my addr 172.21.15.43:0/485219277 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e8cf9c700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 0x7f0e880c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 -- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 msgr2=0x7f0e881497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e877fe700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e881497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e881497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 -- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 msgr2=0x7f0e880c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 0x7f0e880c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 -- 172.21.15.43:0/485219277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c009550 con 0x7f0e8806a850 2023-08-27T11:23:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e8cf9c700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 0x7f0e880c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e877fe700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e881497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e87fff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e9b0 tx=0x7f0e7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.060+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78009710 con 0x7f0e8806a850 2023-08-27T11:23:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.061+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800c850 con 0x7f0e8806a850 2023-08-27T11:23:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.061+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800cbc0 con 0x7f0e8806a850 2023-08-27T11:23:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.061+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e880a66f0 con 0x7f0e8806a850 2023-08-27T11:23:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.061+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e88149ce0 con 0x7f0e8806a850 2023-08-27T11:23:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.062+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8804ee70 con 0x7f0e8806a850 2023-08-27T11:23:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.063+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e7800cd20 con 0x7f0e8806a850 2023-08-27T11:23:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.064+0000 7f0e84ff9700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 0x7f0e7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.064+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e780885f0 con 0x7f0e8806a850 2023-08-27T11:23:53.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.064+0000 7f0e877fe700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 0x7f0e7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.065+0000 7f0e877fe700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 0x7f0e7406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e88157830 tx=0x7f0e7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.069+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e78057800 con 0x7f0e8806a850 2023-08-27T11:23:53.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.278+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e8806d7a0 con 0x7f0e8806a850 2023-08-27T11:23:53.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.279+0000 7f0e84ff9700 1 -- 172.21.15.43:0/485219277 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f0e78057390 con 0x7f0e8806a850 2023-08-27T11:23:53.281 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:53.281 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":34,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:50.282244+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:23:53.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 msgr2=0x7f0e7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 0x7f0e7406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0e88157830 tx=0x7f0e7c008030 comp rx=0 tx=0).stop 2023-08-27T11:23:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 msgr2=0x7f0e881ed590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e9b0 tx=0x7f0e7800ed70 comp rx=0 tx=0).stop 2023-08-27T11:23:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 shutdown_connections 2023-08-27T11:23:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e7406a0e0 0x7f0e7406c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e880c6080 0x7f0e880c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e8806a850 0x7f0e881ed590 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 --2- 172.21.15.43:0/485219277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e8806d9c0 0x7f0e881497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 >> 172.21.15.43:0/485219277 conn(0x7f0e880a85e0 msgr2=0x7f0e880c6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 shutdown_connections 2023-08-27T11:23:53.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.282+0000 7f0e8e9ff700 1 -- 172.21.15.43:0/485219277 wait complete. 2023-08-27T11:23:53.301 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:23:53.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:23:53.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.502+0000 7fe6a8fff700 1 Processor -- start 2023-08-27T11:23:53.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.502+0000 7fe6a8fff700 1 -- start start 2023-08-27T11:23:53.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.503+0000 7fe6a8fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe6a414e960 0x7fe6a40a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.503+0000 7fe6a8fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a4154d00 con 0x7fe6a40c50d0 2023-08-27T11:23:53.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.503+0000 7fe6a8fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a4154fe0 con 0x7fe6a40a79c0 2023-08-27T11:23:53.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.503+0000 7fe6a8fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40baf30 con 0x7fe6a414e960 2023-08-27T11:23:53.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe6a414e960 0x7fe6a40a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a2d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe6a40c50d0 0x7fe6a40c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42504/0 (socket says 172.21.15.43:42504) 2023-08-27T11:23:53.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a2d9d700 1 -- 172.21.15.43:0/696725210 learned_addr learned my addr 172.21.15.43:0/696725210 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:53.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a259c700 1 -- 172.21.15.43:0/696725210 >> v1:172.21.15.57:6789/0 conn(0x7fe6a40a79c0 legacy=0x7fe6a40c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:53.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a259c700 1 -- 172.21.15.43:0/696725210 >> v1:172.21.15.43:6789/0 conn(0x7fe6a40c50d0 legacy=0x7fe6a40c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a259c700 1 -- 172.21.15.43:0/696725210 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a41552c0 con 0x7fe6a414e960 2023-08-27T11:23:53.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.504+0000 7fe6a159a700 1 -- 172.21.15.43:0/696725210 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073637088 0 0) 0x7fe6a4154d00 con 0x7fe6a40c50d0 2023-08-27T11:23:53.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a259c700 1 --2- 172.21.15.43:0/696725210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a414e960 0x7fe6a40a7480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe694009840 tx=0x7fe694009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd1e8145c736bf8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a159a700 1 -- 172.21.15.43:0/696725210 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694004230 con 0x7fe6a414e960 2023-08-27T11:23:53.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a159a700 1 -- 172.21.15.43:0/696725210 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694004390 con 0x7fe6a414e960 2023-08-27T11:23:53.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a159a700 1 -- 172.21.15.43:0/696725210 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940036a0 con 0x7fe6a414e960 2023-08-27T11:23:53.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 -- 172.21.15.43:0/696725210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a414e960 msgr2=0x7fe6a40a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/696725210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a414e960 0x7fe6a40a7480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe694009840 tx=0x7fe694009b50 comp rx=0 tx=0).stop 2023-08-27T11:23:53.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 -- 172.21.15.43:0/696725210 shutdown_connections 2023-08-27T11:23:53.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/696725210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a414e960 0x7fe6a40a7480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 -- 172.21.15.43:0/696725210 >> 172.21.15.43:0/696725210 conn(0x7fe6a406aa50 msgr2=0x7fe6a40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:53.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 -- 172.21.15.43:0/696725210 shutdown_connections 2023-08-27T11:23:53.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.505+0000 7fe6a8fff700 1 -- 172.21.15.43:0/696725210 wait complete. 2023-08-27T11:23:53.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.507+0000 7fe6a8fff700 1 Processor -- start 2023-08-27T11:23:53.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.507+0000 7fe6a8fff700 1 -- start start 2023-08-27T11:23:53.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6a40a79c0 0x7fe6a41e9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6a414e960 0x7fe6a414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4151560 con 0x7fe6a40c50d0 2023-08-27T11:23:53.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a414fe50 con 0x7fe6a414e960 2023-08-27T11:23:53.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a8fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41508e0 con 0x7fe6a40a79c0 2023-08-27T11:23:53.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37134/0 (socket says 172.21.15.43:37134) 2023-08-27T11:23:53.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.508+0000 7fe6a1d9b700 1 -- 172.21.15.43:0/536484917 learned_addr learned my addr 172.21.15.43:0/536484917 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:53.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a259c700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6a40a79c0 0x7fe6a41e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a2d9d700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6a414e960 0x7fe6a414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 -- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6a40a79c0 msgr2=0x7fe6a41e9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6a40a79c0 0x7fe6a41e9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 -- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6a414e960 msgr2=0x7fe6a414a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6a414e960 0x7fe6a414a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 -- 172.21.15.43:0/536484917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940094a0 con 0x7fe6a40c50d0 2023-08-27T11:23:53.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a1d9b700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c4d0 tx=0x7fe69800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698011790 con 0x7fe6a40c50d0 2023-08-27T11:23:53.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6980118f0 con 0x7fe6a40c50d0 2023-08-27T11:23:53.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698011ca0 con 0x7fe6a40c50d0 2023-08-27T11:23:53.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.509+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a4150bc0 con 0x7fe6a40c50d0 2023-08-27T11:23:53.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.510+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a4151180 con 0x7fe6a40c50d0 2023-08-27T11:23:53.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.510+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a404ee70 con 0x7fe6a40c50d0 2023-08-27T11:23:53.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.511+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe69801c460 con 0x7fe6a40c50d0 2023-08-27T11:23:53.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.512+0000 7fe692ffd700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 0x7fe68406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:53.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.512+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6980882d0 con 0x7fe6a40c50d0 2023-08-27T11:23:53.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.513+0000 7fe6a259c700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 0x7fe68406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:53.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.513+0000 7fe6a259c700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 0x7fe68406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe6940090b0 tx=0x7fe694008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:53.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.517+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe698053920 con 0x7fe6a40c50d0 2023-08-27T11:23:53.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.721+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6a40c37a0 con 0x7fe68406a0e0 2023-08-27T11:23:53.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.734+0000 7fe692ffd700 1 -- 172.21.15.43:0/536484917 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311594 (secure 0 0 0) 0x7fe694003850 con 0x7fe68406a0e0 2023-08-27T11:23:53.739 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 msgr2=0x7fe68406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 0x7fe68406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe6940090b0 tx=0x7fe694008030 comp rx=0 tx=0).stop 2023-08-27T11:23:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 msgr2=0x7fe6a40a9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:53.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c4d0 tx=0x7fe69800c7e0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 shutdown_connections 2023-08-27T11:23:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe68406a0e0 0x7fe68406c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6a414e960 0x7fe6a414a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6a40a79c0 0x7fe6a41e9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 --2- 172.21.15.43:0/536484917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe6a40c50d0 0x7fe6a40a9840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 >> 172.21.15.43:0/536484917 conn(0x7fe6a406aa50 msgr2=0x7fe6a4154470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 shutdown_connections 2023-08-27T11:23:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.738+0000 7fe6a8fff700 1 -- 172.21.15.43:0/536484917 wait complete. 2023-08-27T11:23:53.744 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:23:53.758 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-27T11:23:52.327343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220304,"kb_used_data":4120,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754416,"statfs":{"total":773094113280,"available":772868521984,"internally_reserved":0,"allocated":4218880,"data_stored":2405036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071597"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312408+0000","last_change":"2023-08-27T11:23:49.304211+0000","last_active":"2023-08-27T11:23:49.312408+0000","last_peered":"2023-08-27T11:23:49.312408+0000","last_clean":"2023-08-27T11:23:49.312408+0000","last_became_active":"2023-08-27T11:23:49.303898+0000","last_became_peered":"2023-08-27T11:23:49.303898+0000","last_unstale":"2023-08-27T11:23:49.312408+0000","last_undegraded":"2023-08-27T11:23:49.312408+0000","last_fullsized":"2023-08-27T11:23:49.312408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:13.213841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.310678+0000","last_change":"2023-08-27T11:23:49.298797+0000","last_active":"2023-08-27T11:23:49.310678+0000","last_peered":"2023-08-27T11:23:49.310678+0000","last_clean":"2023-08-27T11:23:49.310678+0000","last_became_active":"2023-08-27T11:23:49.298354+0000","last_became_peered":"2023-08-27T11:23:49.298354+0000","last_unstale":"2023-08-27T11:23:49.310678+0000","last_undegraded":"2023-08-27T11:23:49.310678+0000","last_fullsized":"2023-08-27T11:23:49.310678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:51.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314834+0000","last_change":"2023-08-27T11:23:49.311688+0000","last_active":"2023-08-27T11:23:49.314834+0000","last_peered":"2023-08-27T11:23:49.314834+0000","last_clean":"2023-08-27T11:23:49.314834+0000","last_became_active":"2023-08-27T11:23:49.311364+0000","last_became_peered":"2023-08-27T11:23:49.311364+0000","last_unstale":"2023-08-27T11:23:49.314834+0000","last_undegraded":"2023-08-27T11:23:49.314834+0000","last_fullsized":"2023-08-27T11:23:49.314834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:23.682423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306021+0000","last_change":"2023-08-27T11:23:49.293788+0000","last_active":"2023-08-27T11:23:49.306021+0000","last_peered":"2023-08-27T11:23:49.306021+0000","last_clean":"2023-08-27T11:23:49.306021+0000","last_became_active":"2023-08-27T11:23:49.292968+0000","last_became_peered":"2023-08-27T11:23:49.292968+0000","last_unstale":"2023-08-27T11:23:49.306021+0000","last_undegraded":"2023-08-27T11:23:49.306021+0000","last_fullsized":"2023-08-27T11:23:49.306021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:35:36.132892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.301723+0000","last_change":"2023-08-27T11:23:49.293320+0000","last_active":"2023-08-27T11:23:49.301723+0000","last_peered":"2023-08-27T11:23:49.301723+0000","last_clean":"2023-08-27T11:23:49.301723+0000","last_became_active":"2023-08-27T11:23:49.293035+0000","last_became_peered":"2023-08-27T11:23:49.293035+0000","last_unstale":"2023-08-27T11:23:49.301723+0000","last_undegraded":"2023-08-27T11:23:49.301723+0000","last_fullsized":"2023-08-27T11:23:49.301723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:01:40.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308458+0000","last_change":"2023-08-27T11:23:49.305864+0000","last_active":"2023-08-27T11:23:49.308458+0000","last_peered":"2023-08-27T11:23:49.308458+0000","last_clean":"2023-08-27T11:23:49.308458+0000","last_became_active":"2023-08-27T11:23:49.305568+0000","last_became_peered":"2023-08-27T11:23:49.305568+0000","last_unstale":"2023-08-27T11:23:49.308458+0000","last_undegraded":"2023-08-27T11:23:49.308458+0000","last_fullsized":"2023-08-27T11:23:49.308458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:41.715892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313297+0000","last_change":"2023-08-27T11:23:49.306881+0000","last_active":"2023-08-27T11:23:49.313297+0000","last_peered":"2023-08-27T11:23:49.313297+0000","last_clean":"2023-08-27T11:23:49.313297+0000","last_became_active":"2023-08-27T11:23:49.306227+0000","last_became_peered":"2023-08-27T11:23:49.306227+0000","last_unstale":"2023-08-27T11:23:49.313297+0000","last_undegraded":"2023-08-27T11:23:49.313297+0000","last_fullsized":"2023-08-27T11:23:49.313297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:38.600303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316703+0000","last_change":"2023-08-27T11:23:49.309640+0000","last_active":"2023-08-27T11:23:49.316703+0000","last_peered":"2023-08-27T11:23:49.316703+0000","last_clean":"2023-08-27T11:23:49.316703+0000","last_became_active":"2023-08-27T11:23:49.309409+0000","last_became_peered":"2023-08-27T11:23:49.309409+0000","last_unstale":"2023-08-27T11:23:49.316703+0000","last_undegraded":"2023-08-27T11:23:49.316703+0000","last_fullsized":"2023-08-27T11:23:49.316703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:25:04.269139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314199+0000","last_change":"2023-08-27T11:23:49.311763+0000","last_active":"2023-08-27T11:23:49.314199+0000","last_peered":"2023-08-27T11:23:49.314199+0000","last_clean":"2023-08-27T11:23:49.314199+0000","last_became_active":"2023-08-27T11:23:49.311480+0000","last_became_peered":"2023-08-27T11:23:49.311480+0000","last_unstale":"2023-08-27T11:23:49.314199+0000","last_undegraded":"2023-08-27T11:23:49.314199+0000","last_fullsized":"2023-08-27T11:23:49.314199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316084+0000","last_change":"2023-08-27T11:23:49.311775+0000","last_active":"2023-08-27T11:23:49.316084+0000","last_peered":"2023-08-27T11:23:49.316084+0000","last_clean":"2023-08-27T11:23:49.316084+0000","last_became_active":"2023-08-27T11:23:49.311459+0000","last_became_peered":"2023-08-27T11:23:49.311459+0000","last_unstale":"2023-08-27T11:23:49.316084+0000","last_undegraded":"2023-08-27T11:23:49.316084+0000","last_fullsized":"2023-08-27T11:23:49.316084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:50.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315546+0000","last_change":"2023-08-27T11:23:49.311227+0000","last_active":"2023-08-27T11:23:49.315546+0000","last_peered":"2023-08-27T11:23:49.315546+0000","last_clean":"2023-08-27T11:23:49.315546+0000","last_became_active":"2023-08-27T11:23:49.310094+0000","last_became_peered":"2023-08-27T11:23:49.310094+0000","last_unstale":"2023-08-27T11:23:49.315546+0000","last_undegraded":"2023-08-27T11:23:49.315546+0000","last_fullsized":"2023-08-27T11:23:49.315546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.309190+0000","last_change":"2023-08-27T11:23:49.307653+0000","last_active":"2023-08-27T11:23:49.309190+0000","last_peered":"2023-08-27T11:23:49.309190+0000","last_clean":"2023-08-27T11:23:49.309190+0000","last_became_active":"2023-08-27T11:23:49.307315+0000","last_became_peered":"2023-08-27T11:23:49.307315+0000","last_unstale":"2023-08-27T11:23:49.309190+0000","last_undegraded":"2023-08-27T11:23:49.309190+0000","last_fullsized":"2023-08-27T11:23:49.309190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:10.757295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314011+0000","last_change":"2023-08-27T11:23:49.310845+0000","last_active":"2023-08-27T11:23:49.314011+0000","last_peered":"2023-08-27T11:23:49.314011+0000","last_clean":"2023-08-27T11:23:49.314011+0000","last_became_active":"2023-08-27T11:23:49.310551+0000","last_became_peered":"2023-08-27T11:23:49.310551+0000","last_unstale":"2023-08-27T11:23:49.314011+0000","last_undegraded":"2023-08-27T11:23:49.314011+0000","last_fullsized":"2023-08-27T11:23:49.314011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:34.229781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292071+0000","last_change":"2023-08-27T11:23:49.296042+0000","last_active":"2023-08-27T11:23:50.292071+0000","last_peered":"2023-08-27T11:23:50.292071+0000","last_clean":"2023-08-27T11:23:50.292071+0000","last_became_active":"2023-08-27T11:23:49.295734+0000","last_became_peered":"2023-08-27T11:23:49.295734+0000","last_unstale":"2023-08-27T11:23:50.292071+0000","last_undegraded":"2023-08-27T11:23:50.292071+0000","last_fullsized":"2023-08-27T11:23:50.292071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:46.869454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313317+0000","last_change":"2023-08-27T11:23:49.307077+0000","last_active":"2023-08-27T11:23:49.313317+0000","last_peered":"2023-08-27T11:23:49.313317+0000","last_clean":"2023-08-27T11:23:49.313317+0000","last_became_active":"2023-08-27T11:23:49.306597+0000","last_became_peered":"2023-08-27T11:23:49.306597+0000","last_unstale":"2023-08-27T11:23:49.313317+0000","last_undegraded":"2023-08-27T11:23:49.313317+0000","last_fullsized":"2023-08-27T11:23:49.313317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292640+0000","last_change":"2023-08-27T11:23:49.314492+0000","last_active":"2023-08-27T11:23:50.292640+0000","last_peered":"2023-08-27T11:23:50.292640+0000","last_clean":"2023-08-27T11:23:50.292640+0000","last_became_active":"2023-08-27T11:23:49.314211+0000","last_became_peered":"2023-08-27T11:23:49.314211+0000","last_unstale":"2023-08-27T11:23:50.292640+0000","last_undegraded":"2023-08-27T11:23:50.292640+0000","last_fullsized":"2023-08-27T11:23:50.292640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:19:12.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291504+0000","last_change":"2023-08-27T11:23:49.314159+0000","last_active":"2023-08-27T11:23:50.291504+0000","last_peered":"2023-08-27T11:23:50.291504+0000","last_clean":"2023-08-27T11:23:50.291504+0000","last_became_active":"2023-08-27T11:23:49.313836+0000","last_became_peered":"2023-08-27T11:23:49.313836+0000","last_unstale":"2023-08-27T11:23:50.291504+0000","last_undegraded":"2023-08-27T11:23:50.291504+0000","last_fullsized":"2023-08-27T11:23:50.291504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:39.604913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290230+0000","last_change":"2023-08-27T11:23:49.305196+0000","last_active":"2023-08-27T11:23:50.290230+0000","last_peered":"2023-08-27T11:23:50.290230+0000","last_clean":"2023-08-27T11:23:50.290230+0000","last_became_active":"2023-08-27T11:23:49.304788+0000","last_became_peered":"2023-08-27T11:23:49.304788+0000","last_unstale":"2023-08-27T11:23:50.290230+0000","last_undegraded":"2023-08-27T11:23:50.290230+0000","last_fullsized":"2023-08-27T11:23:50.290230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306254+0000","last_change":"2023-08-27T11:23:49.296809+0000","last_active":"2023-08-27T11:23:49.306254+0000","last_peered":"2023-08-27T11:23:49.306254+0000","last_clean":"2023-08-27T11:23:49.306254+0000","last_became_active":"2023-08-27T11:23:49.296516+0000","last_became_peered":"2023-08-27T11:23:49.296516+0000","last_unstale":"2023-08-27T11:23:49.306254+0000","last_undegraded":"2023-08-27T11:23:49.306254+0000","last_fullsized":"2023-08-27T11:23:49.306254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:40:44.212767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289905+0000","last_change":"2023-08-27T11:23:49.300731+0000","last_active":"2023-08-27T11:23:50.289905+0000","last_peered":"2023-08-27T11:23:50.289905+0000","last_clean":"2023-08-27T11:23:50.289905+0000","last_became_active":"2023-08-27T11:23:49.300360+0000","last_became_peered":"2023-08-27T11:23:49.300360+0000","last_unstale":"2023-08-27T11:23:50.289905+0000","last_undegraded":"2023-08-27T11:23:50.289905+0000","last_fullsized":"2023-08-27T11:23:50.289905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.322976+0000","last_change":"2023-08-27T11:23:49.315732+0000","last_active":"2023-08-27T11:23:49.322976+0000","last_peered":"2023-08-27T11:23:49.322976+0000","last_clean":"2023-08-27T11:23:49.322976+0000","last_became_active":"2023-08-27T11:23:49.315457+0000","last_became_peered":"2023-08-27T11:23:49.315457+0000","last_unstale":"2023-08-27T11:23:49.322976+0000","last_undegraded":"2023-08-27T11:23:49.322976+0000","last_fullsized":"2023-08-27T11:23:49.322976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:16:17.044424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292149+0000","last_change":"2023-08-27T11:23:49.301802+0000","last_active":"2023-08-27T11:23:50.292149+0000","last_peered":"2023-08-27T11:23:50.292149+0000","last_clean":"2023-08-27T11:23:50.292149+0000","last_became_active":"2023-08-27T11:23:49.301495+0000","last_became_peered":"2023-08-27T11:23:49.301495+0000","last_unstale":"2023-08-27T11:23:50.292149+0000","last_undegraded":"2023-08-27T11:23:50.292149+0000","last_fullsized":"2023-08-27T11:23:50.292149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:22.659339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291708+0000","last_change":"2023-08-27T11:23:49.310734+0000","last_active":"2023-08-27T11:23:50.291708+0000","last_peered":"2023-08-27T11:23:50.291708+0000","last_clean":"2023-08-27T11:23:50.291708+0000","last_became_active":"2023-08-27T11:23:49.310436+0000","last_became_peered":"2023-08-27T11:23:49.310436+0000","last_unstale":"2023-08-27T11:23:50.291708+0000","last_undegraded":"2023-08-27T11:23:50.291708+0000","last_fullsized":"2023-08-27T11:23:50.291708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:44:19.487589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.317736+0000","last_change":"2023-08-27T11:23:49.305758+0000","last_active":"2023-08-27T11:23:49.317736+0000","last_peered":"2023-08-27T11:23:49.317736+0000","last_clean":"2023-08-27T11:23:49.317736+0000","last_became_active":"2023-08-27T11:23:49.305473+0000","last_became_peered":"2023-08-27T11:23:49.305473+0000","last_unstale":"2023-08-27T11:23:49.317736+0000","last_undegraded":"2023-08-27T11:23:49.317736+0000","last_fullsized":"2023-08-27T11:23:49.317736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:29.603334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290394+0000","last_change":"2023-08-27T11:23:49.302496+0000","last_active":"2023-08-27T11:23:50.290394+0000","last_peered":"2023-08-27T11:23:50.290394+0000","last_clean":"2023-08-27T11:23:50.290394+0000","last_became_active":"2023-08-27T11:23:49.302171+0000","last_became_peered":"2023-08-27T11:23:49.302171+0000","last_unstale":"2023-08-27T11:23:50.290394+0000","last_undegraded":"2023-08-27T11:23:50.290394+0000","last_fullsized":"2023-08-27T11:23:50.290394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316658+0000","last_change":"2023-08-27T11:23:49.313528+0000","last_active":"2023-08-27T11:23:49.316658+0000","last_peered":"2023-08-27T11:23:49.316658+0000","last_clean":"2023-08-27T11:23:49.316658+0000","last_became_active":"2023-08-27T11:23:49.313164+0000","last_became_peered":"2023-08-27T11:23:49.313164+0000","last_unstale":"2023-08-27T11:23:49.316658+0000","last_undegraded":"2023-08-27T11:23:49.316658+0000","last_fullsized":"2023-08-27T11:23:49.316658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:14.991184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290057+0000","last_change":"2023-08-27T11:23:49.305728+0000","last_active":"2023-08-27T11:23:50.290057+0000","last_peered":"2023-08-27T11:23:50.290057+0000","last_clean":"2023-08-27T11:23:50.290057+0000","last_became_active":"2023-08-27T11:23:49.305458+0000","last_became_peered":"2023-08-27T11:23:49.305458+0000","last_unstale":"2023-08-27T11:23:50.290057+0000","last_undegraded":"2023-08-27T11:23:50.290057+0000","last_fullsized":"2023-08-27T11:23:50.290057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313371+0000","last_change":"2023-08-27T11:23:49.307996+0000","last_active":"2023-08-27T11:23:49.313371+0000","last_peered":"2023-08-27T11:23:49.313371+0000","last_clean":"2023-08-27T11:23:49.313371+0000","last_became_active":"2023-08-27T11:23:49.307723+0000","last_became_peered":"2023-08-27T11:23:49.307723+0000","last_unstale":"2023-08-27T11:23:49.313371+0000","last_undegraded":"2023-08-27T11:23:49.313371+0000","last_fullsized":"2023-08-27T11:23:49.313371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:10.757295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289731+0000","last_change":"2023-08-27T11:23:49.297762+0000","last_active":"2023-08-27T11:23:50.289731+0000","last_peered":"2023-08-27T11:23:50.289731+0000","last_clean":"2023-08-27T11:23:50.289731+0000","last_became_active":"2023-08-27T11:23:49.297443+0000","last_became_peered":"2023-08-27T11:23:49.297443+0000","last_unstale":"2023-08-27T11:23:50.289731+0000","last_undegraded":"2023-08-27T11:23:50.289731+0000","last_fullsized":"2023-08-27T11:23:50.289731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289632+0000","last_change":"2023-08-27T11:23:49.311450+0000","last_active":"2023-08-27T11:23:50.289632+0000","last_peered":"2023-08-27T11:23:50.289632+0000","last_clean":"2023-08-27T11:23:50.289632+0000","last_became_active":"2023-08-27T11:23:49.311164+0000","last_became_peered":"2023-08-27T11:23:49.311164+0000","last_unstale":"2023-08-27T11:23:50.289632+0000","last_undegraded":"2023-08-27T11:23:50.289632+0000","last_fullsized":"2023-08-27T11:23:50.289632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:38.600303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291436+0000","last_change":"2023-08-27T11:23:49.309341+0000","last_active":"2023-08-27T11:23:50.291436+0000","last_peered":"2023-08-27T11:23:50.291436+0000","last_clean":"2023-08-27T11:23:50.291436+0000","last_became_active":"2023-08-27T11:23:49.309048+0000","last_became_peered":"2023-08-27T11:23:49.309048+0000","last_unstale":"2023-08-27T11:23:50.291436+0000","last_undegraded":"2023-08-27T11:23:50.291436+0000","last_fullsized":"2023-08-27T11:23:50.291436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:36.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313505+0000","last_change":"2023-08-27T11:23:49.302517+0000","last_active":"2023-08-27T11:23:49.313505+0000","last_peered":"2023-08-27T11:23:49.313505+0000","last_clean":"2023-08-27T11:23:49.313505+0000","last_became_active":"2023-08-27T11:23:49.302099+0000","last_became_peered":"2023-08-27T11:23:49.302099+0000","last_unstale":"2023-08-27T11:23:49.313505+0000","last_undegraded":"2023-08-27T11:23:49.313505+0000","last_fullsized":"2023-08-27T11:23:49.313505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:57:26.763261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291474+0000","last_change":"2023-08-27T11:23:49.314175+0000","last_active":"2023-08-27T11:23:50.291474+0000","last_peered":"2023-08-27T11:23:50.291474+0000","last_clean":"2023-08-27T11:23:50.291474+0000","last_became_active":"2023-08-27T11:23:49.313889+0000","last_became_peered":"2023-08-27T11:23:49.313889+0000","last_unstale":"2023-08-27T11:23:50.291474+0000","last_undegraded":"2023-08-27T11:23:50.291474+0000","last_fullsized":"2023-08-27T11:23:50.291474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:56:37.369321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290407+0000","last_change":"2023-08-27T11:23:48.277675+0000","last_active":"2023-08-27T11:23:50.290407+0000","last_peered":"2023-08-27T11:23:50.290407+0000","last_clean":"2023-08-27T11:23:50.290407+0000","last_became_active":"2023-08-27T11:23:48.277388+0000","last_became_peered":"2023-08-27T11:23:48.277388+0000","last_unstale":"2023-08-27T11:23:50.290407+0000","last_undegraded":"2023-08-27T11:23:50.290407+0000","last_fullsized":"2023-08-27T11:23:50.290407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:33.220480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.322361+0000","last_change":"2023-08-27T11:23:49.315119+0000","last_active":"2023-08-27T11:23:49.322361+0000","last_peered":"2023-08-27T11:23:49.322361+0000","last_clean":"2023-08-27T11:23:49.322361+0000","last_became_active":"2023-08-27T11:23:49.314764+0000","last_became_peered":"2023-08-27T11:23:49.314764+0000","last_unstale":"2023-08-27T11:23:49.322361+0000","last_undegraded":"2023-08-27T11:23:49.322361+0000","last_fullsized":"2023-08-27T11:23:49.322361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:24:35.422197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324849+0000","last_change":"2023-08-27T11:23:48.287052+0000","last_active":"2023-08-27T11:23:49.324849+0000","last_peered":"2023-08-27T11:23:49.324849+0000","last_clean":"2023-08-27T11:23:49.324849+0000","last_became_active":"2023-08-27T11:23:48.286780+0000","last_became_peered":"2023-08-27T11:23:48.286780+0000","last_unstale":"2023-08-27T11:23:49.324849+0000","last_undegraded":"2023-08-27T11:23:49.324849+0000","last_fullsized":"2023-08-27T11:23:49.324849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:33.220480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292216+0000","last_change":"2023-08-27T11:23:49.294464+0000","last_active":"2023-08-27T11:23:50.292216+0000","last_peered":"2023-08-27T11:23:50.292216+0000","last_clean":"2023-08-27T11:23:50.292216+0000","last_became_active":"2023-08-27T11:23:49.294160+0000","last_became_peered":"2023-08-27T11:23:49.294160+0000","last_unstale":"2023-08-27T11:23:50.292216+0000","last_undegraded":"2023-08-27T11:23:50.292216+0000","last_fullsized":"2023-08-27T11:23:50.292216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:07:50.064209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.326205+0000","last_change":"2023-08-27T11:23:48.285419+0000","last_active":"2023-08-27T11:23:49.326205+0000","last_peered":"2023-08-27T11:23:49.326205+0000","last_clean":"2023-08-27T11:23:49.326205+0000","last_became_active":"2023-08-27T11:23:48.285069+0000","last_became_peered":"2023-08-27T11:23:48.285069+0000","last_unstale":"2023-08-27T11:23:49.326205+0000","last_undegraded":"2023-08-27T11:23:49.326205+0000","last_fullsized":"2023-08-27T11:23:49.326205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:37.591003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312385+0000","last_change":"2023-08-27T11:23:49.303421+0000","last_active":"2023-08-27T11:23:49.312385+0000","last_peered":"2023-08-27T11:23:49.312385+0000","last_clean":"2023-08-27T11:23:49.312385+0000","last_became_active":"2023-08-27T11:23:49.303052+0000","last_became_peered":"2023-08-27T11:23:49.303052+0000","last_unstale":"2023-08-27T11:23:49.312385+0000","last_undegraded":"2023-08-27T11:23:49.312385+0000","last_fullsized":"2023-08-27T11:23:49.312385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:07.452206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292715+0000","last_change":"2023-08-27T11:23:48.278058+0000","last_active":"2023-08-27T11:23:50.292715+0000","last_peered":"2023-08-27T11:23:50.292715+0000","last_clean":"2023-08-27T11:23:50.292715+0000","last_became_active":"2023-08-27T11:23:48.277745+0000","last_became_peered":"2023-08-27T11:23:48.277745+0000","last_unstale":"2023-08-27T11:23:50.292715+0000","last_undegraded":"2023-08-27T11:23:50.292715+0000","last_fullsized":"2023-08-27T11:23:50.292715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:57:13.208813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308319+0000","last_change":"2023-08-27T11:23:49.305635+0000","last_active":"2023-08-27T11:23:49.308319+0000","last_peered":"2023-08-27T11:23:49.308319+0000","last_clean":"2023-08-27T11:23:49.308319+0000","last_became_active":"2023-08-27T11:23:49.305245+0000","last_became_peered":"2023-08-27T11:23:49.305245+0000","last_unstale":"2023-08-27T11:23:49.308319+0000","last_undegraded":"2023-08-27T11:23:49.308319+0000","last_fullsized":"2023-08-27T11:23:49.308319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324859+0000","last_change":"2023-08-27T11:23:48.290484+0000","last_active":"2023-08-27T11:23:49.324859+0000","last_peered":"2023-08-27T11:23:49.324859+0000","last_clean":"2023-08-27T11:23:49.324859+0000","last_became_active":"2023-08-27T11:23:48.289311+0000","last_became_peered":"2023-08-27T11:23:48.289311+0000","last_unstale":"2023-08-27T11:23:49.324859+0000","last_undegraded":"2023-08-27T11:23:49.324859+0000","last_fullsized":"2023-08-27T11:23:49.324859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:23.936708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313333+0000","last_change":"2023-08-27T11:23:49.309504+0000","last_active":"2023-08-27T11:23:49.313333+0000","last_peered":"2023-08-27T11:23:49.313333+0000","last_clean":"2023-08-27T11:23:49.313333+0000","last_became_active":"2023-08-27T11:23:49.309089+0000","last_became_peered":"2023-08-27T11:23:49.309089+0000","last_unstale":"2023-08-27T11:23:49.313333+0000","last_undegraded":"2023-08-27T11:23:49.313333+0000","last_fullsized":"2023-08-27T11:23:49.313333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291923+0000","last_change":"2023-08-27T11:23:48.287570+0000","last_active":"2023-08-27T11:23:50.291923+0000","last_peered":"2023-08-27T11:23:50.291923+0000","last_clean":"2023-08-27T11:23:50.291923+0000","last_became_active":"2023-08-27T11:23:48.287262+0000","last_became_peered":"2023-08-27T11:23:48.287262+0000","last_unstale":"2023-08-27T11:23:50.291923+0000","last_undegraded":"2023-08-27T11:23:50.291923+0000","last_fullsized":"2023-08-27T11:23:50.291923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:26:32.034693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292342+0000","last_change":"2023-08-27T11:23:49.313004+0000","last_active":"2023-08-27T11:23:50.292342+0000","last_peered":"2023-08-27T11:23:50.292342+0000","last_clean":"2023-08-27T11:23:50.292342+0000","last_became_active":"2023-08-27T11:23:49.312554+0000","last_became_peered":"2023-08-27T11:23:49.312554+0000","last_unstale":"2023-08-27T11:23:50.292342+0000","last_undegraded":"2023-08-27T11:23:50.292342+0000","last_fullsized":"2023-08-27T11:23:50.292342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:11:03.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290645+0000","last_change":"2023-08-27T11:23:48.285133+0000","last_active":"2023-08-27T11:23:49.290645+0000","last_peered":"2023-08-27T11:23:49.290645+0000","last_clean":"2023-08-27T11:23:49.290645+0000","last_became_active":"2023-08-27T11:23:48.284833+0000","last_became_peered":"2023-08-27T11:23:48.284833+0000","last_unstale":"2023-08-27T11:23:49.290645+0000","last_undegraded":"2023-08-27T11:23:49.290645+0000","last_fullsized":"2023-08-27T11:23:49.290645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:47.260019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312794+0000","last_change":"2023-08-27T11:23:49.304740+0000","last_active":"2023-08-27T11:23:49.312794+0000","last_peered":"2023-08-27T11:23:49.312794+0000","last_clean":"2023-08-27T11:23:49.312794+0000","last_became_active":"2023-08-27T11:23:49.304230+0000","last_became_peered":"2023-08-27T11:23:49.304230+0000","last_unstale":"2023-08-27T11:23:49.312794+0000","last_undegraded":"2023-08-27T11:23:49.312794+0000","last_fullsized":"2023-08-27T11:23:49.312794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:43:13.809668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292249+0000","last_change":"2023-08-27T11:23:48.280188+0000","last_active":"2023-08-27T11:23:50.292249+0000","last_peered":"2023-08-27T11:23:50.292249+0000","last_clean":"2023-08-27T11:23:50.292249+0000","last_became_active":"2023-08-27T11:23:48.279807+0000","last_became_peered":"2023-08-27T11:23:48.279807+0000","last_unstale":"2023-08-27T11:23:50.292249+0000","last_undegraded":"2023-08-27T11:23:50.292249+0000","last_fullsized":"2023-08-27T11:23:50.292249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:57:40.846943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306642+0000","last_change":"2023-08-27T11:23:49.300422+0000","last_active":"2023-08-27T11:23:49.306642+0000","last_peered":"2023-08-27T11:23:49.306642+0000","last_clean":"2023-08-27T11:23:49.306642+0000","last_became_active":"2023-08-27T11:23:49.300146+0000","last_became_peered":"2023-08-27T11:23:49.300146+0000","last_unstale":"2023-08-27T11:23:49.306642+0000","last_undegraded":"2023-08-27T11:23:49.306642+0000","last_fullsized":"2023-08-27T11:23:49.306642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:24.290080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295185+0000","last_change":"2023-08-27T11:23:48.273395+0000","last_active":"2023-08-27T11:23:49.295185+0000","last_peered":"2023-08-27T11:23:49.295185+0000","last_clean":"2023-08-27T11:23:49.295185+0000","last_became_active":"2023-08-27T11:23:48.273004+0000","last_became_peered":"2023-08-27T11:23:48.273004+0000","last_unstale":"2023-08-27T11:23:49.295185+0000","last_undegraded":"2023-08-27T11:23:49.295185+0000","last_fullsized":"2023-08-27T11:23:49.295185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:38.595613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292398+0000","last_change":"2023-08-27T11:23:49.308710+0000","last_active":"2023-08-27T11:23:50.292398+0000","last_peered":"2023-08-27T11:23:50.292398+0000","last_clean":"2023-08-27T11:23:50.292398+0000","last_became_active":"2023-08-27T11:23:49.308387+0000","last_became_peered":"2023-08-27T11:23:49.308387+0000","last_unstale":"2023-08-27T11:23:50.292398+0000","last_undegraded":"2023-08-27T11:23:50.292398+0000","last_fullsized":"2023-08-27T11:23:50.292398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:51:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.300197+0000","last_change":"2023-08-27T11:23:48.285496+0000","last_active":"2023-08-27T11:23:49.300197+0000","last_peered":"2023-08-27T11:23:49.300197+0000","last_clean":"2023-08-27T11:23:49.300197+0000","last_became_active":"2023-08-27T11:23:48.285000+0000","last_became_peered":"2023-08-27T11:23:48.285000+0000","last_unstale":"2023-08-27T11:23:49.300197+0000","last_undegraded":"2023-08-27T11:23:49.300197+0000","last_fullsized":"2023-08-27T11:23:49.300197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:26:51.034784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308351+0000","last_change":"2023-08-27T11:23:49.306228+0000","last_active":"2023-08-27T11:23:49.308351+0000","last_peered":"2023-08-27T11:23:49.308351+0000","last_clean":"2023-08-27T11:23:49.308351+0000","last_became_active":"2023-08-27T11:23:49.305971+0000","last_became_peered":"2023-08-27T11:23:49.305971+0000","last_unstale":"2023-08-27T11:23:49.308351+0000","last_undegraded":"2023-08-27T11:23:49.308351+0000","last_fullsized":"2023-08-27T11:23:49.308351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:50.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.326464+0000","last_change":"2023-08-27T11:23:48.284652+0000","last_active":"2023-08-27T11:23:49.326464+0000","last_peered":"2023-08-27T11:23:49.326464+0000","last_clean":"2023-08-27T11:23:49.326464+0000","last_became_active":"2023-08-27T11:23:48.284382+0000","last_became_peered":"2023-08-27T11:23:48.284382+0000","last_unstale":"2023-08-27T11:23:49.326464+0000","last_undegraded":"2023-08-27T11:23:49.326464+0000","last_fullsized":"2023-08-27T11:23:49.326464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:26.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292432+0000","last_change":"2023-08-27T11:23:49.299065+0000","last_active":"2023-08-27T11:23:50.292432+0000","last_peered":"2023-08-27T11:23:50.292432+0000","last_clean":"2023-08-27T11:23:50.292432+0000","last_became_active":"2023-08-27T11:23:49.298761+0000","last_became_peered":"2023-08-27T11:23:49.298761+0000","last_unstale":"2023-08-27T11:23:50.292432+0000","last_undegraded":"2023-08-27T11:23:50.292432+0000","last_fullsized":"2023-08-27T11:23:50.292432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:22.868521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.327687+0000","last_change":"2023-08-27T11:23:48.283246+0000","last_active":"2023-08-27T11:23:49.327687+0000","last_peered":"2023-08-27T11:23:49.327687+0000","last_clean":"2023-08-27T11:23:49.327687+0000","last_became_active":"2023-08-27T11:23:48.282922+0000","last_became_peered":"2023-08-27T11:23:48.282922+0000","last_unstale":"2023-08-27T11:23:49.327687+0000","last_undegraded":"2023-08-27T11:23:49.327687+0000","last_fullsized":"2023-08-27T11:23:49.327687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:35.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314234+0000","last_change":"2023-08-27T11:23:49.311891+0000","last_active":"2023-08-27T11:23:49.314234+0000","last_peered":"2023-08-27T11:23:49.314234+0000","last_clean":"2023-08-27T11:23:49.314234+0000","last_became_active":"2023-08-27T11:23:49.311341+0000","last_became_peered":"2023-08-27T11:23:49.311341+0000","last_unstale":"2023-08-27T11:23:49.314234+0000","last_undegraded":"2023-08-27T11:23:49.314234+0000","last_fullsized":"2023-08-27T11:23:49.314234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324583+0000","last_change":"2023-08-27T11:23:48.274651+0000","last_active":"2023-08-27T11:23:49.324583+0000","last_peered":"2023-08-27T11:23:49.324583+0000","last_clean":"2023-08-27T11:23:49.324583+0000","last_became_active":"2023-08-27T11:23:48.274353+0000","last_became_peered":"2023-08-27T11:23:48.274353+0000","last_unstale":"2023-08-27T11:23:49.324583+0000","last_undegraded":"2023-08-27T11:23:49.324583+0000","last_fullsized":"2023-08-27T11:23:49.324583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:28.944879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315922+0000","last_change":"2023-08-27T11:23:49.305974+0000","last_active":"2023-08-27T11:23:49.315922+0000","last_peered":"2023-08-27T11:23:49.315922+0000","last_clean":"2023-08-27T11:23:49.315922+0000","last_became_active":"2023-08-27T11:23:49.305679+0000","last_became_peered":"2023-08-27T11:23:49.305679+0000","last_unstale":"2023-08-27T11:23:49.315922+0000","last_undegraded":"2023-08-27T11:23:49.315922+0000","last_fullsized":"2023-08-27T11:23:49.315922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:46.286432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290495+0000","last_change":"2023-08-27T11:23:48.285837+0000","last_active":"2023-08-27T11:23:49.290495+0000","last_peered":"2023-08-27T11:23:49.290495+0000","last_clean":"2023-08-27T11:23:49.290495+0000","last_became_active":"2023-08-27T11:23:48.285515+0000","last_became_peered":"2023-08-27T11:23:48.285515+0000","last_unstale":"2023-08-27T11:23:49.290495+0000","last_undegraded":"2023-08-27T11:23:49.290495+0000","last_fullsized":"2023-08-27T11:23:49.290495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.887400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291599+0000","last_change":"2023-08-27T11:23:49.309026+0000","last_active":"2023-08-27T11:23:50.291599+0000","last_peered":"2023-08-27T11:23:50.291599+0000","last_clean":"2023-08-27T11:23:50.291599+0000","last_became_active":"2023-08-27T11:23:49.308707+0000","last_became_peered":"2023-08-27T11:23:49.308707+0000","last_unstale":"2023-08-27T11:23:50.291599+0000","last_undegraded":"2023-08-27T11:23:50.291599+0000","last_fullsized":"2023-08-27T11:23:50.291599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:58.593129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289560+0000","last_change":"2023-08-27T11:23:48.276797+0000","last_active":"2023-08-27T11:23:50.289560+0000","last_peered":"2023-08-27T11:23:50.289560+0000","last_clean":"2023-08-27T11:23:50.289560+0000","last_became_active":"2023-08-27T11:23:48.276448+0000","last_became_peered":"2023-08-27T11:23:48.276448+0000","last_unstale":"2023-08-27T11:23:50.289560+0000","last_undegraded":"2023-08-27T11:23:50.289560+0000","last_fullsized":"2023-08-27T11:23:50.289560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:41.484365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312753+0000","last_change":"2023-08-27T11:23:49.303066+0000","last_active":"2023-08-27T11:23:49.312753+0000","last_peered":"2023-08-27T11:23:49.312753+0000","last_clean":"2023-08-27T11:23:49.312753+0000","last_became_active":"2023-08-27T11:23:49.302707+0000","last_became_peered":"2023-08-27T11:23:49.302707+0000","last_unstale":"2023-08-27T11:23:49.312753+0000","last_undegraded":"2023-08-27T11:23:49.312753+0000","last_fullsized":"2023-08-27T11:23:49.312753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:01.932383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292277+0000","last_change":"2023-08-27T11:23:48.287277+0000","last_active":"2023-08-27T11:23:50.292277+0000","last_peered":"2023-08-27T11:23:50.292277+0000","last_clean":"2023-08-27T11:23:50.292277+0000","last_became_active":"2023-08-27T11:23:48.286977+0000","last_became_peered":"2023-08-27T11:23:48.286977+0000","last_unstale":"2023-08-27T11:23:50.292277+0000","last_undegraded":"2023-08-27T11:23:50.292277+0000","last_fullsized":"2023-08-27T11:23:50.292277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:33:01.706739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.311041+0000","last_change":"2023-08-27T11:23:49.302111+0000","last_active":"2023-08-27T11:23:49.311041+0000","last_peered":"2023-08-27T11:23:49.311041+0000","last_clean":"2023-08-27T11:23:49.311041+0000","last_became_active":"2023-08-27T11:23:49.301794+0000","last_became_peered":"2023-08-27T11:23:49.301794+0000","last_unstale":"2023-08-27T11:23:49.311041+0000","last_undegraded":"2023-08-27T11:23:49.311041+0000","last_fullsized":"2023-08-27T11:23:49.311041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:56:37.369321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325009+0000","last_change":"2023-08-27T11:23:48.285893+0000","last_active":"2023-08-27T11:23:49.325009+0000","last_peered":"2023-08-27T11:23:49.325009+0000","last_clean":"2023-08-27T11:23:49.325009+0000","last_became_active":"2023-08-27T11:23:48.285526+0000","last_became_peered":"2023-08-27T11:23:48.285526+0000","last_unstale":"2023-08-27T11:23:49.325009+0000","last_undegraded":"2023-08-27T11:23:49.325009+0000","last_fullsized":"2023-08-27T11:23:49.325009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:46.684392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315681+0000","last_change":"2023-08-27T11:23:49.312926+0000","last_active":"2023-08-27T11:23:49.315681+0000","last_peered":"2023-08-27T11:23:49.315681+0000","last_clean":"2023-08-27T11:23:49.315681+0000","last_became_active":"2023-08-27T11:23:49.312539+0000","last_became_peered":"2023-08-27T11:23:49.312539+0000","last_unstale":"2023-08-27T11:23:49.315681+0000","last_undegraded":"2023-08-27T11:23:49.315681+0000","last_fullsized":"2023-08-27T11:23:49.315681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:23.682423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292425+0000","last_change":"2023-08-27T11:23:48.283536+0000","last_active":"2023-08-27T11:23:50.292425+0000","last_peered":"2023-08-27T11:23:50.292425+0000","last_clean":"2023-08-27T11:23:50.292425+0000","last_became_active":"2023-08-27T11:23:48.282244+0000","last_became_peered":"2023-08-27T11:23:48.282244+0000","last_unstale":"2023-08-27T11:23:50.292425+0000","last_undegraded":"2023-08-27T11:23:50.292425+0000","last_fullsized":"2023-08-27T11:23:50.292425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:22.545843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292509+0000","last_change":"2023-08-27T11:23:49.298306+0000","last_active":"2023-08-27T11:23:50.292509+0000","last_peered":"2023-08-27T11:23:50.292509+0000","last_clean":"2023-08-27T11:23:50.292509+0000","last_became_active":"2023-08-27T11:23:49.297906+0000","last_became_peered":"2023-08-27T11:23:49.297906+0000","last_unstale":"2023-08-27T11:23:50.292509+0000","last_undegraded":"2023-08-27T11:23:50.292509+0000","last_fullsized":"2023-08-27T11:23:50.292509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:52.347231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325693+0000","last_change":"2023-08-27T11:23:48.283474+0000","last_active":"2023-08-27T11:23:49.325693+0000","last_peered":"2023-08-27T11:23:49.325693+0000","last_clean":"2023-08-27T11:23:49.325693+0000","last_became_active":"2023-08-27T11:23:48.283039+0000","last_became_peered":"2023-08-27T11:23:48.283039+0000","last_unstale":"2023-08-27T11:23:49.325693+0000","last_undegraded":"2023-08-27T11:23:49.325693+0000","last_fullsized":"2023-08-27T11:23:49.325693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:46:55.069920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306305+0000","last_change":"2023-08-27T11:23:49.296343+0000","last_active":"2023-08-27T11:23:49.306305+0000","last_peered":"2023-08-27T11:23:49.306305+0000","last_clean":"2023-08-27T11:23:49.306305+0000","last_became_active":"2023-08-27T11:23:49.296040+0000","last_became_peered":"2023-08-27T11:23:49.296040+0000","last_unstale":"2023-08-27T11:23:49.306305+0000","last_undegraded":"2023-08-27T11:23:49.306305+0000","last_fullsized":"2023-08-27T11:23:49.306305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:31.402876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290734+0000","last_change":"2023-08-27T11:23:48.284514+0000","last_active":"2023-08-27T11:23:49.290734+0000","last_peered":"2023-08-27T11:23:49.290734+0000","last_clean":"2023-08-27T11:23:49.290734+0000","last_became_active":"2023-08-27T11:23:48.284081+0000","last_became_peered":"2023-08-27T11:23:48.284081+0000","last_unstale":"2023-08-27T11:23:49.290734+0000","last_undegraded":"2023-08-27T11:23:49.290734+0000","last_fullsized":"2023-08-27T11:23:49.290734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:41.484365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292126+0000","last_change":"2023-08-27T11:23:49.307724+0000","last_active":"2023-08-27T11:23:50.292126+0000","last_peered":"2023-08-27T11:23:50.292126+0000","last_clean":"2023-08-27T11:23:50.292126+0000","last_became_active":"2023-08-27T11:23:49.307437+0000","last_became_peered":"2023-08-27T11:23:49.307437+0000","last_unstale":"2023-08-27T11:23:50.292126+0000","last_undegraded":"2023-08-27T11:23:50.292126+0000","last_fullsized":"2023-08-27T11:23:50.292126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:37:44.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324342+0000","last_change":"2023-08-27T11:23:48.275088+0000","last_active":"2023-08-27T11:23:49.324342+0000","last_peered":"2023-08-27T11:23:49.324342+0000","last_clean":"2023-08-27T11:23:49.324342+0000","last_became_active":"2023-08-27T11:23:48.274662+0000","last_became_peered":"2023-08-27T11:23:48.274662+0000","last_unstale":"2023-08-27T11:23:49.324342+0000","last_undegraded":"2023-08-27T11:23:49.324342+0000","last_fullsized":"2023-08-27T11:23:49.324342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:58:52.707309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308436+0000","last_change":"2023-08-27T11:23:49.304637+0000","last_active":"2023-08-27T11:23:49.308436+0000","last_peered":"2023-08-27T11:23:49.308436+0000","last_clean":"2023-08-27T11:23:49.308436+0000","last_became_active":"2023-08-27T11:23:49.304378+0000","last_became_peered":"2023-08-27T11:23:49.304378+0000","last_unstale":"2023-08-27T11:23:49.308436+0000","last_undegraded":"2023-08-27T11:23:49.308436+0000","last_fullsized":"2023-08-27T11:23:49.308436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.284953+0000","last_change":"2023-08-27T11:23:48.278562+0000","last_active":"2023-08-27T11:23:49.284953+0000","last_peered":"2023-08-27T11:23:49.284953+0000","last_clean":"2023-08-27T11:23:49.284953+0000","last_became_active":"2023-08-27T11:23:48.278184+0000","last_became_peered":"2023-08-27T11:23:48.278184+0000","last_unstale":"2023-08-27T11:23:49.284953+0000","last_undegraded":"2023-08-27T11:23:49.284953+0000","last_fullsized":"2023-08-27T11:23:49.284953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:48.198693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313458+0000","last_change":"2023-08-27T11:23:49.310089+0000","last_active":"2023-08-27T11:23:49.313458+0000","last_peered":"2023-08-27T11:23:49.313458+0000","last_clean":"2023-08-27T11:23:49.313458+0000","last_became_active":"2023-08-27T11:23:49.309694+0000","last_became_peered":"2023-08-27T11:23:49.309694+0000","last_unstale":"2023-08-27T11:23:49.313458+0000","last_undegraded":"2023-08-27T11:23:49.313458+0000","last_fullsized":"2023-08-27T11:23:49.313458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291723+0000","last_change":"2023-08-27T11:23:48.289101+0000","last_active":"2023-08-27T11:23:50.291723+0000","last_peered":"2023-08-27T11:23:50.291723+0000","last_clean":"2023-08-27T11:23:50.291723+0000","last_became_active":"2023-08-27T11:23:48.288729+0000","last_became_peered":"2023-08-27T11:23:48.288729+0000","last_unstale":"2023-08-27T11:23:50.291723+0000","last_undegraded":"2023-08-27T11:23:50.291723+0000","last_fullsized":"2023-08-27T11:23:50.291723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:19:44.075444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312773+0000","last_change":"2023-08-27T11:23:49.304560+0000","last_active":"2023-08-27T11:23:49.312773+0000","last_peered":"2023-08-27T11:23:49.312773+0000","last_clean":"2023-08-27T11:23:49.312773+0000","last_became_active":"2023-08-27T11:23:49.303805+0000","last_became_peered":"2023-08-27T11:23:49.303805+0000","last_unstale":"2023-08-27T11:23:49.312773+0000","last_undegraded":"2023-08-27T11:23:49.312773+0000","last_fullsized":"2023-08-27T11:23:49.312773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:23.464665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.284969+0000","last_change":"2023-08-27T11:23:48.272595+0000","last_active":"2023-08-27T11:23:49.284969+0000","last_peered":"2023-08-27T11:23:49.284969+0000","last_clean":"2023-08-27T11:23:49.284969+0000","last_became_active":"2023-08-27T11:23:48.272303+0000","last_became_peered":"2023-08-27T11:23:48.272303+0000","last_unstale":"2023-08-27T11:23:49.284969+0000","last_undegraded":"2023-08-27T11:23:49.284969+0000","last_fullsized":"2023-08-27T11:23:49.284969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:26.757047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292526+0000","last_change":"2023-08-27T11:23:49.300305+0000","last_active":"2023-08-27T11:23:50.292526+0000","last_peered":"2023-08-27T11:23:50.292526+0000","last_clean":"2023-08-27T11:23:50.292526+0000","last_became_active":"2023-08-27T11:23:49.299880+0000","last_became_peered":"2023-08-27T11:23:49.299880+0000","last_unstale":"2023-08-27T11:23:50.292526+0000","last_undegraded":"2023-08-27T11:23:50.292526+0000","last_fullsized":"2023-08-27T11:23:50.292526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:47.918472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292302+0000","last_change":"2023-08-27T11:23:48.277920+0000","last_active":"2023-08-27T11:23:50.292302+0000","last_peered":"2023-08-27T11:23:50.292302+0000","last_clean":"2023-08-27T11:23:50.292302+0000","last_became_active":"2023-08-27T11:23:48.277607+0000","last_became_peered":"2023-08-27T11:23:48.277607+0000","last_unstale":"2023-08-27T11:23:50.292302+0000","last_undegraded":"2023-08-27T11:23:50.292302+0000","last_fullsized":"2023-08-27T11:23:50.292302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:32.745200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292094+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:23:50.292094+0000","last_peered":"2023-08-27T11:23:50.292094+0000","last_clean":"2023-08-27T11:23:50.292094+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:23:50.292094+0000","last_undegraded":"2023-08-27T11:23:50.292094+0000","last_fullsized":"2023-08-27T11:23:50.292094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:55.851576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291718+0000","last_change":"2023-08-27T11:23:49.308202+0000","last_active":"2023-08-27T11:23:50.291718+0000","last_peered":"2023-08-27T11:23:50.291718+0000","last_clean":"2023-08-27T11:23:50.291718+0000","last_became_active":"2023-08-27T11:23:49.307887+0000","last_became_peered":"2023-08-27T11:23:49.307887+0000","last_unstale":"2023-08-27T11:23:50.291718+0000","last_undegraded":"2023-08-27T11:23:50.291718+0000","last_fullsized":"2023-08-27T11:23:50.291718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:23.912400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.289039+0000","last_change":"2023-08-27T11:23:48.271778+0000","last_active":"2023-08-27T11:23:49.289039+0000","last_peered":"2023-08-27T11:23:49.289039+0000","last_clean":"2023-08-27T11:23:49.289039+0000","last_became_active":"2023-08-27T11:23:48.271458+0000","last_became_peered":"2023-08-27T11:23:48.271458+0000","last_unstale":"2023-08-27T11:23:49.289039+0000","last_undegraded":"2023-08-27T11:23:49.289039+0000","last_fullsized":"2023-08-27T11:23:49.289039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:25.813965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.291701+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:23:49.291701+0000","last_peered":"2023-08-27T11:23:49.291701+0000","last_clean":"2023-08-27T11:23:49.291701+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:23:49.291701+0000","last_undegraded":"2023-08-27T11:23:49.291701+0000","last_fullsized":"2023-08-27T11:23:49.291701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:00.270092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.317718+0000","last_change":"2023-08-27T11:23:49.315044+0000","last_active":"2023-08-27T11:23:49.317718+0000","last_peered":"2023-08-27T11:23:49.317718+0000","last_clean":"2023-08-27T11:23:49.317718+0000","last_became_active":"2023-08-27T11:23:49.314671+0000","last_became_peered":"2023-08-27T11:23:49.314671+0000","last_unstale":"2023-08-27T11:23:49.317718+0000","last_undegraded":"2023-08-27T11:23:49.317718+0000","last_fullsized":"2023-08-27T11:23:49.317718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:09.275370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325770+0000","last_change":"2023-08-27T11:23:48.291101+0000","last_active":"2023-08-27T11:23:49.325770+0000","last_peered":"2023-08-27T11:23:49.325770+0000","last_clean":"2023-08-27T11:23:49.325770+0000","last_became_active":"2023-08-27T11:23:48.289497+0000","last_became_peered":"2023-08-27T11:23:48.289497+0000","last_unstale":"2023-08-27T11:23:49.325770+0000","last_undegraded":"2023-08-27T11:23:49.325770+0000","last_fullsized":"2023-08-27T11:23:49.325770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:11:56.377593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290375+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:23:49.290375+0000","last_peered":"2023-08-27T11:23:49.290375+0000","last_clean":"2023-08-27T11:23:49.290375+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:23:49.290375+0000","last_undegraded":"2023-08-27T11:23:49.290375+0000","last_fullsized":"2023-08-27T11:23:49.290375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:02.834152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292521+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:23:50.292521+0000","last_peered":"2023-08-27T11:23:50.292521+0000","last_clean":"2023-08-27T11:23:50.292521+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:23:50.292521+0000","last_undegraded":"2023-08-27T11:23:50.292521+0000","last_fullsized":"2023-08-27T11:23:50.292521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:59:57.970256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291624+0000","last_change":"2023-08-27T11:23:49.308352+0000","last_active":"2023-08-27T11:23:50.291624+0000","last_peered":"2023-08-27T11:23:50.291624+0000","last_clean":"2023-08-27T11:23:50.291624+0000","last_became_active":"2023-08-27T11:23:49.308056+0000","last_became_peered":"2023-08-27T11:23:49.308056+0000","last_unstale":"2023-08-27T11:23:50.291624+0000","last_undegraded":"2023-08-27T11:23:50.291624+0000","last_fullsized":"2023-08-27T11:23:50.291624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:16:08.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.285146+0000","last_change":"2023-08-27T11:23:48.289520+0000","last_active":"2023-08-27T11:23:49.285146+0000","last_peered":"2023-08-27T11:23:49.285146+0000","last_clean":"2023-08-27T11:23:49.285146+0000","last_became_active":"2023-08-27T11:23:48.289211+0000","last_became_peered":"2023-08-27T11:23:48.289211+0000","last_unstale":"2023-08-27T11:23:49.285146+0000","last_undegraded":"2023-08-27T11:23:49.285146+0000","last_fullsized":"2023-08-27T11:23:49.285146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:01.224180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291723+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:23:50.291723+0000","last_peered":"2023-08-27T11:23:50.291723+0000","last_clean":"2023-08-27T11:23:50.291723+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:23:50.291723+0000","last_undegraded":"2023-08-27T11:23:50.291723+0000","last_fullsized":"2023-08-27T11:23:50.291723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:10.927816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313199+0000","last_change":"2023-08-27T11:23:49.306665+0000","last_active":"2023-08-27T11:23:49.313199+0000","last_peered":"2023-08-27T11:23:49.313199+0000","last_clean":"2023-08-27T11:23:49.313199+0000","last_became_active":"2023-08-27T11:23:49.306390+0000","last_became_peered":"2023-08-27T11:23:49.306390+0000","last_unstale":"2023-08-27T11:23:49.313199+0000","last_undegraded":"2023-08-27T11:23:49.313199+0000","last_fullsized":"2023-08-27T11:23:49.313199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291583+0000","last_change":"2023-08-27T11:23:48.286998+0000","last_active":"2023-08-27T11:23:50.291583+0000","last_peered":"2023-08-27T11:23:50.291583+0000","last_clean":"2023-08-27T11:23:50.291583+0000","last_became_active":"2023-08-27T11:23:48.286681+0000","last_became_peered":"2023-08-27T11:23:48.286681+0000","last_unstale":"2023-08-27T11:23:50.291583+0000","last_undegraded":"2023-08-27T11:23:50.291583+0000","last_fullsized":"2023-08-27T11:23:50.291583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:43.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292379+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:23:50.292379+0000","last_peered":"2023-08-27T11:23:50.292379+0000","last_clean":"2023-08-27T11:23:50.292379+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:23:50.292379+0000","last_undegraded":"2023-08-27T11:23:50.292379+0000","last_fullsized":"2023-08-27T11:23:50.292379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:15:10.310069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.310699+0000","last_change":"2023-08-27T11:23:49.299222+0000","last_active":"2023-08-27T11:23:49.310699+0000","last_peered":"2023-08-27T11:23:49.310699+0000","last_clean":"2023-08-27T11:23:49.310699+0000","last_became_active":"2023-08-27T11:23:49.298835+0000","last_became_peered":"2023-08-27T11:23:49.298835+0000","last_unstale":"2023-08-27T11:23:49.310699+0000","last_undegraded":"2023-08-27T11:23:49.310699+0000","last_fullsized":"2023-08-27T11:23:49.310699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:28:51.450055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295918+0000","last_change":"2023-08-27T11:23:48.277098+0000","last_active":"2023-08-27T11:23:49.295918+0000","last_peered":"2023-08-27T11:23:49.295918+0000","last_clean":"2023-08-27T11:23:49.295918+0000","last_became_active":"2023-08-27T11:23:48.276781+0000","last_became_peered":"2023-08-27T11:23:48.276781+0000","last_unstale":"2023-08-27T11:23:49.295918+0000","last_undegraded":"2023-08-27T11:23:49.295918+0000","last_fullsized":"2023-08-27T11:23:49.295918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:12.565271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.299386+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:23:49.299386+0000","last_peered":"2023-08-27T11:23:49.299386+0000","last_clean":"2023-08-27T11:23:49.299386+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:23:49.299386+0000","last_undegraded":"2023-08-27T11:23:49.299386+0000","last_fullsized":"2023-08-27T11:23:49.299386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:29:01.226014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308399+0000","last_change":"2023-08-27T11:23:49.302727+0000","last_active":"2023-08-27T11:23:49.308399+0000","last_peered":"2023-08-27T11:23:49.308399+0000","last_clean":"2023-08-27T11:23:49.308399+0000","last_became_active":"2023-08-27T11:23:49.302425+0000","last_became_peered":"2023-08-27T11:23:49.302425+0000","last_unstale":"2023-08-27T11:23:49.308399+0000","last_undegraded":"2023-08-27T11:23:49.308399+0000","last_fullsized":"2023-08-27T11:23:49.308399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:47.130872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289760+0000","last_change":"2023-08-27T11:23:48.276589+0000","last_active":"2023-08-27T11:23:50.289760+0000","last_peered":"2023-08-27T11:23:50.289760+0000","last_clean":"2023-08-27T11:23:50.289760+0000","last_became_active":"2023-08-27T11:23:48.276313+0000","last_became_peered":"2023-08-27T11:23:48.276313+0000","last_unstale":"2023-08-27T11:23:50.289760+0000","last_undegraded":"2023-08-27T11:23:50.289760+0000","last_fullsized":"2023-08-27T11:23:50.289760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:09.747994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290204+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:23:50.290204+0000","last_peered":"2023-08-27T11:23:50.290204+0000","last_clean":"2023-08-27T11:23:50.290204+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:23:50.290204+0000","last_undegraded":"2023-08-27T11:23:50.290204+0000","last_fullsized":"2023-08-27T11:23:50.290204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:38.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308295+0000","last_change":"2023-08-27T11:23:49.304382+0000","last_active":"2023-08-27T11:23:49.308295+0000","last_peered":"2023-08-27T11:23:49.308295+0000","last_clean":"2023-08-27T11:23:49.308295+0000","last_became_active":"2023-08-27T11:23:49.304117+0000","last_became_peered":"2023-08-27T11:23:49.304117+0000","last_unstale":"2023-08-27T11:23:49.308295+0000","last_undegraded":"2023-08-27T11:23:49.308295+0000","last_fullsized":"2023-08-27T11:23:49.308295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295462+0000","last_change":"2023-08-27T11:23:48.280893+0000","last_active":"2023-08-27T11:23:49.295462+0000","last_peered":"2023-08-27T11:23:49.295462+0000","last_clean":"2023-08-27T11:23:49.295462+0000","last_became_active":"2023-08-27T11:23:48.280566+0000","last_became_peered":"2023-08-27T11:23:48.280566+0000","last_unstale":"2023-08-27T11:23:49.295462+0000","last_undegraded":"2023-08-27T11:23:49.295462+0000","last_fullsized":"2023-08-27T11:23:49.295462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:16:16.035123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290478+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:23:50.290478+0000","last_peered":"2023-08-27T11:23:50.290478+0000","last_clean":"2023-08-27T11:23:50.290478+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:23:50.290478+0000","last_undegraded":"2023-08-27T11:23:50.290478+0000","last_fullsized":"2023-08-27T11:23:50.290478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:15:04.695867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":744978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.747}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":152524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5419999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.622}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.5920000000000005,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":7.4850000000000003,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.69799999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.91100000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":743386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.621}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.87}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.04}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":151976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.438},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":152998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.99299999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.76800000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.88600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.4249999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.498},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.5700000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.4699999999999998,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.77300000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5,"5min":5,"15min":5},"last":0.877},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.86199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":153532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66900000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.746}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79900000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.82199999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":152054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.78000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.84899999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:23:53.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:23:53.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.997+0000 7fd28e1ff700 1 Processor -- start 2023-08-27T11:23:53.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.997+0000 7fd28e1ff700 1 -- start start 2023-08-27T11:23:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.998+0000 7fd28e1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd28806a310 0x7fd28806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.998+0000 7fd28e1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd288158190 0x7fd28815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.998+0000 7fd28e1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2880c6820 con 0x7fd28806e360 2023-08-27T11:23:54.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.998+0000 7fd28e1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2880c23a0 con 0x7fd288158190 2023-08-27T11:23:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.998+0000 7fd28e1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2881548c0 con 0x7fd28806a310 2023-08-27T11:23:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd286ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd28806e360 0x7fd288157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42520/0 (socket says 172.21.15.43:42520) 2023-08-27T11:23:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd286ffd700 1 -- 172.21.15.43:0/1536246098 learned_addr learned my addr 172.21.15.43:0/1536246098 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:54.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 --2- 172.21.15.43:0/1536246098 >> v2:172.21.15.43:3300/0 conn(0x7fd288158190 0x7fd28815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd2877fe700 1 --2- 172.21.15.43:0/1536246098 >> v2:172.21.15.57:3300/0 conn(0x7fd28806a310 0x7fd28806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd2867fc700 1 -- 172.21.15.43:0/1536246098 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599115326 0 0) 0x7fd2880c6820 con 0x7fd28806e360 2023-08-27T11:23:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd2867fc700 1 -- 172.21.15.43:0/1536246098 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2700035b0 con 0x7fd28806e360 2023-08-27T11:23:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 -- 172.21.15.43:0/1536246098 >> v2:172.21.15.57:3300/0 conn(0x7fd28806a310 msgr2=0x7fd28806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 --2- 172.21.15.43:0/1536246098 >> v2:172.21.15.57:3300/0 conn(0x7fd28806a310 0x7fd28806a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 -- 172.21.15.43:0/1536246098 >> v1:172.21.15.43:6789/0 conn(0x7fd28806e360 legacy=0x7fd288157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 -- 172.21.15.43:0/1536246098 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880c4a50 con 0x7fd288158190 2023-08-27T11:23:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:53.999+0000 7fd287fff700 1 --2- 172.21.15.43:0/1536246098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd288158190 0x7fd28815ee10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd28806b3f0 tx=0x7fd28000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4f69cbb0185abd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd2867fc700 1 -- 172.21.15.43:0/1536246098 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000e070 con 0x7fd288158190 2023-08-27T11:23:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd2867fc700 1 -- 172.21.15.43:0/1536246098 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000bb20 con 0x7fd288158190 2023-08-27T11:23:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd2867fc700 1 -- 172.21.15.43:0/1536246098 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280012430 con 0x7fd288158190 2023-08-27T11:23:54.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1536246098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd288158190 msgr2=0x7fd28815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1536246098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd288158190 0x7fd28815ee10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd28806b3f0 tx=0x7fd28000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1536246098 shutdown_connections 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1536246098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd288158190 0x7fd28815ee10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1536246098 >> v2:172.21.15.57:3300/0 conn(0x7fd28806a310 0x7fd28806a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1536246098 >> 172.21.15.43:0/1536246098 conn(0x7fd2880a85e0 msgr2=0x7fd2880a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:54.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1536246098 shutdown_connections 2023-08-27T11:23:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.000+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1536246098 wait complete. 2023-08-27T11:23:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.002+0000 7fd28e1ff700 1 Processor -- start 2023-08-27T11:23:54.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.002+0000 7fd28e1ff700 1 -- start start 2023-08-27T11:23:54.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd28806a310 0x7fd2880c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd288158190 0x7fd288150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2880be8c0 con 0x7fd28806e360 2023-08-27T11:23:54.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd288150f50 con 0x7fd28806a310 2023-08-27T11:23:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.003+0000 7fd28e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2881ed6e0 con 0x7fd288158190 2023-08-27T11:23:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37152/0 (socket says 172.21.15.43:37152) 2023-08-27T11:23:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 -- 172.21.15.43:0/1108257808 learned_addr learned my addr 172.21.15.43:0/1108257808 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:54.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd287fff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd288158190 0x7fd288150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd2877fe700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd28806a310 0x7fd2880c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 -- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd288158190 msgr2=0x7fd288150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd288158190 0x7fd288150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 -- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd28806a310 msgr2=0x7fd2880c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd28806a310 0x7fd2880c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 -- 172.21.15.43:0/1108257808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280009a70 con 0x7fd28806e360 2023-08-27T11:23:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd286ffd700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c700 tx=0x7fd27c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c005d70 con 0x7fd28806e360 2023-08-27T11:23:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0070d0 con 0x7fd28806e360 2023-08-27T11:23:54.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.004+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c007460 con 0x7fd28806e360 2023-08-27T11:23:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.005+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2881ed400 con 0x7fd28806e360 2023-08-27T11:23:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.005+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2880be550 con 0x7fd28806e360 2023-08-27T11:23:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.006+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28804ee70 con 0x7fd28806e360 2023-08-27T11:23:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.007+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd27c0075c0 con 0x7fd28806e360 2023-08-27T11:23:54.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.008+0000 7fd26ffff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.008+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd27c087a40 con 0x7fd28806e360 2023-08-27T11:23:54.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.008+0000 7fd2877fe700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.009+0000 7fd2877fe700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 0x7fd27406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd278009b70 tx=0x7fd278008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.012+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd27c089e60 con 0x7fd28806e360 2023-08-27T11:23:54.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.217+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2880c5010 con 0x7fd27406a0e0 2023-08-27T11:23:54.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.228+0000 7fd26ffff700 1 -- 172.21.15.43:0/1108257808 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311594 (secure 0 0 0) 0x7fd2780117b0 con 0x7fd27406a0e0 2023-08-27T11:23:54.233 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:54.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 msgr2=0x7fd27406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 0x7fd27406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd278009b70 tx=0x7fd278008040 comp rx=0 tx=0).stop 2023-08-27T11:23:54.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 msgr2=0x7fd2881504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c700 tx=0x7fd27c00ca10 comp rx=0 tx=0).stop 2023-08-27T11:23:54.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 shutdown_connections 2023-08-27T11:23:54.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd27406a0e0 0x7fd27406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd288158190 0x7fd288150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd28806a310 0x7fd2880c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 --2- 172.21.15.43:0/1108257808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd28806e360 0x7fd2881504d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 >> 172.21.15.43:0/1108257808 conn(0x7fd2880a85e0 msgr2=0x7fd2880a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:54.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 shutdown_connections 2023-08-27T11:23:54.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.232+0000 7fd28e1ff700 1 -- 172.21.15.43:0/1108257808 wait complete. 2023-08-27T11:23:54.239 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:23:54.251 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-08-27T11:23:52.327343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220304,"kb_used_data":4120,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754416,"statfs":{"total":773094113280,"available":772868521984,"internally_reserved":0,"allocated":4218880,"data_stored":2405036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.071597"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312408+0000","last_change":"2023-08-27T11:23:49.304211+0000","last_active":"2023-08-27T11:23:49.312408+0000","last_peered":"2023-08-27T11:23:49.312408+0000","last_clean":"2023-08-27T11:23:49.312408+0000","last_became_active":"2023-08-27T11:23:49.303898+0000","last_became_peered":"2023-08-27T11:23:49.303898+0000","last_unstale":"2023-08-27T11:23:49.312408+0000","last_undegraded":"2023-08-27T11:23:49.312408+0000","last_fullsized":"2023-08-27T11:23:49.312408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:13.213841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.310678+0000","last_change":"2023-08-27T11:23:49.298797+0000","last_active":"2023-08-27T11:23:49.310678+0000","last_peered":"2023-08-27T11:23:49.310678+0000","last_clean":"2023-08-27T11:23:49.310678+0000","last_became_active":"2023-08-27T11:23:49.298354+0000","last_became_peered":"2023-08-27T11:23:49.298354+0000","last_unstale":"2023-08-27T11:23:49.310678+0000","last_undegraded":"2023-08-27T11:23:49.310678+0000","last_fullsized":"2023-08-27T11:23:49.310678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:51.436036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314834+0000","last_change":"2023-08-27T11:23:49.311688+0000","last_active":"2023-08-27T11:23:49.314834+0000","last_peered":"2023-08-27T11:23:49.314834+0000","last_clean":"2023-08-27T11:23:49.314834+0000","last_became_active":"2023-08-27T11:23:49.311364+0000","last_became_peered":"2023-08-27T11:23:49.311364+0000","last_unstale":"2023-08-27T11:23:49.314834+0000","last_undegraded":"2023-08-27T11:23:49.314834+0000","last_fullsized":"2023-08-27T11:23:49.314834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:23.682423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306021+0000","last_change":"2023-08-27T11:23:49.293788+0000","last_active":"2023-08-27T11:23:49.306021+0000","last_peered":"2023-08-27T11:23:49.306021+0000","last_clean":"2023-08-27T11:23:49.306021+0000","last_became_active":"2023-08-27T11:23:49.292968+0000","last_became_peered":"2023-08-27T11:23:49.292968+0000","last_unstale":"2023-08-27T11:23:49.306021+0000","last_undegraded":"2023-08-27T11:23:49.306021+0000","last_fullsized":"2023-08-27T11:23:49.306021+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:35:36.132892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.301723+0000","last_change":"2023-08-27T11:23:49.293320+0000","last_active":"2023-08-27T11:23:49.301723+0000","last_peered":"2023-08-27T11:23:49.301723+0000","last_clean":"2023-08-27T11:23:49.301723+0000","last_became_active":"2023-08-27T11:23:49.293035+0000","last_became_peered":"2023-08-27T11:23:49.293035+0000","last_unstale":"2023-08-27T11:23:49.301723+0000","last_undegraded":"2023-08-27T11:23:49.301723+0000","last_fullsized":"2023-08-27T11:23:49.301723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:01:40.154127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308458+0000","last_change":"2023-08-27T11:23:49.305864+0000","last_active":"2023-08-27T11:23:49.308458+0000","last_peered":"2023-08-27T11:23:49.308458+0000","last_clean":"2023-08-27T11:23:49.308458+0000","last_became_active":"2023-08-27T11:23:49.305568+0000","last_became_peered":"2023-08-27T11:23:49.305568+0000","last_unstale":"2023-08-27T11:23:49.308458+0000","last_undegraded":"2023-08-27T11:23:49.308458+0000","last_fullsized":"2023-08-27T11:23:49.308458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:41.715892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313297+0000","last_change":"2023-08-27T11:23:49.306881+0000","last_active":"2023-08-27T11:23:49.313297+0000","last_peered":"2023-08-27T11:23:49.313297+0000","last_clean":"2023-08-27T11:23:49.313297+0000","last_became_active":"2023-08-27T11:23:49.306227+0000","last_became_peered":"2023-08-27T11:23:49.306227+0000","last_unstale":"2023-08-27T11:23:49.313297+0000","last_undegraded":"2023-08-27T11:23:49.313297+0000","last_fullsized":"2023-08-27T11:23:49.313297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:38.600303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316703+0000","last_change":"2023-08-27T11:23:49.309640+0000","last_active":"2023-08-27T11:23:49.316703+0000","last_peered":"2023-08-27T11:23:49.316703+0000","last_clean":"2023-08-27T11:23:49.316703+0000","last_became_active":"2023-08-27T11:23:49.309409+0000","last_became_peered":"2023-08-27T11:23:49.309409+0000","last_unstale":"2023-08-27T11:23:49.316703+0000","last_undegraded":"2023-08-27T11:23:49.316703+0000","last_fullsized":"2023-08-27T11:23:49.316703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:25:04.269139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314199+0000","last_change":"2023-08-27T11:23:49.311763+0000","last_active":"2023-08-27T11:23:49.314199+0000","last_peered":"2023-08-27T11:23:49.314199+0000","last_clean":"2023-08-27T11:23:49.314199+0000","last_became_active":"2023-08-27T11:23:49.311480+0000","last_became_peered":"2023-08-27T11:23:49.311480+0000","last_unstale":"2023-08-27T11:23:49.314199+0000","last_undegraded":"2023-08-27T11:23:49.314199+0000","last_fullsized":"2023-08-27T11:23:49.314199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316084+0000","last_change":"2023-08-27T11:23:49.311775+0000","last_active":"2023-08-27T11:23:49.316084+0000","last_peered":"2023-08-27T11:23:49.316084+0000","last_clean":"2023-08-27T11:23:49.316084+0000","last_became_active":"2023-08-27T11:23:49.311459+0000","last_became_peered":"2023-08-27T11:23:49.311459+0000","last_unstale":"2023-08-27T11:23:49.316084+0000","last_undegraded":"2023-08-27T11:23:49.316084+0000","last_fullsized":"2023-08-27T11:23:49.316084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:50.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315546+0000","last_change":"2023-08-27T11:23:49.311227+0000","last_active":"2023-08-27T11:23:49.315546+0000","last_peered":"2023-08-27T11:23:49.315546+0000","last_clean":"2023-08-27T11:23:49.315546+0000","last_became_active":"2023-08-27T11:23:49.310094+0000","last_became_peered":"2023-08-27T11:23:49.310094+0000","last_unstale":"2023-08-27T11:23:49.315546+0000","last_undegraded":"2023-08-27T11:23:49.315546+0000","last_fullsized":"2023-08-27T11:23:49.315546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.309190+0000","last_change":"2023-08-27T11:23:49.307653+0000","last_active":"2023-08-27T11:23:49.309190+0000","last_peered":"2023-08-27T11:23:49.309190+0000","last_clean":"2023-08-27T11:23:49.309190+0000","last_became_active":"2023-08-27T11:23:49.307315+0000","last_became_peered":"2023-08-27T11:23:49.307315+0000","last_unstale":"2023-08-27T11:23:49.309190+0000","last_undegraded":"2023-08-27T11:23:49.309190+0000","last_fullsized":"2023-08-27T11:23:49.309190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:10.757295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314011+0000","last_change":"2023-08-27T11:23:49.310845+0000","last_active":"2023-08-27T11:23:49.314011+0000","last_peered":"2023-08-27T11:23:49.314011+0000","last_clean":"2023-08-27T11:23:49.314011+0000","last_became_active":"2023-08-27T11:23:49.310551+0000","last_became_peered":"2023-08-27T11:23:49.310551+0000","last_unstale":"2023-08-27T11:23:49.314011+0000","last_undegraded":"2023-08-27T11:23:49.314011+0000","last_fullsized":"2023-08-27T11:23:49.314011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:34.229781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292071+0000","last_change":"2023-08-27T11:23:49.296042+0000","last_active":"2023-08-27T11:23:50.292071+0000","last_peered":"2023-08-27T11:23:50.292071+0000","last_clean":"2023-08-27T11:23:50.292071+0000","last_became_active":"2023-08-27T11:23:49.295734+0000","last_became_peered":"2023-08-27T11:23:49.295734+0000","last_unstale":"2023-08-27T11:23:50.292071+0000","last_undegraded":"2023-08-27T11:23:50.292071+0000","last_fullsized":"2023-08-27T11:23:50.292071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:46.869454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313317+0000","last_change":"2023-08-27T11:23:49.307077+0000","last_active":"2023-08-27T11:23:49.313317+0000","last_peered":"2023-08-27T11:23:49.313317+0000","last_clean":"2023-08-27T11:23:49.313317+0000","last_became_active":"2023-08-27T11:23:49.306597+0000","last_became_peered":"2023-08-27T11:23:49.306597+0000","last_unstale":"2023-08-27T11:23:49.313317+0000","last_undegraded":"2023-08-27T11:23:49.313317+0000","last_fullsized":"2023-08-27T11:23:49.313317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292640+0000","last_change":"2023-08-27T11:23:49.314492+0000","last_active":"2023-08-27T11:23:50.292640+0000","last_peered":"2023-08-27T11:23:50.292640+0000","last_clean":"2023-08-27T11:23:50.292640+0000","last_became_active":"2023-08-27T11:23:49.314211+0000","last_became_peered":"2023-08-27T11:23:49.314211+0000","last_unstale":"2023-08-27T11:23:50.292640+0000","last_undegraded":"2023-08-27T11:23:50.292640+0000","last_fullsized":"2023-08-27T11:23:50.292640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:19:12.618649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291504+0000","last_change":"2023-08-27T11:23:49.314159+0000","last_active":"2023-08-27T11:23:50.291504+0000","last_peered":"2023-08-27T11:23:50.291504+0000","last_clean":"2023-08-27T11:23:50.291504+0000","last_became_active":"2023-08-27T11:23:49.313836+0000","last_became_peered":"2023-08-27T11:23:49.313836+0000","last_unstale":"2023-08-27T11:23:50.291504+0000","last_undegraded":"2023-08-27T11:23:50.291504+0000","last_fullsized":"2023-08-27T11:23:50.291504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:39.604913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290230+0000","last_change":"2023-08-27T11:23:49.305196+0000","last_active":"2023-08-27T11:23:50.290230+0000","last_peered":"2023-08-27T11:23:50.290230+0000","last_clean":"2023-08-27T11:23:50.290230+0000","last_became_active":"2023-08-27T11:23:49.304788+0000","last_became_peered":"2023-08-27T11:23:49.304788+0000","last_unstale":"2023-08-27T11:23:50.290230+0000","last_undegraded":"2023-08-27T11:23:50.290230+0000","last_fullsized":"2023-08-27T11:23:50.290230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:30.919770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306254+0000","last_change":"2023-08-27T11:23:49.296809+0000","last_active":"2023-08-27T11:23:49.306254+0000","last_peered":"2023-08-27T11:23:49.306254+0000","last_clean":"2023-08-27T11:23:49.306254+0000","last_became_active":"2023-08-27T11:23:49.296516+0000","last_became_peered":"2023-08-27T11:23:49.296516+0000","last_unstale":"2023-08-27T11:23:49.306254+0000","last_undegraded":"2023-08-27T11:23:49.306254+0000","last_fullsized":"2023-08-27T11:23:49.306254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:40:44.212767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289905+0000","last_change":"2023-08-27T11:23:49.300731+0000","last_active":"2023-08-27T11:23:50.289905+0000","last_peered":"2023-08-27T11:23:50.289905+0000","last_clean":"2023-08-27T11:23:50.289905+0000","last_became_active":"2023-08-27T11:23:49.300360+0000","last_became_peered":"2023-08-27T11:23:49.300360+0000","last_unstale":"2023-08-27T11:23:50.289905+0000","last_undegraded":"2023-08-27T11:23:50.289905+0000","last_fullsized":"2023-08-27T11:23:50.289905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.322976+0000","last_change":"2023-08-27T11:23:49.315732+0000","last_active":"2023-08-27T11:23:49.322976+0000","last_peered":"2023-08-27T11:23:49.322976+0000","last_clean":"2023-08-27T11:23:49.322976+0000","last_became_active":"2023-08-27T11:23:49.315457+0000","last_became_peered":"2023-08-27T11:23:49.315457+0000","last_unstale":"2023-08-27T11:23:49.322976+0000","last_undegraded":"2023-08-27T11:23:49.322976+0000","last_fullsized":"2023-08-27T11:23:49.322976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:16:17.044424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292149+0000","last_change":"2023-08-27T11:23:49.301802+0000","last_active":"2023-08-27T11:23:50.292149+0000","last_peered":"2023-08-27T11:23:50.292149+0000","last_clean":"2023-08-27T11:23:50.292149+0000","last_became_active":"2023-08-27T11:23:49.301495+0000","last_became_peered":"2023-08-27T11:23:49.301495+0000","last_unstale":"2023-08-27T11:23:50.292149+0000","last_undegraded":"2023-08-27T11:23:50.292149+0000","last_fullsized":"2023-08-27T11:23:50.292149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:22.659339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291708+0000","last_change":"2023-08-27T11:23:49.310734+0000","last_active":"2023-08-27T11:23:50.291708+0000","last_peered":"2023-08-27T11:23:50.291708+0000","last_clean":"2023-08-27T11:23:50.291708+0000","last_became_active":"2023-08-27T11:23:49.310436+0000","last_became_peered":"2023-08-27T11:23:49.310436+0000","last_unstale":"2023-08-27T11:23:50.291708+0000","last_undegraded":"2023-08-27T11:23:50.291708+0000","last_fullsized":"2023-08-27T11:23:50.291708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:44:19.487589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.317736+0000","last_change":"2023-08-27T11:23:49.305758+0000","last_active":"2023-08-27T11:23:49.317736+0000","last_peered":"2023-08-27T11:23:49.317736+0000","last_clean":"2023-08-27T11:23:49.317736+0000","last_became_active":"2023-08-27T11:23:49.305473+0000","last_became_peered":"2023-08-27T11:23:49.305473+0000","last_unstale":"2023-08-27T11:23:49.317736+0000","last_undegraded":"2023-08-27T11:23:49.317736+0000","last_fullsized":"2023-08-27T11:23:49.317736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:29.603334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290394+0000","last_change":"2023-08-27T11:23:49.302496+0000","last_active":"2023-08-27T11:23:50.290394+0000","last_peered":"2023-08-27T11:23:50.290394+0000","last_clean":"2023-08-27T11:23:50.290394+0000","last_became_active":"2023-08-27T11:23:49.302171+0000","last_became_peered":"2023-08-27T11:23:49.302171+0000","last_unstale":"2023-08-27T11:23:50.290394+0000","last_undegraded":"2023-08-27T11:23:50.290394+0000","last_fullsized":"2023-08-27T11:23:50.290394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.316658+0000","last_change":"2023-08-27T11:23:49.313528+0000","last_active":"2023-08-27T11:23:49.316658+0000","last_peered":"2023-08-27T11:23:49.316658+0000","last_clean":"2023-08-27T11:23:49.316658+0000","last_became_active":"2023-08-27T11:23:49.313164+0000","last_became_peered":"2023-08-27T11:23:49.313164+0000","last_unstale":"2023-08-27T11:23:49.316658+0000","last_undegraded":"2023-08-27T11:23:49.316658+0000","last_fullsized":"2023-08-27T11:23:49.316658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:14.991184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290057+0000","last_change":"2023-08-27T11:23:49.305728+0000","last_active":"2023-08-27T11:23:50.290057+0000","last_peered":"2023-08-27T11:23:50.290057+0000","last_clean":"2023-08-27T11:23:50.290057+0000","last_became_active":"2023-08-27T11:23:49.305458+0000","last_became_peered":"2023-08-27T11:23:49.305458+0000","last_unstale":"2023-08-27T11:23:50.290057+0000","last_undegraded":"2023-08-27T11:23:50.290057+0000","last_fullsized":"2023-08-27T11:23:50.290057+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313371+0000","last_change":"2023-08-27T11:23:49.307996+0000","last_active":"2023-08-27T11:23:49.313371+0000","last_peered":"2023-08-27T11:23:49.313371+0000","last_clean":"2023-08-27T11:23:49.313371+0000","last_became_active":"2023-08-27T11:23:49.307723+0000","last_became_peered":"2023-08-27T11:23:49.307723+0000","last_unstale":"2023-08-27T11:23:49.313371+0000","last_undegraded":"2023-08-27T11:23:49.313371+0000","last_fullsized":"2023-08-27T11:23:49.313371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:10.757295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289731+0000","last_change":"2023-08-27T11:23:49.297762+0000","last_active":"2023-08-27T11:23:50.289731+0000","last_peered":"2023-08-27T11:23:50.289731+0000","last_clean":"2023-08-27T11:23:50.289731+0000","last_became_active":"2023-08-27T11:23:49.297443+0000","last_became_peered":"2023-08-27T11:23:49.297443+0000","last_unstale":"2023-08-27T11:23:50.289731+0000","last_undegraded":"2023-08-27T11:23:50.289731+0000","last_fullsized":"2023-08-27T11:23:50.289731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289632+0000","last_change":"2023-08-27T11:23:49.311450+0000","last_active":"2023-08-27T11:23:50.289632+0000","last_peered":"2023-08-27T11:23:50.289632+0000","last_clean":"2023-08-27T11:23:50.289632+0000","last_became_active":"2023-08-27T11:23:49.311164+0000","last_became_peered":"2023-08-27T11:23:49.311164+0000","last_unstale":"2023-08-27T11:23:50.289632+0000","last_undegraded":"2023-08-27T11:23:50.289632+0000","last_fullsized":"2023-08-27T11:23:50.289632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:38.600303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291436+0000","last_change":"2023-08-27T11:23:49.309341+0000","last_active":"2023-08-27T11:23:50.291436+0000","last_peered":"2023-08-27T11:23:50.291436+0000","last_clean":"2023-08-27T11:23:50.291436+0000","last_became_active":"2023-08-27T11:23:49.309048+0000","last_became_peered":"2023-08-27T11:23:49.309048+0000","last_unstale":"2023-08-27T11:23:50.291436+0000","last_undegraded":"2023-08-27T11:23:50.291436+0000","last_fullsized":"2023-08-27T11:23:50.291436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:36.861220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313505+0000","last_change":"2023-08-27T11:23:49.302517+0000","last_active":"2023-08-27T11:23:49.313505+0000","last_peered":"2023-08-27T11:23:49.313505+0000","last_clean":"2023-08-27T11:23:49.313505+0000","last_became_active":"2023-08-27T11:23:49.302099+0000","last_became_peered":"2023-08-27T11:23:49.302099+0000","last_unstale":"2023-08-27T11:23:49.313505+0000","last_undegraded":"2023-08-27T11:23:49.313505+0000","last_fullsized":"2023-08-27T11:23:49.313505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:57:26.763261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291474+0000","last_change":"2023-08-27T11:23:49.314175+0000","last_active":"2023-08-27T11:23:50.291474+0000","last_peered":"2023-08-27T11:23:50.291474+0000","last_clean":"2023-08-27T11:23:50.291474+0000","last_became_active":"2023-08-27T11:23:49.313889+0000","last_became_peered":"2023-08-27T11:23:49.313889+0000","last_unstale":"2023-08-27T11:23:50.291474+0000","last_undegraded":"2023-08-27T11:23:50.291474+0000","last_fullsized":"2023-08-27T11:23:50.291474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:56:37.369321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290407+0000","last_change":"2023-08-27T11:23:48.277675+0000","last_active":"2023-08-27T11:23:50.290407+0000","last_peered":"2023-08-27T11:23:50.290407+0000","last_clean":"2023-08-27T11:23:50.290407+0000","last_became_active":"2023-08-27T11:23:48.277388+0000","last_became_peered":"2023-08-27T11:23:48.277388+0000","last_unstale":"2023-08-27T11:23:50.290407+0000","last_undegraded":"2023-08-27T11:23:50.290407+0000","last_fullsized":"2023-08-27T11:23:50.290407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:33.220480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.322361+0000","last_change":"2023-08-27T11:23:49.315119+0000","last_active":"2023-08-27T11:23:49.322361+0000","last_peered":"2023-08-27T11:23:49.322361+0000","last_clean":"2023-08-27T11:23:49.322361+0000","last_became_active":"2023-08-27T11:23:49.314764+0000","last_became_peered":"2023-08-27T11:23:49.314764+0000","last_unstale":"2023-08-27T11:23:49.322361+0000","last_undegraded":"2023-08-27T11:23:49.322361+0000","last_fullsized":"2023-08-27T11:23:49.322361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:24:35.422197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324849+0000","last_change":"2023-08-27T11:23:48.287052+0000","last_active":"2023-08-27T11:23:49.324849+0000","last_peered":"2023-08-27T11:23:49.324849+0000","last_clean":"2023-08-27T11:23:49.324849+0000","last_became_active":"2023-08-27T11:23:48.286780+0000","last_became_peered":"2023-08-27T11:23:48.286780+0000","last_unstale":"2023-08-27T11:23:49.324849+0000","last_undegraded":"2023-08-27T11:23:49.324849+0000","last_fullsized":"2023-08-27T11:23:49.324849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:33.220480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292216+0000","last_change":"2023-08-27T11:23:49.294464+0000","last_active":"2023-08-27T11:23:50.292216+0000","last_peered":"2023-08-27T11:23:50.292216+0000","last_clean":"2023-08-27T11:23:50.292216+0000","last_became_active":"2023-08-27T11:23:49.294160+0000","last_became_peered":"2023-08-27T11:23:49.294160+0000","last_unstale":"2023-08-27T11:23:50.292216+0000","last_undegraded":"2023-08-27T11:23:50.292216+0000","last_fullsized":"2023-08-27T11:23:50.292216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:07:50.064209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.326205+0000","last_change":"2023-08-27T11:23:48.285419+0000","last_active":"2023-08-27T11:23:49.326205+0000","last_peered":"2023-08-27T11:23:49.326205+0000","last_clean":"2023-08-27T11:23:49.326205+0000","last_became_active":"2023-08-27T11:23:48.285069+0000","last_became_peered":"2023-08-27T11:23:48.285069+0000","last_unstale":"2023-08-27T11:23:49.326205+0000","last_undegraded":"2023-08-27T11:23:49.326205+0000","last_fullsized":"2023-08-27T11:23:49.326205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:37.591003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312385+0000","last_change":"2023-08-27T11:23:49.303421+0000","last_active":"2023-08-27T11:23:49.312385+0000","last_peered":"2023-08-27T11:23:49.312385+0000","last_clean":"2023-08-27T11:23:49.312385+0000","last_became_active":"2023-08-27T11:23:49.303052+0000","last_became_peered":"2023-08-27T11:23:49.303052+0000","last_unstale":"2023-08-27T11:23:49.312385+0000","last_undegraded":"2023-08-27T11:23:49.312385+0000","last_fullsized":"2023-08-27T11:23:49.312385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:07.452206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292715+0000","last_change":"2023-08-27T11:23:48.278058+0000","last_active":"2023-08-27T11:23:50.292715+0000","last_peered":"2023-08-27T11:23:50.292715+0000","last_clean":"2023-08-27T11:23:50.292715+0000","last_became_active":"2023-08-27T11:23:48.277745+0000","last_became_peered":"2023-08-27T11:23:48.277745+0000","last_unstale":"2023-08-27T11:23:50.292715+0000","last_undegraded":"2023-08-27T11:23:50.292715+0000","last_fullsized":"2023-08-27T11:23:50.292715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:57:13.208813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308319+0000","last_change":"2023-08-27T11:23:49.305635+0000","last_active":"2023-08-27T11:23:49.308319+0000","last_peered":"2023-08-27T11:23:49.308319+0000","last_clean":"2023-08-27T11:23:49.308319+0000","last_became_active":"2023-08-27T11:23:49.305245+0000","last_became_peered":"2023-08-27T11:23:49.305245+0000","last_unstale":"2023-08-27T11:23:49.308319+0000","last_undegraded":"2023-08-27T11:23:49.308319+0000","last_fullsized":"2023-08-27T11:23:49.308319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324859+0000","last_change":"2023-08-27T11:23:48.290484+0000","last_active":"2023-08-27T11:23:49.324859+0000","last_peered":"2023-08-27T11:23:49.324859+0000","last_clean":"2023-08-27T11:23:49.324859+0000","last_became_active":"2023-08-27T11:23:48.289311+0000","last_became_peered":"2023-08-27T11:23:48.289311+0000","last_unstale":"2023-08-27T11:23:49.324859+0000","last_undegraded":"2023-08-27T11:23:49.324859+0000","last_fullsized":"2023-08-27T11:23:49.324859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:23.936708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313333+0000","last_change":"2023-08-27T11:23:49.309504+0000","last_active":"2023-08-27T11:23:49.313333+0000","last_peered":"2023-08-27T11:23:49.313333+0000","last_clean":"2023-08-27T11:23:49.313333+0000","last_became_active":"2023-08-27T11:23:49.309089+0000","last_became_peered":"2023-08-27T11:23:49.309089+0000","last_unstale":"2023-08-27T11:23:49.313333+0000","last_undegraded":"2023-08-27T11:23:49.313333+0000","last_fullsized":"2023-08-27T11:23:49.313333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291923+0000","last_change":"2023-08-27T11:23:48.287570+0000","last_active":"2023-08-27T11:23:50.291923+0000","last_peered":"2023-08-27T11:23:50.291923+0000","last_clean":"2023-08-27T11:23:50.291923+0000","last_became_active":"2023-08-27T11:23:48.287262+0000","last_became_peered":"2023-08-27T11:23:48.287262+0000","last_unstale":"2023-08-27T11:23:50.291923+0000","last_undegraded":"2023-08-27T11:23:50.291923+0000","last_fullsized":"2023-08-27T11:23:50.291923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:26:32.034693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292342+0000","last_change":"2023-08-27T11:23:49.313004+0000","last_active":"2023-08-27T11:23:50.292342+0000","last_peered":"2023-08-27T11:23:50.292342+0000","last_clean":"2023-08-27T11:23:50.292342+0000","last_became_active":"2023-08-27T11:23:49.312554+0000","last_became_peered":"2023-08-27T11:23:49.312554+0000","last_unstale":"2023-08-27T11:23:50.292342+0000","last_undegraded":"2023-08-27T11:23:50.292342+0000","last_fullsized":"2023-08-27T11:23:50.292342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:11:03.741312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290645+0000","last_change":"2023-08-27T11:23:48.285133+0000","last_active":"2023-08-27T11:23:49.290645+0000","last_peered":"2023-08-27T11:23:49.290645+0000","last_clean":"2023-08-27T11:23:49.290645+0000","last_became_active":"2023-08-27T11:23:48.284833+0000","last_became_peered":"2023-08-27T11:23:48.284833+0000","last_unstale":"2023-08-27T11:23:49.290645+0000","last_undegraded":"2023-08-27T11:23:49.290645+0000","last_fullsized":"2023-08-27T11:23:49.290645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:26:47.260019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312794+0000","last_change":"2023-08-27T11:23:49.304740+0000","last_active":"2023-08-27T11:23:49.312794+0000","last_peered":"2023-08-27T11:23:49.312794+0000","last_clean":"2023-08-27T11:23:49.312794+0000","last_became_active":"2023-08-27T11:23:49.304230+0000","last_became_peered":"2023-08-27T11:23:49.304230+0000","last_unstale":"2023-08-27T11:23:49.312794+0000","last_undegraded":"2023-08-27T11:23:49.312794+0000","last_fullsized":"2023-08-27T11:23:49.312794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:43:13.809668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292249+0000","last_change":"2023-08-27T11:23:48.280188+0000","last_active":"2023-08-27T11:23:50.292249+0000","last_peered":"2023-08-27T11:23:50.292249+0000","last_clean":"2023-08-27T11:23:50.292249+0000","last_became_active":"2023-08-27T11:23:48.279807+0000","last_became_peered":"2023-08-27T11:23:48.279807+0000","last_unstale":"2023-08-27T11:23:50.292249+0000","last_undegraded":"2023-08-27T11:23:50.292249+0000","last_fullsized":"2023-08-27T11:23:50.292249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:57:40.846943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306642+0000","last_change":"2023-08-27T11:23:49.300422+0000","last_active":"2023-08-27T11:23:49.306642+0000","last_peered":"2023-08-27T11:23:49.306642+0000","last_clean":"2023-08-27T11:23:49.306642+0000","last_became_active":"2023-08-27T11:23:49.300146+0000","last_became_peered":"2023-08-27T11:23:49.300146+0000","last_unstale":"2023-08-27T11:23:49.306642+0000","last_undegraded":"2023-08-27T11:23:49.306642+0000","last_fullsized":"2023-08-27T11:23:49.306642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:24.290080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295185+0000","last_change":"2023-08-27T11:23:48.273395+0000","last_active":"2023-08-27T11:23:49.295185+0000","last_peered":"2023-08-27T11:23:49.295185+0000","last_clean":"2023-08-27T11:23:49.295185+0000","last_became_active":"2023-08-27T11:23:48.273004+0000","last_became_peered":"2023-08-27T11:23:48.273004+0000","last_unstale":"2023-08-27T11:23:49.295185+0000","last_undegraded":"2023-08-27T11:23:49.295185+0000","last_fullsized":"2023-08-27T11:23:49.295185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:38.595613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292398+0000","last_change":"2023-08-27T11:23:49.308710+0000","last_active":"2023-08-27T11:23:50.292398+0000","last_peered":"2023-08-27T11:23:50.292398+0000","last_clean":"2023-08-27T11:23:50.292398+0000","last_became_active":"2023-08-27T11:23:49.308387+0000","last_became_peered":"2023-08-27T11:23:49.308387+0000","last_unstale":"2023-08-27T11:23:50.292398+0000","last_undegraded":"2023-08-27T11:23:50.292398+0000","last_fullsized":"2023-08-27T11:23:50.292398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:51:38.396904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.300197+0000","last_change":"2023-08-27T11:23:48.285496+0000","last_active":"2023-08-27T11:23:49.300197+0000","last_peered":"2023-08-27T11:23:49.300197+0000","last_clean":"2023-08-27T11:23:49.300197+0000","last_became_active":"2023-08-27T11:23:48.285000+0000","last_became_peered":"2023-08-27T11:23:48.285000+0000","last_unstale":"2023-08-27T11:23:49.300197+0000","last_undegraded":"2023-08-27T11:23:49.300197+0000","last_fullsized":"2023-08-27T11:23:49.300197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:26:51.034784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308351+0000","last_change":"2023-08-27T11:23:49.306228+0000","last_active":"2023-08-27T11:23:49.308351+0000","last_peered":"2023-08-27T11:23:49.308351+0000","last_clean":"2023-08-27T11:23:49.308351+0000","last_became_active":"2023-08-27T11:23:49.305971+0000","last_became_peered":"2023-08-27T11:23:49.305971+0000","last_unstale":"2023-08-27T11:23:49.308351+0000","last_undegraded":"2023-08-27T11:23:49.308351+0000","last_fullsized":"2023-08-27T11:23:49.308351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:50.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.326464+0000","last_change":"2023-08-27T11:23:48.284652+0000","last_active":"2023-08-27T11:23:49.326464+0000","last_peered":"2023-08-27T11:23:49.326464+0000","last_clean":"2023-08-27T11:23:49.326464+0000","last_became_active":"2023-08-27T11:23:48.284382+0000","last_became_peered":"2023-08-27T11:23:48.284382+0000","last_unstale":"2023-08-27T11:23:49.326464+0000","last_undegraded":"2023-08-27T11:23:49.326464+0000","last_fullsized":"2023-08-27T11:23:49.326464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:26.685667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292432+0000","last_change":"2023-08-27T11:23:49.299065+0000","last_active":"2023-08-27T11:23:50.292432+0000","last_peered":"2023-08-27T11:23:50.292432+0000","last_clean":"2023-08-27T11:23:50.292432+0000","last_became_active":"2023-08-27T11:23:49.298761+0000","last_became_peered":"2023-08-27T11:23:49.298761+0000","last_unstale":"2023-08-27T11:23:50.292432+0000","last_undegraded":"2023-08-27T11:23:50.292432+0000","last_fullsized":"2023-08-27T11:23:50.292432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:22.868521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.327687+0000","last_change":"2023-08-27T11:23:48.283246+0000","last_active":"2023-08-27T11:23:49.327687+0000","last_peered":"2023-08-27T11:23:49.327687+0000","last_clean":"2023-08-27T11:23:49.327687+0000","last_became_active":"2023-08-27T11:23:48.282922+0000","last_became_peered":"2023-08-27T11:23:48.282922+0000","last_unstale":"2023-08-27T11:23:49.327687+0000","last_undegraded":"2023-08-27T11:23:49.327687+0000","last_fullsized":"2023-08-27T11:23:49.327687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:35.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.314234+0000","last_change":"2023-08-27T11:23:49.311891+0000","last_active":"2023-08-27T11:23:49.314234+0000","last_peered":"2023-08-27T11:23:49.314234+0000","last_clean":"2023-08-27T11:23:49.314234+0000","last_became_active":"2023-08-27T11:23:49.311341+0000","last_became_peered":"2023-08-27T11:23:49.311341+0000","last_unstale":"2023-08-27T11:23:49.314234+0000","last_undegraded":"2023-08-27T11:23:49.314234+0000","last_fullsized":"2023-08-27T11:23:49.314234+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:58.737649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324583+0000","last_change":"2023-08-27T11:23:48.274651+0000","last_active":"2023-08-27T11:23:49.324583+0000","last_peered":"2023-08-27T11:23:49.324583+0000","last_clean":"2023-08-27T11:23:49.324583+0000","last_became_active":"2023-08-27T11:23:48.274353+0000","last_became_peered":"2023-08-27T11:23:48.274353+0000","last_unstale":"2023-08-27T11:23:49.324583+0000","last_undegraded":"2023-08-27T11:23:49.324583+0000","last_fullsized":"2023-08-27T11:23:49.324583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:28.944879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315922+0000","last_change":"2023-08-27T11:23:49.305974+0000","last_active":"2023-08-27T11:23:49.315922+0000","last_peered":"2023-08-27T11:23:49.315922+0000","last_clean":"2023-08-27T11:23:49.315922+0000","last_became_active":"2023-08-27T11:23:49.305679+0000","last_became_peered":"2023-08-27T11:23:49.305679+0000","last_unstale":"2023-08-27T11:23:49.315922+0000","last_undegraded":"2023-08-27T11:23:49.315922+0000","last_fullsized":"2023-08-27T11:23:49.315922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:46.286432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290495+0000","last_change":"2023-08-27T11:23:48.285837+0000","last_active":"2023-08-27T11:23:49.290495+0000","last_peered":"2023-08-27T11:23:49.290495+0000","last_clean":"2023-08-27T11:23:49.290495+0000","last_became_active":"2023-08-27T11:23:48.285515+0000","last_became_peered":"2023-08-27T11:23:48.285515+0000","last_unstale":"2023-08-27T11:23:49.290495+0000","last_undegraded":"2023-08-27T11:23:49.290495+0000","last_fullsized":"2023-08-27T11:23:49.290495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:43.887400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291599+0000","last_change":"2023-08-27T11:23:49.309026+0000","last_active":"2023-08-27T11:23:50.291599+0000","last_peered":"2023-08-27T11:23:50.291599+0000","last_clean":"2023-08-27T11:23:50.291599+0000","last_became_active":"2023-08-27T11:23:49.308707+0000","last_became_peered":"2023-08-27T11:23:49.308707+0000","last_unstale":"2023-08-27T11:23:50.291599+0000","last_undegraded":"2023-08-27T11:23:50.291599+0000","last_fullsized":"2023-08-27T11:23:50.291599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:58.593129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289560+0000","last_change":"2023-08-27T11:23:48.276797+0000","last_active":"2023-08-27T11:23:50.289560+0000","last_peered":"2023-08-27T11:23:50.289560+0000","last_clean":"2023-08-27T11:23:50.289560+0000","last_became_active":"2023-08-27T11:23:48.276448+0000","last_became_peered":"2023-08-27T11:23:48.276448+0000","last_unstale":"2023-08-27T11:23:50.289560+0000","last_undegraded":"2023-08-27T11:23:50.289560+0000","last_fullsized":"2023-08-27T11:23:50.289560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:41.484365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312753+0000","last_change":"2023-08-27T11:23:49.303066+0000","last_active":"2023-08-27T11:23:49.312753+0000","last_peered":"2023-08-27T11:23:49.312753+0000","last_clean":"2023-08-27T11:23:49.312753+0000","last_became_active":"2023-08-27T11:23:49.302707+0000","last_became_peered":"2023-08-27T11:23:49.302707+0000","last_unstale":"2023-08-27T11:23:49.312753+0000","last_undegraded":"2023-08-27T11:23:49.312753+0000","last_fullsized":"2023-08-27T11:23:49.312753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:01.932383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292277+0000","last_change":"2023-08-27T11:23:48.287277+0000","last_active":"2023-08-27T11:23:50.292277+0000","last_peered":"2023-08-27T11:23:50.292277+0000","last_clean":"2023-08-27T11:23:50.292277+0000","last_became_active":"2023-08-27T11:23:48.286977+0000","last_became_peered":"2023-08-27T11:23:48.286977+0000","last_unstale":"2023-08-27T11:23:50.292277+0000","last_undegraded":"2023-08-27T11:23:50.292277+0000","last_fullsized":"2023-08-27T11:23:50.292277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:33:01.706739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.311041+0000","last_change":"2023-08-27T11:23:49.302111+0000","last_active":"2023-08-27T11:23:49.311041+0000","last_peered":"2023-08-27T11:23:49.311041+0000","last_clean":"2023-08-27T11:23:49.311041+0000","last_became_active":"2023-08-27T11:23:49.301794+0000","last_became_peered":"2023-08-27T11:23:49.301794+0000","last_unstale":"2023-08-27T11:23:49.311041+0000","last_undegraded":"2023-08-27T11:23:49.311041+0000","last_fullsized":"2023-08-27T11:23:49.311041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:56:37.369321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325009+0000","last_change":"2023-08-27T11:23:48.285893+0000","last_active":"2023-08-27T11:23:49.325009+0000","last_peered":"2023-08-27T11:23:49.325009+0000","last_clean":"2023-08-27T11:23:49.325009+0000","last_became_active":"2023-08-27T11:23:48.285526+0000","last_became_peered":"2023-08-27T11:23:48.285526+0000","last_unstale":"2023-08-27T11:23:49.325009+0000","last_undegraded":"2023-08-27T11:23:49.325009+0000","last_fullsized":"2023-08-27T11:23:49.325009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:46.684392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.315681+0000","last_change":"2023-08-27T11:23:49.312926+0000","last_active":"2023-08-27T11:23:49.315681+0000","last_peered":"2023-08-27T11:23:49.315681+0000","last_clean":"2023-08-27T11:23:49.315681+0000","last_became_active":"2023-08-27T11:23:49.312539+0000","last_became_peered":"2023-08-27T11:23:49.312539+0000","last_unstale":"2023-08-27T11:23:49.315681+0000","last_undegraded":"2023-08-27T11:23:49.315681+0000","last_fullsized":"2023-08-27T11:23:49.315681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:23.682423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292425+0000","last_change":"2023-08-27T11:23:48.283536+0000","last_active":"2023-08-27T11:23:50.292425+0000","last_peered":"2023-08-27T11:23:50.292425+0000","last_clean":"2023-08-27T11:23:50.292425+0000","last_became_active":"2023-08-27T11:23:48.282244+0000","last_became_peered":"2023-08-27T11:23:48.282244+0000","last_unstale":"2023-08-27T11:23:50.292425+0000","last_undegraded":"2023-08-27T11:23:50.292425+0000","last_fullsized":"2023-08-27T11:23:50.292425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:22.545843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292509+0000","last_change":"2023-08-27T11:23:49.298306+0000","last_active":"2023-08-27T11:23:50.292509+0000","last_peered":"2023-08-27T11:23:50.292509+0000","last_clean":"2023-08-27T11:23:50.292509+0000","last_became_active":"2023-08-27T11:23:49.297906+0000","last_became_peered":"2023-08-27T11:23:49.297906+0000","last_unstale":"2023-08-27T11:23:50.292509+0000","last_undegraded":"2023-08-27T11:23:50.292509+0000","last_fullsized":"2023-08-27T11:23:50.292509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:52.347231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325693+0000","last_change":"2023-08-27T11:23:48.283474+0000","last_active":"2023-08-27T11:23:49.325693+0000","last_peered":"2023-08-27T11:23:49.325693+0000","last_clean":"2023-08-27T11:23:49.325693+0000","last_became_active":"2023-08-27T11:23:48.283039+0000","last_became_peered":"2023-08-27T11:23:48.283039+0000","last_unstale":"2023-08-27T11:23:49.325693+0000","last_undegraded":"2023-08-27T11:23:49.325693+0000","last_fullsized":"2023-08-27T11:23:49.325693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:46:55.069920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.306305+0000","last_change":"2023-08-27T11:23:49.296343+0000","last_active":"2023-08-27T11:23:49.306305+0000","last_peered":"2023-08-27T11:23:49.306305+0000","last_clean":"2023-08-27T11:23:49.306305+0000","last_became_active":"2023-08-27T11:23:49.296040+0000","last_became_peered":"2023-08-27T11:23:49.296040+0000","last_unstale":"2023-08-27T11:23:49.306305+0000","last_undegraded":"2023-08-27T11:23:49.306305+0000","last_fullsized":"2023-08-27T11:23:49.306305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:31.402876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290734+0000","last_change":"2023-08-27T11:23:48.284514+0000","last_active":"2023-08-27T11:23:49.290734+0000","last_peered":"2023-08-27T11:23:49.290734+0000","last_clean":"2023-08-27T11:23:49.290734+0000","last_became_active":"2023-08-27T11:23:48.284081+0000","last_became_peered":"2023-08-27T11:23:48.284081+0000","last_unstale":"2023-08-27T11:23:49.290734+0000","last_undegraded":"2023-08-27T11:23:49.290734+0000","last_fullsized":"2023-08-27T11:23:49.290734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:41.484365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292126+0000","last_change":"2023-08-27T11:23:49.307724+0000","last_active":"2023-08-27T11:23:50.292126+0000","last_peered":"2023-08-27T11:23:50.292126+0000","last_clean":"2023-08-27T11:23:50.292126+0000","last_became_active":"2023-08-27T11:23:49.307437+0000","last_became_peered":"2023-08-27T11:23:49.307437+0000","last_unstale":"2023-08-27T11:23:50.292126+0000","last_undegraded":"2023-08-27T11:23:50.292126+0000","last_fullsized":"2023-08-27T11:23:50.292126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:37:44.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.324342+0000","last_change":"2023-08-27T11:23:48.275088+0000","last_active":"2023-08-27T11:23:49.324342+0000","last_peered":"2023-08-27T11:23:49.324342+0000","last_clean":"2023-08-27T11:23:49.324342+0000","last_became_active":"2023-08-27T11:23:48.274662+0000","last_became_peered":"2023-08-27T11:23:48.274662+0000","last_unstale":"2023-08-27T11:23:49.324342+0000","last_undegraded":"2023-08-27T11:23:49.324342+0000","last_fullsized":"2023-08-27T11:23:49.324342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:58:52.707309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308436+0000","last_change":"2023-08-27T11:23:49.304637+0000","last_active":"2023-08-27T11:23:49.308436+0000","last_peered":"2023-08-27T11:23:49.308436+0000","last_clean":"2023-08-27T11:23:49.308436+0000","last_became_active":"2023-08-27T11:23:49.304378+0000","last_became_peered":"2023-08-27T11:23:49.304378+0000","last_unstale":"2023-08-27T11:23:49.308436+0000","last_undegraded":"2023-08-27T11:23:49.308436+0000","last_fullsized":"2023-08-27T11:23:49.308436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.284953+0000","last_change":"2023-08-27T11:23:48.278562+0000","last_active":"2023-08-27T11:23:49.284953+0000","last_peered":"2023-08-27T11:23:49.284953+0000","last_clean":"2023-08-27T11:23:49.284953+0000","last_became_active":"2023-08-27T11:23:48.278184+0000","last_became_peered":"2023-08-27T11:23:48.278184+0000","last_unstale":"2023-08-27T11:23:49.284953+0000","last_undegraded":"2023-08-27T11:23:49.284953+0000","last_fullsized":"2023-08-27T11:23:49.284953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:48.198693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313458+0000","last_change":"2023-08-27T11:23:49.310089+0000","last_active":"2023-08-27T11:23:49.313458+0000","last_peered":"2023-08-27T11:23:49.313458+0000","last_clean":"2023-08-27T11:23:49.313458+0000","last_became_active":"2023-08-27T11:23:49.309694+0000","last_became_peered":"2023-08-27T11:23:49.309694+0000","last_unstale":"2023-08-27T11:23:49.313458+0000","last_undegraded":"2023-08-27T11:23:49.313458+0000","last_fullsized":"2023-08-27T11:23:49.313458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:55.454547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291723+0000","last_change":"2023-08-27T11:23:48.289101+0000","last_active":"2023-08-27T11:23:50.291723+0000","last_peered":"2023-08-27T11:23:50.291723+0000","last_clean":"2023-08-27T11:23:50.291723+0000","last_became_active":"2023-08-27T11:23:48.288729+0000","last_became_peered":"2023-08-27T11:23:48.288729+0000","last_unstale":"2023-08-27T11:23:50.291723+0000","last_undegraded":"2023-08-27T11:23:50.291723+0000","last_fullsized":"2023-08-27T11:23:50.291723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:19:44.075444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.312773+0000","last_change":"2023-08-27T11:23:49.304560+0000","last_active":"2023-08-27T11:23:49.312773+0000","last_peered":"2023-08-27T11:23:49.312773+0000","last_clean":"2023-08-27T11:23:49.312773+0000","last_became_active":"2023-08-27T11:23:49.303805+0000","last_became_peered":"2023-08-27T11:23:49.303805+0000","last_unstale":"2023-08-27T11:23:49.312773+0000","last_undegraded":"2023-08-27T11:23:49.312773+0000","last_fullsized":"2023-08-27T11:23:49.312773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:23.464665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.284969+0000","last_change":"2023-08-27T11:23:48.272595+0000","last_active":"2023-08-27T11:23:49.284969+0000","last_peered":"2023-08-27T11:23:49.284969+0000","last_clean":"2023-08-27T11:23:49.284969+0000","last_became_active":"2023-08-27T11:23:48.272303+0000","last_became_peered":"2023-08-27T11:23:48.272303+0000","last_unstale":"2023-08-27T11:23:49.284969+0000","last_undegraded":"2023-08-27T11:23:49.284969+0000","last_fullsized":"2023-08-27T11:23:49.284969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:26.757047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292526+0000","last_change":"2023-08-27T11:23:49.300305+0000","last_active":"2023-08-27T11:23:50.292526+0000","last_peered":"2023-08-27T11:23:50.292526+0000","last_clean":"2023-08-27T11:23:50.292526+0000","last_became_active":"2023-08-27T11:23:49.299880+0000","last_became_peered":"2023-08-27T11:23:49.299880+0000","last_unstale":"2023-08-27T11:23:50.292526+0000","last_undegraded":"2023-08-27T11:23:50.292526+0000","last_fullsized":"2023-08-27T11:23:50.292526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:47.918472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292302+0000","last_change":"2023-08-27T11:23:48.277920+0000","last_active":"2023-08-27T11:23:50.292302+0000","last_peered":"2023-08-27T11:23:50.292302+0000","last_clean":"2023-08-27T11:23:50.292302+0000","last_became_active":"2023-08-27T11:23:48.277607+0000","last_became_peered":"2023-08-27T11:23:48.277607+0000","last_unstale":"2023-08-27T11:23:50.292302+0000","last_undegraded":"2023-08-27T11:23:50.292302+0000","last_fullsized":"2023-08-27T11:23:50.292302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:32.745200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292094+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:23:50.292094+0000","last_peered":"2023-08-27T11:23:50.292094+0000","last_clean":"2023-08-27T11:23:50.292094+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:23:50.292094+0000","last_undegraded":"2023-08-27T11:23:50.292094+0000","last_fullsized":"2023-08-27T11:23:50.292094+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:55.851576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291718+0000","last_change":"2023-08-27T11:23:49.308202+0000","last_active":"2023-08-27T11:23:50.291718+0000","last_peered":"2023-08-27T11:23:50.291718+0000","last_clean":"2023-08-27T11:23:50.291718+0000","last_became_active":"2023-08-27T11:23:49.307887+0000","last_became_peered":"2023-08-27T11:23:49.307887+0000","last_unstale":"2023-08-27T11:23:50.291718+0000","last_undegraded":"2023-08-27T11:23:50.291718+0000","last_fullsized":"2023-08-27T11:23:50.291718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:23.912400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.289039+0000","last_change":"2023-08-27T11:23:48.271778+0000","last_active":"2023-08-27T11:23:49.289039+0000","last_peered":"2023-08-27T11:23:49.289039+0000","last_clean":"2023-08-27T11:23:49.289039+0000","last_became_active":"2023-08-27T11:23:48.271458+0000","last_became_peered":"2023-08-27T11:23:48.271458+0000","last_unstale":"2023-08-27T11:23:49.289039+0000","last_undegraded":"2023-08-27T11:23:49.289039+0000","last_fullsized":"2023-08-27T11:23:49.289039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:25.813965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.291701+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:23:49.291701+0000","last_peered":"2023-08-27T11:23:49.291701+0000","last_clean":"2023-08-27T11:23:49.291701+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:23:49.291701+0000","last_undegraded":"2023-08-27T11:23:49.291701+0000","last_fullsized":"2023-08-27T11:23:49.291701+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:00.270092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.317718+0000","last_change":"2023-08-27T11:23:49.315044+0000","last_active":"2023-08-27T11:23:49.317718+0000","last_peered":"2023-08-27T11:23:49.317718+0000","last_clean":"2023-08-27T11:23:49.317718+0000","last_became_active":"2023-08-27T11:23:49.314671+0000","last_became_peered":"2023-08-27T11:23:49.314671+0000","last_unstale":"2023-08-27T11:23:49.317718+0000","last_undegraded":"2023-08-27T11:23:49.317718+0000","last_fullsized":"2023-08-27T11:23:49.317718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:09.275370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.325770+0000","last_change":"2023-08-27T11:23:48.291101+0000","last_active":"2023-08-27T11:23:49.325770+0000","last_peered":"2023-08-27T11:23:49.325770+0000","last_clean":"2023-08-27T11:23:49.325770+0000","last_became_active":"2023-08-27T11:23:48.289497+0000","last_became_peered":"2023-08-27T11:23:48.289497+0000","last_unstale":"2023-08-27T11:23:49.325770+0000","last_undegraded":"2023-08-27T11:23:49.325770+0000","last_fullsized":"2023-08-27T11:23:49.325770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:11:56.377593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.290375+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:23:49.290375+0000","last_peered":"2023-08-27T11:23:49.290375+0000","last_clean":"2023-08-27T11:23:49.290375+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:23:49.290375+0000","last_undegraded":"2023-08-27T11:23:49.290375+0000","last_fullsized":"2023-08-27T11:23:49.290375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:02.834152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292521+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:23:50.292521+0000","last_peered":"2023-08-27T11:23:50.292521+0000","last_clean":"2023-08-27T11:23:50.292521+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:23:50.292521+0000","last_undegraded":"2023-08-27T11:23:50.292521+0000","last_fullsized":"2023-08-27T11:23:50.292521+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:59:57.970256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291624+0000","last_change":"2023-08-27T11:23:49.308352+0000","last_active":"2023-08-27T11:23:50.291624+0000","last_peered":"2023-08-27T11:23:50.291624+0000","last_clean":"2023-08-27T11:23:50.291624+0000","last_became_active":"2023-08-27T11:23:49.308056+0000","last_became_peered":"2023-08-27T11:23:49.308056+0000","last_unstale":"2023-08-27T11:23:50.291624+0000","last_undegraded":"2023-08-27T11:23:50.291624+0000","last_fullsized":"2023-08-27T11:23:50.291624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:16:08.394057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.285146+0000","last_change":"2023-08-27T11:23:48.289520+0000","last_active":"2023-08-27T11:23:49.285146+0000","last_peered":"2023-08-27T11:23:49.285146+0000","last_clean":"2023-08-27T11:23:49.285146+0000","last_became_active":"2023-08-27T11:23:48.289211+0000","last_became_peered":"2023-08-27T11:23:48.289211+0000","last_unstale":"2023-08-27T11:23:49.285146+0000","last_undegraded":"2023-08-27T11:23:49.285146+0000","last_fullsized":"2023-08-27T11:23:49.285146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:01.224180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291723+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:23:50.291723+0000","last_peered":"2023-08-27T11:23:50.291723+0000","last_clean":"2023-08-27T11:23:50.291723+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:23:50.291723+0000","last_undegraded":"2023-08-27T11:23:50.291723+0000","last_fullsized":"2023-08-27T11:23:50.291723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:10.927816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.313199+0000","last_change":"2023-08-27T11:23:49.306665+0000","last_active":"2023-08-27T11:23:49.313199+0000","last_peered":"2023-08-27T11:23:49.313199+0000","last_clean":"2023-08-27T11:23:49.313199+0000","last_became_active":"2023-08-27T11:23:49.306390+0000","last_became_peered":"2023-08-27T11:23:49.306390+0000","last_unstale":"2023-08-27T11:23:49.313199+0000","last_undegraded":"2023-08-27T11:23:49.313199+0000","last_fullsized":"2023-08-27T11:23:49.313199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:51:23.184137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.291583+0000","last_change":"2023-08-27T11:23:48.286998+0000","last_active":"2023-08-27T11:23:50.291583+0000","last_peered":"2023-08-27T11:23:50.291583+0000","last_clean":"2023-08-27T11:23:50.291583+0000","last_became_active":"2023-08-27T11:23:48.286681+0000","last_became_peered":"2023-08-27T11:23:48.286681+0000","last_unstale":"2023-08-27T11:23:50.291583+0000","last_undegraded":"2023-08-27T11:23:50.291583+0000","last_fullsized":"2023-08-27T11:23:50.291583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:43.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.292379+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:23:50.292379+0000","last_peered":"2023-08-27T11:23:50.292379+0000","last_clean":"2023-08-27T11:23:50.292379+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:23:50.292379+0000","last_undegraded":"2023-08-27T11:23:50.292379+0000","last_fullsized":"2023-08-27T11:23:50.292379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:15:10.310069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.310699+0000","last_change":"2023-08-27T11:23:49.299222+0000","last_active":"2023-08-27T11:23:49.310699+0000","last_peered":"2023-08-27T11:23:49.310699+0000","last_clean":"2023-08-27T11:23:49.310699+0000","last_became_active":"2023-08-27T11:23:49.298835+0000","last_became_peered":"2023-08-27T11:23:49.298835+0000","last_unstale":"2023-08-27T11:23:49.310699+0000","last_undegraded":"2023-08-27T11:23:49.310699+0000","last_fullsized":"2023-08-27T11:23:49.310699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:28:51.450055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295918+0000","last_change":"2023-08-27T11:23:48.277098+0000","last_active":"2023-08-27T11:23:49.295918+0000","last_peered":"2023-08-27T11:23:49.295918+0000","last_clean":"2023-08-27T11:23:49.295918+0000","last_became_active":"2023-08-27T11:23:48.276781+0000","last_became_peered":"2023-08-27T11:23:48.276781+0000","last_unstale":"2023-08-27T11:23:49.295918+0000","last_undegraded":"2023-08-27T11:23:49.295918+0000","last_fullsized":"2023-08-27T11:23:49.295918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:12.565271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.299386+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:23:49.299386+0000","last_peered":"2023-08-27T11:23:49.299386+0000","last_clean":"2023-08-27T11:23:49.299386+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:23:49.299386+0000","last_undegraded":"2023-08-27T11:23:49.299386+0000","last_fullsized":"2023-08-27T11:23:49.299386+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:29:01.226014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308399+0000","last_change":"2023-08-27T11:23:49.302727+0000","last_active":"2023-08-27T11:23:49.308399+0000","last_peered":"2023-08-27T11:23:49.308399+0000","last_clean":"2023-08-27T11:23:49.308399+0000","last_became_active":"2023-08-27T11:23:49.302425+0000","last_became_peered":"2023-08-27T11:23:49.302425+0000","last_unstale":"2023-08-27T11:23:49.308399+0000","last_undegraded":"2023-08-27T11:23:49.308399+0000","last_fullsized":"2023-08-27T11:23:49.308399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:47.130872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.289760+0000","last_change":"2023-08-27T11:23:48.276589+0000","last_active":"2023-08-27T11:23:50.289760+0000","last_peered":"2023-08-27T11:23:50.289760+0000","last_clean":"2023-08-27T11:23:50.289760+0000","last_became_active":"2023-08-27T11:23:48.276313+0000","last_became_peered":"2023-08-27T11:23:48.276313+0000","last_unstale":"2023-08-27T11:23:50.289760+0000","last_undegraded":"2023-08-27T11:23:50.289760+0000","last_fullsized":"2023-08-27T11:23:50.289760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:09.747994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290204+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:23:50.290204+0000","last_peered":"2023-08-27T11:23:50.290204+0000","last_clean":"2023-08-27T11:23:50.290204+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:23:50.290204+0000","last_undegraded":"2023-08-27T11:23:50.290204+0000","last_fullsized":"2023-08-27T11:23:50.290204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:38.142336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.308295+0000","last_change":"2023-08-27T11:23:49.304382+0000","last_active":"2023-08-27T11:23:49.308295+0000","last_peered":"2023-08-27T11:23:49.308295+0000","last_clean":"2023-08-27T11:23:49.308295+0000","last_became_active":"2023-08-27T11:23:49.304117+0000","last_became_peered":"2023-08-27T11:23:49.304117+0000","last_unstale":"2023-08-27T11:23:49.308295+0000","last_undegraded":"2023-08-27T11:23:49.308295+0000","last_fullsized":"2023-08-27T11:23:49.308295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:48.255300+0000","last_clean_scrub_stamp":"2023-08-27T11:23:48.255300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:37:11.814954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-27T11:23:49.295462+0000","last_change":"2023-08-27T11:23:48.280893+0000","last_active":"2023-08-27T11:23:49.295462+0000","last_peered":"2023-08-27T11:23:49.295462+0000","last_clean":"2023-08-27T11:23:49.295462+0000","last_became_active":"2023-08-27T11:23:48.280566+0000","last_became_peered":"2023-08-27T11:23:48.280566+0000","last_unstale":"2023-08-27T11:23:49.295462+0000","last_undegraded":"2023-08-27T11:23:49.295462+0000","last_fullsized":"2023-08-27T11:23:49.295462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:23:47.246000+0000","last_clean_scrub_stamp":"2023-08-27T11:23:47.246000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:16:16.035123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-08-27T11:23:50.290478+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:23:50.290478+0000","last_peered":"2023-08-27T11:23:50.290478+0000","last_clean":"2023-08-27T11:23:50.290478+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:23:50.290478+0000","last_undegraded":"2023-08-27T11:23:50.290478+0000","last_fullsized":"2023-08-27T11:23:50.290478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:15:04.695867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":744978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.747}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61899999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":152524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5419999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.622}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.5920000000000005,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":7.4850000000000003,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.69799999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.91100000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":743386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.621}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.87}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.04}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":1.018}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":151976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.438},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":152998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.99299999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.76800000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.88600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":385024,"data_stored":153588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.4249999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.32700000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.498},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.5700000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.4699999999999998,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.77300000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5,"5min":5,"15min":5},"last":0.877},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.86199999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":153532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66900000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.746}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79900000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.82199999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":152054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.78000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.71999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.84899999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.88}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:23:54.258 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:23:54.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:23:54.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.500+0000 7fa43b3ff700 1 Processor -- start 2023-08-27T11:23:54.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.500+0000 7fa43b3ff700 1 -- start start 2023-08-27T11:23:54.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43b3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa43415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43b3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4340c5270 con 0x7fa434151d20 2023-08-27T11:23:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43b3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4340ac7e0 con 0x7fa43406a790 2023-08-27T11:23:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43b3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340c86a0 con 0x7fa4340c4e20 2023-08-27T11:23:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43919b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa434151d20 0x7fa4340c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42528/0 (socket says 172.21.15.43:42528) 2023-08-27T11:23:54.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43919b700 1 -- 172.21.15.43:0/521168200 learned_addr learned my addr 172.21.15.43:0/521168200 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:54.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.501+0000 7fa43999c700 1 --2- 172.21.15.43:0/521168200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa43415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990026437 0 0) 0x7fa430001110 con 0x7fa434151d20 2023-08-27T11:23:54.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4200035b0 con 0x7fa434151d20 2023-08-27T11:23:54.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856167708 0 0) 0x7fa4340ac7e0 con 0x7fa43406a790 2023-08-27T11:23:54.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa430001110 con 0x7fa43406a790 2023-08-27T11:23:54.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa43999c700 1 -- 172.21.15.43:0/521168200 >> v1:172.21.15.57:6789/0 conn(0x7fa43406a790 legacy=0x7fa4340c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa43999c700 1 -- 172.21.15.43:0/521168200 >> v1:172.21.15.43:6789/0 conn(0x7fa434151d20 legacy=0x7fa4340c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa43999c700 1 -- 172.21.15.43:0/521168200 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340c99f0 con 0x7fa4340c4e20 2023-08-27T11:23:54.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.502+0000 7fa43999c700 1 --2- 172.21.15.43:0/521168200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa43415ff90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009dc0 tx=0x7fa42c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ab1aa5d018a2919 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c00e070 con 0x7fa4340c4e20 2023-08-27T11:23:54.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c00bb20 con 0x7fa4340c4e20 2023-08-27T11:23:54.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa42bfff700 1 -- 172.21.15.43:0/521168200 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c012430 con 0x7fa4340c4e20 2023-08-27T11:23:54.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa43b3ff700 1 -- 172.21.15.43:0/521168200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 msgr2=0x7fa43415ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/521168200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa43415ff90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009dc0 tx=0x7fa42c00b330 comp rx=0 tx=0).stop 2023-08-27T11:23:54.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa43b3ff700 1 -- 172.21.15.43:0/521168200 shutdown_connections 2023-08-27T11:23:54.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/521168200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa43415ff90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.503+0000 7fa43b3ff700 1 -- 172.21.15.43:0/521168200 >> 172.21.15.43:0/521168200 conn(0x7fa4340ab880 msgr2=0x7fa4340abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:54.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.504+0000 7fa43b3ff700 1 -- 172.21.15.43:0/521168200 shutdown_connections 2023-08-27T11:23:54.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.504+0000 7fa43b3ff700 1 -- 172.21.15.43:0/521168200 wait complete. 2023-08-27T11:23:54.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.505+0000 7fa43b3ff700 1 Processor -- start 2023-08-27T11:23:54.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.505+0000 7fa43b3ff700 1 -- start start 2023-08-27T11:23:54.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa434149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 0x7fa43414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4340bf670 con 0x7fa43406a790 2023-08-27T11:23:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43414aa40 con 0x7fa434151d20 2023-08-27T11:23:54.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43b3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43414a800 con 0x7fa4340c4e20 2023-08-27T11:23:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37162/0 (socket says 172.21.15.43:37162) 2023-08-27T11:23:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.506+0000 7fa43919b700 1 -- 172.21.15.43:0/162217515 learned_addr learned my addr 172.21.15.43:0/162217515 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 -- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 msgr2=0x7fa434149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43899a700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa434149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43999c700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 0x7fa43414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa434149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 -- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 msgr2=0x7fa43414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 0x7fa43414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 -- 172.21.15.43:0/162217515 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c009a70 con 0x7fa43406a790 2023-08-27T11:23:54.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43899a700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa434149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:54.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43999c700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 0x7fa43414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:54.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43919b700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa43000c650 tx=0x7fa43000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430005d70 con 0x7fa43406a790 2023-08-27T11:23:54.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430007070 con 0x7fa43406a790 2023-08-27T11:23:54.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43414ac90 con 0x7fa43406a790 2023-08-27T11:23:54.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.507+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430007420 con 0x7fa43406a790 2023-08-27T11:23:54.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.508+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4340c40a0 con 0x7fa43406a790 2023-08-27T11:23:54.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.509+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa434074680 con 0x7fa43406a790 2023-08-27T11:23:54.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.510+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa430007580 con 0x7fa43406a790 2023-08-27T11:23:54.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.510+0000 7fa429ffb700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 0x7fa41806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:54.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.511+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4300879b0 con 0x7fa43406a790 2023-08-27T11:23:54.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.511+0000 7fa43899a700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 0x7fa41806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:54.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.512+0000 7fa43899a700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 0x7fa41806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa434154500 tx=0x7fa424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:54.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.515+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa430053090 con 0x7fa43406a790 2023-08-27T11:23:54.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.803+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa4340c5270 con 0x7fa43406a790 2023-08-27T11:23:54.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.807+0000 7fa429ffb700 1 -- 172.21.15.43:0/162217515 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa4340c5270 con 0x7fa43406a790 2023-08-27T11:23:54.808 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:23:54.808 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:23:54.809 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:23:54.809 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:23:54.809 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:23:54.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 msgr2=0x7fa41806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 0x7fa41806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa434154500 tx=0x7fa424009040 comp rx=0 tx=0).stop 2023-08-27T11:23:54.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 msgr2=0x7fa434157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:54.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa43000c650 tx=0x7fa43000ca10 comp rx=0 tx=0).stop 2023-08-27T11:23:54.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 shutdown_connections 2023-08-27T11:23:54.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa41806a0e0 0x7fa41806c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa434151d20 0x7fa43414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa43406a790 0x7fa434157ca0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 --2- 172.21.15.43:0/162217515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4340c4e20 0x7fa434149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:54.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 >> 172.21.15.43:0/162217515 conn(0x7fa4340ab880 msgr2=0x7fa4340c7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:54.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 shutdown_connections 2023-08-27T11:23:54.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:54.809+0000 7fa43b3ff700 1 -- 172.21.15.43:0/162217515 wait complete. 2023-08-27T11:23:54.813 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:23:54.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:55.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.027+0000 7efc9abff700 1 Processor -- start 2023-08-27T11:23:55.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.027+0000 7efc9abff700 1 -- start start 2023-08-27T11:23:55.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc9abff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc940c4630 0x7efc940c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc9abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc9406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc9abff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9406c4e0 con 0x7efc94151a90 2023-08-27T11:23:55.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc9abff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc94155370 con 0x7efc940c4630 2023-08-27T11:23:55.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc9abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c82c0 con 0x7efc9406ad70 2023-08-27T11:23:55.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.028+0000 7efc93fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc940c4630 0x7efc940c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efc940c4630 0x7efc940c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37174/0 (socket says 172.21.15.43:37174) 2023-08-27T11:23:55.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 -- 172.21.15.43:0/1845748044 learned_addr learned my addr 172.21.15.43:0/1845748044 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc9919c700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc9406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc937fe700 1 -- 172.21.15.43:0/1845748044 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260237860 0 0) 0x7efc9406c4e0 con 0x7efc94151a90 2023-08-27T11:23:55.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc937fe700 1 -- 172.21.15.43:0/1845748044 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc840035b0 con 0x7efc94151a90 2023-08-27T11:23:55.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 -- 172.21.15.43:0/1845748044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 msgr2=0x7efc9406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc9406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 -- 172.21.15.43:0/1845748044 >> v1:172.21.15.57:6789/0 conn(0x7efc94151a90 legacy=0x7efc940c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 -- 172.21.15.43:0/1845748044 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94151e70 con 0x7efc940c4630 2023-08-27T11:23:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc9919c700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc9406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.029+0000 7efc93fff700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc940c4630 0x7efc940c4a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc800098f0 tx=0x7efc80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8556c243f0fba8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc937fe700 1 -- 172.21.15.43:0/1845748044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011830 con 0x7efc940c4630 2023-08-27T11:23:55.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc937fe700 1 -- 172.21.15.43:0/1845748044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80011990 con 0x7efc940c4630 2023-08-27T11:23:55.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc937fe700 1 -- 172.21.15.43:0/1845748044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80011d00 con 0x7efc940c4630 2023-08-27T11:23:55.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 -- 172.21.15.43:0/1845748044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc940c4630 msgr2=0x7efc940c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc940c4630 0x7efc940c4a90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efc800098f0 tx=0x7efc80009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 -- 172.21.15.43:0/1845748044 shutdown_connections 2023-08-27T11:23:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc9406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 --2- 172.21.15.43:0/1845748044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc940c4630 0x7efc940c4a90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 -- 172.21.15.43:0/1845748044 >> 172.21.15.43:0/1845748044 conn(0x7efc940ab820 msgr2=0x7efc940abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 -- 172.21.15.43:0/1845748044 shutdown_connections 2023-08-27T11:23:55.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.030+0000 7efc9abff700 1 -- 172.21.15.43:0/1845748044 wait complete. 2023-08-27T11:23:55.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.032+0000 7efc9abff700 1 Processor -- start 2023-08-27T11:23:55.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.032+0000 7efc9abff700 1 -- start start 2023-08-27T11:23:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc94148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc940c4630 0x7efc941e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c2d20 con 0x7efc94151a90 2023-08-27T11:23:55.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c3850 con 0x7efc940c4630 2023-08-27T11:23:55.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9abff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c3b30 con 0x7efc9406ad70 2023-08-27T11:23:55.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9919c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9919c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37182/0 (socket says 172.21.15.43:37182) 2023-08-27T11:23:55.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.033+0000 7efc9919c700 1 -- 172.21.15.43:0/452381185 learned_addr learned my addr 172.21.15.43:0/452381185 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc93fff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc940c4630 0x7efc941e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9899b700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc94148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 -- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 msgr2=0x7efc94148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc94148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 -- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc940c4630 msgr2=0x7efc941e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc940c4630 0x7efc941e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 -- 172.21.15.43:0/452381185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009a70 con 0x7efc94151a90 2023-08-27T11:23:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9899b700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc94148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9919c700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00efc0 tx=0x7efc8c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c009d70 con 0x7efc94151a90 2023-08-27T11:23:55.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00f040 con 0x7efc94151a90 2023-08-27T11:23:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00ce00 con 0x7efc94151a90 2023-08-27T11:23:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc80009550 con 0x7efc94151a90 2023-08-27T11:23:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.034+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940c2640 con 0x7efc94151a90 2023-08-27T11:23:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.035+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94072450 con 0x7efc94151a90 2023-08-27T11:23:55.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.036+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc8c014480 con 0x7efc94151a90 2023-08-27T11:23:55.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.037+0000 7efc917fa700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 0x7efc7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.037+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc8c088d30 con 0x7efc94151a90 2023-08-27T11:23:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.038+0000 7efc9899b700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 0x7efc7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.038+0000 7efc9899b700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 0x7efc7806c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efc880016b0 tx=0x7efc88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.041+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efc8c0544b0 con 0x7efc94151a90 2023-08-27T11:23:55.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.299+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc940c2e60 con 0x7efc94151a90 2023-08-27T11:23:55.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.300+0000 7efc917fa700 1 -- 172.21.15.43:0/452381185 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4866 (secure 0 0 0) 0x7efc940c2e60 con 0x7efc94151a90 2023-08-27T11:23:55.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:55.302 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:23:52.315776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1831306112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1831306112},{"type":"v1","addr":"172.21.15.43:6836","nonce":1831306112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:23:55.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 msgr2=0x7efc7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 0x7efc7806c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efc880016b0 tx=0x7efc88009040 comp rx=0 tx=0).stop 2023-08-27T11:23:55.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 msgr2=0x7efc941e7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00efc0 tx=0x7efc8c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 shutdown_connections 2023-08-27T11:23:55.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.302+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efc7806a0e0 0x7efc7806c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efc94151a90 0x7efc941e7270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc9406ad70 0x7efc94148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 --2- 172.21.15.43:0/452381185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc940c4630 0x7efc941e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 >> 172.21.15.43:0/452381185 conn(0x7efc940ab820 msgr2=0x7efc9406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 shutdown_connections 2023-08-27T11:23:55.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.303+0000 7efc9abff700 1 -- 172.21.15.43:0/452381185 wait complete. 2023-08-27T11:23:55.307 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-08-27T11:23:55.724 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:23:48.777715+0000', 'modified': '2023-08-27T11:23:52.315776+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5085': {'gid': 5085, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1831306112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1831306112}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1831306112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:23:55.725 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:23:55.725 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:23:55.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.929+0000 7f4df09ff700 1 Processor -- start 2023-08-27T11:23:55.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.929+0000 7f4df09ff700 1 -- start start 2023-08-27T11:23:55.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4df09ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4dec06ca60 0x7f4dec06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4df09ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec06d700 con 0x7f4dec155910 2023-08-27T11:23:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4df09ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dec152430 con 0x7f4dec0c51a0 2023-08-27T11:23:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4df09ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dec1530b0 con 0x7f4dec06ca60 2023-08-27T11:23:55.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4de9d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4dec06ca60 0x7f4dec06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4de9d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4dec06ca60 0x7f4dec06d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37188/0 (socket says 172.21.15.43:37188) 2023-08-27T11:23:55.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4dead9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4dec155910 0x7f4dec155d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42538/0 (socket says 172.21.15.43:42538) 2023-08-27T11:23:55.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.930+0000 7f4de9d9b700 1 -- 172.21.15.43:0/3941821532 learned_addr learned my addr 172.21.15.43:0/3941821532 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de9d9b700 1 -- 172.21.15.43:0/3941821532 >> v1:172.21.15.57:6789/0 conn(0x7f4dec0c51a0 legacy=0x7f4dec0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de9d9b700 1 -- 172.21.15.43:0/3941821532 >> v1:172.21.15.43:6789/0 conn(0x7f4dec155910 legacy=0x7f4dec155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de9d9b700 1 -- 172.21.15.43:0/3941821532 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec152710 con 0x7f4dec06ca60 2023-08-27T11:23:55.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de959a700 1 -- 172.21.15.43:0/3941821532 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835119561 0 0) 0x7f4dec06d700 con 0x7f4dec155910 2023-08-27T11:23:55.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/3941821532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec06d1c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098f0 tx=0x7f4de0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da515876bbde5e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de959a700 1 -- 172.21.15.43:0/3941821532 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0004230 con 0x7f4dec06ca60 2023-08-27T11:23:55.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de959a700 1 -- 172.21.15.43:0/3941821532 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0004390 con 0x7f4dec06ca60 2023-08-27T11:23:55.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.931+0000 7f4de959a700 1 -- 172.21.15.43:0/3941821532 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00036a0 con 0x7f4dec06ca60 2023-08-27T11:23:55.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 -- 172.21.15.43:0/3941821532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 msgr2=0x7f4dec06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 --2- 172.21.15.43:0/3941821532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec06d1c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4de00098f0 tx=0x7f4de0009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:55.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 -- 172.21.15.43:0/3941821532 shutdown_connections 2023-08-27T11:23:55.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 --2- 172.21.15.43:0/3941821532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec06d1c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 -- 172.21.15.43:0/3941821532 >> 172.21.15.43:0/3941821532 conn(0x7f4dec06aa50 msgr2=0x7f4dec0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 -- 172.21.15.43:0/3941821532 shutdown_connections 2023-08-27T11:23:55.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.932+0000 7f4df09ff700 1 -- 172.21.15.43:0/3941821532 wait complete. 2023-08-27T11:23:55.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.934+0000 7f4df09ff700 1 Processor -- start 2023-08-27T11:23:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.934+0000 7f4df09ff700 1 -- start start 2023-08-27T11:23:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec0c51a0 0x7f4dec0bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec155910 0x7f4dec0a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1eb420 con 0x7f4dec06ca60 2023-08-27T11:23:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec151370 con 0x7f4dec0c51a0 2023-08-27T11:23:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4df09ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec1eb610 con 0x7f4dec155910 2023-08-27T11:23:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37192/0 (socket says 172.21.15.43:37192) 2023-08-27T11:23:55.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.935+0000 7f4dea59c700 1 -- 172.21.15.43:0/1454569933 learned_addr learned my addr 172.21.15.43:0/1454569933 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 -- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec155910 msgr2=0x7f4dec0a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec155910 0x7f4dec0a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 -- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec0c51a0 msgr2=0x7f4dec0bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec0c51a0 0x7f4dec0bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 -- 172.21.15.43:0/1454569933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009550 con 0x7f4dec06ca60 2023-08-27T11:23:55.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4dea59c700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c4d0 tx=0x7f4ddc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4ddaffd700 1 -- 172.21.15.43:0/1454569933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc011790 con 0x7f4dec06ca60 2023-08-27T11:23:55.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4ddaffd700 1 -- 172.21.15.43:0/1454569933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0118f0 con 0x7f4dec06ca60 2023-08-27T11:23:55.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4ddaffd700 1 -- 172.21.15.43:0/1454569933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc011ca0 con 0x7f4dec06ca60 2023-08-27T11:23:55.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec1eb8f0 con 0x7f4dec06ca60 2023-08-27T11:23:55.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.936+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec070040 con 0x7f4dec06ca60 2023-08-27T11:23:55.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.939+0000 7f4ddaffd700 1 -- 172.21.15.43:0/1454569933 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ddc01c460 con 0x7f4dec06ca60 2023-08-27T11:23:55.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.939+0000 7f4ddaffd700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 0x7f4dcc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.940+0000 7f4ddaffd700 1 -- 172.21.15.43:0/1454569933 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ddc0883e0 con 0x7f4dec06ca60 2023-08-27T11:23:55.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.940+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 0x7f4dcc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.940+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 0x7f4dcc06c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4dec151700 tx=0x7f4de0010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.941+0000 7f4e042a2b80 1 Processor -- start 2023-08-27T11:23:55.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.941+0000 7f4e042a2b80 1 -- start start 2023-08-27T11:23:55.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f557320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f578510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f491730 con 0x55991f5385f0 2023-08-27T11:23:55.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f48f050 con 0x55991f5780b0 2023-08-27T11:23:55.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55991f48a940 con 0x55991f5389d0 2023-08-27T11:23:55.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37208/0 (socket says 172.21.15.43:37208) 2023-08-27T11:23:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.942+0000 7f4dea59c700 1 -- 172.21.15.43:0/801195869 learned_addr learned my addr 172.21.15.43:0/801195869 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dead9d700 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f578510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f557320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 -- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 msgr2=0x55991f557320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f557320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 -- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 msgr2=0x55991f578510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f578510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 -- 172.21.15.43:0/801195869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55991f30a5e0 con 0x55991f5385f0 2023-08-27T11:23:55.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dea59c700 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00a040 tx=0x7f4ddc0573f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc65182f70aef3e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dcbfff700 1 -- 172.21.15.43:0/801195869 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0558c0 con 0x55991f5385f0 2023-08-27T11:23:55.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dcbfff700 1 -- 172.21.15.43:0/801195869 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc055b20 con 0x55991f5385f0 2023-08-27T11:23:55.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.943+0000 7f4dcbfff700 1 -- 172.21.15.43:0/801195869 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc05b370 con 0x55991f5385f0 2023-08-27T11:23:55.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 -- 172.21.15.43:0/801195869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 msgr2=0x55991f556de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00a040 tx=0x7f4ddc0573f0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 -- 172.21.15.43:0/801195869 shutdown_connections 2023-08-27T11:23:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f578510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f556de0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/801195869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f557320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 -- 172.21.15.43:0/801195869 >> 172.21.15.43:0/801195869 conn(0x55991f496c30 msgr2=0x55991f5366e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 -- 172.21.15.43:0/801195869 shutdown_connections 2023-08-27T11:23:55.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.944+0000 7f4e042a2b80 1 -- 172.21.15.43:0/801195869 wait complete. 2023-08-27T11:23:55.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.945+0000 7f4e042a2b80 1 -- start start 2023-08-27T11:23:55.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.945+0000 7f4e042a2b80 1 Processor -- start 2023-08-27T11:23:55.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5385f0 0x55991f551ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f5857d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f428b60 con 0x55991f5389d0 2023-08-27T11:23:55.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f428860 con 0x55991f5780b0 2023-08-27T11:23:55.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55991f30c8d0 con 0x55991f5385f0 2023-08-27T11:23:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4e042a2b80 10 client.0 _ll_register_callbacks cb 0x55991f426630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4de9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4de9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37222/0 (socket says 172.21.15.43:37222) 2023-08-27T11:23:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4de9d9b700 1 -- 172.21.15.43:0/4110724895 learned_addr learned my addr 172.21.15.43:0/4110724895 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4dead9d700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f5857d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.946+0000 7f4dea59c700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5385f0 0x55991f551ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 -- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5385f0 msgr2=0x55991f551ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5385f0 0x55991f551ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 -- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 msgr2=0x55991f5857d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f5857d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 -- 172.21.15.43:0/4110724895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec070040 con 0x55991f5389d0 2023-08-27T11:23:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4dec06de40 tx=0x7f4de00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cadc421d5cc960 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4dc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0003ea0 con 0x55991f5389d0 2023-08-27T11:23:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55991f52b4f0 con 0x55991f5389d0 2023-08-27T11:23:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.947+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4de0021070 con 0x55991f5389d0 2023-08-27T11:23:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4de000b860 con 0x55991f5389d0 2023-08-27T11:23:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 10 client.5262 fetch_fsmap learned FSMap version 17 2023-08-27T11:23:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55991f4a2750 con 0x55991f5389d0 2023-08-27T11:23:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0038020 con 0x55991f5389d0 2023-08-27T11:23:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4de000b9c0 con 0x55991f5389d0 2023-08-27T11:23:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 10 client.5262 fetch_fsmap finished waiting for FSMap version 17 2023-08-27T11:23:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 10 client.5262 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:23:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 20 client.5262 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f58bce0 0x55991f58c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 4 client.5262 mds_command: new command op to 5085 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:23:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 --> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55991f483920 con 0x55991f58bce0 2023-08-27T11:23:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.948+0000 7f4dea59c700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f58bce0 0x55991f58c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.949+0000 7f4dea59c700 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f58bce0 0x55991f58c0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa807df3099a7d53 server_cookie=d3880812c17777f6 in_seq=0 out_seq=0 2023-08-27T11:23:55.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.949+0000 7f4dc97fa700 10 client.5262 ms_handle_connect on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:55.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4dc97fa700 1 -- 172.21.15.43:0/4110724895 <== mds.0 v2:172.21.15.43:6834/1831306112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55991f483920 con 0x55991f58bce0 2023-08-27T11:23:55.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4dc97fa700 10 client.5262 handle_command_reply: tid=0 2023-08-27T11:23:55.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 client.5262 shutdown 2023-08-27T11:23:55.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 msgr2=0x55991f55b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4dec06de40 tx=0x7f4de00047c0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 shutdown_connections 2023-08-27T11:23:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f58bce0 0x55991f58c0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f5857d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5385f0 0x55991f551ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/4110724895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5389d0 0x55991f55b570 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4dc97fa700 0 client.5262 ms_handle_reset on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 >> 172.21.15.43:0/4110724895 conn(0x55991f496c30 msgr2=0x55991f5366e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 shutdown_connections 2023-08-27T11:23:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 1 -- 172.21.15.43:0/4110724895 wait complete. 2023-08-27T11:23:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.950+0000 7f4e042a2b80 20 client.5262 trim_cache size 0 max 16384 2023-08-27T11:23:55.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.969+0000 7f4e042a2b80 1 Processor -- start 2023-08-27T11:23:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.969+0000 7f4e042a2b80 1 -- start start 2023-08-27T11:23:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5389d0 0x55991f533b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5780b0 0x55991f54cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f534eb0 con 0x55991f5385f0 2023-08-27T11:23:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f515560 con 0x55991f5389d0 2023-08-27T11:23:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55991f571a20 con 0x55991f5780b0 2023-08-27T11:23:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37236/0 (socket says 172.21.15.43:37236) 2023-08-27T11:23:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 -- 172.21.15.43:0/3691949262 learned_addr learned my addr 172.21.15.43:0/3691949262 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 -- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5780b0 msgr2=0x55991f54cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5780b0 0x55991f54cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 -- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5389d0 msgr2=0x55991f533b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5389d0 0x55991f533b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 -- 172.21.15.43:0/3691949262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55991f2b6d90 con 0x55991f5385f0 2023-08-27T11:23:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.970+0000 7f4dea59c700 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc05f650 tx=0x7f4ddc053bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc5fbf7e12b7f53 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4dd8ff9700 1 -- 172.21.15.43:0/3691949262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc086040 con 0x55991f5385f0 2023-08-27T11:23:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4dd8ff9700 1 -- 172.21.15.43:0/3691949262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0039b0 con 0x55991f5385f0 2023-08-27T11:23:55.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4dd8ff9700 1 -- 172.21.15.43:0/3691949262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc057570 con 0x55991f5385f0 2023-08-27T11:23:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 -- 172.21.15.43:0/3691949262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 msgr2=0x55991f55b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc05f650 tx=0x7f4ddc053bf0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 -- 172.21.15.43:0/3691949262 shutdown_connections 2023-08-27T11:23:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5780b0 0x55991f54cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f55b550 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/3691949262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5389d0 0x55991f533b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 -- 172.21.15.43:0/3691949262 >> 172.21.15.43:0/3691949262 conn(0x55991f496c30 msgr2=0x55991f5366e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 -- 172.21.15.43:0/3691949262 shutdown_connections 2023-08-27T11:23:55.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.971+0000 7f4e042a2b80 1 -- 172.21.15.43:0/3691949262 wait complete. 2023-08-27T11:23:55.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.972+0000 7f4e042a2b80 1 -- start start 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.972+0000 7f4e042a2b80 1 Processor -- start 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f5924f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f54fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f55a800 con 0x55991f5385f0 2023-08-27T11:23:55.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55991f5e3e70 con 0x55991f5780b0 2023-08-27T11:23:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55991f55a5b0 con 0x55991f5389d0 2023-08-27T11:23:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4e042a2b80 10 client.0 _ll_register_callbacks cb 0x55991f426630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.973+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37244/0 (socket says 172.21.15.43:37244) 2023-08-27T11:23:55.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 -- 172.21.15.43:0/2689221366 learned_addr learned my addr 172.21.15.43:0/2689221366 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:55.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f5924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dead9d700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f54fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 -- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 msgr2=0x55991f5924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f5924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 -- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 msgr2=0x55991f54fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f54fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 -- 172.21.15.43:0/2689221366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55991f30a5e0 con 0x55991f5385f0 2023-08-27T11:23:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f5924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:55.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dea59c700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc05f650 tx=0x7f4ddc0037f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846374ca298573bb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:55.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0864d0 con 0x55991f5385f0 2023-08-27T11:23:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ddc00e280 con 0x55991f5385f0 2023-08-27T11:23:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55991f444000 con 0x55991f5385f0 2023-08-27T11:23:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.974+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ddc00e440 con 0x55991f5385f0 2023-08-27T11:23:55.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 10 client.5268 fetch_fsmap learned FSMap version 17 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55991f29fc10 con 0x55991f5385f0 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc063080 con 0x55991f5385f0 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4ddc056c70 con 0x55991f5385f0 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 10 client.5268 fetch_fsmap finished waiting for FSMap version 17 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 10 client.5268 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:23:55.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 20 client.5268 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:55.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f5dd7b0 0x55991f5ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:55.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 4 client.5268 mds_command: new command op to 5085 tid=0[{"prefix": "status"}] 2023-08-27T11:23:55.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 --> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55991f2d7f20 con 0x55991f5dd7b0 2023-08-27T11:23:55.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.975+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f5dd7b0 0x55991f5ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:55.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4dc97fa700 10 client.5268 ms_handle_connect on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:55.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4de9d9b700 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f5dd7b0 0x55991f5ddb90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e516767ab777d0 server_cookie=5cbc8c894a6c61f8 in_seq=0 out_seq=0 2023-08-27T11:23:55.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4dc97fa700 1 -- 172.21.15.43:0/2689221366 <== mds.0 v2:172.21.15.43:6834/1831306112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55991f2d7f20 con 0x55991f5dd7b0 2023-08-27T11:23:55.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4dc97fa700 10 client.5268 handle_command_reply: tid=0 2023-08-27T11:23:55.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 client.5268 shutdown 2023-08-27T11:23:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 msgr2=0x55991f553300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc05f650 tx=0x7f4ddc0037f0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 shutdown_connections 2023-08-27T11:23:55.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x55991f5dd7b0 0x55991f5ddb90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55991f5780b0 0x55991f54fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55991f5385f0 0x55991f553300 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 --2- 172.21.15.43:0/2689221366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55991f5389d0 0x55991f5924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:55.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4dc97fa700 0 client.5268 ms_handle_reset on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:55.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 >> 172.21.15.43:0/2689221366 conn(0x55991f496c30 msgr2=0x55991f54ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:55.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 shutdown_connections 2023-08-27T11:23:55.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 1 -- 172.21.15.43:0/2689221366 wait complete. 2023-08-27T11:23:55.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.976+0000 7f4e042a2b80 20 client.5268 trim_cache size 0 max 16384 2023-08-27T11:23:55.998 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:23:55.998 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:23:55.998 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 5085, 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.6775771690000001, 2023-08-27T11:23:55.999 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 17, 2023-08-27T11:23:56.000 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 34, 2023-08-27T11:23:56.000 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 34, 2023-08-27T11:23:56.000 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 16.509876585000001 2023-08-27T11:23:56.000 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:23:56.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 msgr2=0x7f4dcc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 0x7f4dcc06c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4dec151700 tx=0x7f4de0010000 comp rx=0 tx=0).stop 2023-08-27T11:23:56.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 msgr2=0x7f4dec071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c4d0 tx=0x7f4ddc00c890 comp rx=0 tx=0).stop 2023-08-27T11:23:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 shutdown_connections 2023-08-27T11:23:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dcc06a0e0 0x7f4dcc06c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dec155910 0x7f4dec0a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dec06ca60 0x7f4dec071dc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 --2- 172.21.15.43:0/1454569933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dec0c51a0 0x7f4dec0bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 >> 172.21.15.43:0/1454569933 conn(0x7f4dec06aa50 msgr2=0x7f4dec150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:56.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 shutdown_connections 2023-08-27T11:23:56.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:55.977+0000 7f4df09ff700 1 -- 172.21.15.43:0/1454569933 wait complete. 2023-08-27T11:23:56.005 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:56.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.204+0000 7f6002fff700 1 Processor -- start 2023-08-27T11:23:56.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.204+0000 7f6002fff700 1 -- start start 2023-08-27T11:23:56.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.205+0000 7f6002fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ffc0c51a0 0x7f5ffc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.205+0000 7f6002fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ffc06ca60 0x7f5ffc0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.205+0000 7f6002fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc06d700 con 0x7f5ffc0ab040 2023-08-27T11:23:56.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.205+0000 7f6002fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc1530b0 con 0x7f5ffc06ca60 2023-08-27T11:23:56.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.205+0000 7f6002fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc14c860 con 0x7f5ffc0c51a0 2023-08-27T11:23:56.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ffc06ca60 0x7f5ffc0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ffc06ca60 0x7f5ffc0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37246/0 (socket says 172.21.15.43:37246) 2023-08-27T11:23:56.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f600159c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5ffc0ab040 0x7f5ffc155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42542/0 (socket says 172.21.15.43:42542) 2023-08-27T11:23:56.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 -- 172.21.15.43:0/2423541687 learned_addr learned my addr 172.21.15.43:0/2423541687 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f6000d9b700 1 --2- 172.21.15.43:0/2423541687 >> v2:172.21.15.57:3300/0 conn(0x7f5ffc0c51a0 0x7f5ffc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 -- 172.21.15.43:0/2423541687 >> v2:172.21.15.57:3300/0 conn(0x7f5ffc0c51a0 msgr2=0x7f5ffc06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 --2- 172.21.15.43:0/2423541687 >> v2:172.21.15.57:3300/0 conn(0x7f5ffc0c51a0 0x7f5ffc06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 -- 172.21.15.43:0/2423541687 >> v1:172.21.15.43:6789/0 conn(0x7f5ffc0ab040 legacy=0x7f5ffc155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 -- 172.21.15.43:0/2423541687 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc152430 con 0x7f5ffc06ca60 2023-08-27T11:23:56.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffb7fe700 1 -- 172.21.15.43:0/2423541687 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471644667 0 0) 0x7f5ffc06d700 con 0x7f5ffc0ab040 2023-08-27T11:23:56.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.206+0000 7f5ffbfff700 1 --2- 172.21.15.43:0/2423541687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc0aab00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc06db90 tx=0x7f5fe8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3969390f70da6e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f5ffb7fe700 1 -- 172.21.15.43:0/2423541687 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011830 con 0x7f5ffc06ca60 2023-08-27T11:23:56.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f5ffb7fe700 1 -- 172.21.15.43:0/2423541687 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8011990 con 0x7f5ffc06ca60 2023-08-27T11:23:56.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f5ffb7fe700 1 -- 172.21.15.43:0/2423541687 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8011d20 con 0x7f5ffc06ca60 2023-08-27T11:23:56.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 -- 172.21.15.43:0/2423541687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 msgr2=0x7f5ffc0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 --2- 172.21.15.43:0/2423541687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc0aab00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc06db90 tx=0x7f5fe8009c00 comp rx=0 tx=0).stop 2023-08-27T11:23:56.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 -- 172.21.15.43:0/2423541687 shutdown_connections 2023-08-27T11:23:56.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 --2- 172.21.15.43:0/2423541687 >> v2:172.21.15.57:3300/0 conn(0x7f5ffc0c51a0 0x7f5ffc06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 --2- 172.21.15.43:0/2423541687 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc0aab00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 -- 172.21.15.43:0/2423541687 >> 172.21.15.43:0/2423541687 conn(0x7f5ffc06aa50 msgr2=0x7f5ffc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:56.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 -- 172.21.15.43:0/2423541687 shutdown_connections 2023-08-27T11:23:56.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.207+0000 7f6002fff700 1 -- 172.21.15.43:0/2423541687 wait complete. 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.209+0000 7f6002fff700 1 Processor -- start 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.209+0000 7f6002fff700 1 -- start start 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ffc0ab040 0x7f5ffc14a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 0x7f5ffc14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc06ff90 con 0x7f5ffc06ca60 2023-08-27T11:23:56.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1eb7c0 con 0x7f5ffc0c51a0 2023-08-27T11:23:56.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6002fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc071880 con 0x7f5ffc0ab040 2023-08-27T11:23:56.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6000d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6000d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37258/0 (socket says 172.21.15.43:37258) 2023-08-27T11:23:56.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.210+0000 7f6000d9b700 1 -- 172.21.15.43:0/3656469196 learned_addr learned my addr 172.21.15.43:0/3656469196 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:56.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f5ffbfff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ffc0ab040 0x7f5ffc14a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f600159c700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 0x7f5ffc14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 -- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ffc0ab040 msgr2=0x7f5ffc14a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ffc0ab040 0x7f5ffc14a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 -- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 msgr2=0x7f5ffc14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 0x7f5ffc14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 -- 172.21.15.43:0/3656469196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8009550 con 0x7f5ffc06ca60 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f600159c700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 0x7f5ffc14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6000d9b700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e870 tx=0x7f5ff000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0009590 con 0x7f5ffc06ca60 2023-08-27T11:23:56.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0013680 con 0x7f5ffc06ca60 2023-08-27T11:23:56.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00139f0 con 0x7f5ffc06ca60 2023-08-27T11:23:56.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.211+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc071b60 con 0x7f5ffc06ca60 2023-08-27T11:23:56.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.212+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc0a8120 con 0x7f5ffc06ca60 2023-08-27T11:23:56.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.213+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc0ab8a0 con 0x7f5ffc06ca60 2023-08-27T11:23:56.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.214+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ff0013b50 con 0x7f5ffc06ca60 2023-08-27T11:23:56.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.215+0000 7f5ff97fa700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 0x7f5fe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.215+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ff0088500 con 0x7f5ffc06ca60 2023-08-27T11:23:56.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.215+0000 7f5ffbfff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 0x7f5fe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.216+0000 7f5ffbfff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 0x7f5fe006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.219+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ff0053b50 con 0x7f5ffc06ca60 2023-08-27T11:23:56.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.479+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ffc04ee70 con 0x7f5ffc06ca60 2023-08-27T11:23:56.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.479+0000 7f5ff97fa700 1 -- 172.21.15.43:0/3656469196 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4866 (secure 0 0 0) 0x7f5ff0057170 con 0x7f5ffc06ca60 2023-08-27T11:23:56.482 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:56.482 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:23:52.315776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1831306112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1831306112},{"type":"v1","addr":"172.21.15.43:6836","nonce":1831306112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:23:56.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 msgr2=0x7f5fe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 0x7f5fe006c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009870 tx=0x7f5fe8008030 comp rx=0 tx=0).stop 2023-08-27T11:23:56.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 msgr2=0x7f5ffc1ead40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e870 tx=0x7f5ff000eb80 comp rx=0 tx=0).stop 2023-08-27T11:23:56.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 shutdown_connections 2023-08-27T11:23:56.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fe006a0e0 0x7f5fe006c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ffc0c51a0 0x7f5ffc14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ffc06ca60 0x7f5ffc1ead40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 --2- 172.21.15.43:0/3656469196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ffc0ab040 0x7f5ffc14a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 >> 172.21.15.43:0/3656469196 conn(0x7f5ffc06aa50 msgr2=0x7f5ffc155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:56.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 shutdown_connections 2023-08-27T11:23:56.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.482+0000 7f6002fff700 1 -- 172.21.15.43:0/3656469196 wait complete. 2023-08-27T11:23:56.487 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-08-27T11:23:56.505 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:23:48.777715+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5085": { "addr": "172.21.15.43:6836/1831306112", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1831306112, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 1831306112, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5085, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-08-27T11:23:52.315776+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5085 } } } ], "standbys": [ { "addr": "172.21.15.57:6834/2873976200", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 2873976200, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 2873976200, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4799, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/69565059", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 69565059, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 69565059, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4802, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/651062384", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 651062384, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 651062384, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4808, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:23:56.506 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:23:56.507 INFO:tasks.cephfs.test_failover:current = [{'gid': 4808, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/651062384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 651062384}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 651062384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 4802, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/69565059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 69565059}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 69565059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5085, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1831306112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1831306112}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1831306112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4799, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}] 2023-08-27T11:23:56.507 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.d mds_join_fs cephfs 2023-08-27T11:23:56.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.710+0000 7f8287fff700 1 Processor -- start 2023-08-27T11:23:56.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.710+0000 7f8287fff700 1 -- start start 2023-08-27T11:23:56.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.711+0000 7f8287fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8280155f90 0x7f828006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.711+0000 7f8287fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8280152290 con 0x7f82800c5230 2023-08-27T11:23:56.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8287fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828006d7a0 con 0x7f828006c5e0 2023-08-27T11:23:56.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8287fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8280152550 con 0x7f8280155f90 2023-08-27T11:23:56.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8285d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f82800c5230 0x7f82800aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42556/0 (socket says 172.21.15.43:42556) 2023-08-27T11:23:56.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8285d9b700 1 -- 172.21.15.43:0/3592468030 learned_addr learned my addr 172.21.15.43:0/3592468030 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f828659c700 1 --2- 172.21.15.43:0/3592468030 >> v2:172.21.15.57:3300/0 conn(0x7f8280155f90 0x7f828006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870059676 0 0) 0x7f8280152290 con 0x7f82800c5230 2023-08-27T11:23:56.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c0035b0 con 0x7f82800c5230 2023-08-27T11:23:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820225680 0 0) 0x7f828006d7a0 con 0x7f828006c5e0 2023-08-27T11:23:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280152290 con 0x7f828006c5e0 2023-08-27T11:23:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.712+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2146146773 0 0) 0x7f826c0035b0 con 0x7f82800c5230 2023-08-27T11:23:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 >> v2:172.21.15.57:3300/0 conn(0x7f8280155f90 msgr2=0x7f828006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:56.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 --2- 172.21.15.43:0/3592468030 >> v2:172.21.15.57:3300/0 conn(0x7f8280155f90 0x7f828006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 >> v1:172.21.15.57:6789/0 conn(0x7f828006c5e0 legacy=0x7f8280155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280152830 con 0x7f82800c5230 2023-08-27T11:23:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f827c001670 con 0x7f82800c5230 2023-08-27T11:23:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 >> v1:172.21.15.43:6789/0 conn(0x7f82800c5230 legacy=0x7f82800aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c003c00 0x7f826c004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 0x7f826c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c005260 0x7f826c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280152550 con 0x7f826c004850 2023-08-27T11:23:56.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00c1b0 con 0x7f826c005260 2023-08-27T11:23:56.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00c370 con 0x7f826c003c00 2023-08-27T11:23:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828659c700 1 --2- 172.21.15.43:0/3592468030 >> v2:172.21.15.57:3300/0 conn(0x7f8280155f90 0x7f828006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:23:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 0x7f826c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f8285d9b700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c003c00 0x7f826c004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828659c700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c005260 0x7f826c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 -- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c003c00 msgr2=0x7f826c004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:56.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c003c00 0x7f826c004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 -- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c005260 msgr2=0x7f826c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:56.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c005260 0x7f826c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828559a700 1 -- 172.21.15.43:0/3592468030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0035b0 con 0x7f826c004850 2023-08-27T11:23:56.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828659c700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c005260 0x7f826c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:56.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.713+0000 7f828659c700 1 -- 172.21.15.43:0/3592468030 reap_dead start 2023-08-27T11:23:56.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f828559a700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 0x7f826c004cd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8270007fd0 tx=0x7f826c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a877aecb710d6352 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700052d0 con 0x7f826c004850 2023-08-27T11:23:56.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270005430 con 0x7f826c004850 2023-08-27T11:23:56.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f8284d99700 1 -- 172.21.15.43:0/3592468030 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700038a0 con 0x7f826c004850 2023-08-27T11:23:56.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f8287fff700 1 -- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 msgr2=0x7f826c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.714+0000 7f8287fff700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 0x7f826c004cd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8270007fd0 tx=0x7f826c005880 comp rx=0 tx=0).stop 2023-08-27T11:23:56.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.715+0000 7f8287fff700 1 -- 172.21.15.43:0/3592468030 shutdown_connections 2023-08-27T11:23:56.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.715+0000 7f8287fff700 1 --2- 172.21.15.43:0/3592468030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c004850 0x7f826c004cd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.715+0000 7f8287fff700 1 -- 172.21.15.43:0/3592468030 >> 172.21.15.43:0/3592468030 conn(0x7f82800c5b10 msgr2=0x7f82800c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:56.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.715+0000 7f8287fff700 1 -- 172.21.15.43:0/3592468030 shutdown_connections 2023-08-27T11:23:56.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.715+0000 7f8287fff700 1 -- 172.21.15.43:0/3592468030 wait complete. 2023-08-27T11:23:56.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.716+0000 7f8287fff700 1 Processor -- start 2023-08-27T11:23:56.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 -- start start 2023-08-27T11:23:56.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c004850 0x7f828014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 0x7f8280071f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800aa580 con 0x7f82801e5be0 2023-08-27T11:23:56.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800ab690 con 0x7f8280071880 2023-08-27T11:23:56.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.717+0000 7f8287fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82801e6070 con 0x7f826c004850 2023-08-27T11:23:56.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37282/0 (socket says 172.21.15.43:37282) 2023-08-27T11:23:56.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 -- 172.21.15.43:0/416227730 learned_addr learned my addr 172.21.15.43:0/416227730 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:56.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f8285d9b700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c004850 0x7f828014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828659c700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 0x7f8280071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 -- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c004850 msgr2=0x7f828014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c004850 0x7f828014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 -- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 msgr2=0x7f8280071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 0x7f8280071f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 -- 172.21.15.43:0/416227730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800a9fc0 con 0x7f82801e5be0 2023-08-27T11:23:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828659c700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 0x7f8280071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:23:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.718+0000 7f828559a700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8270015040 tx=0x7f82700012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.719+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700013e0 con 0x7f82801e5be0 2023-08-27T11:23:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.719+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270001d30 con 0x7f82801e5be0 2023-08-27T11:23:56.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.719+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800aa2a0 con 0x7f82801e5be0 2023-08-27T11:23:56.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.719+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000c890 con 0x7f82801e5be0 2023-08-27T11:23:56.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.719+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800c2af0 con 0x7f82801e5be0 2023-08-27T11:23:56.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.720+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800aafd0 con 0x7f82801e5be0 2023-08-27T11:23:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.721+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8270019040 con 0x7f82801e5be0 2023-08-27T11:23:56.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.722+0000 7f82767fc700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 0x7f826406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.722+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8270089120 con 0x7f82801e5be0 2023-08-27T11:23:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.722+0000 7f8285d9b700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 0x7f826406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.723+0000 7f8285d9b700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 0x7f826406c5f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:56.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.726+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f82800aafd0 con 0x7f82801e5be0 2023-08-27T11:23:56.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.936+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f82800ab3b0 con 0x7f82801e5be0 2023-08-27T11:23:56.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.940+0000 7f82767fc700 1 -- 172.21.15.43:0/416227730 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7f82800ab3b0 con 0x7f82801e5be0 2023-08-27T11:23:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 msgr2=0x7f826406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 0x7f826406c5f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c001e00 comp rx=0 tx=0).stop 2023-08-27T11:23:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 msgr2=0x7f82800c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:56.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8270015040 tx=0x7f82700012d0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 shutdown_connections 2023-08-27T11:23:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f826406a130 0x7f826406c5f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8280071880 0x7f8280071f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c004850 0x7f828014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 --2- 172.21.15.43:0/416227730 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82801e5be0 0x7f82800c25b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:56.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.942+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 >> 172.21.15.43:0/416227730 conn(0x7f82800c5b10 msgr2=0x7f82800a6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:56.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.943+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 shutdown_connections 2023-08-27T11:23:56.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:56.943+0000 7f8287fff700 1 -- 172.21.15.43:0/416227730 wait complete. 2023-08-27T11:23:56.962 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:23:57.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.162+0000 7f1f4b3ff700 1 Processor -- start 2023-08-27T11:23:57.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.162+0000 7f1f4b3ff700 1 -- start start 2023-08-27T11:23:57.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.163+0000 7f1f4b3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f440c50d0 0x7f1f440c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.163+0000 7f1f4b3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f440c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.163+0000 7f1f4b3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f44154d00 con 0x7f1f4414e960 2023-08-27T11:23:57.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.163+0000 7f1f4b3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440baf30 con 0x7f1f440c50d0 2023-08-27T11:23:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.163+0000 7f1f4b3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44154fe0 con 0x7f1f44154740 2023-08-27T11:23:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f4919b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1f4414e960 0x7f1f440a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42558/0 (socket says 172.21.15.43:42558) 2023-08-27T11:23:57.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f4919b700 1 -- 172.21.15.43:0/2923863077 learned_addr learned my addr 172.21.15.43:0/2923863077 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:23:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f4899a700 1 --2- 172.21.15.43:0/2923863077 >> v2:172.21.15.57:3300/0 conn(0x7f1f440c50d0 0x7f1f440c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f4999c700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f440c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517492386 0 0) 0x7f1f44154d00 con 0x7f1f4414e960 2023-08-27T11:23:57.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f300034b0 con 0x7f1f4414e960 2023-08-27T11:23:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935288356 0 0) 0x7f1f300034b0 con 0x7f1f4414e960 2023-08-27T11:23:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 msgr2=0x7f1f440c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f440c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 >> v2:172.21.15.57:3300/0 conn(0x7f1f440c50d0 msgr2=0x7f1f440c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:57.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 --2- 172.21.15.43:0/2923863077 >> v2:172.21.15.57:3300/0 conn(0x7f1f440c50d0 0x7f1f440c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f441552c0 con 0x7f1f4414e960 2023-08-27T11:23:57.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f1f40001670 con 0x7f1f4414e960 2023-08-27T11:23:57.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 >> v1:172.21.15.43:6789/0 conn(0x7f1f4414e960 legacy=0x7f1f440a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f30004ae0 0x7f1f30004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f30003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f30004140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440baf30 con 0x7f1f300036f0 2023-08-27T11:23:57.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44154fe0 con 0x7f1f30004ae0 2023-08-27T11:23:57.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.164+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3000fe10 con 0x7f1f44154740 2023-08-27T11:23:57.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f30003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4919b700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f30004ae0 0x7f1f30004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4999c700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f30004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 -- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 msgr2=0x7f1f30004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:57.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44154740 0x7f1f30004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 -- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f30004ae0 msgr2=0x7f1f30004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f30004ae0 0x7f1f30004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 -- 172.21.15.43:0/2923863077 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300034b0 con 0x7f1f300036f0 2023-08-27T11:23:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.165+0000 7f1f4899a700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f30003b70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009b30 tx=0x7f1f30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f6cb258f4e5340 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400e6c0 con 0x7f1f300036f0 2023-08-27T11:23:57.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400e820 con 0x7f1f300036f0 2023-08-27T11:23:57.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f3bfff700 1 -- 172.21.15.43:0/2923863077 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400eb90 con 0x7f1f300036f0 2023-08-27T11:23:57.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/2923863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 msgr2=0x7f1f30003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/2923863077 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f30003b70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009b30 tx=0x7f1f30004770 comp rx=0 tx=0).stop 2023-08-27T11:23:57.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4999c700 1 -- 172.21.15.43:0/2923863077 reap_dead start 2023-08-27T11:23:57.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/2923863077 shutdown_connections 2023-08-27T11:23:57.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/2923863077 >> 172.21.15.43:0/2923863077 conn(0x7f1f4406aa50 msgr2=0x7f1f440c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:57.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/2923863077 shutdown_connections 2023-08-27T11:23:57.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.166+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/2923863077 wait complete. 2023-08-27T11:23:57.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.168+0000 7f1f4b3ff700 1 Processor -- start 2023-08-27T11:23:57.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.168+0000 7f1f4b3ff700 1 -- start start 2023-08-27T11:23:57.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44148820 0x7f1f440aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f440ab470 0x7f1f441e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440aaac0 con 0x7f1f300036f0 2023-08-27T11:23:57.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440a87f0 con 0x7f1f440ab470 2023-08-27T11:23:57.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4b3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440a8a40 con 0x7f1f44148820 2023-08-27T11:23:57.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37298/0 (socket says 172.21.15.43:37298) 2023-08-27T11:23:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.169+0000 7f1f4919b700 1 -- 172.21.15.43:0/1754739626 learned_addr learned my addr 172.21.15.43:0/1754739626 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4899a700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44148820 0x7f1f440aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4999c700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f440ab470 0x7f1f441e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 -- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44148820 msgr2=0x7f1f440aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44148820 0x7f1f440aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 -- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f440ab470 msgr2=0x7f1f441e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f440ab470 0x7f1f441e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 -- 172.21.15.43:0/1754739626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440a8d20 con 0x7f1f300036f0 2023-08-27T11:23:57.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4919b700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007340 tx=0x7f1f40007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:57.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000f6c0 con 0x7f1f300036f0 2023-08-27T11:23:57.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4000f840 con 0x7f1f300036f0 2023-08-27T11:23:57.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440a9000 con 0x7f1f300036f0 2023-08-27T11:23:57.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000fbf0 con 0x7f1f300036f0 2023-08-27T11:23:57.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.170+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f44151f10 con 0x7f1f300036f0 2023-08-27T11:23:57.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.172+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440aad80 con 0x7f1f300036f0 2023-08-27T11:23:57.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.173+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f4000fd50 con 0x7f1f300036f0 2023-08-27T11:23:57.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.174+0000 7f1f39ffb700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 0x7f1f2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:57.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.174+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f40088590 con 0x7f1f300036f0 2023-08-27T11:23:57.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.174+0000 7f1f4899a700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 0x7f1f2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:57.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.175+0000 7f1f4899a700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 0x7f1f2806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f4414c3a0 tx=0x7f1f3401e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:57.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.178+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1f40053be0 con 0x7f1f300036f0 2023-08-27T11:23:57.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.439+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f4404ee70 con 0x7f1f300036f0 2023-08-27T11:23:57.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.439+0000 7f1f39ffb700 1 -- 172.21.15.43:0/1754739626 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4866 (secure 0 0 0) 0x7f1f40057200 con 0x7f1f300036f0 2023-08-27T11:23:57.441 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:23:57.441 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4799,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:23:52.315776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1831306112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1831306112},{"type":"v1","addr":"172.21.15.43:6836","nonce":1831306112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:23:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.441+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 msgr2=0x7f1f2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.441+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 0x7f1f2806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1f4414c3a0 tx=0x7f1f3401e040 comp rx=0 tx=0).stop 2023-08-27T11:23:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.441+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 msgr2=0x7f1f441519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.441+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007340 tx=0x7f1f40007650 comp rx=0 tx=0).stop 2023-08-27T11:23:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 shutdown_connections 2023-08-27T11:23:57.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f2806a0e0 0x7f1f2806c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f440ab470 0x7f1f441e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f300036f0 0x7f1f441519d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 --2- 172.21.15.43:0/1754739626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f44148820 0x7f1f440aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 >> 172.21.15.43:0/1754739626 conn(0x7f1f4406aa50 msgr2=0x7f1f440c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:57.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 shutdown_connections 2023-08-27T11:23:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:57.442+0000 7f1f4b3ff700 1 -- 172.21.15.43:0/1754739626 wait complete. 2023-08-27T11:23:57.446 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 17 2023-08-27T11:23:57.866 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:23:48.777715+0000', 'modified': '2023-08-27T11:23:52.315776+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5085': {'gid': 5085, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1831306112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1831306112}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1831306112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:23:57.867 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:23:57.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:23:58.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.076+0000 7f3bad7ff700 1 Processor -- start 2023-08-27T11:23:58.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.077+0000 7f3bad7ff700 1 -- start start 2023-08-27T11:23:58.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba80c51a0 0x7f3ba806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ba806ca60 0x7f3ba80aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba80ab040 0x7f3ba8155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba81530b0 con 0x7f3ba80ab040 2023-08-27T11:23:58.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba814c860 con 0x7f3ba806ca60 2023-08-27T11:23:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3bad7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba806d700 con 0x7f3ba80c51a0 2023-08-27T11:23:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba80ab040 0x7f3ba8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba80ab040 0x7f3ba8155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37310/0 (socket says 172.21.15.43:37310) 2023-08-27T11:23:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba77fe700 1 -- 172.21.15.43:0/2027244971 learned_addr learned my addr 172.21.15.43:0/2027244971 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba80c51a0 0x7f3ba806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/2027244971 >> v2:172.21.15.57:3300/0 conn(0x7f3ba806ca60 0x7f3ba80aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba77fe700 1 -- 172.21.15.43:0/2027244971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba80c51a0 msgr2=0x7f3ba806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.078+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba80c51a0 0x7f3ba806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba77fe700 1 -- 172.21.15.43:0/2027244971 >> v2:172.21.15.57:3300/0 conn(0x7f3ba806ca60 msgr2=0x7f3ba80aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/2027244971 >> v2:172.21.15.57:3300/0 conn(0x7f3ba806ca60 0x7f3ba80aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba77fe700 1 -- 172.21.15.43:0/2027244971 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8152430 con 0x7f3ba80ab040 2023-08-27T11:23:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80ab040 0x7f3ba8155910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ba806dc80 tx=0x7f3ba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606fbd398e22ca49 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba5ffb700 1 -- 172.21.15.43:0/2027244971 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000e070 con 0x7f3ba80ab040 2023-08-27T11:23:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba5ffb700 1 -- 172.21.15.43:0/2027244971 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba000b940 con 0x7f3ba80ab040 2023-08-27T11:23:58.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.079+0000 7f3ba5ffb700 1 -- 172.21.15.43:0/2027244971 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba000bcf0 con 0x7f3ba80ab040 2023-08-27T11:23:58.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 -- 172.21.15.43:0/2027244971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80ab040 msgr2=0x7f3ba8155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80ab040 0x7f3ba8155910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ba806dc80 tx=0x7f3ba000b330 comp rx=0 tx=0).stop 2023-08-27T11:23:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 -- 172.21.15.43:0/2027244971 shutdown_connections 2023-08-27T11:23:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80ab040 0x7f3ba8155910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/2027244971 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba80c51a0 0x7f3ba806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/2027244971 >> v2:172.21.15.57:3300/0 conn(0x7f3ba806ca60 0x7f3ba80aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 -- 172.21.15.43:0/2027244971 >> 172.21.15.43:0/2027244971 conn(0x7f3ba806aa50 msgr2=0x7f3ba80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 -- 172.21.15.43:0/2027244971 shutdown_connections 2023-08-27T11:23:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.080+0000 7f3bad7ff700 1 -- 172.21.15.43:0/2027244971 wait complete. 2023-08-27T11:23:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.081+0000 7f3bad7ff700 1 Processor -- start 2023-08-27T11:23:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.082+0000 7f3bad7ff700 1 -- start start 2023-08-27T11:23:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 0x7f3ba80a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba80ab040 0x7f3ba80a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 0x7f3ba80a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81ea5b0 con 0x7f3ba80c51a0 2023-08-27T11:23:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba80a5900 con 0x7f3ba80ab040 2023-08-27T11:23:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3bad7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba81ea030 con 0x7f3ba806ca60 2023-08-27T11:23:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 0x7f3ba80a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 0x7f3ba80a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 0x7f3ba80a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:45566/0 (socket says 172.21.15.43:45566) 2023-08-27T11:23:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba6ffd700 1 -- 172.21.15.43:0/4229480103 learned_addr learned my addr 172.21.15.43:0/4229480103 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba80ab040 0x7f3ba80a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 -- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 msgr2=0x7f3ba80a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 0x7f3ba80a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 -- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba80ab040 msgr2=0x7f3ba80a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba80ab040 0x7f3ba80a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.083+0000 7f3ba77fe700 1 -- 172.21.15.43:0/4229480103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0009b30 con 0x7f3ba80c51a0 2023-08-27T11:23:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 0x7f3ba80a62d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8072b20 tx=0x7f3ba0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3b8f7fe700 1 -- 172.21.15.43:0/4229480103 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00092e0 con 0x7f3ba80c51a0 2023-08-27T11:23:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3b8f7fe700 1 -- 172.21.15.43:0/4229480103 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0004250 con 0x7f3ba80c51a0 2023-08-27T11:23:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3b8f7fe700 1 -- 172.21.15.43:0/4229480103 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0004600 con 0x7f3ba80c51a0 2023-08-27T11:23:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba81ea2d0 con 0x7f3ba80c51a0 2023-08-27T11:23:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.084+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba80a9d90 con 0x7f3ba80c51a0 2023-08-27T11:23:58.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.086+0000 7f3b8f7fe700 1 -- 172.21.15.43:0/4229480103 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ba0004760 con 0x7f3ba80c51a0 2023-08-27T11:23:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.087+0000 7f3b8f7fe700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.087+0000 7f3b8f7fe700 1 -- 172.21.15.43:0/4229480103 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ba0089930 con 0x7f3ba80c51a0 2023-08-27T11:23:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.087+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.088+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8151e40 tx=0x7f3b98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.089+0000 7f3bc1166b80 1 Processor -- start 2023-08-27T11:23:58.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 -- start start 2023-08-27T11:23:58.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eaf00 0x563c5010dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c50123500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50048730 con 0x563c500f0fe0 2023-08-27T11:23:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50046050 con 0x563c500eb2e0 2023-08-27T11:23:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.090+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c50041940 con 0x563c500eaf00 2023-08-27T11:23:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37320/0 (socket says 172.21.15.43:37320) 2023-08-27T11:23:58.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 -- 172.21.15.43:0/969368233 learned_addr learned my addr 172.21.15.43:0/969368233 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eaf00 0x563c5010dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c50123500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 -- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eaf00 msgr2=0x563c5010dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eaf00 0x563c5010dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 -- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 msgr2=0x563c50123500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c50123500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 -- 172.21.15.43:0/969368233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c4fec15e0 con 0x563c500f0fe0 2023-08-27T11:23:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.091+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009950 tx=0x7f3b9c009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b54409d036c68a9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3b8d7fa700 1 -- 172.21.15.43:0/969368233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00c070 con 0x563c500f0fe0 2023-08-27T11:23:58.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3b8d7fa700 1 -- 172.21.15.43:0/969368233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c015720 con 0x563c500f0fe0 2023-08-27T11:23:58.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3b8d7fa700 1 -- 172.21.15.43:0/969368233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c015a90 con 0x563c500f0fe0 2023-08-27T11:23:58.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 -- 172.21.15.43:0/969368233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 msgr2=0x563c5010e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009950 tx=0x7f3b9c009c60 comp rx=0 tx=0).stop 2023-08-27T11:23:58.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 -- 172.21.15.43:0/969368233 shutdown_connections 2023-08-27T11:23:58.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c50123500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eaf00 0x563c5010dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/969368233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500f0fe0 0x563c5010e2b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 -- 172.21.15.43:0/969368233 >> 172.21.15.43:0/969368233 conn(0x563c5004dc30 msgr2=0x563c500ed6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.092+0000 7f3bc1166b80 1 -- 172.21.15.43:0/969368233 shutdown_connections 2023-08-27T11:23:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.093+0000 7f3bc1166b80 1 -- 172.21.15.43:0/969368233 wait complete. 2023-08-27T11:23:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.093+0000 7f3bc1166b80 1 -- start start 2023-08-27T11:23:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.093+0000 7f3bc1166b80 1 Processor -- start 2023-08-27T11:23:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c5013e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c50138d10 0x563c5013b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4ffdfb60 con 0x563c500eaf00 2023-08-27T11:23:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c4ffdf860 con 0x563c500eb2e0 2023-08-27T11:23:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.094+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c4fec38d0 con 0x563c50138d10 2023-08-27T11:23:58.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3bc1166b80 10 client.0 _ll_register_callbacks cb 0x563c4ffdd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba67fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c5013e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37322/0 (socket says 172.21.15.43:37322) 2023-08-27T11:23:58.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 -- 172.21.15.43:0/426760528 learned_addr learned my addr 172.21.15.43:0/426760528 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c50138d10 0x563c5013b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 -- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c50138d10 msgr2=0x563c5013b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c50138d10 0x563c5013b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 -- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 msgr2=0x563c5013e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c5013e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 -- 172.21.15.43:0/426760528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c00e040 con 0x563c500eaf00 2023-08-27T11:23:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b98016760 tx=0x7f3b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8f8e7e376c5834 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.095+0000 7f3b85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98014640 con 0x563c500eaf00 2023-08-27T11:23:58.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b980147a0 con 0x563c500eaf00 2023-08-27T11:23:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c500e24f0 con 0x563c500eaf00 2023-08-27T11:23:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b98014960 con 0x563c500eaf00 2023-08-27T11:23:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 10 client.5301 fetch_fsmap learned FSMap version 17 2023-08-27T11:23:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563c50059750 con 0x563c500eaf00 2023-08-27T11:23:58.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c500e24f0 con 0x563c500eaf00 2023-08-27T11:23:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3b98014ac0 con 0x563c500eaf00 2023-08-27T11:23:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 10 client.5301 fetch_fsmap finished waiting for FSMap version 17 2023-08-27T11:23:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 10 client.5301 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:23:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 20 client.5301 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:58.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c5013ee20 0x563c5013bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 4 client.5301 mds_command: new command op to 5085 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:23:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.096+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 --> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c5003a920 con 0x563c5013ee20 2023-08-27T11:23:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.097+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c5013ee20 0x563c5013bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.097+0000 7f3b85ffb700 10 client.5301 ms_handle_connect on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:58.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.097+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c5013ee20 0x563c5013bd20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94933463465e7335 server_cookie=180bd87383300634 in_seq=0 out_seq=0 2023-08-27T11:23:58.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3b85ffb700 1 -- 172.21.15.43:0/426760528 <== mds.0 v2:172.21.15.43:6834/1831306112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563c5003a920 con 0x563c5013ee20 2023-08-27T11:23:58.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3b85ffb700 10 client.5301 handle_command_reply: tid=0 2023-08-27T11:23:58.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 client.5301 shutdown 2023-08-27T11:23:58.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 msgr2=0x563c5012e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3b98016760 tx=0x7f3b98004750 comp rx=0 tx=0).stop 2023-08-27T11:23:58.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 shutdown_connections 2023-08-27T11:23:58.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c50138d10 0x563c5013b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c500eaf00 0x563c5012e140 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c5013ee20 0x563c5013bd20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/426760528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eb2e0 0x563c5013e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3b85ffb700 0 client.5301 ms_handle_reset on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:58.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 >> 172.21.15.43:0/426760528 conn(0x563c5004dc30 msgr2=0x563c5010db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 shutdown_connections 2023-08-27T11:23:58.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.098+0000 7f3bc1166b80 1 -- 172.21.15.43:0/426760528 wait complete. 2023-08-27T11:23:58.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.099+0000 7f3bc1166b80 20 client.5301 trim_cache size 0 max 16384 2023-08-27T11:23:58.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.117+0000 7f3bc1166b80 1 Processor -- start 2023-08-27T11:23:58.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.117+0000 7f3bc1166b80 1 -- start start 2023-08-27T11:23:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c5012f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c50109780 con 0x563c50138d10 2023-08-27T11:23:58.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c5010cb90 con 0x563c500eaf00 2023-08-27T11:23:58.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c5013e860 con 0x563c500eb2e0 2023-08-27T11:23:58.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37334/0 (socket says 172.21.15.43:37334) 2023-08-27T11:23:58.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 -- 172.21.15.43:0/1510774673 learned_addr learned my addr 172.21.15.43:0/1510774673 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c5012f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 -- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 msgr2=0x563c5010f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 -- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 msgr2=0x563c5012f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c5012f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.118+0000 7f3ba77fe700 1 -- 172.21.15.43:0/1510774673 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c4fe6dd90 con 0x563c50138d10 2023-08-27T11:23:58.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0003fd0 tx=0x7f3ba00551f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4beaba018f09dd67 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3b8dffb700 1 -- 172.21.15.43:0/1510774673 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0057120 con 0x563c50138d10 2023-08-27T11:23:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3b8dffb700 1 -- 172.21.15.43:0/1510774673 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba0055490 con 0x563c50138d10 2023-08-27T11:23:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3b8dffb700 1 -- 172.21.15.43:0/1510774673 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0058470 con 0x563c50138d10 2023-08-27T11:23:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 -- 172.21.15.43:0/1510774673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 msgr2=0x563c5010fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0003fd0 tx=0x7f3ba00551f0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 -- 172.21.15.43:0/1510774673 shutdown_connections 2023-08-27T11:23:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c5010fda0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c5012f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/1510774673 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.119+0000 7f3bc1166b80 1 -- 172.21.15.43:0/1510774673 >> 172.21.15.43:0/1510774673 conn(0x563c5004dc30 msgr2=0x563c5014dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.120+0000 7f3bc1166b80 1 -- 172.21.15.43:0/1510774673 shutdown_connections 2023-08-27T11:23:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.120+0000 7f3bc1166b80 1 -- 172.21.15.43:0/1510774673 wait complete. 2023-08-27T11:23:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.120+0000 7f3bc1166b80 1 -- start start 2023-08-27T11:23:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.120+0000 7f3bc1166b80 1 Processor -- start 2023-08-27T11:23:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c500e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c5012f430 con 0x563c50138d10 2023-08-27T11:23:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c501133d0 con 0x563c500eaf00 2023-08-27T11:23:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c5010f180 con 0x563c500eb2e0 2023-08-27T11:23:58.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.121+0000 7f3bc1166b80 10 client.0 _ll_register_callbacks cb 0x563c4ffdd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:23:58.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37340/0 (socket says 172.21.15.43:37340) 2023-08-27T11:23:58.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 -- 172.21.15.43:0/3818729209 learned_addr learned my addr 172.21.15.43:0/3818729209 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:23:58.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 -- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 msgr2=0x563c5010e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c500e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 -- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 msgr2=0x563c500e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:23:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c500e8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 -- 172.21.15.43:0/3818729209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba80a9d90 con 0x563c50138d10 2023-08-27T11:23:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba67fc700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:23:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3ba77fe700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0058a80 tx=0x7f3ba0009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb72ff5ca8461 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:23:58.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3b85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:23:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0087e30 con 0x563c50138d10 2023-08-27T11:23:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ba0060550 con 0x563c50138d10 2023-08-27T11:23:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.122+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b9c015720 con 0x563c50138d10 2023-08-27T11:23:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba0060710 con 0x563c50138d10 2023-08-27T11:23:58.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 10 client.5307 fetch_fsmap learned FSMap version 17 2023-08-27T11:23:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563c4fe56c10 con 0x563c50138d10 2023-08-27T11:23:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c015720 con 0x563c50138d10 2023-08-27T11:23:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ba0054b70 con 0x563c50138d10 2023-08-27T11:23:58.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 10 client.5307 fetch_fsmap finished waiting for FSMap version 17 2023-08-27T11:23:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 10 client.5307 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:23:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 20 client.5307 populate_metadata read hostname 'smithi043' 2023-08-27T11:23:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c50121710 0x563c50121af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:23:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 4 client.5307 mds_command: new command op to 5085 tid=0[{"prefix": "status"}] 2023-08-27T11:23:58.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 --> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c4fffb000 con 0x563c50121710 2023-08-27T11:23:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.123+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c50121710 0x563c50121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:23:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3ba6ffd700 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c50121710 0x563c50121af0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73048fc694e5e11a server_cookie=248fce1228057001 in_seq=0 out_seq=0 2023-08-27T11:23:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3b85ffb700 10 client.5307 ms_handle_connect on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3b85ffb700 1 -- 172.21.15.43:0/3818729209 <== mds.0 v2:172.21.15.43:6834/1831306112 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563c4fffb000 con 0x563c50121710 2023-08-27T11:23:58.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3b85ffb700 10 client.5307 handle_command_reply: tid=0 2023-08-27T11:23:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 client.5307 shutdown 2023-08-27T11:23:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 msgr2=0x563c501211d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0058a80 tx=0x7f3ba0009e80 comp rx=0 tx=0).stop 2023-08-27T11:23:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 shutdown_connections 2023-08-27T11:23:58.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563c50138d10 0x563c501211d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.43:6834/1831306112,v1:172.21.15.43:6836/1831306112] conn(0x563c50121710 0x563c50121af0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x563c500eaf00 0x563c500e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 --2- 172.21.15.43:0/3818729209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x563c500eb2e0 0x563c5010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3b85ffb700 0 client.5307 ms_handle_reset on v2:172.21.15.43:6834/1831306112 2023-08-27T11:23:58.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 >> 172.21.15.43:0/3818729209 conn(0x563c5004dc30 msgr2=0x563c500e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 shutdown_connections 2023-08-27T11:23:58.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.124+0000 7f3bc1166b80 1 -- 172.21.15.43:0/3818729209 wait complete. 2023-08-27T11:23:58.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bc1166b80 20 client.5307 trim_cache size 0 max 16384 2023-08-27T11:23:58.145 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:23:58.145 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:23:58.145 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:23:58.145 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 5085, 2023-08-27T11:23:58.146 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:23:58.146 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:23:58.146 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:23:58.146 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 8.8257561100000004, 2023-08-27T11:23:58.146 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 17, 2023-08-27T11:23:58.147 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 34, 2023-08-27T11:23:58.147 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 34, 2023-08-27T11:23:58.147 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.658045905000002 2023-08-27T11:23:58.147 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:23:58.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 msgr2=0x7f3b9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8151e40 tx=0x7f3b98008040 comp rx=0 tx=0).stop 2023-08-27T11:23:58.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 msgr2=0x7f3ba80a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:23:58.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 0x7f3ba80a62d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8072b20 tx=0x7f3ba0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 shutdown_connections 2023-08-27T11:23:58.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b9406a0e0 0x7f3b9406c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba80c51a0 0x7f3ba80a62d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba806ca60 0x7f3ba80a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 --2- 172.21.15.43:0/4229480103 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba80ab040 0x7f3ba80a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:23:58.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 >> 172.21.15.43:0/4229480103 conn(0x7f3ba806aa50 msgr2=0x7f3ba80bc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:23:58.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 shutdown_connections 2023-08-27T11:23:58.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:23:58.125+0000 7f3bad7ff700 1 -- 172.21.15.43:0/4229480103 wait complete. 2023-08-27T11:23:58.152 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:23:48.777715+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5085": { "addr": "172.21.15.43:6836/1831306112", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1831306112, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 1831306112, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5085, "incarnation": 13, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-08-27T11:23:52.315776+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5085 } } } ], "standbys": [ { "addr": "172.21.15.57:6834/2873976200", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 2873976200, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 2873976200, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 11, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4799, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/69565059", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 69565059, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 69565059, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4802, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/651062384", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 651062384, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 651062384, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4808, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:23:58.153 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': 2, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:23:58.154 INFO:tasks.cephfs.test_failover:current = [{'gid': 4808, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/651062384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 651062384}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 651062384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 4802, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/69565059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 69565059}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 69565059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5085, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1831306112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1831306112}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1831306112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 4799, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 11}] 2023-08-27T11:23:58.154 DEBUG:tasks.cephfs.test_failover:2 != -1 2023-08-27T11:23:58.155 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:23:59.886 INFO:tasks.ceph.mds.c.smithi043.stderr: -325> 2023-08-27T11:23:51.235+0000 7f977f5f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:23:59.936 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:24:03.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:03.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.367+0000 7fef02fff700 1 Processor -- start 2023-08-27T11:24:03.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.368+0000 7fef02fff700 1 -- start start 2023-08-27T11:24:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef02fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 0x7feefc0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef02fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef02fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc154d00 con 0x7feefc14e960 2023-08-27T11:24:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef02fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0baf30 con 0x7feefc0c50d0 2023-08-27T11:24:03.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef02fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc154fe0 con 0x7feefc154740 2023-08-27T11:24:03.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef00d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feefc14e960 0x7feefc0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:50062/0 (socket says 172.21.15.43:50062) 2023-08-27T11:24:03.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef00d9b700 1 -- 172.21.15.43:0/696908652 learned_addr learned my addr 172.21.15.43:0/696908652 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:03.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7fef0159c700 1 --2- 172.21.15.43:0/696908652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7feefbfff700 1 --2- 172.21.15.43:0/696908652 >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 0x7feefc0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.369+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452893186 0 0) 0x7feefc154d00 con 0x7feefc14e960 2023-08-27T11:24:03.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec0035b0 con 0x7feefc14e960 2023-08-27T11:24:03.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7fef0159c700 1 -- 172.21.15.43:0/696908652 >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 msgr2=0x7feefc0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7fef0159c700 1 --2- 172.21.15.43:0/696908652 >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 0x7feefc0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371686409 0 0) 0x7feeec0035b0 con 0x7feefc14e960 2023-08-27T11:24:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7fef0159c700 1 -- 172.21.15.43:0/696908652 >> v1:172.21.15.43:6789/0 conn(0x7feefc14e960 legacy=0x7feefc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7fef0159c700 1 -- 172.21.15.43:0/696908652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc1552c0 con 0x7feefc154740 2023-08-27T11:24:03.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefbfff700 1 --2- 172.21.15.43:0/696908652 >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 0x7feefc0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7fef0159c700 1 --2- 172.21.15.43:0/696908652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc0c4200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef4009d90 tx=0x7feef400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295986ebc3ec3049 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef400e070 con 0x7feefc154740 2023-08-27T11:24:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef4003a20 con 0x7feefc154740 2023-08-27T11:24:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.370+0000 7feefb7fe700 1 -- 172.21.15.43:0/696908652 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0001670 con 0x7feefc154740 2023-08-27T11:24:03.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 -- 172.21.15.43:0/696908652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 msgr2=0x7feefc0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 --2- 172.21.15.43:0/696908652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc0c4200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef4009d90 tx=0x7feef400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 -- 172.21.15.43:0/696908652 shutdown_connections 2023-08-27T11:24:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 --2- 172.21.15.43:0/696908652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc0c4200 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 --2- 172.21.15.43:0/696908652 >> v2:172.21.15.57:3300/0 conn(0x7feefc0c50d0 0x7feefc0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 -- 172.21.15.43:0/696908652 >> 172.21.15.43:0/696908652 conn(0x7feefc06aa50 msgr2=0x7feefc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 -- 172.21.15.43:0/696908652 shutdown_connections 2023-08-27T11:24:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.371+0000 7fef02fff700 1 -- 172.21.15.43:0/696908652 wait complete. 2023-08-27T11:24:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.373+0000 7fef02fff700 1 Processor -- start 2023-08-27T11:24:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.373+0000 7fef02fff700 1 -- start start 2023-08-27T11:24:03.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feefc0c50d0 0x7feefc0aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0bdf60 con 0x7feefc14e960 2023-08-27T11:24:03.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc154360 con 0x7feefc0c50d0 2023-08-27T11:24:03.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7fef02fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc1470f0 con 0x7feefc154740 2023-08-27T11:24:03.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7feefbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7feefbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56670/0 (socket says 172.21.15.43:56670) 2023-08-27T11:24:03.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.374+0000 7feefbfff700 1 -- 172.21.15.43:0/1577366241 learned_addr learned my addr 172.21.15.43:0/1577366241 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:03.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7fef00d9b700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feefc0c50d0 0x7feefc0aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7fef0159c700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 -- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 msgr2=0x7feefc146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 -- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feefc0c50d0 msgr2=0x7feefc0aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feefc0c50d0 0x7feefc0aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 -- 172.21.15.43:0/1577366241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80094a0 con 0x7feefc14e960 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feefbfff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feee800ebb0 tx=0x7feee800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800c910 con 0x7feefc14e960 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee800ca70 con 0x7feefc14e960 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee800ce00 con 0x7feefc14e960 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef4009a70 con 0x7feefc14e960 2023-08-27T11:24:03.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.375+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0be170 con 0x7feefc14e960 2023-08-27T11:24:03.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.376+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc0bb390 con 0x7feefc14e960 2023-08-27T11:24:03.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.377+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feee8013470 con 0x7feefc14e960 2023-08-27T11:24:03.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.379+0000 7feef97fa700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 0x7feee006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:03.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.380+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7feee8088770 con 0x7feefc14e960 2023-08-27T11:24:03.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.380+0000 7fef00d9b700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 0x7feee006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:03.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.380+0000 7fef00d9b700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 0x7feee006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feef00011e0 tx=0x7feef0001550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:03.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.384+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feee8053df0 con 0x7feefc14e960 2023-08-27T11:24:03.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.639+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feefc04ee70 con 0x7feefc14e960 2023-08-27T11:24:03.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.639+0000 7feef97fa700 1 -- 172.21.15.43:0/1577366241 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4866 (secure 0 0 0) 0x7feee8086e60 con 0x7feefc14e960 2023-08-27T11:24:03.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:03.642 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:02.890231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":2,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:03.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 msgr2=0x7feee006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 0x7feee006c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feef00011e0 tx=0x7feef0001550 comp rx=0 tx=0).stop 2023-08-27T11:24:03.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 msgr2=0x7feefc146670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:03.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feee800ebb0 tx=0x7feee800ef70 comp rx=0 tx=0).stop 2023-08-27T11:24:03.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 shutdown_connections 2023-08-27T11:24:03.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feee006a0e0 0x7feee006c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feefc154740 0x7feefc146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feefc0c50d0 0x7feefc0aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 --2- 172.21.15.43:0/1577366241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feefc14e960 0x7feefc146670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:03.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 >> 172.21.15.43:0/1577366241 conn(0x7feefc06aa50 msgr2=0x7feefc1539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:03.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 shutdown_connections 2023-08-27T11:24:03.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:03.642+0000 7fef02fff700 1 -- 172.21.15.43:0/1577366241 wait complete. 2023-08-27T11:24:03.647 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 22 2023-08-27T11:24:04.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:23:48.777715+0000', 'modified': '2023-08-27T11:24:02.890231+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4799}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4799': {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:24:04.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:24:04.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:24:04.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.269+0000 7f6d8f1ff700 1 Processor -- start 2023-08-27T11:24:04.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.269+0000 7f6d8f1ff700 1 -- start start 2023-08-27T11:24:04.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.270+0000 7f6d8f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 0x7f6d8806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.270+0000 7f6d8f1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6d8806ca60 0x7f6d880aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.270+0000 7f6d8f1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6d880ab040 0x7f6d88155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.270+0000 7f6d8f1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d881530b0 con 0x7f6d880ab040 2023-08-27T11:24:04.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8f1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8814c860 con 0x7f6d8806ca60 2023-08-27T11:24:04.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8806d700 con 0x7f6d880c51a0 2023-08-27T11:24:04.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6d880ab040 0x7f6d88155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6d880ab040 0x7f6d88155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56678/0 (socket says 172.21.15.43:56678) 2023-08-27T11:24:04.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 -- 172.21.15.43:0/3750335358 learned_addr learned my addr 172.21.15.43:0/3750335358 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 0x7f6d8806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d87fff700 1 --2- 172.21.15.43:0/3750335358 >> v2:172.21.15.57:3300/0 conn(0x7f6d8806ca60 0x7f6d880aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 -- 172.21.15.43:0/3750335358 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 msgr2=0x7f6d8806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 0x7f6d8806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 -- 172.21.15.43:0/3750335358 >> v2:172.21.15.57:3300/0 conn(0x7f6d8806ca60 msgr2=0x7f6d880aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/3750335358 >> v2:172.21.15.57:3300/0 conn(0x7f6d8806ca60 0x7f6d880aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8d79c700 1 -- 172.21.15.43:0/3750335358 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88152430 con 0x7f6d880ab040 2023-08-27T11:24:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.271+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 0x7f6d8806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.272+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d880ab040 0x7f6d88155910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6d8806dc80 tx=0x7f6d8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66517010bfe48777 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.272+0000 7f6d877fe700 1 -- 172.21.15.43:0/3750335358 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000e070 con 0x7f6d880ab040 2023-08-27T11:24:04.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.272+0000 7f6d877fe700 1 -- 172.21.15.43:0/3750335358 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000b890 con 0x7f6d880ab040 2023-08-27T11:24:04.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.272+0000 7f6d877fe700 1 -- 172.21.15.43:0/3750335358 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000bc40 con 0x7f6d880ab040 2023-08-27T11:24:04.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/3750335358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d880ab040 msgr2=0x7f6d88155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d880ab040 0x7f6d88155910 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6d8806dc80 tx=0x7f6d8000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/3750335358 shutdown_connections 2023-08-27T11:24:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d880ab040 0x7f6d88155910 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/3750335358 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880c51a0 0x7f6d8806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/3750335358 >> v2:172.21.15.57:3300/0 conn(0x7f6d8806ca60 0x7f6d880aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/3750335358 >> 172.21.15.43:0/3750335358 conn(0x7f6d8806aa50 msgr2=0x7f6d880c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/3750335358 shutdown_connections 2023-08-27T11:24:04.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.273+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/3750335358 wait complete. 2023-08-27T11:24:04.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.275+0000 7f6d8f1ff700 1 Processor -- start 2023-08-27T11:24:04.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.275+0000 7f6d8f1ff700 1 -- start start 2023-08-27T11:24:04.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880ab040 0x7f6d880bc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d880c51a0 0x7f6d881509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8806f580 con 0x7f6d8806ca60 2023-08-27T11:24:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880a64b0 con 0x7f6d880c51a0 2023-08-27T11:24:04.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881e80d0 con 0x7f6d880ab040 2023-08-27T11:24:04.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56684/0 (socket says 172.21.15.43:56684) 2023-08-27T11:24:04.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/497739536 learned_addr learned my addr 172.21.15.43:0/497739536 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d87fff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880ab040 0x7f6d880bc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d880c51a0 0x7f6d881509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880ab040 msgr2=0x7f6d880bc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880ab040 0x7f6d880bc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.277+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d880c51a0 msgr2=0x7f6d881509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d880c51a0 0x7f6d881509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/497739536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80009b30 con 0x7f6d8806ca60 2023-08-27T11:24:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e810 tx=0x7f6d7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d857fa700 1 -- 172.21.15.43:0/497739536 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00c020 con 0x7f6d8806ca60 2023-08-27T11:24:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d857fa700 1 -- 172.21.15.43:0/497739536 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c004250 con 0x7f6d8806ca60 2023-08-27T11:24:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d857fa700 1 -- 172.21.15.43:0/497739536 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0036a0 con 0x7f6d8806ca60 2023-08-27T11:24:04.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880bf240 con 0x7f6d8806ca60 2023-08-27T11:24:04.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.278+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d880a6a30 con 0x7f6d8806ca60 2023-08-27T11:24:04.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.282+0000 7f6d857fa700 1 -- 172.21.15.43:0/497739536 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6d7c003800 con 0x7f6d8806ca60 2023-08-27T11:24:04.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.283+0000 7f6d857fa700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 0x7f6d6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.283+0000 7f6d857fa700 1 -- 172.21.15.43:0/497739536 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6d7c0882c0 con 0x7f6d8806ca60 2023-08-27T11:24:04.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.283+0000 7f6d87fff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 0x7f6d6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.284+0000 7f6d87fff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 0x7f6d6c06c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d88156760 tx=0x7f6d74009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.285+0000 7f6da2af0b80 1 Processor -- start 2023-08-27T11:24:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.285+0000 7f6da2af0b80 1 -- start start 2023-08-27T11:24:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 0x56393a09ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a0bc0b0 0x56393a0bc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563939fd5730 con 0x56393a07c9d0 2023-08-27T11:24:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563939fd3050 con 0x56393a07c5f0 2023-08-27T11:24:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563939fce940 con 0x56393a0bc0b0 2023-08-27T11:24:04.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 0x56393a09ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56688/0 (socket says 172.21.15.43:56688) 2023-08-27T11:24:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 0x56393a09ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:51410/0 (socket says 172.21.15.43:51410) 2023-08-27T11:24:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d87fff700 1 -- 172.21.15.43:0/3596355958 learned_addr learned my addr 172.21.15.43:0/3596355958 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.286+0000 7f6d8d79c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a0bc0b0 0x56393a0bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 -- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a0bc0b0 msgr2=0x56393a0bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a0bc0b0 0x56393a0bc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 -- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 msgr2=0x56393a09ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 0x56393a09ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 -- 172.21.15.43:0/3596355958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563939e4e5e0 con 0x56393a07c9d0 2023-08-27T11:24:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d87fff700 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d74004560 tx=0x7f6d74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965142950891e3cd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d727fc700 1 -- 172.21.15.43:0/3596355958 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7401c040 con 0x56393a07c9d0 2023-08-27T11:24:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d727fc700 1 -- 172.21.15.43:0/3596355958 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74004590 con 0x56393a07c9d0 2023-08-27T11:24:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.287+0000 7f6d727fc700 1 -- 172.21.15.43:0/3596355958 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74003ab0 con 0x56393a07c9d0 2023-08-27T11:24:04.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 -- 172.21.15.43:0/3596355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 msgr2=0x56393a09b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d74004560 tx=0x7f6d74014000 comp rx=0 tx=0).stop 2023-08-27T11:24:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 -- 172.21.15.43:0/3596355958 shutdown_connections 2023-08-27T11:24:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a0bc0b0 0x56393a0bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c5f0 0x56393a09ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/3596355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c9d0 0x56393a09b320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 -- 172.21.15.43:0/3596355958 >> 172.21.15.43:0/3596355958 conn(0x563939fdac30 msgr2=0x56393a07a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 -- 172.21.15.43:0/3596355958 shutdown_connections 2023-08-27T11:24:04.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.288+0000 7f6da2af0b80 1 -- 172.21.15.43:0/3596355958 wait complete. 2023-08-27T11:24:04.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.289+0000 7f6da2af0b80 1 -- start start 2023-08-27T11:24:04.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.289+0000 7f6da2af0b80 1 Processor -- start 2023-08-27T11:24:04.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a09d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a092880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x563939f6cb60 con 0x56393a07c5f0 2023-08-27T11:24:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x563939f6c860 con 0x56393a0bc0b0 2023-08-27T11:24:04.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x563939e508d0 con 0x56393a07c9d0 2023-08-27T11:24:04.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6da2af0b80 10 client.0 _ll_register_callbacks cb 0x563939f6a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:04.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56700/0 (socket says 172.21.15.43:56700) 2023-08-27T11:24:04.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/130908123 learned_addr learned my addr 172.21.15.43:0/130908123 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.291+0000 7f6d87fff700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a09d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a092880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 msgr2=0x56393a09d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a09d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 msgr2=0x56393a092880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a092880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/130908123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740041b0 con 0x56393a07c5f0 2023-08-27T11:24:04.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a092880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:04.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c086590 tx=0x7f6d7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23eb5fd3d4469de server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d677fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:04.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0880f0 con 0x56393a07c5f0 2023-08-27T11:24:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563939fc7920 con 0x56393a07c5f0 2023-08-27T11:24:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6d7c05f280 con 0x56393a07c5f0 2023-08-27T11:24:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.292+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d7c086170 con 0x56393a07c5f0 2023-08-27T11:24:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 10 client.5331 fetch_fsmap learned FSMap version 22 2023-08-27T11:24:04.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x563939fe6750 con 0x56393a07c5f0 2023-08-27T11:24:04.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563939fc7920 con 0x56393a07c5f0 2023-08-27T11:24:04.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d7c05edf0 con 0x56393a07c5f0 2023-08-27T11:24:04.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 10 client.5331 fetch_fsmap finished waiting for FSMap version 22 2023-08-27T11:24:04.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 10 client.5331 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:04.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 20 client.5331 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:04.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a092dc0 0x56393a0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 4 client.5331 mds_command: new command op to 4799 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:24:04.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563939f88000 con 0x56393a092dc0 2023-08-27T11:24:04.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.293+0000 7f6d87fff700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a092dc0 0x56393a0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.294+0000 7f6d87fff700 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a092dc0 0x56393a0cc3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736d81a7e7023135 server_cookie=e0e4490d53627d93 in_seq=0 out_seq=0 2023-08-27T11:24:04.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.294+0000 7f6d677fe700 10 client.5331 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:04.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.295+0000 7f6d677fe700 1 -- 172.21.15.43:0/130908123 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563939f88000 con 0x56393a092dc0 2023-08-27T11:24:04.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.295+0000 7f6d677fe700 10 client.5331 handle_command_reply: tid=0 2023-08-27T11:24:04.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.295+0000 7f6da2af0b80 1 client.5331 shutdown 2023-08-27T11:24:04.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.295+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 msgr2=0x56393a09b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.295+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c086590 tx=0x7f6d7c004750 comp rx=0 tx=0).stop 2023-08-27T11:24:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 shutdown_connections 2023-08-27T11:24:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a092dc0 0x56393a0cc3f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a092880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a09b8b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/130908123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a09d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6d677fe700 0 client.5331 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 >> 172.21.15.43:0/130908123 conn(0x563939fdac30 msgr2=0x56393a07a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 shutdown_connections 2023-08-27T11:24:04.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 1 -- 172.21.15.43:0/130908123 wait complete. 2023-08-27T11:24:04.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.296+0000 7f6da2af0b80 20 client.5331 trim_cache size 0 max 16384 2023-08-27T11:24:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.314+0000 7f6da2af0b80 1 Processor -- start 2023-08-27T11:24:04.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.314+0000 7f6da2af0b80 1 -- start start 2023-08-27T11:24:04.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a07b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a07baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393a0bb2e0 con 0x56393a07c5f0 2023-08-27T11:24:04.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393a07cdb0 con 0x56393a0bc0b0 2023-08-27T11:24:04.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56393a09a2e0 con 0x56393a07c9d0 2023-08-27T11:24:04.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6d8cf9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56710/0 (socket says 172.21.15.43:56710) 2023-08-27T11:24:04.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/1541571309 learned_addr learned my addr 172.21.15.43:0/1541571309 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a07baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.315+0000 7f6d87fff700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a07b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 msgr2=0x56393a07b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a07b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 msgr2=0x56393a07baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a07baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 -- 172.21.15.43:0/1541571309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563939dfad90 con 0x56393a07c5f0 2023-08-27T11:24:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d87fff700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a07b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e7e0 tx=0x7f6d7c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e465d9e6240e4ad server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d72ffd700 1 -- 172.21.15.43:0/1541571309 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c05f280 con 0x56393a07c5f0 2023-08-27T11:24:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d72ffd700 1 -- 172.21.15.43:0/1541571309 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c088070 con 0x56393a07c5f0 2023-08-27T11:24:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6d72ffd700 1 -- 172.21.15.43:0/1541571309 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c086170 con 0x56393a07c5f0 2023-08-27T11:24:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6da2af0b80 1 -- 172.21.15.43:0/1541571309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 msgr2=0x56393a0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.316+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e7e0 tx=0x7f6d7c05b000 comp rx=0 tx=0).stop 2023-08-27T11:24:04.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 -- 172.21.15.43:0/1541571309 shutdown_connections 2023-08-27T11:24:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a0bc0b0 0x56393a07baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a07c5f0 0x56393a0cfcf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/1541571309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c9d0 0x56393a07b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 -- 172.21.15.43:0/1541571309 >> 172.21.15.43:0/1541571309 conn(0x563939fdac30 msgr2=0x56393a0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 -- 172.21.15.43:0/1541571309 shutdown_connections 2023-08-27T11:24:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 -- 172.21.15.43:0/1541571309 wait complete. 2023-08-27T11:24:04.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 -- start start 2023-08-27T11:24:04.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.317+0000 7f6da2af0b80 1 Processor -- start 2023-08-27T11:24:04.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 0x56393a124ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 0x56393a125010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393a0bae70 con 0x56393a0bc0b0 2023-08-27T11:24:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393a125860 con 0x56393a07c9d0 2023-08-27T11:24:04.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56393a0b6780 con 0x56393a07c5f0 2023-08-27T11:24:04.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.318+0000 7f6da2af0b80 10 client.0 _ll_register_callbacks cb 0x563939f6a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:04.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56718/0 (socket says 172.21.15.43:56718) 2023-08-27T11:24:04.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 -- 172.21.15.43:0/144978574 learned_addr learned my addr 172.21.15.43:0/144978574 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 0x56393a124ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d87fff700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 0x56393a125010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 -- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 msgr2=0x56393a124ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 0x56393a124ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 -- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 msgr2=0x56393a125010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 0x56393a125010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 -- 172.21.15.43:0/144978574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563939fe6750 con 0x56393a0bc0b0 2023-08-27T11:24:04.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 0x56393a124ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:04.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d87fff700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 0x56393a125010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d8d79c700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009850 tx=0x7f6d80004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5652c1be4d11dbb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.319+0000 7f6d677fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80022040 con 0x56393a0bc0b0 2023-08-27T11:24:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56393a06f4f0 con 0x56393a0bc0b0 2023-08-27T11:24:04.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6d800044d0 con 0x56393a0bc0b0 2023-08-27T11:24:04.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d80004690 con 0x56393a0bc0b0 2023-08-27T11:24:04.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 10 client.5337 fetch_fsmap learned FSMap version 22 2023-08-27T11:24:04.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x563939de3c10 con 0x56393a0bc0b0 2023-08-27T11:24:04.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56393a06f4f0 con 0x56393a0bc0b0 2023-08-27T11:24:04.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 22) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d80025070 con 0x56393a0bc0b0 2023-08-27T11:24:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 10 client.5337 fetch_fsmap finished waiting for FSMap version 22 2023-08-27T11:24:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 10 client.5337 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 20 client.5337 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a122330 0x56393a0991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 4 client.5337 mds_command: new command op to 4799 tid=0[{"prefix": "status"}] 2023-08-27T11:24:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.320+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563939e1bf20 con 0x56393a122330 2023-08-27T11:24:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a122330 0x56393a0991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6d8cf9b700 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a122330 0x56393a0991d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f78d307ed154d9 server_cookie=18c1cb8d532e9a73 in_seq=0 out_seq=0 2023-08-27T11:24:04.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6d677fe700 10 client.5337 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6d677fe700 1 -- 172.21.15.43:0/144978574 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563939e1bf20 con 0x56393a122330 2023-08-27T11:24:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6d677fe700 10 client.5337 handle_command_reply: tid=0 2023-08-27T11:24:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.321+0000 7f6da2af0b80 1 client.5337 shutdown 2023-08-27T11:24:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 msgr2=0x56393a075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009850 tx=0x7f6d80004b40 comp rx=0 tx=0).stop 2023-08-27T11:24:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 shutdown_connections 2023-08-27T11:24:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56393a0bc0b0 0x56393a075f60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56393a07c5f0 0x56393a124ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x56393a122330 0x56393a0991d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 --2- 172.21.15.43:0/144978574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56393a07c9d0 0x56393a125010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 >> 172.21.15.43:0/144978574 conn(0x563939fdac30 msgr2=0x56393a0cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6d677fe700 0 client.5337 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 shutdown_connections 2023-08-27T11:24:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 1 -- 172.21.15.43:0/144978574 wait complete. 2023-08-27T11:24:04.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6da2af0b80 20 client.5337 trim_cache size 0 max 16384 2023-08-27T11:24:04.341 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:24:04.341 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:24:04.341 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:24:04.342 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4799, 2023-08-27T11:24:04.342 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:24:04.342 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:24:04.342 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:24:04.342 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 4.4411186870000003, 2023-08-27T11:24:04.343 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 22, 2023-08-27T11:24:04.343 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 35, 2023-08-27T11:24:04.343 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 35, 2023-08-27T11:24:04.343 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 24.871607395000002 2023-08-27T11:24:04.343 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:24:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 msgr2=0x7f6d6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.322+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 0x7f6d6c06c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6d88156760 tx=0x7f6d74009210 comp rx=0 tx=0).stop 2023-08-27T11:24:04.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 msgr2=0x7f6d881e7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e810 tx=0x7f6d7c00eb20 comp rx=0 tx=0).stop 2023-08-27T11:24:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 shutdown_connections 2023-08-27T11:24:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d6c06a0e0 0x7f6d6c06c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6d880c51a0 0x7f6d881509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6d8806ca60 0x7f6d881e7b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 --2- 172.21.15.43:0/497739536 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6d880ab040 0x7f6d880bc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 >> 172.21.15.43:0/497739536 conn(0x7f6d8806aa50 msgr2=0x7f6d881554b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 shutdown_connections 2023-08-27T11:24:04.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.323+0000 7f6d8f1ff700 1 -- 172.21.15.43:0/497739536 wait complete. 2023-08-27T11:24:04.348 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:23:48.777715+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4799": { "addr": "172.21.15.57:6834/2873976200", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 2873976200, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 2873976200, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4799, "incarnation": 19, "join_fscid": 2, "name": "d", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-08-27T11:24:02.890231+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4799 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/69565059", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 69565059, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 69565059, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4802, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/651062384", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 651062384, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 651062384, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4808, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/3770159957", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3770159957, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3770159957, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5313, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:24:04.349 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': 2, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:24:04.349 INFO:tasks.cephfs.test_failover:current = [{'gid': 4808, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/651062384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 651062384}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 651062384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 4802, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/69565059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 69565059}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 69565059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5313, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/3770159957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3770159957}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3770159957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 20}, {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:24:04.350 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:24:04.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.d mds_join_fs 2023-08-27T11:24:04.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.552+0000 7f9ffc5ff700 1 Processor -- start 2023-08-27T11:24:04.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.553+0000 7f9ffc5ff700 1 -- start start 2023-08-27T11:24:04.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ff4151b20 0x7f9ff40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9ff40c4630 0x7f9ff40c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff4151f00 con 0x7f9ff40c4630 2023-08-27T11:24:04.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff406c450 con 0x7f9ff4151b20 2023-08-27T11:24:04.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4154760 con 0x7f9ff406ad70 2023-08-27T11:24:04.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9ff40c4630 0x7f9ff40c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9ff40c4630 0x7f9ff40c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56728/0 (socket says 172.21.15.43:56728) 2023-08-27T11:24:04.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/196760357 learned_addr learned my addr 172.21.15.43:0/196760357 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffa39b700 1 --2- 172.21.15.43:0/196760357 >> v2:172.21.15.57:3300/0 conn(0x7f9ff4151b20 0x7f9ff40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ffab9c700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/196760357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 msgr2=0x7f9ff406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff406b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/196760357 >> v2:172.21.15.57:3300/0 conn(0x7f9ff4151b20 msgr2=0x7f9ff40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:04.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/196760357 >> v2:172.21.15.57:3300/0 conn(0x7f9ff4151b20 0x7f9ff40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.554+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/196760357 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4154a40 con 0x7f9ff40c4630 2023-08-27T11:24:04.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff40c4ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ac360 tx=0x7f9fe4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86265975e6df519c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ff9399700 1 -- 172.21.15.43:0/196760357 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4005e30 con 0x7f9ff40c4630 2023-08-27T11:24:04.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ff9399700 1 -- 172.21.15.43:0/196760357 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4004030 con 0x7f9ff40c4630 2023-08-27T11:24:04.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ff9399700 1 -- 172.21.15.43:0/196760357 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40043e0 con 0x7f9ff40c4630 2023-08-27T11:24:04.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/196760357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 msgr2=0x7f9ff40c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.555+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff40c4ae0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ac360 tx=0x7f9fe4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/196760357 shutdown_connections 2023-08-27T11:24:04.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/196760357 >> v2:172.21.15.57:3300/0 conn(0x7f9ff4151b20 0x7f9ff40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/196760357 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff40c4ae0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/196760357 >> 172.21.15.43:0/196760357 conn(0x7f9ff40ab820 msgr2=0x7f9ff40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/196760357 shutdown_connections 2023-08-27T11:24:04.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.556+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/196760357 wait complete. 2023-08-27T11:24:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.557+0000 7f9ffc5ff700 1 Processor -- start 2023-08-27T11:24:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.557+0000 7f9ffc5ff700 1 -- start start 2023-08-27T11:24:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ff4151b20 0x7f9ff4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41408e0 con 0x7f9ff40c4630 2023-08-27T11:24:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40c3ad0 con 0x7f9ff4151b20 2023-08-27T11:24:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.558+0000 7f9ffc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40bd480 con 0x7f9ff406ad70 2023-08-27T11:24:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56730/0 (socket says 172.21.15.43:56730) 2023-08-27T11:24:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/2412323313 learned_addr learned my addr 172.21.15.43:0/2412323313 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ffa39b700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ffab9c700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ff4151b20 0x7f9ff4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 msgr2=0x7f9ff414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ff4151b20 msgr2=0x7f9ff4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ff4151b20 0x7f9ff4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 -- 172.21.15.43:0/2412323313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009500 con 0x7f9ff40c4630 2023-08-27T11:24:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.559+0000 7f9ff9b9a700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ac6e0 tx=0x7f9fe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.560+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4003c30 con 0x7f9ff40c4630 2023-08-27T11:24:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.560+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4003d90 con 0x7f9ff40c4630 2023-08-27T11:24:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.560+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe401c640 con 0x7f9ff40c4630 2023-08-27T11:24:04.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.560+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff40c31a0 con 0x7f9ff40c4630 2023-08-27T11:24:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.560+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff40c3760 con 0x7f9ff40c4630 2023-08-27T11:24:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.561+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff40c5ab0 con 0x7f9ff40c4630 2023-08-27T11:24:04.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.562+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9fe401c7a0 con 0x7f9ff40c4630 2023-08-27T11:24:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.563+0000 7f9feaffd700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 0x7f9fd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:04.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.563+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9fe40894e0 con 0x7f9ff40c4630 2023-08-27T11:24:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.563+0000 7f9ffa39b700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 0x7f9fd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.564+0000 7f9ffa39b700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 0x7f9fd806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009ac0 tx=0x7f9ff0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:04.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.567+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9fe4054b60 con 0x7f9ff40c4630 2023-08-27T11:24:04.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.776+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"} v 0) v1 -- 0x7f9ff4153d50 con 0x7f9ff40c4630 2023-08-27T11:24:04.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.780+0000 7f9feaffd700 1 -- 172.21.15.43:0/2412323313 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"}]=0 v13) v1 ==== 96+0+0 (secure 0 0 0) 0x7f9fe4058180 con 0x7f9ff40c4630 2023-08-27T11:24:04.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.782+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 msgr2=0x7f9fd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.782+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 0x7f9fd806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009ac0 tx=0x7f9ff0009210 comp rx=0 tx=0).stop 2023-08-27T11:24:04.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.782+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 msgr2=0x7f9ff41403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:04.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.782+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40ac6e0 tx=0x7f9fe4004750 comp rx=0 tx=0).stop 2023-08-27T11:24:04.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 shutdown_connections 2023-08-27T11:24:04.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fd806a0e0 0x7f9fd806c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ff4151b20 0x7f9ff4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ff406ad70 0x7f9ff414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 --2- 172.21.15.43:0/2412323313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ff40c4630 0x7f9ff41403a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:04.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 >> 172.21.15.43:0/2412323313 conn(0x7f9ff40ab820 msgr2=0x7f9ff406b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:04.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 shutdown_connections 2023-08-27T11:24:04.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:04.783+0000 7f9ffc5ff700 1 -- 172.21.15.43:0/2412323313 wait complete. 2023-08-27T11:24:04.802 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.004+0000 7f4896bff700 1 Processor -- start 2023-08-27T11:24:05.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.005+0000 7f4896bff700 1 -- start start 2023-08-27T11:24:05.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f4896bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f48900c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f4896bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48900c4a90 0x7f489006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f4896bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489006c4e0 con 0x7f48900c4630 2023-08-27T11:24:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f4896bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4890155370 con 0x7f48900c4a90 2023-08-27T11:24:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f4896bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890151e70 con 0x7f4890151a90 2023-08-27T11:24:05.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f488ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f48900c4630 0x7f489006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:50076/0 (socket says 172.21.15.43:50076) 2023-08-27T11:24:05.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f488ffff700 1 -- 172.21.15.43:0/2663946647 learned_addr learned my addr 172.21.15.43:0/2663946647 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:05.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f489519c700 1 --2- 172.21.15.43:0/2663946647 >> v2:172.21.15.57:3300/0 conn(0x7f48900c4a90 0x7f489006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f489499b700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f48900c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639283075 0 0) 0x7f489006c4e0 con 0x7f48900c4630 2023-08-27T11:24:05.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.006+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48800035b0 con 0x7f48900c4630 2023-08-27T11:24:05.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2613789132 0 0) 0x7f48800035b0 con 0x7f48900c4630 2023-08-27T11:24:05.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 msgr2=0x7f48900c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f48900c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 >> v2:172.21.15.57:3300/0 conn(0x7f48900c4a90 msgr2=0x7f489006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 --2- 172.21.15.43:0/2663946647 >> v2:172.21.15.57:3300/0 conn(0x7f48900c4a90 0x7f489006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890154480 con 0x7f48900c4630 2023-08-27T11:24:05.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f487c001670 con 0x7f48900c4630 2023-08-27T11:24:05.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 >> v1:172.21.15.43:6789/0 conn(0x7f48900c4630 legacy=0x7f489006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4880003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4880004850 0x7f4880004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f4880005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890155370 con 0x7f4880003a00 2023-08-27T11:24:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890151e70 con 0x7f4880004850 2023-08-27T11:24:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488000ba60 con 0x7f4890151a90 2023-08-27T11:24:05.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f489499b700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4880003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f489519c700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f4880005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.007+0000 7f488ffff700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4880004850 0x7f4880004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 -- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 msgr2=0x7f4880005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890151a90 0x7f4880005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 -- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4880004850 msgr2=0x7f4880004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4880004850 0x7f4880004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 -- 172.21.15.43:0/2663946647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800035b0 con 0x7f4880003a00 2023-08-27T11:24:05.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489499b700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4880003e20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4884009b90 tx=0x7f4880005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e86d100eff0fc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400e6c0 con 0x7f4880003a00 2023-08-27T11:24:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400e820 con 0x7f4880003a00 2023-08-27T11:24:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f488f7fe700 1 -- 172.21.15.43:0/2663946647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400eb90 con 0x7f4880003a00 2023-08-27T11:24:05.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f4896bff700 1 -- 172.21.15.43:0/2663946647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 msgr2=0x7f4880003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f4896bff700 1 --2- 172.21.15.43:0/2663946647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4880003e20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4884009b90 tx=0x7f4880005880 comp rx=0 tx=0).stop 2023-08-27T11:24:05.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.008+0000 7f489519c700 1 -- 172.21.15.43:0/2663946647 reap_dead start 2023-08-27T11:24:05.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.009+0000 7f4896bff700 1 -- 172.21.15.43:0/2663946647 shutdown_connections 2023-08-27T11:24:05.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.009+0000 7f4896bff700 1 -- 172.21.15.43:0/2663946647 >> 172.21.15.43:0/2663946647 conn(0x7f48900ab820 msgr2=0x7f48900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.009+0000 7f4896bff700 1 -- 172.21.15.43:0/2663946647 shutdown_connections 2023-08-27T11:24:05.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.009+0000 7f4896bff700 1 -- 172.21.15.43:0/2663946647 wait complete. 2023-08-27T11:24:05.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.010+0000 7f4896bff700 1 Processor -- start 2023-08-27T11:24:05.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.011+0000 7f4896bff700 1 -- start start 2023-08-27T11:24:05.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890158380 0x7f48901ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 0x7f489014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900c13d0 con 0x7f4880003a00 2023-08-27T11:24:05.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901559e0 con 0x7f48901ed560 2023-08-27T11:24:05.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f4896bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489014cd20 con 0x7f4890158380 2023-08-27T11:24:05.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56736/0 (socket says 172.21.15.43:56736) 2023-08-27T11:24:05.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 -- 172.21.15.43:0/2588050458 learned_addr learned my addr 172.21.15.43:0/2588050458 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f488ffff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890158380 0x7f48901ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489519c700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 0x7f489014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 -- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890158380 msgr2=0x7f48901ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890158380 0x7f48901ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 -- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 msgr2=0x7f489014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 0x7f489014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489499b700 1 -- 172.21.15.43:0/2588050458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890158800 con 0x7f4880003a00 2023-08-27T11:24:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.012+0000 7f489519c700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 0x7f489014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f489499b700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48840090b0 tx=0x7f48840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400e6c0 con 0x7f4880003a00 2023-08-27T11:24:05.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840038c0 con 0x7f4880003a00 2023-08-27T11:24:05.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4884003c70 con 0x7f4880003a00 2023-08-27T11:24:05.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48900c32c0 con 0x7f4880003a00 2023-08-27T11:24:05.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.013+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48900c3880 con 0x7f4880003a00 2023-08-27T11:24:05.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.014+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900abc30 con 0x7f4880003a00 2023-08-27T11:24:05.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.015+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4884013470 con 0x7f4880003a00 2023-08-27T11:24:05.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.016+0000 7f488d7fa700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 0x7f487406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.016+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f4884089dd0 con 0x7f4880003a00 2023-08-27T11:24:05.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.016+0000 7f488ffff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 0x7f487406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.017+0000 7f488ffff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 0x7f487406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f487c001050 tx=0x7f487c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.020+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f48840554f0 con 0x7f4880003a00 2023-08-27T11:24:05.220 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:24:05.219+0000 7fb2517f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:24:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.273+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f489004ee70 con 0x7f4880003a00 2023-08-27T11:24:05.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.273+0000 7f488d7fa700 1 -- 172.21.15.43:0/2588050458 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4866 (secure 0 0 0) 0x7f4884058b10 con 0x7f4880003a00 2023-08-27T11:24:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:05.275 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:02.890231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":2,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:05.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 msgr2=0x7f487406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 0x7f487406c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f487c001050 tx=0x7f487c007040 comp rx=0 tx=0).stop 2023-08-27T11:24:05.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 msgr2=0x7f4890157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f48840090b0 tx=0x7f48840047c0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 shutdown_connections 2023-08-27T11:24:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f487406a0e0 0x7f487406c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48901ed560 0x7f489014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4880003a00 0x7f4890157e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 --2- 172.21.15.43:0/2588050458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4890158380 0x7f48901ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 >> 172.21.15.43:0/2588050458 conn(0x7f48900ab820 msgr2=0x7f4890150680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 shutdown_connections 2023-08-27T11:24:05.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.276+0000 7f4896bff700 1 -- 172.21.15.43:0/2588050458 wait complete. 2023-08-27T11:24:05.280 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 22 2023-08-27T11:24:05.698 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:23:48.777715+0000', 'modified': '2023-08-27T11:24:02.890231+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4799}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4799': {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:24:05.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:24:05.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:24:05.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.904+0000 7f270b5ff700 1 Processor -- start 2023-08-27T11:24:05.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.904+0000 7f270b5ff700 1 -- start start 2023-08-27T11:24:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270b5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f270406ca60 0x7f270406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270b5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2704155910 0x7f2704155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270b5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270406d700 con 0x7f27040c51a0 2023-08-27T11:24:05.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270b5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27041530b0 con 0x7f2704155910 2023-08-27T11:24:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270b5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270414c860 con 0x7f270406ca60 2023-08-27T11:24:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270939b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f27040c51a0 0x7f27040aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:50086/0 (socket says 172.21.15.43:50086) 2023-08-27T11:24:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f270939b700 1 -- 172.21.15.43:0/2599936065 learned_addr learned my addr 172.21.15.43:0/2599936065 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2709b9c700 1 --2- 172.21.15.43:0/2599936065 >> v2:172.21.15.43:3300/0 conn(0x7f2704155910 0x7f2704155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2708b9a700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f270406ca60 0x7f270406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f26fbfff700 1 -- 172.21.15.43:0/2599936065 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440610656 0 0) 0x7f270406d700 con 0x7f27040c51a0 2023-08-27T11:24:05.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2709b9c700 1 -- 172.21.15.43:0/2599936065 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f270406ca60 msgr2=0x7f270406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2709b9c700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f270406ca60 0x7f270406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2709b9c700 1 -- 172.21.15.43:0/2599936065 >> v1:172.21.15.43:6789/0 conn(0x7f27040c51a0 legacy=0x7f27040aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.906+0000 7f2709b9c700 1 -- 172.21.15.43:0/2599936065 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704152430 con 0x7f2704155910 2023-08-27T11:24:05.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f2709b9c700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2704155910 0x7f2704155da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009dc0 tx=0x7f26fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a03f10629a0e37 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f26fbfff700 1 -- 172.21.15.43:0/2599936065 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00e070 con 0x7f2704155910 2023-08-27T11:24:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f26fbfff700 1 -- 172.21.15.43:0/2599936065 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00bae0 con 0x7f2704155910 2023-08-27T11:24:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f26fbfff700 1 -- 172.21.15.43:0/2599936065 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00be90 con 0x7f2704155910 2023-08-27T11:24:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f270b5ff700 1 -- 172.21.15.43:0/2599936065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2704155910 msgr2=0x7f2704155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.907+0000 7f270b5ff700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2704155910 0x7f2704155da0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009dc0 tx=0x7f26fc00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 -- 172.21.15.43:0/2599936065 shutdown_connections 2023-08-27T11:24:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2704155910 0x7f2704155da0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 --2- 172.21.15.43:0/2599936065 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f270406ca60 0x7f270406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 -- 172.21.15.43:0/2599936065 >> 172.21.15.43:0/2599936065 conn(0x7f270406aa50 msgr2=0x7f27040c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 -- 172.21.15.43:0/2599936065 shutdown_connections 2023-08-27T11:24:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.908+0000 7f270b5ff700 1 -- 172.21.15.43:0/2599936065 wait complete. 2023-08-27T11:24:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.910+0000 7f270b5ff700 1 Processor -- start 2023-08-27T11:24:05.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.910+0000 7f270b5ff700 1 -- start start 2023-08-27T11:24:05.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.911+0000 7f270b5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f270406ca60 0x7f27041dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.911+0000 7f270b5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f270b5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2704155910 0x7f27040bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f270b5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270414bd80 con 0x7f27040c51a0 2023-08-27T11:24:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f270b5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270414bf30 con 0x7f270406ca60 2023-08-27T11:24:05.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f270b5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270414c4f0 con 0x7f2704155910 2023-08-27T11:24:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56744/0 (socket says 172.21.15.43:56744) 2023-08-27T11:24:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 -- 172.21.15.43:0/3322543589 learned_addr learned my addr 172.21.15.43:0/3322543589 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f270939b700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f270406ca60 0x7f27041dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2709b9c700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2704155910 0x7f27040bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 -- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2704155910 msgr2=0x7f27040bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2704155910 0x7f27040bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 -- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f270406ca60 msgr2=0x7f27041dcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f270406ca60 0x7f27041dcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.912+0000 7f2708b9a700 1 -- 172.21.15.43:0/3322543589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009a70 con 0x7f27040c51a0 2023-08-27T11:24:05.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e9b0 tx=0x7f26f400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f26f9ffb700 1 -- 172.21.15.43:0/3322543589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4009710 con 0x7f27040c51a0 2023-08-27T11:24:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f26f9ffb700 1 -- 172.21.15.43:0/3322543589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f400ee50 con 0x7f27040c51a0 2023-08-27T11:24:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f26f9ffb700 1 -- 172.21.15.43:0/3322543589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f400ca50 con 0x7f27040c51a0 2023-08-27T11:24:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040aa3e0 con 0x7f27040c51a0 2023-08-27T11:24:05.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.913+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270414c180 con 0x7f27040c51a0 2023-08-27T11:24:05.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.915+0000 7f26f9ffb700 1 -- 172.21.15.43:0/3322543589 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26f400cbb0 con 0x7f27040c51a0 2023-08-27T11:24:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.916+0000 7f26f9ffb700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.916+0000 7f26f9ffb700 1 -- 172.21.15.43:0/3322543589 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f26f4088580 con 0x7f27040c51a0 2023-08-27T11:24:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.917+0000 7f270939b700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.917+0000 7f270939b700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 0x7f26e806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2700007fd0 tx=0x7f2700007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.918+0000 7f271ee67b80 1 Processor -- start 2023-08-27T11:24:05.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.918+0000 7f271ee67b80 1 -- start start 2023-08-27T11:24:05.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bef00 0x5651c36e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36c4fe0 0x5651c36e22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c361c730 con 0x5651c36bf2e0 2023-08-27T11:24:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c361a050 con 0x5651c36c4fe0 2023-08-27T11:24:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c3615940 con 0x5651c36bef00 2023-08-27T11:24:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.919+0000 7f2709b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56746/0 (socket says 172.21.15.43:56746) 2023-08-27T11:24:05.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 -- 172.21.15.43:0/3662942895 learned_addr learned my addr 172.21.15.43:0/3662942895 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36c4fe0 0x5651c36e22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f270939b700 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bef00 0x5651c36e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 -- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bef00 msgr2=0x5651c36e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bef00 0x5651c36e1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 -- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36c4fe0 msgr2=0x5651c36e22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36c4fe0 0x5651c36e22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 -- 172.21.15.43:0/3662942895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c34955e0 con 0x5651c36bf2e0 2023-08-27T11:24:05.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.920+0000 7f2709b9c700 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00b370 tx=0x7f26fc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8c8e5a4d7aeb9a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.922+0000 7f26e6ffd700 1 -- 172.21.15.43:0/3662942895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc003d10 con 0x5651c36bf2e0 2023-08-27T11:24:05.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.922+0000 7f26e6ffd700 1 -- 172.21.15.43:0/3662942895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc003e70 con 0x5651c36bf2e0 2023-08-27T11:24:05.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.922+0000 7f26e6ffd700 1 -- 172.21.15.43:0/3662942895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc004240 con 0x5651c36bf2e0 2023-08-27T11:24:05.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 -- 172.21.15.43:0/3662942895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 msgr2=0x5651c36f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00b370 tx=0x7f26fc010000 comp rx=0 tx=0).stop 2023-08-27T11:24:05.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 -- 172.21.15.43:0/3662942895 shutdown_connections 2023-08-27T11:24:05.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36f7500 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bef00 0x5651c36e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3662942895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36c4fe0 0x5651c36e22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 -- 172.21.15.43:0/3662942895 >> 172.21.15.43:0/3662942895 conn(0x5651c3621c30 msgr2=0x5651c36c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 -- 172.21.15.43:0/3662942895 shutdown_connections 2023-08-27T11:24:05.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.923+0000 7f271ee67b80 1 -- 172.21.15.43:0/3662942895 wait complete. 2023-08-27T11:24:05.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.924+0000 7f271ee67b80 1 -- start start 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.924+0000 7f271ee67b80 1 Processor -- start 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c37004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c35b3b60 con 0x5651c36bf2e0 2023-08-27T11:24:05.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c35b3860 con 0x5651c36bef00 2023-08-27T11:24:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c34978d0 con 0x5651c3700070 2023-08-27T11:24:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f271ee67b80 10 client.0 _ll_register_callbacks cb 0x5651c35b1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56748/0 (socket says 172.21.15.43:56748) 2023-08-27T11:24:05.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.926+0000 7f2708b9a700 1 -- 172.21.15.43:0/2248037904 learned_addr learned my addr 172.21.15.43:0/2248037904 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 -- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 msgr2=0x5651c37004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c37004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 -- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 msgr2=0x5651c36e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 -- 172.21.15.43:0/2248037904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2704152430 con 0x5651c36bf2e0 2023-08-27T11:24:05.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f2708b9a700 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26f40868f0 tx=0x7f26f405b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33503b476387711a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:05.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4055d30 con 0x5651c36bf2e0 2023-08-27T11:24:05.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f26f405b170 con 0x5651c36bf2e0 2023-08-27T11:24:05.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651c36b64f0 con 0x5651c36bf2e0 2023-08-27T11:24:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26f405b330 con 0x5651c36bf2e0 2023-08-27T11:24:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f271ee67b80 10 client.5364 fetch_fsmap learned FSMap version 23 2023-08-27T11:24:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5651c362d750 con 0x5651c36bf2e0 2023-08-27T11:24:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651c36b64f0 con 0x5651c36bf2e0 2023-08-27T11:24:05.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f26f4088070 con 0x5651c36bf2e0 2023-08-27T11:24:05.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f271ee67b80 10 client.5364 fetch_fsmap finished waiting for FSMap version 23 2023-08-27T11:24:05.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.927+0000 7f271ee67b80 10 client.5364 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:05.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f271ee67b80 20 client.5364 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:05.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c36fdd40 0x5651c36fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f271ee67b80 4 client.5364 mds_command: new command op to 4799 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:24:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651c360e920 con 0x5651c36fdd40 2023-08-27T11:24:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f270939b700 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c36fdd40 0x5651c36fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f270939b700 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c36fdd40 0x5651c36fe160 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78d2e0f6d6153094 server_cookie=63fd287772e79bb in_seq=0 out_seq=0 2023-08-27T11:24:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.928+0000 7f26dffff700 10 client.5364 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:05.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.929+0000 7f26dffff700 1 -- 172.21.15.43:0/2248037904 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651c360e920 con 0x5651c36fdd40 2023-08-27T11:24:05.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.929+0000 7f26dffff700 10 client.5364 handle_command_reply: tid=0 2023-08-27T11:24:05.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.929+0000 7f271ee67b80 1 client.5364 shutdown 2023-08-27T11:24:05.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.929+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 msgr2=0x5651c370fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f26f40868f0 tx=0x7f26f405b7c0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 shutdown_connections 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c37004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c36fdd40 0x5651c36fe160 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 --2- 172.21.15.43:0/2248037904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c370fcc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f26dffff700 0 client.5364 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:05.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 >> 172.21.15.43:0/2248037904 conn(0x5651c3621c30 msgr2=0x5651c36bcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 shutdown_connections 2023-08-27T11:24:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 1 -- 172.21.15.43:0/2248037904 wait complete. 2023-08-27T11:24:05.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.930+0000 7f271ee67b80 20 client.5364 trim_cache size 0 max 16384 2023-08-27T11:24:05.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.948+0000 7f271ee67b80 1 Processor -- start 2023-08-27T11:24:05.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.948+0000 7f271ee67b80 1 -- start start 2023-08-27T11:24:05.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c36c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c3701520 con 0x5651c36bf2e0 2023-08-27T11:24:05.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c3701a00 con 0x5651c36bef00 2023-08-27T11:24:05.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c36c19a0 con 0x5651c3700070 2023-08-27T11:24:05.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f2708b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56750/0 (socket says 172.21.15.43:56750) 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.949+0000 7f2708b9a700 1 -- 172.21.15.43:0/4105574341 learned_addr learned my addr 172.21.15.43:0/4105574341 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 -- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 msgr2=0x5651c36c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c36c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 -- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 msgr2=0x5651c36e6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 -- 172.21.15.43:0/4105574341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c3441d90 con 0x5651c36bf2e0 2023-08-27T11:24:05.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f2708b9a700 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f26f405f0b0 tx=0x7f26f401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86195a0f3c6c0a6e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f26e77fe700 1 -- 172.21.15.43:0/4105574341 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4055d30 con 0x5651c36bf2e0 2023-08-27T11:24:05.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f26e77fe700 1 -- 172.21.15.43:0/4105574341 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f406ae90 con 0x5651c36bf2e0 2023-08-27T11:24:05.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.950+0000 7f26e77fe700 1 -- 172.21.15.43:0/4105574341 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f405b170 con 0x5651c36bf2e0 2023-08-27T11:24:05.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- 172.21.15.43:0/4105574341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 msgr2=0x5651c36c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f26f405f0b0 tx=0x7f26f401e000 comp rx=0 tx=0).stop 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- 172.21.15.43:0/4105574341 shutdown_connections 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c3700070 0x5651c36c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c36bef00 0x5651c36e6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 --2- 172.21.15.43:0/4105574341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bf2e0 0x5651c36c3340 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- 172.21.15.43:0/4105574341 >> 172.21.15.43:0/4105574341 conn(0x5651c3621c30 msgr2=0x5651c36bcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- 172.21.15.43:0/4105574341 shutdown_connections 2023-08-27T11:24:05.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- 172.21.15.43:0/4105574341 wait complete. 2023-08-27T11:24:05.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.951+0000 7f271ee67b80 1 -- start start 2023-08-27T11:24:05.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.952+0000 7f271ee67b80 1 Processor -- start 2023-08-27T11:24:05.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bf2e0 0x5651c376a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c3700070 0x5651c376a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c376ac30 con 0x5651c36bef00 2023-08-27T11:24:05.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c376ada0 con 0x5651c3700070 2023-08-27T11:24:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c36fd410 con 0x5651c36bf2e0 2023-08-27T11:24:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f271ee67b80 10 client.0 _ll_register_callbacks cb 0x5651c35b1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56764/0 (socket says 172.21.15.43:56764) 2023-08-27T11:24:05.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 -- 172.21.15.43:0/3550539165 learned_addr learned my addr 172.21.15.43:0/3550539165 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bf2e0 0x5651c376a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f2709b9c700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c3700070 0x5651c376a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 -- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bf2e0 msgr2=0x5651c376a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bf2e0 0x5651c376a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 -- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c3700070 msgr2=0x5651c376a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:05.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c3700070 0x5651c376a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.953+0000 7f270939b700 1 -- 172.21.15.43:0/3550539165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651c362d750 con 0x5651c36bef00 2023-08-27T11:24:05.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f270939b700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5651c36c0f80 tx=0x7f2700024d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed595ee2d7675c37 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:05.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:05.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000245d0 con 0x5651c36bef00 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f270001b040 con 0x5651c36bef00 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26fc003e70 con 0x5651c36bef00 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2700024e60 con 0x5651c36bef00 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 10 client.5370 fetch_fsmap learned FSMap version 23 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5651c342ac10 con 0x5651c36bef00 2023-08-27T11:24:05.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc003e70 con 0x5651c36bef00 2023-08-27T11:24:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f270002c030 con 0x5651c36bef00 2023-08-27T11:24:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 10 client.5370 fetch_fsmap finished waiting for FSMap version 23 2023-08-27T11:24:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 10 client.5370 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 20 client.5370 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:05.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.954+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c3764370 0x5651c370e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:05.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.955+0000 7f271ee67b80 4 client.5370 mds_command: new command op to 4799 tid=0[{"prefix": "status"}] 2023-08-27T11:24:05.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.955+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651c35cf000 con 0x5651c3764370 2023-08-27T11:24:05.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.955+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c3764370 0x5651c370e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:05.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.955+0000 7f2708b9a700 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c3764370 0x5651c370e380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8eb88fe9b3baa1 server_cookie=717daada1cc2adac in_seq=0 out_seq=0 2023-08-27T11:24:05.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.955+0000 7f26dffff700 10 client.5370 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f26dffff700 1 -- 172.21.15.43:0/3550539165 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5651c35cf000 con 0x5651c3764370 2023-08-27T11:24:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f26dffff700 10 client.5370 handle_command_reply: tid=0 2023-08-27T11:24:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 client.5370 shutdown 2023-08-27T11:24:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 msgr2=0x5651c36e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x5651c36c0f80 tx=0x7f2700024d40 comp rx=0 tx=0).stop 2023-08-27T11:24:05.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 shutdown_connections 2023-08-27T11:24:05.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x5651c3764370 0x5651c370e380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5651c3700070 0x5651c376a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651c36bef00 0x5651c36e6f10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f26dffff700 0 client.5370 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:05.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 --2- 172.21.15.43:0/3550539165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5651c36bf2e0 0x5651c376a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 >> 172.21.15.43:0/3550539165 conn(0x5651c3621c30 msgr2=0x5651c37029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 shutdown_connections 2023-08-27T11:24:05.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 1 -- 172.21.15.43:0/3550539165 wait complete. 2023-08-27T11:24:05.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.956+0000 7f271ee67b80 20 client.5370 trim_cache size 0 max 16384 2023-08-27T11:24:05.971 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:24:05.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:24:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:24:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4799, 2023-08-27T11:24:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:24:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:24:05.972 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:24:05.973 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.0753545889999998, 2023-08-27T11:24:05.973 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 23, 2023-08-27T11:24:05.973 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 35, 2023-08-27T11:24:05.973 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 35, 2023-08-27T11:24:05.973 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 26.505838967999999 2023-08-27T11:24:05.974 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:24:05.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 msgr2=0x7f26e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 0x7f26e806c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2700007fd0 tx=0x7f2700007de0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 msgr2=0x7f27040beb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f26f400e9b0 tx=0x7f26f400ecc0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 shutdown_connections 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26e806a0e0 0x7f26e806c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2704155910 0x7f27040bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f270406ca60 0x7f27041dcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 --2- 172.21.15.43:0/3322543589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27040c51a0 0x7f27040beb80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 >> 172.21.15.43:0/3322543589 conn(0x7f270406aa50 msgr2=0x7f2704155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:05.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 shutdown_connections 2023-08-27T11:24:05.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:05.957+0000 7f270b5ff700 1 -- 172.21.15.43:0/3322543589 wait complete. 2023-08-27T11:24:05.978 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 22, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:23:48.777715+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 22, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4799": { "addr": "172.21.15.57:6834/2873976200", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 2873976200, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 2873976200, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4799, "incarnation": 19, "join_fscid": 2, "name": "d", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-08-27T11:24:02.890231+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4799 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/69565059", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 69565059, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 69565059, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4802, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/651062384", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 651062384, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 651062384, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4808, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/3770159957", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3770159957, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3770159957, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5313, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:24:05.979 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:24:05.979 INFO:tasks.cephfs.test_failover:current = [{'gid': 4808, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/651062384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 651062384}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 651062384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 4802, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/69565059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 69565059}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 69565059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5313, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/3770159957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3770159957}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3770159957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 20}, {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:24:05.980 DEBUG:tasks.cephfs.test_failover:-1 != 2 2023-08-27T11:24:05.980 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:24:10.283 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:24:10.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:24:10.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:11.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.193+0000 7fc5571ff700 1 Processor -- start 2023-08-27T11:24:11.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.193+0000 7fc5571ff700 1 -- start start 2023-08-27T11:24:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.194+0000 7fc5571ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc550151910 0x7fc550157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.194+0000 7fc5571ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc5500c15e0 0x7fc550157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.194+0000 7fc5571ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500c5ae0 con 0x7fc5500c51a0 2023-08-27T11:24:11.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.194+0000 7fc5571ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc550158480 con 0x7fc5500c15e0 2023-08-27T11:24:11.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.194+0000 7fc5571ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5500c1190 con 0x7fc550151910 2023-08-27T11:24:11.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc54ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc5500c51a0 0x7fc5500c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46134/0 (socket says 172.21.15.43:46134) 2023-08-27T11:24:11.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc54ffff700 1 -- 172.21.15.43:0/3507023506 learned_addr learned my addr 172.21.15.43:0/3507023506 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:11.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc55579c700 1 --2- 172.21.15.43:0/3507023506 >> v2:172.21.15.43:3300/0 conn(0x7fc5500c15e0 0x7fc550157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc554f9b700 1 --2- 172.21.15.43:0/3507023506 >> v2:172.21.15.57:3300/0 conn(0x7fc550151910 0x7fc550157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc55579c700 1 -- 172.21.15.43:0/3507023506 >> v2:172.21.15.57:3300/0 conn(0x7fc550151910 msgr2=0x7fc550157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:11.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc55579c700 1 --2- 172.21.15.43:0/3507023506 >> v2:172.21.15.57:3300/0 conn(0x7fc550151910 0x7fc550157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc55579c700 1 -- 172.21.15.43:0/3507023506 >> v1:172.21.15.43:6789/0 conn(0x7fc5500c51a0 legacy=0x7fc5500c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc55579c700 1 -- 172.21.15.43:0/3507023506 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550072900 con 0x7fc5500c15e0 2023-08-27T11:24:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.195+0000 7fc54f7fe700 1 -- 172.21.15.43:0/3507023506 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409059721 0 0) 0x7fc5500c5ae0 con 0x7fc5500c51a0 2023-08-27T11:24:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc55579c700 1 --2- 172.21.15.43:0/3507023506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5500c15e0 0x7fc550157f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc550071480 tx=0x7fc54800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f31189ba3ca5956 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc54f7fe700 1 -- 172.21.15.43:0/3507023506 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800e070 con 0x7fc5500c15e0 2023-08-27T11:24:11.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc54f7fe700 1 -- 172.21.15.43:0/3507023506 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54800bb20 con 0x7fc5500c15e0 2023-08-27T11:24:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc54f7fe700 1 -- 172.21.15.43:0/3507023506 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012430 con 0x7fc5500c15e0 2023-08-27T11:24:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 -- 172.21.15.43:0/3507023506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5500c15e0 msgr2=0x7fc550157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 --2- 172.21.15.43:0/3507023506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5500c15e0 0x7fc550157f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc550071480 tx=0x7fc54800b330 comp rx=0 tx=0).stop 2023-08-27T11:24:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 -- 172.21.15.43:0/3507023506 shutdown_connections 2023-08-27T11:24:11.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 --2- 172.21.15.43:0/3507023506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc5500c15e0 0x7fc550157f40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 --2- 172.21.15.43:0/3507023506 >> v2:172.21.15.57:3300/0 conn(0x7fc550151910 0x7fc550157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 -- 172.21.15.43:0/3507023506 >> 172.21.15.43:0/3507023506 conn(0x7fc5500a9740 msgr2=0x7fc5500a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:11.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.196+0000 7fc5571ff700 1 -- 172.21.15.43:0/3507023506 shutdown_connections 2023-08-27T11:24:11.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.197+0000 7fc5571ff700 1 -- 172.21.15.43:0/3507023506 wait complete. 2023-08-27T11:24:11.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.198+0000 7fc5571ff700 1 Processor -- start 2023-08-27T11:24:11.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.199+0000 7fc5571ff700 1 -- start start 2023-08-27T11:24:11.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5500c15e0 0x7fc55006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5500c51a0 0x7fc55014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55006e230 con 0x7fc550151910 2023-08-27T11:24:11.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501ede80 con 0x7fc5500c15e0 2023-08-27T11:24:11.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc5571ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55014d720 con 0x7fc5500c51a0 2023-08-27T11:24:11.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc55579c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc55579c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54102/0 (socket says 172.21.15.43:54102) 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc55579c700 1 -- 172.21.15.43:0/4048063591 learned_addr learned my addr 172.21.15.43:0/4048063591 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc554f9b700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5500c15e0 0x7fc55006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.200+0000 7fc54ffff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5500c51a0 0x7fc55014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 -- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5500c51a0 msgr2=0x7fc55014cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5500c51a0 0x7fc55014cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 -- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5500c15e0 msgr2=0x7fc55006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5500c15e0 0x7fc55006d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 -- 172.21.15.43:0/4048063591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc548009a70 con 0x7fc550151910 2023-08-27T11:24:11.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc55579c700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc548013000 tx=0x7fc548004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:11.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012430 con 0x7fc550151910 2023-08-27T11:24:11.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548020070 con 0x7fc550151910 2023-08-27T11:24:11.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5501ed960 con 0x7fc550151910 2023-08-27T11:24:11.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548004280 con 0x7fc550151910 2023-08-27T11:24:11.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.201+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5501edba0 con 0x7fc550151910 2023-08-27T11:24:11.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.202+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55004ee70 con 0x7fc550151910 2023-08-27T11:24:11.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.203+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5480043e0 con 0x7fc550151910 2023-08-27T11:24:11.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.205+0000 7fc54d7fa700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 0x7fc53406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:11.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.205+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc548022070 con 0x7fc550151910 2023-08-27T11:24:11.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.205+0000 7fc554f9b700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 0x7fc53406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:11.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.205+0000 7fc554f9b700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 0x7fc53406c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc544009be0 tx=0x7fc544009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:11.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.209+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5480556c0 con 0x7fc550151910 2023-08-27T11:24:11.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.467+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5501ed960 con 0x7fc550151910 2023-08-27T11:24:11.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.468+0000 7fc54d7fa700 1 -- 172.21.15.43:0/4048063591 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fc5501ed960 con 0x7fc550151910 2023-08-27T11:24:11.470 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:11.471 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:05.913700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:11.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.470+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 msgr2=0x7fc53406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.470+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 0x7fc53406c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc544009be0 tx=0x7fc544009210 comp rx=0 tx=0).stop 2023-08-27T11:24:11.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.470+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 msgr2=0x7fc55014d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:11.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.470+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc548013000 tx=0x7fc548004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.470+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 shutdown_connections 2023-08-27T11:24:11.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc53406a110 0x7fc53406c5d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc550151910 0x7fc55014d1e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5500c15e0 0x7fc55006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 --2- 172.21.15.43:0/4048063591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5500c51a0 0x7fc55014cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:11.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 >> 172.21.15.43:0/4048063591 conn(0x7fc5500a9740 msgr2=0x7fc5500a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:11.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 shutdown_connections 2023-08-27T11:24:11.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:11.471+0000 7fc5571ff700 1 -- 172.21.15.43:0/4048063591 wait complete. 2023-08-27T11:24:11.475 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 23 2023-08-27T11:24:11.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:23:48.777715+0000', 'modified': '2023-08-27T11:24:05.913700+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4799}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4799': {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:24:11.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:24:11.895 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:24:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.099+0000 7f3e22dff700 1 Processor -- start 2023-08-27T11:24:12.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.100+0000 7f3e22dff700 1 -- start start 2023-08-27T11:24:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e22dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 0x7f3e1c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e22dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 0x7f3e1c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e22dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c06d700 con 0x7f3e1c0ab040 2023-08-27T11:24:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e22dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c1530b0 con 0x7f3e1c06ca60 2023-08-27T11:24:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e22dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c14c860 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e2139c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3e1c0ab040 0x7f3e1c155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46148/0 (socket says 172.21.15.43:46148) 2023-08-27T11:24:12.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e2139c700 1 -- 172.21.15.43:0/2127316469 learned_addr learned my addr 172.21.15.43:0/2127316469 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:12.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/2127316469 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 0x7f3e1c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.101+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/2127316469 >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 0x7f3e1c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408880267 0 0) 0x7f3e1c06d700 con 0x7f3e1c0ab040 2023-08-27T11:24:12.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e0c0035b0 con 0x7f3e1c0ab040 2023-08-27T11:24:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974077620 0 0) 0x7f3e0c0035b0 con 0x7f3e1c0ab040 2023-08-27T11:24:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e20b9b700 1 -- 172.21.15.43:0/2127316469 >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 msgr2=0x7f3e1c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/2127316469 >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 0x7f3e1c0aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e20b9b700 1 -- 172.21.15.43:0/2127316469 >> v1:172.21.15.43:6789/0 conn(0x7f3e1c0ab040 legacy=0x7f3e1c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e20b9b700 1 -- 172.21.15.43:0/2127316469 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c152430 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/2127316469 >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 0x7f3e1c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/2127316469 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 0x7f3e1c06d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009840 tx=0x7f3e10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a923b1362802964b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.102+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140019f0 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10004030 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e1b7fe700 1 -- 172.21.15.43:0/2127316469 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100043a0 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 -- 172.21.15.43:0/2127316469 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 msgr2=0x7f3e1c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 --2- 172.21.15.43:0/2127316469 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 0x7f3e1c06d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009840 tx=0x7f3e10009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 -- 172.21.15.43:0/2127316469 shutdown_connections 2023-08-27T11:24:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 --2- 172.21.15.43:0/2127316469 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0c51a0 0x7f3e1c06d1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 --2- 172.21.15.43:0/2127316469 >> v2:172.21.15.57:3300/0 conn(0x7f3e1c06ca60 0x7f3e1c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 -- 172.21.15.43:0/2127316469 >> 172.21.15.43:0/2127316469 conn(0x7f3e1c06aa50 msgr2=0x7f3e1c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 -- 172.21.15.43:0/2127316469 shutdown_connections 2023-08-27T11:24:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.103+0000 7f3e22dff700 1 -- 172.21.15.43:0/2127316469 wait complete. 2023-08-27T11:24:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.105+0000 7f3e22dff700 1 Processor -- start 2023-08-27T11:24:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.105+0000 7f3e22dff700 1 -- start start 2023-08-27T11:24:12.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 0x7f3e1c1ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 0x7f3e1c1dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0a7370 con 0x7f3e1c06ca60 2023-08-27T11:24:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c1ed660 con 0x7f3e1c0c51a0 2023-08-27T11:24:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e22dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0a6fd0 con 0x7f3e1c0ab040 2023-08-27T11:24:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54110/0 (socket says 172.21.15.43:54110) 2023-08-27T11:24:12.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.106+0000 7f3e20b9b700 1 -- 172.21.15.43:0/984266429 learned_addr learned my addr 172.21.15.43:0/984266429 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 -- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 msgr2=0x7f3e1c1ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 0x7f3e1c1ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e2139c700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 0x7f3e1c1dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 0x7f3e1c1ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 -- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 msgr2=0x7f3e1c1dbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 0x7f3e1c1dbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 -- 172.21.15.43:0/984266429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080094a0 con 0x7f3e1c06ca60 2023-08-27T11:24:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 0x7f3e1c1ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:12.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e2139c700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 0x7f3e1c1dbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:12.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000c00 tx=0x7f3e10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e197fa700 1 -- 172.21.15.43:0/984266429 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10003df0 con 0x7f3e1c06ca60 2023-08-27T11:24:12.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e197fa700 1 -- 172.21.15.43:0/984266429 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1001f070 con 0x7f3e1c06ca60 2023-08-27T11:24:12.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e197fa700 1 -- 172.21.15.43:0/984266429 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10011870 con 0x7f3e1c06ca60 2023-08-27T11:24:12.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100094a0 con 0x7f3e1c06ca60 2023-08-27T11:24:12.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.107+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c1e9900 con 0x7f3e1c06ca60 2023-08-27T11:24:12.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.109+0000 7f3e197fa700 1 -- 172.21.15.43:0/984266429 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e10021030 con 0x7f3e1c06ca60 2023-08-27T11:24:12.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.110+0000 7f3e197fa700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 0x7f3e0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.110+0000 7f3e197fa700 1 -- 172.21.15.43:0/984266429 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3e10089a70 con 0x7f3e1c06ca60 2023-08-27T11:24:12.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.111+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 0x7f3e0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.111+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 0x7f3e0006c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009cf0 tx=0x7f3e08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.112+0000 7f3e3675eb80 1 Processor -- start 2023-08-27T11:24:12.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 -- start start 2023-08-27T11:24:12.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba8fe0 0x55d743bc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743bdb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743b00730 con 0x55d743ba2f00 2023-08-27T11:24:12.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743afe050 con 0x55d743ba8fe0 2023-08-27T11:24:12.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.113+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d743af9940 con 0x55d743ba32e0 2023-08-27T11:24:12.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54114/0 (socket says 172.21.15.43:54114) 2023-08-27T11:24:12.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 -- 172.21.15.43:0/3308792036 learned_addr learned my addr 172.21.15.43:0/3308792036 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba8fe0 0x55d743bc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e2139c700 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743bdb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 -- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 msgr2=0x55d743bdb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743bdb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 -- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba8fe0 msgr2=0x55d743bc62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba8fe0 0x55d743bc62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 -- 172.21.15.43:0/3308792036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7439795e0 con 0x55d743ba2f00 2023-08-27T11:24:12.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e10058ab0 tx=0x7f3e10058c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad45b762c30d366 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.114+0000 7f3e067fc700 1 -- 172.21.15.43:0/3308792036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1005cb70 con 0x55d743ba2f00 2023-08-27T11:24:12.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e067fc700 1 -- 172.21.15.43:0/3308792036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10060ac0 con 0x55d743ba2f00 2023-08-27T11:24:12.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e067fc700 1 -- 172.21.15.43:0/3308792036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10019c50 con 0x55d743ba2f00 2023-08-27T11:24:12.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 -- 172.21.15.43:0/3308792036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 msgr2=0x55d743bc5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3e10058ab0 tx=0x7f3e10058c00 comp rx=0 tx=0).stop 2023-08-27T11:24:12.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 -- 172.21.15.43:0/3308792036 shutdown_connections 2023-08-27T11:24:12.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743bdb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/3308792036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba8fe0 0x55d743bc62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 -- 172.21.15.43:0/3308792036 >> 172.21.15.43:0/3308792036 conn(0x55d743b05c30 msgr2=0x55d743ba56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 -- 172.21.15.43:0/3308792036 shutdown_connections 2023-08-27T11:24:12.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.115+0000 7f3e3675eb80 1 -- 172.21.15.43:0/3308792036 wait complete. 2023-08-27T11:24:12.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.116+0000 7f3e3675eb80 1 -- start start 2023-08-27T11:24:12.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.116+0000 7f3e3675eb80 1 Processor -- start 2023-08-27T11:24:12.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743bbed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743bf6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743a97b60 con 0x55d743ba2f00 2023-08-27T11:24:12.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743a97860 con 0x55d743ba32e0 2023-08-27T11:24:12.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d74397b8d0 con 0x55d743bf6970 2023-08-27T11:24:12.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.117+0000 7f3e3675eb80 10 client.0 _ll_register_callbacks cb 0x55d743a95630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:12.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54120/0 (socket says 172.21.15.43:54120) 2023-08-27T11:24:12.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4041750548 learned_addr learned my addr 172.21.15.43:0/4041750548 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743bbed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e2139c700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743bf6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 msgr2=0x55d743bf6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743bf6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 msgr2=0x55d743bbed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743bbed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4041750548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c1e9900 con 0x55d743ba2f00 2023-08-27T11:24:12.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743bbed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:12.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e1006f040 tx=0x7f3e10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5830093013210d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3dfb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:12.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1005cb70 con 0x55d743ba2f00 2023-08-27T11:24:12.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3e10077080 con 0x55d743ba2f00 2023-08-27T11:24:12.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.118+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d743b9a4f0 con 0x55d743ba2f00 2023-08-27T11:24:12.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e10019c50 con 0x55d743ba2f00 2023-08-27T11:24:12.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 10 client.5391 fetch_fsmap learned FSMap version 23 2023-08-27T11:24:12.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d743b11750 con 0x55d743ba2f00 2023-08-27T11:24:12.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d743b9a4f0 con 0x55d743ba2f00 2023-08-27T11:24:12.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3e100582a0 con 0x55d743ba2f00 2023-08-27T11:24:12.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 10 client.5391 fetch_fsmap finished waiting for FSMap version 23 2023-08-27T11:24:12.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 10 client.5391 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:12.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 20 client.5391 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:12.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743bbbc30 0x55d743bc6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 4 client.5391 mds_command: new command op to 4799 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:24:12.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d743af2920 con 0x55d743bbbc30 2023-08-27T11:24:12.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.119+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743bbbc30 0x55d743bc6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.120+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743bbbc30 0x55d743bc6850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e23383b3c0df43 server_cookie=bd73ca988427691a in_seq=0 out_seq=0 2023-08-27T11:24:12.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.120+0000 7f3dfb7fe700 10 client.5391 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:12.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.120+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4041750548 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d743af2920 con 0x55d743bbbc30 2023-08-27T11:24:12.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3dfb7fe700 10 client.5391 handle_command_reply: tid=0 2023-08-27T11:24:12.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 client.5391 shutdown 2023-08-27T11:24:12.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 msgr2=0x55d743be1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e1006f040 tx=0x7f3e10009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:12.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 shutdown_connections 2023-08-27T11:24:12.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743bf6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743be1070 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743bbbc30 0x55d743bc6850 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4041750548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743bbed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 >> 172.21.15.43:0/4041750548 conn(0x55d743b05c30 msgr2=0x55d743ba0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3dfb7fe700 0 client.5391 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:12.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 shutdown_connections 2023-08-27T11:24:12.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4041750548 wait complete. 2023-08-27T11:24:12.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.121+0000 7f3e3675eb80 20 client.5391 trim_cache size 0 max 16384 2023-08-27T11:24:12.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.139+0000 7f3e3675eb80 1 Processor -- start 2023-08-27T11:24:12.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.139+0000 7f3e3675eb80 1 -- start start 2023-08-27T11:24:12.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba2f00 0x55d743ba65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743ba1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743ba36c0 con 0x55d743bf6970 2023-08-27T11:24:12.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743bdd1e0 con 0x55d743ba2f00 2023-08-27T11:24:12.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d743bc8860 con 0x55d743ba32e0 2023-08-27T11:24:12.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e2139c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e2139c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54136/0 (socket says 172.21.15.43:54136) 2023-08-27T11:24:12.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.140+0000 7f3e2139c700 1 -- 172.21.15.43:0/1593075463 learned_addr learned my addr 172.21.15.43:0/1593075463 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba2f00 0x55d743ba65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 -- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 msgr2=0x55d743ba1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743ba1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 -- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba2f00 msgr2=0x55d743ba65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba2f00 0x55d743ba65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 -- 172.21.15.43:0/1593075463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d743925d90 con 0x55d743bf6970 2023-08-27T11:24:12.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e2139c700 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e14007250 tx=0x7f3e14007560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc82bd3364cb372 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e06ffd700 1 -- 172.21.15.43:0/1593075463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14015650 con 0x55d743bf6970 2023-08-27T11:24:12.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e06ffd700 1 -- 172.21.15.43:0/1593075463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e140157b0 con 0x55d743bf6970 2023-08-27T11:24:12.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.141+0000 7f3e06ffd700 1 -- 172.21.15.43:0/1593075463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14015b60 con 0x55d743bf6970 2023-08-27T11:24:12.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- 172.21.15.43:0/1593075463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 msgr2=0x55d743bbd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3e14007250 tx=0x7f3e14007560 comp rx=0 tx=0).stop 2023-08-27T11:24:12.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- 172.21.15.43:0/1593075463 shutdown_connections 2023-08-27T11:24:12.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743bf6970 0x55d743bbd7f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba2f00 0x55d743ba65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/1593075463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743ba32e0 0x55d743ba1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- 172.21.15.43:0/1593075463 >> 172.21.15.43:0/1593075463 conn(0x55d743b05c30 msgr2=0x55d743ba0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- 172.21.15.43:0/1593075463 shutdown_connections 2023-08-27T11:24:12.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- 172.21.15.43:0/1593075463 wait complete. 2023-08-27T11:24:12.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.142+0000 7f3e3675eb80 1 -- start start 2023-08-27T11:24:12.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 Processor -- start 2023-08-27T11:24:12.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743c4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743c47990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743c4ea10 con 0x55d743ba2f00 2023-08-27T11:24:12.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.143+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d743bf76e0 con 0x55d743ba32e0 2023-08-27T11:24:12.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e3675eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d743bdb630 con 0x55d743bf6970 2023-08-27T11:24:12.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e3675eb80 10 client.0 _ll_register_callbacks cb 0x55d743a95630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:12.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e1bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743c4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54144/0 (socket says 172.21.15.43:54144) 2023-08-27T11:24:12.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4128842746 learned_addr learned my addr 172.21.15.43:0/4128842746 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e2139c700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743c47990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 msgr2=0x55d743c47990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743c47990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 msgr2=0x55d743c4dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:12.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743c4dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 -- 172.21.15.43:0/4128842746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e14002050 con 0x55d743ba2f00 2023-08-27T11:24:12.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743c4dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:12.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3e20b9b700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e100552b0 tx=0x7f3e10013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e70402c1d71626 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.144+0000 7f3dfb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:12.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100770d0 con 0x55d743ba2f00 2023-08-27T11:24:12.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e10060ac0 con 0x55d743ba2f00 2023-08-27T11:24:12.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f3e10004590 con 0x55d743ba2f00 2023-08-27T11:24:12.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e1005cb70 con 0x55d743ba2f00 2023-08-27T11:24:12.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 10 client.5397 fetch_fsmap learned FSMap version 23 2023-08-27T11:24:12.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55d74390ec10 con 0x55d743ba2f00 2023-08-27T11:24:12.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10060ac0 con 0x55d743ba2f00 2023-08-27T11:24:12.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 23) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3e10060630 con 0x55d743ba2f00 2023-08-27T11:24:12.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 10 client.5397 fetch_fsmap finished waiting for FSMap version 23 2023-08-27T11:24:12.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 10 client.5397 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:12.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 20 client.5397 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:12.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743c4e230 0x55d743c47ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 4 client.5397 mds_command: new command op to 4799 tid=0[{"prefix": "status"}] 2023-08-27T11:24:12.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.145+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 --> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d743ab3000 con 0x55d743c4e230 2023-08-27T11:24:12.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743c4e230 0x55d743c47ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3e1bfff700 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743c4e230 0x55d743c47ed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac0b4caf03847540 server_cookie=784e17fbbcdaa67e in_seq=0 out_seq=0 2023-08-27T11:24:12.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3dfb7fe700 10 client.5397 ms_handle_connect on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:12.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3dfb7fe700 1 -- 172.21.15.43:0/4128842746 <== mds.0 v2:172.21.15.57:6832/2873976200 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d743ab3000 con 0x55d743c4e230 2023-08-27T11:24:12.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3dfb7fe700 10 client.5397 handle_command_reply: tid=0 2023-08-27T11:24:12.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.146+0000 7f3e3675eb80 1 client.5397 shutdown 2023-08-27T11:24:12.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 msgr2=0x55d743bc5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3e100552b0 tx=0x7f3e10013040 comp rx=0 tx=0).stop 2023-08-27T11:24:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 shutdown_connections 2023-08-27T11:24:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55d743bf6970 0x55d743c47990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d743ba2f00 0x55d743bc5d70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:6832/2873976200,v1:172.21.15.57:6834/2873976200] conn(0x55d743c4e230 0x55d743c47ed0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 --2- 172.21.15.43:0/4128842746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55d743ba32e0 0x55d743c4dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 >> 172.21.15.43:0/4128842746 conn(0x55d743b05c30 msgr2=0x55d743ba65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3dfb7fe700 0 client.5397 ms_handle_reset on v2:172.21.15.57:6832/2873976200 2023-08-27T11:24:12.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 shutdown_connections 2023-08-27T11:24:12.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 1 -- 172.21.15.43:0/4128842746 wait complete. 2023-08-27T11:24:12.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e3675eb80 20 client.5397 trim_cache size 0 max 16384 2023-08-27T11:24:12.171 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:24:12.171 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:24:12.171 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:24:12.172 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4799, 2023-08-27T11:24:12.172 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:24:12.172 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:24:12.172 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:24:12.172 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 12.266140656999999, 2023-08-27T11:24:12.173 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 23, 2023-08-27T11:24:12.173 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 35, 2023-08-27T11:24:12.173 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 35, 2023-08-27T11:24:12.173 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 32.696627485999997 2023-08-27T11:24:12.173 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:24:12.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 msgr2=0x7f3e0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 0x7f3e0006c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009cf0 tx=0x7f3e08008040 comp rx=0 tx=0).stop 2023-08-27T11:24:12.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.147+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 msgr2=0x7f3e1c1e9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000c00 tx=0x7f3e10004750 comp rx=0 tx=0).stop 2023-08-27T11:24:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 shutdown_connections 2023-08-27T11:24:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3e0006a0e0 0x7f3e0006c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e1c0c51a0 0x7f3e1c1dbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e1c06ca60 0x7f3e1c1e9d90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 --2- 172.21.15.43:0/984266429 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e1c0ab040 0x7f3e1c1ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:12.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 >> 172.21.15.43:0/984266429 conn(0x7f3e1c06aa50 msgr2=0x7f3e1c0c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:12.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 shutdown_connections 2023-08-27T11:24:12.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.148+0000 7f3e22dff700 1 -- 172.21.15.43:0/984266429 wait complete. 2023-08-27T11:24:12.178 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:23:48.777715+0000", "damaged": [], "data_pools": [ 6 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4799": { "addr": "172.21.15.57:6834/2873976200", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 2873976200, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 2873976200, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4799, "incarnation": 19, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 10 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-08-27T11:24:05.913700+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4799 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/69565059", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 69565059, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 69565059, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4802, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/651062384", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 651062384, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 651062384, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 12, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4808, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/3770159957", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3770159957, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3770159957, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 20, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5313, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:24:12.179 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:24:12.180 INFO:tasks.cephfs.test_failover:current = [{'gid': 4808, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/651062384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 651062384}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 651062384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 4802, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/69565059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 69565059}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 69565059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 12}, {'gid': 5313, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/3770159957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3770159957}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3770159957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 20}, {'gid': 4799, 'name': 'd', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6834/2873976200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2873976200}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2873976200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:24:12.180 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:24:12.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:24:12.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:12.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:12.394 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:24:12.394 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:24:12.394 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:12.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:24:12.439 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:24:12.439 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:12.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:24:12.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.684+0000 7fa96c5ff700 1 Processor -- start 2023-08-27T11:24:12.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.685+0000 7fa96c5ff700 1 -- start start 2023-08-27T11:24:12.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa964151a90 0x7fa9640c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:12.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96c5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96406c4e0 con 0x7fa9640c4630 2023-08-27T11:24:12.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa964155370 con 0x7fa9640c4a90 2023-08-27T11:24:12.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa964151e70 con 0x7fa964151a90 2023-08-27T11:24:12.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa964151a90 0x7fa9640c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:12.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa964151a90 0x7fa9640c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54146/0 (socket says 172.21.15.43:54146) 2023-08-27T11:24:12.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa969b9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa9640c4630 0x7fa96406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46164/0 (socket says 172.21.15.43:46164) 2023-08-27T11:24:12.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.686+0000 7fa96a39b700 1 -- 172.21.15.43:0/2450213406 learned_addr learned my addr 172.21.15.43:0/2450213406 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:12.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa96a39b700 1 -- 172.21.15.43:0/2450213406 >> v1:172.21.15.57:6789/0 conn(0x7fa9640c4a90 legacy=0x7fa96406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa96a39b700 1 -- 172.21.15.43:0/2450213406 >> v1:172.21.15.43:6789/0 conn(0x7fa9640c4630 legacy=0x7fa96406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa96a39b700 1 -- 172.21.15.43:0/2450213406 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa964154480 con 0x7fa964151a90 2023-08-27T11:24:12.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa969399700 1 -- 172.21.15.43:0/2450213406 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451162218 0 0) 0x7fa96406c4e0 con 0x7fa9640c4630 2023-08-27T11:24:12.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa96a39b700 1 --2- 172.21.15.43:0/2450213406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa964151a90 0x7fa9640c7bb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9600098f0 tx=0x7fa960009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506cc8b2ea26f5d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:12.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa969399700 1 -- 172.21.15.43:0/2450213406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000b8a0 con 0x7fa964151a90 2023-08-27T11:24:12.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa969399700 1 -- 172.21.15.43:0/2450213406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ba00 con 0x7fa964151a90 2023-08-27T11:24:12.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.687+0000 7fa969399700 1 -- 172.21.15.43:0/2450213406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000bd90 con 0x7fa964151a90 2023-08-27T11:24:12.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 -- 172.21.15.43:0/2450213406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa964151a90 msgr2=0x7fa9640c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:12.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/2450213406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa964151a90 0x7fa9640c7bb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9600098f0 tx=0x7fa960009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:13.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 -- 172.21.15.43:0/2450213406 shutdown_connections 2023-08-27T11:24:13.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/2450213406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa964151a90 0x7fa9640c7bb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 -- 172.21.15.43:0/2450213406 >> 172.21.15.43:0/2450213406 conn(0x7fa9640ab820 msgr2=0x7fa9640abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 -- 172.21.15.43:0/2450213406 shutdown_connections 2023-08-27T11:24:13.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.688+0000 7fa96c5ff700 1 -- 172.21.15.43:0/2450213406 wait complete. 2023-08-27T11:24:13.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.690+0000 7fa96c5ff700 1 Processor -- start 2023-08-27T11:24:13.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.690+0000 7fa96c5ff700 1 -- start start 2023-08-27T11:24:13.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 0x7fa96414f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa964151a90 0x7fa96414feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640c9370 con 0x7fa9640c4630 2023-08-27T11:24:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9641ea3f0 con 0x7fa9640c4a90 2023-08-27T11:24:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa964144420 con 0x7fa964151a90 2023-08-27T11:24:13.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54156/0 (socket says 172.21.15.43:54156) 2023-08-27T11:24:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 -- 172.21.15.43:0/3764839334 learned_addr learned my addr 172.21.15.43:0/3764839334 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa969b9a700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 0x7fa96414f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 -- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa964151a90 msgr2=0x7fa96414feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa964151a90 0x7fa96414feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 -- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 msgr2=0x7fa96414f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 0x7fa96414f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa96a39b700 1 -- 172.21.15.43:0/3764839334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009550 con 0x7fa9640c4630 2023-08-27T11:24:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.691+0000 7fa969b9a700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 0x7fa96414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:13.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa96a39b700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ac6e0 tx=0x7fa960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600038a0 con 0x7fa9640c4630 2023-08-27T11:24:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96001e070 con 0x7fa9640c4630 2023-08-27T11:24:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960003c20 con 0x7fa9640c4630 2023-08-27T11:24:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96414e4f0 con 0x7fa9640c4630 2023-08-27T11:24:13.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.692+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96414e210 con 0x7fa9640c4630 2023-08-27T11:24:13.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.693+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96414e070 con 0x7fa9640c4630 2023-08-27T11:24:13.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.694+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa960011420 con 0x7fa9640c4630 2023-08-27T11:24:13.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.695+0000 7fa95affd700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 0x7fa94806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.695+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa960020070 con 0x7fa9640c4630 2023-08-27T11:24:13.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.695+0000 7fa969b9a700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 0x7fa94806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.696+0000 7fa969b9a700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 0x7fa94806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa964154450 tx=0x7fa954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.699+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa96414e070 con 0x7fa9640c4630 2023-08-27T11:24:13.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.956+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa96414e070 con 0x7fa9640c4630 2023-08-27T11:24:13.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.956+0000 7fa95affd700 1 -- 172.21.15.43:0/3764839334 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fa96414e070 con 0x7fa9640c4630 2023-08-27T11:24:13.046 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:13.046 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:05.913700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:13.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.958+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 msgr2=0x7fa94806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.958+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 0x7fa94806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa964154450 tx=0x7fa954009040 comp rx=0 tx=0).stop 2023-08-27T11:24:13.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.958+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 msgr2=0x7fa9641532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.958+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ac6e0 tx=0x7fa960004750 comp rx=0 tx=0).stop 2023-08-27T11:24:13.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 shutdown_connections 2023-08-27T11:24:13.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa94806a0e0 0x7fa94806c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa964151a90 0x7fa96414feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9640c4630 0x7fa9641532d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 --2- 172.21.15.43:0/3764839334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9640c4a90 0x7fa96414f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 >> 172.21.15.43:0/3764839334 conn(0x7fa9640ab820 msgr2=0x7fa964149d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 shutdown_connections 2023-08-27T11:24:13.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:12.959+0000 7fa96c5ff700 1 -- 172.21.15.43:0/3764839334 wait complete. 2023-08-27T11:24:13.051 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 23 2023-08-27T11:24:13.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:13.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.251+0000 7f6cf87ff700 1 Processor -- start 2023-08-27T11:24:13.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.251+0000 7f6cf87ff700 1 -- start start 2023-08-27T11:24:13.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.252+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 0x7f6cf006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.252+0000 7f6cf87ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 0x7f6cf0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf87ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf006d700 con 0x7f6cf006ca60 2023-08-27T11:24:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf87ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf01530b0 con 0x7f6cf0155910 2023-08-27T11:24:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf014c860 con 0x7f6cf00c51a0 2023-08-27T11:24:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf5d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6cf006ca60 0x7f6cf00aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46180/0 (socket says 172.21.15.43:46180) 2023-08-27T11:24:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf5d9a700 1 -- 172.21.15.43:0/592950679 learned_addr learned my addr 172.21.15.43:0/592950679 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf6d9c700 1 --2- 172.21.15.43:0/592950679 >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 0x7f6cf0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf659b700 1 --2- 172.21.15.43:0/592950679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 0x7f6cf006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf5599700 1 -- 172.21.15.43:0/592950679 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073338656 0 0) 0x7f6cf006d700 con 0x7f6cf006ca60 2023-08-27T11:24:13.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf5599700 1 -- 172.21.15.43:0/592950679 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cdc0035b0 con 0x7f6cf006ca60 2023-08-27T11:24:13.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf659b700 1 -- 172.21.15.43:0/592950679 >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 msgr2=0x7f6cf0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:13.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf659b700 1 --2- 172.21.15.43:0/592950679 >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 0x7f6cf0155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf659b700 1 -- 172.21.15.43:0/592950679 >> v1:172.21.15.43:6789/0 conn(0x7f6cf006ca60 legacy=0x7f6cf00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf659b700 1 -- 172.21.15.43:0/592950679 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0152430 con 0x7f6cf00c51a0 2023-08-27T11:24:13.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.253+0000 7f6cf6d9c700 1 --2- 172.21.15.43:0/592950679 >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 0x7f6cf0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.254+0000 7f6cf659b700 1 --2- 172.21.15.43:0/592950679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 0x7f6cf006d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009840 tx=0x7f6cec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08befb92422bf5a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.254+0000 7f6cf5599700 1 -- 172.21.15.43:0/592950679 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec011830 con 0x7f6cf00c51a0 2023-08-27T11:24:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.254+0000 7f6cf5599700 1 -- 172.21.15.43:0/592950679 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec011990 con 0x7f6cf00c51a0 2023-08-27T11:24:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.254+0000 7f6cf5599700 1 -- 172.21.15.43:0/592950679 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec011d20 con 0x7f6cf00c51a0 2023-08-27T11:24:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 -- 172.21.15.43:0/592950679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 msgr2=0x7f6cf006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/592950679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 0x7f6cf006d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009840 tx=0x7f6cec009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 -- 172.21.15.43:0/592950679 shutdown_connections 2023-08-27T11:24:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/592950679 >> v2:172.21.15.57:3300/0 conn(0x7f6cf0155910 0x7f6cf0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/592950679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf00c51a0 0x7f6cf006d1c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 -- 172.21.15.43:0/592950679 >> 172.21.15.43:0/592950679 conn(0x7f6cf006aa50 msgr2=0x7f6cf00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 -- 172.21.15.43:0/592950679 shutdown_connections 2023-08-27T11:24:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.255+0000 7f6cf87ff700 1 -- 172.21.15.43:0/592950679 wait complete. 2023-08-27T11:24:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.256+0000 7f6cf87ff700 1 Processor -- start 2023-08-27T11:24:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 -- start start 2023-08-27T11:24:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cf006ca60 0x7f6cf00aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf0155910 0x7f6cf014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00bd8e0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00bcfb0 con 0x7f6cf006ca60 2023-08-27T11:24:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.257+0000 7f6cf87ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00bd290 con 0x7f6cf0155910 2023-08-27T11:24:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54170/0 (socket says 172.21.15.43:54170) 2023-08-27T11:24:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 -- 172.21.15.43:0/1092347097 learned_addr learned my addr 172.21.15.43:0/1092347097 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf659b700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cf006ca60 0x7f6cf00aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf6d9c700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf0155910 0x7f6cf014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 -- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf0155910 msgr2=0x7f6cf014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf0155910 0x7f6cf014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 -- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cf006ca60 msgr2=0x7f6cf00aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cf006ca60 0x7f6cf00aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 -- 172.21.15.43:0/1092347097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8009a70 con 0x7f6cf00c51a0 2023-08-27T11:24:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.258+0000 7f6cf5d9a700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c700 tx=0x7f6ce000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.259+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005d70 con 0x7f6cf00c51a0 2023-08-27T11:24:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.259+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00070d0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.259+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0007460 con 0x7f6cf00c51a0 2023-08-27T11:24:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.259+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec0094a0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.259+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf014b480 con 0x7f6cf00c51a0 2023-08-27T11:24:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.260+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf004ee70 con 0x7f6cf00c51a0 2023-08-27T11:24:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.261+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ce00075c0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.262+0000 7f6ce6ffd700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 0x7f6cd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.262+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6ce0087a50 con 0x7f6cf00c51a0 2023-08-27T11:24:13.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.262+0000 7f6cf659b700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 0x7f6cd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.263+0000 7f6cf659b700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 0x7f6cd406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.267+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ce00530d0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.484+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cf0152ca0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.485+0000 7f6ce6ffd700 1 -- 172.21.15.43:0/1092347097 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18362 (secure 0 0 0) 0x7f6ce00566f0 con 0x7f6cf00c51a0 2023-08-27T11:24:13.487 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:13.487 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":35,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:59.878520+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1831306112":"2023-08-28T11:23:59.878489+0000","172.21.15.43:6834/1831306112":"2023-08-28T11:23:59.878489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:13.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 msgr2=0x7f6cd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 0x7f6cd406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009fd0 tx=0x7f6cec008030 comp rx=0 tx=0).stop 2023-08-27T11:24:13.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 msgr2=0x7f6cf014aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c700 tx=0x7f6ce000ca10 comp rx=0 tx=0).stop 2023-08-27T11:24:13.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 shutdown_connections 2023-08-27T11:24:13.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6cd406a0e0 0x7f6cd406c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cf0155910 0x7f6cf014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cf006ca60 0x7f6cf00aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 --2- 172.21.15.43:0/1092347097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cf00c51a0 0x7f6cf014aa00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 >> 172.21.15.43:0/1092347097 conn(0x7f6cf006aa50 msgr2=0x7f6cf0155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 shutdown_connections 2023-08-27T11:24:13.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.487+0000 7f6cf87ff700 1 -- 172.21.15.43:0/1092347097 wait complete. 2023-08-27T11:24:13.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:23:46.316500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:23:47.765077+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:24:13.508 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:24:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.710+0000 7fa2a3fff700 1 Processor -- start 2023-08-27T11:24:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.711+0000 7fa2a3fff700 1 -- start start 2023-08-27T11:24:13.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa29c0c4780 0x7fa29c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa29c0c9010 0x7fa29c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0c6040 con 0x7fa29c0c9010 2023-08-27T11:24:13.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0c7d00 con 0x7fa29c0c4780 2023-08-27T11:24:13.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.712+0000 7fa2a3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0c8510 con 0x7fa29c151b70 2023-08-27T11:24:13.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa29c0c9010 0x7fa29c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa29c0c9010 0x7fa29c0c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54180/0 (socket says 172.21.15.43:54180) 2023-08-27T11:24:13.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 -- 172.21.15.43:0/1221077423 learned_addr learned my addr 172.21.15.43:0/1221077423 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:13.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a159a700 1 --2- 172.21.15.43:0/1221077423 >> v2:172.21.15.57:3300/0 conn(0x7fa29c0c4780 0x7fa29c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a1d9b700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 -- 172.21.15.43:0/1221077423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 msgr2=0x7fa29c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 -- 172.21.15.43:0/1221077423 >> v2:172.21.15.57:3300/0 conn(0x7fa29c0c4780 msgr2=0x7fa29c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 --2- 172.21.15.43:0/1221077423 >> v2:172.21.15.57:3300/0 conn(0x7fa29c0c4780 0x7fa29c0c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 -- 172.21.15.43:0/1221077423 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0c8b80 con 0x7fa29c0c9010 2023-08-27T11:24:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.713+0000 7fa2a259c700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0c94a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0a9730 tx=0x7fa29400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a34baf70f05fbb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a0d99700 1 -- 172.21.15.43:0/1221077423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400e070 con 0x7fa29c0c9010 2023-08-27T11:24:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a0d99700 1 -- 172.21.15.43:0/1221077423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400b910 con 0x7fa29c0c9010 2023-08-27T11:24:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a0d99700 1 -- 172.21.15.43:0/1221077423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400bcc0 con 0x7fa29c0c9010 2023-08-27T11:24:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 -- 172.21.15.43:0/1221077423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 msgr2=0x7fa29c0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0c94a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0a9730 tx=0x7fa29400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 -- 172.21.15.43:0/1221077423 shutdown_connections 2023-08-27T11:24:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0c94a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/1221077423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/1221077423 >> v2:172.21.15.57:3300/0 conn(0x7fa29c0c4780 0x7fa29c0c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 -- 172.21.15.43:0/1221077423 >> 172.21.15.43:0/1221077423 conn(0x7fa29c0ab8f0 msgr2=0x7fa29c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.714+0000 7fa2a3fff700 1 -- 172.21.15.43:0/1221077423 shutdown_connections 2023-08-27T11:24:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.715+0000 7fa2a3fff700 1 -- 172.21.15.43:0/1221077423 wait complete. 2023-08-27T11:24:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.716+0000 7fa2a3fff700 1 Processor -- start 2023-08-27T11:24:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.716+0000 7fa2a3fff700 1 -- start start 2023-08-27T11:24:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa29c0c4780 0x7fa29c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0ad610 con 0x7fa29c0c9010 2023-08-27T11:24:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0c3c10 con 0x7fa29c0c4780 2023-08-27T11:24:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.717+0000 7fa2a3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1e9b50 con 0x7fa29c151b70 2023-08-27T11:24:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54196/0 (socket says 172.21.15.43:54196) 2023-08-27T11:24:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 -- 172.21.15.43:0/685771705 learned_addr learned my addr 172.21.15.43:0/685771705 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a1d9b700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa29c0c4780 0x7fa29c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a259c700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 -- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 msgr2=0x7fa29c149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 -- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa29c0c4780 msgr2=0x7fa29c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa29c0c4780 0x7fa29c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 -- 172.21.15.43:0/685771705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009b30 con 0x7fa29c0c9010 2023-08-27T11:24:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2a159a700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e8d0 tx=0x7fa28c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00ee70 con 0x7fa29c0c9010 2023-08-27T11:24:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.718+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00c7f0 con 0x7fa29c0c9010 2023-08-27T11:24:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.719+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00cba0 con 0x7fa29c0c9010 2023-08-27T11:24:13.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.719+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0aca20 con 0x7fa29c0c9010 2023-08-27T11:24:13.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.719+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c1ea070 con 0x7fa29c0c9010 2023-08-27T11:24:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.720+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c14c670 con 0x7fa29c0c9010 2023-08-27T11:24:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.721+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa28c00cd00 con 0x7fa29c0c9010 2023-08-27T11:24:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.721+0000 7fa2927fc700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 0x7fa28006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.722+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fa28c088430 con 0x7fa29c0c9010 2023-08-27T11:24:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.722+0000 7fa2a1d9b700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 0x7fa28006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.722+0000 7fa2a1d9b700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 0x7fa28006c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa298009b70 tx=0x7fa298008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.726+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa28c053ab0 con 0x7fa29c0c9010 2023-08-27T11:24:13.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.933+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa29c04ee70 con 0x7fa29c0c9010 2023-08-27T11:24:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.933+0000 7fa2927fc700 1 -- 172.21.15.43:0/685771705 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa28c0570d0 con 0x7fa29c0c9010 2023-08-27T11:24:13.935 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:24:13.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 msgr2=0x7fa28006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 0x7fa28006c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa298009b70 tx=0x7fa298008040 comp rx=0 tx=0).stop 2023-08-27T11:24:13.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 msgr2=0x7fa29c0aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:13.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e8d0 tx=0x7fa28c00ec90 comp rx=0 tx=0).stop 2023-08-27T11:24:13.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 shutdown_connections 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa28006a0e0 0x7fa28006c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa29c151b70 0x7fa29c149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa29c0c4780 0x7fa29c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 --2- 172.21.15.43:0/685771705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa29c0c9010 0x7fa29c0aec60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 >> 172.21.15.43:0/685771705 conn(0x7fa29c0ab8f0 msgr2=0x7fa29c154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:13.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 shutdown_connections 2023-08-27T11:24:13.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:13.936+0000 7fa2a3fff700 1 -- 172.21.15.43:0/685771705 wait complete. 2023-08-27T11:24:13.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:24:14.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.159+0000 7f62767ff700 1 Processor -- start 2023-08-27T11:24:14.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.160+0000 7f62767ff700 1 -- start start 2023-08-27T11:24:14.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f62767ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62700c0020 0x7f6270158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f62767ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6270157af0 con 0x7f6270071f70 2023-08-27T11:24:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f62767ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6270158a80 con 0x7f6270151fc0 2023-08-27T11:24:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f62767ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62700a6040 con 0x7f62700c0020 2023-08-27T11:24:14.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f626ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62700c0020 0x7f6270158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f626f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6270071f70 0x7f62701518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46196/0 (socket says 172.21.15.43:46196) 2023-08-27T11:24:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f626ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f62700c0020 0x7f6270158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54200/0 (socket says 172.21.15.43:54200) 2023-08-27T11:24:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.161+0000 7f626f7fe700 1 -- 172.21.15.43:0/1175732909 learned_addr learned my addr 172.21.15.43:0/1175732909 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626ffff700 1 -- 172.21.15.43:0/1175732909 >> v1:172.21.15.57:6789/0 conn(0x7f6270151fc0 legacy=0x7f62700708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626ffff700 1 -- 172.21.15.43:0/1175732909 >> v1:172.21.15.43:6789/0 conn(0x7f6270071f70 legacy=0x7f62701518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626ffff700 1 -- 172.21.15.43:0/1175732909 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62700a6320 con 0x7f62700c0020 2023-08-27T11:24:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626effd700 1 -- 172.21.15.43:0/1175732909 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218415742 0 0) 0x7f6270157af0 con 0x7f6270071f70 2023-08-27T11:24:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626ffff700 1 --2- 172.21.15.43:0/1175732909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62700c0020 0x7f6270158540 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6260009840 tx=0x7f6260009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7b70133c09d4fc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626effd700 1 -- 172.21.15.43:0/1175732909 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260004230 con 0x7f62700c0020 2023-08-27T11:24:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626effd700 1 -- 172.21.15.43:0/1175732909 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260004390 con 0x7f62700c0020 2023-08-27T11:24:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.162+0000 7f626effd700 1 -- 172.21.15.43:0/1175732909 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62600036a0 con 0x7f62700c0020 2023-08-27T11:24:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 -- 172.21.15.43:0/1175732909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62700c0020 msgr2=0x7f6270158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 --2- 172.21.15.43:0/1175732909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62700c0020 0x7f6270158540 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6260009840 tx=0x7f6260009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 -- 172.21.15.43:0/1175732909 shutdown_connections 2023-08-27T11:24:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 --2- 172.21.15.43:0/1175732909 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f62700c0020 0x7f6270158540 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 -- 172.21.15.43:0/1175732909 >> 172.21.15.43:0/1175732909 conn(0x7f62700c6a40 msgr2=0x7f62700c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 -- 172.21.15.43:0/1175732909 shutdown_connections 2023-08-27T11:24:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.163+0000 7f62767ff700 1 -- 172.21.15.43:0/1175732909 wait complete. 2023-08-27T11:24:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.165+0000 7f62767ff700 1 Processor -- start 2023-08-27T11:24:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.166+0000 7f62767ff700 1 -- start start 2023-08-27T11:24:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62700c0020 0x7f62701558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6270151fc0 0x7f627014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270154cc0 con 0x7f6270071f70 2023-08-27T11:24:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6270152590 con 0x7f6270151fc0 2023-08-27T11:24:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f62767ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6270152870 con 0x7f62700c0020 2023-08-27T11:24:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54212/0 (socket says 172.21.15.43:54212) 2023-08-27T11:24:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 -- 172.21.15.43:0/447943923 learned_addr learned my addr 172.21.15.43:0/447943923 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626f7fe700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62700c0020 0x7f62701558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f6274d9c700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6270151fc0 0x7f627014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 -- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62700c0020 msgr2=0x7f62701558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62700c0020 0x7f62701558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 -- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6270151fc0 msgr2=0x7f627014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6270151fc0 0x7f627014ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.167+0000 7f626ffff700 1 -- 172.21.15.43:0/447943923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600094a0 con 0x7f6270071f70 2023-08-27T11:24:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f626ffff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f62600090b0 tx=0x7f62600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011830 con 0x7f6270071f70 2023-08-27T11:24:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6260011990 con 0x7f6270071f70 2023-08-27T11:24:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6260011d40 con 0x7f6270071f70 2023-08-27T11:24:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62701549e0 con 0x7f6270071f70 2023-08-27T11:24:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.168+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627006d7c0 con 0x7f6270071f70 2023-08-27T11:24:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.169+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62700c4af0 con 0x7f6270071f70 2023-08-27T11:24:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.170+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f626001b440 con 0x7f6270071f70 2023-08-27T11:24:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.171+0000 7f626cff9700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 0x7f625c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.171+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6260089fa0 con 0x7f6270071f70 2023-08-27T11:24:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.171+0000 7f626f7fe700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 0x7f625c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.172+0000 7f626f7fe700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 0x7f625c06c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62700ac050 tx=0x7f6264007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.175+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6260055620 con 0x7f6270071f70 2023-08-27T11:24:14.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.386+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62701e9fb0 con 0x7f6270071f70 2023-08-27T11:24:14.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.387+0000 7f626cff9700 1 -- 172.21.15.43:0/447943923 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62701e9fb0 con 0x7f6270071f70 2023-08-27T11:24:14.389 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:24:14.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 msgr2=0x7f625c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 0x7f625c06c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f62700ac050 tx=0x7f6264007c90 comp rx=0 tx=0).stop 2023-08-27T11:24:14.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 msgr2=0x7f6270154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f62600090b0 tx=0x7f62600047c0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 shutdown_connections 2023-08-27T11:24:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f625c06a0e0 0x7f625c06c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6270151fc0 0x7f627014ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6270071f70 0x7f6270154010 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 --2- 172.21.15.43:0/447943923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62700c0020 0x7f62701558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 >> 172.21.15.43:0/447943923 conn(0x7f62700c6a40 msgr2=0x7f62700a7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 shutdown_connections 2023-08-27T11:24:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.389+0000 7f62767ff700 1 -- 172.21.15.43:0/447943923 wait complete. 2023-08-27T11:24:14.409 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:24:14.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.611+0000 7f70e43ff700 1 Processor -- start 2023-08-27T11:24:14.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.611+0000 7f70e43ff700 1 -- start start 2023-08-27T11:24:14.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e43ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f70dc0c5150 0x7f70dc1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e43ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70dc14eb60 0x7f70dc0c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e43ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc0c03e0 con 0x7f70dc14e780 2023-08-27T11:24:14.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e43ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc151900 con 0x7f70dc0c5150 2023-08-27T11:24:14.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e43ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc151be0 con 0x7f70dc14eb60 2023-08-27T11:24:14.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e199a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f70dc0c5150 0x7f70dc1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e199a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f70dc0c5150 0x7f70dc1512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54226/0 (socket says 172.21.15.43:54226) 2023-08-27T11:24:14.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.612+0000 7f70e199a700 1 -- 172.21.15.43:0/3743553612 learned_addr learned my addr 172.21.15.43:0/3743553612 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:14.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e299c700 1 --2- 172.21.15.43:0/3743553612 >> v2:172.21.15.57:3300/0 conn(0x7f70dc14eb60 0x7f70dc0c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e199a700 1 -- 172.21.15.43:0/3743553612 >> v2:172.21.15.57:3300/0 conn(0x7f70dc14eb60 msgr2=0x7f70dc0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:14.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e199a700 1 --2- 172.21.15.43:0/3743553612 >> v2:172.21.15.57:3300/0 conn(0x7f70dc14eb60 0x7f70dc0c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e199a700 1 -- 172.21.15.43:0/3743553612 >> v1:172.21.15.57:6789/0 conn(0x7f70dc14e780 legacy=0x7f70dc06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e199a700 1 -- 172.21.15.43:0/3743553612 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc151ec0 con 0x7f70dc0c5150 2023-08-27T11:24:14.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e199a700 1 --2- 172.21.15.43:0/3743553612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc1512b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00bb90 tx=0x7f70cc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98397a8d6a8d1de server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e1199700 1 -- 172.21.15.43:0/3743553612 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00dcf0 con 0x7f70dc0c5150 2023-08-27T11:24:14.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e1199700 1 -- 172.21.15.43:0/3743553612 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00de50 con 0x7f70dc0c5150 2023-08-27T11:24:14.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.613+0000 7f70e1199700 1 -- 172.21.15.43:0/3743553612 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc010690 con 0x7f70dc0c5150 2023-08-27T11:24:14.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 -- 172.21.15.43:0/3743553612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 msgr2=0x7f70dc1512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 --2- 172.21.15.43:0/3743553612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc1512b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00bb90 tx=0x7f70cc00bea0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 -- 172.21.15.43:0/3743553612 shutdown_connections 2023-08-27T11:24:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 --2- 172.21.15.43:0/3743553612 >> v2:172.21.15.57:3300/0 conn(0x7f70dc14eb60 0x7f70dc0c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 --2- 172.21.15.43:0/3743553612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc1512b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 -- 172.21.15.43:0/3743553612 >> 172.21.15.43:0/3743553612 conn(0x7f70dc0c5b10 msgr2=0x7f70dc0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 -- 172.21.15.43:0/3743553612 shutdown_connections 2023-08-27T11:24:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.614+0000 7f70e43ff700 1 -- 172.21.15.43:0/3743553612 wait complete. 2023-08-27T11:24:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.616+0000 7f70e43ff700 1 Processor -- start 2023-08-27T11:24:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.616+0000 7f70e43ff700 1 -- start start 2023-08-27T11:24:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70dc14e780 0x7f70dc14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70dc14eb60 0x7f70dc14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0a5640 con 0x7f70dc0c5150 2023-08-27T11:24:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0c2030 con 0x7f70dc14eb60 2023-08-27T11:24:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e43ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0a5fb0 con 0x7f70dc14e780 2023-08-27T11:24:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e219b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e219b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54236/0 (socket says 172.21.15.43:54236) 2023-08-27T11:24:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e219b700 1 -- 172.21.15.43:0/1751402995 learned_addr learned my addr 172.21.15.43:0/1751402995 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e299c700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70dc14eb60 0x7f70dc14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.617+0000 7f70e199a700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70dc14e780 0x7f70dc14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 -- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70dc14e780 msgr2=0x7f70dc14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70dc14e780 0x7f70dc14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 -- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70dc14eb60 msgr2=0x7f70dc14c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70dc14eb60 0x7f70dc14c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 -- 172.21.15.43:0/1751402995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc00b7f0 con 0x7f70dc0c5150 2023-08-27T11:24:14.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e219b700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c510 tx=0x7f70d800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80052d0 con 0x7f70dc0c5150 2023-08-27T11:24:14.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8005430 con 0x7f70dc0c5150 2023-08-27T11:24:14.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d80038c0 con 0x7f70dc0c5150 2023-08-27T11:24:14.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc0a64e0 con 0x7f70dc0c5150 2023-08-27T11:24:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.618+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc0bf600 con 0x7f70dc0c5150 2023-08-27T11:24:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.619+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc04ee70 con 0x7f70dc0c5150 2023-08-27T11:24:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.620+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70d8003a20 con 0x7f70dc0c5150 2023-08-27T11:24:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.621+0000 7f70d2ffd700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 0x7f70c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:14.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.621+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f70d8087980 con 0x7f70dc0c5150 2023-08-27T11:24:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.621+0000 7f70e199a700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 0x7f70c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.622+0000 7f70e199a700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 0x7f70c006c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00bee0 tx=0x7f70cc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:14.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.625+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f70d8053000 con 0x7f70dc0c5150 2023-08-27T11:24:14.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.836+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70dc06b2e0 con 0x7f70dc0c5150 2023-08-27T11:24:14.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.836+0000 7f70d2ffd700 1 -- 172.21.15.43:0/1751402995 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70d8056620 con 0x7f70dc0c5150 2023-08-27T11:24:14.838 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:24:14.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 msgr2=0x7f70c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 0x7f70c006c5a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00bee0 tx=0x7f70cc01c040 comp rx=0 tx=0).stop 2023-08-27T11:24:14.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 msgr2=0x7f70dc14cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:14.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c510 tx=0x7f70d800c820 comp rx=0 tx=0).stop 2023-08-27T11:24:14.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 shutdown_connections 2023-08-27T11:24:14.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70c006a0e0 0x7f70c006c5a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70dc14eb60 0x7f70dc14c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f70dc0c5150 0x7f70dc14cbe0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 --2- 172.21.15.43:0/1751402995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70dc14e780 0x7f70dc14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 >> 172.21.15.43:0/1751402995 conn(0x7f70dc0c5b10 msgr2=0x7f70dc14dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 shutdown_connections 2023-08-27T11:24:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:14.839+0000 7f70e43ff700 1 -- 172.21.15.43:0/1751402995 wait complete. 2023-08-27T11:24:14.858 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:24:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.063+0000 7f1a265ff700 1 Processor -- start 2023-08-27T11:24:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.063+0000 7f1a265ff700 1 -- start start 2023-08-27T11:24:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a265ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a20151d20 0x7f1a200c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a265ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a20154660 con 0x7f1a2006a8e0 2023-08-27T11:24:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a265ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a20154940 con 0x7f1a200c7c00 2023-08-27T11:24:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a265ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a200c5750 con 0x7f1a20151d20 2023-08-27T11:24:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a1ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a20151d20 0x7f1a200c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a24b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1a2006a8e0 0x7f1a2006acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46204/0 (socket says 172.21.15.43:46204) 2023-08-27T11:24:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.064+0000 7f1a24b9c700 1 -- 172.21.15.43:0/722811252 learned_addr learned my addr 172.21.15.43:0/722811252 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1ffff700 1 -- 172.21.15.43:0/722811252 >> v1:172.21.15.57:6789/0 conn(0x7f1a200c7c00 legacy=0x7f1a200ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1ffff700 1 -- 172.21.15.43:0/722811252 >> v1:172.21.15.43:6789/0 conn(0x7f1a2006a8e0 legacy=0x7f1a2006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1ffff700 1 -- 172.21.15.43:0/722811252 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20154c20 con 0x7f1a20151d20 2023-08-27T11:24:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1ffff700 1 --2- 172.21.15.43:0/722811252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20151d20 0x7f1a200c8110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a20152140 tx=0x7f1a10009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88e0b3c28d2518d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1effd700 1 -- 172.21.15.43:0/722811252 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004020 con 0x7f1a20151d20 2023-08-27T11:24:15.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1effd700 1 -- 172.21.15.43:0/722811252 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10004180 con 0x7f1a20151d20 2023-08-27T11:24:15.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.065+0000 7f1a1effd700 1 -- 172.21.15.43:0/722811252 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004530 con 0x7f1a20151d20 2023-08-27T11:24:15.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 -- 172.21.15.43:0/722811252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20151d20 msgr2=0x7f1a200c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 --2- 172.21.15.43:0/722811252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20151d20 0x7f1a200c8110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1a20152140 tx=0x7f1a10009b20 comp rx=0 tx=0).stop 2023-08-27T11:24:15.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 -- 172.21.15.43:0/722811252 shutdown_connections 2023-08-27T11:24:15.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 --2- 172.21.15.43:0/722811252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a20151d20 0x7f1a200c8110 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 -- 172.21.15.43:0/722811252 >> 172.21.15.43:0/722811252 conn(0x7f1a200c9d00 msgr2=0x7f1a200ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:15.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 -- 172.21.15.43:0/722811252 shutdown_connections 2023-08-27T11:24:15.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.066+0000 7f1a265ff700 1 -- 172.21.15.43:0/722811252 wait complete. 2023-08-27T11:24:15.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.068+0000 7f1a265ff700 1 Processor -- start 2023-08-27T11:24:15.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.068+0000 7f1a265ff700 1 -- start start 2023-08-27T11:24:15.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 0x7f1a20153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 0x7f1a201e9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c1f80 con 0x7f1a2006a8e0 2023-08-27T11:24:15.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201543e0 con 0x7f1a200c7c00 2023-08-27T11:24:15.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a265ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c28e0 con 0x7f1a20151d20 2023-08-27T11:24:15.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54248/0 (socket says 172.21.15.43:54248) 2023-08-27T11:24:15.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 -- 172.21.15.43:0/3478011957 learned_addr learned my addr 172.21.15.43:0/3478011957 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:15.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a24b9c700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 0x7f1a201e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1f7fe700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 0x7f1a20153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 -- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 msgr2=0x7f1a201e9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 0x7f1a201e9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 -- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 msgr2=0x7f1a20153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 0x7f1a20153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1ffff700 1 -- 172.21.15.43:0/3478011957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100094a0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a1f7fe700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 0x7f1a20153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:15.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.069+0000 7f1a24b9c700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 0x7f1a201e9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:15.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a1ffff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a100090b0 tx=0x7f1a10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100036a0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10003800 con 0x7f1a2006a8e0 2023-08-27T11:24:15.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2014d590 con 0x7f1a2006a8e0 2023-08-27T11:24:15.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10003bb0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.070+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201edba0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.071+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2004ee70 con 0x7f1a2006a8e0 2023-08-27T11:24:15.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.072+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a10003d10 con 0x7f1a2006a8e0 2023-08-27T11:24:15.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.073+0000 7f1a1cff9700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.073+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f1a100898f0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.073+0000 7f1a1f7fe700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.074+0000 7f1a1f7fe700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a201e76e0 tx=0x7f1a14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.078+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1a10055090 con 0x7f1a2006a8e0 2023-08-27T11:24:15.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.290+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a2014ba30 con 0x7f1a2006a8e0 2023-08-27T11:24:15.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.290+0000 7f1a1cff9700 1 -- 172.21.15.43:0/3478011957 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a100586b0 con 0x7f1a2006a8e0 2023-08-27T11:24:15.292 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:24:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 msgr2=0x7f1a0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a201e76e0 tx=0x7f1a14009040 comp rx=0 tx=0).stop 2023-08-27T11:24:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 msgr2=0x7f1a200c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a100090b0 tx=0x7f1a10004750 comp rx=0 tx=0).stop 2023-08-27T11:24:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 shutdown_connections 2023-08-27T11:24:15.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a0c06a0e0 0x7f1a0c06c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a20151d20 0x7f1a201e9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a2006a8e0 0x7f1a200c23a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 --2- 172.21.15.43:0/3478011957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a200c7c00 0x7f1a20153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 >> 172.21.15.43:0/3478011957 conn(0x7f1a200c9d00 msgr2=0x7f1a200ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:15.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 shutdown_connections 2023-08-27T11:24:15.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.293+0000 7f1a265ff700 1 -- 172.21.15.43:0/3478011957 wait complete. 2023-08-27T11:24:15.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:15.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.513+0000 7fc2abbff700 1 Processor -- start 2023-08-27T11:24:15.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.513+0000 7fc2abbff700 1 -- start start 2023-08-27T11:24:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.514+0000 7fc2abbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2a4151a90 0x7fc2a40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2abbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4a90 0x7fc2a406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2abbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a406c4e0 con 0x7fc2a40c4630 2023-08-27T11:24:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2abbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a4155370 con 0x7fc2a4151a90 2023-08-27T11:24:15.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2abbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4151e70 con 0x7fc2a40c4a90 2023-08-27T11:24:15.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2a4151a90 0x7fc2a40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc2a4151a90 0x7fc2a40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54260/0 (socket says 172.21.15.43:54260) 2023-08-27T11:24:15.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 -- 172.21.15.43:0/3588088269 learned_addr learned my addr 172.21.15.43:0/3588088269 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:15.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2aa19c700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4a90 0x7fc2a406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 -- 172.21.15.43:0/3588088269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4a90 msgr2=0x7fc2a406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:15.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4a90 0x7fc2a406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 -- 172.21.15.43:0/3588088269 >> v1:172.21.15.43:6789/0 conn(0x7fc2a40c4630 legacy=0x7fc2a406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.515+0000 7fc2a999b700 1 -- 172.21.15.43:0/3588088269 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4154480 con 0x7fc2a4151a90 2023-08-27T11:24:15.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2a999b700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098f0 tx=0x7fc2a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8bfa2b217e6843 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2a8999700 1 -- 172.21.15.43:0/3588088269 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0011830 con 0x7fc2a4151a90 2023-08-27T11:24:15.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2a8999700 1 -- 172.21.15.43:0/3588088269 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a0011990 con 0x7fc2a4151a90 2023-08-27T11:24:15.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2a8999700 1 -- 172.21.15.43:0/3588088269 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0011d20 con 0x7fc2a4151a90 2023-08-27T11:24:15.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2abbff700 1 -- 172.21.15.43:0/3588088269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 msgr2=0x7fc2a40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.516+0000 7fc2abbff700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00098f0 tx=0x7fc2a0009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:15.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 -- 172.21.15.43:0/3588088269 shutdown_connections 2023-08-27T11:24:15.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4a90 0x7fc2a406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 --2- 172.21.15.43:0/3588088269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7bb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 -- 172.21.15.43:0/3588088269 >> 172.21.15.43:0/3588088269 conn(0x7fc2a40ab820 msgr2=0x7fc2a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:15.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 -- 172.21.15.43:0/3588088269 shutdown_connections 2023-08-27T11:24:15.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.517+0000 7fc2abbff700 1 -- 172.21.15.43:0/3588088269 wait complete. 2023-08-27T11:24:15.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.518+0000 7fc2abbff700 1 Processor -- start 2023-08-27T11:24:15.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.518+0000 7fc2abbff700 1 -- start start 2023-08-27T11:24:15.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4630 0x7fc2a40a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2a40c4a90 0x7fc2a4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40c9a40 con 0x7fc2a4151a90 2023-08-27T11:24:15.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41ea730 con 0x7fc2a40c4a90 2023-08-27T11:24:15.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2abbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41eaa10 con 0x7fc2a40c4630 2023-08-27T11:24:15.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2aa19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.519+0000 7fc2aa19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54270/0 (socket says 172.21.15.43:54270) 2023-08-27T11:24:15.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 -- 172.21.15.43:0/2208326421 learned_addr learned my addr 172.21.15.43:0/2208326421 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:15.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2a999b700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4630 0x7fc2a40a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2a919a700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2a40c4a90 0x7fc2a4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 -- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4630 msgr2=0x7fc2a40a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4630 0x7fc2a40a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 -- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2a40c4a90 msgr2=0x7fc2a4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2a40c4a90 0x7fc2a4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 -- 172.21.15.43:0/2208326421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009550 con 0x7fc2a4151a90 2023-08-27T11:24:15.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2aa19c700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00efc0 tx=0x7fc29c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c009ea0 con 0x7fc2a4151a90 2023-08-27T11:24:15.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00f040 con 0x7fc2a4151a90 2023-08-27T11:24:15.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a40c93f0 con 0x7fc2a4151a90 2023-08-27T11:24:15.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c014480 con 0x7fc2a4151a90 2023-08-27T11:24:15.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.521+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a41491b0 con 0x7fc2a4151a90 2023-08-27T11:24:15.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.522+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a4154d00 con 0x7fc2a4151a90 2023-08-27T11:24:15.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.523+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc29c0145e0 con 0x7fc2a4151a90 2023-08-27T11:24:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.524+0000 7fc29a7fc700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 0x7fc28806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.524+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc29c088f20 con 0x7fc2a4151a90 2023-08-27T11:24:15.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.525+0000 7fc2a999b700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 0x7fc28806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.525+0000 7fc2a999b700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 0x7fc28806c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0014040 tx=0x7fc2a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:15.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.529+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2a4154d00 con 0x7fc2a4151a90 2023-08-27T11:24:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.783+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2a4154d00 con 0x7fc2a4151a90 2023-08-27T11:24:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.783+0000 7fc29a7fc700 1 -- 172.21.15.43:0/2208326421 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fc2a4154d00 con 0x7fc2a4151a90 2023-08-27T11:24:15.786 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:15.786 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:05.913700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:15.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 msgr2=0x7fc28806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 0x7fc28806c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0014040 tx=0x7fc2a0008030 comp rx=0 tx=0).stop 2023-08-27T11:24:15.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 msgr2=0x7fc2a40c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:15.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00efc0 tx=0x7fc29c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 shutdown_connections 2023-08-27T11:24:15.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc28806a0e0 0x7fc28806c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2a4151a90 0x7fc2a40c7860 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2a40c4630 0x7fc2a40a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 --2- 172.21.15.43:0/2208326421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2a40c4a90 0x7fc2a4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:15.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 >> 172.21.15.43:0/2208326421 conn(0x7fc2a40ab820 msgr2=0x7fc2a41507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:15.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 shutdown_connections 2023-08-27T11:24:15.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:15.786+0000 7fc2abbff700 1 -- 172.21.15.43:0/2208326421 wait complete. 2023-08-27T11:24:15.792 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 23 2023-08-27T11:24:15.808 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:16.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.010+0000 7fc6471ff700 1 Processor -- start 2023-08-27T11:24:16.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.010+0000 7fc6471ff700 1 -- start start 2023-08-27T11:24:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc6471ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc640151a90 0x7fc6400c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc6471ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6400c4a90 0x7fc64006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc6471ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64006c4e0 con 0x7fc6400c4630 2023-08-27T11:24:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc6471ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc640155370 con 0x7fc640151a90 2023-08-27T11:24:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc6471ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc640151e70 con 0x7fc6400c4a90 2023-08-27T11:24:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc644f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc640151a90 0x7fc6400c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc644f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc640151a90 0x7fc6400c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54286/0 (socket says 172.21.15.43:54286) 2023-08-27T11:24:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc644f9b700 1 -- 172.21.15.43:0/1610297241 learned_addr learned my addr 172.21.15.43:0/1610297241 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:16.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.011+0000 7fc63ffff700 1 --1- 172.21.15.43:0/1610297241 >> v1:172.21.15.43:6789/0 conn(0x7fc6400c4630 0x7fc64006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46214/0 (socket says 172.21.15.43:46214) 2023-08-27T11:24:16.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc64579c700 1 --2- 172.21.15.43:0/1610297241 >> v2:172.21.15.57:3300/0 conn(0x7fc6400c4a90 0x7fc64006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc644f9b700 1 -- 172.21.15.43:0/1610297241 >> v2:172.21.15.57:3300/0 conn(0x7fc6400c4a90 msgr2=0x7fc64006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:16.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc644f9b700 1 --2- 172.21.15.43:0/1610297241 >> v2:172.21.15.57:3300/0 conn(0x7fc6400c4a90 0x7fc64006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc644f9b700 1 -- 172.21.15.43:0/1610297241 >> v1:172.21.15.43:6789/0 conn(0x7fc6400c4630 legacy=0x7fc64006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc644f9b700 1 -- 172.21.15.43:0/1610297241 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640154480 con 0x7fc640151a90 2023-08-27T11:24:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc63f7fe700 1 -- 172.21.15.43:0/1610297241 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449286418 0 0) 0x7fc64006c4e0 con 0x7fc6400c4630 2023-08-27T11:24:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc644f9b700 1 --2- 172.21.15.43:0/1610297241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc640151a90 0x7fc6400c7bb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc6400c4270 tx=0x7fc634009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd556e9cb26447d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc63f7fe700 1 -- 172.21.15.43:0/1610297241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400b870 con 0x7fc640151a90 2023-08-27T11:24:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.012+0000 7fc63f7fe700 1 -- 172.21.15.43:0/1610297241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400b9d0 con 0x7fc640151a90 2023-08-27T11:24:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc63f7fe700 1 -- 172.21.15.43:0/1610297241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400bd60 con 0x7fc640151a90 2023-08-27T11:24:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 -- 172.21.15.43:0/1610297241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc640151a90 msgr2=0x7fc6400c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1610297241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc640151a90 0x7fc6400c7bb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc6400c4270 tx=0x7fc634009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 -- 172.21.15.43:0/1610297241 shutdown_connections 2023-08-27T11:24:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1610297241 >> v2:172.21.15.57:3300/0 conn(0x7fc6400c4a90 0x7fc64006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1610297241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc640151a90 0x7fc6400c7bb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 -- 172.21.15.43:0/1610297241 >> 172.21.15.43:0/1610297241 conn(0x7fc6400ab820 msgr2=0x7fc6400abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 -- 172.21.15.43:0/1610297241 shutdown_connections 2023-08-27T11:24:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.013+0000 7fc6471ff700 1 -- 172.21.15.43:0/1610297241 wait complete. 2023-08-27T11:24:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.015+0000 7fc6471ff700 1 Processor -- start 2023-08-27T11:24:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.015+0000 7fc6471ff700 1 -- start start 2023-08-27T11:24:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6400c4630 0x7fc6400aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640151a90 0x7fc640158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc640155960 con 0x7fc6400c4a90 2023-08-27T11:24:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401ed830 con 0x7fc640151a90 2023-08-27T11:24:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc6471ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401edb10 con 0x7fc6400c4630 2023-08-27T11:24:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc63ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc63ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54298/0 (socket says 172.21.15.43:54298) 2023-08-27T11:24:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc63ffff700 1 -- 172.21.15.43:0/1846777419 learned_addr learned my addr 172.21.15.43:0/1846777419 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc644f9b700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6400c4630 0x7fc6400aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc64579c700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640151a90 0x7fc640158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.016+0000 7fc63ffff700 1 -- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6400c4630 msgr2=0x7fc6400aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63ffff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6400c4630 0x7fc6400aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63ffff700 1 -- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640151a90 msgr2=0x7fc640158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63ffff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640151a90 0x7fc640158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63ffff700 1 -- 172.21.15.43:0/1846777419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc634009550 con 0x7fc6400c4a90 2023-08-27T11:24:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63ffff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0011e0 tx=0x7fc62c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c004c80 con 0x7fc6400c4a90 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62c004e00 con 0x7fc6400c4a90 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62c007310 con 0x7fc6400c4a90 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc640155c20 con 0x7fc6400c4a90 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.017+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6400c8dd0 con 0x7fc6400c4a90 2023-08-27T11:24:16.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.018+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400c70d0 con 0x7fc6400c4a90 2023-08-27T11:24:16.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.019+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc62c007470 con 0x7fc6400c4a90 2023-08-27T11:24:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.020+0000 7fc63d7fa700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 0x7fc62406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.020+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc62c0883e0 con 0x7fc6400c4a90 2023-08-27T11:24:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.020+0000 7fc644f9b700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 0x7fc62406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.021+0000 7fc644f9b700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 0x7fc62406c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc634009c10 tx=0x7fc634008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.024+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc62c053a60 con 0x7fc6400c4a90 2023-08-27T11:24:16.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.234+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc64004ee70 con 0x7fc6400c4a90 2023-08-27T11:24:16.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.235+0000 7fc63d7fa700 1 -- 172.21.15.43:0/1846777419 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18362 (secure 0 0 0) 0x7fc62c057080 con 0x7fc6400c4a90 2023-08-27T11:24:16.237 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:16.238 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":35,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:59.878520+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1831306112":"2023-08-28T11:23:59.878489+0000","172.21.15.43:6834/1831306112":"2023-08-28T11:23:59.878489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:16.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 msgr2=0x7fc62406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 0x7fc62406c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc634009c10 tx=0x7fc634008030 comp rx=0 tx=0).stop 2023-08-27T11:24:16.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 msgr2=0x7fc640157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc62c0011e0 tx=0x7fc62c00cae0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 shutdown_connections 2023-08-27T11:24:16.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc62406a0e0 0x7fc62406c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640151a90 0x7fc640158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6400c4630 0x7fc6400aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 --2- 172.21.15.43:0/1846777419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6400c4a90 0x7fc640157d50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 >> 172.21.15.43:0/1846777419 conn(0x7fc6400ab820 msgr2=0x7fc64014c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:16.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 shutdown_connections 2023-08-27T11:24:16.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.238+0000 7fc6471ff700 1 -- 172.21.15.43:0/1846777419 wait complete. 2023-08-27T11:24:16.260 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:24:16.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:16.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.460+0000 7f8a407ff700 1 Processor -- start 2023-08-27T11:24:16.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.460+0000 7f8a407ff700 1 -- start start 2023-08-27T11:24:16.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.461+0000 7f8a407ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a407ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8a3806ad70 0x7f8a3806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a407ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3806c4e0 con 0x7f8a38151a90 2023-08-27T11:24:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a407ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38155370 con 0x7f8a3806ad70 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a407ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380c82c0 con 0x7f8a380c4630 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3e59b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8a38151a90 0x7f8a380c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46226/0 (socket says 172.21.15.43:46226) 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3e59b700 1 -- 172.21.15.43:0/694183931 learned_addr learned my addr 172.21.15.43:0/694183931 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/694183931 >> v2:172.21.15.43:3300/0 conn(0x7f8a3806ad70 0x7f8a3806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3dd9a700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/694183931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 msgr2=0x7f8a380c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/694183931 >> v1:172.21.15.43:6789/0 conn(0x7f8a38151a90 legacy=0x7f8a380c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/694183931 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38151e70 con 0x7f8a3806ad70 2023-08-27T11:24:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3dd9a700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.462+0000 7f8a3d599700 1 -- 172.21.15.43:0/694183931 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210386982 0 0) 0x7f8a3806c4e0 con 0x7f8a38151a90 2023-08-27T11:24:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3806ad70 0x7f8a3806b200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009d90 tx=0x7f8a3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e0a79574b2aa3a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a3d599700 1 -- 172.21.15.43:0/694183931 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000e070 con 0x7f8a3806ad70 2023-08-27T11:24:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a3d599700 1 -- 172.21.15.43:0/694183931 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000bbd0 con 0x7f8a3806ad70 2023-08-27T11:24:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a3d599700 1 -- 172.21.15.43:0/694183931 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30012430 con 0x7f8a3806ad70 2023-08-27T11:24:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a407ff700 1 -- 172.21.15.43:0/694183931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3806ad70 msgr2=0x7f8a3806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.463+0000 7f8a407ff700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3806ad70 0x7f8a3806b200 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009d90 tx=0x7f8a3000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 -- 172.21.15.43:0/694183931 shutdown_connections 2023-08-27T11:24:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a3806ad70 0x7f8a3806b200 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 --2- 172.21.15.43:0/694183931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 -- 172.21.15.43:0/694183931 >> 172.21.15.43:0/694183931 conn(0x7f8a380ab820 msgr2=0x7f8a380abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 -- 172.21.15.43:0/694183931 shutdown_connections 2023-08-27T11:24:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.464+0000 7f8a407ff700 1 -- 172.21.15.43:0/694183931 wait complete. 2023-08-27T11:24:16.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.466+0000 7f8a407ff700 1 Processor -- start 2023-08-27T11:24:16.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.466+0000 7f8a407ff700 1 -- start start 2023-08-27T11:24:16.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a3806ad70 0x7f8a3814d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3814f380 con 0x7f8a38151a90 2023-08-27T11:24:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a381edaf0 con 0x7f8a3806ad70 2023-08-27T11:24:16.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.467+0000 7f8a407ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a381edf80 con 0x7f8a380c4630 2023-08-27T11:24:16.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54310/0 (socket says 172.21.15.43:54310) 2023-08-27T11:24:16.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/2293175617 learned_addr learned my addr 172.21.15.43:0/2293175617 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:16.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3e59b700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a3806ad70 0x7f8a3814d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3dd9a700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 msgr2=0x7f8a380c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a3806ad70 msgr2=0x7f8a3814d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a3806ad70 0x7f8a3814d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 -- 172.21.15.43:0/2293175617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009a70 con 0x7f8a38151a90 2023-08-27T11:24:16.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3dd9a700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:16.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.468+0000 7f8a3ed9c700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ac6e0 tx=0x7f8a30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.469+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30012430 con 0x7f8a38151a90 2023-08-27T11:24:16.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.469+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30020070 con 0x7f8a38151a90 2023-08-27T11:24:16.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.469+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a381ed1c0 con 0x7f8a38151a90 2023-08-27T11:24:16.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.469+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004280 con 0x7f8a38151a90 2023-08-27T11:24:16.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.469+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a381ed780 con 0x7f8a38151a90 2023-08-27T11:24:16.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.470+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a381edca0 con 0x7f8a38151a90 2023-08-27T11:24:16.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.471+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a300043e0 con 0x7f8a38151a90 2023-08-27T11:24:16.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.472+0000 7f8a2effd700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 0x7f8a1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.472+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8a30022070 con 0x7f8a38151a90 2023-08-27T11:24:16.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.472+0000 7f8a3e59b700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 0x7f8a1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.473+0000 7f8a3e59b700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 0x7f8a1c06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000f60 tx=0x7f8a34007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.476+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8a30055df0 con 0x7f8a38151a90 2023-08-27T11:24:16.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.729+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a38074680 con 0x7f8a38151a90 2023-08-27T11:24:16.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.730+0000 7f8a2effd700 1 -- 172.21.15.43:0/2293175617 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f8a30088e60 con 0x7f8a38151a90 2023-08-27T11:24:16.732 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:16.732 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:05.913700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:16.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.732+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 msgr2=0x7f8a1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.732+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 0x7f8a1c06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000f60 tx=0x7f8a34007c90 comp rx=0 tx=0).stop 2023-08-27T11:24:16.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.732+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 msgr2=0x7f8a38147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.732+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ac6e0 tx=0x7f8a30004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 shutdown_connections 2023-08-27T11:24:16.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8a1c06a0e0 0x7f8a1c06c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8a38151a90 0x7f8a38147ea0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a3806ad70 0x7f8a3814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 --2- 172.21.15.43:0/2293175617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a380c4630 0x7f8a380c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 >> 172.21.15.43:0/2293175617 conn(0x7f8a380ab820 msgr2=0x7f8a3806b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:16.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 shutdown_connections 2023-08-27T11:24:16.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.733+0000 7f8a407ff700 1 -- 172.21.15.43:0/2293175617 wait complete. 2023-08-27T11:24:16.737 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 23 2023-08-27T11:24:16.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:16.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.952+0000 7f5b435ff700 1 Processor -- start 2023-08-27T11:24:16.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.952+0000 7f5b435ff700 1 -- start start 2023-08-27T11:24:16.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.953+0000 7f5b435ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b3c151950 0x7f5b3c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.953+0000 7f5b435ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.953+0000 7f5b435ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c0727a0 con 0x7f5b3c06ee30 2023-08-27T11:24:16.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.953+0000 7f5b435ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c0c2aa0 con 0x7f5b3c151950 2023-08-27T11:24:16.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.953+0000 7f5b435ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c1579e0 con 0x7f5b3c1586d0 2023-08-27T11:24:16.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b41b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5b3c06ee30 0x7f5b3c0a96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46230/0 (socket says 172.21.15.43:46230) 2023-08-27T11:24:16.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b41b9c700 1 -- 172.21.15.43:0/2270004339 learned_addr learned my addr 172.21.15.43:0/2270004339 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:16.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/2270004339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b4139b700 1 --2- 172.21.15.43:0/2270004339 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c151950 0x7f5b3c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b40b9a700 1 -- 172.21.15.43:0/2270004339 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c151950 msgr2=0x7f5b3c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:16.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/2270004339 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c151950 0x7f5b3c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b40b9a700 1 -- 172.21.15.43:0/2270004339 >> v1:172.21.15.43:6789/0 conn(0x7f5b3c06ee30 legacy=0x7f5b3c0a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.954+0000 7f5b40b9a700 1 -- 172.21.15.43:0/2270004339 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c157bf0 con 0x7f5b3c1586d0 2023-08-27T11:24:16.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.955+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/2270004339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c1543f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009840 tx=0x7f5b2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5015364c012352d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b33fff700 1 -- 172.21.15.43:0/2270004339 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c011830 con 0x7f5b3c1586d0 2023-08-27T11:24:16.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b33fff700 1 -- 172.21.15.43:0/2270004339 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c011990 con 0x7f5b3c1586d0 2023-08-27T11:24:16.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b33fff700 1 -- 172.21.15.43:0/2270004339 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c011d20 con 0x7f5b3c1586d0 2023-08-27T11:24:16.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 -- 172.21.15.43:0/2270004339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 msgr2=0x7f5b3c1543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 --2- 172.21.15.43:0/2270004339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c1543f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009840 tx=0x7f5b2c009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:16.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 -- 172.21.15.43:0/2270004339 shutdown_connections 2023-08-27T11:24:16.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 --2- 172.21.15.43:0/2270004339 >> v2:172.21.15.57:3300/0 conn(0x7f5b3c151950 0x7f5b3c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 --2- 172.21.15.43:0/2270004339 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c1543f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.960+0000 7f5b435ff700 1 -- 172.21.15.43:0/2270004339 >> 172.21.15.43:0/2270004339 conn(0x7f5b3c0c7af0 msgr2=0x7f5b3c0c7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:16.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.961+0000 7f5b435ff700 1 -- 172.21.15.43:0/2270004339 shutdown_connections 2023-08-27T11:24:16.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.961+0000 7f5b435ff700 1 -- 172.21.15.43:0/2270004339 wait complete. 2023-08-27T11:24:16.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.962+0000 7f5b435ff700 1 Processor -- start 2023-08-27T11:24:16.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 -- start start 2023-08-27T11:24:16.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b3c06ee30 0x7f5b3c0a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a9b80 con 0x7f5b3c151950 2023-08-27T11:24:16.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0ace30 con 0x7f5b3c06ee30 2023-08-27T11:24:16.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.963+0000 7f5b435ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c0a8360 con 0x7f5b3c1586d0 2023-08-27T11:24:16.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54326/0 (socket says 172.21.15.43:54326) 2023-08-27T11:24:16.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 -- 172.21.15.43:0/1476185559 learned_addr learned my addr 172.21.15.43:0/1476185559 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:16.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b4139b700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b3c06ee30 0x7f5b3c0a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b41b9c700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 -- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 msgr2=0x7f5b3c14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 -- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b3c06ee30 msgr2=0x7f5b3c0a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:16.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b3c06ee30 0x7f5b3c0a95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:16.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 -- 172.21.15.43:0/1476185559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0094a0 con 0x7f5b3c151950 2023-08-27T11:24:16.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b41b9c700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:16.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.964+0000 7f5b40b9a700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009fd0 tx=0x7f5b2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.965+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0036a0 con 0x7f5b3c151950 2023-08-27T11:24:16.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.965+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c01e070 con 0x7f5b3c151950 2023-08-27T11:24:16.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.965+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c003a60 con 0x7f5b3c151950 2023-08-27T11:24:16.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.965+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c0a8030 con 0x7f5b3c151950 2023-08-27T11:24:16.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.965+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c0aa3a0 con 0x7f5b3c151950 2023-08-27T11:24:16.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.966+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c04ee70 con 0x7f5b3c151950 2023-08-27T11:24:16.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.967+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5b2c003bc0 con 0x7f5b3c151950 2023-08-27T11:24:16.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.968+0000 7f5b31ffb700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 0x7f5b2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:16.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.968+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5b2c0894c0 con 0x7f5b3c151950 2023-08-27T11:24:16.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.968+0000 7f5b4139b700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 0x7f5b2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:16.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.969+0000 7f5b4139b700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 0x7f5b2006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009be0 tx=0x7f5b38009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:16.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:16.972+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5b2c054b40 con 0x7f5b3c151950 2023-08-27T11:24:17.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.224+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b3c157ea0 con 0x7f5b3c151950 2023-08-27T11:24:17.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.225+0000 7f5b31ffb700 1 -- 172.21.15.43:0/1476185559 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f5b2c058160 con 0x7f5b3c151950 2023-08-27T11:24:17.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:17.227 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:23:48.777715+0000","modified":"2023-08-27T11:24:05.913700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4799},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4799":{"gid":4799,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2873976200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2873976200},{"type":"v1","addr":"172.21.15.57:6834","nonce":2873976200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-27T11:24:17.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 msgr2=0x7f5b2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 0x7f5b2006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009be0 tx=0x7f5b38009210 comp rx=0 tx=0).stop 2023-08-27T11:24:17.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 msgr2=0x7f5b3c0a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009fd0 tx=0x7f5b2c004750 comp rx=0 tx=0).stop 2023-08-27T11:24:17.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 shutdown_connections 2023-08-27T11:24:17.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5b2006a0e0 0x7f5b2006c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5b3c1586d0 0x7f5b3c14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b3c06ee30 0x7f5b3c0a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 --2- 172.21.15.43:0/1476185559 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5b3c151950 0x7f5b3c0a87f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 >> 172.21.15.43:0/1476185559 conn(0x7f5b3c0c7af0 msgr2=0x7f5b3c0c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:17.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 shutdown_connections 2023-08-27T11:24:17.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.227+0000 7f5b435ff700 1 -- 172.21.15.43:0/1476185559 wait complete. 2023-08-27T11:24:17.232 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 23 2023-08-27T11:24:17.247 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:17.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.445+0000 7f8048fff700 1 Processor -- start 2023-08-27T11:24:17.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.445+0000 7f8048fff700 1 -- start start 2023-08-27T11:24:17.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8048fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f804406ca60 0x7f804406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8048fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8044155910 0x7f8044155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8048fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804406d700 con 0x7f80440c51a0 2023-08-27T11:24:17.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8048fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80441530b0 con 0x7f804406ca60 2023-08-27T11:24:17.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8048fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804414c860 con 0x7f8044155910 2023-08-27T11:24:17.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f804406ca60 0x7f804406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f804406ca60 0x7f804406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54338/0 (socket says 172.21.15.43:54338) 2023-08-27T11:24:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 -- 172.21.15.43:0/316815612 learned_addr learned my addr 172.21.15.43:0/316815612 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:17.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f8042d9d700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8044155910 0x7f8044155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 -- 172.21.15.43:0/316815612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8044155910 msgr2=0x7f8044155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:17.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8044155910 0x7f8044155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 -- 172.21.15.43:0/316815612 >> v1:172.21.15.57:6789/0 conn(0x7f80440c51a0 legacy=0x7f80440aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.447+0000 7f803bfff700 1 -- 172.21.15.43:0/316815612 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044152430 con 0x7f804406ca60 2023-08-27T11:24:17.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f803bfff700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804406ca60 0x7f804406d1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f802c009920 tx=0x7f802c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f3073b0af70509 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f8041d9b700 1 -- 172.21.15.43:0/316815612 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011830 con 0x7f804406ca60 2023-08-27T11:24:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f8041d9b700 1 -- 172.21.15.43:0/316815612 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c011990 con 0x7f804406ca60 2023-08-27T11:24:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f8041d9b700 1 -- 172.21.15.43:0/316815612 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011d20 con 0x7f804406ca60 2023-08-27T11:24:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f8048fff700 1 -- 172.21.15.43:0/316815612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804406ca60 msgr2=0x7f804406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.448+0000 7f8048fff700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804406ca60 0x7f804406d1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f802c009920 tx=0x7f802c009c30 comp rx=0 tx=0).stop 2023-08-27T11:24:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 -- 172.21.15.43:0/316815612 shutdown_connections 2023-08-27T11:24:17.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8044155910 0x7f8044155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 --2- 172.21.15.43:0/316815612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f804406ca60 0x7f804406d1c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 -- 172.21.15.43:0/316815612 >> 172.21.15.43:0/316815612 conn(0x7f804406aa50 msgr2=0x7f80440c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:17.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 -- 172.21.15.43:0/316815612 shutdown_connections 2023-08-27T11:24:17.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.449+0000 7f8048fff700 1 -- 172.21.15.43:0/316815612 wait complete. 2023-08-27T11:24:17.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.451+0000 7f8048fff700 1 Processor -- start 2023-08-27T11:24:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.451+0000 7f8048fff700 1 -- start start 2023-08-27T11:24:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804406ca60 0x7f8044154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80440c51a0 0x7f80440a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80440a7260 con 0x7f8044155910 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044151d20 con 0x7f804406ca60 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.452+0000 7f8048fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80441ea180 con 0x7f80440c51a0 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54344/0 (socket says 172.21.15.43:54344) 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 -- 172.21.15.43:0/1629526585 learned_addr learned my addr 172.21.15.43:0/1629526585 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f804259c700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804406ca60 0x7f8044154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f803bfff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80440c51a0 0x7f80440a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 -- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80440c51a0 msgr2=0x7f80440a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80440c51a0 0x7f80440a3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 -- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804406ca60 msgr2=0x7f8044154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804406ca60 0x7f8044154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 -- 172.21.15.43:0/1629526585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009550 con 0x7f8044155910 2023-08-27T11:24:17.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.453+0000 7f8042d9d700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d30 tx=0x7f803c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.454+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c009ba0 con 0x7f8044155910 2023-08-27T11:24:17.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.454+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00f040 con 0x7f8044155910 2023-08-27T11:24:17.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.454+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c014480 con 0x7f8044155910 2023-08-27T11:24:17.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.454+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80441ea670 con 0x7f8044155910 2023-08-27T11:24:17.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.454+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80441ea390 con 0x7f8044155910 2023-08-27T11:24:17.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.455+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804404ee70 con 0x7f8044155910 2023-08-27T11:24:17.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.456+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f803c0145e0 con 0x7f8044155910 2023-08-27T11:24:17.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.457+0000 7f803affd700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.457+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f803c088f50 con 0x7f8044155910 2023-08-27T11:24:17.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.457+0000 7f804259c700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.458+0000 7f804259c700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 0x7f802406c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8034000f60 tx=0x7f8034009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.461+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f803c0545d0 con 0x7f8044155910 2023-08-27T11:24:17.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.671+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80440aafc0 con 0x7f8044155910 2023-08-27T11:24:17.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.672+0000 7f803affd700 1 -- 172.21.15.43:0/1629526585 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18362 (secure 0 0 0) 0x7f803c057bf0 con 0x7f8044155910 2023-08-27T11:24:17.674 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:17.674 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":35,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:23:59.878520+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:23:46.316500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-27T11:23:47.765077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1831306112":"2023-08-28T11:23:59.878489+0000","172.21.15.43:6834/1831306112":"2023-08-28T11:23:59.878489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:17.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 msgr2=0x7f802406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 0x7f802406c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8034000f60 tx=0x7f8034009040 comp rx=0 tx=0).stop 2023-08-27T11:24:17.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 msgr2=0x7f80440a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f803c009d30 tx=0x7f803c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 shutdown_connections 2023-08-27T11:24:17.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f802406a0e0 0x7f802406c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8044155910 0x7f80440a43d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804406ca60 0x7f8044154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 --2- 172.21.15.43:0/1629526585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80440c51a0 0x7f80440a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.674+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 >> 172.21.15.43:0/1629526585 conn(0x7f804406aa50 msgr2=0x7f804414bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.675+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 shutdown_connections 2023-08-27T11:24:17.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.675+0000 7f8048fff700 1 -- 172.21.15.43:0/1629526585 wait complete. 2023-08-27T11:24:17.696 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:24:17.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.898+0000 7feeb639d700 1 Processor -- start 2023-08-27T11:24:17.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.898+0000 7feeb639d700 1 -- start start 2023-08-27T11:24:17.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb639d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feeb0151850 0x7feeb0158460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb639d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb639d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb0155300 con 0x7feeb0154e50 2023-08-27T11:24:17.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb639d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb00c8160 con 0x7feeb0151850 2023-08-27T11:24:17.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb639d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00c69d0 con 0x7feeb00c6560 2023-08-27T11:24:17.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb539b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feeb0151850 0x7feeb0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb539b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feeb0151850 0x7feeb0158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54360/0 (socket says 172.21.15.43:54360) 2023-08-27T11:24:17.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.899+0000 7feeb539b700 1 -- 172.21.15.43:0/485796153 learned_addr learned my addr 172.21.15.43:0/485796153 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:17.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb5b9c700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb539b700 1 -- 172.21.15.43:0/485796153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 msgr2=0x7feeb00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:17.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb539b700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb00c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb539b700 1 -- 172.21.15.43:0/485796153 >> v1:172.21.15.57:6789/0 conn(0x7feeb0154e50 legacy=0x7feeb00c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:17.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb539b700 1 -- 172.21.15.43:0/485796153 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00c6c90 con 0x7feeb0151850 2023-08-27T11:24:17.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb5b9c700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb00c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:17.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feeb539b700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0151850 0x7feeb0158460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feeac0098f0 tx=0x7feeac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b734c222f4b7059 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feea7fff700 1 -- 172.21.15.43:0/485796153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac004230 con 0x7feeb0151850 2023-08-27T11:24:17.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feea7fff700 1 -- 172.21.15.43:0/485796153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac004390 con 0x7feeb0151850 2023-08-27T11:24:17.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.900+0000 7feea7fff700 1 -- 172.21.15.43:0/485796153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac0036a0 con 0x7feeb0151850 2023-08-27T11:24:17.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 -- 172.21.15.43:0/485796153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0151850 msgr2=0x7feeb0158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0151850 0x7feeb0158460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feeac0098f0 tx=0x7feeac009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:17.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 -- 172.21.15.43:0/485796153 shutdown_connections 2023-08-27T11:24:17.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb00c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 --2- 172.21.15.43:0/485796153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0151850 0x7feeb0158460 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 -- 172.21.15.43:0/485796153 >> 172.21.15.43:0/485796153 conn(0x7feeb00ab660 msgr2=0x7feeb00aba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 -- 172.21.15.43:0/485796153 shutdown_connections 2023-08-27T11:24:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.901+0000 7feeb639d700 1 -- 172.21.15.43:0/485796153 wait complete. 2023-08-27T11:24:17.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.903+0000 7feeb639d700 1 Processor -- start 2023-08-27T11:24:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.903+0000 7feeb639d700 1 -- start start 2023-08-27T11:24:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb01ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeb0151850 0x7feeb0152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01ed430 con 0x7feeb0154e50 2023-08-27T11:24:17.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00a9da0 con 0x7feeb0151850 2023-08-27T11:24:17.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb639d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb0144a50 con 0x7feeb00c6560 2023-08-27T11:24:17.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb539b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb01ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54376/0 (socket says 172.21.15.43:54376) 2023-08-27T11:24:17.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 -- 172.21.15.43:0/2427082049 learned_addr learned my addr 172.21.15.43:0/2427082049 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:17.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb4b9a700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeb0151850 0x7feeb0152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 -- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 msgr2=0x7feeb01ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb01ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 -- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeb0151850 msgr2=0x7feeb0152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:17.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeb0151850 0x7feeb0152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:17.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.904+0000 7feeb5b9c700 1 -- 172.21.15.43:0/2427082049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009550 con 0x7feeb0154e50 2023-08-27T11:24:17.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feeb5b9c700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feea800cd50 tx=0x7feea800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800cea0 con 0x7feeb0154e50 2023-08-27T11:24:17.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800f480 con 0x7feeb0154e50 2023-08-27T11:24:17.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800f810 con 0x7feeb0154e50 2023-08-27T11:24:17.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb01e9720 con 0x7feeb0154e50 2023-08-27T11:24:17.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.905+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb01ed050 con 0x7feeb0154e50 2023-08-27T11:24:17.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.906+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb01ed570 con 0x7feeb0154e50 2023-08-27T11:24:17.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.907+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feea800b040 con 0x7feeb0154e50 2023-08-27T11:24:17.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.908+0000 7feea5ffb700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:17.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.908+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6148+0+0 (secure 0 0 0) 0x7feea8088d90 con 0x7feeb0154e50 2023-08-27T11:24:17.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.908+0000 7feeb539b700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:17.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.909+0000 7feeb539b700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 0x7fee9406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feeac009130 tx=0x7feeac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:17.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:17.913+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feeb01ed570 con 0x7feeb0154e50 2023-08-27T11:24:18.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.168+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feeb01ed570 con 0x7feeb0154e50 2023-08-27T11:24:18.171 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:24:18.169+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:24:18.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.174+0000 7feea5ffb700 1 -- 172.21.15.43:0/2427082049 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7feeb01ed570 con 0x7feeb0154e50 2023-08-27T11:24:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 msgr2=0x7fee9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 0x7fee9406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feeac009130 tx=0x7feeac008030 comp rx=0 tx=0).stop 2023-08-27T11:24:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 msgr2=0x7feeb0150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feea800cd50 tx=0x7feea800a560 comp rx=0 tx=0).stop 2023-08-27T11:24:18.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 shutdown_connections 2023-08-27T11:24:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9406a0e0 0x7fee9406c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feeb0154e50 0x7feeb0150710 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeb00c6560 0x7feeb01ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 --2- 172.21.15.43:0/2427082049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeb0151850 0x7feeb0152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 >> 172.21.15.43:0/2427082049 conn(0x7feeb00ab660 msgr2=0x7feeb00c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 shutdown_connections 2023-08-27T11:24:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.176+0000 7feeb639d700 1 -- 172.21.15.43:0/2427082049 wait complete. 2023-08-27T11:24:18.180 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:24:18.182 INFO:tasks.ceph.mds.d.smithi057.stderr: -400> 2023-08-27T11:24:05.219+0000 7fb2517f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:24:18.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:24:18.229 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:24:18.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.400+0000 7f67965ff700 1 Processor -- start 2023-08-27T11:24:18.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.400+0000 7f67965ff700 1 -- start start 2023-08-27T11:24:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f67965ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67900c4630 0x7f67900c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f67965ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f679006ad70 0x7f679006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f67965ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67900c82c0 con 0x7f6790151b20 2023-08-27T11:24:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f67965ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6790151f00 con 0x7f67900c4630 2023-08-27T11:24:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f67965ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679006c450 con 0x7f679006ad70 2023-08-27T11:24:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f678f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67900c4630 0x7f67900c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f678f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67900c4630 0x7f67900c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54382/0 (socket says 172.21.15.43:54382) 2023-08-27T11:24:18.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f678f7fe700 1 -- 172.21.15.43:0/2165919264 learned_addr learned my addr 172.21.15.43:0/2165919264 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:18.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f6794b9c700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f679006ad70 0x7f679006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f678f7fe700 1 -- 172.21.15.43:0/2165919264 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f679006ad70 msgr2=0x7f679006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:18.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.401+0000 7f678f7fe700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f679006ad70 0x7f679006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678f7fe700 1 -- 172.21.15.43:0/2165919264 >> v1:172.21.15.57:6789/0 conn(0x7f6790151b20 legacy=0x7f67900c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:18.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678f7fe700 1 -- 172.21.15.43:0/2165919264 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790154760 con 0x7f67900c4630 2023-08-27T11:24:18.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678f7fe700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67900c4630 0x7f67900c4ae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6784006fd0 tx=0x7f6784009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e9cb2a028f078c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:18.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678effd700 1 -- 172.21.15.43:0/2165919264 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784005e30 con 0x7f67900c4630 2023-08-27T11:24:18.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678effd700 1 -- 172.21.15.43:0/2165919264 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6784006030 con 0x7f67900c4630 2023-08-27T11:24:18.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f678effd700 1 -- 172.21.15.43:0/2165919264 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67840063c0 con 0x7f67900c4630 2023-08-27T11:24:18.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f67965ff700 1 -- 172.21.15.43:0/2165919264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67900c4630 msgr2=0x7f67900c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:18.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.402+0000 7f67965ff700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67900c4630 0x7f67900c4ae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6784006fd0 tx=0x7f6784009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 -- 172.21.15.43:0/2165919264 shutdown_connections 2023-08-27T11:24:18.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f679006ad70 0x7f679006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 --2- 172.21.15.43:0/2165919264 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67900c4630 0x7f67900c4ae0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 -- 172.21.15.43:0/2165919264 >> 172.21.15.43:0/2165919264 conn(0x7f67900ab820 msgr2=0x7f67900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:18.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 -- 172.21.15.43:0/2165919264 shutdown_connections 2023-08-27T11:24:18.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.403+0000 7f67965ff700 1 -- 172.21.15.43:0/2165919264 wait complete. 2023-08-27T11:24:18.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.404+0000 7f67965ff700 1 Processor -- start 2023-08-27T11:24:18.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 -- start start 2023-08-27T11:24:18.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67900c4630 0x7f67901557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6790151b20 0x7f6790155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900af800 con 0x7f679006ad70 2023-08-27T11:24:18.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c3670 con 0x7f67900c4630 2023-08-27T11:24:18.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.405+0000 7f67965ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67900c3bd0 con 0x7f6790151b20 2023-08-27T11:24:18.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54386/0 (socket says 172.21.15.43:54386) 2023-08-27T11:24:18.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 -- 172.21.15.43:0/120974772 learned_addr learned my addr 172.21.15.43:0/120974772 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:18.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f6794b9c700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6790151b20 0x7f6790155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678f7fe700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67900c4630 0x7f67901557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 -- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6790151b20 msgr2=0x7f6790155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:18.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6790151b20 0x7f6790155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 -- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67900c4630 msgr2=0x7f67901557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:18.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67900c4630 0x7f67901557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:18.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 -- 172.21.15.43:0/120974772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009500 con 0x7f679006ad70 2023-08-27T11:24:18.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.406+0000 7f678ffff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f678000b4d0 tx=0x7f678000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:18.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.407+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000bea0 con 0x7f679006ad70 2023-08-27T11:24:18.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.407+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780011830 con 0x7f679006ad70 2023-08-27T11:24:18.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.407+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780011be0 con 0x7f679006ad70 2023-08-27T11:24:18.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.407+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6790158360 con 0x7f679006ad70 2023-08-27T11:24:18.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.407+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67900c2080 con 0x7f679006ad70 2023-08-27T11:24:18.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.408+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679004ee70 con 0x7f679006ad70 2023-08-27T11:24:18.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.409+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6780011d40 con 0x7f679006ad70 2023-08-27T11:24:18.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.410+0000 7f678cff9700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:18.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.410+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f67800881e0 con 0x7f679006ad70 2023-08-27T11:24:18.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.410+0000 7f678f7fe700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.411+0000 7f678f7fe700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 0x7f677c06c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6784013040 tx=0x7f6784008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:18.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.415+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6780053810 con 0x7f679006ad70 2023-08-27T11:24:18.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:18.678+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6790154cf0 con 0x7f679006ad70 2023-08-27T11:24:19.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.179+0000 7f678cff9700 1 -- 172.21.15.43:0/120974772 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6780056e30 con 0x7f679006ad70 2023-08-27T11:24:19.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 msgr2=0x7f677c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 0x7f677c06c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6784013040 tx=0x7f6784008070 comp rx=0 tx=0).stop 2023-08-27T11:24:19.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 msgr2=0x7f67900aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f678000b4d0 tx=0x7f678000b7e0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 shutdown_connections 2023-08-27T11:24:19.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f677c06a0e0 0x7f677c06c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6790151b20 0x7f6790155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f679006ad70 0x7f67900aa9a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 --2- 172.21.15.43:0/120974772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f67900c4630 0x7f67901557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 >> 172.21.15.43:0/120974772 conn(0x7f67900ab820 msgr2=0x7f67900c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:19.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 shutdown_connections 2023-08-27T11:24:19.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.182+0000 7f67965ff700 1 -- 172.21.15.43:0/120974772 wait complete. 2023-08-27T11:24:19.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:24:19.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.409+0000 7f68d6bff700 1 Processor -- start 2023-08-27T11:24:19.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.409+0000 7f68d6bff700 1 -- start start 2023-08-27T11:24:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d6bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f68d0151a40 0x7f68d00c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 0x7f68d00c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d6bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d0154730 con 0x7f68d00c4c40 2023-08-27T11:24:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d6bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d0154520 con 0x7f68d0151a40 2023-08-27T11:24:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0154a10 con 0x7f68d00c81c0 2023-08-27T11:24:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d519c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f68d00c4c40 0x7f68d006b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35554/0 (socket says 172.21.15.43:35554) 2023-08-27T11:24:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d519c700 1 -- 172.21.15.43:0/3007405928 learned_addr learned my addr 172.21.15.43:0/3007405928 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.410+0000 7f68d499b700 1 --2- 172.21.15.43:0/3007405928 >> v2:172.21.15.57:3300/0 conn(0x7f68d0151a40 0x7f68d00c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68cffff700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 0x7f68d00c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68cf7fe700 1 -- 172.21.15.43:0/3007405928 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448681333 0 0) 0x7f68d0154730 con 0x7f68d00c4c40 2023-08-27T11:24:19.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68cf7fe700 1 -- 172.21.15.43:0/3007405928 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c00035b0 con 0x7f68d00c4c40 2023-08-27T11:24:19.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68d499b700 1 -- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 msgr2=0x7f68d00c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:19.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68d499b700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 0x7f68d00c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68d499b700 1 -- 172.21.15.43:0/3007405928 >> v1:172.21.15.43:6789/0 conn(0x7f68d00c4c40 legacy=0x7f68d006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68d499b700 1 -- 172.21.15.43:0/3007405928 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0154cf0 con 0x7f68d0151a40 2023-08-27T11:24:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68cffff700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 0x7f68d00c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.411+0000 7f68d499b700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d0151a40 0x7f68d00c7c80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009840 tx=0x7f68c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fc2891aba64d509 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68cf7fe700 1 -- 172.21.15.43:0/3007405928 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011830 con 0x7f68d0151a40 2023-08-27T11:24:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68cf7fe700 1 -- 172.21.15.43:0/3007405928 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4011990 con 0x7f68d0151a40 2023-08-27T11:24:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68cf7fe700 1 -- 172.21.15.43:0/3007405928 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011d20 con 0x7f68d0151a40 2023-08-27T11:24:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 -- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d0151a40 msgr2=0x7f68d00c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d0151a40 0x7f68d00c7c80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009840 tx=0x7f68c4009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 -- 172.21.15.43:0/3007405928 shutdown_connections 2023-08-27T11:24:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d0151a40 0x7f68d00c7c80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 --2- 172.21.15.43:0/3007405928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d00c81c0 0x7f68d00c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 -- 172.21.15.43:0/3007405928 >> 172.21.15.43:0/3007405928 conn(0x7f68d00ab890 msgr2=0x7f68d00abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:19.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 -- 172.21.15.43:0/3007405928 shutdown_connections 2023-08-27T11:24:19.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.412+0000 7f68d6bff700 1 -- 172.21.15.43:0/3007405928 wait complete. 2023-08-27T11:24:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.414+0000 7f68d6bff700 1 Processor -- start 2023-08-27T11:24:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.414+0000 7f68d6bff700 1 -- start start 2023-08-27T11:24:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d00c81c0 0x7f68d0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d0151a40 0x7f68d01e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d01569e0 con 0x7f68d00c4c40 2023-08-27T11:24:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d01ec910 con 0x7f68d00c81c0 2023-08-27T11:24:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d01565c0 con 0x7f68d0151a40 2023-08-27T11:24:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35984/0 (socket says 172.21.15.43:35984) 2023-08-27T11:24:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.415+0000 7f68d499b700 1 -- 172.21.15.43:0/328243578 learned_addr learned my addr 172.21.15.43:0/328243578 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d519c700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d0151a40 0x7f68d01e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68cffff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d00c81c0 0x7f68d0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 -- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d0151a40 msgr2=0x7f68d01e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d0151a40 0x7f68d01e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 -- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d00c81c0 msgr2=0x7f68d0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d00c81c0 0x7f68d0155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 -- 172.21.15.43:0/328243578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0094a0 con 0x7f68d00c4c40 2023-08-27T11:24:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.416+0000 7f68d499b700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009fd0 tx=0x7f68c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.417+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4004590 con 0x7f68d00c4c40 2023-08-27T11:24:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.417+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c401e070 con 0x7f68d00c4c40 2023-08-27T11:24:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.417+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c40038e0 con 0x7f68d00c4c40 2023-08-27T11:24:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.417+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40094a0 con 0x7f68d00c4c40 2023-08-27T11:24:19.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.417+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d01ecbb0 con 0x7f68d00c4c40 2023-08-27T11:24:19.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.418+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d01ec770 con 0x7f68d00c4c40 2023-08-27T11:24:19.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.419+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68c4003a40 con 0x7f68d00c4c40 2023-08-27T11:24:19.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.420+0000 7f68cd7fa700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 0x7f68b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:19.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.420+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f68c4089410 con 0x7f68d00c4c40 2023-08-27T11:24:19.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.420+0000 7f68cffff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 0x7f68b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:19.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.421+0000 7f68cffff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 0x7f68b406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f68d00a9b70 tx=0x7f68bc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:19.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.424+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68d01ec770 con 0x7f68d00c4c40 2023-08-27T11:24:19.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:19.632+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68d01ec770 con 0x7f68d00c4c40 2023-08-27T11:24:20.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.182+0000 7f68cd7fa700 1 -- 172.21.15.43:0/328243578 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68d01ec770 con 0x7f68d00c4c40 2023-08-27T11:24:20.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 msgr2=0x7f68b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 0x7f68b406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f68d00a9b70 tx=0x7f68bc009210 comp rx=0 tx=0).stop 2023-08-27T11:24:20.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 msgr2=0x7f68d00c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009fd0 tx=0x7f68c4004750 comp rx=0 tx=0).stop 2023-08-27T11:24:20.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 shutdown_connections 2023-08-27T11:24:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f68b406a0e0 0x7f68b406c5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68d0151a40 0x7f68d01e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68d00c4c40 0x7f68d00c3290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 --2- 172.21.15.43:0/328243578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68d00c81c0 0x7f68d0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 >> 172.21.15.43:0/328243578 conn(0x7f68d00ab890 msgr2=0x7f68d01536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:20.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 shutdown_connections 2023-08-27T11:24:20.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.185+0000 7f68d6bff700 1 -- 172.21.15.43:0/328243578 wait complete. 2023-08-27T11:24:20.189 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:24:20.210 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:24:20.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.426+0000 7f5ec8bff700 1 Processor -- start 2023-08-27T11:24:20.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.426+0000 7f5ec8bff700 1 -- start start 2023-08-27T11:24:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec8bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec8bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ec414fd20 0x7f5ec4152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec8bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec4155b00 con 0x7f5ec40aae50 2023-08-27T11:24:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec8bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec41558f0 con 0x7f5ec414fd20 2023-08-27T11:24:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec8bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4155de0 con 0x7f5ec406d360 2023-08-27T11:24:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec2d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ec414fd20 0x7f5ec4152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.427+0000 7f5ec1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ec414fd20 0x7f5ec4152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35992/0 (socket says 172.21.15.43:35992) 2023-08-27T11:24:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 -- 172.21.15.43:0/708770332 learned_addr learned my addr 172.21.15.43:0/708770332 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 -- 172.21.15.43:0/708770332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 msgr2=0x7f5ec414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 --2- 172.21.15.43:0/708770332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 -- 172.21.15.43:0/708770332 >> v1:172.21.15.57:6789/0 conn(0x7f5ec40aae50 legacy=0x7f5ec406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 -- 172.21.15.43:0/708770332 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec41560c0 con 0x7f5ec414fd20 2023-08-27T11:24:20.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec2d9d700 1 --2- 172.21.15.43:0/708770332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec414fd20 0x7f5ec4152380 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009e50 tx=0x7f5ebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6a594d6273475c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:20.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec159a700 1 -- 172.21.15.43:0/708770332 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00e070 con 0x7f5ec414fd20 2023-08-27T11:24:20.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec159a700 1 -- 172.21.15.43:0/708770332 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00b910 con 0x7f5ec414fd20 2023-08-27T11:24:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.428+0000 7f5ec159a700 1 -- 172.21.15.43:0/708770332 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00bcc0 con 0x7f5ec414fd20 2023-08-27T11:24:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 -- 172.21.15.43:0/708770332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec414fd20 msgr2=0x7f5ec4152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/708770332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec414fd20 0x7f5ec4152380 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009e50 tx=0x7f5ebc00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 -- 172.21.15.43:0/708770332 shutdown_connections 2023-08-27T11:24:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/708770332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec414fd20 0x7f5ec4152380 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/708770332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 -- 172.21.15.43:0/708770332 >> 172.21.15.43:0/708770332 conn(0x7f5ec40c2400 msgr2=0x7f5ec40c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 -- 172.21.15.43:0/708770332 shutdown_connections 2023-08-27T11:24:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.429+0000 7f5ec8bff700 1 -- 172.21.15.43:0/708770332 wait complete. 2023-08-27T11:24:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.431+0000 7f5ec8bff700 1 Processor -- start 2023-08-27T11:24:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.432+0000 7f5ec8bff700 1 -- start start 2023-08-27T11:24:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec4150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec414fd20 0x7f5ec40a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4152a80 con 0x7f5ec40aae50 2023-08-27T11:24:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4150ed0 con 0x7f5ec414fd20 2023-08-27T11:24:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec8bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4153270 con 0x7f5ec406d360 2023-08-27T11:24:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36002/0 (socket says 172.21.15.43:36002) 2023-08-27T11:24:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec1d9b700 1 -- 172.21.15.43:0/681901970 learned_addr learned my addr 172.21.15.43:0/681901970 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.433+0000 7f5ec2d9d700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec414fd20 0x7f5ec40a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 -- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 msgr2=0x7f5ec4150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec4150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 -- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec414fd20 msgr2=0x7f5ec40a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec414fd20 0x7f5ec40a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 -- 172.21.15.43:0/681901970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009b30 con 0x7f5ec40aae50 2023-08-27T11:24:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec1d9b700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e9e0 tx=0x7f5eb800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8009710 con 0x7f5ec40aae50 2023-08-27T11:24:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb800ee80 con 0x7f5ec40aae50 2023-08-27T11:24:20.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec4150940 con 0x7f5ec40aae50 2023-08-27T11:24:20.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb800ca50 con 0x7f5ec40aae50 2023-08-27T11:24:20.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.434+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec4152f90 con 0x7f5ec40aae50 2023-08-27T11:24:20.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.435+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec4074680 con 0x7f5ec40aae50 2023-08-27T11:24:20.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.436+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5eb800cbb0 con 0x7f5ec40aae50 2023-08-27T11:24:20.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.438+0000 7f5eb2ffd700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 0x7f5ea406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.438+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5796+0+0 (secure 0 0 0) 0x7f5eb8088800 con 0x7f5ec40aae50 2023-08-27T11:24:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.438+0000 7f5ec259c700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 0x7f5ea406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.439+0000 7f5ec259c700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 0x7f5ea406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:20.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.442+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5eb80579e0 con 0x7f5ec40aae50 2023-08-27T11:24:20.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:20.650+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ec404ee70 con 0x7f5ec40aae50 2023-08-27T11:24:21.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.189+0000 7f5eb2ffd700 1 -- 172.21.15.43:0/681901970 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5eb8057570 con 0x7f5ec40aae50 2023-08-27T11:24:21.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 msgr2=0x7f5ea406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 0x7f5ea406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4007fd0 tx=0x7f5eb4007ec0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 msgr2=0x7f5ec4071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e9e0 tx=0x7f5eb800ecf0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 shutdown_connections 2023-08-27T11:24:21.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ea406a0e0 0x7f5ea406c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ec414fd20 0x7f5ec40a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ec406d360 0x7f5ec4150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 --2- 172.21.15.43:0/681901970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ec40aae50 0x7f5ec4071a80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 >> 172.21.15.43:0/681901970 conn(0x7f5ec40c2400 msgr2=0x7f5ec41536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 shutdown_connections 2023-08-27T11:24:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.193+0000 7f5ec8bff700 1 -- 172.21.15.43:0/681901970 wait complete. 2023-08-27T11:24:21.198 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:24:21.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:24:21.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.425+0000 7fd23a1ff700 1 Processor -- start 2023-08-27T11:24:21.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.425+0000 7fd23a1ff700 1 -- start start 2023-08-27T11:24:21.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd23a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 0x7fd23406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd23a1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23406c4e0 con 0x7fd234151a90 2023-08-27T11:24:21.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd23a1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd234155370 con 0x7fd2340c4630 2023-08-27T11:24:21.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd23a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2340c82c0 con 0x7fd2340c4a90 2023-08-27T11:24:21.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd2337fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd234151a90 0x7fd2340c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35562/0 (socket says 172.21.15.43:35562) 2023-08-27T11:24:21.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.426+0000 7fd2337fe700 1 -- 172.21.15.43:0/3414368514 learned_addr learned my addr 172.21.15.43:0/3414368514 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:21.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd233fff700 1 --2- 172.21.15.43:0/3414368514 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 0x7fd23406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950357430 0 0) 0x7fd23406c4e0 con 0x7fd234151a90 2023-08-27T11:24:21.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c0035b0 con 0x7fd234151a90 2023-08-27T11:24:21.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787177283 0 0) 0x7fd234155370 con 0x7fd2340c4630 2023-08-27T11:24:21.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd23406c4e0 con 0x7fd2340c4630 2023-08-27T11:24:21.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437643665 0 0) 0x7fd21c0035b0 con 0x7fd234151a90 2023-08-27T11:24:21.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd233fff700 1 -- 172.21.15.43:0/3414368514 >> v1:172.21.15.57:6789/0 conn(0x7fd2340c4630 legacy=0x7fd23406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd233fff700 1 -- 172.21.15.43:0/3414368514 >> v1:172.21.15.43:6789/0 conn(0x7fd234151a90 legacy=0x7fd2340c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.427+0000 7fd233fff700 1 -- 172.21.15.43:0/3414368514 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234151e70 con 0x7fd2340c4a90 2023-08-27T11:24:21.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd233fff700 1 --2- 172.21.15.43:0/3414368514 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 0x7fd23406b480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009dc0 tx=0x7fd22c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1988bd75da7a81f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00e070 con 0x7fd2340c4a90 2023-08-27T11:24:21.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c003a20 con 0x7fd2340c4a90 2023-08-27T11:24:21.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd2327fc700 1 -- 172.21.15.43:0/3414368514 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224001670 con 0x7fd2340c4a90 2023-08-27T11:24:21.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd23a1ff700 1 -- 172.21.15.43:0/3414368514 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 msgr2=0x7fd23406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.428+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/3414368514 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 0x7fd23406b480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009dc0 tx=0x7fd22c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:21.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.429+0000 7fd23a1ff700 1 -- 172.21.15.43:0/3414368514 shutdown_connections 2023-08-27T11:24:21.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.429+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/3414368514 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd2340c4a90 0x7fd23406b480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.429+0000 7fd23a1ff700 1 -- 172.21.15.43:0/3414368514 >> 172.21.15.43:0/3414368514 conn(0x7fd2340ab820 msgr2=0x7fd2340abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:21.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.429+0000 7fd23a1ff700 1 -- 172.21.15.43:0/3414368514 shutdown_connections 2023-08-27T11:24:21.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.429+0000 7fd23a1ff700 1 -- 172.21.15.43:0/3414368514 wait complete. 2023-08-27T11:24:21.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.430+0000 7fd23a1ff700 1 Processor -- start 2023-08-27T11:24:21.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.431+0000 7fd23a1ff700 1 -- start start 2023-08-27T11:24:21.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.431+0000 7fd23a1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2340c4630 0x7fd2341ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.431+0000 7fd23a1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.431+0000 7fd23a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd23a1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd234153c20 con 0x7fd2340c4a90 2023-08-27T11:24:21.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd23a1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341e9840 con 0x7fd2340c4630 2023-08-27T11:24:21.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd23a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2341edcd0 con 0x7fd234151a90 2023-08-27T11:24:21.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd232ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd2337fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2340c4630 0x7fd2341ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:45030/0 (socket says 172.21.15.43:45030) 2023-08-27T11:24:21.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd232ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36004/0 (socket says 172.21.15.43:36004) 2023-08-27T11:24:21.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 -- 172.21.15.43:0/195690594 learned_addr learned my addr 172.21.15.43:0/195690594 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:21.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 -- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2340c4630 msgr2=0x7fd2341ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2340c4630 0x7fd2341ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 -- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 msgr2=0x7fd2341ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd233fff700 1 -- 172.21.15.43:0/195690594 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009a70 con 0x7fd234151a90 2023-08-27T11:24:21.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.432+0000 7fd232ffd700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd233fff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0044c0 con 0x7fd234151a90 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c004620 con 0x7fd234151a90 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c01d470 con 0x7fd234151a90 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234153410 con 0x7fd234151a90 2023-08-27T11:24:21.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.433+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd234153660 con 0x7fd234151a90 2023-08-27T11:24:21.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.434+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23404ee70 con 0x7fd234151a90 2023-08-27T11:24:21.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.435+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd22c01d5d0 con 0x7fd234151a90 2023-08-27T11:24:21.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.436+0000 7fd21bfff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 0x7fd22006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.436+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd22c08a520 con 0x7fd234151a90 2023-08-27T11:24:21.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.436+0000 7fd2337fe700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 0x7fd22006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.437+0000 7fd2337fe700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 0x7fd22006c5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd224000f60 tx=0x7fd224000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.441+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd22c056040 con 0x7fd234151a90 2023-08-27T11:24:21.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.650+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd23414e270 con 0x7fd234151a90 2023-08-27T11:24:21.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.658+0000 7fd21bfff700 1 -- 172.21.15.43:0/195690594 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd22c059660 con 0x7fd234151a90 2023-08-27T11:24:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 msgr2=0x7fd22006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 0x7fd22006c5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd224000f60 tx=0x7fd224000bc0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 msgr2=0x7fd234150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009d90 tx=0x7fd22c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 shutdown_connections 2023-08-27T11:24:21.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd22006a130 0x7fd22006c5f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd234151a90 0x7fd234150ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2340c4630 0x7fd2341ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 --2- 172.21.15.43:0/195690594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd2340c4a90 0x7fd2341ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 >> 172.21.15.43:0/195690594 conn(0x7fd2340ab820 msgr2=0x7fd23414b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 shutdown_connections 2023-08-27T11:24:21.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.660+0000 7fd23a1ff700 1 -- 172.21.15.43:0/195690594 wait complete. 2023-08-27T11:24:21.680 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.d mds_join_fs 2023-08-27T11:24:21.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.883+0000 7f47533ff700 1 Processor -- start 2023-08-27T11:24:21.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.884+0000 7f47533ff700 1 -- start start 2023-08-27T11:24:21.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f47533ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f474c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f47533ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474c154d00 con 0x7f474c0c50d0 2023-08-27T11:24:21.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f47533ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474c154fe0 con 0x7f474c0a79c0 2023-08-27T11:24:21.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f47533ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0baf30 con 0x7f474c14e960 2023-08-27T11:24:21.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f475199c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f474c0c50d0 0x7f474c0c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35578/0 (socket says 172.21.15.43:35578) 2023-08-27T11:24:21.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f475199c700 1 -- 172.21.15.43:0/2522015036 learned_addr learned my addr 172.21.15.43:0/2522015036 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:21.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.885+0000 7f475119b700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f474c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107711036 0 0) 0x7f474c154d00 con 0x7f474c0c50d0 2023-08-27T11:24:21.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47380057c0 con 0x7f474c0c50d0 2023-08-27T11:24:21.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2191073667 0 0) 0x7f47380057c0 con 0x7f474c0c50d0 2023-08-27T11:24:21.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 msgr2=0x7f474c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:21.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f474c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 >> v1:172.21.15.57:6789/0 conn(0x7f474c0a79c0 legacy=0x7f474c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c1552c0 con 0x7f474c0c50d0 2023-08-27T11:24:21.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f47440019f0 con 0x7f474c0c50d0 2023-08-27T11:24:21.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 >> v1:172.21.15.43:6789/0 conn(0x7f474c0c50d0 legacy=0x7f474c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738005c40 0x7f4738006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4738006a60 0x7f4738006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f4738007460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0baf30 con 0x7f4738006a60 2023-08-27T11:24:21.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473800dd50 con 0x7f4738005c40 2023-08-27T11:24:21.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473800df10 con 0x7f474c14e960 2023-08-27T11:24:21.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.886+0000 7f475099a700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4738006a60 0x7f4738006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475119b700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738005c40 0x7f4738006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475199c700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f4738007460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 -- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 msgr2=0x7f4738007460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:21.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14e960 0x7f4738007460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 -- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738005c40 msgr2=0x7f4738006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738005c40 0x7f4738006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 -- 172.21.15.43:0/2522015036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380057c0 con 0x7f4738006a60 2023-08-27T11:24:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475119b700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738005c40 0x7f4738006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:21.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f475099a700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4738006a60 0x7f4738006ee0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f473c0018d0 tx=0x7f4738007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739fdb8bb98fd951 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00c690 con 0x7f4738006a60 2023-08-27T11:24:21.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00c7f0 con 0x7f4738006a60 2023-08-27T11:24:21.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.887+0000 7f4743fff700 1 -- 172.21.15.43:0/2522015036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00cba0 con 0x7f4738006a60 2023-08-27T11:24:21.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 -- 172.21.15.43:0/2522015036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4738006a60 msgr2=0x7f4738006ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 --2- 172.21.15.43:0/2522015036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4738006a60 0x7f4738006ee0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f473c0018d0 tx=0x7f4738007a90 comp rx=0 tx=0).stop 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f475199c700 1 -- 172.21.15.43:0/2522015036 reap_dead start 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 -- 172.21.15.43:0/2522015036 shutdown_connections 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 -- 172.21.15.43:0/2522015036 >> 172.21.15.43:0/2522015036 conn(0x7f474c06aa50 msgr2=0x7f474c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 -- 172.21.15.43:0/2522015036 shutdown_connections 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.888+0000 7f47533ff700 1 -- 172.21.15.43:0/2522015036 wait complete. 2023-08-27T11:24:21.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.890+0000 7f47533ff700 1 Processor -- start 2023-08-27T11:24:21.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.890+0000 7f47533ff700 1 -- start start 2023-08-27T11:24:21.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738006a60 0x7f474c0a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14f000 0x7f474c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c0a9050 con 0x7f474c0a9e60 2023-08-27T11:24:21.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474c151af0 con 0x7f4738006a60 2023-08-27T11:24:21.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f47533ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474c151dd0 con 0x7f474c14f000 2023-08-27T11:24:21.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36028/0 (socket says 172.21.15.43:36028) 2023-08-27T11:24:21.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 -- 172.21.15.43:0/2794832088 learned_addr learned my addr 172.21.15.43:0/2794832088 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:21.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475119b700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738006a60 0x7f474c0a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475099a700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14f000 0x7f474c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 -- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14f000 msgr2=0x7f474c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14f000 0x7f474c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 -- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738006a60 msgr2=0x7f474c0a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:21.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738006a60 0x7f474c0a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:21.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.891+0000 7f475199c700 1 -- 172.21.15.43:0/2794832088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c0a8990 con 0x7f474c0a9e60 2023-08-27T11:24:21.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f475199c700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f474c06da20 tx=0x7f474400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474400eb40 con 0x7f474c0a9e60 2023-08-27T11:24:21.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474400eca0 con 0x7f474c0a9e60 2023-08-27T11:24:21.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744013420 con 0x7f474c0a9e60 2023-08-27T11:24:21.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c0a8c70 con 0x7f474c0a9e60 2023-08-27T11:24:21.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.892+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474c0bf2d0 con 0x7f474c0a9e60 2023-08-27T11:24:21.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.893+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474c0a87f0 con 0x7f474c0a9e60 2023-08-27T11:24:21.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.894+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4744013580 con 0x7f474c0a9e60 2023-08-27T11:24:21.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.895+0000 7f4741ffb700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 0x7f473006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:21.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.895+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f47440886e0 con 0x7f474c0a9e60 2023-08-27T11:24:21.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.895+0000 7f475119b700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 0x7f473006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:21.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.896+0000 7f475119b700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 0x7f473006c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f474c149ea0 tx=0x7f4748008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:21.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:21.899+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f474c0a87f0 con 0x7f474c0a9e60 2023-08-27T11:24:22.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.107+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"} v 0) v1 -- 0x7f474c0a9190 con 0x7f474c0a9e60 2023-08-27T11:24:22.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.107+0000 7f4741ffb700 1 -- 172.21.15.43:0/2794832088 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"}]=0 v14) v1 ==== 96+0+0 (secure 0 0 0) 0x7f474c0a9190 con 0x7f474c0a9e60 2023-08-27T11:24:22.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 msgr2=0x7f473006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 0x7f473006c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f474c149ea0 tx=0x7f4748008040 comp rx=0 tx=0).stop 2023-08-27T11:24:22.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 msgr2=0x7f474c145d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f474c06da20 tx=0x7f474400e440 comp rx=0 tx=0).stop 2023-08-27T11:24:22.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 shutdown_connections 2023-08-27T11:24:22.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f473006a0e0 0x7f473006c5a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f474c0a9e60 0x7f474c145d50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4738006a60 0x7f474c0a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 --2- 172.21.15.43:0/2794832088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f474c14f000 0x7f474c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 >> 172.21.15.43:0/2794832088 conn(0x7f474c06aa50 msgr2=0x7f474c152c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:22.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 shutdown_connections 2023-08-27T11:24:22.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.110+0000 7f47533ff700 1 -- 172.21.15.43:0/2794832088 wait complete. 2023-08-27T11:24:22.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop' 2023-08-27T11:24:22.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.331+0000 7f52093ff700 1 Processor -- start 2023-08-27T11:24:22.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.331+0000 7f52093ff700 1 -- start start 2023-08-27T11:24:22.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.332+0000 7f52093ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5204151a90 0x7f52040c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.332+0000 7f52093ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f52040c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.332+0000 7f52093ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520406c4e0 con 0x7f520406ad70 2023-08-27T11:24:22.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.332+0000 7f52093ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5204155370 con 0x7f5204151a90 2023-08-27T11:24:22.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.332+0000 7f52093ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5204151e70 con 0x7f52040c4630 2023-08-27T11:24:22.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f52037fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f520406ad70 0x7f520406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35588/0 (socket says 172.21.15.43:35588) 2023-08-27T11:24:22.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f52037fe700 1 -- 172.21.15.43:0/320246153 learned_addr learned my addr 172.21.15.43:0/320246153 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5202ffd700 1 --2- 172.21.15.43:0/320246153 >> v2:172.21.15.57:3300/0 conn(0x7f5204151a90 0x7f52040c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f52027fc700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f52040c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756048447 0 0) 0x7f520406c4e0 con 0x7f520406ad70 2023-08-27T11:24:22.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec0035b0 con 0x7f520406ad70 2023-08-27T11:24:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 491860030 0 0) 0x7f51ec0035b0 con 0x7f520406ad70 2023-08-27T11:24:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 msgr2=0x7f52040c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f52040c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 >> v2:172.21.15.57:3300/0 conn(0x7f5204151a90 msgr2=0x7f52040c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:22.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 --2- 172.21.15.43:0/320246153 >> v2:172.21.15.57:3300/0 conn(0x7f5204151a90 0x7f52040c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204154480 con 0x7f520406ad70 2023-08-27T11:24:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f51fc0019f0 con 0x7f520406ad70 2023-08-27T11:24:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5202ffd700 1 --2- 172.21.15.43:0/320246153 >> v2:172.21.15.57:3300/0 conn(0x7f5204151a90 0x7f52040c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 >> v1:172.21.15.43:6789/0 conn(0x7f520406ad70 legacy=0x7f520406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ec003a00 0x7f51ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.333+0000 7f5201ffb700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f51ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f5201ffb700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51ec004d90 0x7f51ec005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204155370 con 0x7f51ec004d90 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204151e70 con 0x7f51ec003a00 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec00ba10 con 0x7f52040c4630 2023-08-27T11:24:22.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51ec004d90 0x7f51ec005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f5202ffd700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ec003a00 0x7f51ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52027fc700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f51ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 -- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 msgr2=0x7f51ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:22.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4630 0x7f51ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 -- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ec003a00 msgr2=0x7f51ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51ec003a00 0x7f51ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 -- 172.21.15.43:0/320246153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0035b0 con 0x7f51ec004d90 2023-08-27T11:24:22.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.334+0000 7f52037fe700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51ec004d90 0x7f51ec005210 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00a860 tx=0x7f51ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14c686b3988a92a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc012600 con 0x7f51ec004d90 2023-08-27T11:24:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc012780 con 0x7f51ec004d90 2023-08-27T11:24:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f5201ffb700 1 -- 172.21.15.43:0/320246153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc012b30 con 0x7f51ec004d90 2023-08-27T11:24:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 -- 172.21.15.43:0/320246153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51ec004d90 msgr2=0x7f51ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 --2- 172.21.15.43:0/320246153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51ec004d90 0x7f51ec005210 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00a860 tx=0x7f51ec005880 comp rx=0 tx=0).stop 2023-08-27T11:24:22.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52037fe700 1 -- 172.21.15.43:0/320246153 reap_dead start 2023-08-27T11:24:22.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 -- 172.21.15.43:0/320246153 shutdown_connections 2023-08-27T11:24:22.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 -- 172.21.15.43:0/320246153 >> 172.21.15.43:0/320246153 conn(0x7f52040ab820 msgr2=0x7f52040abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:22.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 -- 172.21.15.43:0/320246153 shutdown_connections 2023-08-27T11:24:22.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.335+0000 7f52093ff700 1 -- 172.21.15.43:0/320246153 wait complete. 2023-08-27T11:24:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.338+0000 7f52093ff700 1 Processor -- start 2023-08-27T11:24:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.338+0000 7f52093ff700 1 -- start start 2023-08-27T11:24:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5204148df0 0x7f5204157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52041583c0 0x7f52041ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52041567f0 con 0x7f52041557e0 2023-08-27T11:24:22.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52041574b0 con 0x7f5204148df0 2023-08-27T11:24:22.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52093ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5204152e10 con 0x7f52041583c0 2023-08-27T11:24:22.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36056/0 (socket says 172.21.15.43:36056) 2023-08-27T11:24:22.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.339+0000 7f52027fc700 1 -- 172.21.15.43:0/87639671 learned_addr learned my addr 172.21.15.43:0/87639671 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:22.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f5202ffd700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5204148df0 0x7f5204157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52037fe700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52041583c0 0x7f52041ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 -- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52041583c0 msgr2=0x7f52041ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52041583c0 0x7f52041ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 -- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5204148df0 msgr2=0x7f5204157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:22.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5204148df0 0x7f5204157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:22.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 -- 172.21.15.43:0/87639671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52041530f0 con 0x7f52041557e0 2023-08-27T11:24:22.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52027fc700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51f8011aa0 tx=0x7f51f8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:22.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8011ee0 con 0x7f52041557e0 2023-08-27T11:24:22.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f800f940 con 0x7f52041557e0 2023-08-27T11:24:22.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.340+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041497f0 con 0x7f52041557e0 2023-08-27T11:24:22.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.341+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f800fcf0 con 0x7f52041557e0 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.341+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041491d0 con 0x7f52041557e0 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.342+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5204152f50 con 0x7f52041557e0 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.343+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51f8014440 con 0x7f52041557e0 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.344+0000 7f51eb7fe700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 0x7f51f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.344+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f51f80888c0 con 0x7f52041557e0 2023-08-27T11:24:22.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.344+0000 7f5202ffd700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 0x7f51f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:22.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.345+0000 7f5202ffd700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 0x7f51f006c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e60 tx=0x7f51f4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:22.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.350+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5204152f50 con 0x7f52041557e0 2023-08-27T11:24:22.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:22.640+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]} v 0) v1 -- 0x7f5204152f50 con 0x7f52041557e0 2023-08-27T11:24:23.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.205+0000 7f51eb7fe700 1 -- 172.21.15.43:0/87639671 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_drop"]}]=0 v108) v1 ==== 143+0+0 (secure 0 0 0) 0x7f5204152f50 con 0x7f52041557e0 2023-08-27T11:24:23.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 msgr2=0x7f51f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 0x7f51f006c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009e60 tx=0x7f51f4009210 comp rx=0 tx=0).stop 2023-08-27T11:24:23.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 msgr2=0x7f5204157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f51f8011aa0 tx=0x7f51f8011db0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 shutdown_connections 2023-08-27T11:24:23.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51f006a0e0 0x7f51f006c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52041583c0 0x7f52041ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5204148df0 0x7f5204157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 --2- 172.21.15.43:0/87639671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52041557e0 0x7f5204157e80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 >> 172.21.15.43:0/87639671 conn(0x7f52040ab820 msgr2=0x7f520406b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:23.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 shutdown_connections 2023-08-27T11:24:23.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.208+0000 7f52093ff700 1 -- 172.21.15.43:0/87639671 wait complete. 2023-08-27T11:24:23.233 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will not cause failover if no high-affinity standby exists. ... ok 2023-08-27T11:24:23.233 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_last_resort (tasks.cephfs.test_failover.TestClusterAffinity) That a standby with mds_join_fs set to another fs is still used if necessary. 2023-08-27T11:24:23.234 INFO:tasks.cephfs_test_runner:test_join_fs_last_resort (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:24:23.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort' 2023-08-27T11:24:23.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.435+0000 7fa15a9ff700 1 Processor -- start 2023-08-27T11:24:23.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.436+0000 7fa15a9ff700 1 -- start start 2023-08-27T11:24:23.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa15a9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa15406b320 0x7fa15414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa15a9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa15a9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1541546f0 con 0x7fa15406c690 2023-08-27T11:24:23.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa15a9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540c4bb0 con 0x7fa15406b320 2023-08-27T11:24:23.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa15a9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540c4e90 con 0x7fa1540c4600 2023-08-27T11:24:23.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa153fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa15406b320 0x7fa15414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa158f9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa158f9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:45102/0 (socket says 172.21.15.43:45102) 2023-08-27T11:24:23.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa158f9c700 1 -- 172.21.15.43:0/3747265485 learned_addr learned my addr 172.21.15.43:0/3747265485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:23.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.437+0000 7fa153fff700 1 --2- 172.21.15.43:0/3747265485 >> v2:172.21.15.57:3300/0 conn(0x7fa15406b320 0x7fa15414dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:39280/0 (socket says 172.21.15.43:39280) 2023-08-27T11:24:23.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa152ffd700 1 -- 172.21.15.43:0/3747265485 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557802822 0 0) 0x7fa1541546f0 con 0x7fa15406c690 2023-08-27T11:24:23.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa152ffd700 1 -- 172.21.15.43:0/3747265485 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c0035b0 con 0x7fa15406c690 2023-08-27T11:24:23.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa153fff700 1 -- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 msgr2=0x7fa15414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:23.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa153fff700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa153fff700 1 -- 172.21.15.43:0/3747265485 >> v1:172.21.15.57:6789/0 conn(0x7fa15406c690 legacy=0x7fa1540c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa153fff700 1 -- 172.21.15.43:0/3747265485 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540c5170 con 0x7fa15406b320 2023-08-27T11:24:23.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa158f9c700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:23.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa153fff700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa15414dfd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa144009840 tx=0x7fa144009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc6a7873728e10b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:23.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa152ffd700 1 -- 172.21.15.43:0/3747265485 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011830 con 0x7fa15406b320 2023-08-27T11:24:23.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa152ffd700 1 -- 172.21.15.43:0/3747265485 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144011990 con 0x7fa15406b320 2023-08-27T11:24:23.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.438+0000 7fa152ffd700 1 -- 172.21.15.43:0/3747265485 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011d20 con 0x7fa15406b320 2023-08-27T11:24:23.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 -- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 msgr2=0x7fa15414dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa15414dfd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa144009840 tx=0x7fa144009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:23.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 -- 172.21.15.43:0/3747265485 shutdown_connections 2023-08-27T11:24:23.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa15414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/3747265485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa15414dfd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 -- 172.21.15.43:0/3747265485 >> 172.21.15.43:0/3747265485 conn(0x7fa1540c9c80 msgr2=0x7fa1540ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:23.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 -- 172.21.15.43:0/3747265485 shutdown_connections 2023-08-27T11:24:23.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.439+0000 7fa15a9ff700 1 -- 172.21.15.43:0/3747265485 wait complete. 2023-08-27T11:24:23.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.441+0000 7fa15a9ff700 1 Processor -- start 2023-08-27T11:24:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.441+0000 7fa15a9ff700 1 -- start start 2023-08-27T11:24:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa1540af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa1540c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540ae4d0 con 0x7fa15406c690 2023-08-27T11:24:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1540ae1f0 con 0x7fa15406b320 2023-08-27T11:24:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa15a9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1541eac10 con 0x7fa1540c4600 2023-08-27T11:24:23.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa1537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa1537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36058/0 (socket says 172.21.15.43:36058) 2023-08-27T11:24:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa1537fe700 1 -- 172.21.15.43:0/260556692 learned_addr learned my addr 172.21.15.43:0/260556692 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.442+0000 7fa153fff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa1540af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa158f9c700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa1540c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 -- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 msgr2=0x7fa1540c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa1540c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 -- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 msgr2=0x7fa1540af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa1540af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 -- 172.21.15.43:0/260556692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c009b30 con 0x7fa15406c690 2023-08-27T11:24:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa158f9c700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa1540c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:23.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa1537fe700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c500 tx=0x7fa14800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480052d0 con 0x7fa15406c690 2023-08-27T11:24:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148005430 con 0x7fa15406c690 2023-08-27T11:24:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480038c0 con 0x7fa15406c690 2023-08-27T11:24:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1440094a0 con 0x7fa15406c690 2023-08-27T11:24:23.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.443+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1541eb1d0 con 0x7fa15406c690 2023-08-27T11:24:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.445+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15404ee70 con 0x7fa15406c690 2023-08-27T11:24:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.445+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa148003a20 con 0x7fa15406c690 2023-08-27T11:24:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.446+0000 7fa150ff9700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 0x7fa14006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.446+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa148087730 con 0x7fa15406c690 2023-08-27T11:24:23.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.447+0000 7fa153fff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 0x7fa14006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.447+0000 7fa153fff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 0x7fa14006c5d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:23.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.451+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa148053170 con 0x7fa15406c690 2023-08-27T11:24:23.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:23.743+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort"]} v 0) v1 -- 0x7fa15406bac0 con 0x7fa15406c690 2023-08-27T11:24:24.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.208+0000 7fa150ff9700 1 -- 172.21.15.43:0/260556692 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort"]}]=0 v109) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa148056790 con 0x7fa15406c690 2023-08-27T11:24:24.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 msgr2=0x7fa14006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 0x7fa14006c5d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa144000c00 tx=0x7fa144008030 comp rx=0 tx=0).stop 2023-08-27T11:24:24.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 msgr2=0x7fa1540ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa14800c500 tx=0x7fa14800c810 comp rx=0 tx=0).stop 2023-08-27T11:24:24.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 shutdown_connections 2023-08-27T11:24:24.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa14006a110 0x7fa14006c5d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1540c4600 0x7fa1540c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa15406b320 0x7fa1540af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 --2- 172.21.15.43:0/260556692 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa15406c690 0x7fa1540ad740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 >> 172.21.15.43:0/260556692 conn(0x7fa1540c9c80 msgr2=0x7fa154152650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:24.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 shutdown_connections 2023-08-27T11:24:24.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.211+0000 7fa15a9ff700 1 -- 172.21.15.43:0/260556692 wait complete. 2023-08-27T11:24:24.234 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:24.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 Processor -- start 2023-08-27T11:24:24.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 -- start start 2023-08-27T11:24:24.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c0c51a0 0x7f178c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f178c06ca60 0x7f178c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c06d700 con 0x7f178c0ab040 2023-08-27T11:24:24.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c1530b0 con 0x7f178c06ca60 2023-08-27T11:24:24.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.437+0000 7f17913ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c14c860 con 0x7f178c0c51a0 2023-08-27T11:24:24.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f178c06ca60 0x7f178c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f178c06ca60 0x7f178c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36068/0 (socket says 172.21.15.43:36068) 2023-08-27T11:24:24.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f178c0ab040 0x7f178c155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35590/0 (socket says 172.21.15.43:35590) 2023-08-27T11:24:24.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 -- 172.21.15.43:0/2397393213 learned_addr learned my addr 172.21.15.43:0/2397393213 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:24.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178affd700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c0c51a0 0x7f178c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 -- 172.21.15.43:0/2397393213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c0c51a0 msgr2=0x7f178c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c0c51a0 0x7f178c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 -- 172.21.15.43:0/2397393213 >> v1:172.21.15.43:6789/0 conn(0x7f178c0ab040 legacy=0x7f178c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f178a7fc700 1 -- 172.21.15.43:0/2397393213 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c152430 con 0x7f178c06ca60 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.438+0000 7f1789ffb700 1 -- 172.21.15.43:0/2397393213 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361068881 0 0) 0x7f178c06d700 con 0x7f178c0ab040 2023-08-27T11:24:24.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f178a7fc700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c06ca60 0x7f178c0aab00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1780009920 tx=0x7f1780009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be565bf236067c07 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f1789ffb700 1 -- 172.21.15.43:0/2397393213 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780011830 con 0x7f178c06ca60 2023-08-27T11:24:24.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f1789ffb700 1 -- 172.21.15.43:0/2397393213 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1780011990 con 0x7f178c06ca60 2023-08-27T11:24:24.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f1789ffb700 1 -- 172.21.15.43:0/2397393213 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780011d20 con 0x7f178c06ca60 2023-08-27T11:24:24.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 -- 172.21.15.43:0/2397393213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c06ca60 msgr2=0x7f178c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c06ca60 0x7f178c0aab00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1780009920 tx=0x7f1780009c30 comp rx=0 tx=0).stop 2023-08-27T11:24:24.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 -- 172.21.15.43:0/2397393213 shutdown_connections 2023-08-27T11:24:24.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c0c51a0 0x7f178c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 --2- 172.21.15.43:0/2397393213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c06ca60 0x7f178c0aab00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 -- 172.21.15.43:0/2397393213 >> 172.21.15.43:0/2397393213 conn(0x7f178c06aa50 msgr2=0x7f178c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:24.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.439+0000 7f17913ff700 1 -- 172.21.15.43:0/2397393213 shutdown_connections 2023-08-27T11:24:24.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.440+0000 7f17913ff700 1 -- 172.21.15.43:0/2397393213 wait complete. 2023-08-27T11:24:24.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.441+0000 7f17913ff700 1 Processor -- start 2023-08-27T11:24:24.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.441+0000 7f17913ff700 1 -- start start 2023-08-27T11:24:24.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c06ca60 0x7f178c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c0ab040 0x7f178c0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0712e0 con 0x7f178c0c51a0 2023-08-27T11:24:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1ec970 con 0x7f178c0ab040 2023-08-27T11:24:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f17913ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c06fea0 con 0x7f178c06ca60 2023-08-27T11:24:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.442+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36076/0 (socket says 172.21.15.43:36076) 2023-08-27T11:24:24.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 -- 172.21.15.43:0/1820665989 learned_addr learned my addr 172.21.15.43:0/1820665989 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:24.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 -- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c06ca60 msgr2=0x7f178c06f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c06ca60 0x7f178c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 -- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c0ab040 msgr2=0x7f178c0c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c0ab040 0x7f178c0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 -- 172.21.15.43:0/1820665989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009550 con 0x7f178c0c51a0 2023-08-27T11:24:24.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f178b7fe700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f178400cc70 tx=0x7f178400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400ada0 con 0x7f178c0c51a0 2023-08-27T11:24:24.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400ce70 con 0x7f178c0c51a0 2023-08-27T11:24:24.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c06f680 con 0x7f178c0c51a0 2023-08-27T11:24:24.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.443+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17840072f0 con 0x7f178c0c51a0 2023-08-27T11:24:24.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.444+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0c3c20 con 0x7f178c0c51a0 2023-08-27T11:24:24.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.445+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c04ee70 con 0x7f178c0c51a0 2023-08-27T11:24:24.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.446+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1784007450 con 0x7f178c0c51a0 2023-08-27T11:24:24.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.447+0000 7f17737fe700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 0x7f177806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.447+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1784088140 con 0x7f178c0c51a0 2023-08-27T11:24:24.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.447+0000 7f178affd700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 0x7f177806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.448+0000 7f178affd700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 0x7f177806c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f177c006b20 tx=0x7f177c006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.451+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1784053ac0 con 0x7f178c0c51a0 2023-08-27T11:24:24.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.663+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f178c1ecb20 con 0x7f178c0c51a0 2023-08-27T11:24:24.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.664+0000 7f17737fe700 1 -- 172.21.15.43:0/1820665989 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14780 (secure 0 0 0) 0x7f178c1ecb20 con 0x7f178c0c51a0 2023-08-27T11:24:24.670 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:24.670 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":38,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:21.181554+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6832/2873976200":"2023-08-28T11:24:18.170230+0000","172.21.15.57:6834/2873976200":"2023-08-28T11:24:18.170230+0000","172.21.15.43:6834/1831306112":"2023-08-28T11:23:59.878489+0000","172.21.15.43:6836/1831306112":"2023-08-28T11:23:59.878489+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:24.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 msgr2=0x7f177806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 0x7f177806c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f177c006b20 tx=0x7f177c006ab0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 msgr2=0x7f178c1ece00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f178400cc70 tx=0x7f178400a340 comp rx=0 tx=0).stop 2023-08-27T11:24:24.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 shutdown_connections 2023-08-27T11:24:24.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f177806a0e0 0x7f177806c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f178c0c51a0 0x7f178c1ece00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f178c06ca60 0x7f178c06f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 --2- 172.21.15.43:0/1820665989 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f178c0ab040 0x7f178c0c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 >> 172.21.15.43:0/1820665989 conn(0x7f178c06aa50 msgr2=0x7f178c0aa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:24.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.666+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 shutdown_connections 2023-08-27T11:24:24.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.667+0000 7f17913ff700 1 -- 172.21.15.43:0/1820665989 wait complete. 2023-08-27T11:24:24.687 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:24:24.688 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:24:24.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.890+0000 7fd7c2bff700 1 Processor -- start 2023-08-27T11:24:24.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.890+0000 7fd7c2bff700 1 -- start start 2023-08-27T11:24:24.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7bc151d20 0x7fd7bc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc0c7c00 0x7fd7bc0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c5750 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc154660 con 0x7fd7bc151d20 2023-08-27T11:24:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c2bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc154940 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36084/0 (socket says 172.21.15.43:36084) 2023-08-27T11:24:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 -- 172.21.15.43:0/526085907 learned_addr learned my addr 172.21.15.43:0/526085907 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7bbfff700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc0c7c00 0x7fd7bc0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c099b700 1 --2- 172.21.15.43:0/526085907 >> v2:172.21.15.57:3300/0 conn(0x7fd7bc151d20 0x7fd7bc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 -- 172.21.15.43:0/526085907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc0c7c00 msgr2=0x7fd7bc0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc0c7c00 0x7fd7bc0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 -- 172.21.15.43:0/526085907 >> v2:172.21.15.57:3300/0 conn(0x7fd7bc151d20 msgr2=0x7fd7bc0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:24.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 --2- 172.21.15.43:0/526085907 >> v2:172.21.15.57:3300/0 conn(0x7fd7bc151d20 0x7fd7bc0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.891+0000 7fd7c119c700 1 -- 172.21.15.43:0/526085907 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc154c20 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.892+0000 7fd7c119c700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cac10 tx=0x7fd7b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ea5ab3182a8718 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.892+0000 7fd7bb7fe700 1 -- 172.21.15.43:0/526085907 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400e070 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.892+0000 7fd7bb7fe700 1 -- 172.21.15.43:0/526085907 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400b910 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.892+0000 7fd7bb7fe700 1 -- 172.21.15.43:0/526085907 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400bcc0 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 -- 172.21.15.43:0/526085907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0abcc0 msgr2=0x7fd7bc06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0cac10 tx=0x7fd7b400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 -- 172.21.15.43:0/526085907 shutdown_connections 2023-08-27T11:24:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc06a8e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/526085907 >> v2:172.21.15.57:3300/0 conn(0x7fd7bc151d20 0x7fd7bc0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/526085907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc0c7c00 0x7fd7bc0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 -- 172.21.15.43:0/526085907 >> 172.21.15.43:0/526085907 conn(0x7fd7bc0c9d00 msgr2=0x7fd7bc0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 -- 172.21.15.43:0/526085907 shutdown_connections 2023-08-27T11:24:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.893+0000 7fd7c2bff700 1 -- 172.21.15.43:0/526085907 wait complete. 2023-08-27T11:24:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.894+0000 7fd7c2bff700 1 Processor -- start 2023-08-27T11:24:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.895+0000 7fd7c2bff700 1 -- start start 2023-08-27T11:24:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.895+0000 7fd7c2bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc1ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.895+0000 7fd7c2bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.895+0000 7fd7c2bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc151d20 0x7fd7bc0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7c2bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0abb80 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7c2bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c2920 con 0x7fd7bc0abcc0 2023-08-27T11:24:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7c2bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc0c22d0 con 0x7fd7bc151d20 2023-08-27T11:24:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36096/0 (socket says 172.21.15.43:36096) 2023-08-27T11:24:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 -- 172.21.15.43:0/4265317005 learned_addr learned my addr 172.21.15.43:0/4265317005 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7c099b700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc1ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7c119c700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc151d20 0x7fd7bc0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 -- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc151d20 msgr2=0x7fd7bc0c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc151d20 0x7fd7bc0c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 -- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7bc0abcc0 msgr2=0x7fd7bc1ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc1ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 -- 172.21.15.43:0/4265317005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009b30 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.896+0000 7fd7bbfff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800e930 tx=0x7fd7a800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.897+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8009690 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.897+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a800c850 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.897+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800cbe0 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.897+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc1ee190 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.897+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc1ee470 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.898+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc14ee20 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.899+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7a800cd40 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.900+0000 7fd7b97fa700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.900+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd7a8088390 con 0x7fd7bc0c7c00 2023-08-27T11:24:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.900+0000 7fd7c099b700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.901+0000 7fd7c099b700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009ad0 tx=0x7fd7b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:24.904+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7a8053d10 con 0x7fd7bc0c7c00 2023-08-27T11:24:25.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.112+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd7bc04ee70 con 0x7fd7bc0c7c00 2023-08-27T11:24:25.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.112+0000 7fd7b97fa700 1 -- 172.21.15.43:0/4265317005 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7a8057330 con 0x7fd7bc0c7c00 2023-08-27T11:24:25.115 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:24:25.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 msgr2=0x7fd7a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009ad0 tx=0x7fd7b0008040 comp rx=0 tx=0).stop 2023-08-27T11:24:25.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 msgr2=0x7fd7bc1edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800e930 tx=0x7fd7a800ecf0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 shutdown_connections 2023-08-27T11:24:25.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7bc151d20 0x7fd7bc0c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7bc0abcc0 0x7fd7bc1ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 --2- 172.21.15.43:0/4265317005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7bc0c7c00 0x7fd7bc1edb40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 >> 172.21.15.43:0/4265317005 conn(0x7fd7bc0c9d00 msgr2=0x7fd7bc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:25.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 shutdown_connections 2023-08-27T11:24:25.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.114+0000 7fd7c2bff700 1 -- 172.21.15.43:0/4265317005 wait complete. 2023-08-27T11:24:25.135 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:24:25.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.338+0000 7f0bbf3ff700 1 Processor -- start 2023-08-27T11:24:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.338+0000 7f0bbf3ff700 1 -- start start 2023-08-27T11:24:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbf3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 0x7f0bb80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbf3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 0x7f0bb80ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbf3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb8154660 con 0x7f0bb80abcc0 2023-08-27T11:24:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbf3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80c5750 con 0x7f0bb8151d20 2023-08-27T11:24:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbf3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8154940 con 0x7f0bb80c7c00 2023-08-27T11:24:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbd99c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0bb80abcc0 0x7f0bb806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35602/0 (socket says 172.21.15.43:35602) 2023-08-27T11:24:25.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbd99c700 1 -- 172.21.15.43:0/351666190 learned_addr learned my addr 172.21.15.43:0/351666190 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:25.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/351666190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 0x7f0bb80ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.339+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/351666190 >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 0x7f0bb80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0baffff700 1 -- 172.21.15.43:0/351666190 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524082928 0 0) 0x7f0bb8154660 con 0x7f0bb80abcc0 2023-08-27T11:24:25.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0baffff700 1 -- 172.21.15.43:0/351666190 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba40035b0 con 0x7f0bb80abcc0 2023-08-27T11:24:25.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbc99a700 1 -- 172.21.15.43:0/351666190 >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 msgr2=0x7f0bb80c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:25.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/351666190 >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 0x7f0bb80c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbc99a700 1 -- 172.21.15.43:0/351666190 >> v1:172.21.15.43:6789/0 conn(0x7f0bb80abcc0 legacy=0x7f0bb806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbc99a700 1 -- 172.21.15.43:0/351666190 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8154c20 con 0x7f0bb80c7c00 2023-08-27T11:24:25.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/351666190 >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 0x7f0bb80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:25.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.340+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/351666190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 0x7f0bb80ab780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009840 tx=0x7f0ba8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d481d299dc5ae4d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0baffff700 1 -- 172.21.15.43:0/351666190 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011830 con 0x7f0bb80c7c00 2023-08-27T11:24:25.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0baffff700 1 -- 172.21.15.43:0/351666190 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8011990 con 0x7f0bb80c7c00 2023-08-27T11:24:25.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0baffff700 1 -- 172.21.15.43:0/351666190 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8011d20 con 0x7f0bb80c7c00 2023-08-27T11:24:25.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/351666190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 msgr2=0x7f0bb80ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/351666190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 0x7f0bb80ab780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009840 tx=0x7f0ba8009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:25.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/351666190 shutdown_connections 2023-08-27T11:24:25.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/351666190 >> v2:172.21.15.57:3300/0 conn(0x7f0bb8151d20 0x7f0bb80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/351666190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80c7c00 0x7f0bb80ab780 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/351666190 >> 172.21.15.43:0/351666190 conn(0x7f0bb80c9d00 msgr2=0x7f0bb80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:25.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/351666190 shutdown_connections 2023-08-27T11:24:25.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.341+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/351666190 wait complete. 2023-08-27T11:24:25.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.343+0000 7f0bbf3ff700 1 Processor -- start 2023-08-27T11:24:25.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.343+0000 7f0bbf3ff700 1 -- start start 2023-08-27T11:24:25.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 0x7f0bb80c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 0x7f0bb8155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb81572e0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8153e90 con 0x7f0bb8151d20 2023-08-27T11:24:25.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbf3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8158610 con 0x7f0bb80abcc0 2023-08-27T11:24:25.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbc99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbc99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36100/0 (socket says 172.21.15.43:36100) 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.344+0000 7f0bbc99a700 1 -- 172.21.15.43:0/3164777574 learned_addr learned my addr 172.21.15.43:0/3164777574 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbd99c700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 0x7f0bb8155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 0x7f0bb80c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 -- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 msgr2=0x7f0bb80c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 0x7f0bb80c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 -- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 msgr2=0x7f0bb8155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 0x7f0bb8155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 -- 172.21.15.43:0/3164777574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb40094a0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbd99c700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 0x7f0bb8155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:25.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 0x7f0bb80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:25.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbc99a700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80090b0 tx=0x7f0ba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80036a0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba801f070 con 0x7f0bb80c7c00 2023-08-27T11:24:25.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba80094a0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8003a40 con 0x7f0bb80c7c00 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.345+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb80c27a0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.346+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8158780 con 0x7f0bb80c7c00 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.347+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ba8003ba0 con 0x7f0bb80c7c00 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.348+0000 7f0badffb700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 0x7f0b9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.348+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0ba8021070 con 0x7f0bb80c7c00 2023-08-27T11:24:25.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.349+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 0x7f0b9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.349+0000 7f0bbd19b700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 0x7f0b9c06c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009c50 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.353+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0bb8158780 con 0x7f0bb80c7c00 2023-08-27T11:24:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.563+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0bb8158780 con 0x7f0bb80c7c00 2023-08-27T11:24:25.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.563+0000 7f0badffb700 1 -- 172.21.15.43:0/3164777574 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0bb8158780 con 0x7f0bb80c7c00 2023-08-27T11:24:25.567 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:24:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 msgr2=0x7f0b9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 0x7f0b9c06c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009c50 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2023-08-27T11:24:25.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 msgr2=0x7f0bb80aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80090b0 tx=0x7f0ba8004750 comp rx=0 tx=0).stop 2023-08-27T11:24:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 shutdown_connections 2023-08-27T11:24:25.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b9c06a0e0 0x7f0b9c06c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bb8151d20 0x7f0bb8155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bb80abcc0 0x7f0bb80c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 --2- 172.21.15.43:0/3164777574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bb80c7c00 0x7f0bb80aaff0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 >> 172.21.15.43:0/3164777574 conn(0x7f0bb80c9d00 msgr2=0x7f0bb806b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 shutdown_connections 2023-08-27T11:24:25.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.566+0000 7f0bbf3ff700 1 -- 172.21.15.43:0/3164777574 wait complete. 2023-08-27T11:24:25.586 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:24:25.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.788+0000 7fcd5e1ff700 1 Processor -- start 2023-08-27T11:24:25.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.789+0000 7fcd5e1ff700 1 -- start start 2023-08-27T11:24:25.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcd580aab90 0x7fcd5806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580c4f30 0x7fcd58154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd5806b0e0 0x7fcd58154560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580c0a80 con 0x7fcd580aab90 2023-08-27T11:24:25.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd580c02b0 con 0x7fcd5806b0e0 2023-08-27T11:24:25.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd5e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58154aa0 con 0x7fcd580c4f30 2023-08-27T11:24:25.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd577fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcd580aab90 0x7fcd5806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd577fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcd580aab90 0x7fcd5806aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36102/0 (socket says 172.21.15.43:36102) 2023-08-27T11:24:25.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd577fe700 1 -- 172.21.15.43:0/807549424 learned_addr learned my addr 172.21.15.43:0/807549424 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:25.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd56ffd700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580c4f30 0x7fcd58154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.790+0000 7fcd57fff700 1 --2- 172.21.15.43:0/807549424 >> v2:172.21.15.57:3300/0 conn(0x7fcd5806b0e0 0x7fcd58154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 -- 172.21.15.43:0/807549424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580c4f30 msgr2=0x7fcd58154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:25.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580c4f30 0x7fcd58154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 -- 172.21.15.43:0/807549424 >> v2:172.21.15.57:3300/0 conn(0x7fcd5806b0e0 msgr2=0x7fcd58154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:25.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 --2- 172.21.15.43:0/807549424 >> v2:172.21.15.57:3300/0 conn(0x7fcd5806b0e0 0x7fcd58154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 -- 172.21.15.43:0/807549424 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580c04c0 con 0x7fcd580aab90 2023-08-27T11:24:25.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd577fe700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd580aab90 0x7fcd5806aba0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcd5806dd30 tx=0x7fcd48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9999fda0b34f1ca4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd567fc700 1 -- 172.21.15.43:0/807549424 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011830 con 0x7fcd580aab90 2023-08-27T11:24:25.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd567fc700 1 -- 172.21.15.43:0/807549424 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48011990 con 0x7fcd580aab90 2023-08-27T11:24:25.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.791+0000 7fcd567fc700 1 -- 172.21.15.43:0/807549424 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48011d20 con 0x7fcd580aab90 2023-08-27T11:24:25.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/807549424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd580aab90 msgr2=0x7fcd5806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd580aab90 0x7fcd5806aba0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcd5806dd30 tx=0x7fcd48009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/807549424 shutdown_connections 2023-08-27T11:24:25.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/807549424 >> v2:172.21.15.57:3300/0 conn(0x7fcd5806b0e0 0x7fcd58154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd580aab90 0x7fcd5806aba0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/807549424 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580c4f30 0x7fcd58154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/807549424 >> 172.21.15.43:0/807549424 conn(0x7fcd580c5b10 msgr2=0x7fcd580c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:25.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/807549424 shutdown_connections 2023-08-27T11:24:25.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.792+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/807549424 wait complete. 2023-08-27T11:24:25.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.793+0000 7fcd5e1ff700 1 Processor -- start 2023-08-27T11:24:25.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 -- start start 2023-08-27T11:24:25.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 0x7fcd581ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 0x7fcd58148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58150620 con 0x7fcd5806b0e0 2023-08-27T11:24:25.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd581e9450 con 0x7fcd5814cd20 2023-08-27T11:24:25.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.794+0000 7fcd5e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd58070830 con 0x7fcd580aab90 2023-08-27T11:24:25.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36116/0 (socket says 172.21.15.43:36116) 2023-08-27T11:24:25.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 -- 172.21.15.43:0/3002772612 learned_addr learned my addr 172.21.15.43:0/3002772612 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:25.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd57fff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 0x7fcd58148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd56ffd700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 0x7fcd581ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 -- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 msgr2=0x7fcd581ea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 0x7fcd581ea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 -- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 msgr2=0x7fcd58148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 0x7fcd58148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 -- 172.21.15.43:0/3002772612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48009550 con 0x7fcd5806b0e0 2023-08-27T11:24:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd57fff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 0x7fcd58148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd56ffd700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 0x7fcd581ea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:25.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.795+0000 7fcd577fe700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.796+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004300 con 0x7fcd5806b0e0 2023-08-27T11:24:25.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.796+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4801f070 con 0x7fcd5806b0e0 2023-08-27T11:24:25.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.796+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480036a0 con 0x7fcd5806b0e0 2023-08-27T11:24:25.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.796+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd581e9660 con 0x7fcd5806b0e0 2023-08-27T11:24:25.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.796+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd58070d60 con 0x7fcd5806b0e0 2023-08-27T11:24:25.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.797+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5804ee70 con 0x7fcd5806b0e0 2023-08-27T11:24:25.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.798+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd48021030 con 0x7fcd5806b0e0 2023-08-27T11:24:25.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.799+0000 7fcd3ffff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 0x7fcd4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:25.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.799+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcd48089550 con 0x7fcd5806b0e0 2023-08-27T11:24:25.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.799+0000 7fcd56ffd700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 0x7fcd4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:25.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.799+0000 7fcd56ffd700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 0x7fcd4406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd5815e620 tx=0x7fcd4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:25.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:25.803+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd48054ed0 con 0x7fcd5806b0e0 2023-08-27T11:24:26.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.011+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcd580c3e20 con 0x7fcd5806b0e0 2023-08-27T11:24:26.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.015+0000 7fcd3ffff700 1 -- 172.21.15.43:0/3002772612 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd480584f0 con 0x7fcd5806b0e0 2023-08-27T11:24:26.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 msgr2=0x7fcd4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 0x7fcd4406c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcd5815e620 tx=0x7fcd4c008040 comp rx=0 tx=0).stop 2023-08-27T11:24:26.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 msgr2=0x7fcd5814bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48004750 comp rx=0 tx=0).stop 2023-08-27T11:24:26.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 shutdown_connections 2023-08-27T11:24:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd4406a0e0 0x7fcd4406c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd5814cd20 0x7fcd58148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd5806b0e0 0x7fcd5814bb50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 --2- 172.21.15.43:0/3002772612 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd580aab90 0x7fcd581ea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 >> 172.21.15.43:0/3002772612 conn(0x7fcd580c5b10 msgr2=0x7fcd580c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 shutdown_connections 2023-08-27T11:24:26.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.018+0000 7fcd5e1ff700 1 -- 172.21.15.43:0/3002772612 wait complete. 2023-08-27T11:24:26.038 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:24:26.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:26.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:26.238 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:24:26.238 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:24:26.239 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:26.282 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:24:26.283 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:24:26.283 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:26.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:24:26.328 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:24:26.329 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:26.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.528+0000 7f8c9d1ff700 1 Processor -- start 2023-08-27T11:24:26.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.528+0000 7f8c9d1ff700 1 -- start start 2023-08-27T11:24:26.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.529+0000 7f8c9d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 0x7f8c980c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9d1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c9806ad70 0x7f8c9806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9d1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9806c4e0 con 0x7f8c98151a90 2023-08-27T11:24:26.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9d1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c98155370 con 0x7f8c9806ad70 2023-08-27T11:24:26.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980c82c0 con 0x7f8c980c4630 2023-08-27T11:24:26.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c96d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8c98151a90 0x7f8c980c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:35616/0 (socket says 172.21.15.43:35616) 2023-08-27T11:24:26.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c96d9d700 1 -- 172.21.15.43:0/2215889683 learned_addr learned my addr 172.21.15.43:0/2215889683 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:26.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/2215889683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 0x7f8c980c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9759e700 1 --2- 172.21.15.43:0/2215889683 >> v2:172.21.15.57:3300/0 conn(0x7f8c9806ad70 0x7f8c9806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779281074 0 0) 0x7f8c9806c4e0 con 0x7f8c98151a90 2023-08-27T11:24:26.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.530+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c840035b0 con 0x7f8c98151a90 2023-08-27T11:24:26.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c8ffff700 1 -- 172.21.15.43:0/2215889683 >> v2:172.21.15.57:3300/0 conn(0x7f8c9806ad70 msgr2=0x7f8c9806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:26.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/2215889683 >> v2:172.21.15.57:3300/0 conn(0x7f8c9806ad70 0x7f8c9806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c8ffff700 1 -- 172.21.15.43:0/2215889683 >> v1:172.21.15.43:6789/0 conn(0x7f8c98151a90 legacy=0x7f8c980c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 276205809 0 0) 0x7f8c840035b0 con 0x7f8c98151a90 2023-08-27T11:24:26.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c8ffff700 1 -- 172.21.15.43:0/2215889683 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98151e70 con 0x7f8c980c4630 2023-08-27T11:24:26.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/2215889683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 0x7f8c980c4a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009840 tx=0x7f8c80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=871b95f62bb8913d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:26.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88001670 con 0x7f8c980c4630 2023-08-27T11:24:26.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c80004030 con 0x7f8c980c4630 2023-08-27T11:24:26.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.531+0000 7f8c9659c700 1 -- 172.21.15.43:0/2215889683 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800043c0 con 0x7f8c980c4630 2023-08-27T11:24:26.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/2215889683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 msgr2=0x7f8c980c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/2215889683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 0x7f8c980c4a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009840 tx=0x7f8c80009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/2215889683 shutdown_connections 2023-08-27T11:24:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/2215889683 >> v2:172.21.15.57:3300/0 conn(0x7f8c9806ad70 0x7f8c9806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/2215889683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c980c4630 0x7f8c980c4a90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/2215889683 >> 172.21.15.43:0/2215889683 conn(0x7f8c980ab820 msgr2=0x7f8c980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:26.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/2215889683 shutdown_connections 2023-08-27T11:24:26.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.532+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/2215889683 wait complete. 2023-08-27T11:24:26.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.534+0000 7f8c9d1ff700 1 Processor -- start 2023-08-27T11:24:26.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.534+0000 7f8c9d1ff700 1 -- start start 2023-08-27T11:24:26.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c980c4630 0x7f8c98153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c98151a90 0x7f8c981e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c98155c00 con 0x7f8c9806ad70 2023-08-27T11:24:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c981ecca0 con 0x7f8c980c4630 2023-08-27T11:24:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c981e9f20 con 0x7f8c98151a90 2023-08-27T11:24:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36124/0 (socket says 172.21.15.43:36124) 2023-08-27T11:24:26.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 -- 172.21.15.43:0/3066835636 learned_addr learned my addr 172.21.15.43:0/3066835636 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c9759e700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c98151a90 0x7f8c981e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c980c4630 0x7f8c98153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 -- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c98151a90 msgr2=0x7f8c981e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c98151a90 0x7f8c981e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 -- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c980c4630 msgr2=0x7f8c98153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c980c4630 0x7f8c98153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.535+0000 7f8c96d9d700 1 -- 172.21.15.43:0/3066835636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800094a0 con 0x7f8c9806ad70 2023-08-27T11:24:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c96d9d700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c750 tx=0x7f8c8800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88004c80 con 0x7f8c9806ad70 2023-08-27T11:24:26.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c88004de0 con 0x7f8c9806ad70 2023-08-27T11:24:26.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c981ea200 con 0x7f8c9806ad70 2023-08-27T11:24:26.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88007310 con 0x7f8c9806ad70 2023-08-27T11:24:26.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.536+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c981eceb0 con 0x7f8c9806ad70 2023-08-27T11:24:26.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.537+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9814e480 con 0x7f8c9806ad70 2023-08-27T11:24:26.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.538+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c88007470 con 0x7f8c9806ad70 2023-08-27T11:24:26.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.539+0000 7f8c8f7fe700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 0x7f8c7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:26.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.539+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8c88087f80 con 0x7f8c9806ad70 2023-08-27T11:24:26.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.539+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 0x7f8c7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:26.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.540+0000 7f8c8ffff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 0x7f8c7806c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c800090b0 tx=0x7f8c80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:26.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.543+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c88053870 con 0x7f8c9806ad70 2023-08-27T11:24:26.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.801+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c9804ee70 con 0x7f8c9806ad70 2023-08-27T11:24:26.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.801+0000 7f8c8f7fe700 1 -- 172.21.15.43:0/3066835636 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3690 (secure 0 0 0) 0x7f8c88056e90 con 0x7f8c9806ad70 2023-08-27T11:24:26.803 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:26.803 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/69565059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":69565059},{"type":"v1","addr":"172.21.15.57:6835","nonce":69565059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4808,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/651062384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":651062384},{"type":"v1","addr":"172.21.15.43:6837","nonce":651062384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3770159957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3770159957},{"type":"v1","addr":"172.21.15.43:6836","nonce":3770159957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5332,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/1026552069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1026552069},{"type":"v1","addr":"172.21.15.57:6834","nonce":1026552069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[]} 2023-08-27T11:24:26.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 msgr2=0x7f8c7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 0x7f8c7806c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c800090b0 tx=0x7f8c80008030 comp rx=0 tx=0).stop 2023-08-27T11:24:26.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 msgr2=0x7f8c98156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:26.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800c750 tx=0x7f8c8800ca60 comp rx=0 tx=0).stop 2023-08-27T11:24:26.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 shutdown_connections 2023-08-27T11:24:26.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c7806a0e0 0x7f8c7806c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c98151a90 0x7f8c981e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c9806ad70 0x7f8c98156a10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 --2- 172.21.15.43:0/3066835636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c980c4630 0x7f8c98153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 >> 172.21.15.43:0/3066835636 conn(0x7f8c980ab820 msgr2=0x7f8c9806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 shutdown_connections 2023-08-27T11:24:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:26.804+0000 7f8c9d1ff700 1 -- 172.21.15.43:0/3066835636 wait complete. 2023-08-27T11:24:26.808 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 25 2023-08-27T11:24:26.824 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:24:26.824 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:24:26.824 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:24:26.825 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:24:26.825 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:24:26.825 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:24:26.826 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:24:26.826 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:24:26.826 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:24:26.826 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:24:26.827 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:24:26.827 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:24:26.827 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:24:26.827 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:24:26.828 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:24:26.828 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:24:26.841 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:24:26.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:24:26.842 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:24:26.842 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:24:26.844 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:24:26.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:24:26.845 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:24:26.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:24:26.886 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:24:26.886 DEBUG:teuthology.parallel:result is None 2023-08-27T11:24:26.888 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:24:26.889 DEBUG:teuthology.parallel:result is None 2023-08-27T11:24:26.889 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:24:26.890 DEBUG:teuthology.parallel:result is None 2023-08-27T11:24:26.892 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:24:26.892 DEBUG:teuthology.parallel:result is None 2023-08-27T11:24:26.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:24:27.043 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:24:27.043 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:24:27.046 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:24:27.046 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:24:27.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.104+0000 7f3b75bff700 1 Processor -- start 2023-08-27T11:24:27.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.104+0000 7f3b75bff700 1 -- start start 2023-08-27T11:24:27.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b75bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b700c51a0 0x7f3b7006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b75bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3b7006ca60 0x7f3b700aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b75bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7006d700 con 0x7f3b700ab040 2023-08-27T11:24:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b75bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b701530b0 con 0x7f3b7006ca60 2023-08-27T11:24:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b75bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7014c860 con 0x7f3b700c51a0 2023-08-27T11:24:27.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b6effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3b7006ca60 0x7f3b700aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b6effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3b7006ca60 0x7f3b700aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36178/0 (socket says 172.21.15.43:36178) 2023-08-27T11:24:27.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.105+0000 7f3b6effd700 1 -- 172.21.15.43:0/3759534897 learned_addr learned my addr 172.21.15.43:0/3759534897 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:27.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6f7fe700 1 --2- 172.21.15.43:0/3759534897 >> v2:172.21.15.57:3300/0 conn(0x7f3b700c51a0 0x7f3b7006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6effd700 1 -- 172.21.15.43:0/3759534897 >> v2:172.21.15.57:3300/0 conn(0x7f3b700c51a0 msgr2=0x7f3b7006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6effd700 1 --2- 172.21.15.43:0/3759534897 >> v2:172.21.15.57:3300/0 conn(0x7f3b700c51a0 0x7f3b7006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6effd700 1 -- 172.21.15.43:0/3759534897 >> v1:172.21.15.57:6789/0 conn(0x7f3b700ab040 legacy=0x7f3b70155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6effd700 1 -- 172.21.15.43:0/3759534897 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70152430 con 0x7f3b7006ca60 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6effd700 1 --2- 172.21.15.43:0/3759534897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b7006ca60 0x7f3b700aab00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b7006db90 tx=0x7f3b64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb43f08465be3b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6e7fc700 1 -- 172.21.15.43:0/3759534897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400b860 con 0x7f3b7006ca60 2023-08-27T11:24:27.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6e7fc700 1 -- 172.21.15.43:0/3759534897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400b9c0 con 0x7f3b7006ca60 2023-08-27T11:24:27.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.106+0000 7f3b6e7fc700 1 -- 172.21.15.43:0/3759534897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400bd50 con 0x7f3b7006ca60 2023-08-27T11:24:27.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 -- 172.21.15.43:0/3759534897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b7006ca60 msgr2=0x7f3b700aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 --2- 172.21.15.43:0/3759534897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b7006ca60 0x7f3b700aab00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b7006db90 tx=0x7f3b64009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 -- 172.21.15.43:0/3759534897 shutdown_connections 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 --2- 172.21.15.43:0/3759534897 >> v2:172.21.15.57:3300/0 conn(0x7f3b700c51a0 0x7f3b7006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 --2- 172.21.15.43:0/3759534897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b7006ca60 0x7f3b700aab00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 -- 172.21.15.43:0/3759534897 >> 172.21.15.43:0/3759534897 conn(0x7f3b7006aa50 msgr2=0x7f3b700c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:27.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 -- 172.21.15.43:0/3759534897 shutdown_connections 2023-08-27T11:24:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.107+0000 7f3b75bff700 1 -- 172.21.15.43:0/3759534897 wait complete. 2023-08-27T11:24:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.109+0000 7f3b75bff700 1 Processor -- start 2023-08-27T11:24:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.109+0000 7f3b75bff700 1 -- start start 2023-08-27T11:24:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 0x7f3b700beef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 0x7f3b700bd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 0x7f3b701e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700bdaa0 con 0x7f3b700c51a0 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b700a5aa0 con 0x7f3b7006ca60 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b75bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b701e8450 con 0x7f3b700ab040 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 0x7f3b701e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 0x7f3b700beef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b6effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 0x7f3b700bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b6f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 0x7f3b700beef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:39408/0 (socket says 172.21.15.43:39408) 2023-08-27T11:24:27.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.110+0000 7f3b6f7fe700 1 -- 172.21.15.43:0/1802807189 learned_addr learned my addr 172.21.15.43:0/1802807189 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:27.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 -- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 msgr2=0x7f3b700beef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:27.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 0x7f3b700beef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:27.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 -- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 msgr2=0x7f3b701e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:27.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 0x7f3b701e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:27.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 -- 172.21.15.43:0/1802807189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009550 con 0x7f3b700ab040 2023-08-27T11:24:27.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6ffff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 0x7f3b701e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:27.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b6effd700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 0x7f3b700bd560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b64016000 tx=0x7f3b64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004300 con 0x7f3b700ab040 2023-08-27T11:24:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6401f070 con 0x7f3b700ab040 2023-08-27T11:24:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640036a0 con 0x7f3b700ab040 2023-08-27T11:24:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b701e7490 con 0x7f3b700ab040 2023-08-27T11:24:27.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.111+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b700bf820 con 0x7f3b700ab040 2023-08-27T11:24:27.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.113+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b700bf9b0 con 0x7f3b700ab040 2023-08-27T11:24:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.113+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b64021030 con 0x7f3b700ab040 2023-08-27T11:24:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.114+0000 7f3b57fff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 0x7f3b5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.114+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3b640896c0 con 0x7f3b700ab040 2023-08-27T11:24:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.115+0000 7f3b6f7fe700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 0x7f3b5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:27.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.115+0000 7f3b6f7fe700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 0x7f3b5c06c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b60007af0 tx=0x7f3b60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:27.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.119+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b64055160 con 0x7f3b700ab040 2023-08-27T11:24:27.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:27.352+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3b7004ee70 con 0x7f3b700ab040 2023-08-27T11:24:28.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.250+0000 7f3b57fff700 1 -- 172.21.15.43:0/1802807189 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3b64058780 con 0x7f3b700ab040 2023-08-27T11:24:28.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 msgr2=0x7f3b5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 0x7f3b5c06c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3b60007af0 tx=0x7f3b60008040 comp rx=0 tx=0).stop 2023-08-27T11:24:28.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 msgr2=0x7f3b700bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 0x7f3b700bd560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3b64016000 tx=0x7f3b64004750 comp rx=0 tx=0).stop 2023-08-27T11:24:28.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 shutdown_connections 2023-08-27T11:24:28.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b5c06a0e0 0x7f3b5c06c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b700c51a0 0x7f3b701e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b7006ca60 0x7f3b700beef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 --2- 172.21.15.43:0/1802807189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b700ab040 0x7f3b700bd560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 >> 172.21.15.43:0/1802807189 conn(0x7f3b7006aa50 msgr2=0x7f3b70155500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:28.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 shutdown_connections 2023-08-27T11:24:28.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.253+0000 7f3b75bff700 1 -- 172.21.15.43:0/1802807189 wait complete. 2023-08-27T11:24:28.258 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:24:28.275 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:24:28.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.484+0000 7f0e435ff700 1 Processor -- start 2023-08-27T11:24:28.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.484+0000 7f0e435ff700 1 -- start start 2023-08-27T11:24:28.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e435ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e3c06ca60 0x7f0e3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e435ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e3c155910 0x7f0e3c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e435ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c06d700 con 0x7f0e3c0c51a0 2023-08-27T11:24:28.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e435ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c1530b0 con 0x7f0e3c155910 2023-08-27T11:24:28.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e435ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c14c860 con 0x7f0e3c06ca60 2023-08-27T11:24:28.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e41b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e3c155910 0x7f0e3c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e41b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e3c155910 0x7f0e3c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36198/0 (socket says 172.21.15.43:36198) 2023-08-27T11:24:28.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e41b9c700 1 -- 172.21.15.43:0/153842415 learned_addr learned my addr 172.21.15.43:0/153842415 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:28.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.485+0000 7f0e40b9a700 1 --2- 172.21.15.43:0/153842415 >> v2:172.21.15.57:3300/0 conn(0x7f0e3c06ca60 0x7f0e3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e41b9c700 1 -- 172.21.15.43:0/153842415 >> v2:172.21.15.57:3300/0 conn(0x7f0e3c06ca60 msgr2=0x7f0e3c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:28.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e41b9c700 1 --2- 172.21.15.43:0/153842415 >> v2:172.21.15.57:3300/0 conn(0x7f0e3c06ca60 0x7f0e3c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e41b9c700 1 -- 172.21.15.43:0/153842415 >> v1:172.21.15.57:6789/0 conn(0x7f0e3c0c51a0 legacy=0x7f0e3c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e41b9c700 1 -- 172.21.15.43:0/153842415 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c152430 con 0x7f0e3c155910 2023-08-27T11:24:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e41b9c700 1 --2- 172.21.15.43:0/153842415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c155910 0x7f0e3c155d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0aba70 tx=0x7f0e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5641016832ae0d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e33fff700 1 -- 172.21.15.43:0/153842415 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400e070 con 0x7f0e3c155910 2023-08-27T11:24:28.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e33fff700 1 -- 172.21.15.43:0/153842415 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400b8d0 con 0x7f0e3c155910 2023-08-27T11:24:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.486+0000 7f0e33fff700 1 -- 172.21.15.43:0/153842415 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400bc80 con 0x7f0e3c155910 2023-08-27T11:24:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 -- 172.21.15.43:0/153842415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c155910 msgr2=0x7f0e3c155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 --2- 172.21.15.43:0/153842415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c155910 0x7f0e3c155d80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0aba70 tx=0x7f0e3400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 -- 172.21.15.43:0/153842415 shutdown_connections 2023-08-27T11:24:28.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 --2- 172.21.15.43:0/153842415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c155910 0x7f0e3c155d80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 --2- 172.21.15.43:0/153842415 >> v2:172.21.15.57:3300/0 conn(0x7f0e3c06ca60 0x7f0e3c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 -- 172.21.15.43:0/153842415 >> 172.21.15.43:0/153842415 conn(0x7f0e3c06aa50 msgr2=0x7f0e3c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:28.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 -- 172.21.15.43:0/153842415 shutdown_connections 2023-08-27T11:24:28.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.487+0000 7f0e435ff700 1 -- 172.21.15.43:0/153842415 wait complete. 2023-08-27T11:24:28.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.489+0000 7f0e435ff700 1 Processor -- start 2023-08-27T11:24:28.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.489+0000 7f0e435ff700 1 -- start start 2023-08-27T11:24:28.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e3c0c51a0 0x7f0e3c0bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e3c155910 0x7f0e3c1ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c06fc40 con 0x7f0e3c06ca60 2023-08-27T11:24:28.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c071bc0 con 0x7f0e3c0c51a0 2023-08-27T11:24:28.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e435ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1e7000 con 0x7f0e3c155910 2023-08-27T11:24:28.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36212/0 (socket says 172.21.15.43:36212) 2023-08-27T11:24:28.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 -- 172.21.15.43:0/1616817060 learned_addr learned my addr 172.21.15.43:0/1616817060 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:28.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e41b9c700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e3c155910 0x7f0e3c1ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e40b9a700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e3c0c51a0 0x7f0e3c0bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 -- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e3c155910 msgr2=0x7f0e3c1ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e3c155910 0x7f0e3c1ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 -- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e3c0c51a0 msgr2=0x7f0e3c0bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e3c0c51a0 0x7f0e3c0bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.490+0000 7f0e4139b700 1 -- 172.21.15.43:0/1616817060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009b30 con 0x7f0e3c06ca60 2023-08-27T11:24:28.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e4139b700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c490 tx=0x7f0e3800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:28.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380052d0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38005450 con 0x7f0e3c06ca60 2023-08-27T11:24:28.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38006aa0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c06f960 con 0x7f0e3c06ca60 2023-08-27T11:24:28.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.491+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c1e74f0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.492+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c04ee70 con 0x7f0e3c06ca60 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.493+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e38003680 con 0x7f0e3c06ca60 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.494+0000 7f0e31ffb700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 0x7f0e2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.494+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0e380873f0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.494+0000 7f0e40b9a700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 0x7f0e2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:28.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.495+0000 7f0e40b9a700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 0x7f0e2006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0bce30 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:28.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.499+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e38052ec0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.786+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0e3c06fd80 con 0x7f0e3c06ca60 2023-08-27T11:24:28.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.787+0000 7f0e31ffb700 1 -- 172.21.15.43:0/1616817060 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4724 (secure 0 0 0) 0x7f0e380564e0 con 0x7f0e3c06ca60 2023-08-27T11:24:28.789 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:28.789 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:24:28.790 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:24:28.790 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.790 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:24:28.790 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:24:28.791 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.791 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.791 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:24:28.791 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:24:28.792 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.792 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.792 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.792 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.793 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:24:28.793 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:24:28.793 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.793 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:24:28.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:24:28.794 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.794 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.795 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:24:28.796 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:24:28.796 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.797 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:24:28.797 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:24:28.797 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.798 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:24:28.800 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:24:28.800 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.800 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.800 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.801 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.801 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.801 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.801 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.802 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.803 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.803 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.803 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.803 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.804 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.805 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.805 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.805 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:24:28.805 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:24:28.805 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.806 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.806 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.806 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.806 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.806 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.807 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.808 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.808 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.808 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.808 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.808 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:24:28.809 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:24:28.809 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.809 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.809 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.809 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:24:28.810 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.811 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.812 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.812 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:24:28.812 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:24:28.812 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.813 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:24:28.813 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:24:28.813 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.813 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.813 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.814 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:24:28.815 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:24:28.815 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.815 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.815 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.815 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:24:28.816 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:24:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:24:28.817 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:24:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:24:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:24:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:24:28.818 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.819 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.819 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.819 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.819 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:24:28.819 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.820 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:28.821 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:28.821 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:24:28.821 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:24:28.821 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:24:28.821 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:24:28.822 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:24:28.822 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:24:28.822 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.822 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:28.823 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:24:28.823 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:24:28.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 msgr2=0x7f0e2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 0x7f0e2006c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0bce30 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2023-08-27T11:24:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 msgr2=0x7f0e3c071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c490 tx=0x7f0e3800c850 comp rx=0 tx=0).stop 2023-08-27T11:24:28.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 shutdown_connections 2023-08-27T11:24:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e2006a0e0 0x7f0e2006c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e3c155910 0x7f0e3c1ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e3c06ca60 0x7f0e3c071680 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 --2- 172.21.15.43:0/1616817060 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e3c0c51a0 0x7f0e3c0bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:28.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 >> 172.21.15.43:0/1616817060 conn(0x7f0e3c06aa50 msgr2=0x7f0e3c150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 shutdown_connections 2023-08-27T11:24:28.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:28.789+0000 7f0e435ff700 1 -- 172.21.15.43:0/1616817060 wait complete. 2023-08-27T11:24:28.827 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:29.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.028+0000 7f18917ff700 1 Processor -- start 2023-08-27T11:24:29.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.028+0000 7f18917ff700 1 -- start start 2023-08-27T11:24:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.029+0000 7f18917ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.029+0000 7f18917ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f188c155910 0x7f188c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.029+0000 7f18917ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c06d700 con 0x7f188c06ca60 2023-08-27T11:24:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.029+0000 7f18917ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c1530b0 con 0x7f188c155910 2023-08-27T11:24:29.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.029+0000 7f18917ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c14c860 con 0x7f188c0c51a0 2023-08-27T11:24:29.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f188c155910 0x7f188c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f188c155910 0x7f188c155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57084/0 (socket says 172.21.15.43:57084) 2023-08-27T11:24:29.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 -- 172.21.15.43:0/1449936048 learned_addr learned my addr 172.21.15.43:0/1449936048 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:29.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188affd700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 -- 172.21.15.43:0/1449936048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 msgr2=0x7f188c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 -- 172.21.15.43:0/1449936048 >> v1:172.21.15.57:6789/0 conn(0x7f188c06ca60 legacy=0x7f188c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 -- 172.21.15.43:0/1449936048 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c152430 con 0x7f188c155910 2023-08-27T11:24:29.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.030+0000 7f188b7fe700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c155910 0x7f188c155da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1884009e80 tx=0x7f188400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fe3dc5cb1ff78 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f1889ffb700 1 -- 172.21.15.43:0/1449936048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400e070 con 0x7f188c155910 2023-08-27T11:24:29.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f1889ffb700 1 -- 172.21.15.43:0/1449936048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400b980 con 0x7f188c155910 2023-08-27T11:24:29.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f1889ffb700 1 -- 172.21.15.43:0/1449936048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400bd30 con 0x7f188c155910 2023-08-27T11:24:29.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 -- 172.21.15.43:0/1449936048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c155910 msgr2=0x7f188c155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c155910 0x7f188c155da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1884009e80 tx=0x7f188400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:29.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 -- 172.21.15.43:0/1449936048 shutdown_connections 2023-08-27T11:24:29.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c155910 0x7f188c155da0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 --2- 172.21.15.43:0/1449936048 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.031+0000 7f18917ff700 1 -- 172.21.15.43:0/1449936048 >> 172.21.15.43:0/1449936048 conn(0x7f188c06aa50 msgr2=0x7f188c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:29.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.032+0000 7f18917ff700 1 -- 172.21.15.43:0/1449936048 shutdown_connections 2023-08-27T11:24:29.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.032+0000 7f18917ff700 1 -- 172.21.15.43:0/1449936048 wait complete. 2023-08-27T11:24:29.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.033+0000 7f18917ff700 1 Processor -- start 2023-08-27T11:24:29.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.033+0000 7f18917ff700 1 -- start start 2023-08-27T11:24:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 0x7f188c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0705d0 con 0x7f188c06ca60 2023-08-27T11:24:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1ed620 con 0x7f188c155910 2023-08-27T11:24:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.034+0000 7f18917ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c072030 con 0x7f188c0c51a0 2023-08-27T11:24:29.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57096/0 (socket says 172.21.15.43:57096) 2023-08-27T11:24:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 -- 172.21.15.43:0/3101862314 learned_addr learned my addr 172.21.15.43:0/3101862314 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188b7fe700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 0x7f188c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188a7fc700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 -- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 msgr2=0x7f188c14bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c14bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 -- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 msgr2=0x7f188c14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 0x7f188c14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 -- 172.21.15.43:0/3101862314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009b30 con 0x7f188c06ca60 2023-08-27T11:24:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188b7fe700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 0x7f188c14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188a7fc700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f188affd700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e810 tx=0x7f187c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.035+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c013610 con 0x7f188c06ca60 2023-08-27T11:24:29.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.036+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c013770 con 0x7f188c06ca60 2023-08-27T11:24:29.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.036+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c013b20 con 0x7f188c06ca60 2023-08-27T11:24:29.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.036+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c1ed8c0 con 0x7f188c06ca60 2023-08-27T11:24:29.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.036+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c072310 con 0x7f188c06ca60 2023-08-27T11:24:29.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.037+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c1edab0 con 0x7f188c06ca60 2023-08-27T11:24:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.038+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f187c013c80 con 0x7f188c06ca60 2023-08-27T11:24:29.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.038+0000 7f18737fe700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 0x7f187806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.039+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f187c087f90 con 0x7f188c06ca60 2023-08-27T11:24:29.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.039+0000 7f188a7fc700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 0x7f187806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.039+0000 7f188a7fc700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 0x7f187806c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f188c0c43b0 tx=0x7f1880009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.043+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f187c0573d0 con 0x7f188c06ca60 2023-08-27T11:24:29.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.256+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f188c04ee70 con 0x7f188c06ca60 2023-08-27T11:24:29.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.257+0000 7f18737fe700 1 -- 172.21.15.43:0/3101862314 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14521 (secure 0 0 0) 0x7f187c056f60 con 0x7f188c06ca60 2023-08-27T11:24:29.259 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:29.259 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":43,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:28.245565+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:29.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 msgr2=0x7f187806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 0x7f187806c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f188c0c43b0 tx=0x7f1880009040 comp rx=0 tx=0).stop 2023-08-27T11:24:29.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 msgr2=0x7f188c0aa810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f187c00e810 tx=0x7f187c00ebd0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 shutdown_connections 2023-08-27T11:24:29.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f187806a0e0 0x7f187806c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f188c155910 0x7f188c14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f188c06ca60 0x7f188c0aa810 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 --2- 172.21.15.43:0/3101862314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f188c0c51a0 0x7f188c14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.259+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 >> 172.21.15.43:0/3101862314 conn(0x7f188c06aa50 msgr2=0x7f188c0c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:29.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.260+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 shutdown_connections 2023-08-27T11:24:29.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.260+0000 7f18917ff700 1 -- 172.21.15.43:0/3101862314 wait complete. 2023-08-27T11:24:29.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:24:29.281 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:24:29.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.484+0000 7ff73f7ff700 1 Processor -- start 2023-08-27T11:24:29.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.485+0000 7ff73f7ff700 1 -- start start 2023-08-27T11:24:29.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73f7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff738151d20 0x7ff7380c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380c7c00 0x7ff7380ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73f7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff738154660 con 0x7ff7380abcc0 2023-08-27T11:24:29.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73f7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380c5750 con 0x7ff738151d20 2023-08-27T11:24:29.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff738154940 con 0x7ff7380c7c00 2023-08-27T11:24:29.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73d59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff738151d20 0x7ff7380c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73dd9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff7380abcc0 0x7ff73806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55164/0 (socket says 172.21.15.43:55164) 2023-08-27T11:24:29.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73d59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff738151d20 0x7ff7380c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57110/0 (socket says 172.21.15.43:57110) 2023-08-27T11:24:29.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.486+0000 7ff73dd9c700 1 -- 172.21.15.43:0/2002531011 learned_addr learned my addr 172.21.15.43:0/2002531011 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:29.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73cd9a700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380c7c00 0x7ff7380ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73d59b700 1 -- 172.21.15.43:0/2002531011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380c7c00 msgr2=0x7ff7380ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:29.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73d59b700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380c7c00 0x7ff7380ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73d59b700 1 -- 172.21.15.43:0/2002531011 >> v1:172.21.15.43:6789/0 conn(0x7ff7380abcc0 legacy=0x7ff73806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73d59b700 1 -- 172.21.15.43:0/2002531011 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738154c20 con 0x7ff738151d20 2023-08-27T11:24:29.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff72ffff700 1 -- 172.21.15.43:0/2002531011 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545591724 0 0) 0x7ff738154660 con 0x7ff7380abcc0 2023-08-27T11:24:29.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff73d59b700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff7380c8110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff734009840 tx=0x7ff734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ef15827d1fbb4f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff72ffff700 1 -- 172.21.15.43:0/2002531011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734011830 con 0x7ff738151d20 2023-08-27T11:24:29.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff72ffff700 1 -- 172.21.15.43:0/2002531011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734011990 con 0x7ff738151d20 2023-08-27T11:24:29.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.487+0000 7ff72ffff700 1 -- 172.21.15.43:0/2002531011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734011d20 con 0x7ff738151d20 2023-08-27T11:24:29.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 -- 172.21.15.43:0/2002531011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 msgr2=0x7ff7380c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff7380c8110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff734009840 tx=0x7ff734009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:29.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 -- 172.21.15.43:0/2002531011 shutdown_connections 2023-08-27T11:24:29.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff7380c8110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/2002531011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380c7c00 0x7ff7380ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 -- 172.21.15.43:0/2002531011 >> 172.21.15.43:0/2002531011 conn(0x7ff7380c9d00 msgr2=0x7ff7380ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:29.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 -- 172.21.15.43:0/2002531011 shutdown_connections 2023-08-27T11:24:29.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.488+0000 7ff73f7ff700 1 -- 172.21.15.43:0/2002531011 wait complete. 2023-08-27T11:24:29.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.490+0000 7ff73f7ff700 1 Processor -- start 2023-08-27T11:24:29.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.490+0000 7ff73f7ff700 1 -- start start 2023-08-27T11:24:29.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380abcc0 0x7ff7381edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 0x7ff738153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c1280 con 0x7ff738151d20 2023-08-27T11:24:29.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381edfe0 con 0x7ff7380c7c00 2023-08-27T11:24:29.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c0ee0 con 0x7ff7380abcc0 2023-08-27T11:24:29.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57124/0 (socket says 172.21.15.43:57124) 2023-08-27T11:24:29.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 -- 172.21.15.43:0/3184639598 learned_addr learned my addr 172.21.15.43:0/3184639598 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:29.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73d59b700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380abcc0 0x7ff7381edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73cd9a700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 0x7ff738153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 -- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380abcc0 msgr2=0x7ff7381edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380abcc0 0x7ff7381edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 -- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 msgr2=0x7ff738153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 0x7ff738153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73dd9c700 1 -- 172.21.15.43:0/3184639598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340094a0 con 0x7ff738151d20 2023-08-27T11:24:29.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.491+0000 7ff73cd9a700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 0x7ff738153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:29.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff73dd9c700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff7300015b0 tx=0x7ff73000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000ab00 con 0x7ff738151d20 2023-08-27T11:24:29.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000ac60 con 0x7ff738151d20 2023-08-27T11:24:29.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730012400 con 0x7ff738151d20 2023-08-27T11:24:29.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380aadd0 con 0x7ff738151d20 2023-08-27T11:24:29.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.492+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff738153bc0 con 0x7ff738151d20 2023-08-27T11:24:29.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.493+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380ab2f0 con 0x7ff738151d20 2023-08-27T11:24:29.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.494+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff730007d50 con 0x7ff738151d20 2023-08-27T11:24:29.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.495+0000 7ff72dffb700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 0x7ff71c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.495+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff730087ca0 con 0x7ff738151d20 2023-08-27T11:24:29.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.495+0000 7ff73d59b700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 0x7ff71c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.496+0000 7ff73d59b700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 0x7ff71c06c5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff7340090b0 tx=0x7ff73401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.499+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff7380ab2f0 con 0x7ff738151d20 2023-08-27T11:24:29.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.708+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7380c0d40 con 0x7ff738151d20 2023-08-27T11:24:29.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.709+0000 7ff72dffb700 1 -- 172.21.15.43:0/3184639598 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7380c0d40 con 0x7ff738151d20 2023-08-27T11:24:29.710 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:24:29.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 msgr2=0x7ff71c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 0x7ff71c06c5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff7340090b0 tx=0x7ff73401c040 comp rx=0 tx=0).stop 2023-08-27T11:24:29.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 msgr2=0x7ff738147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff7300015b0 tx=0x7ff73000cee0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 shutdown_connections 2023-08-27T11:24:29.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff71c06a110 0x7ff71c06c5d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff738151d20 0x7ff738147ff0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7380abcc0 0x7ff7381edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 --2- 172.21.15.43:0/3184639598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7380c7c00 0x7ff738153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 >> 172.21.15.43:0/3184639598 conn(0x7ff7380c9d00 msgr2=0x7ff738150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:29.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 shutdown_connections 2023-08-27T11:24:29.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.711+0000 7ff73f7ff700 1 -- 172.21.15.43:0/3184639598 wait complete. 2023-08-27T11:24:29.731 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:24:29.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.934+0000 7f9b305ff700 1 Processor -- start 2023-08-27T11:24:29.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.934+0000 7f9b305ff700 1 -- start start 2023-08-27T11:24:29.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b305ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280ac410 0x7f9b280c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b305ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b280c94c0 0x7f9b2815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b305ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280c80c0 con 0x7f9b280c49f0 2023-08-27T11:24:29.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b305ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b281555a0 con 0x7f9b280c94c0 2023-08-27T11:24:29.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b305ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281552c0 con 0x7f9b280ac410 2023-08-27T11:24:29.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b2eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b280c94c0 0x7f9b2815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b2e39b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9b280c49f0 0x7f9b28151790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55170/0 (socket says 172.21.15.43:55170) 2023-08-27T11:24:29.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.935+0000 7f9b2e39b700 1 -- 172.21.15.43:0/3493897807 learned_addr learned my addr 172.21.15.43:0/3493897807 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:29.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2db9a700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280ac410 0x7f9b280c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2eb9c700 1 -- 172.21.15.43:0/3493897807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280ac410 msgr2=0x7f9b280c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:29.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2eb9c700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280ac410 0x7f9b280c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2eb9c700 1 -- 172.21.15.43:0/3493897807 >> v1:172.21.15.43:6789/0 conn(0x7f9b280c49f0 legacy=0x7f9b28151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2eb9c700 1 -- 172.21.15.43:0/3493897807 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280c8360 con 0x7f9b280c94c0 2023-08-27T11:24:29.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2d399700 1 -- 172.21.15.43:0/3493897807 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001416746 0 0) 0x7f9b280c80c0 con 0x7f9b280c49f0 2023-08-27T11:24:29.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2eb9c700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c94c0 0x7f9b2815eee0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009d90 tx=0x7f9b2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbf65e7007a71fa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2d399700 1 -- 172.21.15.43:0/3493897807 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000e070 con 0x7f9b280c94c0 2023-08-27T11:24:29.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2d399700 1 -- 172.21.15.43:0/3493897807 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000bbd0 con 0x7f9b280c94c0 2023-08-27T11:24:29.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.936+0000 7f9b2d399700 1 -- 172.21.15.43:0/3493897807 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20012430 con 0x7f9b280c94c0 2023-08-27T11:24:29.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 -- 172.21.15.43:0/3493897807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c94c0 msgr2=0x7f9b2815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c94c0 0x7f9b2815eee0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009d90 tx=0x7f9b2000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:29.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 -- 172.21.15.43:0/3493897807 shutdown_connections 2023-08-27T11:24:29.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c94c0 0x7f9b2815eee0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 --2- 172.21.15.43:0/3493897807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280ac410 0x7f9b280c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 -- 172.21.15.43:0/3493897807 >> 172.21.15.43:0/3493897807 conn(0x7f9b280ab8f0 msgr2=0x7f9b280abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:29.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 -- 172.21.15.43:0/3493897807 shutdown_connections 2023-08-27T11:24:29.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.937+0000 7f9b305ff700 1 -- 172.21.15.43:0/3493897807 wait complete. 2023-08-27T11:24:29.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.939+0000 7f9b305ff700 1 Processor -- start 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.939+0000 7f9b305ff700 1 -- start start 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b280ac410 0x7f9b280aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 0x7f9b28149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2814d6e0 con 0x7f9b280c49f0 2023-08-27T11:24:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2814d400 con 0x7f9b280ac410 2023-08-27T11:24:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b305ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c1000 con 0x7f9b280c94c0 2023-08-27T11:24:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57144/0 (socket says 172.21.15.43:57144) 2023-08-27T11:24:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 -- 172.21.15.43:0/4097267917 learned_addr learned my addr 172.21.15.43:0/4097267917 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2eb9c700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 0x7f9b28149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2e39b700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b280ac410 0x7f9b280aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 -- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 msgr2=0x7f9b28149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 0x7f9b28149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 -- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b280ac410 msgr2=0x7f9b280aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:29.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b280ac410 0x7f9b280aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:29.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2db9a700 1 -- 172.21.15.43:0/4097267917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20009a70 con 0x7f9b280c49f0 2023-08-27T11:24:29.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.940+0000 7f9b2eb9c700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 0x7f9b28149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:29.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b2db9a700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800e810 tx=0x7f9b1800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18013610 con 0x7f9b280c49f0 2023-08-27T11:24:29.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18013770 con 0x7f9b280c49f0 2023-08-27T11:24:29.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b280c12e0 con 0x7f9b280c49f0 2023-08-27T11:24:29.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18013b20 con 0x7f9b280c49f0 2023-08-27T11:24:29.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.941+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b280c15c0 con 0x7f9b280c49f0 2023-08-27T11:24:29.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.942+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280c89e0 con 0x7f9b280c49f0 2023-08-27T11:24:29.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.943+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b18013c80 con 0x7f9b280c49f0 2023-08-27T11:24:29.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.944+0000 7f9b1effd700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 0x7f9b0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:29.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.944+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9b18087fe0 con 0x7f9b280c49f0 2023-08-27T11:24:29.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.944+0000 7f9b2e39b700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 0x7f9b0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:29.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.945+0000 7f9b2e39b700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 0x7f9b0c06c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b24000f60 tx=0x7f9b24007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:29.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:29.948+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b180539d0 con 0x7f9b280c49f0 2023-08-27T11:24:30.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.158+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b2804ee70 con 0x7f9b280c49f0 2023-08-27T11:24:30.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.158+0000 7f9b1effd700 1 -- 172.21.15.43:0/4097267917 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b18056ff0 con 0x7f9b280c49f0 2023-08-27T11:24:30.160 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:24:30.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.160+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 msgr2=0x7f9b0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.160+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 0x7f9b0c06c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9b24000f60 tx=0x7f9b24007be0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 msgr2=0x7f9b28149100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800e810 tx=0x7f9b1800ebd0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 shutdown_connections 2023-08-27T11:24:30.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b0c06a0e0 0x7f9b0c06c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b280c94c0 0x7f9b28149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b280ac410 0x7f9b280aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 --2- 172.21.15.43:0/4097267917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b280c49f0 0x7f9b28149100 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 >> 172.21.15.43:0/4097267917 conn(0x7f9b280ab8f0 msgr2=0x7f9b280abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:30.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 shutdown_connections 2023-08-27T11:24:30.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.161+0000 7f9b305ff700 1 -- 172.21.15.43:0/4097267917 wait complete. 2023-08-27T11:24:30.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:24:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.381+0000 7f4992fff700 1 Processor -- start 2023-08-27T11:24:30.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.382+0000 7f4992fff700 1 -- start start 2023-08-27T11:24:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4992fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f498c06d1c0 0x7f498c156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4992fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c152430 con 0x7f498c0c51a0 2023-08-27T11:24:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4992fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f498c152710 con 0x7f498c06ca60 2023-08-27T11:24:30.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4992fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c1530b0 con 0x7f498c06d1c0 2023-08-27T11:24:30.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4990d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f498c0c51a0 0x7f498c0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55180/0 (socket says 172.21.15.43:55180) 2023-08-27T11:24:30.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f4990d9b700 1 -- 172.21.15.43:0/3542699753 learned_addr learned my addr 172.21.15.43:0/3542699753 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:30.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f499159c700 1 --2- 172.21.15.43:0/3542699753 >> v2:172.21.15.57:3300/0 conn(0x7f498c06d1c0 0x7f498c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.383+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920186053 0 0) 0x7f498c152430 con 0x7f498c0c51a0 2023-08-27T11:24:30.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c0035b0 con 0x7f498c0c51a0 2023-08-27T11:24:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688083703 0 0) 0x7f498c152710 con 0x7f498c06ca60 2023-08-27T11:24:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f498c152430 con 0x7f498c06ca60 2023-08-27T11:24:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2189065403 0 0) 0x7f497c0035b0 con 0x7f498c0c51a0 2023-08-27T11:24:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 >> v2:172.21.15.57:3300/0 conn(0x7f498c06d1c0 msgr2=0x7f498c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:30.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 --2- 172.21.15.43:0/3542699753 >> v2:172.21.15.57:3300/0 conn(0x7f498c06d1c0 0x7f498c156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 >> v1:172.21.15.57:6789/0 conn(0x7f498c06ca60 legacy=0x7f498c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c1529f0 con 0x7f498c0c51a0 2023-08-27T11:24:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f4980001670 con 0x7f498c0c51a0 2023-08-27T11:24:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 >> v1:172.21.15.43:6789/0 conn(0x7f498c0c51a0 legacy=0x7f498c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c003be0 0x7f497c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c004850 0x7f497c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f497c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c1530b0 con 0x7f497c005260 2023-08-27T11:24:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c00c190 con 0x7f497c004850 2023-08-27T11:24:30.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c00c350 con 0x7f497c003be0 2023-08-27T11:24:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f499159c700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f497c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f498bfff700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c004850 0x7f497c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.384+0000 7f4990d9b700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c003be0 0x7f497c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 -- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c003be0 msgr2=0x7f497c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:30.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c003be0 0x7f497c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 -- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c004850 msgr2=0x7f497c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c004850 0x7f497c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 -- 172.21.15.43:0/3542699753 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0035b0 con 0x7f497c005260 2023-08-27T11:24:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f498bfff700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c004850 0x7f497c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:30.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 -- 172.21.15.43:0/3542699753 reap_dead start 2023-08-27T11:24:30.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f499159c700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f497c00ba10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4984009fc0 tx=0x7f497c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a9d1bf1d6cae51 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984003a20 con 0x7f497c005260 2023-08-27T11:24:30.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498400f040 con 0x7f497c005260 2023-08-27T11:24:30.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.385+0000 7f498b7fe700 1 -- 172.21.15.43:0/3542699753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984003de0 con 0x7f497c005260 2023-08-27T11:24:30.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 -- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 msgr2=0x7f497c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f497c00ba10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4984009fc0 tx=0x7f497c005880 comp rx=0 tx=0).stop 2023-08-27T11:24:30.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 -- 172.21.15.43:0/3542699753 shutdown_connections 2023-08-27T11:24:30.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 --2- 172.21.15.43:0/3542699753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f497c00ba10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 -- 172.21.15.43:0/3542699753 >> 172.21.15.43:0/3542699753 conn(0x7f498c06aa50 msgr2=0x7f498c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:30.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 -- 172.21.15.43:0/3542699753 shutdown_connections 2023-08-27T11:24:30.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.386+0000 7f4992fff700 1 -- 172.21.15.43:0/3542699753 wait complete. 2023-08-27T11:24:30.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.388+0000 7f4992fff700 1 Processor -- start 2023-08-27T11:24:30.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.388+0000 7f4992fff700 1 -- start start 2023-08-27T11:24:30.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f498c072450 0x7f498c14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f498c0c3930 0x7f498c14b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c14da40 con 0x7f497c005260 2023-08-27T11:24:30.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c1e9b30 con 0x7f498c072450 2023-08-27T11:24:30.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4992fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c1e9e10 con 0x7f498c0c3930 2023-08-27T11:24:30.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4990d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4990d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57162/0 (socket says 172.21.15.43:57162) 2023-08-27T11:24:30.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f4990d9b700 1 -- 172.21.15.43:0/2086816808 learned_addr learned my addr 172.21.15.43:0/2086816808 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:30.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f498bfff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f498c072450 0x7f498c14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.389+0000 7f499159c700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f498c0c3930 0x7f498c14b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 -- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f498c0c3930 msgr2=0x7f498c14b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f498c0c3930 0x7f498c14b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 -- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f498c072450 msgr2=0x7f498c14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f498c072450 0x7f498c14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 -- 172.21.15.43:0/2086816808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c1ea0f0 con 0x7f497c005260 2023-08-27T11:24:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4990d9b700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4980004f80 tx=0x7f4980007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980012560 con 0x7f497c005260 2023-08-27T11:24:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49800126e0 con 0x7f497c005260 2023-08-27T11:24:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c1ea3d0 con 0x7f497c005260 2023-08-27T11:24:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4980012a90 con 0x7f497c005260 2023-08-27T11:24:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.390+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c1e97e0 con 0x7f497c005260 2023-08-27T11:24:30.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.391+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c14ffd0 con 0x7f497c005260 2023-08-27T11:24:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.392+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4980012bf0 con 0x7f497c005260 2023-08-27T11:24:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.393+0000 7f49897fa700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 0x7f497006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.393+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f49800880b0 con 0x7f497c005260 2023-08-27T11:24:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.394+0000 7f498bfff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 0x7f497006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.394+0000 7f498bfff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 0x7f497006c5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f498c1ea950 tx=0x7f4978009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.397+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4980053ae0 con 0x7f497c005260 2023-08-27T11:24:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.611+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f498c1ea5c0 con 0x7f497c005260 2023-08-27T11:24:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.612+0000 7f49897fa700 1 -- 172.21.15.43:0/2086816808 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4980057100 con 0x7f497c005260 2023-08-27T11:24:30.614 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:30.614 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:24:30.614 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:30.614 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:24:30.615 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:24:30.615 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:30.615 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:30.615 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:24:30.615 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:24:30.616 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:30.616 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:24:30.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 msgr2=0x7f497006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 0x7f497006c5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f498c1ea950 tx=0x7f4978009040 comp rx=0 tx=0).stop 2023-08-27T11:24:30.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 msgr2=0x7f498c0bed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4980004f80 tx=0x7f4980007340 comp rx=0 tx=0).stop 2023-08-27T11:24:30.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 shutdown_connections 2023-08-27T11:24:30.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f497006a110 0x7f497006c5d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f498c0c3930 0x7f498c14b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c005260 0x7f498c0bed20 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 --2- 172.21.15.43:0/2086816808 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f498c072450 0x7f498c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 >> 172.21.15.43:0/2086816808 conn(0x7f498c06aa50 msgr2=0x7f498c0c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:30.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.614+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 shutdown_connections 2023-08-27T11:24:30.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.615+0000 7f4992fff700 1 -- 172.21.15.43:0/2086816808 wait complete. 2023-08-27T11:24:30.634 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:24:30.635 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:24:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.839+0000 7feb643ff700 1 Processor -- start 2023-08-27T11:24:30.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.839+0000 7feb643ff700 1 -- start start 2023-08-27T11:24:30.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb643ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 0x7feb5c06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb643ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c06cde0 con 0x7feb5c06d360 2023-08-27T11:24:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb643ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5c155b00 con 0x7feb5c152380 2023-08-27T11:24:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb643ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c1558f0 con 0x7feb5c0aae50 2023-08-27T11:24:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb6199a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feb5c06d360 0x7feb5c14f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55196/0 (socket says 172.21.15.43:55196) 2023-08-27T11:24:30.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.840+0000 7feb6199a700 1 -- 172.21.15.43:0/1932501073 learned_addr learned my addr 172.21.15.43:0/1932501073 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb6219b700 1 --2- 172.21.15.43:0/1932501073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 0x7feb5c06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957854622 0 0) 0x7feb5c06cde0 con 0x7feb5c06d360 2023-08-27T11:24:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb480035b0 con 0x7feb5c06d360 2023-08-27T11:24:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2384448728 0 0) 0x7feb480035b0 con 0x7feb5c06d360 2023-08-27T11:24:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb6219b700 1 -- 172.21.15.43:0/1932501073 >> v1:172.21.15.57:6789/0 conn(0x7feb5c152380 legacy=0x7feb5c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb6219b700 1 -- 172.21.15.43:0/1932501073 >> v1:172.21.15.43:6789/0 conn(0x7feb5c06d360 legacy=0x7feb5c14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb6219b700 1 -- 172.21.15.43:0/1932501073 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c155de0 con 0x7feb5c0aae50 2023-08-27T11:24:30.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.841+0000 7feb6219b700 1 --2- 172.21.15.43:0/1932501073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 0x7feb5c06c8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb58009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d285205bfa0dd706 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c001670 con 0x7feb5c0aae50 2023-08-27T11:24:30.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58004030 con 0x7feb5c0aae50 2023-08-27T11:24:30.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb61199700 1 -- 172.21.15.43:0/1932501073 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580043c0 con 0x7feb5c0aae50 2023-08-27T11:24:30.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 -- 172.21.15.43:0/1932501073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 msgr2=0x7feb5c06c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 --2- 172.21.15.43:0/1932501073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 0x7feb5c06c8a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb58009b80 comp rx=0 tx=0).stop 2023-08-27T11:24:30.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 -- 172.21.15.43:0/1932501073 shutdown_connections 2023-08-27T11:24:30.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 --2- 172.21.15.43:0/1932501073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c0aae50 0x7feb5c06c8a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 -- 172.21.15.43:0/1932501073 >> 172.21.15.43:0/1932501073 conn(0x7feb5c0c2400 msgr2=0x7feb5c0c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:30.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 -- 172.21.15.43:0/1932501073 shutdown_connections 2023-08-27T11:24:30.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.842+0000 7feb643ff700 1 -- 172.21.15.43:0/1932501073 wait complete. 2023-08-27T11:24:30.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.844+0000 7feb643ff700 1 Processor -- start 2023-08-27T11:24:30.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.844+0000 7feb643ff700 1 -- start start 2023-08-27T11:24:30.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c06d360 0x7feb5c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb5c152380 0x7feb5c1e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c14f0d0 con 0x7feb5c0aae50 2023-08-27T11:24:30.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c14f270 con 0x7feb5c152380 2023-08-27T11:24:30.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb643ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c1e9010 con 0x7feb5c06d360 2023-08-27T11:24:30.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb6199a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb6199a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57166/0 (socket says 172.21.15.43:57166) 2023-08-27T11:24:30.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.845+0000 7feb6199a700 1 -- 172.21.15.43:0/848689372 learned_addr learned my addr 172.21.15.43:0/848689372 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:30.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6299c700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb5c152380 0x7feb5c1e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6219b700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c06d360 0x7feb5c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 -- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c06d360 msgr2=0x7feb5c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c06d360 0x7feb5c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 -- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb5c152380 msgr2=0x7feb5c1e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:30.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb5c152380 0x7feb5c1e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:30.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 -- 172.21.15.43:0/848689372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580094a0 con 0x7feb5c0aae50 2023-08-27T11:24:30.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb6199a700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c750 tx=0x7feb4c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c007560 con 0x7feb5c0aae50 2023-08-27T11:24:30.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c0076e0 con 0x7feb5c0aae50 2023-08-27T11:24:30.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c004ab0 con 0x7feb5c0aae50 2023-08-27T11:24:30.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.846+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c071630 con 0x7feb5c0aae50 2023-08-27T11:24:30.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.847+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c0718d0 con 0x7feb5c0aae50 2023-08-27T11:24:30.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.847+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c0be8c0 con 0x7feb5c0aae50 2023-08-27T11:24:30.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.849+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb4c004c10 con 0x7feb5c0aae50 2023-08-27T11:24:30.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.849+0000 7feb52ffd700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:30.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.849+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feb4c0873c0 con 0x7feb5c0aae50 2023-08-27T11:24:30.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.850+0000 7feb6219b700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:30.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.850+0000 7feb6219b700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 0x7feb4006c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb580090b0 tx=0x7feb58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:30.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:30.853+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb4c052df0 con 0x7feb5c0aae50 2023-08-27T11:24:31.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.068+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb5c04ee70 con 0x7feb5c0aae50 2023-08-27T11:24:31.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.263+0000 7feb52ffd700 1 -- 172.21.15.43:0/848689372 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7feb4c085e60 con 0x7feb5c0aae50 2023-08-27T11:24:31.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.266+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 msgr2=0x7feb4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.266+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 0x7feb4006c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb580090b0 tx=0x7feb58008030 comp rx=0 tx=0).stop 2023-08-27T11:24:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.266+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 msgr2=0x7feb5c0bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.266+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c750 tx=0x7feb4c00cb10 comp rx=0 tx=0).stop 2023-08-27T11:24:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 shutdown_connections 2023-08-27T11:24:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb5c152380 0x7feb5c1e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb5c06d360 0x7feb5c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 --2- 172.21.15.43:0/848689372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb5c0aae50 0x7feb5c0bbfd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 >> 172.21.15.43:0/848689372 conn(0x7feb5c0c2400 msgr2=0x7feb5c0c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 shutdown_connections 2023-08-27T11:24:31.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.267+0000 7feb643ff700 1 -- 172.21.15.43:0/848689372 wait complete. 2023-08-27T11:24:31.271 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:24:31.289 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:24:31.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.497+0000 7fb2e07ff700 1 Processor -- start 2023-08-27T11:24:31.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.497+0000 7fb2e07ff700 1 -- start start 2023-08-27T11:24:31.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2e07ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2d81552a0 0x7fb2d815ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:31.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2e07ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c2670 con 0x7fb2d806e570 2023-08-27T11:24:31.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2e07ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c2950 con 0x7fb2d8158890 2023-08-27T11:24:31.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2e07ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d80c2c30 con 0x7fb2d81552a0 2023-08-27T11:24:31.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2ddd9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb2d806e570 0x7fb2d8154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55212/0 (socket says 172.21.15.43:55212) 2023-08-27T11:24:31.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2ddd9a700 1 -- 172.21.15.43:0/4163681118 learned_addr learned my addr 172.21.15.43:0/4163681118 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:31.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.499+0000 7fb2ded9c700 1 --2- 172.21.15.43:0/4163681118 >> v2:172.21.15.43:3300/0 conn(0x7fb2d81552a0 0x7fb2d815ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2dd599700 1 -- 172.21.15.43:0/4163681118 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657207262 0 0) 0x7fb2d80c2670 con 0x7fb2d806e570 2023-08-27T11:24:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2dd599700 1 -- 172.21.15.43:0/4163681118 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c40035b0 con 0x7fb2d806e570 2023-08-27T11:24:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2ded9c700 1 -- 172.21.15.43:0/4163681118 >> v1:172.21.15.57:6789/0 conn(0x7fb2d8158890 legacy=0x7fb2d806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2ded9c700 1 -- 172.21.15.43:0/4163681118 >> v1:172.21.15.43:6789/0 conn(0x7fb2d806e570 legacy=0x7fb2d8154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2ded9c700 1 -- 172.21.15.43:0/4163681118 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c2f10 con 0x7fb2d81552a0 2023-08-27T11:24:31.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2ded9c700 1 --2- 172.21.15.43:0/4163681118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d815ff10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0f315e00a82327 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:31.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2dd599700 1 -- 172.21.15.43:0/4163681118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000e070 con 0x7fb2d81552a0 2023-08-27T11:24:31.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2dd599700 1 -- 172.21.15.43:0/4163681118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000bb20 con 0x7fb2d81552a0 2023-08-27T11:24:31.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.500+0000 7fb2dd599700 1 -- 172.21.15.43:0/4163681118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0012430 con 0x7fb2d81552a0 2023-08-27T11:24:31.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 -- 172.21.15.43:0/4163681118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 msgr2=0x7fb2d815ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/4163681118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d815ff10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:31.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 -- 172.21.15.43:0/4163681118 shutdown_connections 2023-08-27T11:24:31.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/4163681118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d815ff10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 -- 172.21.15.43:0/4163681118 >> 172.21.15.43:0/4163681118 conn(0x7fb2d806b420 msgr2=0x7fb2d806b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:31.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 -- 172.21.15.43:0/4163681118 shutdown_connections 2023-08-27T11:24:31.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.501+0000 7fb2e07ff700 1 -- 172.21.15.43:0/4163681118 wait complete. 2023-08-27T11:24:31.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.503+0000 7fb2e07ff700 1 Processor -- start 2023-08-27T11:24:31.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.504+0000 7fb2e07ff700 1 -- start start 2023-08-27T11:24:31.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 0x7fb2d814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:31.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:31.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 0x7fb2d8152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:31.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8155ff0 con 0x7fb2d81552a0 2023-08-27T11:24:31.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8152500 con 0x7fb2d8158890 2023-08-27T11:24:31.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2e07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80a7710 con 0x7fb2d806e570 2023-08-27T11:24:31.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2ddd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:31.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2ddd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57180/0 (socket says 172.21.15.43:57180) 2023-08-27T11:24:31.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2ddd9a700 1 -- 172.21.15.43:0/750945685 learned_addr learned my addr 172.21.15.43:0/750945685 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:31.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.505+0000 7fb2ded9c700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 0x7fb2d8152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:31.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2de59b700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 0x7fb2d814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:31.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 -- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 msgr2=0x7fb2d814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 0x7fb2d814ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 -- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 msgr2=0x7fb2d8152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 0x7fb2d8152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 -- 172.21.15.43:0/750945685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009a70 con 0x7fb2d81552a0 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ded9c700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 0x7fb2d8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2de59b700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 0x7fb2d814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ddd9a700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c700 tx=0x7fb2c800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:31.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8005d70 con 0x7fb2d81552a0 2023-08-27T11:24:31.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c80070d0 con 0x7fb2d81552a0 2023-08-27T11:24:31.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8007460 con 0x7fb2d81552a0 2023-08-27T11:24:31.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d80a79f0 con 0x7fb2d81552a0 2023-08-27T11:24:31.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.506+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d80a7fb0 con 0x7fb2d81552a0 2023-08-27T11:24:31.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.507+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8074680 con 0x7fb2d81552a0 2023-08-27T11:24:31.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.509+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2c80075c0 con 0x7fb2d81552a0 2023-08-27T11:24:31.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.510+0000 7fb2ceffd700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 0x7fb2bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:31.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.510+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb2c8087e80 con 0x7fb2d81552a0 2023-08-27T11:24:31.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.510+0000 7fb2de59b700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 0x7fb2bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:31.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.511+0000 7fb2de59b700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 0x7fb2bc06c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000f60 tx=0x7fb2d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:31.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.514+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2c8053740 con 0x7fb2d81552a0 2023-08-27T11:24:31.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:31.723+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb2d806d890 con 0x7fb2d81552a0 2023-08-27T11:24:32.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.268+0000 7fb2ceffd700 1 -- 172.21.15.43:0/750945685 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb2c8056d60 con 0x7fb2d81552a0 2023-08-27T11:24:32.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.273+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 msgr2=0x7fb2bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:32.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.273+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 0x7fb2bc06c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000f60 tx=0x7fb2d4009040 comp rx=0 tx=0).stop 2023-08-27T11:24:32.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.273+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 msgr2=0x7fb2d8152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:32.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.273+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2c800c700 tx=0x7fb2c800cac0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 shutdown_connections 2023-08-27T11:24:32.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2bc06a0e0 0x7fb2bc06c5a0 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4000f60 tx=0x7fb2d4009040 comp rx=0 tx=0).stop 2023-08-27T11:24:32.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2d8158890 0x7fb2d8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2d806e570 0x7fb2d814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 --2- 172.21.15.43:0/750945685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2d81552a0 0x7fb2d8152990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 >> 172.21.15.43:0/750945685 conn(0x7fb2d806b420 msgr2=0x7fb2d8154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:32.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 shutdown_connections 2023-08-27T11:24:32.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.274+0000 7fb2e07ff700 1 -- 172.21.15.43:0/750945685 wait complete. 2023-08-27T11:24:32.289 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:24:32.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:24:32.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.516+0000 7fc6bd5ff700 1 Processor -- start 2023-08-27T11:24:32.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.516+0000 7fc6bd5ff700 1 -- start start 2023-08-27T11:24:32.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b80c49f0 0x7fc6b8151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6b8151cd0 0x7fc6b80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b81555a0 con 0x7fc6b80c49f0 2023-08-27T11:24:32.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b80c80c0 con 0x7fc6b8151cd0 2023-08-27T11:24:32.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6bd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b81552c0 con 0x7fc6b80ac410 2023-08-27T11:24:32.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6b6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b80c49f0 0x7fc6b8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6b6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b80c49f0 0x7fc6b8151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57186/0 (socket says 172.21.15.43:57186) 2023-08-27T11:24:32.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.517+0000 7fc6b6ffd700 1 -- 172.21.15.43:0/1463039935 learned_addr learned my addr 172.21.15.43:0/1463039935 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:32.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b67fc700 1 --2- 172.21.15.43:0/1463039935 >> v2:172.21.15.57:3300/0 conn(0x7fc6b8151cd0 0x7fc6b80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b77fe700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 -- 172.21.15.43:0/1463039935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 msgr2=0x7fc6b80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:32.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 -- 172.21.15.43:0/1463039935 >> v2:172.21.15.57:3300/0 conn(0x7fc6b8151cd0 msgr2=0x7fc6b80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:32.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/1463039935 >> v2:172.21.15.57:3300/0 conn(0x7fc6b8151cd0 0x7fc6b80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 -- 172.21.15.43:0/1463039935 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80c8360 con 0x7fc6b80c49f0 2023-08-27T11:24:32.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8151790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8072830 tx=0x7fc6a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fed033ca32b9972 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:32.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b5ffb700 1 -- 172.21.15.43:0/1463039935 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800b870 con 0x7fc6b80c49f0 2023-08-27T11:24:32.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b5ffb700 1 -- 172.21.15.43:0/1463039935 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800b9d0 con 0x7fc6b80c49f0 2023-08-27T11:24:32.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.518+0000 7fc6b5ffb700 1 -- 172.21.15.43:0/1463039935 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800bd60 con 0x7fc6b80c49f0 2023-08-27T11:24:32.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/1463039935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b80c49f0 msgr2=0x7fc6b8151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:32.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8151790 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8072830 tx=0x7fc6a8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/1463039935 shutdown_connections 2023-08-27T11:24:32.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/1463039935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8151790 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/1463039935 >> v2:172.21.15.57:3300/0 conn(0x7fc6b8151cd0 0x7fc6b80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/1463039935 >> 172.21.15.43:0/1463039935 conn(0x7fc6b80ab8f0 msgr2=0x7fc6b80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:32.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/1463039935 shutdown_connections 2023-08-27T11:24:32.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.519+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/1463039935 wait complete. 2023-08-27T11:24:32.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.521+0000 7fc6bd5ff700 1 Processor -- start 2023-08-27T11:24:32.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.521+0000 7fc6bd5ff700 1 -- start start 2023-08-27T11:24:32.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8158b40 con 0x7fc6b8151cd0 2023-08-27T11:24:32.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8158580 con 0x7fc6b80c49f0 2023-08-27T11:24:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6bd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8158860 con 0x7fc6b80ac410 2023-08-27T11:24:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57196/0 (socket says 172.21.15.43:57196) 2023-08-27T11:24:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 -- 172.21.15.43:0/2439102568 learned_addr learned my addr 172.21.15.43:0/2439102568 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:32.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b67fc700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 -- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 msgr2=0x7fc6b8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:32.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 -- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6b80c49f0 msgr2=0x7fc6b8157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:32.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:32.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.522+0000 7fc6b77fe700 1 -- 172.21.15.43:0/2439102568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009550 con 0x7fc6b8151cd0 2023-08-27T11:24:32.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc6b77fe700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0007d20 tx=0x7fc6b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:32.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000ed30 con 0x7fc6b8151cd0 2023-08-27T11:24:32.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0007e70 con 0x7fc6b8151cd0 2023-08-27T11:24:32.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0014640 con 0x7fc6b8151cd0 2023-08-27T11:24:32.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b8156850 con 0x7fc6b8151cd0 2023-08-27T11:24:32.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.523+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b80c9630 con 0x7fc6b8151cd0 2023-08-27T11:24:32.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.524+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b8156d70 con 0x7fc6b8151cd0 2023-08-27T11:24:32.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.525+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6b00147a0 con 0x7fc6b8151cd0 2023-08-27T11:24:32.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.526+0000 7fc69f7fe700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 0x7fc6a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:32.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.526+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc6b0088ad0 con 0x7fc6b8151cd0 2023-08-27T11:24:32.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.526+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 0x7fc6a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:32.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.527+0000 7fc6b6ffd700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 0x7fc6a406c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8000c00 tx=0x7fc6a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:32.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.531+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc6b8156d70 con 0x7fc6b8151cd0 2023-08-27T11:24:32.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:32.789+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc6b8156d70 con 0x7fc6b8151cd0 2023-08-27T11:24:33.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.281+0000 7fc69f7fe700 1 -- 172.21.15.43:0/2439102568 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc6b8156d70 con 0x7fc6b8151cd0 2023-08-27T11:24:33.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 msgr2=0x7fc6a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 0x7fc6a406c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8000c00 tx=0x7fc6a8008030 comp rx=0 tx=0).stop 2023-08-27T11:24:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 msgr2=0x7fc6b80c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0007d20 tx=0x7fc6b000e3c0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 shutdown_connections 2023-08-27T11:24:33.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc6a406a0e0 0x7fc6a406c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b8151cd0 0x7fc6b80c90f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6b80ac410 0x7fc6b8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 --2- 172.21.15.43:0/2439102568 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6b80c49f0 0x7fc6b8157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 >> 172.21.15.43:0/2439102568 conn(0x7fc6b80ab8f0 msgr2=0x7fc6b806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:33.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 shutdown_connections 2023-08-27T11:24:33.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.285+0000 7fc6bd5ff700 1 -- 172.21.15.43:0/2439102568 wait complete. 2023-08-27T11:24:33.291 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 7 and data pool 8 2023-08-27T11:24:33.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:33.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.515+0000 7ff8045ff700 1 Processor -- start 2023-08-27T11:24:33.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.515+0000 7ff8045ff700 1 -- start start 2023-08-27T11:24:33.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.516+0000 7ff8045ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff7fc0c4630 0x7ff7fc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.516+0000 7ff8045ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7fc06ad70 0x7ff7fc06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.516+0000 7ff8045ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc06c4e0 con 0x7ff7fc151a90 2023-08-27T11:24:33.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.516+0000 7ff8045ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc155370 con 0x7ff7fc06ad70 2023-08-27T11:24:33.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.516+0000 7ff8045ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0c82c0 con 0x7ff7fc0c4630 2023-08-27T11:24:33.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7fc06ad70 0x7ff7fc06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff7fc06ad70 0x7ff7fc06b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57200/0 (socket says 172.21.15.43:57200) 2023-08-27T11:24:33.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 -- 172.21.15.43:0/3556108346 learned_addr learned my addr 172.21.15.43:0/3556108346 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:33.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff801b9a700 1 --2- 172.21.15.43:0/3556108346 >> v2:172.21.15.57:3300/0 conn(0x7ff7fc0c4630 0x7ff7fc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 -- 172.21.15.43:0/3556108346 >> v2:172.21.15.57:3300/0 conn(0x7ff7fc0c4630 msgr2=0x7ff7fc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:33.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 --2- 172.21.15.43:0/3556108346 >> v2:172.21.15.57:3300/0 conn(0x7ff7fc0c4630 0x7ff7fc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 -- 172.21.15.43:0/3556108346 >> v1:172.21.15.57:6789/0 conn(0x7ff7fc151a90 legacy=0x7ff7fc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 -- 172.21.15.43:0/3556108346 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc151e70 con 0x7ff7fc06ad70 2023-08-27T11:24:33.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff802b9c700 1 --2- 172.21.15.43:0/3556108346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc06b200 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0c7740 tx=0x7ff7f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db01a043a37e90cb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.517+0000 7ff801399700 1 -- 172.21.15.43:0/3556108346 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400e070 con 0x7ff7fc06ad70 2023-08-27T11:24:33.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff801399700 1 -- 172.21.15.43:0/3556108346 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400b910 con 0x7ff7fc06ad70 2023-08-27T11:24:33.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff801399700 1 -- 172.21.15.43:0/3556108346 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400bcc0 con 0x7ff7fc06ad70 2023-08-27T11:24:33.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 -- 172.21.15.43:0/3556108346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 msgr2=0x7ff7fc06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 --2- 172.21.15.43:0/3556108346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc06b200 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0c7740 tx=0x7ff7f400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:33.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 -- 172.21.15.43:0/3556108346 shutdown_connections 2023-08-27T11:24:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 --2- 172.21.15.43:0/3556108346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc06b200 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 --2- 172.21.15.43:0/3556108346 >> v2:172.21.15.57:3300/0 conn(0x7ff7fc0c4630 0x7ff7fc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 -- 172.21.15.43:0/3556108346 >> 172.21.15.43:0/3556108346 conn(0x7ff7fc0ab820 msgr2=0x7ff7fc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 -- 172.21.15.43:0/3556108346 shutdown_connections 2023-08-27T11:24:33.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.518+0000 7ff8045ff700 1 -- 172.21.15.43:0/3556108346 wait complete. 2023-08-27T11:24:33.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.520+0000 7ff8045ff700 1 Processor -- start 2023-08-27T11:24:33.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.520+0000 7ff8045ff700 1 -- start start 2023-08-27T11:24:33.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 0x7ff7fc0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 0x7ff7fc0c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1edb40 con 0x7ff7fc06ad70 2023-08-27T11:24:33.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0c1300 con 0x7ff7fc151a90 2023-08-27T11:24:33.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff8045ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0c3d10 con 0x7ff7fc0c4630 2023-08-27T11:24:33.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff80239b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff80239b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57216/0 (socket says 172.21.15.43:57216) 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff80239b700 1 -- 172.21.15.43:0/956209723 learned_addr learned my addr 172.21.15.43:0/956209723 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff802b9c700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 0x7ff7fc0c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.521+0000 7ff801b9a700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 0x7ff7fc0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 -- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 msgr2=0x7ff7fc0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 0x7ff7fc0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 -- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 msgr2=0x7ff7fc0c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 0x7ff7fc0c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 -- 172.21.15.43:0/956209723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4009b30 con 0x7ff7fc06ad70 2023-08-27T11:24:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff802b9c700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 0x7ff7fc0c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:33.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff801b9a700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 0x7ff7fc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:33.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff80239b700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c4b0 tx=0x7ff7f800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80052d0 con 0x7ff7fc06ad70 2023-08-27T11:24:33.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8005430 con 0x7ff7fc06ad70 2023-08-27T11:24:33.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc1ecf00 con 0x7ff7fc06ad70 2023-08-27T11:24:33.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80038c0 con 0x7ff7fc06ad70 2023-08-27T11:24:33.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.522+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1ed480 con 0x7ff7fc06ad70 2023-08-27T11:24:33.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.523+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc04ee70 con 0x7ff7fc06ad70 2023-08-27T11:24:33.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.524+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff7f8003a20 con 0x7ff7fc06ad70 2023-08-27T11:24:33.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.526+0000 7ff7f2ffd700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 0x7ff7e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.526+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7f8087950 con 0x7ff7fc06ad70 2023-08-27T11:24:33.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.526+0000 7ff801b9a700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 0x7ff7e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.526+0000 7ff801b9a700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 0x7ff7e006c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc1e7610 tx=0x7ff7ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.530+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff7f80530d0 con 0x7ff7fc06ad70 2023-08-27T11:24:33.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.739+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7fc06c130 con 0x7ff7fc06ad70 2023-08-27T11:24:33.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.740+0000 7ff7f2ffd700 1 -- 172.21.15.43:0/956209723 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18246 (secure 0 0 0) 0x7ff7f80566f0 con 0x7ff7fc06ad70 2023-08-27T11:24:33.742 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:33.742 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":46,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:32.790577+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:33.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.742+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 msgr2=0x7ff7e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 0x7ff7e006c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc1e7610 tx=0x7ff7ec008040 comp rx=0 tx=0).stop 2023-08-27T11:24:33.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 msgr2=0x7ff7fc0c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800c4b0 tx=0x7ff7f800c870 comp rx=0 tx=0).stop 2023-08-27T11:24:33.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 shutdown_connections 2023-08-27T11:24:33.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff7e006a0e0 0x7ff7e006c5a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff7fc151a90 0x7ff7fc0c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff7fc06ad70 0x7ff7fc0c9e70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 --2- 172.21.15.43:0/956209723 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff7fc0c4630 0x7ff7fc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 >> 172.21.15.43:0/956209723 conn(0x7ff7fc0ab820 msgr2=0x7ff7fc14f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 shutdown_connections 2023-08-27T11:24:33.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.743+0000 7ff8045ff700 1 -- 172.21.15.43:0/956209723 wait complete. 2023-08-27T11:24:33.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:33.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.963+0000 7ff00dfff700 1 Processor -- start 2023-08-27T11:24:33.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.963+0000 7ff00dfff700 1 -- start start 2023-08-27T11:24:33.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff00dfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 0x7ff0080c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff00dfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0080c4630 0x7ff0080c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff00dfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00806c4e0 con 0x7ff00806ad70 2023-08-27T11:24:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff00dfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff008155370 con 0x7ff0080c4630 2023-08-27T11:24:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff00dfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff008151e70 con 0x7ff008151a90 2023-08-27T11:24:33.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0080c4630 0x7ff0080c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0080c4630 0x7ff0080c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57222/0 (socket says 172.21.15.43:57222) 2023-08-27T11:24:33.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 -- 172.21.15.43:0/3056322558 learned_addr learned my addr 172.21.15.43:0/3056322558 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff0077fe700 1 --2- 172.21.15.43:0/3056322558 >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 0x7ff0080c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 -- 172.21.15.43:0/3056322558 >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 msgr2=0x7ff0080c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3056322558 >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 0x7ff0080c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.965+0000 7ff006ffd700 1 -- 172.21.15.43:0/3056322558 >> v1:172.21.15.57:6789/0 conn(0x7ff00806ad70 legacy=0x7ff00806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:33.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff006ffd700 1 -- 172.21.15.43:0/3056322558 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008154480 con 0x7ff0080c4630 2023-08-27T11:24:33.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff0077fe700 1 --2- 172.21.15.43:0/3056322558 >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 0x7ff0080c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:33.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3056322558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0080c4630 0x7ff0080c4a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff008067710 tx=0x7feffc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cac2d8b6515f913 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff0067fc700 1 -- 172.21.15.43:0/3056322558 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc004230 con 0x7ff0080c4630 2023-08-27T11:24:33.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff0067fc700 1 -- 172.21.15.43:0/3056322558 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc004390 con 0x7ff0080c4630 2023-08-27T11:24:33.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.966+0000 7ff0067fc700 1 -- 172.21.15.43:0/3056322558 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0036a0 con 0x7ff0080c4630 2023-08-27T11:24:33.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 -- 172.21.15.43:0/3056322558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0080c4630 msgr2=0x7ff0080c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3056322558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0080c4630 0x7ff0080c4a90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff008067710 tx=0x7feffc009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 -- 172.21.15.43:0/3056322558 shutdown_connections 2023-08-27T11:24:33.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3056322558 >> v2:172.21.15.57:3300/0 conn(0x7ff008151a90 0x7ff0080c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3056322558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0080c4630 0x7ff0080c4a90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 -- 172.21.15.43:0/3056322558 >> 172.21.15.43:0/3056322558 conn(0x7ff0080ab820 msgr2=0x7ff0080abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 -- 172.21.15.43:0/3056322558 shutdown_connections 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.967+0000 7ff00dfff700 1 -- 172.21.15.43:0/3056322558 wait complete. 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.968+0000 7ff00dfff700 1 Processor -- start 2023-08-27T11:24:33.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.969+0000 7ff00dfff700 1 -- start start 2023-08-27T11:24:33.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.969+0000 7ff00dfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.969+0000 7ff00dfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 0x7ff00814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff00dfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff008151a90 0x7ff0080c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff00dfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081ed7d0 con 0x7ff00806ad70 2023-08-27T11:24:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff00dfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c93f0 con 0x7ff0080c4630 2023-08-27T11:24:33.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff00dfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0081ed180 con 0x7ff008151a90 2023-08-27T11:24:33.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57232/0 (socket says 172.21.15.43:57232) 2023-08-27T11:24:33.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 -- 172.21.15.43:0/3989766031 learned_addr learned my addr 172.21.15.43:0/3989766031 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:33.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff007fff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff008151a90 0x7ff0080c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 0x7ff00814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 -- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff008151a90 msgr2=0x7ff0080c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff008151a90 0x7ff0080c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 -- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 msgr2=0x7ff00814fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:33.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 0x7ff00814fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:33.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 -- 172.21.15.43:0/3989766031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009550 con 0x7ff00806ad70 2023-08-27T11:24:33.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 0x7ff00814fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:33.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.970+0000 7ff0077fe700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feff800c7f0 tx=0x7feff800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.971+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8011800 con 0x7ff00806ad70 2023-08-27T11:24:33.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.971+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff8011960 con 0x7ff00806ad70 2023-08-27T11:24:33.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.971+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0081ed460 con 0x7ff00806ad70 2023-08-27T11:24:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.971+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8011d10 con 0x7ff00806ad70 2023-08-27T11:24:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.971+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff008153d30 con 0x7ff00806ad70 2023-08-27T11:24:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.972+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00804ee70 con 0x7ff00806ad70 2023-08-27T11:24:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.973+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feff8018360 con 0x7ff00806ad70 2023-08-27T11:24:33.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.974+0000 7fefeffff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 0x7feff406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.974+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feff80885c0 con 0x7ff00806ad70 2023-08-27T11:24:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.974+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 0x7feff406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.975+0000 7ff006ffd700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 0x7feff406c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feffc009130 tx=0x7feffc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:33.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:33.978+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feff8057730 con 0x7ff00806ad70 2023-08-27T11:24:34.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.191+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0081ed5f0 con 0x7ff00806ad70 2023-08-27T11:24:34.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.193+0000 7fefeffff700 1 -- 172.21.15.43:0/3989766031 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18233 (secure 0 0 0) 0x7feff80572c0 con 0x7ff00806ad70 2023-08-27T11:24:34.194 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:34.195 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":47,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:33.876379+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:34.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 msgr2=0x7feff406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:34.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 0x7feff406c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feffc009130 tx=0x7feffc008030 comp rx=0 tx=0).stop 2023-08-27T11:24:34.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 msgr2=0x7ff0080c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:34.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7feff800c7f0 tx=0x7feff800cbb0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 shutdown_connections 2023-08-27T11:24:34.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feff406a0e0 0x7feff406c5a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff008151a90 0x7ff0080c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff00806ad70 0x7ff0080c8e10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 --2- 172.21.15.43:0/3989766031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0080c4630 0x7ff00814fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 >> 172.21.15.43:0/3989766031 conn(0x7ff0080ab820 msgr2=0x7ff00814a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:34.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 shutdown_connections 2023-08-27T11:24:34.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.195+0000 7ff00dfff700 1 -- 172.21.15.43:0/3989766031 wait complete. 2023-08-27T11:24:34.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:24:34.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.419+0000 7f95775ff700 1 Processor -- start 2023-08-27T11:24:34.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.419+0000 7f95775ff700 1 -- start start 2023-08-27T11:24:34.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f95775ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f95700ac410 0x7f95700c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f95775ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f957015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f95775ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95700c80c0 con 0x7f95700c49f0 2023-08-27T11:24:34.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f95775ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95701555a0 con 0x7f95700ac410 2023-08-27T11:24:34.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f95775ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95701552c0 con 0x7f95700c94c0 2023-08-27T11:24:34.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f9574b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f95700ac410 0x7f95700c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f9574b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f95700ac410 0x7f95700c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57236/0 (socket says 172.21.15.43:57236) 2023-08-27T11:24:34.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.420+0000 7f9574b9a700 1 -- 172.21.15.43:0/3890042288 learned_addr learned my addr 172.21.15.43:0/3890042288 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:34.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9575b9c700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f957015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9574b9a700 1 -- 172.21.15.43:0/3890042288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 msgr2=0x7f957015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:34.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9574b9a700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f957015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9574b9a700 1 -- 172.21.15.43:0/3890042288 >> v1:172.21.15.57:6789/0 conn(0x7f95700c49f0 legacy=0x7f9570151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9574b9a700 1 -- 172.21.15.43:0/3890042288 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700c8360 con 0x7f95700ac410 2023-08-27T11:24:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9575b9c700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f957015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9574b9a700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f95700c8f80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95600098f0 tx=0x7f9560009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4455028240dc8c44 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:34.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9567fff700 1 -- 172.21.15.43:0/3890042288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560004230 con 0x7f95700ac410 2023-08-27T11:24:34.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9567fff700 1 -- 172.21.15.43:0/3890042288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560004390 con 0x7f95700ac410 2023-08-27T11:24:34.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.421+0000 7f9567fff700 1 -- 172.21.15.43:0/3890042288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600036a0 con 0x7f95700ac410 2023-08-27T11:24:34.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 -- 172.21.15.43:0/3890042288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 msgr2=0x7f95700c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:34.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f95700c8f80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f95600098f0 tx=0x7f9560009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:34.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 -- 172.21.15.43:0/3890042288 shutdown_connections 2023-08-27T11:24:34.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f957015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 --2- 172.21.15.43:0/3890042288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f95700c8f80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 -- 172.21.15.43:0/3890042288 >> 172.21.15.43:0/3890042288 conn(0x7f95700ab8f0 msgr2=0x7f95700abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:34.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 -- 172.21.15.43:0/3890042288 shutdown_connections 2023-08-27T11:24:34.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.422+0000 7f95775ff700 1 -- 172.21.15.43:0/3890042288 wait complete. 2023-08-27T11:24:34.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.424+0000 7f95775ff700 1 Processor -- start 2023-08-27T11:24:34.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.424+0000 7f95775ff700 1 -- start start 2023-08-27T11:24:34.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95700c49f0 0x7f95701576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f9570157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701561b0 con 0x7f95700ac410 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95700accb0 con 0x7f95700c49f0 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f95775ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95701ed8e0 con 0x7f95700c94c0 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57244/0 (socket says 172.21.15.43:57244) 2023-08-27T11:24:34.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 -- 172.21.15.43:0/1810140402 learned_addr learned my addr 172.21.15.43:0/1810140402 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:34.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f9574b9a700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95700c49f0 0x7f95701576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f9575b9c700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f9570157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 -- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 msgr2=0x7f9570157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:34.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f9570157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 -- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95700c49f0 msgr2=0x7f95701576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95700c49f0 0x7f95701576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f957539b700 1 -- 172.21.15.43:0/1810140402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009550 con 0x7f95700ac410 2023-08-27T11:24:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.425+0000 7f9575b9c700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f9570157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:34.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f957539b700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c4d0 tx=0x7f956c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c011790 con 0x7f95700ac410 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c0118f0 con 0x7f95700ac410 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9570155ed0 con 0x7f95700ac410 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c011ca0 con 0x7f95700ac410 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.426+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95701ed570 con 0x7f95700ac410 2023-08-27T11:24:34.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.427+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95701ed0f0 con 0x7f95700ac410 2023-08-27T11:24:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.428+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f956c01c460 con 0x7f95700ac410 2023-08-27T11:24:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.429+0000 7f9565ffb700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 0x7f955406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.429+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f956c088340 con 0x7f95700ac410 2023-08-27T11:24:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.429+0000 7f9574b9a700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 0x7f955406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:34.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.430+0000 7f9574b9a700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 0x7f955406c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95600098f0 tx=0x7f9560008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:34.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.433+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f95701ed0f0 con 0x7f95700ac410 2023-08-27T11:24:34.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:34.690+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f95701ed0f0 con 0x7f95700ac410 2023-08-27T11:24:35.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.321+0000 7f9565ffb700 1 -- 172.21.15.43:0/1810140402 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f95701ed0f0 con 0x7f95700ac410 2023-08-27T11:24:35.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 msgr2=0x7f955406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:35.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 0x7f955406c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95600098f0 tx=0x7f9560008030 comp rx=0 tx=0).stop 2023-08-27T11:24:35.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 msgr2=0x7f9570153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:35.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c4d0 tx=0x7f956c00c7e0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 shutdown_connections 2023-08-27T11:24:35.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f955406a0e0 0x7f955406c5a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95700c94c0 0x7f9570157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f95700ac410 0x7f9570153550 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 --2- 172.21.15.43:0/1810140402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95700c49f0 0x7f95701576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 >> 172.21.15.43:0/1810140402 conn(0x7f95700ab8f0 msgr2=0x7f9570151560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:35.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 shutdown_connections 2023-08-27T11:24:35.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.324+0000 7f95775ff700 1 -- 172.21.15.43:0/1810140402 wait complete. 2023-08-27T11:24:35.347 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:24:35.348 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:24:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.556+0000 7fcbbc5ff700 1 Processor -- start 2023-08-27T11:24:35.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.557+0000 7fcbbc5ff700 1 -- start start 2023-08-27T11:24:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbb4151d20 0x7fcbb40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb40c7c00 0x7fcbb40ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbb40abcc0 0x7fcbb406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40c5750 con 0x7fcbb4151d20 2023-08-27T11:24:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb4154660 con 0x7fcbb40abcc0 2023-08-27T11:24:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4154940 con 0x7fcbb40c7c00 2023-08-27T11:24:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbb4151d20 0x7fcbb40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcbb4151d20 0x7fcbb40c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57252/0 (socket says 172.21.15.43:57252) 2023-08-27T11:24:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 -- 172.21.15.43:0/484045762 learned_addr learned my addr 172.21.15.43:0/484045762 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbbab9c700 1 --2- 172.21.15.43:0/484045762 >> v2:172.21.15.57:3300/0 conn(0x7fcbb40abcc0 0x7fcbb406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbb9b9a700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb40c7c00 0x7fcbb40ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 -- 172.21.15.43:0/484045762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb40c7c00 msgr2=0x7fcbb40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:35.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb40c7c00 0x7fcbb40ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 -- 172.21.15.43:0/484045762 >> v2:172.21.15.57:3300/0 conn(0x7fcbb40abcc0 msgr2=0x7fcbb406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 --2- 172.21.15.43:0/484045762 >> v2:172.21.15.57:3300/0 conn(0x7fcbb40abcc0 0x7fcbb406a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.558+0000 7fcbba39b700 1 -- 172.21.15.43:0/484045762 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4154c20 con 0x7fcbb4151d20 2023-08-27T11:24:35.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.559+0000 7fcbba39b700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4151d20 0x7fcbb40c8110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4158be0 tx=0x7fcbb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c76177f082a1cbd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:35.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.559+0000 7fcbb9399700 1 -- 172.21.15.43:0/484045762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000b870 con 0x7fcbb4151d20 2023-08-27T11:24:35.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.559+0000 7fcbb9399700 1 -- 172.21.15.43:0/484045762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb000b9d0 con 0x7fcbb4151d20 2023-08-27T11:24:35.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.559+0000 7fcbb9399700 1 -- 172.21.15.43:0/484045762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000bd60 con 0x7fcbb4151d20 2023-08-27T11:24:35.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/484045762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4151d20 msgr2=0x7fcbb40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:35.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4151d20 0x7fcbb40c8110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4158be0 tx=0x7fcbb0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/484045762 shutdown_connections 2023-08-27T11:24:35.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/484045762 >> v2:172.21.15.57:3300/0 conn(0x7fcbb40abcc0 0x7fcbb406a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb4151d20 0x7fcbb40c8110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/484045762 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb40c7c00 0x7fcbb40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/484045762 >> 172.21.15.43:0/484045762 conn(0x7fcbb40c9d00 msgr2=0x7fcbb40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:35.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/484045762 shutdown_connections 2023-08-27T11:24:35.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.560+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/484045762 wait complete. 2023-08-27T11:24:35.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.561+0000 7fcbbc5ff700 1 Processor -- start 2023-08-27T11:24:35.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.562+0000 7fcbbc5ff700 1 -- start start 2023-08-27T11:24:35.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.562+0000 7fcbbc5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb40abcc0 0x7fcbb41edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.562+0000 7fcbbc5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbbc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb4151d20 0x7fcbb40c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbbc5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb41e9b90 con 0x7fcbb40c7c00 2023-08-27T11:24:35.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbbc5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c82f0 con 0x7fcbb40abcc0 2023-08-27T11:24:35.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbbc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4153cd0 con 0x7fcbb4151d20 2023-08-27T11:24:35.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57254/0 (socket says 172.21.15.43:57254) 2023-08-27T11:24:35.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 -- 172.21.15.43:0/327926075 learned_addr learned my addr 172.21.15.43:0/327926075 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:35.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbba39b700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb40abcc0 0x7fcbb41edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbbab9c700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb4151d20 0x7fcbb40c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 -- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb4151d20 msgr2=0x7fcbb40c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:35.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb4151d20 0x7fcbb40c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 -- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb40abcc0 msgr2=0x7fcbb41edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:35.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb40abcc0 0x7fcbb41edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:35.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.563+0000 7fcbb9b9a700 1 -- 172.21.15.43:0/327926075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009550 con 0x7fcbb40c7c00 2023-08-27T11:24:35.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbb9b9a700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcba400e810 tx=0x7fcba400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:35.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4013610 con 0x7fcbb40c7c00 2023-08-27T11:24:35.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba4013770 con 0x7fcbb40c7c00 2023-08-27T11:24:35.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41ee050 con 0x7fcbb40c7c00 2023-08-27T11:24:35.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4013b20 con 0x7fcbb40c7c00 2023-08-27T11:24:35.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.564+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41e9da0 con 0x7fcbb40c7c00 2023-08-27T11:24:35.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.565+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40c78d0 con 0x7fcbb40c7c00 2023-08-27T11:24:35.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.566+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcba4013c80 con 0x7fcbb40c7c00 2023-08-27T11:24:35.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.567+0000 7fcbaaffd700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:35.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.567+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcba4087f70 con 0x7fcbb40c7c00 2023-08-27T11:24:35.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.567+0000 7fcbba39b700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:35.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.568+0000 7fcbba39b700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0014040 tx=0x7fcbb0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:35.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.571+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcba4057100 con 0x7fcbb40c7c00 2023-08-27T11:24:35.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:35.832+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcbb41ee050 con 0x7fcbb40c7c00 2023-08-27T11:24:36.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.323+0000 7fcbaaffd700 1 -- 172.21.15.43:0/327926075 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcbb41ee050 con 0x7fcbb40c7c00 2023-08-27T11:24:36.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 msgr2=0x7fcb9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0014040 tx=0x7fcbb0008030 comp rx=0 tx=0).stop 2023-08-27T11:24:36.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 msgr2=0x7fcbb40aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcba400e810 tx=0x7fcba400eb20 comp rx=0 tx=0).stop 2023-08-27T11:24:36.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 shutdown_connections 2023-08-27T11:24:36.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcb9806a0e0 0x7fcb9806c5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb4151d20 0x7fcbb40c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb40abcc0 0x7fcbb41edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 --2- 172.21.15.43:0/327926075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcbb40c7c00 0x7fcbb40aa920 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.326+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 >> 172.21.15.43:0/327926075 conn(0x7fcbb40c9d00 msgr2=0x7fcbb40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.327+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 shutdown_connections 2023-08-27T11:24:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.327+0000 7fcbbc5ff700 1 -- 172.21.15.43:0/327926075 wait complete. 2023-08-27T11:24:36.350 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:24:36.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.554+0000 7f80511ff700 1 Processor -- start 2023-08-27T11:24:36.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.555+0000 7f80511ff700 1 -- start start 2023-08-27T11:24:36.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f80511ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f804c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f80511ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f804c0c4630 0x7f804c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f80511ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c06c4e0 con 0x7f804c06ad70 2023-08-27T11:24:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f80511ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c155370 con 0x7f804c0c4630 2023-08-27T11:24:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f80511ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c151e70 con 0x7f804c151a90 2023-08-27T11:24:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f804b59e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f804c06ad70 0x7f804c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55224/0 (socket says 172.21.15.43:55224) 2023-08-27T11:24:36.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f804b59e700 1 -- 172.21.15.43:0/2563602403 learned_addr learned my addr 172.21.15.43:0/2563602403 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:36.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f804ad9d700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f804c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f804a59c700 1 --2- 172.21.15.43:0/2563602403 >> v2:172.21.15.57:3300/0 conn(0x7f804c0c4630 0x7f804c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.556+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368026843 0 0) 0x7f804c06c4e0 con 0x7f804c06ad70 2023-08-27T11:24:36.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80340035b0 con 0x7f804c06ad70 2023-08-27T11:24:36.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2067006655 0 0) 0x7f80340035b0 con 0x7f804c06ad70 2023-08-27T11:24:36.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 msgr2=0x7f804c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:36.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f804c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 >> v2:172.21.15.57:3300/0 conn(0x7f804c0c4630 msgr2=0x7f804c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:36.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 --2- 172.21.15.43:0/2563602403 >> v2:172.21.15.57:3300/0 conn(0x7f804c0c4630 0x7f804c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c154480 con 0x7f804c06ad70 2023-08-27T11:24:36.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f80440019f0 con 0x7f804c06ad70 2023-08-27T11:24:36.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 >> v1:172.21.15.43:6789/0 conn(0x7f804c06ad70 legacy=0x7f804c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f8034003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8034004850 0x7f8034004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f8034005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c155370 con 0x7f8034003a00 2023-08-27T11:24:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c151e70 con 0x7f8034004850 2023-08-27T11:24:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803400ba10 con 0x7f804c151a90 2023-08-27T11:24:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f804ad9d700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f8034003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f804b59e700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f8034005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.557+0000 7f804a59c700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8034004850 0x7f8034004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 -- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 msgr2=0x7f8034005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:36.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c151a90 0x7f8034005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 -- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8034004850 msgr2=0x7f8034004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:36.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8034004850 0x7f8034004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 -- 172.21.15.43:0/2563602403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340035b0 con 0x7f8034003a00 2023-08-27T11:24:36.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804a59c700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8034004850 0x7f8034004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:36.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f804ad9d700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f8034003e20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f803c009b90 tx=0x7f8034005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59623f611cd698f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:36.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e6c0 con 0x7f8034003a00 2023-08-27T11:24:36.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c00e820 con 0x7f8034003a00 2023-08-27T11:24:36.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.558+0000 7f8049d9b700 1 -- 172.21.15.43:0/2563602403 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00eb90 con 0x7f8034003a00 2023-08-27T11:24:36.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 -- 172.21.15.43:0/2563602403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 msgr2=0x7f8034003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 --2- 172.21.15.43:0/2563602403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f8034003e20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f803c009b90 tx=0x7f8034005880 comp rx=0 tx=0).stop 2023-08-27T11:24:36.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f804b59e700 1 -- 172.21.15.43:0/2563602403 reap_dead start 2023-08-27T11:24:36.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 -- 172.21.15.43:0/2563602403 shutdown_connections 2023-08-27T11:24:36.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 -- 172.21.15.43:0/2563602403 >> 172.21.15.43:0/2563602403 conn(0x7f804c0ab820 msgr2=0x7f804c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:36.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 -- 172.21.15.43:0/2563602403 shutdown_connections 2023-08-27T11:24:36.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.559+0000 7f80511ff700 1 -- 172.21.15.43:0/2563602403 wait complete. 2023-08-27T11:24:36.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.561+0000 7f80511ff700 1 Processor -- start 2023-08-27T11:24:36.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.561+0000 7f80511ff700 1 -- start start 2023-08-27T11:24:36.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 0x7f804c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c153e70 0x7f804c0c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c155ec0 con 0x7f8034003a00 2023-08-27T11:24:36.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0a9d00 con 0x7f804c1569f0 2023-08-27T11:24:36.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f80511ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c1534a0 con 0x7f804c153e70 2023-08-27T11:24:36.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57280/0 (socket says 172.21.15.43:57280) 2023-08-27T11:24:36.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 -- 172.21.15.43:0/879478664 learned_addr learned my addr 172.21.15.43:0/879478664 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:36.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804a59c700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 0x7f804c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804b59e700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c153e70 0x7f804c0c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 -- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c153e70 msgr2=0x7f804c0c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c153e70 0x7f804c0c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 -- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 msgr2=0x7f804c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 0x7f804c153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804ad9d700 1 -- 172.21.15.43:0/879478664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c152900 con 0x7f8034003a00 2023-08-27T11:24:36.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.562+0000 7f804a59c700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 0x7f804c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:36.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f804ad9d700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f803c00e4b0 tx=0x7f803c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:36.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c00e6c0 con 0x7f8034003a00 2023-08-27T11:24:36.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c003ab0 con 0x7f8034003a00 2023-08-27T11:24:36.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c003e60 con 0x7f8034003a00 2023-08-27T11:24:36.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c1ed9a0 con 0x7f8034003a00 2023-08-27T11:24:36.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.563+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c152e50 con 0x7f8034003a00 2023-08-27T11:24:36.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.564+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c04ee70 con 0x7f8034003a00 2023-08-27T11:24:36.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.565+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f803c013470 con 0x7f8034003a00 2023-08-27T11:24:36.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.566+0000 7f80337fe700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 0x7f803806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:36.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.566+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f803c089de0 con 0x7f8034003a00 2023-08-27T11:24:36.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.566+0000 7f804a59c700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 0x7f803806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:36.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.567+0000 7f804a59c700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 0x7f803806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f804c1e3e00 tx=0x7f8040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:36.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.570+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f803c0555e0 con 0x7f8034003a00 2023-08-27T11:24:36.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.822+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f804c06c130 con 0x7f8034003a00 2023-08-27T11:24:36.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.822+0000 7f80337fe700 1 -- 172.21.15.43:0/879478664 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4872 (secure 0 0 0) 0x7f803c058c00 con 0x7f8034003a00 2023-08-27T11:24:36.824 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:36.824 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:36.320500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1932805485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1932805485},{"type":"v1","addr":"172.21.15.57:6835","nonce":1932805485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-27T11:24:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.824+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 msgr2=0x7f803806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.824+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 0x7f803806c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f804c1e3e00 tx=0x7f8040008040 comp rx=0 tx=0).stop 2023-08-27T11:24:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.824+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 msgr2=0x7f804c1ed460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.824+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f803c00e4b0 tx=0x7f803c0047c0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 shutdown_connections 2023-08-27T11:24:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f803806a0e0 0x7f803806c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f804c153e70 0x7f804c0c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8034003a00 0x7f804c1ed460 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 --2- 172.21.15.43:0/879478664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f804c1569f0 0x7f804c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:36.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 >> 172.21.15.43:0/879478664 conn(0x7f804c0ab820 msgr2=0x7f804c149bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:36.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 shutdown_connections 2023-08-27T11:24:36.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:36.825+0000 7f80511ff700 1 -- 172.21.15.43:0/879478664 wait complete. 2023-08-27T11:24:36.829 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 32 2023-08-27T11:24:36.845 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:37.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.046+0000 7f7e7b7ff700 1 Processor -- start 2023-08-27T11:24:37.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.046+0000 7f7e7b7ff700 1 -- start start 2023-08-27T11:24:37.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.047+0000 7f7e7b7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e74151a90 0x7f7e740c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.047+0000 7f7e7b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.047+0000 7f7e7b7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7406c4e0 con 0x7f7e7406ad70 2023-08-27T11:24:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.047+0000 7f7e7b7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e74155370 con 0x7f7e74151a90 2023-08-27T11:24:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.047+0000 7f7e7b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74151e70 con 0x7f7e740c4630 2023-08-27T11:24:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e79d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7e7406ad70 0x7f7e7406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55230/0 (socket says 172.21.15.43:55230) 2023-08-27T11:24:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e79d9c700 1 -- 172.21.15.43:0/986588492 learned_addr learned my addr 172.21.15.43:0/986588492 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:37.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e7959b700 1 --2- 172.21.15.43:0/986588492 >> v2:172.21.15.57:3300/0 conn(0x7f7e74151a90 0x7f7e740c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e78d9a700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e7959b700 1 -- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 msgr2=0x7f7e740c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e7959b700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e7959b700 1 -- 172.21.15.43:0/986588492 >> v1:172.21.15.43:6789/0 conn(0x7f7e7406ad70 legacy=0x7f7e7406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e7959b700 1 -- 172.21.15.43:0/986588492 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74154480 con 0x7f7e74151a90 2023-08-27T11:24:37.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.048+0000 7f7e6bfff700 1 -- 172.21.15.43:0/986588492 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323973251 0 0) 0x7f7e7406c4e0 con 0x7f7e7406ad70 2023-08-27T11:24:37.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e7959b700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c7bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009840 tx=0x7f7e70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26bce917de192e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e6bfff700 1 -- 172.21.15.43:0/986588492 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011830 con 0x7f7e74151a90 2023-08-27T11:24:37.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e6bfff700 1 -- 172.21.15.43:0/986588492 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70011990 con 0x7f7e74151a90 2023-08-27T11:24:37.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e6bfff700 1 -- 172.21.15.43:0/986588492 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011d20 con 0x7f7e74151a90 2023-08-27T11:24:37.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 msgr2=0x7f7e740c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.049+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c7bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009840 tx=0x7f7e70009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:37.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/986588492 shutdown_connections 2023-08-27T11:24:37.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c7bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/986588492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/986588492 >> 172.21.15.43:0/986588492 conn(0x7f7e740ab820 msgr2=0x7f7e740abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:37.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/986588492 shutdown_connections 2023-08-27T11:24:37.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.050+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/986588492 wait complete. 2023-08-27T11:24:37.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.051+0000 7f7e7b7ff700 1 Processor -- start 2023-08-27T11:24:37.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.051+0000 7f7e7b7ff700 1 -- start start 2023-08-27T11:24:37.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740c0fb0 con 0x7f7e7406ad70 2023-08-27T11:24:37.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740c20a0 con 0x7f7e74151a90 2023-08-27T11:24:37.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.052+0000 7f7e7b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741529e0 con 0x7f7e740c4630 2023-08-27T11:24:37.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57286/0 (socket says 172.21.15.43:57286) 2023-08-27T11:24:37.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 -- 172.21.15.43:0/1799462518 learned_addr learned my addr 172.21.15.43:0/1799462518 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:37.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e79d9c700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e78d9a700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 -- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 msgr2=0x7f7e740c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 -- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 msgr2=0x7f7e740c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 -- 172.21.15.43:0/1799462518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700094a0 con 0x7f7e7406ad70 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e78d9a700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e79d9c700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.053+0000 7f7e7959b700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009fd0 tx=0x7f7e70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.054+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700036a0 con 0x7f7e7406ad70 2023-08-27T11:24:37.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.054+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7001e070 con 0x7f7e7406ad70 2023-08-27T11:24:37.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.054+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740c2620 con 0x7f7e7406ad70 2023-08-27T11:24:37.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.054+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003a60 con 0x7f7e7406ad70 2023-08-27T11:24:37.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.054+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740c33a0 con 0x7f7e7406ad70 2023-08-27T11:24:37.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.055+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e740c2900 con 0x7f7e7406ad70 2023-08-27T11:24:37.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.056+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e70003bc0 con 0x7f7e7406ad70 2023-08-27T11:24:37.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.057+0000 7f7e69ffb700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 0x7f7e5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.057+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e70089590 con 0x7f7e7406ad70 2023-08-27T11:24:37.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.058+0000 7f7e78d9a700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 0x7f7e5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.058+0000 7f7e78d9a700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 0x7f7e5806c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e7414d280 tx=0x7f7e64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.062+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e70054c70 con 0x7f7e7406ad70 2023-08-27T11:24:37.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.272+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e7404ee70 con 0x7f7e7406ad70 2023-08-27T11:24:37.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.274+0000 7f7e69ffb700 1 -- 172.21.15.43:0/1799462518 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18233 (secure 0 0 0) 0x7f7e70058290 con 0x7f7e7406ad70 2023-08-27T11:24:37.275 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:37.276 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":47,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:33.876379+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:37.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 msgr2=0x7f7e5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 0x7f7e5806c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e7414d280 tx=0x7f7e64008040 comp rx=0 tx=0).stop 2023-08-27T11:24:37.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 msgr2=0x7f7e74153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009fd0 tx=0x7f7e70004750 comp rx=0 tx=0).stop 2023-08-27T11:24:37.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 shutdown_connections 2023-08-27T11:24:37.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e5806a0e0 0x7f7e5806c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e74151a90 0x7f7e740c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e7406ad70 0x7f7e74153e80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 --2- 172.21.15.43:0/1799462518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e740c4630 0x7f7e740c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 >> 172.21.15.43:0/1799462518 conn(0x7f7e740ab820 msgr2=0x7f7e74150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:37.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 shutdown_connections 2023-08-27T11:24:37.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.276+0000 7f7e7b7ff700 1 -- 172.21.15.43:0/1799462518 wait complete. 2023-08-27T11:24:37.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:24:37.296 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:24:37.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.497+0000 7f9da29ff700 1 Processor -- start 2023-08-27T11:24:37.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.497+0000 7f9da29ff700 1 -- start start 2023-08-27T11:24:37.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9da29ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c14e960 0x7f9d9c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9da29ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9da29ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9c154d00 con 0x7f9d9c0c50d0 2023-08-27T11:24:37.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9da29ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9c0baf30 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9da29ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c154fe0 con 0x7f9d9c14e960 2023-08-27T11:24:37.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57292/0 (socket says 172.21.15.43:57292) 2023-08-27T11:24:37.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 -- 172.21.15.43:0/762809334 learned_addr learned my addr 172.21.15.43:0/762809334 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:37.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9bfff700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c14e960 0x7f9d9c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 -- 172.21.15.43:0/762809334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c14e960 msgr2=0x7f9d9c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:37.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c14e960 0x7f9d9c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.499+0000 7f9d9b7fe700 1 -- 172.21.15.43:0/762809334 >> v1:172.21.15.43:6789/0 conn(0x7f9d9c0c50d0 legacy=0x7f9d9c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9b7fe700 1 -- 172.21.15.43:0/762809334 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c1552c0 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9affd700 1 -- 172.21.15.43:0/762809334 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363831383 0 0) 0x7f9d9c154d00 con 0x7f9d9c0c50d0 2023-08-27T11:24:37.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9b7fe700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9d900098f0 tx=0x7f9d90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b443c018cb084 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9affd700 1 -- 172.21.15.43:0/762809334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000b8a0 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9affd700 1 -- 172.21.15.43:0/762809334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000ba00 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.500+0000 7f9d9affd700 1 -- 172.21.15.43:0/762809334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000bd90 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 -- 172.21.15.43:0/762809334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 msgr2=0x7f9d9c0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9d900098f0 tx=0x7f9d90009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:37.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 -- 172.21.15.43:0/762809334 shutdown_connections 2023-08-27T11:24:37.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c14e960 0x7f9d9c0a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 --2- 172.21.15.43:0/762809334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c0c3cc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 -- 172.21.15.43:0/762809334 >> 172.21.15.43:0/762809334 conn(0x7f9d9c06aa50 msgr2=0x7f9d9c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:37.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 -- 172.21.15.43:0/762809334 shutdown_connections 2023-08-27T11:24:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.501+0000 7f9da29ff700 1 -- 172.21.15.43:0/762809334 wait complete. 2023-08-27T11:24:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.502+0000 7f9da29ff700 1 Processor -- start 2023-08-27T11:24:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 -- start start 2023-08-27T11:24:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c0c50d0 0x7f9d9c0bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 0x7f9d9c14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c145c90 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c146700 con 0x7f9d9c14e960 2023-08-27T11:24:37.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.503+0000 7f9da29ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9c145f00 con 0x7f9d9c0c50d0 2023-08-27T11:24:37.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57306/0 (socket says 172.21.15.43:57306) 2023-08-27T11:24:37.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 -- 172.21.15.43:0/73863771 learned_addr learned my addr 172.21.15.43:0/73863771 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:37.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9b7fe700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c0c50d0 0x7f9d9c0bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9da0f9c700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 0x7f9d9c14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 -- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c0c50d0 msgr2=0x7f9d9c0bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c0c50d0 0x7f9d9c0bc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 -- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 msgr2=0x7f9d9c14c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 0x7f9d9c14c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 -- 172.21.15.43:0/73863771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90009550 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9da0f9c700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 0x7f9d9c14c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:37.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.504+0000 7f9d9bfff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00e810 tx=0x7f9d8c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.505+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c013610 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.505+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c013770 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.505+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c013b20 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.505+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9c1e9ca0 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.505+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9c1ea260 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.506+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9c1ea5d0 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.507+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d8c013c80 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.508+0000 7f9d98ff9700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 0x7f9d8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.508+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d8c088270 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.508+0000 7f9d9b7fe700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 0x7f9d8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:37.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.509+0000 7f9d9b7fe700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 0x7f9d8806c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9d90014040 tx=0x7f9d90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:37.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.512+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9d8c057360 con 0x7f9d9c0a79c0 2023-08-27T11:24:37.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.717+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d9c1e9b20 con 0x7f9d8806a0e0 2023-08-27T11:24:37.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.729+0000 7f9d98ff9700 1 -- 172.21.15.43:0/73863771 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311650 (secure 0 0 0) 0x7f9d9000bb70 con 0x7f9d8806a0e0 2023-08-27T11:24:37.736 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:37.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.733+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 msgr2=0x7f9d8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.733+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 0x7f9d8806c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9d90014040 tx=0x7f9d90008030 comp rx=0 tx=0).stop 2023-08-27T11:24:37.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.733+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 msgr2=0x7f9d9c1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.733+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00e810 tx=0x7f9d8c00eb20 comp rx=0 tx=0).stop 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 shutdown_connections 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d8806a0e0 0x7f9d8806c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9c14e960 0x7f9d9c14c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d9c0a79c0 0x7f9d9c1461c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 --2- 172.21.15.43:0/73863771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d9c0c50d0 0x7f9d9c0bc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:37.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 >> 172.21.15.43:0/73863771 conn(0x7f9d9c06aa50 msgr2=0x7f9d9c154550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:37.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 shutdown_connections 2023-08-27T11:24:37.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.734+0000 7f9da29ff700 1 -- 172.21.15.43:0/73863771 wait complete. 2023-08-27T11:24:37.741 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:24:37.754 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-08-27T11:24:36.335638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221704,"kb_used_data":5528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753016,"statfs":{"total":773094113280,"available":772867088384,"internally_reserved":0,"allocated":5660672,"data_stored":3097116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.073503"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506555+0000","last_change":"2023-08-27T11:24:32.898902+0000","last_active":"2023-08-27T11:24:34.506555+0000","last_peered":"2023-08-27T11:24:34.506555+0000","last_clean":"2023-08-27T11:24:34.506555+0000","last_became_active":"2023-08-27T11:24:32.898635+0000","last_became_peered":"2023-08-27T11:24:32.898635+0000","last_unstale":"2023-08-27T11:24:34.506555+0000","last_undegraded":"2023-08-27T11:24:34.506555+0000","last_fullsized":"2023-08-27T11:24:34.506555+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:46.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891090+0000","last_change":"2023-08-27T11:24:32.905490+0000","last_active":"2023-08-27T11:24:33.891090+0000","last_peered":"2023-08-27T11:24:33.891090+0000","last_clean":"2023-08-27T11:24:33.891090+0000","last_became_active":"2023-08-27T11:24:32.904866+0000","last_became_peered":"2023-08-27T11:24:32.904866+0000","last_unstale":"2023-08-27T11:24:33.891090+0000","last_undegraded":"2023-08-27T11:24:33.891090+0000","last_fullsized":"2023-08-27T11:24:33.891090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:11.031610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505613+0000","last_change":"2023-08-27T11:24:32.912255+0000","last_active":"2023-08-27T11:24:34.505613+0000","last_peered":"2023-08-27T11:24:34.505613+0000","last_clean":"2023-08-27T11:24:34.505613+0000","last_became_active":"2023-08-27T11:24:32.909842+0000","last_became_peered":"2023-08-27T11:24:32.909842+0000","last_unstale":"2023-08-27T11:24:34.505613+0000","last_undegraded":"2023-08-27T11:24:34.505613+0000","last_fullsized":"2023-08-27T11:24:34.505613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:54:42.463318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891287+0000","last_change":"2023-08-27T11:24:32.904922+0000","last_active":"2023-08-27T11:24:33.891287+0000","last_peered":"2023-08-27T11:24:33.891287+0000","last_clean":"2023-08-27T11:24:33.891287+0000","last_became_active":"2023-08-27T11:24:32.904570+0000","last_became_peered":"2023-08-27T11:24:32.904570+0000","last_unstale":"2023-08-27T11:24:33.891287+0000","last_undegraded":"2023-08-27T11:24:33.891287+0000","last_fullsized":"2023-08-27T11:24:33.891287+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:28.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891469+0000","last_change":"2023-08-27T11:24:32.908868+0000","last_active":"2023-08-27T11:24:33.891469+0000","last_peered":"2023-08-27T11:24:33.891469+0000","last_clean":"2023-08-27T11:24:33.891469+0000","last_became_active":"2023-08-27T11:24:32.908413+0000","last_became_peered":"2023-08-27T11:24:32.908413+0000","last_unstale":"2023-08-27T11:24:33.891469+0000","last_undegraded":"2023-08-27T11:24:33.891469+0000","last_fullsized":"2023-08-27T11:24:33.891469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:12.553037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505676+0000","last_change":"2023-08-27T11:24:32.900880+0000","last_active":"2023-08-27T11:24:34.505676+0000","last_peered":"2023-08-27T11:24:34.505676+0000","last_clean":"2023-08-27T11:24:34.505676+0000","last_became_active":"2023-08-27T11:24:32.900515+0000","last_became_peered":"2023-08-27T11:24:32.900515+0000","last_unstale":"2023-08-27T11:24:34.505676+0000","last_undegraded":"2023-08-27T11:24:34.505676+0000","last_fullsized":"2023-08-27T11:24:34.505676+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:41.755468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.504984+0000","last_change":"2023-08-27T11:24:32.907204+0000","last_active":"2023-08-27T11:24:34.504984+0000","last_peered":"2023-08-27T11:24:34.504984+0000","last_clean":"2023-08-27T11:24:34.504984+0000","last_became_active":"2023-08-27T11:24:32.906510+0000","last_became_peered":"2023-08-27T11:24:32.906510+0000","last_unstale":"2023-08-27T11:24:34.504984+0000","last_undegraded":"2023-08-27T11:24:34.504984+0000","last_fullsized":"2023-08-27T11:24:34.504984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:22:54.267729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505335+0000","last_change":"2023-08-27T11:24:32.906146+0000","last_active":"2023-08-27T11:24:34.505335+0000","last_peered":"2023-08-27T11:24:34.505335+0000","last_clean":"2023-08-27T11:24:34.505335+0000","last_became_active":"2023-08-27T11:24:32.905867+0000","last_became_peered":"2023-08-27T11:24:32.905867+0000","last_unstale":"2023-08-27T11:24:34.505335+0000","last_undegraded":"2023-08-27T11:24:34.505335+0000","last_fullsized":"2023-08-27T11:24:34.505335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:27.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506388+0000","last_change":"2023-08-27T11:24:32.910119+0000","last_active":"2023-08-27T11:24:34.506388+0000","last_peered":"2023-08-27T11:24:34.506388+0000","last_clean":"2023-08-27T11:24:34.506388+0000","last_became_active":"2023-08-27T11:24:32.909855+0000","last_became_peered":"2023-08-27T11:24:32.909855+0000","last_unstale":"2023-08-27T11:24:34.506388+0000","last_undegraded":"2023-08-27T11:24:34.506388+0000","last_fullsized":"2023-08-27T11:24:34.506388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:04.494505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506320+0000","last_change":"2023-08-27T11:24:32.901649+0000","last_active":"2023-08-27T11:24:34.506320+0000","last_peered":"2023-08-27T11:24:34.506320+0000","last_clean":"2023-08-27T11:24:34.506320+0000","last_became_active":"2023-08-27T11:24:32.901366+0000","last_became_peered":"2023-08-27T11:24:32.901366+0000","last_unstale":"2023-08-27T11:24:34.506320+0000","last_undegraded":"2023-08-27T11:24:34.506320+0000","last_fullsized":"2023-08-27T11:24:34.506320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:58.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.881065+0000","last_change":"2023-08-27T11:24:32.900281+0000","last_active":"2023-08-27T11:24:33.881065+0000","last_peered":"2023-08-27T11:24:33.881065+0000","last_clean":"2023-08-27T11:24:33.881065+0000","last_became_active":"2023-08-27T11:24:32.900032+0000","last_became_peered":"2023-08-27T11:24:32.900032+0000","last_unstale":"2023-08-27T11:24:33.881065+0000","last_undegraded":"2023-08-27T11:24:33.881065+0000","last_fullsized":"2023-08-27T11:24:33.881065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:30.875988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506329+0000","last_change":"2023-08-27T11:24:32.895742+0000","last_active":"2023-08-27T11:24:34.506329+0000","last_peered":"2023-08-27T11:24:34.506329+0000","last_clean":"2023-08-27T11:24:34.506329+0000","last_became_active":"2023-08-27T11:24:32.894897+0000","last_became_peered":"2023-08-27T11:24:32.894897+0000","last_unstale":"2023-08-27T11:24:34.506329+0000","last_undegraded":"2023-08-27T11:24:34.506329+0000","last_fullsized":"2023-08-27T11:24:34.506329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:17.470090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506586+0000","last_change":"2023-08-27T11:24:32.909896+0000","last_active":"2023-08-27T11:24:34.506586+0000","last_peered":"2023-08-27T11:24:34.506586+0000","last_clean":"2023-08-27T11:24:34.506586+0000","last_became_active":"2023-08-27T11:24:32.909605+0000","last_became_peered":"2023-08-27T11:24:32.909605+0000","last_unstale":"2023-08-27T11:24:34.506586+0000","last_undegraded":"2023-08-27T11:24:34.506586+0000","last_fullsized":"2023-08-27T11:24:34.506586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:34.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505013+0000","last_change":"2023-08-27T11:24:32.907370+0000","last_active":"2023-08-27T11:24:34.505013+0000","last_peered":"2023-08-27T11:24:34.505013+0000","last_clean":"2023-08-27T11:24:34.505013+0000","last_became_active":"2023-08-27T11:24:32.907051+0000","last_became_peered":"2023-08-27T11:24:32.907051+0000","last_unstale":"2023-08-27T11:24:34.505013+0000","last_undegraded":"2023-08-27T11:24:34.505013+0000","last_fullsized":"2023-08-27T11:24:34.505013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:49:44.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891665+0000","last_change":"2023-08-27T11:24:32.900338+0000","last_active":"2023-08-27T11:24:33.891665+0000","last_peered":"2023-08-27T11:24:33.891665+0000","last_clean":"2023-08-27T11:24:33.891665+0000","last_became_active":"2023-08-27T11:24:32.900045+0000","last_became_peered":"2023-08-27T11:24:32.900045+0000","last_unstale":"2023-08-27T11:24:33.891665+0000","last_undegraded":"2023-08-27T11:24:33.891665+0000","last_fullsized":"2023-08-27T11:24:33.891665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:58:09.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505363+0000","last_change":"2023-08-27T11:24:32.902464+0000","last_active":"2023-08-27T11:24:34.505363+0000","last_peered":"2023-08-27T11:24:34.505363+0000","last_clean":"2023-08-27T11:24:34.505363+0000","last_became_active":"2023-08-27T11:24:32.902171+0000","last_became_peered":"2023-08-27T11:24:32.902171+0000","last_unstale":"2023-08-27T11:24:34.505363+0000","last_undegraded":"2023-08-27T11:24:34.505363+0000","last_fullsized":"2023-08-27T11:24:34.505363+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:01:40.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506025+0000","last_change":"2023-08-27T11:24:32.913021+0000","last_active":"2023-08-27T11:24:34.506025+0000","last_peered":"2023-08-27T11:24:34.506025+0000","last_clean":"2023-08-27T11:24:34.506025+0000","last_became_active":"2023-08-27T11:24:32.912510+0000","last_became_peered":"2023-08-27T11:24:32.912510+0000","last_unstale":"2023-08-27T11:24:34.506025+0000","last_undegraded":"2023-08-27T11:24:34.506025+0000","last_fullsized":"2023-08-27T11:24:34.506025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:49.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891250+0000","last_change":"2023-08-27T11:24:32.905710+0000","last_active":"2023-08-27T11:24:33.891250+0000","last_peered":"2023-08-27T11:24:33.891250+0000","last_clean":"2023-08-27T11:24:33.891250+0000","last_became_active":"2023-08-27T11:24:32.905225+0000","last_became_peered":"2023-08-27T11:24:32.905225+0000","last_unstale":"2023-08-27T11:24:33.891250+0000","last_undegraded":"2023-08-27T11:24:33.891250+0000","last_fullsized":"2023-08-27T11:24:33.891250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:17.470090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505847+0000","last_change":"2023-08-27T11:24:32.912893+0000","last_active":"2023-08-27T11:24:34.505847+0000","last_peered":"2023-08-27T11:24:34.505847+0000","last_clean":"2023-08-27T11:24:34.505847+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:34.505847+0000","last_undegraded":"2023-08-27T11:24:34.505847+0000","last_fullsized":"2023-08-27T11:24:34.505847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:20.558108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505577+0000","last_change":"2023-08-27T11:24:32.903525+0000","last_active":"2023-08-27T11:24:34.505577+0000","last_peered":"2023-08-27T11:24:34.505577+0000","last_clean":"2023-08-27T11:24:34.505577+0000","last_became_active":"2023-08-27T11:24:32.903193+0000","last_became_peered":"2023-08-27T11:24:32.903193+0000","last_unstale":"2023-08-27T11:24:34.505577+0000","last_undegraded":"2023-08-27T11:24:34.505577+0000","last_fullsized":"2023-08-27T11:24:34.505577+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:46.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505826+0000","last_change":"2023-08-27T11:24:32.900837+0000","last_active":"2023-08-27T11:24:34.505826+0000","last_peered":"2023-08-27T11:24:34.505826+0000","last_clean":"2023-08-27T11:24:34.505826+0000","last_became_active":"2023-08-27T11:24:32.900383+0000","last_became_peered":"2023-08-27T11:24:32.900383+0000","last_unstale":"2023-08-27T11:24:34.505826+0000","last_undegraded":"2023-08-27T11:24:34.505826+0000","last_fullsized":"2023-08-27T11:24:34.505826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:41:02.975943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505311+0000","last_change":"2023-08-27T11:24:32.906541+0000","last_active":"2023-08-27T11:24:34.505311+0000","last_peered":"2023-08-27T11:24:34.505311+0000","last_clean":"2023-08-27T11:24:34.505311+0000","last_became_active":"2023-08-27T11:24:32.906237+0000","last_became_peered":"2023-08-27T11:24:32.906237+0000","last_unstale":"2023-08-27T11:24:34.505311+0000","last_undegraded":"2023-08-27T11:24:34.505311+0000","last_fullsized":"2023-08-27T11:24:34.505311+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:39.373915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.880665+0000","last_change":"2023-08-27T11:24:32.902996+0000","last_active":"2023-08-27T11:24:33.880665+0000","last_peered":"2023-08-27T11:24:33.880665+0000","last_clean":"2023-08-27T11:24:33.880665+0000","last_became_active":"2023-08-27T11:24:32.902692+0000","last_became_peered":"2023-08-27T11:24:32.902692+0000","last_unstale":"2023-08-27T11:24:33.880665+0000","last_undegraded":"2023-08-27T11:24:33.880665+0000","last_fullsized":"2023-08-27T11:24:33.880665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:16.997303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505991+0000","last_change":"2023-08-27T11:24:32.905733+0000","last_active":"2023-08-27T11:24:34.505991+0000","last_peered":"2023-08-27T11:24:34.505991+0000","last_clean":"2023-08-27T11:24:34.505991+0000","last_became_active":"2023-08-27T11:24:32.905472+0000","last_became_peered":"2023-08-27T11:24:32.905472+0000","last_unstale":"2023-08-27T11:24:34.505991+0000","last_undegraded":"2023-08-27T11:24:34.505991+0000","last_fullsized":"2023-08-27T11:24:34.505991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:09.164249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505882+0000","last_change":"2023-08-27T11:24:32.911479+0000","last_active":"2023-08-27T11:24:34.505882+0000","last_peered":"2023-08-27T11:24:34.505882+0000","last_clean":"2023-08-27T11:24:34.505882+0000","last_became_active":"2023-08-27T11:24:32.909452+0000","last_became_peered":"2023-08-27T11:24:32.909452+0000","last_unstale":"2023-08-27T11:24:34.505882+0000","last_undegraded":"2023-08-27T11:24:34.505882+0000","last_fullsized":"2023-08-27T11:24:34.505882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:30.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506462+0000","last_change":"2023-08-27T11:24:32.883832+0000","last_active":"2023-08-27T11:24:34.506462+0000","last_peered":"2023-08-27T11:24:34.506462+0000","last_clean":"2023-08-27T11:24:34.506462+0000","last_became_active":"2023-08-27T11:24:32.883350+0000","last_became_peered":"2023-08-27T11:24:32.883350+0000","last_unstale":"2023-08-27T11:24:34.506462+0000","last_undegraded":"2023-08-27T11:24:34.506462+0000","last_fullsized":"2023-08-27T11:24:34.506462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:06.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506163+0000","last_change":"2023-08-27T11:24:32.909695+0000","last_active":"2023-08-27T11:24:34.506163+0000","last_peered":"2023-08-27T11:24:34.506163+0000","last_clean":"2023-08-27T11:24:34.506163+0000","last_became_active":"2023-08-27T11:24:32.909365+0000","last_became_peered":"2023-08-27T11:24:32.909365+0000","last_unstale":"2023-08-27T11:24:34.506163+0000","last_undegraded":"2023-08-27T11:24:34.506163+0000","last_fullsized":"2023-08-27T11:24:34.506163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:21.268122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506064+0000","last_change":"2023-08-27T11:24:32.893599+0000","last_active":"2023-08-27T11:24:34.506064+0000","last_peered":"2023-08-27T11:24:34.506064+0000","last_clean":"2023-08-27T11:24:34.506064+0000","last_became_active":"2023-08-27T11:24:32.893201+0000","last_became_peered":"2023-08-27T11:24:32.893201+0000","last_unstale":"2023-08-27T11:24:34.506064+0000","last_undegraded":"2023-08-27T11:24:34.506064+0000","last_fullsized":"2023-08-27T11:24:34.506064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:28.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505104+0000","last_change":"2023-08-27T11:24:32.905940+0000","last_active":"2023-08-27T11:24:34.505104+0000","last_peered":"2023-08-27T11:24:34.505104+0000","last_clean":"2023-08-27T11:24:34.505104+0000","last_became_active":"2023-08-27T11:24:32.904461+0000","last_became_peered":"2023-08-27T11:24:32.904461+0000","last_unstale":"2023-08-27T11:24:34.505104+0000","last_undegraded":"2023-08-27T11:24:34.505104+0000","last_fullsized":"2023-08-27T11:24:34.505104+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:03.040174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891643+0000","last_change":"2023-08-27T11:24:32.900476+0000","last_active":"2023-08-27T11:24:33.891643+0000","last_peered":"2023-08-27T11:24:33.891643+0000","last_clean":"2023-08-27T11:24:33.891643+0000","last_became_active":"2023-08-27T11:24:32.900121+0000","last_became_peered":"2023-08-27T11:24:32.900121+0000","last_unstale":"2023-08-27T11:24:33.891643+0000","last_undegraded":"2023-08-27T11:24:33.891643+0000","last_fullsized":"2023-08-27T11:24:33.891643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:07.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.504837+0000","last_change":"2023-08-27T11:24:32.907054+0000","last_active":"2023-08-27T11:24:34.504837+0000","last_peered":"2023-08-27T11:24:34.504837+0000","last_clean":"2023-08-27T11:24:34.504837+0000","last_became_active":"2023-08-27T11:24:32.906207+0000","last_became_peered":"2023-08-27T11:24:32.906207+0000","last_unstale":"2023-08-27T11:24:34.504837+0000","last_undegraded":"2023-08-27T11:24:34.504837+0000","last_fullsized":"2023-08-27T11:24:34.504837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:30.584079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506034+0000","last_change":"2023-08-27T11:24:32.900379+0000","last_active":"2023-08-27T11:24:34.506034+0000","last_peered":"2023-08-27T11:24:34.506034+0000","last_clean":"2023-08-27T11:24:34.506034+0000","last_became_active":"2023-08-27T11:24:32.899692+0000","last_became_peered":"2023-08-27T11:24:32.899692+0000","last_unstale":"2023-08-27T11:24:34.506034+0000","last_undegraded":"2023-08-27T11:24:34.506034+0000","last_fullsized":"2023-08-27T11:24:34.506034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:15:29.722229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890707+0000","last_change":"2023-08-27T11:24:32.898642+0000","last_active":"2023-08-27T11:24:33.890707+0000","last_peered":"2023-08-27T11:24:33.890707+0000","last_clean":"2023-08-27T11:24:33.890707+0000","last_became_active":"2023-08-27T11:24:32.898270+0000","last_became_peered":"2023-08-27T11:24:32.898270+0000","last_unstale":"2023-08-27T11:24:33.890707+0000","last_undegraded":"2023-08-27T11:24:33.890707+0000","last_fullsized":"2023-08-27T11:24:33.890707+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:57.187870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506313+0000","last_change":"2023-08-27T11:24:32.282881+0000","last_active":"2023-08-27T11:24:34.506313+0000","last_peered":"2023-08-27T11:24:34.506313+0000","last_clean":"2023-08-27T11:24:34.506313+0000","last_became_active":"2023-08-27T11:24:32.282586+0000","last_became_peered":"2023-08-27T11:24:32.282586+0000","last_unstale":"2023-08-27T11:24:34.506313+0000","last_undegraded":"2023-08-27T11:24:34.506313+0000","last_fullsized":"2023-08-27T11:24:34.506313+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:22:18.212577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506238+0000","last_change":"2023-08-27T11:24:32.907402+0000","last_active":"2023-08-27T11:24:34.506238+0000","last_peered":"2023-08-27T11:24:34.506238+0000","last_clean":"2023-08-27T11:24:34.506238+0000","last_became_active":"2023-08-27T11:24:32.907043+0000","last_became_peered":"2023-08-27T11:24:32.907043+0000","last_unstale":"2023-08-27T11:24:34.506238+0000","last_undegraded":"2023-08-27T11:24:34.506238+0000","last_fullsized":"2023-08-27T11:24:34.506238+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:43.589504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506454+0000","last_change":"2023-08-27T11:24:32.294572+0000","last_active":"2023-08-27T11:24:34.506454+0000","last_peered":"2023-08-27T11:24:34.506454+0000","last_clean":"2023-08-27T11:24:34.506454+0000","last_became_active":"2023-08-27T11:24:32.294253+0000","last_became_peered":"2023-08-27T11:24:32.294253+0000","last_unstale":"2023-08-27T11:24:34.506454+0000","last_undegraded":"2023-08-27T11:24:34.506454+0000","last_fullsized":"2023-08-27T11:24:34.506454+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:08.334851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505588+0000","last_change":"2023-08-27T11:24:32.902261+0000","last_active":"2023-08-27T11:24:34.505588+0000","last_peered":"2023-08-27T11:24:34.505588+0000","last_clean":"2023-08-27T11:24:34.505588+0000","last_became_active":"2023-08-27T11:24:32.901957+0000","last_became_peered":"2023-08-27T11:24:32.901957+0000","last_unstale":"2023-08-27T11:24:34.505588+0000","last_undegraded":"2023-08-27T11:24:34.505588+0000","last_fullsized":"2023-08-27T11:24:34.505588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:34.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506234+0000","last_change":"2023-08-27T11:24:32.289666+0000","last_active":"2023-08-27T11:24:34.506234+0000","last_peered":"2023-08-27T11:24:34.506234+0000","last_clean":"2023-08-27T11:24:34.506234+0000","last_became_active":"2023-08-27T11:24:32.289236+0000","last_became_peered":"2023-08-27T11:24:32.289236+0000","last_unstale":"2023-08-27T11:24:34.506234+0000","last_undegraded":"2023-08-27T11:24:34.506234+0000","last_fullsized":"2023-08-27T11:24:34.506234+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:45:07.542684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505726+0000","last_change":"2023-08-27T11:24:32.883656+0000","last_active":"2023-08-27T11:24:34.505726+0000","last_peered":"2023-08-27T11:24:34.505726+0000","last_clean":"2023-08-27T11:24:34.505726+0000","last_became_active":"2023-08-27T11:24:32.883338+0000","last_became_peered":"2023-08-27T11:24:32.883338+0000","last_unstale":"2023-08-27T11:24:34.505726+0000","last_undegraded":"2023-08-27T11:24:34.505726+0000","last_fullsized":"2023-08-27T11:24:34.505726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:07.858421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506640+0000","last_change":"2023-08-27T11:24:32.294367+0000","last_active":"2023-08-27T11:24:34.506640+0000","last_peered":"2023-08-27T11:24:34.506640+0000","last_clean":"2023-08-27T11:24:34.506640+0000","last_became_active":"2023-08-27T11:24:32.294063+0000","last_became_peered":"2023-08-27T11:24:32.294063+0000","last_unstale":"2023-08-27T11:24:34.506640+0000","last_undegraded":"2023-08-27T11:24:34.506640+0000","last_fullsized":"2023-08-27T11:24:34.506640+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:20.032441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891996+0000","last_change":"2023-08-27T11:24:32.910605+0000","last_active":"2023-08-27T11:24:33.891996+0000","last_peered":"2023-08-27T11:24:33.891996+0000","last_clean":"2023-08-27T11:24:33.891996+0000","last_became_active":"2023-08-27T11:24:32.910330+0000","last_became_peered":"2023-08-27T11:24:32.910330+0000","last_unstale":"2023-08-27T11:24:33.891996+0000","last_undegraded":"2023-08-27T11:24:33.891996+0000","last_fullsized":"2023-08-27T11:24:33.891996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:41:46.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506224+0000","last_change":"2023-08-27T11:24:32.298886+0000","last_active":"2023-08-27T11:24:34.506224+0000","last_peered":"2023-08-27T11:24:34.506224+0000","last_clean":"2023-08-27T11:24:34.506224+0000","last_became_active":"2023-08-27T11:24:32.298269+0000","last_became_peered":"2023-08-27T11:24:32.298269+0000","last_unstale":"2023-08-27T11:24:34.506224+0000","last_undegraded":"2023-08-27T11:24:34.506224+0000","last_fullsized":"2023-08-27T11:24:34.506224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:50.266609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892256+0000","last_change":"2023-08-27T11:24:32.904723+0000","last_active":"2023-08-27T11:24:33.892256+0000","last_peered":"2023-08-27T11:24:33.892256+0000","last_clean":"2023-08-27T11:24:33.892256+0000","last_became_active":"2023-08-27T11:24:32.904416+0000","last_became_peered":"2023-08-27T11:24:32.904416+0000","last_unstale":"2023-08-27T11:24:33.892256+0000","last_undegraded":"2023-08-27T11:24:33.892256+0000","last_fullsized":"2023-08-27T11:24:33.892256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:47:24.435986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891138+0000","last_change":"2023-08-27T11:24:32.282892+0000","last_active":"2023-08-27T11:24:33.891138+0000","last_peered":"2023-08-27T11:24:33.891138+0000","last_clean":"2023-08-27T11:24:33.891138+0000","last_became_active":"2023-08-27T11:24:32.282592+0000","last_became_peered":"2023-08-27T11:24:32.282592+0000","last_unstale":"2023-08-27T11:24:33.891138+0000","last_undegraded":"2023-08-27T11:24:33.891138+0000","last_fullsized":"2023-08-27T11:24:33.891138+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:27:25.572183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506230+0000","last_change":"2023-08-27T11:24:32.884415+0000","last_active":"2023-08-27T11:24:34.506230+0000","last_peered":"2023-08-27T11:24:34.506230+0000","last_clean":"2023-08-27T11:24:34.506230+0000","last_became_active":"2023-08-27T11:24:32.884135+0000","last_became_peered":"2023-08-27T11:24:32.884135+0000","last_unstale":"2023-08-27T11:24:34.506230+0000","last_undegraded":"2023-08-27T11:24:34.506230+0000","last_fullsized":"2023-08-27T11:24:34.506230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:45.484143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506045+0000","last_change":"2023-08-27T11:24:32.290256+0000","last_active":"2023-08-27T11:24:34.506045+0000","last_peered":"2023-08-27T11:24:34.506045+0000","last_clean":"2023-08-27T11:24:34.506045+0000","last_became_active":"2023-08-27T11:24:32.289480+0000","last_became_peered":"2023-08-27T11:24:32.289480+0000","last_unstale":"2023-08-27T11:24:34.506045+0000","last_undegraded":"2023-08-27T11:24:34.506045+0000","last_fullsized":"2023-08-27T11:24:34.506045+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:57:45.872664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891544+0000","last_change":"2023-08-27T11:24:32.910118+0000","last_active":"2023-08-27T11:24:33.891544+0000","last_peered":"2023-08-27T11:24:33.891544+0000","last_clean":"2023-08-27T11:24:33.891544+0000","last_became_active":"2023-08-27T11:24:32.909727+0000","last_became_peered":"2023-08-27T11:24:32.909727+0000","last_unstale":"2023-08-27T11:24:33.891544+0000","last_undegraded":"2023-08-27T11:24:33.891544+0000","last_fullsized":"2023-08-27T11:24:33.891544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:06.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505124+0000","last_change":"2023-08-27T11:24:32.298796+0000","last_active":"2023-08-27T11:24:34.505124+0000","last_peered":"2023-08-27T11:24:34.505124+0000","last_clean":"2023-08-27T11:24:34.505124+0000","last_became_active":"2023-08-27T11:24:32.298437+0000","last_became_peered":"2023-08-27T11:24:32.298437+0000","last_unstale":"2023-08-27T11:24:34.505124+0000","last_undegraded":"2023-08-27T11:24:34.505124+0000","last_fullsized":"2023-08-27T11:24:34.505124+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:43:52.701242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890774+0000","last_change":"2023-08-27T11:24:32.901552+0000","last_active":"2023-08-27T11:24:33.890774+0000","last_peered":"2023-08-27T11:24:33.890774+0000","last_clean":"2023-08-27T11:24:33.890774+0000","last_became_active":"2023-08-27T11:24:32.901215+0000","last_became_peered":"2023-08-27T11:24:32.901215+0000","last_unstale":"2023-08-27T11:24:33.890774+0000","last_undegraded":"2023-08-27T11:24:33.890774+0000","last_fullsized":"2023-08-27T11:24:33.890774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:29:04.571917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891474+0000","last_change":"2023-08-27T11:24:32.288640+0000","last_active":"2023-08-27T11:24:33.891474+0000","last_peered":"2023-08-27T11:24:33.891474+0000","last_clean":"2023-08-27T11:24:33.891474+0000","last_became_active":"2023-08-27T11:24:32.288294+0000","last_became_peered":"2023-08-27T11:24:32.288294+0000","last_unstale":"2023-08-27T11:24:33.891474+0000","last_undegraded":"2023-08-27T11:24:33.891474+0000","last_fullsized":"2023-08-27T11:24:33.891474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:03.488898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506054+0000","last_change":"2023-08-27T11:24:32.909216+0000","last_active":"2023-08-27T11:24:34.506054+0000","last_peered":"2023-08-27T11:24:34.506054+0000","last_clean":"2023-08-27T11:24:34.506054+0000","last_became_active":"2023-08-27T11:24:32.908852+0000","last_became_peered":"2023-08-27T11:24:32.908852+0000","last_unstale":"2023-08-27T11:24:34.506054+0000","last_undegraded":"2023-08-27T11:24:34.506054+0000","last_fullsized":"2023-08-27T11:24:34.506054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:38.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891921+0000","last_change":"2023-08-27T11:24:32.299429+0000","last_active":"2023-08-27T11:24:33.891921+0000","last_peered":"2023-08-27T11:24:33.891921+0000","last_clean":"2023-08-27T11:24:33.891921+0000","last_became_active":"2023-08-27T11:24:32.299132+0000","last_became_peered":"2023-08-27T11:24:32.299132+0000","last_unstale":"2023-08-27T11:24:33.891921+0000","last_undegraded":"2023-08-27T11:24:33.891921+0000","last_fullsized":"2023-08-27T11:24:33.891921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:30:56.350503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506500+0000","last_change":"2023-08-27T11:24:32.905500+0000","last_active":"2023-08-27T11:24:34.506500+0000","last_peered":"2023-08-27T11:24:34.506500+0000","last_clean":"2023-08-27T11:24:34.506500+0000","last_became_active":"2023-08-27T11:24:32.905258+0000","last_became_peered":"2023-08-27T11:24:32.905258+0000","last_unstale":"2023-08-27T11:24:34.506500+0000","last_undegraded":"2023-08-27T11:24:34.506500+0000","last_fullsized":"2023-08-27T11:24:34.506500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:44:14.279660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892058+0000","last_change":"2023-08-27T11:24:32.291485+0000","last_active":"2023-08-27T11:24:33.892058+0000","last_peered":"2023-08-27T11:24:33.892058+0000","last_clean":"2023-08-27T11:24:33.892058+0000","last_became_active":"2023-08-27T11:24:32.291149+0000","last_became_peered":"2023-08-27T11:24:32.291149+0000","last_unstale":"2023-08-27T11:24:33.892058+0000","last_undegraded":"2023-08-27T11:24:33.892058+0000","last_fullsized":"2023-08-27T11:24:33.892058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:42:48.245409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891616+0000","last_change":"2023-08-27T11:24:32.909417+0000","last_active":"2023-08-27T11:24:33.891616+0000","last_peered":"2023-08-27T11:24:33.891616+0000","last_clean":"2023-08-27T11:24:33.891616+0000","last_became_active":"2023-08-27T11:24:32.908900+0000","last_became_peered":"2023-08-27T11:24:32.908900+0000","last_unstale":"2023-08-27T11:24:33.891616+0000","last_undegraded":"2023-08-27T11:24:33.891616+0000","last_fullsized":"2023-08-27T11:24:33.891616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:24.676746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506196+0000","last_change":"2023-08-27T11:24:32.283014+0000","last_active":"2023-08-27T11:24:34.506196+0000","last_peered":"2023-08-27T11:24:34.506196+0000","last_clean":"2023-08-27T11:24:34.506196+0000","last_became_active":"2023-08-27T11:24:32.282692+0000","last_became_peered":"2023-08-27T11:24:32.282692+0000","last_unstale":"2023-08-27T11:24:34.506196+0000","last_undegraded":"2023-08-27T11:24:34.506196+0000","last_fullsized":"2023-08-27T11:24:34.506196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:10.026002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506401+0000","last_change":"2023-08-27T11:24:32.906136+0000","last_active":"2023-08-27T11:24:34.506401+0000","last_peered":"2023-08-27T11:24:34.506401+0000","last_clean":"2023-08-27T11:24:34.506401+0000","last_became_active":"2023-08-27T11:24:32.905859+0000","last_became_peered":"2023-08-27T11:24:32.905859+0000","last_unstale":"2023-08-27T11:24:34.506401+0000","last_undegraded":"2023-08-27T11:24:34.506401+0000","last_fullsized":"2023-08-27T11:24:34.506401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:20.558108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505362+0000","last_change":"2023-08-27T11:24:32.292723+0000","last_active":"2023-08-27T11:24:34.505362+0000","last_peered":"2023-08-27T11:24:34.505362+0000","last_clean":"2023-08-27T11:24:34.505362+0000","last_became_active":"2023-08-27T11:24:32.292342+0000","last_became_peered":"2023-08-27T11:24:32.292342+0000","last_unstale":"2023-08-27T11:24:34.505362+0000","last_undegraded":"2023-08-27T11:24:34.505362+0000","last_fullsized":"2023-08-27T11:24:34.505362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:13.545322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505756+0000","last_change":"2023-08-27T11:24:32.908533+0000","last_active":"2023-08-27T11:24:34.505756+0000","last_peered":"2023-08-27T11:24:34.505756+0000","last_clean":"2023-08-27T11:24:34.505756+0000","last_became_active":"2023-08-27T11:24:32.908214+0000","last_became_peered":"2023-08-27T11:24:32.908214+0000","last_unstale":"2023-08-27T11:24:34.505756+0000","last_undegraded":"2023-08-27T11:24:34.505756+0000","last_fullsized":"2023-08-27T11:24:34.505756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:27:40.188603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505779+0000","last_change":"2023-08-27T11:24:32.298695+0000","last_active":"2023-08-27T11:24:34.505779+0000","last_peered":"2023-08-27T11:24:34.505779+0000","last_clean":"2023-08-27T11:24:34.505779+0000","last_became_active":"2023-08-27T11:24:32.298396+0000","last_became_peered":"2023-08-27T11:24:32.298396+0000","last_unstale":"2023-08-27T11:24:34.505779+0000","last_undegraded":"2023-08-27T11:24:34.505779+0000","last_fullsized":"2023-08-27T11:24:34.505779+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:40.657736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506089+0000","last_change":"2023-08-27T11:24:32.900978+0000","last_active":"2023-08-27T11:24:34.506089+0000","last_peered":"2023-08-27T11:24:34.506089+0000","last_clean":"2023-08-27T11:24:34.506089+0000","last_became_active":"2023-08-27T11:24:32.900695+0000","last_became_peered":"2023-08-27T11:24:32.900695+0000","last_unstale":"2023-08-27T11:24:34.506089+0000","last_undegraded":"2023-08-27T11:24:34.506089+0000","last_fullsized":"2023-08-27T11:24:34.506089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:57.187870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891819+0000","last_change":"2023-08-27T11:24:32.287269+0000","last_active":"2023-08-27T11:24:33.891819+0000","last_peered":"2023-08-27T11:24:33.891819+0000","last_clean":"2023-08-27T11:24:33.891819+0000","last_became_active":"2023-08-27T11:24:32.286965+0000","last_became_peered":"2023-08-27T11:24:32.286965+0000","last_unstale":"2023-08-27T11:24:33.891819+0000","last_undegraded":"2023-08-27T11:24:33.891819+0000","last_fullsized":"2023-08-27T11:24:33.891819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:42:51.120317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505747+0000","last_change":"2023-08-27T11:24:32.913029+0000","last_active":"2023-08-27T11:24:34.505747+0000","last_peered":"2023-08-27T11:24:34.505747+0000","last_clean":"2023-08-27T11:24:34.505747+0000","last_became_active":"2023-08-27T11:24:32.912708+0000","last_became_peered":"2023-08-27T11:24:32.912708+0000","last_unstale":"2023-08-27T11:24:34.505747+0000","last_undegraded":"2023-08-27T11:24:34.505747+0000","last_fullsized":"2023-08-27T11:24:34.505747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:43.589504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":21,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505678+0000","last_change":"2023-08-27T11:24:32.278403+0000","last_active":"2023-08-27T11:24:34.505678+0000","last_peered":"2023-08-27T11:24:34.505678+0000","last_clean":"2023-08-27T11:24:34.505678+0000","last_became_active":"2023-08-27T11:24:32.278104+0000","last_became_peered":"2023-08-27T11:24:32.278104+0000","last_unstale":"2023-08-27T11:24:34.505678+0000","last_undegraded":"2023-08-27T11:24:34.505678+0000","last_fullsized":"2023-08-27T11:24:34.505678+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:45.980800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505470+0000","last_change":"2023-08-27T11:24:32.898773+0000","last_active":"2023-08-27T11:24:34.505470+0000","last_peered":"2023-08-27T11:24:34.505470+0000","last_clean":"2023-08-27T11:24:34.505470+0000","last_became_active":"2023-08-27T11:24:32.898512+0000","last_became_peered":"2023-08-27T11:24:32.898512+0000","last_unstale":"2023-08-27T11:24:34.505470+0000","last_undegraded":"2023-08-27T11:24:34.505470+0000","last_fullsized":"2023-08-27T11:24:34.505470+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:00:10.398047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505599+0000","last_change":"2023-08-27T11:24:32.297792+0000","last_active":"2023-08-27T11:24:34.505599+0000","last_peered":"2023-08-27T11:24:34.505599+0000","last_clean":"2023-08-27T11:24:34.505599+0000","last_became_active":"2023-08-27T11:24:32.297492+0000","last_became_peered":"2023-08-27T11:24:32.297492+0000","last_unstale":"2023-08-27T11:24:34.505599+0000","last_undegraded":"2023-08-27T11:24:34.505599+0000","last_fullsized":"2023-08-27T11:24:34.505599+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:37.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505054+0000","last_change":"2023-08-27T11:24:32.904851+0000","last_active":"2023-08-27T11:24:34.505054+0000","last_peered":"2023-08-27T11:24:34.505054+0000","last_clean":"2023-08-27T11:24:34.505054+0000","last_became_active":"2023-08-27T11:24:32.904617+0000","last_became_peered":"2023-08-27T11:24:32.904617+0000","last_unstale":"2023-08-27T11:24:34.505054+0000","last_undegraded":"2023-08-27T11:24:34.505054+0000","last_fullsized":"2023-08-27T11:24:34.505054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:41.034300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.881112+0000","last_change":"2023-08-27T11:24:32.287931+0000","last_active":"2023-08-27T11:24:33.881112+0000","last_peered":"2023-08-27T11:24:33.881112+0000","last_clean":"2023-08-27T11:24:33.881112+0000","last_became_active":"2023-08-27T11:24:32.287220+0000","last_became_peered":"2023-08-27T11:24:32.287220+0000","last_unstale":"2023-08-27T11:24:33.881112+0000","last_undegraded":"2023-08-27T11:24:33.881112+0000","last_fullsized":"2023-08-27T11:24:33.881112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:05.660265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890986+0000","last_change":"2023-08-27T11:24:32.912907+0000","last_active":"2023-08-27T11:24:33.890986+0000","last_peered":"2023-08-27T11:24:33.890986+0000","last_clean":"2023-08-27T11:24:33.890986+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:33.890986+0000","last_undegraded":"2023-08-27T11:24:33.890986+0000","last_fullsized":"2023-08-27T11:24:33.890986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:48:35.650642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505913+0000","last_change":"2023-08-27T11:24:32.291693+0000","last_active":"2023-08-27T11:24:34.505913+0000","last_peered":"2023-08-27T11:24:34.505913+0000","last_clean":"2023-08-27T11:24:34.505913+0000","last_became_active":"2023-08-27T11:24:32.291329+0000","last_became_peered":"2023-08-27T11:24:32.291329+0000","last_unstale":"2023-08-27T11:24:34.505913+0000","last_undegraded":"2023-08-27T11:24:34.505913+0000","last_fullsized":"2023-08-27T11:24:34.505913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:15.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505958+0000","last_change":"2023-08-27T11:24:32.896839+0000","last_active":"2023-08-27T11:24:34.505958+0000","last_peered":"2023-08-27T11:24:34.505958+0000","last_clean":"2023-08-27T11:24:34.505958+0000","last_became_active":"2023-08-27T11:24:32.896629+0000","last_became_peered":"2023-08-27T11:24:32.896629+0000","last_unstale":"2023-08-27T11:24:34.505958+0000","last_undegraded":"2023-08-27T11:24:34.505958+0000","last_fullsized":"2023-08-27T11:24:34.505958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:18.114498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505889+0000","last_change":"2023-08-27T11:24:32.283531+0000","last_active":"2023-08-27T11:24:34.505889+0000","last_peered":"2023-08-27T11:24:34.505889+0000","last_clean":"2023-08-27T11:24:34.505889+0000","last_became_active":"2023-08-27T11:24:32.283231+0000","last_became_peered":"2023-08-27T11:24:32.283231+0000","last_unstale":"2023-08-27T11:24:34.505889+0000","last_undegraded":"2023-08-27T11:24:34.505889+0000","last_fullsized":"2023-08-27T11:24:34.505889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:27.483472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506553+0000","last_change":"2023-08-27T11:24:32.909037+0000","last_active":"2023-08-27T11:24:34.506553+0000","last_peered":"2023-08-27T11:24:34.506553+0000","last_clean":"2023-08-27T11:24:34.506553+0000","last_became_active":"2023-08-27T11:24:32.908719+0000","last_became_peered":"2023-08-27T11:24:32.908719+0000","last_unstale":"2023-08-27T11:24:34.506553+0000","last_undegraded":"2023-08-27T11:24:34.506553+0000","last_fullsized":"2023-08-27T11:24:34.506553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506098+0000","last_change":"2023-08-27T11:24:32.291430+0000","last_active":"2023-08-27T11:24:34.506098+0000","last_peered":"2023-08-27T11:24:34.506098+0000","last_clean":"2023-08-27T11:24:34.506098+0000","last_became_active":"2023-08-27T11:24:32.291106+0000","last_became_peered":"2023-08-27T11:24:32.291106+0000","last_unstale":"2023-08-27T11:24:34.506098+0000","last_undegraded":"2023-08-27T11:24:34.506098+0000","last_fullsized":"2023-08-27T11:24:34.506098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:52:52.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505735+0000","last_change":"2023-08-27T11:24:32.903976+0000","last_active":"2023-08-27T11:24:34.505735+0000","last_peered":"2023-08-27T11:24:34.505735+0000","last_clean":"2023-08-27T11:24:34.505735+0000","last_became_active":"2023-08-27T11:24:32.903486+0000","last_became_peered":"2023-08-27T11:24:32.903486+0000","last_unstale":"2023-08-27T11:24:34.505735+0000","last_undegraded":"2023-08-27T11:24:34.505735+0000","last_fullsized":"2023-08-27T11:24:34.505735+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:10.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505438+0000","last_change":"2023-08-27T11:24:32.278431+0000","last_active":"2023-08-27T11:24:34.505438+0000","last_peered":"2023-08-27T11:24:34.505438+0000","last_clean":"2023-08-27T11:24:34.505438+0000","last_became_active":"2023-08-27T11:24:32.278149+0000","last_became_peered":"2023-08-27T11:24:32.278149+0000","last_unstale":"2023-08-27T11:24:34.505438+0000","last_undegraded":"2023-08-27T11:24:34.505438+0000","last_fullsized":"2023-08-27T11:24:34.505438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:27.405248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505575+0000","last_change":"2023-08-27T11:24:32.904659+0000","last_active":"2023-08-27T11:24:34.505575+0000","last_peered":"2023-08-27T11:24:34.505575+0000","last_clean":"2023-08-27T11:24:34.505575+0000","last_became_active":"2023-08-27T11:24:32.904365+0000","last_became_peered":"2023-08-27T11:24:32.904365+0000","last_unstale":"2023-08-27T11:24:34.505575+0000","last_undegraded":"2023-08-27T11:24:34.505575+0000","last_fullsized":"2023-08-27T11:24:34.505575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:50.837386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505120+0000","last_change":"2023-08-27T11:24:32.293744+0000","last_active":"2023-08-27T11:24:34.505120+0000","last_peered":"2023-08-27T11:24:34.505120+0000","last_clean":"2023-08-27T11:24:34.505120+0000","last_became_active":"2023-08-27T11:24:32.293488+0000","last_became_peered":"2023-08-27T11:24:32.293488+0000","last_unstale":"2023-08-27T11:24:34.505120+0000","last_undegraded":"2023-08-27T11:24:34.505120+0000","last_fullsized":"2023-08-27T11:24:34.505120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:55:15.992932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506527+0000","last_change":"2023-08-27T11:24:32.889628+0000","last_active":"2023-08-27T11:24:34.506527+0000","last_peered":"2023-08-27T11:24:34.506527+0000","last_clean":"2023-08-27T11:24:34.506527+0000","last_became_active":"2023-08-27T11:24:32.889347+0000","last_became_peered":"2023-08-27T11:24:32.889347+0000","last_unstale":"2023-08-27T11:24:34.506527+0000","last_undegraded":"2023-08-27T11:24:34.506527+0000","last_fullsized":"2023-08-27T11:24:34.506527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:23.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.880610+0000","last_change":"2023-08-27T11:24:32.285270+0000","last_active":"2023-08-27T11:24:33.880610+0000","last_peered":"2023-08-27T11:24:33.880610+0000","last_clean":"2023-08-27T11:24:33.880610+0000","last_became_active":"2023-08-27T11:24:32.284877+0000","last_became_peered":"2023-08-27T11:24:32.284877+0000","last_unstale":"2023-08-27T11:24:33.880610+0000","last_undegraded":"2023-08-27T11:24:33.880610+0000","last_fullsized":"2023-08-27T11:24:33.880610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:41:40.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505590+0000","last_change":"2023-08-27T11:24:32.905190+0000","last_active":"2023-08-27T11:24:34.505590+0000","last_peered":"2023-08-27T11:24:34.505590+0000","last_clean":"2023-08-27T11:24:34.505590+0000","last_became_active":"2023-08-27T11:24:32.904921+0000","last_became_peered":"2023-08-27T11:24:32.904921+0000","last_unstale":"2023-08-27T11:24:34.505590+0000","last_undegraded":"2023-08-27T11:24:34.505590+0000","last_fullsized":"2023-08-27T11:24:34.505590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:15:29.722229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506382+0000","last_change":"2023-08-27T11:24:32.278516+0000","last_active":"2023-08-27T11:24:34.506382+0000","last_peered":"2023-08-27T11:24:34.506382+0000","last_clean":"2023-08-27T11:24:34.506382+0000","last_became_active":"2023-08-27T11:24:32.278225+0000","last_became_peered":"2023-08-27T11:24:32.278225+0000","last_unstale":"2023-08-27T11:24:34.506382+0000","last_undegraded":"2023-08-27T11:24:34.506382+0000","last_fullsized":"2023-08-27T11:24:34.506382+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:27.354259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":69,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891882+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:24:33.891882+0000","last_peered":"2023-08-27T11:24:33.891882+0000","last_clean":"2023-08-27T11:24:33.891882+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:24:33.891882+0000","last_undegraded":"2023-08-27T11:24:33.891882+0000","last_fullsized":"2023-08-27T11:24:33.891882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:11:00.934629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506538+0000","last_change":"2023-08-27T11:24:32.906148+0000","last_active":"2023-08-27T11:24:34.506538+0000","last_peered":"2023-08-27T11:24:34.506538+0000","last_clean":"2023-08-27T11:24:34.506538+0000","last_became_active":"2023-08-27T11:24:32.905830+0000","last_became_peered":"2023-08-27T11:24:32.905830+0000","last_unstale":"2023-08-27T11:24:34.506538+0000","last_undegraded":"2023-08-27T11:24:34.506538+0000","last_fullsized":"2023-08-27T11:24:34.506538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:49.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505554+0000","last_change":"2023-08-27T11:24:32.288364+0000","last_active":"2023-08-27T11:24:34.505554+0000","last_peered":"2023-08-27T11:24:34.505554+0000","last_clean":"2023-08-27T11:24:34.505554+0000","last_became_active":"2023-08-27T11:24:32.287929+0000","last_became_peered":"2023-08-27T11:24:32.287929+0000","last_unstale":"2023-08-27T11:24:34.505554+0000","last_undegraded":"2023-08-27T11:24:34.505554+0000","last_fullsized":"2023-08-27T11:24:34.505554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:55.947045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506138+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:24:34.506138+0000","last_peered":"2023-08-27T11:24:34.506138+0000","last_clean":"2023-08-27T11:24:34.506138+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:24:34.506138+0000","last_undegraded":"2023-08-27T11:24:34.506138+0000","last_fullsized":"2023-08-27T11:24:34.506138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:22.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505764+0000","last_change":"2023-08-27T11:24:32.889337+0000","last_active":"2023-08-27T11:24:34.505764+0000","last_peered":"2023-08-27T11:24:34.505764+0000","last_clean":"2023-08-27T11:24:34.505764+0000","last_became_active":"2023-08-27T11:24:32.889050+0000","last_became_peered":"2023-08-27T11:24:32.889050+0000","last_unstale":"2023-08-27T11:24:34.505764+0000","last_undegraded":"2023-08-27T11:24:34.505764+0000","last_fullsized":"2023-08-27T11:24:34.505764+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:43.501300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892199+0000","last_change":"2023-08-27T11:24:32.292210+0000","last_active":"2023-08-27T11:24:33.892199+0000","last_peered":"2023-08-27T11:24:33.892199+0000","last_clean":"2023-08-27T11:24:33.892199+0000","last_became_active":"2023-08-27T11:24:32.291811+0000","last_became_peered":"2023-08-27T11:24:32.291811+0000","last_unstale":"2023-08-27T11:24:33.892199+0000","last_undegraded":"2023-08-27T11:24:33.892199+0000","last_fullsized":"2023-08-27T11:24:33.892199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:50.774611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506186+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:24:34.506186+0000","last_peered":"2023-08-27T11:24:34.506186+0000","last_clean":"2023-08-27T11:24:34.506186+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:24:34.506186+0000","last_undegraded":"2023-08-27T11:24:34.506186+0000","last_fullsized":"2023-08-27T11:24:34.506186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:34.390981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":213,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891061+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:24:33.891061+0000","last_peered":"2023-08-27T11:24:33.891061+0000","last_clean":"2023-08-27T11:24:33.891061+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:24:33.891061+0000","last_undegraded":"2023-08-27T11:24:33.891061+0000","last_fullsized":"2023-08-27T11:24:33.891061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:28:50.132393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505861+0000","last_change":"2023-08-27T11:24:32.910307+0000","last_active":"2023-08-27T11:24:34.505861+0000","last_peered":"2023-08-27T11:24:34.505861+0000","last_clean":"2023-08-27T11:24:34.505861+0000","last_became_active":"2023-08-27T11:24:32.909518+0000","last_became_peered":"2023-08-27T11:24:32.909518+0000","last_unstale":"2023-08-27T11:24:34.505861+0000","last_undegraded":"2023-08-27T11:24:34.505861+0000","last_fullsized":"2023-08-27T11:24:34.505861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:52:03.104861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505434+0000","last_change":"2023-08-27T11:24:32.298891+0000","last_active":"2023-08-27T11:24:34.505434+0000","last_peered":"2023-08-27T11:24:34.505434+0000","last_clean":"2023-08-27T11:24:34.505434+0000","last_became_active":"2023-08-27T11:24:32.298585+0000","last_became_peered":"2023-08-27T11:24:32.298585+0000","last_unstale":"2023-08-27T11:24:34.505434+0000","last_undegraded":"2023-08-27T11:24:34.505434+0000","last_fullsized":"2023-08-27T11:24:34.505434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:00.329812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":65,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891567+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:24:33.891567+0000","last_peered":"2023-08-27T11:24:33.891567+0000","last_clean":"2023-08-27T11:24:33.891567+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:24:33.891567+0000","last_undegraded":"2023-08-27T11:24:33.891567+0000","last_fullsized":"2023-08-27T11:24:33.891567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:45.560256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505428+0000","last_change":"2023-08-27T11:24:32.899689+0000","last_active":"2023-08-27T11:24:34.505428+0000","last_peered":"2023-08-27T11:24:34.505428+0000","last_clean":"2023-08-27T11:24:34.505428+0000","last_became_active":"2023-08-27T11:24:32.899314+0000","last_became_peered":"2023-08-27T11:24:32.899314+0000","last_unstale":"2023-08-27T11:24:34.505428+0000","last_undegraded":"2023-08-27T11:24:34.505428+0000","last_fullsized":"2023-08-27T11:24:34.505428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:23.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505420+0000","last_change":"2023-08-27T11:24:32.299417+0000","last_active":"2023-08-27T11:24:34.505420+0000","last_peered":"2023-08-27T11:24:34.505420+0000","last_clean":"2023-08-27T11:24:34.505420+0000","last_became_active":"2023-08-27T11:24:32.298960+0000","last_became_peered":"2023-08-27T11:24:32.298960+0000","last_unstale":"2023-08-27T11:24:34.505420+0000","last_undegraded":"2023-08-27T11:24:34.505420+0000","last_fullsized":"2023-08-27T11:24:34.505420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:34:02.280340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890882+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:24:33.890882+0000","last_peered":"2023-08-27T11:24:33.890882+0000","last_clean":"2023-08-27T11:24:33.890882+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:24:33.890882+0000","last_undegraded":"2023-08-27T11:24:33.890882+0000","last_fullsized":"2023-08-27T11:24:33.890882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:22.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506220+0000","last_change":"2023-08-27T11:24:32.898742+0000","last_active":"2023-08-27T11:24:34.506220+0000","last_peered":"2023-08-27T11:24:34.506220+0000","last_clean":"2023-08-27T11:24:34.506220+0000","last_became_active":"2023-08-27T11:24:32.898394+0000","last_became_peered":"2023-08-27T11:24:32.898394+0000","last_unstale":"2023-08-27T11:24:34.506220+0000","last_undegraded":"2023-08-27T11:24:34.506220+0000","last_fullsized":"2023-08-27T11:24:34.506220+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:54:42.463318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506262+0000","last_change":"2023-08-27T11:24:32.298551+0000","last_active":"2023-08-27T11:24:34.506262+0000","last_peered":"2023-08-27T11:24:34.506262+0000","last_clean":"2023-08-27T11:24:34.506262+0000","last_became_active":"2023-08-27T11:24:32.298256+0000","last_became_peered":"2023-08-27T11:24:32.298256+0000","last_unstale":"2023-08-27T11:24:34.506262+0000","last_undegraded":"2023-08-27T11:24:34.506262+0000","last_fullsized":"2023-08-27T11:24:34.506262+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:13:10.102752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":69,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506269+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:24:34.506269+0000","last_peered":"2023-08-27T11:24:34.506269+0000","last_clean":"2023-08-27T11:24:34.506269+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:24:34.506269+0000","last_undegraded":"2023-08-27T11:24:34.506269+0000","last_fullsized":"2023-08-27T11:24:34.506269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:43.833512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506506+0000","last_change":"2023-08-27T11:24:32.883742+0000","last_active":"2023-08-27T11:24:34.506506+0000","last_peered":"2023-08-27T11:24:34.506506+0000","last_clean":"2023-08-27T11:24:34.506506+0000","last_became_active":"2023-08-27T11:24:32.883361+0000","last_became_peered":"2023-08-27T11:24:32.883361+0000","last_unstale":"2023-08-27T11:24:34.506506+0000","last_undegraded":"2023-08-27T11:24:34.506506+0000","last_fullsized":"2023-08-27T11:24:34.506506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:41.915348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506478+0000","last_change":"2023-08-27T11:24:32.291308+0000","last_active":"2023-08-27T11:24:34.506478+0000","last_peered":"2023-08-27T11:24:34.506478+0000","last_clean":"2023-08-27T11:24:34.506478+0000","last_became_active":"2023-08-27T11:24:32.291005+0000","last_became_peered":"2023-08-27T11:24:32.291005+0000","last_unstale":"2023-08-27T11:24:34.506478+0000","last_undegraded":"2023-08-27T11:24:34.506478+0000","last_fullsized":"2023-08-27T11:24:34.506478+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:29.540246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505795+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:24:34.505795+0000","last_peered":"2023-08-27T11:24:34.505795+0000","last_clean":"2023-08-27T11:24:34.505795+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:24:34.505795+0000","last_undegraded":"2023-08-27T11:24:34.505795+0000","last_fullsized":"2023-08-27T11:24:34.505795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:02:26.398938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505198+0000","last_change":"2023-08-27T11:24:32.908654+0000","last_active":"2023-08-27T11:24:34.505198+0000","last_peered":"2023-08-27T11:24:34.505198+0000","last_clean":"2023-08-27T11:24:34.505198+0000","last_became_active":"2023-08-27T11:24:32.907172+0000","last_became_peered":"2023-08-27T11:24:32.907172+0000","last_unstale":"2023-08-27T11:24:34.505198+0000","last_undegraded":"2023-08-27T11:24:34.505198+0000","last_fullsized":"2023-08-27T11:24:34.505198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:02.851202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891061+0000","last_change":"2023-08-27T11:24:32.283734+0000","last_active":"2023-08-27T11:24:33.891061+0000","last_peered":"2023-08-27T11:24:33.891061+0000","last_clean":"2023-08-27T11:24:33.891061+0000","last_became_active":"2023-08-27T11:24:32.283396+0000","last_became_peered":"2023-08-27T11:24:32.283396+0000","last_unstale":"2023-08-27T11:24:33.891061+0000","last_undegraded":"2023-08-27T11:24:33.891061+0000","last_fullsized":"2023-08-27T11:24:33.891061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:57:11.719756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506353+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:24:34.506353+0000","last_peered":"2023-08-27T11:24:34.506353+0000","last_clean":"2023-08-27T11:24:34.506353+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:24:34.506353+0000","last_undegraded":"2023-08-27T11:24:34.506353+0000","last_fullsized":"2023-08-27T11:24:34.506353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:36:14.655397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":829930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.747}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":239104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5419999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.5920000000000005,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.66100000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":7.4850000000000003,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":829966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.443},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.625},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":238508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69899999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":241050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.504}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.25}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.81399999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.04},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92000000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":240086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.4249999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.443}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.502},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.5700000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.4699999999999998,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5,"5min":5,"15min":5},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":240020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.754}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.78300000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.90900000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":238452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82099999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.872}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:24:37.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:24:37.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.995+0000 7f16d87ff700 1 Processor -- start 2023-08-27T11:24:37.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.995+0000 7f16d87ff700 1 -- start start 2023-08-27T11:24:37.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.996+0000 7f16d87ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 0x7f16d00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:37.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.996+0000 7f16d87ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d006c4e0 con 0x7f16d006ad70 2023-08-27T11:24:37.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.996+0000 7f16d87ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d0155370 con 0x7f16d0151a90 2023-08-27T11:24:37.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.996+0000 7f16d87ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d00c82c0 con 0x7f16d00c4630 2023-08-27T11:24:37.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d6d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f16d006ad70 0x7f16d006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:55254/0 (socket says 172.21.15.43:55254) 2023-08-27T11:24:37.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d6d9c700 1 -- 172.21.15.43:0/368938150 learned_addr learned my addr 172.21.15.43:0/368938150 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:37.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5d9a700 1 --2- 172.21.15.43:0/368938150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 0x7f16d00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846568763 0 0) 0x7f16d006c4e0 con 0x7f16d006ad70 2023-08-27T11:24:38.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc0035b0 con 0x7f16d006ad70 2023-08-27T11:24:38.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032065612 0 0) 0x7f16d0155370 con 0x7f16d0151a90 2023-08-27T11:24:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d006c4e0 con 0x7f16d0151a90 2023-08-27T11:24:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5d9a700 1 -- 172.21.15.43:0/368938150 >> v1:172.21.15.57:6789/0 conn(0x7f16d0151a90 legacy=0x7f16d00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5d9a700 1 -- 172.21.15.43:0/368938150 >> v1:172.21.15.43:6789/0 conn(0x7f16d006ad70 legacy=0x7f16d006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.997+0000 7f16d5d9a700 1 -- 172.21.15.43:0/368938150 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0151e70 con 0x7f16d00c4630 2023-08-27T11:24:38.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.998+0000 7f16d5d9a700 1 --2- 172.21.15.43:0/368938150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 0x7f16d00c4a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009870 tx=0x7f16c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=148bdecd0371a4fc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.998+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0011830 con 0x7f16d00c4630 2023-08-27T11:24:38.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.998+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c0011990 con 0x7f16d00c4630 2023-08-27T11:24:38.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.998+0000 7f16d5599700 1 -- 172.21.15.43:0/368938150 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0011d20 con 0x7f16d00c4630 2023-08-27T11:24:38.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 -- 172.21.15.43:0/368938150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 msgr2=0x7f16d00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 --2- 172.21.15.43:0/368938150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 0x7f16d00c4a90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009870 tx=0x7f16c0009b80 comp rx=0 tx=0).stop 2023-08-27T11:24:38.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 -- 172.21.15.43:0/368938150 shutdown_connections 2023-08-27T11:24:38.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 --2- 172.21.15.43:0/368938150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d00c4630 0x7f16d00c4a90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 -- 172.21.15.43:0/368938150 >> 172.21.15.43:0/368938150 conn(0x7f16d00ab820 msgr2=0x7f16d00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:38.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 -- 172.21.15.43:0/368938150 shutdown_connections 2023-08-27T11:24:38.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:37.999+0000 7f16d87ff700 1 -- 172.21.15.43:0/368938150 wait complete. 2023-08-27T11:24:38.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.001+0000 7f16d87ff700 1 Processor -- start 2023-08-27T11:24:38.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.001+0000 7f16d87ff700 1 -- start start 2023-08-27T11:24:38.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d006ad70 0x7f16d014a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16d0151a90 0x7f16d00a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01542a0 con 0x7f16d00c4630 2023-08-27T11:24:38.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d01ed780 con 0x7f16d0151a90 2023-08-27T11:24:38.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d87ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d0153fc0 con 0x7f16d006ad70 2023-08-27T11:24:38.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57314/0 (socket says 172.21.15.43:57314) 2023-08-27T11:24:38.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d659b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d006ad70 0x7f16d014a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 -- 172.21.15.43:0/2506451787 learned_addr learned my addr 172.21.15.43:0/2506451787 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d6d9c700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16d0151a90 0x7f16d00a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 -- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d006ad70 msgr2=0x7f16d014a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d006ad70 0x7f16d014a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 -- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16d0151a90 msgr2=0x7f16d00a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16d0151a90 0x7f16d00a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.002+0000 7f16d5d9a700 1 -- 172.21.15.43:0/2506451787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00094a0 con 0x7f16d00c4630 2023-08-27T11:24:38.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16d5d9a700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f16c00097c0 tx=0x7f16c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c001a8f0 con 0x7f16d00c4630 2023-08-27T11:24:38.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c001aa50 con 0x7f16d00c4630 2023-08-27T11:24:38.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d01ed130 con 0x7f16d00c4630 2023-08-27T11:24:38.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c001adc0 con 0x7f16d00c4630 2023-08-27T11:24:38.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.003+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d014de50 con 0x7f16d00c4630 2023-08-27T11:24:38.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.004+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d004ee70 con 0x7f16d00c4630 2023-08-27T11:24:38.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.005+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f16c00243f0 con 0x7f16d00c4630 2023-08-27T11:24:38.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.006+0000 7f16c6ffd700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 0x7f16b406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.006+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f16c0089800 con 0x7f16d00c4630 2023-08-27T11:24:38.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.006+0000 7f16d659b700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 0x7f16b406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.007+0000 7f16d659b700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 0x7f16b406c5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0011e0 tx=0x7f16cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.011+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f16c0055000 con 0x7f16d00c4630 2023-08-27T11:24:38.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.215+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16d0154760 con 0x7f16b406a110 2023-08-27T11:24:38.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.226+0000 7f16c6ffd700 1 -- 172.21.15.43:0/2506451787 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311650 (secure 0 0 0) 0x7f16cc001550 con 0x7f16b406a110 2023-08-27T11:24:38.232 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:38.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 msgr2=0x7f16b406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 0x7f16b406c5d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0011e0 tx=0x7f16cc009040 comp rx=0 tx=0).stop 2023-08-27T11:24:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 msgr2=0x7f16d014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f16c00097c0 tx=0x7f16c0004750 comp rx=0 tx=0).stop 2023-08-27T11:24:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 shutdown_connections 2023-08-27T11:24:38.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f16b406a110 0x7f16b406c5d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16d0151a90 0x7f16d00a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16d006ad70 0x7f16d014a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 --2- 172.21.15.43:0/2506451787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f16d00c4630 0x7f16d014d910 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 >> 172.21.15.43:0/2506451787 conn(0x7f16d00ab820 msgr2=0x7f16d00c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:38.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 shutdown_connections 2023-08-27T11:24:38.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.231+0000 7f16d87ff700 1 -- 172.21.15.43:0/2506451787 wait complete. 2023-08-27T11:24:38.237 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:24:38.249 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:24:38.248+0000 7f26d4df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:24:38.251 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-08-27T11:24:36.335638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221704,"kb_used_data":5528,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753016,"statfs":{"total":773094113280,"available":772867088384,"internally_reserved":0,"allocated":5660672,"data_stored":3097116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.073503"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506555+0000","last_change":"2023-08-27T11:24:32.898902+0000","last_active":"2023-08-27T11:24:34.506555+0000","last_peered":"2023-08-27T11:24:34.506555+0000","last_clean":"2023-08-27T11:24:34.506555+0000","last_became_active":"2023-08-27T11:24:32.898635+0000","last_became_peered":"2023-08-27T11:24:32.898635+0000","last_unstale":"2023-08-27T11:24:34.506555+0000","last_undegraded":"2023-08-27T11:24:34.506555+0000","last_fullsized":"2023-08-27T11:24:34.506555+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:46.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891090+0000","last_change":"2023-08-27T11:24:32.905490+0000","last_active":"2023-08-27T11:24:33.891090+0000","last_peered":"2023-08-27T11:24:33.891090+0000","last_clean":"2023-08-27T11:24:33.891090+0000","last_became_active":"2023-08-27T11:24:32.904866+0000","last_became_peered":"2023-08-27T11:24:32.904866+0000","last_unstale":"2023-08-27T11:24:33.891090+0000","last_undegraded":"2023-08-27T11:24:33.891090+0000","last_fullsized":"2023-08-27T11:24:33.891090+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:11.031610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505613+0000","last_change":"2023-08-27T11:24:32.912255+0000","last_active":"2023-08-27T11:24:34.505613+0000","last_peered":"2023-08-27T11:24:34.505613+0000","last_clean":"2023-08-27T11:24:34.505613+0000","last_became_active":"2023-08-27T11:24:32.909842+0000","last_became_peered":"2023-08-27T11:24:32.909842+0000","last_unstale":"2023-08-27T11:24:34.505613+0000","last_undegraded":"2023-08-27T11:24:34.505613+0000","last_fullsized":"2023-08-27T11:24:34.505613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:54:42.463318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891287+0000","last_change":"2023-08-27T11:24:32.904922+0000","last_active":"2023-08-27T11:24:33.891287+0000","last_peered":"2023-08-27T11:24:33.891287+0000","last_clean":"2023-08-27T11:24:33.891287+0000","last_became_active":"2023-08-27T11:24:32.904570+0000","last_became_peered":"2023-08-27T11:24:32.904570+0000","last_unstale":"2023-08-27T11:24:33.891287+0000","last_undegraded":"2023-08-27T11:24:33.891287+0000","last_fullsized":"2023-08-27T11:24:33.891287+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:28.359866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891469+0000","last_change":"2023-08-27T11:24:32.908868+0000","last_active":"2023-08-27T11:24:33.891469+0000","last_peered":"2023-08-27T11:24:33.891469+0000","last_clean":"2023-08-27T11:24:33.891469+0000","last_became_active":"2023-08-27T11:24:32.908413+0000","last_became_peered":"2023-08-27T11:24:32.908413+0000","last_unstale":"2023-08-27T11:24:33.891469+0000","last_undegraded":"2023-08-27T11:24:33.891469+0000","last_fullsized":"2023-08-27T11:24:33.891469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:12.553037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505676+0000","last_change":"2023-08-27T11:24:32.900880+0000","last_active":"2023-08-27T11:24:34.505676+0000","last_peered":"2023-08-27T11:24:34.505676+0000","last_clean":"2023-08-27T11:24:34.505676+0000","last_became_active":"2023-08-27T11:24:32.900515+0000","last_became_peered":"2023-08-27T11:24:32.900515+0000","last_unstale":"2023-08-27T11:24:34.505676+0000","last_undegraded":"2023-08-27T11:24:34.505676+0000","last_fullsized":"2023-08-27T11:24:34.505676+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:41.755468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.504984+0000","last_change":"2023-08-27T11:24:32.907204+0000","last_active":"2023-08-27T11:24:34.504984+0000","last_peered":"2023-08-27T11:24:34.504984+0000","last_clean":"2023-08-27T11:24:34.504984+0000","last_became_active":"2023-08-27T11:24:32.906510+0000","last_became_peered":"2023-08-27T11:24:32.906510+0000","last_unstale":"2023-08-27T11:24:34.504984+0000","last_undegraded":"2023-08-27T11:24:34.504984+0000","last_fullsized":"2023-08-27T11:24:34.504984+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:22:54.267729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505335+0000","last_change":"2023-08-27T11:24:32.906146+0000","last_active":"2023-08-27T11:24:34.505335+0000","last_peered":"2023-08-27T11:24:34.505335+0000","last_clean":"2023-08-27T11:24:34.505335+0000","last_became_active":"2023-08-27T11:24:32.905867+0000","last_became_peered":"2023-08-27T11:24:32.905867+0000","last_unstale":"2023-08-27T11:24:34.505335+0000","last_undegraded":"2023-08-27T11:24:34.505335+0000","last_fullsized":"2023-08-27T11:24:34.505335+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:27.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506388+0000","last_change":"2023-08-27T11:24:32.910119+0000","last_active":"2023-08-27T11:24:34.506388+0000","last_peered":"2023-08-27T11:24:34.506388+0000","last_clean":"2023-08-27T11:24:34.506388+0000","last_became_active":"2023-08-27T11:24:32.909855+0000","last_became_peered":"2023-08-27T11:24:32.909855+0000","last_unstale":"2023-08-27T11:24:34.506388+0000","last_undegraded":"2023-08-27T11:24:34.506388+0000","last_fullsized":"2023-08-27T11:24:34.506388+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:04.494505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506320+0000","last_change":"2023-08-27T11:24:32.901649+0000","last_active":"2023-08-27T11:24:34.506320+0000","last_peered":"2023-08-27T11:24:34.506320+0000","last_clean":"2023-08-27T11:24:34.506320+0000","last_became_active":"2023-08-27T11:24:32.901366+0000","last_became_peered":"2023-08-27T11:24:32.901366+0000","last_unstale":"2023-08-27T11:24:34.506320+0000","last_undegraded":"2023-08-27T11:24:34.506320+0000","last_fullsized":"2023-08-27T11:24:34.506320+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:58.698136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.881065+0000","last_change":"2023-08-27T11:24:32.900281+0000","last_active":"2023-08-27T11:24:33.881065+0000","last_peered":"2023-08-27T11:24:33.881065+0000","last_clean":"2023-08-27T11:24:33.881065+0000","last_became_active":"2023-08-27T11:24:32.900032+0000","last_became_peered":"2023-08-27T11:24:32.900032+0000","last_unstale":"2023-08-27T11:24:33.881065+0000","last_undegraded":"2023-08-27T11:24:33.881065+0000","last_fullsized":"2023-08-27T11:24:33.881065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:30.875988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506329+0000","last_change":"2023-08-27T11:24:32.895742+0000","last_active":"2023-08-27T11:24:34.506329+0000","last_peered":"2023-08-27T11:24:34.506329+0000","last_clean":"2023-08-27T11:24:34.506329+0000","last_became_active":"2023-08-27T11:24:32.894897+0000","last_became_peered":"2023-08-27T11:24:32.894897+0000","last_unstale":"2023-08-27T11:24:34.506329+0000","last_undegraded":"2023-08-27T11:24:34.506329+0000","last_fullsized":"2023-08-27T11:24:34.506329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:17.470090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506586+0000","last_change":"2023-08-27T11:24:32.909896+0000","last_active":"2023-08-27T11:24:34.506586+0000","last_peered":"2023-08-27T11:24:34.506586+0000","last_clean":"2023-08-27T11:24:34.506586+0000","last_became_active":"2023-08-27T11:24:32.909605+0000","last_became_peered":"2023-08-27T11:24:32.909605+0000","last_unstale":"2023-08-27T11:24:34.506586+0000","last_undegraded":"2023-08-27T11:24:34.506586+0000","last_fullsized":"2023-08-27T11:24:34.506586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:34.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505013+0000","last_change":"2023-08-27T11:24:32.907370+0000","last_active":"2023-08-27T11:24:34.505013+0000","last_peered":"2023-08-27T11:24:34.505013+0000","last_clean":"2023-08-27T11:24:34.505013+0000","last_became_active":"2023-08-27T11:24:32.907051+0000","last_became_peered":"2023-08-27T11:24:32.907051+0000","last_unstale":"2023-08-27T11:24:34.505013+0000","last_undegraded":"2023-08-27T11:24:34.505013+0000","last_fullsized":"2023-08-27T11:24:34.505013+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:49:44.213237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891665+0000","last_change":"2023-08-27T11:24:32.900338+0000","last_active":"2023-08-27T11:24:33.891665+0000","last_peered":"2023-08-27T11:24:33.891665+0000","last_clean":"2023-08-27T11:24:33.891665+0000","last_became_active":"2023-08-27T11:24:32.900045+0000","last_became_peered":"2023-08-27T11:24:32.900045+0000","last_unstale":"2023-08-27T11:24:33.891665+0000","last_undegraded":"2023-08-27T11:24:33.891665+0000","last_fullsized":"2023-08-27T11:24:33.891665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:58:09.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505363+0000","last_change":"2023-08-27T11:24:32.902464+0000","last_active":"2023-08-27T11:24:34.505363+0000","last_peered":"2023-08-27T11:24:34.505363+0000","last_clean":"2023-08-27T11:24:34.505363+0000","last_became_active":"2023-08-27T11:24:32.902171+0000","last_became_peered":"2023-08-27T11:24:32.902171+0000","last_unstale":"2023-08-27T11:24:34.505363+0000","last_undegraded":"2023-08-27T11:24:34.505363+0000","last_fullsized":"2023-08-27T11:24:34.505363+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:01:40.096144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506025+0000","last_change":"2023-08-27T11:24:32.913021+0000","last_active":"2023-08-27T11:24:34.506025+0000","last_peered":"2023-08-27T11:24:34.506025+0000","last_clean":"2023-08-27T11:24:34.506025+0000","last_became_active":"2023-08-27T11:24:32.912510+0000","last_became_peered":"2023-08-27T11:24:32.912510+0000","last_unstale":"2023-08-27T11:24:34.506025+0000","last_undegraded":"2023-08-27T11:24:34.506025+0000","last_fullsized":"2023-08-27T11:24:34.506025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:49.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891250+0000","last_change":"2023-08-27T11:24:32.905710+0000","last_active":"2023-08-27T11:24:33.891250+0000","last_peered":"2023-08-27T11:24:33.891250+0000","last_clean":"2023-08-27T11:24:33.891250+0000","last_became_active":"2023-08-27T11:24:32.905225+0000","last_became_peered":"2023-08-27T11:24:32.905225+0000","last_unstale":"2023-08-27T11:24:33.891250+0000","last_undegraded":"2023-08-27T11:24:33.891250+0000","last_fullsized":"2023-08-27T11:24:33.891250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:17.470090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505847+0000","last_change":"2023-08-27T11:24:32.912893+0000","last_active":"2023-08-27T11:24:34.505847+0000","last_peered":"2023-08-27T11:24:34.505847+0000","last_clean":"2023-08-27T11:24:34.505847+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:34.505847+0000","last_undegraded":"2023-08-27T11:24:34.505847+0000","last_fullsized":"2023-08-27T11:24:34.505847+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:20.558108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505577+0000","last_change":"2023-08-27T11:24:32.903525+0000","last_active":"2023-08-27T11:24:34.505577+0000","last_peered":"2023-08-27T11:24:34.505577+0000","last_clean":"2023-08-27T11:24:34.505577+0000","last_became_active":"2023-08-27T11:24:32.903193+0000","last_became_peered":"2023-08-27T11:24:32.903193+0000","last_unstale":"2023-08-27T11:24:34.505577+0000","last_undegraded":"2023-08-27T11:24:34.505577+0000","last_fullsized":"2023-08-27T11:24:34.505577+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:46.129110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505826+0000","last_change":"2023-08-27T11:24:32.900837+0000","last_active":"2023-08-27T11:24:34.505826+0000","last_peered":"2023-08-27T11:24:34.505826+0000","last_clean":"2023-08-27T11:24:34.505826+0000","last_became_active":"2023-08-27T11:24:32.900383+0000","last_became_peered":"2023-08-27T11:24:32.900383+0000","last_unstale":"2023-08-27T11:24:34.505826+0000","last_undegraded":"2023-08-27T11:24:34.505826+0000","last_fullsized":"2023-08-27T11:24:34.505826+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:41:02.975943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505311+0000","last_change":"2023-08-27T11:24:32.906541+0000","last_active":"2023-08-27T11:24:34.505311+0000","last_peered":"2023-08-27T11:24:34.505311+0000","last_clean":"2023-08-27T11:24:34.505311+0000","last_became_active":"2023-08-27T11:24:32.906237+0000","last_became_peered":"2023-08-27T11:24:32.906237+0000","last_unstale":"2023-08-27T11:24:34.505311+0000","last_undegraded":"2023-08-27T11:24:34.505311+0000","last_fullsized":"2023-08-27T11:24:34.505311+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:39.373915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.880665+0000","last_change":"2023-08-27T11:24:32.902996+0000","last_active":"2023-08-27T11:24:33.880665+0000","last_peered":"2023-08-27T11:24:33.880665+0000","last_clean":"2023-08-27T11:24:33.880665+0000","last_became_active":"2023-08-27T11:24:32.902692+0000","last_became_peered":"2023-08-27T11:24:32.902692+0000","last_unstale":"2023-08-27T11:24:33.880665+0000","last_undegraded":"2023-08-27T11:24:33.880665+0000","last_fullsized":"2023-08-27T11:24:33.880665+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:16.997303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505991+0000","last_change":"2023-08-27T11:24:32.905733+0000","last_active":"2023-08-27T11:24:34.505991+0000","last_peered":"2023-08-27T11:24:34.505991+0000","last_clean":"2023-08-27T11:24:34.505991+0000","last_became_active":"2023-08-27T11:24:32.905472+0000","last_became_peered":"2023-08-27T11:24:32.905472+0000","last_unstale":"2023-08-27T11:24:34.505991+0000","last_undegraded":"2023-08-27T11:24:34.505991+0000","last_fullsized":"2023-08-27T11:24:34.505991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:09.164249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505882+0000","last_change":"2023-08-27T11:24:32.911479+0000","last_active":"2023-08-27T11:24:34.505882+0000","last_peered":"2023-08-27T11:24:34.505882+0000","last_clean":"2023-08-27T11:24:34.505882+0000","last_became_active":"2023-08-27T11:24:32.909452+0000","last_became_peered":"2023-08-27T11:24:32.909452+0000","last_unstale":"2023-08-27T11:24:34.505882+0000","last_undegraded":"2023-08-27T11:24:34.505882+0000","last_fullsized":"2023-08-27T11:24:34.505882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:30.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506462+0000","last_change":"2023-08-27T11:24:32.883832+0000","last_active":"2023-08-27T11:24:34.506462+0000","last_peered":"2023-08-27T11:24:34.506462+0000","last_clean":"2023-08-27T11:24:34.506462+0000","last_became_active":"2023-08-27T11:24:32.883350+0000","last_became_peered":"2023-08-27T11:24:32.883350+0000","last_unstale":"2023-08-27T11:24:34.506462+0000","last_undegraded":"2023-08-27T11:24:34.506462+0000","last_fullsized":"2023-08-27T11:24:34.506462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:06.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506163+0000","last_change":"2023-08-27T11:24:32.909695+0000","last_active":"2023-08-27T11:24:34.506163+0000","last_peered":"2023-08-27T11:24:34.506163+0000","last_clean":"2023-08-27T11:24:34.506163+0000","last_became_active":"2023-08-27T11:24:32.909365+0000","last_became_peered":"2023-08-27T11:24:32.909365+0000","last_unstale":"2023-08-27T11:24:34.506163+0000","last_undegraded":"2023-08-27T11:24:34.506163+0000","last_fullsized":"2023-08-27T11:24:34.506163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:21.268122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506064+0000","last_change":"2023-08-27T11:24:32.893599+0000","last_active":"2023-08-27T11:24:34.506064+0000","last_peered":"2023-08-27T11:24:34.506064+0000","last_clean":"2023-08-27T11:24:34.506064+0000","last_became_active":"2023-08-27T11:24:32.893201+0000","last_became_peered":"2023-08-27T11:24:32.893201+0000","last_unstale":"2023-08-27T11:24:34.506064+0000","last_undegraded":"2023-08-27T11:24:34.506064+0000","last_fullsized":"2023-08-27T11:24:34.506064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:28.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505104+0000","last_change":"2023-08-27T11:24:32.905940+0000","last_active":"2023-08-27T11:24:34.505104+0000","last_peered":"2023-08-27T11:24:34.505104+0000","last_clean":"2023-08-27T11:24:34.505104+0000","last_became_active":"2023-08-27T11:24:32.904461+0000","last_became_peered":"2023-08-27T11:24:32.904461+0000","last_unstale":"2023-08-27T11:24:34.505104+0000","last_undegraded":"2023-08-27T11:24:34.505104+0000","last_fullsized":"2023-08-27T11:24:34.505104+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:03.040174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891643+0000","last_change":"2023-08-27T11:24:32.900476+0000","last_active":"2023-08-27T11:24:33.891643+0000","last_peered":"2023-08-27T11:24:33.891643+0000","last_clean":"2023-08-27T11:24:33.891643+0000","last_became_active":"2023-08-27T11:24:32.900121+0000","last_became_peered":"2023-08-27T11:24:32.900121+0000","last_unstale":"2023-08-27T11:24:33.891643+0000","last_undegraded":"2023-08-27T11:24:33.891643+0000","last_fullsized":"2023-08-27T11:24:33.891643+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:07.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.504837+0000","last_change":"2023-08-27T11:24:32.907054+0000","last_active":"2023-08-27T11:24:34.504837+0000","last_peered":"2023-08-27T11:24:34.504837+0000","last_clean":"2023-08-27T11:24:34.504837+0000","last_became_active":"2023-08-27T11:24:32.906207+0000","last_became_peered":"2023-08-27T11:24:32.906207+0000","last_unstale":"2023-08-27T11:24:34.504837+0000","last_undegraded":"2023-08-27T11:24:34.504837+0000","last_fullsized":"2023-08-27T11:24:34.504837+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:30.584079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506034+0000","last_change":"2023-08-27T11:24:32.900379+0000","last_active":"2023-08-27T11:24:34.506034+0000","last_peered":"2023-08-27T11:24:34.506034+0000","last_clean":"2023-08-27T11:24:34.506034+0000","last_became_active":"2023-08-27T11:24:32.899692+0000","last_became_peered":"2023-08-27T11:24:32.899692+0000","last_unstale":"2023-08-27T11:24:34.506034+0000","last_undegraded":"2023-08-27T11:24:34.506034+0000","last_fullsized":"2023-08-27T11:24:34.506034+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:15:29.722229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890707+0000","last_change":"2023-08-27T11:24:32.898642+0000","last_active":"2023-08-27T11:24:33.890707+0000","last_peered":"2023-08-27T11:24:33.890707+0000","last_clean":"2023-08-27T11:24:33.890707+0000","last_became_active":"2023-08-27T11:24:32.898270+0000","last_became_peered":"2023-08-27T11:24:32.898270+0000","last_unstale":"2023-08-27T11:24:33.890707+0000","last_undegraded":"2023-08-27T11:24:33.890707+0000","last_fullsized":"2023-08-27T11:24:33.890707+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:57.187870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":17,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506313+0000","last_change":"2023-08-27T11:24:32.282881+0000","last_active":"2023-08-27T11:24:34.506313+0000","last_peered":"2023-08-27T11:24:34.506313+0000","last_clean":"2023-08-27T11:24:34.506313+0000","last_became_active":"2023-08-27T11:24:32.282586+0000","last_became_peered":"2023-08-27T11:24:32.282586+0000","last_unstale":"2023-08-27T11:24:34.506313+0000","last_undegraded":"2023-08-27T11:24:34.506313+0000","last_fullsized":"2023-08-27T11:24:34.506313+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:22:18.212577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506238+0000","last_change":"2023-08-27T11:24:32.907402+0000","last_active":"2023-08-27T11:24:34.506238+0000","last_peered":"2023-08-27T11:24:34.506238+0000","last_clean":"2023-08-27T11:24:34.506238+0000","last_became_active":"2023-08-27T11:24:32.907043+0000","last_became_peered":"2023-08-27T11:24:32.907043+0000","last_unstale":"2023-08-27T11:24:34.506238+0000","last_undegraded":"2023-08-27T11:24:34.506238+0000","last_fullsized":"2023-08-27T11:24:34.506238+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:43.589504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506454+0000","last_change":"2023-08-27T11:24:32.294572+0000","last_active":"2023-08-27T11:24:34.506454+0000","last_peered":"2023-08-27T11:24:34.506454+0000","last_clean":"2023-08-27T11:24:34.506454+0000","last_became_active":"2023-08-27T11:24:32.294253+0000","last_became_peered":"2023-08-27T11:24:32.294253+0000","last_unstale":"2023-08-27T11:24:34.506454+0000","last_undegraded":"2023-08-27T11:24:34.506454+0000","last_fullsized":"2023-08-27T11:24:34.506454+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:08.334851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505588+0000","last_change":"2023-08-27T11:24:32.902261+0000","last_active":"2023-08-27T11:24:34.505588+0000","last_peered":"2023-08-27T11:24:34.505588+0000","last_clean":"2023-08-27T11:24:34.505588+0000","last_became_active":"2023-08-27T11:24:32.901957+0000","last_became_peered":"2023-08-27T11:24:32.901957+0000","last_unstale":"2023-08-27T11:24:34.505588+0000","last_undegraded":"2023-08-27T11:24:34.505588+0000","last_fullsized":"2023-08-27T11:24:34.505588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:34.036395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506234+0000","last_change":"2023-08-27T11:24:32.289666+0000","last_active":"2023-08-27T11:24:34.506234+0000","last_peered":"2023-08-27T11:24:34.506234+0000","last_clean":"2023-08-27T11:24:34.506234+0000","last_became_active":"2023-08-27T11:24:32.289236+0000","last_became_peered":"2023-08-27T11:24:32.289236+0000","last_unstale":"2023-08-27T11:24:34.506234+0000","last_undegraded":"2023-08-27T11:24:34.506234+0000","last_fullsized":"2023-08-27T11:24:34.506234+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:45:07.542684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505726+0000","last_change":"2023-08-27T11:24:32.883656+0000","last_active":"2023-08-27T11:24:34.505726+0000","last_peered":"2023-08-27T11:24:34.505726+0000","last_clean":"2023-08-27T11:24:34.505726+0000","last_became_active":"2023-08-27T11:24:32.883338+0000","last_became_peered":"2023-08-27T11:24:32.883338+0000","last_unstale":"2023-08-27T11:24:34.505726+0000","last_undegraded":"2023-08-27T11:24:34.505726+0000","last_fullsized":"2023-08-27T11:24:34.505726+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:07.858421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506640+0000","last_change":"2023-08-27T11:24:32.294367+0000","last_active":"2023-08-27T11:24:34.506640+0000","last_peered":"2023-08-27T11:24:34.506640+0000","last_clean":"2023-08-27T11:24:34.506640+0000","last_became_active":"2023-08-27T11:24:32.294063+0000","last_became_peered":"2023-08-27T11:24:32.294063+0000","last_unstale":"2023-08-27T11:24:34.506640+0000","last_undegraded":"2023-08-27T11:24:34.506640+0000","last_fullsized":"2023-08-27T11:24:34.506640+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:20.032441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891996+0000","last_change":"2023-08-27T11:24:32.910605+0000","last_active":"2023-08-27T11:24:33.891996+0000","last_peered":"2023-08-27T11:24:33.891996+0000","last_clean":"2023-08-27T11:24:33.891996+0000","last_became_active":"2023-08-27T11:24:32.910330+0000","last_became_peered":"2023-08-27T11:24:32.910330+0000","last_unstale":"2023-08-27T11:24:33.891996+0000","last_undegraded":"2023-08-27T11:24:33.891996+0000","last_fullsized":"2023-08-27T11:24:33.891996+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:41:46.121761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506224+0000","last_change":"2023-08-27T11:24:32.298886+0000","last_active":"2023-08-27T11:24:34.506224+0000","last_peered":"2023-08-27T11:24:34.506224+0000","last_clean":"2023-08-27T11:24:34.506224+0000","last_became_active":"2023-08-27T11:24:32.298269+0000","last_became_peered":"2023-08-27T11:24:32.298269+0000","last_unstale":"2023-08-27T11:24:34.506224+0000","last_undegraded":"2023-08-27T11:24:34.506224+0000","last_fullsized":"2023-08-27T11:24:34.506224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:50.266609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892256+0000","last_change":"2023-08-27T11:24:32.904723+0000","last_active":"2023-08-27T11:24:33.892256+0000","last_peered":"2023-08-27T11:24:33.892256+0000","last_clean":"2023-08-27T11:24:33.892256+0000","last_became_active":"2023-08-27T11:24:32.904416+0000","last_became_peered":"2023-08-27T11:24:32.904416+0000","last_unstale":"2023-08-27T11:24:33.892256+0000","last_undegraded":"2023-08-27T11:24:33.892256+0000","last_fullsized":"2023-08-27T11:24:33.892256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:47:24.435986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891138+0000","last_change":"2023-08-27T11:24:32.282892+0000","last_active":"2023-08-27T11:24:33.891138+0000","last_peered":"2023-08-27T11:24:33.891138+0000","last_clean":"2023-08-27T11:24:33.891138+0000","last_became_active":"2023-08-27T11:24:32.282592+0000","last_became_peered":"2023-08-27T11:24:32.282592+0000","last_unstale":"2023-08-27T11:24:33.891138+0000","last_undegraded":"2023-08-27T11:24:33.891138+0000","last_fullsized":"2023-08-27T11:24:33.891138+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:27:25.572183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506230+0000","last_change":"2023-08-27T11:24:32.884415+0000","last_active":"2023-08-27T11:24:34.506230+0000","last_peered":"2023-08-27T11:24:34.506230+0000","last_clean":"2023-08-27T11:24:34.506230+0000","last_became_active":"2023-08-27T11:24:32.884135+0000","last_became_peered":"2023-08-27T11:24:32.884135+0000","last_unstale":"2023-08-27T11:24:34.506230+0000","last_undegraded":"2023-08-27T11:24:34.506230+0000","last_fullsized":"2023-08-27T11:24:34.506230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:45.484143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506045+0000","last_change":"2023-08-27T11:24:32.290256+0000","last_active":"2023-08-27T11:24:34.506045+0000","last_peered":"2023-08-27T11:24:34.506045+0000","last_clean":"2023-08-27T11:24:34.506045+0000","last_became_active":"2023-08-27T11:24:32.289480+0000","last_became_peered":"2023-08-27T11:24:32.289480+0000","last_unstale":"2023-08-27T11:24:34.506045+0000","last_undegraded":"2023-08-27T11:24:34.506045+0000","last_fullsized":"2023-08-27T11:24:34.506045+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:57:45.872664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891544+0000","last_change":"2023-08-27T11:24:32.910118+0000","last_active":"2023-08-27T11:24:33.891544+0000","last_peered":"2023-08-27T11:24:33.891544+0000","last_clean":"2023-08-27T11:24:33.891544+0000","last_became_active":"2023-08-27T11:24:32.909727+0000","last_became_peered":"2023-08-27T11:24:32.909727+0000","last_unstale":"2023-08-27T11:24:33.891544+0000","last_undegraded":"2023-08-27T11:24:33.891544+0000","last_fullsized":"2023-08-27T11:24:33.891544+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:06.246304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505124+0000","last_change":"2023-08-27T11:24:32.298796+0000","last_active":"2023-08-27T11:24:34.505124+0000","last_peered":"2023-08-27T11:24:34.505124+0000","last_clean":"2023-08-27T11:24:34.505124+0000","last_became_active":"2023-08-27T11:24:32.298437+0000","last_became_peered":"2023-08-27T11:24:32.298437+0000","last_unstale":"2023-08-27T11:24:34.505124+0000","last_undegraded":"2023-08-27T11:24:34.505124+0000","last_fullsized":"2023-08-27T11:24:34.505124+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:43:52.701242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890774+0000","last_change":"2023-08-27T11:24:32.901552+0000","last_active":"2023-08-27T11:24:33.890774+0000","last_peered":"2023-08-27T11:24:33.890774+0000","last_clean":"2023-08-27T11:24:33.890774+0000","last_became_active":"2023-08-27T11:24:32.901215+0000","last_became_peered":"2023-08-27T11:24:32.901215+0000","last_unstale":"2023-08-27T11:24:33.890774+0000","last_undegraded":"2023-08-27T11:24:33.890774+0000","last_fullsized":"2023-08-27T11:24:33.890774+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:29:04.571917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891474+0000","last_change":"2023-08-27T11:24:32.288640+0000","last_active":"2023-08-27T11:24:33.891474+0000","last_peered":"2023-08-27T11:24:33.891474+0000","last_clean":"2023-08-27T11:24:33.891474+0000","last_became_active":"2023-08-27T11:24:32.288294+0000","last_became_peered":"2023-08-27T11:24:32.288294+0000","last_unstale":"2023-08-27T11:24:33.891474+0000","last_undegraded":"2023-08-27T11:24:33.891474+0000","last_fullsized":"2023-08-27T11:24:33.891474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:03.488898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506054+0000","last_change":"2023-08-27T11:24:32.909216+0000","last_active":"2023-08-27T11:24:34.506054+0000","last_peered":"2023-08-27T11:24:34.506054+0000","last_clean":"2023-08-27T11:24:34.506054+0000","last_became_active":"2023-08-27T11:24:32.908852+0000","last_became_peered":"2023-08-27T11:24:32.908852+0000","last_unstale":"2023-08-27T11:24:34.506054+0000","last_undegraded":"2023-08-27T11:24:34.506054+0000","last_fullsized":"2023-08-27T11:24:34.506054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:38.414023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891921+0000","last_change":"2023-08-27T11:24:32.299429+0000","last_active":"2023-08-27T11:24:33.891921+0000","last_peered":"2023-08-27T11:24:33.891921+0000","last_clean":"2023-08-27T11:24:33.891921+0000","last_became_active":"2023-08-27T11:24:32.299132+0000","last_became_peered":"2023-08-27T11:24:32.299132+0000","last_unstale":"2023-08-27T11:24:33.891921+0000","last_undegraded":"2023-08-27T11:24:33.891921+0000","last_fullsized":"2023-08-27T11:24:33.891921+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:30:56.350503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506500+0000","last_change":"2023-08-27T11:24:32.905500+0000","last_active":"2023-08-27T11:24:34.506500+0000","last_peered":"2023-08-27T11:24:34.506500+0000","last_clean":"2023-08-27T11:24:34.506500+0000","last_became_active":"2023-08-27T11:24:32.905258+0000","last_became_peered":"2023-08-27T11:24:32.905258+0000","last_unstale":"2023-08-27T11:24:34.506500+0000","last_undegraded":"2023-08-27T11:24:34.506500+0000","last_fullsized":"2023-08-27T11:24:34.506500+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:44:14.279660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":16,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892058+0000","last_change":"2023-08-27T11:24:32.291485+0000","last_active":"2023-08-27T11:24:33.892058+0000","last_peered":"2023-08-27T11:24:33.892058+0000","last_clean":"2023-08-27T11:24:33.892058+0000","last_became_active":"2023-08-27T11:24:32.291149+0000","last_became_peered":"2023-08-27T11:24:32.291149+0000","last_unstale":"2023-08-27T11:24:33.892058+0000","last_undegraded":"2023-08-27T11:24:33.892058+0000","last_fullsized":"2023-08-27T11:24:33.892058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:42:48.245409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891616+0000","last_change":"2023-08-27T11:24:32.909417+0000","last_active":"2023-08-27T11:24:33.891616+0000","last_peered":"2023-08-27T11:24:33.891616+0000","last_clean":"2023-08-27T11:24:33.891616+0000","last_became_active":"2023-08-27T11:24:32.908900+0000","last_became_peered":"2023-08-27T11:24:32.908900+0000","last_unstale":"2023-08-27T11:24:33.891616+0000","last_undegraded":"2023-08-27T11:24:33.891616+0000","last_fullsized":"2023-08-27T11:24:33.891616+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:24.676746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":19,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506196+0000","last_change":"2023-08-27T11:24:32.283014+0000","last_active":"2023-08-27T11:24:34.506196+0000","last_peered":"2023-08-27T11:24:34.506196+0000","last_clean":"2023-08-27T11:24:34.506196+0000","last_became_active":"2023-08-27T11:24:32.282692+0000","last_became_peered":"2023-08-27T11:24:32.282692+0000","last_unstale":"2023-08-27T11:24:34.506196+0000","last_undegraded":"2023-08-27T11:24:34.506196+0000","last_fullsized":"2023-08-27T11:24:34.506196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:10.026002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506401+0000","last_change":"2023-08-27T11:24:32.906136+0000","last_active":"2023-08-27T11:24:34.506401+0000","last_peered":"2023-08-27T11:24:34.506401+0000","last_clean":"2023-08-27T11:24:34.506401+0000","last_became_active":"2023-08-27T11:24:32.905859+0000","last_became_peered":"2023-08-27T11:24:32.905859+0000","last_unstale":"2023-08-27T11:24:34.506401+0000","last_undegraded":"2023-08-27T11:24:34.506401+0000","last_fullsized":"2023-08-27T11:24:34.506401+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:20.558108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505362+0000","last_change":"2023-08-27T11:24:32.292723+0000","last_active":"2023-08-27T11:24:34.505362+0000","last_peered":"2023-08-27T11:24:34.505362+0000","last_clean":"2023-08-27T11:24:34.505362+0000","last_became_active":"2023-08-27T11:24:32.292342+0000","last_became_peered":"2023-08-27T11:24:32.292342+0000","last_unstale":"2023-08-27T11:24:34.505362+0000","last_undegraded":"2023-08-27T11:24:34.505362+0000","last_fullsized":"2023-08-27T11:24:34.505362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:13.545322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505756+0000","last_change":"2023-08-27T11:24:32.908533+0000","last_active":"2023-08-27T11:24:34.505756+0000","last_peered":"2023-08-27T11:24:34.505756+0000","last_clean":"2023-08-27T11:24:34.505756+0000","last_became_active":"2023-08-27T11:24:32.908214+0000","last_became_peered":"2023-08-27T11:24:32.908214+0000","last_unstale":"2023-08-27T11:24:34.505756+0000","last_undegraded":"2023-08-27T11:24:34.505756+0000","last_fullsized":"2023-08-27T11:24:34.505756+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:27:40.188603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505779+0000","last_change":"2023-08-27T11:24:32.298695+0000","last_active":"2023-08-27T11:24:34.505779+0000","last_peered":"2023-08-27T11:24:34.505779+0000","last_clean":"2023-08-27T11:24:34.505779+0000","last_became_active":"2023-08-27T11:24:32.298396+0000","last_became_peered":"2023-08-27T11:24:32.298396+0000","last_unstale":"2023-08-27T11:24:34.505779+0000","last_undegraded":"2023-08-27T11:24:34.505779+0000","last_fullsized":"2023-08-27T11:24:34.505779+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:40.657736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506089+0000","last_change":"2023-08-27T11:24:32.900978+0000","last_active":"2023-08-27T11:24:34.506089+0000","last_peered":"2023-08-27T11:24:34.506089+0000","last_clean":"2023-08-27T11:24:34.506089+0000","last_became_active":"2023-08-27T11:24:32.900695+0000","last_became_peered":"2023-08-27T11:24:32.900695+0000","last_unstale":"2023-08-27T11:24:34.506089+0000","last_undegraded":"2023-08-27T11:24:34.506089+0000","last_fullsized":"2023-08-27T11:24:34.506089+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:57.187870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891819+0000","last_change":"2023-08-27T11:24:32.287269+0000","last_active":"2023-08-27T11:24:33.891819+0000","last_peered":"2023-08-27T11:24:33.891819+0000","last_clean":"2023-08-27T11:24:33.891819+0000","last_became_active":"2023-08-27T11:24:32.286965+0000","last_became_peered":"2023-08-27T11:24:32.286965+0000","last_unstale":"2023-08-27T11:24:33.891819+0000","last_undegraded":"2023-08-27T11:24:33.891819+0000","last_fullsized":"2023-08-27T11:24:33.891819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:42:51.120317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505747+0000","last_change":"2023-08-27T11:24:32.913029+0000","last_active":"2023-08-27T11:24:34.505747+0000","last_peered":"2023-08-27T11:24:34.505747+0000","last_clean":"2023-08-27T11:24:34.505747+0000","last_became_active":"2023-08-27T11:24:32.912708+0000","last_became_peered":"2023-08-27T11:24:32.912708+0000","last_unstale":"2023-08-27T11:24:34.505747+0000","last_undegraded":"2023-08-27T11:24:34.505747+0000","last_fullsized":"2023-08-27T11:24:34.505747+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:43.589504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":21,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505678+0000","last_change":"2023-08-27T11:24:32.278403+0000","last_active":"2023-08-27T11:24:34.505678+0000","last_peered":"2023-08-27T11:24:34.505678+0000","last_clean":"2023-08-27T11:24:34.505678+0000","last_became_active":"2023-08-27T11:24:32.278104+0000","last_became_peered":"2023-08-27T11:24:32.278104+0000","last_unstale":"2023-08-27T11:24:34.505678+0000","last_undegraded":"2023-08-27T11:24:34.505678+0000","last_fullsized":"2023-08-27T11:24:34.505678+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:45.980800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505470+0000","last_change":"2023-08-27T11:24:32.898773+0000","last_active":"2023-08-27T11:24:34.505470+0000","last_peered":"2023-08-27T11:24:34.505470+0000","last_clean":"2023-08-27T11:24:34.505470+0000","last_became_active":"2023-08-27T11:24:32.898512+0000","last_became_peered":"2023-08-27T11:24:32.898512+0000","last_unstale":"2023-08-27T11:24:34.505470+0000","last_undegraded":"2023-08-27T11:24:34.505470+0000","last_fullsized":"2023-08-27T11:24:34.505470+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:00:10.398047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505599+0000","last_change":"2023-08-27T11:24:32.297792+0000","last_active":"2023-08-27T11:24:34.505599+0000","last_peered":"2023-08-27T11:24:34.505599+0000","last_clean":"2023-08-27T11:24:34.505599+0000","last_became_active":"2023-08-27T11:24:32.297492+0000","last_became_peered":"2023-08-27T11:24:32.297492+0000","last_unstale":"2023-08-27T11:24:34.505599+0000","last_undegraded":"2023-08-27T11:24:34.505599+0000","last_fullsized":"2023-08-27T11:24:34.505599+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:37.408416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505054+0000","last_change":"2023-08-27T11:24:32.904851+0000","last_active":"2023-08-27T11:24:34.505054+0000","last_peered":"2023-08-27T11:24:34.505054+0000","last_clean":"2023-08-27T11:24:34.505054+0000","last_became_active":"2023-08-27T11:24:32.904617+0000","last_became_peered":"2023-08-27T11:24:32.904617+0000","last_unstale":"2023-08-27T11:24:34.505054+0000","last_undegraded":"2023-08-27T11:24:34.505054+0000","last_fullsized":"2023-08-27T11:24:34.505054+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:41.034300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.881112+0000","last_change":"2023-08-27T11:24:32.287931+0000","last_active":"2023-08-27T11:24:33.881112+0000","last_peered":"2023-08-27T11:24:33.881112+0000","last_clean":"2023-08-27T11:24:33.881112+0000","last_became_active":"2023-08-27T11:24:32.287220+0000","last_became_peered":"2023-08-27T11:24:32.287220+0000","last_unstale":"2023-08-27T11:24:33.881112+0000","last_undegraded":"2023-08-27T11:24:33.881112+0000","last_fullsized":"2023-08-27T11:24:33.881112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:05.660265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890986+0000","last_change":"2023-08-27T11:24:32.912907+0000","last_active":"2023-08-27T11:24:33.890986+0000","last_peered":"2023-08-27T11:24:33.890986+0000","last_clean":"2023-08-27T11:24:33.890986+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:33.890986+0000","last_undegraded":"2023-08-27T11:24:33.890986+0000","last_fullsized":"2023-08-27T11:24:33.890986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:48:35.650642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":14,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505913+0000","last_change":"2023-08-27T11:24:32.291693+0000","last_active":"2023-08-27T11:24:34.505913+0000","last_peered":"2023-08-27T11:24:34.505913+0000","last_clean":"2023-08-27T11:24:34.505913+0000","last_became_active":"2023-08-27T11:24:32.291329+0000","last_became_peered":"2023-08-27T11:24:32.291329+0000","last_unstale":"2023-08-27T11:24:34.505913+0000","last_undegraded":"2023-08-27T11:24:34.505913+0000","last_fullsized":"2023-08-27T11:24:34.505913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:15.200849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505958+0000","last_change":"2023-08-27T11:24:32.896839+0000","last_active":"2023-08-27T11:24:34.505958+0000","last_peered":"2023-08-27T11:24:34.505958+0000","last_clean":"2023-08-27T11:24:34.505958+0000","last_became_active":"2023-08-27T11:24:32.896629+0000","last_became_peered":"2023-08-27T11:24:32.896629+0000","last_unstale":"2023-08-27T11:24:34.505958+0000","last_undegraded":"2023-08-27T11:24:34.505958+0000","last_fullsized":"2023-08-27T11:24:34.505958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:18.114498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505889+0000","last_change":"2023-08-27T11:24:32.283531+0000","last_active":"2023-08-27T11:24:34.505889+0000","last_peered":"2023-08-27T11:24:34.505889+0000","last_clean":"2023-08-27T11:24:34.505889+0000","last_became_active":"2023-08-27T11:24:32.283231+0000","last_became_peered":"2023-08-27T11:24:32.283231+0000","last_unstale":"2023-08-27T11:24:34.505889+0000","last_undegraded":"2023-08-27T11:24:34.505889+0000","last_fullsized":"2023-08-27T11:24:34.505889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:27.483472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506553+0000","last_change":"2023-08-27T11:24:32.909037+0000","last_active":"2023-08-27T11:24:34.506553+0000","last_peered":"2023-08-27T11:24:34.506553+0000","last_clean":"2023-08-27T11:24:34.506553+0000","last_became_active":"2023-08-27T11:24:32.908719+0000","last_became_peered":"2023-08-27T11:24:32.908719+0000","last_unstale":"2023-08-27T11:24:34.506553+0000","last_undegraded":"2023-08-27T11:24:34.506553+0000","last_fullsized":"2023-08-27T11:24:34.506553+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:51.272217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506098+0000","last_change":"2023-08-27T11:24:32.291430+0000","last_active":"2023-08-27T11:24:34.506098+0000","last_peered":"2023-08-27T11:24:34.506098+0000","last_clean":"2023-08-27T11:24:34.506098+0000","last_became_active":"2023-08-27T11:24:32.291106+0000","last_became_peered":"2023-08-27T11:24:32.291106+0000","last_unstale":"2023-08-27T11:24:34.506098+0000","last_undegraded":"2023-08-27T11:24:34.506098+0000","last_fullsized":"2023-08-27T11:24:34.506098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:52:52.100307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505735+0000","last_change":"2023-08-27T11:24:32.903976+0000","last_active":"2023-08-27T11:24:34.505735+0000","last_peered":"2023-08-27T11:24:34.505735+0000","last_clean":"2023-08-27T11:24:34.505735+0000","last_became_active":"2023-08-27T11:24:32.903486+0000","last_became_peered":"2023-08-27T11:24:32.903486+0000","last_unstale":"2023-08-27T11:24:34.505735+0000","last_undegraded":"2023-08-27T11:24:34.505735+0000","last_fullsized":"2023-08-27T11:24:34.505735+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:10.356626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505438+0000","last_change":"2023-08-27T11:24:32.278431+0000","last_active":"2023-08-27T11:24:34.505438+0000","last_peered":"2023-08-27T11:24:34.505438+0000","last_clean":"2023-08-27T11:24:34.505438+0000","last_became_active":"2023-08-27T11:24:32.278149+0000","last_became_peered":"2023-08-27T11:24:32.278149+0000","last_unstale":"2023-08-27T11:24:34.505438+0000","last_undegraded":"2023-08-27T11:24:34.505438+0000","last_fullsized":"2023-08-27T11:24:34.505438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:29:27.405248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505575+0000","last_change":"2023-08-27T11:24:32.904659+0000","last_active":"2023-08-27T11:24:34.505575+0000","last_peered":"2023-08-27T11:24:34.505575+0000","last_clean":"2023-08-27T11:24:34.505575+0000","last_became_active":"2023-08-27T11:24:32.904365+0000","last_became_peered":"2023-08-27T11:24:32.904365+0000","last_unstale":"2023-08-27T11:24:34.505575+0000","last_undegraded":"2023-08-27T11:24:34.505575+0000","last_fullsized":"2023-08-27T11:24:34.505575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:50.837386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505120+0000","last_change":"2023-08-27T11:24:32.293744+0000","last_active":"2023-08-27T11:24:34.505120+0000","last_peered":"2023-08-27T11:24:34.505120+0000","last_clean":"2023-08-27T11:24:34.505120+0000","last_became_active":"2023-08-27T11:24:32.293488+0000","last_became_peered":"2023-08-27T11:24:32.293488+0000","last_unstale":"2023-08-27T11:24:34.505120+0000","last_undegraded":"2023-08-27T11:24:34.505120+0000","last_fullsized":"2023-08-27T11:24:34.505120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:55:15.992932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506527+0000","last_change":"2023-08-27T11:24:32.889628+0000","last_active":"2023-08-27T11:24:34.506527+0000","last_peered":"2023-08-27T11:24:34.506527+0000","last_clean":"2023-08-27T11:24:34.506527+0000","last_became_active":"2023-08-27T11:24:32.889347+0000","last_became_peered":"2023-08-27T11:24:32.889347+0000","last_unstale":"2023-08-27T11:24:34.506527+0000","last_undegraded":"2023-08-27T11:24:34.506527+0000","last_fullsized":"2023-08-27T11:24:34.506527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:23.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.880610+0000","last_change":"2023-08-27T11:24:32.285270+0000","last_active":"2023-08-27T11:24:33.880610+0000","last_peered":"2023-08-27T11:24:33.880610+0000","last_clean":"2023-08-27T11:24:33.880610+0000","last_became_active":"2023-08-27T11:24:32.284877+0000","last_became_peered":"2023-08-27T11:24:32.284877+0000","last_unstale":"2023-08-27T11:24:33.880610+0000","last_undegraded":"2023-08-27T11:24:33.880610+0000","last_fullsized":"2023-08-27T11:24:33.880610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:41:40.701745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505590+0000","last_change":"2023-08-27T11:24:32.905190+0000","last_active":"2023-08-27T11:24:34.505590+0000","last_peered":"2023-08-27T11:24:34.505590+0000","last_clean":"2023-08-27T11:24:34.505590+0000","last_became_active":"2023-08-27T11:24:32.904921+0000","last_became_peered":"2023-08-27T11:24:32.904921+0000","last_unstale":"2023-08-27T11:24:34.505590+0000","last_undegraded":"2023-08-27T11:24:34.505590+0000","last_fullsized":"2023-08-27T11:24:34.505590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:15:29.722229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506382+0000","last_change":"2023-08-27T11:24:32.278516+0000","last_active":"2023-08-27T11:24:34.506382+0000","last_peered":"2023-08-27T11:24:34.506382+0000","last_clean":"2023-08-27T11:24:34.506382+0000","last_became_active":"2023-08-27T11:24:32.278225+0000","last_became_peered":"2023-08-27T11:24:32.278225+0000","last_unstale":"2023-08-27T11:24:34.506382+0000","last_undegraded":"2023-08-27T11:24:34.506382+0000","last_fullsized":"2023-08-27T11:24:34.506382+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:27.354259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":69,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891882+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:24:33.891882+0000","last_peered":"2023-08-27T11:24:33.891882+0000","last_clean":"2023-08-27T11:24:33.891882+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:24:33.891882+0000","last_undegraded":"2023-08-27T11:24:33.891882+0000","last_fullsized":"2023-08-27T11:24:33.891882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:11:00.934629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506538+0000","last_change":"2023-08-27T11:24:32.906148+0000","last_active":"2023-08-27T11:24:34.506538+0000","last_peered":"2023-08-27T11:24:34.506538+0000","last_clean":"2023-08-27T11:24:34.506538+0000","last_became_active":"2023-08-27T11:24:32.905830+0000","last_became_peered":"2023-08-27T11:24:32.905830+0000","last_unstale":"2023-08-27T11:24:34.506538+0000","last_undegraded":"2023-08-27T11:24:34.506538+0000","last_fullsized":"2023-08-27T11:24:34.506538+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:49.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505554+0000","last_change":"2023-08-27T11:24:32.288364+0000","last_active":"2023-08-27T11:24:34.505554+0000","last_peered":"2023-08-27T11:24:34.505554+0000","last_clean":"2023-08-27T11:24:34.505554+0000","last_became_active":"2023-08-27T11:24:32.287929+0000","last_became_peered":"2023-08-27T11:24:32.287929+0000","last_unstale":"2023-08-27T11:24:34.505554+0000","last_undegraded":"2023-08-27T11:24:34.505554+0000","last_fullsized":"2023-08-27T11:24:34.505554+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:55.947045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506138+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:24:34.506138+0000","last_peered":"2023-08-27T11:24:34.506138+0000","last_clean":"2023-08-27T11:24:34.506138+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:24:34.506138+0000","last_undegraded":"2023-08-27T11:24:34.506138+0000","last_fullsized":"2023-08-27T11:24:34.506138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:22.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505764+0000","last_change":"2023-08-27T11:24:32.889337+0000","last_active":"2023-08-27T11:24:34.505764+0000","last_peered":"2023-08-27T11:24:34.505764+0000","last_clean":"2023-08-27T11:24:34.505764+0000","last_became_active":"2023-08-27T11:24:32.889050+0000","last_became_peered":"2023-08-27T11:24:32.889050+0000","last_unstale":"2023-08-27T11:24:34.505764+0000","last_undegraded":"2023-08-27T11:24:34.505764+0000","last_fullsized":"2023-08-27T11:24:34.505764+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:43.501300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.892199+0000","last_change":"2023-08-27T11:24:32.292210+0000","last_active":"2023-08-27T11:24:33.892199+0000","last_peered":"2023-08-27T11:24:33.892199+0000","last_clean":"2023-08-27T11:24:33.892199+0000","last_became_active":"2023-08-27T11:24:32.291811+0000","last_became_peered":"2023-08-27T11:24:32.291811+0000","last_unstale":"2023-08-27T11:24:33.892199+0000","last_undegraded":"2023-08-27T11:24:33.892199+0000","last_fullsized":"2023-08-27T11:24:33.892199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:50.774611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":63,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506186+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:24:34.506186+0000","last_peered":"2023-08-27T11:24:34.506186+0000","last_clean":"2023-08-27T11:24:34.506186+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:24:34.506186+0000","last_undegraded":"2023-08-27T11:24:34.506186+0000","last_fullsized":"2023-08-27T11:24:34.506186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:34.390981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":213,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891061+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:24:33.891061+0000","last_peered":"2023-08-27T11:24:33.891061+0000","last_clean":"2023-08-27T11:24:33.891061+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:24:33.891061+0000","last_undegraded":"2023-08-27T11:24:33.891061+0000","last_fullsized":"2023-08-27T11:24:33.891061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:28:50.132393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505861+0000","last_change":"2023-08-27T11:24:32.910307+0000","last_active":"2023-08-27T11:24:34.505861+0000","last_peered":"2023-08-27T11:24:34.505861+0000","last_clean":"2023-08-27T11:24:34.505861+0000","last_became_active":"2023-08-27T11:24:32.909518+0000","last_became_peered":"2023-08-27T11:24:32.909518+0000","last_unstale":"2023-08-27T11:24:34.505861+0000","last_undegraded":"2023-08-27T11:24:34.505861+0000","last_fullsized":"2023-08-27T11:24:34.505861+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:52:03.104861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505434+0000","last_change":"2023-08-27T11:24:32.298891+0000","last_active":"2023-08-27T11:24:34.505434+0000","last_peered":"2023-08-27T11:24:34.505434+0000","last_clean":"2023-08-27T11:24:34.505434+0000","last_became_active":"2023-08-27T11:24:32.298585+0000","last_became_peered":"2023-08-27T11:24:32.298585+0000","last_unstale":"2023-08-27T11:24:34.505434+0000","last_undegraded":"2023-08-27T11:24:34.505434+0000","last_fullsized":"2023-08-27T11:24:34.505434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:00.329812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":65,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891567+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:24:33.891567+0000","last_peered":"2023-08-27T11:24:33.891567+0000","last_clean":"2023-08-27T11:24:33.891567+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:24:33.891567+0000","last_undegraded":"2023-08-27T11:24:33.891567+0000","last_fullsized":"2023-08-27T11:24:33.891567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:45.560256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505428+0000","last_change":"2023-08-27T11:24:32.899689+0000","last_active":"2023-08-27T11:24:34.505428+0000","last_peered":"2023-08-27T11:24:34.505428+0000","last_clean":"2023-08-27T11:24:34.505428+0000","last_became_active":"2023-08-27T11:24:32.899314+0000","last_became_peered":"2023-08-27T11:24:32.899314+0000","last_unstale":"2023-08-27T11:24:34.505428+0000","last_undegraded":"2023-08-27T11:24:34.505428+0000","last_fullsized":"2023-08-27T11:24:34.505428+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:23.887766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505420+0000","last_change":"2023-08-27T11:24:32.299417+0000","last_active":"2023-08-27T11:24:34.505420+0000","last_peered":"2023-08-27T11:24:34.505420+0000","last_clean":"2023-08-27T11:24:34.505420+0000","last_became_active":"2023-08-27T11:24:32.298960+0000","last_became_peered":"2023-08-27T11:24:32.298960+0000","last_unstale":"2023-08-27T11:24:34.505420+0000","last_undegraded":"2023-08-27T11:24:34.505420+0000","last_fullsized":"2023-08-27T11:24:34.505420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:34:02.280340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.890882+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:24:33.890882+0000","last_peered":"2023-08-27T11:24:33.890882+0000","last_clean":"2023-08-27T11:24:33.890882+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:24:33.890882+0000","last_undegraded":"2023-08-27T11:24:33.890882+0000","last_fullsized":"2023-08-27T11:24:33.890882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:22.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506220+0000","last_change":"2023-08-27T11:24:32.898742+0000","last_active":"2023-08-27T11:24:34.506220+0000","last_peered":"2023-08-27T11:24:34.506220+0000","last_clean":"2023-08-27T11:24:34.506220+0000","last_became_active":"2023-08-27T11:24:32.898394+0000","last_became_peered":"2023-08-27T11:24:32.898394+0000","last_unstale":"2023-08-27T11:24:34.506220+0000","last_undegraded":"2023-08-27T11:24:34.506220+0000","last_fullsized":"2023-08-27T11:24:34.506220+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:54:42.463318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":15,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506262+0000","last_change":"2023-08-27T11:24:32.298551+0000","last_active":"2023-08-27T11:24:34.506262+0000","last_peered":"2023-08-27T11:24:34.506262+0000","last_clean":"2023-08-27T11:24:34.506262+0000","last_became_active":"2023-08-27T11:24:32.298256+0000","last_became_peered":"2023-08-27T11:24:32.298256+0000","last_unstale":"2023-08-27T11:24:34.506262+0000","last_undegraded":"2023-08-27T11:24:34.506262+0000","last_fullsized":"2023-08-27T11:24:34.506262+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:13:10.102752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":69,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506269+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:24:34.506269+0000","last_peered":"2023-08-27T11:24:34.506269+0000","last_clean":"2023-08-27T11:24:34.506269+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:24:34.506269+0000","last_undegraded":"2023-08-27T11:24:34.506269+0000","last_fullsized":"2023-08-27T11:24:34.506269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:43.833512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506506+0000","last_change":"2023-08-27T11:24:32.883742+0000","last_active":"2023-08-27T11:24:34.506506+0000","last_peered":"2023-08-27T11:24:34.506506+0000","last_clean":"2023-08-27T11:24:34.506506+0000","last_became_active":"2023-08-27T11:24:32.883361+0000","last_became_peered":"2023-08-27T11:24:32.883361+0000","last_unstale":"2023-08-27T11:24:34.506506+0000","last_undegraded":"2023-08-27T11:24:34.506506+0000","last_fullsized":"2023-08-27T11:24:34.506506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:41.915348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506478+0000","last_change":"2023-08-27T11:24:32.291308+0000","last_active":"2023-08-27T11:24:34.506478+0000","last_peered":"2023-08-27T11:24:34.506478+0000","last_clean":"2023-08-27T11:24:34.506478+0000","last_became_active":"2023-08-27T11:24:32.291005+0000","last_became_peered":"2023-08-27T11:24:32.291005+0000","last_unstale":"2023-08-27T11:24:34.506478+0000","last_undegraded":"2023-08-27T11:24:34.506478+0000","last_fullsized":"2023-08-27T11:24:34.506478+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:29.540246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505795+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:24:34.505795+0000","last_peered":"2023-08-27T11:24:34.505795+0000","last_clean":"2023-08-27T11:24:34.505795+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:24:34.505795+0000","last_undegraded":"2023-08-27T11:24:34.505795+0000","last_fullsized":"2023-08-27T11:24:34.505795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:02:26.398938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.505198+0000","last_change":"2023-08-27T11:24:32.908654+0000","last_active":"2023-08-27T11:24:34.505198+0000","last_peered":"2023-08-27T11:24:34.505198+0000","last_clean":"2023-08-27T11:24:34.505198+0000","last_became_active":"2023-08-27T11:24:32.907172+0000","last_became_peered":"2023-08-27T11:24:32.907172+0000","last_unstale":"2023-08-27T11:24:34.505198+0000","last_undegraded":"2023-08-27T11:24:34.505198+0000","last_fullsized":"2023-08-27T11:24:34.505198+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:02.851202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:33.891061+0000","last_change":"2023-08-27T11:24:32.283734+0000","last_active":"2023-08-27T11:24:33.891061+0000","last_peered":"2023-08-27T11:24:33.891061+0000","last_clean":"2023-08-27T11:24:33.891061+0000","last_became_active":"2023-08-27T11:24:32.283396+0000","last_became_peered":"2023-08-27T11:24:32.283396+0000","last_unstale":"2023-08-27T11:24:33.891061+0000","last_undegraded":"2023-08-27T11:24:33.891061+0000","last_fullsized":"2023-08-27T11:24:33.891061+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:57:11.719756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":67,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-08-27T11:24:34.506353+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:24:34.506353+0000","last_peered":"2023-08-27T11:24:34.506353+0000","last_clean":"2023-08-27T11:24:34.506353+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:24:34.506353+0000","last_undegraded":"2023-08-27T11:24:34.506353+0000","last_fullsized":"2023-08-27T11:24:34.506353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:36:14.655397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":829930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.747}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.621}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":239104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":8.5419999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":8.5920000000000005,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.5039999999999996,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.6179999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.66100000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":7.4850000000000003,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":829966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.443},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.57899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.625},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":238508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.69899999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.64200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":241050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.504}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":1.25}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.81399999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":1.04},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.92000000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":565248,"data_stored":240086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.4249999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.928000000000001,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":5.5380000000000003,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.443}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.502},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.5700000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.5039999999999996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.4699999999999998,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":5.0389999999999997,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":5,"5min":5,"15min":5},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.71199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":240020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73499999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.754}]},{"osd":2,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.83399999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.78300000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.90900000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:23:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":238452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82099999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.872}]},{"osd":6,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:24:38.257 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:24:38.258 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:24:38.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.499+0000 7fae40dff700 1 Processor -- start 2023-08-27T11:24:38.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.499+0000 7fae40dff700 1 -- start start 2023-08-27T11:24:38.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae3c151d20 0x7fae3c06a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 0x7fae3c0c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c9750 0x7fae3c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0c86a0 con 0x7fae3c151d20 2023-08-27T11:24:38.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c155030 con 0x7fae3c0c92e0 2023-08-27T11:24:38.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae40dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c152100 con 0x7fae3c0c9750 2023-08-27T11:24:38.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae3a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae3c151d20 0x7fae3c06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae3a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fae3c151d20 0x7fae3c06a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57326/0 (socket says 172.21.15.43:57326) 2023-08-27T11:24:38.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae3a59c700 1 -- 172.21.15.43:0/3508745695 learned_addr learned my addr 172.21.15.43:0/3508745695 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:38.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae3ad9d700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c9750 0x7fae3c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.500+0000 7fae33fff700 1 --2- 172.21.15.43:0/3508745695 >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 0x7fae3c0c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 -- 172.21.15.43:0/3508745695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c9750 msgr2=0x7fae3c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:38.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c9750 0x7fae3c0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 -- 172.21.15.43:0/3508745695 >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 msgr2=0x7fae3c0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:38.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3508745695 >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 0x7fae3c0c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 -- 172.21.15.43:0/3508745695 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0ac7e0 con 0x7fae3c151d20 2023-08-27T11:24:38.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae33fff700 1 --2- 172.21.15.43:0/3508745695 >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 0x7fae3c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:38.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c06a790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06c7e0 tx=0x7fae2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d3dc616d07589e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae39d9b700 1 -- 172.21.15.43:0/3508745695 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011830 con 0x7fae3c151d20 2023-08-27T11:24:38.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae39d9b700 1 -- 172.21.15.43:0/3508745695 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c011990 con 0x7fae3c151d20 2023-08-27T11:24:38.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.501+0000 7fae39d9b700 1 -- 172.21.15.43:0/3508745695 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011d20 con 0x7fae3c151d20 2023-08-27T11:24:38.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 -- 172.21.15.43:0/3508745695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 msgr2=0x7fae3c06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c06a790 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae3c06c7e0 tx=0x7fae2c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 -- 172.21.15.43:0/3508745695 shutdown_connections 2023-08-27T11:24:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c9750 0x7fae3c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 --2- 172.21.15.43:0/3508745695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c06a790 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 --2- 172.21.15.43:0/3508745695 >> v2:172.21.15.57:3300/0 conn(0x7fae3c0c92e0 0x7fae3c0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 -- 172.21.15.43:0/3508745695 >> 172.21.15.43:0/3508745695 conn(0x7fae3c0ab880 msgr2=0x7fae3c0abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 -- 172.21.15.43:0/3508745695 shutdown_connections 2023-08-27T11:24:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.502+0000 7fae40dff700 1 -- 172.21.15.43:0/3508745695 wait complete. 2023-08-27T11:24:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.504+0000 7fae40dff700 1 Processor -- start 2023-08-27T11:24:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.504+0000 7fae40dff700 1 -- start start 2023-08-27T11:24:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c92e0 0x7fae3c14ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae3c0c9750 0x7fae3c0bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0bf2c0 con 0x7fae3c151d20 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1ee000 con 0x7fae3c0c9750 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae40dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c158270 con 0x7fae3c0c92e0 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae3ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae3ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57338/0 (socket says 172.21.15.43:57338) 2023-08-27T11:24:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae3ad9d700 1 -- 172.21.15.43:0/3849227593 learned_addr learned my addr 172.21.15.43:0/3849227593 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c92e0 0x7fae3c14ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.505+0000 7fae33fff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae3c0c9750 0x7fae3c0bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 -- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c92e0 msgr2=0x7fae3c14ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c92e0 0x7fae3c14ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 -- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae3c0c9750 msgr2=0x7fae3c0bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae3c0c9750 0x7fae3c0bed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 -- 172.21.15.43:0/3849227593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c009550 con 0x7fae3c151d20 2023-08-27T11:24:38.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae3ad9d700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efc0 tx=0x7fae3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34009ea0 con 0x7fae3c151d20 2023-08-27T11:24:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400f040 con 0x7fae3c151d20 2023-08-27T11:24:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400ced0 con 0x7fae3c151d20 2023-08-27T11:24:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c158550 con 0x7fae3c151d20 2023-08-27T11:24:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.506+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c1ed2c0 con 0x7fae3c151d20 2023-08-27T11:24:38.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.507+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c074680 con 0x7fae3c151d20 2023-08-27T11:24:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.508+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fae34014480 con 0x7fae3c151d20 2023-08-27T11:24:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.509+0000 7fae32ffd700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 0x7fae1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.509+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae34088de0 con 0x7fae3c151d20 2023-08-27T11:24:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.510+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 0x7fae1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.510+0000 7fae3a59c700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 0x7fae1c06c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fae2c014040 tx=0x7fae2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.514+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fae340544d0 con 0x7fae3c151d20 2023-08-27T11:24:38.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.807+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fae3c0c5f90 con 0x7fae3c151d20 2023-08-27T11:24:38.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.811+0000 7fae32ffd700 1 -- 172.21.15.43:0/3849227593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7fae340180e0 con 0x7fae3c151d20 2023-08-27T11:24:38.812 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:24:38.812 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:24:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:24:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:24:38.813 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:24:38.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 msgr2=0x7fae1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 0x7fae1c06c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fae2c014040 tx=0x7fae2c008030 comp rx=0 tx=0).stop 2023-08-27T11:24:38.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 msgr2=0x7fae3c1edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:38.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efc0 tx=0x7fae3400c3a0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 shutdown_connections 2023-08-27T11:24:38.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fae1c06a0e0 0x7fae1c06c5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fae3c151d20 0x7fae3c1edac0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fae3c0c92e0 0x7fae3c14ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 --2- 172.21.15.43:0/3849227593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae3c0c9750 0x7fae3c0bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:38.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 >> 172.21.15.43:0/3849227593 conn(0x7fae3c0ab880 msgr2=0x7fae3c154070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:38.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 shutdown_connections 2023-08-27T11:24:38.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:38.813+0000 7fae40dff700 1 -- 172.21.15.43:0/3849227593 wait complete. 2023-08-27T11:24:38.818 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:24:38.833 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:39.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.034+0000 7fc9abbff700 1 Processor -- start 2023-08-27T11:24:39.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.034+0000 7fc9abbff700 1 -- start start 2023-08-27T11:24:39.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.035+0000 7fc9abbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.035+0000 7fc9abbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.035+0000 7fc9abbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a406c4e0 con 0x7fc9a4151a90 2023-08-27T11:24:39.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.035+0000 7fc9abbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a4155370 con 0x7fc9a406ad70 2023-08-27T11:24:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.035+0000 7fc9abbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40c82c0 con 0x7fc9a40c4630 2023-08-27T11:24:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46636/0 (socket says 172.21.15.43:46636) 2023-08-27T11:24:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 -- 172.21.15.43:0/823597672 learned_addr learned my addr 172.21.15.43:0/823597672 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9a919a700 1 --2- 172.21.15.43:0/823597672 >> v2:172.21.15.57:3300/0 conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 -- 172.21.15.43:0/823597672 >> v2:172.21.15.57:3300/0 conn(0x7fc9a40c4630 msgr2=0x7fc9a40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 --2- 172.21.15.43:0/823597672 >> v2:172.21.15.57:3300/0 conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 -- 172.21.15.43:0/823597672 >> v1:172.21.15.57:6789/0 conn(0x7fc9a4151a90 legacy=0x7fc9a40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 -- 172.21.15.43:0/823597672 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4151e70 con 0x7fc9a406ad70 2023-08-27T11:24:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9aa19c700 1 --2- 172.21.15.43:0/823597672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a406b200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40c7740 tx=0x7fc99c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d283c6524a0a89 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.036+0000 7fc9a8999700 1 -- 172.21.15.43:0/823597672 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00e070 con 0x7fc9a406ad70 2023-08-27T11:24:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9a8999700 1 -- 172.21.15.43:0/823597672 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c00b910 con 0x7fc9a406ad70 2023-08-27T11:24:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9a8999700 1 -- 172.21.15.43:0/823597672 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c00bcc0 con 0x7fc9a406ad70 2023-08-27T11:24:39.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 -- 172.21.15.43:0/823597672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 msgr2=0x7fc9a406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 --2- 172.21.15.43:0/823597672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a406b200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40c7740 tx=0x7fc99c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 -- 172.21.15.43:0/823597672 shutdown_connections 2023-08-27T11:24:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 --2- 172.21.15.43:0/823597672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 --2- 172.21.15.43:0/823597672 >> v2:172.21.15.57:3300/0 conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 -- 172.21.15.43:0/823597672 >> 172.21.15.43:0/823597672 conn(0x7fc9a40ab820 msgr2=0x7fc9a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 -- 172.21.15.43:0/823597672 shutdown_connections 2023-08-27T11:24:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.037+0000 7fc9abbff700 1 -- 172.21.15.43:0/823597672 wait complete. 2023-08-27T11:24:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.039+0000 7fc9abbff700 1 Processor -- start 2023-08-27T11:24:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.039+0000 7fc9abbff700 1 -- start start 2023-08-27T11:24:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40c4630 0x7fc9a40bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a4151a90 0x7fc9a40bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a414c740 con 0x7fc9a406ad70 2023-08-27T11:24:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40be620 con 0x7fc9a40c4630 2023-08-27T11:24:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9abbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a414c990 con 0x7fc9a4151a90 2023-08-27T11:24:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46642/0 (socket says 172.21.15.43:46642) 2023-08-27T11:24:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 -- 172.21.15.43:0/1716759959 learned_addr learned my addr 172.21.15.43:0/1716759959 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a919a700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40c4630 0x7fc9a40bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 -- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a4151a90 msgr2=0x7fc9a40bef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a4151a90 0x7fc9a40bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 -- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40c4630 msgr2=0x7fc9a40bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40c4630 0x7fc9a40bea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.040+0000 7fc9a999b700 1 -- 172.21.15.43:0/1716759959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c009b30 con 0x7fc9a406ad70 2023-08-27T11:24:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc9a999b700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c480 tx=0x7fc9a000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00052d0 con 0x7fc9a406ad70 2023-08-27T11:24:39.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a0005430 con 0x7fc9a406ad70 2023-08-27T11:24:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00038c0 con 0x7fc9a406ad70 2023-08-27T11:24:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a414cc70 con 0x7fc9a406ad70 2023-08-27T11:24:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.041+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a414d230 con 0x7fc9a406ad70 2023-08-27T11:24:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.042+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a414d440 con 0x7fc9a406ad70 2023-08-27T11:24:39.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.043+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9a0003a20 con 0x7fc9a406ad70 2023-08-27T11:24:39.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.044+0000 7fc99a7fc700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.045+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9a00879f0 con 0x7fc9a406ad70 2023-08-27T11:24:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.045+0000 7fc9a919a700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.045+0000 7fc9a919a700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4158800 tx=0x7fc994008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.049+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc9a00530d0 con 0x7fc9a406ad70 2023-08-27T11:24:39.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.306+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a414f2b0 con 0x7fc9a406ad70 2023-08-27T11:24:39.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.307+0000 7fc99a7fc700 1 -- 172.21.15.43:0/1716759959 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4872 (secure 0 0 0) 0x7fc9a00566f0 con 0x7fc9a406ad70 2023-08-27T11:24:39.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:39.310 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:36.320500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1932805485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1932805485},{"type":"v1","addr":"172.21.15.57:6835","nonce":1932805485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-27T11:24:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 msgr2=0x7fc98806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4158800 tx=0x7fc994008040 comp rx=0 tx=0).stop 2023-08-27T11:24:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 msgr2=0x7fc9a40c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c480 tx=0x7fc9a000c840 comp rx=0 tx=0).stop 2023-08-27T11:24:39.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 shutdown_connections 2023-08-27T11:24:39.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a4151a90 0x7fc9a40bef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a406ad70 0x7fc9a40c0d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 --2- 172.21.15.43:0/1716759959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a40c4630 0x7fc9a40bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.309+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 >> 172.21.15.43:0/1716759959 conn(0x7fc9a40ab820 msgr2=0x7fc9a414f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.310+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 shutdown_connections 2023-08-27T11:24:39.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.310+0000 7fc9abbff700 1 -- 172.21.15.43:0/1716759959 wait complete. 2023-08-27T11:24:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 32 2023-08-27T11:24:39.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:24:32.790907+0000', 'modified': '2023-08-27T11:24:36.320500+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'd', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1932805485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 1932805485}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1932805485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:24:39.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:24:39.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:24:39.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.941+0000 7fdb867ff700 1 Processor -- start 2023-08-27T11:24:39.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.941+0000 7fdb867ff700 1 -- start start 2023-08-27T11:24:39.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb867ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb8014e960 0x7fdb800a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb867ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb80154d00 con 0x7fdb800c50d0 2023-08-27T11:24:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb867ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb80154fe0 con 0x7fdb800a79c0 2023-08-27T11:24:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb867ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800baf30 con 0x7fdb8014e960 2023-08-27T11:24:39.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb84d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdb800c50d0 0x7fdb800c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51652/0 (socket says 172.21.15.43:51652) 2023-08-27T11:24:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb84d9c700 1 -- 172.21.15.43:0/3138758725 learned_addr learned my addr 172.21.15.43:0/3138758725 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:39.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.942+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/3138758725 >> v2:172.21.15.57:3300/0 conn(0x7fdb8014e960 0x7fdb800a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757474349 0 0) 0x7fdb80154d00 con 0x7fdb800c50d0 2023-08-27T11:24:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb680035b0 con 0x7fdb800c50d0 2023-08-27T11:24:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507772847 0 0) 0x7fdb80154fe0 con 0x7fdb800a79c0 2023-08-27T11:24:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb80154d00 con 0x7fdb800a79c0 2023-08-27T11:24:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7ffff700 1 -- 172.21.15.43:0/3138758725 >> v1:172.21.15.57:6789/0 conn(0x7fdb800a79c0 legacy=0x7fdb800c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7ffff700 1 -- 172.21.15.43:0/3138758725 >> v1:172.21.15.43:6789/0 conn(0x7fdb800c50d0 legacy=0x7fdb800c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7ffff700 1 -- 172.21.15.43:0/3138758725 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb801552c0 con 0x7fdb8014e960 2023-08-27T11:24:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.943+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/3138758725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb800a7480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009840 tx=0x7fdb70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5db1a238fef50e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70011830 con 0x7fdb8014e960 2023-08-27T11:24:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70011990 con 0x7fdb8014e960 2023-08-27T11:24:39.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb7effd700 1 -- 172.21.15.43:0/3138758725 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70011d20 con 0x7fdb8014e960 2023-08-27T11:24:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 -- 172.21.15.43:0/3138758725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 msgr2=0x7fdb800a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3138758725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb800a7480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009840 tx=0x7fdb70009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 -- 172.21.15.43:0/3138758725 shutdown_connections 2023-08-27T11:24:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3138758725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb800a7480 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 -- 172.21.15.43:0/3138758725 >> 172.21.15.43:0/3138758725 conn(0x7fdb8006aa50 msgr2=0x7fdb800c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 -- 172.21.15.43:0/3138758725 shutdown_connections 2023-08-27T11:24:39.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.944+0000 7fdb867ff700 1 -- 172.21.15.43:0/3138758725 wait complete. 2023-08-27T11:24:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.946+0000 7fdb867ff700 1 Processor -- start 2023-08-27T11:24:39.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.946+0000 7fdb867ff700 1 -- start start 2023-08-27T11:24:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb800a79c0 0x7fdb80151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb801495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb801e9f80 con 0x7fdb800c50d0 2023-08-27T11:24:39.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014b590 con 0x7fdb8014e960 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb867ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014b2b0 con 0x7fdb800a79c0 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.947+0000 7fdb7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46648/0 (socket says 172.21.15.43:46648) 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/3497891875 learned_addr learned my addr 172.21.15.43:0/3497891875 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb800a79c0 0x7fdb80151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb801495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb800a79c0 msgr2=0x7fdb80151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb800a79c0 0x7fdb80151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 msgr2=0x7fdb801495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb801495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/3497891875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb700094a0 con 0x7fdb800c50d0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c520 tx=0x7fdb7400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.948+0000 7fdb7cff9700 1 -- 172.21.15.43:0/3497891875 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740052d0 con 0x7fdb800c50d0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.949+0000 7fdb7cff9700 1 -- 172.21.15.43:0/3497891875 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74005430 con 0x7fdb800c50d0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.949+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb801e9930 con 0x7fdb800c50d0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.949+0000 7fdb7cff9700 1 -- 172.21.15.43:0/3497891875 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740038c0 con 0x7fdb800c50d0 2023-08-27T11:24:39.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.949+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800c26a0 con 0x7fdb800c50d0 2023-08-27T11:24:39.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.951+0000 7fdb7cff9700 1 -- 172.21.15.43:0/3497891875 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb74003a20 con 0x7fdb800c50d0 2023-08-27T11:24:39.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.952+0000 7fdb7cff9700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 0x7fdb6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.952+0000 7fdb7cff9700 1 -- 172.21.15.43:0/3497891875 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb74087980 con 0x7fdb800c50d0 2023-08-27T11:24:39.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.952+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 0x7fdb6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.952+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 0x7fdb6c06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009fd0 tx=0x7fdb7001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.954+0000 7fdb9a069b80 1 Processor -- start 2023-08-27T11:24:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.954+0000 7fdb9a069b80 1 -- start start 2023-08-27T11:24:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 0x5607149732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149502e0 0x560714988500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607148ad730 con 0x56071494ff00 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607148ab050 con 0x5607149502e0 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607148a6940 con 0x560714955fe0 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb7ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46650/0 (socket says 172.21.15.43:46650) 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb7ffff700 1 -- 172.21.15.43:0/1791962804 learned_addr learned my addr 172.21.15.43:0/1791962804 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149502e0 0x560714988500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.955+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 0x5607149732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 -- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 msgr2=0x5607149732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 0x5607149732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 -- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149502e0 msgr2=0x560714988500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149502e0 0x560714988500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 -- 172.21.15.43:0/1791962804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607147265e0 con 0x56071494ff00 2023-08-27T11:24:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 0x5607149732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014040 tx=0x7fdb70010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42f2aa718798578 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb65ffb700 1 -- 172.21.15.43:0/1791962804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7002a070 con 0x56071494ff00 2023-08-27T11:24:39.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb65ffb700 1 -- 172.21.15.43:0/1791962804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70011cd0 con 0x56071494ff00 2023-08-27T11:24:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.956+0000 7fdb65ffb700 1 -- 172.21.15.43:0/1791962804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70025a50 con 0x56071494ff00 2023-08-27T11:24:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1791962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 msgr2=0x560714972d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdb70014040 tx=0x7fdb70010000 comp rx=0 tx=0).stop 2023-08-27T11:24:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1791962804 shutdown_connections 2023-08-27T11:24:39.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149502e0 0x560714988500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56071494ff00 0x560714972d70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1791962804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560714955fe0 0x5607149732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1791962804 >> 172.21.15.43:0/1791962804 conn(0x5607148b2c30 msgr2=0x5607149526e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1791962804 shutdown_connections 2023-08-27T11:24:39.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.957+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1791962804 wait complete. 2023-08-27T11:24:39.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.958+0000 7fdb9a069b80 1 -- start start 2023-08-27T11:24:39.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.958+0000 7fdb9a069b80 1 Processor -- start 2023-08-27T11:24:39.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x56071496bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x5607149a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560714844b60 con 0x5607149a4390 2023-08-27T11:24:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560714844860 con 0x56071494ff00 2023-08-27T11:24:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607147288d0 con 0x5607149502e0 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb9a069b80 10 client.0 _ll_register_callbacks cb 0x560714842630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb84d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb84d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46660/0 (socket says 172.21.15.43:46660) 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.959+0000 7fdb84d9c700 1 -- 172.21.15.43:0/1167920468 learned_addr learned my addr 172.21.15.43:0/1167920468 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x5607149a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x56071496bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 -- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 msgr2=0x5607149a3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x5607149a3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 -- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 msgr2=0x56071496bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x56071496bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 -- 172.21.15.43:0/1167920468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb801552c0 con 0x5607149a4390 2023-08-27T11:24:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb78007a90 tx=0x7fdb78011530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a97fe64371db5f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb5effd700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780020e0 con 0x5607149a4390 2023-08-27T11:24:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607149474f0 con 0x5607149a4390 2023-08-27T11:24:39.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.960+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb78011a90 con 0x5607149a4390 2023-08-27T11:24:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb78011c50 con 0x5607149a4390 2023-08-27T11:24:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 10 client.5724 fetch_fsmap learned FSMap version 32 2023-08-27T11:24:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5607148be750 con 0x5607149a4390 2023-08-27T11:24:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5607149474f0 con 0x5607149a4390 2023-08-27T11:24:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb78015470 con 0x5607149a4390 2023-08-27T11:24:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 10 client.5724 fetch_fsmap finished waiting for FSMap version 32 2023-08-27T11:24:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 10 client.5724 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 20 client.5724 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x560714973850 0x560714973c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 4 client.5724 mds_command: new command op to 5586 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:24:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 --> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56071489f920 con 0x560714973850 2023-08-27T11:24:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.961+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x560714973850 0x560714973c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.962+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x560714973850 0x560714973c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f31c5513c5d88c6 server_cookie=50b9fd3202551fdb in_seq=0 out_seq=0 2023-08-27T11:24:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.962+0000 7fdb5effd700 10 client.5724 ms_handle_connect on v2:172.21.15.57:6833/1932805485 2023-08-27T11:24:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb5effd700 1 -- 172.21.15.43:0/1167920468 <== mds.0 v2:172.21.15.57:6833/1932805485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56071489f920 con 0x560714973850 2023-08-27T11:24:39.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb5effd700 10 client.5724 handle_command_reply: tid=0 2023-08-27T11:24:39.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 client.5724 shutdown 2023-08-27T11:24:39.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 msgr2=0x56071498dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdb78007a90 tx=0x7fdb78011530 comp rx=0 tx=0).stop 2023-08-27T11:24:39.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 shutdown_connections 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x56071498dc10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x56071496bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x560714973850 0x560714973c30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/1167920468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x5607149a3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb5effd700 0 client.5724 ms_handle_reset on v2:172.21.15.57:6833/1932805485 2023-08-27T11:24:39.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.963+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 >> 172.21.15.43:0/1167920468 conn(0x5607148b2c30 msgr2=0x56071494db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.964+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 shutdown_connections 2023-08-27T11:24:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.964+0000 7fdb9a069b80 1 -- 172.21.15.43:0/1167920468 wait complete. 2023-08-27T11:24:39.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.964+0000 7fdb9a069b80 20 client.5724 trim_cache size 0 max 16384 2023-08-27T11:24:39.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.982+0000 7fdb9a069b80 1 Processor -- start 2023-08-27T11:24:39.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.982+0000 7fdb9a069b80 1 -- start start 2023-08-27T11:24:39.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x5607149a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x560714974370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607149717b0 con 0x5607149a4390 2023-08-27T11:24:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607149506c0 con 0x56071494ff00 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5607149474c0 con 0x5607149502e0 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb84d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb84d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46672/0 (socket says 172.21.15.43:46672) 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb84d9c700 1 -- 172.21.15.43:0/450231652 learned_addr learned my addr 172.21.15.43:0/450231652 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x5607149a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.983+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x560714974370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 -- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 msgr2=0x560714974370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x560714974370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 -- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 msgr2=0x5607149a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x5607149a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 -- 172.21.15.43:0/450231652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607146d2d90 con 0x5607149a4390 2023-08-27T11:24:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdb78001470 tx=0x7fdb7800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2969131ebd5f6f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb667fc700 1 -- 172.21.15.43:0/450231652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78015ce0 con 0x5607149a4390 2023-08-27T11:24:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb667fc700 1 -- 172.21.15.43:0/450231652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb78015e40 con 0x5607149a4390 2023-08-27T11:24:39.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.984+0000 7fdb667fc700 1 -- 172.21.15.43:0/450231652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78015b30 con 0x5607149a4390 2023-08-27T11:24:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 -- 172.21.15.43:0/450231652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 msgr2=0x560714953090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdb78001470 tx=0x7fdb7800c000 comp rx=0 tx=0).stop 2023-08-27T11:24:39.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 -- 172.21.15.43:0/450231652 shutdown_connections 2023-08-27T11:24:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149a4390 0x560714953090 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56071494ff00 0x5607149a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/450231652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5607149502e0 0x560714974370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 -- 172.21.15.43:0/450231652 >> 172.21.15.43:0/450231652 conn(0x5607148b2c30 msgr2=0x56071494b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:39.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 -- 172.21.15.43:0/450231652 shutdown_connections 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.985+0000 7fdb9a069b80 1 -- 172.21.15.43:0/450231652 wait complete. 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.986+0000 7fdb9a069b80 1 -- start start 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.986+0000 7fdb9a069b80 1 Processor -- start 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56071494ff00 0x560714986d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149a4390 0x5607149f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560714951540 con 0x5607149502e0 2023-08-27T11:24:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607149f87e0 con 0x5607149a4390 2023-08-27T11:24:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x560714951320 con 0x56071494ff00 2023-08-27T11:24:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb9a069b80 10 client.0 _ll_register_callbacks cb 0x560714842630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:24:39.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56071494ff00 0x560714986d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46684/0 (socket says 172.21.15.43:46684) 2023-08-27T11:24:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/2062983243 learned_addr learned my addr 172.21.15.43:0/2062983243 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb84d9c700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149a4390 0x5607149f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:39.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56071494ff00 msgr2=0x560714986d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56071494ff00 0x560714986d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149a4390 msgr2=0x5607149f1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149a4390 0x5607149f1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.988+0000 7fdb7f7fe700 1 -- 172.21.15.43:0/2062983243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607148be750 con 0x5607149502e0 2023-08-27T11:24:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb7f7fe700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a040 tx=0x7fdb740574f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13723aa713351c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7405e7a0 con 0x5607149502e0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb74085a10 con 0x5607149502e0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb70011cd0 con 0x5607149502e0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb74056af0 con 0x5607149502e0 2023-08-27T11:24:40.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 10 client.5730 fetch_fsmap learned FSMap version 32 2023-08-27T11:24:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5607146bbc10 con 0x5607149502e0 2023-08-27T11:24:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74073070 con 0x5607149502e0 2023-08-27T11:24:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb74052b10 con 0x5607149502e0 2023-08-27T11:24:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 10 client.5730 fetch_fsmap finished waiting for FSMap version 32 2023-08-27T11:24:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 10 client.5730 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:24:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 20 client.5730 populate_metadata read hostname 'smithi043' 2023-08-27T11:24:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x5607149f24d0 0x560714972330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 4 client.5730 mds_command: new command op to 5586 tid=0[{"prefix": "status"}] 2023-08-27T11:24:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.989+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 --> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560714860000 con 0x5607149f24d0 2023-08-27T11:24:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.990+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x5607149f24d0 0x560714972330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.990+0000 7fdb7ffff700 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x5607149f24d0 0x560714972330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64290441f13377 server_cookie=60f1e5e34e91484d in_seq=0 out_seq=0 2023-08-27T11:24:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.990+0000 7fdb5effd700 10 client.5730 ms_handle_connect on v2:172.21.15.57:6833/1932805485 2023-08-27T11:24:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb5effd700 1 -- 172.21.15.43:0/2062983243 <== mds.0 v2:172.21.15.57:6833/1932805485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560714860000 con 0x5607149f24d0 2023-08-27T11:24:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb5effd700 10 client.5730 handle_command_reply: tid=0 2023-08-27T11:24:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 client.5730 shutdown 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 msgr2=0x560714990c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a040 tx=0x7fdb740574f0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 shutdown_connections 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5607149a4390 0x5607149f1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:6833/1932805485,v1:172.21.15.57:6835/1932805485] conn(0x5607149f24d0 0x560714972330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56071494ff00 0x560714986d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 --2- 172.21.15.43:0/2062983243 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5607149502e0 0x560714990c20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb5effd700 0 client.5730 ms_handle_reset on v2:172.21.15.57:6833/1932805485 2023-08-27T11:24:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 >> 172.21.15.43:0/2062983243 conn(0x5607148b2c30 msgr2=0x560714968460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 shutdown_connections 2023-08-27T11:24:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 1 -- 172.21.15.43:0/2062983243 wait complete. 2023-08-27T11:24:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.991+0000 7fdb9a069b80 20 client.5730 trim_cache size 0 max 16384 2023-08-27T11:24:40.006 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:24:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:24:40.006 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:24:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 5586, 2023-08-27T11:24:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:24:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:24:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:24:40.007 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.7106924479999996, 2023-08-27T11:24:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 32, 2023-08-27T11:24:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 47, 2023-08-27T11:24:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 47, 2023-08-27T11:24:40.008 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 12.941078102000001 2023-08-27T11:24:40.008 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:24:40.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 msgr2=0x7fdb6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 0x7fdb6c06c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009fd0 tx=0x7fdb7001c040 comp rx=0 tx=0).stop 2023-08-27T11:24:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 msgr2=0x7fdb800c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c520 tx=0x7fdb7400c830 comp rx=0 tx=0).stop 2023-08-27T11:24:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 shutdown_connections 2023-08-27T11:24:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb6c06a0e0 0x7fdb6c06c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb8014e960 0x7fdb801495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb800a79c0 0x7fdb80151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 --2- 172.21.15.43:0/3497891875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb800c50d0 0x7fdb800c2160 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 >> 172.21.15.43:0/3497891875 conn(0x7fdb8006aa50 msgr2=0x7fdb800a6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 shutdown_connections 2023-08-27T11:24:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:39.992+0000 7fdb867ff700 1 -- 172.21.15.43:0/3497891875 wait complete. 2023-08-27T11:24:40.013 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.212+0000 7f1ccb5ff700 1 Processor -- start 2023-08-27T11:24:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.213+0000 7f1ccb5ff700 1 -- start start 2023-08-27T11:24:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1ccb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc414e960 0x7f1cc40a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1ccb5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1ccb5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc4154d00 con 0x7f1cc40c50d0 2023-08-27T11:24:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1ccb5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40baf30 con 0x7f1cc40a79c0 2023-08-27T11:24:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1ccb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4154fe0 con 0x7f1cc414e960 2023-08-27T11:24:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1cc8b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1cc8b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46690/0 (socket says 172.21.15.43:46690) 2023-08-27T11:24:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1cc8b9a700 1 -- 172.21.15.43:0/3432883825 learned_addr learned my addr 172.21.15.43:0/3432883825 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.214+0000 7f1cc939b700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc414e960 0x7f1cc40a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cc8b9a700 1 -- 172.21.15.43:0/3432883825 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc414e960 msgr2=0x7f1cc40a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cc8b9a700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc414e960 0x7f1cc40a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cc8b9a700 1 -- 172.21.15.43:0/3432883825 >> v1:172.21.15.57:6789/0 conn(0x7f1cc40c50d0 legacy=0x7f1cc40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cc8b9a700 1 -- 172.21.15.43:0/3432883825 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc41552c0 con 0x7f1cc40a79c0 2023-08-27T11:24:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cc8b9a700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40098f0 tx=0x7f1cb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60bfdb6024ee4a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cbbfff700 1 -- 172.21.15.43:0/3432883825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4011830 con 0x7f1cc40a79c0 2023-08-27T11:24:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cbbfff700 1 -- 172.21.15.43:0/3432883825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4011990 con 0x7f1cc40a79c0 2023-08-27T11:24:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.215+0000 7f1cbbfff700 1 -- 172.21.15.43:0/3432883825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4011d20 con 0x7f1cc40a79c0 2023-08-27T11:24:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/3432883825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc40a79c0 msgr2=0x7f1cc40c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40098f0 tx=0x7f1cb4009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/3432883825 shutdown_connections 2023-08-27T11:24:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc414e960 0x7f1cc40a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/3432883825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc40a79c0 0x7f1cc40c3cc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/3432883825 >> 172.21.15.43:0/3432883825 conn(0x7f1cc406aa50 msgr2=0x7f1cc40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/3432883825 shutdown_connections 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.216+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/3432883825 wait complete. 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.217+0000 7f1ccb5ff700 1 Processor -- start 2023-08-27T11:24:40.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 -- start start 2023-08-27T11:24:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a79c0 0x7f1cc4072100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40c50d0 0x7f1cc40aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40a9c00 con 0x7f1cc414e960 2023-08-27T11:24:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40ab870 con 0x7f1cc40c50d0 2023-08-27T11:24:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.218+0000 7f1ccb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40a9450 con 0x7f1cc40a79c0 2023-08-27T11:24:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc8b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40c50d0 0x7f1cc40aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc939b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a79c0 0x7f1cc4072100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46698/0 (socket says 172.21.15.43:46698) 2023-08-27T11:24:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 -- 172.21.15.43:0/651392562 learned_addr learned my addr 172.21.15.43:0/651392562 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 -- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a79c0 msgr2=0x7f1cc4072100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a79c0 0x7f1cc4072100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 -- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40c50d0 msgr2=0x7f1cc40aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40c50d0 0x7f1cc40aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 -- 172.21.15.43:0/651392562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009550 con 0x7f1cc414e960 2023-08-27T11:24:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.219+0000 7f1cc9b9c700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc50 tx=0x7f1cbc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.220+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc003c00 con 0x7f1cc414e960 2023-08-27T11:24:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.220+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc003d60 con 0x7f1cc414e960 2023-08-27T11:24:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.220+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc4071620 con 0x7f1cc414e960 2023-08-27T11:24:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.220+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc00aab0 con 0x7f1cc414e960 2023-08-27T11:24:40.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.220+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4071be0 con 0x7f1cc414e960 2023-08-27T11:24:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.221+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc40bb390 con 0x7f1cc414e960 2023-08-27T11:24:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.222+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1cbc00ac10 con 0x7f1cc414e960 2023-08-27T11:24:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.223+0000 7f1cb9ffb700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 0x7f1ca806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.223+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cbc088510 con 0x7f1cc414e960 2023-08-27T11:24:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.223+0000 7f1cc939b700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 0x7f1ca806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.224+0000 7f1cc939b700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 0x7f1ca806c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4146090 tx=0x7f1cc0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.227+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1cbc053bf0 con 0x7f1cc414e960 2023-08-27T11:24:40.397 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:24:40.403 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:24:40.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.484+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cc404ee70 con 0x7f1cc414e960 2023-08-27T11:24:40.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.485+0000 7f1cb9ffb700 1 -- 172.21.15.43:0/651392562 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4872 (secure 0 0 0) 0x7f1cbc057210 con 0x7f1cc414e960 2023-08-27T11:24:40.487 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:40.487 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:36.320500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1932805485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1932805485},{"type":"v1","addr":"172.21.15.57:6835","nonce":1932805485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-27T11:24:40.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.487+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 msgr2=0x7f1ca806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.487+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 0x7f1ca806c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4146090 tx=0x7f1cc0009210 comp rx=0 tx=0).stop 2023-08-27T11:24:40.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 msgr2=0x7f1cc41eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00cc50 tx=0x7f1cbc00cf60 comp rx=0 tx=0).stop 2023-08-27T11:24:40.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 shutdown_connections 2023-08-27T11:24:40.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ca806a0e0 0x7f1ca806c5a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1cc414e960 0x7f1cc41eabc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a79c0 0x7f1cc4072100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 --2- 172.21.15.43:0/651392562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40c50d0 0x7f1cc40aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 >> 172.21.15.43:0/651392562 conn(0x7f1cc406aa50 msgr2=0x7f1cc41544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 shutdown_connections 2023-08-27T11:24:40.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.488+0000 7f1ccb5ff700 1 -- 172.21.15.43:0/651392562 wait complete. 2023-08-27T11:24:40.492 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 32 2023-08-27T11:24:40.508 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 3, "epoch": 32, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:24:32.790907+0000", "damaged": [], "data_pools": [ 8 ], "enabled": true, "epoch": 32, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5586": { "addr": "172.21.15.57:6835/1932805485", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 1932805485, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 1932805485, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5586, "incarnation": 28, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 7, "modified": "2023-08-27T11:24:36.320500+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5586 } } } ], "standbys": [ { "addr": "172.21.15.43:6837/2697205419", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 2697205419, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 2697205419, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 27, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5144, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/675883669", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 675883669, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 675883669, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 26, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5577, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/3641122539", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 3641122539, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 3641122539, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 27, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5583, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:24:40.509 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:24:40.509 INFO:tasks.cephfs.test_failover:current = [{'gid': 5144, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/2697205419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 2697205419}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2697205419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 27}, {'gid': 5583, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/3641122539', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3641122539}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3641122539}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 27}, {'gid': 5577, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/675883669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 675883669}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 675883669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 26}, {'gid': 5586, 'name': 'd', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/1932805485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 1932805485}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 1932805485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:24:40.510 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.a mds_join_fs cephfs2 2023-08-27T11:24:40.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.713+0000 7f20721ff700 1 Processor -- start 2023-08-27T11:24:40.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.713+0000 7f20721ff700 1 -- start start 2023-08-27T11:24:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f20721ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f206c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f20721ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f206c0c4780 0x7f206c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f20721ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0c6040 con 0x7f206c0c9010 2023-08-27T11:24:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f20721ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c0c7d00 con 0x7f206c0c4780 2023-08-27T11:24:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f20721ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c8510 con 0x7f206c151b70 2023-08-27T11:24:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f206bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f206c0c9010 0x7f206c0c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51662/0 (socket says 172.21.15.43:51662) 2023-08-27T11:24:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.714+0000 7f206bfff700 1 -- 172.21.15.43:0/1771189029 learned_addr learned my addr 172.21.15.43:0/1771189029 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:40.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206affd700 1 --2- 172.21.15.43:0/1771189029 >> v2:172.21.15.57:3300/0 conn(0x7f206c0c4780 0x7f206c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206b7fe700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f206c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676474214 0 0) 0x7f206c0c6040 con 0x7f206c0c9010 2023-08-27T11:24:40.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20540035b0 con 0x7f206c0c9010 2023-08-27T11:24:40.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510072708 0 0) 0x7f20540035b0 con 0x7f206c0c9010 2023-08-27T11:24:40.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 msgr2=0x7f206c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f206c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 >> v2:172.21.15.57:3300/0 conn(0x7f206c0c4780 msgr2=0x7f206c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 --2- 172.21.15.43:0/1771189029 >> v2:172.21.15.57:3300/0 conn(0x7f206c0c4780 0x7f206c0c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0c8b80 con 0x7f206c0c9010 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f20640019f0 con 0x7f206c0c9010 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 >> v1:172.21.15.43:6789/0 conn(0x7f206c0c9010 legacy=0x7f206c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f2054003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f2054004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2054004d90 0x7f2054005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c7d00 con 0x7f2054004040 2023-08-27T11:24:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0c8510 con 0x7f2054004d90 2023-08-27T11:24:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205400bbd0 con 0x7f206c151b70 2023-08-27T11:24:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206affd700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f2054004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206b7fe700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f2054003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.715+0000 7f206bfff700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2054004d90 0x7f2054005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 -- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 msgr2=0x7f2054003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c151b70 0x7f2054003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 -- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2054004d90 msgr2=0x7f2054005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2054004d90 0x7f2054005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 -- 172.21.15.43:0/1771189029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540035b0 con 0x7f2054004040 2023-08-27T11:24:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206affd700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f2054004850 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2060009b60 tx=0x7f2054005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54317cf3a96d79a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000e6c0 con 0x7f2054004040 2023-08-27T11:24:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206000e820 con 0x7f2054004040 2023-08-27T11:24:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.716+0000 7f206a7fc700 1 -- 172.21.15.43:0/1771189029 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000eb90 con 0x7f2054004040 2023-08-27T11:24:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 -- 172.21.15.43:0/1771189029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 msgr2=0x7f2054004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 --2- 172.21.15.43:0/1771189029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f2054004850 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2060009b60 tx=0x7f2054005880 comp rx=0 tx=0).stop 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f206bfff700 1 -- 172.21.15.43:0/1771189029 reap_dead start 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 -- 172.21.15.43:0/1771189029 shutdown_connections 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 -- 172.21.15.43:0/1771189029 >> 172.21.15.43:0/1771189029 conn(0x7f206c0ab8f0 msgr2=0x7f206c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 -- 172.21.15.43:0/1771189029 shutdown_connections 2023-08-27T11:24:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.717+0000 7f20721ff700 1 -- 172.21.15.43:0/1771189029 wait complete. 2023-08-27T11:24:40.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.719+0000 7f20721ff700 1 Processor -- start 2023-08-27T11:24:40.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.719+0000 7f20721ff700 1 -- start start 2023-08-27T11:24:40.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f206c1e9e00 0x7f206c1ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c145f40 0x7f206c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c1e99e0 con 0x7f2054004040 2023-08-27T11:24:40.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c152620 con 0x7f206c1e9e00 2023-08-27T11:24:40.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f20721ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c152e30 con 0x7f206c145f40 2023-08-27T11:24:40.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46720/0 (socket says 172.21.15.43:46720) 2023-08-27T11:24:40.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 -- 172.21.15.43:0/3418306960 learned_addr learned my addr 172.21.15.43:0/3418306960 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:40.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206affd700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f206c1e9e00 0x7f206c1ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206bfff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c145f40 0x7f206c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 -- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c145f40 msgr2=0x7f206c1463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c145f40 0x7f206c1463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 -- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f206c1e9e00 msgr2=0x7f206c1ea280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f206c1e9e00 0x7f206c1ea280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.720+0000 7f206b7fe700 1 -- 172.21.15.43:0/3418306960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c152870 con 0x7f2054004040 2023-08-27T11:24:40.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f206b7fe700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f205c011aa0 tx=0x7f205c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00f980 con 0x7f2054004040 2023-08-27T11:24:40.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c00fae0 con 0x7f2054004040 2023-08-27T11:24:40.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c00fe90 con 0x7f2054004040 2023-08-27T11:24:40.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c152b50 con 0x7f2054004040 2023-08-27T11:24:40.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.721+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c146910 con 0x7f2054004040 2023-08-27T11:24:40.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.722+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c1e9740 con 0x7f2054004040 2023-08-27T11:24:40.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.723+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f205c014440 con 0x7f2054004040 2023-08-27T11:24:40.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.724+0000 7f2053fff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 0x7f205806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:40.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.724+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f205c088c80 con 0x7f2054004040 2023-08-27T11:24:40.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.724+0000 7f206affd700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 0x7f205806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:40.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.725+0000 7f206affd700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 0x7f205806c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20600090b0 tx=0x7f2060008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:40.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.728+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f206c1e9740 con 0x7f2054004040 2023-08-27T11:24:40.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.944+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f206c1e9740 con 0x7f2054004040 2023-08-27T11:24:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.949+0000 7f2053fff700 1 -- 172.21.15.43:0/3418306960 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v16)=0 v16) v1 ==== 117+0+0 (secure 0 0 0) 0x7f206c1e9740 con 0x7f2054004040 2023-08-27T11:24:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 msgr2=0x7f205806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 0x7f205806c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20600090b0 tx=0x7f2060008030 comp rx=0 tx=0).stop 2023-08-27T11:24:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 msgr2=0x7f206c0c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f205c011aa0 tx=0x7f205c011e60 comp rx=0 tx=0).stop 2023-08-27T11:24:40.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 shutdown_connections 2023-08-27T11:24:40.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f205806a0e0 0x7f205806c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f206c145f40 0x7f206c1463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2054004040 0x7f206c0c2710 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 --2- 172.21.15.43:0/3418306960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f206c1e9e00 0x7f206c1ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:40.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 >> 172.21.15.43:0/3418306960 conn(0x7f206c0ab8f0 msgr2=0x7f206c0aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:40.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 shutdown_connections 2023-08-27T11:24:40.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:40.951+0000 7f20721ff700 1 -- 172.21.15.43:0/3418306960 wait complete. 2023-08-27T11:24:40.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.c mds_join_fs cephfs2 2023-08-27T11:24:41.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.173+0000 7f07801ff700 1 Processor -- start 2023-08-27T11:24:41.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.174+0000 7f07801ff700 1 -- start start 2023-08-27T11:24:41.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.174+0000 7f07801ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f07801ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f07780ac410 0x7f07780c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f07801ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780c80c0 con 0x7f0778151cd0 2023-08-27T11:24:41.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f07801ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780c9bd0 con 0x7f07780ac410 2023-08-27T11:24:41.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f07801ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07781555a0 con 0x7f07780c49f0 2023-08-27T11:24:41.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f077df9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f077df9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48918/0 (socket says 172.21.15.43:48918) 2023-08-27T11:24:41.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f077df9b700 1 -- 172.21.15.43:0/734623511 learned_addr learned my addr 172.21.15.43:0/734623511 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:41.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.175+0000 7f077e79c700 1 --2- 172.21.15.43:0/734623511 >> v2:172.21.15.57:3300/0 conn(0x7f07780ac410 0x7f07780c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077df9b700 1 -- 172.21.15.43:0/734623511 >> v2:172.21.15.57:3300/0 conn(0x7f07780ac410 msgr2=0x7f07780c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:41.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077df9b700 1 --2- 172.21.15.43:0/734623511 >> v2:172.21.15.57:3300/0 conn(0x7f07780ac410 0x7f07780c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077df9b700 1 -- 172.21.15.43:0/734623511 >> v1:172.21.15.57:6789/0 conn(0x7f0778151cd0 legacy=0x7f07780c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077df9b700 1 -- 172.21.15.43:0/734623511 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07781552c0 con 0x7f07780c49f0 2023-08-27T11:24:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077df9b700 1 --2- 172.21.15.43:0/734623511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07740098f0 tx=0x7f0774009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c349131ad7e96df6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077cf99700 1 -- 172.21.15.43:0/734623511 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011830 con 0x7f07780c49f0 2023-08-27T11:24:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077cf99700 1 -- 172.21.15.43:0/734623511 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774011990 con 0x7f07780c49f0 2023-08-27T11:24:41.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.176+0000 7f077cf99700 1 -- 172.21.15.43:0/734623511 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774011d20 con 0x7f07780c49f0 2023-08-27T11:24:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 -- 172.21.15.43:0/734623511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 msgr2=0x7f0778151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 --2- 172.21.15.43:0/734623511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07740098f0 tx=0x7f0774009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 -- 172.21.15.43:0/734623511 shutdown_connections 2023-08-27T11:24:41.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 --2- 172.21.15.43:0/734623511 >> v2:172.21.15.57:3300/0 conn(0x7f07780ac410 0x7f07780c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 --2- 172.21.15.43:0/734623511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778151790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 -- 172.21.15.43:0/734623511 >> 172.21.15.43:0/734623511 conn(0x7f07780ab8f0 msgr2=0x7f07780abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 -- 172.21.15.43:0/734623511 shutdown_connections 2023-08-27T11:24:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.177+0000 7f07801ff700 1 -- 172.21.15.43:0/734623511 wait complete. 2023-08-27T11:24:41.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.179+0000 7f07801ff700 1 Processor -- start 2023-08-27T11:24:41.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.180+0000 7f07801ff700 1 -- start start 2023-08-27T11:24:41.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 0x7f07781569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778156000 con 0x7f07780ac410 2023-08-27T11:24:41.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077814b8d0 con 0x7f0778151cd0 2023-08-27T11:24:41.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f07801ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07781559f0 con 0x7f07780c49f0 2023-08-27T11:24:41.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f077df9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f077df9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46736/0 (socket says 172.21.15.43:46736) 2023-08-27T11:24:41.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.181+0000 7f077df9b700 1 -- 172.21.15.43:0/2502136954 learned_addr learned my addr 172.21.15.43:0/2502136954 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:41.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077d79a700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077e79c700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 0x7f07781569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 -- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 msgr2=0x7f0778156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 -- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 msgr2=0x7f07781569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 0x7f07781569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 -- 172.21.15.43:0/2502136954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0774009550 con 0x7f07780ac410 2023-08-27T11:24:41.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077e79c700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 0x7f07781569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:41.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f077df9b700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0774009c40 tx=0x7f0774004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0774004480 con 0x7f07780ac410 2023-08-27T11:24:41.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077401f070 con 0x7f07780ac410 2023-08-27T11:24:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07781ea4b0 con 0x7f07780ac410 2023-08-27T11:24:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07740038e0 con 0x7f07780ac410 2023-08-27T11:24:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.182+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07781ea790 con 0x7f07780ac410 2023-08-27T11:24:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.183+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07780c86b0 con 0x7f07780ac410 2023-08-27T11:24:41.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.184+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0774021030 con 0x7f07780ac410 2023-08-27T11:24:41.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.185+0000 7f076e7fc700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 0x7f075c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.185+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07740899e0 con 0x7f07780ac410 2023-08-27T11:24:41.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.185+0000 7f077d79a700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 0x7f075c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.186+0000 7f077d79a700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 0x7f075c06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07780afed0 tx=0x7f0768009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.189+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f07740550c0 con 0x7f07780ac410 2023-08-27T11:24:41.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.398+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f0778074680 con 0x7f07780ac410 2023-08-27T11:24:41.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.402+0000 7f076e7fc700 1 -- 172.21.15.43:0/2502136954 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v17)=0 v17) v1 ==== 117+0+0 (secure 0 0 0) 0x7f07740150b0 con 0x7f07780ac410 2023-08-27T11:24:41.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 msgr2=0x7f075c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 0x7f075c06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f07780afed0 tx=0x7f0768009040 comp rx=0 tx=0).stop 2023-08-27T11:24:41.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 msgr2=0x7f077814b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0774009c40 tx=0x7f0774004750 comp rx=0 tx=0).stop 2023-08-27T11:24:41.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 shutdown_connections 2023-08-27T11:24:41.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075c06a0e0 0x7f075c06c5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0778151cd0 0x7f07781569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07780ac410 0x7f077814b390 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 --2- 172.21.15.43:0/2502136954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07780c49f0 0x7f0778156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 >> 172.21.15.43:0/2502136954 conn(0x7f07780ab8f0 msgr2=0x7f07780abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:41.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 shutdown_connections 2023-08-27T11:24:41.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.405+0000 7f07801ff700 1 -- 172.21.15.43:0/2502136954 wait complete. 2023-08-27T11:24:41.424 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.b mds_join_fs cephfs2 2023-08-27T11:24:41.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.627+0000 7fd86ebff700 1 Processor -- start 2023-08-27T11:24:41.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.627+0000 7fd86ebff700 1 -- start start 2023-08-27T11:24:41.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.628+0000 7fd86ebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd868136f50 0x7fd8680c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.628+0000 7fd86ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd86806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.628+0000 7fd86ebff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd868137330 con 0x7fd86806b370 2023-08-27T11:24:41.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86ebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd868154450 con 0x7fd868136f50 2023-08-27T11:24:41.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd868158840 con 0x7fd868158340 2023-08-27T11:24:41.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd868136f50 0x7fd8680c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd868136f50 0x7fd8680c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46742/0 (socket says 172.21.15.43:46742) 2023-08-27T11:24:41.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 -- 172.21.15.43:0/3608739109 learned_addr learned my addr 172.21.15.43:0/3608739109 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:41.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd867fff700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd86806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 -- 172.21.15.43:0/3608739109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 msgr2=0x7fd86806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd86806ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 -- 172.21.15.43:0/3608739109 >> v1:172.21.15.57:6789/0 conn(0x7fd86806b370 legacy=0x7fd86806cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 -- 172.21.15.43:0/3608739109 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8681546f0 con 0x7fd868136f50 2023-08-27T11:24:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd867fff700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd86806ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:41.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.629+0000 7fd86c99b700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd868136f50 0x7fd8680c03e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0098f0 tx=0x7fd85c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e175afde68e12c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd8677fe700 1 -- 172.21.15.43:0/3608739109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c004230 con 0x7fd868136f50 2023-08-27T11:24:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd8677fe700 1 -- 172.21.15.43:0/3608739109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c004390 con 0x7fd868136f50 2023-08-27T11:24:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd8677fe700 1 -- 172.21.15.43:0/3608739109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c0036a0 con 0x7fd868136f50 2023-08-27T11:24:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 -- 172.21.15.43:0/3608739109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd868136f50 msgr2=0x7fd8680c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd868136f50 0x7fd8680c03e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0098f0 tx=0x7fd85c009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 -- 172.21.15.43:0/3608739109 shutdown_connections 2023-08-27T11:24:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd868136f50 0x7fd8680c03e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 --2- 172.21.15.43:0/3608739109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd86806ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 -- 172.21.15.43:0/3608739109 >> 172.21.15.43:0/3608739109 conn(0x7fd86806a310 msgr2=0x7fd86806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:41.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.630+0000 7fd86ebff700 1 -- 172.21.15.43:0/3608739109 shutdown_connections 2023-08-27T11:24:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.631+0000 7fd86ebff700 1 -- 172.21.15.43:0/3608739109 wait complete. 2023-08-27T11:24:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.632+0000 7fd86ebff700 1 Processor -- start 2023-08-27T11:24:41.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.632+0000 7fd86ebff700 1 -- start start 2023-08-27T11:24:41.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868136f50 0x7fd8681533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd8680c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680c5ae0 con 0x7fd86806b370 2023-08-27T11:24:41.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8681ea300 con 0x7fd868136f50 2023-08-27T11:24:41.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8681ea5e0 con 0x7fd868158340 2023-08-27T11:24:41.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46744/0 (socket says 172.21.15.43:46744) 2023-08-27T11:24:41.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.633+0000 7fd86c99b700 1 -- 172.21.15.43:0/2243865533 learned_addr learned my addr 172.21.15.43:0/2243865533 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:41.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd867fff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868136f50 0x7fd8681533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86d19c700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd8680c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 -- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 msgr2=0x7fd8680c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd8680c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 -- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868136f50 msgr2=0x7fd8681533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868136f50 0x7fd8681533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 -- 172.21.15.43:0/2243865533 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009550 con 0x7fd86806b370 2023-08-27T11:24:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd86c99b700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009130 tx=0x7fd85c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c003cd0 con 0x7fd86806b370 2023-08-27T11:24:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c01f070 con 0x7fd86806b370 2023-08-27T11:24:41.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.634+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00b8a0 con 0x7fd86806b370 2023-08-27T11:24:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.635+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8680c3fa0 con 0x7fd86806b370 2023-08-27T11:24:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.635+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd868153cf0 con 0x7fd86806b370 2023-08-27T11:24:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.636+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86804ee70 con 0x7fd86806b370 2023-08-27T11:24:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.637+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd85c021030 con 0x7fd86806b370 2023-08-27T11:24:41.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.638+0000 7fd8657fa700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 0x7fd84c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.638+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd85c089b20 con 0x7fd86806b370 2023-08-27T11:24:41.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.638+0000 7fd867fff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 0x7fd84c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:41.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.639+0000 7fd867fff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 0x7fd84c06c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8681358e0 tx=0x7fd854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:41.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.642+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd85c055200 con 0x7fd86806b370 2023-08-27T11:24:41.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.852+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7fd86804ee70 con 0x7fd86806b370 2023-08-27T11:24:41.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.856+0000 7fd8657fa700 1 -- 172.21.15.43:0/2243865533 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v18)=0 v18) v1 ==== 117+0+0 (secure 0 0 0) 0x7fd85c058820 con 0x7fd86806b370 2023-08-27T11:24:41.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 msgr2=0x7fd84c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 0x7fd84c06c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8681358e0 tx=0x7fd854008040 comp rx=0 tx=0).stop 2023-08-27T11:24:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 msgr2=0x7fd86813bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009130 tx=0x7fd85c004750 comp rx=0 tx=0).stop 2023-08-27T11:24:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 shutdown_connections 2023-08-27T11:24:41.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd84c06a0e0 0x7fd84c06c5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd868158340 0x7fd8680c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd86806b370 0x7fd86813bba0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 --2- 172.21.15.43:0/2243865533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd868136f50 0x7fd8681533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:41.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 >> 172.21.15.43:0/2243865533 conn(0x7fd86806a310 msgr2=0x7fd868157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:41.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 shutdown_connections 2023-08-27T11:24:41.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:41.859+0000 7fd86ebff700 1 -- 172.21.15.43:0/2243865533 wait complete. 2023-08-27T11:24:41.879 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:42.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.078+0000 7fa247fff700 1 Processor -- start 2023-08-27T11:24:42.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.078+0000 7fa247fff700 1 -- start start 2023-08-27T11:24:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.079+0000 7fa247fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa24006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.079+0000 7fa247fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa240155910 0x7fa240155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.079+0000 7fa247fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24006d700 con 0x7fa24006ca60 2023-08-27T11:24:42.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.079+0000 7fa247fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2401530b0 con 0x7fa240155910 2023-08-27T11:24:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.079+0000 7fa247fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24014c860 con 0x7fa2400c51a0 2023-08-27T11:24:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa24559a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa24006ca60 0x7fa2400aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51670/0 (socket says 172.21.15.43:51670) 2023-08-27T11:24:42.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa24559a700 1 -- 172.21.15.43:0/121213790 learned_addr learned my addr 172.21.15.43:0/121213790 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:42.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa24659c700 1 --2- 172.21.15.43:0/121213790 >> v2:172.21.15.57:3300/0 conn(0x7fa240155910 0x7fa240155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa245d9b700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa24006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40681749 0 0) 0x7fa24006d700 con 0x7fa24006ca60 2023-08-27T11:24:42.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa22c0035b0 con 0x7fa24006ca60 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865468680 0 0) 0x7fa22c0035b0 con 0x7fa24006ca60 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 msgr2=0x7fa24006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa24006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 >> v2:172.21.15.57:3300/0 conn(0x7fa240155910 msgr2=0x7fa240155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 --2- 172.21.15.43:0/121213790 >> v2:172.21.15.57:3300/0 conn(0x7fa240155910 0x7fa240155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240152430 con 0x7fa24006ca60 2023-08-27T11:24:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.080+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fa230001670 con 0x7fa24006ca60 2023-08-27T11:24:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 >> v1:172.21.15.43:6789/0 conn(0x7fa24006ca60 legacy=0x7fa2400aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c003a30 0x7fa22c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa22c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa22c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401530b0 con 0x7fa22c004d90 2023-08-27T11:24:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24014c860 con 0x7fa22c003a30 2023-08-27T11:24:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c00ba40 con 0x7fa2400c51a0 2023-08-27T11:24:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa22c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24559a700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa22c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa245d9b700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c003a30 0x7fa22c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 -- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 msgr2=0x7fa22c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2400c51a0 0x7fa22c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 -- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c003a30 msgr2=0x7fa22c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa22c003a30 0x7fa22c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.081+0000 7fa24659c700 1 -- 172.21.15.43:0/121213790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0035b0 con 0x7fa22c004d90 2023-08-27T11:24:42.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa24659c700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa22c005210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa238009fc0 tx=0x7fa22c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb6093e895afbd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800ec30 con 0x7fa22c004d90 2023-08-27T11:24:42.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800f040 con 0x7fa22c004d90 2023-08-27T11:24:42.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa244d99700 1 -- 172.21.15.43:0/121213790 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238014480 con 0x7fa22c004d90 2023-08-27T11:24:42.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa247fff700 1 -- 172.21.15.43:0/121213790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 msgr2=0x7fa22c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa247fff700 1 --2- 172.21.15.43:0/121213790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa22c005210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa238009fc0 tx=0x7fa22c005880 comp rx=0 tx=0).stop 2023-08-27T11:24:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa24659c700 1 -- 172.21.15.43:0/121213790 reap_dead start 2023-08-27T11:24:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa247fff700 1 -- 172.21.15.43:0/121213790 shutdown_connections 2023-08-27T11:24:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.082+0000 7fa247fff700 1 -- 172.21.15.43:0/121213790 >> 172.21.15.43:0/121213790 conn(0x7fa24006aa50 msgr2=0x7fa2400c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:42.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.083+0000 7fa247fff700 1 -- 172.21.15.43:0/121213790 shutdown_connections 2023-08-27T11:24:42.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.083+0000 7fa247fff700 1 -- 172.21.15.43:0/121213790 wait complete. 2023-08-27T11:24:42.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.085+0000 7fa247fff700 1 Processor -- start 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.085+0000 7fa247fff700 1 -- start start 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa240150ca0 0x7fa2400a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2400a7eb0 0x7fa2400be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400a5710 con 0x7fa22c004d90 2023-08-27T11:24:42.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2401ea420 con 0x7fa2400a7eb0 2023-08-27T11:24:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.086+0000 7fa247fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400a8360 con 0x7fa240150ca0 2023-08-27T11:24:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46762/0 (socket says 172.21.15.43:46762) 2023-08-27T11:24:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 -- 172.21.15.43:0/625729236 learned_addr learned my addr 172.21.15.43:0/625729236 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:42.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa24559a700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa240150ca0 0x7fa2400a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa24659c700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2400a7eb0 0x7fa2400be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 -- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa240150ca0 msgr2=0x7fa2400a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa240150ca0 0x7fa2400a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 -- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2400a7eb0 msgr2=0x7fa2400be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2400a7eb0 0x7fa2400be1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 -- 172.21.15.43:0/625729236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400a4520 con 0x7fa22c004d90 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.087+0000 7fa245d9b700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa23c011ad0 tx=0x7fa23c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.088+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00f8e0 con 0x7fa22c004d90 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.088+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c00fa40 con 0x7fa22c004d90 2023-08-27T11:24:42.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.088+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2400a4800 con 0x7fa22c004d90 2023-08-27T11:24:42.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.088+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00fdf0 con 0x7fa22c004d90 2023-08-27T11:24:42.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.088+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2400bd9d0 con 0x7fa22c004d90 2023-08-27T11:24:42.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.089+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400be020 con 0x7fa22c004d90 2023-08-27T11:24:42.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.090+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa23c014440 con 0x7fa22c004d90 2023-08-27T11:24:42.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.091+0000 7fa2367fc700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.091+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa23c088ba0 con 0x7fa22c004d90 2023-08-27T11:24:42.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.091+0000 7fa24559a700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.091+0000 7fa24559a700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 0x7fa22406c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa240150a00 tx=0x7fa230000fc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.095+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa23c054340 con 0x7fa22c004d90 2023-08-27T11:24:42.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.302+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa24004ee70 con 0x7fa22c004d90 2023-08-27T11:24:42.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.304+0000 7fa2367fc700 1 -- 172.21.15.43:0/625729236 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+18233 (secure 0 0 0) 0x7fa23c022020 con 0x7fa22c004d90 2023-08-27T11:24:42.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:42.306 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":47,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:33.876379+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 msgr2=0x7fa22406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 0x7fa22406c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa240150a00 tx=0x7fa230000fc0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 msgr2=0x7fa2401e9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa23c011ad0 tx=0x7fa23c011de0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 shutdown_connections 2023-08-27T11:24:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa22406a0e0 0x7fa22406c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2400a7eb0 0x7fa2400be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa22c004d90 0x7fa2401e9ee0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 --2- 172.21.15.43:0/625729236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa240150ca0 0x7fa2400a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 >> 172.21.15.43:0/625729236 conn(0x7fa24006aa50 msgr2=0x7fa2400c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:42.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 shutdown_connections 2023-08-27T11:24:42.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.306+0000 7fa247fff700 1 -- 172.21.15.43:0/625729236 wait complete. 2023-08-27T11:24:42.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:24:31.109964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:24:31.765112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:24:42.327 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:24:42.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.532+0000 7f9a89bff700 1 Processor -- start 2023-08-27T11:24:42.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.532+0000 7f9a89bff700 1 -- start start 2023-08-27T11:24:42.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a89bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a840ac410 0x7f9a840c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a89bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a840c94c0 0x7f9a8415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a89bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840c80c0 con 0x7f9a840c49f0 2023-08-27T11:24:42.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a89bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a841555a0 con 0x7f9a840c94c0 2023-08-27T11:24:42.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a89bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a841552c0 con 0x7f9a840ac410 2023-08-27T11:24:42.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a83fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a840c94c0 0x7f9a8415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.533+0000 7f9a83fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a840c94c0 0x7f9a8415eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46766/0 (socket says 172.21.15.43:46766) 2023-08-27T11:24:42.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 -- 172.21.15.43:0/262049020 learned_addr learned my addr 172.21.15.43:0/262049020 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:42.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a82ffd700 1 --2- 172.21.15.43:0/262049020 >> v2:172.21.15.57:3300/0 conn(0x7f9a840ac410 0x7f9a840c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 -- 172.21.15.43:0/262049020 >> v2:172.21.15.57:3300/0 conn(0x7f9a840ac410 msgr2=0x7f9a840c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 --2- 172.21.15.43:0/262049020 >> v2:172.21.15.57:3300/0 conn(0x7f9a840ac410 0x7f9a840c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 -- 172.21.15.43:0/262049020 >> v1:172.21.15.57:6789/0 conn(0x7f9a840c49f0 legacy=0x7f9a84151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 -- 172.21.15.43:0/262049020 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840c8360 con 0x7f9a840c94c0 2023-08-27T11:24:42.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a83fff700 1 --2- 172.21.15.43:0/262049020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840c94c0 0x7f9a8415eee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a84072830 tx=0x7f9a7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26558d405c033f1e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a827fc700 1 -- 172.21.15.43:0/262049020 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00e070 con 0x7f9a840c94c0 2023-08-27T11:24:42.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a827fc700 1 -- 172.21.15.43:0/262049020 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7c00b9c0 con 0x7f9a840c94c0 2023-08-27T11:24:42.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.534+0000 7f9a827fc700 1 -- 172.21.15.43:0/262049020 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00bd70 con 0x7f9a840c94c0 2023-08-27T11:24:42.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 -- 172.21.15.43:0/262049020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840c94c0 msgr2=0x7f9a8415eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 --2- 172.21.15.43:0/262049020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840c94c0 0x7f9a8415eee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a84072830 tx=0x7f9a7c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:42.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 -- 172.21.15.43:0/262049020 shutdown_connections 2023-08-27T11:24:42.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 --2- 172.21.15.43:0/262049020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840c94c0 0x7f9a8415eee0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 --2- 172.21.15.43:0/262049020 >> v2:172.21.15.57:3300/0 conn(0x7f9a840ac410 0x7f9a840c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 -- 172.21.15.43:0/262049020 >> 172.21.15.43:0/262049020 conn(0x7f9a840ab8f0 msgr2=0x7f9a840abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:42.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 -- 172.21.15.43:0/262049020 shutdown_connections 2023-08-27T11:24:42.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.535+0000 7f9a89bff700 1 -- 172.21.15.43:0/262049020 wait complete. 2023-08-27T11:24:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.537+0000 7f9a89bff700 1 Processor -- start 2023-08-27T11:24:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.538+0000 7f9a89bff700 1 -- start start 2023-08-27T11:24:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 0x7f9a84149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a840c94c0 0x7f9a84149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840c1a50 con 0x7f9a840ac410 2023-08-27T11:24:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840c16b0 con 0x7f9a840c94c0 2023-08-27T11:24:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a89bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840c13d0 con 0x7f9a840c49f0 2023-08-27T11:24:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46772/0 (socket says 172.21.15.43:46772) 2023-08-27T11:24:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a837fe700 1 -- 172.21.15.43:0/2979729792 learned_addr learned my addr 172.21.15.43:0/2979729792 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a82ffd700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 0x7f9a84149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a83fff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a840c94c0 0x7f9a84149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.539+0000 7f9a837fe700 1 -- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 msgr2=0x7f9a84149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a837fe700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 0x7f9a84149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a837fe700 1 -- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a840c94c0 msgr2=0x7f9a84149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a837fe700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a840c94c0 0x7f9a84149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a837fe700 1 -- 172.21.15.43:0/2979729792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c009b30 con 0x7f9a840ac410 2023-08-27T11:24:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a82ffd700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 0x7f9a84149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a837fe700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c510 tx=0x7f9a7400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740052d0 con 0x7f9a840ac410 2023-08-27T11:24:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74005430 con 0x7f9a840ac410 2023-08-27T11:24:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a841ec9c0 con 0x7f9a840ac410 2023-08-27T11:24:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740038c0 con 0x7f9a840ac410 2023-08-27T11:24:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.540+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a841ecf80 con 0x7f9a840ac410 2023-08-27T11:24:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.541+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a841ec820 con 0x7f9a840ac410 2023-08-27T11:24:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.542+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a74003a20 con 0x7f9a840ac410 2023-08-27T11:24:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.544+0000 7f9a6bfff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 0x7f9a7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.544+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a740879b0 con 0x7f9a840ac410 2023-08-27T11:24:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.544+0000 7f9a82ffd700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 0x7f9a7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.544+0000 7f9a82ffd700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 0x7f9a7006c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9a840c3b50 tx=0x7f9a78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.548+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9a841ec820 con 0x7f9a840ac410 2023-08-27T11:24:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.754+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a841ec820 con 0x7f9a840ac410 2023-08-27T11:24:42.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.755+0000 7f9a6bfff700 1 -- 172.21.15.43:0/2979729792 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a74017020 con 0x7f9a840ac410 2023-08-27T11:24:42.757 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:24:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 msgr2=0x7f9a7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 0x7f9a7006c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9a840c3b50 tx=0x7f9a78008040 comp rx=0 tx=0).stop 2023-08-27T11:24:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 msgr2=0x7f9a840ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c510 tx=0x7f9a7400c820 comp rx=0 tx=0).stop 2023-08-27T11:24:42.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 shutdown_connections 2023-08-27T11:24:42.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a7006a0e0 0x7f9a7006c5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a840c94c0 0x7f9a84149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a840ac410 0x7f9a840ada70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 --2- 172.21.15.43:0/2979729792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a840c49f0 0x7f9a84149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 >> 172.21.15.43:0/2979729792 conn(0x7f9a840ab8f0 msgr2=0x7f9a840abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:42.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 shutdown_connections 2023-08-27T11:24:42.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.757+0000 7f9a89bff700 1 -- 172.21.15.43:0/2979729792 wait complete. 2023-08-27T11:24:42.777 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:24:42.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.983+0000 7f14e9bff700 1 Processor -- start 2023-08-27T11:24:42.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.984+0000 7f14e9bff700 1 -- start start 2023-08-27T11:24:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e9bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14e40c7c00 0x7f14e40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e9bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14e406ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e9bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e4154660 con 0x7f14e4151d20 2023-08-27T11:24:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e9bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e40c5750 con 0x7f14e40c7c00 2023-08-27T11:24:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e9bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e4154940 con 0x7f14e406a8e0 2023-08-27T11:24:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e37fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f14e4151d20 0x7f14e40ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51680/0 (socket says 172.21.15.43:51680) 2023-08-27T11:24:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e37fe700 1 -- 172.21.15.43:0/3599042558 learned_addr learned my addr 172.21.15.43:0/3599042558 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:42.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/3599042558 >> v2:172.21.15.57:3300/0 conn(0x7f14e40c7c00 0x7f14e40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e3fff700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14e406ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317217689 0 0) 0x7f14e4154660 con 0x7f14e4151d20 2023-08-27T11:24:42.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.985+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14cc0035b0 con 0x7f14e4151d20 2023-08-27T11:24:42.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547501187 0 0) 0x7f14cc0035b0 con 0x7f14e4151d20 2023-08-27T11:24:42.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 msgr2=0x7f14e406ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14e406ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 >> v2:172.21.15.57:3300/0 conn(0x7f14e40c7c00 msgr2=0x7f14e40c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 --2- 172.21.15.43:0/3599042558 >> v2:172.21.15.57:3300/0 conn(0x7f14e40c7c00 0x7f14e40c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4154c20 con 0x7f14e4151d20 2023-08-27T11:24:42.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f14d4001670 con 0x7f14e4151d20 2023-08-27T11:24:42.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 >> v1:172.21.15.43:6789/0 conn(0x7f14e4151d20 legacy=0x7f14e40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14cc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14cc004d90 0x7f14cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:42.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e4154940 con 0x7f14cc003ff0 2023-08-27T11:24:42.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc00ba40 con 0x7f14cc004d90 2023-08-27T11:24:42.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc00bc00 con 0x7f14e406a8e0 2023-08-27T11:24:42.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e37fe700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14cc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.986+0000 7f14e3fff700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14cc004d90 0x7f14cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 -- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 msgr2=0x7f14cc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e406a8e0 0x7f14cc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 -- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14cc004d90 msgr2=0x7f14cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14cc004d90 0x7f14cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:42.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 -- 172.21.15.43:0/3599042558 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0035b0 con 0x7f14cc003ff0 2023-08-27T11:24:42.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14cc004850 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009b60 tx=0x7f14cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1dd5cb9107ae3c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:42.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800e6c0 con 0x7f14cc003ff0 2023-08-27T11:24:42.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800e820 con 0x7f14cc003ff0 2023-08-27T11:24:42.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.987+0000 7f14e27fc700 1 -- 172.21.15.43:0/3599042558 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800eb90 con 0x7f14cc003ff0 2023-08-27T11:24:42.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 -- 172.21.15.43:0/3599042558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 msgr2=0x7f14cc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:42.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 --2- 172.21.15.43:0/3599042558 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14cc004850 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009b60 tx=0x7f14cc005880 comp rx=0 tx=0).stop 2023-08-27T11:24:42.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e3fff700 1 -- 172.21.15.43:0/3599042558 reap_dead start 2023-08-27T11:24:42.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 -- 172.21.15.43:0/3599042558 shutdown_connections 2023-08-27T11:24:42.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 -- 172.21.15.43:0/3599042558 >> 172.21.15.43:0/3599042558 conn(0x7f14e40c9d00 msgr2=0x7f14e40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:42.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 -- 172.21.15.43:0/3599042558 shutdown_connections 2023-08-27T11:24:42.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.988+0000 7f14e9bff700 1 -- 172.21.15.43:0/3599042558 wait complete. 2023-08-27T11:24:43.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.989+0000 7f14e9bff700 1 Processor -- start 2023-08-27T11:24:43.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.990+0000 7f14e9bff700 1 -- start start 2023-08-27T11:24:43.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.990+0000 7f14e9bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.990+0000 7f14e9bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e4148660 0x7f14e4147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.990+0000 7f14e9bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 0x7f14e41e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e9bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e40c2d10 con 0x7f14cc003ff0 2023-08-27T11:24:43.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e9bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e414d8c0 con 0x7f14e4148210 2023-08-27T11:24:43.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e9bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e41ea220 con 0x7f14e4148660 2023-08-27T11:24:43.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46784/0 (socket says 172.21.15.43:46784) 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 -- 172.21.15.43:0/2405215868 learned_addr learned my addr 172.21.15.43:0/2405215868 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e4148660 0x7f14e4147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e3fff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 0x7f14e41e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 -- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e4148660 msgr2=0x7f14e4147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e4148660 0x7f14e4147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 -- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 msgr2=0x7f14e41e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 0x7f14e41e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 -- 172.21.15.43:0/2405215868 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e41ea500 con 0x7f14cc003ff0 2023-08-27T11:24:43.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e3fff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 0x7f14e41e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:43.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.991+0000 7f14e37fe700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f14d4007340 tx=0x7f14d4007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.992+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400f6c0 con 0x7f14cc003ff0 2023-08-27T11:24:43.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.992+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400f840 con 0x7f14cc003ff0 2023-08-27T11:24:43.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.992+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400fbf0 con 0x7f14cc003ff0 2023-08-27T11:24:43.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.992+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e414d4e0 con 0x7f14cc003ff0 2023-08-27T11:24:43.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.992+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e41e9c40 con 0x7f14cc003ff0 2023-08-27T11:24:43.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.993+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e414d670 con 0x7f14cc003ff0 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.994+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14d400fd50 con 0x7f14cc003ff0 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.995+0000 7f14cbfff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 0x7f14d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.995+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14d4088470 con 0x7f14cc003ff0 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.995+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 0x7f14d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.996+0000 7f14e2ffd700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 0x7f14d006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14d80090b0 tx=0x7f14d801f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:42.999+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14d4053c00 con 0x7f14cc003ff0 2023-08-27T11:24:43.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.211+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14e41ea690 con 0x7f14cc003ff0 2023-08-27T11:24:43.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.212+0000 7f14cbfff700 1 -- 172.21.15.43:0/2405215868 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14d4057220 con 0x7f14cc003ff0 2023-08-27T11:24:43.214 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:24:43.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 msgr2=0x7f14d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 0x7f14d006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14d80090b0 tx=0x7f14d801f040 comp rx=0 tx=0).stop 2023-08-27T11:24:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 msgr2=0x7f14e414e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f14d4007340 tx=0x7f14d4007650 comp rx=0 tx=0).stop 2023-08-27T11:24:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 shutdown_connections 2023-08-27T11:24:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14d006a0e0 0x7f14d006c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e4148210 0x7f14e41e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14cc003ff0 0x7f14e414e240 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.214+0000 7f14e9bff700 1 --2- 172.21.15.43:0/2405215868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e4148660 0x7f14e4147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.215+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 >> 172.21.15.43:0/2405215868 conn(0x7f14e40c9d00 msgr2=0x7f14e40bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.215+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 shutdown_connections 2023-08-27T11:24:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.215+0000 7f14e9bff700 1 -- 172.21.15.43:0/2405215868 wait complete. 2023-08-27T11:24:43.235 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:24:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.438+0000 7f084a3ff700 1 Processor -- start 2023-08-27T11:24:43.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.438+0000 7f084a3ff700 1 -- start start 2023-08-27T11:24:43.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084a3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f08440c7c00 0x7f08440c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084a3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f084406a8e0 0x7f084406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084a3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0844154660 con 0x7f0844151d20 2023-08-27T11:24:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084a3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440c5750 con 0x7f084406a8e0 2023-08-27T11:24:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084a3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0844154940 con 0x7f08440c7c00 2023-08-27T11:24:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f084406a8e0 0x7f084406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f084406a8e0 0x7f084406acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46794/0 (socket says 172.21.15.43:46794) 2023-08-27T11:24:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 -- 172.21.15.43:0/1802107988 learned_addr learned my addr 172.21.15.43:0/1802107988 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f08437fe700 1 --2- 172.21.15.43:0/1802107988 >> v2:172.21.15.57:3300/0 conn(0x7f08440c7c00 0x7f08440c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 -- 172.21.15.43:0/1802107988 >> v2:172.21.15.57:3300/0 conn(0x7f08440c7c00 msgr2=0x7f08440c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 --2- 172.21.15.43:0/1802107988 >> v2:172.21.15.57:3300/0 conn(0x7f08440c7c00 0x7f08440c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.440+0000 7f084899c700 1 -- 172.21.15.43:0/1802107988 >> v1:172.21.15.57:6789/0 conn(0x7f0844151d20 legacy=0x7f08440ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f084899c700 1 -- 172.21.15.43:0/1802107988 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844154c20 con 0x7f084406a8e0 2023-08-27T11:24:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f0842ffd700 1 -- 172.21.15.43:0/1802107988 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889569689 0 0) 0x7f0844154660 con 0x7f0844151d20 2023-08-27T11:24:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f084899c700 1 --2- 172.21.15.43:0/1802107988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f084406acf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f08440cac40 tx=0x7f083c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3d618c06ac3a82 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f0842ffd700 1 -- 172.21.15.43:0/1802107988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00e070 con 0x7f084406a8e0 2023-08-27T11:24:43.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f0842ffd700 1 -- 172.21.15.43:0/1802107988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c00b910 con 0x7f084406a8e0 2023-08-27T11:24:43.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.441+0000 7f0842ffd700 1 -- 172.21.15.43:0/1802107988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c00bcc0 con 0x7f084406a8e0 2023-08-27T11:24:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 -- 172.21.15.43:0/1802107988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 msgr2=0x7f084406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 --2- 172.21.15.43:0/1802107988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f084406acf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f08440cac40 tx=0x7f083c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 -- 172.21.15.43:0/1802107988 shutdown_connections 2023-08-27T11:24:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 --2- 172.21.15.43:0/1802107988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f084406acf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 --2- 172.21.15.43:0/1802107988 >> v2:172.21.15.57:3300/0 conn(0x7f08440c7c00 0x7f08440c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 -- 172.21.15.43:0/1802107988 >> 172.21.15.43:0/1802107988 conn(0x7f08440c9d00 msgr2=0x7f08440ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:43.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 -- 172.21.15.43:0/1802107988 shutdown_connections 2023-08-27T11:24:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.442+0000 7f084a3ff700 1 -- 172.21.15.43:0/1802107988 wait complete. 2023-08-27T11:24:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.443+0000 7f084a3ff700 1 Processor -- start 2023-08-27T11:24:43.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.444+0000 7f084a3ff700 1 -- start start 2023-08-27T11:24:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.444+0000 7f084a3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.444+0000 7f084a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 0x7f08441ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f084a3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0844151d20 0x7f08441eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f084a3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844158230 con 0x7f084406a8e0 2023-08-27T11:24:43.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f084a3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440c1750 con 0x7f0844151d20 2023-08-27T11:24:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f084a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440c1d10 con 0x7f08440c7c00 2023-08-27T11:24:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46796/0 (socket says 172.21.15.43:46796) 2023-08-27T11:24:43.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 -- 172.21.15.43:0/841324885 learned_addr learned my addr 172.21.15.43:0/841324885 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f084899c700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0844151d20 0x7f08441eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f08437fe700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 0x7f08441ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 -- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 msgr2=0x7f08441ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 0x7f08441ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 -- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0844151d20 msgr2=0x7f08441eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0844151d20 0x7f08441eaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 -- 172.21.15.43:0/841324885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083c009b30 con 0x7f084406a8e0 2023-08-27T11:24:43.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f08437fe700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 0x7f08441ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:43.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.445+0000 7f0843fff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f083400c580 tx=0x7f083400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.446+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08340054e0 con 0x7f084406a8e0 2023-08-27T11:24:43.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.446+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834003680 con 0x7f084406a8e0 2023-08-27T11:24:43.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.446+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834003a30 con 0x7f084406a8e0 2023-08-27T11:24:43.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.446+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08441ed620 con 0x7f084406a8e0 2023-08-27T11:24:43.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.446+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440c19a0 con 0x7f084406a8e0 2023-08-27T11:24:43.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.447+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084404ee70 con 0x7f084406a8e0 2023-08-27T11:24:43.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.448+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0834003b90 con 0x7f084406a8e0 2023-08-27T11:24:43.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.449+0000 7f0840ff9700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 0x7f083006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.449+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0834087a60 con 0x7f084406a8e0 2023-08-27T11:24:43.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.450+0000 7f08437fe700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 0x7f083006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.450+0000 7f08437fe700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 0x7f083006c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08440c0c70 tx=0x7f0838008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.454+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0834053020 con 0x7f084406a8e0 2023-08-27T11:24:43.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.665+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08440ac650 con 0x7f084406a8e0 2023-08-27T11:24:43.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.666+0000 7f0840ff9700 1 -- 172.21.15.43:0/841324885 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0834017070 con 0x7f084406a8e0 2023-08-27T11:24:43.726 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:24:43.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 msgr2=0x7f083006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 0x7f083006c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08440c0c70 tx=0x7f0838008040 comp rx=0 tx=0).stop 2023-08-27T11:24:43.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 msgr2=0x7f08440c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f083400c580 tx=0x7f083400c890 comp rx=0 tx=0).stop 2023-08-27T11:24:43.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 shutdown_connections 2023-08-27T11:24:43.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f083006a0e0 0x7f083006c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0844151d20 0x7f08441eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f084406a8e0 0x7f08440c3910 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 --2- 172.21.15.43:0/841324885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f08440c7c00 0x7f08441ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.668+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 >> 172.21.15.43:0/841324885 conn(0x7f08440c9d00 msgr2=0x7f08440ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:43.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.669+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 shutdown_connections 2023-08-27T11:24:43.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.669+0000 7f084a3ff700 1 -- 172.21.15.43:0/841324885 wait complete. 2023-08-27T11:24:43.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:24:43.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.933+0000 7f9b63fff700 1 Processor -- start 2023-08-27T11:24:43.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.933+0000 7f9b63fff700 1 -- start start 2023-08-27T11:24:43.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c151d20 0x7f9b5c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b63fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b63fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c154660 con 0x7f9b5c0c7c00 2023-08-27T11:24:43.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b63fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c5750 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b63fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c154940 con 0x7f9b5c151d20 2023-08-27T11:24:43.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b6259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b6259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46812/0 (socket says 172.21.15.43:46812) 2023-08-27T11:24:43.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.934+0000 7f9b6259c700 1 -- 172.21.15.43:0/3413172492 learned_addr learned my addr 172.21.15.43:0/3413172492 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:43.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b61d9b700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c151d20 0x7f9b5c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b6259c700 1 -- 172.21.15.43:0/3413172492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c151d20 msgr2=0x7f9b5c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:43.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b6259c700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c151d20 0x7f9b5c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b6259c700 1 -- 172.21.15.43:0/3413172492 >> v1:172.21.15.57:6789/0 conn(0x7f9b5c0c7c00 legacy=0x7f9b5c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:43.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b6259c700 1 -- 172.21.15.43:0/3413172492 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c154c20 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b6259c700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97949ca0dd1e1091 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b60d99700 1 -- 172.21.15.43:0/3413172492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400e070 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b60d99700 1 -- 172.21.15.43:0/3413172492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54003a70 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.935+0000 7f9b60d99700 1 -- 172.21.15.43:0/3413172492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54003e20 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 -- 172.21.15.43:0/3413172492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 msgr2=0x7f9b5c06ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e50 tx=0x7f9b5400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:43.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 -- 172.21.15.43:0/3413172492 shutdown_connections 2023-08-27T11:24:43.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c06ad70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3413172492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c151d20 0x7f9b5c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 -- 172.21.15.43:0/3413172492 >> 172.21.15.43:0/3413172492 conn(0x7f9b5c0c9d00 msgr2=0x7f9b5c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:43.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 -- 172.21.15.43:0/3413172492 shutdown_connections 2023-08-27T11:24:43.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.936+0000 7f9b63fff700 1 -- 172.21.15.43:0/3413172492 wait complete. 2023-08-27T11:24:43.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.938+0000 7f9b63fff700 1 Processor -- start 2023-08-27T11:24:43.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.938+0000 7f9b63fff700 1 -- start start 2023-08-27T11:24:43.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c0c7c00 0x7f9b5c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b5c151d20 0x7f9b5c147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c2d70 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c151300 con 0x7f9b5c151d20 2023-08-27T11:24:43.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b63fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c14e790 con 0x7f9b5c0c7c00 2023-08-27T11:24:43.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46814/0 (socket says 172.21.15.43:46814) 2023-08-27T11:24:43.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 -- 172.21.15.43:0/3972358248 learned_addr learned my addr 172.21.15.43:0/3972358248 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:43.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b6159a700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c0c7c00 0x7f9b5c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b6259c700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b5c151d20 0x7f9b5c147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 -- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c0c7c00 msgr2=0x7f9b5c14c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c0c7c00 0x7f9b5c14c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 -- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b5c151d20 msgr2=0x7f9b5c147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b5c151d20 0x7f9b5c147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:43.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.939+0000 7f9b61d9b700 1 -- 172.21.15.43:0/3972358248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009b30 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b61d9b700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800d830 tx=0x7f9b5800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580125f0 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b58012750 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c1ea010 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58012b00 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.940+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c14e140 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.941+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c14df80 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.942+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b58012c60 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.943+0000 7f9b527fc700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 0x7f9b4006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:43.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.944+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b58088500 con 0x7f9b5c06a8e0 2023-08-27T11:24:43.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.944+0000 7f9b6159a700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 0x7f9b4006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:43.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.944+0000 7f9b6159a700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 0x7f9b4006c5d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0abbd0 tx=0x7f9b4c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:43.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:43.948+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b58053be0 con 0x7f9b5c06a8e0 2023-08-27T11:24:44.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.159+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b5c04ee70 con 0x7f9b5c06a8e0 2023-08-27T11:24:44.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.160+0000 7f9b527fc700 1 -- 172.21.15.43:0/3972358248 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b58057200 con 0x7f9b5c06a8e0 2023-08-27T11:24:44.162 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:24:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 msgr2=0x7f9b4006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 0x7f9b4006c5d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0abbd0 tx=0x7f9b4c007ec0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 msgr2=0x7f9b5c150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9b5800d830 tx=0x7f9b5800db40 comp rx=0 tx=0).stop 2023-08-27T11:24:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 shutdown_connections 2023-08-27T11:24:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4006a110 0x7f9b4006c5d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b5c151d20 0x7f9b5c147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b5c06a8e0 0x7f9b5c150920 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 --2- 172.21.15.43:0/3972358248 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b5c0c7c00 0x7f9b5c14c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 >> 172.21.15.43:0/3972358248 conn(0x7f9b5c0c9d00 msgr2=0x7f9b5c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 shutdown_connections 2023-08-27T11:24:44.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.162+0000 7f9b63fff700 1 -- 172.21.15.43:0/3972358248 wait complete. 2023-08-27T11:24:44.182 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:24:44.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.384+0000 7fcfad9ff700 1 Processor -- start 2023-08-27T11:24:44.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.384+0000 7fcfad9ff700 1 -- start start 2023-08-27T11:24:44.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfad9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfa814e960 0x7fcfa80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfad9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcfa80c50d0 0x7fcfa80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfad9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa8154d00 con 0x7fcfa80a79c0 2023-08-27T11:24:44.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfad9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80baf30 con 0x7fcfa814e960 2023-08-27T11:24:44.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfad9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa8154fe0 con 0x7fcfa80c50d0 2023-08-27T11:24:44.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.385+0000 7fcfa6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfa814e960 0x7fcfa80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcfa80a79c0 0x7fcfa80c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51688/0 (socket says 172.21.15.43:51688) 2023-08-27T11:24:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa67fc700 1 -- 172.21.15.43:0/3900008347 learned_addr learned my addr 172.21.15.43:0/3900008347 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa77fe700 1 --2- 172.21.15.43:0/3900008347 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80c50d0 0x7fcfa80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa6ffd700 1 -- 172.21.15.43:0/3900008347 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80c50d0 msgr2=0x7fcfa80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa6ffd700 1 --2- 172.21.15.43:0/3900008347 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80c50d0 0x7fcfa80c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa6ffd700 1 -- 172.21.15.43:0/3900008347 >> v1:172.21.15.43:6789/0 conn(0x7fcfa80a79c0 legacy=0x7fcfa80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa6ffd700 1 -- 172.21.15.43:0/3900008347 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa81552c0 con 0x7fcfa814e960 2023-08-27T11:24:44.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa5ffb700 1 -- 172.21.15.43:0/3900008347 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726621394 0 0) 0x7fcfa8154d00 con 0x7fcfa80a79c0 2023-08-27T11:24:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.386+0000 7fcfa6ffd700 1 --2- 172.21.15.43:0/3900008347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a7480 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcfa81521a0 tx=0x7fcf98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a761b70d6308786 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfa5ffb700 1 -- 172.21.15.43:0/3900008347 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98011830 con 0x7fcfa814e960 2023-08-27T11:24:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfa5ffb700 1 -- 172.21.15.43:0/3900008347 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98011990 con 0x7fcfa814e960 2023-08-27T11:24:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfa5ffb700 1 -- 172.21.15.43:0/3900008347 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98011d20 con 0x7fcfa814e960 2023-08-27T11:24:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3900008347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 msgr2=0x7fcfa80a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3900008347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a7480 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcfa81521a0 tx=0x7fcf98009b20 comp rx=0 tx=0).stop 2023-08-27T11:24:44.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3900008347 shutdown_connections 2023-08-27T11:24:44.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3900008347 >> v2:172.21.15.57:3300/0 conn(0x7fcfa80c50d0 0x7fcfa80c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3900008347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a7480 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3900008347 >> 172.21.15.43:0/3900008347 conn(0x7fcfa806aa50 msgr2=0x7fcfa80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:44.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3900008347 shutdown_connections 2023-08-27T11:24:44.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.387+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3900008347 wait complete. 2023-08-27T11:24:44.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.390+0000 7fcfad9ff700 1 Processor -- start 2023-08-27T11:24:44.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.390+0000 7fcfad9ff700 1 -- start start 2023-08-27T11:24:44.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa80a79c0 0x7fcfa80c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfa80c50d0 0x7fcfa814af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80bf2d0 con 0x7fcfa814e960 2023-08-27T11:24:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80bf500 con 0x7fcfa80a79c0 2023-08-27T11:24:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfad9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80aacf0 con 0x7fcfa80c50d0 2023-08-27T11:24:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46828/0 (socket says 172.21.15.43:46828) 2023-08-27T11:24:44.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.391+0000 7fcfa77fe700 1 -- 172.21.15.43:0/3239626824 learned_addr learned my addr 172.21.15.43:0/3239626824 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:44.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa67fc700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfa80c50d0 0x7fcfa814af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa6ffd700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa80a79c0 0x7fcfa80c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 -- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfa80c50d0 msgr2=0x7fcfa814af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfa80c50d0 0x7fcfa814af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 -- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa80a79c0 msgr2=0x7fcfa80c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa80a79c0 0x7fcfa80c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 -- 172.21.15.43:0/3239626824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf980094a0 con 0x7fcfa814e960 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfa77fe700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007e40 tx=0x7fcfa000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000eea0 con 0x7fcfa814e960 2023-08-27T11:24:44.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0014420 con 0x7fcfa814e960 2023-08-27T11:24:44.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00147b0 con 0x7fcfa814e960 2023-08-27T11:24:44.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.392+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80aa4e0 con 0x7fcfa814e960 2023-08-27T11:24:44.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.393+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80aa730 con 0x7fcfa814e960 2023-08-27T11:24:44.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.394+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80bb390 con 0x7fcfa814e960 2023-08-27T11:24:44.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.394+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcfa0014910 con 0x7fcfa814e960 2023-08-27T11:24:44.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.396+0000 7fcf8ffff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 0x7fcf9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.396+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfa0088dc0 con 0x7fcfa814e960 2023-08-27T11:24:44.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.396+0000 7fcfa6ffd700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 0x7fcf9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.397+0000 7fcfa6ffd700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 0x7fcf9406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf980090b0 tx=0x7fcf9801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.400+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcfa0054410 con 0x7fcfa814e960 2023-08-27T11:24:44.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.614+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcfa804ee70 con 0x7fcfa814e960 2023-08-27T11:24:44.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.614+0000 7fcf8ffff700 1 -- 172.21.15.43:0/3239626824 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+268 (secure 0 0 0) 0x7fcfa0057a30 con 0x7fcfa814e960 2023-08-27T11:24:44.616 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:44.616 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:24:44.617 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:44.617 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:24:44.617 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:24:44.617 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:44.617 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:44.618 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:24:44.618 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:24:44.618 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:44.618 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:44.619 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 7, 2023-08-27T11:24:44.619 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "cephfs_metadata" 2023-08-27T11:24:44.619 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:24:44.619 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:24:44.619 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 8, 2023-08-27T11:24:44.620 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "cephfs_data" 2023-08-27T11:24:44.620 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:24:44.620 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:24:44.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 msgr2=0x7fcf9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 0x7fcf9406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf980090b0 tx=0x7fcf9801c040 comp rx=0 tx=0).stop 2023-08-27T11:24:44.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 msgr2=0x7fcfa80a8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007e40 tx=0x7fcfa000e3c0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 shutdown_connections 2023-08-27T11:24:44.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf9406a0e0 0x7fcf9406c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfa814e960 0x7fcfa80a8bd0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfa80a79c0 0x7fcfa80c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 --2- 172.21.15.43:0/3239626824 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfa80c50d0 0x7fcfa814af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 >> 172.21.15.43:0/3239626824 conn(0x7fcfa806aa50 msgr2=0x7fcfa80c2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:44.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 shutdown_connections 2023-08-27T11:24:44.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.617+0000 7fcfad9ff700 1 -- 172.21.15.43:0/3239626824 wait complete. 2023-08-27T11:24:44.637 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-08-27T11:24:44.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-08-27T11:24:44.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.841+0000 7f56bd9ff700 1 Processor -- start 2023-08-27T11:24:44.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.842+0000 7f56bd9ff700 1 -- start start 2023-08-27T11:24:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56bd9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f56b80a6d90 0x7f56b8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56bd9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b8158590 con 0x7f56b80c1630 2023-08-27T11:24:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56bd9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b8157c60 con 0x7f56b8151e20 2023-08-27T11:24:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56bd9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b8157f40 con 0x7f56b80a6d90 2023-08-27T11:24:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56b67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f56b80c1630 0x7f56b8154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51702/0 (socket says 172.21.15.43:51702) 2023-08-27T11:24:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56b67fc700 1 -- 172.21.15.43:0/1329236046 learned_addr learned my addr 172.21.15.43:0/1329236046 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:44.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56b77fe700 1 --2- 172.21.15.43:0/1329236046 >> v2:172.21.15.43:3300/0 conn(0x7f56b80a6d90 0x7f56b8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.843+0000 7f56b5ffb700 1 -- 172.21.15.43:0/1329236046 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850221526 0 0) 0x7f56b8158590 con 0x7f56b80c1630 2023-08-27T11:24:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b5ffb700 1 -- 172.21.15.43:0/1329236046 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a00035b0 con 0x7f56b80c1630 2023-08-27T11:24:44.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b77fe700 1 -- 172.21.15.43:0/1329236046 >> v1:172.21.15.57:6789/0 conn(0x7f56b8151e20 legacy=0x7f56b80c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b77fe700 1 -- 172.21.15.43:0/1329236046 >> v1:172.21.15.43:6789/0 conn(0x7f56b80c1630 legacy=0x7f56b8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b77fe700 1 -- 172.21.15.43:0/1329236046 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8158220 con 0x7f56b80a6d90 2023-08-27T11:24:44.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b77fe700 1 --2- 172.21.15.43:0/1329236046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b80a6d90 0x7f56b8154d60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed3cac5a9fd050b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b5ffb700 1 -- 172.21.15.43:0/1329236046 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b000e070 con 0x7f56b80a6d90 2023-08-27T11:24:44.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b5ffb700 1 -- 172.21.15.43:0/1329236046 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b000bb20 con 0x7f56b80a6d90 2023-08-27T11:24:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.844+0000 7f56b5ffb700 1 -- 172.21.15.43:0/1329236046 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0012430 con 0x7f56b80a6d90 2023-08-27T11:24:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 -- 172.21.15.43:0/1329236046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b80a6d90 msgr2=0x7f56b8154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/1329236046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b80a6d90 0x7f56b8154d60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009d90 tx=0x7f56b000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 -- 172.21.15.43:0/1329236046 shutdown_connections 2023-08-27T11:24:44.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/1329236046 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b80a6d90 0x7f56b8154d60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 -- 172.21.15.43:0/1329236046 >> 172.21.15.43:0/1329236046 conn(0x7f56b80a97d0 msgr2=0x7f56b80a9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 -- 172.21.15.43:0/1329236046 shutdown_connections 2023-08-27T11:24:44.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.845+0000 7f56bd9ff700 1 -- 172.21.15.43:0/1329236046 wait complete. 2023-08-27T11:24:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.847+0000 7f56bd9ff700 1 Processor -- start 2023-08-27T11:24:44.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.847+0000 7f56bd9ff700 1 -- start start 2023-08-27T11:24:44.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56b80a6d90 0x7f56b80c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56b80c1630 0x7f56b80ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80ad050 con 0x7f56b8151e20 2023-08-27T11:24:44.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80c7b50 con 0x7f56b80c1630 2023-08-27T11:24:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56bd9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8155700 con 0x7f56b80a6d90 2023-08-27T11:24:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46840/0 (socket says 172.21.15.43:46840) 2023-08-27T11:24:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 -- 172.21.15.43:0/643968863 learned_addr learned my addr 172.21.15.43:0/643968863 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:44.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b6ffd700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56b80a6d90 0x7f56b80c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b67fc700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56b80c1630 0x7f56b80ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 -- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56b80a6d90 msgr2=0x7f56b80c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56b80a6d90 0x7f56b80c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 -- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56b80c1630 msgr2=0x7f56b80ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:44.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56b80c1630 0x7f56b80ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.848+0000 7f56b77fe700 1 -- 172.21.15.43:0/643968863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b0009a70 con 0x7f56b8151e20 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f56b77fe700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56b0014040 tx=0x7f56b0004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0012430 con 0x7f56b8151e20 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b0020070 con 0x7f56b8151e20 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b80aac60 con 0x7f56b8151e20 2023-08-27T11:24:44.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0004280 con 0x7f56b8151e20 2023-08-27T11:24:44.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.849+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b81559c0 con 0x7f56b8151e20 2023-08-27T11:24:44.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.850+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b804ee70 con 0x7f56b8151e20 2023-08-27T11:24:44.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.851+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f56b00043e0 con 0x7f56b8151e20 2023-08-27T11:24:44.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.852+0000 7f569ffff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 0x7f56a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:44.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.852+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56b0022070 con 0x7f56b8151e20 2023-08-27T11:24:44.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.852+0000 7f56b6ffd700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 0x7f56a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:44.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.853+0000 7f56b6ffd700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 0x7f56a406c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f56a8000f60 tx=0x7f56a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:44.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:44.856+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56b00bc990 con 0x7f56b8151e20 2023-08-27T11:24:45.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.072+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f56b80c1410 con 0x7f56b8151e20 2023-08-27T11:24:45.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.980+0000 7f569ffff700 1 -- 172.21.15.43:0/643968863 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v48) v1 ==== 140+0+0 (secure 0 0 0) 0x7f56b00558e0 con 0x7f56b8151e20 2023-08-27T11:24:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.985+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 msgr2=0x7f56a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:45.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.985+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 0x7f56a406c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f56a8000f60 tx=0x7f56a8009040 comp rx=0 tx=0).stop 2023-08-27T11:24:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.985+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 msgr2=0x7f56b80acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.985+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f56b0014040 tx=0x7f56b0004b20 comp rx=0 tx=0).stop 2023-08-27T11:24:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 shutdown_connections 2023-08-27T11:24:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f56a406a0e0 0x7f56a406c5a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:45.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f56b8151e20 0x7f56b80acb10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:45.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f56b80a6d90 0x7f56b80c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:45.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 --2- 172.21.15.43:0/643968863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f56b80c1630 0x7f56b80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:45.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 >> 172.21.15.43:0/643968863 conn(0x7f56b80a97d0 msgr2=0x7f56b80a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:45.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 shutdown_connections 2023-08-27T11:24:45.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:45.986+0000 7f56bd9ff700 1 -- 172.21.15.43:0/643968863 wait complete. 2023-08-27T11:24:45.990 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_metadata' created 2023-08-27T11:24:46.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:24:46.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.224+0000 7f47391ff700 1 Processor -- start 2023-08-27T11:24:46.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.224+0000 7f47391ff700 1 -- start start 2023-08-27T11:24:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.225+0000 7f47391ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f47340c7c90 0x7f4734154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.225+0000 7f47391ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734157ee0 0x7f4734158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.225+0000 7f47391ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340c5250 con 0x7f4734151a70 2023-08-27T11:24:46.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.225+0000 7f47391ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340c4710 con 0x7f47340c7c90 2023-08-27T11:24:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.225+0000 7f47391ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c4920 con 0x7f4734157ee0 2023-08-27T11:24:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f4732d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4734151a70 0x7f47340c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51716/0 (socket says 172.21.15.43:51716) 2023-08-27T11:24:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f4732d9d700 1 -- 172.21.15.43:0/3206451197 learned_addr learned my addr 172.21.15.43:0/3206451197 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473259c700 1 --2- 172.21.15.43:0/3206451197 >> v2:172.21.15.57:3300/0 conn(0x7f47340c7c90 0x7f4734154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473359e700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734157ee0 0x7f4734158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f4731d9b700 1 -- 172.21.15.43:0/3206451197 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875756522 0 0) 0x7f47340c5250 con 0x7f4734151a70 2023-08-27T11:24:46.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f4731d9b700 1 -- 172.21.15.43:0/3206451197 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f471c0035b0 con 0x7f4734151a70 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473259c700 1 -- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734157ee0 msgr2=0x7f4734158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473259c700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734157ee0 0x7f4734158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473259c700 1 -- 172.21.15.43:0/3206451197 >> v1:172.21.15.43:6789/0 conn(0x7f4734151a70 legacy=0x7f47340c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.226+0000 7f473259c700 1 -- 172.21.15.43:0/3206451197 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340c4c00 con 0x7f47340c7c90 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.227+0000 7f473259c700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f4734154ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4728009870 tx=0x7f4728009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f6c28052de727a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:46.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.227+0000 7f4731d9b700 1 -- 172.21.15.43:0/3206451197 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011830 con 0x7f47340c7c90 2023-08-27T11:24:46.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.227+0000 7f4731d9b700 1 -- 172.21.15.43:0/3206451197 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728011990 con 0x7f47340c7c90 2023-08-27T11:24:46.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.227+0000 7f4731d9b700 1 -- 172.21.15.43:0/3206451197 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011d20 con 0x7f47340c7c90 2023-08-27T11:24:46.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 -- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 msgr2=0x7f4734154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f4734154ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4728009870 tx=0x7f4728009b80 comp rx=0 tx=0).stop 2023-08-27T11:24:46.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 -- 172.21.15.43:0/3206451197 shutdown_connections 2023-08-27T11:24:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734157ee0 0x7f4734158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 --2- 172.21.15.43:0/3206451197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f4734154ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 -- 172.21.15.43:0/3206451197 >> 172.21.15.43:0/3206451197 conn(0x7f47340c9d90 msgr2=0x7f47340ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 -- 172.21.15.43:0/3206451197 shutdown_connections 2023-08-27T11:24:46.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.228+0000 7f47391ff700 1 -- 172.21.15.43:0/3206451197 wait complete. 2023-08-27T11:24:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.229+0000 7f47391ff700 1 Processor -- start 2023-08-27T11:24:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 -- start start 2023-08-27T11:24:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f47341e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734151a70 0x7f473414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c3680 con 0x7f4734157ee0 2023-08-27T11:24:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c3890 con 0x7f47340c7c90 2023-08-27T11:24:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.230+0000 7f47391ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c3b70 con 0x7f4734151a70 2023-08-27T11:24:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46842/0 (socket says 172.21.15.43:46842) 2023-08-27T11:24:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 -- 172.21.15.43:0/2992008476 learned_addr learned my addr 172.21.15.43:0/2992008476 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f4732d9d700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f47341e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473259c700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734151a70 0x7f473414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 -- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734151a70 msgr2=0x7f473414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734151a70 0x7f473414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 -- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 msgr2=0x7f47341e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f47341e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 -- 172.21.15.43:0/2992008476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094a0 con 0x7f4734157ee0 2023-08-27T11:24:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.231+0000 7f473359e700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f472c00efc0 tx=0x7f472c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:46.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.232+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00cad0 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.232+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00f040 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.232+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00ce70 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.232+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47341ecce0 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.232+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473414b520 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.233+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47341ed200 con 0x7f4734157ee0 2023-08-27T11:24:46.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.234+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f472c014480 con 0x7f4734157ee0 2023-08-27T11:24:46.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.235+0000 7f471b7fe700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 0x7f472006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:46.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.235+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f472c089760 con 0x7f4734157ee0 2023-08-27T11:24:46.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.235+0000 7f4732d9d700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 0x7f472006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:46.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.236+0000 7f4732d9d700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 0x7f472006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47240010e0 tx=0x7f4724007c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:46.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.239+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f472c054d40 con 0x7f4734157ee0 2023-08-27T11:24:46.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.448+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f47341ed200 con 0x7f4734157ee0 2023-08-27T11:24:46.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.989+0000 7f471b7fe700 1 -- 172.21.15.43:0/2992008476 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v49) v1 ==== 172+0+0 (secure 0 0 0) 0x7f47341ed200 con 0x7f4734157ee0 2023-08-27T11:24:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.995+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 msgr2=0x7f472006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.995+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 0x7f472006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47240010e0 tx=0x7f4724007c70 comp rx=0 tx=0).stop 2023-08-27T11:24:46.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.995+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 msgr2=0x7f47341ed4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.995+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f472c00efc0 tx=0x7f472c00c0c0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 shutdown_connections 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f472006a0e0 0x7f472006c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4734157ee0 0x7f47341ed4e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f47340c7c90 0x7f47341e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:46.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 --2- 172.21.15.43:0/2992008476 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4734151a70 0x7f473414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.996+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 >> 172.21.15.43:0/2992008476 conn(0x7f47340c9d90 msgr2=0x7f473414a080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.997+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 shutdown_connections 2023-08-27T11:24:47.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:46.997+0000 7f47391ff700 1 -- 172.21.15.43:0/2992008476 wait complete. 2023-08-27T11:24:47.007 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_data' created 2023-08-27T11:24:47.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-08-27T11:24:47.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.238+0000 7f3c31dff700 1 Processor -- start 2023-08-27T11:24:47.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.238+0000 7f3c31dff700 1 -- start start 2023-08-27T11:24:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.239+0000 7f3c31dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c2c0c5230 0x7f3c2c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c31dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c31dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2c1561f0 con 0x7f3c2c06c5e0 2023-08-27T11:24:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c31dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c152290 con 0x7f3c2c0c5230 2023-08-27T11:24:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c31dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c06d7a0 con 0x7f3c2c155880 2023-08-27T11:24:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c2b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3c2c0c5230 0x7f3c2c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:49080/0 (socket says 172.21.15.43:49080) 2023-08-27T11:24:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.240+0000 7f3c2bfff700 1 -- 172.21.15.43:0/2577574526 learned_addr learned my addr 172.21.15.43:0/2577574526 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2bfff700 1 -- 172.21.15.43:0/2577574526 >> v2:172.21.15.57:3300/0 conn(0x7f3c2c0c5230 msgr2=0x7f3c2c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2bfff700 1 --2- 172.21.15.43:0/2577574526 >> v2:172.21.15.57:3300/0 conn(0x7f3c2c0c5230 0x7f3c2c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2a7fc700 1 -- 172.21.15.43:0/2577574526 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399820974 0 0) 0x7f3c2c1561f0 con 0x7f3c2c06c5e0 2023-08-27T11:24:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2bfff700 1 -- 172.21.15.43:0/2577574526 >> v1:172.21.15.57:6789/0 conn(0x7f3c2c06c5e0 legacy=0x7f3c2c0aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2bfff700 1 -- 172.21.15.43:0/2577574526 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c152550 con 0x7f3c2c155880 2023-08-27T11:24:47.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2bfff700 1 --2- 172.21.15.43:0/2577574526 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009e50 tx=0x7f3c2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc0b0bb82233ecf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2a7fc700 1 -- 172.21.15.43:0/2577574526 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400e070 con 0x7f3c2c155880 2023-08-27T11:24:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2a7fc700 1 -- 172.21.15.43:0/2577574526 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2400b910 con 0x7f3c2c155880 2023-08-27T11:24:47.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.241+0000 7f3c2a7fc700 1 -- 172.21.15.43:0/2577574526 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2400bcc0 con 0x7f3c2c155880 2023-08-27T11:24:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 -- 172.21.15.43:0/2577574526 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 msgr2=0x7f3c2c155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 --2- 172.21.15.43:0/2577574526 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009e50 tx=0x7f3c2400b330 comp rx=0 tx=0).stop 2023-08-27T11:24:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 -- 172.21.15.43:0/2577574526 shutdown_connections 2023-08-27T11:24:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 --2- 172.21.15.43:0/2577574526 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c155880 0x7f3c2c155cb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 --2- 172.21.15.43:0/2577574526 >> v2:172.21.15.57:3300/0 conn(0x7f3c2c0c5230 0x7f3c2c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 -- 172.21.15.43:0/2577574526 >> 172.21.15.43:0/2577574526 conn(0x7f3c2c0c5b10 msgr2=0x7f3c2c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:47.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 -- 172.21.15.43:0/2577574526 shutdown_connections 2023-08-27T11:24:47.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.242+0000 7f3c31dff700 1 -- 172.21.15.43:0/2577574526 wait complete. 2023-08-27T11:24:47.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.244+0000 7f3c31dff700 1 Processor -- start 2023-08-27T11:24:47.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.244+0000 7f3c31dff700 1 -- start start 2023-08-27T11:24:47.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c06c5e0 0x7f3c2c1e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c0c5230 0x7f3c2c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c06fd30 con 0x7f3c2c155880 2023-08-27T11:24:47.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0722d0 con 0x7f3c2c0c5230 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c31dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c1ea060 con 0x7f3c2c06c5e0 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46856/0 (socket says 172.21.15.43:46856) 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 -- 172.21.15.43:0/1955719361 learned_addr learned my addr 172.21.15.43:0/1955719361 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2b7fe700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c06c5e0 0x7f3c2c1e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2affd700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c0c5230 0x7f3c2c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 -- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c06c5e0 msgr2=0x7f3c2c1e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c06c5e0 0x7f3c2c1e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 -- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c0c5230 msgr2=0x7f3c2c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c0c5230 0x7f3c2c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.245+0000 7f3c2bfff700 1 -- 172.21.15.43:0/1955719361 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24009b30 con 0x7f3c2c155880 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c2bfff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b680 tx=0x7f3c24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c240099b0 con 0x7f3c2c155880 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c240092e0 con 0x7f3c2c155880 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c14fdf0 con 0x7f3c2c155880 2023-08-27T11:24:47.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2401b650 con 0x7f3c2c155880 2023-08-27T11:24:47.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.246+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c14f7a0 con 0x7f3c2c155880 2023-08-27T11:24:47.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.247+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c14f600 con 0x7f3c2c155880 2023-08-27T11:24:47.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.249+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c2401b7b0 con 0x7f3c2c155880 2023-08-27T11:24:47.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.250+0000 7f3c13fff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 0x7f3c1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:47.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.250+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f3c2408a580 con 0x7f3c2c155880 2023-08-27T11:24:47.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.250+0000 7f3c2b7fe700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 0x7f3c1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:47.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.251+0000 7f3c2b7fe700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 0x7f3c1806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c155350 tx=0x7f3c1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:47.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.254+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c24055b30 con 0x7f3c2c155880 2023-08-27T11:24:47.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.509+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f3c2c0a8700 con 0x7f3c2c155880 2023-08-27T11:24:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.989+0000 7f3c13fff700 1 -- 172.21.15.43:0/1955719361 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 9 and data pool 10 v33) v1 ==== 176+0+0 (secure 0 0 0) 0x7f3c2c0a8700 con 0x7f3c2c155880 2023-08-27T11:24:47.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 msgr2=0x7f3c1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 0x7f3c1806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c155350 tx=0x7f3c1c008040 comp rx=0 tx=0).stop 2023-08-27T11:24:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 msgr2=0x7f3c2c14ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b680 tx=0x7f3c24004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 shutdown_connections 2023-08-27T11:24:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c1806a0e0 0x7f3c1806c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c2c155880 0x7f3c2c14ae30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c2c06c5e0 0x7f3c2c1e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 --2- 172.21.15.43:0/1955719361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c2c0c5230 0x7f3c2c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 >> 172.21.15.43:0/1955719361 conn(0x7f3c2c0c5b10 msgr2=0x7f3c2c0a6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:47.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 shutdown_connections 2023-08-27T11:24:47.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:47.993+0000 7f3c31dff700 1 -- 172.21.15.43:0/1955719361 wait complete. 2023-08-27T11:24:47.997 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 9 and data pool 10 2023-08-27T11:24:48.017 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:48.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.218+0000 7f14e7bff700 1 Processor -- start 2023-08-27T11:24:48.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.219+0000 7f14e7bff700 1 -- start start 2023-08-27T11:24:48.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e7bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14e00c4a90 0x7f14e006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e7bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e006c4e0 con 0x7f14e0151a90 2023-08-27T11:24:48.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e7bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e0155370 con 0x7f14e00c4630 2023-08-27T11:24:48.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e7bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00c82c0 con 0x7f14e00c4a90 2023-08-27T11:24:48.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e599b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f14e0151a90 0x7f14e00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51726/0 (socket says 172.21.15.43:51726) 2023-08-27T11:24:48.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e599b700 1 -- 172.21.15.43:0/1434048416 learned_addr learned my addr 172.21.15.43:0/1434048416 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:48.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e619c700 1 --2- 172.21.15.43:0/1434048416 >> v2:172.21.15.57:3300/0 conn(0x7f14e00c4a90 0x7f14e006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e4999700 1 -- 172.21.15.43:0/1434048416 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223527544 0 0) 0x7f14e006c4e0 con 0x7f14e0151a90 2023-08-27T11:24:48.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.220+0000 7f14e4999700 1 -- 172.21.15.43:0/1434048416 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14cc0035b0 con 0x7f14e0151a90 2023-08-27T11:24:48.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e619c700 1 -- 172.21.15.43:0/1434048416 >> v1:172.21.15.57:6789/0 conn(0x7f14e00c4630 legacy=0x7f14e006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e619c700 1 -- 172.21.15.43:0/1434048416 >> v1:172.21.15.43:6789/0 conn(0x7f14e0151a90 legacy=0x7f14e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e619c700 1 -- 172.21.15.43:0/1434048416 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0151e70 con 0x7f14e00c4a90 2023-08-27T11:24:48.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e619c700 1 --2- 172.21.15.43:0/1434048416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4a90 0x7f14e006b480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009d90 tx=0x7f14d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c5ff450cdc377c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e4999700 1 -- 172.21.15.43:0/1434048416 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800e070 con 0x7f14e00c4a90 2023-08-27T11:24:48.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e4999700 1 -- 172.21.15.43:0/1434048416 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800bb20 con 0x7f14e00c4a90 2023-08-27T11:24:48.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.221+0000 7f14e4999700 1 -- 172.21.15.43:0/1434048416 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8012430 con 0x7f14e00c4a90 2023-08-27T11:24:48.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 -- 172.21.15.43:0/1434048416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4a90 msgr2=0x7f14e006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1434048416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4a90 0x7f14e006b480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009d90 tx=0x7f14d800b330 comp rx=0 tx=0).stop 2023-08-27T11:24:48.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 -- 172.21.15.43:0/1434048416 shutdown_connections 2023-08-27T11:24:48.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1434048416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4a90 0x7f14e006b480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 -- 172.21.15.43:0/1434048416 >> 172.21.15.43:0/1434048416 conn(0x7f14e00ab820 msgr2=0x7f14e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:48.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 -- 172.21.15.43:0/1434048416 shutdown_connections 2023-08-27T11:24:48.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.222+0000 7f14e7bff700 1 -- 172.21.15.43:0/1434048416 wait complete. 2023-08-27T11:24:48.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.223+0000 7f14e7bff700 1 Processor -- start 2023-08-27T11:24:48.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 -- start start 2023-08-27T11:24:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4630 0x7f14e01eca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e00c4a90 0x7f14e0153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e014e560 con 0x7f14e0151a90 2023-08-27T11:24:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00bd470 con 0x7f14e00c4630 2023-08-27T11:24:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.224+0000 7f14e7bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c1b50 con 0x7f14e00c4a90 2023-08-27T11:24:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46868/0 (socket says 172.21.15.43:46868) 2023-08-27T11:24:48.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 -- 172.21.15.43:0/1245422066 learned_addr learned my addr 172.21.15.43:0/1245422066 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e519a700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e00c4a90 0x7f14e0153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e599b700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4630 0x7f14e01eca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 -- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e00c4a90 msgr2=0x7f14e0153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e00c4a90 0x7f14e0153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 -- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4630 msgr2=0x7f14e01eca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4630 0x7f14e01eca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 -- 172.21.15.43:0/1245422066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8009a70 con 0x7f14e0151a90 2023-08-27T11:24:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.225+0000 7f14e619c700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ac6e0 tx=0x7f14d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.226+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8012430 con 0x7f14e0151a90 2023-08-27T11:24:48.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.226+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8020070 con 0x7f14e0151a90 2023-08-27T11:24:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.226+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8004280 con 0x7f14e0151a90 2023-08-27T11:24:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.226+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e01e9460 con 0x7f14e0151a90 2023-08-27T11:24:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.226+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e00c0f20 con 0x7f14e0151a90 2023-08-27T11:24:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.227+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e00c0d80 con 0x7f14e0151a90 2023-08-27T11:24:48.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.228+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14d80043e0 con 0x7f14e0151a90 2023-08-27T11:24:48.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.229+0000 7f14d67fc700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.229+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f14d8022070 con 0x7f14e0151a90 2023-08-27T11:24:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.229+0000 7f14e599b700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.230+0000 7f14e599b700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 0x7f14c406c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f14dc007fd0 tx=0x7f14dc007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.233+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f14e00c0d80 con 0x7f14e0151a90 2023-08-27T11:24:48.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.445+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14e00c0d80 con 0x7f14e0151a90 2023-08-27T11:24:48.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.447+0000 7f14d67fc700 1 -- 172.21.15.43:0/1245422066 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+21904 (secure 0 0 0) 0x7f14e00c0d80 con 0x7f14e0151a90 2023-08-27T11:24:48.448 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:48.449 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":50,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:47.511314+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 msgr2=0x7f14c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 0x7f14c406c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f14dc007fd0 tx=0x7f14dc007dc0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 msgr2=0x7f14e01e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ac6e0 tx=0x7f14d8004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 shutdown_connections 2023-08-27T11:24:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f14c406a0e0 0x7f14c406c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f14e0151a90 0x7f14e01e9c40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14e00c4630 0x7f14e01eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 --2- 172.21.15.43:0/1245422066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f14e00c4a90 0x7f14e0153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 >> 172.21.15.43:0/1245422066 conn(0x7f14e00ab820 msgr2=0x7f14e00c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 shutdown_connections 2023-08-27T11:24:48.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.449+0000 7f14e7bff700 1 -- 172.21.15.43:0/1245422066 wait complete. 2023-08-27T11:24:48.469 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:48.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.669+0000 7f4b695ff700 1 Processor -- start 2023-08-27T11:24:48.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.669+0000 7f4b695ff700 1 -- start start 2023-08-27T11:24:48.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b695ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4b640c50d0 0x7f4b640c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b695ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 0x7f4b640c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b695ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b64154d00 con 0x7f4b6414e960 2023-08-27T11:24:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b695ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640baf30 con 0x7f4b640c50d0 2023-08-27T11:24:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b695ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b64154fe0 con 0x7f4b64154740 2023-08-27T11:24:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b62ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4b6414e960 0x7f4b640a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:51736/0 (socket says 172.21.15.43:51736) 2023-08-27T11:24:48.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b62ffd700 1 -- 172.21.15.43:0/4292688961 learned_addr learned my addr 172.21.15.43:0/4292688961 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:48.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b627fc700 1 --2- 172.21.15.43:0/4292688961 >> v2:172.21.15.43:3300/0 conn(0x7f4b640c50d0 0x7f4b640c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b637fe700 1 --2- 172.21.15.43:0/4292688961 >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 0x7f4b640c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b61ffb700 1 -- 172.21.15.43:0/4292688961 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621466579 0 0) 0x7f4b64154d00 con 0x7f4b6414e960 2023-08-27T11:24:48.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b61ffb700 1 -- 172.21.15.43:0/4292688961 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b4c0035b0 con 0x7f4b6414e960 2023-08-27T11:24:48.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b627fc700 1 -- 172.21.15.43:0/4292688961 >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 msgr2=0x7f4b640c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b627fc700 1 --2- 172.21.15.43:0/4292688961 >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 0x7f4b640c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b627fc700 1 -- 172.21.15.43:0/4292688961 >> v1:172.21.15.43:6789/0 conn(0x7f4b6414e960 legacy=0x7f4b640a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b627fc700 1 -- 172.21.15.43:0/4292688961 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b641552c0 con 0x7f4b640c50d0 2023-08-27T11:24:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.671+0000 7f4b637fe700 1 --2- 172.21.15.43:0/4292688961 >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 0x7f4b640c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:48.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b627fc700 1 --2- 172.21.15.43:0/4292688961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b640c3cc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b641521a0 tx=0x7f4b58009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c59e24d30cb7ed3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b61ffb700 1 -- 172.21.15.43:0/4292688961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011830 con 0x7f4b640c50d0 2023-08-27T11:24:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b61ffb700 1 -- 172.21.15.43:0/4292688961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b58011990 con 0x7f4b640c50d0 2023-08-27T11:24:48.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b61ffb700 1 -- 172.21.15.43:0/4292688961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011d00 con 0x7f4b640c50d0 2023-08-27T11:24:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b695ff700 1 -- 172.21.15.43:0/4292688961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 msgr2=0x7f4b640c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.672+0000 7f4b695ff700 1 --2- 172.21.15.43:0/4292688961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b640c3cc0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4b641521a0 tx=0x7f4b58009b20 comp rx=0 tx=0).stop 2023-08-27T11:24:48.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 -- 172.21.15.43:0/4292688961 shutdown_connections 2023-08-27T11:24:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 --2- 172.21.15.43:0/4292688961 >> v2:172.21.15.57:3300/0 conn(0x7f4b64154740 0x7f4b640c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 --2- 172.21.15.43:0/4292688961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b640c3cc0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 -- 172.21.15.43:0/4292688961 >> 172.21.15.43:0/4292688961 conn(0x7f4b6406aa50 msgr2=0x7f4b640c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:48.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 -- 172.21.15.43:0/4292688961 shutdown_connections 2023-08-27T11:24:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.673+0000 7f4b695ff700 1 -- 172.21.15.43:0/4292688961 wait complete. 2023-08-27T11:24:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.674+0000 7f4b695ff700 1 Processor -- start 2023-08-27T11:24:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.674+0000 7f4b695ff700 1 -- start start 2023-08-27T11:24:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6414e960 0x7f4b640c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b64154740 0x7f4b64150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640a8d30 con 0x7f4b640c50d0 2023-08-27T11:24:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b640aa880 con 0x7f4b64154740 2023-08-27T11:24:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.675+0000 7f4b695ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b641ea3e0 con 0x7f4b6414e960 2023-08-27T11:24:48.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46882/0 (socket says 172.21.15.43:46882) 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 -- 172.21.15.43:0/365566508 learned_addr learned my addr 172.21.15.43:0/365566508 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b637fe700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b64154740 0x7f4b64150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b627fc700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6414e960 0x7f4b640c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 -- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6414e960 msgr2=0x7f4b640c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6414e960 0x7f4b640c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 -- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b64154740 msgr2=0x7f4b64150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b64154740 0x7f4b64150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 -- 172.21.15.43:0/365566508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580094a0 con 0x7f4b640c50d0 2023-08-27T11:24:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.676+0000 7f4b62ffd700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c500 tx=0x7f4b5400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.677+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54005d70 con 0x7f4b640c50d0 2023-08-27T11:24:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.677+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400ce70 con 0x7f4b640c50d0 2023-08-27T11:24:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.677+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540072d0 con 0x7f4b640c50d0 2023-08-27T11:24:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.677+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640a58a0 con 0x7f4b640c50d0 2023-08-27T11:24:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.677+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b640aa2c0 con 0x7f4b640c50d0 2023-08-27T11:24:48.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.678+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b640bb390 con 0x7f4b640c50d0 2023-08-27T11:24:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.679+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b54007430 con 0x7f4b640c50d0 2023-08-27T11:24:48.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.679+0000 7f4b4b7fe700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.680+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f4b54087b70 con 0x7f4b640c50d0 2023-08-27T11:24:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.680+0000 7f4b627fc700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.680+0000 7f4b627fc700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b641521a0 tx=0x7f4b58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:48.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.684+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b54052fa0 con 0x7f4b640c50d0 2023-08-27T11:24:48.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.900+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b640a87f0 con 0x7f4b640c50d0 2023-08-27T11:24:48.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.901+0000 7f4b4b7fe700 1 -- 172.21.15.43:0/365566508 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+21891 (secure 0 0 0) 0x7f4b640a87f0 con 0x7f4b640c50d0 2023-08-27T11:24:48.903 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:48.904 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":51,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:48.879550+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 msgr2=0x7f4b5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4b641521a0 tx=0x7f4b58008030 comp rx=0 tx=0).stop 2023-08-27T11:24:48.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 msgr2=0x7f4b641e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400c500 tx=0x7f4b5400c810 comp rx=0 tx=0).stop 2023-08-27T11:24:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 shutdown_connections 2023-08-27T11:24:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.904+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b64154740 0x7f4b64150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.905+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b640c50d0 0x7f4b641e9ea0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.905+0000 7f4b695ff700 1 --2- 172.21.15.43:0/365566508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6414e960 0x7f4b640c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:48.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.905+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 >> 172.21.15.43:0/365566508 conn(0x7f4b6406aa50 msgr2=0x7f4b641535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:48.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.905+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 shutdown_connections 2023-08-27T11:24:48.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:48.905+0000 7f4b695ff700 1 -- 172.21.15.43:0/365566508 wait complete. 2023-08-27T11:24:48.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-08-27T11:24:49.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.134+0000 7f3145dff700 1 Processor -- start 2023-08-27T11:24:49.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.135+0000 7f3145dff700 1 -- start start 2023-08-27T11:24:49.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f3145dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f3140151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f3145dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31400ac410 0x7f31400c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f3145dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400c80c0 con 0x7f3140151cd0 2023-08-27T11:24:49.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f3145dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400c9bd0 con 0x7f31400ac410 2023-08-27T11:24:49.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f3145dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31401555a0 con 0x7f31400c49f0 2023-08-27T11:24:49.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31400ac410 0x7f31400c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f31400ac410 0x7f31400c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58878/0 (socket says 172.21.15.43:58878) 2023-08-27T11:24:49.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 -- 172.21.15.43:0/2768499474 learned_addr learned my addr 172.21.15.43:0/2768499474 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:49.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313f7fe700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f3140151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 -- 172.21.15.43:0/2768499474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 msgr2=0x7f3140151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:49.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f3140151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:49.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 -- 172.21.15.43:0/2768499474 >> v1:172.21.15.43:6789/0 conn(0x7f3140151cd0 legacy=0x7f31400c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:49.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313ffff700 1 -- 172.21.15.43:0/2768499474 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31401552c0 con 0x7f31400ac410 2023-08-27T11:24:49.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.136+0000 7f313effd700 1 -- 172.21.15.43:0/2768499474 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191204417 0 0) 0x7f31400c80c0 con 0x7f3140151cd0 2023-08-27T11:24:49.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f313ffff700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f31400c9690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e80 tx=0x7f313800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f607484ad89aff server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:49.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f313effd700 1 -- 172.21.15.43:0/2768499474 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800e070 con 0x7f31400ac410 2023-08-27T11:24:49.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f313effd700 1 -- 172.21.15.43:0/2768499474 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800b8d0 con 0x7f31400ac410 2023-08-27T11:24:49.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f313effd700 1 -- 172.21.15.43:0/2768499474 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800bc80 con 0x7f31400ac410 2023-08-27T11:24:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f3145dff700 1 -- 172.21.15.43:0/2768499474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 msgr2=0x7f31400c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.137+0000 7f3145dff700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f31400c9690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e80 tx=0x7f313800b330 comp rx=0 tx=0).stop 2023-08-27T11:24:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 -- 172.21.15.43:0/2768499474 shutdown_connections 2023-08-27T11:24:49.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f31400c9690 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:49.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 --2- 172.21.15.43:0/2768499474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f3140151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:49.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 -- 172.21.15.43:0/2768499474 >> 172.21.15.43:0/2768499474 conn(0x7f31400ab8f0 msgr2=0x7f31400abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:49.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 -- 172.21.15.43:0/2768499474 shutdown_connections 2023-08-27T11:24:49.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.138+0000 7f3145dff700 1 -- 172.21.15.43:0/2768499474 wait complete. 2023-08-27T11:24:49.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.139+0000 7f3145dff700 1 Processor -- start 2023-08-27T11:24:49.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.140+0000 7f3145dff700 1 -- start start 2023-08-27T11:24:49.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.140+0000 7f3145dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3145dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f314014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3145dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3140151cd0 0x7f314014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3145dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400ada80 con 0x7f31400ac410 2023-08-27T11:24:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3145dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314014ac50 con 0x7f3140151cd0 2023-08-27T11:24:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3145dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140157e90 con 0x7f31400c49f0 2023-08-27T11:24:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58894/0 (socket says 172.21.15.43:58894) 2023-08-27T11:24:49.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 -- 172.21.15.43:0/1582462397 learned_addr learned my addr 172.21.15.43:0/1582462397 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f3137fff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f314014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313ffff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3140151cd0 0x7f314014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 -- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 msgr2=0x7f314014a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f314014a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:49.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 -- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3140151cd0 msgr2=0x7f314014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3140151cd0 0x7f314014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.141+0000 7f313f7fe700 1 -- 172.21.15.43:0/1582462397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3138009b30 con 0x7f31400ac410 2023-08-27T11:24:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f313f7fe700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f313000e9e0 tx=0x7f313000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130009710 con 0x7f31400ac410 2023-08-27T11:24:49.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000ee80 con 0x7f31400ac410 2023-08-27T11:24:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000ca50 con 0x7f31400ac410 2023-08-27T11:24:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31400ad7a0 con 0x7f31400ac410 2023-08-27T11:24:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.142+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140158750 con 0x7f31400ac410 2023-08-27T11:24:49.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.143+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31401582b0 con 0x7f31400ac410 2023-08-27T11:24:49.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.144+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f313000cbb0 con 0x7f31400ac410 2023-08-27T11:24:49.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.145+0000 7f313cff9700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 0x7f312006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.145+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f3130088880 con 0x7f31400ac410 2023-08-27T11:24:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.145+0000 7f3137fff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 0x7f312006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.146+0000 7f3137fff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 0x7f312006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f31400aa960 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:49.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.150+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3130057730 con 0x7f31400ac410 2023-08-27T11:24:49.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:49.406+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f314006c720 con 0x7f31400ac410 2023-08-27T11:24:50.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.013+0000 7f313cff9700 1 -- 172.21.15.43:0/1582462397 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7f31300572c0 con 0x7f31400ac410 2023-08-27T11:24:50.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 msgr2=0x7f312006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:50.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 0x7f312006c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f31400aa960 tx=0x7f3128009040 comp rx=0 tx=0).stop 2023-08-27T11:24:50.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 msgr2=0x7f3140150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:50.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f313000e9e0 tx=0x7f313000ecf0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 shutdown_connections 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f312006a0e0 0x7f312006c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3140151cd0 0x7f314014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31400ac410 0x7f3140150450 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 --2- 172.21.15.43:0/1582462397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31400c49f0 0x7f314014a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 >> 172.21.15.43:0/1582462397 conn(0x7f31400ab8f0 msgr2=0x7f31400c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:50.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 shutdown_connections 2023-08-27T11:24:50.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.017+0000 7f3145dff700 1 -- 172.21.15.43:0/1582462397 wait complete. 2023-08-27T11:24:50.040 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:24:50.041 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-08-27T11:24:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.248+0000 7fdb4b7ff700 1 Processor -- start 2023-08-27T11:24:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.249+0000 7fdb4b7ff700 1 -- start start 2023-08-27T11:24:50.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb44151d20 0x7fdb440c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb440ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb440abcc0 0x7fdb4406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440c5750 con 0x7fdb440abcc0 2023-08-27T11:24:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb44154660 con 0x7fdb44151d20 2023-08-27T11:24:50.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44154940 con 0x7fdb440c7c00 2023-08-27T11:24:50.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb440abcc0 0x7fdb4406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb440abcc0 0x7fdb4406a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58906/0 (socket says 172.21.15.43:58906) 2023-08-27T11:24:50.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 -- 172.21.15.43:0/4203312020 learned_addr learned my addr 172.21.15.43:0/4203312020 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb48d9a700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb440ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb4959b700 1 --2- 172.21.15.43:0/4203312020 >> v2:172.21.15.57:3300/0 conn(0x7fdb44151d20 0x7fdb440c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 -- 172.21.15.43:0/4203312020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 msgr2=0x7fdb440ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb440ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 -- 172.21.15.43:0/4203312020 >> v2:172.21.15.57:3300/0 conn(0x7fdb44151d20 msgr2=0x7fdb440c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:50.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.250+0000 7fdb49d9c700 1 --2- 172.21.15.43:0/4203312020 >> v2:172.21.15.57:3300/0 conn(0x7fdb44151d20 0x7fdb440c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.251+0000 7fdb49d9c700 1 -- 172.21.15.43:0/4203312020 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44154c20 con 0x7fdb440abcc0 2023-08-27T11:24:50.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.251+0000 7fdb49d9c700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb4406a8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb440cac10 tx=0x7fdb3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdb721df8d81abd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:50.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.251+0000 7fdb3bfff700 1 -- 172.21.15.43:0/4203312020 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00e070 con 0x7fdb440abcc0 2023-08-27T11:24:50.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.251+0000 7fdb3bfff700 1 -- 172.21.15.43:0/4203312020 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00b910 con 0x7fdb440abcc0 2023-08-27T11:24:50.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.251+0000 7fdb3bfff700 1 -- 172.21.15.43:0/4203312020 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00bcc0 con 0x7fdb440abcc0 2023-08-27T11:24:50.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/4203312020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 msgr2=0x7fdb4406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:50.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb4406a8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdb440cac10 tx=0x7fdb3c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:50.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/4203312020 shutdown_connections 2023-08-27T11:24:50.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb4406a8e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/4203312020 >> v2:172.21.15.57:3300/0 conn(0x7fdb44151d20 0x7fdb440c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/4203312020 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb440ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/4203312020 >> 172.21.15.43:0/4203312020 conn(0x7fdb440c9d00 msgr2=0x7fdb440ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:50.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/4203312020 shutdown_connections 2023-08-27T11:24:50.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.252+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/4203312020 wait complete. 2023-08-27T11:24:50.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.253+0000 7fdb4b7ff700 1 Processor -- start 2023-08-27T11:24:50.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.254+0000 7fdb4b7ff700 1 -- start start 2023-08-27T11:24:50.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb44153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 0x7fdb44157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c2bb0 con 0x7fdb440abcc0 2023-08-27T11:24:50.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb441ea5c0 con 0x7fdb44151d20 2023-08-27T11:24:50.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440aa6b0 con 0x7fdb440c7c00 2023-08-27T11:24:50.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58914/0 (socket says 172.21.15.43:58914) 2023-08-27T11:24:50.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 -- 172.21.15.43:0/291917468 learned_addr learned my addr 172.21.15.43:0/291917468 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:50.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb48d9a700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb44153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb49d9c700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 0x7fdb44157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 -- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 msgr2=0x7fdb44153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:50.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb44153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 -- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 msgr2=0x7fdb44157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:50.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 0x7fdb44157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:50.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 -- 172.21.15.43:0/291917468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c009b30 con 0x7fdb440abcc0 2023-08-27T11:24:50.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb49d9c700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 0x7fdb44157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:50.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb48d9a700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb44153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:50.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.255+0000 7fdb4959b700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000e8a0 tx=0x7fdb4000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:50.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.256+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40009590 con 0x7fdb440abcc0 2023-08-27T11:24:50.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.256+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4000eea0 con 0x7fdb440abcc0 2023-08-27T11:24:50.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.256+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb440aac30 con 0x7fdb440abcc0 2023-08-27T11:24:50.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.256+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000ca50 con 0x7fdb440abcc0 2023-08-27T11:24:50.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.256+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb440ab910 con 0x7fdb440abcc0 2023-08-27T11:24:50.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.257+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4404ee70 con 0x7fdb440abcc0 2023-08-27T11:24:50.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.258+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb4000cbb0 con 0x7fdb440abcc0 2023-08-27T11:24:50.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.259+0000 7fdb39ffb700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 0x7fdb2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:50.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.259+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fdb40088870 con 0x7fdb440abcc0 2023-08-27T11:24:50.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.259+0000 7fdb48d9a700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 0x7fdb2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:50.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.260+0000 7fdb48d9a700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 0x7fdb2806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb4414c090 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:50.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.264+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb40057680 con 0x7fdb440abcc0 2023-08-27T11:24:50.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:50.523+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdb440ac650 con 0x7fdb440abcc0 2023-08-27T11:24:51.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.020+0000 7fdb39ffb700 1 -- 172.21.15.43:0/291917468 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7fdb40057210 con 0x7fdb440abcc0 2023-08-27T11:24:51.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 msgr2=0x7fdb2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 0x7fdb2806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdb4414c090 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2023-08-27T11:24:51.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 msgr2=0x7fdb441ea080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000e8a0 tx=0x7fdb4000ec60 comp rx=0 tx=0).stop 2023-08-27T11:24:51.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 shutdown_connections 2023-08-27T11:24:51.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb2806a0e0 0x7fdb2806c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb44151d20 0x7fdb44157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb440abcc0 0x7fdb441ea080 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 --2- 172.21.15.43:0/291917468 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb440c7c00 0x7fdb44153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.023+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 >> 172.21.15.43:0/291917468 conn(0x7fdb440c9d00 msgr2=0x7fdb4414df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:51.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.024+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 shutdown_connections 2023-08-27T11:24:51.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.024+0000 7fdb4b7ff700 1 -- 172.21.15.43:0/291917468 wait complete. 2023-08-27T11:24:51.046 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-08-27T11:24:51.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:51.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.250+0000 7feb717ff700 1 Processor -- start 2023-08-27T11:24:51.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.250+0000 7feb717ff700 1 -- start start 2023-08-27T11:24:51.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb6c0a76f0 0x7feb6c0c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0bbf10 0x7feb6c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feb6c06cc40 0x7feb6c06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c158690 con 0x7feb6c0a76f0 2023-08-27T11:24:51.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c157d60 con 0x7feb6c06cc40 2023-08-27T11:24:51.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb717ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c158040 con 0x7feb6c0bbf10 2023-08-27T11:24:51.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb6c0a76f0 0x7feb6c0c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb6c0a76f0 0x7feb6c0c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58920/0 (socket says 172.21.15.43:58920) 2023-08-27T11:24:51.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 -- 172.21.15.43:0/4016056460 learned_addr learned my addr 172.21.15.43:0/4016056460 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:51.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 -- 172.21.15.43:0/4016056460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0bbf10 msgr2=0x7feb6c06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:51.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 --2- 172.21.15.43:0/4016056460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0bbf10 0x7feb6c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 -- 172.21.15.43:0/4016056460 >> v2:172.21.15.57:3300/0 conn(0x7feb6c06cc40 msgr2=0x7feb6c06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:51.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 --2- 172.21.15.43:0/4016056460 >> v2:172.21.15.57:3300/0 conn(0x7feb6c06cc40 0x7feb6c06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.252+0000 7feb6affd700 1 -- 172.21.15.43:0/4016056460 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c158320 con 0x7feb6c0a76f0 2023-08-27T11:24:51.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb6affd700 1 --2- 172.21.15.43:0/4016056460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0a76f0 0x7feb6c0c5000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0a8040 tx=0x7feb5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e75ece96652bb5d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb6a7fc700 1 -- 172.21.15.43:0/4016056460 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00b870 con 0x7feb6c0a76f0 2023-08-27T11:24:51.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb6a7fc700 1 -- 172.21.15.43:0/4016056460 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c00b9d0 con 0x7feb6c0a76f0 2023-08-27T11:24:51.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb6a7fc700 1 -- 172.21.15.43:0/4016056460 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00bd60 con 0x7feb6c0a76f0 2023-08-27T11:24:51.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 -- 172.21.15.43:0/4016056460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0a76f0 msgr2=0x7feb6c0c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 --2- 172.21.15.43:0/4016056460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0a76f0 0x7feb6c0c5000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0a8040 tx=0x7feb5c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 -- 172.21.15.43:0/4016056460 shutdown_connections 2023-08-27T11:24:51.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 --2- 172.21.15.43:0/4016056460 >> v2:172.21.15.57:3300/0 conn(0x7feb6c06cc40 0x7feb6c06d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 --2- 172.21.15.43:0/4016056460 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0a76f0 0x7feb6c0c5000 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 --2- 172.21.15.43:0/4016056460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0bbf10 0x7feb6c06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.253+0000 7feb717ff700 1 -- 172.21.15.43:0/4016056460 >> 172.21.15.43:0/4016056460 conn(0x7feb6c06aa50 msgr2=0x7feb6c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.254+0000 7feb717ff700 1 -- 172.21.15.43:0/4016056460 shutdown_connections 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.254+0000 7feb717ff700 1 -- 172.21.15.43:0/4016056460 wait complete. 2023-08-27T11:24:51.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.255+0000 7feb717ff700 1 Processor -- start 2023-08-27T11:24:51.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.255+0000 7feb717ff700 1 -- start start 2023-08-27T11:24:51.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb6c06cc40 0x7feb6c0a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 0x7feb6c0aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1511f0 con 0x7feb6c0bbf10 2023-08-27T11:24:51.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0ab6b0 con 0x7feb6c06cc40 2023-08-27T11:24:51.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb717ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c1ea160 con 0x7feb6c0a76f0 2023-08-27T11:24:51.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.256+0000 7feb6b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58930/0 (socket says 172.21.15.43:58930) 2023-08-27T11:24:51.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 -- 172.21.15.43:0/479657623 learned_addr learned my addr 172.21.15.43:0/479657623 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:51.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6affd700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb6c06cc40 0x7feb6c0a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb63fff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 0x7feb6c0aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 -- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 msgr2=0x7feb6c0aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 0x7feb6c0aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 -- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb6c06cc40 msgr2=0x7feb6c0a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb6c06cc40 0x7feb6c0a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 -- 172.21.15.43:0/479657623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c009550 con 0x7feb6c0bbf10 2023-08-27T11:24:51.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb63fff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 0x7feb6c0aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:51.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb6b7fe700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feb6400b970 tx=0x7feb6400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6400c930 con 0x7feb6c0bbf10 2023-08-27T11:24:51.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6400cab0 con 0x7feb6c0bbf10 2023-08-27T11:24:51.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c0a9540 con 0x7feb6c0bbf10 2023-08-27T11:24:51.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.257+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6400ce60 con 0x7feb6c0bbf10 2023-08-27T11:24:51.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.258+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c0a92a0 con 0x7feb6c0bbf10 2023-08-27T11:24:51.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.259+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c158b00 con 0x7feb6c0bbf10 2023-08-27T11:24:51.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.260+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb6401d3b0 con 0x7feb6c0bbf10 2023-08-27T11:24:51.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.261+0000 7feb637fe700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.261+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7feb64088610 con 0x7feb6c0bbf10 2023-08-27T11:24:51.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.261+0000 7feb6affd700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.262+0000 7feb6affd700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.265+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb6c158b00 con 0x7feb6c0bbf10 2023-08-27T11:24:51.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.522+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb6c151330 con 0x7feb6c0bbf10 2023-08-27T11:24:51.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.522+0000 7feb637fe700 1 -- 172.21.15.43:0/479657623 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6051 (secure 0 0 0) 0x7feb6c151330 con 0x7feb6c0bbf10 2023-08-27T11:24:51.524 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:51.524 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5144,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:36.320500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"d","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/1932805485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":1932805485},{"type":"v1","addr":"172.21.15.57:6835","nonce":1932805485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:51.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 msgr2=0x7feb4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feb5c000c00 tx=0x7feb5c008030 comp rx=0 tx=0).stop 2023-08-27T11:24:51.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 msgr2=0x7feb6c0ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feb6400b970 tx=0x7feb6400bc80 comp rx=0 tx=0).stop 2023-08-27T11:24:51.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 shutdown_connections 2023-08-27T11:24:51.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb4c06a0e0 0x7feb4c06c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb6c0bbf10 0x7feb6c0ab170 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb6c06cc40 0x7feb6c0a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 --2- 172.21.15.43:0/479657623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb6c0a76f0 0x7feb6c0aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 >> 172.21.15.43:0/479657623 conn(0x7feb6c06aa50 msgr2=0x7feb6c153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:51.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 shutdown_connections 2023-08-27T11:24:51.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.525+0000 7feb717ff700 1 -- 172.21.15.43:0/479657623 wait complete. 2023-08-27T11:24:51.531 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 37 2023-08-27T11:24:51.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:51.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.746+0000 7fe70a9ff700 1 Processor -- start 2023-08-27T11:24:51.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.746+0000 7fe70a9ff700 1 -- start start 2023-08-27T11:24:51.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.747+0000 7fe70a9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7040c4630 0x7fe7040c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.747+0000 7fe70a9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70406c4e0 con 0x7fe704151a90 2023-08-27T11:24:51.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe70a9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704155370 con 0x7fe70406ad70 2023-08-27T11:24:51.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe70a9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7040c82c0 con 0x7fe7040c4630 2023-08-27T11:24:51.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe7037fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7040c4630 0x7fe7040c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe703fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe704151a90 0x7fe7040c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52608/0 (socket says 172.21.15.43:52608) 2023-08-27T11:24:51.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe703fff700 1 -- 172.21.15.43:0/3760500642 learned_addr learned my addr 172.21.15.43:0/3760500642 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:51.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe7037fe700 1 -- 172.21.15.43:0/3760500642 >> v1:172.21.15.57:6789/0 conn(0x7fe70406ad70 legacy=0x7fe70406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:51.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe7037fe700 1 -- 172.21.15.43:0/3760500642 >> v1:172.21.15.43:6789/0 conn(0x7fe704151a90 legacy=0x7fe7040c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe7037fe700 1 -- 172.21.15.43:0/3760500642 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe704151e70 con 0x7fe7040c4630 2023-08-27T11:24:51.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe702ffd700 1 -- 172.21.15.43:0/3760500642 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442434573 0 0) 0x7fe70406c4e0 con 0x7fe704151a90 2023-08-27T11:24:51.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.748+0000 7fe7037fe700 1 --2- 172.21.15.43:0/3760500642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7040c4630 0x7fe7040c4a90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009840 tx=0x7fe6f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909fbc120b6bf318 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe702ffd700 1 -- 172.21.15.43:0/3760500642 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8004230 con 0x7fe7040c4630 2023-08-27T11:24:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe702ffd700 1 -- 172.21.15.43:0/3760500642 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8004390 con 0x7fe7040c4630 2023-08-27T11:24:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe702ffd700 1 -- 172.21.15.43:0/3760500642 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80036a0 con 0x7fe7040c4630 2023-08-27T11:24:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 -- 172.21.15.43:0/3760500642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7040c4630 msgr2=0x7fe7040c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/3760500642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7040c4630 0x7fe7040c4a90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009840 tx=0x7fe6f8009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 -- 172.21.15.43:0/3760500642 shutdown_connections 2023-08-27T11:24:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/3760500642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7040c4630 0x7fe7040c4a90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 -- 172.21.15.43:0/3760500642 >> 172.21.15.43:0/3760500642 conn(0x7fe7040ab820 msgr2=0x7fe7040abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 -- 172.21.15.43:0/3760500642 shutdown_connections 2023-08-27T11:24:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.749+0000 7fe70a9ff700 1 -- 172.21.15.43:0/3760500642 wait complete. 2023-08-27T11:24:51.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.751+0000 7fe70a9ff700 1 Processor -- start 2023-08-27T11:24:51.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.751+0000 7fe70a9ff700 1 -- start start 2023-08-27T11:24:51.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 0x7fe7041e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 0x7fe7040aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe704146bd0 con 0x7fe704151a90 2023-08-27T11:24:51.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040c0e20 con 0x7fe7040c4630 2023-08-27T11:24:51.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe70a9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7041ecd40 con 0x7fe70406ad70 2023-08-27T11:24:51.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe708f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe708f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58936/0 (socket says 172.21.15.43:58936) 2023-08-27T11:24:51.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe708f9c700 1 -- 172.21.15.43:0/264901014 learned_addr learned my addr 172.21.15.43:0/264901014 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:51.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.752+0000 7fe703fff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 0x7fe7041e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe7037fe700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 0x7fe7040aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 -- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 msgr2=0x7fe7041e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 0x7fe7041e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 -- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 msgr2=0x7fe7040aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 0x7fe7040aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 -- 172.21.15.43:0/264901014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80094a0 con 0x7fe704151a90 2023-08-27T11:24:51.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe7037fe700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 0x7fe7040aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:51.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe703fff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 0x7fe7041e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:51.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe708f9c700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc10 tx=0x7fe6fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00abb0 con 0x7fe704151a90 2023-08-27T11:24:51.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00ad10 con 0x7fe704151a90 2023-08-27T11:24:51.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc012660 con 0x7fe704151a90 2023-08-27T11:24:51.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.753+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7041ed020 con 0x7fe704151a90 2023-08-27T11:24:51.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.754+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70414bd30 con 0x7fe704151a90 2023-08-27T11:24:51.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.754+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7041ed260 con 0x7fe704151a90 2023-08-27T11:24:51.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.755+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe6fc0127c0 con 0x7fe704151a90 2023-08-27T11:24:51.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.756+0000 7fe700ff9700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 0x7fe6f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:51.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.756+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fe6fc089090 con 0x7fe704151a90 2023-08-27T11:24:51.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.757+0000 7fe703fff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 0x7fe6f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:51.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.757+0000 7fe703fff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 0x7fe6f006c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4000f60 tx=0x7fe6f4007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:51.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.761+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7041ed260 con 0x7fe704151a90 2023-08-27T11:24:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.969+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7041ed260 con 0x7fe704151a90 2023-08-27T11:24:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.970+0000 7fe700ff9700 1 -- 172.21.15.43:0/264901014 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+21891 (secure 0 0 0) 0x7fe7041ed260 con 0x7fe704151a90 2023-08-27T11:24:51.972 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:51.972 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":51,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:48.879550+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 msgr2=0x7fe6f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 0x7fe6f006c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4000f60 tx=0x7fe6f4007e50 comp rx=0 tx=0).stop 2023-08-27T11:24:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 msgr2=0x7fe7041ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00cc10 tx=0x7fe6fc00a060 comp rx=0 tx=0).stop 2023-08-27T11:24:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 shutdown_connections 2023-08-27T11:24:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe6f006a0e0 0x7fe6f006c5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe704151a90 0x7fe7041ed540 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe70406ad70 0x7fe7041e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 --2- 172.21.15.43:0/264901014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7040c4630 0x7fe7040aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 >> 172.21.15.43:0/264901014 conn(0x7fe7040ab820 msgr2=0x7fe704073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:51.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 shutdown_connections 2023-08-27T11:24:51.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:51.973+0000 7fe70a9ff700 1 -- 172.21.15.43:0/264901014 wait complete. 2023-08-27T11:24:51.993 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:24:51.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:24:52.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.195+0000 7fb26f7ff700 1 Processor -- start 2023-08-27T11:24:52.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.195+0000 7fb26f7ff700 1 -- start start 2023-08-27T11:24:52.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.196+0000 7fb26f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.196+0000 7fb26f7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.196+0000 7fb26f7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb268154d00 con 0x7fb26814e960 2023-08-27T11:24:52.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.196+0000 7fb26f7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680baf30 con 0x7fb268154740 2023-08-27T11:24:52.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.196+0000 7fb26f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268154fe0 con 0x7fb2680c50d0 2023-08-27T11:24:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26dd9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26dd9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49184/0 (socket says 172.21.15.43:49184) 2023-08-27T11:24:52.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26dd9c700 1 -- 172.21.15.43:0/3774316926 learned_addr learned my addr 172.21.15.43:0/3774316926 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:52.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26d59b700 1 --1- 172.21.15.43:0/3774316926 >> v1:172.21.15.57:6789/0 conn(0x7fb26814e960 0x7fb2680a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:49170/0 (socket says 172.21.15.43:49170) 2023-08-27T11:24:52.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3774316926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb25ffff700 1 -- 172.21.15.43:0/3774316926 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016602065 0 0) 0x7fb268154d00 con 0x7fb26814e960 2023-08-27T11:24:52.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb25ffff700 1 -- 172.21.15.43:0/3774316926 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2540035b0 con 0x7fb26814e960 2023-08-27T11:24:52.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3774316926 >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 msgr2=0x7fb2680c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:52.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3774316926 >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3774316926 >> v1:172.21.15.57:6789/0 conn(0x7fb26814e960 legacy=0x7fb2680a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3774316926 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2681552c0 con 0x7fb2680c50d0 2023-08-27T11:24:52.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.197+0000 7fb26dd9c700 1 --2- 172.21.15.43:0/3774316926 >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:52.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3774316926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680c3cc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb258009840 tx=0x7fb258009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6471c3223fbe7d1a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb25ffff700 1 -- 172.21.15.43:0/3774316926 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258011830 con 0x7fb2680c50d0 2023-08-27T11:24:52.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb25ffff700 1 -- 172.21.15.43:0/3774316926 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb258011990 con 0x7fb2680c50d0 2023-08-27T11:24:52.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb25ffff700 1 -- 172.21.15.43:0/3774316926 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258011d20 con 0x7fb2680c50d0 2023-08-27T11:24:52.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3774316926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 msgr2=0x7fb2680c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.198+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3774316926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680c3cc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb258009840 tx=0x7fb258009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3774316926 shutdown_connections 2023-08-27T11:24:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3774316926 >> v2:172.21.15.57:3300/0 conn(0x7fb268154740 0x7fb2680c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3774316926 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680c3cc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3774316926 >> 172.21.15.43:0/3774316926 conn(0x7fb26806aa50 msgr2=0x7fb2680c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:52.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3774316926 shutdown_connections 2023-08-27T11:24:52.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.199+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3774316926 wait complete. 2023-08-27T11:24:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.201+0000 7fb26f7ff700 1 Processor -- start 2023-08-27T11:24:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.201+0000 7fb26f7ff700 1 -- start start 2023-08-27T11:24:52.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb268154740 0x7fb268144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268142ca0 con 0x7fb26814e960 2023-08-27T11:24:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268153830 con 0x7fb268154740 2023-08-27T11:24:52.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.202+0000 7fb26f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268142a00 con 0x7fb2680c50d0 2023-08-27T11:24:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26d59b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26d59b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:34310/0 (socket says 172.21.15.43:34310) 2023-08-27T11:24:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58942/0 (socket says 172.21.15.43:58942) 2023-08-27T11:24:52.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26d59b700 1 -- 172.21.15.43:0/3440950741 learned_addr learned my addr 172.21.15.43:0/3440950741 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:52.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26dd9c700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb268154740 0x7fb268144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 msgr2=0x7fb2680ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680ab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb268154740 msgr2=0x7fb268144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb268154740 0x7fb268144aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.203+0000 7fb26cd9a700 1 -- 172.21.15.43:0/3440950741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26000bd40 con 0x7fb26814e960 2023-08-27T11:24:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb26cd9a700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb258016000 tx=0x7fb258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258004380 con 0x7fb26814e960 2023-08-27T11:24:52.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25801f070 con 0x7fb26814e960 2023-08-27T11:24:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2580094a0 con 0x7fb26814e960 2023-08-27T11:24:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580036a0 con 0x7fb26814e960 2023-08-27T11:24:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.204+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2680aaf60 con 0x7fb26814e960 2023-08-27T11:24:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.205+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2680bb390 con 0x7fb26814e960 2023-08-27T11:24:52.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.206+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb258021030 con 0x7fb26814e960 2023-08-27T11:24:52.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.207+0000 7fb25dffb700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 0x7fb24c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.207+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb2580898d0 con 0x7fb26814e960 2023-08-27T11:24:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.208+0000 7fb26d59b700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 0x7fb24c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.208+0000 7fb26d59b700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 0x7fb24c06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2640011e0 tx=0x7fb264007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.212+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb258054bd0 con 0x7fb26814e960 2023-08-27T11:24:52.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.420+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2680c37a0 con 0x7fb24c06a0e0 2023-08-27T11:24:52.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.439+0000 7fb25dffb700 1 -- 172.21.15.43:0/3440950741 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549982 (secure 0 0 0) 0x7fb264001410 con 0x7fb24c06a0e0 2023-08-27T11:24:52.447 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:52.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 msgr2=0x7fb24c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 0x7fb24c06c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb2640011e0 tx=0x7fb264007e80 comp rx=0 tx=0).stop 2023-08-27T11:24:52.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 msgr2=0x7fb2680c0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb258016000 tx=0x7fb258004750 comp rx=0 tx=0).stop 2023-08-27T11:24:52.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 shutdown_connections 2023-08-27T11:24:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb24c06a0e0 0x7fb24c06c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb268154740 0x7fb268144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2680c50d0 0x7fb2680ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 --2- 172.21.15.43:0/3440950741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb26814e960 0x7fb2680c0cc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 >> 172.21.15.43:0/3440950741 conn(0x7fb26806aa50 msgr2=0x7fb26814b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:52.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 shutdown_connections 2023-08-27T11:24:52.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.445+0000 7fb26f7ff700 1 -- 172.21.15.43:0/3440950741 wait complete. 2023-08-27T11:24:52.455 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:24:52.465 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-08-27T11:24:52.338806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":352,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222152,"kb_used_data":5976,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752568,"statfs":{"total":773094113280,"available":772866629632,"internally_reserved":0,"allocated":6119424,"data_stored":3341896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001120"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247200+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:24:49.247200+0000","last_peered":"2023-08-27T11:24:49.247200+0000","last_clean":"2023-08-27T11:24:49.247200+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:24:49.247200+0000","last_undegraded":"2023-08-27T11:24:49.247200+0000","last_fullsized":"2023-08-27T11:24:49.247200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:48:42.339194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886160+0000","last_change":"2023-08-27T11:24:32.283734+0000","last_active":"2023-08-27T11:24:48.886160+0000","last_peered":"2023-08-27T11:24:48.886160+0000","last_clean":"2023-08-27T11:24:48.886160+0000","last_became_active":"2023-08-27T11:24:32.283396+0000","last_became_peered":"2023-08-27T11:24:32.283396+0000","last_unstale":"2023-08-27T11:24:48.886160+0000","last_undegraded":"2023-08-27T11:24:48.886160+0000","last_fullsized":"2023-08-27T11:24:48.886160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:36:01.856329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944287+0000","last_change":"2023-08-27T11:24:32.908654+0000","last_active":"2023-08-27T11:24:48.944287+0000","last_peered":"2023-08-27T11:24:48.944287+0000","last_clean":"2023-08-27T11:24:48.944287+0000","last_became_active":"2023-08-27T11:24:32.907172+0000","last_became_peered":"2023-08-27T11:24:32.907172+0000","last_unstale":"2023-08-27T11:24:48.944287+0000","last_undegraded":"2023-08-27T11:24:48.944287+0000","last_fullsized":"2023-08-27T11:24:48.944287+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:37:20.342509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886777+0000","last_change":"2023-08-27T11:24:47.012245+0000","last_active":"2023-08-27T11:24:48.886777+0000","last_peered":"2023-08-27T11:24:48.886777+0000","last_clean":"2023-08-27T11:24:48.886777+0000","last_became_active":"2023-08-27T11:24:47.011755+0000","last_became_peered":"2023-08-27T11:24:47.011755+0000","last_unstale":"2023-08-27T11:24:48.886777+0000","last_undegraded":"2023-08-27T11:24:48.886777+0000","last_fullsized":"2023-08-27T11:24:48.886777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:12.190051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246665+0000","last_change":"2023-08-27T11:24:47.917245+0000","last_active":"2023-08-27T11:24:49.246665+0000","last_peered":"2023-08-27T11:24:49.246665+0000","last_clean":"2023-08-27T11:24:49.246665+0000","last_became_active":"2023-08-27T11:24:47.916929+0000","last_became_peered":"2023-08-27T11:24:47.916929+0000","last_unstale":"2023-08-27T11:24:49.246665+0000","last_undegraded":"2023-08-27T11:24:49.246665+0000","last_fullsized":"2023-08-27T11:24:49.246665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:30.974752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246998+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:24:49.246998+0000","last_peered":"2023-08-27T11:24:49.246998+0000","last_clean":"2023-08-27T11:24:49.246998+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:24:49.246998+0000","last_undegraded":"2023-08-27T11:24:49.246998+0000","last_fullsized":"2023-08-27T11:24:49.246998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:16.642117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886429+0000","last_change":"2023-08-27T11:24:32.291308+0000","last_active":"2023-08-27T11:24:48.886429+0000","last_peered":"2023-08-27T11:24:48.886429+0000","last_clean":"2023-08-27T11:24:48.886429+0000","last_became_active":"2023-08-27T11:24:32.291005+0000","last_became_peered":"2023-08-27T11:24:32.291005+0000","last_unstale":"2023-08-27T11:24:48.886429+0000","last_undegraded":"2023-08-27T11:24:48.886429+0000","last_fullsized":"2023-08-27T11:24:48.886429+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:58.267488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.093251+0000","last_change":"2023-08-27T11:24:32.883742+0000","last_active":"2023-08-27T11:24:49.093251+0000","last_peered":"2023-08-27T11:24:49.093251+0000","last_clean":"2023-08-27T11:24:49.093251+0000","last_became_active":"2023-08-27T11:24:32.883361+0000","last_became_peered":"2023-08-27T11:24:32.883361+0000","last_unstale":"2023-08-27T11:24:49.093251+0000","last_undegraded":"2023-08-27T11:24:49.093251+0000","last_fullsized":"2023-08-27T11:24:49.093251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:09.258794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247471+0000","last_change":"2023-08-27T11:24:47.020155+0000","last_active":"2023-08-27T11:24:49.247471+0000","last_peered":"2023-08-27T11:24:49.247471+0000","last_clean":"2023-08-27T11:24:49.247471+0000","last_became_active":"2023-08-27T11:24:47.019740+0000","last_became_peered":"2023-08-27T11:24:47.019740+0000","last_unstale":"2023-08-27T11:24:49.247471+0000","last_undegraded":"2023-08-27T11:24:49.247471+0000","last_fullsized":"2023-08-27T11:24:49.247471+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:55.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246541+0000","last_change":"2023-08-27T11:24:47.914354+0000","last_active":"2023-08-27T11:24:49.246541+0000","last_peered":"2023-08-27T11:24:49.246541+0000","last_clean":"2023-08-27T11:24:49.246541+0000","last_became_active":"2023-08-27T11:24:47.914017+0000","last_became_peered":"2023-08-27T11:24:47.914017+0000","last_unstale":"2023-08-27T11:24:49.246541+0000","last_undegraded":"2023-08-27T11:24:49.246541+0000","last_fullsized":"2023-08-27T11:24:49.246541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:43:00.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886199+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:24:48.886199+0000","last_peered":"2023-08-27T11:24:48.886199+0000","last_clean":"2023-08-27T11:24:48.886199+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:24:48.886199+0000","last_undegraded":"2023-08-27T11:24:48.886199+0000","last_fullsized":"2023-08-27T11:24:48.886199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:29.519948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246995+0000","last_change":"2023-08-27T11:24:32.298551+0000","last_active":"2023-08-27T11:24:49.246995+0000","last_peered":"2023-08-27T11:24:49.246995+0000","last_clean":"2023-08-27T11:24:49.246995+0000","last_became_active":"2023-08-27T11:24:32.298256+0000","last_became_peered":"2023-08-27T11:24:32.298256+0000","last_unstale":"2023-08-27T11:24:49.246995+0000","last_undegraded":"2023-08-27T11:24:49.246995+0000","last_fullsized":"2023-08-27T11:24:49.246995+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:42.738370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885744+0000","last_change":"2023-08-27T11:24:32.898742+0000","last_active":"2023-08-27T11:24:48.885744+0000","last_peered":"2023-08-27T11:24:48.885744+0000","last_clean":"2023-08-27T11:24:48.885744+0000","last_became_active":"2023-08-27T11:24:32.898394+0000","last_became_peered":"2023-08-27T11:24:32.898394+0000","last_unstale":"2023-08-27T11:24:48.885744+0000","last_undegraded":"2023-08-27T11:24:48.885744+0000","last_fullsized":"2023-08-27T11:24:48.885744+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:32.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944611+0000","last_change":"2023-08-27T11:24:47.017782+0000","last_active":"2023-08-27T11:24:48.944611+0000","last_peered":"2023-08-27T11:24:48.944611+0000","last_clean":"2023-08-27T11:24:48.944611+0000","last_became_active":"2023-08-27T11:24:47.017386+0000","last_became_peered":"2023-08-27T11:24:47.017386+0000","last_unstale":"2023-08-27T11:24:48.944611+0000","last_undegraded":"2023-08-27T11:24:48.944611+0000","last_fullsized":"2023-08-27T11:24:48.944611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:47.926952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245714+0000","last_change":"2023-08-27T11:24:47.909420+0000","last_active":"2023-08-27T11:24:49.245714+0000","last_peered":"2023-08-27T11:24:49.245714+0000","last_clean":"2023-08-27T11:24:49.245714+0000","last_became_active":"2023-08-27T11:24:47.909138+0000","last_became_peered":"2023-08-27T11:24:47.909138+0000","last_unstale":"2023-08-27T11:24:49.245714+0000","last_undegraded":"2023-08-27T11:24:49.245714+0000","last_fullsized":"2023-08-27T11:24:49.245714+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:49.679096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245927+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:24:49.245927+0000","last_peered":"2023-08-27T11:24:49.245927+0000","last_clean":"2023-08-27T11:24:49.245927+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:24:49.245927+0000","last_undegraded":"2023-08-27T11:24:49.245927+0000","last_fullsized":"2023-08-27T11:24:49.245927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:11:48.693495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"47'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945552+0000","last_change":"2023-08-27T11:24:32.299417+0000","last_active":"2023-08-27T11:24:48.945552+0000","last_peered":"2023-08-27T11:24:48.945552+0000","last_clean":"2023-08-27T11:24:48.945552+0000","last_became_active":"2023-08-27T11:24:32.298960+0000","last_became_peered":"2023-08-27T11:24:32.298960+0000","last_unstale":"2023-08-27T11:24:48.945552+0000","last_undegraded":"2023-08-27T11:24:48.945552+0000","last_fullsized":"2023-08-27T11:24:48.945552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:57.045550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244409+0000","last_change":"2023-08-27T11:24:32.899689+0000","last_active":"2023-08-27T11:24:49.244409+0000","last_peered":"2023-08-27T11:24:49.244409+0000","last_clean":"2023-08-27T11:24:49.244409+0000","last_became_active":"2023-08-27T11:24:32.899314+0000","last_became_peered":"2023-08-27T11:24:32.899314+0000","last_unstale":"2023-08-27T11:24:49.244409+0000","last_undegraded":"2023-08-27T11:24:49.244409+0000","last_fullsized":"2023-08-27T11:24:49.244409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:18.267003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092153+0000","last_change":"2023-08-27T11:24:47.014048+0000","last_active":"2023-08-27T11:24:49.092153+0000","last_peered":"2023-08-27T11:24:49.092153+0000","last_clean":"2023-08-27T11:24:49.092153+0000","last_became_active":"2023-08-27T11:24:47.013604+0000","last_became_peered":"2023-08-27T11:24:47.013604+0000","last_unstale":"2023-08-27T11:24:49.092153+0000","last_undegraded":"2023-08-27T11:24:49.092153+0000","last_fullsized":"2023-08-27T11:24:49.092153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:30.143916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245656+0000","last_change":"2023-08-27T11:24:47.906237+0000","last_active":"2023-08-27T11:24:49.245656+0000","last_peered":"2023-08-27T11:24:49.245656+0000","last_clean":"2023-08-27T11:24:49.245656+0000","last_became_active":"2023-08-27T11:24:47.905967+0000","last_became_peered":"2023-08-27T11:24:47.905967+0000","last_unstale":"2023-08-27T11:24:49.245656+0000","last_undegraded":"2023-08-27T11:24:49.245656+0000","last_fullsized":"2023-08-27T11:24:49.245656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:48.349559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245389+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:24:49.245389+0000","last_peered":"2023-08-27T11:24:49.245389+0000","last_clean":"2023-08-27T11:24:49.245389+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:24:49.245389+0000","last_undegraded":"2023-08-27T11:24:49.245389+0000","last_fullsized":"2023-08-27T11:24:49.245389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:35:07.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945121+0000","last_change":"2023-08-27T11:24:32.298891+0000","last_active":"2023-08-27T11:24:48.945121+0000","last_peered":"2023-08-27T11:24:48.945121+0000","last_clean":"2023-08-27T11:24:48.945121+0000","last_became_active":"2023-08-27T11:24:32.298585+0000","last_became_peered":"2023-08-27T11:24:32.298585+0000","last_unstale":"2023-08-27T11:24:48.945121+0000","last_undegraded":"2023-08-27T11:24:48.945121+0000","last_fullsized":"2023-08-27T11:24:48.945121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:17.262843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091811+0000","last_change":"2023-08-27T11:24:32.910307+0000","last_active":"2023-08-27T11:24:49.091811+0000","last_peered":"2023-08-27T11:24:49.091811+0000","last_clean":"2023-08-27T11:24:49.091811+0000","last_became_active":"2023-08-27T11:24:32.909518+0000","last_became_peered":"2023-08-27T11:24:32.909518+0000","last_unstale":"2023-08-27T11:24:49.091811+0000","last_undegraded":"2023-08-27T11:24:49.091811+0000","last_fullsized":"2023-08-27T11:24:49.091811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:16.366498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887504+0000","last_change":"2023-08-27T11:24:47.012260+0000","last_active":"2023-08-27T11:24:48.887504+0000","last_peered":"2023-08-27T11:24:48.887504+0000","last_clean":"2023-08-27T11:24:48.887504+0000","last_became_active":"2023-08-27T11:24:47.011507+0000","last_became_peered":"2023-08-27T11:24:47.011507+0000","last_unstale":"2023-08-27T11:24:48.887504+0000","last_undegraded":"2023-08-27T11:24:48.887504+0000","last_fullsized":"2023-08-27T11:24:48.887504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:47.873973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885732+0000","last_change":"2023-08-27T11:24:47.896009+0000","last_active":"2023-08-27T11:24:48.885732+0000","last_peered":"2023-08-27T11:24:48.885732+0000","last_clean":"2023-08-27T11:24:48.885732+0000","last_became_active":"2023-08-27T11:24:47.895690+0000","last_became_peered":"2023-08-27T11:24:47.895690+0000","last_unstale":"2023-08-27T11:24:48.885732+0000","last_undegraded":"2023-08-27T11:24:48.885732+0000","last_fullsized":"2023-08-27T11:24:48.885732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:22.403683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":222,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245776+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:24:49.245776+0000","last_peered":"2023-08-27T11:24:49.245776+0000","last_clean":"2023-08-27T11:24:49.245776+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:24:49.245776+0000","last_undegraded":"2023-08-27T11:24:49.245776+0000","last_fullsized":"2023-08-27T11:24:49.245776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:35.318368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":72,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000207+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:24:49.000207+0000","last_peered":"2023-08-27T11:24:49.000207+0000","last_clean":"2023-08-27T11:24:49.000207+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:24:49.000207+0000","last_undegraded":"2023-08-27T11:24:49.000207+0000","last_fullsized":"2023-08-27T11:24:49.000207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:16:53.037066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246820+0000","last_change":"2023-08-27T11:24:32.292210+0000","last_active":"2023-08-27T11:24:49.246820+0000","last_peered":"2023-08-27T11:24:49.246820+0000","last_clean":"2023-08-27T11:24:49.246820+0000","last_became_active":"2023-08-27T11:24:32.291811+0000","last_became_peered":"2023-08-27T11:24:32.291811+0000","last_unstale":"2023-08-27T11:24:49.246820+0000","last_undegraded":"2023-08-27T11:24:49.246820+0000","last_fullsized":"2023-08-27T11:24:49.246820+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:04:41.648428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999634+0000","last_change":"2023-08-27T11:24:32.889337+0000","last_active":"2023-08-27T11:24:48.999634+0000","last_peered":"2023-08-27T11:24:48.999634+0000","last_clean":"2023-08-27T11:24:48.999634+0000","last_became_active":"2023-08-27T11:24:32.889050+0000","last_became_peered":"2023-08-27T11:24:32.889050+0000","last_unstale":"2023-08-27T11:24:48.999634+0000","last_undegraded":"2023-08-27T11:24:48.999634+0000","last_fullsized":"2023-08-27T11:24:48.999634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:43:24.658639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944921+0000","last_change":"2023-08-27T11:24:47.019430+0000","last_active":"2023-08-27T11:24:48.944921+0000","last_peered":"2023-08-27T11:24:48.944921+0000","last_clean":"2023-08-27T11:24:48.944921+0000","last_became_active":"2023-08-27T11:24:47.019126+0000","last_became_peered":"2023-08-27T11:24:47.019126+0000","last_unstale":"2023-08-27T11:24:48.944921+0000","last_undegraded":"2023-08-27T11:24:48.944921+0000","last_fullsized":"2023-08-27T11:24:48.944921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:51:12.369555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944711+0000","last_change":"2023-08-27T11:24:47.897540+0000","last_active":"2023-08-27T11:24:48.944711+0000","last_peered":"2023-08-27T11:24:48.944711+0000","last_clean":"2023-08-27T11:24:48.944711+0000","last_became_active":"2023-08-27T11:24:47.896003+0000","last_became_peered":"2023-08-27T11:24:47.896003+0000","last_unstale":"2023-08-27T11:24:48.944711+0000","last_undegraded":"2023-08-27T11:24:48.944711+0000","last_fullsized":"2023-08-27T11:24:48.944711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:47.159610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092519+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:24:49.092519+0000","last_peered":"2023-08-27T11:24:49.092519+0000","last_clean":"2023-08-27T11:24:49.092519+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:24:49.092519+0000","last_undegraded":"2023-08-27T11:24:49.092519+0000","last_fullsized":"2023-08-27T11:24:49.092519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:50.142502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092515+0000","last_change":"2023-08-27T11:24:32.288364+0000","last_active":"2023-08-27T11:24:49.092515+0000","last_peered":"2023-08-27T11:24:49.092515+0000","last_clean":"2023-08-27T11:24:49.092515+0000","last_became_active":"2023-08-27T11:24:32.287929+0000","last_became_peered":"2023-08-27T11:24:32.287929+0000","last_unstale":"2023-08-27T11:24:49.092515+0000","last_undegraded":"2023-08-27T11:24:49.092515+0000","last_fullsized":"2023-08-27T11:24:49.092515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:24.144492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886971+0000","last_change":"2023-08-27T11:24:32.906148+0000","last_active":"2023-08-27T11:24:48.886971+0000","last_peered":"2023-08-27T11:24:48.886971+0000","last_clean":"2023-08-27T11:24:48.886971+0000","last_became_active":"2023-08-27T11:24:32.905830+0000","last_became_peered":"2023-08-27T11:24:32.905830+0000","last_unstale":"2023-08-27T11:24:48.886971+0000","last_undegraded":"2023-08-27T11:24:48.886971+0000","last_fullsized":"2023-08-27T11:24:48.886971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:52:55.617567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092459+0000","last_change":"2023-08-27T11:24:47.009864+0000","last_active":"2023-08-27T11:24:49.092459+0000","last_peered":"2023-08-27T11:24:49.092459+0000","last_clean":"2023-08-27T11:24:49.092459+0000","last_became_active":"2023-08-27T11:24:47.009578+0000","last_became_peered":"2023-08-27T11:24:47.009578+0000","last_unstale":"2023-08-27T11:24:49.092459+0000","last_undegraded":"2023-08-27T11:24:49.092459+0000","last_fullsized":"2023-08-27T11:24:49.092459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:08.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247061+0000","last_change":"2023-08-27T11:24:47.901974+0000","last_active":"2023-08-27T11:24:49.247061+0000","last_peered":"2023-08-27T11:24:49.247061+0000","last_clean":"2023-08-27T11:24:49.247061+0000","last_became_active":"2023-08-27T11:24:47.901470+0000","last_became_peered":"2023-08-27T11:24:47.901470+0000","last_unstale":"2023-08-27T11:24:49.247061+0000","last_undegraded":"2023-08-27T11:24:49.247061+0000","last_fullsized":"2023-08-27T11:24:49.247061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:14.800506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886830+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:24:48.886830+0000","last_peered":"2023-08-27T11:24:48.886830+0000","last_clean":"2023-08-27T11:24:48.886830+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:24:48.886830+0000","last_undegraded":"2023-08-27T11:24:48.886830+0000","last_fullsized":"2023-08-27T11:24:48.886830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:11.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092514+0000","last_change":"2023-08-27T11:24:32.278516+0000","last_active":"2023-08-27T11:24:49.092514+0000","last_peered":"2023-08-27T11:24:49.092514+0000","last_clean":"2023-08-27T11:24:49.092514+0000","last_became_active":"2023-08-27T11:24:32.278225+0000","last_became_peered":"2023-08-27T11:24:32.278225+0000","last_unstale":"2023-08-27T11:24:49.092514+0000","last_undegraded":"2023-08-27T11:24:49.092514+0000","last_fullsized":"2023-08-27T11:24:49.092514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:30:29.664511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945171+0000","last_change":"2023-08-27T11:24:32.905190+0000","last_active":"2023-08-27T11:24:48.945171+0000","last_peered":"2023-08-27T11:24:48.945171+0000","last_clean":"2023-08-27T11:24:48.945171+0000","last_became_active":"2023-08-27T11:24:32.904921+0000","last_became_peered":"2023-08-27T11:24:32.904921+0000","last_unstale":"2023-08-27T11:24:48.945171+0000","last_undegraded":"2023-08-27T11:24:48.945171+0000","last_fullsized":"2023-08-27T11:24:48.945171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:35.896764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247355+0000","last_change":"2023-08-27T11:24:47.018035+0000","last_active":"2023-08-27T11:24:49.247355+0000","last_peered":"2023-08-27T11:24:49.247355+0000","last_clean":"2023-08-27T11:24:49.247355+0000","last_became_active":"2023-08-27T11:24:47.017721+0000","last_became_peered":"2023-08-27T11:24:47.017721+0000","last_unstale":"2023-08-27T11:24:49.247355+0000","last_undegraded":"2023-08-27T11:24:49.247355+0000","last_fullsized":"2023-08-27T11:24:49.247355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:09:42.952015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887137+0000","last_change":"2023-08-27T11:24:47.901954+0000","last_active":"2023-08-27T11:24:48.887137+0000","last_peered":"2023-08-27T11:24:48.887137+0000","last_clean":"2023-08-27T11:24:48.887137+0000","last_became_active":"2023-08-27T11:24:47.901635+0000","last_became_peered":"2023-08-27T11:24:47.901635+0000","last_unstale":"2023-08-27T11:24:48.887137+0000","last_undegraded":"2023-08-27T11:24:48.887137+0000","last_fullsized":"2023-08-27T11:24:48.887137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:13.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884334+0000","last_change":"2023-08-27T11:24:32.285270+0000","last_active":"2023-08-27T11:24:48.884334+0000","last_peered":"2023-08-27T11:24:48.884334+0000","last_clean":"2023-08-27T11:24:48.884334+0000","last_became_active":"2023-08-27T11:24:32.284877+0000","last_became_peered":"2023-08-27T11:24:32.284877+0000","last_unstale":"2023-08-27T11:24:48.884334+0000","last_undegraded":"2023-08-27T11:24:48.884334+0000","last_fullsized":"2023-08-27T11:24:48.884334+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:46.595722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000966+0000","last_change":"2023-08-27T11:24:32.889628+0000","last_active":"2023-08-27T11:24:49.000966+0000","last_peered":"2023-08-27T11:24:49.000966+0000","last_clean":"2023-08-27T11:24:49.000966+0000","last_became_active":"2023-08-27T11:24:32.889347+0000","last_became_peered":"2023-08-27T11:24:32.889347+0000","last_unstale":"2023-08-27T11:24:49.000966+0000","last_undegraded":"2023-08-27T11:24:49.000966+0000","last_fullsized":"2023-08-27T11:24:49.000966+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:34.960826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887572+0000","last_change":"2023-08-27T11:24:47.013753+0000","last_active":"2023-08-27T11:24:48.887572+0000","last_peered":"2023-08-27T11:24:48.887572+0000","last_clean":"2023-08-27T11:24:48.887572+0000","last_became_active":"2023-08-27T11:24:47.013461+0000","last_became_peered":"2023-08-27T11:24:47.013461+0000","last_unstale":"2023-08-27T11:24:48.887572+0000","last_undegraded":"2023-08-27T11:24:48.887572+0000","last_fullsized":"2023-08-27T11:24:48.887572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:52:05.275464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885049+0000","last_change":"2023-08-27T11:24:47.897695+0000","last_active":"2023-08-27T11:24:48.885049+0000","last_peered":"2023-08-27T11:24:48.885049+0000","last_clean":"2023-08-27T11:24:48.885049+0000","last_became_active":"2023-08-27T11:24:47.897354+0000","last_became_peered":"2023-08-27T11:24:47.897354+0000","last_unstale":"2023-08-27T11:24:48.885049+0000","last_undegraded":"2023-08-27T11:24:48.885049+0000","last_fullsized":"2023-08-27T11:24:48.885049+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:50.515951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944426+0000","last_change":"2023-08-27T11:24:32.293744+0000","last_active":"2023-08-27T11:24:48.944426+0000","last_peered":"2023-08-27T11:24:48.944426+0000","last_clean":"2023-08-27T11:24:48.944426+0000","last_became_active":"2023-08-27T11:24:32.293488+0000","last_became_peered":"2023-08-27T11:24:32.293488+0000","last_unstale":"2023-08-27T11:24:48.944426+0000","last_undegraded":"2023-08-27T11:24:48.944426+0000","last_fullsized":"2023-08-27T11:24:48.944426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:52:38.327155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945409+0000","last_change":"2023-08-27T11:24:32.904659+0000","last_active":"2023-08-27T11:24:48.945409+0000","last_peered":"2023-08-27T11:24:48.945409+0000","last_clean":"2023-08-27T11:24:48.945409+0000","last_became_active":"2023-08-27T11:24:32.904365+0000","last_became_peered":"2023-08-27T11:24:32.904365+0000","last_unstale":"2023-08-27T11:24:48.945409+0000","last_undegraded":"2023-08-27T11:24:48.945409+0000","last_fullsized":"2023-08-27T11:24:48.945409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:54:29.360643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887172+0000","last_change":"2023-08-27T11:24:47.016887+0000","last_active":"2023-08-27T11:24:48.887172+0000","last_peered":"2023-08-27T11:24:48.887172+0000","last_clean":"2023-08-27T11:24:48.887172+0000","last_became_active":"2023-08-27T11:24:47.016548+0000","last_became_peered":"2023-08-27T11:24:47.016548+0000","last_unstale":"2023-08-27T11:24:48.887172+0000","last_undegraded":"2023-08-27T11:24:48.887172+0000","last_fullsized":"2023-08-27T11:24:48.887172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:03.906011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945018+0000","last_change":"2023-08-27T11:24:47.904132+0000","last_active":"2023-08-27T11:24:48.945018+0000","last_peered":"2023-08-27T11:24:48.945018+0000","last_clean":"2023-08-27T11:24:48.945018+0000","last_became_active":"2023-08-27T11:24:47.903800+0000","last_became_peered":"2023-08-27T11:24:47.903800+0000","last_unstale":"2023-08-27T11:24:48.945018+0000","last_undegraded":"2023-08-27T11:24:48.945018+0000","last_fullsized":"2023-08-27T11:24:48.945018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:15:54.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092232+0000","last_change":"2023-08-27T11:24:32.278431+0000","last_active":"2023-08-27T11:24:49.092232+0000","last_peered":"2023-08-27T11:24:49.092232+0000","last_clean":"2023-08-27T11:24:49.092232+0000","last_became_active":"2023-08-27T11:24:32.278149+0000","last_became_peered":"2023-08-27T11:24:32.278149+0000","last_unstale":"2023-08-27T11:24:49.092232+0000","last_undegraded":"2023-08-27T11:24:49.092232+0000","last_fullsized":"2023-08-27T11:24:49.092232+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:13:44.042979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244445+0000","last_change":"2023-08-27T11:24:32.903976+0000","last_active":"2023-08-27T11:24:49.244445+0000","last_peered":"2023-08-27T11:24:49.244445+0000","last_clean":"2023-08-27T11:24:49.244445+0000","last_became_active":"2023-08-27T11:24:32.903486+0000","last_became_peered":"2023-08-27T11:24:32.903486+0000","last_unstale":"2023-08-27T11:24:49.244445+0000","last_undegraded":"2023-08-27T11:24:49.244445+0000","last_fullsized":"2023-08-27T11:24:49.244445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:04.691076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000772+0000","last_change":"2023-08-27T11:24:47.014859+0000","last_active":"2023-08-27T11:24:49.000772+0000","last_peered":"2023-08-27T11:24:49.000772+0000","last_clean":"2023-08-27T11:24:49.000772+0000","last_became_active":"2023-08-27T11:24:47.014540+0000","last_became_peered":"2023-08-27T11:24:47.014540+0000","last_unstale":"2023-08-27T11:24:49.000772+0000","last_undegraded":"2023-08-27T11:24:49.000772+0000","last_fullsized":"2023-08-27T11:24:49.000772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:13.483337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247220+0000","last_change":"2023-08-27T11:24:47.901738+0000","last_active":"2023-08-27T11:24:49.247220+0000","last_peered":"2023-08-27T11:24:49.247220+0000","last_clean":"2023-08-27T11:24:49.247220+0000","last_became_active":"2023-08-27T11:24:47.901122+0000","last_became_peered":"2023-08-27T11:24:47.901122+0000","last_unstale":"2023-08-27T11:24:49.247220+0000","last_undegraded":"2023-08-27T11:24:49.247220+0000","last_fullsized":"2023-08-27T11:24:49.247220+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:21.057236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000283+0000","last_change":"2023-08-27T11:24:32.291430+0000","last_active":"2023-08-27T11:24:49.000283+0000","last_peered":"2023-08-27T11:24:49.000283+0000","last_clean":"2023-08-27T11:24:49.000283+0000","last_became_active":"2023-08-27T11:24:32.291106+0000","last_became_peered":"2023-08-27T11:24:32.291106+0000","last_unstale":"2023-08-27T11:24:49.000283+0000","last_undegraded":"2023-08-27T11:24:49.000283+0000","last_fullsized":"2023-08-27T11:24:49.000283+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:48.104401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886708+0000","last_change":"2023-08-27T11:24:32.909037+0000","last_active":"2023-08-27T11:24:48.886708+0000","last_peered":"2023-08-27T11:24:48.886708+0000","last_clean":"2023-08-27T11:24:48.886708+0000","last_became_active":"2023-08-27T11:24:32.908719+0000","last_became_peered":"2023-08-27T11:24:32.908719+0000","last_unstale":"2023-08-27T11:24:48.886708+0000","last_undegraded":"2023-08-27T11:24:48.886708+0000","last_fullsized":"2023-08-27T11:24:48.886708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:51.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945413+0000","last_change":"2023-08-27T11:24:47.012189+0000","last_active":"2023-08-27T11:24:48.945413+0000","last_peered":"2023-08-27T11:24:48.945413+0000","last_clean":"2023-08-27T11:24:48.945413+0000","last_became_active":"2023-08-27T11:24:47.011806+0000","last_became_peered":"2023-08-27T11:24:47.011806+0000","last_unstale":"2023-08-27T11:24:48.945413+0000","last_undegraded":"2023-08-27T11:24:48.945413+0000","last_fullsized":"2023-08-27T11:24:48.945413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:30.143916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887365+0000","last_change":"2023-08-27T11:24:47.898238+0000","last_active":"2023-08-27T11:24:48.887365+0000","last_peered":"2023-08-27T11:24:48.887365+0000","last_clean":"2023-08-27T11:24:48.887365+0000","last_became_active":"2023-08-27T11:24:47.897948+0000","last_became_peered":"2023-08-27T11:24:47.897948+0000","last_unstale":"2023-08-27T11:24:48.887365+0000","last_undegraded":"2023-08-27T11:24:48.887365+0000","last_fullsized":"2023-08-27T11:24:48.887365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:45.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245200+0000","last_change":"2023-08-27T11:24:32.283531+0000","last_active":"2023-08-27T11:24:49.245200+0000","last_peered":"2023-08-27T11:24:49.245200+0000","last_clean":"2023-08-27T11:24:49.245200+0000","last_became_active":"2023-08-27T11:24:32.283231+0000","last_became_peered":"2023-08-27T11:24:32.283231+0000","last_unstale":"2023-08-27T11:24:49.245200+0000","last_undegraded":"2023-08-27T11:24:49.245200+0000","last_fullsized":"2023-08-27T11:24:49.245200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:26.534874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999685+0000","last_change":"2023-08-27T11:24:32.896839+0000","last_active":"2023-08-27T11:24:48.999685+0000","last_peered":"2023-08-27T11:24:48.999685+0000","last_clean":"2023-08-27T11:24:48.999685+0000","last_became_active":"2023-08-27T11:24:32.896629+0000","last_became_peered":"2023-08-27T11:24:32.896629+0000","last_unstale":"2023-08-27T11:24:48.999685+0000","last_undegraded":"2023-08-27T11:24:48.999685+0000","last_fullsized":"2023-08-27T11:24:48.999685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:57.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092074+0000","last_change":"2023-08-27T11:24:47.008423+0000","last_active":"2023-08-27T11:24:49.092074+0000","last_peered":"2023-08-27T11:24:49.092074+0000","last_clean":"2023-08-27T11:24:49.092074+0000","last_became_active":"2023-08-27T11:24:47.008083+0000","last_became_peered":"2023-08-27T11:24:47.008083+0000","last_unstale":"2023-08-27T11:24:49.092074+0000","last_undegraded":"2023-08-27T11:24:49.092074+0000","last_fullsized":"2023-08-27T11:24:49.092074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:31.978636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885973+0000","last_change":"2023-08-27T11:24:47.906802+0000","last_active":"2023-08-27T11:24:48.885973+0000","last_peered":"2023-08-27T11:24:48.885973+0000","last_clean":"2023-08-27T11:24:48.885973+0000","last_became_active":"2023-08-27T11:24:47.906466+0000","last_became_peered":"2023-08-27T11:24:47.906466+0000","last_unstale":"2023-08-27T11:24:48.885973+0000","last_undegraded":"2023-08-27T11:24:48.885973+0000","last_fullsized":"2023-08-27T11:24:48.885973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246681+0000","last_change":"2023-08-27T11:24:32.291693+0000","last_active":"2023-08-27T11:24:49.246681+0000","last_peered":"2023-08-27T11:24:49.246681+0000","last_clean":"2023-08-27T11:24:49.246681+0000","last_became_active":"2023-08-27T11:24:32.291329+0000","last_became_peered":"2023-08-27T11:24:32.291329+0000","last_unstale":"2023-08-27T11:24:49.246681+0000","last_undegraded":"2023-08-27T11:24:49.246681+0000","last_fullsized":"2023-08-27T11:24:49.246681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:11.322410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885585+0000","last_change":"2023-08-27T11:24:32.912907+0000","last_active":"2023-08-27T11:24:48.885585+0000","last_peered":"2023-08-27T11:24:48.885585+0000","last_clean":"2023-08-27T11:24:48.885585+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:48.885585+0000","last_undegraded":"2023-08-27T11:24:48.885585+0000","last_fullsized":"2023-08-27T11:24:48.885585+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:02.440440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246395+0000","last_change":"2023-08-27T11:24:47.020476+0000","last_active":"2023-08-27T11:24:49.246395+0000","last_peered":"2023-08-27T11:24:49.246395+0000","last_clean":"2023-08-27T11:24:49.246395+0000","last_became_active":"2023-08-27T11:24:47.019974+0000","last_became_peered":"2023-08-27T11:24:47.019974+0000","last_unstale":"2023-08-27T11:24:49.246395+0000","last_undegraded":"2023-08-27T11:24:49.246395+0000","last_fullsized":"2023-08-27T11:24:49.246395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:46.615325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244855+0000","last_change":"2023-08-27T11:24:47.903664+0000","last_active":"2023-08-27T11:24:49.244855+0000","last_peered":"2023-08-27T11:24:49.244855+0000","last_clean":"2023-08-27T11:24:49.244855+0000","last_became_active":"2023-08-27T11:24:47.903355+0000","last_became_peered":"2023-08-27T11:24:47.903355+0000","last_unstale":"2023-08-27T11:24:49.244855+0000","last_undegraded":"2023-08-27T11:24:49.244855+0000","last_fullsized":"2023-08-27T11:24:49.244855+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:29.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884894+0000","last_change":"2023-08-27T11:24:32.287931+0000","last_active":"2023-08-27T11:24:48.884894+0000","last_peered":"2023-08-27T11:24:48.884894+0000","last_clean":"2023-08-27T11:24:48.884894+0000","last_became_active":"2023-08-27T11:24:32.287220+0000","last_became_peered":"2023-08-27T11:24:32.287220+0000","last_unstale":"2023-08-27T11:24:48.884894+0000","last_undegraded":"2023-08-27T11:24:48.884894+0000","last_fullsized":"2023-08-27T11:24:48.884894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:23.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000008+0000","last_change":"2023-08-27T11:24:32.904851+0000","last_active":"2023-08-27T11:24:49.000008+0000","last_peered":"2023-08-27T11:24:49.000008+0000","last_clean":"2023-08-27T11:24:49.000008+0000","last_became_active":"2023-08-27T11:24:32.904617+0000","last_became_peered":"2023-08-27T11:24:32.904617+0000","last_unstale":"2023-08-27T11:24:49.000008+0000","last_undegraded":"2023-08-27T11:24:49.000008+0000","last_fullsized":"2023-08-27T11:24:49.000008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:34.667606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000084+0000","last_change":"2023-08-27T11:24:47.010525+0000","last_active":"2023-08-27T11:24:49.000084+0000","last_peered":"2023-08-27T11:24:49.000084+0000","last_clean":"2023-08-27T11:24:49.000084+0000","last_became_active":"2023-08-27T11:24:47.010256+0000","last_became_peered":"2023-08-27T11:24:47.010256+0000","last_unstale":"2023-08-27T11:24:49.000084+0000","last_undegraded":"2023-08-27T11:24:49.000084+0000","last_fullsized":"2023-08-27T11:24:49.000084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:58:42.804675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884640+0000","last_change":"2023-08-27T11:24:47.893457+0000","last_active":"2023-08-27T11:24:48.884640+0000","last_peered":"2023-08-27T11:24:48.884640+0000","last_clean":"2023-08-27T11:24:48.884640+0000","last_became_active":"2023-08-27T11:24:47.893164+0000","last_became_peered":"2023-08-27T11:24:47.893164+0000","last_unstale":"2023-08-27T11:24:48.884640+0000","last_undegraded":"2023-08-27T11:24:48.884640+0000","last_fullsized":"2023-08-27T11:24:48.884640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:33.448965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945522+0000","last_change":"2023-08-27T11:24:32.297792+0000","last_active":"2023-08-27T11:24:48.945522+0000","last_peered":"2023-08-27T11:24:48.945522+0000","last_clean":"2023-08-27T11:24:48.945522+0000","last_became_active":"2023-08-27T11:24:32.297492+0000","last_became_peered":"2023-08-27T11:24:32.297492+0000","last_unstale":"2023-08-27T11:24:48.945522+0000","last_undegraded":"2023-08-27T11:24:48.945522+0000","last_fullsized":"2023-08-27T11:24:48.945522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:30:59.935592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091968+0000","last_change":"2023-08-27T11:24:32.898773+0000","last_active":"2023-08-27T11:24:49.091968+0000","last_peered":"2023-08-27T11:24:49.091968+0000","last_clean":"2023-08-27T11:24:49.091968+0000","last_became_active":"2023-08-27T11:24:32.898512+0000","last_became_peered":"2023-08-27T11:24:32.898512+0000","last_unstale":"2023-08-27T11:24:49.091968+0000","last_undegraded":"2023-08-27T11:24:49.091968+0000","last_fullsized":"2023-08-27T11:24:49.091968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:14:38.023183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092699+0000","last_change":"2023-08-27T11:24:47.014484+0000","last_active":"2023-08-27T11:24:49.092699+0000","last_peered":"2023-08-27T11:24:49.092699+0000","last_clean":"2023-08-27T11:24:49.092699+0000","last_became_active":"2023-08-27T11:24:47.014112+0000","last_became_peered":"2023-08-27T11:24:47.014112+0000","last_unstale":"2023-08-27T11:24:49.092699+0000","last_undegraded":"2023-08-27T11:24:49.092699+0000","last_fullsized":"2023-08-27T11:24:49.092699+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:29.787182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000247+0000","last_change":"2023-08-27T11:24:47.905541+0000","last_active":"2023-08-27T11:24:49.000247+0000","last_peered":"2023-08-27T11:24:49.000247+0000","last_clean":"2023-08-27T11:24:49.000247+0000","last_became_active":"2023-08-27T11:24:47.905269+0000","last_became_peered":"2023-08-27T11:24:47.905269+0000","last_unstale":"2023-08-27T11:24:49.000247+0000","last_undegraded":"2023-08-27T11:24:49.000247+0000","last_fullsized":"2023-08-27T11:24:49.000247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:19.409347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887161+0000","last_change":"2023-08-27T11:24:47.908860+0000","last_active":"2023-08-27T11:24:48.887161+0000","last_peered":"2023-08-27T11:24:48.887161+0000","last_clean":"2023-08-27T11:24:48.887161+0000","last_became_active":"2023-08-27T11:24:47.908474+0000","last_became_peered":"2023-08-27T11:24:47.908474+0000","last_unstale":"2023-08-27T11:24:48.887161+0000","last_undegraded":"2023-08-27T11:24:48.887161+0000","last_fullsized":"2023-08-27T11:24:48.887161+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:10.335838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":29,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092530+0000","last_change":"2023-08-27T11:24:32.278403+0000","last_active":"2023-08-27T11:24:49.092530+0000","last_peered":"2023-08-27T11:24:49.092530+0000","last_clean":"2023-08-27T11:24:49.092530+0000","last_became_active":"2023-08-27T11:24:32.278104+0000","last_became_peered":"2023-08-27T11:24:32.278104+0000","last_unstale":"2023-08-27T11:24:49.092530+0000","last_undegraded":"2023-08-27T11:24:49.092530+0000","last_fullsized":"2023-08-27T11:24:49.092530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:31.215420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944271+0000","last_change":"2023-08-27T11:24:32.913029+0000","last_active":"2023-08-27T11:24:48.944271+0000","last_peered":"2023-08-27T11:24:48.944271+0000","last_clean":"2023-08-27T11:24:48.944271+0000","last_became_active":"2023-08-27T11:24:32.912708+0000","last_became_peered":"2023-08-27T11:24:32.912708+0000","last_unstale":"2023-08-27T11:24:48.944271+0000","last_undegraded":"2023-08-27T11:24:48.944271+0000","last_fullsized":"2023-08-27T11:24:48.944271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:45:48.089310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945695+0000","last_change":"2023-08-27T11:24:47.016833+0000","last_active":"2023-08-27T11:24:48.945695+0000","last_peered":"2023-08-27T11:24:48.945695+0000","last_clean":"2023-08-27T11:24:48.945695+0000","last_became_active":"2023-08-27T11:24:47.016470+0000","last_became_peered":"2023-08-27T11:24:47.016470+0000","last_unstale":"2023-08-27T11:24:48.945695+0000","last_undegraded":"2023-08-27T11:24:48.945695+0000","last_fullsized":"2023-08-27T11:24:48.945695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:37:17.930997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245578+0000","last_change":"2023-08-27T11:24:32.287269+0000","last_active":"2023-08-27T11:24:49.245578+0000","last_peered":"2023-08-27T11:24:49.245578+0000","last_clean":"2023-08-27T11:24:49.245578+0000","last_became_active":"2023-08-27T11:24:32.286965+0000","last_became_peered":"2023-08-27T11:24:32.286965+0000","last_unstale":"2023-08-27T11:24:49.245578+0000","last_undegraded":"2023-08-27T11:24:49.245578+0000","last_fullsized":"2023-08-27T11:24:49.245578+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:53.556466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092721+0000","last_change":"2023-08-27T11:24:32.900978+0000","last_active":"2023-08-27T11:24:49.092721+0000","last_peered":"2023-08-27T11:24:49.092721+0000","last_clean":"2023-08-27T11:24:49.092721+0000","last_became_active":"2023-08-27T11:24:32.900695+0000","last_became_peered":"2023-08-27T11:24:32.900695+0000","last_unstale":"2023-08-27T11:24:49.092721+0000","last_undegraded":"2023-08-27T11:24:49.092721+0000","last_fullsized":"2023-08-27T11:24:49.092721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:32.905139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001079+0000","last_change":"2023-08-27T11:24:47.016744+0000","last_active":"2023-08-27T11:24:49.001079+0000","last_peered":"2023-08-27T11:24:49.001079+0000","last_clean":"2023-08-27T11:24:49.001079+0000","last_became_active":"2023-08-27T11:24:47.016442+0000","last_became_peered":"2023-08-27T11:24:47.016442+0000","last_unstale":"2023-08-27T11:24:49.001079+0000","last_undegraded":"2023-08-27T11:24:49.001079+0000","last_fullsized":"2023-08-27T11:24:49.001079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:07.205563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245382+0000","last_change":"2023-08-27T11:24:47.905679+0000","last_active":"2023-08-27T11:24:49.245382+0000","last_peered":"2023-08-27T11:24:49.245382+0000","last_clean":"2023-08-27T11:24:49.245382+0000","last_became_active":"2023-08-27T11:24:47.905406+0000","last_became_peered":"2023-08-27T11:24:47.905406+0000","last_unstale":"2023-08-27T11:24:49.245382+0000","last_undegraded":"2023-08-27T11:24:49.245382+0000","last_fullsized":"2023-08-27T11:24:49.245382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:38.696066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247439+0000","last_change":"2023-08-27T11:24:47.909448+0000","last_active":"2023-08-27T11:24:49.247439+0000","last_peered":"2023-08-27T11:24:49.247439+0000","last_clean":"2023-08-27T11:24:49.247439+0000","last_became_active":"2023-08-27T11:24:47.909169+0000","last_became_peered":"2023-08-27T11:24:47.909169+0000","last_unstale":"2023-08-27T11:24:49.247439+0000","last_undegraded":"2023-08-27T11:24:49.247439+0000","last_fullsized":"2023-08-27T11:24:49.247439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:07:11.726614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245176+0000","last_change":"2023-08-27T11:24:32.298695+0000","last_active":"2023-08-27T11:24:49.245176+0000","last_peered":"2023-08-27T11:24:49.245176+0000","last_clean":"2023-08-27T11:24:49.245176+0000","last_became_active":"2023-08-27T11:24:32.298396+0000","last_became_peered":"2023-08-27T11:24:32.298396+0000","last_unstale":"2023-08-27T11:24:49.245176+0000","last_undegraded":"2023-08-27T11:24:49.245176+0000","last_fullsized":"2023-08-27T11:24:49.245176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:26.874176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945221+0000","last_change":"2023-08-27T11:24:32.908533+0000","last_active":"2023-08-27T11:24:48.945221+0000","last_peered":"2023-08-27T11:24:48.945221+0000","last_clean":"2023-08-27T11:24:48.945221+0000","last_became_active":"2023-08-27T11:24:32.908214+0000","last_became_peered":"2023-08-27T11:24:32.908214+0000","last_unstale":"2023-08-27T11:24:48.945221+0000","last_undegraded":"2023-08-27T11:24:48.945221+0000","last_fullsized":"2023-08-27T11:24:48.945221+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:39.181679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945088+0000","last_change":"2023-08-27T11:24:47.012692+0000","last_active":"2023-08-27T11:24:48.945088+0000","last_peered":"2023-08-27T11:24:48.945088+0000","last_clean":"2023-08-27T11:24:48.945088+0000","last_became_active":"2023-08-27T11:24:47.012401+0000","last_became_peered":"2023-08-27T11:24:47.012401+0000","last_unstale":"2023-08-27T11:24:48.945088+0000","last_undegraded":"2023-08-27T11:24:48.945088+0000","last_fullsized":"2023-08-27T11:24:48.945088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:30.303526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945388+0000","last_change":"2023-08-27T11:24:47.897560+0000","last_active":"2023-08-27T11:24:48.945388+0000","last_peered":"2023-08-27T11:24:48.945388+0000","last_clean":"2023-08-27T11:24:48.945388+0000","last_became_active":"2023-08-27T11:24:47.897275+0000","last_became_peered":"2023-08-27T11:24:47.897275+0000","last_unstale":"2023-08-27T11:24:48.945388+0000","last_undegraded":"2023-08-27T11:24:48.945388+0000","last_fullsized":"2023-08-27T11:24:48.945388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:50.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945038+0000","last_change":"2023-08-27T11:24:32.292723+0000","last_active":"2023-08-27T11:24:48.945038+0000","last_peered":"2023-08-27T11:24:48.945038+0000","last_clean":"2023-08-27T11:24:48.945038+0000","last_became_active":"2023-08-27T11:24:32.292342+0000","last_became_peered":"2023-08-27T11:24:32.292342+0000","last_unstale":"2023-08-27T11:24:48.945038+0000","last_undegraded":"2023-08-27T11:24:48.945038+0000","last_fullsized":"2023-08-27T11:24:48.945038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:14:37.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886531+0000","last_change":"2023-08-27T11:24:32.906136+0000","last_active":"2023-08-27T11:24:48.886531+0000","last_peered":"2023-08-27T11:24:48.886531+0000","last_clean":"2023-08-27T11:24:48.886531+0000","last_became_active":"2023-08-27T11:24:32.905859+0000","last_became_peered":"2023-08-27T11:24:32.905859+0000","last_unstale":"2023-08-27T11:24:48.886531+0000","last_undegraded":"2023-08-27T11:24:48.886531+0000","last_fullsized":"2023-08-27T11:24:48.886531+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:36:02.861937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945446+0000","last_change":"2023-08-27T11:24:47.011982+0000","last_active":"2023-08-27T11:24:48.945446+0000","last_peered":"2023-08-27T11:24:48.945446+0000","last_clean":"2023-08-27T11:24:48.945446+0000","last_became_active":"2023-08-27T11:24:47.011379+0000","last_became_peered":"2023-08-27T11:24:47.011379+0000","last_unstale":"2023-08-27T11:24:48.945446+0000","last_undegraded":"2023-08-27T11:24:48.945446+0000","last_fullsized":"2023-08-27T11:24:48.945446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:13.738553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":27,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092572+0000","last_change":"2023-08-27T11:24:32.283014+0000","last_active":"2023-08-27T11:24:49.092572+0000","last_peered":"2023-08-27T11:24:49.092572+0000","last_clean":"2023-08-27T11:24:49.092572+0000","last_became_active":"2023-08-27T11:24:32.282692+0000","last_became_peered":"2023-08-27T11:24:32.282692+0000","last_unstale":"2023-08-27T11:24:49.092572+0000","last_undegraded":"2023-08-27T11:24:49.092572+0000","last_fullsized":"2023-08-27T11:24:49.092572+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:46.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885873+0000","last_change":"2023-08-27T11:24:32.909417+0000","last_active":"2023-08-27T11:24:48.885873+0000","last_peered":"2023-08-27T11:24:48.885873+0000","last_clean":"2023-08-27T11:24:48.885873+0000","last_became_active":"2023-08-27T11:24:32.908900+0000","last_became_peered":"2023-08-27T11:24:32.908900+0000","last_unstale":"2023-08-27T11:24:48.885873+0000","last_undegraded":"2023-08-27T11:24:48.885873+0000","last_fullsized":"2023-08-27T11:24:48.885873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:38:08.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092402+0000","last_change":"2023-08-27T11:24:47.003141+0000","last_active":"2023-08-27T11:24:49.092402+0000","last_peered":"2023-08-27T11:24:49.092402+0000","last_clean":"2023-08-27T11:24:49.092402+0000","last_became_active":"2023-08-27T11:24:47.002815+0000","last_became_peered":"2023-08-27T11:24:47.002815+0000","last_unstale":"2023-08-27T11:24:49.092402+0000","last_undegraded":"2023-08-27T11:24:49.092402+0000","last_fullsized":"2023-08-27T11:24:49.092402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:37:17.930997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999923+0000","last_change":"2023-08-27T11:24:47.913875+0000","last_active":"2023-08-27T11:24:48.999923+0000","last_peered":"2023-08-27T11:24:48.999923+0000","last_clean":"2023-08-27T11:24:48.999923+0000","last_became_active":"2023-08-27T11:24:47.913505+0000","last_became_peered":"2023-08-27T11:24:47.913505+0000","last_unstale":"2023-08-27T11:24:48.999923+0000","last_undegraded":"2023-08-27T11:24:48.999923+0000","last_fullsized":"2023-08-27T11:24:48.999923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:08.294436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246910+0000","last_change":"2023-08-27T11:24:32.291485+0000","last_active":"2023-08-27T11:24:49.246910+0000","last_peered":"2023-08-27T11:24:49.246910+0000","last_clean":"2023-08-27T11:24:49.246910+0000","last_became_active":"2023-08-27T11:24:32.291149+0000","last_became_peered":"2023-08-27T11:24:32.291149+0000","last_unstale":"2023-08-27T11:24:49.246910+0000","last_undegraded":"2023-08-27T11:24:49.246910+0000","last_fullsized":"2023-08-27T11:24:49.246910+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:53.365934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944762+0000","last_change":"2023-08-27T11:24:32.905500+0000","last_active":"2023-08-27T11:24:48.944762+0000","last_peered":"2023-08-27T11:24:48.944762+0000","last_clean":"2023-08-27T11:24:48.944762+0000","last_became_active":"2023-08-27T11:24:32.905258+0000","last_became_peered":"2023-08-27T11:24:32.905258+0000","last_unstale":"2023-08-27T11:24:48.944762+0000","last_undegraded":"2023-08-27T11:24:48.944762+0000","last_fullsized":"2023-08-27T11:24:48.944762+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:08.615489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092472+0000","last_change":"2023-08-27T11:24:47.013982+0000","last_active":"2023-08-27T11:24:49.092472+0000","last_peered":"2023-08-27T11:24:49.092472+0000","last_clean":"2023-08-27T11:24:49.092472+0000","last_became_active":"2023-08-27T11:24:47.013680+0000","last_became_peered":"2023-08-27T11:24:47.013680+0000","last_unstale":"2023-08-27T11:24:49.092472+0000","last_undegraded":"2023-08-27T11:24:49.092472+0000","last_fullsized":"2023-08-27T11:24:49.092472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:18:23.255582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884965+0000","last_change":"2023-08-27T11:24:47.905311+0000","last_active":"2023-08-27T11:24:48.884965+0000","last_peered":"2023-08-27T11:24:48.884965+0000","last_clean":"2023-08-27T11:24:48.884965+0000","last_became_active":"2023-08-27T11:24:47.905014+0000","last_became_peered":"2023-08-27T11:24:47.905014+0000","last_unstale":"2023-08-27T11:24:48.884965+0000","last_undegraded":"2023-08-27T11:24:48.884965+0000","last_fullsized":"2023-08-27T11:24:48.884965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:34.411100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887497+0000","last_change":"2023-08-27T11:24:32.299429+0000","last_active":"2023-08-27T11:24:48.887497+0000","last_peered":"2023-08-27T11:24:48.887497+0000","last_clean":"2023-08-27T11:24:48.887497+0000","last_became_active":"2023-08-27T11:24:32.299132+0000","last_became_peered":"2023-08-27T11:24:32.299132+0000","last_unstale":"2023-08-27T11:24:48.887497+0000","last_undegraded":"2023-08-27T11:24:48.887497+0000","last_fullsized":"2023-08-27T11:24:48.887497+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:00:32.414723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885834+0000","last_change":"2023-08-27T11:24:32.909216+0000","last_active":"2023-08-27T11:24:48.885834+0000","last_peered":"2023-08-27T11:24:48.885834+0000","last_clean":"2023-08-27T11:24:48.885834+0000","last_became_active":"2023-08-27T11:24:32.908852+0000","last_became_peered":"2023-08-27T11:24:32.908852+0000","last_unstale":"2023-08-27T11:24:48.885834+0000","last_undegraded":"2023-08-27T11:24:48.885834+0000","last_fullsized":"2023-08-27T11:24:48.885834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:12.997208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244927+0000","last_change":"2023-08-27T11:24:47.016633+0000","last_active":"2023-08-27T11:24:49.244927+0000","last_peered":"2023-08-27T11:24:49.244927+0000","last_clean":"2023-08-27T11:24:49.244927+0000","last_became_active":"2023-08-27T11:24:47.016296+0000","last_became_peered":"2023-08-27T11:24:47.016296+0000","last_unstale":"2023-08-27T11:24:49.244927+0000","last_undegraded":"2023-08-27T11:24:49.244927+0000","last_fullsized":"2023-08-27T11:24:49.244927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:05.325518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092417+0000","last_change":"2023-08-27T11:24:47.892660+0000","last_active":"2023-08-27T11:24:49.092417+0000","last_peered":"2023-08-27T11:24:49.092417+0000","last_clean":"2023-08-27T11:24:49.092417+0000","last_became_active":"2023-08-27T11:24:47.892366+0000","last_became_peered":"2023-08-27T11:24:47.892366+0000","last_unstale":"2023-08-27T11:24:49.092417+0000","last_undegraded":"2023-08-27T11:24:49.092417+0000","last_fullsized":"2023-08-27T11:24:49.092417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:57.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246991+0000","last_change":"2023-08-27T11:24:32.288640+0000","last_active":"2023-08-27T11:24:49.246991+0000","last_peered":"2023-08-27T11:24:49.246991+0000","last_clean":"2023-08-27T11:24:49.246991+0000","last_became_active":"2023-08-27T11:24:32.288294+0000","last_became_peered":"2023-08-27T11:24:32.288294+0000","last_unstale":"2023-08-27T11:24:49.246991+0000","last_undegraded":"2023-08-27T11:24:49.246991+0000","last_fullsized":"2023-08-27T11:24:49.246991+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:25.979914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885871+0000","last_change":"2023-08-27T11:24:32.901552+0000","last_active":"2023-08-27T11:24:48.885871+0000","last_peered":"2023-08-27T11:24:48.885871+0000","last_clean":"2023-08-27T11:24:48.885871+0000","last_became_active":"2023-08-27T11:24:32.901215+0000","last_became_peered":"2023-08-27T11:24:32.901215+0000","last_unstale":"2023-08-27T11:24:48.885871+0000","last_undegraded":"2023-08-27T11:24:48.885871+0000","last_fullsized":"2023-08-27T11:24:48.885871+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:46.013783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092150+0000","last_change":"2023-08-27T11:24:47.013634+0000","last_active":"2023-08-27T11:24:49.092150+0000","last_peered":"2023-08-27T11:24:49.092150+0000","last_clean":"2023-08-27T11:24:49.092150+0000","last_became_active":"2023-08-27T11:24:47.013298+0000","last_became_peered":"2023-08-27T11:24:47.013298+0000","last_unstale":"2023-08-27T11:24:49.092150+0000","last_undegraded":"2023-08-27T11:24:49.092150+0000","last_fullsized":"2023-08-27T11:24:49.092150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:49.803890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246115+0000","last_change":"2023-08-27T11:24:47.907900+0000","last_active":"2023-08-27T11:24:49.246115+0000","last_peered":"2023-08-27T11:24:49.246115+0000","last_clean":"2023-08-27T11:24:49.246115+0000","last_became_active":"2023-08-27T11:24:47.907298+0000","last_became_peered":"2023-08-27T11:24:47.907298+0000","last_unstale":"2023-08-27T11:24:49.246115+0000","last_undegraded":"2023-08-27T11:24:49.246115+0000","last_fullsized":"2023-08-27T11:24:49.246115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:08.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944531+0000","last_change":"2023-08-27T11:24:32.298796+0000","last_active":"2023-08-27T11:24:48.944531+0000","last_peered":"2023-08-27T11:24:48.944531+0000","last_clean":"2023-08-27T11:24:48.944531+0000","last_became_active":"2023-08-27T11:24:32.298437+0000","last_became_peered":"2023-08-27T11:24:32.298437+0000","last_unstale":"2023-08-27T11:24:48.944531+0000","last_undegraded":"2023-08-27T11:24:48.944531+0000","last_fullsized":"2023-08-27T11:24:48.944531+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:42:00.835630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247360+0000","last_change":"2023-08-27T11:24:32.910118+0000","last_active":"2023-08-27T11:24:49.247360+0000","last_peered":"2023-08-27T11:24:49.247360+0000","last_clean":"2023-08-27T11:24:49.247360+0000","last_became_active":"2023-08-27T11:24:32.909727+0000","last_became_peered":"2023-08-27T11:24:32.909727+0000","last_unstale":"2023-08-27T11:24:49.247360+0000","last_undegraded":"2023-08-27T11:24:49.247360+0000","last_fullsized":"2023-08-27T11:24:49.247360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:14.792347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887390+0000","last_change":"2023-08-27T11:24:47.008957+0000","last_active":"2023-08-27T11:24:48.887390+0000","last_peered":"2023-08-27T11:24:48.887390+0000","last_clean":"2023-08-27T11:24:48.887390+0000","last_became_active":"2023-08-27T11:24:47.008637+0000","last_became_peered":"2023-08-27T11:24:47.008637+0000","last_unstale":"2023-08-27T11:24:48.887390+0000","last_undegraded":"2023-08-27T11:24:48.887390+0000","last_fullsized":"2023-08-27T11:24:48.887390+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:44.431525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092325+0000","last_change":"2023-08-27T11:24:47.894532+0000","last_active":"2023-08-27T11:24:49.092325+0000","last_peered":"2023-08-27T11:24:49.092325+0000","last_clean":"2023-08-27T11:24:49.092325+0000","last_became_active":"2023-08-27T11:24:47.894217+0000","last_became_peered":"2023-08-27T11:24:47.894217+0000","last_unstale":"2023-08-27T11:24:49.092325+0000","last_undegraded":"2023-08-27T11:24:49.092325+0000","last_fullsized":"2023-08-27T11:24:49.092325+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:31:15.659470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245420+0000","last_change":"2023-08-27T11:24:32.290256+0000","last_active":"2023-08-27T11:24:49.245420+0000","last_peered":"2023-08-27T11:24:49.245420+0000","last_clean":"2023-08-27T11:24:49.245420+0000","last_became_active":"2023-08-27T11:24:32.289480+0000","last_became_peered":"2023-08-27T11:24:32.289480+0000","last_unstale":"2023-08-27T11:24:49.245420+0000","last_undegraded":"2023-08-27T11:24:49.245420+0000","last_fullsized":"2023-08-27T11:24:49.245420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:58.767544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091846+0000","last_change":"2023-08-27T11:24:32.884415+0000","last_active":"2023-08-27T11:24:49.091846+0000","last_peered":"2023-08-27T11:24:49.091846+0000","last_clean":"2023-08-27T11:24:49.091846+0000","last_became_active":"2023-08-27T11:24:32.884135+0000","last_became_peered":"2023-08-27T11:24:32.884135+0000","last_unstale":"2023-08-27T11:24:49.091846+0000","last_undegraded":"2023-08-27T11:24:49.091846+0000","last_fullsized":"2023-08-27T11:24:49.091846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:16.593340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247238+0000","last_change":"2023-08-27T11:24:47.020268+0000","last_active":"2023-08-27T11:24:49.247238+0000","last_peered":"2023-08-27T11:24:49.247238+0000","last_clean":"2023-08-27T11:24:49.247238+0000","last_became_active":"2023-08-27T11:24:47.019798+0000","last_became_peered":"2023-08-27T11:24:47.019798+0000","last_unstale":"2023-08-27T11:24:49.247238+0000","last_undegraded":"2023-08-27T11:24:49.247238+0000","last_fullsized":"2023-08-27T11:24:49.247238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:44.330656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000560+0000","last_change":"2023-08-27T11:24:47.902928+0000","last_active":"2023-08-27T11:24:49.000560+0000","last_peered":"2023-08-27T11:24:49.000560+0000","last_clean":"2023-08-27T11:24:49.000560+0000","last_became_active":"2023-08-27T11:24:47.902538+0000","last_became_peered":"2023-08-27T11:24:47.902538+0000","last_unstale":"2023-08-27T11:24:49.000560+0000","last_undegraded":"2023-08-27T11:24:49.000560+0000","last_fullsized":"2023-08-27T11:24:49.000560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:42.598054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885877+0000","last_change":"2023-08-27T11:24:32.282892+0000","last_active":"2023-08-27T11:24:48.885877+0000","last_peered":"2023-08-27T11:24:48.885877+0000","last_clean":"2023-08-27T11:24:48.885877+0000","last_became_active":"2023-08-27T11:24:32.282592+0000","last_became_peered":"2023-08-27T11:24:32.282592+0000","last_unstale":"2023-08-27T11:24:48.885877+0000","last_undegraded":"2023-08-27T11:24:48.885877+0000","last_fullsized":"2023-08-27T11:24:48.885877+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:58.267488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247340+0000","last_change":"2023-08-27T11:24:32.904723+0000","last_active":"2023-08-27T11:24:49.247340+0000","last_peered":"2023-08-27T11:24:49.247340+0000","last_clean":"2023-08-27T11:24:49.247340+0000","last_became_active":"2023-08-27T11:24:32.904416+0000","last_became_peered":"2023-08-27T11:24:32.904416+0000","last_unstale":"2023-08-27T11:24:49.247340+0000","last_undegraded":"2023-08-27T11:24:49.247340+0000","last_fullsized":"2023-08-27T11:24:49.247340+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:44.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000739+0000","last_change":"2023-08-27T11:24:47.015021+0000","last_active":"2023-08-27T11:24:49.000739+0000","last_peered":"2023-08-27T11:24:49.000739+0000","last_clean":"2023-08-27T11:24:49.000739+0000","last_became_active":"2023-08-27T11:24:47.014658+0000","last_became_peered":"2023-08-27T11:24:47.014658+0000","last_unstale":"2023-08-27T11:24:49.000739+0000","last_undegraded":"2023-08-27T11:24:49.000739+0000","last_fullsized":"2023-08-27T11:24:49.000739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:41.250666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887138+0000","last_change":"2023-08-27T11:24:47.898368+0000","last_active":"2023-08-27T11:24:48.887138+0000","last_peered":"2023-08-27T11:24:48.887138+0000","last_clean":"2023-08-27T11:24:48.887138+0000","last_became_active":"2023-08-27T11:24:47.898051+0000","last_became_peered":"2023-08-27T11:24:47.898051+0000","last_unstale":"2023-08-27T11:24:48.887138+0000","last_undegraded":"2023-08-27T11:24:48.887138+0000","last_fullsized":"2023-08-27T11:24:48.887138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:17.928294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945025+0000","last_change":"2023-08-27T11:24:32.298886+0000","last_active":"2023-08-27T11:24:48.945025+0000","last_peered":"2023-08-27T11:24:48.945025+0000","last_clean":"2023-08-27T11:24:48.945025+0000","last_became_active":"2023-08-27T11:24:32.298269+0000","last_became_peered":"2023-08-27T11:24:32.298269+0000","last_unstale":"2023-08-27T11:24:48.945025+0000","last_undegraded":"2023-08-27T11:24:48.945025+0000","last_fullsized":"2023-08-27T11:24:48.945025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:15.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887671+0000","last_change":"2023-08-27T11:24:32.910605+0000","last_active":"2023-08-27T11:24:48.887671+0000","last_peered":"2023-08-27T11:24:48.887671+0000","last_clean":"2023-08-27T11:24:48.887671+0000","last_became_active":"2023-08-27T11:24:32.910330+0000","last_became_peered":"2023-08-27T11:24:32.910330+0000","last_unstale":"2023-08-27T11:24:48.887671+0000","last_undegraded":"2023-08-27T11:24:48.887671+0000","last_fullsized":"2023-08-27T11:24:48.887671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:15:50.087109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246781+0000","last_change":"2023-08-27T11:24:47.021071+0000","last_active":"2023-08-27T11:24:49.246781+0000","last_peered":"2023-08-27T11:24:49.246781+0000","last_clean":"2023-08-27T11:24:49.246781+0000","last_became_active":"2023-08-27T11:24:47.020702+0000","last_became_peered":"2023-08-27T11:24:47.020702+0000","last_unstale":"2023-08-27T11:24:49.246781+0000","last_undegraded":"2023-08-27T11:24:49.246781+0000","last_fullsized":"2023-08-27T11:24:49.246781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:22.968979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246842+0000","last_change":"2023-08-27T11:24:47.904224+0000","last_active":"2023-08-27T11:24:49.246842+0000","last_peered":"2023-08-27T11:24:49.246842+0000","last_clean":"2023-08-27T11:24:49.246842+0000","last_became_active":"2023-08-27T11:24:47.903819+0000","last_became_peered":"2023-08-27T11:24:47.903819+0000","last_unstale":"2023-08-27T11:24:49.246842+0000","last_undegraded":"2023-08-27T11:24:49.246842+0000","last_fullsized":"2023-08-27T11:24:49.246842+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:22.403683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886632+0000","last_change":"2023-08-27T11:24:32.294367+0000","last_active":"2023-08-27T11:24:48.886632+0000","last_peered":"2023-08-27T11:24:48.886632+0000","last_clean":"2023-08-27T11:24:48.886632+0000","last_became_active":"2023-08-27T11:24:32.294063+0000","last_became_peered":"2023-08-27T11:24:32.294063+0000","last_unstale":"2023-08-27T11:24:48.886632+0000","last_undegraded":"2023-08-27T11:24:48.886632+0000","last_fullsized":"2023-08-27T11:24:48.886632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:10:06.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092194+0000","last_change":"2023-08-27T11:24:32.883656+0000","last_active":"2023-08-27T11:24:49.092194+0000","last_peered":"2023-08-27T11:24:49.092194+0000","last_clean":"2023-08-27T11:24:49.092194+0000","last_became_active":"2023-08-27T11:24:32.883338+0000","last_became_peered":"2023-08-27T11:24:32.883338+0000","last_unstale":"2023-08-27T11:24:49.092194+0000","last_undegraded":"2023-08-27T11:24:49.092194+0000","last_fullsized":"2023-08-27T11:24:49.092194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:00.028368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886597+0000","last_change":"2023-08-27T11:24:47.012447+0000","last_active":"2023-08-27T11:24:48.886597+0000","last_peered":"2023-08-27T11:24:48.886597+0000","last_clean":"2023-08-27T11:24:48.886597+0000","last_became_active":"2023-08-27T11:24:47.011969+0000","last_became_peered":"2023-08-27T11:24:47.011969+0000","last_unstale":"2023-08-27T11:24:48.886597+0000","last_undegraded":"2023-08-27T11:24:48.886597+0000","last_fullsized":"2023-08-27T11:24:48.886597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:13:45.412522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885434+0000","last_change":"2023-08-27T11:24:47.898780+0000","last_active":"2023-08-27T11:24:48.885434+0000","last_peered":"2023-08-27T11:24:48.885434+0000","last_clean":"2023-08-27T11:24:48.885434+0000","last_became_active":"2023-08-27T11:24:47.898425+0000","last_became_peered":"2023-08-27T11:24:47.898425+0000","last_unstale":"2023-08-27T11:24:48.885434+0000","last_undegraded":"2023-08-27T11:24:48.885434+0000","last_fullsized":"2023-08-27T11:24:48.885434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:27.046288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000643+0000","last_change":"2023-08-27T11:24:32.289666+0000","last_active":"2023-08-27T11:24:49.000643+0000","last_peered":"2023-08-27T11:24:49.000643+0000","last_clean":"2023-08-27T11:24:49.000643+0000","last_became_active":"2023-08-27T11:24:32.289236+0000","last_became_peered":"2023-08-27T11:24:32.289236+0000","last_unstale":"2023-08-27T11:24:49.000643+0000","last_undegraded":"2023-08-27T11:24:49.000643+0000","last_fullsized":"2023-08-27T11:24:49.000643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:35.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245806+0000","last_change":"2023-08-27T11:24:32.902261+0000","last_active":"2023-08-27T11:24:49.245806+0000","last_peered":"2023-08-27T11:24:49.245806+0000","last_clean":"2023-08-27T11:24:49.245806+0000","last_became_active":"2023-08-27T11:24:32.901957+0000","last_became_peered":"2023-08-27T11:24:32.901957+0000","last_unstale":"2023-08-27T11:24:49.245806+0000","last_undegraded":"2023-08-27T11:24:49.245806+0000","last_fullsized":"2023-08-27T11:24:49.245806+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:48.185155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246426+0000","last_change":"2023-08-27T11:24:47.019976+0000","last_active":"2023-08-27T11:24:49.246426+0000","last_peered":"2023-08-27T11:24:49.246426+0000","last_clean":"2023-08-27T11:24:49.246426+0000","last_became_active":"2023-08-27T11:24:47.019494+0000","last_became_peered":"2023-08-27T11:24:47.019494+0000","last_unstale":"2023-08-27T11:24:49.246426+0000","last_undegraded":"2023-08-27T11:24:49.246426+0000","last_fullsized":"2023-08-27T11:24:49.246426+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:31:03.228153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886080+0000","last_change":"2023-08-27T11:24:47.908924+0000","last_active":"2023-08-27T11:24:48.886080+0000","last_peered":"2023-08-27T11:24:48.886080+0000","last_clean":"2023-08-27T11:24:48.886080+0000","last_became_active":"2023-08-27T11:24:47.908614+0000","last_became_peered":"2023-08-27T11:24:47.908614+0000","last_unstale":"2023-08-27T11:24:48.886080+0000","last_undegraded":"2023-08-27T11:24:48.886080+0000","last_fullsized":"2023-08-27T11:24:48.886080+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:13:46.420607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000891+0000","last_change":"2023-08-27T11:24:32.294572+0000","last_active":"2023-08-27T11:24:49.000891+0000","last_peered":"2023-08-27T11:24:49.000891+0000","last_clean":"2023-08-27T11:24:49.000891+0000","last_became_active":"2023-08-27T11:24:32.294253+0000","last_became_peered":"2023-08-27T11:24:32.294253+0000","last_unstale":"2023-08-27T11:24:49.000891+0000","last_undegraded":"2023-08-27T11:24:49.000891+0000","last_fullsized":"2023-08-27T11:24:49.000891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:32.625681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886046+0000","last_change":"2023-08-27T11:24:32.907402+0000","last_active":"2023-08-27T11:24:48.886046+0000","last_peered":"2023-08-27T11:24:48.886046+0000","last_clean":"2023-08-27T11:24:48.886046+0000","last_became_active":"2023-08-27T11:24:32.907043+0000","last_became_peered":"2023-08-27T11:24:32.907043+0000","last_unstale":"2023-08-27T11:24:48.886046+0000","last_undegraded":"2023-08-27T11:24:48.886046+0000","last_fullsized":"2023-08-27T11:24:48.886046+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:38.694285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885656+0000","last_change":"2023-08-27T11:24:47.012361+0000","last_active":"2023-08-27T11:24:48.885656+0000","last_peered":"2023-08-27T11:24:48.885656+0000","last_clean":"2023-08-27T11:24:48.885656+0000","last_became_active":"2023-08-27T11:24:47.012023+0000","last_became_peered":"2023-08-27T11:24:47.012023+0000","last_unstale":"2023-08-27T11:24:48.885656+0000","last_undegraded":"2023-08-27T11:24:48.885656+0000","last_fullsized":"2023-08-27T11:24:48.885656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:20.049151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000340+0000","last_change":"2023-08-27T11:24:47.904203+0000","last_active":"2023-08-27T11:24:49.000340+0000","last_peered":"2023-08-27T11:24:49.000340+0000","last_clean":"2023-08-27T11:24:49.000340+0000","last_became_active":"2023-08-27T11:24:47.902628+0000","last_became_peered":"2023-08-27T11:24:47.902628+0000","last_unstale":"2023-08-27T11:24:49.000340+0000","last_undegraded":"2023-08-27T11:24:49.000340+0000","last_fullsized":"2023-08-27T11:24:49.000340+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:29.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246816+0000","last_change":"2023-08-27T11:24:32.282881+0000","last_active":"2023-08-27T11:24:49.246816+0000","last_peered":"2023-08-27T11:24:49.246816+0000","last_clean":"2023-08-27T11:24:49.246816+0000","last_became_active":"2023-08-27T11:24:32.282586+0000","last_became_peered":"2023-08-27T11:24:32.282586+0000","last_unstale":"2023-08-27T11:24:49.246816+0000","last_undegraded":"2023-08-27T11:24:49.246816+0000","last_fullsized":"2023-08-27T11:24:49.246816+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:31.154008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244462+0000","last_change":"2023-08-27T11:24:32.898642+0000","last_active":"2023-08-27T11:24:49.244462+0000","last_peered":"2023-08-27T11:24:49.244462+0000","last_clean":"2023-08-27T11:24:49.244462+0000","last_became_active":"2023-08-27T11:24:32.898270+0000","last_became_peered":"2023-08-27T11:24:32.898270+0000","last_unstale":"2023-08-27T11:24:49.244462+0000","last_undegraded":"2023-08-27T11:24:49.244462+0000","last_fullsized":"2023-08-27T11:24:49.244462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:10.378391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246013+0000","last_change":"2023-08-27T11:24:47.016445+0000","last_active":"2023-08-27T11:24:49.246013+0000","last_peered":"2023-08-27T11:24:49.246013+0000","last_clean":"2023-08-27T11:24:49.246013+0000","last_became_active":"2023-08-27T11:24:47.016101+0000","last_became_peered":"2023-08-27T11:24:47.016101+0000","last_unstale":"2023-08-27T11:24:49.246013+0000","last_undegraded":"2023-08-27T11:24:49.246013+0000","last_fullsized":"2023-08-27T11:24:49.246013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:52:00.207779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246183+0000","last_change":"2023-08-27T11:24:47.907682+0000","last_active":"2023-08-27T11:24:49.246183+0000","last_peered":"2023-08-27T11:24:49.246183+0000","last_clean":"2023-08-27T11:24:49.246183+0000","last_became_active":"2023-08-27T11:24:47.906821+0000","last_became_peered":"2023-08-27T11:24:47.906821+0000","last_unstale":"2023-08-27T11:24:49.246183+0000","last_undegraded":"2023-08-27T11:24:49.246183+0000","last_fullsized":"2023-08-27T11:24:49.246183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:06.668299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886384+0000","last_change":"2023-08-27T11:24:47.910317+0000","last_active":"2023-08-27T11:24:48.886384+0000","last_peered":"2023-08-27T11:24:48.886384+0000","last_clean":"2023-08-27T11:24:48.886384+0000","last_became_active":"2023-08-27T11:24:47.910020+0000","last_became_peered":"2023-08-27T11:24:47.910020+0000","last_unstale":"2023-08-27T11:24:48.886384+0000","last_undegraded":"2023-08-27T11:24:48.886384+0000","last_fullsized":"2023-08-27T11:24:48.886384+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:17.158711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885894+0000","last_change":"2023-08-27T11:24:32.900379+0000","last_active":"2023-08-27T11:24:48.885894+0000","last_peered":"2023-08-27T11:24:48.885894+0000","last_clean":"2023-08-27T11:24:48.885894+0000","last_became_active":"2023-08-27T11:24:32.899692+0000","last_became_peered":"2023-08-27T11:24:32.899692+0000","last_unstale":"2023-08-27T11:24:48.885894+0000","last_undegraded":"2023-08-27T11:24:48.885894+0000","last_fullsized":"2023-08-27T11:24:48.885894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:00.082236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246284+0000","last_change":"2023-08-27T11:24:47.917197+0000","last_active":"2023-08-27T11:24:49.246284+0000","last_peered":"2023-08-27T11:24:49.246284+0000","last_clean":"2023-08-27T11:24:49.246284+0000","last_became_active":"2023-08-27T11:24:47.916869+0000","last_became_peered":"2023-08-27T11:24:47.916869+0000","last_unstale":"2023-08-27T11:24:49.246284+0000","last_undegraded":"2023-08-27T11:24:49.246284+0000","last_fullsized":"2023-08-27T11:24:49.246284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:02.281287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944051+0000","last_change":"2023-08-27T11:24:32.907054+0000","last_active":"2023-08-27T11:24:48.944051+0000","last_peered":"2023-08-27T11:24:48.944051+0000","last_clean":"2023-08-27T11:24:48.944051+0000","last_became_active":"2023-08-27T11:24:32.906207+0000","last_became_peered":"2023-08-27T11:24:32.906207+0000","last_unstale":"2023-08-27T11:24:48.944051+0000","last_undegraded":"2023-08-27T11:24:48.944051+0000","last_fullsized":"2023-08-27T11:24:48.944051+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:39:02.849881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944509+0000","last_change":"2023-08-27T11:24:47.896246+0000","last_active":"2023-08-27T11:24:48.944509+0000","last_peered":"2023-08-27T11:24:48.944509+0000","last_clean":"2023-08-27T11:24:48.944509+0000","last_became_active":"2023-08-27T11:24:47.895966+0000","last_became_peered":"2023-08-27T11:24:47.895966+0000","last_unstale":"2023-08-27T11:24:48.944509+0000","last_undegraded":"2023-08-27T11:24:48.944509+0000","last_fullsized":"2023-08-27T11:24:48.944509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:49.494556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245533+0000","last_change":"2023-08-27T11:24:32.900476+0000","last_active":"2023-08-27T11:24:49.245533+0000","last_peered":"2023-08-27T11:24:49.245533+0000","last_clean":"2023-08-27T11:24:49.245533+0000","last_became_active":"2023-08-27T11:24:32.900121+0000","last_became_peered":"2023-08-27T11:24:32.900121+0000","last_unstale":"2023-08-27T11:24:49.245533+0000","last_undegraded":"2023-08-27T11:24:49.245533+0000","last_fullsized":"2023-08-27T11:24:49.245533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:42.589444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885785+0000","last_change":"2023-08-27T11:24:47.899025+0000","last_active":"2023-08-27T11:24:48.885785+0000","last_peered":"2023-08-27T11:24:48.885785+0000","last_clean":"2023-08-27T11:24:48.885785+0000","last_became_active":"2023-08-27T11:24:47.898740+0000","last_became_peered":"2023-08-27T11:24:47.898740+0000","last_unstale":"2023-08-27T11:24:48.885785+0000","last_undegraded":"2023-08-27T11:24:48.885785+0000","last_fullsized":"2023-08-27T11:24:48.885785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:33:14.726906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944871+0000","last_change":"2023-08-27T11:24:32.905940+0000","last_active":"2023-08-27T11:24:48.944871+0000","last_peered":"2023-08-27T11:24:48.944871+0000","last_clean":"2023-08-27T11:24:48.944871+0000","last_became_active":"2023-08-27T11:24:32.904461+0000","last_became_peered":"2023-08-27T11:24:32.904461+0000","last_unstale":"2023-08-27T11:24:48.944871+0000","last_undegraded":"2023-08-27T11:24:48.944871+0000","last_fullsized":"2023-08-27T11:24:48.944871+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:53.010766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887429+0000","last_change":"2023-08-27T11:24:47.897224+0000","last_active":"2023-08-27T11:24:48.887429+0000","last_peered":"2023-08-27T11:24:48.887429+0000","last_clean":"2023-08-27T11:24:48.887429+0000","last_became_active":"2023-08-27T11:24:47.896884+0000","last_became_peered":"2023-08-27T11:24:47.896884+0000","last_unstale":"2023-08-27T11:24:48.887429+0000","last_undegraded":"2023-08-27T11:24:48.887429+0000","last_fullsized":"2023-08-27T11:24:48.887429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:33:14.726906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244446+0000","last_change":"2023-08-27T11:24:32.893599+0000","last_active":"2023-08-27T11:24:49.244446+0000","last_peered":"2023-08-27T11:24:49.244446+0000","last_clean":"2023-08-27T11:24:49.244446+0000","last_became_active":"2023-08-27T11:24:32.893201+0000","last_became_peered":"2023-08-27T11:24:32.893201+0000","last_unstale":"2023-08-27T11:24:49.244446+0000","last_undegraded":"2023-08-27T11:24:49.244446+0000","last_fullsized":"2023-08-27T11:24:49.244446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:49.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886584+0000","last_change":"2023-08-27T11:24:47.897788+0000","last_active":"2023-08-27T11:24:48.886584+0000","last_peered":"2023-08-27T11:24:48.886584+0000","last_clean":"2023-08-27T11:24:48.886584+0000","last_became_active":"2023-08-27T11:24:47.897484+0000","last_became_peered":"2023-08-27T11:24:47.897484+0000","last_unstale":"2023-08-27T11:24:48.886584+0000","last_undegraded":"2023-08-27T11:24:48.886584+0000","last_fullsized":"2023-08-27T11:24:48.886584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:38:23.463007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000797+0000","last_change":"2023-08-27T11:24:32.909695+0000","last_active":"2023-08-27T11:24:49.000797+0000","last_peered":"2023-08-27T11:24:49.000797+0000","last_clean":"2023-08-27T11:24:49.000797+0000","last_became_active":"2023-08-27T11:24:32.909365+0000","last_became_peered":"2023-08-27T11:24:32.909365+0000","last_unstale":"2023-08-27T11:24:49.000797+0000","last_undegraded":"2023-08-27T11:24:49.000797+0000","last_fullsized":"2023-08-27T11:24:49.000797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:10.808056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000547+0000","last_change":"2023-08-27T11:24:47.907773+0000","last_active":"2023-08-27T11:24:49.000547+0000","last_peered":"2023-08-27T11:24:49.000547+0000","last_clean":"2023-08-27T11:24:49.000547+0000","last_became_active":"2023-08-27T11:24:47.907495+0000","last_became_peered":"2023-08-27T11:24:47.907495+0000","last_unstale":"2023-08-27T11:24:49.000547+0000","last_undegraded":"2023-08-27T11:24:49.000547+0000","last_fullsized":"2023-08-27T11:24:49.000547+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:06.333603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092832+0000","last_change":"2023-08-27T11:24:32.883832+0000","last_active":"2023-08-27T11:24:49.092832+0000","last_peered":"2023-08-27T11:24:49.092832+0000","last_clean":"2023-08-27T11:24:49.092832+0000","last_became_active":"2023-08-27T11:24:32.883350+0000","last_became_peered":"2023-08-27T11:24:32.883350+0000","last_unstale":"2023-08-27T11:24:49.092832+0000","last_undegraded":"2023-08-27T11:24:49.092832+0000","last_fullsized":"2023-08-27T11:24:49.092832+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:16.256481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887375+0000","last_change":"2023-08-27T11:24:47.897699+0000","last_active":"2023-08-27T11:24:48.887375+0000","last_peered":"2023-08-27T11:24:48.887375+0000","last_clean":"2023-08-27T11:24:48.887375+0000","last_became_active":"2023-08-27T11:24:47.897419+0000","last_became_peered":"2023-08-27T11:24:47.897419+0000","last_unstale":"2023-08-27T11:24:48.887375+0000","last_undegraded":"2023-08-27T11:24:48.887375+0000","last_fullsized":"2023-08-27T11:24:48.887375+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:04.914096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945521+0000","last_change":"2023-08-27T11:24:32.911479+0000","last_active":"2023-08-27T11:24:48.945521+0000","last_peered":"2023-08-27T11:24:48.945521+0000","last_clean":"2023-08-27T11:24:48.945521+0000","last_became_active":"2023-08-27T11:24:32.909452+0000","last_became_peered":"2023-08-27T11:24:32.909452+0000","last_unstale":"2023-08-27T11:24:48.945521+0000","last_undegraded":"2023-08-27T11:24:48.945521+0000","last_fullsized":"2023-08-27T11:24:48.945521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:10.378391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092098+0000","last_change":"2023-08-27T11:24:47.908360+0000","last_active":"2023-08-27T11:24:49.092098+0000","last_peered":"2023-08-27T11:24:49.092098+0000","last_clean":"2023-08-27T11:24:49.092098+0000","last_became_active":"2023-08-27T11:24:47.908044+0000","last_became_peered":"2023-08-27T11:24:47.908044+0000","last_unstale":"2023-08-27T11:24:49.092098+0000","last_undegraded":"2023-08-27T11:24:49.092098+0000","last_fullsized":"2023-08-27T11:24:49.092098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:53.899950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944050+0000","last_change":"2023-08-27T11:24:32.905733+0000","last_active":"2023-08-27T11:24:48.944050+0000","last_peered":"2023-08-27T11:24:48.944050+0000","last_clean":"2023-08-27T11:24:48.944050+0000","last_became_active":"2023-08-27T11:24:32.905472+0000","last_became_peered":"2023-08-27T11:24:32.905472+0000","last_unstale":"2023-08-27T11:24:48.944050+0000","last_undegraded":"2023-08-27T11:24:48.944050+0000","last_fullsized":"2023-08-27T11:24:48.944050+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:00.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886115+0000","last_change":"2023-08-27T11:24:47.903647+0000","last_active":"2023-08-27T11:24:48.886115+0000","last_peered":"2023-08-27T11:24:48.886115+0000","last_clean":"2023-08-27T11:24:48.886115+0000","last_became_active":"2023-08-27T11:24:47.903207+0000","last_became_peered":"2023-08-27T11:24:47.903207+0000","last_unstale":"2023-08-27T11:24:48.886115+0000","last_undegraded":"2023-08-27T11:24:48.886115+0000","last_fullsized":"2023-08-27T11:24:48.886115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:21.057236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884485+0000","last_change":"2023-08-27T11:24:32.902996+0000","last_active":"2023-08-27T11:24:48.884485+0000","last_peered":"2023-08-27T11:24:48.884485+0000","last_clean":"2023-08-27T11:24:48.884485+0000","last_became_active":"2023-08-27T11:24:32.902692+0000","last_became_peered":"2023-08-27T11:24:32.902692+0000","last_unstale":"2023-08-27T11:24:48.884485+0000","last_undegraded":"2023-08-27T11:24:48.884485+0000","last_fullsized":"2023-08-27T11:24:48.884485+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:56.957791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246357+0000","last_change":"2023-08-27T11:24:47.906910+0000","last_active":"2023-08-27T11:24:49.246357+0000","last_peered":"2023-08-27T11:24:49.246357+0000","last_clean":"2023-08-27T11:24:49.246357+0000","last_became_active":"2023-08-27T11:24:47.906629+0000","last_became_peered":"2023-08-27T11:24:47.906629+0000","last_unstale":"2023-08-27T11:24:49.246357+0000","last_undegraded":"2023-08-27T11:24:49.246357+0000","last_fullsized":"2023-08-27T11:24:49.246357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:30.795267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092196+0000","last_change":"2023-08-27T11:24:32.906541+0000","last_active":"2023-08-27T11:24:49.092196+0000","last_peered":"2023-08-27T11:24:49.092196+0000","last_clean":"2023-08-27T11:24:49.092196+0000","last_became_active":"2023-08-27T11:24:32.906237+0000","last_became_peered":"2023-08-27T11:24:32.906237+0000","last_unstale":"2023-08-27T11:24:49.092196+0000","last_undegraded":"2023-08-27T11:24:49.092196+0000","last_fullsized":"2023-08-27T11:24:49.092196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:54:29.360643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092089+0000","last_change":"2023-08-27T11:24:47.910014+0000","last_active":"2023-08-27T11:24:49.092089+0000","last_peered":"2023-08-27T11:24:49.092089+0000","last_clean":"2023-08-27T11:24:49.092089+0000","last_became_active":"2023-08-27T11:24:47.909740+0000","last_became_peered":"2023-08-27T11:24:47.909740+0000","last_unstale":"2023-08-27T11:24:49.092089+0000","last_undegraded":"2023-08-27T11:24:49.092089+0000","last_fullsized":"2023-08-27T11:24:49.092089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:50.615035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245463+0000","last_change":"2023-08-27T11:24:32.900837+0000","last_active":"2023-08-27T11:24:49.245463+0000","last_peered":"2023-08-27T11:24:49.245463+0000","last_clean":"2023-08-27T11:24:49.245463+0000","last_became_active":"2023-08-27T11:24:32.900383+0000","last_became_peered":"2023-08-27T11:24:32.900383+0000","last_unstale":"2023-08-27T11:24:49.245463+0000","last_undegraded":"2023-08-27T11:24:49.245463+0000","last_fullsized":"2023-08-27T11:24:49.245463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:10.808056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886962+0000","last_change":"2023-08-27T11:24:47.898333+0000","last_active":"2023-08-27T11:24:48.886962+0000","last_peered":"2023-08-27T11:24:48.886962+0000","last_clean":"2023-08-27T11:24:48.886962+0000","last_became_active":"2023-08-27T11:24:47.898030+0000","last_became_peered":"2023-08-27T11:24:47.898030+0000","last_unstale":"2023-08-27T11:24:48.886962+0000","last_undegraded":"2023-08-27T11:24:48.886962+0000","last_fullsized":"2023-08-27T11:24:48.886962+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:05.774085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244437+0000","last_change":"2023-08-27T11:24:32.903525+0000","last_active":"2023-08-27T11:24:49.244437+0000","last_peered":"2023-08-27T11:24:49.244437+0000","last_clean":"2023-08-27T11:24:49.244437+0000","last_became_active":"2023-08-27T11:24:32.903193+0000","last_became_peered":"2023-08-27T11:24:32.903193+0000","last_unstale":"2023-08-27T11:24:49.244437+0000","last_undegraded":"2023-08-27T11:24:49.244437+0000","last_fullsized":"2023-08-27T11:24:49.244437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:18:49.392158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001174+0000","last_change":"2023-08-27T11:24:47.913850+0000","last_active":"2023-08-27T11:24:49.001174+0000","last_peered":"2023-08-27T11:24:49.001174+0000","last_clean":"2023-08-27T11:24:49.001174+0000","last_became_active":"2023-08-27T11:24:47.913508+0000","last_became_peered":"2023-08-27T11:24:47.913508+0000","last_unstale":"2023-08-27T11:24:49.001174+0000","last_undegraded":"2023-08-27T11:24:49.001174+0000","last_fullsized":"2023-08-27T11:24:49.001174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:06.668299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944170+0000","last_change":"2023-08-27T11:24:32.912893+0000","last_active":"2023-08-27T11:24:48.944170+0000","last_peered":"2023-08-27T11:24:48.944170+0000","last_clean":"2023-08-27T11:24:48.944170+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:48.944170+0000","last_undegraded":"2023-08-27T11:24:48.944170+0000","last_fullsized":"2023-08-27T11:24:48.944170+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:07.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092246+0000","last_change":"2023-08-27T11:24:47.903582+0000","last_active":"2023-08-27T11:24:49.092246+0000","last_peered":"2023-08-27T11:24:49.092246+0000","last_clean":"2023-08-27T11:24:49.092246+0000","last_became_active":"2023-08-27T11:24:47.903303+0000","last_became_peered":"2023-08-27T11:24:47.903303+0000","last_unstale":"2023-08-27T11:24:49.092246+0000","last_undegraded":"2023-08-27T11:24:49.092246+0000","last_fullsized":"2023-08-27T11:24:49.092246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:25.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244755+0000","last_change":"2023-08-27T11:24:32.905710+0000","last_active":"2023-08-27T11:24:49.244755+0000","last_peered":"2023-08-27T11:24:49.244755+0000","last_clean":"2023-08-27T11:24:49.244755+0000","last_became_active":"2023-08-27T11:24:32.905225+0000","last_became_peered":"2023-08-27T11:24:32.905225+0000","last_unstale":"2023-08-27T11:24:49.244755+0000","last_undegraded":"2023-08-27T11:24:49.244755+0000","last_fullsized":"2023-08-27T11:24:49.244755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:58.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246358+0000","last_change":"2023-08-27T11:24:47.905323+0000","last_active":"2023-08-27T11:24:49.246358+0000","last_peered":"2023-08-27T11:24:49.246358+0000","last_clean":"2023-08-27T11:24:49.246358+0000","last_became_active":"2023-08-27T11:24:47.904973+0000","last_became_peered":"2023-08-27T11:24:47.904973+0000","last_unstale":"2023-08-27T11:24:49.246358+0000","last_undegraded":"2023-08-27T11:24:49.246358+0000","last_fullsized":"2023-08-27T11:24:49.246358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:22.421790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944257+0000","last_change":"2023-08-27T11:24:32.913021+0000","last_active":"2023-08-27T11:24:48.944257+0000","last_peered":"2023-08-27T11:24:48.944257+0000","last_clean":"2023-08-27T11:24:48.944257+0000","last_became_active":"2023-08-27T11:24:32.912510+0000","last_became_peered":"2023-08-27T11:24:32.912510+0000","last_unstale":"2023-08-27T11:24:48.944257+0000","last_undegraded":"2023-08-27T11:24:48.944257+0000","last_fullsized":"2023-08-27T11:24:48.944257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:28.772750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246096+0000","last_change":"2023-08-27T11:24:47.910018+0000","last_active":"2023-08-27T11:24:49.246096+0000","last_peered":"2023-08-27T11:24:49.246096+0000","last_clean":"2023-08-27T11:24:49.246096+0000","last_became_active":"2023-08-27T11:24:47.909209+0000","last_became_peered":"2023-08-27T11:24:47.909209+0000","last_unstale":"2023-08-27T11:24:49.246096+0000","last_undegraded":"2023-08-27T11:24:49.246096+0000","last_fullsized":"2023-08-27T11:24:49.246096+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:46.939298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999635+0000","last_change":"2023-08-27T11:24:32.902464+0000","last_active":"2023-08-27T11:24:48.999635+0000","last_peered":"2023-08-27T11:24:48.999635+0000","last_clean":"2023-08-27T11:24:48.999635+0000","last_became_active":"2023-08-27T11:24:32.902171+0000","last_became_peered":"2023-08-27T11:24:32.902171+0000","last_unstale":"2023-08-27T11:24:48.999635+0000","last_undegraded":"2023-08-27T11:24:48.999635+0000","last_fullsized":"2023-08-27T11:24:48.999635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:24:32.931026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885993+0000","last_change":"2023-08-27T11:24:47.900678+0000","last_active":"2023-08-27T11:24:48.885993+0000","last_peered":"2023-08-27T11:24:48.885993+0000","last_clean":"2023-08-27T11:24:48.885993+0000","last_became_active":"2023-08-27T11:24:47.900332+0000","last_became_peered":"2023-08-27T11:24:47.900332+0000","last_unstale":"2023-08-27T11:24:48.885993+0000","last_undegraded":"2023-08-27T11:24:48.885993+0000","last_fullsized":"2023-08-27T11:24:48.885993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:58.462249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245753+0000","last_change":"2023-08-27T11:24:32.900338+0000","last_active":"2023-08-27T11:24:49.245753+0000","last_peered":"2023-08-27T11:24:49.245753+0000","last_clean":"2023-08-27T11:24:49.245753+0000","last_became_active":"2023-08-27T11:24:32.900045+0000","last_became_peered":"2023-08-27T11:24:32.900045+0000","last_unstale":"2023-08-27T11:24:49.245753+0000","last_undegraded":"2023-08-27T11:24:49.245753+0000","last_fullsized":"2023-08-27T11:24:49.245753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:18:09.545396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884303+0000","last_change":"2023-08-27T11:24:47.892555+0000","last_active":"2023-08-27T11:24:48.884303+0000","last_peered":"2023-08-27T11:24:48.884303+0000","last_clean":"2023-08-27T11:24:48.884303+0000","last_became_active":"2023-08-27T11:24:47.892307+0000","last_became_peered":"2023-08-27T11:24:47.892307+0000","last_unstale":"2023-08-27T11:24:48.884303+0000","last_undegraded":"2023-08-27T11:24:48.884303+0000","last_fullsized":"2023-08-27T11:24:48.884303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:25.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944148+0000","last_change":"2023-08-27T11:24:32.907370+0000","last_active":"2023-08-27T11:24:48.944148+0000","last_peered":"2023-08-27T11:24:48.944148+0000","last_clean":"2023-08-27T11:24:48.944148+0000","last_became_active":"2023-08-27T11:24:32.907051+0000","last_became_peered":"2023-08-27T11:24:32.907051+0000","last_unstale":"2023-08-27T11:24:48.944148+0000","last_undegraded":"2023-08-27T11:24:48.944148+0000","last_fullsized":"2023-08-27T11:24:48.944148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:11:13.910079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245964+0000","last_change":"2023-08-27T11:24:47.908814+0000","last_active":"2023-08-27T11:24:49.245964+0000","last_peered":"2023-08-27T11:24:49.245964+0000","last_clean":"2023-08-27T11:24:49.245964+0000","last_became_active":"2023-08-27T11:24:47.908300+0000","last_became_peered":"2023-08-27T11:24:47.908300+0000","last_unstale":"2023-08-27T11:24:49.245964+0000","last_undegraded":"2023-08-27T11:24:49.245964+0000","last_fullsized":"2023-08-27T11:24:49.245964+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:39.868370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999655+0000","last_change":"2023-08-27T11:24:32.909896+0000","last_active":"2023-08-27T11:24:48.999655+0000","last_peered":"2023-08-27T11:24:48.999655+0000","last_clean":"2023-08-27T11:24:48.999655+0000","last_became_active":"2023-08-27T11:24:32.909605+0000","last_became_peered":"2023-08-27T11:24:32.909605+0000","last_unstale":"2023-08-27T11:24:48.999655+0000","last_undegraded":"2023-08-27T11:24:48.999655+0000","last_fullsized":"2023-08-27T11:24:48.999655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:43.846197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247258+0000","last_change":"2023-08-27T11:24:47.910695+0000","last_active":"2023-08-27T11:24:49.247258+0000","last_peered":"2023-08-27T11:24:49.247258+0000","last_clean":"2023-08-27T11:24:49.247258+0000","last_became_active":"2023-08-27T11:24:47.910371+0000","last_became_peered":"2023-08-27T11:24:47.910371+0000","last_unstale":"2023-08-27T11:24:49.247258+0000","last_undegraded":"2023-08-27T11:24:49.247258+0000","last_fullsized":"2023-08-27T11:24:49.247258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:43:37.040256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092741+0000","last_change":"2023-08-27T11:24:32.895742+0000","last_active":"2023-08-27T11:24:49.092741+0000","last_peered":"2023-08-27T11:24:49.092741+0000","last_clean":"2023-08-27T11:24:49.092741+0000","last_became_active":"2023-08-27T11:24:32.894897+0000","last_became_peered":"2023-08-27T11:24:32.894897+0000","last_unstale":"2023-08-27T11:24:49.092741+0000","last_undegraded":"2023-08-27T11:24:49.092741+0000","last_fullsized":"2023-08-27T11:24:49.092741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:49.517968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246877+0000","last_change":"2023-08-27T11:24:47.917194+0000","last_active":"2023-08-27T11:24:49.246877+0000","last_peered":"2023-08-27T11:24:49.246877+0000","last_clean":"2023-08-27T11:24:49.246877+0000","last_became_active":"2023-08-27T11:24:47.916845+0000","last_became_peered":"2023-08-27T11:24:47.916845+0000","last_unstale":"2023-08-27T11:24:49.246877+0000","last_undegraded":"2023-08-27T11:24:49.246877+0000","last_fullsized":"2023-08-27T11:24:49.246877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:31.278908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884835+0000","last_change":"2023-08-27T11:24:32.900281+0000","last_active":"2023-08-27T11:24:48.884835+0000","last_peered":"2023-08-27T11:24:48.884835+0000","last_clean":"2023-08-27T11:24:48.884835+0000","last_became_active":"2023-08-27T11:24:32.900032+0000","last_became_peered":"2023-08-27T11:24:32.900032+0000","last_unstale":"2023-08-27T11:24:48.884835+0000","last_undegraded":"2023-08-27T11:24:48.884835+0000","last_fullsized":"2023-08-27T11:24:48.884835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:16:39.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886507+0000","last_change":"2023-08-27T11:24:47.900431+0000","last_active":"2023-08-27T11:24:48.886507+0000","last_peered":"2023-08-27T11:24:48.886507+0000","last_clean":"2023-08-27T11:24:48.886507+0000","last_became_active":"2023-08-27T11:24:47.900006+0000","last_became_peered":"2023-08-27T11:24:47.900006+0000","last_unstale":"2023-08-27T11:24:48.886507+0000","last_undegraded":"2023-08-27T11:24:48.886507+0000","last_fullsized":"2023-08-27T11:24:48.886507+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:00.732054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999701+0000","last_change":"2023-08-27T11:24:32.901649+0000","last_active":"2023-08-27T11:24:48.999701+0000","last_peered":"2023-08-27T11:24:48.999701+0000","last_clean":"2023-08-27T11:24:48.999701+0000","last_became_active":"2023-08-27T11:24:32.901366+0000","last_became_peered":"2023-08-27T11:24:32.901366+0000","last_unstale":"2023-08-27T11:24:48.999701+0000","last_undegraded":"2023-08-27T11:24:48.999701+0000","last_fullsized":"2023-08-27T11:24:48.999701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:38.518585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887457+0000","last_change":"2023-08-27T11:24:47.903989+0000","last_active":"2023-08-27T11:24:48.887457+0000","last_peered":"2023-08-27T11:24:48.887457+0000","last_clean":"2023-08-27T11:24:48.887457+0000","last_became_active":"2023-08-27T11:24:47.903611+0000","last_became_peered":"2023-08-27T11:24:47.903611+0000","last_unstale":"2023-08-27T11:24:48.887457+0000","last_undegraded":"2023-08-27T11:24:48.887457+0000","last_fullsized":"2023-08-27T11:24:48.887457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:48.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.093250+0000","last_change":"2023-08-27T11:24:32.910119+0000","last_active":"2023-08-27T11:24:49.093250+0000","last_peered":"2023-08-27T11:24:49.093250+0000","last_clean":"2023-08-27T11:24:49.093250+0000","last_became_active":"2023-08-27T11:24:32.909855+0000","last_became_peered":"2023-08-27T11:24:32.909855+0000","last_unstale":"2023-08-27T11:24:49.093250+0000","last_undegraded":"2023-08-27T11:24:49.093250+0000","last_fullsized":"2023-08-27T11:24:49.093250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:10.266899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944633+0000","last_change":"2023-08-27T11:24:47.908421+0000","last_active":"2023-08-27T11:24:48.944633+0000","last_peered":"2023-08-27T11:24:48.944633+0000","last_clean":"2023-08-27T11:24:48.944633+0000","last_became_active":"2023-08-27T11:24:47.908144+0000","last_became_peered":"2023-08-27T11:24:47.908144+0000","last_unstale":"2023-08-27T11:24:48.944633+0000","last_undegraded":"2023-08-27T11:24:48.944633+0000","last_fullsized":"2023-08-27T11:24:48.944633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:47.664238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092356+0000","last_change":"2023-08-27T11:24:32.906146+0000","last_active":"2023-08-27T11:24:49.092356+0000","last_peered":"2023-08-27T11:24:49.092356+0000","last_clean":"2023-08-27T11:24:49.092356+0000","last_became_active":"2023-08-27T11:24:32.905867+0000","last_became_peered":"2023-08-27T11:24:32.905867+0000","last_unstale":"2023-08-27T11:24:49.092356+0000","last_undegraded":"2023-08-27T11:24:49.092356+0000","last_fullsized":"2023-08-27T11:24:49.092356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:58.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245276+0000","last_change":"2023-08-27T11:24:47.914343+0000","last_active":"2023-08-27T11:24:49.245276+0000","last_peered":"2023-08-27T11:24:49.245276+0000","last_clean":"2023-08-27T11:24:49.245276+0000","last_became_active":"2023-08-27T11:24:47.913975+0000","last_became_peered":"2023-08-27T11:24:47.913975+0000","last_unstale":"2023-08-27T11:24:49.245276+0000","last_undegraded":"2023-08-27T11:24:49.245276+0000","last_fullsized":"2023-08-27T11:24:49.245276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:51.541858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944067+0000","last_change":"2023-08-27T11:24:32.907204+0000","last_active":"2023-08-27T11:24:48.944067+0000","last_peered":"2023-08-27T11:24:48.944067+0000","last_clean":"2023-08-27T11:24:48.944067+0000","last_became_active":"2023-08-27T11:24:32.906510+0000","last_became_peered":"2023-08-27T11:24:32.906510+0000","last_unstale":"2023-08-27T11:24:48.944067+0000","last_undegraded":"2023-08-27T11:24:48.944067+0000","last_fullsized":"2023-08-27T11:24:48.944067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:26.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886830+0000","last_change":"2023-08-27T11:24:47.910413+0000","last_active":"2023-08-27T11:24:48.886830+0000","last_peered":"2023-08-27T11:24:48.886830+0000","last_clean":"2023-08-27T11:24:48.886830+0000","last_became_active":"2023-08-27T11:24:47.910073+0000","last_became_peered":"2023-08-27T11:24:47.910073+0000","last_unstale":"2023-08-27T11:24:48.886830+0000","last_undegraded":"2023-08-27T11:24:48.886830+0000","last_fullsized":"2023-08-27T11:24:48.886830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:17.928294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000191+0000","last_change":"2023-08-27T11:24:32.900880+0000","last_active":"2023-08-27T11:24:49.000191+0000","last_peered":"2023-08-27T11:24:49.000191+0000","last_clean":"2023-08-27T11:24:49.000191+0000","last_became_active":"2023-08-27T11:24:32.900515+0000","last_became_peered":"2023-08-27T11:24:32.900515+0000","last_unstale":"2023-08-27T11:24:49.000191+0000","last_undegraded":"2023-08-27T11:24:49.000191+0000","last_fullsized":"2023-08-27T11:24:49.000191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:18.267003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884666+0000","last_change":"2023-08-27T11:24:47.909299+0000","last_active":"2023-08-27T11:24:48.884666+0000","last_peered":"2023-08-27T11:24:48.884666+0000","last_clean":"2023-08-27T11:24:48.884666+0000","last_became_active":"2023-08-27T11:24:47.908992+0000","last_became_peered":"2023-08-27T11:24:47.908992+0000","last_unstale":"2023-08-27T11:24:48.884666+0000","last_undegraded":"2023-08-27T11:24:48.884666+0000","last_fullsized":"2023-08-27T11:24:48.884666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:20.069179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887403+0000","last_change":"2023-08-27T11:24:32.908868+0000","last_active":"2023-08-27T11:24:48.887403+0000","last_peered":"2023-08-27T11:24:48.887403+0000","last_clean":"2023-08-27T11:24:48.887403+0000","last_became_active":"2023-08-27T11:24:32.908413+0000","last_became_peered":"2023-08-27T11:24:32.908413+0000","last_unstale":"2023-08-27T11:24:48.887403+0000","last_undegraded":"2023-08-27T11:24:48.887403+0000","last_fullsized":"2023-08-27T11:24:48.887403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:51:51.565279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000775+0000","last_change":"2023-08-27T11:24:47.902903+0000","last_active":"2023-08-27T11:24:49.000775+0000","last_peered":"2023-08-27T11:24:49.000775+0000","last_clean":"2023-08-27T11:24:49.000775+0000","last_became_active":"2023-08-27T11:24:47.902613+0000","last_became_peered":"2023-08-27T11:24:47.902613+0000","last_unstale":"2023-08-27T11:24:49.000775+0000","last_undegraded":"2023-08-27T11:24:49.000775+0000","last_fullsized":"2023-08-27T11:24:49.000775+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:38.696066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246710+0000","last_change":"2023-08-27T11:24:32.904922+0000","last_active":"2023-08-27T11:24:49.246710+0000","last_peered":"2023-08-27T11:24:49.246710+0000","last_clean":"2023-08-27T11:24:49.246710+0000","last_became_active":"2023-08-27T11:24:32.904570+0000","last_became_peered":"2023-08-27T11:24:32.904570+0000","last_unstale":"2023-08-27T11:24:49.246710+0000","last_undegraded":"2023-08-27T11:24:49.246710+0000","last_fullsized":"2023-08-27T11:24:49.246710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:10.266899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001050+0000","last_change":"2023-08-27T11:24:47.904844+0000","last_active":"2023-08-27T11:24:49.001050+0000","last_peered":"2023-08-27T11:24:49.001050+0000","last_clean":"2023-08-27T11:24:49.001050+0000","last_became_active":"2023-08-27T11:24:47.904525+0000","last_became_peered":"2023-08-27T11:24:47.904525+0000","last_unstale":"2023-08-27T11:24:49.001050+0000","last_undegraded":"2023-08-27T11:24:49.001050+0000","last_fullsized":"2023-08-27T11:24:49.001050+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:02.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944234+0000","last_change":"2023-08-27T11:24:32.912255+0000","last_active":"2023-08-27T11:24:48.944234+0000","last_peered":"2023-08-27T11:24:48.944234+0000","last_clean":"2023-08-27T11:24:48.944234+0000","last_became_active":"2023-08-27T11:24:32.909842+0000","last_became_peered":"2023-08-27T11:24:32.909842+0000","last_unstale":"2023-08-27T11:24:48.944234+0000","last_undegraded":"2023-08-27T11:24:48.944234+0000","last_fullsized":"2023-08-27T11:24:48.944234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:37.586419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887830+0000","last_change":"2023-08-27T11:24:47.897521+0000","last_active":"2023-08-27T11:24:48.887830+0000","last_peered":"2023-08-27T11:24:48.887830+0000","last_clean":"2023-08-27T11:24:48.887830+0000","last_became_active":"2023-08-27T11:24:47.897246+0000","last_became_peered":"2023-08-27T11:24:47.897246+0000","last_unstale":"2023-08-27T11:24:48.887830+0000","last_undegraded":"2023-08-27T11:24:48.887830+0000","last_fullsized":"2023-08-27T11:24:48.887830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:27.517072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244717+0000","last_change":"2023-08-27T11:24:32.905490+0000","last_active":"2023-08-27T11:24:49.244717+0000","last_peered":"2023-08-27T11:24:49.244717+0000","last_clean":"2023-08-27T11:24:49.244717+0000","last_became_active":"2023-08-27T11:24:32.904866+0000","last_became_peered":"2023-08-27T11:24:32.904866+0000","last_unstale":"2023-08-27T11:24:49.244717+0000","last_undegraded":"2023-08-27T11:24:49.244717+0000","last_fullsized":"2023-08-27T11:24:49.244717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:31:00.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247186+0000","last_change":"2023-08-27T11:24:47.909411+0000","last_active":"2023-08-27T11:24:49.247186+0000","last_peered":"2023-08-27T11:24:49.247186+0000","last_clean":"2023-08-27T11:24:49.247186+0000","last_became_active":"2023-08-27T11:24:47.909065+0000","last_became_peered":"2023-08-27T11:24:47.909065+0000","last_unstale":"2023-08-27T11:24:49.247186+0000","last_undegraded":"2023-08-27T11:24:49.247186+0000","last_fullsized":"2023-08-27T11:24:49.247186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:48:55.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999832+0000","last_change":"2023-08-27T11:24:32.898902+0000","last_active":"2023-08-27T11:24:48.999832+0000","last_peered":"2023-08-27T11:24:48.999832+0000","last_clean":"2023-08-27T11:24:48.999832+0000","last_became_active":"2023-08-27T11:24:32.898635+0000","last_became_peered":"2023-08-27T11:24:32.898635+0000","last_unstale":"2023-08-27T11:24:48.999832+0000","last_undegraded":"2023-08-27T11:24:48.999832+0000","last_fullsized":"2023-08-27T11:24:48.999832+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:50.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.879},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71399999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":269133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77500000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.755},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":862337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90700000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":268503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.439}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.495}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54500000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":271045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.28000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.79300000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":270081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.82699999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.878},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":271627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81999999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.879},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73899999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":268469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.874},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.86299999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:24:52.477 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:24:52.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.705+0000 7fa9e0dff700 1 Processor -- start 2023-08-27T11:24:52.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.705+0000 7fa9e0dff700 1 -- start start 2023-08-27T11:24:52.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.706+0000 7fa9e0dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9dc06a310 0x7fa9dc06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.706+0000 7fa9e0dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9dc06e360 0x7fa9dc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.706+0000 7fa9e0dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0c4a50 con 0x7fa9dc157fc0 2023-08-27T11:24:52.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.706+0000 7fa9e0dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c23a0 con 0x7fa9dc06e360 2023-08-27T11:24:52.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.706+0000 7fa9e0dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc1548c0 con 0x7fa9dc06a310 2023-08-27T11:24:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9dc06e360 0x7fa9dc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9da59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa9dc06a310 0x7fa9dc06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa9dc06e360 0x7fa9dc157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58948/0 (socket says 172.21.15.43:58948) 2023-08-27T11:24:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9dad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa9dc157fc0 0x7fa9dc0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:49182/0 (socket says 172.21.15.43:49182) 2023-08-27T11:24:52.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 -- 172.21.15.43:0/825863227 learned_addr learned my addr 172.21.15.43:0/825863227 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:52.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 -- 172.21.15.43:0/825863227 >> v2:172.21.15.57:3300/0 conn(0x7fa9dc06a310 msgr2=0x7fa9dc06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:52.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 --2- 172.21.15.43:0/825863227 >> v2:172.21.15.57:3300/0 conn(0x7fa9dc06a310 0x7fa9dc06a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 -- 172.21.15.43:0/825863227 >> v1:172.21.15.57:6789/0 conn(0x7fa9dc157fc0 legacy=0x7fa9dc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d3fff700 1 -- 172.21.15.43:0/825863227 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0c4d30 con 0x7fa9dc06e360 2023-08-27T11:24:52.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.707+0000 7fa9d9d9b700 1 -- 172.21.15.43:0/825863227 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441403902 0 0) 0x7fa9dc0c4a50 con 0x7fa9dc157fc0 2023-08-27T11:24:52.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9d3fff700 1 --2- 172.21.15.43:0/825863227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc157a80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc06b3f0 tx=0x7fa9c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f6cae1bb2901e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9d9d9b700 1 -- 172.21.15.43:0/825863227 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011830 con 0x7fa9dc06e360 2023-08-27T11:24:52.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9d9d9b700 1 -- 172.21.15.43:0/825863227 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4011990 con 0x7fa9dc06e360 2023-08-27T11:24:52.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9d9d9b700 1 -- 172.21.15.43:0/825863227 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011d20 con 0x7fa9dc06e360 2023-08-27T11:24:52.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9e0dff700 1 -- 172.21.15.43:0/825863227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 msgr2=0x7fa9dc157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/825863227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc157a80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc06b3f0 tx=0x7fa9c4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.708+0000 7fa9e0dff700 1 -- 172.21.15.43:0/825863227 shutdown_connections 2023-08-27T11:24:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.709+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/825863227 >> v2:172.21.15.57:3300/0 conn(0x7fa9dc06a310 0x7fa9dc06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.709+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/825863227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc157a80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.709+0000 7fa9e0dff700 1 -- 172.21.15.43:0/825863227 >> 172.21.15.43:0/825863227 conn(0x7fa9dc0a85e0 msgr2=0x7fa9dc0a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:52.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.709+0000 7fa9e0dff700 1 -- 172.21.15.43:0/825863227 shutdown_connections 2023-08-27T11:24:52.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.709+0000 7fa9e0dff700 1 -- 172.21.15.43:0/825863227 wait complete. 2023-08-27T11:24:52.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.710+0000 7fa9e0dff700 1 Processor -- start 2023-08-27T11:24:52.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.710+0000 7fa9e0dff700 1 -- start start 2023-08-27T11:24:52.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9dc06a310 0x7fa9dc157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9dc157fc0 0x7fa9dc0be420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1ed810 con 0x7fa9dc06e360 2023-08-27T11:24:52.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc157990 con 0x7fa9dc06a310 2023-08-27T11:24:52.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9e0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1ed380 con 0x7fa9dc157fc0 2023-08-27T11:24:52.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.711+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58950/0 (socket says 172.21.15.43:58950) 2023-08-27T11:24:52.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 -- 172.21.15.43:0/2339524251 learned_addr learned my addr 172.21.15.43:0/2339524251 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:52.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9dad9d700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9dc157fc0 0x7fa9dc0be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9da59c700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9dc06a310 0x7fa9dc157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 -- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9dc157fc0 msgr2=0x7fa9dc0be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9dc157fc0 0x7fa9dc0be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 -- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9dc06a310 msgr2=0x7fa9dc157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9dc06a310 0x7fa9dc157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 -- 172.21.15.43:0/2339524251 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c4009550 con 0x7fa9dc06e360 2023-08-27T11:24:52.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.712+0000 7fa9d3fff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0a95e0 tx=0x7fa9c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.713+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4004510 con 0x7fa9dc06e360 2023-08-27T11:24:52.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.713+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c40036a0 con 0x7fa9dc06e360 2023-08-27T11:24:52.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.713+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc1eca90 con 0x7fa9dc06e360 2023-08-27T11:24:52.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.713+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4003a10 con 0x7fa9dc06e360 2023-08-27T11:24:52.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.713+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1ed010 con 0x7fa9dc06e360 2023-08-27T11:24:52.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.714+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc04ee70 con 0x7fa9dc06e360 2023-08-27T11:24:52.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.715+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa9c4003b70 con 0x7fa9dc06e360 2023-08-27T11:24:52.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.715+0000 7fa9d2ffd700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 0x7fa9bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:52.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.716+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa9c4021030 con 0x7fa9dc06e360 2023-08-27T11:24:52.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.716+0000 7fa9da59c700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 0x7fa9bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:52.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.716+0000 7fa9da59c700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 0x7fa9bc06c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009be0 tx=0x7fa9cc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:52.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.720+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa9c40551f0 con 0x7fa9dc06e360 2023-08-27T11:24:52.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.927+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9dc0c52f0 con 0x7fa9bc06a0e0 2023-08-27T11:24:52.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.945+0000 7fa9d2ffd700 1 -- 172.21.15.43:0/2339524251 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549982 (secure 0 0 0) 0x7fa9cc011860 con 0x7fa9bc06a0e0 2023-08-27T11:24:52.953 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:52.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 msgr2=0x7fa9bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 0x7fa9bc06c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc009be0 tx=0x7fa9cc009210 comp rx=0 tx=0).stop 2023-08-27T11:24:52.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 msgr2=0x7fa9dc0c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:52.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc0a95e0 tx=0x7fa9c4004750 comp rx=0 tx=0).stop 2023-08-27T11:24:52.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 shutdown_connections 2023-08-27T11:24:52.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa9bc06a0e0 0x7fa9bc06c5a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa9dc157fc0 0x7fa9dc0be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa9dc06a310 0x7fa9dc157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 --2- 172.21.15.43:0/2339524251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa9dc06e360 0x7fa9dc0c6150 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:52.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.950+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 >> 172.21.15.43:0/2339524251 conn(0x7fa9dc0a85e0 msgr2=0x7fa9dc0a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:52.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.951+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 shutdown_connections 2023-08-27T11:24:52.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:52.951+0000 7fa9e0dff700 1 -- 172.21.15.43:0/2339524251 wait complete. 2023-08-27T11:24:52.961 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:24:52.970 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-08-27T11:24:52.338806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":352,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222152,"kb_used_data":5976,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752568,"statfs":{"total":773094113280,"available":772866629632,"internally_reserved":0,"allocated":6119424,"data_stored":3341896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001120"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247200+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:24:49.247200+0000","last_peered":"2023-08-27T11:24:49.247200+0000","last_clean":"2023-08-27T11:24:49.247200+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:24:49.247200+0000","last_undegraded":"2023-08-27T11:24:49.247200+0000","last_fullsized":"2023-08-27T11:24:49.247200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:48:42.339194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886160+0000","last_change":"2023-08-27T11:24:32.283734+0000","last_active":"2023-08-27T11:24:48.886160+0000","last_peered":"2023-08-27T11:24:48.886160+0000","last_clean":"2023-08-27T11:24:48.886160+0000","last_became_active":"2023-08-27T11:24:32.283396+0000","last_became_peered":"2023-08-27T11:24:32.283396+0000","last_unstale":"2023-08-27T11:24:48.886160+0000","last_undegraded":"2023-08-27T11:24:48.886160+0000","last_fullsized":"2023-08-27T11:24:48.886160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:36:01.856329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944287+0000","last_change":"2023-08-27T11:24:32.908654+0000","last_active":"2023-08-27T11:24:48.944287+0000","last_peered":"2023-08-27T11:24:48.944287+0000","last_clean":"2023-08-27T11:24:48.944287+0000","last_became_active":"2023-08-27T11:24:32.907172+0000","last_became_peered":"2023-08-27T11:24:32.907172+0000","last_unstale":"2023-08-27T11:24:48.944287+0000","last_undegraded":"2023-08-27T11:24:48.944287+0000","last_fullsized":"2023-08-27T11:24:48.944287+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:37:20.342509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886777+0000","last_change":"2023-08-27T11:24:47.012245+0000","last_active":"2023-08-27T11:24:48.886777+0000","last_peered":"2023-08-27T11:24:48.886777+0000","last_clean":"2023-08-27T11:24:48.886777+0000","last_became_active":"2023-08-27T11:24:47.011755+0000","last_became_peered":"2023-08-27T11:24:47.011755+0000","last_unstale":"2023-08-27T11:24:48.886777+0000","last_undegraded":"2023-08-27T11:24:48.886777+0000","last_fullsized":"2023-08-27T11:24:48.886777+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:12.190051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246665+0000","last_change":"2023-08-27T11:24:47.917245+0000","last_active":"2023-08-27T11:24:49.246665+0000","last_peered":"2023-08-27T11:24:49.246665+0000","last_clean":"2023-08-27T11:24:49.246665+0000","last_became_active":"2023-08-27T11:24:47.916929+0000","last_became_peered":"2023-08-27T11:24:47.916929+0000","last_unstale":"2023-08-27T11:24:49.246665+0000","last_undegraded":"2023-08-27T11:24:49.246665+0000","last_fullsized":"2023-08-27T11:24:49.246665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:30.974752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246998+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:24:49.246998+0000","last_peered":"2023-08-27T11:24:49.246998+0000","last_clean":"2023-08-27T11:24:49.246998+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:24:49.246998+0000","last_undegraded":"2023-08-27T11:24:49.246998+0000","last_fullsized":"2023-08-27T11:24:49.246998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:16.642117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886429+0000","last_change":"2023-08-27T11:24:32.291308+0000","last_active":"2023-08-27T11:24:48.886429+0000","last_peered":"2023-08-27T11:24:48.886429+0000","last_clean":"2023-08-27T11:24:48.886429+0000","last_became_active":"2023-08-27T11:24:32.291005+0000","last_became_peered":"2023-08-27T11:24:32.291005+0000","last_unstale":"2023-08-27T11:24:48.886429+0000","last_undegraded":"2023-08-27T11:24:48.886429+0000","last_fullsized":"2023-08-27T11:24:48.886429+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:58.267488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.093251+0000","last_change":"2023-08-27T11:24:32.883742+0000","last_active":"2023-08-27T11:24:49.093251+0000","last_peered":"2023-08-27T11:24:49.093251+0000","last_clean":"2023-08-27T11:24:49.093251+0000","last_became_active":"2023-08-27T11:24:32.883361+0000","last_became_peered":"2023-08-27T11:24:32.883361+0000","last_unstale":"2023-08-27T11:24:49.093251+0000","last_undegraded":"2023-08-27T11:24:49.093251+0000","last_fullsized":"2023-08-27T11:24:49.093251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:09.258794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247471+0000","last_change":"2023-08-27T11:24:47.020155+0000","last_active":"2023-08-27T11:24:49.247471+0000","last_peered":"2023-08-27T11:24:49.247471+0000","last_clean":"2023-08-27T11:24:49.247471+0000","last_became_active":"2023-08-27T11:24:47.019740+0000","last_became_peered":"2023-08-27T11:24:47.019740+0000","last_unstale":"2023-08-27T11:24:49.247471+0000","last_undegraded":"2023-08-27T11:24:49.247471+0000","last_fullsized":"2023-08-27T11:24:49.247471+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:55.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246541+0000","last_change":"2023-08-27T11:24:47.914354+0000","last_active":"2023-08-27T11:24:49.246541+0000","last_peered":"2023-08-27T11:24:49.246541+0000","last_clean":"2023-08-27T11:24:49.246541+0000","last_became_active":"2023-08-27T11:24:47.914017+0000","last_became_peered":"2023-08-27T11:24:47.914017+0000","last_unstale":"2023-08-27T11:24:49.246541+0000","last_undegraded":"2023-08-27T11:24:49.246541+0000","last_fullsized":"2023-08-27T11:24:49.246541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:43:00.387799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886199+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:24:48.886199+0000","last_peered":"2023-08-27T11:24:48.886199+0000","last_clean":"2023-08-27T11:24:48.886199+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:24:48.886199+0000","last_undegraded":"2023-08-27T11:24:48.886199+0000","last_fullsized":"2023-08-27T11:24:48.886199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:29.519948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246995+0000","last_change":"2023-08-27T11:24:32.298551+0000","last_active":"2023-08-27T11:24:49.246995+0000","last_peered":"2023-08-27T11:24:49.246995+0000","last_clean":"2023-08-27T11:24:49.246995+0000","last_became_active":"2023-08-27T11:24:32.298256+0000","last_became_peered":"2023-08-27T11:24:32.298256+0000","last_unstale":"2023-08-27T11:24:49.246995+0000","last_undegraded":"2023-08-27T11:24:49.246995+0000","last_fullsized":"2023-08-27T11:24:49.246995+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:42.738370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885744+0000","last_change":"2023-08-27T11:24:32.898742+0000","last_active":"2023-08-27T11:24:48.885744+0000","last_peered":"2023-08-27T11:24:48.885744+0000","last_clean":"2023-08-27T11:24:48.885744+0000","last_became_active":"2023-08-27T11:24:32.898394+0000","last_became_peered":"2023-08-27T11:24:32.898394+0000","last_unstale":"2023-08-27T11:24:48.885744+0000","last_undegraded":"2023-08-27T11:24:48.885744+0000","last_fullsized":"2023-08-27T11:24:48.885744+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:32.159616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944611+0000","last_change":"2023-08-27T11:24:47.017782+0000","last_active":"2023-08-27T11:24:48.944611+0000","last_peered":"2023-08-27T11:24:48.944611+0000","last_clean":"2023-08-27T11:24:48.944611+0000","last_became_active":"2023-08-27T11:24:47.017386+0000","last_became_peered":"2023-08-27T11:24:47.017386+0000","last_unstale":"2023-08-27T11:24:48.944611+0000","last_undegraded":"2023-08-27T11:24:48.944611+0000","last_fullsized":"2023-08-27T11:24:48.944611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:47.926952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245714+0000","last_change":"2023-08-27T11:24:47.909420+0000","last_active":"2023-08-27T11:24:49.245714+0000","last_peered":"2023-08-27T11:24:49.245714+0000","last_clean":"2023-08-27T11:24:49.245714+0000","last_became_active":"2023-08-27T11:24:47.909138+0000","last_became_peered":"2023-08-27T11:24:47.909138+0000","last_unstale":"2023-08-27T11:24:49.245714+0000","last_undegraded":"2023-08-27T11:24:49.245714+0000","last_fullsized":"2023-08-27T11:24:49.245714+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:49.679096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245927+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:24:49.245927+0000","last_peered":"2023-08-27T11:24:49.245927+0000","last_clean":"2023-08-27T11:24:49.245927+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:24:49.245927+0000","last_undegraded":"2023-08-27T11:24:49.245927+0000","last_fullsized":"2023-08-27T11:24:49.245927+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:11:48.693495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"47'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945552+0000","last_change":"2023-08-27T11:24:32.299417+0000","last_active":"2023-08-27T11:24:48.945552+0000","last_peered":"2023-08-27T11:24:48.945552+0000","last_clean":"2023-08-27T11:24:48.945552+0000","last_became_active":"2023-08-27T11:24:32.298960+0000","last_became_peered":"2023-08-27T11:24:32.298960+0000","last_unstale":"2023-08-27T11:24:48.945552+0000","last_undegraded":"2023-08-27T11:24:48.945552+0000","last_fullsized":"2023-08-27T11:24:48.945552+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:57.045550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244409+0000","last_change":"2023-08-27T11:24:32.899689+0000","last_active":"2023-08-27T11:24:49.244409+0000","last_peered":"2023-08-27T11:24:49.244409+0000","last_clean":"2023-08-27T11:24:49.244409+0000","last_became_active":"2023-08-27T11:24:32.899314+0000","last_became_peered":"2023-08-27T11:24:32.899314+0000","last_unstale":"2023-08-27T11:24:49.244409+0000","last_undegraded":"2023-08-27T11:24:49.244409+0000","last_fullsized":"2023-08-27T11:24:49.244409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:18.267003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092153+0000","last_change":"2023-08-27T11:24:47.014048+0000","last_active":"2023-08-27T11:24:49.092153+0000","last_peered":"2023-08-27T11:24:49.092153+0000","last_clean":"2023-08-27T11:24:49.092153+0000","last_became_active":"2023-08-27T11:24:47.013604+0000","last_became_peered":"2023-08-27T11:24:47.013604+0000","last_unstale":"2023-08-27T11:24:49.092153+0000","last_undegraded":"2023-08-27T11:24:49.092153+0000","last_fullsized":"2023-08-27T11:24:49.092153+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:30.143916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245656+0000","last_change":"2023-08-27T11:24:47.906237+0000","last_active":"2023-08-27T11:24:49.245656+0000","last_peered":"2023-08-27T11:24:49.245656+0000","last_clean":"2023-08-27T11:24:49.245656+0000","last_became_active":"2023-08-27T11:24:47.905967+0000","last_became_peered":"2023-08-27T11:24:47.905967+0000","last_unstale":"2023-08-27T11:24:49.245656+0000","last_undegraded":"2023-08-27T11:24:49.245656+0000","last_fullsized":"2023-08-27T11:24:49.245656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:48.349559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245389+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:24:49.245389+0000","last_peered":"2023-08-27T11:24:49.245389+0000","last_clean":"2023-08-27T11:24:49.245389+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:24:49.245389+0000","last_undegraded":"2023-08-27T11:24:49.245389+0000","last_fullsized":"2023-08-27T11:24:49.245389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:35:07.865721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945121+0000","last_change":"2023-08-27T11:24:32.298891+0000","last_active":"2023-08-27T11:24:48.945121+0000","last_peered":"2023-08-27T11:24:48.945121+0000","last_clean":"2023-08-27T11:24:48.945121+0000","last_became_active":"2023-08-27T11:24:32.298585+0000","last_became_peered":"2023-08-27T11:24:32.298585+0000","last_unstale":"2023-08-27T11:24:48.945121+0000","last_undegraded":"2023-08-27T11:24:48.945121+0000","last_fullsized":"2023-08-27T11:24:48.945121+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:17.262843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091811+0000","last_change":"2023-08-27T11:24:32.910307+0000","last_active":"2023-08-27T11:24:49.091811+0000","last_peered":"2023-08-27T11:24:49.091811+0000","last_clean":"2023-08-27T11:24:49.091811+0000","last_became_active":"2023-08-27T11:24:32.909518+0000","last_became_peered":"2023-08-27T11:24:32.909518+0000","last_unstale":"2023-08-27T11:24:49.091811+0000","last_undegraded":"2023-08-27T11:24:49.091811+0000","last_fullsized":"2023-08-27T11:24:49.091811+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:16.366498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887504+0000","last_change":"2023-08-27T11:24:47.012260+0000","last_active":"2023-08-27T11:24:48.887504+0000","last_peered":"2023-08-27T11:24:48.887504+0000","last_clean":"2023-08-27T11:24:48.887504+0000","last_became_active":"2023-08-27T11:24:47.011507+0000","last_became_peered":"2023-08-27T11:24:47.011507+0000","last_unstale":"2023-08-27T11:24:48.887504+0000","last_undegraded":"2023-08-27T11:24:48.887504+0000","last_fullsized":"2023-08-27T11:24:48.887504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:47.873973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885732+0000","last_change":"2023-08-27T11:24:47.896009+0000","last_active":"2023-08-27T11:24:48.885732+0000","last_peered":"2023-08-27T11:24:48.885732+0000","last_clean":"2023-08-27T11:24:48.885732+0000","last_became_active":"2023-08-27T11:24:47.895690+0000","last_became_peered":"2023-08-27T11:24:47.895690+0000","last_unstale":"2023-08-27T11:24:48.885732+0000","last_undegraded":"2023-08-27T11:24:48.885732+0000","last_fullsized":"2023-08-27T11:24:48.885732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:22.403683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":222,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245776+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:24:49.245776+0000","last_peered":"2023-08-27T11:24:49.245776+0000","last_clean":"2023-08-27T11:24:49.245776+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:24:49.245776+0000","last_undegraded":"2023-08-27T11:24:49.245776+0000","last_fullsized":"2023-08-27T11:24:49.245776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:35.318368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":72,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000207+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:24:49.000207+0000","last_peered":"2023-08-27T11:24:49.000207+0000","last_clean":"2023-08-27T11:24:49.000207+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:24:49.000207+0000","last_undegraded":"2023-08-27T11:24:49.000207+0000","last_fullsized":"2023-08-27T11:24:49.000207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:16:53.037066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246820+0000","last_change":"2023-08-27T11:24:32.292210+0000","last_active":"2023-08-27T11:24:49.246820+0000","last_peered":"2023-08-27T11:24:49.246820+0000","last_clean":"2023-08-27T11:24:49.246820+0000","last_became_active":"2023-08-27T11:24:32.291811+0000","last_became_peered":"2023-08-27T11:24:32.291811+0000","last_unstale":"2023-08-27T11:24:49.246820+0000","last_undegraded":"2023-08-27T11:24:49.246820+0000","last_fullsized":"2023-08-27T11:24:49.246820+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:04:41.648428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999634+0000","last_change":"2023-08-27T11:24:32.889337+0000","last_active":"2023-08-27T11:24:48.999634+0000","last_peered":"2023-08-27T11:24:48.999634+0000","last_clean":"2023-08-27T11:24:48.999634+0000","last_became_active":"2023-08-27T11:24:32.889050+0000","last_became_peered":"2023-08-27T11:24:32.889050+0000","last_unstale":"2023-08-27T11:24:48.999634+0000","last_undegraded":"2023-08-27T11:24:48.999634+0000","last_fullsized":"2023-08-27T11:24:48.999634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:43:24.658639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944921+0000","last_change":"2023-08-27T11:24:47.019430+0000","last_active":"2023-08-27T11:24:48.944921+0000","last_peered":"2023-08-27T11:24:48.944921+0000","last_clean":"2023-08-27T11:24:48.944921+0000","last_became_active":"2023-08-27T11:24:47.019126+0000","last_became_peered":"2023-08-27T11:24:47.019126+0000","last_unstale":"2023-08-27T11:24:48.944921+0000","last_undegraded":"2023-08-27T11:24:48.944921+0000","last_fullsized":"2023-08-27T11:24:48.944921+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:51:12.369555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944711+0000","last_change":"2023-08-27T11:24:47.897540+0000","last_active":"2023-08-27T11:24:48.944711+0000","last_peered":"2023-08-27T11:24:48.944711+0000","last_clean":"2023-08-27T11:24:48.944711+0000","last_became_active":"2023-08-27T11:24:47.896003+0000","last_became_peered":"2023-08-27T11:24:47.896003+0000","last_unstale":"2023-08-27T11:24:48.944711+0000","last_undegraded":"2023-08-27T11:24:48.944711+0000","last_fullsized":"2023-08-27T11:24:48.944711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:47.159610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":76,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092519+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:24:49.092519+0000","last_peered":"2023-08-27T11:24:49.092519+0000","last_clean":"2023-08-27T11:24:49.092519+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:24:49.092519+0000","last_undegraded":"2023-08-27T11:24:49.092519+0000","last_fullsized":"2023-08-27T11:24:49.092519+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:49:50.142502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092515+0000","last_change":"2023-08-27T11:24:32.288364+0000","last_active":"2023-08-27T11:24:49.092515+0000","last_peered":"2023-08-27T11:24:49.092515+0000","last_clean":"2023-08-27T11:24:49.092515+0000","last_became_active":"2023-08-27T11:24:32.287929+0000","last_became_peered":"2023-08-27T11:24:32.287929+0000","last_unstale":"2023-08-27T11:24:49.092515+0000","last_undegraded":"2023-08-27T11:24:49.092515+0000","last_fullsized":"2023-08-27T11:24:49.092515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:24.144492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886971+0000","last_change":"2023-08-27T11:24:32.906148+0000","last_active":"2023-08-27T11:24:48.886971+0000","last_peered":"2023-08-27T11:24:48.886971+0000","last_clean":"2023-08-27T11:24:48.886971+0000","last_became_active":"2023-08-27T11:24:32.905830+0000","last_became_peered":"2023-08-27T11:24:32.905830+0000","last_unstale":"2023-08-27T11:24:48.886971+0000","last_undegraded":"2023-08-27T11:24:48.886971+0000","last_fullsized":"2023-08-27T11:24:48.886971+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:52:55.617567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092459+0000","last_change":"2023-08-27T11:24:47.009864+0000","last_active":"2023-08-27T11:24:49.092459+0000","last_peered":"2023-08-27T11:24:49.092459+0000","last_clean":"2023-08-27T11:24:49.092459+0000","last_became_active":"2023-08-27T11:24:47.009578+0000","last_became_peered":"2023-08-27T11:24:47.009578+0000","last_unstale":"2023-08-27T11:24:49.092459+0000","last_undegraded":"2023-08-27T11:24:49.092459+0000","last_fullsized":"2023-08-27T11:24:49.092459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:08.272258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247061+0000","last_change":"2023-08-27T11:24:47.901974+0000","last_active":"2023-08-27T11:24:49.247061+0000","last_peered":"2023-08-27T11:24:49.247061+0000","last_clean":"2023-08-27T11:24:49.247061+0000","last_became_active":"2023-08-27T11:24:47.901470+0000","last_became_peered":"2023-08-27T11:24:47.901470+0000","last_unstale":"2023-08-27T11:24:49.247061+0000","last_undegraded":"2023-08-27T11:24:49.247061+0000","last_fullsized":"2023-08-27T11:24:49.247061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:14.800506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":78,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886830+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:24:48.886830+0000","last_peered":"2023-08-27T11:24:48.886830+0000","last_clean":"2023-08-27T11:24:48.886830+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:24:48.886830+0000","last_undegraded":"2023-08-27T11:24:48.886830+0000","last_fullsized":"2023-08-27T11:24:48.886830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:11.576286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092514+0000","last_change":"2023-08-27T11:24:32.278516+0000","last_active":"2023-08-27T11:24:49.092514+0000","last_peered":"2023-08-27T11:24:49.092514+0000","last_clean":"2023-08-27T11:24:49.092514+0000","last_became_active":"2023-08-27T11:24:32.278225+0000","last_became_peered":"2023-08-27T11:24:32.278225+0000","last_unstale":"2023-08-27T11:24:49.092514+0000","last_undegraded":"2023-08-27T11:24:49.092514+0000","last_fullsized":"2023-08-27T11:24:49.092514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:30:29.664511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945171+0000","last_change":"2023-08-27T11:24:32.905190+0000","last_active":"2023-08-27T11:24:48.945171+0000","last_peered":"2023-08-27T11:24:48.945171+0000","last_clean":"2023-08-27T11:24:48.945171+0000","last_became_active":"2023-08-27T11:24:32.904921+0000","last_became_peered":"2023-08-27T11:24:32.904921+0000","last_unstale":"2023-08-27T11:24:48.945171+0000","last_undegraded":"2023-08-27T11:24:48.945171+0000","last_fullsized":"2023-08-27T11:24:48.945171+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:35.896764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247355+0000","last_change":"2023-08-27T11:24:47.018035+0000","last_active":"2023-08-27T11:24:49.247355+0000","last_peered":"2023-08-27T11:24:49.247355+0000","last_clean":"2023-08-27T11:24:49.247355+0000","last_became_active":"2023-08-27T11:24:47.017721+0000","last_became_peered":"2023-08-27T11:24:47.017721+0000","last_unstale":"2023-08-27T11:24:49.247355+0000","last_undegraded":"2023-08-27T11:24:49.247355+0000","last_fullsized":"2023-08-27T11:24:49.247355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:09:42.952015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887137+0000","last_change":"2023-08-27T11:24:47.901954+0000","last_active":"2023-08-27T11:24:48.887137+0000","last_peered":"2023-08-27T11:24:48.887137+0000","last_clean":"2023-08-27T11:24:48.887137+0000","last_became_active":"2023-08-27T11:24:47.901635+0000","last_became_peered":"2023-08-27T11:24:47.901635+0000","last_unstale":"2023-08-27T11:24:48.887137+0000","last_undegraded":"2023-08-27T11:24:48.887137+0000","last_fullsized":"2023-08-27T11:24:48.887137+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:13.198136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884334+0000","last_change":"2023-08-27T11:24:32.285270+0000","last_active":"2023-08-27T11:24:48.884334+0000","last_peered":"2023-08-27T11:24:48.884334+0000","last_clean":"2023-08-27T11:24:48.884334+0000","last_became_active":"2023-08-27T11:24:32.284877+0000","last_became_peered":"2023-08-27T11:24:32.284877+0000","last_unstale":"2023-08-27T11:24:48.884334+0000","last_undegraded":"2023-08-27T11:24:48.884334+0000","last_fullsized":"2023-08-27T11:24:48.884334+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:46.595722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000966+0000","last_change":"2023-08-27T11:24:32.889628+0000","last_active":"2023-08-27T11:24:49.000966+0000","last_peered":"2023-08-27T11:24:49.000966+0000","last_clean":"2023-08-27T11:24:49.000966+0000","last_became_active":"2023-08-27T11:24:32.889347+0000","last_became_peered":"2023-08-27T11:24:32.889347+0000","last_unstale":"2023-08-27T11:24:49.000966+0000","last_undegraded":"2023-08-27T11:24:49.000966+0000","last_fullsized":"2023-08-27T11:24:49.000966+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:34.960826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887572+0000","last_change":"2023-08-27T11:24:47.013753+0000","last_active":"2023-08-27T11:24:48.887572+0000","last_peered":"2023-08-27T11:24:48.887572+0000","last_clean":"2023-08-27T11:24:48.887572+0000","last_became_active":"2023-08-27T11:24:47.013461+0000","last_became_peered":"2023-08-27T11:24:47.013461+0000","last_unstale":"2023-08-27T11:24:48.887572+0000","last_undegraded":"2023-08-27T11:24:48.887572+0000","last_fullsized":"2023-08-27T11:24:48.887572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:52:05.275464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885049+0000","last_change":"2023-08-27T11:24:47.897695+0000","last_active":"2023-08-27T11:24:48.885049+0000","last_peered":"2023-08-27T11:24:48.885049+0000","last_clean":"2023-08-27T11:24:48.885049+0000","last_became_active":"2023-08-27T11:24:47.897354+0000","last_became_peered":"2023-08-27T11:24:47.897354+0000","last_unstale":"2023-08-27T11:24:48.885049+0000","last_undegraded":"2023-08-27T11:24:48.885049+0000","last_fullsized":"2023-08-27T11:24:48.885049+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:50.515951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944426+0000","last_change":"2023-08-27T11:24:32.293744+0000","last_active":"2023-08-27T11:24:48.944426+0000","last_peered":"2023-08-27T11:24:48.944426+0000","last_clean":"2023-08-27T11:24:48.944426+0000","last_became_active":"2023-08-27T11:24:32.293488+0000","last_became_peered":"2023-08-27T11:24:32.293488+0000","last_unstale":"2023-08-27T11:24:48.944426+0000","last_undegraded":"2023-08-27T11:24:48.944426+0000","last_fullsized":"2023-08-27T11:24:48.944426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:52:38.327155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945409+0000","last_change":"2023-08-27T11:24:32.904659+0000","last_active":"2023-08-27T11:24:48.945409+0000","last_peered":"2023-08-27T11:24:48.945409+0000","last_clean":"2023-08-27T11:24:48.945409+0000","last_became_active":"2023-08-27T11:24:32.904365+0000","last_became_peered":"2023-08-27T11:24:32.904365+0000","last_unstale":"2023-08-27T11:24:48.945409+0000","last_undegraded":"2023-08-27T11:24:48.945409+0000","last_fullsized":"2023-08-27T11:24:48.945409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:54:29.360643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887172+0000","last_change":"2023-08-27T11:24:47.016887+0000","last_active":"2023-08-27T11:24:48.887172+0000","last_peered":"2023-08-27T11:24:48.887172+0000","last_clean":"2023-08-27T11:24:48.887172+0000","last_became_active":"2023-08-27T11:24:47.016548+0000","last_became_peered":"2023-08-27T11:24:47.016548+0000","last_unstale":"2023-08-27T11:24:48.887172+0000","last_undegraded":"2023-08-27T11:24:48.887172+0000","last_fullsized":"2023-08-27T11:24:48.887172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:03.906011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945018+0000","last_change":"2023-08-27T11:24:47.904132+0000","last_active":"2023-08-27T11:24:48.945018+0000","last_peered":"2023-08-27T11:24:48.945018+0000","last_clean":"2023-08-27T11:24:48.945018+0000","last_became_active":"2023-08-27T11:24:47.903800+0000","last_became_peered":"2023-08-27T11:24:47.903800+0000","last_unstale":"2023-08-27T11:24:48.945018+0000","last_undegraded":"2023-08-27T11:24:48.945018+0000","last_fullsized":"2023-08-27T11:24:48.945018+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:15:54.281969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092232+0000","last_change":"2023-08-27T11:24:32.278431+0000","last_active":"2023-08-27T11:24:49.092232+0000","last_peered":"2023-08-27T11:24:49.092232+0000","last_clean":"2023-08-27T11:24:49.092232+0000","last_became_active":"2023-08-27T11:24:32.278149+0000","last_became_peered":"2023-08-27T11:24:32.278149+0000","last_unstale":"2023-08-27T11:24:49.092232+0000","last_undegraded":"2023-08-27T11:24:49.092232+0000","last_fullsized":"2023-08-27T11:24:49.092232+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:13:44.042979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244445+0000","last_change":"2023-08-27T11:24:32.903976+0000","last_active":"2023-08-27T11:24:49.244445+0000","last_peered":"2023-08-27T11:24:49.244445+0000","last_clean":"2023-08-27T11:24:49.244445+0000","last_became_active":"2023-08-27T11:24:32.903486+0000","last_became_peered":"2023-08-27T11:24:32.903486+0000","last_unstale":"2023-08-27T11:24:49.244445+0000","last_undegraded":"2023-08-27T11:24:49.244445+0000","last_fullsized":"2023-08-27T11:24:49.244445+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:04.691076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000772+0000","last_change":"2023-08-27T11:24:47.014859+0000","last_active":"2023-08-27T11:24:49.000772+0000","last_peered":"2023-08-27T11:24:49.000772+0000","last_clean":"2023-08-27T11:24:49.000772+0000","last_became_active":"2023-08-27T11:24:47.014540+0000","last_became_peered":"2023-08-27T11:24:47.014540+0000","last_unstale":"2023-08-27T11:24:49.000772+0000","last_undegraded":"2023-08-27T11:24:49.000772+0000","last_fullsized":"2023-08-27T11:24:49.000772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:13.483337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247220+0000","last_change":"2023-08-27T11:24:47.901738+0000","last_active":"2023-08-27T11:24:49.247220+0000","last_peered":"2023-08-27T11:24:49.247220+0000","last_clean":"2023-08-27T11:24:49.247220+0000","last_became_active":"2023-08-27T11:24:47.901122+0000","last_became_peered":"2023-08-27T11:24:47.901122+0000","last_unstale":"2023-08-27T11:24:49.247220+0000","last_undegraded":"2023-08-27T11:24:49.247220+0000","last_fullsized":"2023-08-27T11:24:49.247220+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:21.057236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000283+0000","last_change":"2023-08-27T11:24:32.291430+0000","last_active":"2023-08-27T11:24:49.000283+0000","last_peered":"2023-08-27T11:24:49.000283+0000","last_clean":"2023-08-27T11:24:49.000283+0000","last_became_active":"2023-08-27T11:24:32.291106+0000","last_became_peered":"2023-08-27T11:24:32.291106+0000","last_unstale":"2023-08-27T11:24:49.000283+0000","last_undegraded":"2023-08-27T11:24:49.000283+0000","last_fullsized":"2023-08-27T11:24:49.000283+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:48.104401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886708+0000","last_change":"2023-08-27T11:24:32.909037+0000","last_active":"2023-08-27T11:24:48.886708+0000","last_peered":"2023-08-27T11:24:48.886708+0000","last_clean":"2023-08-27T11:24:48.886708+0000","last_became_active":"2023-08-27T11:24:32.908719+0000","last_became_peered":"2023-08-27T11:24:32.908719+0000","last_unstale":"2023-08-27T11:24:48.886708+0000","last_undegraded":"2023-08-27T11:24:48.886708+0000","last_fullsized":"2023-08-27T11:24:48.886708+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:51.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945413+0000","last_change":"2023-08-27T11:24:47.012189+0000","last_active":"2023-08-27T11:24:48.945413+0000","last_peered":"2023-08-27T11:24:48.945413+0000","last_clean":"2023-08-27T11:24:48.945413+0000","last_became_active":"2023-08-27T11:24:47.011806+0000","last_became_peered":"2023-08-27T11:24:47.011806+0000","last_unstale":"2023-08-27T11:24:48.945413+0000","last_undegraded":"2023-08-27T11:24:48.945413+0000","last_fullsized":"2023-08-27T11:24:48.945413+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:30.143916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887365+0000","last_change":"2023-08-27T11:24:47.898238+0000","last_active":"2023-08-27T11:24:48.887365+0000","last_peered":"2023-08-27T11:24:48.887365+0000","last_clean":"2023-08-27T11:24:48.887365+0000","last_became_active":"2023-08-27T11:24:47.897948+0000","last_became_peered":"2023-08-27T11:24:47.897948+0000","last_unstale":"2023-08-27T11:24:48.887365+0000","last_undegraded":"2023-08-27T11:24:48.887365+0000","last_fullsized":"2023-08-27T11:24:48.887365+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:45.439611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245200+0000","last_change":"2023-08-27T11:24:32.283531+0000","last_active":"2023-08-27T11:24:49.245200+0000","last_peered":"2023-08-27T11:24:49.245200+0000","last_clean":"2023-08-27T11:24:49.245200+0000","last_became_active":"2023-08-27T11:24:32.283231+0000","last_became_peered":"2023-08-27T11:24:32.283231+0000","last_unstale":"2023-08-27T11:24:49.245200+0000","last_undegraded":"2023-08-27T11:24:49.245200+0000","last_fullsized":"2023-08-27T11:24:49.245200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:26.534874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999685+0000","last_change":"2023-08-27T11:24:32.896839+0000","last_active":"2023-08-27T11:24:48.999685+0000","last_peered":"2023-08-27T11:24:48.999685+0000","last_clean":"2023-08-27T11:24:48.999685+0000","last_became_active":"2023-08-27T11:24:32.896629+0000","last_became_peered":"2023-08-27T11:24:32.896629+0000","last_unstale":"2023-08-27T11:24:48.999685+0000","last_undegraded":"2023-08-27T11:24:48.999685+0000","last_fullsized":"2023-08-27T11:24:48.999685+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:57.958932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092074+0000","last_change":"2023-08-27T11:24:47.008423+0000","last_active":"2023-08-27T11:24:49.092074+0000","last_peered":"2023-08-27T11:24:49.092074+0000","last_clean":"2023-08-27T11:24:49.092074+0000","last_became_active":"2023-08-27T11:24:47.008083+0000","last_became_peered":"2023-08-27T11:24:47.008083+0000","last_unstale":"2023-08-27T11:24:49.092074+0000","last_undegraded":"2023-08-27T11:24:49.092074+0000","last_fullsized":"2023-08-27T11:24:49.092074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:31.978636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885973+0000","last_change":"2023-08-27T11:24:47.906802+0000","last_active":"2023-08-27T11:24:48.885973+0000","last_peered":"2023-08-27T11:24:48.885973+0000","last_clean":"2023-08-27T11:24:48.885973+0000","last_became_active":"2023-08-27T11:24:47.906466+0000","last_became_peered":"2023-08-27T11:24:47.906466+0000","last_unstale":"2023-08-27T11:24:48.885973+0000","last_undegraded":"2023-08-27T11:24:48.885973+0000","last_fullsized":"2023-08-27T11:24:48.885973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:40.593310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246681+0000","last_change":"2023-08-27T11:24:32.291693+0000","last_active":"2023-08-27T11:24:49.246681+0000","last_peered":"2023-08-27T11:24:49.246681+0000","last_clean":"2023-08-27T11:24:49.246681+0000","last_became_active":"2023-08-27T11:24:32.291329+0000","last_became_peered":"2023-08-27T11:24:32.291329+0000","last_unstale":"2023-08-27T11:24:49.246681+0000","last_undegraded":"2023-08-27T11:24:49.246681+0000","last_fullsized":"2023-08-27T11:24:49.246681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:11.322410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885585+0000","last_change":"2023-08-27T11:24:32.912907+0000","last_active":"2023-08-27T11:24:48.885585+0000","last_peered":"2023-08-27T11:24:48.885585+0000","last_clean":"2023-08-27T11:24:48.885585+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:48.885585+0000","last_undegraded":"2023-08-27T11:24:48.885585+0000","last_fullsized":"2023-08-27T11:24:48.885585+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:02.440440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246395+0000","last_change":"2023-08-27T11:24:47.020476+0000","last_active":"2023-08-27T11:24:49.246395+0000","last_peered":"2023-08-27T11:24:49.246395+0000","last_clean":"2023-08-27T11:24:49.246395+0000","last_became_active":"2023-08-27T11:24:47.019974+0000","last_became_peered":"2023-08-27T11:24:47.019974+0000","last_unstale":"2023-08-27T11:24:49.246395+0000","last_undegraded":"2023-08-27T11:24:49.246395+0000","last_fullsized":"2023-08-27T11:24:49.246395+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:46.615325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244855+0000","last_change":"2023-08-27T11:24:47.903664+0000","last_active":"2023-08-27T11:24:49.244855+0000","last_peered":"2023-08-27T11:24:49.244855+0000","last_clean":"2023-08-27T11:24:49.244855+0000","last_became_active":"2023-08-27T11:24:47.903355+0000","last_became_peered":"2023-08-27T11:24:47.903355+0000","last_unstale":"2023-08-27T11:24:49.244855+0000","last_undegraded":"2023-08-27T11:24:49.244855+0000","last_fullsized":"2023-08-27T11:24:49.244855+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:29.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884894+0000","last_change":"2023-08-27T11:24:32.287931+0000","last_active":"2023-08-27T11:24:48.884894+0000","last_peered":"2023-08-27T11:24:48.884894+0000","last_clean":"2023-08-27T11:24:48.884894+0000","last_became_active":"2023-08-27T11:24:32.287220+0000","last_became_peered":"2023-08-27T11:24:32.287220+0000","last_unstale":"2023-08-27T11:24:48.884894+0000","last_undegraded":"2023-08-27T11:24:48.884894+0000","last_fullsized":"2023-08-27T11:24:48.884894+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:23.875545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000008+0000","last_change":"2023-08-27T11:24:32.904851+0000","last_active":"2023-08-27T11:24:49.000008+0000","last_peered":"2023-08-27T11:24:49.000008+0000","last_clean":"2023-08-27T11:24:49.000008+0000","last_became_active":"2023-08-27T11:24:32.904617+0000","last_became_peered":"2023-08-27T11:24:32.904617+0000","last_unstale":"2023-08-27T11:24:49.000008+0000","last_undegraded":"2023-08-27T11:24:49.000008+0000","last_fullsized":"2023-08-27T11:24:49.000008+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:34.667606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000084+0000","last_change":"2023-08-27T11:24:47.010525+0000","last_active":"2023-08-27T11:24:49.000084+0000","last_peered":"2023-08-27T11:24:49.000084+0000","last_clean":"2023-08-27T11:24:49.000084+0000","last_became_active":"2023-08-27T11:24:47.010256+0000","last_became_peered":"2023-08-27T11:24:47.010256+0000","last_unstale":"2023-08-27T11:24:49.000084+0000","last_undegraded":"2023-08-27T11:24:49.000084+0000","last_fullsized":"2023-08-27T11:24:49.000084+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:58:42.804675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884640+0000","last_change":"2023-08-27T11:24:47.893457+0000","last_active":"2023-08-27T11:24:48.884640+0000","last_peered":"2023-08-27T11:24:48.884640+0000","last_clean":"2023-08-27T11:24:48.884640+0000","last_became_active":"2023-08-27T11:24:47.893164+0000","last_became_peered":"2023-08-27T11:24:47.893164+0000","last_unstale":"2023-08-27T11:24:48.884640+0000","last_undegraded":"2023-08-27T11:24:48.884640+0000","last_fullsized":"2023-08-27T11:24:48.884640+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:33.448965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945522+0000","last_change":"2023-08-27T11:24:32.297792+0000","last_active":"2023-08-27T11:24:48.945522+0000","last_peered":"2023-08-27T11:24:48.945522+0000","last_clean":"2023-08-27T11:24:48.945522+0000","last_became_active":"2023-08-27T11:24:32.297492+0000","last_became_peered":"2023-08-27T11:24:32.297492+0000","last_unstale":"2023-08-27T11:24:48.945522+0000","last_undegraded":"2023-08-27T11:24:48.945522+0000","last_fullsized":"2023-08-27T11:24:48.945522+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:30:59.935592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091968+0000","last_change":"2023-08-27T11:24:32.898773+0000","last_active":"2023-08-27T11:24:49.091968+0000","last_peered":"2023-08-27T11:24:49.091968+0000","last_clean":"2023-08-27T11:24:49.091968+0000","last_became_active":"2023-08-27T11:24:32.898512+0000","last_became_peered":"2023-08-27T11:24:32.898512+0000","last_unstale":"2023-08-27T11:24:49.091968+0000","last_undegraded":"2023-08-27T11:24:49.091968+0000","last_fullsized":"2023-08-27T11:24:49.091968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:14:38.023183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092699+0000","last_change":"2023-08-27T11:24:47.014484+0000","last_active":"2023-08-27T11:24:49.092699+0000","last_peered":"2023-08-27T11:24:49.092699+0000","last_clean":"2023-08-27T11:24:49.092699+0000","last_became_active":"2023-08-27T11:24:47.014112+0000","last_became_peered":"2023-08-27T11:24:47.014112+0000","last_unstale":"2023-08-27T11:24:49.092699+0000","last_undegraded":"2023-08-27T11:24:49.092699+0000","last_fullsized":"2023-08-27T11:24:49.092699+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:29.787182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000247+0000","last_change":"2023-08-27T11:24:47.905541+0000","last_active":"2023-08-27T11:24:49.000247+0000","last_peered":"2023-08-27T11:24:49.000247+0000","last_clean":"2023-08-27T11:24:49.000247+0000","last_became_active":"2023-08-27T11:24:47.905269+0000","last_became_peered":"2023-08-27T11:24:47.905269+0000","last_unstale":"2023-08-27T11:24:49.000247+0000","last_undegraded":"2023-08-27T11:24:49.000247+0000","last_fullsized":"2023-08-27T11:24:49.000247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:25:19.409347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887161+0000","last_change":"2023-08-27T11:24:47.908860+0000","last_active":"2023-08-27T11:24:48.887161+0000","last_peered":"2023-08-27T11:24:48.887161+0000","last_clean":"2023-08-27T11:24:48.887161+0000","last_became_active":"2023-08-27T11:24:47.908474+0000","last_became_peered":"2023-08-27T11:24:47.908474+0000","last_unstale":"2023-08-27T11:24:48.887161+0000","last_undegraded":"2023-08-27T11:24:48.887161+0000","last_fullsized":"2023-08-27T11:24:48.887161+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:10.335838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":29,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092530+0000","last_change":"2023-08-27T11:24:32.278403+0000","last_active":"2023-08-27T11:24:49.092530+0000","last_peered":"2023-08-27T11:24:49.092530+0000","last_clean":"2023-08-27T11:24:49.092530+0000","last_became_active":"2023-08-27T11:24:32.278104+0000","last_became_peered":"2023-08-27T11:24:32.278104+0000","last_unstale":"2023-08-27T11:24:49.092530+0000","last_undegraded":"2023-08-27T11:24:49.092530+0000","last_fullsized":"2023-08-27T11:24:49.092530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:31.215420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944271+0000","last_change":"2023-08-27T11:24:32.913029+0000","last_active":"2023-08-27T11:24:48.944271+0000","last_peered":"2023-08-27T11:24:48.944271+0000","last_clean":"2023-08-27T11:24:48.944271+0000","last_became_active":"2023-08-27T11:24:32.912708+0000","last_became_peered":"2023-08-27T11:24:32.912708+0000","last_unstale":"2023-08-27T11:24:48.944271+0000","last_undegraded":"2023-08-27T11:24:48.944271+0000","last_fullsized":"2023-08-27T11:24:48.944271+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:45:48.089310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945695+0000","last_change":"2023-08-27T11:24:47.016833+0000","last_active":"2023-08-27T11:24:48.945695+0000","last_peered":"2023-08-27T11:24:48.945695+0000","last_clean":"2023-08-27T11:24:48.945695+0000","last_became_active":"2023-08-27T11:24:47.016470+0000","last_became_peered":"2023-08-27T11:24:47.016470+0000","last_unstale":"2023-08-27T11:24:48.945695+0000","last_undegraded":"2023-08-27T11:24:48.945695+0000","last_fullsized":"2023-08-27T11:24:48.945695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:37:17.930997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245578+0000","last_change":"2023-08-27T11:24:32.287269+0000","last_active":"2023-08-27T11:24:49.245578+0000","last_peered":"2023-08-27T11:24:49.245578+0000","last_clean":"2023-08-27T11:24:49.245578+0000","last_became_active":"2023-08-27T11:24:32.286965+0000","last_became_peered":"2023-08-27T11:24:32.286965+0000","last_unstale":"2023-08-27T11:24:49.245578+0000","last_undegraded":"2023-08-27T11:24:49.245578+0000","last_fullsized":"2023-08-27T11:24:49.245578+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:53.556466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092721+0000","last_change":"2023-08-27T11:24:32.900978+0000","last_active":"2023-08-27T11:24:49.092721+0000","last_peered":"2023-08-27T11:24:49.092721+0000","last_clean":"2023-08-27T11:24:49.092721+0000","last_became_active":"2023-08-27T11:24:32.900695+0000","last_became_peered":"2023-08-27T11:24:32.900695+0000","last_unstale":"2023-08-27T11:24:49.092721+0000","last_undegraded":"2023-08-27T11:24:49.092721+0000","last_fullsized":"2023-08-27T11:24:49.092721+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:32.905139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"50'4","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001079+0000","last_change":"2023-08-27T11:24:47.016744+0000","last_active":"2023-08-27T11:24:49.001079+0000","last_peered":"2023-08-27T11:24:49.001079+0000","last_clean":"2023-08-27T11:24:49.001079+0000","last_became_active":"2023-08-27T11:24:47.016442+0000","last_became_peered":"2023-08-27T11:24:47.016442+0000","last_unstale":"2023-08-27T11:24:49.001079+0000","last_undegraded":"2023-08-27T11:24:49.001079+0000","last_fullsized":"2023-08-27T11:24:49.001079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:07.205563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245382+0000","last_change":"2023-08-27T11:24:47.905679+0000","last_active":"2023-08-27T11:24:49.245382+0000","last_peered":"2023-08-27T11:24:49.245382+0000","last_clean":"2023-08-27T11:24:49.245382+0000","last_became_active":"2023-08-27T11:24:47.905406+0000","last_became_peered":"2023-08-27T11:24:47.905406+0000","last_unstale":"2023-08-27T11:24:49.245382+0000","last_undegraded":"2023-08-27T11:24:49.245382+0000","last_fullsized":"2023-08-27T11:24:49.245382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:38.696066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247439+0000","last_change":"2023-08-27T11:24:47.909448+0000","last_active":"2023-08-27T11:24:49.247439+0000","last_peered":"2023-08-27T11:24:49.247439+0000","last_clean":"2023-08-27T11:24:49.247439+0000","last_became_active":"2023-08-27T11:24:47.909169+0000","last_became_peered":"2023-08-27T11:24:47.909169+0000","last_unstale":"2023-08-27T11:24:49.247439+0000","last_undegraded":"2023-08-27T11:24:49.247439+0000","last_fullsized":"2023-08-27T11:24:49.247439+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:07:11.726614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245176+0000","last_change":"2023-08-27T11:24:32.298695+0000","last_active":"2023-08-27T11:24:49.245176+0000","last_peered":"2023-08-27T11:24:49.245176+0000","last_clean":"2023-08-27T11:24:49.245176+0000","last_became_active":"2023-08-27T11:24:32.298396+0000","last_became_peered":"2023-08-27T11:24:32.298396+0000","last_unstale":"2023-08-27T11:24:49.245176+0000","last_undegraded":"2023-08-27T11:24:49.245176+0000","last_fullsized":"2023-08-27T11:24:49.245176+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:26.874176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945221+0000","last_change":"2023-08-27T11:24:32.908533+0000","last_active":"2023-08-27T11:24:48.945221+0000","last_peered":"2023-08-27T11:24:48.945221+0000","last_clean":"2023-08-27T11:24:48.945221+0000","last_became_active":"2023-08-27T11:24:32.908214+0000","last_became_peered":"2023-08-27T11:24:32.908214+0000","last_unstale":"2023-08-27T11:24:48.945221+0000","last_undegraded":"2023-08-27T11:24:48.945221+0000","last_fullsized":"2023-08-27T11:24:48.945221+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:39.181679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945088+0000","last_change":"2023-08-27T11:24:47.012692+0000","last_active":"2023-08-27T11:24:48.945088+0000","last_peered":"2023-08-27T11:24:48.945088+0000","last_clean":"2023-08-27T11:24:48.945088+0000","last_became_active":"2023-08-27T11:24:47.012401+0000","last_became_peered":"2023-08-27T11:24:47.012401+0000","last_unstale":"2023-08-27T11:24:48.945088+0000","last_undegraded":"2023-08-27T11:24:48.945088+0000","last_fullsized":"2023-08-27T11:24:48.945088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:30.303526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945388+0000","last_change":"2023-08-27T11:24:47.897560+0000","last_active":"2023-08-27T11:24:48.945388+0000","last_peered":"2023-08-27T11:24:48.945388+0000","last_clean":"2023-08-27T11:24:48.945388+0000","last_became_active":"2023-08-27T11:24:47.897275+0000","last_became_peered":"2023-08-27T11:24:47.897275+0000","last_unstale":"2023-08-27T11:24:48.945388+0000","last_undegraded":"2023-08-27T11:24:48.945388+0000","last_fullsized":"2023-08-27T11:24:48.945388+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:50.811976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945038+0000","last_change":"2023-08-27T11:24:32.292723+0000","last_active":"2023-08-27T11:24:48.945038+0000","last_peered":"2023-08-27T11:24:48.945038+0000","last_clean":"2023-08-27T11:24:48.945038+0000","last_became_active":"2023-08-27T11:24:32.292342+0000","last_became_peered":"2023-08-27T11:24:32.292342+0000","last_unstale":"2023-08-27T11:24:48.945038+0000","last_undegraded":"2023-08-27T11:24:48.945038+0000","last_fullsized":"2023-08-27T11:24:48.945038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:14:37.017576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886531+0000","last_change":"2023-08-27T11:24:32.906136+0000","last_active":"2023-08-27T11:24:48.886531+0000","last_peered":"2023-08-27T11:24:48.886531+0000","last_clean":"2023-08-27T11:24:48.886531+0000","last_became_active":"2023-08-27T11:24:32.905859+0000","last_became_peered":"2023-08-27T11:24:32.905859+0000","last_unstale":"2023-08-27T11:24:48.886531+0000","last_undegraded":"2023-08-27T11:24:48.886531+0000","last_fullsized":"2023-08-27T11:24:48.886531+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:36:02.861937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945446+0000","last_change":"2023-08-27T11:24:47.011982+0000","last_active":"2023-08-27T11:24:48.945446+0000","last_peered":"2023-08-27T11:24:48.945446+0000","last_clean":"2023-08-27T11:24:48.945446+0000","last_became_active":"2023-08-27T11:24:47.011379+0000","last_became_peered":"2023-08-27T11:24:47.011379+0000","last_unstale":"2023-08-27T11:24:48.945446+0000","last_undegraded":"2023-08-27T11:24:48.945446+0000","last_fullsized":"2023-08-27T11:24:48.945446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:13.738553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":27,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092572+0000","last_change":"2023-08-27T11:24:32.283014+0000","last_active":"2023-08-27T11:24:49.092572+0000","last_peered":"2023-08-27T11:24:49.092572+0000","last_clean":"2023-08-27T11:24:49.092572+0000","last_became_active":"2023-08-27T11:24:32.282692+0000","last_became_peered":"2023-08-27T11:24:32.282692+0000","last_unstale":"2023-08-27T11:24:49.092572+0000","last_undegraded":"2023-08-27T11:24:49.092572+0000","last_fullsized":"2023-08-27T11:24:49.092572+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:46.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885873+0000","last_change":"2023-08-27T11:24:32.909417+0000","last_active":"2023-08-27T11:24:48.885873+0000","last_peered":"2023-08-27T11:24:48.885873+0000","last_clean":"2023-08-27T11:24:48.885873+0000","last_became_active":"2023-08-27T11:24:32.908900+0000","last_became_peered":"2023-08-27T11:24:32.908900+0000","last_unstale":"2023-08-27T11:24:48.885873+0000","last_undegraded":"2023-08-27T11:24:48.885873+0000","last_fullsized":"2023-08-27T11:24:48.885873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:38:08.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092402+0000","last_change":"2023-08-27T11:24:47.003141+0000","last_active":"2023-08-27T11:24:49.092402+0000","last_peered":"2023-08-27T11:24:49.092402+0000","last_clean":"2023-08-27T11:24:49.092402+0000","last_became_active":"2023-08-27T11:24:47.002815+0000","last_became_peered":"2023-08-27T11:24:47.002815+0000","last_unstale":"2023-08-27T11:24:49.092402+0000","last_undegraded":"2023-08-27T11:24:49.092402+0000","last_fullsized":"2023-08-27T11:24:49.092402+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:37:17.930997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999923+0000","last_change":"2023-08-27T11:24:47.913875+0000","last_active":"2023-08-27T11:24:48.999923+0000","last_peered":"2023-08-27T11:24:48.999923+0000","last_clean":"2023-08-27T11:24:48.999923+0000","last_became_active":"2023-08-27T11:24:47.913505+0000","last_became_peered":"2023-08-27T11:24:47.913505+0000","last_unstale":"2023-08-27T11:24:48.999923+0000","last_undegraded":"2023-08-27T11:24:48.999923+0000","last_fullsized":"2023-08-27T11:24:48.999923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:08.294436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246910+0000","last_change":"2023-08-27T11:24:32.291485+0000","last_active":"2023-08-27T11:24:49.246910+0000","last_peered":"2023-08-27T11:24:49.246910+0000","last_clean":"2023-08-27T11:24:49.246910+0000","last_became_active":"2023-08-27T11:24:32.291149+0000","last_became_peered":"2023-08-27T11:24:32.291149+0000","last_unstale":"2023-08-27T11:24:49.246910+0000","last_undegraded":"2023-08-27T11:24:49.246910+0000","last_fullsized":"2023-08-27T11:24:49.246910+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:53.365934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944762+0000","last_change":"2023-08-27T11:24:32.905500+0000","last_active":"2023-08-27T11:24:48.944762+0000","last_peered":"2023-08-27T11:24:48.944762+0000","last_clean":"2023-08-27T11:24:48.944762+0000","last_became_active":"2023-08-27T11:24:32.905258+0000","last_became_peered":"2023-08-27T11:24:32.905258+0000","last_unstale":"2023-08-27T11:24:48.944762+0000","last_undegraded":"2023-08-27T11:24:48.944762+0000","last_fullsized":"2023-08-27T11:24:48.944762+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:08.615489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"50'1","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092472+0000","last_change":"2023-08-27T11:24:47.013982+0000","last_active":"2023-08-27T11:24:49.092472+0000","last_peered":"2023-08-27T11:24:49.092472+0000","last_clean":"2023-08-27T11:24:49.092472+0000","last_became_active":"2023-08-27T11:24:47.013680+0000","last_became_peered":"2023-08-27T11:24:47.013680+0000","last_unstale":"2023-08-27T11:24:49.092472+0000","last_undegraded":"2023-08-27T11:24:49.092472+0000","last_fullsized":"2023-08-27T11:24:49.092472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:18:23.255582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884965+0000","last_change":"2023-08-27T11:24:47.905311+0000","last_active":"2023-08-27T11:24:48.884965+0000","last_peered":"2023-08-27T11:24:48.884965+0000","last_clean":"2023-08-27T11:24:48.884965+0000","last_became_active":"2023-08-27T11:24:47.905014+0000","last_became_peered":"2023-08-27T11:24:47.905014+0000","last_unstale":"2023-08-27T11:24:48.884965+0000","last_undegraded":"2023-08-27T11:24:48.884965+0000","last_fullsized":"2023-08-27T11:24:48.884965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:34.411100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887497+0000","last_change":"2023-08-27T11:24:32.299429+0000","last_active":"2023-08-27T11:24:48.887497+0000","last_peered":"2023-08-27T11:24:48.887497+0000","last_clean":"2023-08-27T11:24:48.887497+0000","last_became_active":"2023-08-27T11:24:32.299132+0000","last_became_peered":"2023-08-27T11:24:32.299132+0000","last_unstale":"2023-08-27T11:24:48.887497+0000","last_undegraded":"2023-08-27T11:24:48.887497+0000","last_fullsized":"2023-08-27T11:24:48.887497+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:00:32.414723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885834+0000","last_change":"2023-08-27T11:24:32.909216+0000","last_active":"2023-08-27T11:24:48.885834+0000","last_peered":"2023-08-27T11:24:48.885834+0000","last_clean":"2023-08-27T11:24:48.885834+0000","last_became_active":"2023-08-27T11:24:32.908852+0000","last_became_peered":"2023-08-27T11:24:32.908852+0000","last_unstale":"2023-08-27T11:24:48.885834+0000","last_undegraded":"2023-08-27T11:24:48.885834+0000","last_fullsized":"2023-08-27T11:24:48.885834+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:12.997208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244927+0000","last_change":"2023-08-27T11:24:47.016633+0000","last_active":"2023-08-27T11:24:49.244927+0000","last_peered":"2023-08-27T11:24:49.244927+0000","last_clean":"2023-08-27T11:24:49.244927+0000","last_became_active":"2023-08-27T11:24:47.016296+0000","last_became_peered":"2023-08-27T11:24:47.016296+0000","last_unstale":"2023-08-27T11:24:49.244927+0000","last_undegraded":"2023-08-27T11:24:49.244927+0000","last_fullsized":"2023-08-27T11:24:49.244927+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:05.325518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092417+0000","last_change":"2023-08-27T11:24:47.892660+0000","last_active":"2023-08-27T11:24:49.092417+0000","last_peered":"2023-08-27T11:24:49.092417+0000","last_clean":"2023-08-27T11:24:49.092417+0000","last_became_active":"2023-08-27T11:24:47.892366+0000","last_became_peered":"2023-08-27T11:24:47.892366+0000","last_unstale":"2023-08-27T11:24:49.092417+0000","last_undegraded":"2023-08-27T11:24:49.092417+0000","last_fullsized":"2023-08-27T11:24:49.092417+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:57.307715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246991+0000","last_change":"2023-08-27T11:24:32.288640+0000","last_active":"2023-08-27T11:24:49.246991+0000","last_peered":"2023-08-27T11:24:49.246991+0000","last_clean":"2023-08-27T11:24:49.246991+0000","last_became_active":"2023-08-27T11:24:32.288294+0000","last_became_peered":"2023-08-27T11:24:32.288294+0000","last_unstale":"2023-08-27T11:24:49.246991+0000","last_undegraded":"2023-08-27T11:24:49.246991+0000","last_fullsized":"2023-08-27T11:24:49.246991+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:25.979914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885871+0000","last_change":"2023-08-27T11:24:32.901552+0000","last_active":"2023-08-27T11:24:48.885871+0000","last_peered":"2023-08-27T11:24:48.885871+0000","last_clean":"2023-08-27T11:24:48.885871+0000","last_became_active":"2023-08-27T11:24:32.901215+0000","last_became_peered":"2023-08-27T11:24:32.901215+0000","last_unstale":"2023-08-27T11:24:48.885871+0000","last_undegraded":"2023-08-27T11:24:48.885871+0000","last_fullsized":"2023-08-27T11:24:48.885871+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:46.013783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092150+0000","last_change":"2023-08-27T11:24:47.013634+0000","last_active":"2023-08-27T11:24:49.092150+0000","last_peered":"2023-08-27T11:24:49.092150+0000","last_clean":"2023-08-27T11:24:49.092150+0000","last_became_active":"2023-08-27T11:24:47.013298+0000","last_became_peered":"2023-08-27T11:24:47.013298+0000","last_unstale":"2023-08-27T11:24:49.092150+0000","last_undegraded":"2023-08-27T11:24:49.092150+0000","last_fullsized":"2023-08-27T11:24:49.092150+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:49.803890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246115+0000","last_change":"2023-08-27T11:24:47.907900+0000","last_active":"2023-08-27T11:24:49.246115+0000","last_peered":"2023-08-27T11:24:49.246115+0000","last_clean":"2023-08-27T11:24:49.246115+0000","last_became_active":"2023-08-27T11:24:47.907298+0000","last_became_peered":"2023-08-27T11:24:47.907298+0000","last_unstale":"2023-08-27T11:24:49.246115+0000","last_undegraded":"2023-08-27T11:24:49.246115+0000","last_fullsized":"2023-08-27T11:24:49.246115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:08.213648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944531+0000","last_change":"2023-08-27T11:24:32.298796+0000","last_active":"2023-08-27T11:24:48.944531+0000","last_peered":"2023-08-27T11:24:48.944531+0000","last_clean":"2023-08-27T11:24:48.944531+0000","last_became_active":"2023-08-27T11:24:32.298437+0000","last_became_peered":"2023-08-27T11:24:32.298437+0000","last_unstale":"2023-08-27T11:24:48.944531+0000","last_undegraded":"2023-08-27T11:24:48.944531+0000","last_fullsized":"2023-08-27T11:24:48.944531+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:42:00.835630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247360+0000","last_change":"2023-08-27T11:24:32.910118+0000","last_active":"2023-08-27T11:24:49.247360+0000","last_peered":"2023-08-27T11:24:49.247360+0000","last_clean":"2023-08-27T11:24:49.247360+0000","last_became_active":"2023-08-27T11:24:32.909727+0000","last_became_peered":"2023-08-27T11:24:32.909727+0000","last_unstale":"2023-08-27T11:24:49.247360+0000","last_undegraded":"2023-08-27T11:24:49.247360+0000","last_fullsized":"2023-08-27T11:24:49.247360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:14.792347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887390+0000","last_change":"2023-08-27T11:24:47.008957+0000","last_active":"2023-08-27T11:24:48.887390+0000","last_peered":"2023-08-27T11:24:48.887390+0000","last_clean":"2023-08-27T11:24:48.887390+0000","last_became_active":"2023-08-27T11:24:47.008637+0000","last_became_peered":"2023-08-27T11:24:47.008637+0000","last_unstale":"2023-08-27T11:24:48.887390+0000","last_undegraded":"2023-08-27T11:24:48.887390+0000","last_fullsized":"2023-08-27T11:24:48.887390+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:44.431525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092325+0000","last_change":"2023-08-27T11:24:47.894532+0000","last_active":"2023-08-27T11:24:49.092325+0000","last_peered":"2023-08-27T11:24:49.092325+0000","last_clean":"2023-08-27T11:24:49.092325+0000","last_became_active":"2023-08-27T11:24:47.894217+0000","last_became_peered":"2023-08-27T11:24:47.894217+0000","last_unstale":"2023-08-27T11:24:49.092325+0000","last_undegraded":"2023-08-27T11:24:49.092325+0000","last_fullsized":"2023-08-27T11:24:49.092325+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:31:15.659470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245420+0000","last_change":"2023-08-27T11:24:32.290256+0000","last_active":"2023-08-27T11:24:49.245420+0000","last_peered":"2023-08-27T11:24:49.245420+0000","last_clean":"2023-08-27T11:24:49.245420+0000","last_became_active":"2023-08-27T11:24:32.289480+0000","last_became_peered":"2023-08-27T11:24:32.289480+0000","last_unstale":"2023-08-27T11:24:49.245420+0000","last_undegraded":"2023-08-27T11:24:49.245420+0000","last_fullsized":"2023-08-27T11:24:49.245420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:58.767544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.091846+0000","last_change":"2023-08-27T11:24:32.884415+0000","last_active":"2023-08-27T11:24:49.091846+0000","last_peered":"2023-08-27T11:24:49.091846+0000","last_clean":"2023-08-27T11:24:49.091846+0000","last_became_active":"2023-08-27T11:24:32.884135+0000","last_became_peered":"2023-08-27T11:24:32.884135+0000","last_unstale":"2023-08-27T11:24:49.091846+0000","last_undegraded":"2023-08-27T11:24:49.091846+0000","last_fullsized":"2023-08-27T11:24:49.091846+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:16.593340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247238+0000","last_change":"2023-08-27T11:24:47.020268+0000","last_active":"2023-08-27T11:24:49.247238+0000","last_peered":"2023-08-27T11:24:49.247238+0000","last_clean":"2023-08-27T11:24:49.247238+0000","last_became_active":"2023-08-27T11:24:47.019798+0000","last_became_peered":"2023-08-27T11:24:47.019798+0000","last_unstale":"2023-08-27T11:24:49.247238+0000","last_undegraded":"2023-08-27T11:24:49.247238+0000","last_fullsized":"2023-08-27T11:24:49.247238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:44.330656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000560+0000","last_change":"2023-08-27T11:24:47.902928+0000","last_active":"2023-08-27T11:24:49.000560+0000","last_peered":"2023-08-27T11:24:49.000560+0000","last_clean":"2023-08-27T11:24:49.000560+0000","last_became_active":"2023-08-27T11:24:47.902538+0000","last_became_peered":"2023-08-27T11:24:47.902538+0000","last_unstale":"2023-08-27T11:24:49.000560+0000","last_undegraded":"2023-08-27T11:24:49.000560+0000","last_fullsized":"2023-08-27T11:24:49.000560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:42.598054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885877+0000","last_change":"2023-08-27T11:24:32.282892+0000","last_active":"2023-08-27T11:24:48.885877+0000","last_peered":"2023-08-27T11:24:48.885877+0000","last_clean":"2023-08-27T11:24:48.885877+0000","last_became_active":"2023-08-27T11:24:32.282592+0000","last_became_peered":"2023-08-27T11:24:32.282592+0000","last_unstale":"2023-08-27T11:24:48.885877+0000","last_undegraded":"2023-08-27T11:24:48.885877+0000","last_fullsized":"2023-08-27T11:24:48.885877+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:12:58.267488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247340+0000","last_change":"2023-08-27T11:24:32.904723+0000","last_active":"2023-08-27T11:24:49.247340+0000","last_peered":"2023-08-27T11:24:49.247340+0000","last_clean":"2023-08-27T11:24:49.247340+0000","last_became_active":"2023-08-27T11:24:32.904416+0000","last_became_peered":"2023-08-27T11:24:32.904416+0000","last_unstale":"2023-08-27T11:24:49.247340+0000","last_undegraded":"2023-08-27T11:24:49.247340+0000","last_fullsized":"2023-08-27T11:24:49.247340+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:44.210007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"50'6","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000739+0000","last_change":"2023-08-27T11:24:47.015021+0000","last_active":"2023-08-27T11:24:49.000739+0000","last_peered":"2023-08-27T11:24:49.000739+0000","last_clean":"2023-08-27T11:24:49.000739+0000","last_became_active":"2023-08-27T11:24:47.014658+0000","last_became_peered":"2023-08-27T11:24:47.014658+0000","last_unstale":"2023-08-27T11:24:49.000739+0000","last_undegraded":"2023-08-27T11:24:49.000739+0000","last_fullsized":"2023-08-27T11:24:49.000739+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:41.250666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887138+0000","last_change":"2023-08-27T11:24:47.898368+0000","last_active":"2023-08-27T11:24:48.887138+0000","last_peered":"2023-08-27T11:24:48.887138+0000","last_clean":"2023-08-27T11:24:48.887138+0000","last_became_active":"2023-08-27T11:24:47.898051+0000","last_became_peered":"2023-08-27T11:24:47.898051+0000","last_unstale":"2023-08-27T11:24:48.887138+0000","last_undegraded":"2023-08-27T11:24:48.887138+0000","last_fullsized":"2023-08-27T11:24:48.887138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:17.928294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945025+0000","last_change":"2023-08-27T11:24:32.298886+0000","last_active":"2023-08-27T11:24:48.945025+0000","last_peered":"2023-08-27T11:24:48.945025+0000","last_clean":"2023-08-27T11:24:48.945025+0000","last_became_active":"2023-08-27T11:24:32.298269+0000","last_became_peered":"2023-08-27T11:24:32.298269+0000","last_unstale":"2023-08-27T11:24:48.945025+0000","last_undegraded":"2023-08-27T11:24:48.945025+0000","last_fullsized":"2023-08-27T11:24:48.945025+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:15.360890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887671+0000","last_change":"2023-08-27T11:24:32.910605+0000","last_active":"2023-08-27T11:24:48.887671+0000","last_peered":"2023-08-27T11:24:48.887671+0000","last_clean":"2023-08-27T11:24:48.887671+0000","last_became_active":"2023-08-27T11:24:32.910330+0000","last_became_peered":"2023-08-27T11:24:32.910330+0000","last_unstale":"2023-08-27T11:24:48.887671+0000","last_undegraded":"2023-08-27T11:24:48.887671+0000","last_fullsized":"2023-08-27T11:24:48.887671+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:15:50.087109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"50'3","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246781+0000","last_change":"2023-08-27T11:24:47.021071+0000","last_active":"2023-08-27T11:24:49.246781+0000","last_peered":"2023-08-27T11:24:49.246781+0000","last_clean":"2023-08-27T11:24:49.246781+0000","last_became_active":"2023-08-27T11:24:47.020702+0000","last_became_peered":"2023-08-27T11:24:47.020702+0000","last_unstale":"2023-08-27T11:24:49.246781+0000","last_undegraded":"2023-08-27T11:24:49.246781+0000","last_fullsized":"2023-08-27T11:24:49.246781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:22.968979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246842+0000","last_change":"2023-08-27T11:24:47.904224+0000","last_active":"2023-08-27T11:24:49.246842+0000","last_peered":"2023-08-27T11:24:49.246842+0000","last_clean":"2023-08-27T11:24:49.246842+0000","last_became_active":"2023-08-27T11:24:47.903819+0000","last_became_peered":"2023-08-27T11:24:47.903819+0000","last_unstale":"2023-08-27T11:24:49.246842+0000","last_undegraded":"2023-08-27T11:24:49.246842+0000","last_fullsized":"2023-08-27T11:24:49.246842+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:22.403683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886632+0000","last_change":"2023-08-27T11:24:32.294367+0000","last_active":"2023-08-27T11:24:48.886632+0000","last_peered":"2023-08-27T11:24:48.886632+0000","last_clean":"2023-08-27T11:24:48.886632+0000","last_became_active":"2023-08-27T11:24:32.294063+0000","last_became_peered":"2023-08-27T11:24:32.294063+0000","last_unstale":"2023-08-27T11:24:48.886632+0000","last_undegraded":"2023-08-27T11:24:48.886632+0000","last_fullsized":"2023-08-27T11:24:48.886632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:10:06.925770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092194+0000","last_change":"2023-08-27T11:24:32.883656+0000","last_active":"2023-08-27T11:24:49.092194+0000","last_peered":"2023-08-27T11:24:49.092194+0000","last_clean":"2023-08-27T11:24:49.092194+0000","last_became_active":"2023-08-27T11:24:32.883338+0000","last_became_peered":"2023-08-27T11:24:32.883338+0000","last_unstale":"2023-08-27T11:24:49.092194+0000","last_undegraded":"2023-08-27T11:24:49.092194+0000","last_fullsized":"2023-08-27T11:24:49.092194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:00.028368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886597+0000","last_change":"2023-08-27T11:24:47.012447+0000","last_active":"2023-08-27T11:24:48.886597+0000","last_peered":"2023-08-27T11:24:48.886597+0000","last_clean":"2023-08-27T11:24:48.886597+0000","last_became_active":"2023-08-27T11:24:47.011969+0000","last_became_peered":"2023-08-27T11:24:47.011969+0000","last_unstale":"2023-08-27T11:24:48.886597+0000","last_undegraded":"2023-08-27T11:24:48.886597+0000","last_fullsized":"2023-08-27T11:24:48.886597+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:13:45.412522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885434+0000","last_change":"2023-08-27T11:24:47.898780+0000","last_active":"2023-08-27T11:24:48.885434+0000","last_peered":"2023-08-27T11:24:48.885434+0000","last_clean":"2023-08-27T11:24:48.885434+0000","last_became_active":"2023-08-27T11:24:47.898425+0000","last_became_peered":"2023-08-27T11:24:47.898425+0000","last_unstale":"2023-08-27T11:24:48.885434+0000","last_undegraded":"2023-08-27T11:24:48.885434+0000","last_fullsized":"2023-08-27T11:24:48.885434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:27.046288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000643+0000","last_change":"2023-08-27T11:24:32.289666+0000","last_active":"2023-08-27T11:24:49.000643+0000","last_peered":"2023-08-27T11:24:49.000643+0000","last_clean":"2023-08-27T11:24:49.000643+0000","last_became_active":"2023-08-27T11:24:32.289236+0000","last_became_peered":"2023-08-27T11:24:32.289236+0000","last_unstale":"2023-08-27T11:24:49.000643+0000","last_undegraded":"2023-08-27T11:24:49.000643+0000","last_fullsized":"2023-08-27T11:24:49.000643+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:35.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245806+0000","last_change":"2023-08-27T11:24:32.902261+0000","last_active":"2023-08-27T11:24:49.245806+0000","last_peered":"2023-08-27T11:24:49.245806+0000","last_clean":"2023-08-27T11:24:49.245806+0000","last_became_active":"2023-08-27T11:24:32.901957+0000","last_became_peered":"2023-08-27T11:24:32.901957+0000","last_unstale":"2023-08-27T11:24:49.245806+0000","last_undegraded":"2023-08-27T11:24:49.245806+0000","last_fullsized":"2023-08-27T11:24:49.245806+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:48.185155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"50'2","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246426+0000","last_change":"2023-08-27T11:24:47.019976+0000","last_active":"2023-08-27T11:24:49.246426+0000","last_peered":"2023-08-27T11:24:49.246426+0000","last_clean":"2023-08-27T11:24:49.246426+0000","last_became_active":"2023-08-27T11:24:47.019494+0000","last_became_peered":"2023-08-27T11:24:47.019494+0000","last_unstale":"2023-08-27T11:24:49.246426+0000","last_undegraded":"2023-08-27T11:24:49.246426+0000","last_fullsized":"2023-08-27T11:24:49.246426+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:31:03.228153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886080+0000","last_change":"2023-08-27T11:24:47.908924+0000","last_active":"2023-08-27T11:24:48.886080+0000","last_peered":"2023-08-27T11:24:48.886080+0000","last_clean":"2023-08-27T11:24:48.886080+0000","last_became_active":"2023-08-27T11:24:47.908614+0000","last_became_peered":"2023-08-27T11:24:47.908614+0000","last_unstale":"2023-08-27T11:24:48.886080+0000","last_undegraded":"2023-08-27T11:24:48.886080+0000","last_fullsized":"2023-08-27T11:24:48.886080+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:13:46.420607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000891+0000","last_change":"2023-08-27T11:24:32.294572+0000","last_active":"2023-08-27T11:24:49.000891+0000","last_peered":"2023-08-27T11:24:49.000891+0000","last_clean":"2023-08-27T11:24:49.000891+0000","last_became_active":"2023-08-27T11:24:32.294253+0000","last_became_peered":"2023-08-27T11:24:32.294253+0000","last_unstale":"2023-08-27T11:24:49.000891+0000","last_undegraded":"2023-08-27T11:24:49.000891+0000","last_fullsized":"2023-08-27T11:24:49.000891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:32.625681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886046+0000","last_change":"2023-08-27T11:24:32.907402+0000","last_active":"2023-08-27T11:24:48.886046+0000","last_peered":"2023-08-27T11:24:48.886046+0000","last_clean":"2023-08-27T11:24:48.886046+0000","last_became_active":"2023-08-27T11:24:32.907043+0000","last_became_peered":"2023-08-27T11:24:32.907043+0000","last_unstale":"2023-08-27T11:24:48.886046+0000","last_undegraded":"2023-08-27T11:24:48.886046+0000","last_fullsized":"2023-08-27T11:24:48.886046+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:38.694285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"50'8","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885656+0000","last_change":"2023-08-27T11:24:47.012361+0000","last_active":"2023-08-27T11:24:48.885656+0000","last_peered":"2023-08-27T11:24:48.885656+0000","last_clean":"2023-08-27T11:24:48.885656+0000","last_became_active":"2023-08-27T11:24:47.012023+0000","last_became_peered":"2023-08-27T11:24:47.012023+0000","last_unstale":"2023-08-27T11:24:48.885656+0000","last_undegraded":"2023-08-27T11:24:48.885656+0000","last_fullsized":"2023-08-27T11:24:48.885656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:20.049151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000340+0000","last_change":"2023-08-27T11:24:47.904203+0000","last_active":"2023-08-27T11:24:49.000340+0000","last_peered":"2023-08-27T11:24:49.000340+0000","last_clean":"2023-08-27T11:24:49.000340+0000","last_became_active":"2023-08-27T11:24:47.902628+0000","last_became_peered":"2023-08-27T11:24:47.902628+0000","last_unstale":"2023-08-27T11:24:49.000340+0000","last_undegraded":"2023-08-27T11:24:49.000340+0000","last_fullsized":"2023-08-27T11:24:49.000340+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:29.036443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":25,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246816+0000","last_change":"2023-08-27T11:24:32.282881+0000","last_active":"2023-08-27T11:24:49.246816+0000","last_peered":"2023-08-27T11:24:49.246816+0000","last_clean":"2023-08-27T11:24:49.246816+0000","last_became_active":"2023-08-27T11:24:32.282586+0000","last_became_peered":"2023-08-27T11:24:32.282586+0000","last_unstale":"2023-08-27T11:24:49.246816+0000","last_undegraded":"2023-08-27T11:24:49.246816+0000","last_fullsized":"2023-08-27T11:24:49.246816+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:31.256227+0000","last_clean_scrub_stamp":"2023-08-27T11:24:31.256227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:31.154008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244462+0000","last_change":"2023-08-27T11:24:32.898642+0000","last_active":"2023-08-27T11:24:49.244462+0000","last_peered":"2023-08-27T11:24:49.244462+0000","last_clean":"2023-08-27T11:24:49.244462+0000","last_became_active":"2023-08-27T11:24:32.898270+0000","last_became_peered":"2023-08-27T11:24:32.898270+0000","last_unstale":"2023-08-27T11:24:49.244462+0000","last_undegraded":"2023-08-27T11:24:49.244462+0000","last_fullsized":"2023-08-27T11:24:49.244462+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:10.378391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246013+0000","last_change":"2023-08-27T11:24:47.016445+0000","last_active":"2023-08-27T11:24:49.246013+0000","last_peered":"2023-08-27T11:24:49.246013+0000","last_clean":"2023-08-27T11:24:49.246013+0000","last_became_active":"2023-08-27T11:24:47.016101+0000","last_became_peered":"2023-08-27T11:24:47.016101+0000","last_unstale":"2023-08-27T11:24:49.246013+0000","last_undegraded":"2023-08-27T11:24:49.246013+0000","last_fullsized":"2023-08-27T11:24:49.246013+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:45.972020+0000","last_clean_scrub_stamp":"2023-08-27T11:24:45.972020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:52:00.207779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246183+0000","last_change":"2023-08-27T11:24:47.907682+0000","last_active":"2023-08-27T11:24:49.246183+0000","last_peered":"2023-08-27T11:24:49.246183+0000","last_clean":"2023-08-27T11:24:49.246183+0000","last_became_active":"2023-08-27T11:24:47.906821+0000","last_became_peered":"2023-08-27T11:24:47.906821+0000","last_unstale":"2023-08-27T11:24:49.246183+0000","last_undegraded":"2023-08-27T11:24:49.246183+0000","last_fullsized":"2023-08-27T11:24:49.246183+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:06.668299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886384+0000","last_change":"2023-08-27T11:24:47.910317+0000","last_active":"2023-08-27T11:24:48.886384+0000","last_peered":"2023-08-27T11:24:48.886384+0000","last_clean":"2023-08-27T11:24:48.886384+0000","last_became_active":"2023-08-27T11:24:47.910020+0000","last_became_peered":"2023-08-27T11:24:47.910020+0000","last_unstale":"2023-08-27T11:24:48.886384+0000","last_undegraded":"2023-08-27T11:24:48.886384+0000","last_fullsized":"2023-08-27T11:24:48.886384+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:17.158711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885894+0000","last_change":"2023-08-27T11:24:32.900379+0000","last_active":"2023-08-27T11:24:48.885894+0000","last_peered":"2023-08-27T11:24:48.885894+0000","last_clean":"2023-08-27T11:24:48.885894+0000","last_became_active":"2023-08-27T11:24:32.899692+0000","last_became_peered":"2023-08-27T11:24:32.899692+0000","last_unstale":"2023-08-27T11:24:48.885894+0000","last_undegraded":"2023-08-27T11:24:48.885894+0000","last_fullsized":"2023-08-27T11:24:48.885894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:00.082236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246284+0000","last_change":"2023-08-27T11:24:47.917197+0000","last_active":"2023-08-27T11:24:49.246284+0000","last_peered":"2023-08-27T11:24:49.246284+0000","last_clean":"2023-08-27T11:24:49.246284+0000","last_became_active":"2023-08-27T11:24:47.916869+0000","last_became_peered":"2023-08-27T11:24:47.916869+0000","last_unstale":"2023-08-27T11:24:49.246284+0000","last_undegraded":"2023-08-27T11:24:49.246284+0000","last_fullsized":"2023-08-27T11:24:49.246284+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:02.281287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944051+0000","last_change":"2023-08-27T11:24:32.907054+0000","last_active":"2023-08-27T11:24:48.944051+0000","last_peered":"2023-08-27T11:24:48.944051+0000","last_clean":"2023-08-27T11:24:48.944051+0000","last_became_active":"2023-08-27T11:24:32.906207+0000","last_became_peered":"2023-08-27T11:24:32.906207+0000","last_unstale":"2023-08-27T11:24:48.944051+0000","last_undegraded":"2023-08-27T11:24:48.944051+0000","last_fullsized":"2023-08-27T11:24:48.944051+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:39:02.849881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944509+0000","last_change":"2023-08-27T11:24:47.896246+0000","last_active":"2023-08-27T11:24:48.944509+0000","last_peered":"2023-08-27T11:24:48.944509+0000","last_clean":"2023-08-27T11:24:48.944509+0000","last_became_active":"2023-08-27T11:24:47.895966+0000","last_became_peered":"2023-08-27T11:24:47.895966+0000","last_unstale":"2023-08-27T11:24:48.944509+0000","last_undegraded":"2023-08-27T11:24:48.944509+0000","last_fullsized":"2023-08-27T11:24:48.944509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:49.494556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245533+0000","last_change":"2023-08-27T11:24:32.900476+0000","last_active":"2023-08-27T11:24:49.245533+0000","last_peered":"2023-08-27T11:24:49.245533+0000","last_clean":"2023-08-27T11:24:49.245533+0000","last_became_active":"2023-08-27T11:24:32.900121+0000","last_became_peered":"2023-08-27T11:24:32.900121+0000","last_unstale":"2023-08-27T11:24:49.245533+0000","last_undegraded":"2023-08-27T11:24:49.245533+0000","last_fullsized":"2023-08-27T11:24:49.245533+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:42.589444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885785+0000","last_change":"2023-08-27T11:24:47.899025+0000","last_active":"2023-08-27T11:24:48.885785+0000","last_peered":"2023-08-27T11:24:48.885785+0000","last_clean":"2023-08-27T11:24:48.885785+0000","last_became_active":"2023-08-27T11:24:47.898740+0000","last_became_peered":"2023-08-27T11:24:47.898740+0000","last_unstale":"2023-08-27T11:24:48.885785+0000","last_undegraded":"2023-08-27T11:24:48.885785+0000","last_fullsized":"2023-08-27T11:24:48.885785+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:33:14.726906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944871+0000","last_change":"2023-08-27T11:24:32.905940+0000","last_active":"2023-08-27T11:24:48.944871+0000","last_peered":"2023-08-27T11:24:48.944871+0000","last_clean":"2023-08-27T11:24:48.944871+0000","last_became_active":"2023-08-27T11:24:32.904461+0000","last_became_peered":"2023-08-27T11:24:32.904461+0000","last_unstale":"2023-08-27T11:24:48.944871+0000","last_undegraded":"2023-08-27T11:24:48.944871+0000","last_fullsized":"2023-08-27T11:24:48.944871+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:53.010766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887429+0000","last_change":"2023-08-27T11:24:47.897224+0000","last_active":"2023-08-27T11:24:48.887429+0000","last_peered":"2023-08-27T11:24:48.887429+0000","last_clean":"2023-08-27T11:24:48.887429+0000","last_became_active":"2023-08-27T11:24:47.896884+0000","last_became_peered":"2023-08-27T11:24:47.896884+0000","last_unstale":"2023-08-27T11:24:48.887429+0000","last_undegraded":"2023-08-27T11:24:48.887429+0000","last_fullsized":"2023-08-27T11:24:48.887429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:33:14.726906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244446+0000","last_change":"2023-08-27T11:24:32.893599+0000","last_active":"2023-08-27T11:24:49.244446+0000","last_peered":"2023-08-27T11:24:49.244446+0000","last_clean":"2023-08-27T11:24:49.244446+0000","last_became_active":"2023-08-27T11:24:32.893201+0000","last_became_peered":"2023-08-27T11:24:32.893201+0000","last_unstale":"2023-08-27T11:24:49.244446+0000","last_undegraded":"2023-08-27T11:24:49.244446+0000","last_fullsized":"2023-08-27T11:24:49.244446+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:49.110009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886584+0000","last_change":"2023-08-27T11:24:47.897788+0000","last_active":"2023-08-27T11:24:48.886584+0000","last_peered":"2023-08-27T11:24:48.886584+0000","last_clean":"2023-08-27T11:24:48.886584+0000","last_became_active":"2023-08-27T11:24:47.897484+0000","last_became_peered":"2023-08-27T11:24:47.897484+0000","last_unstale":"2023-08-27T11:24:48.886584+0000","last_undegraded":"2023-08-27T11:24:48.886584+0000","last_fullsized":"2023-08-27T11:24:48.886584+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:38:23.463007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000797+0000","last_change":"2023-08-27T11:24:32.909695+0000","last_active":"2023-08-27T11:24:49.000797+0000","last_peered":"2023-08-27T11:24:49.000797+0000","last_clean":"2023-08-27T11:24:49.000797+0000","last_became_active":"2023-08-27T11:24:32.909365+0000","last_became_peered":"2023-08-27T11:24:32.909365+0000","last_unstale":"2023-08-27T11:24:49.000797+0000","last_undegraded":"2023-08-27T11:24:49.000797+0000","last_fullsized":"2023-08-27T11:24:49.000797+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:10.808056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000547+0000","last_change":"2023-08-27T11:24:47.907773+0000","last_active":"2023-08-27T11:24:49.000547+0000","last_peered":"2023-08-27T11:24:49.000547+0000","last_clean":"2023-08-27T11:24:49.000547+0000","last_became_active":"2023-08-27T11:24:47.907495+0000","last_became_peered":"2023-08-27T11:24:47.907495+0000","last_unstale":"2023-08-27T11:24:49.000547+0000","last_undegraded":"2023-08-27T11:24:49.000547+0000","last_fullsized":"2023-08-27T11:24:49.000547+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:06.333603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092832+0000","last_change":"2023-08-27T11:24:32.883832+0000","last_active":"2023-08-27T11:24:49.092832+0000","last_peered":"2023-08-27T11:24:49.092832+0000","last_clean":"2023-08-27T11:24:49.092832+0000","last_became_active":"2023-08-27T11:24:32.883350+0000","last_became_peered":"2023-08-27T11:24:32.883350+0000","last_unstale":"2023-08-27T11:24:49.092832+0000","last_undegraded":"2023-08-27T11:24:49.092832+0000","last_fullsized":"2023-08-27T11:24:49.092832+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:16.256481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887375+0000","last_change":"2023-08-27T11:24:47.897699+0000","last_active":"2023-08-27T11:24:48.887375+0000","last_peered":"2023-08-27T11:24:48.887375+0000","last_clean":"2023-08-27T11:24:48.887375+0000","last_became_active":"2023-08-27T11:24:47.897419+0000","last_became_peered":"2023-08-27T11:24:47.897419+0000","last_unstale":"2023-08-27T11:24:48.887375+0000","last_undegraded":"2023-08-27T11:24:48.887375+0000","last_fullsized":"2023-08-27T11:24:48.887375+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:04.914096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.945521+0000","last_change":"2023-08-27T11:24:32.911479+0000","last_active":"2023-08-27T11:24:48.945521+0000","last_peered":"2023-08-27T11:24:48.945521+0000","last_clean":"2023-08-27T11:24:48.945521+0000","last_became_active":"2023-08-27T11:24:32.909452+0000","last_became_peered":"2023-08-27T11:24:32.909452+0000","last_unstale":"2023-08-27T11:24:48.945521+0000","last_undegraded":"2023-08-27T11:24:48.945521+0000","last_fullsized":"2023-08-27T11:24:48.945521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:10.378391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092098+0000","last_change":"2023-08-27T11:24:47.908360+0000","last_active":"2023-08-27T11:24:49.092098+0000","last_peered":"2023-08-27T11:24:49.092098+0000","last_clean":"2023-08-27T11:24:49.092098+0000","last_became_active":"2023-08-27T11:24:47.908044+0000","last_became_peered":"2023-08-27T11:24:47.908044+0000","last_unstale":"2023-08-27T11:24:49.092098+0000","last_undegraded":"2023-08-27T11:24:49.092098+0000","last_fullsized":"2023-08-27T11:24:49.092098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:53.899950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944050+0000","last_change":"2023-08-27T11:24:32.905733+0000","last_active":"2023-08-27T11:24:48.944050+0000","last_peered":"2023-08-27T11:24:48.944050+0000","last_clean":"2023-08-27T11:24:48.944050+0000","last_became_active":"2023-08-27T11:24:32.905472+0000","last_became_peered":"2023-08-27T11:24:32.905472+0000","last_unstale":"2023-08-27T11:24:48.944050+0000","last_undegraded":"2023-08-27T11:24:48.944050+0000","last_fullsized":"2023-08-27T11:24:48.944050+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:00.952370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886115+0000","last_change":"2023-08-27T11:24:47.903647+0000","last_active":"2023-08-27T11:24:48.886115+0000","last_peered":"2023-08-27T11:24:48.886115+0000","last_clean":"2023-08-27T11:24:48.886115+0000","last_became_active":"2023-08-27T11:24:47.903207+0000","last_became_peered":"2023-08-27T11:24:47.903207+0000","last_unstale":"2023-08-27T11:24:48.886115+0000","last_undegraded":"2023-08-27T11:24:48.886115+0000","last_fullsized":"2023-08-27T11:24:48.886115+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:21.057236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884485+0000","last_change":"2023-08-27T11:24:32.902996+0000","last_active":"2023-08-27T11:24:48.884485+0000","last_peered":"2023-08-27T11:24:48.884485+0000","last_clean":"2023-08-27T11:24:48.884485+0000","last_became_active":"2023-08-27T11:24:32.902692+0000","last_became_peered":"2023-08-27T11:24:32.902692+0000","last_unstale":"2023-08-27T11:24:48.884485+0000","last_undegraded":"2023-08-27T11:24:48.884485+0000","last_fullsized":"2023-08-27T11:24:48.884485+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:56.957791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246357+0000","last_change":"2023-08-27T11:24:47.906910+0000","last_active":"2023-08-27T11:24:49.246357+0000","last_peered":"2023-08-27T11:24:49.246357+0000","last_clean":"2023-08-27T11:24:49.246357+0000","last_became_active":"2023-08-27T11:24:47.906629+0000","last_became_peered":"2023-08-27T11:24:47.906629+0000","last_unstale":"2023-08-27T11:24:49.246357+0000","last_undegraded":"2023-08-27T11:24:49.246357+0000","last_fullsized":"2023-08-27T11:24:49.246357+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:30.795267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092196+0000","last_change":"2023-08-27T11:24:32.906541+0000","last_active":"2023-08-27T11:24:49.092196+0000","last_peered":"2023-08-27T11:24:49.092196+0000","last_clean":"2023-08-27T11:24:49.092196+0000","last_became_active":"2023-08-27T11:24:32.906237+0000","last_became_peered":"2023-08-27T11:24:32.906237+0000","last_unstale":"2023-08-27T11:24:49.092196+0000","last_undegraded":"2023-08-27T11:24:49.092196+0000","last_fullsized":"2023-08-27T11:24:49.092196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:54:29.360643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092089+0000","last_change":"2023-08-27T11:24:47.910014+0000","last_active":"2023-08-27T11:24:49.092089+0000","last_peered":"2023-08-27T11:24:49.092089+0000","last_clean":"2023-08-27T11:24:49.092089+0000","last_became_active":"2023-08-27T11:24:47.909740+0000","last_became_peered":"2023-08-27T11:24:47.909740+0000","last_unstale":"2023-08-27T11:24:49.092089+0000","last_undegraded":"2023-08-27T11:24:49.092089+0000","last_fullsized":"2023-08-27T11:24:49.092089+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:50.615035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245463+0000","last_change":"2023-08-27T11:24:32.900837+0000","last_active":"2023-08-27T11:24:49.245463+0000","last_peered":"2023-08-27T11:24:49.245463+0000","last_clean":"2023-08-27T11:24:49.245463+0000","last_became_active":"2023-08-27T11:24:32.900383+0000","last_became_peered":"2023-08-27T11:24:32.900383+0000","last_unstale":"2023-08-27T11:24:49.245463+0000","last_undegraded":"2023-08-27T11:24:49.245463+0000","last_fullsized":"2023-08-27T11:24:49.245463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:10.808056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886962+0000","last_change":"2023-08-27T11:24:47.898333+0000","last_active":"2023-08-27T11:24:48.886962+0000","last_peered":"2023-08-27T11:24:48.886962+0000","last_clean":"2023-08-27T11:24:48.886962+0000","last_became_active":"2023-08-27T11:24:47.898030+0000","last_became_peered":"2023-08-27T11:24:47.898030+0000","last_unstale":"2023-08-27T11:24:48.886962+0000","last_undegraded":"2023-08-27T11:24:48.886962+0000","last_fullsized":"2023-08-27T11:24:48.886962+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:05.774085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244437+0000","last_change":"2023-08-27T11:24:32.903525+0000","last_active":"2023-08-27T11:24:49.244437+0000","last_peered":"2023-08-27T11:24:49.244437+0000","last_clean":"2023-08-27T11:24:49.244437+0000","last_became_active":"2023-08-27T11:24:32.903193+0000","last_became_peered":"2023-08-27T11:24:32.903193+0000","last_unstale":"2023-08-27T11:24:49.244437+0000","last_undegraded":"2023-08-27T11:24:49.244437+0000","last_fullsized":"2023-08-27T11:24:49.244437+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:18:49.392158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001174+0000","last_change":"2023-08-27T11:24:47.913850+0000","last_active":"2023-08-27T11:24:49.001174+0000","last_peered":"2023-08-27T11:24:49.001174+0000","last_clean":"2023-08-27T11:24:49.001174+0000","last_became_active":"2023-08-27T11:24:47.913508+0000","last_became_peered":"2023-08-27T11:24:47.913508+0000","last_unstale":"2023-08-27T11:24:49.001174+0000","last_undegraded":"2023-08-27T11:24:49.001174+0000","last_fullsized":"2023-08-27T11:24:49.001174+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:06.668299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944170+0000","last_change":"2023-08-27T11:24:32.912893+0000","last_active":"2023-08-27T11:24:48.944170+0000","last_peered":"2023-08-27T11:24:48.944170+0000","last_clean":"2023-08-27T11:24:48.944170+0000","last_became_active":"2023-08-27T11:24:32.912575+0000","last_became_peered":"2023-08-27T11:24:32.912575+0000","last_unstale":"2023-08-27T11:24:48.944170+0000","last_undegraded":"2023-08-27T11:24:48.944170+0000","last_fullsized":"2023-08-27T11:24:48.944170+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:07.765024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092246+0000","last_change":"2023-08-27T11:24:47.903582+0000","last_active":"2023-08-27T11:24:49.092246+0000","last_peered":"2023-08-27T11:24:49.092246+0000","last_clean":"2023-08-27T11:24:49.092246+0000","last_became_active":"2023-08-27T11:24:47.903303+0000","last_became_peered":"2023-08-27T11:24:47.903303+0000","last_unstale":"2023-08-27T11:24:49.092246+0000","last_undegraded":"2023-08-27T11:24:49.092246+0000","last_fullsized":"2023-08-27T11:24:49.092246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:25.096662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244755+0000","last_change":"2023-08-27T11:24:32.905710+0000","last_active":"2023-08-27T11:24:49.244755+0000","last_peered":"2023-08-27T11:24:49.244755+0000","last_clean":"2023-08-27T11:24:49.244755+0000","last_became_active":"2023-08-27T11:24:32.905225+0000","last_became_peered":"2023-08-27T11:24:32.905225+0000","last_unstale":"2023-08-27T11:24:49.244755+0000","last_undegraded":"2023-08-27T11:24:49.244755+0000","last_fullsized":"2023-08-27T11:24:49.244755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:58.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246358+0000","last_change":"2023-08-27T11:24:47.905323+0000","last_active":"2023-08-27T11:24:49.246358+0000","last_peered":"2023-08-27T11:24:49.246358+0000","last_clean":"2023-08-27T11:24:49.246358+0000","last_became_active":"2023-08-27T11:24:47.904973+0000","last_became_peered":"2023-08-27T11:24:47.904973+0000","last_unstale":"2023-08-27T11:24:49.246358+0000","last_undegraded":"2023-08-27T11:24:49.246358+0000","last_fullsized":"2023-08-27T11:24:49.246358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:22.421790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944257+0000","last_change":"2023-08-27T11:24:32.913021+0000","last_active":"2023-08-27T11:24:48.944257+0000","last_peered":"2023-08-27T11:24:48.944257+0000","last_clean":"2023-08-27T11:24:48.944257+0000","last_became_active":"2023-08-27T11:24:32.912510+0000","last_became_peered":"2023-08-27T11:24:32.912510+0000","last_unstale":"2023-08-27T11:24:48.944257+0000","last_undegraded":"2023-08-27T11:24:48.944257+0000","last_fullsized":"2023-08-27T11:24:48.944257+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:28.772750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246096+0000","last_change":"2023-08-27T11:24:47.910018+0000","last_active":"2023-08-27T11:24:49.246096+0000","last_peered":"2023-08-27T11:24:49.246096+0000","last_clean":"2023-08-27T11:24:49.246096+0000","last_became_active":"2023-08-27T11:24:47.909209+0000","last_became_peered":"2023-08-27T11:24:47.909209+0000","last_unstale":"2023-08-27T11:24:49.246096+0000","last_undegraded":"2023-08-27T11:24:49.246096+0000","last_fullsized":"2023-08-27T11:24:49.246096+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:46.939298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999635+0000","last_change":"2023-08-27T11:24:32.902464+0000","last_active":"2023-08-27T11:24:48.999635+0000","last_peered":"2023-08-27T11:24:48.999635+0000","last_clean":"2023-08-27T11:24:48.999635+0000","last_became_active":"2023-08-27T11:24:32.902171+0000","last_became_peered":"2023-08-27T11:24:32.902171+0000","last_unstale":"2023-08-27T11:24:48.999635+0000","last_undegraded":"2023-08-27T11:24:48.999635+0000","last_fullsized":"2023-08-27T11:24:48.999635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:24:32.931026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.885993+0000","last_change":"2023-08-27T11:24:47.900678+0000","last_active":"2023-08-27T11:24:48.885993+0000","last_peered":"2023-08-27T11:24:48.885993+0000","last_clean":"2023-08-27T11:24:48.885993+0000","last_became_active":"2023-08-27T11:24:47.900332+0000","last_became_peered":"2023-08-27T11:24:47.900332+0000","last_unstale":"2023-08-27T11:24:48.885993+0000","last_undegraded":"2023-08-27T11:24:48.885993+0000","last_fullsized":"2023-08-27T11:24:48.885993+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:58.462249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245753+0000","last_change":"2023-08-27T11:24:32.900338+0000","last_active":"2023-08-27T11:24:49.245753+0000","last_peered":"2023-08-27T11:24:49.245753+0000","last_clean":"2023-08-27T11:24:49.245753+0000","last_became_active":"2023-08-27T11:24:32.900045+0000","last_became_peered":"2023-08-27T11:24:32.900045+0000","last_unstale":"2023-08-27T11:24:49.245753+0000","last_undegraded":"2023-08-27T11:24:49.245753+0000","last_fullsized":"2023-08-27T11:24:49.245753+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:18:09.545396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884303+0000","last_change":"2023-08-27T11:24:47.892555+0000","last_active":"2023-08-27T11:24:48.884303+0000","last_peered":"2023-08-27T11:24:48.884303+0000","last_clean":"2023-08-27T11:24:48.884303+0000","last_became_active":"2023-08-27T11:24:47.892307+0000","last_became_peered":"2023-08-27T11:24:47.892307+0000","last_unstale":"2023-08-27T11:24:48.884303+0000","last_undegraded":"2023-08-27T11:24:48.884303+0000","last_fullsized":"2023-08-27T11:24:48.884303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:25.574493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944148+0000","last_change":"2023-08-27T11:24:32.907370+0000","last_active":"2023-08-27T11:24:48.944148+0000","last_peered":"2023-08-27T11:24:48.944148+0000","last_clean":"2023-08-27T11:24:48.944148+0000","last_became_active":"2023-08-27T11:24:32.907051+0000","last_became_peered":"2023-08-27T11:24:32.907051+0000","last_unstale":"2023-08-27T11:24:48.944148+0000","last_undegraded":"2023-08-27T11:24:48.944148+0000","last_fullsized":"2023-08-27T11:24:48.944148+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:11:13.910079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245964+0000","last_change":"2023-08-27T11:24:47.908814+0000","last_active":"2023-08-27T11:24:49.245964+0000","last_peered":"2023-08-27T11:24:49.245964+0000","last_clean":"2023-08-27T11:24:49.245964+0000","last_became_active":"2023-08-27T11:24:47.908300+0000","last_became_peered":"2023-08-27T11:24:47.908300+0000","last_unstale":"2023-08-27T11:24:49.245964+0000","last_undegraded":"2023-08-27T11:24:49.245964+0000","last_fullsized":"2023-08-27T11:24:49.245964+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:39.868370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999655+0000","last_change":"2023-08-27T11:24:32.909896+0000","last_active":"2023-08-27T11:24:48.999655+0000","last_peered":"2023-08-27T11:24:48.999655+0000","last_clean":"2023-08-27T11:24:48.999655+0000","last_became_active":"2023-08-27T11:24:32.909605+0000","last_became_peered":"2023-08-27T11:24:32.909605+0000","last_unstale":"2023-08-27T11:24:48.999655+0000","last_undegraded":"2023-08-27T11:24:48.999655+0000","last_fullsized":"2023-08-27T11:24:48.999655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:43.846197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247258+0000","last_change":"2023-08-27T11:24:47.910695+0000","last_active":"2023-08-27T11:24:49.247258+0000","last_peered":"2023-08-27T11:24:49.247258+0000","last_clean":"2023-08-27T11:24:49.247258+0000","last_became_active":"2023-08-27T11:24:47.910371+0000","last_became_peered":"2023-08-27T11:24:47.910371+0000","last_unstale":"2023-08-27T11:24:49.247258+0000","last_undegraded":"2023-08-27T11:24:49.247258+0000","last_fullsized":"2023-08-27T11:24:49.247258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:43:37.040256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092741+0000","last_change":"2023-08-27T11:24:32.895742+0000","last_active":"2023-08-27T11:24:49.092741+0000","last_peered":"2023-08-27T11:24:49.092741+0000","last_clean":"2023-08-27T11:24:49.092741+0000","last_became_active":"2023-08-27T11:24:32.894897+0000","last_became_peered":"2023-08-27T11:24:32.894897+0000","last_unstale":"2023-08-27T11:24:49.092741+0000","last_undegraded":"2023-08-27T11:24:49.092741+0000","last_fullsized":"2023-08-27T11:24:49.092741+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:49.517968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246877+0000","last_change":"2023-08-27T11:24:47.917194+0000","last_active":"2023-08-27T11:24:49.246877+0000","last_peered":"2023-08-27T11:24:49.246877+0000","last_clean":"2023-08-27T11:24:49.246877+0000","last_became_active":"2023-08-27T11:24:47.916845+0000","last_became_peered":"2023-08-27T11:24:47.916845+0000","last_unstale":"2023-08-27T11:24:49.246877+0000","last_undegraded":"2023-08-27T11:24:49.246877+0000","last_fullsized":"2023-08-27T11:24:49.246877+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:31.278908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884835+0000","last_change":"2023-08-27T11:24:32.900281+0000","last_active":"2023-08-27T11:24:48.884835+0000","last_peered":"2023-08-27T11:24:48.884835+0000","last_clean":"2023-08-27T11:24:48.884835+0000","last_became_active":"2023-08-27T11:24:32.900032+0000","last_became_peered":"2023-08-27T11:24:32.900032+0000","last_unstale":"2023-08-27T11:24:48.884835+0000","last_undegraded":"2023-08-27T11:24:48.884835+0000","last_fullsized":"2023-08-27T11:24:48.884835+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:16:39.888763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886507+0000","last_change":"2023-08-27T11:24:47.900431+0000","last_active":"2023-08-27T11:24:48.886507+0000","last_peered":"2023-08-27T11:24:48.886507+0000","last_clean":"2023-08-27T11:24:48.886507+0000","last_became_active":"2023-08-27T11:24:47.900006+0000","last_became_peered":"2023-08-27T11:24:47.900006+0000","last_unstale":"2023-08-27T11:24:48.886507+0000","last_undegraded":"2023-08-27T11:24:48.886507+0000","last_fullsized":"2023-08-27T11:24:48.886507+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:21:00.732054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999701+0000","last_change":"2023-08-27T11:24:32.901649+0000","last_active":"2023-08-27T11:24:48.999701+0000","last_peered":"2023-08-27T11:24:48.999701+0000","last_clean":"2023-08-27T11:24:48.999701+0000","last_became_active":"2023-08-27T11:24:32.901366+0000","last_became_peered":"2023-08-27T11:24:32.901366+0000","last_unstale":"2023-08-27T11:24:48.999701+0000","last_undegraded":"2023-08-27T11:24:48.999701+0000","last_fullsized":"2023-08-27T11:24:48.999701+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:38.518585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887457+0000","last_change":"2023-08-27T11:24:47.903989+0000","last_active":"2023-08-27T11:24:48.887457+0000","last_peered":"2023-08-27T11:24:48.887457+0000","last_clean":"2023-08-27T11:24:48.887457+0000","last_became_active":"2023-08-27T11:24:47.903611+0000","last_became_peered":"2023-08-27T11:24:47.903611+0000","last_unstale":"2023-08-27T11:24:48.887457+0000","last_undegraded":"2023-08-27T11:24:48.887457+0000","last_fullsized":"2023-08-27T11:24:48.887457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:47:48.882059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.093250+0000","last_change":"2023-08-27T11:24:32.910119+0000","last_active":"2023-08-27T11:24:49.093250+0000","last_peered":"2023-08-27T11:24:49.093250+0000","last_clean":"2023-08-27T11:24:49.093250+0000","last_became_active":"2023-08-27T11:24:32.909855+0000","last_became_peered":"2023-08-27T11:24:32.909855+0000","last_unstale":"2023-08-27T11:24:49.093250+0000","last_undegraded":"2023-08-27T11:24:49.093250+0000","last_fullsized":"2023-08-27T11:24:49.093250+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:10.266899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944633+0000","last_change":"2023-08-27T11:24:47.908421+0000","last_active":"2023-08-27T11:24:48.944633+0000","last_peered":"2023-08-27T11:24:48.944633+0000","last_clean":"2023-08-27T11:24:48.944633+0000","last_became_active":"2023-08-27T11:24:47.908144+0000","last_became_peered":"2023-08-27T11:24:47.908144+0000","last_unstale":"2023-08-27T11:24:48.944633+0000","last_undegraded":"2023-08-27T11:24:48.944633+0000","last_fullsized":"2023-08-27T11:24:48.944633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:47.664238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.092356+0000","last_change":"2023-08-27T11:24:32.906146+0000","last_active":"2023-08-27T11:24:49.092356+0000","last_peered":"2023-08-27T11:24:49.092356+0000","last_clean":"2023-08-27T11:24:49.092356+0000","last_became_active":"2023-08-27T11:24:32.905867+0000","last_became_peered":"2023-08-27T11:24:32.905867+0000","last_unstale":"2023-08-27T11:24:49.092356+0000","last_undegraded":"2023-08-27T11:24:49.092356+0000","last_fullsized":"2023-08-27T11:24:49.092356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:58.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.245276+0000","last_change":"2023-08-27T11:24:47.914343+0000","last_active":"2023-08-27T11:24:49.245276+0000","last_peered":"2023-08-27T11:24:49.245276+0000","last_clean":"2023-08-27T11:24:49.245276+0000","last_became_active":"2023-08-27T11:24:47.913975+0000","last_became_peered":"2023-08-27T11:24:47.913975+0000","last_unstale":"2023-08-27T11:24:49.245276+0000","last_undegraded":"2023-08-27T11:24:49.245276+0000","last_fullsized":"2023-08-27T11:24:49.245276+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:46:51.541858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944067+0000","last_change":"2023-08-27T11:24:32.907204+0000","last_active":"2023-08-27T11:24:48.944067+0000","last_peered":"2023-08-27T11:24:48.944067+0000","last_clean":"2023-08-27T11:24:48.944067+0000","last_became_active":"2023-08-27T11:24:32.906510+0000","last_became_peered":"2023-08-27T11:24:32.906510+0000","last_unstale":"2023-08-27T11:24:48.944067+0000","last_undegraded":"2023-08-27T11:24:48.944067+0000","last_fullsized":"2023-08-27T11:24:48.944067+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:26.104276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.886830+0000","last_change":"2023-08-27T11:24:47.910413+0000","last_active":"2023-08-27T11:24:48.886830+0000","last_peered":"2023-08-27T11:24:48.886830+0000","last_clean":"2023-08-27T11:24:48.886830+0000","last_became_active":"2023-08-27T11:24:47.910073+0000","last_became_peered":"2023-08-27T11:24:47.910073+0000","last_unstale":"2023-08-27T11:24:48.886830+0000","last_undegraded":"2023-08-27T11:24:48.886830+0000","last_fullsized":"2023-08-27T11:24:48.886830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:17.928294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000191+0000","last_change":"2023-08-27T11:24:32.900880+0000","last_active":"2023-08-27T11:24:49.000191+0000","last_peered":"2023-08-27T11:24:49.000191+0000","last_clean":"2023-08-27T11:24:49.000191+0000","last_became_active":"2023-08-27T11:24:32.900515+0000","last_became_peered":"2023-08-27T11:24:32.900515+0000","last_unstale":"2023-08-27T11:24:49.000191+0000","last_undegraded":"2023-08-27T11:24:49.000191+0000","last_fullsized":"2023-08-27T11:24:49.000191+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:18.267003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.884666+0000","last_change":"2023-08-27T11:24:47.909299+0000","last_active":"2023-08-27T11:24:48.884666+0000","last_peered":"2023-08-27T11:24:48.884666+0000","last_clean":"2023-08-27T11:24:48.884666+0000","last_became_active":"2023-08-27T11:24:47.908992+0000","last_became_peered":"2023-08-27T11:24:47.908992+0000","last_unstale":"2023-08-27T11:24:48.884666+0000","last_undegraded":"2023-08-27T11:24:48.884666+0000","last_fullsized":"2023-08-27T11:24:48.884666+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:23:20.069179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887403+0000","last_change":"2023-08-27T11:24:32.908868+0000","last_active":"2023-08-27T11:24:48.887403+0000","last_peered":"2023-08-27T11:24:48.887403+0000","last_clean":"2023-08-27T11:24:48.887403+0000","last_became_active":"2023-08-27T11:24:32.908413+0000","last_became_peered":"2023-08-27T11:24:32.908413+0000","last_unstale":"2023-08-27T11:24:48.887403+0000","last_undegraded":"2023-08-27T11:24:48.887403+0000","last_fullsized":"2023-08-27T11:24:48.887403+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:51:51.565279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.000775+0000","last_change":"2023-08-27T11:24:47.902903+0000","last_active":"2023-08-27T11:24:49.000775+0000","last_peered":"2023-08-27T11:24:49.000775+0000","last_clean":"2023-08-27T11:24:49.000775+0000","last_became_active":"2023-08-27T11:24:47.902613+0000","last_became_peered":"2023-08-27T11:24:47.902613+0000","last_unstale":"2023-08-27T11:24:49.000775+0000","last_undegraded":"2023-08-27T11:24:49.000775+0000","last_fullsized":"2023-08-27T11:24:49.000775+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:17:38.696066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.246710+0000","last_change":"2023-08-27T11:24:32.904922+0000","last_active":"2023-08-27T11:24:49.246710+0000","last_peered":"2023-08-27T11:24:49.246710+0000","last_clean":"2023-08-27T11:24:49.246710+0000","last_became_active":"2023-08-27T11:24:32.904570+0000","last_became_peered":"2023-08-27T11:24:32.904570+0000","last_unstale":"2023-08-27T11:24:49.246710+0000","last_undegraded":"2023-08-27T11:24:49.246710+0000","last_fullsized":"2023-08-27T11:24:49.246710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:10.266899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.001050+0000","last_change":"2023-08-27T11:24:47.904844+0000","last_active":"2023-08-27T11:24:49.001050+0000","last_peered":"2023-08-27T11:24:49.001050+0000","last_clean":"2023-08-27T11:24:49.001050+0000","last_became_active":"2023-08-27T11:24:47.904525+0000","last_became_peered":"2023-08-27T11:24:47.904525+0000","last_unstale":"2023-08-27T11:24:49.001050+0000","last_undegraded":"2023-08-27T11:24:49.001050+0000","last_fullsized":"2023-08-27T11:24:49.001050+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:02.903426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.944234+0000","last_change":"2023-08-27T11:24:32.912255+0000","last_active":"2023-08-27T11:24:48.944234+0000","last_peered":"2023-08-27T11:24:48.944234+0000","last_clean":"2023-08-27T11:24:48.944234+0000","last_became_active":"2023-08-27T11:24:32.909842+0000","last_became_peered":"2023-08-27T11:24:32.909842+0000","last_unstale":"2023-08-27T11:24:48.944234+0000","last_undegraded":"2023-08-27T11:24:48.944234+0000","last_fullsized":"2023-08-27T11:24:48.944234+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:37.586419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.887830+0000","last_change":"2023-08-27T11:24:47.897521+0000","last_active":"2023-08-27T11:24:48.887830+0000","last_peered":"2023-08-27T11:24:48.887830+0000","last_clean":"2023-08-27T11:24:48.887830+0000","last_became_active":"2023-08-27T11:24:47.897246+0000","last_became_peered":"2023-08-27T11:24:47.897246+0000","last_unstale":"2023-08-27T11:24:48.887830+0000","last_undegraded":"2023-08-27T11:24:48.887830+0000","last_fullsized":"2023-08-27T11:24:48.887830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:27.517072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.244717+0000","last_change":"2023-08-27T11:24:32.905490+0000","last_active":"2023-08-27T11:24:49.244717+0000","last_peered":"2023-08-27T11:24:49.244717+0000","last_clean":"2023-08-27T11:24:49.244717+0000","last_became_active":"2023-08-27T11:24:32.904866+0000","last_became_peered":"2023-08-27T11:24:32.904866+0000","last_unstale":"2023-08-27T11:24:49.244717+0000","last_undegraded":"2023-08-27T11:24:49.244717+0000","last_fullsized":"2023-08-27T11:24:49.244717+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:31:00.941199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:49.247186+0000","last_change":"2023-08-27T11:24:47.909411+0000","last_active":"2023-08-27T11:24:49.247186+0000","last_peered":"2023-08-27T11:24:49.247186+0000","last_clean":"2023-08-27T11:24:49.247186+0000","last_became_active":"2023-08-27T11:24:47.909065+0000","last_became_peered":"2023-08-27T11:24:47.909065+0000","last_unstale":"2023-08-27T11:24:49.247186+0000","last_undegraded":"2023-08-27T11:24:49.247186+0000","last_fullsized":"2023-08-27T11:24:49.247186+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:46.980106+0000","last_clean_scrub_stamp":"2023-08-27T11:24:46.980106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:48:55.096429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-08-27T11:24:48.999832+0000","last_change":"2023-08-27T11:24:32.898902+0000","last_active":"2023-08-27T11:24:48.999832+0000","last_peered":"2023-08-27T11:24:48.999832+0000","last_clean":"2023-08-27T11:24:48.999832+0000","last_became_active":"2023-08-27T11:24:32.898635+0000","last_became_peered":"2023-08-27T11:24:32.898635+0000","last_unstale":"2023-08-27T11:24:48.999832+0000","last_undegraded":"2023-08-27T11:24:48.999832+0000","last_fullsized":"2023-08-27T11:24:48.999832+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:24:32.261835+0000","last_clean_scrub_stamp":"2023-08-27T11:24:32.261835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:22:50.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":860701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.879},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.71399999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":610304,"data_stored":269133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77500000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.755},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.72499999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.85899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":862337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.752},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90700000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":606208,"data_stored":268503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.439}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.495}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54500000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61899999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":271045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.28000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.79300000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":614400,"data_stored":270081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.82699999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.878},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.77900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":618496,"data_stored":271627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.62},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.81999999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.879},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.73899999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":602112,"data_stored":268469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.874},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.86299999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:24:52.982 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:24:52.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 3:0 2023-08-27T11:24:53.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.213+0000 7f8925dff700 1 Processor -- start 2023-08-27T11:24:53.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.213+0000 7f8925dff700 1 -- start start 2023-08-27T11:24:53.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.214+0000 7f8925dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 0x7f892006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.214+0000 7f8925dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892006c4e0 con 0x7f89200c4630 2023-08-27T11:24:53.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.214+0000 7f8925dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8920155370 con 0x7f8920151a90 2023-08-27T11:24:53.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.214+0000 7f8925dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200c82c0 con 0x7f89200c4a90 2023-08-27T11:24:53.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891effd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f89200c4630 0x7f892006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52612/0 (socket says 172.21.15.43:52612) 2023-08-27T11:24:53.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891effd700 1 -- 172.21.15.43:0/1774599368 learned_addr learned my addr 172.21.15.43:0/1774599368 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:53.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891ffff700 1 --2- 172.21.15.43:0/1774599368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 0x7f892006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246756566 0 0) 0x7f892006c4e0 con 0x7f89200c4630 2023-08-27T11:24:53.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89080035b0 con 0x7f89200c4630 2023-08-27T11:24:53.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68977005 0 0) 0x7f8920155370 con 0x7f8920151a90 2023-08-27T11:24:53.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f892006c4e0 con 0x7f8920151a90 2023-08-27T11:24:53.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891ffff700 1 -- 172.21.15.43:0/1774599368 >> v1:172.21.15.57:6789/0 conn(0x7f8920151a90 legacy=0x7f89200c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891ffff700 1 -- 172.21.15.43:0/1774599368 >> v1:172.21.15.43:6789/0 conn(0x7f89200c4630 legacy=0x7f892006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.215+0000 7f891ffff700 1 -- 172.21.15.43:0/1774599368 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920151e70 con 0x7f89200c4a90 2023-08-27T11:24:53.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.216+0000 7f891ffff700 1 --2- 172.21.15.43:0/1774599368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 0x7f892006b480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8918009dc0 tx=0x7f891800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b7c49fc6be7638 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.216+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800e070 con 0x7f89200c4a90 2023-08-27T11:24:53.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.216+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891800bb20 con 0x7f89200c4a90 2023-08-27T11:24:53.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.216+0000 7f891e7fc700 1 -- 172.21.15.43:0/1774599368 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918012430 con 0x7f89200c4a90 2023-08-27T11:24:53.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 -- 172.21.15.43:0/1774599368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 msgr2=0x7f892006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 --2- 172.21.15.43:0/1774599368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 0x7f892006b480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8918009dc0 tx=0x7f891800b330 comp rx=0 tx=0).stop 2023-08-27T11:24:53.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 -- 172.21.15.43:0/1774599368 shutdown_connections 2023-08-27T11:24:53.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 --2- 172.21.15.43:0/1774599368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f89200c4a90 0x7f892006b480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 -- 172.21.15.43:0/1774599368 >> 172.21.15.43:0/1774599368 conn(0x7f89200ab820 msgr2=0x7f89200abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:53.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 -- 172.21.15.43:0/1774599368 shutdown_connections 2023-08-27T11:24:53.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.217+0000 7f8925dff700 1 -- 172.21.15.43:0/1774599368 wait complete. 2023-08-27T11:24:53.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.218+0000 7f8925dff700 1 Processor -- start 2023-08-27T11:24:53.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.219+0000 7f8925dff700 1 -- start start 2023-08-27T11:24:53.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.219+0000 7f8925dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 0x7f8920149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.219+0000 7f8925dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f8925dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8920151a90 0x7f8920152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f8925dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8920154270 con 0x7f89200c4a90 2023-08-27T11:24:53.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f8925dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892014d870 con 0x7f89200c4630 2023-08-27T11:24:53.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f8925dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89201ed110 con 0x7f8920151a90 2023-08-27T11:24:53.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58964/0 (socket says 172.21.15.43:58964) 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 -- 172.21.15.43:0/4108316178 learned_addr learned my addr 172.21.15.43:0/4108316178 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891f7fe700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 0x7f8920149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891ffff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8920151a90 0x7f8920152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 -- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8920151a90 msgr2=0x7f8920152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8920151a90 0x7f8920152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 -- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 msgr2=0x7f8920149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 0x7f8920149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 -- 172.21.15.43:0/4108316178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009a70 con 0x7f89200c4a90 2023-08-27T11:24:53.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891f7fe700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 0x7f8920149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:24:53.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.220+0000 7f891effd700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8914001eb0 tx=0x7f891400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.221+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914005d70 con 0x7f89200c4a90 2023-08-27T11:24:53.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.221+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89140070d0 con 0x7f89200c4a90 2023-08-27T11:24:53.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.221+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89200bd0b0 con 0x7f89200c4a90 2023-08-27T11:24:53.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.221+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914007460 con 0x7f89200c4a90 2023-08-27T11:24:53.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.221+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8920153c20 con 0x7f89200c4a90 2023-08-27T11:24:53.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.222+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920152280 con 0x7f89200c4a90 2023-08-27T11:24:53.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.223+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89140075c0 con 0x7f89200c4a90 2023-08-27T11:24:53.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.224+0000 7f8907fff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 0x7f890c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.224+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8914087ec0 con 0x7f89200c4a90 2023-08-27T11:24:53.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.225+0000 7f891f7fe700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 0x7f890c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.225+0000 7f891f7fe700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 0x7f890c06c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89100011e0 tx=0x7f8910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.229+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8920152280 con 0x7f89200c4a90 2023-08-27T11:24:53.249 INFO:tasks.ceph.mds.b.smithi057.stderr:2023-08-27T11:24:53.248+0000 7f999bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:24:53.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.528+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "3:0"} v 0) v1 -- 0x7f8920152280 con 0x7f89200c4a90 2023-08-27T11:24:53.530 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:24:53.528+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:24:53.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.533+0000 7f8907fff700 1 -- 172.21.15.43:0/4108316178 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "3:0"}]=0 failed mds gid 5586 v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8920152280 con 0x7f89200c4a90 2023-08-27T11:24:53.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 msgr2=0x7f890c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 0x7f890c06c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89100011e0 tx=0x7f8910009040 comp rx=0 tx=0).stop 2023-08-27T11:24:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 msgr2=0x7f8920152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8914001eb0 tx=0x7f891400c860 comp rx=0 tx=0).stop 2023-08-27T11:24:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 shutdown_connections 2023-08-27T11:24:53.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f890c06a0e0 0x7f890c06c5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8920151a90 0x7f8920152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89200c4630 0x7f8920149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 --2- 172.21.15.43:0/4108316178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f89200c4a90 0x7f8920152560 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 >> 172.21.15.43:0/4108316178 conn(0x7f89200ab820 msgr2=0x7f892014f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:53.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 shutdown_connections 2023-08-27T11:24:53.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.536+0000 7f8925dff700 1 -- 172.21.15.43:0/4108316178 wait complete. 2023-08-27T11:24:53.540 INFO:tasks.ceph.mds.d.smithi057.stderr: -446> 2023-08-27T11:24:38.248+0000 7f26d4df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:24:53.540 INFO:teuthology.orchestra.run.smithi043.stderr:failed mds gid 5586 2023-08-27T11:24:53.562 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:53.592 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:24:53.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.762+0000 7f1b683ff700 1 Processor -- start 2023-08-27T11:24:53.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.762+0000 7f1b683ff700 1 -- start start 2023-08-27T11:24:53.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b683ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1b60151a90 0x7f1b600c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b683ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6006c4e0 con 0x7f1b600c4a90 2023-08-27T11:24:53.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b683ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b60155370 con 0x7f1b600c4630 2023-08-27T11:24:53.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b683ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b60151e70 con 0x7f1b60151a90 2023-08-27T11:24:53.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b6619b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1b60151a90 0x7f1b600c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b6699c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1b600c4a90 0x7f1b6006b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52622/0 (socket says 172.21.15.43:52622) 2023-08-27T11:24:53.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.763+0000 7f1b6699c700 1 -- 172.21.15.43:0/3534582479 learned_addr learned my addr 172.21.15.43:0/3534582479 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:53.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b6619b700 1 -- 172.21.15.43:0/3534582479 >> v1:172.21.15.57:6789/0 conn(0x7f1b600c4630 legacy=0x7f1b6006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b6619b700 1 -- 172.21.15.43:0/3534582479 >> v1:172.21.15.43:6789/0 conn(0x7f1b600c4a90 legacy=0x7f1b6006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b6619b700 1 -- 172.21.15.43:0/3534582479 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b60154480 con 0x7f1b60151a90 2023-08-27T11:24:53.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b65199700 1 -- 172.21.15.43:0/3534582479 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28345401 0 0) 0x7f1b6006c4e0 con 0x7f1b600c4a90 2023-08-27T11:24:53.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b6619b700 1 --2- 172.21.15.43:0/3534582479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b60151a90 0x7f1b600c7bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009840 tx=0x7f1b5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad00d03b6d5e46 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b65199700 1 -- 172.21.15.43:0/3534582479 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011830 con 0x7f1b60151a90 2023-08-27T11:24:53.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b65199700 1 -- 172.21.15.43:0/3534582479 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c011990 con 0x7f1b60151a90 2023-08-27T11:24:53.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.764+0000 7f1b65199700 1 -- 172.21.15.43:0/3534582479 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c011d20 con 0x7f1b60151a90 2023-08-27T11:24:53.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 -- 172.21.15.43:0/3534582479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b60151a90 msgr2=0x7f1b600c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 --2- 172.21.15.43:0/3534582479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b60151a90 0x7f1b600c7bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009840 tx=0x7f1b5c009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:53.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 -- 172.21.15.43:0/3534582479 shutdown_connections 2023-08-27T11:24:53.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 --2- 172.21.15.43:0/3534582479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b60151a90 0x7f1b600c7bb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 -- 172.21.15.43:0/3534582479 >> 172.21.15.43:0/3534582479 conn(0x7f1b600ab820 msgr2=0x7f1b600abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:53.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 -- 172.21.15.43:0/3534582479 shutdown_connections 2023-08-27T11:24:53.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.765+0000 7f1b683ff700 1 -- 172.21.15.43:0/3534582479 wait complete. 2023-08-27T11:24:53.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.767+0000 7f1b683ff700 1 Processor -- start 2023-08-27T11:24:53.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.767+0000 7f1b683ff700 1 -- start start 2023-08-27T11:24:53.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 0x7f1b601e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b60151a90 0x7f1b601e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c13a0 con 0x7f1b600c4630 2023-08-27T11:24:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c3400 con 0x7f1b60151a90 2023-08-27T11:24:53.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b683ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c3cc0 con 0x7f1b600c4a90 2023-08-27T11:24:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58982/0 (socket says 172.21.15.43:58982) 2023-08-27T11:24:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 -- 172.21.15.43:0/1246564902 learned_addr learned my addr 172.21.15.43:0/1246564902 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6699c700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b60151a90 0x7f1b601e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6599a700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 0x7f1b601e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 -- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 msgr2=0x7f1b601e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 0x7f1b601e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 -- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b60151a90 msgr2=0x7f1b601e9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.768+0000 7f1b6619b700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b60151a90 0x7f1b601e9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:53.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b6619b700 1 -- 172.21.15.43:0/1246564902 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094a0 con 0x7f1b600c4630 2023-08-27T11:24:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b6599a700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 0x7f1b601e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b6619b700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c014040 tx=0x7f1b5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01a900 con 0x7f1b600c4630 2023-08-27T11:24:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c01aa60 con 0x7f1b600c4630 2023-08-27T11:24:53.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c01add0 con 0x7f1b600c4630 2023-08-27T11:24:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b60153b70 con 0x7f1b600c4630 2023-08-27T11:24:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.769+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600c3950 con 0x7f1b600c4630 2023-08-27T11:24:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.770+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b600c3ae0 con 0x7f1b600c4630 2023-08-27T11:24:53.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.771+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1b5c022070 con 0x7f1b600c4630 2023-08-27T11:24:53.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.772+0000 7f1b56ffd700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 0x7f1b4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:53.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.772+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f1b5c0897a0 con 0x7f1b600c4630 2023-08-27T11:24:53.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.772+0000 7f1b6599a700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 0x7f1b4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:53.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.773+0000 7f1b6599a700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 0x7f1b4406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b6014d2d0 tx=0x7f1b50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:53.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:53.776+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1b5c054ca0 con 0x7f1b600c4630 2023-08-27T11:24:54.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.030+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b6004ee70 con 0x7f1b600c4630 2023-08-27T11:24:54.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.031+0000 7f1b56ffd700 1 -- 172.21.15.43:0/1246564902 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5259 (secure 0 0 0) 0x7f1b5c0582c0 con 0x7f1b600c4630 2023-08-27T11:24:54.033 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:54.033 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:53.534412+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5144":{"gid":5144,"name":"a","rank":0,"incarnation":40,"state":"up:replay","state_seq":7,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:54.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 msgr2=0x7f1b4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 0x7f1b4406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1b6014d2d0 tx=0x7f1b50009040 comp rx=0 tx=0).stop 2023-08-27T11:24:54.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 msgr2=0x7f1b600aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c014040 tx=0x7f1b5c004750 comp rx=0 tx=0).stop 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 shutdown_connections 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1b4406a0e0 0x7f1b4406c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b60151a90 0x7f1b601e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b600c4630 0x7f1b600aa8d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 --2- 172.21.15.43:0/1246564902 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1b600c4a90 0x7f1b601e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 >> 172.21.15.43:0/1246564902 conn(0x7f1b600ab820 msgr2=0x7f1b6014d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:54.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 shutdown_connections 2023-08-27T11:24:54.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.033+0000 7f1b683ff700 1 -- 172.21.15.43:0/1246564902 wait complete. 2023-08-27T11:24:54.037 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 40 2023-08-27T11:24:54.053 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:24:54.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:54.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:24:54.264 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:24:54.265 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:24:54.265 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:54.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:24:54.310 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:24:54.310 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:24:54.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:24:54.356 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:54.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.558+0000 7f9c9e7ff700 1 Processor -- start 2023-08-27T11:24:54.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.558+0000 7f9c9e7ff700 1 -- start start 2023-08-27T11:24:54.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9e7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c980c51a0 0x7f9c980c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9e7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9c980c15e0 0x7f9c980c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9e7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980c5ae0 con 0x7f9c98151910 2023-08-27T11:24:54.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9e7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980c69f0 con 0x7f9c980c15e0 2023-08-27T11:24:54.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9e7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980c1190 con 0x7f9c980c51a0 2023-08-27T11:24:54.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9cd9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9c980c15e0 0x7f9c980c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9cd9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9c980c15e0 0x7f9c980c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58990/0 (socket says 172.21.15.43:58990) 2023-08-27T11:24:54.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c9cd9c700 1 -- 172.21.15.43:0/4036762873 learned_addr learned my addr 172.21.15.43:0/4036762873 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:54.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.559+0000 7f9c977fe700 1 --2- 172.21.15.43:0/4036762873 >> v2:172.21.15.57:3300/0 conn(0x7f9c980c51a0 0x7f9c980c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c9cd9c700 1 -- 172.21.15.43:0/4036762873 >> v2:172.21.15.57:3300/0 conn(0x7f9c980c51a0 msgr2=0x7f9c980c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:54.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c9cd9c700 1 --2- 172.21.15.43:0/4036762873 >> v2:172.21.15.57:3300/0 conn(0x7f9c980c51a0 0x7f9c980c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c9cd9c700 1 -- 172.21.15.43:0/4036762873 >> v1:172.21.15.57:6789/0 conn(0x7f9c98151910 legacy=0x7f9c98157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c9cd9c700 1 -- 172.21.15.43:0/4036762873 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98072900 con 0x7f9c980c15e0 2023-08-27T11:24:54.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c9cd9c700 1 --2- 172.21.15.43:0/4036762873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c980c64b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9c980c8ac0 tx=0x7f9c9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941b7cdee0da98ed server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:54.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c96ffd700 1 -- 172.21.15.43:0/4036762873 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000e070 con 0x7f9c980c15e0 2023-08-27T11:24:54.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c96ffd700 1 -- 172.21.15.43:0/4036762873 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000b910 con 0x7f9c980c15e0 2023-08-27T11:24:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.560+0000 7f9c96ffd700 1 -- 172.21.15.43:0/4036762873 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000bcc0 con 0x7f9c980c15e0 2023-08-27T11:24:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4036762873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 msgr2=0x7f9c980c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4036762873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c980c64b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9c980c8ac0 tx=0x7f9c9000b330 comp rx=0 tx=0).stop 2023-08-27T11:24:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4036762873 shutdown_connections 2023-08-27T11:24:54.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4036762873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c980c64b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4036762873 >> v2:172.21.15.57:3300/0 conn(0x7f9c980c51a0 0x7f9c980c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4036762873 >> 172.21.15.43:0/4036762873 conn(0x7f9c980a9740 msgr2=0x7f9c980a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:54.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4036762873 shutdown_connections 2023-08-27T11:24:54.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.561+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4036762873 wait complete. 2023-08-27T11:24:54.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.563+0000 7f9c9e7ff700 1 Processor -- start 2023-08-27T11:24:54.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.563+0000 7f9c9e7ff700 1 -- start start 2023-08-27T11:24:54.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c980c51a0 0x7f9c981548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c98151910 0x7f9c98152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98152280 con 0x7f9c980c15e0 2023-08-27T11:24:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c981ea860 con 0x7f9c98151910 2023-08-27T11:24:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c981eab40 con 0x7f9c980c51a0 2023-08-27T11:24:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c97fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c97fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59002/0 (socket says 172.21.15.43:59002) 2023-08-27T11:24:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c97fff700 1 -- 172.21.15.43:0/4271078133 learned_addr learned my addr 172.21.15.43:0/4271078133 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c977fe700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c980c51a0 0x7f9c981548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.564+0000 7f9c9cd9c700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c98151910 0x7f9c98152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 -- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c980c51a0 msgr2=0x7f9c981548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c980c51a0 0x7f9c981548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 -- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c98151910 msgr2=0x7f9c98152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c98151910 0x7f9c98152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 -- 172.21.15.43:0/4271078133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009b30 con 0x7f9c980c15e0 2023-08-27T11:24:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c97fff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c450 tx=0x7f9c8800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880052d0 con 0x7f9c980c15e0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c88005430 con 0x7f9c980c15e0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c981524d0 con 0x7f9c980c15e0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880038c0 con 0x7f9c980c15e0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.565+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9814bdf0 con 0x7f9c980c15e0 2023-08-27T11:24:54.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.566+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9804e620 con 0x7f9c980c15e0 2023-08-27T11:24:54.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.567+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c88003a20 con 0x7f9c980c15e0 2023-08-27T11:24:54.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.568+0000 7f9c94ff9700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 0x7f9c8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:54.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.568+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f9c88087c70 con 0x7f9c980c15e0 2023-08-27T11:24:54.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.568+0000 7f9c977fe700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 0x7f9c8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:54.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.569+0000 7f9c977fe700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 0x7f9c8406c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9c981506c0 tx=0x7f9c8c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.573+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9c88052f10 con 0x7f9c980c15e0 2023-08-27T11:24:54.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.824+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c9804ee70 con 0x7f9c980c15e0 2023-08-27T11:24:54.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.825+0000 7f9c94ff9700 1 -- 172.21.15.43:0/4271078133 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+6053 (secure 0 0 0) 0x7f9c8800ce60 con 0x7f9c980c15e0 2023-08-27T11:24:54.826 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:54.827 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":41,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/4060215483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":4060215483},{"type":"v1","addr":"172.21.15.57:6835","nonce":4060215483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:54.541875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":52,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5144},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5144":{"gid":5144,"name":"a","rank":0,"incarnation":40,"state":"up:reconnect","state_seq":8,"addr":"172.21.15.43:6837/2697205419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2697205419},{"type":"v1","addr":"172.21.15.43:6837","nonce":2697205419}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 msgr2=0x7f9c8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 0x7f9c8406c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9c981506c0 tx=0x7f9c8c009210 comp rx=0 tx=0).stop 2023-08-27T11:24:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 msgr2=0x7f9c9814b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:54.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c450 tx=0x7f9c8800c760 comp rx=0 tx=0).stop 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 shutdown_connections 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c8406a0e0 0x7f9c8406c5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c98151910 0x7f9c98152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c980c15e0 0x7f9c9814b8b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 --2- 172.21.15.43:0/4271078133 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c980c51a0 0x7f9c981548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:54.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 >> 172.21.15.43:0/4271078133 conn(0x7f9c980a9740 msgr2=0x7f9c981511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 shutdown_connections 2023-08-27T11:24:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:54.827+0000 7f9c9e7ff700 1 -- 172.21.15.43:0/4271078133 wait complete. 2023-08-27T11:24:54.831 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 41 2023-08-27T11:24:54.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:55.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.051+0000 7fa7fc5ff700 1 Processor -- start 2023-08-27T11:24:55.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.051+0000 7fa7fc5ff700 1 -- start start 2023-08-27T11:24:55.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.052+0000 7fa7fc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.052+0000 7fa7fc5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 0x7fa7f40c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.052+0000 7fa7fc5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f4154d00 con 0x7fa7f414e960 2023-08-27T11:24:55.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.052+0000 7fa7fc5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f40baf30 con 0x7fa7f4154740 2023-08-27T11:24:55.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.052+0000 7fa7fc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4154fe0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7fab9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 0x7fa7f40c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:34376/0 (socket says 172.21.15.43:34376) 2023-08-27T11:24:55.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 -- 172.21.15.43:0/2123804288 learned_addr learned my addr 172.21.15.43:0/2123804288 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7fa39b700 1 --1- 172.21.15.43:0/2123804288 >> v1:172.21.15.57:6789/0 conn(0x7fa7f414e960 0x7fa7f40a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:49232/0 (socket says 172.21.15.43:49232) 2023-08-27T11:24:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 -- 172.21.15.43:0/2123804288 >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 msgr2=0x7fa7f40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 --2- 172.21.15.43:0/2123804288 >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 0x7fa7f40c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 -- 172.21.15.43:0/2123804288 >> v1:172.21.15.57:6789/0 conn(0x7fa7f414e960 legacy=0x7fa7f40a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9b9a700 1 -- 172.21.15.43:0/2123804288 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f41552c0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7fab9c700 1 --2- 172.21.15.43:0/2123804288 >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 0x7fa7f40c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:24:55.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.053+0000 7fa7f9399700 1 -- 172.21.15.43:0/2123804288 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472348184 0 0) 0x7fa7f4154d00 con 0x7fa7f414e960 2023-08-27T11:24:55.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7f9b9a700 1 --2- 172.21.15.43:0/2123804288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400bb90 tx=0x7fa7e400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4be954da59bb5d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7f9399700 1 -- 172.21.15.43:0/2123804288 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400dd30 con 0x7fa7f40c50d0 2023-08-27T11:24:55.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7f9399700 1 -- 172.21.15.43:0/2123804288 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e400de90 con 0x7fa7f40c50d0 2023-08-27T11:24:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7f9399700 1 -- 172.21.15.43:0/2123804288 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4010690 con 0x7fa7f40c50d0 2023-08-27T11:24:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/2123804288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 msgr2=0x7fa7f40c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.054+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/2123804288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400bb90 tx=0x7fa7e400bea0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/2123804288 shutdown_connections 2023-08-27T11:24:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/2123804288 >> v2:172.21.15.57:3300/0 conn(0x7fa7f4154740 0x7fa7f40c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/2123804288 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f40c50d0 0x7fa7f40c3cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/2123804288 >> 172.21.15.43:0/2123804288 conn(0x7fa7f406aa50 msgr2=0x7fa7f40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:55.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/2123804288 shutdown_connections 2023-08-27T11:24:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.055+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/2123804288 wait complete. 2023-08-27T11:24:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.056+0000 7fa7fc5ff700 1 Processor -- start 2023-08-27T11:24:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 -- start start 2023-08-27T11:24:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f414e960 0x7fa7f41e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f4154740 0x7fa7f41ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f41e9a10 con 0x7fa7f40c50d0 2023-08-27T11:24:55.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f414f000 con 0x7fa7f4154740 2023-08-27T11:24:55.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.057+0000 7fa7fc5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f41ed360 con 0x7fa7f414e960 2023-08-27T11:24:55.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59018/0 (socket says 172.21.15.43:59018) 2023-08-27T11:24:55.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 -- 172.21.15.43:0/1578311649 learned_addr learned my addr 172.21.15.43:0/1578311649 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7f9b9a700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f414e960 0x7fa7f41e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fab9c700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f4154740 0x7fa7f41ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 -- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f414e960 msgr2=0x7fa7f41e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f414e960 0x7fa7f41e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 -- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f4154740 msgr2=0x7fa7f41ea3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f4154740 0x7fa7f41ea3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.058+0000 7fa7fa39b700 1 -- 172.21.15.43:0/1578311649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009a70 con 0x7fa7f40c50d0 2023-08-27T11:24:55.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7fa39b700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00011e0 tx=0x7fa7f000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0004c80 con 0x7fa7f40c50d0 2023-08-27T11:24:55.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0004de0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0007310 con 0x7fa7f40c50d0 2023-08-27T11:24:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e400b7f0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.059+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f41ed920 con 0x7fa7f40c50d0 2023-08-27T11:24:55.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.060+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f40bb390 con 0x7fa7f40c50d0 2023-08-27T11:24:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.061+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7f0007470 con 0x7fa7f40c50d0 2023-08-27T11:24:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.062+0000 7fa7eaffd700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 0x7fa7d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.062+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fa7f00884d0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.062+0000 7fa7f9b9a700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 0x7fa7d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.062+0000 7fa7f9b9a700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 0x7fa7d806c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400bb90 tx=0x7fa7e401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.066+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7f00538a0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.282+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7f404ee70 con 0x7fa7f40c50d0 2023-08-27T11:24:55.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.283+0000 7fa7eaffd700 1 -- 172.21.15.43:0/1578311649 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+22020 (secure 0 0 0) 0x7fa7f0056ec0 con 0x7fa7f40c50d0 2023-08-27T11:24:55.285 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:55.285 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":52,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:53.529650+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:55.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.285+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 msgr2=0x7fa7d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.285+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 0x7fa7d806c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400bb90 tx=0x7fa7e401c040 comp rx=0 tx=0).stop 2023-08-27T11:24:55.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.285+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 msgr2=0x7fa7f40aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00011e0 tx=0x7fa7f000ca30 comp rx=0 tx=0).stop 2023-08-27T11:24:55.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 shutdown_connections 2023-08-27T11:24:55.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7d806a0e0 0x7fa7d806c5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7f4154740 0x7fa7f41ea3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7f40c50d0 0x7fa7f40aac30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 --2- 172.21.15.43:0/1578311649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7f414e960 0x7fa7f41e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 >> 172.21.15.43:0/1578311649 conn(0x7fa7f406aa50 msgr2=0x7fa7f406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:55.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 shutdown_connections 2023-08-27T11:24:55.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.286+0000 7fa7fc5ff700 1 -- 172.21.15.43:0/1578311649 wait complete. 2023-08-27T11:24:55.306 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:24:31.109964+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:24:31.765112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-27T11:24:45.113541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-27T11:24:46.490147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:24:55.307 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:24:55.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.510+0000 7f2fb59ff700 1 Processor -- start 2023-08-27T11:24:55.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.510+0000 7f2fb59ff700 1 -- start start 2023-08-27T11:24:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2fb59ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 0x7f2fb00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2fb59ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fb006a8e0 0x7f2fb006ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2fb59ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb0154660 con 0x7f2fb00c7c00 2023-08-27T11:24:55.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2fb59ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00c5750 con 0x7f2fb006a8e0 2023-08-27T11:24:55.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2fb59ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0154940 con 0x7f2fb0151d20 2023-08-27T11:24:55.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2faf7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fb006a8e0 0x7f2fb006ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.511+0000 7f2faeffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 0x7f2fb00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2fb006a8e0 0x7f2fb006ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49256/0 (socket says 172.21.15.43:49256) 2023-08-27T11:24:55.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faeffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 0x7f2fb00c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:34392/0 (socket says 172.21.15.43:34392) 2023-08-27T11:24:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 -- 172.21.15.43:0/2918471773 learned_addr learned my addr 172.21.15.43:0/2918471773 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 -- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 msgr2=0x7f2fb00c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 --2- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 0x7f2fb00c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 -- 172.21.15.43:0/2918471773 >> v1:172.21.15.57:6789/0 conn(0x7f2fb00c7c00 legacy=0x7f2fb00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 -- 172.21.15.43:0/2918471773 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0154c20 con 0x7f2fb006a8e0 2023-08-27T11:24:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2faf7fe700 1 --2- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb006a8e0 0x7f2fb006ad70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009e50 tx=0x7f2fa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300bd502716c8ece server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.512+0000 7f2fadffb700 1 -- 172.21.15.43:0/2918471773 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800e070 con 0x7f2fb006a8e0 2023-08-27T11:24:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fadffb700 1 -- 172.21.15.43:0/2918471773 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa800b910 con 0x7f2fb006a8e0 2023-08-27T11:24:55.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fadffb700 1 -- 172.21.15.43:0/2918471773 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800bcc0 con 0x7f2fb006a8e0 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 -- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb006a8e0 msgr2=0x7f2fb006ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb006a8e0 0x7f2fb006ad70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009e50 tx=0x7f2fa800b330 comp rx=0 tx=0).stop 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 -- 172.21.15.43:0/2918471773 shutdown_connections 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb006a8e0 0x7f2fb006ad70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/2918471773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb0151d20 0x7f2fb00c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 -- 172.21.15.43:0/2918471773 >> 172.21.15.43:0/2918471773 conn(0x7f2fb00c9d00 msgr2=0x7f2fb00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:55.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 -- 172.21.15.43:0/2918471773 shutdown_connections 2023-08-27T11:24:55.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.513+0000 7f2fb59ff700 1 -- 172.21.15.43:0/2918471773 wait complete. 2023-08-27T11:24:55.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.515+0000 7f2fb59ff700 1 Processor -- start 2023-08-27T11:24:55.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.516+0000 7f2fb59ff700 1 -- start start 2023-08-27T11:24:55.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb00c7c00 0x7f2fb00c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb0151d20 0x7f2fb00c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0157090 con 0x7f2fb006a8e0 2023-08-27T11:24:55.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb014f030 con 0x7f2fb0151d20 2023-08-27T11:24:55.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fb59ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0155b50 con 0x7f2fb00c7c00 2023-08-27T11:24:55.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2faeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2faeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59022/0 (socket says 172.21.15.43:59022) 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2faeffd700 1 -- 172.21.15.43:0/4241488245 learned_addr learned my addr 172.21.15.43:0/4241488245 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2faf7fe700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb0151d20 0x7f2fb00c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.517+0000 7f2fae7fc700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb00c7c00 0x7f2fb00c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 -- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb00c7c00 msgr2=0x7f2fb00c2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb00c7c00 0x7f2fb00c2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 -- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb0151d20 msgr2=0x7f2fb00c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb0151d20 0x7f2fb00c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 -- 172.21.15.43:0/4241488245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8009b30 con 0x7f2fb006a8e0 2023-08-27T11:24:55.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2faeffd700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000e8a0 tx=0x7f2fa000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0009590 con 0x7f2fb006a8e0 2023-08-27T11:24:55.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000eea0 con 0x7f2fb006a8e0 2023-08-27T11:24:55.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000ca50 con 0x7f2fb006a8e0 2023-08-27T11:24:55.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00ab550 con 0x7f2fb006a8e0 2023-08-27T11:24:55.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.518+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb01ea3b0 con 0x7f2fb006a8e0 2023-08-27T11:24:55.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.519+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0155e30 con 0x7f2fb006a8e0 2023-08-27T11:24:55.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.520+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2fa000cbb0 con 0x7f2fb006a8e0 2023-08-27T11:24:55.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.521+0000 7f2f97fff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 0x7f2f9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.521+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f2fa0088930 con 0x7f2fb006a8e0 2023-08-27T11:24:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.521+0000 7f2fae7fc700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 0x7f2f9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.522+0000 7f2fae7fc700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 0x7f2f9c06c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00abe80 tx=0x7f2fa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.525+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2fa0057670 con 0x7f2fb006a8e0 2023-08-27T11:24:55.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.735+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2fb004ee70 con 0x7f2fb006a8e0 2023-08-27T11:24:55.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.736+0000 7f2f97fff700 1 -- 172.21.15.43:0/4241488245 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2fa0057200 con 0x7f2fb006a8e0 2023-08-27T11:24:55.738 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:24:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 msgr2=0x7f2f9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 0x7f2f9c06c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00abe80 tx=0x7f2fa4009040 comp rx=0 tx=0).stop 2023-08-27T11:24:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 msgr2=0x7f2fb0158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000e8a0 tx=0x7f2fa000ec60 comp rx=0 tx=0).stop 2023-08-27T11:24:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 shutdown_connections 2023-08-27T11:24:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2f9c06a0e0 0x7f2f9c06c5a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2fb0151d20 0x7f2fb00c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2fb006a8e0 0x7f2fb0158480 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 --2- 172.21.15.43:0/4241488245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2fb00c7c00 0x7f2fb00c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 >> 172.21.15.43:0/4241488245 conn(0x7f2fb00c9d00 msgr2=0x7f2fb00c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 shutdown_connections 2023-08-27T11:24:55.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.739+0000 7f2fb59ff700 1 -- 172.21.15.43:0/4241488245 wait complete. 2023-08-27T11:24:55.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:24:55.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.963+0000 7f468e1ff700 1 Processor -- start 2023-08-27T11:24:55.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.963+0000 7f468e1ff700 1 -- start start 2023-08-27T11:24:55.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.964+0000 7f468e1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f46880c0020 0x7f4688158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.964+0000 7f468e1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4688151fc0 0x7f46880708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.964+0000 7f468e1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4688157af0 con 0x7f4688071f70 2023-08-27T11:24:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.964+0000 7f468e1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4688071e10 con 0x7f46880c0020 2023-08-27T11:24:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.964+0000 7f468e1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4688158a80 con 0x7f4688151fc0 2023-08-27T11:24:55.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f46880c0020 0x7f4688158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f46880c0020 0x7f4688158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59026/0 (socket says 172.21.15.43:59026) 2023-08-27T11:24:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 -- 172.21.15.43:0/432347058 learned_addr learned my addr 172.21.15.43:0/432347058 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f4687fff700 1 --2- 172.21.15.43:0/432347058 >> v2:172.21.15.57:3300/0 conn(0x7f4688151fc0 0x7f46880708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 -- 172.21.15.43:0/432347058 >> v2:172.21.15.57:3300/0 conn(0x7f4688151fc0 msgr2=0x7f46880708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:55.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 --2- 172.21.15.43:0/432347058 >> v2:172.21.15.57:3300/0 conn(0x7f4688151fc0 0x7f46880708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 -- 172.21.15.43:0/432347058 >> v1:172.21.15.57:6789/0 conn(0x7f4688071f70 legacy=0x7f46881518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 -- 172.21.15.43:0/432347058 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880a6040 con 0x7f46880c0020 2023-08-27T11:24:55.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.965+0000 7f46877fe700 1 --2- 172.21.15.43:0/432347058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46880c0020 0x7f4688158540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f46880a97b0 tx=0x7f4678009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05a8519ec49dbaa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f46867fc700 1 -- 172.21.15.43:0/432347058 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800b870 con 0x7f46880c0020 2023-08-27T11:24:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f46867fc700 1 -- 172.21.15.43:0/432347058 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800b9d0 con 0x7f46880c0020 2023-08-27T11:24:55.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f46867fc700 1 -- 172.21.15.43:0/432347058 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800bd60 con 0x7f46880c0020 2023-08-27T11:24:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 -- 172.21.15.43:0/432347058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46880c0020 msgr2=0x7f4688158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 --2- 172.21.15.43:0/432347058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46880c0020 0x7f4688158540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f46880a97b0 tx=0x7f4678009bd0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 -- 172.21.15.43:0/432347058 shutdown_connections 2023-08-27T11:24:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 --2- 172.21.15.43:0/432347058 >> v2:172.21.15.57:3300/0 conn(0x7f4688151fc0 0x7f46880708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 --2- 172.21.15.43:0/432347058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46880c0020 0x7f4688158540 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 -- 172.21.15.43:0/432347058 >> 172.21.15.43:0/432347058 conn(0x7f46880c6a40 msgr2=0x7f46880c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 -- 172.21.15.43:0/432347058 shutdown_connections 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.966+0000 7f468e1ff700 1 -- 172.21.15.43:0/432347058 wait complete. 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.968+0000 7f468e1ff700 1 Processor -- start 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.968+0000 7f468e1ff700 1 -- start start 2023-08-27T11:24:55.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46880c0020 0x7f46880a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4688151fc0 0x7f46881dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880aa0b0 con 0x7f4688071f70 2023-08-27T11:24:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881ed190 con 0x7f4688151fc0 2023-08-27T11:24:55.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f468e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a9d60 con 0x7f46880c0020 2023-08-27T11:24:55.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f46877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f46877fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59030/0 (socket says 172.21.15.43:59030) 2023-08-27T11:24:55.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.969+0000 7f46877fe700 1 -- 172.21.15.43:0/509588270 learned_addr learned my addr 172.21.15.43:0/509588270 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:55.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f4687fff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4688151fc0 0x7f46881dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f4686ffd700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46880c0020 0x7f46880a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 -- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46880c0020 msgr2=0x7f46880a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46880c0020 0x7f46880a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 -- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4688151fc0 msgr2=0x7f46881dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4688151fc0 0x7f46881dfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:55.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 -- 172.21.15.43:0/509588270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678009550 con 0x7f4688071f70 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f46877fe700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46880c7600 tx=0x7f4678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678004310 con 0x7f4688071f70 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467801f070 con 0x7f4688071f70 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46780036a0 con 0x7f4688071f70 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.970+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46881ed3c0 con 0x7f4688071f70 2023-08-27T11:24:55.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.971+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46881ed980 con 0x7f4688071f70 2023-08-27T11:24:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.972+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880c4af0 con 0x7f4688071f70 2023-08-27T11:24:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.973+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4678021030 con 0x7f4688071f70 2023-08-27T11:24:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.973+0000 7f466ffff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 0x7f467406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.974+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f4678089c30 con 0x7f4688071f70 2023-08-27T11:24:55.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.974+0000 7f4686ffd700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 0x7f467406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.974+0000 7f4686ffd700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 0x7f467406c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46881de520 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:55.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:55.978+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4678054f60 con 0x7f4688071f70 2023-08-27T11:24:56.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.192+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46880aa1f0 con 0x7f4688071f70 2023-08-27T11:24:56.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.192+0000 7f466ffff700 1 -- 172.21.15.43:0/509588270 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46880aa1f0 con 0x7f4688071f70 2023-08-27T11:24:56.194 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:24:56.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.194+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 msgr2=0x7f467406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.194+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 0x7f467406c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46881de520 tx=0x7f467c009040 comp rx=0 tx=0).stop 2023-08-27T11:24:56.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.194+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 msgr2=0x7f46881ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.194+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f46880c7600 tx=0x7f4678004750 comp rx=0 tx=0).stop 2023-08-27T11:24:56.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 shutdown_connections 2023-08-27T11:24:56.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f467406a0e0 0x7f467406c5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4688151fc0 0x7f46881dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4688071f70 0x7f46881ecc50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 --2- 172.21.15.43:0/509588270 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46880c0020 0x7f46880a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 >> 172.21.15.43:0/509588270 conn(0x7f46880c6a40 msgr2=0x7f468806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:56.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 shutdown_connections 2023-08-27T11:24:56.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.195+0000 7f468e1ff700 1 -- 172.21.15.43:0/509588270 wait complete. 2023-08-27T11:24:56.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:24:56.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.421+0000 7f467adff700 1 Processor -- start 2023-08-27T11:24:56.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.422+0000 7f467adff700 1 -- start start 2023-08-27T11:24:56.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4674136f50 0x7f46740c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467adff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4674158340 0x7f467406ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467adff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4674137330 con 0x7f467406b370 2023-08-27T11:24:56.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467adff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4674154450 con 0x7f4674158340 2023-08-27T11:24:56.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4674158840 con 0x7f4674136f50 2023-08-27T11:24:56.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f4673fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4674158340 0x7f467406ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f4678b9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4674136f50 0x7f46740c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f4673fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4674158340 0x7f467406ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49284/0 (socket says 172.21.15.43:49284) 2023-08-27T11:24:56.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f467939c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f467406b370 0x7f467406cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:49266/0 (socket says 172.21.15.43:49266) 2023-08-27T11:24:56.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.423+0000 7f4673fff700 1 -- 172.21.15.43:0/2842308517 learned_addr learned my addr 172.21.15.43:0/2842308517 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:56.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f4673fff700 1 -- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4674136f50 msgr2=0x7f46740c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:56.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f4673fff700 1 --2- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4674136f50 0x7f46740c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f4673fff700 1 -- 172.21.15.43:0/2842308517 >> v1:172.21.15.57:6789/0 conn(0x7f467406b370 legacy=0x7f467406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f4673fff700 1 -- 172.21.15.43:0/2842308517 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46741546f0 con 0x7f4674158340 2023-08-27T11:24:56.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f4673fff700 1 --2- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f467406ae30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46600098f0 tx=0x7f4660009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279d66397ecfa50e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.424+0000 7f46737fe700 1 -- 172.21.15.43:0/2842308517 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011830 con 0x7f4674158340 2023-08-27T11:24:56.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f46737fe700 1 -- 172.21.15.43:0/2842308517 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660011990 con 0x7f4674158340 2023-08-27T11:24:56.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f46737fe700 1 -- 172.21.15.43:0/2842308517 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660011d20 con 0x7f4674158340 2023-08-27T11:24:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 -- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 msgr2=0x7f467406ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 --2- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f467406ae30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46600098f0 tx=0x7f4660009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 -- 172.21.15.43:0/2842308517 shutdown_connections 2023-08-27T11:24:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 --2- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4674136f50 0x7f46740c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 --2- 172.21.15.43:0/2842308517 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f467406ae30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 -- 172.21.15.43:0/2842308517 >> 172.21.15.43:0/2842308517 conn(0x7f467406a310 msgr2=0x7f467406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:56.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 -- 172.21.15.43:0/2842308517 shutdown_connections 2023-08-27T11:24:56.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.425+0000 7f467adff700 1 -- 172.21.15.43:0/2842308517 wait complete. 2023-08-27T11:24:56.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.427+0000 7f467adff700 1 Processor -- start 2023-08-27T11:24:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.427+0000 7f467adff700 1 -- start start 2023-08-27T11:24:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f467406b370 0x7f46740a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f4674152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740aa3c0 con 0x7f4674136f50 2023-08-27T11:24:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740ac030 con 0x7f4674158340 2023-08-27T11:24:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f467adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740ab290 con 0x7f467406b370 2023-08-27T11:24:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f4673fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f4673fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59038/0 (socket says 172.21.15.43:59038) 2023-08-27T11:24:56.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.428+0000 7f4673fff700 1 -- 172.21.15.43:0/497872923 learned_addr learned my addr 172.21.15.43:0/497872923 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:56.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4678b9b700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f467406b370 0x7f46740a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f467939c700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f4674152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 -- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f467406b370 msgr2=0x7f46740a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f467406b370 0x7f46740a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 -- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 msgr2=0x7f4674152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f4674152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 -- 172.21.15.43:0/497872923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009550 con 0x7f4674136f50 2023-08-27T11:24:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f4673fff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4660000c00 tx=0x7f4660004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004570 con 0x7f4674136f50 2023-08-27T11:24:56.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466001f070 con 0x7f4674136f50 2023-08-27T11:24:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600038c0 con 0x7f4674136f50 2023-08-27T11:24:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.429+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46741ed6f0 con 0x7f4674136f50 2023-08-27T11:24:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.430+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46740ab830 con 0x7f4674136f50 2023-08-27T11:24:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.430+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467404ee70 con 0x7f4674136f50 2023-08-27T11:24:56.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.431+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4660021030 con 0x7f4674136f50 2023-08-27T11:24:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.433+0000 7f46717fa700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 0x7f465806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.433+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f4660089d70 con 0x7f4674136f50 2023-08-27T11:24:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.433+0000 7f4678b9b700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 0x7f465806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.434+0000 7f4678b9b700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 0x7f465806c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4668009b70 tx=0x7f4668008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.437+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46600550a0 con 0x7f4674136f50 2023-08-27T11:24:56.604 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:24:56.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.658+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46740bfae0 con 0x7f4674136f50 2023-08-27T11:24:56.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.659+0000 7f46717fa700 1 -- 172.21.15.43:0/497872923 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4660015020 con 0x7f4674136f50 2023-08-27T11:24:56.661 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:24:56.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.661+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 msgr2=0x7f465806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.661+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 0x7f465806c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4668009b70 tx=0x7f4668008040 comp rx=0 tx=0).stop 2023-08-27T11:24:56.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 msgr2=0x7f46741ecd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4660000c00 tx=0x7f4660004750 comp rx=0 tx=0).stop 2023-08-27T11:24:56.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 shutdown_connections 2023-08-27T11:24:56.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f465806a0e0 0x7f465806c5a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4674158340 0x7f4674152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f467406b370 0x7f46740a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 --2- 172.21.15.43:0/497872923 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4674136f50 0x7f46741ecd40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 >> 172.21.15.43:0/497872923 conn(0x7f467406a310 msgr2=0x7f46740c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:56.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 shutdown_connections 2023-08-27T11:24:56.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.662+0000 7f467adff700 1 -- 172.21.15.43:0/497872923 wait complete. 2023-08-27T11:24:56.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:24:56.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.885+0000 7fb07c3ff700 1 Processor -- start 2023-08-27T11:24:56.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.885+0000 7fb07c3ff700 1 -- start start 2023-08-27T11:24:56.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb0740c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07c3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb074154660 con 0x7fb07406a8e0 2023-08-27T11:24:56.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07c3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb074154940 con 0x7fb074151d20 2023-08-27T11:24:56.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740c5750 con 0x7fb0740c7c00 2023-08-27T11:24:56.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07a99c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb07406a8e0 0x7fb07406ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52624/0 (socket says 172.21.15.43:52624) 2023-08-27T11:24:56.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.886+0000 7fb07a99c700 1 -- 172.21.15.43:0/1004036282 learned_addr learned my addr 172.21.15.43:0/1004036282 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:56.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb07999a700 1 --2- 172.21.15.43:0/1004036282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb0740c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466028349 0 0) 0x7fb074154660 con 0x7fb07406a8e0 2023-08-27T11:24:56.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0600035b0 con 0x7fb07406a8e0 2023-08-27T11:24:56.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272131003 0 0) 0x7fb074154940 con 0x7fb074151d20 2023-08-27T11:24:56.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb074154660 con 0x7fb074151d20 2023-08-27T11:24:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb07999a700 1 -- 172.21.15.43:0/1004036282 >> v1:172.21.15.57:6789/0 conn(0x7fb074151d20 legacy=0x7fb0740ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb07999a700 1 -- 172.21.15.43:0/1004036282 >> v1:172.21.15.43:6789/0 conn(0x7fb07406a8e0 legacy=0x7fb07406ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb07999a700 1 -- 172.21.15.43:0/1004036282 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074154c20 con 0x7fb0740c7c00 2023-08-27T11:24:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.887+0000 7fb07999a700 1 --2- 172.21.15.43:0/1004036282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb0740c8110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb064009870 tx=0x7fb064009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329c79063329c4f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064011830 con 0x7fb0740c7c00 2023-08-27T11:24:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064011990 con 0x7fb0740c7c00 2023-08-27T11:24:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb079199700 1 -- 172.21.15.43:0/1004036282 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064011d20 con 0x7fb0740c7c00 2023-08-27T11:24:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb07c3ff700 1 -- 172.21.15.43:0/1004036282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 msgr2=0x7fb0740c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/1004036282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb0740c8110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb064009870 tx=0x7fb064009b80 comp rx=0 tx=0).stop 2023-08-27T11:24:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb07c3ff700 1 -- 172.21.15.43:0/1004036282 shutdown_connections 2023-08-27T11:24:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/1004036282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb0740c8110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.888+0000 7fb07c3ff700 1 -- 172.21.15.43:0/1004036282 >> 172.21.15.43:0/1004036282 conn(0x7fb0740c9d00 msgr2=0x7fb0740ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:56.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.889+0000 7fb07c3ff700 1 -- 172.21.15.43:0/1004036282 shutdown_connections 2023-08-27T11:24:56.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.889+0000 7fb07c3ff700 1 -- 172.21.15.43:0/1004036282 wait complete. 2023-08-27T11:24:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.890+0000 7fb07c3ff700 1 Processor -- start 2023-08-27T11:24:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.890+0000 7fb07c3ff700 1 -- start start 2023-08-27T11:24:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 0x7fb0741ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb074157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0740c2a20 con 0x7fb074151d20 2023-08-27T11:24:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074148bb0 con 0x7fb07406a8e0 2023-08-27T11:24:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.891+0000 7fb07c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb074154410 con 0x7fb0740c7c00 2023-08-27T11:24:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59068/0 (socket says 172.21.15.43:59068) 2023-08-27T11:24:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 -- 172.21.15.43:0/3206955508 learned_addr learned my addr 172.21.15.43:0/3206955508 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a19b700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 0x7fb0741ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07999a700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb074157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 -- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 msgr2=0x7fb074157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb074157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 -- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 msgr2=0x7fb0741ea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 0x7fb0741ea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 -- 172.21.15.43:0/3206955508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640094a0 con 0x7fb074151d20 2023-08-27T11:24:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07999a700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb074157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a19b700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 0x7fb0741ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.892+0000 7fb07a99c700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cbc0 tx=0x7fb06c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.893+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00ab10 con 0x7fb074151d20 2023-08-27T11:24:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.893+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00ac70 con 0x7fb074151d20 2023-08-27T11:24:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.893+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c012400 con 0x7fb074151d20 2023-08-27T11:24:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.893+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb074153ae0 con 0x7fb074151d20 2023-08-27T11:24:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.893+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0741540a0 con 0x7fb074151d20 2023-08-27T11:24:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.894+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb074152190 con 0x7fb074151d20 2023-08-27T11:24:56.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.895+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb06c007d50 con 0x7fb074151d20 2023-08-27T11:24:56.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.896+0000 7fb06affd700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:56.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.896+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7fb06c0883a0 con 0x7fb074151d20 2023-08-27T11:24:56.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.896+0000 7fb07a19b700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:56.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.896+0000 7fb07a19b700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0700011e0 tx=0x7fb070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:56.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:56.900+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb074152190 con 0x7fb074151d20 2023-08-27T11:24:57.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.109+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb074152190 con 0x7fb074151d20 2023-08-27T11:24:57.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.110+0000 7fb06affd700 1 -- 172.21.15.43:0/3206955508 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb074152190 con 0x7fb074151d20 2023-08-27T11:24:57.112 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:24:57.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 msgr2=0x7fb05806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0700011e0 tx=0x7fb070009040 comp rx=0 tx=0).stop 2023-08-27T11:24:57.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 msgr2=0x7fb07414d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00cbc0 tx=0x7fb06c00cf80 comp rx=0 tx=0).stop 2023-08-27T11:24:57.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 shutdown_connections 2023-08-27T11:24:57.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb074151d20 0x7fb07414d1a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb07406a8e0 0x7fb0741ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 --2- 172.21.15.43:0/3206955508 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0740c7c00 0x7fb074157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 >> 172.21.15.43:0/3206955508 conn(0x7fb0740c9d00 msgr2=0x7fb0740ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:57.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 shutdown_connections 2023-08-27T11:24:57.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.112+0000 7fb07c3ff700 1 -- 172.21.15.43:0/3206955508 wait complete. 2023-08-27T11:24:57.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-27T11:24:57.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.335+0000 7f1ff9b9d700 1 Processor -- start 2023-08-27T11:24:57.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.335+0000 7f1ff9b9d700 1 -- start start 2023-08-27T11:24:57.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff9b9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff40c5d10 0x7f1ff40c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff9b9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff40c60f0 0x7f1ff414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff9b9d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff41553c0 con 0x7f1ff40c9610 2023-08-27T11:24:57.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff9b9d700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff41543b0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff9b9d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff4154600 con 0x7f1ff40c60f0 2023-08-27T11:24:57.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff40c5d10 0x7f1ff40c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff40c5d10 0x7f1ff40c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59080/0 (socket says 172.21.15.43:59080) 2023-08-27T11:24:57.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/3772582383 learned_addr learned my addr 172.21.15.43:0/3772582383 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:57.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/3772582383 >> v2:172.21.15.57:3300/0 conn(0x7f1ff40c60f0 0x7f1ff414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/3772582383 >> v2:172.21.15.57:3300/0 conn(0x7f1ff40c60f0 msgr2=0x7f1ff414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:57.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 --2- 172.21.15.43:0/3772582383 >> v2:172.21.15.57:3300/0 conn(0x7f1ff40c60f0 0x7f1ff414dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/3772582383 >> v1:172.21.15.57:6789/0 conn(0x7f1ff40c9610 legacy=0x7f1ff40c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.337+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/3772582383 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff41548e0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff8b9b700 1 --2- 172.21.15.43:0/3772582383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff40c4c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80098f0 tx=0x7f1fe8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8914e6c8d225a79c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff37fe700 1 -- 172.21.15.43:0/3772582383 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011830 con 0x7f1ff40c5d10 2023-08-27T11:24:57.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff37fe700 1 -- 172.21.15.43:0/3772582383 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8011990 con 0x7f1ff40c5d10 2023-08-27T11:24:57.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff37fe700 1 -- 172.21.15.43:0/3772582383 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011d20 con 0x7f1ff40c5d10 2023-08-27T11:24:57.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/3772582383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 msgr2=0x7f1ff40c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.338+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/3772582383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff40c4c90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80098f0 tx=0x7f1fe8009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:57.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/3772582383 shutdown_connections 2023-08-27T11:24:57.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/3772582383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff40c4c90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/3772582383 >> v2:172.21.15.57:3300/0 conn(0x7f1ff40c60f0 0x7f1ff414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/3772582383 >> 172.21.15.43:0/3772582383 conn(0x7f1ff40c9b60 msgr2=0x7f1ff40c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:57.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/3772582383 shutdown_connections 2023-08-27T11:24:57.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.339+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/3772582383 wait complete. 2023-08-27T11:24:57.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.340+0000 7f1ff9b9d700 1 Processor -- start 2023-08-27T11:24:57.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.340+0000 7f1ff9b9d700 1 -- start start 2023-08-27T11:24:57.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff40c60f0 0x7f1ff41e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff40c9610 0x7f1ff41e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41e9930 con 0x7f1ff40c5d10 2023-08-27T11:24:57.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41ed020 con 0x7f1ff40c60f0 2023-08-27T11:24:57.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff9b9d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41e9bb0 con 0x7f1ff40c9610 2023-08-27T11:24:57.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.341+0000 7f1ff8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59088/0 (socket says 172.21.15.43:59088) 2023-08-27T11:24:57.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/1031628192 learned_addr learned my addr 172.21.15.43:0/1031628192 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff40c60f0 0x7f1ff41e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff939c700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff40c9610 0x7f1ff41e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff40c9610 msgr2=0x7f1ff41e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff40c9610 0x7f1ff41e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff40c60f0 msgr2=0x7f1ff41e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff40c60f0 0x7f1ff41e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 -- 172.21.15.43:0/1031628192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009550 con 0x7f1ff40c5d10 2023-08-27T11:24:57.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff8b9b700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009c40 tx=0x7f1fe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004400 con 0x7f1ff40c5d10 2023-08-27T11:24:57.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe801f070 con 0x7f1ff40c5d10 2023-08-27T11:24:57.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.342+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80038c0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.343+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff41e9e90 con 0x7f1ff40c5d10 2023-08-27T11:24:57.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.343+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff414f840 con 0x7f1ff40c5d10 2023-08-27T11:24:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.344+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff41ea3b0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.345+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1fe8021030 con 0x7f1ff40c5d10 2023-08-27T11:24:57.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.346+0000 7f1ff17fa700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 0x7f1fd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.346+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f1fe8089ce0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.346+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 0x7f1fd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.347+0000 7f1ff3fff700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 0x7f1fd806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ff41ece00 tx=0x7f1fe0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.350+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1ff41ea3b0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.557+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ff41ea3b0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.557+0000 7f1ff17fa700 1 -- 172.21.15.43:0/1031628192 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v53) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1ff41ea3b0 con 0x7f1ff40c5d10 2023-08-27T11:24:57.559 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:24:57.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.559+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 msgr2=0x7f1fd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.559+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 0x7f1fd806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1ff41ece00 tx=0x7f1fe0009210 comp rx=0 tx=0).stop 2023-08-27T11:24:57.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.559+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 msgr2=0x7f1ff414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.559+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009c40 tx=0x7f1fe8004750 comp rx=0 tx=0).stop 2023-08-27T11:24:57.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 shutdown_connections 2023-08-27T11:24:57.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fd806a0e0 0x7f1fd806c5a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff40c9610 0x7f1ff41e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff40c5d10 0x7f1ff414f300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 --2- 172.21.15.43:0/1031628192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff40c60f0 0x7f1ff41e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 >> 172.21.15.43:0/1031628192 conn(0x7f1ff40c9b60 msgr2=0x7f1ff4152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:57.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 shutdown_connections 2023-08-27T11:24:57.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.560+0000 7f1ff9b9d700 1 -- 172.21.15.43:0/1031628192 wait complete. 2023-08-27T11:24:57.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-27T11:24:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.784+0000 7f7bdadff700 1 Processor -- start 2023-08-27T11:24:57.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.785+0000 7f7bdadff700 1 -- start start 2023-08-27T11:24:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bdadff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd406c5e0 0x7f7bd406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bdadff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7bd4155880 0x7f7bd4155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bdadff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd41561f0 con 0x7f7bd40c5230 2023-08-27T11:24:57.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bdadff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd4152290 con 0x7f7bd4155880 2023-08-27T11:24:57.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bdadff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd406d7a0 con 0x7f7bd406c5e0 2023-08-27T11:24:57.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd939c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7bd4155880 0x7f7bd4155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd8b9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7bd40c5230 0x7f7bd40aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52638/0 (socket says 172.21.15.43:52638) 2023-08-27T11:24:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd8b9b700 1 -- 172.21.15.43:0/3636671419 learned_addr learned my addr 172.21.15.43:0/3636671419 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd3fff700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd406c5e0 0x7f7bd406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd939c700 1 -- 172.21.15.43:0/3636671419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd406c5e0 msgr2=0x7f7bd406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd939c700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd406c5e0 0x7f7bd406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.786+0000 7f7bd939c700 1 -- 172.21.15.43:0/3636671419 >> v1:172.21.15.43:6789/0 conn(0x7f7bd40c5230 legacy=0x7f7bd40aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd939c700 1 -- 172.21.15.43:0/3636671419 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4152550 con 0x7f7bd4155880 2023-08-27T11:24:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd37fe700 1 -- 172.21.15.43:0/3636671419 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857651432 0 0) 0x7f7bd41561f0 con 0x7f7bd40c5230 2023-08-27T11:24:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd939c700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd4155880 0x7f7bd4155cb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009d90 tx=0x7f7bcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617dc56e0a64080b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd37fe700 1 -- 172.21.15.43:0/3636671419 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00e070 con 0x7f7bd4155880 2023-08-27T11:24:57.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd37fe700 1 -- 172.21.15.43:0/3636671419 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00bbd0 con 0x7f7bd4155880 2023-08-27T11:24:57.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.787+0000 7f7bd37fe700 1 -- 172.21.15.43:0/3636671419 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc012430 con 0x7f7bd4155880 2023-08-27T11:24:57.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 -- 172.21.15.43:0/3636671419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd4155880 msgr2=0x7f7bd4155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd4155880 0x7f7bd4155cb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009d90 tx=0x7f7bcc00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 -- 172.21.15.43:0/3636671419 shutdown_connections 2023-08-27T11:24:57.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd4155880 0x7f7bd4155cb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 --2- 172.21.15.43:0/3636671419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd406c5e0 0x7f7bd406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 -- 172.21.15.43:0/3636671419 >> 172.21.15.43:0/3636671419 conn(0x7f7bd40c5b10 msgr2=0x7f7bd40c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 -- 172.21.15.43:0/3636671419 shutdown_connections 2023-08-27T11:24:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.788+0000 7f7bdadff700 1 -- 172.21.15.43:0/3636671419 wait complete. 2023-08-27T11:24:57.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.789+0000 7f7bdadff700 1 Processor -- start 2023-08-27T11:24:57.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.790+0000 7f7bdadff700 1 -- start start 2023-08-27T11:24:57.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.790+0000 7f7bdadff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bdadff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd40c5230 0x7f7bd414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bdadff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4155880 0x7f7bd414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bdadff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd41ec500 con 0x7f7bd406c5e0 2023-08-27T11:24:57.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bdadff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd414b740 con 0x7f7bd40c5230 2023-08-27T11:24:57.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bdadff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd406f9e0 con 0x7f7bd4155880 2023-08-27T11:24:57.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59102/0 (socket says 172.21.15.43:59102) 2023-08-27T11:24:57.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 -- 172.21.15.43:0/437442034 learned_addr learned my addr 172.21.15.43:0/437442034 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:57.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd3fff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd40c5230 0x7f7bd414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd939c700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4155880 0x7f7bd414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 -- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4155880 msgr2=0x7f7bd414fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4155880 0x7f7bd414fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 -- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd40c5230 msgr2=0x7f7bd414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:57.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd40c5230 0x7f7bd414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:57.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.791+0000 7f7bd8b9b700 1 -- 172.21.15.43:0/437442034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc009a70 con 0x7f7bd406c5e0 2023-08-27T11:24:57.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bd8b9b700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80011e0 tx=0x7f7bc800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8004c80 con 0x7f7bd406c5e0 2023-08-27T11:24:57.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc8004e00 con 0x7f7bd406c5e0 2023-08-27T11:24:57.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8007310 con 0x7f7bd406c5e0 2023-08-27T11:24:57.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd41ec750 con 0x7f7bd406c5e0 2023-08-27T11:24:57.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.792+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd41ecd10 con 0x7f7bd406c5e0 2023-08-27T11:24:57.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.793+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd41ecf30 con 0x7f7bd406c5e0 2023-08-27T11:24:57.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.794+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7bc8007470 con 0x7f7bd406c5e0 2023-08-27T11:24:57.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.795+0000 7f7bd17fa700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 0x7f7bb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:57.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.795+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f7bc8088600 con 0x7f7bd406c5e0 2023-08-27T11:24:57.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.795+0000 7f7bd3fff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 0x7f7bb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:57.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.796+0000 7f7bd3fff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 0x7f7bb806c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bd41427b0 tx=0x7f7bc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:57.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:57.799+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7bc80538d0 con 0x7f7bd406c5e0 2023-08-27T11:24:58.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.008+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7bd404ee70 con 0x7f7bd406c5e0 2023-08-27T11:24:58.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.009+0000 7f7bd17fa700 1 -- 172.21.15.43:0/437442034 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v53) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7bc8056ef0 con 0x7f7bd406c5e0 2023-08-27T11:24:58.010 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:24:58.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 msgr2=0x7f7bb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 0x7f7bb806c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7bd41427b0 tx=0x7f7bc0008040 comp rx=0 tx=0).stop 2023-08-27T11:24:58.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 msgr2=0x7f7bd40c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80011e0 tx=0x7f7bc800ca30 comp rx=0 tx=0).stop 2023-08-27T11:24:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 shutdown_connections 2023-08-27T11:24:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7bb806a0e0 0x7f7bb806c5a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7bd4155880 0x7f7bd414fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7bd406c5e0 0x7f7bd40c2760 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 --2- 172.21.15.43:0/437442034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bd40c5230 0x7f7bd414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 >> 172.21.15.43:0/437442034 conn(0x7f7bd40c5b10 msgr2=0x7f7bd4151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:58.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 shutdown_connections 2023-08-27T11:24:58.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.011+0000 7f7bdadff700 1 -- 172.21.15.43:0/437442034 wait complete. 2023-08-27T11:24:58.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:58.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.232+0000 7fa8311ff700 1 Processor -- start 2023-08-27T11:24:58.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.233+0000 7fa8311ff700 1 -- start start 2023-08-27T11:24:58.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa8311ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa82c0c4630 0x7fa82c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa8311ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c06c4e0 con 0x7fa82c151a90 2023-08-27T11:24:58.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa8311ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c155370 con 0x7fa82c06ad70 2023-08-27T11:24:58.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa8311ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82c0c82c0 con 0x7fa82c0c4630 2023-08-27T11:24:58.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa823fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa82c0c4630 0x7fa82c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa82ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa82c151a90 0x7fa82c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52642/0 (socket says 172.21.15.43:52642) 2023-08-27T11:24:58.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.234+0000 7fa82ad9d700 1 -- 172.21.15.43:0/2875014401 learned_addr learned my addr 172.21.15.43:0/2875014401 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:58.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa823fff700 1 -- 172.21.15.43:0/2875014401 >> v1:172.21.15.57:6789/0 conn(0x7fa82c06ad70 legacy=0x7fa82c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa823fff700 1 -- 172.21.15.43:0/2875014401 >> v1:172.21.15.43:6789/0 conn(0x7fa82c151a90 legacy=0x7fa82c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa823fff700 1 -- 172.21.15.43:0/2875014401 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c151e70 con 0x7fa82c0c4630 2023-08-27T11:24:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa823fff700 1 --2- 172.21.15.43:0/2875014401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c0c4a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa814009840 tx=0x7fa814009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17830300d69e53a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa82a59c700 1 -- 172.21.15.43:0/2875014401 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011830 con 0x7fa82c0c4630 2023-08-27T11:24:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa82a59c700 1 -- 172.21.15.43:0/2875014401 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814011990 con 0x7fa82c0c4630 2023-08-27T11:24:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.235+0000 7fa82a59c700 1 -- 172.21.15.43:0/2875014401 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011d20 con 0x7fa82c0c4630 2023-08-27T11:24:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 -- 172.21.15.43:0/2875014401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 msgr2=0x7fa82c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 --2- 172.21.15.43:0/2875014401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c0c4a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa814009840 tx=0x7fa814009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 -- 172.21.15.43:0/2875014401 shutdown_connections 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 --2- 172.21.15.43:0/2875014401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c0c4a90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 -- 172.21.15.43:0/2875014401 >> 172.21.15.43:0/2875014401 conn(0x7fa82c0ab820 msgr2=0x7fa82c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 -- 172.21.15.43:0/2875014401 shutdown_connections 2023-08-27T11:24:58.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.236+0000 7fa8311ff700 1 -- 172.21.15.43:0/2875014401 wait complete. 2023-08-27T11:24:58.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.237+0000 7fa8311ff700 1 Processor -- start 2023-08-27T11:24:58.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 -- start start 2023-08-27T11:24:58.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa82c06ad70 0x7fa82c1e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa82c151a90 0x7fa82c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0c1100 con 0x7fa82c0c4630 2023-08-27T11:24:58.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c156030 con 0x7fa82c151a90 2023-08-27T11:24:58.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.238+0000 7fa8311ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c14c7e0 con 0x7fa82c06ad70 2023-08-27T11:24:58.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59114/0 (socket says 172.21.15.43:59114) 2023-08-27T11:24:58.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 -- 172.21.15.43:0/958331015 learned_addr learned my addr 172.21.15.43:0/958331015 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:58.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa82ad9d700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa82c06ad70 0x7fa82c1e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa82b59e700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa82c151a90 0x7fa82c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 -- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa82c06ad70 msgr2=0x7fa82c1e99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa82c06ad70 0x7fa82c1e99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 -- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa82c151a90 msgr2=0x7fa82c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa82c151a90 0x7fa82c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 -- 172.21.15.43:0/958331015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140094a0 con 0x7fa82c0c4630 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.239+0000 7fa823fff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa8140090b0 tx=0x7fa814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.240+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140038a0 con 0x7fa82c0c4630 2023-08-27T11:24:58.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.240+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81401f070 con 0x7fa82c0c4630 2023-08-27T11:24:58.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.240+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814003c60 con 0x7fa82c0c4630 2023-08-27T11:24:58.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.240+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c14d740 con 0x7fa82c0c4630 2023-08-27T11:24:58.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.240+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c0c0e20 con 0x7fa82c0c4630 2023-08-27T11:24:58.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.241+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c14c9e0 con 0x7fa82c0c4630 2023-08-27T11:24:58.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.242+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa81401a430 con 0x7fa82c0c4630 2023-08-27T11:24:58.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.243+0000 7fa8237fe700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 0x7fa80c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.243+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7fa814021070 con 0x7fa82c0c4630 2023-08-27T11:24:58.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.243+0000 7fa82ad9d700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 0x7fa80c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.244+0000 7fa82ad9d700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 0x7fa80c06c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005910 tx=0x7fa81c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.248+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa82c14c9e0 con 0x7fa82c0c4630 2023-08-27T11:24:58.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.503+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa82c14c9a0 con 0x7fa82c0c4630 2023-08-27T11:24:58.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.504+0000 7fa8237fe700 1 -- 172.21.15.43:0/958331015 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+6053 (secure 0 0 0) 0x7fa814055700 con 0x7fa82c0c4630 2023-08-27T11:24:58.506 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:58.506 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":45,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:57.562023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":53,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5351":{"gid":5351,"name":"d","rank":0,"incarnation":44,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.57:6835/4060215483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":4060215483},{"type":"v1","addr":"172.21.15.57:6835","nonce":4060215483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:58.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 msgr2=0x7fa80c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 0x7fa80c06c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa81c005910 tx=0x7fa81c009040 comp rx=0 tx=0).stop 2023-08-27T11:24:58.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 msgr2=0x7fa82c14ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa8140090b0 tx=0x7fa814004750 comp rx=0 tx=0).stop 2023-08-27T11:24:58.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 shutdown_connections 2023-08-27T11:24:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa80c06a0e0 0x7fa80c06c5a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa82c151a90 0x7fa82c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa82c06ad70 0x7fa82c1e99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 --2- 172.21.15.43:0/958331015 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa82c0c4630 0x7fa82c14ccc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 >> 172.21.15.43:0/958331015 conn(0x7fa82c0ab820 msgr2=0x7fa82c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:58.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 shutdown_connections 2023-08-27T11:24:58.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.506+0000 7fa8311ff700 1 -- 172.21.15.43:0/958331015 wait complete. 2023-08-27T11:24:58.510 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 45 2023-08-27T11:24:58.526 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:24:58.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.729+0000 7f18dd5ff700 1 Processor -- start 2023-08-27T11:24:58.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.729+0000 7f18dd5ff700 1 -- start start 2023-08-27T11:24:58.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18dd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18d814e960 0x7f18d80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18dd5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d8154d00 con 0x7f18d80c50d0 2023-08-27T11:24:58.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18dd5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d8154fe0 con 0x7f18d80a79c0 2023-08-27T11:24:58.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18dd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80baf30 con 0x7f18d814e960 2023-08-27T11:24:58.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18d77fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f18d80c50d0 0x7f18d80c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52644/0 (socket says 172.21.15.43:52644) 2023-08-27T11:24:58.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18d77fe700 1 -- 172.21.15.43:0/3186004997 learned_addr learned my addr 172.21.15.43:0/3186004997 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:24:58.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18d6ffd700 1 --2- 172.21.15.43:0/3186004997 >> v2:172.21.15.57:3300/0 conn(0x7f18d814e960 0x7f18d80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18d5ffb700 1 -- 172.21.15.43:0/3186004997 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774791004 0 0) 0x7f18d8154d00 con 0x7f18d80c50d0 2023-08-27T11:24:58.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.731+0000 7f18d5ffb700 1 -- 172.21.15.43:0/3186004997 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c00035b0 con 0x7f18d80c50d0 2023-08-27T11:24:58.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d6ffd700 1 -- 172.21.15.43:0/3186004997 >> v1:172.21.15.57:6789/0 conn(0x7f18d80a79c0 legacy=0x7f18d80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d6ffd700 1 -- 172.21.15.43:0/3186004997 >> v1:172.21.15.43:6789/0 conn(0x7f18d80c50d0 legacy=0x7f18d80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d6ffd700 1 -- 172.21.15.43:0/3186004997 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d81552c0 con 0x7f18d814e960 2023-08-27T11:24:58.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d6ffd700 1 --2- 172.21.15.43:0/3186004997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d80a7480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009840 tx=0x7f18c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ae1d1e9b3b27d67 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d5ffb700 1 -- 172.21.15.43:0/3186004997 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011830 con 0x7f18d814e960 2023-08-27T11:24:58.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d5ffb700 1 -- 172.21.15.43:0/3186004997 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8011990 con 0x7f18d814e960 2023-08-27T11:24:58.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.732+0000 7f18d5ffb700 1 -- 172.21.15.43:0/3186004997 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011d20 con 0x7f18d814e960 2023-08-27T11:24:58.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 -- 172.21.15.43:0/3186004997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 msgr2=0x7f18d80a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/3186004997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d80a7480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009840 tx=0x7f18c8009b50 comp rx=0 tx=0).stop 2023-08-27T11:24:58.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 -- 172.21.15.43:0/3186004997 shutdown_connections 2023-08-27T11:24:58.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/3186004997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d80a7480 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 -- 172.21.15.43:0/3186004997 >> 172.21.15.43:0/3186004997 conn(0x7f18d806aa50 msgr2=0x7f18d80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:58.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 -- 172.21.15.43:0/3186004997 shutdown_connections 2023-08-27T11:24:58.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.733+0000 7f18dd5ff700 1 -- 172.21.15.43:0/3186004997 wait complete. 2023-08-27T11:24:58.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.735+0000 7f18dd5ff700 1 Processor -- start 2023-08-27T11:24:58.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.735+0000 7f18dd5ff700 1 -- start start 2023-08-27T11:24:58.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18d80c50d0 0x7f18d8071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d8071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81ea740 con 0x7f18d80a79c0 2023-08-27T11:24:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80bc9c0 con 0x7f18d814e960 2023-08-27T11:24:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18dd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80bcca0 con 0x7f18d80c50d0 2023-08-27T11:24:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:59124/0 (socket says 172.21.15.43:59124) 2023-08-27T11:24:58.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 -- 172.21.15.43:0/490331281 learned_addr learned my addr 172.21.15.43:0/490331281 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:58.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d77fe700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d8071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d67fc700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18d80c50d0 0x7f18d8071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 -- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18d80c50d0 msgr2=0x7f18d8071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18d80c50d0 0x7f18d8071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 -- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 msgr2=0x7f18d8071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d8071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.736+0000 7f18d6ffd700 1 -- 172.21.15.43:0/490331281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c80094a0 con 0x7f18d80a79c0 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18d6ffd700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009b90 tx=0x7f18c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80036a0 con 0x7f18d80a79c0 2023-08-27T11:24:58.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c801e070 con 0x7f18d80a79c0 2023-08-27T11:24:58.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8003a20 con 0x7f18d80a79c0 2023-08-27T11:24:58.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d81e7fb0 con 0x7f18d80a79c0 2023-08-27T11:24:58.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.737+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d8151430 con 0x7f18d80a79c0 2023-08-27T11:24:58.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.738+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d804ee70 con 0x7f18d80a79c0 2023-08-27T11:24:58.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.739+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18c8003b80 con 0x7f18d80a79c0 2023-08-27T11:24:58.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.740+0000 7f18bf7fe700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 0x7f18c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:58.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.740+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f18c80898d0 con 0x7f18d80a79c0 2023-08-27T11:24:58.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.740+0000 7f18d67fc700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 0x7f18c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:58.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.741+0000 7f18d67fc700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 0x7f18c406c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18d8150080 tx=0x7f18cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:58.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.745+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f18c8054ba0 con 0x7f18d80a79c0 2023-08-27T11:24:58.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.960+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18d80ab3f0 con 0x7f18d80a79c0 2023-08-27T11:24:58.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.962+0000 7f18bf7fe700 1 -- 172.21.15.43:0/490331281 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+22150 (secure 0 0 0) 0x7f18c80581c0 con 0x7f18d80a79c0 2023-08-27T11:24:58.963 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:58.964 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":53,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:56.549253+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:24:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 msgr2=0x7f18c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 0x7f18c406c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f18d8150080 tx=0x7f18cc009040 comp rx=0 tx=0).stop 2023-08-27T11:24:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 msgr2=0x7f18d80aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:58.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009b90 tx=0x7f18c8004750 comp rx=0 tx=0).stop 2023-08-27T11:24:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 shutdown_connections 2023-08-27T11:24:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f18c406a0e0 0x7f18c406c5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d814e960 0x7f18d8071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18d80a79c0 0x7f18d80aaeb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 --2- 172.21.15.43:0/490331281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18d80c50d0 0x7f18d8071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 >> 172.21.15.43:0/490331281 conn(0x7f18d806aa50 msgr2=0x7f18d80c0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 shutdown_connections 2023-08-27T11:24:58.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:58.964+0000 7f18dd5ff700 1 -- 172.21.15.43:0/490331281 wait complete. 2023-08-27T11:24:58.984 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:24:58.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.183+0000 7f4f1d9ff700 1 Processor -- start 2023-08-27T11:24:59.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.184+0000 7f4f1d9ff700 1 -- start start 2023-08-27T11:24:59.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f1d9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f180c51a0 0x7f4f1806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f1d9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4f1806ca60 0x7f4f180aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f1d9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1806d700 con 0x7f4f180ab040 2023-08-27T11:24:59.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f1d9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f181530b0 con 0x7f4f1806ca60 2023-08-27T11:24:59.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f1d9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1814c860 con 0x7f4f180c51a0 2023-08-27T11:24:59.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f167fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4f1806ca60 0x7f4f180aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f167fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4f1806ca60 0x7f4f180aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48592/0 (socket says 172.21.15.43:48592) 2023-08-27T11:24:59.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f167fc700 1 -- 172.21.15.43:0/107501166 learned_addr learned my addr 172.21.15.43:0/107501166 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:59.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f16ffd700 1 --2- 172.21.15.43:0/107501166 >> v2:172.21.15.57:3300/0 conn(0x7f4f180c51a0 0x7f4f1806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.185+0000 7f4f167fc700 1 -- 172.21.15.43:0/107501166 >> v2:172.21.15.57:3300/0 conn(0x7f4f180c51a0 msgr2=0x7f4f1806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:59.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f167fc700 1 --2- 172.21.15.43:0/107501166 >> v2:172.21.15.57:3300/0 conn(0x7f4f180c51a0 0x7f4f1806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f167fc700 1 -- 172.21.15.43:0/107501166 >> v1:172.21.15.57:6789/0 conn(0x7f4f180ab040 legacy=0x7f4f18155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f167fc700 1 -- 172.21.15.43:0/107501166 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18152430 con 0x7f4f1806ca60 2023-08-27T11:24:59.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f167fc700 1 --2- 172.21.15.43:0/107501166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f1806ca60 0x7f4f180aab00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806db90 tx=0x7f4f0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6222af9c1de6090 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f15ffb700 1 -- 172.21.15.43:0/107501166 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011830 con 0x7f4f1806ca60 2023-08-27T11:24:59.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f15ffb700 1 -- 172.21.15.43:0/107501166 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c011990 con 0x7f4f1806ca60 2023-08-27T11:24:59.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.186+0000 7f4f15ffb700 1 -- 172.21.15.43:0/107501166 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c011d20 con 0x7f4f1806ca60 2023-08-27T11:24:59.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/107501166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f1806ca60 msgr2=0x7f4f180aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/107501166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f1806ca60 0x7f4f180aab00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806db90 tx=0x7f4f0c009c00 comp rx=0 tx=0).stop 2023-08-27T11:24:59.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/107501166 shutdown_connections 2023-08-27T11:24:59.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/107501166 >> v2:172.21.15.57:3300/0 conn(0x7f4f180c51a0 0x7f4f1806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/107501166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f1806ca60 0x7f4f180aab00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/107501166 >> 172.21.15.43:0/107501166 conn(0x7f4f1806aa50 msgr2=0x7f4f180c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:59.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/107501166 shutdown_connections 2023-08-27T11:24:59.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.187+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/107501166 wait complete. 2023-08-27T11:24:59.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.188+0000 7f4f1d9ff700 1 Processor -- start 2023-08-27T11:24:59.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 -- start start 2023-08-27T11:24:59.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1806ca60 0x7f4f1814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 0x7f4f180aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180a9700 con 0x7f4f180ab040 2023-08-27T11:24:59.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180aa5a0 con 0x7f4f1806ca60 2023-08-27T11:24:59.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.189+0000 7f4f1d9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180705d0 con 0x7f4f180c51a0 2023-08-27T11:24:59.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48604/0 (socket says 172.21.15.43:48604) 2023-08-27T11:24:59.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 -- 172.21.15.43:0/893710603 learned_addr learned my addr 172.21.15.43:0/893710603 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:59.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f16ffd700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1806ca60 0x7f4f1814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f177fe700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 0x7f4f180aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 -- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 msgr2=0x7f4f180aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 0x7f4f180aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 -- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1806ca60 msgr2=0x7f4f1814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1806ca60 0x7f4f1814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 -- 172.21.15.43:0/893710603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009550 con 0x7f4f180ab040 2023-08-27T11:24:59.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f177fe700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 0x7f4f180aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:24:59.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.190+0000 7f4f167fc700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009c40 tx=0x7f4f0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.191+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c004480 con 0x7f4f180ab040 2023-08-27T11:24:59.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.191+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c01f070 con 0x7f4f180ab040 2023-08-27T11:24:59.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.191+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1814f4a0 con 0x7f4f180ab040 2023-08-27T11:24:59.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.191+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0038c0 con 0x7f4f180ab040 2023-08-27T11:24:59.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.191+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180a9320 con 0x7f4f180ab040 2023-08-27T11:24:59.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.192+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180a9840 con 0x7f4f180ab040 2023-08-27T11:24:59.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.193+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f0c021030 con 0x7f4f180ab040 2023-08-27T11:24:59.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.194+0000 7f4efffff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.194+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f4f0c089dc0 con 0x7f4f180ab040 2023-08-27T11:24:59.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.195+0000 7f4f16ffd700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.195+0000 7f4f16ffd700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f18072150 tx=0x7f4f08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.199+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f180a9840 con 0x7f4f180ab040 2023-08-27T11:24:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.453+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f180a9840 con 0x7f4f180ab040 2023-08-27T11:24:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.454+0000 7f4efffff700 1 -- 172.21.15.43:0/893710603 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6050 (secure 0 0 0) 0x7f4f180a9840 con 0x7f4f180ab040 2023-08-27T11:24:59.456 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:59.456 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":46,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:58.569746+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":53,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5351":{"gid":5351,"name":"d","rank":0,"incarnation":44,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.57:6835/4060215483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":4060215483},{"type":"v1","addr":"172.21.15.57:6835","nonce":4060215483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.456+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 msgr2=0x7f4f0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.456+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4f18072150 tx=0x7f4f08008040 comp rx=0 tx=0).stop 2023-08-27T11:24:59.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.456+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 msgr2=0x7f4f180a9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.456+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009c40 tx=0x7f4f0c004750 comp rx=0 tx=0).stop 2023-08-27T11:24:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 shutdown_connections 2023-08-27T11:24:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f180c51a0 0x7f4f180aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f1806ca60 0x7f4f1814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 --2- 172.21.15.43:0/893710603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f180ab040 0x7f4f180a9b20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 >> 172.21.15.43:0/893710603 conn(0x7f4f1806aa50 msgr2=0x7f4f180baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 shutdown_connections 2023-08-27T11:24:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.457+0000 7f4f1d9ff700 1 -- 172.21.15.43:0/893710603 wait complete. 2023-08-27T11:24:59.460 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 46 2023-08-27T11:24:59.476 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:24:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.677+0000 7f925b1ff700 1 Processor -- start 2023-08-27T11:24:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.677+0000 7f925b1ff700 1 -- start start 2023-08-27T11:24:59.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9254151a90 0x7f92540c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f92540c4630 0x7f92540c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f925406ad70 0x7f925406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925406c4e0 con 0x7f925406ad70 2023-08-27T11:24:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9254155370 con 0x7f92540c4630 2023-08-27T11:24:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.678+0000 7f925b1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9254151e70 con 0x7f9254151a90 2023-08-27T11:24:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f925406ad70 0x7f925406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f925406ad70 0x7f925406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48606/0 (socket says 172.21.15.43:48606) 2023-08-27T11:24:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 -- 172.21.15.43:0/118734668 learned_addr learned my addr 172.21.15.43:0/118734668 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f9253fff700 1 --2- 172.21.15.43:0/118734668 >> v2:172.21.15.57:3300/0 conn(0x7f92540c4630 0x7f92540c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f9258f9b700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9254151a90 0x7f92540c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 -- 172.21.15.43:0/118734668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9254151a90 msgr2=0x7f92540c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9254151a90 0x7f92540c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 -- 172.21.15.43:0/118734668 >> v2:172.21.15.57:3300/0 conn(0x7f92540c4630 msgr2=0x7f92540c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:24:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 --2- 172.21.15.43:0/118734668 >> v2:172.21.15.57:3300/0 conn(0x7f92540c4630 0x7f92540c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 -- 172.21.15.43:0/118734668 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254154480 con 0x7f925406ad70 2023-08-27T11:24:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f925979c700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f925406ad70 0x7f925406b200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f92540ac480 tx=0x7f924c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d8857fe6e77016 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.679+0000 7f92537fe700 1 -- 172.21.15.43:0/118734668 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00e070 con 0x7f925406ad70 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f92537fe700 1 -- 172.21.15.43:0/118734668 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c00b9c0 con 0x7f925406ad70 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f92537fe700 1 -- 172.21.15.43:0/118734668 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00bd70 con 0x7f925406ad70 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 -- 172.21.15.43:0/118734668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f925406ad70 msgr2=0x7f925406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f925406ad70 0x7f925406b200 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f92540ac480 tx=0x7f924c00b330 comp rx=0 tx=0).stop 2023-08-27T11:24:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 -- 172.21.15.43:0/118734668 shutdown_connections 2023-08-27T11:24:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f925406ad70 0x7f925406b200 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 --2- 172.21.15.43:0/118734668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9254151a90 0x7f92540c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 --2- 172.21.15.43:0/118734668 >> v2:172.21.15.57:3300/0 conn(0x7f92540c4630 0x7f92540c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 -- 172.21.15.43:0/118734668 >> 172.21.15.43:0/118734668 conn(0x7f92540ab820 msgr2=0x7f92540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 -- 172.21.15.43:0/118734668 shutdown_connections 2023-08-27T11:24:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.680+0000 7f925b1ff700 1 -- 172.21.15.43:0/118734668 wait complete. 2023-08-27T11:24:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.683+0000 7f925b1ff700 1 Processor -- start 2023-08-27T11:24:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.683+0000 7f925b1ff700 1 -- start start 2023-08-27T11:24:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f925406ad70 0x7f92540c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92540c4630 0x7f9254153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254152940 con 0x7f9254151a90 2023-08-27T11:24:59.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92541542d0 con 0x7f92540c4630 2023-08-27T11:24:59.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925b1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9254152e90 con 0x7f925406ad70 2023-08-27T11:24:59.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925979c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f9258f9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f925406ad70 0x7f92540c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925979c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48612/0 (socket says 172.21.15.43:48612) 2023-08-27T11:24:59.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f925979c700 1 -- 172.21.15.43:0/3250875959 learned_addr learned my addr 172.21.15.43:0/3250875959 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:24:59.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.684+0000 7f9253fff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92540c4630 0x7f9254153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 -- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f925406ad70 msgr2=0x7f92540c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f925406ad70 0x7f92540c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 -- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92540c4630 msgr2=0x7f9254153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92540c4630 0x7f9254153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 -- 172.21.15.43:0/3250875959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c009b30 con 0x7f9254151a90 2023-08-27T11:24:59.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925979c700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f92540ac6e0 tx=0x7f924c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0099b0 con 0x7f9254151a90 2023-08-27T11:24:59.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c004250 con 0x7f9254151a90 2023-08-27T11:24:59.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925414a820 con 0x7f9254151a90 2023-08-27T11:24:59.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c004600 con 0x7f9254151a90 2023-08-27T11:24:59.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.685+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9254152b20 con 0x7f9254151a90 2023-08-27T11:24:59.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.687+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540c9a70 con 0x7f9254151a90 2023-08-27T11:24:59.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.687+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f924c004760 con 0x7f9254151a90 2023-08-27T11:24:59.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.688+0000 7f92517fa700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:24:59.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.689+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f924c089da0 con 0x7f9254151a90 2023-08-27T11:24:59.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.689+0000 7f9258f9b700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:24:59.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.689+0000 7f9258f9b700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 0x7f923806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9248006b20 tx=0x7f9248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:24:59.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.693+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f924c055120 con 0x7f9254151a90 2023-08-27T11:24:59.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.946+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f925404ee70 con 0x7f9254151a90 2023-08-27T11:24:59.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.946+0000 7f92517fa700 1 -- 172.21.15.43:0/3250875959 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+6050 (secure 0 0 0) 0x7f924c020090 con 0x7f9254151a90 2023-08-27T11:24:59.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:24:59.948 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":47,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:32.790907+0000","modified":"2023-08-27T11:24:59.577748+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":53,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5351":{"gid":5351,"name":"d","rank":0,"incarnation":44,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6835/4060215483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":4060215483},{"type":"v1","addr":"172.21.15.57:6835","nonce":4060215483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:24:59.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 msgr2=0x7f923806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 0x7f923806c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9248006b20 tx=0x7f9248008040 comp rx=0 tx=0).stop 2023-08-27T11:24:59.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 msgr2=0x7f9254148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:24:59.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f92540ac6e0 tx=0x7f924c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 shutdown_connections 2023-08-27T11:24:59.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f923806a0e0 0x7f923806c5a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9254151a90 0x7f9254148a60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f925406ad70 0x7f92540c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 --2- 172.21.15.43:0/3250875959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92540c4630 0x7f9254153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:24:59.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 >> 172.21.15.43:0/3250875959 conn(0x7f92540ab820 msgr2=0x7f925414e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:24:59.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 shutdown_connections 2023-08-27T11:24:59.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:24:59.949+0000 7f925b1ff700 1 -- 172.21.15.43:0/3250875959 wait complete. 2023-08-27T11:24:59.953 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 47 2023-08-27T11:24:59.968 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.168+0000 7f3ba81ff700 1 Processor -- start 2023-08-27T11:25:00.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.169+0000 7f3ba81ff700 1 -- start start 2023-08-27T11:25:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba81ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ba006ca60 0x7f3ba006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba81ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba0155910 0x7f3ba0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba81ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba006d700 con 0x7f3ba00c51a0 2023-08-27T11:25:00.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba81ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba01530b0 con 0x7f3ba0155910 2023-08-27T11:25:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba81ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba014c860 con 0x7f3ba006ca60 2023-08-27T11:25:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba0155910 0x7f3ba0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3ba0155910 0x7f3ba0155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48614/0 (socket says 172.21.15.43:48614) 2023-08-27T11:25:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba679c700 1 -- 172.21.15.43:0/3016473494 learned_addr learned my addr 172.21.15.43:0/3016473494 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:00.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba579a700 1 --2- 172.21.15.43:0/3016473494 >> v2:172.21.15.57:3300/0 conn(0x7f3ba006ca60 0x7f3ba006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.170+0000 7f3ba679c700 1 -- 172.21.15.43:0/3016473494 >> v2:172.21.15.57:3300/0 conn(0x7f3ba006ca60 msgr2=0x7f3ba006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba679c700 1 --2- 172.21.15.43:0/3016473494 >> v2:172.21.15.57:3300/0 conn(0x7f3ba006ca60 0x7f3ba006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba679c700 1 -- 172.21.15.43:0/3016473494 >> v1:172.21.15.57:6789/0 conn(0x7f3ba00c51a0 legacy=0x7f3ba00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba679c700 1 -- 172.21.15.43:0/3016473494 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0152430 con 0x7f3ba0155910 2023-08-27T11:25:00.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba679c700 1 --2- 172.21.15.43:0/3016473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba0155910 0x7f3ba0155d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00aba70 tx=0x7f3b9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919a60fb1642da73 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba4f99700 1 -- 172.21.15.43:0/3016473494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9800e070 con 0x7f3ba0155910 2023-08-27T11:25:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba4f99700 1 -- 172.21.15.43:0/3016473494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b98003a20 con 0x7f3ba0155910 2023-08-27T11:25:00.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.171+0000 7f3ba4f99700 1 -- 172.21.15.43:0/3016473494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98003dd0 con 0x7f3ba0155910 2023-08-27T11:25:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3016473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba0155910 msgr2=0x7f3ba0155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3016473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba0155910 0x7f3ba0155d80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00aba70 tx=0x7f3b9800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3016473494 shutdown_connections 2023-08-27T11:25:00.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3016473494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba0155910 0x7f3ba0155d80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3016473494 >> v2:172.21.15.57:3300/0 conn(0x7f3ba006ca60 0x7f3ba006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3016473494 >> 172.21.15.43:0/3016473494 conn(0x7f3ba006aa50 msgr2=0x7f3ba00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3016473494 shutdown_connections 2023-08-27T11:25:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.172+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3016473494 wait complete. 2023-08-27T11:25:00.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.173+0000 7f3ba81ff700 1 Processor -- start 2023-08-27T11:25:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.174+0000 7f3ba81ff700 1 -- start start 2023-08-27T11:25:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba00c51a0 0x7f3ba0070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba0155910 0x7f3ba00714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0071a30 con 0x7f3ba006ca60 2023-08-27T11:25:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00a8180 con 0x7f3ba00c51a0 2023-08-27T11:25:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba81ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00a7870 con 0x7f3ba0155910 2023-08-27T11:25:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48626/0 (socket says 172.21.15.43:48626) 2023-08-27T11:25:00.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 -- 172.21.15.43:0/3850471891 learned_addr learned my addr 172.21.15.43:0/3850471891 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 -- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba0155910 msgr2=0x7f3ba00714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba0155910 0x7f3ba00714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 -- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba00c51a0 msgr2=0x7f3ba0070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba00c51a0 0x7f3ba0070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 -- 172.21.15.43:0/3850471891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009b30 con 0x7f3ba006ca60 2023-08-27T11:25:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.175+0000 7f3ba5f9b700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00c4d0 tx=0x7f3b9c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.176+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c011790 con 0x7f3ba006ca60 2023-08-27T11:25:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.176+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0118f0 con 0x7f3ba006ca60 2023-08-27T11:25:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.176+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c011ca0 con 0x7f3ba006ca60 2023-08-27T11:25:00.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.176+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba01e7dd0 con 0x7f3ba006ca60 2023-08-27T11:25:00.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.176+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba00a7e10 con 0x7f3ba006ca60 2023-08-27T11:25:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.177+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00a7fd0 con 0x7f3ba006ca60 2023-08-27T11:25:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.178+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b9c01c460 con 0x7f3ba006ca60 2023-08-27T11:25:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.179+0000 7f3b967fc700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 0x7f3b8406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.179+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f3b9c088780 con 0x7f3ba006ca60 2023-08-27T11:25:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.179+0000 7f3ba579a700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 0x7f3b8406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.180+0000 7f3ba579a700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 0x7f3b8406c5d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0072810 tx=0x7f3b90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.183+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b9c053a50 con 0x7f3ba006ca60 2023-08-27T11:25:00.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.396+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba004ee70 con 0x7f3ba006ca60 2023-08-27T11:25:00.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.398+0000 7f3b967fc700 1 -- 172.21.15.43:0/3850471891 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+22150 (secure 0 0 0) 0x7f3b9c057070 con 0x7f3ba006ca60 2023-08-27T11:25:00.400 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:00.400 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":53,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:24:56.549253+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:24:31.109964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-27T11:24:31.765112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:00.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 msgr2=0x7f3b8406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 0x7f3b8406c5d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0072810 tx=0x7f3b90008040 comp rx=0 tx=0).stop 2023-08-27T11:25:00.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 msgr2=0x7f3ba00bbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00c4d0 tx=0x7f3b9c00c890 comp rx=0 tx=0).stop 2023-08-27T11:25:00.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 shutdown_connections 2023-08-27T11:25:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3b8406a110 0x7f3b8406c5d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ba0155910 0x7f3ba00714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3ba006ca60 0x7f3ba00bbb50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 --2- 172.21.15.43:0/3850471891 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ba00c51a0 0x7f3ba0070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 >> 172.21.15.43:0/3850471891 conn(0x7f3ba006aa50 msgr2=0x7f3ba0155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 shutdown_connections 2023-08-27T11:25:00.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.401+0000 7f3ba81ff700 1 -- 172.21.15.43:0/3850471891 wait complete. 2023-08-27T11:25:00.422 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:25:00.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.624+0000 7f87f7fff700 1 Processor -- start 2023-08-27T11:25:00.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.625+0000 7f87f7fff700 1 -- start start 2023-08-27T11:25:00.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87f00c4630 0x7f87f00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f7fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f006c4e0 con 0x7f87f0151a90 2023-08-27T11:25:00.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f7fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f0155370 con 0x7f87f006ad70 2023-08-27T11:25:00.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f7fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00c82c0 con 0x7f87f00c4630 2023-08-27T11:25:00.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f5d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f87f0151a90 0x7f87f00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59074/0 (socket says 172.21.15.43:59074) 2023-08-27T11:25:00.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f5d9b700 1 -- 172.21.15.43:0/1745073281 learned_addr learned my addr 172.21.15.43:0/1745073281 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:00.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.626+0000 7f87f559a700 1 --2- 172.21.15.43:0/1745073281 >> v2:172.21.15.57:3300/0 conn(0x7f87f00c4630 0x7f87f00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225546179 0 0) 0x7f87f006c4e0 con 0x7f87f0151a90 2023-08-27T11:25:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc0035b0 con 0x7f87f0151a90 2023-08-27T11:25:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321961550 0 0) 0x7f87f0155370 con 0x7f87f006ad70 2023-08-27T11:25:00.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f006c4e0 con 0x7f87f006ad70 2023-08-27T11:25:00.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f559a700 1 -- 172.21.15.43:0/1745073281 >> v1:172.21.15.57:6789/0 conn(0x7f87f006ad70 legacy=0x7f87f006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f559a700 1 -- 172.21.15.43:0/1745073281 >> v1:172.21.15.43:6789/0 conn(0x7f87f0151a90 legacy=0x7f87f00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f559a700 1 -- 172.21.15.43:0/1745073281 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0151e70 con 0x7f87f00c4630 2023-08-27T11:25:00.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.627+0000 7f87f559a700 1 --2- 172.21.15.43:0/1745073281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c4a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009840 tx=0x7f87e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5532c0bf9d42bb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011830 con 0x7f87f00c4630 2023-08-27T11:25:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0011990 con 0x7f87f00c4630 2023-08-27T11:25:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f4d99700 1 -- 172.21.15.43:0/1745073281 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0011d20 con 0x7f87f00c4630 2023-08-27T11:25:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 -- 172.21.15.43:0/1745073281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 msgr2=0x7f87f00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 --2- 172.21.15.43:0/1745073281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c4a90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f87e0009840 tx=0x7f87e0009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:00.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 -- 172.21.15.43:0/1745073281 shutdown_connections 2023-08-27T11:25:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 --2- 172.21.15.43:0/1745073281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c4a90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 -- 172.21.15.43:0/1745073281 >> 172.21.15.43:0/1745073281 conn(0x7f87f00ab820 msgr2=0x7f87f00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 -- 172.21.15.43:0/1745073281 shutdown_connections 2023-08-27T11:25:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.628+0000 7f87f7fff700 1 -- 172.21.15.43:0/1745073281 wait complete. 2023-08-27T11:25:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.630+0000 7f87f7fff700 1 Processor -- start 2023-08-27T11:25:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.630+0000 7f87f7fff700 1 -- start start 2023-08-27T11:25:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f006ad70 0x7f87f014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00aa170 con 0x7f87f0151a90 2023-08-27T11:25:00.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01446c0 con 0x7f87f00c4630 2023-08-27T11:25:00.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f7fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00a9840 con 0x7f87f006ad70 2023-08-27T11:25:00.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48638/0 (socket says 172.21.15.43:48638) 2023-08-27T11:25:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.631+0000 7f87f659c700 1 -- 172.21.15.43:0/451651947 learned_addr learned my addr 172.21.15.43:0/451651947 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f5d9b700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f006ad70 0x7f87f014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f559a700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 -- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f006ad70 msgr2=0x7f87f014d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f006ad70 0x7f87f014d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 -- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 msgr2=0x7f87f00c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 -- 172.21.15.43:0/451651947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00094a0 con 0x7f87f0151a90 2023-08-27T11:25:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f659c700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f87e800cc20 tx=0x7f87e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e800ac20 con 0x7f87f0151a90 2023-08-27T11:25:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800ad80 con 0x7f87f0151a90 2023-08-27T11:25:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8003c20 con 0x7f87f0151a90 2023-08-27T11:25:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.632+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00a9b20 con 0x7f87f0151a90 2023-08-27T11:25:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.633+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f014de70 con 0x7f87f0151a90 2023-08-27T11:25:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.634+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00aa320 con 0x7f87f0151a90 2023-08-27T11:25:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.634+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f87e80050d0 con 0x7f87f0151a90 2023-08-27T11:25:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.635+0000 7f87e67fc700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 0x7f87d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.635+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f87e8088b00 con 0x7f87f0151a90 2023-08-27T11:25:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.636+0000 7f87f5d9b700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 0x7f87d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.636+0000 7f87f5d9b700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 0x7f87d406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0011e0 tx=0x7f87ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.640+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f87f00aa320 con 0x7f87f0151a90 2023-08-27T11:25:00.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.896+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f87f00aa320 con 0x7f87f0151a90 2023-08-27T11:25:00.898 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:25:00.897+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:25:00.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.901+0000 7f87e67fc700 1 -- 172.21.15.43:0/451651947 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f87f00aa320 con 0x7f87f0151a90 2023-08-27T11:25:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 msgr2=0x7f87d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 0x7f87d406c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0011e0 tx=0x7f87ec009040 comp rx=0 tx=0).stop 2023-08-27T11:25:00.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 msgr2=0x7f87f00aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f87e800cc20 tx=0x7f87e800a060 comp rx=0 tx=0).stop 2023-08-27T11:25:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 shutdown_connections 2023-08-27T11:25:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87d406a0e0 0x7f87d406c5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f0151a90 0x7f87f00aa600 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f006ad70 0x7f87f014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 --2- 172.21.15.43:0/451651947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f00c4630 0x7f87f00c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.903+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 >> 172.21.15.43:0/451651947 conn(0x7f87f00ab820 msgr2=0x7f87f006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.904+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 shutdown_connections 2023-08-27T11:25:00.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:00.904+0000 7f87f7fff700 1 -- 172.21.15.43:0/451651947 wait complete. 2023-08-27T11:25:00.908 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:25:00.923 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:25:00.955 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:25:01.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.130+0000 7fbfe0fff700 1 Processor -- start 2023-08-27T11:25:01.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.130+0000 7fbfe0fff700 1 -- start start 2023-08-27T11:25:01.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfe0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 0x7fbfdc15fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:01.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfe0fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0c5ae0 con 0x7fbfdc0c51a0 2023-08-27T11:25:01.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfe0fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0c1190 con 0x7fbfdc151910 2023-08-27T11:25:01.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfe0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc072900 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfd3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbfdc0c51a0 0x7fbfdc0c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59088/0 (socket says 172.21.15.43:59088) 2023-08-27T11:25:01.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfd3fff700 1 -- 172.21.15.43:0/14855500 learned_addr learned my addr 172.21.15.43:0/14855500 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:01.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.131+0000 7fbfdad9d700 1 --2- 172.21.15.43:0/14855500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 0x7fbfdc15fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:01.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880706060 0 0) 0x7fbfdc0c5ae0 con 0x7fbfdc0c51a0 2023-08-27T11:25:01.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc80035b0 con 0x7fbfdc0c51a0 2023-08-27T11:25:01.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048563079 0 0) 0x7fbfdc0c1190 con 0x7fbfdc151910 2023-08-27T11:25:01.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfdc0c5ae0 con 0x7fbfdc151910 2023-08-27T11:25:01.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfdad9d700 1 -- 172.21.15.43:0/14855500 >> v1:172.21.15.57:6789/0 conn(0x7fbfdc151910 legacy=0x7fbfdc157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfdad9d700 1 -- 172.21.15.43:0/14855500 >> v1:172.21.15.43:6789/0 conn(0x7fbfdc0c51a0 legacy=0x7fbfdc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfdad9d700 1 -- 172.21.15.43:0/14855500 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0c6c00 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfdad9d700 1 --2- 172.21.15.43:0/14855500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 0x7fbfdc15fda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009dc0 tx=0x7fbfd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261cfc3859723a94 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:01.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.132+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd400e070 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd400bb20 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfd9d9b700 1 -- 172.21.15.43:0/14855500 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4012430 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 -- 172.21.15.43:0/14855500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 msgr2=0x7fbfdc15fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/14855500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 0x7fbfdc15fda0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009dc0 tx=0x7fbfd400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 -- 172.21.15.43:0/14855500 shutdown_connections 2023-08-27T11:25:01.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/14855500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc0c15e0 0x7fbfdc15fda0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 -- 172.21.15.43:0/14855500 >> 172.21.15.43:0/14855500 conn(0x7fbfdc0a9740 msgr2=0x7fbfdc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:01.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 -- 172.21.15.43:0/14855500 shutdown_connections 2023-08-27T11:25:01.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.133+0000 7fbfe0fff700 1 -- 172.21.15.43:0/14855500 wait complete. 2023-08-27T11:25:01.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.135+0000 7fbfe0fff700 1 Processor -- start 2023-08-27T11:25:01.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.135+0000 7fbfe0fff700 1 -- start start 2023-08-27T11:25:01.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:01.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 0x7fbfdc152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:01.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc151910 0x7fbfdc14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:01.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc06e3c0 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0ac250 con 0x7fbfdc0c51a0 2023-08-27T11:25:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfe0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc06b800 con 0x7fbfdc151910 2023-08-27T11:25:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfda59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48644/0 (socket says 172.21.15.43:48644) 2023-08-27T11:25:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.136+0000 7fbfda59c700 1 -- 172.21.15.43:0/2760362193 learned_addr learned my addr 172.21.15.43:0/2760362193 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:01.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 -- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc151910 msgr2=0x7fbfdc14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc151910 0x7fbfdc14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 -- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 msgr2=0x7fbfdc152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfd3fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 0x7fbfdc152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:01.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 0x7fbfdc152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 -- 172.21.15.43:0/2760362193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009a70 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfd3fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 0x7fbfdc152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:01.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfda59c700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c520 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:01.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0052d0 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc005430 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc0ac460 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0038c0 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.137+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc0aca20 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.138+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc04ee70 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.139+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfcc003a20 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.140+0000 7fbfd2ffd700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 0x7fbfbc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:01.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.140+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7176+0+0 (secure 0 0 0) 0x7fbfcc087f50 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.140+0000 7fbfd3fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 0x7fbfbc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:01.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.141+0000 7fbfd3fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 0x7fbfbc06c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0aa6a0 tx=0x7fbfc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:01.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.145+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbfcc0531d0 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.400+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbfdc0a7490 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.903+0000 7fbfd2ffd700 1 -- 172.21.15.43:0/2760362193 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbfcc0567f0 con 0x7fbfdc0c15e0 2023-08-27T11:25:01.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 msgr2=0x7fbfbc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 0x7fbfbc06c5a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0aa6a0 tx=0x7fbfc4009040 comp rx=0 tx=0).stop 2023-08-27T11:25:01.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 msgr2=0x7fbfdc0acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:01.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c520 tx=0x7fbfcc00c8e0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 shutdown_connections 2023-08-27T11:25:01.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfbc06a0e0 0x7fbfbc06c5a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbfdc151910 0x7fbfdc14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbfdc0c15e0 0x7fbfdc0acf40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 --2- 172.21.15.43:0/2760362193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfdc0c51a0 0x7fbfdc152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:01.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 >> 172.21.15.43:0/2760362193 conn(0x7fbfdc0a9740 msgr2=0x7fbfdc150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:01.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 shutdown_connections 2023-08-27T11:25:01.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:01.906+0000 7fbfe0fff700 1 -- 172.21.15.43:0/2760362193 wait complete. 2023-08-27T11:25:01.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:25:02.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.138+0000 7f7eb49ff700 1 Processor -- start 2023-08-27T11:25:02.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.138+0000 7f7eb49ff700 1 -- start start 2023-08-27T11:25:02.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eb49ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7eb0151a40 0x7f7eb00c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eb49ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7eb006bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eb49ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb0154730 con 0x7f7eb00c81c0 2023-08-27T11:25:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eb49ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb0154520 con 0x7f7eb0151a40 2023-08-27T11:25:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eb49ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0154a10 con 0x7f7eb006b780 2023-08-27T11:25:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7ea7fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7eb00c81c0 0x7f7eb00c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59092/0 (socket says 172.21.15.43:59092) 2023-08-27T11:25:02.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7ea7fff700 1 -- 172.21.15.43:0/3548941118 learned_addr learned my addr 172.21.15.43:0/3548941118 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:02.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eae59c700 1 --2- 172.21.15.43:0/3548941118 >> v2:172.21.15.57:3300/0 conn(0x7f7eb0151a40 0x7f7eb00c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eaed9d700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7eb006bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661165749 0 0) 0x7f7eb0154730 con 0x7f7eb00c81c0 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.140+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c0035b0 con 0x7f7eb00c81c0 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490107662 0 0) 0x7f7e9c0035b0 con 0x7f7eb00c81c0 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 msgr2=0x7f7eb006bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7eb006bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 >> v2:172.21.15.57:3300/0 conn(0x7f7eb0151a40 msgr2=0x7f7eb00c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:02.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 --2- 172.21.15.43:0/3548941118 >> v2:172.21.15.57:3300/0 conn(0x7f7eb0151a40 0x7f7eb00c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0154cf0 con 0x7f7eb00c81c0 2023-08-27T11:25:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f7e98001670 con 0x7f7eb00c81c0 2023-08-27T11:25:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 >> v1:172.21.15.43:6789/0 conn(0x7f7eb00c81c0 legacy=0x7f7eb00c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7e9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7e9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e9c004d90 0x7f7e9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0154520 con 0x7f7e9c004060 2023-08-27T11:25:02.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0154a10 con 0x7f7e9c004d90 2023-08-27T11:25:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00bb40 con 0x7f7eb006b780 2023-08-27T11:25:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7e9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eae59c700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7e9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.141+0000 7f7eaed9d700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e9c004d90 0x7f7e9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 -- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 msgr2=0x7f7e9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:02.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb006b780 0x7f7e9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 -- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e9c004d90 msgr2=0x7f7e9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:02.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e9c004d90 0x7f7e9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 -- 172.21.15.43:0/3548941118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0035b0 con 0x7f7e9c004060 2023-08-27T11:25:02.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7e9c004850 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c190 tx=0x7f7e9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847d2733573ec12f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:02.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007b70 con 0x7f7e9c004060 2023-08-27T11:25:02.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9800cd30 con 0x7f7e9c004060 2023-08-27T11:25:02.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.142+0000 7f7eadd9b700 1 -- 172.21.15.43:0/3548941118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9800cea0 con 0x7f7e9c004060 2023-08-27T11:25:02.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3548941118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 msgr2=0x7f7e9c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3548941118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7e9c004850 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7e9800c190 tx=0x7f7e9c005880 comp rx=0 tx=0).stop 2023-08-27T11:25:02.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eaed9d700 1 -- 172.21.15.43:0/3548941118 reap_dead start 2023-08-27T11:25:02.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3548941118 shutdown_connections 2023-08-27T11:25:02.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3548941118 >> 172.21.15.43:0/3548941118 conn(0x7f7eb00ab890 msgr2=0x7f7eb00abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:02.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3548941118 shutdown_connections 2023-08-27T11:25:02.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.143+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3548941118 wait complete. 2023-08-27T11:25:02.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.145+0000 7f7eb49ff700 1 Processor -- start 2023-08-27T11:25:02.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.145+0000 7f7eb49ff700 1 -- start start 2023-08-27T11:25:02.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb0147760 0x7f7eb00ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb00c3d90 0x7f7eb00aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0152860 con 0x7f7e9c004060 2023-08-27T11:25:02.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00af1f0 con 0x7f7eb0147760 2023-08-27T11:25:02.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eb49ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0155b20 con 0x7f7eb00c3d90 2023-08-27T11:25:02.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48670/0 (socket says 172.21.15.43:48670) 2023-08-27T11:25:02.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 -- 172.21.15.43:0/3545013330 learned_addr learned my addr 172.21.15.43:0/3545013330 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:02.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 -- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb00c3d90 msgr2=0x7f7eb00aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb00c3d90 0x7f7eb00aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 -- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb0147760 msgr2=0x7f7eb00ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb0147760 0x7f7eb00ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.146+0000 7f7eae59c700 1 -- 172.21.15.43:0/3545013330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb01edb40 con 0x7f7e9c004060 2023-08-27T11:25:02.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7eae59c700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0011aa0 tx=0x7f7ea0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:02.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea000f8a0 con 0x7f7e9c004060 2023-08-27T11:25:02.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea000fa20 con 0x7f7e9c004060 2023-08-27T11:25:02.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea000fdd0 con 0x7f7e9c004060 2023-08-27T11:25:02.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0155de0 con 0x7f7e9c004060 2023-08-27T11:25:02.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.147+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb00af870 con 0x7f7e9c004060 2023-08-27T11:25:02.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.148+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb00afd90 con 0x7f7e9c004060 2023-08-27T11:25:02.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.149+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ea0014440 con 0x7f7e9c004060 2023-08-27T11:25:02.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.150+0000 7f7ea6ffd700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 0x7f7e9006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:02.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.150+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7176+0+0 (secure 0 0 0) 0x7f7ea00890a0 con 0x7f7e9c004060 2023-08-27T11:25:02.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.151+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 0x7f7e9006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:02.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.151+0000 7f7ea7fff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 0x7f7e9006c5d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ca820 tx=0x7f7e9800f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:02.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.155+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ea00543e0 con 0x7f7e9c004060 2023-08-27T11:25:02.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.363+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7eb004ee70 con 0x7f7e9c004060 2023-08-27T11:25:02.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.908+0000 7f7ea6ffd700 1 -- 172.21.15.43:0/3545013330 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7ea00220d0 con 0x7f7e9c004060 2023-08-27T11:25:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 msgr2=0x7f7e9006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 0x7f7e9006c5d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00ca820 tx=0x7f7e9800f000 comp rx=0 tx=0).stop 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 msgr2=0x7f7eb00c3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0011aa0 tx=0x7f7ea0011e60 comp rx=0 tx=0).stop 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 shutdown_connections 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e9006a110 0x7f7e9006c5d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7eb00c3d90 0x7f7eb00aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e9c004060 0x7f7eb00c3850 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 --2- 172.21.15.43:0/3545013330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7eb0147760 0x7f7eb00ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:02.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 >> 172.21.15.43:0/3545013330 conn(0x7f7eb00ab890 msgr2=0x7f7eb00c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 shutdown_connections 2023-08-27T11:25:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:02.912+0000 7f7eb49ff700 1 -- 172.21.15.43:0/3545013330 wait complete. 2023-08-27T11:25:02.916 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:25:02.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:25:03.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.141+0000 7f3c485ff700 1 Processor -- start 2023-08-27T11:25:03.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.141+0000 7f3c485ff700 1 -- start start 2023-08-27T11:25:03.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.142+0000 7f3c485ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3c40151ad0 0x7f3c400c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:03.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.142+0000 7f3c485ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c401554e0 con 0x7f3c400c4c20 2023-08-27T11:25:03.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c485ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c40154960 con 0x7f3c400c4770 2023-08-27T11:25:03.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c485ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400c5030 con 0x7f3c40151ad0 2023-08-27T11:25:03.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c46b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3c400c4c20 0x7f3c4006b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59102/0 (socket says 172.21.15.43:59102) 2023-08-27T11:25:03.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c46b9c700 1 -- 172.21.15.43:0/3579961962 learned_addr learned my addr 172.21.15.43:0/3579961962 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:03.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c4639b700 1 --2- 172.21.15.43:0/3579961962 >> v2:172.21.15.43:3300/0 conn(0x7f3c40151ad0 0x7f3c400c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:03.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775146140 0 0) 0x7f3c401554e0 con 0x7f3c400c4c20 2023-08-27T11:25:03.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c2c0035b0 con 0x7f3c400c4c20 2023-08-27T11:25:03.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c4639b700 1 -- 172.21.15.43:0/3579961962 >> v1:172.21.15.57:6789/0 conn(0x7f3c400c4770 legacy=0x7f3c4006b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192211704 0 0) 0x7f3c40154960 con 0x7f3c400c4770 2023-08-27T11:25:03.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c4639b700 1 -- 172.21.15.43:0/3579961962 >> v1:172.21.15.43:6789/0 conn(0x7f3c400c4c20 legacy=0x7f3c4006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.143+0000 7f3c4639b700 1 -- 172.21.15.43:0/3579961962 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c40154c40 con 0x7f3c40151ad0 2023-08-27T11:25:03.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c4639b700 1 --2- 172.21.15.43:0/3579961962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c40151ad0 0x7f3c400c7cf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009830 tx=0x7f3c3c009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4f5014e4e895d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:03.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c011830 con 0x7f3c40151ad0 2023-08-27T11:25:03.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c011990 con 0x7f3c40151ad0 2023-08-27T11:25:03.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c45399700 1 -- 172.21.15.43:0/3579961962 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c011d40 con 0x7f3c40151ad0 2023-08-27T11:25:03.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c485ff700 1 -- 172.21.15.43:0/3579961962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c40151ad0 msgr2=0x7f3c400c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.144+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3579961962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c40151ad0 0x7f3c400c7cf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009830 tx=0x7f3c3c009b40 comp rx=0 tx=0).stop 2023-08-27T11:25:03.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.145+0000 7f3c485ff700 1 -- 172.21.15.43:0/3579961962 shutdown_connections 2023-08-27T11:25:03.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.145+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3579961962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c40151ad0 0x7f3c400c7cf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.145+0000 7f3c485ff700 1 -- 172.21.15.43:0/3579961962 >> 172.21.15.43:0/3579961962 conn(0x7f3c400ab920 msgr2=0x7f3c400abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:03.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.145+0000 7f3c485ff700 1 -- 172.21.15.43:0/3579961962 shutdown_connections 2023-08-27T11:25:03.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.145+0000 7f3c485ff700 1 -- 172.21.15.43:0/3579961962 wait complete. 2023-08-27T11:25:03.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.146+0000 7f3c485ff700 1 Processor -- start 2023-08-27T11:25:03.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.147+0000 7f3c485ff700 1 -- start start 2023-08-27T11:25:03.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c400c4770 0x7f3c401ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:03.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:03.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c40151ad0 0x7f3c400c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:03.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40155920 con 0x7f3c400c4c20 2023-08-27T11:25:03.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40157f00 con 0x7f3c400c4770 2023-08-27T11:25:03.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c485ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c401ea610 con 0x7f3c40151ad0 2023-08-27T11:25:03.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c45b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:03.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c45b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48684/0 (socket says 172.21.15.43:48684) 2023-08-27T11:25:03.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c45b9a700 1 -- 172.21.15.43:0/3596926701 learned_addr learned my addr 172.21.15.43:0/3596926701 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:03.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c4639b700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c400c4770 0x7f3c401ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:03.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.148+0000 7f3c46b9c700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c40151ad0 0x7f3c400c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:03.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 -- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c40151ad0 msgr2=0x7f3c400c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c40151ad0 0x7f3c400c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 -- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c400c4770 msgr2=0x7f3c401ea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c400c4770 0x7f3c401ea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 -- 172.21.15.43:0/3596926701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009440 con 0x7f3c400c4c20 2023-08-27T11:25:03.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.149+0000 7f3c45b9a700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c580 tx=0x7f3c3000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:03.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.150+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300054e0 con 0x7f3c400c4c20 2023-08-27T11:25:03.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.150+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3000ce90 con 0x7f3c400c4c20 2023-08-27T11:25:03.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.150+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300038c0 con 0x7f3c400c4c20 2023-08-27T11:25:03.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.150+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4014df40 con 0x7f3c400c4c20 2023-08-27T11:25:03.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.150+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4014c4f0 con 0x7f3c400c4c20 2023-08-27T11:25:03.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.152+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4014c680 con 0x7f3c400c4c20 2023-08-27T11:25:03.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.153+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c30003a20 con 0x7f3c400c4c20 2023-08-27T11:25:03.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.154+0000 7f3c36ffd700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 0x7f3c2406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:03.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.155+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6738+0+0 (secure 0 0 0) 0x7f3c30087a70 con 0x7f3c400c4c20 2023-08-27T11:25:03.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.155+0000 7f3c4639b700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 0x7f3c2406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:03.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.156+0000 7f3c4639b700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 0x7f3c2406c5f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b80 tx=0x7f3c3c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:03.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.160+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c30052f20 con 0x7f3c400c4c20 2023-08-27T11:25:03.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.377+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c4004ee70 con 0x7f3c400c4c20 2023-08-27T11:25:03.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.918+0000 7f3c36ffd700 1 -- 172.21.15.43:0/3596926701 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c30056540 con 0x7f3c400c4c20 2023-08-27T11:25:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.922+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 msgr2=0x7f3c2406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.922+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 0x7f3c2406c5f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b80 tx=0x7f3c3c01c040 comp rx=0 tx=0).stop 2023-08-27T11:25:03.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.922+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 msgr2=0x7f3c400c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.922+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c580 tx=0x7f3c3000c890 comp rx=0 tx=0).stop 2023-08-27T11:25:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 shutdown_connections 2023-08-27T11:25:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c2406a130 0x7f3c2406c5f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c40151ad0 0x7f3c400c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c400c4770 0x7f3c401ea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 --2- 172.21.15.43:0/3596926701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c400c4c20 0x7f3c400c8c80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 >> 172.21.15.43:0/3596926701 conn(0x7f3c400ab920 msgr2=0x7f3c400c9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 shutdown_connections 2023-08-27T11:25:03.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:03.923+0000 7f3c485ff700 1 -- 172.21.15.43:0/3596926701 wait complete. 2023-08-27T11:25:03.928 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:25:03.948 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:04.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.152+0000 7f400f5ff700 1 Processor -- start 2023-08-27T11:25:04.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.152+0000 7f400f5ff700 1 -- start start 2023-08-27T11:25:04.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 0x7f40080c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400f5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4008154d00 con 0x7f400814e960 2023-08-27T11:25:04.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400f5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4008154fe0 con 0x7f40080c50d0 2023-08-27T11:25:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080baf30 con 0x7f4008154740 2023-08-27T11:25:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400d39b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f400814e960 0x7f40080a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59114/0 (socket says 172.21.15.43:59114) 2023-08-27T11:25:04.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.153+0000 7f400d39b700 1 -- 172.21.15.43:0/2362854369 learned_addr learned my addr 172.21.15.43:0/2362854369 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f400db9c700 1 --2- 172.21.15.43:0/2362854369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 0x7f40080c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155232979 0 0) 0x7f4008154d00 con 0x7f400814e960 2023-08-27T11:25:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff40035b0 con 0x7f400814e960 2023-08-27T11:25:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079085435 0 0) 0x7f4008154fe0 con 0x7f40080c50d0 2023-08-27T11:25:04.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4008154d00 con 0x7f40080c50d0 2023-08-27T11:25:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f400db9c700 1 -- 172.21.15.43:0/2362854369 >> v1:172.21.15.57:6789/0 conn(0x7f40080c50d0 legacy=0x7f40080c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f400db9c700 1 -- 172.21.15.43:0/2362854369 >> v1:172.21.15.43:6789/0 conn(0x7f400814e960 legacy=0x7f40080a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f400db9c700 1 -- 172.21.15.43:0/2362854369 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40081552c0 con 0x7f4008154740 2023-08-27T11:25:04.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.154+0000 7f400db9c700 1 --2- 172.21.15.43:0/2362854369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 0x7f40080c43d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4000009dc0 tx=0x7f400000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1facd01499c912 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000e070 con 0x7f4008154740 2023-08-27T11:25:04.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000bb20 con 0x7f4008154740 2023-08-27T11:25:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f3ffffff700 1 -- 172.21.15.43:0/2362854369 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000012430 con 0x7f4008154740 2023-08-27T11:25:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 -- 172.21.15.43:0/2362854369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 msgr2=0x7f40080c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 --2- 172.21.15.43:0/2362854369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 0x7f40080c43d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4000009dc0 tx=0x7f400000b330 comp rx=0 tx=0).stop 2023-08-27T11:25:04.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 -- 172.21.15.43:0/2362854369 shutdown_connections 2023-08-27T11:25:04.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 --2- 172.21.15.43:0/2362854369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4008154740 0x7f40080c43d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 -- 172.21.15.43:0/2362854369 >> 172.21.15.43:0/2362854369 conn(0x7f400806aa50 msgr2=0x7f40080c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:04.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 -- 172.21.15.43:0/2362854369 shutdown_connections 2023-08-27T11:25:04.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.155+0000 7f400f5ff700 1 -- 172.21.15.43:0/2362854369 wait complete. 2023-08-27T11:25:04.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.157+0000 7f400f5ff700 1 Processor -- start 2023-08-27T11:25:04.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.157+0000 7f400f5ff700 1 -- start start 2023-08-27T11:25:04.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 0x7f40080aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4008154740 0x7f400814f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080a9840 con 0x7f40080c50d0 2023-08-27T11:25:04.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008151fa0 con 0x7f4008154740 2023-08-27T11:25:04.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080a9a90 con 0x7f400814e960 2023-08-27T11:25:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400d39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400d39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48698/0 (socket says 172.21.15.43:48698) 2023-08-27T11:25:04.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.158+0000 7f400d39b700 1 -- 172.21.15.43:0/1596319853 learned_addr learned my addr 172.21.15.43:0/1596319853 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:04.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400db9c700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4008154740 0x7f400814f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400cb9a700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 0x7f40080aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 -- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 msgr2=0x7f40080aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 0x7f40080aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 -- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4008154740 msgr2=0x7f400814f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4008154740 0x7f400814f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 -- 172.21.15.43:0/1596319853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009a70 con 0x7f40080c50d0 2023-08-27T11:25:04.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400cb9a700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 0x7f40080aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400d39b700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f400400c700 tx=0x7f400400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004005d70 con 0x7f40080c50d0 2023-08-27T11:25:04.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040070d0 con 0x7f40080c50d0 2023-08-27T11:25:04.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004007480 con 0x7f40080c50d0 2023-08-27T11:25:04.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080a9d70 con 0x7f40080c50d0 2023-08-27T11:25:04.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.159+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40080aa330 con 0x7f40080c50d0 2023-08-27T11:25:04.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.160+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400804ee70 con 0x7f40080c50d0 2023-08-27T11:25:04.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.161+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f40040075e0 con 0x7f40080c50d0 2023-08-27T11:25:04.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.162+0000 7f3ffdffb700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 0x7f3fec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.162+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4004087cf0 con 0x7f40080c50d0 2023-08-27T11:25:04.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.163+0000 7f400cb9a700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 0x7f3fec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.163+0000 7f400cb9a700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 0x7f3fec06c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f40080bfcf0 tx=0x7f3ff8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.167+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4004053240 con 0x7f40080c50d0 2023-08-27T11:25:04.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.379+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40080bbdb0 con 0x7f40080c50d0 2023-08-27T11:25:04.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.380+0000 7f3ffdffb700 1 -- 172.21.15.43:0/1596319853 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18568 (secure 0 0 0) 0x7f4004056860 con 0x7f40080c50d0 2023-08-27T11:25:04.382 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:04.382 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":56,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:03.907785+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6833/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:04.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 msgr2=0x7f3fec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 0x7f3fec06c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f40080bfcf0 tx=0x7f3ff8009040 comp rx=0 tx=0).stop 2023-08-27T11:25:04.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 msgr2=0x7f400814d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f400400c700 tx=0x7f400400cac0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 shutdown_connections 2023-08-27T11:25:04.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3fec06a0e0 0x7f3fec06c5a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4008154740 0x7f400814f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f40080c50d0 0x7f400814d6e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 --2- 172.21.15.43:0/1596319853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f400814e960 0x7f40080aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 >> 172.21.15.43:0/1596319853 conn(0x7f400806aa50 msgr2=0x7f40080a7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:04.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 shutdown_connections 2023-08-27T11:25:04.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.383+0000 7f400f5ff700 1 -- 172.21.15.43:0/1596319853 wait complete. 2023-08-27T11:25:04.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-27T11:24:45.113541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-27T11:24:46.490147+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:25:04.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:25:04.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.607+0000 7f9a755ff700 1 Processor -- start 2023-08-27T11:25:04.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.607+0000 7f9a755ff700 1 -- start start 2023-08-27T11:25:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.608+0000 7f9a755ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a7014e780 0x7f9a701512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a755ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a700c03e0 con 0x7f9a7014eb60 2023-08-27T11:25:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a755ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a70151900 con 0x7f9a700c5150 2023-08-27T11:25:04.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a755ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a70151be0 con 0x7f9a7014e780 2023-08-27T11:25:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a6f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9a7014eb60 0x7f9a700c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59128/0 (socket says 172.21.15.43:59128) 2023-08-27T11:25:04.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a6f7fe700 1 -- 172.21.15.43:0/2477073032 learned_addr learned my addr 172.21.15.43:0/2477073032 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:04.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a6effd700 1 --2- 172.21.15.43:0/2477073032 >> v2:172.21.15.57:3300/0 conn(0x7f9a7014e780 0x7f9a701512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a6e7fc700 1 -- 172.21.15.43:0/2477073032 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801003740 0 0) 0x7f9a700c03e0 con 0x7f9a7014eb60 2023-08-27T11:25:04.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.609+0000 7f9a6e7fc700 1 -- 172.21.15.43:0/2477073032 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a5c0035b0 con 0x7f9a7014eb60 2023-08-27T11:25:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6effd700 1 -- 172.21.15.43:0/2477073032 >> v1:172.21.15.57:6789/0 conn(0x7f9a700c5150 legacy=0x7f9a7006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6effd700 1 -- 172.21.15.43:0/2477073032 >> v1:172.21.15.43:6789/0 conn(0x7f9a7014eb60 legacy=0x7f9a700c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6effd700 1 -- 172.21.15.43:0/2477073032 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70151ec0 con 0x7f9a7014e780 2023-08-27T11:25:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6effd700 1 --2- 172.21.15.43:0/2477073032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a701512b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50888fea291fb0d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6e7fc700 1 -- 172.21.15.43:0/2477073032 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60011830 con 0x7f9a7014e780 2023-08-27T11:25:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6e7fc700 1 -- 172.21.15.43:0/2477073032 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60011990 con 0x7f9a7014e780 2023-08-27T11:25:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.610+0000 7f9a6e7fc700 1 -- 172.21.15.43:0/2477073032 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60011d00 con 0x7f9a7014e780 2023-08-27T11:25:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 -- 172.21.15.43:0/2477073032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 msgr2=0x7f9a701512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2477073032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a701512b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009870 tx=0x7f9a60009b80 comp rx=0 tx=0).stop 2023-08-27T11:25:04.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 -- 172.21.15.43:0/2477073032 shutdown_connections 2023-08-27T11:25:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2477073032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a701512b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 -- 172.21.15.43:0/2477073032 >> 172.21.15.43:0/2477073032 conn(0x7f9a700c5b10 msgr2=0x7f9a700c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 -- 172.21.15.43:0/2477073032 shutdown_connections 2023-08-27T11:25:04.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.611+0000 7f9a755ff700 1 -- 172.21.15.43:0/2477073032 wait complete. 2023-08-27T11:25:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.613+0000 7f9a755ff700 1 Processor -- start 2023-08-27T11:25:04.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.613+0000 7f9a755ff700 1 -- start start 2023-08-27T11:25:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a7014d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 0x7f9a701dab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a700bf390 con 0x7f9a700c5150 2023-08-27T11:25:04.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7014d8e0 con 0x7f9a7014e780 2023-08-27T11:25:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a755ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7014af10 con 0x7f9a7014eb60 2023-08-27T11:25:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48700/0 (socket says 172.21.15.43:48700) 2023-08-27T11:25:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 -- 172.21.15.43:0/2530104867 learned_addr learned my addr 172.21.15.43:0/2530104867 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:04.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6f7fe700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 0x7f9a701dab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a67fff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a7014d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 -- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 msgr2=0x7f9a701dab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 0x7f9a701dab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 -- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 msgr2=0x7f9a7014d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a7014d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6effd700 1 -- 172.21.15.43:0/2530104867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600094a0 con 0x7f9a700c5150 2023-08-27T11:25:04.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a6f7fe700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 0x7f9a701dab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:04.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.614+0000 7f9a67fff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a7014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:04.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a6effd700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9a600090b0 tx=0x7f9a60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6001aa90 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6001abf0 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7014a950 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600243f0 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.615+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a700befb0 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.616+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a700bf4d0 con 0x7f9a700c5150 2023-08-27T11:25:04.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.617+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a60024550 con 0x7f9a700c5150 2023-08-27T11:25:04.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.618+0000 7f9a677fe700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 0x7f9a5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:04.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.618+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9a60089bf0 con 0x7f9a700c5150 2023-08-27T11:25:04.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.618+0000 7f9a67fff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 0x7f9a5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:04.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.619+0000 7f9a67fff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 0x7f9a5006c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c4480 tx=0x7f9a58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:04.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.622+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9a600552e0 con 0x7f9a700c5150 2023-08-27T11:25:04.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.848+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a700674e0 con 0x7f9a700c5150 2023-08-27T11:25:04.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.849+0000 7f9a677fe700 1 -- 172.21.15.43:0/2530104867 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a60015020 con 0x7f9a700c5150 2023-08-27T11:25:04.850 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:25:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 msgr2=0x7f9a5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 0x7f9a5006c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c4480 tx=0x7f9a58009040 comp rx=0 tx=0).stop 2023-08-27T11:25:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 msgr2=0x7f9a700bf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9a600090b0 tx=0x7f9a60004750 comp rx=0 tx=0).stop 2023-08-27T11:25:04.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 shutdown_connections 2023-08-27T11:25:04.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a5006a0e0 0x7f9a5006c5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a7014eb60 0x7f9a701dab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a700c5150 0x7f9a700bf7b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 --2- 172.21.15.43:0/2530104867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a7014e780 0x7f9a7014d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 >> 172.21.15.43:0/2530104867 conn(0x7f9a700c5b10 msgr2=0x7f9a700a5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 shutdown_connections 2023-08-27T11:25:04.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:04.851+0000 7f9a755ff700 1 -- 172.21.15.43:0/2530104867 wait complete. 2023-08-27T11:25:04.871 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:25:05.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.074+0000 7fca8e7ff700 1 Processor -- start 2023-08-27T11:25:05.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.074+0000 7fca8e7ff700 1 -- start start 2023-08-27T11:25:05.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.075+0000 7fca8e7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca880c7c00 0x7fca880c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.075+0000 7fca8e7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca88154660 con 0x7fca8806a8e0 2023-08-27T11:25:05.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.075+0000 7fca8e7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca88154940 con 0x7fca88151d20 2023-08-27T11:25:05.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.075+0000 7fca8e7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880c5750 con 0x7fca880c7c00 2023-08-27T11:25:05.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca877fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fca880c7c00 0x7fca880c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca8cd9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fca8806a8e0 0x7fca8806acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59144/0 (socket says 172.21.15.43:59144) 2023-08-27T11:25:05.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca8cd9c700 1 -- 172.21.15.43:0/2979413173 learned_addr learned my addr 172.21.15.43:0/2979413173 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:05.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca877fe700 1 -- 172.21.15.43:0/2979413173 >> v1:172.21.15.57:6789/0 conn(0x7fca88151d20 legacy=0x7fca880ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca877fe700 1 -- 172.21.15.43:0/2979413173 >> v1:172.21.15.43:6789/0 conn(0x7fca8806a8e0 legacy=0x7fca8806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca877fe700 1 -- 172.21.15.43:0/2979413173 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88154c20 con 0x7fca880c7c00 2023-08-27T11:25:05.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca877fe700 1 --2- 172.21.15.43:0/2979413173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880c7c00 0x7fca880c8110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fca88152140 tx=0x7fca7c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2b96e928d4801d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.076+0000 7fca86ffd700 1 -- 172.21.15.43:0/2979413173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004020 con 0x7fca880c7c00 2023-08-27T11:25:05.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca86ffd700 1 -- 172.21.15.43:0/2979413173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c004180 con 0x7fca880c7c00 2023-08-27T11:25:05.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca86ffd700 1 -- 172.21.15.43:0/2979413173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004530 con 0x7fca880c7c00 2023-08-27T11:25:05.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 -- 172.21.15.43:0/2979413173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880c7c00 msgr2=0x7fca880c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/2979413173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880c7c00 0x7fca880c8110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fca88152140 tx=0x7fca7c009b20 comp rx=0 tx=0).stop 2023-08-27T11:25:05.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 -- 172.21.15.43:0/2979413173 shutdown_connections 2023-08-27T11:25:05.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/2979413173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca880c7c00 0x7fca880c8110 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 -- 172.21.15.43:0/2979413173 >> 172.21.15.43:0/2979413173 conn(0x7fca880c9d00 msgr2=0x7fca880ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:05.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 -- 172.21.15.43:0/2979413173 shutdown_connections 2023-08-27T11:25:05.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.077+0000 7fca8e7ff700 1 -- 172.21.15.43:0/2979413173 wait complete. 2023-08-27T11:25:05.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.079+0000 7fca8e7ff700 1 Processor -- start 2023-08-27T11:25:05.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.079+0000 7fca8e7ff700 1 -- start start 2023-08-27T11:25:05.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca880c7c00 0x7fca88156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 0x7fca880bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca880c2b20 con 0x7fca8806a8e0 2023-08-27T11:25:05.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881ea510 con 0x7fca880c7c00 2023-08-27T11:25:05.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca8e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca881ea7f0 con 0x7fca88151d20 2023-08-27T11:25:05.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca87fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48720/0 (socket says 172.21.15.43:48720) 2023-08-27T11:25:05.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca87fff700 1 -- 172.21.15.43:0/483468866 learned_addr learned my addr 172.21.15.43:0/483468866 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:05.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.080+0000 7fca877fe700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca880c7c00 0x7fca88156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca8cd9c700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 0x7fca880bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 -- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 msgr2=0x7fca880bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 0x7fca880bfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 -- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca880c7c00 msgr2=0x7fca88156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca880c7c00 0x7fca88156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 -- 172.21.15.43:0/483468866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0094a0 con 0x7fca8806a8e0 2023-08-27T11:25:05.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca8cd9c700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 0x7fca880bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:05.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca87fff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c450 tx=0x7fca7800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780052d0 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78005430 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca880c2d70 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780038c0 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.081+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88157050 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.083+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8804ee70 con 0x7fca8806a8e0 2023-08-27T11:25:05.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.083+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca78003a20 con 0x7fca8806a8e0 2023-08-27T11:25:05.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.084+0000 7fca84ff9700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 0x7fca7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.084+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fca780879c0 con 0x7fca8806a8e0 2023-08-27T11:25:05.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.085+0000 7fca877fe700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 0x7fca7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.085+0000 7fca877fe700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 0x7fca7406c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca88152140 tx=0x7fca7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.089+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fca78053030 con 0x7fca8806a8e0 2023-08-27T11:25:05.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.298+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca880ac650 con 0x7fca8806a8e0 2023-08-27T11:25:05.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.298+0000 7fca84ff9700 1 -- 172.21.15.43:0/483468866 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca78017020 con 0x7fca8806a8e0 2023-08-27T11:25:05.300 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:25:05.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 msgr2=0x7fca7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 0x7fca7406c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca88152140 tx=0x7fca7c008030 comp rx=0 tx=0).stop 2023-08-27T11:25:05.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 msgr2=0x7fca881586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c450 tx=0x7fca7800c760 comp rx=0 tx=0).stop 2023-08-27T11:25:05.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 shutdown_connections 2023-08-27T11:25:05.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fca7406a0e0 0x7fca7406c5a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca88151d20 0x7fca880bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fca8806a8e0 0x7fca881586f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 --2- 172.21.15.43:0/483468866 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca880c7c00 0x7fca88156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 >> 172.21.15.43:0/483468866 conn(0x7fca880c9d00 msgr2=0x7fca881523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:05.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 shutdown_connections 2023-08-27T11:25:05.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.301+0000 7fca8e7ff700 1 -- 172.21.15.43:0/483468866 wait complete. 2023-08-27T11:25:05.320 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-27T11:25:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.524+0000 7f8bd6bff700 1 Processor -- start 2023-08-27T11:25:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.524+0000 7f8bd6bff700 1 -- start start 2023-08-27T11:25:05.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.525+0000 7f8bd6bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 0x7f8bd00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd6bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8bd00c7c00 0x7f8bd00ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd6bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd0154660 con 0x7f8bd00abcc0 2023-08-27T11:25:05.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd6bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00c5750 con 0x7f8bd00c7c00 2023-08-27T11:25:05.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd6bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd0154940 con 0x7f8bd0151d20 2023-08-27T11:25:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8bd00c7c00 0x7f8bd00ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8bd00c7c00 0x7f8bd00ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48730/0 (socket says 172.21.15.43:48730) 2023-08-27T11:25:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 -- 172.21.15.43:0/1068078338 learned_addr learned my addr 172.21.15.43:0/1068078338 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd499b700 1 --2- 172.21.15.43:0/1068078338 >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 0x7f8bd00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 -- 172.21.15.43:0/1068078338 >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 msgr2=0x7f8bd00c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 --2- 172.21.15.43:0/1068078338 >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 0x7f8bd00c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 -- 172.21.15.43:0/1068078338 >> v1:172.21.15.57:6789/0 conn(0x7f8bd00abcc0 legacy=0x7f8bd006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bcffff700 1 -- 172.21.15.43:0/1068078338 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0154c20 con 0x7f8bd00c7c00 2023-08-27T11:25:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.526+0000 7f8bd499b700 1 --2- 172.21.15.43:0/1068078338 >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 0x7f8bd00c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bcffff700 1 --2- 172.21.15.43:0/1068078338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd00ab780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00cac10 tx=0x7f8bbc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a831633e64126548 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bcf7fe700 1 -- 172.21.15.43:0/1068078338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc004230 con 0x7f8bd00c7c00 2023-08-27T11:25:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bcf7fe700 1 -- 172.21.15.43:0/1068078338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc004390 con 0x7f8bd00c7c00 2023-08-27T11:25:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bcf7fe700 1 -- 172.21.15.43:0/1068078338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0036a0 con 0x7f8bd00c7c00 2023-08-27T11:25:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bd6bff700 1 -- 172.21.15.43:0/1068078338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 msgr2=0x7f8bd00ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/1068078338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd00ab780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00cac10 tx=0x7f8bbc009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.527+0000 7f8bd6bff700 1 -- 172.21.15.43:0/1068078338 shutdown_connections 2023-08-27T11:25:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.528+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/1068078338 >> v2:172.21.15.57:3300/0 conn(0x7f8bd0151d20 0x7f8bd00c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.528+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/1068078338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd00ab780 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.528+0000 7f8bd6bff700 1 -- 172.21.15.43:0/1068078338 >> 172.21.15.43:0/1068078338 conn(0x7f8bd00c9d00 msgr2=0x7f8bd00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.528+0000 7f8bd6bff700 1 -- 172.21.15.43:0/1068078338 shutdown_connections 2023-08-27T11:25:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.528+0000 7f8bd6bff700 1 -- 172.21.15.43:0/1068078338 wait complete. 2023-08-27T11:25:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.530+0000 7f8bd6bff700 1 Processor -- start 2023-08-27T11:25:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.530+0000 7f8bd6bff700 1 -- start start 2023-08-27T11:25:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bd00abcc0 0x7f8bd01464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0151d20 0x7f8bd01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c2fa0 con 0x7f8bd00c7c00 2023-08-27T11:25:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c3580 con 0x7f8bd0151d20 2023-08-27T11:25:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.531+0000 7f8bd6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c3d50 con 0x7f8bd00abcc0 2023-08-27T11:25:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48734/0 (socket says 172.21.15.43:48734) 2023-08-27T11:25:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 -- 172.21.15.43:0/2583025465 learned_addr learned my addr 172.21.15.43:0/2583025465 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:05.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bd499b700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bd00abcc0 0x7f8bd01464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bd519c700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0151d20 0x7f8bd01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 -- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bd00abcc0 msgr2=0x7f8bd01464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bd00abcc0 0x7f8bd01464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 -- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0151d20 msgr2=0x7f8bd01440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0151d20 0x7f8bd01440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 -- 172.21.15.43:0/2583025465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc009550 con 0x7f8bd00c7c00 2023-08-27T11:25:05.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.532+0000 7f8bcffff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00ac340 tx=0x7f8bbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.533+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc003c90 con 0x7f8bd00c7c00 2023-08-27T11:25:05.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.533+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc01f070 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.533+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc011870 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.533+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd01ed2a0 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.533+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00c3a70 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.534+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd01ed100 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.535+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8bbc021030 con 0x7f8bd00c7c00 2023-08-27T11:25:05.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.536+0000 7f8bcd7fa700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 0x7f8bb406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.536+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8bbc089b60 con 0x7f8bd00c7c00 2023-08-27T11:25:05.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.536+0000 7f8bd499b700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 0x7f8bb406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.537+0000 7f8bd499b700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 0x7f8bb406c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.540+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8bd01ed100 con 0x7f8bd00c7c00 2023-08-27T11:25:05.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.750+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bd01ed100 con 0x7f8bd00c7c00 2023-08-27T11:25:05.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.751+0000 7f8bcd7fa700 1 -- 172.21.15.43:0/2583025465 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8bbc029020 con 0x7f8bd00c7c00 2023-08-27T11:25:05.752 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:25:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 msgr2=0x7f8bb406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 0x7f8bb406c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).stop 2023-08-27T11:25:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 msgr2=0x7f8bd01ed780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00ac340 tx=0x7f8bbc004750 comp rx=0 tx=0).stop 2023-08-27T11:25:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 shutdown_connections 2023-08-27T11:25:05.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bb406a0e0 0x7f8bb406c5a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bd0151d20 0x7f8bd01440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bd00abcc0 0x7f8bd01464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 --2- 172.21.15.43:0/2583025465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8bd00c7c00 0x7f8bd01ed780 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 >> 172.21.15.43:0/2583025465 conn(0x7f8bd00c9d00 msgr2=0x7f8bd00ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 shutdown_connections 2023-08-27T11:25:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.753+0000 7f8bd6bff700 1 -- 172.21.15.43:0/2583025465 wait complete. 2023-08-27T11:25:05.772 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-27T11:25:05.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.976+0000 7f4529bff700 1 Processor -- start 2023-08-27T11:25:05.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.977+0000 7f4529bff700 1 -- start start 2023-08-27T11:25:05.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4529bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 0x7f45240c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4529bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 0x7f45240ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4529bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4524154660 con 0x7f45240abcc0 2023-08-27T11:25:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4529bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240c5750 con 0x7f45240c7c00 2023-08-27T11:25:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4529bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524154940 con 0x7f4524151d20 2023-08-27T11:25:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4523fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f45240abcc0 0x7f452406a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59158/0 (socket says 172.21.15.43:59158) 2023-08-27T11:25:05.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4523fff700 1 -- 172.21.15.43:0/3379970714 learned_addr learned my addr 172.21.15.43:0/3379970714 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:05.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f45237fe700 1 --2- 172.21.15.43:0/3379970714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 0x7f45240c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f4522ffd700 1 --2- 172.21.15.43:0/3379970714 >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 0x7f45240ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.978+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550487441 0 0) 0x7f4524154660 con 0x7f45240abcc0 2023-08-27T11:25:05.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450c0035b0 con 0x7f45240abcc0 2023-08-27T11:25:05.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45237fe700 1 -- 172.21.15.43:0/3379970714 >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 msgr2=0x7f45240ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:05.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45237fe700 1 --2- 172.21.15.43:0/3379970714 >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 0x7f45240ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623689295 0 0) 0x7f450c0035b0 con 0x7f45240abcc0 2023-08-27T11:25:05.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45237fe700 1 -- 172.21.15.43:0/3379970714 >> v1:172.21.15.43:6789/0 conn(0x7f45240abcc0 legacy=0x7f452406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45237fe700 1 -- 172.21.15.43:0/3379970714 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524154c20 con 0x7f4524151d20 2023-08-27T11:25:05.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f4522ffd700 1 --2- 172.21.15.43:0/3379970714 >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 0x7f45240ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:05.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45237fe700 1 --2- 172.21.15.43:0/3379970714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 0x7f45240c8110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4514009840 tx=0x7f4514009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6e669f646d68d8e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.979+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c001a40 con 0x7f4524151d20 2023-08-27T11:25:05.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514004030 con 0x7f4524151d20 2023-08-27T11:25:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f45227fc700 1 -- 172.21.15.43:0/3379970714 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140043c0 con 0x7f4524151d20 2023-08-27T11:25:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 -- 172.21.15.43:0/3379970714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 msgr2=0x7f45240c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 --2- 172.21.15.43:0/3379970714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 0x7f45240c8110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4514009840 tx=0x7f4514009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 -- 172.21.15.43:0/3379970714 shutdown_connections 2023-08-27T11:25:05.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 --2- 172.21.15.43:0/3379970714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4524151d20 0x7f45240c8110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 --2- 172.21.15.43:0/3379970714 >> v2:172.21.15.57:3300/0 conn(0x7f45240c7c00 0x7f45240ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 -- 172.21.15.43:0/3379970714 >> 172.21.15.43:0/3379970714 conn(0x7f45240c9d00 msgr2=0x7f45240ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 -- 172.21.15.43:0/3379970714 shutdown_connections 2023-08-27T11:25:05.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.980+0000 7f4529bff700 1 -- 172.21.15.43:0/3379970714 wait complete. 2023-08-27T11:25:05.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.982+0000 7f4529bff700 1 Processor -- start 2023-08-27T11:25:05.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.982+0000 7f4529bff700 1 -- start start 2023-08-27T11:25:05.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45240c7c00 0x7f45240a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 0x7f4524147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ab020 con 0x7f45240abcc0 2023-08-27T11:25:05.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45241e9fa0 con 0x7f4524151d20 2023-08-27T11:25:05.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4529bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45241ea4d0 con 0x7f45240c7c00 2023-08-27T11:25:05.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f45237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f45237fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48738/0 (socket says 172.21.15.43:48738) 2023-08-27T11:25:05.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f45237fe700 1 -- 172.21.15.43:0/155712439 learned_addr learned my addr 172.21.15.43:0/155712439 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:05.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4522ffd700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45240c7c00 0x7f45240a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f4523fff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 0x7f4524147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.983+0000 7f45237fe700 1 -- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45240c7c00 msgr2=0x7f45240a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f45237fe700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45240c7c00 0x7f45240a9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f45237fe700 1 -- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 msgr2=0x7f4524147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f45237fe700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 0x7f4524147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f45237fe700 1 -- 172.21.15.43:0/155712439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180094a0 con 0x7f45240abcc0 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f4523fff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 0x7f4524147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:05.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f45237fe700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4524154a80 tx=0x7f4514004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514003bc0 con 0x7f45240abcc0 2023-08-27T11:25:05.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451401f070 con 0x7f45240abcc0 2023-08-27T11:25:05.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514011630 con 0x7f45240abcc0 2023-08-27T11:25:05.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140094a0 con 0x7f45240abcc0 2023-08-27T11:25:05.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.984+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45240abaa0 con 0x7f45240abcc0 2023-08-27T11:25:05.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.985+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452404ee70 con 0x7f45240abcc0 2023-08-27T11:25:05.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.986+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4514021030 con 0x7f45240abcc0 2023-08-27T11:25:05.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.988+0000 7f450bfff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 0x7f451006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:05.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.988+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f45140899e0 con 0x7f45240abcc0 2023-08-27T11:25:05.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.988+0000 7f4522ffd700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 0x7f451006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.988+0000 7f4522ffd700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 0x7f451006c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f452406b3b0 tx=0x7f4518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:05.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:05.992+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f45140550d0 con 0x7f45240abcc0 2023-08-27T11:25:06.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.203+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f45240ac650 con 0x7f45240abcc0 2023-08-27T11:25:06.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.203+0000 7f450bfff700 1 -- 172.21.15.43:0/155712439 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7f45140586f0 con 0x7f45240abcc0 2023-08-27T11:25:06.205 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:25:06.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.205+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 msgr2=0x7f451006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.205+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 0x7f451006c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f452406b3b0 tx=0x7f4518008040 comp rx=0 tx=0).stop 2023-08-27T11:25:06.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.205+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 msgr2=0x7f45240aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.205+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4524154a80 tx=0x7f4514004750 comp rx=0 tx=0).stop 2023-08-27T11:25:06.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 shutdown_connections 2023-08-27T11:25:06.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451006a0e0 0x7f451006c5a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4524151d20 0x7f4524147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45240abcc0 0x7f45240aaae0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 --2- 172.21.15.43:0/155712439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45240c7c00 0x7f45240a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 >> 172.21.15.43:0/155712439 conn(0x7f45240c9d00 msgr2=0x7f45241508d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:06.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 shutdown_connections 2023-08-27T11:25:06.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.206+0000 7f4529bff700 1 -- 172.21.15.43:0/155712439 wait complete. 2023-08-27T11:25:06.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:06.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.426+0000 7f3a1f9ff700 1 Processor -- start 2023-08-27T11:25:06.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.426+0000 7f3a1f9ff700 1 -- start start 2023-08-27T11:25:06.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1f9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a1806a6f0 0x7f3a1815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1f9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180c6820 con 0x7f3a1806a310 2023-08-27T11:25:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1f9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1806ab60 con 0x7f3a1806e360 2023-08-27T11:25:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1f9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a180c23a0 con 0x7f3a1806a6f0 2023-08-27T11:25:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1d79b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3a1806a310 0x7f3a18157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59164/0 (socket says 172.21.15.43:59164) 2023-08-27T11:25:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1d79b700 1 -- 172.21.15.43:0/3324795921 learned_addr learned my addr 172.21.15.43:0/3324795921 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:06.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.427+0000 7f3a1df9c700 1 --2- 172.21.15.43:0/3324795921 >> v2:172.21.15.43:3300/0 conn(0x7f3a1806a6f0 0x7f3a1815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a0ffff700 1 -- 172.21.15.43:0/3324795921 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621181075 0 0) 0x7f3a180c6820 con 0x7f3a1806a310 2023-08-27T11:25:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a0ffff700 1 -- 172.21.15.43:0/3324795921 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a040035b0 con 0x7f3a1806a310 2023-08-27T11:25:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a1df9c700 1 -- 172.21.15.43:0/3324795921 >> v1:172.21.15.57:6789/0 conn(0x7f3a1806e360 legacy=0x7f3a18158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a1df9c700 1 -- 172.21.15.43:0/3324795921 >> v1:172.21.15.43:6789/0 conn(0x7f3a1806a310 legacy=0x7f3a18157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a1df9c700 1 -- 172.21.15.43:0/3324795921 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a181588a0 con 0x7f3a1806a6f0 2023-08-27T11:25:06.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.428+0000 7f3a1df9c700 1 --2- 172.21.15.43:0/3324795921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a6f0 0x7f3a1815fe20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009d90 tx=0x7f3a1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7efe68ece6fef0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a0ffff700 1 -- 172.21.15.43:0/3324795921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000e070 con 0x7f3a1806a6f0 2023-08-27T11:25:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a0ffff700 1 -- 172.21.15.43:0/3324795921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000bb20 con 0x7f3a1806a6f0 2023-08-27T11:25:06.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a0ffff700 1 -- 172.21.15.43:0/3324795921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10012430 con 0x7f3a1806a6f0 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/3324795921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a6f0 msgr2=0x7f3a1815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/3324795921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a6f0 0x7f3a1815fe20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009d90 tx=0x7f3a1000b330 comp rx=0 tx=0).stop 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/3324795921 shutdown_connections 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/3324795921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a6f0 0x7f3a1815fe20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/3324795921 >> 172.21.15.43:0/3324795921 conn(0x7f3a180a85e0 msgr2=0x7f3a180a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:06.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/3324795921 shutdown_connections 2023-08-27T11:25:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.429+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/3324795921 wait complete. 2023-08-27T11:25:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.431+0000 7f3a1f9ff700 1 Processor -- start 2023-08-27T11:25:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.431+0000 7f3a1f9ff700 1 -- start start 2023-08-27T11:25:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 0x7f3a180c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 0x7f3a181ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181ed2e0 con 0x7f3a1806a310 2023-08-27T11:25:06.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1814e980 con 0x7f3a1806a6f0 2023-08-27T11:25:06.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1f9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180aa9f0 con 0x7f3a1806e360 2023-08-27T11:25:06.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1d79b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1d79b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48760/0 (socket says 172.21.15.43:48760) 2023-08-27T11:25:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1d79b700 1 -- 172.21.15.43:0/1832063998 learned_addr learned my addr 172.21.15.43:0/1832063998 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1df9c700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 0x7f3a181ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.432+0000 7f3a1cf9a700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 0x7f3a180c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 -- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 msgr2=0x7f3a181ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 0x7f3a181ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 -- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 msgr2=0x7f3a180c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 0x7f3a180c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 -- 172.21.15.43:0/1832063998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009a70 con 0x7f3a1806a310 2023-08-27T11:25:06.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1df9c700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 0x7f3a181ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1cf9a700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 0x7f3a180c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:06.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1d79b700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c700 tx=0x7f3a1400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14005d70 con 0x7f3a1806a310 2023-08-27T11:25:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a140070d0 con 0x7f3a1806a310 2023-08-27T11:25:06.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007460 con 0x7f3a1806a310 2023-08-27T11:25:06.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a181e9ea0 con 0x7f3a1806a310 2023-08-27T11:25:06.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.433+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a181e9b50 con 0x7f3a1806a310 2023-08-27T11:25:06.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.435+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a181e9ce0 con 0x7f3a1806a310 2023-08-27T11:25:06.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.435+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3a140075c0 con 0x7f3a1806a310 2023-08-27T11:25:06.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.436+0000 7f3a0dffb700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 0x7f39fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.436+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3a14087d10 con 0x7f3a1806a310 2023-08-27T11:25:06.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.437+0000 7f3a1cf9a700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 0x7f39fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.437+0000 7f3a1cf9a700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 0x7f39fc06c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a181e7740 tx=0x7f3a08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.441+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3a1408d020 con 0x7f3a1806a310 2023-08-27T11:25:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.694+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a181ed550 con 0x7f3a1806a310 2023-08-27T11:25:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.694+0000 7f3a0dffb700 1 -- 172.21.15.43:0/1832063998 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4872 (secure 0 0 0) 0x7f3a14053260 con 0x7f3a1806a310 2023-08-27T11:25:06.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:06.696 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5800,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3014360349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3014360349},{"type":"v1","addr":"172.21.15.57:6835","nonce":3014360349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:25:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 msgr2=0x7f39fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 0x7f39fc06c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a181e7740 tx=0x7f3a08009040 comp rx=0 tx=0).stop 2023-08-27T11:25:06.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 msgr2=0x7f3a18153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c700 tx=0x7f3a1400cac0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 shutdown_connections 2023-08-27T11:25:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f39fc06a0e0 0x7f39fc06c5a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a1806e360 0x7f3a181ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a1806a310 0x7f3a18153e20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 --2- 172.21.15.43:0/1832063998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a1806a6f0 0x7f3a180c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 >> 172.21.15.43:0/1832063998 conn(0x7f3a180a85e0 msgr2=0x7f3a180c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 shutdown_connections 2023-08-27T11:25:06.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.697+0000 7f3a1f9ff700 1 -- 172.21.15.43:0/1832063998 wait complete. 2023-08-27T11:25:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 49 2023-08-27T11:25:06.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:06.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.917+0000 7f50757ff700 1 Processor -- start 2023-08-27T11:25:06.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.917+0000 7f50757ff700 1 -- start start 2023-08-27T11:25:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.918+0000 7f50757ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50700c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.918+0000 7f50757ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.918+0000 7f50757ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507006c4e0 con 0x7f507006ad70 2023-08-27T11:25:06.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f50757ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5070155370 con 0x7f50700c4630 2023-08-27T11:25:06.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f50757ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070151e70 con 0x7f5070151a90 2023-08-27T11:25:06.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48772/0 (socket says 172.21.15.43:48772) 2023-08-27T11:25:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 -- 172.21.15.43:0/1019064310 learned_addr learned my addr 172.21.15.43:0/1019064310 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506effd700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50700c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 -- 172.21.15.43:0/1019064310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 msgr2=0x7f50700c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50700c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 -- 172.21.15.43:0/1019064310 >> v1:172.21.15.57:6789/0 conn(0x7f507006ad70 legacy=0x7f507006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.919+0000 7f506e7fc700 1 -- 172.21.15.43:0/1019064310 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070154480 con 0x7f50700c4630 2023-08-27T11:25:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f506e7fc700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c4630 0x7f50700c4a90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f50640098f0 tx=0x7f5064009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6c7beae4c76f8a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f506dffb700 1 -- 172.21.15.43:0/1019064310 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011830 con 0x7f50700c4630 2023-08-27T11:25:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f506dffb700 1 -- 172.21.15.43:0/1019064310 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064011990 con 0x7f50700c4630 2023-08-27T11:25:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f506dffb700 1 -- 172.21.15.43:0/1019064310 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011d20 con 0x7f50700c4630 2023-08-27T11:25:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 -- 172.21.15.43:0/1019064310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c4630 msgr2=0x7f50700c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c4630 0x7f50700c4a90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f50640098f0 tx=0x7f5064009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 -- 172.21.15.43:0/1019064310 shutdown_connections 2023-08-27T11:25:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50700c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 --2- 172.21.15.43:0/1019064310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50700c4630 0x7f50700c4a90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.920+0000 7f50757ff700 1 -- 172.21.15.43:0/1019064310 >> 172.21.15.43:0/1019064310 conn(0x7f50700ab820 msgr2=0x7f50700abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.921+0000 7f50757ff700 1 -- 172.21.15.43:0/1019064310 shutdown_connections 2023-08-27T11:25:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.921+0000 7f50757ff700 1 -- 172.21.15.43:0/1019064310 wait complete. 2023-08-27T11:25:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.922+0000 7f50757ff700 1 Processor -- start 2023-08-27T11:25:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.922+0000 7f50757ff700 1 -- start start 2023-08-27T11:25:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.923+0000 7f50757ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f50757ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 0x7f507014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f50757ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50701460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f50757ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ab5f0 con 0x7f507006ad70 2023-08-27T11:25:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f50757ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700bd220 con 0x7f50700c4630 2023-08-27T11:25:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f50757ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070158750 con 0x7f5070151a90 2023-08-27T11:25:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48778/0 (socket says 172.21.15.43:48778) 2023-08-27T11:25:06.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 -- 172.21.15.43:0/3686230236 learned_addr learned my addr 172.21.15.43:0/3686230236 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:06.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506f7fe700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50701460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506e7fc700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 0x7f507014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 -- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 msgr2=0x7f50701460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50701460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 -- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 msgr2=0x7f507014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 0x7f507014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506effd700 1 -- 172.21.15.43:0/3686230236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009550 con 0x7f507006ad70 2023-08-27T11:25:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.924+0000 7f506e7fc700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 0x7f507014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f506effd700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f506000e870 tx=0x7f506000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060009590 con 0x7f507006ad70 2023-08-27T11:25:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000ee70 con 0x7f507006ad70 2023-08-27T11:25:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700ab070 con 0x7f507006ad70 2023-08-27T11:25:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000ca50 con 0x7f507006ad70 2023-08-27T11:25:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.925+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700ab310 con 0x7f507006ad70 2023-08-27T11:25:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.926+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004ee70 con 0x7f507006ad70 2023-08-27T11:25:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.929+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f506000cbb0 con 0x7f507006ad70 2023-08-27T11:25:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.930+0000 7f50577fe700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 0x7f505c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.930+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5060088dc0 con 0x7f507006ad70 2023-08-27T11:25:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.930+0000 7f506e7fc700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 0x7f505c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.931+0000 7f506e7fc700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 0x7f505c06c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50640098f0 tx=0x7f5064008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:06.933+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5060057ea0 con 0x7f507006ad70 2023-08-27T11:25:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.148+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f507006c130 con 0x7f507006ad70 2023-08-27T11:25:07.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.149+0000 7f50577fe700 1 -- 172.21.15.43:0/3686230236 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18568 (secure 0 0 0) 0x7f5060017090 con 0x7f507006ad70 2023-08-27T11:25:07.151 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:07.151 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":56,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:03.907785+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6833/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 msgr2=0x7f505c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 0x7f505c06c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50640098f0 tx=0x7f5064008030 comp rx=0 tx=0).stop 2023-08-27T11:25:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 msgr2=0x7f5070150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f506000e870 tx=0x7f506000ec30 comp rx=0 tx=0).stop 2023-08-27T11:25:07.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 shutdown_connections 2023-08-27T11:25:07.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f505c06a0e0 0x7f505c06c5a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5070151a90 0x7f50701460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f507006ad70 0x7f5070150eb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 --2- 172.21.15.43:0/3686230236 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50700c4630 0x7f507014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.151+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 >> 172.21.15.43:0/3686230236 conn(0x7f50700ab820 msgr2=0x7f507014c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.152+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 shutdown_connections 2023-08-27T11:25:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.152+0000 7f50757ff700 1 -- 172.21.15.43:0/3686230236 wait complete. 2023-08-27T11:25:07.171 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-08-27T11:25:07.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:07.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.373+0000 7f8b425ff700 1 Processor -- start 2023-08-27T11:25:07.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.373+0000 7f8b425ff700 1 -- start start 2023-08-27T11:25:07.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 0x7f8b3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8b3c06ca60 0x7f8b3c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b3c0ab040 0x7f8b3c155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c1530b0 con 0x7f8b3c06ca60 2023-08-27T11:25:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3c14c860 con 0x7f8b3c0ab040 2023-08-27T11:25:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b425ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c06d700 con 0x7f8b3c0c51a0 2023-08-27T11:25:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b3b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8b3c06ca60 0x7f8b3c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b3b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8b3c06ca60 0x7f8b3c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48790/0 (socket says 172.21.15.43:48790) 2023-08-27T11:25:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.374+0000 7f8b3b7fe700 1 -- 172.21.15.43:0/2495496079 learned_addr learned my addr 172.21.15.43:0/2495496079 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b40b9c700 1 --2- 172.21.15.43:0/2495496079 >> v2:172.21.15.57:3300/0 conn(0x7f8b3c0ab040 0x7f8b3c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3bfff700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 0x7f8b3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 -- 172.21.15.43:0/2495496079 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 msgr2=0x7f8b3c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 0x7f8b3c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 -- 172.21.15.43:0/2495496079 >> v2:172.21.15.57:3300/0 conn(0x7f8b3c0ab040 msgr2=0x7f8b3c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2495496079 >> v2:172.21.15.57:3300/0 conn(0x7f8b3c0ab040 0x7f8b3c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 -- 172.21.15.43:0/2495496079 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c152430 con 0x7f8b3c06ca60 2023-08-27T11:25:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3bfff700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 0x7f8b3c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c0aab00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c072b20 tx=0x7f8b30009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614a0c7803caaeba server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3affd700 1 -- 172.21.15.43:0/2495496079 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011830 con 0x7f8b3c06ca60 2023-08-27T11:25:07.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3affd700 1 -- 172.21.15.43:0/2495496079 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30011990 con 0x7f8b3c06ca60 2023-08-27T11:25:07.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.375+0000 7f8b3affd700 1 -- 172.21.15.43:0/2495496079 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30011d20 con 0x7f8b3c06ca60 2023-08-27T11:25:07.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 -- 172.21.15.43:0/2495496079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 msgr2=0x7f8b3c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c0aab00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c072b20 tx=0x7f8b30009c30 comp rx=0 tx=0).stop 2023-08-27T11:25:07.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 -- 172.21.15.43:0/2495496079 shutdown_connections 2023-08-27T11:25:07.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2495496079 >> v2:172.21.15.57:3300/0 conn(0x7f8b3c0ab040 0x7f8b3c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0c51a0 0x7f8b3c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2495496079 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c0aab00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 -- 172.21.15.43:0/2495496079 >> 172.21.15.43:0/2495496079 conn(0x7f8b3c06aa50 msgr2=0x7f8b3c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 -- 172.21.15.43:0/2495496079 shutdown_connections 2023-08-27T11:25:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.376+0000 7f8b425ff700 1 -- 172.21.15.43:0/2495496079 wait complete. 2023-08-27T11:25:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.378+0000 7f8b425ff700 1 Processor -- start 2023-08-27T11:25:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.378+0000 7f8b425ff700 1 -- start start 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 0x7f8b3c0a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 0x7f8b3c1e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c1eca30 con 0x7f8b3c06ca60 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0aa1b0 con 0x7f8b3c0c51a0 2023-08-27T11:25:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b425ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c0aa490 con 0x7f8b3c0ab040 2023-08-27T11:25:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b3bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b3bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48798/0 (socket says 172.21.15.43:48798) 2023-08-27T11:25:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.379+0000 7f8b3bfff700 1 -- 172.21.15.43:0/2739341229 learned_addr learned my addr 172.21.15.43:0/2739341229 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b40b9c700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 0x7f8b3c1e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 0x7f8b3c0a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 -- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 msgr2=0x7f8b3c0a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 0x7f8b3c0a7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 -- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 msgr2=0x7f8b3c1e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 0x7f8b3c1e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 -- 172.21.15.43:0/2739341229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30009550 con 0x7f8b3c06ca60 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b40b9c700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 0x7f8b3c1e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 0x7f8b3c0a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b3bfff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00e810 tx=0x7f8b2c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c00c020 con 0x7f8b3c06ca60 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c004250 con 0x7f8b3c06ca60 2023-08-27T11:25:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c0aa770 con 0x7f8b3c06ca60 2023-08-27T11:25:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0036a0 con 0x7f8b3c06ca60 2023-08-27T11:25:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.380+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c0bfbc0 con 0x7f8b3c06ca60 2023-08-27T11:25:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.381+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c0aa900 con 0x7f8b3c06ca60 2023-08-27T11:25:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.382+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b2c003800 con 0x7f8b3c06ca60 2023-08-27T11:25:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.383+0000 7f8b38ff9700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 0x7f8b2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.383+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8b2c088270 con 0x7f8b3c06ca60 2023-08-27T11:25:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.384+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 0x7f8b2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.384+0000 7f8b3b7fe700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 0x7f8b2806c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0c3570 tx=0x7f8b30008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.387+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8b2c0537b0 con 0x7f8b3c06ca60 2023-08-27T11:25:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.643+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b3c04ee70 con 0x7f8b3c06ca60 2023-08-27T11:25:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.643+0000 7f8b38ff9700 1 -- 172.21.15.43:0/2739341229 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4872 (secure 0 0 0) 0x7f8b2c056dd0 con 0x7f8b3c06ca60 2023-08-27T11:25:07.645 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:07.645 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5800,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3014360349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3014360349},{"type":"v1","addr":"172.21.15.57:6835","nonce":3014360349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:25:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.645+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 msgr2=0x7f8b2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.645+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 0x7f8b2806c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c0c3570 tx=0x7f8b30008030 comp rx=0 tx=0).stop 2023-08-27T11:25:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.645+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 msgr2=0x7f8b3c06feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.645+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00e810 tx=0x7f8b2c00ebd0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 shutdown_connections 2023-08-27T11:25:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8b2806a0e0 0x7f8b2806c5a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b3c0c51a0 0x7f8b3c1e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8b3c06ca60 0x7f8b3c06feb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 --2- 172.21.15.43:0/2739341229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b3c0ab040 0x7f8b3c0a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 >> 172.21.15.43:0/2739341229 conn(0x7f8b3c06aa50 msgr2=0x7f8b3c0bab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 shutdown_connections 2023-08-27T11:25:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.646+0000 7f8b425ff700 1 -- 172.21.15.43:0/2739341229 wait complete. 2023-08-27T11:25:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 49 2023-08-27T11:25:07.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:07.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.865+0000 7fb32f7ff700 1 Processor -- start 2023-08-27T11:25:07.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.865+0000 7fb32f7ff700 1 -- start start 2023-08-27T11:25:07.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.866+0000 7fb32f7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb32806c690 0x7fb3280c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.866+0000 7fb32f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3280c4600 0x7fb3280c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.866+0000 7fb32f7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3281546f0 con 0x7fb32806b320 2023-08-27T11:25:07.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.866+0000 7fb32f7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3280c4bb0 con 0x7fb32806c690 2023-08-27T11:25:07.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.866+0000 7fb32f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c4e90 con 0x7fb3280c4600 2023-08-27T11:25:07.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb32806c690 0x7fb3280c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32d59b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb32806b320 0x7fb32814dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59170/0 (socket says 172.21.15.43:59170) 2023-08-27T11:25:07.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32d59b700 1 -- 172.21.15.43:0/250571955 learned_addr learned my addr 172.21.15.43:0/250571955 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:07.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32dd9c700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3280c4600 0x7fb3280c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 -- 172.21.15.43:0/250571955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3280c4600 msgr2=0x7fb3280c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:07.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3280c4600 0x7fb3280c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 -- 172.21.15.43:0/250571955 >> v1:172.21.15.43:6789/0 conn(0x7fb32806b320 legacy=0x7fb32814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 -- 172.21.15.43:0/250571955 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280c5170 con 0x7fb32806c690 2023-08-27T11:25:07.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb31ffff700 1 -- 172.21.15.43:0/250571955 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215611838 0 0) 0x7fb3281546f0 con 0x7fb32806b320 2023-08-27T11:25:07.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.867+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806c690 0x7fb3280c5970 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb318009840 tx=0x7fb318009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6351c2bf0c4bb655 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb31ffff700 1 -- 172.21.15.43:0/250571955 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318011830 con 0x7fb32806c690 2023-08-27T11:25:07.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb31ffff700 1 -- 172.21.15.43:0/250571955 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb318011990 con 0x7fb32806c690 2023-08-27T11:25:07.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb31ffff700 1 -- 172.21.15.43:0/250571955 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318011d20 con 0x7fb32806c690 2023-08-27T11:25:07.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 -- 172.21.15.43:0/250571955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806c690 msgr2=0x7fb3280c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806c690 0x7fb3280c5970 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb318009840 tx=0x7fb318009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:07.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 -- 172.21.15.43:0/250571955 shutdown_connections 2023-08-27T11:25:07.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3280c4600 0x7fb3280c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/250571955 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806c690 0x7fb3280c5970 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 -- 172.21.15.43:0/250571955 >> 172.21.15.43:0/250571955 conn(0x7fb3280c9c80 msgr2=0x7fb3280ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:07.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 -- 172.21.15.43:0/250571955 shutdown_connections 2023-08-27T11:25:07.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.868+0000 7fb32f7ff700 1 -- 172.21.15.43:0/250571955 wait complete. 2023-08-27T11:25:07.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.870+0000 7fb32f7ff700 1 Processor -- start 2023-08-27T11:25:07.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.870+0000 7fb32f7ff700 1 -- start start 2023-08-27T11:25:07.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 0x7fb328158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 0x7fb3281ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c1280 con 0x7fb32806b320 2023-08-27T11:25:07.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c14d0 con 0x7fb3280c4600 2023-08-27T11:25:07.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280c17b0 con 0x7fb32806c690 2023-08-27T11:25:07.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32d59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32d59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48812/0 (socket says 172.21.15.43:48812) 2023-08-27T11:25:07.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.871+0000 7fb32d59b700 1 -- 172.21.15.43:0/2747928075 learned_addr learned my addr 172.21.15.43:0/2747928075 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 0x7fb328158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 -- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 msgr2=0x7fb328158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32dd9c700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 0x7fb3281ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 0x7fb328158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 -- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 msgr2=0x7fb3281ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 0x7fb3281ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 -- 172.21.15.43:0/2747928075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180094a0 con 0x7fb32806b320 2023-08-27T11:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 0x7fb328158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32dd9c700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 0x7fb3281ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32d59b700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb3240011e0 tx=0x7fb32400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324004c80 con 0x7fb32806b320 2023-08-27T11:25:07.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb324004e00 con 0x7fb32806b320 2023-08-27T11:25:07.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324007310 con 0x7fb32806b320 2023-08-27T11:25:07.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3280c1a90 con 0x7fb32806b320 2023-08-27T11:25:07.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.872+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280c1d70 con 0x7fb32806b320 2023-08-27T11:25:07.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.873+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32804ee70 con 0x7fb32806b320 2023-08-27T11:25:07.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.874+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb324007470 con 0x7fb32806b320 2023-08-27T11:25:07.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.875+0000 7fb31dffb700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 0x7fb30c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:07.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.875+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb3240883f0 con 0x7fb32806b320 2023-08-27T11:25:07.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.876+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 0x7fb30c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:07.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.876+0000 7fb32cd9a700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 0x7fb30c06c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3280a96f0 tx=0x7fb318008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:07.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:07.879+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb3240539c0 con 0x7fb32806b320 2023-08-27T11:25:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.133+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb32806bac0 con 0x7fb32806b320 2023-08-27T11:25:08.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.134+0000 7fb31dffb700 1 -- 172.21.15.43:0/2747928075 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4872 (secure 0 0 0) 0x7fb324056fe0 con 0x7fb32806b320 2023-08-27T11:25:08.136 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:08.136 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":5800,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3014360349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3014360349},{"type":"v1","addr":"172.21.15.57:6835","nonce":3014360349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:24:47.511639+0000","modified":"2023-08-27T11:24:51.013676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5583},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5583":{"gid":5583,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":7,"addr":"172.21.15.57:6834/3641122539","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3641122539},{"type":"v1","addr":"172.21.15.57:6834","nonce":3641122539}]},"join_fscid":4,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-27T11:25:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 msgr2=0x7fb30c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 0x7fb30c06c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb3280a96f0 tx=0x7fb318008030 comp rx=0 tx=0).stop 2023-08-27T11:25:08.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 msgr2=0x7fb328157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb3240011e0 tx=0x7fb32400cae0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 shutdown_connections 2023-08-27T11:25:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb30c06a0e0 0x7fb30c06c5a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3280c4600 0x7fb3281ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb32806b320 0x7fb328157b40 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 --2- 172.21.15.43:0/2747928075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb32806c690 0x7fb328158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 >> 172.21.15.43:0/2747928075 conn(0x7fb3280c9c80 msgr2=0x7fb32814d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 shutdown_connections 2023-08-27T11:25:08.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.136+0000 7fb32f7ff700 1 -- 172.21.15.43:0/2747928075 wait complete. 2023-08-27T11:25:08.143 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 49 2023-08-27T11:25:08.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:08.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.355+0000 7fa6703ff700 1 Processor -- start 2023-08-27T11:25:08.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.356+0000 7fa6703ff700 1 -- start start 2023-08-27T11:25:08.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.357+0000 7fa6703ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa66814e0d0 0x7fa6680c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.357+0000 7fa6703ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa6680bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.357+0000 7fa6703ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6680c17f0 con 0x7fa6680c45c0 2023-08-27T11:25:08.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa6703ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6680c21a0 con 0x7fa66814e0d0 2023-08-27T11:25:08.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa6703ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680bc210 con 0x7fa6680c4c40 2023-08-27T11:25:08.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa66814e0d0 0x7fa6680c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e99c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa6680c45c0 0x7fa6680bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59176/0 (socket says 172.21.15.43:59176) 2023-08-27T11:25:08.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e99c700 1 -- 172.21.15.43:0/654427366 learned_addr learned my addr 172.21.15.43:0/654427366 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:08.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66d99a700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa6680bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 -- 172.21.15.43:0/654427366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 msgr2=0x7fa6680bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa6680bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 -- 172.21.15.43:0/654427366 >> v1:172.21.15.43:6789/0 conn(0x7fa6680c45c0 legacy=0x7fa6680bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 -- 172.21.15.43:0/654427366 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6680c0900 con 0x7fa66814e0d0 2023-08-27T11:25:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66d99a700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa6680bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:08.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.358+0000 7fa66e19b700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa6680c4080 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa66400bb10 tx=0x7fa66400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9fd601baba87b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa66d199700 1 -- 172.21.15.43:0/654427366 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400dcf0 con 0x7fa66814e0d0 2023-08-27T11:25:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa66d199700 1 -- 172.21.15.43:0/654427366 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400de50 con 0x7fa66814e0d0 2023-08-27T11:25:08.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa66d199700 1 -- 172.21.15.43:0/654427366 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664010690 con 0x7fa66814e0d0 2023-08-27T11:25:08.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 -- 172.21.15.43:0/654427366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 msgr2=0x7fa6680c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa6680c4080 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa66400bb10 tx=0x7fa66400be20 comp rx=0 tx=0).stop 2023-08-27T11:25:08.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 -- 172.21.15.43:0/654427366 shutdown_connections 2023-08-27T11:25:08.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa6680c4080 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 --2- 172.21.15.43:0/654427366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa6680bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 -- 172.21.15.43:0/654427366 >> 172.21.15.43:0/654427366 conn(0x7fa66806aa50 msgr2=0x7fa6680c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:08.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.359+0000 7fa6703ff700 1 -- 172.21.15.43:0/654427366 shutdown_connections 2023-08-27T11:25:08.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.360+0000 7fa6703ff700 1 -- 172.21.15.43:0/654427366 wait complete. 2023-08-27T11:25:08.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.362+0000 7fa6703ff700 1 Processor -- start 2023-08-27T11:25:08.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.362+0000 7fa6703ff700 1 -- start start 2023-08-27T11:25:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 0x7fa668152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa66806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6681532c0 con 0x7fa66814e0d0 2023-08-27T11:25:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa668150710 con 0x7fa6680c45c0 2023-08-27T11:25:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.363+0000 7fa6703ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa668154aa0 con 0x7fa6680c4c40 2023-08-27T11:25:08.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48834/0 (socket says 172.21.15.43:48834) 2023-08-27T11:25:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 -- 172.21.15.43:0/162859635 learned_addr learned my addr 172.21.15.43:0/162859635 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e19b700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 0x7fa668152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66d99a700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa66806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 -- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 msgr2=0x7fa66806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa66806c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 -- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 msgr2=0x7fa668152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 0x7fa668152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 -- 172.21.15.43:0/162859635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66400b740 con 0x7fa66814e0d0 2023-08-27T11:25:08.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e19b700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 0x7fa668152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66d99a700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa66806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa66e99c700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa66000ca80 tx=0x7fa66000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.364+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000aaa0 con 0x7fa66814e0d0 2023-08-27T11:25:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.365+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000ac00 con 0x7fa66814e0d0 2023-08-27T11:25:08.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.365+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660012400 con 0x7fa66814e0d0 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.365+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa668154d80 con 0x7fa66814e0d0 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.365+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa668154730 con 0x7fa66814e0d0 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.366+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66804ee70 con 0x7fa66814e0d0 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.367+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa66001b3b0 con 0x7fa66814e0d0 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.368+0000 7fa65effd700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 0x7fa64c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.368+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa660088220 con 0x7fa66814e0d0 2023-08-27T11:25:08.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.368+0000 7fa66e19b700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 0x7fa64c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.369+0000 7fa66e19b700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 0x7fa64c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b2c0 tx=0x7fa664013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.373+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa660053810 con 0x7fa66814e0d0 2023-08-27T11:25:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.587+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6680c3e60 con 0x7fa66814e0d0 2023-08-27T11:25:08.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.588+0000 7fa65effd700 1 -- 172.21.15.43:0/162859635 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18568 (secure 0 0 0) 0x7fa660056e30 con 0x7fa66814e0d0 2023-08-27T11:25:08.590 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:08.590 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":56,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:03.907785+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:24:45.113541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:24:46.490147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6833/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.590+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 msgr2=0x7fa64c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.590+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 0x7fa64c06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b2c0 tx=0x7fa664013000 comp rx=0 tx=0).stop 2023-08-27T11:25:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.590+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 msgr2=0x7fa668151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.590+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa66000ca80 tx=0x7fa66000ce40 comp rx=0 tx=0).stop 2023-08-27T11:25:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 shutdown_connections 2023-08-27T11:25:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64c06a0e0 0x7fa64c06c5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa66814e0d0 0x7fa668151d60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6680c45c0 0x7fa668152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 --2- 172.21.15.43:0/162859635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6680c4c40 0x7fa66806c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 >> 172.21.15.43:0/162859635 conn(0x7fa66806aa50 msgr2=0x7fa6680c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 shutdown_connections 2023-08-27T11:25:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.591+0000 7fa6703ff700 1 -- 172.21.15.43:0/162859635 wait complete. 2023-08-27T11:25:08.610 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-08-27T11:25:08.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.811+0000 7f3331fff700 1 Processor -- start 2023-08-27T11:25:08.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.811+0000 7f3331fff700 1 -- start start 2023-08-27T11:25:08.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.812+0000 7f3331fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.812+0000 7f3331fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f332c154740 0x7f332c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.812+0000 7f3331fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c154d00 con 0x7f332c14e960 2023-08-27T11:25:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.812+0000 7f3331fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0baf30 con 0x7f332c154740 2023-08-27T11:25:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.812+0000 7f3331fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c154fe0 con 0x7f332c0c50d0 2023-08-27T11:25:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48556/0 (socket says 172.21.15.43:48556) 2023-08-27T11:25:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 -- 172.21.15.43:0/2828693697 learned_addr learned my addr 172.21.15.43:0/2828693697 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f332c14e960 0x7f332c0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:44434/0 (socket says 172.21.15.43:44434) 2023-08-27T11:25:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332bfff700 1 --2- 172.21.15.43:0/2828693697 >> v2:172.21.15.57:3300/0 conn(0x7f332c154740 0x7f332c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332a7fc700 1 -- 172.21.15.43:0/2828693697 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239311770 0 0) 0x7f332c154d00 con 0x7f332c14e960 2023-08-27T11:25:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332a7fc700 1 -- 172.21.15.43:0/2828693697 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33140035b0 con 0x7f332c14e960 2023-08-27T11:25:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 -- 172.21.15.43:0/2828693697 >> v2:172.21.15.57:3300/0 conn(0x7f332c154740 msgr2=0x7f332c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 --2- 172.21.15.43:0/2828693697 >> v2:172.21.15.57:3300/0 conn(0x7f332c154740 0x7f332c0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 -- 172.21.15.43:0/2828693697 >> v1:172.21.15.57:6789/0 conn(0x7f332c14e960 legacy=0x7f332c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.813+0000 7f332affd700 1 -- 172.21.15.43:0/2828693697 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c1552c0 con 0x7f332c0c50d0 2023-08-27T11:25:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f332affd700 1 --2- 172.21.15.43:0/2828693697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f332000bb90 tx=0x7f332000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77af10702e061508 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f332a7fc700 1 -- 172.21.15.43:0/2828693697 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000dd30 con 0x7f332c0c50d0 2023-08-27T11:25:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f332a7fc700 1 -- 172.21.15.43:0/2828693697 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000de90 con 0x7f332c0c50d0 2023-08-27T11:25:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f332a7fc700 1 -- 172.21.15.43:0/2828693697 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320010690 con 0x7f332c0c50d0 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 -- 172.21.15.43:0/2828693697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 msgr2=0x7f332c0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 --2- 172.21.15.43:0/2828693697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f332000bb90 tx=0x7f332000bea0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 -- 172.21.15.43:0/2828693697 shutdown_connections 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 --2- 172.21.15.43:0/2828693697 >> v2:172.21.15.57:3300/0 conn(0x7f332c154740 0x7f332c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 --2- 172.21.15.43:0/2828693697 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c0c50d0 0x7f332c0c3cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.814+0000 7f3331fff700 1 -- 172.21.15.43:0/2828693697 >> 172.21.15.43:0/2828693697 conn(0x7f332c06aa50 msgr2=0x7f332c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.815+0000 7f3331fff700 1 -- 172.21.15.43:0/2828693697 shutdown_connections 2023-08-27T11:25:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.815+0000 7f3331fff700 1 -- 172.21.15.43:0/2828693697 wait complete. 2023-08-27T11:25:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.816+0000 7f3331fff700 1 Processor -- start 2023-08-27T11:25:08.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.816+0000 7f3331fff700 1 -- start start 2023-08-27T11:25:08.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 0x7f332c1ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 0x7f332c0a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0bfa30 con 0x7f332c14e960 2023-08-27T11:25:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c071800 con 0x7f332c0c50d0 2023-08-27T11:25:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.817+0000 7f3331fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c1eda60 con 0x7f332c154740 2023-08-27T11:25:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48840/0 (socket says 172.21.15.43:48840) 2023-08-27T11:25:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 -- 172.21.15.43:0/50481842 learned_addr learned my addr 172.21.15.43:0/50481842 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332bfff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 0x7f332c0a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332b7fe700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 0x7f332c1ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 -- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 msgr2=0x7f332c0a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 0x7f332c0a3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 -- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 msgr2=0x7f332c1ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 0x7f332c1ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 -- 172.21.15.43:0/50481842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332000b7f0 con 0x7f332c14e960 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332bfff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 0x7f332c0a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332b7fe700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 0x7f332c1ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f332affd700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3320000c00 tx=0x7f3320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320003bf0 con 0x7f332c14e960 2023-08-27T11:25:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.818+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320003d50 con 0x7f332c14e960 2023-08-27T11:25:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.819+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200106b0 con 0x7f332c14e960 2023-08-27T11:25:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.819+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0725d0 con 0x7f332c14e960 2023-08-27T11:25:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.819+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c071d30 con 0x7f332c14e960 2023-08-27T11:25:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.820+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c0bb390 con 0x7f332c14e960 2023-08-27T11:25:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.821+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3320019400 con 0x7f332c14e960 2023-08-27T11:25:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.821+0000 7f3313fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 0x7f331806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.821+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3320089960 con 0x7f332c14e960 2023-08-27T11:25:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.822+0000 7f332b7fe700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 0x7f331806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:08.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.822+0000 7f332b7fe700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 0x7f331806c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f331c0011e0 tx=0x7f331c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:08.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:08.826+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3320054fe0 con 0x7f332c14e960 2023-08-27T11:25:09.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.084+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f332c0a5340 con 0x7f332c14e960 2023-08-27T11:25:09.086 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:25:09.085+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:25:09.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.090+0000 7f3313fff700 1 -- 172.21.15.43:0/50481842 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 163+0+0 (secure 0 0 0) 0x7f332c0a5340 con 0x7f332c14e960 2023-08-27T11:25:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.092+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 msgr2=0x7f331806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.092+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 0x7f331806c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f331c0011e0 tx=0x7f331c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.092+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 msgr2=0x7f332c1ed520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.092+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3320000c00 tx=0x7f3320004750 comp rx=0 tx=0).stop 2023-08-27T11:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.092+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 shutdown_connections 2023-08-27T11:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f331806a0e0 0x7f331806c5a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f332c154740 0x7f332c0a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f332c0c50d0 0x7f332c1ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 --2- 172.21.15.43:0/50481842 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f332c14e960 0x7f332c1ed520 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 >> 172.21.15.43:0/50481842 conn(0x7f332c06aa50 msgr2=0x7f332c0a7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 shutdown_connections 2023-08-27T11:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.093+0000 7f3331fff700 1 -- 172.21.15.43:0/50481842 wait complete. 2023-08-27T11:25:09.097 INFO:tasks.ceph.mds.b.smithi057.stderr: -427> 2023-08-27T11:24:53.248+0000 7f999bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:25:09.097 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:25:09.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-08-27T11:25:09.142 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:25:09.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.315+0000 7ff1f89ff700 1 Processor -- start 2023-08-27T11:25:09.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.315+0000 7ff1f89ff700 1 -- start start 2023-08-27T11:25:09.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.316+0000 7ff1f89ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff1f406d1c0 0x7ff1f4156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:09.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.316+0000 7ff1f89ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f4152430 con 0x7ff1f40c51a0 2023-08-27T11:25:09.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f89ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f4152710 con 0x7ff1f406ca60 2023-08-27T11:25:09.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f89ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f41530b0 con 0x7ff1f406d1c0 2023-08-27T11:25:09.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff1f40c51a0 0x7ff1f40aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53588/0 (socket says 172.21.15.43:53588) 2023-08-27T11:25:09.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f259c700 1 -- 172.21.15.43:0/1442035071 learned_addr learned my addr 172.21.15.43:0/1442035071 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:09.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f2d9d700 1 --2- 172.21.15.43:0/1442035071 >> v2:172.21.15.43:3300/0 conn(0x7ff1f406d1c0 0x7ff1f4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f1d9b700 1 -- 172.21.15.43:0/1442035071 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606777237 0 0) 0x7ff1f4152430 con 0x7ff1f40c51a0 2023-08-27T11:25:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f1d9b700 1 -- 172.21.15.43:0/1442035071 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e00035b0 con 0x7ff1f40c51a0 2023-08-27T11:25:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f2d9d700 1 -- 172.21.15.43:0/1442035071 >> v1:172.21.15.57:6789/0 conn(0x7ff1f406ca60 legacy=0x7ff1f4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f2d9d700 1 -- 172.21.15.43:0/1442035071 >> v1:172.21.15.43:6789/0 conn(0x7ff1f40c51a0 legacy=0x7ff1f40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.317+0000 7ff1f2d9d700 1 -- 172.21.15.43:0/1442035071 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f41529f0 con 0x7ff1f406d1c0 2023-08-27T11:25:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f2d9d700 1 --2- 172.21.15.43:0/1442035071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f4156020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009d90 tx=0x7ff1ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1c1146b2f7c4c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f1d9b700 1 -- 172.21.15.43:0/1442035071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec00e070 con 0x7ff1f406d1c0 2023-08-27T11:25:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f1d9b700 1 -- 172.21.15.43:0/1442035071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00bb20 con 0x7ff1f406d1c0 2023-08-27T11:25:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f1d9b700 1 -- 172.21.15.43:0/1442035071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec012430 con 0x7ff1f406d1c0 2023-08-27T11:25:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1442035071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 msgr2=0x7ff1f4156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1442035071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f4156020 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec009d90 tx=0x7ff1ec00b330 comp rx=0 tx=0).stop 2023-08-27T11:25:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1442035071 shutdown_connections 2023-08-27T11:25:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1442035071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f4156020 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1442035071 >> 172.21.15.43:0/1442035071 conn(0x7ff1f406aa50 msgr2=0x7ff1f40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.318+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1442035071 shutdown_connections 2023-08-27T11:25:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.319+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1442035071 wait complete. 2023-08-27T11:25:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.320+0000 7ff1f89ff700 1 Processor -- start 2023-08-27T11:25:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.320+0000 7ff1f89ff700 1 -- start start 2023-08-27T11:25:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1f406ca60 0x7ff1f41eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f40c51a0 0x7ff1f41e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f41eb900 con 0x7ff1f406d1c0 2023-08-27T11:25:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f41e7550 con 0x7ff1f40c51a0 2023-08-27T11:25:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1f89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40bf290 con 0x7ff1f406ca60 2023-08-27T11:25:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40932/0 (socket says 172.21.15.43:40932) 2023-08-27T11:25:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.321+0000 7ff1ebfff700 1 -- 172.21.15.43:0/1945321004 learned_addr learned my addr 172.21.15.43:0/1945321004 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1f2d9d700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f40c51a0 0x7ff1f41e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1f259c700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1f406ca60 0x7ff1f41eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 -- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1f406ca60 msgr2=0x7ff1f41eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1f406ca60 0x7ff1f41eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 -- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f40c51a0 msgr2=0x7ff1f41e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f40c51a0 0x7ff1f41e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 -- 172.21.15.43:0/1945321004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec009a70 con 0x7ff1f406d1c0 2023-08-27T11:25:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1ebfff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c4e0 tx=0x7ff1dc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0052d0 con 0x7ff1f406d1c0 2023-08-27T11:25:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc005430 con 0x7ff1f406d1c0 2023-08-27T11:25:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40bf570 con 0x7ff1f406d1c0 2023-08-27T11:25:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0038c0 con 0x7ff1f406d1c0 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.322+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f40bfb30 con 0x7ff1f406d1c0 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.323+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f414c840 con 0x7ff1f406d1c0 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.324+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff1dc003a20 con 0x7ff1f406d1c0 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.325+0000 7ff1eaffd700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 0x7ff1d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.325+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff1dc087be0 con 0x7ff1f406d1c0 2023-08-27T11:25:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.325+0000 7ff1f259c700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 0x7ff1d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.326+0000 7ff1f259c700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 0x7ff1d406c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40011e0 tx=0x7ff1e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.330+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff1f414c840 con 0x7ff1f406d1c0 2023-08-27T11:25:09.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:09.588+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff1f414c840 con 0x7ff1f406d1c0 2023-08-27T11:25:10.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.091+0000 7ff1eaffd700 1 -- 172.21.15.43:0/1945321004 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff1f414c840 con 0x7ff1f406d1c0 2023-08-27T11:25:10.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 msgr2=0x7ff1d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 0x7ff1d406c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40011e0 tx=0x7ff1e4009040 comp rx=0 tx=0).stop 2023-08-27T11:25:10.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 msgr2=0x7ff1f40a71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc00c4e0 tx=0x7ff1dc00c8a0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 shutdown_connections 2023-08-27T11:25:10.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff1d406a0e0 0x7ff1d406c5a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1f40c51a0 0x7ff1f41e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1f406ca60 0x7ff1f41eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 --2- 172.21.15.43:0/1945321004 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1f406d1c0 0x7ff1f40a71d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 >> 172.21.15.43:0/1945321004 conn(0x7ff1f406aa50 msgr2=0x7ff1f40bb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 shutdown_connections 2023-08-27T11:25:10.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.094+0000 7ff1f89ff700 1 -- 172.21.15.43:0/1945321004 wait complete. 2023-08-27T11:25:10.115 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-08-27T11:25:10.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.321+0000 7f51bfdff700 1 Processor -- start 2023-08-27T11:25:10.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.321+0000 7f51bfdff700 1 -- start start 2023-08-27T11:25:10.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bfdff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51b8151a40 0x7f51b80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bfdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b806b780 0x7f51b806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bfdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b8154730 con 0x7f51b80c81c0 2023-08-27T11:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bfdff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b8154520 con 0x7f51b8151a40 2023-08-27T11:25:10.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bfdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8154a10 con 0x7f51b806b780 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bdb9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51b8151a40 0x7f51b80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bdb9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51b8151a40 0x7f51b80c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40946/0 (socket says 172.21.15.43:40946) 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bdb9b700 1 -- 172.21.15.43:0/4209180280 learned_addr learned my addr 172.21.15.43:0/4209180280 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.322+0000 7f51bd39a700 1 --1- 172.21.15.43:0/4209180280 >> v1:172.21.15.43:6789/0 conn(0x7f51b80c81c0 0x7f51b80c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53602/0 (socket says 172.21.15.43:53602) 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51be39c700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b806b780 0x7f51b806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bdb9b700 1 -- 172.21.15.43:0/4209180280 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b806b780 msgr2=0x7f51b806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bdb9b700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b806b780 0x7f51b806bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bdb9b700 1 -- 172.21.15.43:0/4209180280 >> v1:172.21.15.43:6789/0 conn(0x7f51b80c81c0 legacy=0x7f51b80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bdb9b700 1 -- 172.21.15.43:0/4209180280 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8154cf0 con 0x7f51b8151a40 2023-08-27T11:25:10.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bdb9b700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b80c7c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f51b8154660 tx=0x7f51b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af7dd5da1ee7b15 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bcb99700 1 -- 172.21.15.43:0/4209180280 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4004230 con 0x7f51b8151a40 2023-08-27T11:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bcb99700 1 -- 172.21.15.43:0/4209180280 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4004390 con 0x7f51b8151a40 2023-08-27T11:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.323+0000 7f51bcb99700 1 -- 172.21.15.43:0/4209180280 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40036a0 con 0x7f51b8151a40 2023-08-27T11:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 -- 172.21.15.43:0/4209180280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 msgr2=0x7f51b80c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b80c7c80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f51b8154660 tx=0x7f51b4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 -- 172.21.15.43:0/4209180280 shutdown_connections 2023-08-27T11:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b806b780 0x7f51b806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 --2- 172.21.15.43:0/4209180280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b80c7c80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 -- 172.21.15.43:0/4209180280 >> 172.21.15.43:0/4209180280 conn(0x7f51b80ab890 msgr2=0x7f51b80abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 -- 172.21.15.43:0/4209180280 shutdown_connections 2023-08-27T11:25:10.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.324+0000 7f51bfdff700 1 -- 172.21.15.43:0/4209180280 wait complete. 2023-08-27T11:25:10.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.326+0000 7f51bfdff700 1 Processor -- start 2023-08-27T11:25:10.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.326+0000 7f51bfdff700 1 -- start start 2023-08-27T11:25:10.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b806b780 0x7f51b80ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b80c81c0 0x7f51b81ed440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80c29f0 con 0x7f51b8151a40 2023-08-27T11:25:10.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80af800 con 0x7f51b806b780 2023-08-27T11:25:10.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bfdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80ac9d0 con 0x7f51b80c81c0 2023-08-27T11:25:10.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51be39c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51be39c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40952/0 (socket says 172.21.15.43:40952) 2023-08-27T11:25:10.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51be39c700 1 -- 172.21.15.43:0/613424107 learned_addr learned my addr 172.21.15.43:0/613424107 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:10.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bd39a700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b80c81c0 0x7f51b81ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51bdb9b700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b806b780 0x7f51b80ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.327+0000 7f51be39c700 1 -- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b80c81c0 msgr2=0x7f51b81ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51be39c700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b80c81c0 0x7f51b81ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51be39c700 1 -- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b806b780 msgr2=0x7f51b80ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:10.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51be39c700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b806b780 0x7f51b80ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:10.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51be39c700 1 -- 172.21.15.43:0/613424107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009550 con 0x7f51b8151a40 2023-08-27T11:25:10.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51be39c700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f51b0007e40 tx=0x7f51b000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:10.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000eea0 con 0x7f51b8151a40 2023-08-27T11:25:10.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0014420 con 0x7f51b8151a40 2023-08-27T11:25:10.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b80accb0 con 0x7f51b8151a40 2023-08-27T11:25:10.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00147b0 con 0x7f51b8151a40 2023-08-27T11:25:10.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.328+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b80ade20 con 0x7f51b8151a40 2023-08-27T11:25:10.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.329+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b81ed160 con 0x7f51b8151a40 2023-08-27T11:25:10.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.330+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51b0014910 con 0x7f51b8151a40 2023-08-27T11:25:10.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.331+0000 7f51ae7fc700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 0x7f519c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:10.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.331+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f51b0088f00 con 0x7f51b8151a40 2023-08-27T11:25:10.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.331+0000 7f51bdb9b700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 0x7f519c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:10.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.332+0000 7f51bdb9b700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 0x7f519c06c5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:10.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.335+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f51b81ed160 con 0x7f51b8151a40 2023-08-27T11:25:10.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:25:10.534 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:25:10.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:10.545+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51b81ed160 con 0x7f51b8151a40 2023-08-27T11:25:11.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.096+0000 7f51ae7fc700 1 -- 172.21.15.43:0/613424107 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v58) v1 ==== 184+0+0 (secure 0 0 0) 0x7f51b81ed160 con 0x7f51b8151a40 2023-08-27T11:25:11.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 msgr2=0x7f519c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 0x7f519c06c5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51b4000c00 tx=0x7f51b4008030 comp rx=0 tx=0).stop 2023-08-27T11:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 msgr2=0x7f51b81ed980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f51b0007e40 tx=0x7f51b000e3c0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 shutdown_connections 2023-08-27T11:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f519c06a0e0 0x7f519c06c5a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51b8151a40 0x7f51b81ed980 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51b806b780 0x7f51b80ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 --2- 172.21.15.43:0/613424107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51b80c81c0 0x7f51b81ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 >> 172.21.15.43:0/613424107 conn(0x7f51b80ab890 msgr2=0x7f51b806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 shutdown_connections 2023-08-27T11:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.099+0000 7f51bfdff700 1 -- 172.21.15.43:0/613424107 wait complete. 2023-08-27T11:25:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_metadata' removed 2023-08-27T11:25:11.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-08-27T11:25:11.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.327+0000 7f7862dff700 1 Processor -- start 2023-08-27T11:25:11.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.327+0000 7f7862dff700 1 -- start start 2023-08-27T11:25:11.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.328+0000 7f7862dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f785c0a77d0 0x7f785c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.328+0000 7f7862dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 0x7f785c14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.328+0000 7f7862dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c152140 con 0x7f785c0c50f0 2023-08-27T11:25:11.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.328+0000 7f7862dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c14ee10 con 0x7f785c0a77d0 2023-08-27T11:25:11.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.328+0000 7f7862dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c1515c0 con 0x7f785c0a5090 2023-08-27T11:25:11.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f785c0a77d0 0x7f785c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f786139c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f785c0c50f0 0x7f785c0c3b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53606/0 (socket says 172.21.15.43:53606) 2023-08-27T11:25:11.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f786139c700 1 -- 172.21.15.43:0/1829053761 learned_addr learned my addr 172.21.15.43:0/1829053761 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:11.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f785bfff700 1 --2- 172.21.15.43:0/1829053761 >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 0x7f785c14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 -- 172.21.15.43:0/1829053761 >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 msgr2=0x7f785c14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:11.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f785b7fe700 1 -- 172.21.15.43:0/1829053761 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120284471 0 0) 0x7f785c152140 con 0x7f785c0c50f0 2023-08-27T11:25:11.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 --2- 172.21.15.43:0/1829053761 >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 0x7f785c14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 -- 172.21.15.43:0/1829053761 >> v1:172.21.15.43:6789/0 conn(0x7f785c0c50f0 legacy=0x7f785c0c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 -- 172.21.15.43:0/1829053761 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c1518a0 con 0x7f785c0a77d0 2023-08-27T11:25:11.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f785bfff700 1 --2- 172.21.15.43:0/1829053761 >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 0x7f785c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:11.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.329+0000 7f7860b9b700 1 --2- 172.21.15.43:0/1829053761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c14e390 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f785c06d660 tx=0x7f7850009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c191054f479df server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:11.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f785b7fe700 1 -- 172.21.15.43:0/1829053761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850011830 con 0x7f785c0a77d0 2023-08-27T11:25:11.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f785b7fe700 1 -- 172.21.15.43:0/1829053761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850011990 con 0x7f785c0a77d0 2023-08-27T11:25:11.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f785b7fe700 1 -- 172.21.15.43:0/1829053761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850011d20 con 0x7f785c0a77d0 2023-08-27T11:25:11.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 -- 172.21.15.43:0/1829053761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 msgr2=0x7f785c14e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 --2- 172.21.15.43:0/1829053761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c14e390 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f785c06d660 tx=0x7f7850009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:11.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 -- 172.21.15.43:0/1829053761 shutdown_connections 2023-08-27T11:25:11.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 --2- 172.21.15.43:0/1829053761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c14e390 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 --2- 172.21.15.43:0/1829053761 >> v2:172.21.15.57:3300/0 conn(0x7f785c0a5090 0x7f785c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 -- 172.21.15.43:0/1829053761 >> 172.21.15.43:0/1829053761 conn(0x7f785c0c2400 msgr2=0x7f785c0c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 -- 172.21.15.43:0/1829053761 shutdown_connections 2023-08-27T11:25:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.330+0000 7f7862dff700 1 -- 172.21.15.43:0/1829053761 wait complete. 2023-08-27T11:25:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.332+0000 7f7862dff700 1 Processor -- start 2023-08-27T11:25:11.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.332+0000 7f7862dff700 1 -- start start 2023-08-27T11:25:11.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0a5090 0x7f785c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0c50f0 0x7f785c149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c14f5e0 con 0x7f785c0a77d0 2023-08-27T11:25:11.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0ab710 con 0x7f785c0c50f0 2023-08-27T11:25:11.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f7862dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c14f8c0 con 0x7f785c0a5090 2023-08-27T11:25:11.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.333+0000 7f785bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40972/0 (socket says 172.21.15.43:40972) 2023-08-27T11:25:11.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 -- 172.21.15.43:0/1796131873 learned_addr learned my addr 172.21.15.43:0/1796131873 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:11.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f7860b9b700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0a5090 0x7f785c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f786139c700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0c50f0 0x7f785c149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 -- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0a5090 msgr2=0x7f785c14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0a5090 0x7f785c14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 -- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0c50f0 msgr2=0x7f785c149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:11.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0c50f0 0x7f785c149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:11.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 -- 172.21.15.43:0/1796131873 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78500094a0 con 0x7f785c0a77d0 2023-08-27T11:25:11.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f785bfff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f784800e7e0 tx=0x7f784800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:11.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784800c030 con 0x7f785c0a77d0 2023-08-27T11:25:11.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848004220 con 0x7f785c0a77d0 2023-08-27T11:25:11.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848004590 con 0x7f785c0a77d0 2023-08-27T11:25:11.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.334+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0ab430 con 0x7f785c0a77d0 2023-08-27T11:25:11.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.335+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c14cfa0 con 0x7f785c0a77d0 2023-08-27T11:25:11.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.336+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0ba9e0 con 0x7f785c0a77d0 2023-08-27T11:25:11.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.336+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78480036a0 con 0x7f785c0a77d0 2023-08-27T11:25:11.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.338+0000 7f78597fa700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 0x7f784006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:11.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.338+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f7848088310 con 0x7f785c0a77d0 2023-08-27T11:25:11.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.338+0000 7f7860b9b700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 0x7f784006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:11.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.339+0000 7f7860b9b700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 0x7f784006c5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f78500097c0 tx=0x7f7850008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:11.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.342+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f78480574d0 con 0x7f785c0a77d0 2023-08-27T11:25:11.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:11.552+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f785c04ee70 con 0x7f785c0a77d0 2023-08-27T11:25:12.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.104+0000 7f78597fa700 1 -- 172.21.15.43:0/1796131873 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v59) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7848057060 con 0x7f785c0a77d0 2023-08-27T11:25:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.107+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 msgr2=0x7f784006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 0x7f784006c5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f78500097c0 tx=0x7f7850008030 comp rx=0 tx=0).stop 2023-08-27T11:25:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 msgr2=0x7f785c1494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f784800e7e0 tx=0x7f784800eba0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 shutdown_connections 2023-08-27T11:25:12.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f784006a0e0 0x7f784006c5a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785c0c50f0 0x7f785c149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785c0a5090 0x7f785c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 --2- 172.21.15.43:0/1796131873 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f785c0a77d0 0x7f785c1494c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 >> 172.21.15.43:0/1796131873 conn(0x7f785c0c2400 msgr2=0x7f785c0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:12.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 shutdown_connections 2023-08-27T11:25:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.108+0000 7f7862dff700 1 -- 172.21.15.43:0/1796131873 wait complete. 2023-08-27T11:25:12.112 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_data' removed 2023-08-27T11:25:12.130 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:25:12.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.338+0000 7f08633ff700 1 Processor -- start 2023-08-27T11:25:12.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.339+0000 7f08633ff700 1 -- start start 2023-08-27T11:25:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c14e380 0x7f085c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f085c154da0 0x7f085c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f085c06dff0 0x7f085c06e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0c2820 con 0x7f085c154da0 2023-08-27T11:25:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085c0c1750 con 0x7f085c06dff0 2023-08-27T11:25:12.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f08633ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c0c1a30 con 0x7f085c14e380 2023-08-27T11:25:12.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f086099a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f085c154da0 0x7f085c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f086099a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f085c154da0 0x7f085c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40988/0 (socket says 172.21.15.43:40988) 2023-08-27T11:25:12.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f086099a700 1 -- 172.21.15.43:0/4293364363 learned_addr learned my addr 172.21.15.43:0/4293364363 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:12.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f086199c700 1 --2- 172.21.15.43:0/4293364363 >> v2:172.21.15.57:3300/0 conn(0x7f085c06dff0 0x7f085c06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.340+0000 7f086119b700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c14e380 0x7f085c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 -- 172.21.15.43:0/4293364363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c14e380 msgr2=0x7f085c06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c14e380 0x7f085c06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 -- 172.21.15.43:0/4293364363 >> v2:172.21.15.57:3300/0 conn(0x7f085c06dff0 msgr2=0x7f085c06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 --2- 172.21.15.43:0/4293364363 >> v2:172.21.15.57:3300/0 conn(0x7f085c06dff0 0x7f085c06e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 -- 172.21.15.43:0/4293364363 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085c0c1d10 con 0x7f085c154da0 2023-08-27T11:25:12.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f086099a700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c154da0 0x7f085c158200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f085c0c2c00 tx=0x7f084c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38a279c5837f237 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f0853fff700 1 -- 172.21.15.43:0/4293364363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c011830 con 0x7f085c154da0 2023-08-27T11:25:12.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f0853fff700 1 -- 172.21.15.43:0/4293364363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c011990 con 0x7f085c154da0 2023-08-27T11:25:12.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.341+0000 7f0853fff700 1 -- 172.21.15.43:0/4293364363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c011d20 con 0x7f085c154da0 2023-08-27T11:25:12.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 -- 172.21.15.43:0/4293364363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c154da0 msgr2=0x7f085c158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c154da0 0x7f085c158200 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f085c0c2c00 tx=0x7f084c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 -- 172.21.15.43:0/4293364363 shutdown_connections 2023-08-27T11:25:12.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 --2- 172.21.15.43:0/4293364363 >> v2:172.21.15.57:3300/0 conn(0x7f085c06dff0 0x7f085c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c14e380 0x7f085c06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 --2- 172.21.15.43:0/4293364363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c154da0 0x7f085c158200 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 -- 172.21.15.43:0/4293364363 >> 172.21.15.43:0/4293364363 conn(0x7f085c0c2c30 msgr2=0x7f085c0c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:12.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 -- 172.21.15.43:0/4293364363 shutdown_connections 2023-08-27T11:25:12.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.342+0000 7f08633ff700 1 -- 172.21.15.43:0/4293364363 wait complete. 2023-08-27T11:25:12.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.345+0000 7f08633ff700 1 Processor -- start 2023-08-27T11:25:12.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.345+0000 7f08633ff700 1 -- start start 2023-08-27T11:25:12.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 0x7f085c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c154da0 0x7f085c157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c149060 con 0x7f085c14e380 2023-08-27T11:25:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c154910 con 0x7f085c06dff0 2023-08-27T11:25:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f08633ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085c149240 con 0x7f085c154da0 2023-08-27T11:25:12.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f086099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f086099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41004/0 (socket says 172.21.15.43:41004) 2023-08-27T11:25:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f086099a700 1 -- 172.21.15.43:0/3207546116 learned_addr learned my addr 172.21.15.43:0/3207546116 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.346+0000 7f086119b700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 0x7f085c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086199c700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c154da0 0x7f085c157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 -- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c154da0 msgr2=0x7f085c157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c154da0 0x7f085c157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 -- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 msgr2=0x7f085c1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 0x7f085c1542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 -- 172.21.15.43:0/3207546116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c009550 con 0x7f085c14e380 2023-08-27T11:25:12.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086119b700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 0x7f085c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:12.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f086099a700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f084c009c10 tx=0x7f084c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c004510 con 0x7f085c14e380 2023-08-27T11:25:12.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c01e070 con 0x7f085c14e380 2023-08-27T11:25:12.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0038e0 con 0x7f085c14e380 2023-08-27T11:25:12.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c149520 con 0x7f085c14e380 2023-08-27T11:25:12.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.347+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c1ed810 con 0x7f085c14e380 2023-08-27T11:25:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.349+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c04ee70 con 0x7f085c14e380 2023-08-27T11:25:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.349+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f084c003a40 con 0x7f085c14e380 2023-08-27T11:25:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.350+0000 7f0851ffb700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 0x7f084006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.350+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f084c0891a0 con 0x7f085c14e380 2023-08-27T11:25:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.350+0000 7f086119b700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 0x7f084006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.351+0000 7f086119b700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 0x7f084006c5a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0858009bb0 tx=0x7f0858008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.355+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f084c054a70 con 0x7f085c14e380 2023-08-27T11:25:12.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.566+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f085c0664c0 con 0x7f085c14e380 2023-08-27T11:25:12.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.570+0000 7f0851ffb700 1 -- 172.21.15.43:0/3207546116 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f084c058090 con 0x7f085c14e380 2023-08-27T11:25:12.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 msgr2=0x7f084006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 0x7f084006c5a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0858009bb0 tx=0x7f0858008040 comp rx=0 tx=0).stop 2023-08-27T11:25:12.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 msgr2=0x7f085c1ed2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f084c009c10 tx=0x7f084c004750 comp rx=0 tx=0).stop 2023-08-27T11:25:12.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 shutdown_connections 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f084006a0e0 0x7f084006c5a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f085c154da0 0x7f085c157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f085c06dff0 0x7f085c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 --2- 172.21.15.43:0/3207546116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f085c14e380 0x7f085c1ed2d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 >> 172.21.15.43:0/3207546116 conn(0x7f085c0c2c30 msgr2=0x7f085c06b480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:12.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 shutdown_connections 2023-08-27T11:25:12.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.573+0000 7f08633ff700 1 -- 172.21.15.43:0/3207546116 wait complete. 2023-08-27T11:25:12.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.c mds_join_fs 2023-08-27T11:25:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.795+0000 7f19573ff700 1 Processor -- start 2023-08-27T11:25:12.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.795+0000 7f19573ff700 1 -- start start 2023-08-27T11:25:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f19573ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1950151b20 0x7f19500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f19573ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f19500c4630 0x7f19500c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f19573ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195006c450 con 0x7f195006ad70 2023-08-27T11:25:12.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f19573ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950151f00 con 0x7f1950151b20 2023-08-27T11:25:12.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f19573ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950154760 con 0x7f19500c4630 2023-08-27T11:25:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.796+0000 7f195519b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1950151b20 0x7f19500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1950151b20 0x7f19500c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41020/0 (socket says 172.21.15.43:41020) 2023-08-27T11:25:12.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 -- 172.21.15.43:0/3108189850 learned_addr learned my addr 172.21.15.43:0/3108189850 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195499a700 1 --2- 172.21.15.43:0/3108189850 >> v2:172.21.15.57:3300/0 conn(0x7f19500c4630 0x7f19500c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 -- 172.21.15.43:0/3108189850 >> v2:172.21.15.57:3300/0 conn(0x7f19500c4630 msgr2=0x7f19500c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 --2- 172.21.15.43:0/3108189850 >> v2:172.21.15.57:3300/0 conn(0x7f19500c4630 0x7f19500c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 -- 172.21.15.43:0/3108189850 >> v1:172.21.15.57:6789/0 conn(0x7f195006ad70 legacy=0x7f195006b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 -- 172.21.15.43:0/3108189850 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950154a40 con 0x7f1950151b20 2023-08-27T11:25:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f195519b700 1 --2- 172.21.15.43:0/3108189850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1950151b20 0x7f19500c7bb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f19500a9720 tx=0x7f194c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504a43a53627428 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.797+0000 7f1947fff700 1 -- 172.21.15.43:0/3108189850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011830 con 0x7f1950151b20 2023-08-27T11:25:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f1947fff700 1 -- 172.21.15.43:0/3108189850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c011990 con 0x7f1950151b20 2023-08-27T11:25:12.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f1947fff700 1 -- 172.21.15.43:0/3108189850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011d20 con 0x7f1950151b20 2023-08-27T11:25:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 -- 172.21.15.43:0/3108189850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1950151b20 msgr2=0x7f19500c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 --2- 172.21.15.43:0/3108189850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1950151b20 0x7f19500c7bb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f19500a9720 tx=0x7f194c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 -- 172.21.15.43:0/3108189850 shutdown_connections 2023-08-27T11:25:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 --2- 172.21.15.43:0/3108189850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1950151b20 0x7f19500c7bb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 --2- 172.21.15.43:0/3108189850 >> v2:172.21.15.57:3300/0 conn(0x7f19500c4630 0x7f19500c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 -- 172.21.15.43:0/3108189850 >> 172.21.15.43:0/3108189850 conn(0x7f19500ab820 msgr2=0x7f19500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:12.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 -- 172.21.15.43:0/3108189850 shutdown_connections 2023-08-27T11:25:12.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.798+0000 7f19573ff700 1 -- 172.21.15.43:0/3108189850 wait complete. 2023-08-27T11:25:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.801+0000 7f19573ff700 1 Processor -- start 2023-08-27T11:25:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.801+0000 7f19573ff700 1 -- start start 2023-08-27T11:25:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19500c4630 0x7f1950146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 0x7f19501474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500af550 con 0x7f195006ad70 2023-08-27T11:25:12.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500c1220 con 0x7f1950151b20 2023-08-27T11:25:12.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f19573ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500af2e0 con 0x7f19500c4630 2023-08-27T11:25:12.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f195519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f195519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41026/0 (socket says 172.21.15.43:41026) 2023-08-27T11:25:12.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.802+0000 7f195519b700 1 -- 172.21.15.43:0/16620278 learned_addr learned my addr 172.21.15.43:0/16620278 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:12.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195599c700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 0x7f19501474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195499a700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19500c4630 0x7f1950146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 -- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19500c4630 msgr2=0x7f1950146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19500c4630 0x7f1950146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 -- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 msgr2=0x7f19501474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:12.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 0x7f19501474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:12.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 -- 172.21.15.43:0/16620278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c009550 con 0x7f195006ad70 2023-08-27T11:25:12.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195599c700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 0x7f19501474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:12.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f195519b700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f19500ac6e0 tx=0x7f194c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0036a0 con 0x7f195006ad70 2023-08-27T11:25:12.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c01e070 con 0x7f195006ad70 2023-08-27T11:25:12.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19500c28e0 con 0x7f195006ad70 2023-08-27T11:25:12.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.803+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c003a60 con 0x7f195006ad70 2023-08-27T11:25:12.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.804+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1950154000 con 0x7f195006ad70 2023-08-27T11:25:12.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.805+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19500c1680 con 0x7f195006ad70 2023-08-27T11:25:12.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.805+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f194c003bc0 con 0x7f195006ad70 2023-08-27T11:25:12.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.807+0000 7f1945ffb700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 0x7f193406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:12.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.807+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f194c089240 con 0x7f195006ad70 2023-08-27T11:25:12.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.807+0000 7f195499a700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 0x7f193406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:12.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.808+0000 7f195499a700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 0x7f193406c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19500afd60 tx=0x7f1940008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:12.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:12.811+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f194c054b10 con 0x7f195006ad70 2023-08-27T11:25:13.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.021+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"} v 0) v1 -- 0x7f195004ee70 con 0x7f195006ad70 2023-08-27T11:25:13.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.025+0000 7f1945ffb700 1 -- 172.21.15.43:0/16620278 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"}]=0 v20) v1 ==== 96+0+0 (secure 0 0 0) 0x7f194c058130 con 0x7f195006ad70 2023-08-27T11:25:13.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.027+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 msgr2=0x7f193406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.027+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 0x7f193406c5a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f19500afd60 tx=0x7f1940008040 comp rx=0 tx=0).stop 2023-08-27T11:25:13.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.027+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 msgr2=0x7f1950153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.027+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f19500ac6e0 tx=0x7f194c004750 comp rx=0 tx=0).stop 2023-08-27T11:25:13.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 shutdown_connections 2023-08-27T11:25:13.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f193406a0e0 0x7f193406c5a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1950151b20 0x7f19501474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195006ad70 0x7f1950153ac0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 --2- 172.21.15.43:0/16620278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f19500c4630 0x7f1950146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 >> 172.21.15.43:0/16620278 conn(0x7f19500ab820 msgr2=0x7f1950147d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:13.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 shutdown_connections 2023-08-27T11:25:13.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.028+0000 7f19573ff700 1 -- 172.21.15.43:0/16620278 wait complete. 2023-08-27T11:25:13.047 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.b mds_join_fs 2023-08-27T11:25:13.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.250+0000 7f96461ff700 1 Processor -- start 2023-08-27T11:25:13.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.250+0000 7f96461ff700 1 -- start start 2023-08-27T11:25:13.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f96461ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96400c4630 0x7f96400c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f96461ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964006c4e0 con 0x7f964006ad70 2023-08-27T11:25:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f96461ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9640155370 con 0x7f9640151a90 2023-08-27T11:25:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f96461ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96400c82c0 con 0x7f96400c4630 2023-08-27T11:25:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f963ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f964006ad70 0x7f964006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53616/0 (socket says 172.21.15.43:53616) 2023-08-27T11:25:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f963ffff700 1 -- 172.21.15.43:0/3539793769 learned_addr learned my addr 172.21.15.43:0/3539793769 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:13.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f963effd700 1 --2- 172.21.15.43:0/3539793769 >> v2:172.21.15.57:3300/0 conn(0x7f96400c4630 0x7f96400c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803331927 0 0) 0x7f964006c4e0 con 0x7f964006ad70 2023-08-27T11:25:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.252+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96280035b0 con 0x7f964006ad70 2023-08-27T11:25:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962541377 0 0) 0x7f9640155370 con 0x7f9640151a90 2023-08-27T11:25:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f964006c4e0 con 0x7f9640151a90 2023-08-27T11:25:13.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963effd700 1 -- 172.21.15.43:0/3539793769 >> v1:172.21.15.57:6789/0 conn(0x7f9640151a90 legacy=0x7f96400c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963effd700 1 -- 172.21.15.43:0/3539793769 >> v1:172.21.15.43:6789/0 conn(0x7f964006ad70 legacy=0x7f964006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918915039 0 0) 0x7f96280035b0 con 0x7f964006ad70 2023-08-27T11:25:13.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963effd700 1 -- 172.21.15.43:0/3539793769 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640151e70 con 0x7f96400c4630 2023-08-27T11:25:13.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963effd700 1 --2- 172.21.15.43:0/3539793769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96400c4630 0x7f96400c4a90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9634009840 tx=0x7f9634009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5a4fddd4f9d3693 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96380019f0 con 0x7f96400c4630 2023-08-27T11:25:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634004030 con 0x7f96400c4630 2023-08-27T11:25:13.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.253+0000 7f963e7fc700 1 -- 172.21.15.43:0/3539793769 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340043c0 con 0x7f96400c4630 2023-08-27T11:25:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 -- 172.21.15.43:0/3539793769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96400c4630 msgr2=0x7f96400c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 --2- 172.21.15.43:0/3539793769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96400c4630 0x7f96400c4a90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9634009840 tx=0x7f9634009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 -- 172.21.15.43:0/3539793769 shutdown_connections 2023-08-27T11:25:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 --2- 172.21.15.43:0/3539793769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96400c4630 0x7f96400c4a90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 -- 172.21.15.43:0/3539793769 >> 172.21.15.43:0/3539793769 conn(0x7f96400ab820 msgr2=0x7f96400abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 -- 172.21.15.43:0/3539793769 shutdown_connections 2023-08-27T11:25:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.254+0000 7f96461ff700 1 -- 172.21.15.43:0/3539793769 wait complete. 2023-08-27T11:25:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.256+0000 7f96461ff700 1 Processor -- start 2023-08-27T11:25:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.256+0000 7f96461ff700 1 -- start start 2023-08-27T11:25:13.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 0x7f96401e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 0x7f96401ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9640154280 con 0x7f964006ad70 2023-08-27T11:25:13.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964014dac0 con 0x7f9640151a90 2023-08-27T11:25:13.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f96461ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964014dda0 con 0x7f96400c4630 2023-08-27T11:25:13.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41034/0 (socket says 172.21.15.43:41034) 2023-08-27T11:25:13.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 -- 172.21.15.43:0/984622715 learned_addr learned my addr 172.21.15.43:0/984622715 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:13.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963effd700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 0x7f96401e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 -- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 msgr2=0x7f96401e9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963ffff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 0x7f96401ea340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 0x7f96401e9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 -- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 msgr2=0x7f96401ea340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 0x7f96401ea340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963f7fe700 1 -- 172.21.15.43:0/984622715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340094a0 con 0x7f964006ad70 2023-08-27T11:25:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963effd700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 0x7f96401e9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.257+0000 7f963ffff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 0x7f96401ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f963f7fe700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f963000c450 tx=0x7f963000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300052d0 con 0x7f964006ad70 2023-08-27T11:25:13.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9630005430 con 0x7f964006ad70 2023-08-27T11:25:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964014e080 con 0x7f964006ad70 2023-08-27T11:25:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96300038c0 con 0x7f964006ad70 2023-08-27T11:25:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.258+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96400ab430 con 0x7f964006ad70 2023-08-27T11:25:13.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.259+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96401e9b20 con 0x7f964006ad70 2023-08-27T11:25:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.260+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9630003a20 con 0x7f964006ad70 2023-08-27T11:25:13.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.261+0000 7f9627fff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 0x7f962c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.261+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9630087880 con 0x7f964006ad70 2023-08-27T11:25:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.261+0000 7f963effd700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 0x7f962c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.262+0000 7f963effd700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 0x7f962c06c5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9640149670 tx=0x7f9634008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.266+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96401e9b20 con 0x7f964006ad70 2023-08-27T11:25:13.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.475+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"} v 0) v1 -- 0x7f96401e9b20 con 0x7f964006ad70 2023-08-27T11:25:13.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.479+0000 7f9627fff700 1 -- 172.21.15.43:0/984622715 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"}]=0 v21) v1 ==== 96+0+0 (secure 0 0 0) 0x7f96401e9b20 con 0x7f964006ad70 2023-08-27T11:25:13.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.481+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 msgr2=0x7f962c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 0x7f962c06c5a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9640149670 tx=0x7f9634008030 comp rx=0 tx=0).stop 2023-08-27T11:25:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 msgr2=0x7f96400aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f963000c450 tx=0x7f963000c810 comp rx=0 tx=0).stop 2023-08-27T11:25:13.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 shutdown_connections 2023-08-27T11:25:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f962c06a0e0 0x7f962c06c5a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9640151a90 0x7f96401ea340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f964006ad70 0x7f96400aaef0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 --2- 172.21.15.43:0/984622715 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96400c4630 0x7f96401e9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 >> 172.21.15.43:0/984622715 conn(0x7f96400ab820 msgr2=0x7f964014eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:13.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 shutdown_connections 2023-08-27T11:25:13.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.482+0000 7f96461ff700 1 -- 172.21.15.43:0/984622715 wait complete. 2023-08-27T11:25:13.501 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.a mds_join_fs 2023-08-27T11:25:13.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.702+0000 7f2e625ff700 1 Processor -- start 2023-08-27T11:25:13.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.703+0000 7f2e625ff700 1 -- start start 2023-08-27T11:25:13.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e625ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e5c0c4630 0x7f2e5c0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e625ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e625ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0c82c0 con 0x7f2e5c151b20 2023-08-27T11:25:13.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e625ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c151f00 con 0x7f2e5c06ad70 2023-08-27T11:25:13.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e625ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c06c450 con 0x7f2e5c0c4630 2023-08-27T11:25:13.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41050/0 (socket says 172.21.15.43:41050) 2023-08-27T11:25:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3642493753 learned_addr learned my addr 172.21.15.43:0/3642493753 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:13.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e53fff700 1 --2- 172.21.15.43:0/3642493753 >> v2:172.21.15.57:3300/0 conn(0x7f2e5c0c4630 0x7f2e5c0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3642493753 >> v2:172.21.15.57:3300/0 conn(0x7f2e5c0c4630 msgr2=0x7f2e5c0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:13.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 --2- 172.21.15.43:0/3642493753 >> v2:172.21.15.57:3300/0 conn(0x7f2e5c0c4630 0x7f2e5c0c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.704+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3642493753 >> v1:172.21.15.57:6789/0 conn(0x7f2e5c151b20 legacy=0x7f2e5c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.705+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3642493753 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c154760 con 0x7f2e5c06ad70 2023-08-27T11:25:13.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.705+0000 7f2e60b9c700 1 --2- 172.21.15.43:0/3642493753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0a9720 tx=0x7f2e5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a70e4be49b0abe0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.705+0000 7f2e5b7fe700 1 -- 172.21.15.43:0/3642493753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400e070 con 0x7f2e5c06ad70 2023-08-27T11:25:13.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.705+0000 7f2e5b7fe700 1 -- 172.21.15.43:0/3642493753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400b910 con 0x7f2e5c06ad70 2023-08-27T11:25:13.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.705+0000 7f2e5b7fe700 1 -- 172.21.15.43:0/3642493753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400bcc0 con 0x7f2e5c06ad70 2023-08-27T11:25:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 -- 172.21.15.43:0/3642493753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c06ad70 msgr2=0x7f2e5c06b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3642493753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0a9720 tx=0x7f2e5400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:13.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 -- 172.21.15.43:0/3642493753 shutdown_connections 2023-08-27T11:25:13.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3642493753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c06b1a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3642493753 >> v2:172.21.15.57:3300/0 conn(0x7f2e5c0c4630 0x7f2e5c0c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 -- 172.21.15.43:0/3642493753 >> 172.21.15.43:0/3642493753 conn(0x7f2e5c0ab820 msgr2=0x7f2e5c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:13.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 -- 172.21.15.43:0/3642493753 shutdown_connections 2023-08-27T11:25:13.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.706+0000 7f2e625ff700 1 -- 172.21.15.43:0/3642493753 wait complete. 2023-08-27T11:25:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.707+0000 7f2e625ff700 1 Processor -- start 2023-08-27T11:25:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.708+0000 7f2e625ff700 1 -- start start 2023-08-27T11:25:13.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c0aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 0x7f2e5c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c150d40 con 0x7f2e5c151b20 2023-08-27T11:25:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1581d0 con 0x7f2e5c06ad70 2023-08-27T11:25:13.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e625ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1584b0 con 0x7f2e5c0c4630 2023-08-27T11:25:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e60b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e60b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41066/0 (socket says 172.21.15.43:41066) 2023-08-27T11:25:13.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.709+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3831364665 learned_addr learned my addr 172.21.15.43:0/3831364665 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e53fff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 0x7f2e5c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e5bfff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c0aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 msgr2=0x7f2e5c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 0x7f2e5c152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 msgr2=0x7f2e5c0aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c0aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 -- 172.21.15.43:0/3831364665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009b30 con 0x7f2e5c151b20 2023-08-27T11:25:13.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e53fff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 0x7f2e5c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e5bfff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e60b9c700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0ac6e0 tx=0x7f2e54004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540099b0 con 0x7f2e5c151b20 2023-08-27T11:25:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e540092e0 con 0x7f2e5c151b20 2023-08-27T11:25:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5401c640 con 0x7f2e5c151b20 2023-08-27T11:25:13.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c0aa160 con 0x7f2e5c151b20 2023-08-27T11:25:13.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.710+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c0aa720 con 0x7f2e5c151b20 2023-08-27T11:25:13.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.711+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c04ee70 con 0x7f2e5c151b20 2023-08-27T11:25:13.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.712+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e5401c7a0 con 0x7f2e5c151b20 2023-08-27T11:25:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.713+0000 7f2e597fa700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 0x7f2e3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:13.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.713+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2e54089d90 con 0x7f2e5c151b20 2023-08-27T11:25:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.714+0000 7f2e5bfff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 0x7f2e3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.714+0000 7f2e5bfff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 0x7f2e3c06c5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0c3ce0 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:13.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.718+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e54055660 con 0x7f2e5c151b20 2023-08-27T11:25:13.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.926+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"} v 0) v1 -- 0x7f2e5c06c130 con 0x7f2e5c151b20 2023-08-27T11:25:13.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.930+0000 7f2e597fa700 1 -- 172.21.15.43:0/3831364665 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"}]=0 v22) v1 ==== 96+0+0 (secure 0 0 0) 0x7f2e54058c80 con 0x7f2e5c151b20 2023-08-27T11:25:13.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 msgr2=0x7f2e3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 0x7f2e3c06c5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0c3ce0 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 msgr2=0x7f2e5c140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0ac6e0 tx=0x7f2e54004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 shutdown_connections 2023-08-27T11:25:13.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e3c06a0e0 0x7f2e3c06c5a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e5c151b20 0x7f2e5c140ff0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e5c06ad70 0x7f2e5c0aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 --2- 172.21.15.43:0/3831364665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e5c0c4630 0x7f2e5c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 >> 172.21.15.43:0/3831364665 conn(0x7f2e5c0ab820 msgr2=0x7f2e5c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 shutdown_connections 2023-08-27T11:25:13.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:13.933+0000 7f2e625ff700 1 -- 172.21.15.43:0/3831364665 wait complete. 2023-08-27T11:25:13.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort' 2023-08-27T11:25:14.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.153+0000 7f59ffbff700 1 Processor -- start 2023-08-27T11:25:14.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.153+0000 7f59ffbff700 1 -- start start 2023-08-27T11:25:14.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59ffbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f814e960 0x7f59f80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59ffbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f59f80a79c0 0x7f59f80c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59ffbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f8154d00 con 0x7f59f80c50d0 2023-08-27T11:25:14.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59ffbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f80baf30 con 0x7f59f80a79c0 2023-08-27T11:25:14.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59ffbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8154fe0 con 0x7f59f814e960 2023-08-27T11:25:14.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59fd19a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f59f80a79c0 0x7f59f80c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59fd19a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f59f80a79c0 0x7f59f80c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41068/0 (socket says 172.21.15.43:41068) 2023-08-27T11:25:14.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59fd19a700 1 -- 172.21.15.43:0/1981069078 learned_addr learned my addr 172.21.15.43:0/1981069078 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:14.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59fe19c700 1 --1- 172.21.15.43:0/1981069078 >> v1:172.21.15.43:6789/0 conn(0x7f59f80c50d0 0x7f59f80c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53620/0 (socket says 172.21.15.43:53620) 2023-08-27T11:25:14.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.154+0000 7f59fd99b700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f814e960 0x7f59f80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fd19a700 1 -- 172.21.15.43:0/1981069078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f814e960 msgr2=0x7f59f80a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:14.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fd19a700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f814e960 0x7f59f80a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:14.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fd19a700 1 -- 172.21.15.43:0/1981069078 >> v1:172.21.15.43:6789/0 conn(0x7f59f80c50d0 legacy=0x7f59f80c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:14.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fd19a700 1 -- 172.21.15.43:0/1981069078 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f81552c0 con 0x7f59f80a79c0 2023-08-27T11:25:14.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fc999700 1 -- 172.21.15.43:0/1981069078 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712081876 0 0) 0x7f59f8154d00 con 0x7f59f80c50d0 2023-08-27T11:25:14.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fd19a700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80c3cc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098f0 tx=0x7f59e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98306e5fc67d6f67 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:14.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fc999700 1 -- 172.21.15.43:0/1981069078 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011830 con 0x7f59f80a79c0 2023-08-27T11:25:14.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fc999700 1 -- 172.21.15.43:0/1981069078 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e8011990 con 0x7f59f80a79c0 2023-08-27T11:25:14.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.155+0000 7f59fc999700 1 -- 172.21.15.43:0/1981069078 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011d20 con 0x7f59f80a79c0 2023-08-27T11:25:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 -- 172.21.15.43:0/1981069078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 msgr2=0x7f59f80c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80c3cc0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f59e80098f0 tx=0x7f59e8009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 -- 172.21.15.43:0/1981069078 shutdown_connections 2023-08-27T11:25:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f814e960 0x7f59f80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:14.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 --2- 172.21.15.43:0/1981069078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80c3cc0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 -- 172.21.15.43:0/1981069078 >> 172.21.15.43:0/1981069078 conn(0x7f59f806aa50 msgr2=0x7f59f80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 -- 172.21.15.43:0/1981069078 shutdown_connections 2023-08-27T11:25:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.156+0000 7f59ffbff700 1 -- 172.21.15.43:0/1981069078 wait complete. 2023-08-27T11:25:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.158+0000 7f59ffbff700 1 Processor -- start 2023-08-27T11:25:14.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.158+0000 7f59ffbff700 1 -- start start 2023-08-27T11:25:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 0x7f59f80c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 0x7f59f80aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80a9370 con 0x7f59f80a79c0 2023-08-27T11:25:14.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f81ed170 con 0x7f59f814e960 2023-08-27T11:25:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59ffbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f80aa7b0 con 0x7f59f80c50d0 2023-08-27T11:25:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41082/0 (socket says 172.21.15.43:41082) 2023-08-27T11:25:14.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 -- 172.21.15.43:0/3615439386 learned_addr learned my addr 172.21.15.43:0/3615439386 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd19a700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 0x7f59f80c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fe19c700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 0x7f59f80aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 -- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 msgr2=0x7f59f80c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 0x7f59f80c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.159+0000 7f59fd99b700 1 -- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 msgr2=0x7f59f80aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:14.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59fd99b700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 0x7f59f80aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:14.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59fd99b700 1 -- 172.21.15.43:0/3615439386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8009550 con 0x7f59f80a79c0 2023-08-27T11:25:14.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59fd19a700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 0x7f59f80c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:14.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59fe19c700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 0x7f59f80aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:14.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59fd99b700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f59f400e870 tx=0x7f59f400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f4009590 con 0x7f59f80a79c0 2023-08-27T11:25:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f400ee70 con 0x7f59f80a79c0 2023-08-27T11:25:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f400ca50 con 0x7f59f80a79c0 2023-08-27T11:25:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f80a8a40 con 0x7f59f80a79c0 2023-08-27T11:25:14.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.160+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f80a9000 con 0x7f59f80a79c0 2023-08-27T11:25:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.161+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f80bb390 con 0x7f59f80a79c0 2023-08-27T11:25:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.162+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f59f400cbb0 con 0x7f59f80a79c0 2023-08-27T11:25:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.163+0000 7f59ee7fc700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.163+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f59f4088360 con 0x7f59f80a79c0 2023-08-27T11:25:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.164+0000 7f59fd19a700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:14.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.164+0000 7f59fd19a700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f59f81447d0 tx=0x7f59e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.167+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f59f40576c0 con 0x7f59f80a79c0 2023-08-27T11:25:14.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:14.461+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort"]} v 0) v1 -- 0x7f59f80a87f0 con 0x7f59f80a79c0 2023-08-27T11:25:15.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.117+0000 7f59ee7fc700 1 -- 172.21.15.43:0/3615439386 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_last_resort"]}]=0 v158) v1 ==== 150+0+0 (secure 0 0 0) 0x7f59f400ce60 con 0x7f59f80a79c0 2023-08-27T11:25:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 msgr2=0x7f59dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f59f81447d0 tx=0x7f59e8008030 comp rx=0 tx=0).stop 2023-08-27T11:25:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 msgr2=0x7f59f80a9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f59f400e870 tx=0x7f59f400ec30 comp rx=0 tx=0).stop 2023-08-27T11:25:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 shutdown_connections 2023-08-27T11:25:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f59dc06a0e0 0x7f59dc06c5a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59f814e960 0x7f59f80aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f59f80a79c0 0x7f59f80a9dd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 --2- 172.21.15.43:0/3615439386 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59f80c50d0 0x7f59f80c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.120+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 >> 172.21.15.43:0/3615439386 conn(0x7f59f806aa50 msgr2=0x7f59f80a5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:15.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.121+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 shutdown_connections 2023-08-27T11:25:15.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.121+0000 7f59ffbff700 1 -- 172.21.15.43:0/3615439386 wait complete. 2023-08-27T11:25:15.143 INFO:tasks.cephfs_test_runner:That a standby with mds_join_fs set to another fs is still used if necessary. ... ok 2023-08-27T11:25:15.144 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_runtime (tasks.cephfs.test_failover.TestClusterAffinity) That setting mds_join_fs at runtime affects the cluster layout. 2023-08-27T11:25:15.144 INFO:tasks.cephfs_test_runner:test_join_fs_runtime (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:25:15.145 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime' 2023-08-27T11:25:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.350+0000 7f86d05ff700 1 Processor -- start 2023-08-27T11:25:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.350+0000 7f86d05ff700 1 -- start start 2023-08-27T11:25:15.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86d05ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f86c80c4630 0x7f86c80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86d05ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86c806ad70 0x7f86c806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86d05ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c806c4e0 con 0x7f86c8151a90 2023-08-27T11:25:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86d05ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8155370 con 0x7f86c80c4630 2023-08-27T11:25:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86d05ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80c82c0 con 0x7f86c806ad70 2023-08-27T11:25:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.351+0000 7f86cdb9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f86c80c4630 0x7f86c80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f86c80c4630 0x7f86c80c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41086/0 (socket says 172.21.15.43:41086) 2023-08-27T11:25:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 -- 172.21.15.43:0/1168490851 learned_addr learned my addr 172.21.15.43:0/1168490851 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86ceb9c700 1 --2- 172.21.15.43:0/1168490851 >> v2:172.21.15.57:3300/0 conn(0x7f86c806ad70 0x7f86c806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 -- 172.21.15.43:0/1168490851 >> v2:172.21.15.57:3300/0 conn(0x7f86c806ad70 msgr2=0x7f86c806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 --2- 172.21.15.43:0/1168490851 >> v2:172.21.15.57:3300/0 conn(0x7f86c806ad70 0x7f86c806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 -- 172.21.15.43:0/1168490851 >> v1:172.21.15.57:6789/0 conn(0x7f86c8151a90 legacy=0x7f86c80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 -- 172.21.15.43:0/1168490851 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8151e70 con 0x7f86c80c4630 2023-08-27T11:25:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cdb9a700 1 --2- 172.21.15.43:0/1168490851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c80c4630 0x7f86c80c4a90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f86c80c4270 tx=0x7f86b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6813f82fcdc7bf3b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.352+0000 7f86cd399700 1 -- 172.21.15.43:0/1168490851 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011830 con 0x7f86c80c4630 2023-08-27T11:25:15.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86cd399700 1 -- 172.21.15.43:0/1168490851 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8011990 con 0x7f86c80c4630 2023-08-27T11:25:15.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86cd399700 1 -- 172.21.15.43:0/1168490851 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011d20 con 0x7f86c80c4630 2023-08-27T11:25:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 -- 172.21.15.43:0/1168490851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c80c4630 msgr2=0x7f86c80c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 --2- 172.21.15.43:0/1168490851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c80c4630 0x7f86c80c4a90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f86c80c4270 tx=0x7f86b8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 -- 172.21.15.43:0/1168490851 shutdown_connections 2023-08-27T11:25:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 --2- 172.21.15.43:0/1168490851 >> v2:172.21.15.57:3300/0 conn(0x7f86c806ad70 0x7f86c806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 --2- 172.21.15.43:0/1168490851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c80c4630 0x7f86c80c4a90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 -- 172.21.15.43:0/1168490851 >> 172.21.15.43:0/1168490851 conn(0x7f86c80ab820 msgr2=0x7f86c80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:15.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 -- 172.21.15.43:0/1168490851 shutdown_connections 2023-08-27T11:25:15.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.353+0000 7f86d05ff700 1 -- 172.21.15.43:0/1168490851 wait complete. 2023-08-27T11:25:15.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.355+0000 7f86d05ff700 1 Processor -- start 2023-08-27T11:25:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.355+0000 7f86d05ff700 1 -- start start 2023-08-27T11:25:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86c80c4630 0x7f86c814cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c8151a90 0x7f86c814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c814cb40 con 0x7f86c806ad70 2023-08-27T11:25:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8146bf0 con 0x7f86c8151a90 2023-08-27T11:25:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86d05ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c814c830 con 0x7f86c80c4630 2023-08-27T11:25:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86ce39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86ce39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41092/0 (socket says 172.21.15.43:41092) 2023-08-27T11:25:15.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86ce39b700 1 -- 172.21.15.43:0/276884467 learned_addr learned my addr 172.21.15.43:0/276884467 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:15.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86ceb9c700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c8151a90 0x7f86c814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.356+0000 7f86cdb9a700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86c80c4630 0x7f86c814cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 -- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86c80c4630 msgr2=0x7f86c814cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86c80c4630 0x7f86c814cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 -- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c8151a90 msgr2=0x7f86c814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c8151a90 0x7f86c814e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 -- 172.21.15.43:0/276884467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8009550 con 0x7f86c806ad70 2023-08-27T11:25:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86ce39b700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c480 tx=0x7f86c400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40052d0 con 0x7f86c806ad70 2023-08-27T11:25:15.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4005430 con 0x7f86c806ad70 2023-08-27T11:25:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80c3390 con 0x7f86c806ad70 2023-08-27T11:25:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40038c0 con 0x7f86c806ad70 2023-08-27T11:25:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.357+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c8146e70 con 0x7f86c806ad70 2023-08-27T11:25:15.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.358+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c814ce20 con 0x7f86c806ad70 2023-08-27T11:25:15.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.359+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f86c4003a20 con 0x7f86c806ad70 2023-08-27T11:25:15.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.360+0000 7f86beffd700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 0x7f86ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:15.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.360+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f86c4087670 con 0x7f86c806ad70 2023-08-27T11:25:15.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.361+0000 7f86cdb9a700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 0x7f86ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:15.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.361+0000 7f86cdb9a700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 0x7f86ac06c5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009c10 tx=0x7f86b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:15.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.364+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f86c4052f40 con 0x7f86c806ad70 2023-08-27T11:25:15.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:15.657+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime"]} v 0) v1 -- 0x7f86c804ee70 con 0x7f86c806ad70 2023-08-27T11:25:16.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.120+0000 7f86beffd700 1 -- 172.21.15.43:0/276884467 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime"]}]=0 v159) v1 ==== 149+0+0 (secure 0 0 0) 0x7f86c4056560 con 0x7f86c806ad70 2023-08-27T11:25:16.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 msgr2=0x7f86ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 0x7f86ac06c5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009c10 tx=0x7f86b8008030 comp rx=0 tx=0).stop 2023-08-27T11:25:16.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 msgr2=0x7f86c80c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f86c400c480 tx=0x7f86c400c790 comp rx=0 tx=0).stop 2023-08-27T11:25:16.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 shutdown_connections 2023-08-27T11:25:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f86ac06a0e0 0x7f86ac06c5a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86c8151a90 0x7f86c814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f86c806ad70 0x7f86c80c2e50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 --2- 172.21.15.43:0/276884467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86c80c4630 0x7f86c814cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 >> 172.21.15.43:0/276884467 conn(0x7f86c80ab820 msgr2=0x7f86c814ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:16.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 shutdown_connections 2023-08-27T11:25:16.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.123+0000 7f86d05ff700 1 -- 172.21.15.43:0/276884467 wait complete. 2023-08-27T11:25:16.148 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.352+0000 7fdab17ff700 1 Processor -- start 2023-08-27T11:25:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.353+0000 7fdab17ff700 1 -- start start 2023-08-27T11:25:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdab17ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdaac0c51a0 0x7fdaac06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdab17ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac06d700 con 0x7fdaac06ca60 2023-08-27T11:25:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdab17ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac152430 con 0x7fdaac155910 2023-08-27T11:25:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdab17ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac1530b0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdaaa7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdaac06ca60 0x7fdaac0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53632/0 (socket says 172.21.15.43:53632) 2023-08-27T11:25:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdaaa7fc700 1 -- 172.21.15.43:0/2426131981 learned_addr learned my addr 172.21.15.43:0/2426131981 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdaaaffd700 1 --2- 172.21.15.43:0/2426131981 >> v2:172.21.15.57:3300/0 conn(0x7fdaac0c51a0 0x7fdaac06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.354+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916591529 0 0) 0x7fdaac06d700 con 0x7fdaac06ca60 2023-08-27T11:25:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda940035b0 con 0x7fdaac06ca60 2023-08-27T11:25:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943352202 0 0) 0x7fdaac152430 con 0x7fdaac155910 2023-08-27T11:25:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaac06d700 con 0x7fdaac155910 2023-08-27T11:25:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaaaffd700 1 -- 172.21.15.43:0/2426131981 >> v1:172.21.15.57:6789/0 conn(0x7fdaac155910 legacy=0x7fdaac155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaaaffd700 1 -- 172.21.15.43:0/2426131981 >> v1:172.21.15.43:6789/0 conn(0x7fdaac06ca60 legacy=0x7fdaac0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaaaffd700 1 -- 172.21.15.43:0/2426131981 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac152710 con 0x7fdaac0c51a0 2023-08-27T11:25:16.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaaaffd700 1 --2- 172.21.15.43:0/2426131981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac0c51a0 0x7fdaac06d1c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009840 tx=0x7fda9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46de654f4a220520 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011830 con 0x7fdaac0c51a0 2023-08-27T11:25:16.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c011990 con 0x7fdaac0c51a0 2023-08-27T11:25:16.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.355+0000 7fdaa9ffb700 1 -- 172.21.15.43:0/2426131981 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c011d20 con 0x7fdaac0c51a0 2023-08-27T11:25:16.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 -- 172.21.15.43:0/2426131981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac0c51a0 msgr2=0x7fdaac06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 --2- 172.21.15.43:0/2426131981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac0c51a0 0x7fdaac06d1c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009840 tx=0x7fda9c009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:16.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 -- 172.21.15.43:0/2426131981 shutdown_connections 2023-08-27T11:25:16.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 --2- 172.21.15.43:0/2426131981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac0c51a0 0x7fdaac06d1c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 -- 172.21.15.43:0/2426131981 >> 172.21.15.43:0/2426131981 conn(0x7fdaac06aa50 msgr2=0x7fdaac0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:16.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 -- 172.21.15.43:0/2426131981 shutdown_connections 2023-08-27T11:25:16.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.356+0000 7fdab17ff700 1 -- 172.21.15.43:0/2426131981 wait complete. 2023-08-27T11:25:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.358+0000 7fdab17ff700 1 Processor -- start 2023-08-27T11:25:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.358+0000 7fdab17ff700 1 -- start start 2023-08-27T11:25:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdaac06ca60 0x7fdaac1ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac155910 0x7fdaac14ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac071420 con 0x7fdaac0c51a0 2023-08-27T11:25:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac1ed6b0 con 0x7fdaac155910 2023-08-27T11:25:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdab17ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0bf220 con 0x7fdaac06ca60 2023-08-27T11:25:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41100/0 (socket says 172.21.15.43:41100) 2023-08-27T11:25:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 -- 172.21.15.43:0/4036239944 learned_addr learned my addr 172.21.15.43:0/4036239944 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaaffd700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdaac06ca60 0x7fdaac1ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaab7fe700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac155910 0x7fdaac14ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 -- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdaac06ca60 msgr2=0x7fdaac1ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdaac06ca60 0x7fdaac1ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 -- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac155910 msgr2=0x7fdaac14ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac155910 0x7fdaac14ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.359+0000 7fdaaa7fc700 1 -- 172.21.15.43:0/4036239944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0094a0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fdaaa7fc700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c700 tx=0x7fdaa000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005d70 con 0x7fdaac0c51a0 2023-08-27T11:25:16.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa00070d0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007440 con 0x7fdaac0c51a0 2023-08-27T11:25:16.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac06fe00 con 0x7fdaac0c51a0 2023-08-27T11:25:16.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.360+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac0bf4c0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.361+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac0bc8e0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.362+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdaa00075a0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.363+0000 7fda937fe700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 0x7fda9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.363+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fdaa0087700 con 0x7fdaac0c51a0 2023-08-27T11:25:16.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.363+0000 7fdaaaffd700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 0x7fda9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.364+0000 7fdaaaffd700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 0x7fda9806c5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009fd0 tx=0x7fda9c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.367+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdaa0052ff0 con 0x7fdaac0c51a0 2023-08-27T11:25:16.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.577+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaac04ee70 con 0x7fdaac0c51a0 2023-08-27T11:25:16.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.578+0000 7fda937fe700 1 -- 172.21.15.43:0/4036239944 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+15041 (secure 0 0 0) 0x7fdaa0056610 con 0x7fdaac0c51a0 2023-08-27T11:25:16.580 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:16.580 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":59,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:12.096547+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6834/3641122539":"2023-08-28T11:25:09.086113+0000","172.21.15.57:6832/3641122539":"2023-08-28T11:25:09.086113+0000","172.21.15.57:6833/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6835/1932805485":"2023-08-28T11:24:53.529626+0000","172.21.15.57:6833/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.43:6835/2697205419":"2023-08-28T11:24:56.549224+0000","172.21.15.57:6835/4060215483":"2023-08-28T11:25:00.897669+0000","172.21.15.43:6837/2697205419":"2023-08-28T11:24:56.549224+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:16.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 msgr2=0x7fda9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 0x7fda9806c5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009fd0 tx=0x7fda9c01c040 comp rx=0 tx=0).stop 2023-08-27T11:25:16.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 msgr2=0x7fdaac0bb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c700 tx=0x7fdaa000ca10 comp rx=0 tx=0).stop 2023-08-27T11:25:16.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 shutdown_connections 2023-08-27T11:25:16.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fda9806a0e0 0x7fda9806c5a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaac155910 0x7fdaac14ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdaac06ca60 0x7fdaac1ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 --2- 172.21.15.43:0/4036239944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdaac0c51a0 0x7fdaac0bb1a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 >> 172.21.15.43:0/4036239944 conn(0x7fdaac06aa50 msgr2=0x7fdaac154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:16.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 shutdown_connections 2023-08-27T11:25:16.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.581+0000 7fdab17ff700 1 -- 172.21.15.43:0/4036239944 wait complete. 2023-08-27T11:25:16.601 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:25:16.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:25:16.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.806+0000 7f705e5ff700 1 Processor -- start 2023-08-27T11:25:16.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.806+0000 7f705e5ff700 1 -- start start 2023-08-27T11:25:16.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f705e5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7058151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f705e5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70580c80c0 con 0x7f7058151cd0 2023-08-27T11:25:16.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f705e5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70581552c0 con 0x7f70580ac410 2023-08-27T11:25:16.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f705e5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70581555a0 con 0x7f70580c49f0 2023-08-27T11:25:16.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f70577fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7058151cd0 0x7f70580c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53638/0 (socket says 172.21.15.43:53638) 2023-08-27T11:25:16.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.807+0000 7f70577fe700 1 -- 172.21.15.43:0/957310524 learned_addr learned my addr 172.21.15.43:0/957310524 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:16.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7057fff700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7058151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948149046 0 0) 0x7f70580c80c0 con 0x7f7058151cd0 2023-08-27T11:25:16.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70400035b0 con 0x7f7058151cd0 2023-08-27T11:25:16.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690059973 0 0) 0x7f70400035b0 con 0x7f7058151cd0 2023-08-27T11:25:16.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 msgr2=0x7f7058151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7058151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 >> v1:172.21.15.57:6789/0 conn(0x7f70580ac410 legacy=0x7f705815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70580c8360 con 0x7f7058151cd0 2023-08-27T11:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f704c001670 con 0x7f7058151cd0 2023-08-27T11:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7057fff700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7058151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 >> v1:172.21.15.43:6789/0 conn(0x7f7058151cd0 legacy=0x7f70580c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7040003aa0 0x7f7040003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7040004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7040004d90 0x7f7040005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70581555a0 con 0x7f7040004d90 2023-08-27T11:25:16.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704000bbd0 con 0x7f7040003aa0 2023-08-27T11:25:16.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.808+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704000bd90 con 0x7f70580c49f0 2023-08-27T11:25:16.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f7057fff700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7040003aa0 0x7f7040003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7040004d90 0x7f7040005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f70577fe700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7040004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 -- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 msgr2=0x7f7040004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:16.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70580c49f0 0x7f7040004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 -- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7040003aa0 msgr2=0x7f7040003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:16.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7040003aa0 0x7f7040003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 -- 172.21.15.43:0/957310524 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480094a0 con 0x7f7040004d90 2023-08-27T11:25:16.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f705cb9c700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7040004d90 0x7f7040005210 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f705000c260 tx=0x7f7040005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e700cabd2dfd10b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.809+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050001e70 con 0x7f7040004d90 2023-08-27T11:25:16.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705000ce20 con 0x7f7040004d90 2023-08-27T11:25:16.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f7056ffd700 1 -- 172.21.15.43:0/957310524 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050012660 con 0x7f7040004d90 2023-08-27T11:25:16.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 -- 172.21.15.43:0/957310524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7040004d90 msgr2=0x7f7040005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 --2- 172.21.15.43:0/957310524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7040004d90 0x7f7040005210 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f705000c260 tx=0x7f7040005880 comp rx=0 tx=0).stop 2023-08-27T11:25:16.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705cb9c700 1 -- 172.21.15.43:0/957310524 reap_dead start 2023-08-27T11:25:16.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 -- 172.21.15.43:0/957310524 shutdown_connections 2023-08-27T11:25:16.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 -- 172.21.15.43:0/957310524 >> 172.21.15.43:0/957310524 conn(0x7f70580ab8f0 msgr2=0x7f70580abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:16.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 -- 172.21.15.43:0/957310524 shutdown_connections 2023-08-27T11:25:16.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.810+0000 7f705e5ff700 1 -- 172.21.15.43:0/957310524 wait complete. 2023-08-27T11:25:16.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.812+0000 7f705e5ff700 1 Processor -- start 2023-08-27T11:25:16.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.812+0000 7f705e5ff700 1 -- start start 2023-08-27T11:25:16.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7040004d90 0x7f7058153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70581566c0 0x7f705814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705814acc0 con 0x7f7058156240 2023-08-27T11:25:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70581e97f0 con 0x7f70581566c0 2023-08-27T11:25:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705e5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70581e9a30 con 0x7f7040004d90 2023-08-27T11:25:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f70577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f70577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41126/0 (socket says 172.21.15.43:41126) 2023-08-27T11:25:16.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f70577fe700 1 -- 172.21.15.43:0/369605067 learned_addr learned my addr 172.21.15.43:0/369605067 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:16.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f7057fff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7040004d90 0x7f7058153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.813+0000 7f705cb9c700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70581566c0 0x7f705814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 -- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7040004d90 msgr2=0x7f7058153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7040004d90 0x7f7058153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 -- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70581566c0 msgr2=0x7f705814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70581566c0 0x7f705814a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 -- 172.21.15.43:0/369605067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70581e9cd0 con 0x7f7058156240 2023-08-27T11:25:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f70577fe700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f704c004f80 tx=0x7f704c007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c012560 con 0x7f7058156240 2023-08-27T11:25:16.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c0126c0 con 0x7f7058156240 2023-08-27T11:25:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70581e9fb0 con 0x7f7058156240 2023-08-27T11:25:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c012a70 con 0x7f7058156240 2023-08-27T11:25:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.814+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70581ea570 con 0x7f7058156240 2023-08-27T11:25:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.815+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705804ee70 con 0x7f7058156240 2023-08-27T11:25:16.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.816+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f704c012bd0 con 0x7f7058156240 2023-08-27T11:25:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.817+0000 7f7054ff9700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 0x7f704406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.817+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f704c088310 con 0x7f7058156240 2023-08-27T11:25:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.818+0000 7f7057fff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 0x7f704406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.818+0000 7f7057fff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 0x7f704406c5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7048009de0 tx=0x7f7048009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:16.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:16.822+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f704c053be0 con 0x7f7058156240 2023-08-27T11:25:17.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.031+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70580ab660 con 0x7f7058156240 2023-08-27T11:25:17.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.032+0000 7f7054ff9700 1 -- 172.21.15.43:0/369605067 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f704c057200 con 0x7f7058156240 2023-08-27T11:25:17.034 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:25:17.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 msgr2=0x7f704406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 0x7f704406c5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7048009de0 tx=0x7f7048009210 comp rx=0 tx=0).stop 2023-08-27T11:25:17.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 msgr2=0x7f705814a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f704c004f80 tx=0x7f704c007340 comp rx=0 tx=0).stop 2023-08-27T11:25:17.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 shutdown_connections 2023-08-27T11:25:17.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f704406a0e0 0x7f704406c5a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.037 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70581566c0 0x7f705814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7040004d90 0x7f7058153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 --2- 172.21.15.43:0/369605067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7058156240 0x7f705814a240 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 >> 172.21.15.43:0/369605067 conn(0x7f70580ab8f0 msgr2=0x7f705814f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 shutdown_connections 2023-08-27T11:25:17.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.034+0000 7f705e5ff700 1 -- 172.21.15.43:0/369605067 wait complete. 2023-08-27T11:25:17.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:25:17.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.258+0000 7f9cf8bff700 1 Processor -- start 2023-08-27T11:25:17.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.258+0000 7f9cf8bff700 1 -- start start 2023-08-27T11:25:17.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.259+0000 7f9cf8bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9cf40c5230 0x7f9cf406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.259+0000 7f9cf8bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9cf406c5e0 0x7f9cf40aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.259+0000 7f9cf8bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf8bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf4152290 con 0x7f9cf40c5230 2023-08-27T11:25:17.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf8bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf406d7a0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf8bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4152550 con 0x7f9cf40ab190 2023-08-27T11:25:17.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9cf40c5230 0x7f9cf406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9cf40c5230 0x7f9cf406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41140/0 (socket says 172.21.15.43:41140) 2023-08-27T11:25:17.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 -- 172.21.15.43:0/1617616499 learned_addr learned my addr 172.21.15.43:0/1617616499 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:17.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf2d9d700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cebfff700 1 --2- 172.21.15.43:0/1617616499 >> v2:172.21.15.57:3300/0 conn(0x7f9cf406c5e0 0x7f9cf40aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 -- 172.21.15.43:0/1617616499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 msgr2=0x7f9cf4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:17.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 -- 172.21.15.43:0/1617616499 >> v2:172.21.15.57:3300/0 conn(0x7f9cf406c5e0 msgr2=0x7f9cf40aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:17.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 --2- 172.21.15.43:0/1617616499 >> v2:172.21.15.57:3300/0 conn(0x7f9cf406c5e0 0x7f9cf40aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.260+0000 7f9cf259c700 1 -- 172.21.15.43:0/1617616499 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4152830 con 0x7f9cf40c5230 2023-08-27T11:25:17.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf259c700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf40c5230 0x7f9cf406d1c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9cf406b910 tx=0x7f9ce4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2aa4a52297147e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf1d9b700 1 -- 172.21.15.43:0/1617616499 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011830 con 0x7f9cf40c5230 2023-08-27T11:25:17.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf1d9b700 1 -- 172.21.15.43:0/1617616499 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4011990 con 0x7f9cf40c5230 2023-08-27T11:25:17.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf1d9b700 1 -- 172.21.15.43:0/1617616499 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4011d20 con 0x7f9cf40c5230 2023-08-27T11:25:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf8bff700 1 -- 172.21.15.43:0/1617616499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf40c5230 msgr2=0x7f9cf406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.261+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf40c5230 0x7f9cf406d1c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f9cf406b910 tx=0x7f9ce4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 -- 172.21.15.43:0/1617616499 shutdown_connections 2023-08-27T11:25:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/1617616499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf40c5230 0x7f9cf406d1c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/1617616499 >> v2:172.21.15.57:3300/0 conn(0x7f9cf406c5e0 0x7f9cf40aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 -- 172.21.15.43:0/1617616499 >> 172.21.15.43:0/1617616499 conn(0x7f9cf40c5b10 msgr2=0x7f9cf40c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 -- 172.21.15.43:0/1617616499 shutdown_connections 2023-08-27T11:25:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.262+0000 7f9cf8bff700 1 -- 172.21.15.43:0/1617616499 wait complete. 2023-08-27T11:25:17.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.264+0000 7f9cf8bff700 1 Processor -- start 2023-08-27T11:25:17.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.264+0000 7f9cf8bff700 1 -- start start 2023-08-27T11:25:17.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 0x7f9cf4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf41557d0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4141a70 con 0x7f9cf40c5230 2023-08-27T11:25:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.265+0000 7f9cf8bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf41ea290 con 0x7f9cf40ab190 2023-08-27T11:25:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41148/0 (socket says 172.21.15.43:41148) 2023-08-27T11:25:17.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 -- 172.21.15.43:0/3442927605 learned_addr learned my addr 172.21.15.43:0/3442927605 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cebfff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf2d9d700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 0x7f9cf4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 -- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 msgr2=0x7f9cf4071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 -- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 msgr2=0x7f9cf4154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 0x7f9cf4154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 -- 172.21.15.43:0/3442927605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009550 con 0x7f9cf406c5e0 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf2d9d700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 0x7f9cf4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.266+0000 7f9cf259c700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009c10 tx=0x7f9ce4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.267+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4004450 con 0x7f9cf406c5e0 2023-08-27T11:25:17.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.267+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce401e070 con 0x7f9cf406c5e0 2023-08-27T11:25:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.267+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce40038e0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.267+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf4153720 con 0x7f9cf406c5e0 2023-08-27T11:25:17.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.267+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf4153ce0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.268+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf404ee70 con 0x7f9cf406c5e0 2023-08-27T11:25:17.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.269+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ce4003a40 con 0x7f9cf406c5e0 2023-08-27T11:25:17.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.270+0000 7f9ceaffd700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 0x7f9cd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.270+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9ce40890c0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.270+0000 7f9cebfff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 0x7f9cd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.271+0000 7f9cebfff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 0x7f9cd406c5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cf414ba50 tx=0x7f9cdc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.274+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ce4054990 con 0x7f9cf406c5e0 2023-08-27T11:25:17.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.483+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cf4153ed0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.483+0000 7f9ceaffd700 1 -- 172.21.15.43:0/3442927605 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ce4057fb0 con 0x7f9cf406c5e0 2023-08-27T11:25:17.485 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:25:17.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 msgr2=0x7f9cd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 0x7f9cd406c5a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9cf414ba50 tx=0x7f9cdc009210 comp rx=0 tx=0).stop 2023-08-27T11:25:17.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 msgr2=0x7f9cf4147a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4009c10 tx=0x7f9ce4004750 comp rx=0 tx=0).stop 2023-08-27T11:25:17.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 shutdown_connections 2023-08-27T11:25:17.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9cd406a0e0 0x7f9cd406c5a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9cf40c5230 0x7f9cf4154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9cf406c5e0 0x7f9cf4147a80 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 --2- 172.21.15.43:0/3442927605 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9cf40ab190 0x7f9cf4071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 >> 172.21.15.43:0/3442927605 conn(0x7f9cf40c5b10 msgr2=0x7f9cf40a66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:17.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 shutdown_connections 2023-08-27T11:25:17.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.486+0000 7f9cf8bff700 1 -- 172.21.15.43:0/3442927605 wait complete. 2023-08-27T11:25:17.506 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:25:17.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.709+0000 7f50fb3ff700 1 Processor -- start 2023-08-27T11:25:17.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.709+0000 7f50fb3ff700 1 -- start start 2023-08-27T11:25:17.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50fb3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50f40c0020 0x7f50f4158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50fb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50fb3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f4157af0 con 0x7f50f4071f70 2023-08-27T11:25:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50fb3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f4071e10 con 0x7f50f40c0020 2023-08-27T11:25:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50fb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f4158a80 con 0x7f50f4151fc0 2023-08-27T11:25:17.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50f40c0020 0x7f50f4158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f899a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f50f4071f70 0x7f50f41518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53650/0 (socket says 172.21.15.43:53650) 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f50f40c0020 0x7f50f4158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41156/0 (socket says 172.21.15.43:41156) 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f899a700 1 -- 172.21.15.43:0/377159255 learned_addr learned my addr 172.21.15.43:0/377159255 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f999c700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 -- 172.21.15.43:0/377159255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 msgr2=0x7f50f40708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:17.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f40708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 -- 172.21.15.43:0/377159255 >> v1:172.21.15.43:6789/0 conn(0x7f50f4071f70 legacy=0x7f50f41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.711+0000 7f50f919b700 1 -- 172.21.15.43:0/377159255 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f40a6040 con 0x7f50f40c0020 2023-08-27T11:25:17.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50f919b700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f40c0020 0x7f50f4158540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009840 tx=0x7f50f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f79705d41878 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50ebfff700 1 -- 172.21.15.43:0/377159255 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0011830 con 0x7f50f40c0020 2023-08-27T11:25:17.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50ebfff700 1 -- 172.21.15.43:0/377159255 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f0011990 con 0x7f50f40c0020 2023-08-27T11:25:17.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50ebfff700 1 -- 172.21.15.43:0/377159255 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0011d20 con 0x7f50f40c0020 2023-08-27T11:25:17.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50fb3ff700 1 -- 172.21.15.43:0/377159255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f40c0020 msgr2=0x7f50f4158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.712+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f40c0020 0x7f50f4158540 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009840 tx=0x7f50f0009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 -- 172.21.15.43:0/377159255 shutdown_connections 2023-08-27T11:25:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f40708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/377159255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f40c0020 0x7f50f4158540 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 -- 172.21.15.43:0/377159255 >> 172.21.15.43:0/377159255 conn(0x7f50f40c6a40 msgr2=0x7f50f40c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:17.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 -- 172.21.15.43:0/377159255 shutdown_connections 2023-08-27T11:25:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.713+0000 7f50fb3ff700 1 -- 172.21.15.43:0/377159255 wait complete. 2023-08-27T11:25:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.714+0000 7f50fb3ff700 1 Processor -- start 2023-08-27T11:25:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.715+0000 7f50fb3ff700 1 -- start start 2023-08-27T11:25:17.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.715+0000 7f50fb3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.715+0000 7f50fb3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f40c0020 0x7f50f40a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50fb3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50fb3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40a7920 con 0x7f50f4071f70 2023-08-27T11:25:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50fb3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f406b5a0 con 0x7f50f40c0020 2023-08-27T11:25:17.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50fb3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40a75f0 con 0x7f50f4151fc0 2023-08-27T11:25:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41172/0 (socket says 172.21.15.43:41172) 2023-08-27T11:25:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 -- 172.21.15.43:0/4041356033 learned_addr learned my addr 172.21.15.43:0/4041356033 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 -- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 msgr2=0x7f50f414cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 -- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f40c0020 msgr2=0x7f50f40a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f40c0020 0x7f50f40a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 -- 172.21.15.43:0/4041356033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00094a0 con 0x7f50f4071f70 2023-08-27T11:25:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.716+0000 7f50f919b700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009b90 tx=0x7f50f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.717+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00036a0 con 0x7f50f4071f70 2023-08-27T11:25:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.717+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f001f070 con 0x7f50f4071f70 2023-08-27T11:25:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.717+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0003a40 con 0x7f50f4071f70 2023-08-27T11:25:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.717+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f406b840 con 0x7f50f4071f70 2023-08-27T11:25:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.717+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40a82f0 con 0x7f50f4071f70 2023-08-27T11:25:17.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.718+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f40c4af0 con 0x7f50f4071f70 2023-08-27T11:25:17.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.719+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f50f0003ba0 con 0x7f50f4071f70 2023-08-27T11:25:17.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.720+0000 7f50e9ffb700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 0x7f50d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:17.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.720+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f50f0021070 con 0x7f50f4071f70 2023-08-27T11:25:17.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.720+0000 7f50f899a700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 0x7f50d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:17.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.721+0000 7f50f899a700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 0x7f50d806c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f50f4072910 tx=0x7f50e4007ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:17.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.724+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50f0055600 con 0x7f50f4071f70 2023-08-27T11:25:17.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.932+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f50f40c5ce0 con 0x7f50f4071f70 2023-08-27T11:25:17.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.937+0000 7f50e9ffb700 1 -- 172.21.15.43:0/4041356033 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v23)=0 v23) v1 ==== 122+0+0 (secure 0 0 0) 0x7f50f002b0c0 con 0x7f50f4071f70 2023-08-27T11:25:17.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 msgr2=0x7f50d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 0x7f50d806c5a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f50f4072910 tx=0x7f50e4007ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 msgr2=0x7f50f40a9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009b90 tx=0x7f50f0004750 comp rx=0 tx=0).stop 2023-08-27T11:25:17.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 shutdown_connections 2023-08-27T11:25:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f50d806a0e0 0x7f50d806c5a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50f4151fc0 0x7f50f414cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f50f4071f70 0x7f50f40a9d00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 --2- 172.21.15.43:0/4041356033 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f50f40c0020 0x7f50f40a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:17.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 >> 172.21.15.43:0/4041356033 conn(0x7f50f40c6a40 msgr2=0x7f50f40c0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 shutdown_connections 2023-08-27T11:25:17.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:17.939+0000 7f50fb3ff700 1 -- 172.21.15.43:0/4041356033 wait complete. 2023-08-27T11:25:17.958 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:25:17.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:25:18.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:25:18.159 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:25:18.160 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:25:18.160 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:25:18.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:25:18.205 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:25:18.205 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:25:18.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:25:18.251 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:25:18.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:18.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.450+0000 7f965cbff700 1 Processor -- start 2023-08-27T11:25:18.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.451+0000 7f965cbff700 1 -- start start 2023-08-27T11:25:18.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9658151a90 0x7f96580c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96580c4630 0x7f96580c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f965806ad70 0x7f965806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965806c4e0 con 0x7f9658151a90 2023-08-27T11:25:18.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9658155370 con 0x7f965806ad70 2023-08-27T11:25:18.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965cbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9658151e70 con 0x7f96580c4630 2023-08-27T11:25:18.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9658151a90 0x7f96580c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9658151a90 0x7f96580c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41188/0 (socket says 172.21.15.43:41188) 2023-08-27T11:25:18.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 -- 172.21.15.43:0/974168975 learned_addr learned my addr 172.21.15.43:0/974168975 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:18.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f9656d9d700 1 --2- 172.21.15.43:0/974168975 >> v2:172.21.15.57:3300/0 conn(0x7f965806ad70 0x7f965806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f964ffff700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96580c4630 0x7f96580c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 -- 172.21.15.43:0/974168975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96580c4630 msgr2=0x7f96580c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:18.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96580c4630 0x7f96580c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 -- 172.21.15.43:0/974168975 >> v2:172.21.15.57:3300/0 conn(0x7f965806ad70 msgr2=0x7f965806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:18.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 --2- 172.21.15.43:0/974168975 >> v2:172.21.15.57:3300/0 conn(0x7f965806ad70 0x7f965806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.452+0000 7f965659c700 1 -- 172.21.15.43:0/974168975 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9658154480 con 0x7f9658151a90 2023-08-27T11:25:18.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.453+0000 7f965659c700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9658151a90 0x7f96580c7bb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f96580bd700 tx=0x7f9648009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d37a4434b3cf38 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:18.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.453+0000 7f9655d9b700 1 -- 172.21.15.43:0/974168975 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800b870 con 0x7f9658151a90 2023-08-27T11:25:18.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.453+0000 7f9655d9b700 1 -- 172.21.15.43:0/974168975 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964800b9d0 con 0x7f9658151a90 2023-08-27T11:25:18.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.453+0000 7f9655d9b700 1 -- 172.21.15.43:0/974168975 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800bd60 con 0x7f9658151a90 2023-08-27T11:25:18.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.453+0000 7f965cbff700 1 -- 172.21.15.43:0/974168975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9658151a90 msgr2=0x7f96580c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:18.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9658151a90 0x7f96580c7bb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f96580bd700 tx=0x7f9648009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 -- 172.21.15.43:0/974168975 shutdown_connections 2023-08-27T11:25:18.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 --2- 172.21.15.43:0/974168975 >> v2:172.21.15.57:3300/0 conn(0x7f965806ad70 0x7f965806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9658151a90 0x7f96580c7bb0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 --2- 172.21.15.43:0/974168975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96580c4630 0x7f96580c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 -- 172.21.15.43:0/974168975 >> 172.21.15.43:0/974168975 conn(0x7f96580ab820 msgr2=0x7f96580abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:18.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 -- 172.21.15.43:0/974168975 shutdown_connections 2023-08-27T11:25:18.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.454+0000 7f965cbff700 1 -- 172.21.15.43:0/974168975 wait complete. 2023-08-27T11:25:18.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.455+0000 7f965cbff700 1 Processor -- start 2023-08-27T11:25:18.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.456+0000 7f965cbff700 1 -- start start 2023-08-27T11:25:18.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.456+0000 7f965cbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f965806ad70 0x7f9658148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.456+0000 7f965cbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f965cbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9658151a90 0x7f9658146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f965cbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96581e75a0 con 0x7f96580c4630 2023-08-27T11:25:18.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f965cbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658147570 con 0x7f9658151a90 2023-08-27T11:25:18.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f965cbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96580c0d80 con 0x7f965806ad70 2023-08-27T11:25:18.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f965659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f965806ad70 0x7f9658148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41198/0 (socket says 172.21.15.43:41198) 2023-08-27T11:25:18.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 -- 172.21.15.43:0/4161915685 learned_addr learned my addr 172.21.15.43:0/4161915685 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f9656d9d700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9658151a90 0x7f9658146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 -- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f965806ad70 msgr2=0x7f9658148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f965806ad70 0x7f9658148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 -- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9658151a90 msgr2=0x7f9658146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9658151a90 0x7f9658146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 -- 172.21.15.43:0/4161915685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648009550 con 0x7f96580c4630 2023-08-27T11:25:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.457+0000 7f964ffff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f964000e840 tx=0x7f964000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.458+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640013610 con 0x7f96580c4630 2023-08-27T11:25:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.458+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640013770 con 0x7f96580c4630 2023-08-27T11:25:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.458+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965814e710 con 0x7f96580c4630 2023-08-27T11:25:18.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.458+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640013b20 con 0x7f96580c4630 2023-08-27T11:25:18.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.458+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96580c7860 con 0x7f96580c4630 2023-08-27T11:25:18.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.459+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96580c7a50 con 0x7f96580c4630 2023-08-27T11:25:18.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.460+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9640013c80 con 0x7f96580c4630 2023-08-27T11:25:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.461+0000 7f964effd700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 0x7f963806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.461+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9640087e90 con 0x7f96580c4630 2023-08-27T11:25:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.461+0000 7f965659c700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 0x7f963806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.462+0000 7f965659c700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 0x7f963806c5a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9648014040 tx=0x7f9648008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.465+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9640053780 con 0x7f96580c4630 2023-08-27T11:25:18.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.723+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f965804ee70 con 0x7f96580c4630 2023-08-27T11:25:18.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.723+0000 7f964effd700 1 -- 172.21.15.43:0/4161915685 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f9640056da0 con 0x7f96580c4630 2023-08-27T11:25:18.725 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:18.726 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5577,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":7,"addr":"172.21.15.43:6836/675883669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":675883669},{"type":"v1","addr":"172.21.15.43:6836","nonce":675883669}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51},{"gid":5734,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2557016580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2557016580},{"type":"v1","addr":"172.21.15.43:6837","nonce":2557016580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51},{"gid":5800,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3014360349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3014360349},{"type":"v1","addr":"172.21.15.57:6835","nonce":3014360349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":49},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3956704431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3956704431},{"type":"v1","addr":"172.21.15.57:6834","nonce":3956704431}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51}],"filesystems":[]} 2023-08-27T11:25:18.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 msgr2=0x7f963806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:18.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 0x7f963806c5a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9648014040 tx=0x7f9648008030 comp rx=0 tx=0).stop 2023-08-27T11:25:18.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 msgr2=0x7f96581e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:18.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f964000e840 tx=0x7f964000eb50 comp rx=0 tx=0).stop 2023-08-27T11:25:18.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 shutdown_connections 2023-08-27T11:25:18.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f963806a0e0 0x7f963806c5a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9658151a90 0x7f9658146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f965806ad70 0x7f9658148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 --2- 172.21.15.43:0/4161915685 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96580c4630 0x7f96581e98b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:18.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 >> 172.21.15.43:0/4161915685 conn(0x7f96580ab820 msgr2=0x7f965814b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:18.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 shutdown_connections 2023-08-27T11:25:18.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:18.726+0000 7f965cbff700 1 -- 172.21.15.43:0/4161915685 wait complete. 2023-08-27T11:25:18.730 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 51 2023-08-27T11:25:18.746 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:25:18.746 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:25:18.747 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:25:18.747 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:25:18.747 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:25:18.748 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:25:18.748 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:25:18.748 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:25:18.748 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:25:18.749 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:25:18.749 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:25:18.749 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:25:18.750 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:25:18.750 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:25:18.750 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:25:18.751 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:25:18.761 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:25:18.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:25:18.763 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:25:18.763 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:25:18.770 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:25:18.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:25:18.772 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:25:18.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:25:18.807 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:25:18.808 DEBUG:teuthology.parallel:result is None 2023-08-27T11:25:18.812 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:25:18.812 DEBUG:teuthology.parallel:result is None 2023-08-27T11:25:18.817 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:25:18.817 DEBUG:teuthology.parallel:result is None 2023-08-27T11:25:18.820 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:25:18.820 DEBUG:teuthology.parallel:result is None 2023-08-27T11:25:18.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:25:18.961 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:25:18.962 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:25:18.974 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:25:18.975 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:25:19.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.035+0000 7f4387bff700 1 Processor -- start 2023-08-27T11:25:19.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.035+0000 7f4387bff700 1 -- start start 2023-08-27T11:25:19.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f4387bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43800c51a0 0x7f43800c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f4387bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f43800c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f4387bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43800c5ae0 con 0x7f4380151910 2023-08-27T11:25:19.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f4387bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800c69f0 con 0x7f43800c51a0 2023-08-27T11:25:19.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f4387bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800c1190 con 0x7f43800c15e0 2023-08-27T11:25:19.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f438519a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43800c51a0 0x7f43800c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f438519a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f43800c51a0 0x7f43800c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46080/0 (socket says 172.21.15.43:46080) 2023-08-27T11:25:19.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f438519a700 1 -- 172.21.15.43:0/705741963 learned_addr learned my addr 172.21.15.43:0/705741963 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:19.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.036+0000 7f438619c700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f43800c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f438519a700 1 -- 172.21.15.43:0/705741963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 msgr2=0x7f43800c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:19.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f438519a700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f43800c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:19.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f438519a700 1 -- 172.21.15.43:0/705741963 >> v1:172.21.15.57:6789/0 conn(0x7f4380151910 legacy=0x7f4380157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:19.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f438519a700 1 -- 172.21.15.43:0/705741963 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380072900 con 0x7f43800c51a0 2023-08-27T11:25:19.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f4384999700 1 -- 172.21.15.43:0/705741963 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292505675 0 0) 0x7f43800c5ae0 con 0x7f4380151910 2023-08-27T11:25:19.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f438519a700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43800c51a0 0x7f43800c5f70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f43700098f0 tx=0x7f4370009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ad8ca053218241 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:19.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f4384999700 1 -- 172.21.15.43:0/705741963 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370011830 con 0x7f43800c51a0 2023-08-27T11:25:19.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f4384999700 1 -- 172.21.15.43:0/705741963 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4370011990 con 0x7f43800c51a0 2023-08-27T11:25:19.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.037+0000 7f4384999700 1 -- 172.21.15.43:0/705741963 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370011d20 con 0x7f43800c51a0 2023-08-27T11:25:19.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 -- 172.21.15.43:0/705741963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43800c51a0 msgr2=0x7f43800c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:19.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43800c51a0 0x7f43800c5f70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f43700098f0 tx=0x7f4370009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:19.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 -- 172.21.15.43:0/705741963 shutdown_connections 2023-08-27T11:25:19.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f43800c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:19.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 --2- 172.21.15.43:0/705741963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f43800c51a0 0x7f43800c5f70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:19.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 -- 172.21.15.43:0/705741963 >> 172.21.15.43:0/705741963 conn(0x7f43800a9740 msgr2=0x7f43800a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:19.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 -- 172.21.15.43:0/705741963 shutdown_connections 2023-08-27T11:25:19.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.038+0000 7f4387bff700 1 -- 172.21.15.43:0/705741963 wait complete. 2023-08-27T11:25:19.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.040+0000 7f4387bff700 1 Processor -- start 2023-08-27T11:25:19.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.041+0000 7f4387bff700 1 -- start start 2023-08-27T11:25:19.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f4380152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43800c51a0 0x7f43801ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43801eaac0 con 0x7f4380151910 2023-08-27T11:25:19.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4380152bf0 con 0x7f43800c51a0 2023-08-27T11:25:19.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f4387bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4380152910 con 0x7f43800c15e0 2023-08-27T11:25:19.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f438619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f438619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46096/0 (socket says 172.21.15.43:46096) 2023-08-27T11:25:19.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f438619c700 1 -- 172.21.15.43:0/1253196083 learned_addr learned my addr 172.21.15.43:0/1253196083 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:19.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f438519a700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43800c51a0 0x7f43801ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.042+0000 7f438599b700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f4380152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 -- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 msgr2=0x7f4380152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:19.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f4380152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:19.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 -- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43800c51a0 msgr2=0x7f43801ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:19.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43800c51a0 0x7f43801ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:19.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 -- 172.21.15.43:0/1253196083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009550 con 0x7f4380151910 2023-08-27T11:25:19.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f438619c700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f437800efc0 tx=0x7f4378009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:19.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378009b20 con 0x7f4380151910 2023-08-27T11:25:19.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437800f040 con 0x7f4380151910 2023-08-27T11:25:19.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437800cc90 con 0x7f4380151910 2023-08-27T11:25:19.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43801ed200 con 0x7f4380151910 2023-08-27T11:25:19.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.043+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43801ed7c0 con 0x7f4380151910 2023-08-27T11:25:19.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.044+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43801ed9e0 con 0x7f4380151910 2023-08-27T11:25:19.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.045+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4378014480 con 0x7f4380151910 2023-08-27T11:25:19.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.046+0000 7f43767fc700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 0x7f436406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:19.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.046+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4378088dd0 con 0x7f4380151910 2023-08-27T11:25:19.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.047+0000 7f438599b700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 0x7f436406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:19.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.047+0000 7f438599b700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 0x7f436406c5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f437c007fd0 tx=0x7f437c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:19.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.051+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43780546a0 con 0x7f4380151910 2023-08-27T11:25:19.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:19.285+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f438004ee70 con 0x7f4380151910 2023-08-27T11:25:20.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.155+0000 7f43767fc700 1 -- 172.21.15.43:0/1253196083 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4378018020 con 0x7f4380151910 2023-08-27T11:25:20.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 msgr2=0x7f436406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 0x7f436406c5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f437c007fd0 tx=0x7f437c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:20.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 msgr2=0x7f4380157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f437800efc0 tx=0x7f4378009f60 comp rx=0 tx=0).stop 2023-08-27T11:25:20.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 shutdown_connections 2023-08-27T11:25:20.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f436406a0e0 0x7f436406c5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4380151910 0x7f4380157e10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f43800c15e0 0x7f4380152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 --2- 172.21.15.43:0/1253196083 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f43800c51a0 0x7f43801ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 >> 172.21.15.43:0/1253196083 conn(0x7f43800a9740 msgr2=0x7f43800a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:20.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 shutdown_connections 2023-08-27T11:25:20.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.158+0000 7f4387bff700 1 -- 172.21.15.43:0/1253196083 wait complete. 2023-08-27T11:25:20.162 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:25:20.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:25:20.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.385+0000 7f6156fff700 1 Processor -- start 2023-08-27T11:25:20.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.386+0000 7f6156fff700 1 -- start start 2023-08-27T11:25:20.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6156fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f615014e960 0x7f61500a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6156fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 0x7f61500c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6156fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6150154d00 con 0x7f61500c50d0 2023-08-27T11:25:20.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6156fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500baf30 con 0x7f615014e960 2023-08-27T11:25:20.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6156fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6150154fe0 con 0x7f61500a79c0 2023-08-27T11:25:20.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6154d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f615014e960 0x7f61500a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6154d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f615014e960 0x7f61500a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46106/0 (socket says 172.21.15.43:46106) 2023-08-27T11:25:20.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f6154d9b700 1 -- 172.21.15.43:0/960913212 learned_addr learned my addr 172.21.15.43:0/960913212 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:20.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.387+0000 7f614ffff700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 0x7f61500c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f6154d9b700 1 -- 172.21.15.43:0/960913212 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 msgr2=0x7f61500c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:20.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f6154d9b700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 0x7f61500c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f6154d9b700 1 -- 172.21.15.43:0/960913212 >> v1:172.21.15.57:6789/0 conn(0x7f61500c50d0 legacy=0x7f61500c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:20.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f6154d9b700 1 -- 172.21.15.43:0/960913212 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61501552c0 con 0x7f615014e960 2023-08-27T11:25:20.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f614ffff700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 0x7f61500c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:20.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f6154d9b700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f615014e960 0x7f61500a7480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f614400bb90 tx=0x7f614400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc214632088d4254 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f614f7fe700 1 -- 172.21.15.43:0/960913212 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400dd10 con 0x7f615014e960 2023-08-27T11:25:20.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f614f7fe700 1 -- 172.21.15.43:0/960913212 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400de70 con 0x7f615014e960 2023-08-27T11:25:20.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.388+0000 7f614f7fe700 1 -- 172.21.15.43:0/960913212 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144004230 con 0x7f615014e960 2023-08-27T11:25:20.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 -- 172.21.15.43:0/960913212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f615014e960 msgr2=0x7f61500a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f615014e960 0x7f61500a7480 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f614400bb90 tx=0x7f614400bea0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 -- 172.21.15.43:0/960913212 shutdown_connections 2023-08-27T11:25:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f615014e960 0x7f61500a7480 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 --2- 172.21.15.43:0/960913212 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f61500a79c0 0x7f61500c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 -- 172.21.15.43:0/960913212 >> 172.21.15.43:0/960913212 conn(0x7f615006aa50 msgr2=0x7f61500c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:20.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 -- 172.21.15.43:0/960913212 shutdown_connections 2023-08-27T11:25:20.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.389+0000 7f6156fff700 1 -- 172.21.15.43:0/960913212 wait complete. 2023-08-27T11:25:20.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.391+0000 7f6156fff700 1 Processor -- start 2023-08-27T11:25:20.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.391+0000 7f6156fff700 1 -- start start 2023-08-27T11:25:20.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61500c50d0 0x7f6150070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f615014e960 0x7f61500710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615006f710 con 0x7f61500a79c0 2023-08-27T11:25:20.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150071610 con 0x7f61500c50d0 2023-08-27T11:25:20.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6156fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61500aa3f0 con 0x7f615014e960 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46120/0 (socket says 172.21.15.43:46120) 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 -- 172.21.15.43:0/808952074 learned_addr learned my addr 172.21.15.43:0/808952074 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f615559c700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f615014e960 0x7f61500710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f614ffff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61500c50d0 0x7f6150070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 -- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f615014e960 msgr2=0x7f61500710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f615014e960 0x7f61500710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 -- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61500c50d0 msgr2=0x7f6150070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61500c50d0 0x7f6150070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.392+0000 7f6154d9b700 1 -- 172.21.15.43:0/808952074 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614400b7f0 con 0x7f61500a79c0 2023-08-27T11:25:20.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f6154d9b700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f615006de20 tx=0x7f6144004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144003d90 con 0x7f61500a79c0 2023-08-27T11:25:20.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144010470 con 0x7f61500a79c0 2023-08-27T11:25:20.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500aa6d0 con 0x7f61500a79c0 2023-08-27T11:25:20.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440107e0 con 0x7f61500a79c0 2023-08-27T11:25:20.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.393+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61500aac90 con 0x7f61500a79c0 2023-08-27T11:25:20.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.394+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61500bb390 con 0x7f61500a79c0 2023-08-27T11:25:20.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.395+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61440193f0 con 0x7f61500a79c0 2023-08-27T11:25:20.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.396+0000 7f614d7fa700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 0x7f613406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.396+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f614408a1a0 con 0x7f61500a79c0 2023-08-27T11:25:20.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.396+0000 7f614ffff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 0x7f613406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.397+0000 7f614ffff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 0x7f613406c5a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61500a40a0 tx=0x7f613c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.400+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6144055bd0 con 0x7f61500a79c0 2023-08-27T11:25:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.693+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f615004ee70 con 0x7f61500a79c0 2023-08-27T11:25:20.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.693+0000 7f614d7fa700 1 -- 172.21.15.43:0/808952074 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4724 (secure 0 0 0) 0x7f6144006d80 con 0x7f61500a79c0 2023-08-27T11:25:20.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:20.696 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:25:20.696 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:25:20.697 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.697 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:25:20.697 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:25:20.697 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.698 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.698 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:25:20.698 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:25:20.698 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.699 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.699 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.699 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.699 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:25:20.699 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.700 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.701 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.701 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.701 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:25:20.701 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:25:20.702 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.702 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.702 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:25:20.702 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:25:20.702 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:25:20.703 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.704 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.704 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:25:20.704 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:25:20.704 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.704 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.705 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.705 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:25:20.705 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:25:20.706 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.706 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.706 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.706 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.706 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.707 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.707 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:25:20.707 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:25:20.707 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.708 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.709 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:25:20.709 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:25:20.709 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.709 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.709 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.710 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.710 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.710 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.710 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:25:20.711 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:25:20.711 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.711 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.711 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.711 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:25:20.712 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.713 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.713 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.713 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.713 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.713 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.714 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.715 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.715 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.715 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.715 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.715 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:25:20.716 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:25:20.716 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.716 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.716 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:25:20.717 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:25:20.718 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.718 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:25:20.718 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:25:20.718 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.718 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.719 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.719 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.719 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:25:20.719 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:25:20.719 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.720 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.721 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:25:20.721 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:25:20.721 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.721 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.722 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.723 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:25:20.723 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:25:20.723 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:25:20.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:25:20.724 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:25:20.724 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.724 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.724 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.724 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.725 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:25:20.725 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:25:20.725 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.725 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:25:20.725 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:25:20.726 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.726 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.726 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:20.726 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:20.726 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:25:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:25:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:25:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:25:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:25:20.727 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:25:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:20.728 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:25:20.728 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:25:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.695+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 msgr2=0x7f613406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.695+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 0x7f613406c5a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f61500a40a0 tx=0x7f613c008040 comp rx=0 tx=0).stop 2023-08-27T11:25:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.695+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 msgr2=0x7f61500bce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.695+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f615006de20 tx=0x7f6144004750 comp rx=0 tx=0).stop 2023-08-27T11:25:20.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 shutdown_connections 2023-08-27T11:25:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f613406a0e0 0x7f613406c5a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f615014e960 0x7f61500710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f61500a79c0 0x7f61500bce20 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 --2- 172.21.15.43:0/808952074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f61500c50d0 0x7f6150070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 >> 172.21.15.43:0/808952074 conn(0x7f615006aa50 msgr2=0x7f61500a60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:20.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 shutdown_connections 2023-08-27T11:25:20.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.696+0000 7f6156fff700 1 -- 172.21.15.43:0/808952074 wait complete. 2023-08-27T11:25:20.733 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:20.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.933+0000 7f50705ff700 1 Processor -- start 2023-08-27T11:25:20.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.933+0000 7f50705ff700 1 -- start start 2023-08-27T11:25:20.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506814e380 0x7f506806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5068154da0 0x7f5068158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f506806dff0 0x7f506806e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680c2820 con 0x7f506806dff0 2023-08-27T11:25:20.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680c1750 con 0x7f5068154da0 2023-08-27T11:25:20.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f50705ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50680c1a30 con 0x7f506814e380 2023-08-27T11:25:20.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f506eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f506806dff0 0x7f506806e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f506eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f506806dff0 0x7f506806e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46122/0 (socket says 172.21.15.43:46122) 2023-08-27T11:25:20.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.934+0000 7f506eb9c700 1 -- 172.21.15.43:0/2864035274 learned_addr learned my addr 172.21.15.43:0/2864035274 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:20.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506e39b700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506814e380 0x7f506806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506db9a700 1 --2- 172.21.15.43:0/2864035274 >> v2:172.21.15.57:3300/0 conn(0x7f5068154da0 0x7f5068158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 -- 172.21.15.43:0/2864035274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506814e380 msgr2=0x7f506806ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:20.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506814e380 0x7f506806ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 -- 172.21.15.43:0/2864035274 >> v2:172.21.15.57:3300/0 conn(0x7f5068154da0 msgr2=0x7f5068158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:20.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 --2- 172.21.15.43:0/2864035274 >> v2:172.21.15.57:3300/0 conn(0x7f5068154da0 0x7f5068158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 -- 172.21.15.43:0/2864035274 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680c1d10 con 0x7f506806dff0 2023-08-27T11:25:20.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506eb9c700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f506806dff0 0x7f506806e460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f506806eab0 tx=0x7f506000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d359b6b401a38d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506d399700 1 -- 172.21.15.43:0/2864035274 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000e070 con 0x7f506806dff0 2023-08-27T11:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506d399700 1 -- 172.21.15.43:0/2864035274 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000b9c0 con 0x7f506806dff0 2023-08-27T11:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.935+0000 7f506d399700 1 -- 172.21.15.43:0/2864035274 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000bd70 con 0x7f506806dff0 2023-08-27T11:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 -- 172.21.15.43:0/2864035274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f506806dff0 msgr2=0x7f506806e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f506806dff0 0x7f506806e460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f506806eab0 tx=0x7f506000b330 comp rx=0 tx=0).stop 2023-08-27T11:25:20.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 -- 172.21.15.43:0/2864035274 shutdown_connections 2023-08-27T11:25:20.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f506806dff0 0x7f506806e460 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 --2- 172.21.15.43:0/2864035274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506814e380 0x7f506806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 --2- 172.21.15.43:0/2864035274 >> v2:172.21.15.57:3300/0 conn(0x7f5068154da0 0x7f5068158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 -- 172.21.15.43:0/2864035274 >> 172.21.15.43:0/2864035274 conn(0x7f50680c2c30 msgr2=0x7f50680c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:20.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 -- 172.21.15.43:0/2864035274 shutdown_connections 2023-08-27T11:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.936+0000 7f50705ff700 1 -- 172.21.15.43:0/2864035274 wait complete. 2023-08-27T11:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.938+0000 7f50705ff700 1 Processor -- start 2023-08-27T11:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.938+0000 7f50705ff700 1 -- start start 2023-08-27T11:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 0x7f506814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 0x7f5068152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068151e60 con 0x7f5068154da0 2023-08-27T11:25:20.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50680c5900 con 0x7f506814e380 2023-08-27T11:25:20.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f50705ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506814da20 con 0x7f506806dff0 2023-08-27T11:25:20.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f506eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f506eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46136/0 (socket says 172.21.15.43:46136) 2023-08-27T11:25:20.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f506eb9c700 1 -- 172.21.15.43:0/3028458238 learned_addr learned my addr 172.21.15.43:0/3028458238 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:20.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f506db9a700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 0x7f5068152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.939+0000 7f506e39b700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 0x7f506814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 -- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 msgr2=0x7f506814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 0x7f506814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 -- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 msgr2=0x7f5068152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:20.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 0x7f5068152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:20.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 -- 172.21.15.43:0/3028458238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060009b30 con 0x7f5068154da0 2023-08-27T11:25:20.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506db9a700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 0x7f5068152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:20.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506e39b700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 0x7f506814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:20.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f506eb9c700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50680c3cb0 tx=0x7f5060004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060004250 con 0x7f5068154da0 2023-08-27T11:25:20.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600043d0 con 0x7f5068154da0 2023-08-27T11:25:20.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50680c5b50 con 0x7f5068154da0 2023-08-27T11:25:20.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060004780 con 0x7f5068154da0 2023-08-27T11:25:20.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.940+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506814d3a0 con 0x7f5068154da0 2023-08-27T11:25:20.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.941+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5068151fa0 con 0x7f5068154da0 2023-08-27T11:25:20.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.942+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f506001b430 con 0x7f5068154da0 2023-08-27T11:25:20.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.943+0000 7f505effd700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 0x7f504c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.943+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5060089610 con 0x7f5068154da0 2023-08-27T11:25:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.944+0000 7f506e39b700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 0x7f504c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:20.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.944+0000 7f506e39b700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 0x7f504c06c5a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5064009a00 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:20.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:20.947+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5068151fa0 con 0x7f5068154da0 2023-08-27T11:25:21.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.157+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5068151fa0 con 0x7f5068154da0 2023-08-27T11:25:21.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.157+0000 7f505effd700 1 -- 172.21.15.43:0/3028458238 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+14522 (secure 0 0 0) 0x7f5068151fa0 con 0x7f5068154da0 2023-08-27T11:25:21.159 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:21.159 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":64,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:20.151799+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:21.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 msgr2=0x7f504c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 0x7f504c06c5a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5064009a00 tx=0x7f5064008040 comp rx=0 tx=0).stop 2023-08-27T11:25:21.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 msgr2=0x7f50681527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f50680c3cb0 tx=0x7f5060004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 shutdown_connections 2023-08-27T11:25:21.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f504c06a0e0 0x7f504c06c5a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5068154da0 0x7f50681527c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f506806dff0 0x7f506814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 --2- 172.21.15.43:0/3028458238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f506814e380 0x7f5068152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 >> 172.21.15.43:0/3028458238 conn(0x7f50680c2c30 msgr2=0x7f5068146670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:21.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 shutdown_connections 2023-08-27T11:25:21.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.160+0000 7f50705ff700 1 -- 172.21.15.43:0/3028458238 wait complete. 2023-08-27T11:25:21.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:25:21.180 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:25:21.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.383+0000 7fafbcbff700 1 Processor -- start 2023-08-27T11:25:21.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.383+0000 7fafbcbff700 1 -- start start 2023-08-27T11:25:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.384+0000 7fafbcbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafb815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.384+0000 7fafbcbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80c80c0 con 0x7fafb80ac410 2023-08-27T11:25:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.384+0000 7fafbcbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb81552c0 con 0x7fafb80c49f0 2023-08-27T11:25:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.384+0000 7fafbcbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81555a0 con 0x7fafb80c9690 2023-08-27T11:25:21.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb5d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fafb80ac410 0x7fafb80c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36036/0 (socket says 172.21.15.43:36036) 2023-08-27T11:25:21.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb5d9b700 1 -- 172.21.15.43:0/3879040758 learned_addr learned my addr 172.21.15.43:0/3879040758 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:21.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb6d9d700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafb815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046595865 0 0) 0x7fafb80c80c0 con 0x7fafb80ac410 2023-08-27T11:25:21.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa00035b0 con 0x7fafb80ac410 2023-08-27T11:25:21.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933914655 0 0) 0x7fafb81552c0 con 0x7fafb80c49f0 2023-08-27T11:25:21.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb80c80c0 con 0x7fafb80c49f0 2023-08-27T11:25:21.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419166231 0 0) 0x7fafa00035b0 con 0x7fafb80ac410 2023-08-27T11:25:21.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 msgr2=0x7fafb815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.385+0000 7fafb559a700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafb815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 >> v1:172.21.15.57:6789/0 conn(0x7fafb80c49f0 legacy=0x7fafb8151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80c8360 con 0x7fafb80ac410 2023-08-27T11:25:21.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fafac001670 con 0x7fafb80ac410 2023-08-27T11:25:21.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 >> v1:172.21.15.43:6789/0 conn(0x7fafb80ac410 legacy=0x7fafb80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafa0003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafa00041e0 0x7fafa0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0004de0 0x7fafa0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81555a0 con 0x7fafa00041e0 2023-08-27T11:25:21.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa000bcd0 con 0x7fafa0004de0 2023-08-27T11:25:21.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa000be90 con 0x7fafb80c9690 2023-08-27T11:25:21.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafa00041e0 0x7fafa0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb659c700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafa0003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb6d9d700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0004de0 0x7fafa0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 -- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 msgr2=0x7fafa0003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb80c9690 0x7fafa0003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 -- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0004de0 msgr2=0x7fafa0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa0004de0 0x7fafa0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.386+0000 7fafb5d9b700 1 -- 172.21.15.43:0/3879040758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00035b0 con 0x7fafa00041e0 2023-08-27T11:25:21.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafb5d9b700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafa00041e0 0x7fafa0004850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c0e0 tx=0x7fafa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791bc78cb9269a3b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac00cc80 con 0x7fafa00041e0 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac00ce00 con 0x7fafa00041e0 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafb559a700 1 -- 172.21.15.43:0/3879040758 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac005ba0 con 0x7fafa00041e0 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafbcbff700 1 -- 172.21.15.43:0/3879040758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafa00041e0 msgr2=0x7fafa0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3879040758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafa00041e0 0x7fafa0004850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fafac00c0e0 tx=0x7fafa0005880 comp rx=0 tx=0).stop 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafb6d9d700 1 -- 172.21.15.43:0/3879040758 reap_dead start 2023-08-27T11:25:21.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.387+0000 7fafbcbff700 1 -- 172.21.15.43:0/3879040758 shutdown_connections 2023-08-27T11:25:21.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.388+0000 7fafbcbff700 1 -- 172.21.15.43:0/3879040758 >> 172.21.15.43:0/3879040758 conn(0x7fafb80ab8f0 msgr2=0x7fafb80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:21.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.388+0000 7fafbcbff700 1 -- 172.21.15.43:0/3879040758 shutdown_connections 2023-08-27T11:25:21.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.388+0000 7fafbcbff700 1 -- 172.21.15.43:0/3879040758 wait complete. 2023-08-27T11:25:21.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.389+0000 7fafbcbff700 1 Processor -- start 2023-08-27T11:25:21.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.389+0000 7fafbcbff700 1 -- start start 2023-08-27T11:25:21.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00041e0 0x7fafb814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 0x7fafb80c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8152db0 con 0x7fafb8153740 2023-08-27T11:25:21.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb814ad00 con 0x7fafa00041e0 2023-08-27T11:25:21.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.390+0000 7fafbcbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81567d0 con 0x7fafb814a880 2023-08-27T11:25:21.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 0x7fafb80c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00041e0 0x7fafb814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48892/0 (socket says 172.21.15.43:48892) 2023-08-27T11:25:21.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb5d9b700 1 -- 172.21.15.43:0/3150398584 learned_addr learned my addr 172.21.15.43:0/3150398584 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:21.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 -- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 msgr2=0x7fafb8153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 -- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00041e0 msgr2=0x7fafb814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00041e0 0x7fafb814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 -- 172.21.15.43:0/3150398584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80c24f0 con 0x7fafb8153740 2023-08-27T11:25:21.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb5d9b700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:21.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.391+0000 7fafb6d9d700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 0x7fafb80c2e40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c020 tx=0x7fafb0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.392+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000e040 con 0x7fafb8153740 2023-08-27T11:25:21.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.392+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000f040 con 0x7fafb8153740 2023-08-27T11:25:21.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.392+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb8153bc0 con 0x7fafb8153740 2023-08-27T11:25:21.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.392+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000fc40 con 0x7fafb8153740 2023-08-27T11:25:21.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.392+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80c1250 con 0x7fafb8153740 2023-08-27T11:25:21.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.393+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb8074680 con 0x7fafb8153740 2023-08-27T11:25:21.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.394+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fafb0015430 con 0x7fafb8153740 2023-08-27T11:25:21.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.395+0000 7fafa6ffd700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 0x7faf9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.395+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fafb00888f0 con 0x7fafb8153740 2023-08-27T11:25:21.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.395+0000 7fafb659c700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 0x7faf9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.395+0000 7fafb659c700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 0x7faf9806c5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007fd0 tx=0x7fafa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.399+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fafb0057db0 con 0x7fafb8153740 2023-08-27T11:25:21.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.611+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafb804ee70 con 0x7fafb8153740 2023-08-27T11:25:21.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.611+0000 7fafa6ffd700 1 -- 172.21.15.43:0/3150398584 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fafb0057940 con 0x7fafb8153740 2023-08-27T11:25:21.613 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:25:21.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.613+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 msgr2=0x7faf9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.613+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 0x7faf9806c5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fafa8007fd0 tx=0x7fafa8009040 comp rx=0 tx=0).stop 2023-08-27T11:25:21.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 msgr2=0x7fafb80c2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 0x7fafb80c2e40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fafa000c020 tx=0x7fafb0011ed0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 shutdown_connections 2023-08-27T11:25:21.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf9806a0e0 0x7faf9806c5a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fafb8153740 0x7fafb80c2e40 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fafa00041e0 0x7fafb814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 --2- 172.21.15.43:0/3150398584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fafb814a880 0x7fafb8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 >> 172.21.15.43:0/3150398584 conn(0x7fafb80ab8f0 msgr2=0x7fafb814ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:21.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 shutdown_connections 2023-08-27T11:25:21.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.614+0000 7fafbcbff700 1 -- 172.21.15.43:0/3150398584 wait complete. 2023-08-27T11:25:21.633 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:25:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.836+0000 7fb6385ff700 1 Processor -- start 2023-08-27T11:25:21.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.837+0000 7fb6385ff700 1 -- start start 2023-08-27T11:25:21.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb6385ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb6300c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb6385ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630154660 con 0x7fb63006a8e0 2023-08-27T11:25:21.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb6385ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630154940 con 0x7fb630151d20 2023-08-27T11:25:21.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb6385ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300c5750 con 0x7fb6300c7c00 2023-08-27T11:25:21.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb636b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb63006a8e0 0x7fb63006ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36038/0 (socket says 172.21.15.43:36038) 2023-08-27T11:25:21.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb636b9c700 1 -- 172.21.15.43:0/2943165132 learned_addr learned my addr 172.21.15.43:0/2943165132 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb635b9a700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb6300c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.838+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114522603 0 0) 0x7fb630154660 con 0x7fb63006a8e0 2023-08-27T11:25:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb61c0035b0 con 0x7fb63006a8e0 2023-08-27T11:25:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121390769 0 0) 0x7fb61c0035b0 con 0x7fb63006a8e0 2023-08-27T11:25:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 msgr2=0x7fb6300c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb6300c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 >> v1:172.21.15.57:6789/0 conn(0x7fb630151d20 legacy=0x7fb6300ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630154c20 con 0x7fb63006a8e0 2023-08-27T11:25:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb628001a40 con 0x7fb63006a8e0 2023-08-27T11:25:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 >> v1:172.21.15.43:6789/0 conn(0x7fb63006a8e0 legacy=0x7fb63006ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb61c003aa0 0x7fb61c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c004850 0x7fb61c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb61c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c005520 con 0x7fb61c003aa0 2023-08-27T11:25:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c005690 con 0x7fb61c004850 2023-08-27T11:25:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c00bf50 con 0x7fb6300c7c00 2023-08-27T11:25:21.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb63639b700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb61c003aa0 0x7fb61c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb636b9c700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb61c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.839+0000 7fb635b9a700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c004850 0x7fb61c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 -- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 msgr2=0x7fb61c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6300c7c00 0x7fb61c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 -- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c004850 msgr2=0x7fb61c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:21.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c004850 0x7fb61c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 -- 172.21.15.43:0/2943165132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0035b0 con 0x7fb61c003aa0 2023-08-27T11:25:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb635b9a700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c004850 0x7fb61c004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb63639b700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb61c003aa0 0x7fb61c003ec0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0017f0 tx=0x7fb61c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54772d26e68f5f83 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0052d0 con 0x7fb61c003aa0 2023-08-27T11:25:21.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c005430 con 0x7fb61c003aa0 2023-08-27T11:25:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.840+0000 7fb635399700 1 -- 172.21.15.43:0/2943165132 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0038c0 con 0x7fb61c003aa0 2023-08-27T11:25:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 -- 172.21.15.43:0/2943165132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb61c003aa0 msgr2=0x7fb61c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 --2- 172.21.15.43:0/2943165132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb61c003aa0 0x7fb61c003ec0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0017f0 tx=0x7fb61c005880 comp rx=0 tx=0).stop 2023-08-27T11:25:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb636b9c700 1 -- 172.21.15.43:0/2943165132 reap_dead start 2023-08-27T11:25:21.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 -- 172.21.15.43:0/2943165132 shutdown_connections 2023-08-27T11:25:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 -- 172.21.15.43:0/2943165132 >> 172.21.15.43:0/2943165132 conn(0x7fb6300c9d00 msgr2=0x7fb6300ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 -- 172.21.15.43:0/2943165132 shutdown_connections 2023-08-27T11:25:21.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.841+0000 7fb6385ff700 1 -- 172.21.15.43:0/2943165132 wait complete. 2023-08-27T11:25:21.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.843+0000 7fb6385ff700 1 Processor -- start 2023-08-27T11:25:21.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.843+0000 7fb6385ff700 1 -- start start 2023-08-27T11:25:21.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 0x7fb630156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 0x7fb6301e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301ea6f0 con 0x7fb6301486d0 2023-08-27T11:25:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300aa910 con 0x7fb61c003aa0 2023-08-27T11:25:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb6385ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300ab080 con 0x7fb63014a4a0 2023-08-27T11:25:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb635b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb635b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46164/0 (socket says 172.21.15.43:46164) 2023-08-27T11:25:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.844+0000 7fb635b9a700 1 -- 172.21.15.43:0/1655245253 learned_addr learned my addr 172.21.15.43:0/1655245253 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 -- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 msgr2=0x7fb6301e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb636b9c700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 0x7fb6301e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb63639b700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 0x7fb630156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 0x7fb6301e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 -- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 msgr2=0x7fb630156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 0x7fb630156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 -- 172.21.15.43:0/1655245253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300ab8f0 con 0x7fb6301486d0 2023-08-27T11:25:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb636b9c700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 0x7fb6301e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:21.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb63639b700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 0x7fb630156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb635b9a700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb620010850 tx=0x7fb620010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620010e50 con 0x7fb6301486d0 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620004020 con 0x7fb6301486d0 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200043b0 con 0x7fb6301486d0 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300abbd0 con 0x7fb6301486d0 2023-08-27T11:25:21.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.845+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb630157370 con 0x7fb6301486d0 2023-08-27T11:25:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.846+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63004ee70 con 0x7fb6301486d0 2023-08-27T11:25:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.847+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb62000e8d0 con 0x7fb6301486d0 2023-08-27T11:25:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.848+0000 7fb626ffd700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 0x7fb61406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.848+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb620088490 con 0x7fb6301486d0 2023-08-27T11:25:21.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.848+0000 7fb63639b700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 0x7fb61406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.849+0000 7fb63639b700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 0x7fb61406c5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb62c015040 tx=0x7fb62c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:21.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:21.853+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb620053ec0 con 0x7fb6301486d0 2023-08-27T11:25:22.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.061+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6300c0b00 con 0x7fb6301486d0 2023-08-27T11:25:22.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.062+0000 7fb626ffd700 1 -- 172.21.15.43:0/1655245253 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6200574e0 con 0x7fb6301486d0 2023-08-27T11:25:22.064 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:25:22.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 msgr2=0x7fb61406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 0x7fb61406c5a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb62c015040 tx=0x7fb62c009030 comp rx=0 tx=0).stop 2023-08-27T11:25:22.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 msgr2=0x7fb630149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb620010850 tx=0x7fb620010c10 comp rx=0 tx=0).stop 2023-08-27T11:25:22.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 shutdown_connections 2023-08-27T11:25:22.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb61406a0e0 0x7fb61406c5a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb63014a4a0 0x7fb6301e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb61c003aa0 0x7fb630156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 --2- 172.21.15.43:0/1655245253 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb6301486d0 0x7fb630149f60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 >> 172.21.15.43:0/1655245253 conn(0x7fb6300c9d00 msgr2=0x7fb6300bcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:22.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 shutdown_connections 2023-08-27T11:25:22.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.064+0000 7fb6385ff700 1 -- 172.21.15.43:0/1655245253 wait complete. 2023-08-27T11:25:22.084 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:25:22.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.284+0000 7f52d5bff700 1 Processor -- start 2023-08-27T11:25:22.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.284+0000 7f52d5bff700 1 -- start start 2023-08-27T11:25:22.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52d5bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52d5bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d006c4e0 con 0x7f52d00c4630 2023-08-27T11:25:22.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52d5bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d0155370 con 0x7f52d0151a90 2023-08-27T11:25:22.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52d5bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00c82c0 con 0x7f52d00c4a90 2023-08-27T11:25:22.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52ceffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f52d00c4630 0x7f52d006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36040/0 (socket says 172.21.15.43:36040) 2023-08-27T11:25:22.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52ceffd700 1 -- 172.21.15.43:0/715326393 learned_addr learned my addr 172.21.15.43:0/715326393 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:22.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.286+0000 7f52cffff700 1 --2- 172.21.15.43:0/715326393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924030374 0 0) 0x7f52d006c4e0 con 0x7f52d00c4630 2023-08-27T11:25:22.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b80035b0 con 0x7f52d00c4630 2023-08-27T11:25:22.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895327129 0 0) 0x7f52d0155370 con 0x7f52d0151a90 2023-08-27T11:25:22.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d006c4e0 con 0x7f52d0151a90 2023-08-27T11:25:22.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52cffff700 1 -- 172.21.15.43:0/715326393 >> v1:172.21.15.57:6789/0 conn(0x7f52d0151a90 legacy=0x7f52d00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52cffff700 1 -- 172.21.15.43:0/715326393 >> v1:172.21.15.43:6789/0 conn(0x7f52d00c4630 legacy=0x7f52d006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52cffff700 1 -- 172.21.15.43:0/715326393 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0151e70 con 0x7f52d00c4a90 2023-08-27T11:25:22.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52cffff700 1 --2- 172.21.15.43:0/715326393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d006b480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009dc0 tx=0x7f52c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed23d0175fd9f2ad server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.287+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800e070 con 0x7f52d00c4a90 2023-08-27T11:25:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800bb20 con 0x7f52d00c4a90 2023-08-27T11:25:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52ce7fc700 1 -- 172.21.15.43:0/715326393 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8012430 con 0x7f52d00c4a90 2023-08-27T11:25:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 -- 172.21.15.43:0/715326393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 msgr2=0x7f52d006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 --2- 172.21.15.43:0/715326393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d006b480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009dc0 tx=0x7f52c800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:22.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 -- 172.21.15.43:0/715326393 shutdown_connections 2023-08-27T11:25:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 --2- 172.21.15.43:0/715326393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d006b480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 -- 172.21.15.43:0/715326393 >> 172.21.15.43:0/715326393 conn(0x7f52d00ab820 msgr2=0x7f52d00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:22.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 -- 172.21.15.43:0/715326393 shutdown_connections 2023-08-27T11:25:22.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.288+0000 7f52d5bff700 1 -- 172.21.15.43:0/715326393 wait complete. 2023-08-27T11:25:22.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.290+0000 7f52d5bff700 1 Processor -- start 2023-08-27T11:25:22.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.290+0000 7f52d5bff700 1 -- start start 2023-08-27T11:25:22.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 0x7f52d0149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d0152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0154270 con 0x7f52d0151a90 2023-08-27T11:25:22.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d014d870 con 0x7f52d00c4630 2023-08-27T11:25:22.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52d5bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d01ed110 con 0x7f52d00c4a90 2023-08-27T11:25:22.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52cffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46174/0 (socket says 172.21.15.43:46174) 2023-08-27T11:25:22.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.291+0000 7f52cffff700 1 -- 172.21.15.43:0/3258271716 learned_addr learned my addr 172.21.15.43:0/3258271716 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:22.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52ceffd700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d0152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cf7fe700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 0x7f52d0149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 -- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 msgr2=0x7f52d0152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d0152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 -- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 msgr2=0x7f52d0149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 0x7f52d0149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 -- 172.21.15.43:0/3258271716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8009a70 con 0x7f52d0151a90 2023-08-27T11:25:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52ceffd700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cf7fe700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 0x7f52d0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52cffff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f52c800b370 tx=0x7f52c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c801b810 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8020070 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c801bbf0 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.292+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00bd0b0 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.293+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0153c20 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.293+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0152280 con 0x7f52d0151a90 2023-08-27T11:25:22.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.295+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f52c801bd50 con 0x7f52d0151a90 2023-08-27T11:25:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.295+0000 7f52b7fff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 0x7f52bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.296+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f52c8022070 con 0x7f52d0151a90 2023-08-27T11:25:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.296+0000 7f52cf7fe700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 0x7f52bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.296+0000 7f52cf7fe700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 0x7f52bc06c5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52c00011e0 tx=0x7f52c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.300+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f52c8055ff0 con 0x7f52d0151a90 2023-08-27T11:25:22.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.512+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f52d004ee70 con 0x7f52d0151a90 2023-08-27T11:25:22.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.512+0000 7f52b7fff700 1 -- 172.21.15.43:0/3258271716 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+126 (secure 0 0 0) 0x7f52c802c090 con 0x7f52d0151a90 2023-08-27T11:25:22.514 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:22.514 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:25:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:25:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:25:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:25:22.515 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:25:22.516 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:25:22.516 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:25:22.516 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:25:22.516 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:25:22.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 msgr2=0x7f52bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 0x7f52bc06c5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52c00011e0 tx=0x7f52c0009040 comp rx=0 tx=0).stop 2023-08-27T11:25:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 msgr2=0x7f52d0152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f52c800b370 tx=0x7f52c8004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 shutdown_connections 2023-08-27T11:25:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f52bc06a0e0 0x7f52bc06c5a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f52d0151a90 0x7f52d0152aa0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d00c4630 0x7f52d0149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 --2- 172.21.15.43:0/3258271716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d00c4a90 0x7f52d0152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 >> 172.21.15.43:0/3258271716 conn(0x7f52d00ab820 msgr2=0x7f52d014f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:22.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 shutdown_connections 2023-08-27T11:25:22.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.515+0000 7f52d5bff700 1 -- 172.21.15.43:0/3258271716 wait complete. 2023-08-27T11:25:22.534 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:25:22.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:25:22.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.738+0000 7f5aaebff700 1 Processor -- start 2023-08-27T11:25:22.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.738+0000 7f5aaebff700 1 -- start start 2023-08-27T11:25:22.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.739+0000 7f5aaebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5aa80a77d0 0x7f5aa814e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.739+0000 7f5aaebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 0x7f5aa814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.739+0000 7f5aaebff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa8152140 con 0x7f5aa80c50f0 2023-08-27T11:25:22.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.739+0000 7f5aaebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa814ee10 con 0x7f5aa80a77d0 2023-08-27T11:25:22.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.739+0000 7f5aaebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81515c0 con 0x7f5aa80a5090 2023-08-27T11:25:22.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5aa80a77d0 0x7f5aa814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5aa80a77d0 0x7f5aa814e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46176/0 (socket says 172.21.15.43:46176) 2023-08-27T11:25:22.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 -- 172.21.15.43:0/1280545296 learned_addr learned my addr 172.21.15.43:0/1280545296 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:22.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 -- 172.21.15.43:0/1280545296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 msgr2=0x7f5aa814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:22.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 0x7f5aa814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 0x7f5aa814e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 -- 172.21.15.43:0/1280545296 >> v1:172.21.15.57:6789/0 conn(0x7f5aa80c50f0 legacy=0x7f5aa80c3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:22.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 -- 172.21.15.43:0/1280545296 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa81518a0 con 0x7f5aa80a77d0 2023-08-27T11:25:22.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 0x7f5aa814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:22.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.740+0000 7f5aac99b700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a77d0 0x7f5aa814e390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00bb90 tx=0x7f5a9c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ef9c0b88206bcf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aa77fe700 1 -- 172.21.15.43:0/1280545296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00dd10 con 0x7f5aa80a77d0 2023-08-27T11:25:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aa77fe700 1 -- 172.21.15.43:0/1280545296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00de70 con 0x7f5aa80a77d0 2023-08-27T11:25:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aa77fe700 1 -- 172.21.15.43:0/1280545296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c004230 con 0x7f5aa80a77d0 2023-08-27T11:25:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 -- 172.21.15.43:0/1280545296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a77d0 msgr2=0x7f5aa814e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a77d0 0x7f5aa814e390 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00bb90 tx=0x7f5a9c00bea0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 -- 172.21.15.43:0/1280545296 shutdown_connections 2023-08-27T11:25:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a77d0 0x7f5aa814e390 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 --2- 172.21.15.43:0/1280545296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80a5090 0x7f5aa814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 -- 172.21.15.43:0/1280545296 >> 172.21.15.43:0/1280545296 conn(0x7f5aa80c2400 msgr2=0x7f5aa80c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:22.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 -- 172.21.15.43:0/1280545296 shutdown_connections 2023-08-27T11:25:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.741+0000 7f5aaebff700 1 -- 172.21.15.43:0/1280545296 wait complete. 2023-08-27T11:25:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.743+0000 7f5aaebff700 1 Processor -- start 2023-08-27T11:25:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.743+0000 7f5aaebff700 1 -- start start 2023-08-27T11:25:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 0x7f5aa80a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 0x7f5aa80a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81e95d0 con 0x7f5aa80a5090 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81474e0 con 0x7f5aa80a77d0 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aaebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa81e7040 con 0x7f5aa80c50f0 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aac99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aac99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46186/0 (socket says 172.21.15.43:46186) 2023-08-27T11:25:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.744+0000 7f5aac99b700 1 -- 172.21.15.43:0/3083318932 learned_addr learned my addr 172.21.15.43:0/3083318932 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 0x7f5aa80a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aad19c700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 0x7f5aa80a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 -- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 msgr2=0x7f5aa80a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 0x7f5aa80a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 -- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 msgr2=0x7f5aa80a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 0x7f5aa80a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 -- 172.21.15.43:0/3083318932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c00b7f0 con 0x7f5aa80a5090 2023-08-27T11:25:22.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 0x7f5aa80a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aad19c700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 0x7f5aa80a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aac99b700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00d5d0 tx=0x7f5a9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00dcc0 con 0x7f5aa80a5090 2023-08-27T11:25:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c010470 con 0x7f5aa80a5090 2023-08-27T11:25:22.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa8146fb0 con 0x7f5aa80a5090 2023-08-27T11:25:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.745+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0107e0 con 0x7f5aa80a5090 2023-08-27T11:25:22.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.746+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa80c03a0 con 0x7f5aa80a5090 2023-08-27T11:25:22.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.747+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa80c0200 con 0x7f5aa80a5090 2023-08-27T11:25:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.748+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5a9c0193f0 con 0x7f5aa80a5090 2023-08-27T11:25:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.749+0000 7f5aa57fa700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 0x7f5a8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.749+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5a9c08a1f0 con 0x7f5aa80a5090 2023-08-27T11:25:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.749+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 0x7f5a8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:22.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.750+0000 7f5aa7fff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 0x7f5a8c06c5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5aa81e7410 tx=0x7f5a94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:22.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.753+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5aa80c0200 con 0x7f5aa80a5090 2023-08-27T11:25:22.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:22.963+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5aa8145840 con 0x7f5aa80a5090 2023-08-27T11:25:23.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.890+0000 7f5aa57fa700 1 -- 172.21.15.43:0/3083318932 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5aa8145840 con 0x7f5aa80a5090 2023-08-27T11:25:23.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 msgr2=0x7f5a8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:23.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 0x7f5a8c06c5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5aa81e7410 tx=0x7f5a94008040 comp rx=0 tx=0).stop 2023-08-27T11:25:23.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 msgr2=0x7f5aa81441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:23.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00d5d0 tx=0x7f5a9c004750 comp rx=0 tx=0).stop 2023-08-27T11:25:23.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 shutdown_connections 2023-08-27T11:25:23.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5a8c06a0e0 0x7f5a8c06c5a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:23.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5aa80c50f0 0x7f5aa80a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:23.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5aa80a5090 0x7f5aa81441d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:23.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 --2- 172.21.15.43:0/3083318932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5aa80a77d0 0x7f5aa80a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:23.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.895+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 >> 172.21.15.43:0/3083318932 conn(0x7f5aa80c2400 msgr2=0x7f5aa80a63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:23.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.897+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 shutdown_connections 2023-08-27T11:25:23.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:23.897+0000 7f5aaebff700 1 -- 172.21.15.43:0/3083318932 wait complete. 2023-08-27T11:25:23.901 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:25:23.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:25:24.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.133+0000 7fc3fcdff700 1 Processor -- start 2023-08-27T11:25:24.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.133+0000 7fc3fcdff700 1 -- start start 2023-08-27T11:25:24.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.134+0000 7fc3fcdff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3f814e860 0x7fc3f80c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.134+0000 7fc3fcdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.134+0000 7fc3fcdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f8154d30 con 0x7fc3f80c2120 2023-08-27T11:25:24.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.134+0000 7fc3fcdff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f80a8c00 con 0x7fc3f814e860 2023-08-27T11:25:24.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.134+0000 7fc3fcdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80c5430 con 0x7fc3f8151e10 2023-08-27T11:25:24.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3f814e860 0x7fc3f80c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48972/0 (socket says 172.21.15.43:48972) 2023-08-27T11:25:24.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc3f814e860 0x7fc3f80c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60122/0 (socket says 172.21.15.43:60122) 2023-08-27T11:25:24.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f5d9b700 1 -- 172.21.15.43:0/4272498050 learned_addr learned my addr 172.21.15.43:0/4272498050 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:24.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 -- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 msgr2=0x7fc3f81551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:24.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 -- 172.21.15.43:0/4272498050 >> v1:172.21.15.57:6789/0 conn(0x7fc3f80c2120 legacy=0x7fc3f80c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f659c700 1 -- 172.21.15.43:0/4272498050 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80c4e70 con 0x7fc3f814e860 2023-08-27T11:25:24.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f5d9b700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:24.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.135+0000 7fc3f559a700 1 -- 172.21.15.43:0/4272498050 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960732262 0 0) 0x7fc3f8154d30 con 0x7fc3f80c2120 2023-08-27T11:25:24.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3f659c700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f814e860 0x7fc3f80c02c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009840 tx=0x7fc3e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=767a013d2de8960d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:24.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3f559a700 1 -- 172.21.15.43:0/4272498050 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8011830 con 0x7fc3f814e860 2023-08-27T11:25:24.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3f559a700 1 -- 172.21.15.43:0/4272498050 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8011990 con 0x7fc3f814e860 2023-08-27T11:25:24.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3f559a700 1 -- 172.21.15.43:0/4272498050 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8011d20 con 0x7fc3f814e860 2023-08-27T11:25:24.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3fcdff700 1 -- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f814e860 msgr2=0x7fc3f80c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.136+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f814e860 0x7fc3f80c02c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009840 tx=0x7fc3e8009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:24.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 -- 172.21.15.43:0/4272498050 shutdown_connections 2023-08-27T11:25:24.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f814e860 0x7fc3f80c02c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/4272498050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 -- 172.21.15.43:0/4272498050 >> 172.21.15.43:0/4272498050 conn(0x7fc3f806a310 msgr2=0x7fc3f806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:24.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 -- 172.21.15.43:0/4272498050 shutdown_connections 2023-08-27T11:25:24.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.137+0000 7fc3fcdff700 1 -- 172.21.15.43:0/4272498050 wait complete. 2023-08-27T11:25:24.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.138+0000 7fc3fcdff700 1 Processor -- start 2023-08-27T11:25:24.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.138+0000 7fc3fcdff700 1 -- start start 2023-08-27T11:25:24.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 0x7fc3f81eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f81ed7a0 con 0x7fc3f814e860 2023-08-27T11:25:24.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f81ed4c0 con 0x7fc3f80c2120 2023-08-27T11:25:24.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.139+0000 7fc3fcdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f8150800 con 0x7fc3f8151e10 2023-08-27T11:25:24.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46200/0 (socket says 172.21.15.43:46200) 2023-08-27T11:25:24.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 -- 172.21.15.43:0/3490691498 learned_addr learned my addr 172.21.15.43:0/3490691498 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:24.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f659c700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 0x7fc3f81eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f6d9d700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 -- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 msgr2=0x7fc3f80a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f80a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 -- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 msgr2=0x7fc3f81eca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 0x7fc3f81eca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 -- 172.21.15.43:0/3490691498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec00b7f0 con 0x7fc3f814e860 2023-08-27T11:25:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f659c700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 0x7fc3f81eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.140+0000 7fc3f5d9b700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00ed70 tx=0x7fc3ec00d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.141+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00dd90 con 0x7fc3f814e860 2023-08-27T11:25:24.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.141+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec010440 con 0x7fc3f814e860 2023-08-27T11:25:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.141+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0107b0 con 0x7fc3f814e860 2023-08-27T11:25:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.141+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80094a0 con 0x7fc3f814e860 2023-08-27T11:25:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.141+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f8150dc0 con 0x7fc3f814e860 2023-08-27T11:25:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.142+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f8074680 con 0x7fc3f814e860 2023-08-27T11:25:24.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.143+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc3ec010910 con 0x7fc3f814e860 2023-08-27T11:25:24.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.144+0000 7fc3e6ffd700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 0x7fc3d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:24.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.144+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fc3ec088ab0 con 0x7fc3f814e860 2023-08-27T11:25:24.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.144+0000 7fc3f659c700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 0x7fc3d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:24.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.145+0000 7fc3f659c700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 0x7fc3d806c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80090b0 tx=0x7fc3e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:24.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.148+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc3ec0543f0 con 0x7fc3f814e860 2023-08-27T11:25:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.361+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc3f80c4850 con 0x7fc3f814e860 2023-08-27T11:25:24.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.898+0000 7fc3e6ffd700 1 -- 172.21.15.43:0/3490691498 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc3ec057a10 con 0x7fc3f814e860 2023-08-27T11:25:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.902+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 msgr2=0x7fc3d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.902+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 0x7fc3d806c5a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80090b0 tx=0x7fc3e8008030 comp rx=0 tx=0).stop 2023-08-27T11:25:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.902+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 msgr2=0x7fc3f80a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.902+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00ed70 tx=0x7fc3ec00d630 comp rx=0 tx=0).stop 2023-08-27T11:25:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 shutdown_connections 2023-08-27T11:25:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc3d806a0e0 0x7fc3d806c5a0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80090b0 tx=0x7fc3e8008030 comp rx=0 tx=0).stop 2023-08-27T11:25:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3f8151e10 0x7fc3f80a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3f80c2120 0x7fc3f81eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 --2- 172.21.15.43:0/3490691498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3f814e860 0x7fc3f80a5500 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.903+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 >> 172.21.15.43:0/3490691498 conn(0x7fc3f806a310 msgr2=0x7fc3f80c0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:24.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.904+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 shutdown_connections 2023-08-27T11:25:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:24.904+0000 7fc3fcdff700 1 -- 172.21.15.43:0/3490691498 wait complete. 2023-08-27T11:25:24.920 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:25:24.937 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:25:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.142+0000 7f74147ff700 1 Processor -- start 2023-08-27T11:25:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.142+0000 7f74147ff700 1 -- start start 2023-08-27T11:25:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f74147ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c0c7c00 0x7f740c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f74147ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f740c06a8e0 0x7f740c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f74147ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740c154660 con 0x7f740c151d20 2023-08-27T11:25:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f74147ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740c0c5750 con 0x7f740c06a8e0 2023-08-27T11:25:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f74147ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c154940 con 0x7f740c0c7c00 2023-08-27T11:25:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f7412d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f740c06a8e0 0x7f740c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f7412d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f740c06a8e0 0x7f740c06ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46204/0 (socket says 172.21.15.43:46204) 2023-08-27T11:25:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.143+0000 7f7412d9c700 1 -- 172.21.15.43:0/2094647271 learned_addr learned my addr 172.21.15.43:0/2094647271 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7411d9a700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c0c7c00 0x7f740c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7412d9c700 1 -- 172.21.15.43:0/2094647271 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c0c7c00 msgr2=0x7f740c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7412d9c700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c0c7c00 0x7f740c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7412d9c700 1 -- 172.21.15.43:0/2094647271 >> v1:172.21.15.57:6789/0 conn(0x7f740c151d20 legacy=0x7f740c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7412d9c700 1 -- 172.21.15.43:0/2094647271 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c154c20 con 0x7f740c06a8e0 2023-08-27T11:25:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7412d9c700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c06a8e0 0x7f740c06ad50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7404009e50 tx=0x7f740400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c4e01aab99bfd8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7411599700 1 -- 172.21.15.43:0/2094647271 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400e070 con 0x7f740c06a8e0 2023-08-27T11:25:25.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7411599700 1 -- 172.21.15.43:0/2094647271 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400b9c0 con 0x7f740c06a8e0 2023-08-27T11:25:25.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.144+0000 7f7411599700 1 -- 172.21.15.43:0/2094647271 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400bd70 con 0x7f740c06a8e0 2023-08-27T11:25:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 -- 172.21.15.43:0/2094647271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c06a8e0 msgr2=0x7f740c06ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c06a8e0 0x7f740c06ad50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7404009e50 tx=0x7f740400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 -- 172.21.15.43:0/2094647271 shutdown_connections 2023-08-27T11:25:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c06a8e0 0x7f740c06ad50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 --2- 172.21.15.43:0/2094647271 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c0c7c00 0x7f740c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 -- 172.21.15.43:0/2094647271 >> 172.21.15.43:0/2094647271 conn(0x7f740c0c9d00 msgr2=0x7f740c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 -- 172.21.15.43:0/2094647271 shutdown_connections 2023-08-27T11:25:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.145+0000 7f74147ff700 1 -- 172.21.15.43:0/2094647271 wait complete. 2023-08-27T11:25:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.147+0000 7f74147ff700 1 Processor -- start 2023-08-27T11:25:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.147+0000 7f74147ff700 1 -- start start 2023-08-27T11:25:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c06a8e0 0x7f740c0bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c151d20 0x7f740c0c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0c3d70 con 0x7f740c0c7c00 2023-08-27T11:25:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740c1ea3c0 con 0x7f740c06a8e0 2023-08-27T11:25:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f74147ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740c0c0e70 con 0x7f740c151d20 2023-08-27T11:25:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f7411d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f7411d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46214/0 (socket says 172.21.15.43:46214) 2023-08-27T11:25:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f7411d9a700 1 -- 172.21.15.43:0/3990185442 learned_addr learned my addr 172.21.15.43:0/3990185442 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f7412d9c700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c151d20 0x7f740c0c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.148+0000 7f741259b700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c06a8e0 0x7f740c0bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 -- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c151d20 msgr2=0x7f740c0c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c151d20 0x7f740c0c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 -- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c06a8e0 msgr2=0x7f740c0bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c06a8e0 0x7f740c0bf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 -- 172.21.15.43:0/3990185442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009b30 con 0x7f740c0c7c00 2023-08-27T11:25:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7411d9a700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e810 tx=0x7f73fc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00c070 con 0x7f740c0c7c00 2023-08-27T11:25:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc013610 con 0x7f740c0c7c00 2023-08-27T11:25:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740c1ea930 con 0x7f740c0c7c00 2023-08-27T11:25:25.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0139c0 con 0x7f740c0c7c00 2023-08-27T11:25:25.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.149+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740c1ea650 con 0x7f740c0c7c00 2023-08-27T11:25:25.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.150+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c04ee70 con 0x7f740c0c7c00 2023-08-27T11:25:25.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.151+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73fc013b20 con 0x7f740c0c7c00 2023-08-27T11:25:25.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.152+0000 7f7402ffd700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 0x7f73f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:25.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.152+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f73fc088310 con 0x7f740c0c7c00 2023-08-27T11:25:25.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.152+0000 7f741259b700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 0x7f73f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:25.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.153+0000 7f741259b700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 0x7f73f006c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7408007fd0 tx=0x7f7408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:25.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.157+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73fc0539d0 con 0x7f740c0c7c00 2023-08-27T11:25:25.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.419+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f740c0c0fb0 con 0x7f740c0c7c00 2023-08-27T11:25:25.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.902+0000 7f7402ffd700 1 -- 172.21.15.43:0/3990185442 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f73fc056ff0 con 0x7f740c0c7c00 2023-08-27T11:25:25.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.922+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 msgr2=0x7f73f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.922+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 0x7f73f006c5a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7408007fd0 tx=0x7f7408009040 comp rx=0 tx=0).stop 2023-08-27T11:25:25.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.922+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 msgr2=0x7f740c0c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:25.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.922+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00e810 tx=0x7f73fc00eb20 comp rx=0 tx=0).stop 2023-08-27T11:25:25.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 shutdown_connections 2023-08-27T11:25:25.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73f006a0e0 0x7f73f006c5a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f740c151d20 0x7f740c0c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f740c06a8e0 0x7f740c0bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 --2- 172.21.15.43:0/3990185442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f740c0c7c00 0x7f740c0c2a80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:25.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 >> 172.21.15.43:0/3990185442 conn(0x7f740c0c9d00 msgr2=0x7f740c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:25.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 shutdown_connections 2023-08-27T11:25:25.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:25.923+0000 7f74147ff700 1 -- 172.21.15.43:0/3990185442 wait complete. 2023-08-27T11:25:25.936 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 11 and data pool 12 2023-08-27T11:25:25.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:26.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.161+0000 7f14539ff700 1 Processor -- start 2023-08-27T11:25:26.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.162+0000 7f14539ff700 1 -- start start 2023-08-27T11:25:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f14539ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f144c14e960 0x7f144c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f14539ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f14539ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144c154d00 con 0x7f144c0a79c0 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f14539ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144c0baf30 con 0x7f144c14e960 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f14539ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c154fe0 con 0x7f144c0c50d0 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f145179b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f144c14e960 0x7f144c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f145179b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f144c14e960 0x7f144c0a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46216/0 (socket says 172.21.15.43:46216) 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f145179b700 1 -- 172.21.15.43:0/4242162525 learned_addr learned my addr 172.21.15.43:0/4242162525 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.163+0000 7f1451f9c700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f145179b700 1 -- 172.21.15.43:0/4242162525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 msgr2=0x7f144c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f145179b700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f145179b700 1 -- 172.21.15.43:0/4242162525 >> v1:172.21.15.57:6789/0 conn(0x7f144c0a79c0 legacy=0x7f144c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f145179b700 1 -- 172.21.15.43:0/4242162525 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c1552c0 con 0x7f144c14e960 2023-08-27T11:25:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f145179b700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c14e960 0x7f144c0a7480 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14480098f0 tx=0x7f1448009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2703de4644c5f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f1443fff700 1 -- 172.21.15.43:0/4242162525 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800b8a0 con 0x7f144c14e960 2023-08-27T11:25:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f1443fff700 1 -- 172.21.15.43:0/4242162525 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800ba00 con 0x7f144c14e960 2023-08-27T11:25:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.164+0000 7f1443fff700 1 -- 172.21.15.43:0/4242162525 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800bd90 con 0x7f144c14e960 2023-08-27T11:25:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 -- 172.21.15.43:0/4242162525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c14e960 msgr2=0x7f144c0a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c14e960 0x7f144c0a7480 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f14480098f0 tx=0x7f1448009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 -- 172.21.15.43:0/4242162525 shutdown_connections 2023-08-27T11:25:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 --2- 172.21.15.43:0/4242162525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c14e960 0x7f144c0a7480 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 -- 172.21.15.43:0/4242162525 >> 172.21.15.43:0/4242162525 conn(0x7f144c06aa50 msgr2=0x7f144c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 -- 172.21.15.43:0/4242162525 shutdown_connections 2023-08-27T11:25:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.165+0000 7f14539ff700 1 -- 172.21.15.43:0/4242162525 wait complete. 2023-08-27T11:25:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.167+0000 7f14539ff700 1 Processor -- start 2023-08-27T11:25:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.167+0000 7f14539ff700 1 -- start start 2023-08-27T11:25:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f144c14e960 0x7f144c1ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c06ff50 con 0x7f144c0a79c0 2023-08-27T11:25:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c1ee170 con 0x7f144c14e960 2023-08-27T11:25:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f14539ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c14cc50 con 0x7f144c0c50d0 2023-08-27T11:25:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46226/0 (socket says 172.21.15.43:46226) 2023-08-27T11:25:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 -- 172.21.15.43:0/3042201669 learned_addr learned my addr 172.21.15.43:0/3042201669 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f1451f9c700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f144c14e960 0x7f144c1ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f1450f9a700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 -- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 msgr2=0x7f144c0aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 -- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f144c14e960 msgr2=0x7f144c1ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f144c14e960 0x7f144c1ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.168+0000 7f145179b700 1 -- 172.21.15.43:0/3042201669 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009550 con 0x7f144c0a79c0 2023-08-27T11:25:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f145179b700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1448014040 tx=0x7f1448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448004300 con 0x7f144c0a79c0 2023-08-27T11:25:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144801e070 con 0x7f144c0a79c0 2023-08-27T11:25:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144c1ede00 con 0x7f144c0a79c0 2023-08-27T11:25:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480036a0 con 0x7f144c0a79c0 2023-08-27T11:25:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.169+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144c06f580 con 0x7f144c0a79c0 2023-08-27T11:25:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.170+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144c0bb390 con 0x7f144c0a79c0 2023-08-27T11:25:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.171+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1448020030 con 0x7f144c0a79c0 2023-08-27T11:25:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.172+0000 7f1441ffb700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 0x7f143006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.172+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14480892a0 con 0x7f144c0a79c0 2023-08-27T11:25:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.173+0000 7f1450f9a700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 0x7f143006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.173+0000 7f1450f9a700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 0x7f143006c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f144c0bc530 tx=0x7f143c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.177+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1448054980 con 0x7f144c0a79c0 2023-08-27T11:25:26.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.388+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144c06f770 con 0x7f144c0a79c0 2023-08-27T11:25:26.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.390+0000 7f1441ffb700 1 -- 172.21.15.43:0/3042201669 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18249 (secure 0 0 0) 0x7f1448057fa0 con 0x7f144c0a79c0 2023-08-27T11:25:26.391 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:26.392 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":67,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:25.420373+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:26.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 msgr2=0x7f143006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 0x7f143006c5a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f144c0bc530 tx=0x7f143c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:26.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 msgr2=0x7f144c0a9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1448014040 tx=0x7f1448004750 comp rx=0 tx=0).stop 2023-08-27T11:25:26.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 shutdown_connections 2023-08-27T11:25:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143006a0e0 0x7f143006c5a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f144c14e960 0x7f144c1ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f144c0a79c0 0x7f144c0a9030 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 --2- 172.21.15.43:0/3042201669 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f144c0c50d0 0x7f144c0aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 >> 172.21.15.43:0/3042201669 conn(0x7f144c06aa50 msgr2=0x7f144c154290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 shutdown_connections 2023-08-27T11:25:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.392+0000 7f14539ff700 1 -- 172.21.15.43:0/3042201669 wait complete. 2023-08-27T11:25:26.412 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.613+0000 7f54b2fff700 1 Processor -- start 2023-08-27T11:25:26.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.613+0000 7f54b2fff700 1 -- start start 2023-08-27T11:25:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b2fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f54ac0c4630 0x7f54ac0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b2fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f54ac06ad70 0x7f54ac06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b2fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac06c4e0 con 0x7f54ac151a90 2023-08-27T11:25:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b2fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac155370 con 0x7f54ac0c4630 2023-08-27T11:25:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b2fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0c82c0 con 0x7f54ac06ad70 2023-08-27T11:25:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54abfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f54ac0c4630 0x7f54ac0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54abfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f54ac0c4630 0x7f54ac0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46242/0 (socket says 172.21.15.43:46242) 2023-08-27T11:25:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54abfff700 1 -- 172.21.15.43:0/3450268609 learned_addr learned my addr 172.21.15.43:0/3450268609 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:26.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.614+0000 7f54b159c700 1 --2- 172.21.15.43:0/3450268609 >> v2:172.21.15.57:3300/0 conn(0x7f54ac06ad70 0x7f54ac06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54abfff700 1 -- 172.21.15.43:0/3450268609 >> v2:172.21.15.57:3300/0 conn(0x7f54ac06ad70 msgr2=0x7f54ac06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:26.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54abfff700 1 --2- 172.21.15.43:0/3450268609 >> v2:172.21.15.57:3300/0 conn(0x7f54ac06ad70 0x7f54ac06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54abfff700 1 -- 172.21.15.43:0/3450268609 >> v1:172.21.15.57:6789/0 conn(0x7f54ac151a90 legacy=0x7f54ac0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54abfff700 1 -- 172.21.15.43:0/3450268609 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac151e70 con 0x7f54ac0c4630 2023-08-27T11:25:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54abfff700 1 --2- 172.21.15.43:0/3450268609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac0c4630 0x7f54ac0c4a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0c4270 tx=0x7f5498009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518eb9439c11ba9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54ab7fe700 1 -- 172.21.15.43:0/3450268609 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498011830 con 0x7f54ac0c4630 2023-08-27T11:25:26.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54ab7fe700 1 -- 172.21.15.43:0/3450268609 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498011990 con 0x7f54ac0c4630 2023-08-27T11:25:26.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.615+0000 7f54ab7fe700 1 -- 172.21.15.43:0/3450268609 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498011d20 con 0x7f54ac0c4630 2023-08-27T11:25:26.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 -- 172.21.15.43:0/3450268609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac0c4630 msgr2=0x7f54ac0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 --2- 172.21.15.43:0/3450268609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac0c4630 0x7f54ac0c4a90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0c4270 tx=0x7f5498009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 -- 172.21.15.43:0/3450268609 shutdown_connections 2023-08-27T11:25:26.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 --2- 172.21.15.43:0/3450268609 >> v2:172.21.15.57:3300/0 conn(0x7f54ac06ad70 0x7f54ac06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 --2- 172.21.15.43:0/3450268609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac0c4630 0x7f54ac0c4a90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 -- 172.21.15.43:0/3450268609 >> 172.21.15.43:0/3450268609 conn(0x7f54ac0ab820 msgr2=0x7f54ac0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:26.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 -- 172.21.15.43:0/3450268609 shutdown_connections 2023-08-27T11:25:26.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.616+0000 7f54b2fff700 1 -- 172.21.15.43:0/3450268609 wait complete. 2023-08-27T11:25:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.618+0000 7f54b2fff700 1 Processor -- start 2023-08-27T11:25:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.618+0000 7f54b2fff700 1 -- start start 2023-08-27T11:25:26.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 0x7f54ac0c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac151a90 0x7f54ac14e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac14cb40 con 0x7f54ac151a90 2023-08-27T11:25:26.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac146bf0 con 0x7f54ac06ad70 2023-08-27T11:25:26.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b2fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac14c830 con 0x7f54ac0c4630 2023-08-27T11:25:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b0d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 0x7f54ac0c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b159c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac151a90 0x7f54ac14e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:49022/0 (socket says 172.21.15.43:49022) 2023-08-27T11:25:26.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 -- 172.21.15.43:0/1706347638 learned_addr learned my addr 172.21.15.43:0/1706347638 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54b0d9b700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 0x7f54ac0c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60164/0 (socket says 172.21.15.43:60164) 2023-08-27T11:25:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 -- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 msgr2=0x7f54ac0c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 0x7f54ac0c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 -- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac151a90 msgr2=0x7f54ac14e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac151a90 0x7f54ac14e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.619+0000 7f54abfff700 1 -- 172.21.15.43:0/1706347638 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498009550 con 0x7f54ac0c4630 2023-08-27T11:25:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54abfff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5498009c10 tx=0x7f5498004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498004380 con 0x7f54ac0c4630 2023-08-27T11:25:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549801f070 con 0x7f54ac0c4630 2023-08-27T11:25:26.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0c3390 con 0x7f54ac0c4630 2023-08-27T11:25:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54980036a0 con 0x7f54ac0c4630 2023-08-27T11:25:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.620+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac146e70 con 0x7f54ac0c4630 2023-08-27T11:25:26.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.621+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac04ee70 con 0x7f54ac0c4630 2023-08-27T11:25:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.622+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5498021030 con 0x7f54ac0c4630 2023-08-27T11:25:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.623+0000 7f54a97fa700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 0x7f549006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.624+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5498089930 con 0x7f54ac0c4630 2023-08-27T11:25:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.624+0000 7f54b0d9b700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 0x7f549006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:26.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.624+0000 7f54b0d9b700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 0x7f549006c5a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54ac14f900 tx=0x7f54a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:26.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.629+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5498054f90 con 0x7f54ac0c4630 2023-08-27T11:25:26.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.841+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54ac14c970 con 0x7f54ac0c4630 2023-08-27T11:25:26.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.843+0000 7f54a97fa700 1 -- 172.21.15.43:0/1706347638 <== mon.2 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18249 (secure 0 0 0) 0x7f54980585b0 con 0x7f54ac0c4630 2023-08-27T11:25:26.844 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:26.845 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":67,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:25.420373+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 msgr2=0x7f549006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 0x7f549006c5a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f54ac14f900 tx=0x7f54a0009040 comp rx=0 tx=0).stop 2023-08-27T11:25:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 msgr2=0x7f54ac14cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:26.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5498009c10 tx=0x7f5498004750 comp rx=0 tx=0).stop 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 shutdown_connections 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f549006a0e0 0x7f549006c5a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f54ac151a90 0x7f54ac14e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f54ac06ad70 0x7f54ac0c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 --2- 172.21.15.43:0/1706347638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54ac0c4630 0x7f54ac14cfd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:26.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 >> 172.21.15.43:0/1706347638 conn(0x7f54ac0ab820 msgr2=0x7f54ac14ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 shutdown_connections 2023-08-27T11:25:26.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:26.845+0000 7f54b2fff700 1 -- 172.21.15.43:0/1706347638 wait complete. 2023-08-27T11:25:26.865 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:25:27.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.070+0000 7f9b67dff700 1 Processor -- start 2023-08-27T11:25:27.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.071+0000 7f9b67dff700 1 -- start start 2023-08-27T11:25:27.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b67dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b600c5230 0x7f9b6006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b67dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b67dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b601561f0 con 0x7f9b6006c5e0 2023-08-27T11:25:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b67dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b60152290 con 0x7f9b600c5230 2023-08-27T11:25:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b67dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006d7a0 con 0x7f9b60155880 2023-08-27T11:25:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b65b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b600c5230 0x7f9b6006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b65b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b600c5230 0x7f9b6006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46268/0 (socket says 172.21.15.43:46268) 2023-08-27T11:25:27.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b65b9b700 1 -- 172.21.15.43:0/2295803190 learned_addr learned my addr 172.21.15.43:0/2295803190 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:27.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b6639c700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.072+0000 7f9b65b9b700 1 -- 172.21.15.43:0/2295803190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 msgr2=0x7f9b60155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:27.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b65b9b700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b65b9b700 1 -- 172.21.15.43:0/2295803190 >> v1:172.21.15.57:6789/0 conn(0x7f9b6006c5e0 legacy=0x7f9b600aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:27.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b65b9b700 1 -- 172.21.15.43:0/2295803190 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b60152550 con 0x7f9b600c5230 2023-08-27T11:25:27.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b6639c700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:27.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b65b9b700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b6006d1c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0098f0 tx=0x7f9b5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5c709c5e5b11bf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:27.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b64b99700 1 -- 172.21.15.43:0/2295803190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c004230 con 0x7f9b600c5230 2023-08-27T11:25:27.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b64b99700 1 -- 172.21.15.43:0/2295803190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c004390 con 0x7f9b600c5230 2023-08-27T11:25:27.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.073+0000 7f9b64b99700 1 -- 172.21.15.43:0/2295803190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c0036a0 con 0x7f9b600c5230 2023-08-27T11:25:27.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 -- 172.21.15.43:0/2295803190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 msgr2=0x7f9b6006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:27.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b6006d1c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0098f0 tx=0x7f9b5c009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:27.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 -- 172.21.15.43:0/2295803190 shutdown_connections 2023-08-27T11:25:27.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 --2- 172.21.15.43:0/2295803190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b6006d1c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 -- 172.21.15.43:0/2295803190 >> 172.21.15.43:0/2295803190 conn(0x7f9b600c5b10 msgr2=0x7f9b600c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:27.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 -- 172.21.15.43:0/2295803190 shutdown_connections 2023-08-27T11:25:27.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.074+0000 7f9b67dff700 1 -- 172.21.15.43:0/2295803190 wait complete. 2023-08-27T11:25:27.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.076+0000 7f9b67dff700 1 Processor -- start 2023-08-27T11:25:27.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.076+0000 7f9b67dff700 1 -- start start 2023-08-27T11:25:27.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b6006c5e0 0x7f9b60144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b60147900 con 0x7f9b600c5230 2023-08-27T11:25:27.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600c4dc0 con 0x7f9b6006c5e0 2023-08-27T11:25:27.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b67dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b601452c0 con 0x7f9b60155880 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46276/0 (socket says 172.21.15.43:46276) 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 -- 172.21.15.43:0/3789614017 learned_addr learned my addr 172.21.15.43:0/3789614017 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b65b9b700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b6006c5e0 0x7f9b60144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6639c700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 -- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 msgr2=0x7f9b60145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:27.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 -- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b6006c5e0 msgr2=0x7f9b60144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:27.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b6006c5e0 0x7f9b60144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.077+0000 7f9b6539a700 1 -- 172.21.15.43:0/3789614017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c009550 con 0x7f9b600c5230 2023-08-27T11:25:27.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b6539a700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c500 tx=0x7f9b5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50011790 con 0x7f9b600c5230 2023-08-27T11:25:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b500118f0 con 0x7f9b600c5230 2023-08-27T11:25:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b60151bd0 con 0x7f9b600c5230 2023-08-27T11:25:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50011ca0 con 0x7f9b600c5230 2023-08-27T11:25:27.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.078+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b601eb2a0 con 0x7f9b600c5230 2023-08-27T11:25:27.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.079+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b601eb100 con 0x7f9b600c5230 2023-08-27T11:25:27.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.080+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b5001c460 con 0x7f9b600c5230 2023-08-27T11:25:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.081+0000 7f9b567fc700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 0x7f9b4406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.081+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b500881e0 con 0x7f9b600c5230 2023-08-27T11:25:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.081+0000 7f9b65b9b700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 0x7f9b4406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.082+0000 7f9b65b9b700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 0x7f9b4406c5a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009130 tx=0x7f9b5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:27.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.085+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b601eb100 con 0x7f9b600c5230 2023-08-27T11:25:27.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.342+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9b60145bb0 con 0x7f9b600c5230 2023-08-27T11:25:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.924+0000 7f9b567fc700 1 -- 172.21.15.43:0/3789614017 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9b60145bb0 con 0x7f9b600c5230 2023-08-27T11:25:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.927+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 msgr2=0x7f9b4406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:27.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.927+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 0x7f9b4406c5a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c009130 tx=0x7f9b5c008030 comp rx=0 tx=0).stop 2023-08-27T11:25:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.927+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 msgr2=0x7f9b60154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.927+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9b5000c500 tx=0x7f9b5000c810 comp rx=0 tx=0).stop 2023-08-27T11:25:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 shutdown_connections 2023-08-27T11:25:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b4406a0e0 0x7f9b4406c5a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b60155880 0x7f9b60145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b6006c5e0 0x7f9b60144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 --2- 172.21.15.43:0/3789614017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b600c5230 0x7f9b60154be0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:27.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 >> 172.21.15.43:0/3789614017 conn(0x7f9b600c5b10 msgr2=0x7f9b600c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:27.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 shutdown_connections 2023-08-27T11:25:27.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:27.928+0000 7f9b67dff700 1 -- 172.21.15.43:0/3789614017 wait complete. 2023-08-27T11:25:27.950 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:25:27.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:25:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.157+0000 7fdc113ff700 1 Processor -- start 2023-08-27T11:25:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.158+0000 7fdc113ff700 1 -- start start 2023-08-27T11:25:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc113ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c151d20 0x7fdc0c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc113ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdc0c06a8e0 0x7fdc0c06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc113ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0c154660 con 0x7fdc0c0c7c00 2023-08-27T11:25:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc113ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c5750 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc113ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c154940 con 0x7fdc0c151d20 2023-08-27T11:25:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc03fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdc0c0c7c00 0x7fdc0c0ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36042/0 (socket says 172.21.15.43:36042) 2023-08-27T11:25:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc03fff700 1 -- 172.21.15.43:0/2880751391 learned_addr learned my addr 172.21.15.43:0/2880751391 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/2880751391 >> v2:172.21.15.43:3300/0 conn(0x7fdc0c06a8e0 0x7fdc0c06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.159+0000 7fdc0affd700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c151d20 0x7fdc0c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0a7fc700 1 -- 172.21.15.43:0/2880751391 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511220793 0 0) 0x7fdc0c154660 con 0x7fdc0c0c7c00 2023-08-27T11:25:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0a7fc700 1 -- 172.21.15.43:0/2880751391 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf80035b0 con 0x7fdc0c0c7c00 2023-08-27T11:25:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/2880751391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c151d20 msgr2=0x7fdc0c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c151d20 0x7fdc0c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/2880751391 >> v1:172.21.15.43:6789/0 conn(0x7fdc0c0c7c00 legacy=0x7fdc0c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/2880751391 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c154c20 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c06a8e0 0x7fdc0c06ad70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c1cf8223394dbf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0a7fc700 1 -- 172.21.15.43:0/2880751391 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400e070 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0a7fc700 1 -- 172.21.15.43:0/2880751391 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400bb20 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.160+0000 7fdc0a7fc700 1 -- 172.21.15.43:0/2880751391 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04012430 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 -- 172.21.15.43:0/2880751391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c06a8e0 msgr2=0x7fdc0c06ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c06a8e0 0x7fdc0c06ad70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:28.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 -- 172.21.15.43:0/2880751391 shutdown_connections 2023-08-27T11:25:28.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c06a8e0 0x7fdc0c06ad70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 --2- 172.21.15.43:0/2880751391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c151d20 0x7fdc0c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 -- 172.21.15.43:0/2880751391 >> 172.21.15.43:0/2880751391 conn(0x7fdc0c0c9d00 msgr2=0x7fdc0c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:28.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 -- 172.21.15.43:0/2880751391 shutdown_connections 2023-08-27T11:25:28.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.161+0000 7fdc113ff700 1 -- 172.21.15.43:0/2880751391 wait complete. 2023-08-27T11:25:28.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.163+0000 7fdc113ff700 1 Processor -- start 2023-08-27T11:25:28.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.164+0000 7fdc113ff700 1 -- start start 2023-08-27T11:25:28.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c06a8e0 0x7fdc0c14d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 0x7fdc0c14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c1e9800 con 0x7fdc0c151d20 2023-08-27T11:25:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c14e110 con 0x7fdc0c0c7c00 2023-08-27T11:25:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc113ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0c0c3220 con 0x7fdc0c06a8e0 2023-08-27T11:25:28.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:46288/0 (socket says 172.21.15.43:46288) 2023-08-27T11:25:28.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/4017211735 learned_addr learned my addr 172.21.15.43:0/4017211735 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:28.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0affd700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c06a8e0 0x7fdc0c14d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc03fff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 0x7fdc0c14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c06a8e0 msgr2=0x7fdc0c14d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c06a8e0 0x7fdc0c14d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.165+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 msgr2=0x7fdc0c14c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 0x7fdc0c14c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc0b7fe700 1 -- 172.21.15.43:0/4017211735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009a70 con 0x7fdc0c151d20 2023-08-27T11:25:28.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc03fff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 0x7fdc0c14c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc0b7fe700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b370 tx=0x7fdc04004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040098f0 con 0x7fdc0c151d20 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04020070 con 0x7fdc0c151d20 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04004280 con 0x7fdc0c151d20 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0c0c3500 con 0x7fdc0c151d20 2023-08-27T11:25:28.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.166+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0c0c3ac0 con 0x7fdc0c151d20 2023-08-27T11:25:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.167+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0c1e9970 con 0x7fdc0c151d20 2023-08-27T11:25:28.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.168+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc040043e0 con 0x7fdc0c151d20 2023-08-27T11:25:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.169+0000 7fdc037fe700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 0x7fdbec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.170+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc04022070 con 0x7fdc0c151d20 2023-08-27T11:25:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.170+0000 7fdc0affd700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 0x7fdbec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:28.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.170+0000 7fdc0affd700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 0x7fdbec06c5a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009ad0 tx=0x7fdbfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:28.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.174+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc040bc990 con 0x7fdc0c151d20 2023-08-27T11:25:28.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.434+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc0c04ee70 con 0x7fdc0c151d20 2023-08-27T11:25:28.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.931+0000 7fdc037fe700 1 -- 172.21.15.43:0/4017211735 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc0402c0c0 con 0x7fdc0c151d20 2023-08-27T11:25:28.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 msgr2=0x7fdbec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 0x7fdbec06c5a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009ad0 tx=0x7fdbfc008040 comp rx=0 tx=0).stop 2023-08-27T11:25:28.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 msgr2=0x7fdc0c1ec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:28.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b370 tx=0x7fdc04004b20 comp rx=0 tx=0).stop 2023-08-27T11:25:28.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 shutdown_connections 2023-08-27T11:25:28.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdbec06a0e0 0x7fdbec06c5a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdc0c151d20 0x7fdc0c1ec050 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc0c06a8e0 0x7fdc0c14d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 --2- 172.21.15.43:0/4017211735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc0c0c7c00 0x7fdc0c14c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:28.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.934+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 >> 172.21.15.43:0/4017211735 conn(0x7fdc0c0c9d00 msgr2=0x7fdc0c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:28.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.935+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 shutdown_connections 2023-08-27T11:25:28.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:28.935+0000 7fdc113ff700 1 -- 172.21.15.43:0/4017211735 wait complete. 2023-08-27T11:25:28.956 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:25:28.956 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:29.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.158+0000 7f9e62bff700 1 Processor -- start 2023-08-27T11:25:29.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.158+0000 7f9e62bff700 1 -- start start 2023-08-27T11:25:29.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e62bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e62bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 0x7f9e5c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e62bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5c06c4e0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e62bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5c155370 con 0x7f9e5c0c4630 2023-08-27T11:25:29.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e62bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c151e70 con 0x7f9e5c151a90 2023-08-27T11:25:29.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e6119c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9e5c06ad70 0x7f9e5c06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41478/0 (socket says 172.21.15.43:41478) 2023-08-27T11:25:29.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e6119c700 1 -- 172.21.15.43:0/354271761 learned_addr learned my addr 172.21.15.43:0/354271761 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:29.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e5bfff700 1 --2- 172.21.15.43:0/354271761 >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 0x7f9e5c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.159+0000 7f9e6099b700 1 --2- 172.21.15.43:0/354271761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e5b7fe700 1 -- 172.21.15.43:0/354271761 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630575628 0 0) 0x7f9e5c06c4e0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e5b7fe700 1 -- 172.21.15.43:0/354271761 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e4c0035b0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e6099b700 1 -- 172.21.15.43:0/354271761 >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 msgr2=0x7f9e5c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:29.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e6099b700 1 --2- 172.21.15.43:0/354271761 >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 0x7f9e5c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e6099b700 1 -- 172.21.15.43:0/354271761 >> v1:172.21.15.43:6789/0 conn(0x7f9e5c06ad70 legacy=0x7f9e5c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e6099b700 1 -- 172.21.15.43:0/354271761 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5c154480 con 0x7f9e5c151a90 2023-08-27T11:25:29.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e5bfff700 1 --2- 172.21.15.43:0/354271761 >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 0x7f9e5c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:29.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e6099b700 1 --2- 172.21.15.43:0/354271761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c0c7bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009840 tx=0x7f9e50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2c6e87856785570 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.160+0000 7f9e5b7fe700 1 -- 172.21.15.43:0/354271761 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50011830 con 0x7f9e5c151a90 2023-08-27T11:25:29.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e5b7fe700 1 -- 172.21.15.43:0/354271761 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e50011990 con 0x7f9e5c151a90 2023-08-27T11:25:29.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e5b7fe700 1 -- 172.21.15.43:0/354271761 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50011d20 con 0x7f9e5c151a90 2023-08-27T11:25:29.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 -- 172.21.15.43:0/354271761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 msgr2=0x7f9e5c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 --2- 172.21.15.43:0/354271761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c0c7bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009840 tx=0x7f9e50009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:29.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 -- 172.21.15.43:0/354271761 shutdown_connections 2023-08-27T11:25:29.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 --2- 172.21.15.43:0/354271761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c0c7bb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 --2- 172.21.15.43:0/354271761 >> v2:172.21.15.57:3300/0 conn(0x7f9e5c0c4630 0x7f9e5c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 -- 172.21.15.43:0/354271761 >> 172.21.15.43:0/354271761 conn(0x7f9e5c0ab820 msgr2=0x7f9e5c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:29.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 -- 172.21.15.43:0/354271761 shutdown_connections 2023-08-27T11:25:29.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.161+0000 7f9e62bff700 1 -- 172.21.15.43:0/354271761 wait complete. 2023-08-27T11:25:29.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.164+0000 7f9e62bff700 1 Processor -- start 2023-08-27T11:25:29.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.164+0000 7f9e62bff700 1 -- start start 2023-08-27T11:25:29.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e5c0c4630 0x7f9e5c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1560f0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1ea050 con 0x7f9e5c0c4630 2023-08-27T11:25:29.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e62bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5c1ea330 con 0x7f9e5c151a90 2023-08-27T11:25:29.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e6099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e6099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38442/0 (socket says 172.21.15.43:38442) 2023-08-27T11:25:29.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.165+0000 7f9e6099b700 1 -- 172.21.15.43:0/2919292474 learned_addr learned my addr 172.21.15.43:0/2919292474 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:29.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e5bfff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e5c0c4630 0x7f9e5c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6119c700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 -- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 msgr2=0x7f9e5c14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c14a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 -- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e5c0c4630 msgr2=0x7f9e5c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e5c0c4630 0x7f9e5c149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 -- 172.21.15.43:0/2919292474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480094a0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e6099b700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9e50014040 tx=0x7f9e50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500038a0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5001f070 con 0x7f9e5c06ad70 2023-08-27T11:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e500094a0 con 0x7f9e5c06ad70 2023-08-27T11:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.166+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50003c00 con 0x7f9e5c06ad70 2023-08-27T11:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.167+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5c158470 con 0x7f9e5c06ad70 2023-08-27T11:25:29.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.168+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5c04ee70 con 0x7f9e5c06ad70 2023-08-27T11:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.168+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e5001a430 con 0x7f9e5c06ad70 2023-08-27T11:25:29.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.169+0000 7f9e597fa700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 0x7f9e4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.170+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e50021070 con 0x7f9e5c06ad70 2023-08-27T11:25:29.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.170+0000 7f9e5bfff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 0x7f9e4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.170+0000 7f9e5bfff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 0x7f9e4006c5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c1578e0 tx=0x7f9e48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.174+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9e50055480 con 0x7f9e5c06ad70 2023-08-27T11:25:29.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.428+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e5c06c130 con 0x7f9e5c06ad70 2023-08-27T11:25:29.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.429+0000 7f9e597fa700 1 -- 172.21.15.43:0/2919292474 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4871 (secure 0 0 0) 0x7f9e50015020 con 0x7f9e5c06ad70 2023-08-27T11:25:29.430 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:29.431 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:28.924409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/497941784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":497941784},{"type":"v1","addr":"172.21.15.43:6837","nonce":497941784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 msgr2=0x7f9e4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 0x7f9e4006c5a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c1578e0 tx=0x7f9e48008040 comp rx=0 tx=0).stop 2023-08-27T11:25:29.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 msgr2=0x7f9e5c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9e50014040 tx=0x7f9e50004750 comp rx=0 tx=0).stop 2023-08-27T11:25:29.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 shutdown_connections 2023-08-27T11:25:29.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4006a0e0 0x7f9e4006c5a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e5c151a90 0x7f9e5c14a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e5c06ad70 0x7f9e5c157f30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 --2- 172.21.15.43:0/2919292474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e5c0c4630 0x7f9e5c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.431+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 >> 172.21.15.43:0/2919292474 conn(0x7f9e5c0ab820 msgr2=0x7f9e5c14be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:29.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.432+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 shutdown_connections 2023-08-27T11:25:29.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.432+0000 7f9e62bff700 1 -- 172.21.15.43:0/2919292474 wait complete. 2023-08-27T11:25:29.435 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2023-08-27T11:25:29.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:29.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.650+0000 7f066c7ff700 1 Processor -- start 2023-08-27T11:25:29.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.650+0000 7f066c7ff700 1 -- start start 2023-08-27T11:25:29.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066c7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06640c51a0 0x7f066406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066c7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 0x7f0664155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066c7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066406d700 con 0x7f066406ca60 2023-08-27T11:25:29.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066c7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06641530b0 con 0x7f06640c51a0 2023-08-27T11:25:29.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066c7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066414c860 con 0x7f0664155910 2023-08-27T11:25:29.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.651+0000 7f066a59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06640c51a0 0x7f066406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06640c51a0 0x7f066406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38450/0 (socket says 172.21.15.43:38450) 2023-08-27T11:25:29.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 -- 172.21.15.43:0/3895382542 learned_addr learned my addr 172.21.15.43:0/3895382542 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:29.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066ad9c700 1 --2- 172.21.15.43:0/3895382542 >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 0x7f0664155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 -- 172.21.15.43:0/3895382542 >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 msgr2=0x7f0664155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:29.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 --2- 172.21.15.43:0/3895382542 >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 0x7f0664155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 -- 172.21.15.43:0/3895382542 >> v1:172.21.15.57:6789/0 conn(0x7f066406ca60 legacy=0x7f06640aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 -- 172.21.15.43:0/3895382542 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664152430 con 0x7f06640c51a0 2023-08-27T11:25:29.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066ad9c700 1 --2- 172.21.15.43:0/3895382542 >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 0x7f0664155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:29.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.652+0000 7f066a59b700 1 --2- 172.21.15.43:0/3895382542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06640c51a0 0x7f066406d1c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0664153440 tx=0x7f0660009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773ad82713a032d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f0669599700 1 -- 172.21.15.43:0/3895382542 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000b860 con 0x7f06640c51a0 2023-08-27T11:25:29.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f0669599700 1 -- 172.21.15.43:0/3895382542 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066000b9c0 con 0x7f06640c51a0 2023-08-27T11:25:29.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f0669599700 1 -- 172.21.15.43:0/3895382542 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000bd50 con 0x7f06640c51a0 2023-08-27T11:25:29.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 -- 172.21.15.43:0/3895382542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06640c51a0 msgr2=0x7f066406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3895382542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06640c51a0 0x7f066406d1c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0664153440 tx=0x7f0660009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:29.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 -- 172.21.15.43:0/3895382542 shutdown_connections 2023-08-27T11:25:29.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3895382542 >> v2:172.21.15.57:3300/0 conn(0x7f0664155910 0x7f0664155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3895382542 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06640c51a0 0x7f066406d1c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 -- 172.21.15.43:0/3895382542 >> 172.21.15.43:0/3895382542 conn(0x7f066406aa50 msgr2=0x7f06640c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:29.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 -- 172.21.15.43:0/3895382542 shutdown_connections 2023-08-27T11:25:29.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.653+0000 7f066c7ff700 1 -- 172.21.15.43:0/3895382542 wait complete. 2023-08-27T11:25:29.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.655+0000 7f066c7ff700 1 Processor -- start 2023-08-27T11:25:29.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.655+0000 7f066c7ff700 1 -- start start 2023-08-27T11:25:29.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066406ca60 0x7f06641ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06640c51a0 0x7f06640a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641edbc0 con 0x7f0664155910 2023-08-27T11:25:29.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06640a5590 con 0x7f06640c51a0 2023-08-27T11:25:29.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066c7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06640a5870 con 0x7f066406ca60 2023-08-27T11:25:29.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066ad9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066ad9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38456/0 (socket says 172.21.15.43:38456) 2023-08-27T11:25:29.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066ad9c700 1 -- 172.21.15.43:0/3026145933 learned_addr learned my addr 172.21.15.43:0/3026145933 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f066a59b700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066406ca60 0x7f06641ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.656+0000 7f0669d9a700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06640c51a0 0x7f06640a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 -- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066406ca60 msgr2=0x7f06641ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066406ca60 0x7f06641ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 -- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06640c51a0 msgr2=0x7f06640a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06640c51a0 0x7f06640a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 -- 172.21.15.43:0/3026145933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009550 con 0x7f0664155910 2023-08-27T11:25:29.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066ad9c700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f065c007df0 tx=0x7f065c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c00dd20 con 0x7f0664155910 2023-08-27T11:25:29.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c00f040 con 0x7f0664155910 2023-08-27T11:25:29.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c003c60 con 0x7f0664155910 2023-08-27T11:25:29.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.657+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06640a5b50 con 0x7f0664155910 2023-08-27T11:25:29.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.658+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06640a6110 con 0x7f0664155910 2023-08-27T11:25:29.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.659+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06640a62d0 con 0x7f0664155910 2023-08-27T11:25:29.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.660+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f065c004030 con 0x7f0664155910 2023-08-27T11:25:29.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.661+0000 7f065affd700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:29.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.661+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f065c0884c0 con 0x7f0664155910 2023-08-27T11:25:29.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.661+0000 7f066a59b700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:29.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.662+0000 7f066a59b700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0660000c00 tx=0x7f0660008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:29.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.665+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f065c053d00 con 0x7f0664155910 2023-08-27T11:25:29.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.874+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06640a6480 con 0x7f0664155910 2023-08-27T11:25:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.875+0000 7f065affd700 1 -- 172.21.15.43:0/3026145933 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18236 (secure 0 0 0) 0x7f065c057320 con 0x7f0664155910 2023-08-27T11:25:29.877 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:29.878 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":68,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:26.908940+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:29.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 msgr2=0x7f064806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 0x7f064806c5a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0660000c00 tx=0x7f0660008030 comp rx=0 tx=0).stop 2023-08-27T11:25:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 msgr2=0x7f06640a7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f065c007df0 tx=0x7f065c00d3b0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 shutdown_connections 2023-08-27T11:25:29.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f064806a0e0 0x7f064806c5a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0664155910 0x7f06640a7790 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066406ca60 0x7f06641ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 --2- 172.21.15.43:0/3026145933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06640c51a0 0x7f06640a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:29.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 >> 172.21.15.43:0/3026145933 conn(0x7f066406aa50 msgr2=0x7f0664155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:29.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 shutdown_connections 2023-08-27T11:25:29.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:29.878+0000 7f066c7ff700 1 -- 172.21.15.43:0/3026145933 wait complete. 2023-08-27T11:25:29.898 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:25:29.898 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:25:30.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.099+0000 7f31d0dff700 1 Processor -- start 2023-08-27T11:25:30.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.099+0000 7f31d0dff700 1 -- start start 2023-08-27T11:25:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31d0dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f31cc06a310 0x7f31cc06a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31d0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31cc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31d0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31cc0c4a50 con 0x7f31cc157fc0 2023-08-27T11:25:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31d0dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31cc0c23a0 con 0x7f31cc06a310 2023-08-27T11:25:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31d0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1548c0 con 0x7f31cc06e360 2023-08-27T11:25:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31cad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f31cc157fc0 0x7f31cc0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41488/0 (socket says 172.21.15.43:41488) 2023-08-27T11:25:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31cad9d700 1 -- 172.21.15.43:0/1135181198 learned_addr learned my addr 172.21.15.43:0/1135181198 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:30.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31c9d9b700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31cc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> v2:172.21.15.57:3300/0 conn(0x7f31cc06a310 0x7f31cc06a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195627261 0 0) 0x7f31cc0c4a50 con 0x7f31cc157fc0 2023-08-27T11:25:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.101+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b40035b0 con 0x7f31cc157fc0 2023-08-27T11:25:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901896550 0 0) 0x7f31b40035b0 con 0x7f31cc157fc0 2023-08-27T11:25:30.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 msgr2=0x7f31cc157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31cc157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 >> v2:172.21.15.57:3300/0 conn(0x7f31cc06a310 msgr2=0x7f31cc06a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 --2- 172.21.15.43:0/1135181198 >> v2:172.21.15.57:3300/0 conn(0x7f31cc06a310 0x7f31cc06a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0c4d30 con 0x7f31cc157fc0 2023-08-27T11:25:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f31c40019f0 con 0x7f31cc157fc0 2023-08-27T11:25:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 >> v1:172.21.15.43:6789/0 conn(0x7f31cc157fc0 legacy=0x7f31cc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31b4003a00 0x7f31b4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4004d90 0x7f31b4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b400ba10 con 0x7f31b4003a00 2023-08-27T11:25:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b400bb50 con 0x7f31b4004d90 2023-08-27T11:25:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b400bc90 con 0x7f31cc06e360 2023-08-27T11:25:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> v2:172.21.15.57:3300/0 conn(0x7f31cc06a310 0x7f31cc06a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31b4003a00 0x7f31b4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31cad9d700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4004d90 0x7f31b4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.102+0000 7f31c9d9b700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 -- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 msgr2=0x7f31b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc06e360 0x7f31b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 -- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4004d90 msgr2=0x7f31b4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:30.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4004d90 0x7f31b4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 -- 172.21.15.43:0/1135181198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b40035b0 con 0x7f31b4003a00 2023-08-27T11:25:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31ca59c700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31b4003a00 0x7f31b4003e20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009d10 tx=0x7f31b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965a63c3b730886d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc009e60 con 0x7f31b4003a00 2023-08-27T11:25:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc00e9a0 con 0x7f31b4003a00 2023-08-27T11:25:30.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.103+0000 7f31c959a700 1 -- 172.21.15.43:0/1135181198 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00ed10 con 0x7f31b4003a00 2023-08-27T11:25:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 -- 172.21.15.43:0/1135181198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31b4003a00 msgr2=0x7f31b4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 --2- 172.21.15.43:0/1135181198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31b4003a00 0x7f31b4003e20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009d10 tx=0x7f31b4005880 comp rx=0 tx=0).stop 2023-08-27T11:25:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31cad9d700 1 -- 172.21.15.43:0/1135181198 reap_dead start 2023-08-27T11:25:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 -- 172.21.15.43:0/1135181198 shutdown_connections 2023-08-27T11:25:30.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 -- 172.21.15.43:0/1135181198 >> 172.21.15.43:0/1135181198 conn(0x7f31cc0a85e0 msgr2=0x7f31cc0a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 -- 172.21.15.43:0/1135181198 shutdown_connections 2023-08-27T11:25:30.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.104+0000 7f31d0dff700 1 -- 172.21.15.43:0/1135181198 wait complete. 2023-08-27T11:25:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.106+0000 7f31d0dff700 1 Processor -- start 2023-08-27T11:25:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.107+0000 7f31d0dff700 1 -- start start 2023-08-27T11:25:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4003a00 0x7f31cc1e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc1563a0 0x7f31cc14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1ea240 con 0x7f31cc071a30 2023-08-27T11:25:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc156850 con 0x7f31b4003a00 2023-08-27T11:25:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31d0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc1556f0 con 0x7f31cc1563a0 2023-08-27T11:25:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31c9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31c9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38476/0 (socket says 172.21.15.43:38476) 2023-08-27T11:25:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31c9d9b700 1 -- 172.21.15.43:0/3286624895 learned_addr learned my addr 172.21.15.43:0/3286624895 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31ca59c700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4003a00 0x7f31cc1e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31cad9d700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc1563a0 0x7f31cc14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31c9d9b700 1 -- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc1563a0 msgr2=0x7f31cc14dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.108+0000 7f31c9d9b700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc1563a0 0x7f31cc14dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31c9d9b700 1 -- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4003a00 msgr2=0x7f31cc1e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31c9d9b700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4003a00 0x7f31cc1e9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31c9d9b700 1 -- 172.21.15.43:0/3286624895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc157c00 con 0x7f31cc071a30 2023-08-27T11:25:30.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31c9d9b700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f31c0011a20 tx=0x7f31c0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0004240 con 0x7f31cc071a30 2023-08-27T11:25:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c00043a0 con 0x7f31cc071a30 2023-08-27T11:25:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00036a0 con 0x7f31cc071a30 2023-08-27T11:25:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31cc156c00 con 0x7f31cc071a30 2023-08-27T11:25:30.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.109+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc1571c0 con 0x7f31cc071a30 2023-08-27T11:25:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.110+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31cc1573e0 con 0x7f31cc071a30 2023-08-27T11:25:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.111+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31c0003800 con 0x7f31cc071a30 2023-08-27T11:25:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.112+0000 7f31baffd700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 0x7f31ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.112+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31c0088a70 con 0x7f31cc071a30 2023-08-27T11:25:30.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.112+0000 7f31ca59c700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 0x7f31ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.113+0000 7f31ca59c700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 0x7f31ac06c5a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0090b0 tx=0x7f31bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.116+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31c0057be0 con 0x7f31cc071a30 2023-08-27T11:25:30.152 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:25:30.151+0000 7f0f777f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:25:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.321+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31cc0c52f0 con 0x7f31ac06a0e0 2023-08-27T11:25:30.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.332+0000 7f31baffd700 1 -- 172.21.15.43:0/3286624895 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306255 (secure 0 0 0) 0x7f31bc022040 con 0x7f31ac06a0e0 2023-08-27T11:25:30.337 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:30.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.336+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 msgr2=0x7f31ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.336+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 0x7f31ac06c5a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0090b0 tx=0x7f31bc008030 comp rx=0 tx=0).stop 2023-08-27T11:25:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.336+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 msgr2=0x7f31cc155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.336+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f31c0011a20 tx=0x7f31c0011de0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 shutdown_connections 2023-08-27T11:25:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f31ac06a0e0 0x7f31ac06c5a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f31cc1563a0 0x7f31cc14dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31b4003a00 0x7f31cc1e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 --2- 172.21.15.43:0/3286624895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f31cc071a30 0x7f31cc155e60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 >> 172.21.15.43:0/3286624895 conn(0x7f31cc0a85e0 msgr2=0x7f31cc0bbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:30.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 shutdown_connections 2023-08-27T11:25:30.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.337+0000 7f31d0dff700 1 -- 172.21.15.43:0/3286624895 wait complete. 2023-08-27T11:25:30.342 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:25:30.357 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-08-27T11:25:28.345989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223560,"kb_used_data":7392,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751160,"statfs":{"total":773094113280,"available":772865187840,"internally_reserved":0,"allocated":7569408,"data_stored":4098632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.457254"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908291+0000","last_change":"2023-08-27T11:25:24.908291+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908291+0000","last_undegraded":"2023-08-27T11:25:24.908291+0000","last_fullsized":"2023-08-27T11:25:24.908291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910924+0000","last_change":"2023-08-27T11:25:24.910924+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910924+0000","last_undegraded":"2023-08-27T11:25:24.910924+0000","last_fullsized":"2023-08-27T11:25:24.910924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911420+0000","last_change":"2023-08-27T11:25:24.911420+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911420+0000","last_undegraded":"2023-08-27T11:25:24.911420+0000","last_fullsized":"2023-08-27T11:25:24.911420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.915042+0000","last_change":"2023-08-27T11:25:24.915042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.915042+0000","last_undegraded":"2023-08-27T11:25:24.915042+0000","last_fullsized":"2023-08-27T11:25:24.915042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903993+0000","last_change":"2023-08-27T11:25:24.903993+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903993+0000","last_undegraded":"2023-08-27T11:25:24.903993+0000","last_fullsized":"2023-08-27T11:25:24.903993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903826+0000","last_change":"2023-08-27T11:25:24.903826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903826+0000","last_undegraded":"2023-08-27T11:25:24.903826+0000","last_fullsized":"2023-08-27T11:25:24.903826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908844+0000","last_change":"2023-08-27T11:25:24.908844+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908844+0000","last_undegraded":"2023-08-27T11:25:24.908844+0000","last_fullsized":"2023-08-27T11:25:24.908844+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903260+0000","last_change":"2023-08-27T11:25:24.903260+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903260+0000","last_undegraded":"2023-08-27T11:25:24.903260+0000","last_fullsized":"2023-08-27T11:25:24.903260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912894+0000","last_change":"2023-08-27T11:25:24.912894+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912894+0000","last_undegraded":"2023-08-27T11:25:24.912894+0000","last_fullsized":"2023-08-27T11:25:24.912894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912390+0000","last_change":"2023-08-27T11:25:24.912390+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912390+0000","last_undegraded":"2023-08-27T11:25:24.912390+0000","last_fullsized":"2023-08-27T11:25:24.912390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907613+0000","last_change":"2023-08-27T11:25:24.907613+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907613+0000","last_undegraded":"2023-08-27T11:25:24.907613+0000","last_fullsized":"2023-08-27T11:25:24.907613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.914370+0000","last_change":"2023-08-27T11:25:24.914370+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.914370+0000","last_undegraded":"2023-08-27T11:25:24.914370+0000","last_fullsized":"2023-08-27T11:25:24.914370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903560+0000","last_change":"2023-08-27T11:25:24.903560+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903560+0000","last_undegraded":"2023-08-27T11:25:24.903560+0000","last_fullsized":"2023-08-27T11:25:24.903560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903415+0000","last_change":"2023-08-27T11:25:24.903415+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903415+0000","last_undegraded":"2023-08-27T11:25:24.903415+0000","last_fullsized":"2023-08-27T11:25:24.903415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908170+0000","last_change":"2023-08-27T11:25:24.908170+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908170+0000","last_undegraded":"2023-08-27T11:25:24.908170+0000","last_fullsized":"2023-08-27T11:25:24.908170+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907020+0000","last_change":"2023-08-27T11:25:24.907020+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907020+0000","last_undegraded":"2023-08-27T11:25:24.907020+0000","last_fullsized":"2023-08-27T11:25:24.907020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903505+0000","last_change":"2023-08-27T11:25:24.903505+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903505+0000","last_undegraded":"2023-08-27T11:25:24.903505+0000","last_fullsized":"2023-08-27T11:25:24.903505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907278+0000","last_change":"2023-08-27T11:25:24.907278+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907278+0000","last_undegraded":"2023-08-27T11:25:24.907278+0000","last_fullsized":"2023-08-27T11:25:24.907278+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901779+0000","last_change":"2023-08-27T11:25:24.901779+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901779+0000","last_undegraded":"2023-08-27T11:25:24.901779+0000","last_fullsized":"2023-08-27T11:25:24.901779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.904458+0000","last_change":"2023-08-27T11:25:24.904458+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.904458+0000","last_undegraded":"2023-08-27T11:25:24.904458+0000","last_fullsized":"2023-08-27T11:25:24.904458+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911655+0000","last_change":"2023-08-27T11:25:24.911655+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911655+0000","last_undegraded":"2023-08-27T11:25:24.911655+0000","last_fullsized":"2023-08-27T11:25:24.911655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903036+0000","last_change":"2023-08-27T11:25:24.903036+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903036+0000","last_undegraded":"2023-08-27T11:25:24.903036+0000","last_fullsized":"2023-08-27T11:25:24.903036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912134+0000","last_change":"2023-08-27T11:25:24.912134+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912134+0000","last_undegraded":"2023-08-27T11:25:24.912134+0000","last_fullsized":"2023-08-27T11:25:24.912134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908074+0000","last_change":"2023-08-27T11:25:24.908074+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908074+0000","last_undegraded":"2023-08-27T11:25:24.908074+0000","last_fullsized":"2023-08-27T11:25:24.908074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910917+0000","last_change":"2023-08-27T11:25:24.910917+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910917+0000","last_undegraded":"2023-08-27T11:25:24.910917+0000","last_fullsized":"2023-08-27T11:25:24.910917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911838+0000","last_change":"2023-08-27T11:25:24.911838+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911838+0000","last_undegraded":"2023-08-27T11:25:24.911838+0000","last_fullsized":"2023-08-27T11:25:24.911838+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907876+0000","last_change":"2023-08-27T11:25:24.907876+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907876+0000","last_undegraded":"2023-08-27T11:25:24.907876+0000","last_fullsized":"2023-08-27T11:25:24.907876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900826+0000","last_change":"2023-08-27T11:25:24.900826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900826+0000","last_undegraded":"2023-08-27T11:25:24.900826+0000","last_fullsized":"2023-08-27T11:25:24.900826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908266+0000","last_change":"2023-08-27T11:25:24.908266+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908266+0000","last_undegraded":"2023-08-27T11:25:24.908266+0000","last_fullsized":"2023-08-27T11:25:24.908266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906424+0000","last_change":"2023-08-27T11:25:24.906424+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906424+0000","last_undegraded":"2023-08-27T11:25:24.906424+0000","last_fullsized":"2023-08-27T11:25:24.906424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906832+0000","last_change":"2023-08-27T11:25:24.906832+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906832+0000","last_undegraded":"2023-08-27T11:25:24.906832+0000","last_fullsized":"2023-08-27T11:25:24.906832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906565+0000","last_change":"2023-08-27T11:25:24.906565+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906565+0000","last_undegraded":"2023-08-27T11:25:24.906565+0000","last_fullsized":"2023-08-27T11:25:24.906565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911042+0000","last_change":"2023-08-27T11:25:24.911042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911042+0000","last_undegraded":"2023-08-27T11:25:24.911042+0000","last_fullsized":"2023-08-27T11:25:24.911042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913516+0000","last_change":"2023-08-27T11:25:24.908438+0000","last_active":"2023-08-27T11:25:24.913516+0000","last_peered":"2023-08-27T11:25:24.913516+0000","last_clean":"2023-08-27T11:25:24.913516+0000","last_became_active":"2023-08-27T11:25:24.908166+0000","last_became_peered":"2023-08-27T11:25:24.908166+0000","last_unstale":"2023-08-27T11:25:24.913516+0000","last_undegraded":"2023-08-27T11:25:24.913516+0000","last_fullsized":"2023-08-27T11:25:24.913516+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:48:16.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907696+0000","last_change":"2023-08-27T11:25:24.907696+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907696+0000","last_undegraded":"2023-08-27T11:25:24.907696+0000","last_fullsized":"2023-08-27T11:25:24.907696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938563+0000","last_change":"2023-08-27T11:25:24.931041+0000","last_active":"2023-08-27T11:25:24.938563+0000","last_peered":"2023-08-27T11:25:24.938563+0000","last_clean":"2023-08-27T11:25:24.938563+0000","last_became_active":"2023-08-27T11:25:24.930712+0000","last_became_peered":"2023-08-27T11:25:24.930712+0000","last_unstale":"2023-08-27T11:25:24.938563+0000","last_undegraded":"2023-08-27T11:25:24.938563+0000","last_fullsized":"2023-08-27T11:25:24.938563+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:24.612963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910301+0000","last_change":"2023-08-27T11:25:24.910301+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910301+0000","last_undegraded":"2023-08-27T11:25:24.910301+0000","last_fullsized":"2023-08-27T11:25:24.910301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925784+0000","last_change":"2023-08-27T11:25:24.919539+0000","last_active":"2023-08-27T11:25:24.925784+0000","last_peered":"2023-08-27T11:25:24.925784+0000","last_clean":"2023-08-27T11:25:24.925784+0000","last_became_active":"2023-08-27T11:25:24.919241+0000","last_became_peered":"2023-08-27T11:25:24.919241+0000","last_unstale":"2023-08-27T11:25:24.925784+0000","last_undegraded":"2023-08-27T11:25:24.925784+0000","last_fullsized":"2023-08-27T11:25:24.925784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:37:07.671605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911116+0000","last_change":"2023-08-27T11:25:24.911116+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911116+0000","last_undegraded":"2023-08-27T11:25:24.911116+0000","last_fullsized":"2023-08-27T11:25:24.911116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930231+0000","last_change":"2023-08-27T11:25:24.920378+0000","last_active":"2023-08-27T11:25:24.930231+0000","last_peered":"2023-08-27T11:25:24.930231+0000","last_clean":"2023-08-27T11:25:24.930231+0000","last_became_active":"2023-08-27T11:25:24.919551+0000","last_became_peered":"2023-08-27T11:25:24.919551+0000","last_unstale":"2023-08-27T11:25:24.930231+0000","last_undegraded":"2023-08-27T11:25:24.930231+0000","last_fullsized":"2023-08-27T11:25:24.930231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:00.552725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909135+0000","last_change":"2023-08-27T11:25:24.909135+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909135+0000","last_undegraded":"2023-08-27T11:25:24.909135+0000","last_fullsized":"2023-08-27T11:25:24.909135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.927274+0000","last_change":"2023-08-27T11:25:24.923303+0000","last_active":"2023-08-27T11:25:24.927274+0000","last_peered":"2023-08-27T11:25:24.927274+0000","last_clean":"2023-08-27T11:25:24.927274+0000","last_became_active":"2023-08-27T11:25:24.922964+0000","last_became_peered":"2023-08-27T11:25:24.922964+0000","last_unstale":"2023-08-27T11:25:24.927274+0000","last_undegraded":"2023-08-27T11:25:24.927274+0000","last_fullsized":"2023-08-27T11:25:24.927274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:29.347866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907095+0000","last_change":"2023-08-27T11:25:24.907095+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907095+0000","last_undegraded":"2023-08-27T11:25:24.907095+0000","last_fullsized":"2023-08-27T11:25:24.907095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930384+0000","last_change":"2023-08-27T11:25:24.924224+0000","last_active":"2023-08-27T11:25:24.930384+0000","last_peered":"2023-08-27T11:25:24.930384+0000","last_clean":"2023-08-27T11:25:24.930384+0000","last_became_active":"2023-08-27T11:25:24.923933+0000","last_became_peered":"2023-08-27T11:25:24.923933+0000","last_unstale":"2023-08-27T11:25:24.930384+0000","last_undegraded":"2023-08-27T11:25:24.930384+0000","last_fullsized":"2023-08-27T11:25:24.930384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:27:14.972078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910854+0000","last_change":"2023-08-27T11:25:24.910854+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910854+0000","last_undegraded":"2023-08-27T11:25:24.910854+0000","last_fullsized":"2023-08-27T11:25:24.910854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925992+0000","last_change":"2023-08-27T11:25:24.925097+0000","last_active":"2023-08-27T11:25:24.925992+0000","last_peered":"2023-08-27T11:25:24.925992+0000","last_clean":"2023-08-27T11:25:24.925992+0000","last_became_active":"2023-08-27T11:25:24.924803+0000","last_became_peered":"2023-08-27T11:25:24.924803+0000","last_unstale":"2023-08-27T11:25:24.925992+0000","last_undegraded":"2023-08-27T11:25:24.925992+0000","last_fullsized":"2023-08-27T11:25:24.925992+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:21.132856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908271+0000","last_change":"2023-08-27T11:25:24.908271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908271+0000","last_undegraded":"2023-08-27T11:25:24.908271+0000","last_fullsized":"2023-08-27T11:25:24.908271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923380+0000","last_change":"2023-08-27T11:25:24.921040+0000","last_active":"2023-08-27T11:25:24.923380+0000","last_peered":"2023-08-27T11:25:24.923380+0000","last_clean":"2023-08-27T11:25:24.923380+0000","last_became_active":"2023-08-27T11:25:24.920745+0000","last_became_peered":"2023-08-27T11:25:24.920745+0000","last_unstale":"2023-08-27T11:25:24.923380+0000","last_undegraded":"2023-08-27T11:25:24.923380+0000","last_fullsized":"2023-08-27T11:25:24.923380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:13:43.404011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907161+0000","last_change":"2023-08-27T11:25:24.907161+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907161+0000","last_undegraded":"2023-08-27T11:25:24.907161+0000","last_fullsized":"2023-08-27T11:25:24.907161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938590+0000","last_change":"2023-08-27T11:25:24.931138+0000","last_active":"2023-08-27T11:25:24.938590+0000","last_peered":"2023-08-27T11:25:24.938590+0000","last_clean":"2023-08-27T11:25:24.938590+0000","last_became_active":"2023-08-27T11:25:24.930796+0000","last_became_peered":"2023-08-27T11:25:24.930796+0000","last_unstale":"2023-08-27T11:25:24.938590+0000","last_undegraded":"2023-08-27T11:25:24.938590+0000","last_fullsized":"2023-08-27T11:25:24.938590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:48.291105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912052+0000","last_change":"2023-08-27T11:25:24.912052+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912052+0000","last_undegraded":"2023-08-27T11:25:24.912052+0000","last_fullsized":"2023-08-27T11:25:24.912052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930349+0000","last_change":"2023-08-27T11:25:24.923906+0000","last_active":"2023-08-27T11:25:24.930349+0000","last_peered":"2023-08-27T11:25:24.930349+0000","last_clean":"2023-08-27T11:25:24.930349+0000","last_became_active":"2023-08-27T11:25:24.923601+0000","last_became_peered":"2023-08-27T11:25:24.923601+0000","last_unstale":"2023-08-27T11:25:24.930349+0000","last_undegraded":"2023-08-27T11:25:24.930349+0000","last_fullsized":"2023-08-27T11:25:24.930349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:10.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902989+0000","last_change":"2023-08-27T11:25:24.902989+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902989+0000","last_undegraded":"2023-08-27T11:25:24.902989+0000","last_fullsized":"2023-08-27T11:25:24.902989+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922741+0000","last_change":"2023-08-27T11:25:24.918632+0000","last_active":"2023-08-27T11:25:24.922741+0000","last_peered":"2023-08-27T11:25:24.922741+0000","last_clean":"2023-08-27T11:25:24.922741+0000","last_became_active":"2023-08-27T11:25:24.918354+0000","last_became_peered":"2023-08-27T11:25:24.918354+0000","last_unstale":"2023-08-27T11:25:24.922741+0000","last_undegraded":"2023-08-27T11:25:24.922741+0000","last_fullsized":"2023-08-27T11:25:24.922741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:40.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907234+0000","last_change":"2023-08-27T11:25:24.907234+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907234+0000","last_undegraded":"2023-08-27T11:25:24.907234+0000","last_fullsized":"2023-08-27T11:25:24.907234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933117+0000","last_change":"2023-08-27T11:25:24.923843+0000","last_active":"2023-08-27T11:25:24.933117+0000","last_peered":"2023-08-27T11:25:24.933117+0000","last_clean":"2023-08-27T11:25:24.933117+0000","last_became_active":"2023-08-27T11:25:24.923525+0000","last_became_peered":"2023-08-27T11:25:24.923525+0000","last_unstale":"2023-08-27T11:25:24.933117+0000","last_undegraded":"2023-08-27T11:25:24.933117+0000","last_fullsized":"2023-08-27T11:25:24.933117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:44.335083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912737+0000","last_change":"2023-08-27T11:25:24.912737+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912737+0000","last_undegraded":"2023-08-27T11:25:24.912737+0000","last_fullsized":"2023-08-27T11:25:24.912737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930402+0000","last_change":"2023-08-27T11:25:24.925180+0000","last_active":"2023-08-27T11:25:24.930402+0000","last_peered":"2023-08-27T11:25:24.930402+0000","last_clean":"2023-08-27T11:25:24.930402+0000","last_became_active":"2023-08-27T11:25:24.924811+0000","last_became_peered":"2023-08-27T11:25:24.924811+0000","last_unstale":"2023-08-27T11:25:24.930402+0000","last_undegraded":"2023-08-27T11:25:24.930402+0000","last_fullsized":"2023-08-27T11:25:24.930402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:36:42.056591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908182+0000","last_change":"2023-08-27T11:25:24.908182+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908182+0000","last_undegraded":"2023-08-27T11:25:24.908182+0000","last_fullsized":"2023-08-27T11:25:24.908182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925507+0000","last_change":"2023-08-27T11:25:24.921229+0000","last_active":"2023-08-27T11:25:24.925507+0000","last_peered":"2023-08-27T11:25:24.925507+0000","last_clean":"2023-08-27T11:25:24.925507+0000","last_became_active":"2023-08-27T11:25:24.920853+0000","last_became_peered":"2023-08-27T11:25:24.920853+0000","last_unstale":"2023-08-27T11:25:24.925507+0000","last_undegraded":"2023-08-27T11:25:24.925507+0000","last_fullsized":"2023-08-27T11:25:24.925507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:42:03.470213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906401+0000","last_change":"2023-08-27T11:25:24.906401+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906401+0000","last_undegraded":"2023-08-27T11:25:24.906401+0000","last_fullsized":"2023-08-27T11:25:24.906401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913573+0000","last_change":"2023-08-27T11:25:24.906755+0000","last_active":"2023-08-27T11:25:24.913573+0000","last_peered":"2023-08-27T11:25:24.913573+0000","last_clean":"2023-08-27T11:25:24.913573+0000","last_became_active":"2023-08-27T11:25:24.906473+0000","last_became_peered":"2023-08-27T11:25:24.906473+0000","last_unstale":"2023-08-27T11:25:24.913573+0000","last_undegraded":"2023-08-27T11:25:24.913573+0000","last_fullsized":"2023-08-27T11:25:24.913573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:43:43.749717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906530+0000","last_change":"2023-08-27T11:25:24.906530+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906530+0000","last_undegraded":"2023-08-27T11:25:24.906530+0000","last_fullsized":"2023-08-27T11:25:24.906530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925685+0000","last_change":"2023-08-27T11:25:24.923864+0000","last_active":"2023-08-27T11:25:24.925685+0000","last_peered":"2023-08-27T11:25:24.925685+0000","last_clean":"2023-08-27T11:25:24.925685+0000","last_became_active":"2023-08-27T11:25:24.923584+0000","last_became_peered":"2023-08-27T11:25:24.923584+0000","last_unstale":"2023-08-27T11:25:24.925685+0000","last_undegraded":"2023-08-27T11:25:24.925685+0000","last_fullsized":"2023-08-27T11:25:24.925685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:28.497788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910195+0000","last_change":"2023-08-27T11:25:24.910195+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910195+0000","last_undegraded":"2023-08-27T11:25:24.910195+0000","last_fullsized":"2023-08-27T11:25:24.910195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930303+0000","last_change":"2023-08-27T11:25:24.922363+0000","last_active":"2023-08-27T11:25:24.930303+0000","last_peered":"2023-08-27T11:25:24.930303+0000","last_clean":"2023-08-27T11:25:24.930303+0000","last_became_active":"2023-08-27T11:25:24.922020+0000","last_became_peered":"2023-08-27T11:25:24.922020+0000","last_unstale":"2023-08-27T11:25:24.930303+0000","last_undegraded":"2023-08-27T11:25:24.930303+0000","last_fullsized":"2023-08-27T11:25:24.930303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:25:19.168348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908352+0000","last_change":"2023-08-27T11:25:24.908352+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908352+0000","last_undegraded":"2023-08-27T11:25:24.908352+0000","last_fullsized":"2023-08-27T11:25:24.908352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.919782+0000","last_change":"2023-08-27T11:25:24.917472+0000","last_active":"2023-08-27T11:25:24.919782+0000","last_peered":"2023-08-27T11:25:24.919782+0000","last_clean":"2023-08-27T11:25:24.919782+0000","last_became_active":"2023-08-27T11:25:24.917200+0000","last_became_peered":"2023-08-27T11:25:24.917200+0000","last_unstale":"2023-08-27T11:25:24.919782+0000","last_undegraded":"2023-08-27T11:25:24.919782+0000","last_fullsized":"2023-08-27T11:25:24.919782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:22:47.877904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909691+0000","last_change":"2023-08-27T11:25:24.909691+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909691+0000","last_undegraded":"2023-08-27T11:25:24.909691+0000","last_fullsized":"2023-08-27T11:25:24.909691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925808+0000","last_change":"2023-08-27T11:25:24.920783+0000","last_active":"2023-08-27T11:25:24.925808+0000","last_peered":"2023-08-27T11:25:24.925808+0000","last_clean":"2023-08-27T11:25:24.925808+0000","last_became_active":"2023-08-27T11:25:24.920476+0000","last_became_peered":"2023-08-27T11:25:24.920476+0000","last_unstale":"2023-08-27T11:25:24.925808+0000","last_undegraded":"2023-08-27T11:25:24.925808+0000","last_fullsized":"2023-08-27T11:25:24.925808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:35.904348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907859+0000","last_change":"2023-08-27T11:25:24.907859+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907859+0000","last_undegraded":"2023-08-27T11:25:24.907859+0000","last_fullsized":"2023-08-27T11:25:24.907859+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933208+0000","last_change":"2023-08-27T11:25:24.926030+0000","last_active":"2023-08-27T11:25:24.933208+0000","last_peered":"2023-08-27T11:25:24.933208+0000","last_clean":"2023-08-27T11:25:24.933208+0000","last_became_active":"2023-08-27T11:25:24.925704+0000","last_became_peered":"2023-08-27T11:25:24.925704+0000","last_unstale":"2023-08-27T11:25:24.933208+0000","last_undegraded":"2023-08-27T11:25:24.933208+0000","last_fullsized":"2023-08-27T11:25:24.933208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:34.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906973+0000","last_change":"2023-08-27T11:25:24.906973+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906973+0000","last_undegraded":"2023-08-27T11:25:24.906973+0000","last_fullsized":"2023-08-27T11:25:24.906973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930154+0000","last_change":"2023-08-27T11:25:24.919971+0000","last_active":"2023-08-27T11:25:24.930154+0000","last_peered":"2023-08-27T11:25:24.930154+0000","last_clean":"2023-08-27T11:25:24.930154+0000","last_became_active":"2023-08-27T11:25:24.919560+0000","last_became_peered":"2023-08-27T11:25:24.919560+0000","last_unstale":"2023-08-27T11:25:24.930154+0000","last_undegraded":"2023-08-27T11:25:24.930154+0000","last_fullsized":"2023-08-27T11:25:24.930154+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:30:14.218994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907238+0000","last_change":"2023-08-27T11:25:24.907238+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907238+0000","last_undegraded":"2023-08-27T11:25:24.907238+0000","last_fullsized":"2023-08-27T11:25:24.907238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913622+0000","last_change":"2023-08-27T11:25:24.908964+0000","last_active":"2023-08-27T11:25:24.913622+0000","last_peered":"2023-08-27T11:25:24.913622+0000","last_clean":"2023-08-27T11:25:24.913622+0000","last_became_active":"2023-08-27T11:25:24.908673+0000","last_became_peered":"2023-08-27T11:25:24.908673+0000","last_unstale":"2023-08-27T11:25:24.913622+0000","last_undegraded":"2023-08-27T11:25:24.913622+0000","last_fullsized":"2023-08-27T11:25:24.913622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:07:44.263637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906790+0000","last_change":"2023-08-27T11:25:24.906790+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906790+0000","last_undegraded":"2023-08-27T11:25:24.906790+0000","last_fullsized":"2023-08-27T11:25:24.906790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933167+0000","last_change":"2023-08-27T11:25:24.923991+0000","last_active":"2023-08-27T11:25:24.933167+0000","last_peered":"2023-08-27T11:25:24.933167+0000","last_clean":"2023-08-27T11:25:24.933167+0000","last_became_active":"2023-08-27T11:25:24.923644+0000","last_became_peered":"2023-08-27T11:25:24.923644+0000","last_unstale":"2023-08-27T11:25:24.933167+0000","last_undegraded":"2023-08-27T11:25:24.933167+0000","last_fullsized":"2023-08-27T11:25:24.933167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:09.884899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907681+0000","last_change":"2023-08-27T11:25:24.907681+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907681+0000","last_undegraded":"2023-08-27T11:25:24.907681+0000","last_fullsized":"2023-08-27T11:25:24.907681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925536+0000","last_change":"2023-08-27T11:25:24.923852+0000","last_active":"2023-08-27T11:25:24.925536+0000","last_peered":"2023-08-27T11:25:24.925536+0000","last_clean":"2023-08-27T11:25:24.925536+0000","last_became_active":"2023-08-27T11:25:24.923556+0000","last_became_peered":"2023-08-27T11:25:24.923556+0000","last_unstale":"2023-08-27T11:25:24.925536+0000","last_undegraded":"2023-08-27T11:25:24.925536+0000","last_fullsized":"2023-08-27T11:25:24.925536+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:37:53.371732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900830+0000","last_change":"2023-08-27T11:25:24.900830+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900830+0000","last_undegraded":"2023-08-27T11:25:24.900830+0000","last_fullsized":"2023-08-27T11:25:24.900830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923277+0000","last_change":"2023-08-27T11:25:24.920647+0000","last_active":"2023-08-27T11:25:24.923277+0000","last_peered":"2023-08-27T11:25:24.923277+0000","last_clean":"2023-08-27T11:25:24.923277+0000","last_became_active":"2023-08-27T11:25:24.920179+0000","last_became_peered":"2023-08-27T11:25:24.920179+0000","last_unstale":"2023-08-27T11:25:24.923277+0000","last_undegraded":"2023-08-27T11:25:24.923277+0000","last_fullsized":"2023-08-27T11:25:24.923277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:23.867540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.914871+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:25:24.914871+0000","last_peered":"2023-08-27T11:25:24.914871+0000","last_clean":"2023-08-27T11:25:24.914871+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:25:24.914871+0000","last_undegraded":"2023-08-27T11:25:24.914871+0000","last_fullsized":"2023-08-27T11:25:24.914871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:27.315983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902693+0000","last_change":"2023-08-27T11:25:24.902693+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902693+0000","last_undegraded":"2023-08-27T11:25:24.902693+0000","last_fullsized":"2023-08-27T11:25:24.902693+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.918762+0000","last_change":"2023-08-27T11:25:24.916105+0000","last_active":"2023-08-27T11:25:24.918762+0000","last_peered":"2023-08-27T11:25:24.918762+0000","last_clean":"2023-08-27T11:25:24.918762+0000","last_became_active":"2023-08-27T11:25:24.915828+0000","last_became_peered":"2023-08-27T11:25:24.915828+0000","last_unstale":"2023-08-27T11:25:24.918762+0000","last_undegraded":"2023-08-27T11:25:24.918762+0000","last_fullsized":"2023-08-27T11:25:24.918762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:48:57.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.915313+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:25:24.915313+0000","last_peered":"2023-08-27T11:25:24.915313+0000","last_clean":"2023-08-27T11:25:24.915313+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:25:24.915313+0000","last_undegraded":"2023-08-27T11:25:24.915313+0000","last_fullsized":"2023-08-27T11:25:24.915313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:35.315388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908695+0000","last_change":"2023-08-27T11:25:24.908695+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908695+0000","last_undegraded":"2023-08-27T11:25:24.908695+0000","last_fullsized":"2023-08-27T11:25:24.908695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922896+0000","last_change":"2023-08-27T11:25:24.918132+0000","last_active":"2023-08-27T11:25:24.922896+0000","last_peered":"2023-08-27T11:25:24.922896+0000","last_clean":"2023-08-27T11:25:24.922896+0000","last_became_active":"2023-08-27T11:25:24.917778+0000","last_became_peered":"2023-08-27T11:25:24.917778+0000","last_unstale":"2023-08-27T11:25:24.922896+0000","last_undegraded":"2023-08-27T11:25:24.922896+0000","last_fullsized":"2023-08-27T11:25:24.922896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:09:31.700567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912353+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:25:24.912353+0000","last_peered":"2023-08-27T11:25:24.912353+0000","last_clean":"2023-08-27T11:25:24.912353+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:25:24.912353+0000","last_undegraded":"2023-08-27T11:25:24.912353+0000","last_fullsized":"2023-08-27T11:25:24.912353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:46.491417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907465+0000","last_change":"2023-08-27T11:25:24.907465+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907465+0000","last_undegraded":"2023-08-27T11:25:24.907465+0000","last_fullsized":"2023-08-27T11:25:24.907465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925010+0000","last_change":"2023-08-27T11:25:24.919858+0000","last_active":"2023-08-27T11:25:24.925010+0000","last_peered":"2023-08-27T11:25:24.925010+0000","last_clean":"2023-08-27T11:25:24.925010+0000","last_became_active":"2023-08-27T11:25:24.919538+0000","last_became_peered":"2023-08-27T11:25:24.919538+0000","last_unstale":"2023-08-27T11:25:24.925010+0000","last_undegraded":"2023-08-27T11:25:24.925010+0000","last_fullsized":"2023-08-27T11:25:24.925010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:36.569893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908412+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:25:24.908412+0000","last_peered":"2023-08-27T11:25:24.908412+0000","last_clean":"2023-08-27T11:25:24.908412+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:25:24.908412+0000","last_undegraded":"2023-08-27T11:25:24.908412+0000","last_fullsized":"2023-08-27T11:25:24.908412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:49.505429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907104+0000","last_change":"2023-08-27T11:25:24.907104+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907104+0000","last_undegraded":"2023-08-27T11:25:24.907104+0000","last_fullsized":"2023-08-27T11:25:24.907104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923000+0000","last_change":"2023-08-27T11:25:24.912962+0000","last_active":"2023-08-27T11:25:24.923000+0000","last_peered":"2023-08-27T11:25:24.923000+0000","last_clean":"2023-08-27T11:25:24.923000+0000","last_became_active":"2023-08-27T11:25:24.912591+0000","last_became_peered":"2023-08-27T11:25:24.912591+0000","last_unstale":"2023-08-27T11:25:24.923000+0000","last_undegraded":"2023-08-27T11:25:24.923000+0000","last_fullsized":"2023-08-27T11:25:24.923000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:40.589564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.909416+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:25:24.909416+0000","last_peered":"2023-08-27T11:25:24.909416+0000","last_clean":"2023-08-27T11:25:24.909416+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:25:24.909416+0000","last_undegraded":"2023-08-27T11:25:24.909416+0000","last_fullsized":"2023-08-27T11:25:24.909416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:21.136228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910460+0000","last_change":"2023-08-27T11:25:24.910460+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910460+0000","last_undegraded":"2023-08-27T11:25:24.910460+0000","last_fullsized":"2023-08-27T11:25:24.910460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925390+0000","last_change":"2023-08-27T11:25:24.919759+0000","last_active":"2023-08-27T11:25:24.925390+0000","last_peered":"2023-08-27T11:25:24.925390+0000","last_clean":"2023-08-27T11:25:24.925390+0000","last_became_active":"2023-08-27T11:25:24.919456+0000","last_became_peered":"2023-08-27T11:25:24.919456+0000","last_unstale":"2023-08-27T11:25:24.925390+0000","last_undegraded":"2023-08-27T11:25:24.925390+0000","last_fullsized":"2023-08-27T11:25:24.925390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:52.084751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":246,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908237+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:25:24.908237+0000","last_peered":"2023-08-27T11:25:24.908237+0000","last_clean":"2023-08-27T11:25:24.908237+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:25:24.908237+0000","last_undegraded":"2023-08-27T11:25:24.908237+0000","last_fullsized":"2023-08-27T11:25:24.908237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:42.306664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912691+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:25:24.912691+0000","last_peered":"2023-08-27T11:25:24.912691+0000","last_clean":"2023-08-27T11:25:24.912691+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:25:24.912691+0000","last_undegraded":"2023-08-27T11:25:24.912691+0000","last_fullsized":"2023-08-27T11:25:24.912691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:28.567657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900797+0000","last_change":"2023-08-27T11:25:24.900797+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900797+0000","last_undegraded":"2023-08-27T11:25:24.900797+0000","last_fullsized":"2023-08-27T11:25:24.900797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.926508+0000","last_change":"2023-08-27T11:25:24.920798+0000","last_active":"2023-08-27T11:25:24.926508+0000","last_peered":"2023-08-27T11:25:24.926508+0000","last_clean":"2023-08-27T11:25:24.926508+0000","last_became_active":"2023-08-27T11:25:24.920323+0000","last_became_peered":"2023-08-27T11:25:24.920323+0000","last_unstale":"2023-08-27T11:25:24.926508+0000","last_undegraded":"2023-08-27T11:25:24.926508+0000","last_fullsized":"2023-08-27T11:25:24.926508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:16.520166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.904792+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:25:24.904792+0000","last_peered":"2023-08-27T11:25:24.904792+0000","last_clean":"2023-08-27T11:25:24.904792+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:25:24.904792+0000","last_undegraded":"2023-08-27T11:25:24.904792+0000","last_fullsized":"2023-08-27T11:25:24.904792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:16.030989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901271+0000","last_change":"2023-08-27T11:25:24.901271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901271+0000","last_undegraded":"2023-08-27T11:25:24.901271+0000","last_fullsized":"2023-08-27T11:25:24.901271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925398+0000","last_change":"2023-08-27T11:25:24.919905+0000","last_active":"2023-08-27T11:25:24.925398+0000","last_peered":"2023-08-27T11:25:24.925398+0000","last_clean":"2023-08-27T11:25:24.925398+0000","last_became_active":"2023-08-27T11:25:24.919452+0000","last_became_peered":"2023-08-27T11:25:24.919452+0000","last_unstale":"2023-08-27T11:25:24.925398+0000","last_undegraded":"2023-08-27T11:25:24.925398+0000","last_fullsized":"2023-08-27T11:25:24.925398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:47.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.916000+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:25:24.916000+0000","last_peered":"2023-08-27T11:25:24.916000+0000","last_clean":"2023-08-27T11:25:24.916000+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:25:24.916000+0000","last_undegraded":"2023-08-27T11:25:24.916000+0000","last_fullsized":"2023-08-27T11:25:24.916000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:44.816245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":1.018},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.97399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":1.032},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.087},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.82299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.871}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.94099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.372},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.434}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.439},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69299999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.92800000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:25:30.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:25:30.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.596+0000 7f665f1ff700 1 Processor -- start 2023-08-27T11:25:30.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.597+0000 7f665f1ff700 1 -- start start 2023-08-27T11:25:30.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665f1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f665806ad70 0x7f665806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665f1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665806c4e0 con 0x7f6658151a90 2023-08-27T11:25:30.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665f1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6658155370 con 0x7f665806ad70 2023-08-27T11:25:30.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580c82c0 con 0x7f66580c4630 2023-08-27T11:25:30.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665cf9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6658151a90 0x7f66580c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41500/0 (socket says 172.21.15.43:41500) 2023-08-27T11:25:30.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665cf9b700 1 -- 172.21.15.43:0/2563362159 learned_addr learned my addr 172.21.15.43:0/2563362159 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:30.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f665d79c700 1 --2- 172.21.15.43:0/2563362159 >> v2:172.21.15.43:3300/0 conn(0x7f665806ad70 0x7f665806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f6657fff700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f66577fe700 1 -- 172.21.15.43:0/2563362159 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262944874 0 0) 0x7f665806c4e0 con 0x7f6658151a90 2023-08-27T11:25:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.598+0000 7f66577fe700 1 -- 172.21.15.43:0/2563362159 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66480035b0 con 0x7f6658151a90 2023-08-27T11:25:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f665d79c700 1 -- 172.21.15.43:0/2563362159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 msgr2=0x7f66580c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f665d79c700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f665d79c700 1 -- 172.21.15.43:0/2563362159 >> v1:172.21.15.43:6789/0 conn(0x7f6658151a90 legacy=0x7f66580c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f665d79c700 1 -- 172.21.15.43:0/2563362159 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6658151e70 con 0x7f665806ad70 2023-08-27T11:25:30.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f665d79c700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665806ad70 0x7f665806b200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6650009d90 tx=0x7f665000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febc69f80cb4a2c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f66577fe700 1 -- 172.21.15.43:0/2563362159 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000e070 con 0x7f665806ad70 2023-08-27T11:25:30.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f66577fe700 1 -- 172.21.15.43:0/2563362159 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000bb20 con 0x7f665806ad70 2023-08-27T11:25:30.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.599+0000 7f66577fe700 1 -- 172.21.15.43:0/2563362159 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650012430 con 0x7f665806ad70 2023-08-27T11:25:30.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 -- 172.21.15.43:0/2563362159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665806ad70 msgr2=0x7f665806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665806ad70 0x7f665806b200 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6650009d90 tx=0x7f665000b330 comp rx=0 tx=0).stop 2023-08-27T11:25:30.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 -- 172.21.15.43:0/2563362159 shutdown_connections 2023-08-27T11:25:30.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f665806ad70 0x7f665806b200 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 --2- 172.21.15.43:0/2563362159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 -- 172.21.15.43:0/2563362159 >> 172.21.15.43:0/2563362159 conn(0x7f66580ab820 msgr2=0x7f66580abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 -- 172.21.15.43:0/2563362159 shutdown_connections 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.600+0000 7f665f1ff700 1 -- 172.21.15.43:0/2563362159 wait complete. 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.602+0000 7f665f1ff700 1 Processor -- start 2023-08-27T11:25:30.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.602+0000 7f665f1ff700 1 -- start start 2023-08-27T11:25:30.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 0x7f66580c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6658156e50 con 0x7f6658151a90 2023-08-27T11:25:30.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66581ed6e0 con 0x7f665806ad70 2023-08-27T11:25:30.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665f1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580c0d80 con 0x7f66580c4630 2023-08-27T11:25:30.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38486/0 (socket says 172.21.15.43:38486) 2023-08-27T11:25:30.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 -- 172.21.15.43:0/919958741 learned_addr learned my addr 172.21.15.43:0/919958741 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:30.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665cf9b700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 0x7f66580c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f6657fff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 -- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 msgr2=0x7f66580c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 -- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 msgr2=0x7f66580c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 0x7f66580c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665d79c700 1 -- 172.21.15.43:0/919958741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009a70 con 0x7f6658151a90 2023-08-27T11:25:30.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f665cf9b700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 0x7f66580c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:30.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.603+0000 7f6657fff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:30.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f665d79c700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6650014040 tx=0x7f6650004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66500129f0 con 0x7f6658151a90 2023-08-27T11:25:30.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6650020070 con 0x7f6658151a90 2023-08-27T11:25:30.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6650012db0 con 0x7f6658151a90 2023-08-27T11:25:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6658156b70 con 0x7f6658151a90 2023-08-27T11:25:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.604+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66580c1280 con 0x7f6658151a90 2023-08-27T11:25:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.605+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66581ed540 con 0x7f6658151a90 2023-08-27T11:25:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.606+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6650004040 con 0x7f6658151a90 2023-08-27T11:25:30.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.608+0000 7f66557fa700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 0x7f663c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:30.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.608+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6650022070 con 0x7f6658151a90 2023-08-27T11:25:30.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.608+0000 7f665cf9b700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 0x7f663c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:30.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.609+0000 7f665cf9b700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 0x7f663c06c5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f664c0011e0 tx=0x7f664c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:30.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.612+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f66581ed540 con 0x7f6658151a90 2023-08-27T11:25:30.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.817+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6658154760 con 0x7f663c06a0e0 2023-08-27T11:25:30.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.827+0000 7f66557fa700 1 -- 172.21.15.43:0/919958741 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306255 (secure 0 0 0) 0x7f664c005920 con 0x7f663c06a0e0 2023-08-27T11:25:30.832 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 msgr2=0x7f663c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 0x7f663c06c5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f664c0011e0 tx=0x7f664c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 msgr2=0x7f665814ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6650014040 tx=0x7f6650004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 shutdown_connections 2023-08-27T11:25:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f663c06a0e0 0x7f663c06c5a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6658151a90 0x7f665814ce80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f665806ad70 0x7f66580c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 --2- 172.21.15.43:0/919958741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f66580c4630 0x7f66580c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:30.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 >> 172.21.15.43:0/919958741 conn(0x7f66580ab820 msgr2=0x7f665814b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:30.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 shutdown_connections 2023-08-27T11:25:30.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:30.832+0000 7f665f1ff700 1 -- 172.21.15.43:0/919958741 wait complete. 2023-08-27T11:25:30.838 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:25:30.851 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-08-27T11:25:30.346279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223560,"kb_used_data":7392,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751160,"statfs":{"total":773094113280,"available":772865187840,"internally_reserved":0,"allocated":7569408,"data_stored":4098632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000975"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908291+0000","last_change":"2023-08-27T11:25:24.908291+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908291+0000","last_undegraded":"2023-08-27T11:25:24.908291+0000","last_fullsized":"2023-08-27T11:25:24.908291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910924+0000","last_change":"2023-08-27T11:25:24.910924+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910924+0000","last_undegraded":"2023-08-27T11:25:24.910924+0000","last_fullsized":"2023-08-27T11:25:24.910924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911420+0000","last_change":"2023-08-27T11:25:24.911420+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911420+0000","last_undegraded":"2023-08-27T11:25:24.911420+0000","last_fullsized":"2023-08-27T11:25:24.911420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.915042+0000","last_change":"2023-08-27T11:25:24.915042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.915042+0000","last_undegraded":"2023-08-27T11:25:24.915042+0000","last_fullsized":"2023-08-27T11:25:24.915042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903993+0000","last_change":"2023-08-27T11:25:24.903993+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903993+0000","last_undegraded":"2023-08-27T11:25:24.903993+0000","last_fullsized":"2023-08-27T11:25:24.903993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903826+0000","last_change":"2023-08-27T11:25:24.903826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903826+0000","last_undegraded":"2023-08-27T11:25:24.903826+0000","last_fullsized":"2023-08-27T11:25:24.903826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908844+0000","last_change":"2023-08-27T11:25:24.908844+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908844+0000","last_undegraded":"2023-08-27T11:25:24.908844+0000","last_fullsized":"2023-08-27T11:25:24.908844+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903260+0000","last_change":"2023-08-27T11:25:24.903260+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903260+0000","last_undegraded":"2023-08-27T11:25:24.903260+0000","last_fullsized":"2023-08-27T11:25:24.903260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912894+0000","last_change":"2023-08-27T11:25:24.912894+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912894+0000","last_undegraded":"2023-08-27T11:25:24.912894+0000","last_fullsized":"2023-08-27T11:25:24.912894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912390+0000","last_change":"2023-08-27T11:25:24.912390+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912390+0000","last_undegraded":"2023-08-27T11:25:24.912390+0000","last_fullsized":"2023-08-27T11:25:24.912390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907613+0000","last_change":"2023-08-27T11:25:24.907613+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907613+0000","last_undegraded":"2023-08-27T11:25:24.907613+0000","last_fullsized":"2023-08-27T11:25:24.907613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.914370+0000","last_change":"2023-08-27T11:25:24.914370+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.914370+0000","last_undegraded":"2023-08-27T11:25:24.914370+0000","last_fullsized":"2023-08-27T11:25:24.914370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903560+0000","last_change":"2023-08-27T11:25:24.903560+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903560+0000","last_undegraded":"2023-08-27T11:25:24.903560+0000","last_fullsized":"2023-08-27T11:25:24.903560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903415+0000","last_change":"2023-08-27T11:25:24.903415+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903415+0000","last_undegraded":"2023-08-27T11:25:24.903415+0000","last_fullsized":"2023-08-27T11:25:24.903415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908170+0000","last_change":"2023-08-27T11:25:24.908170+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908170+0000","last_undegraded":"2023-08-27T11:25:24.908170+0000","last_fullsized":"2023-08-27T11:25:24.908170+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907020+0000","last_change":"2023-08-27T11:25:24.907020+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907020+0000","last_undegraded":"2023-08-27T11:25:24.907020+0000","last_fullsized":"2023-08-27T11:25:24.907020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903505+0000","last_change":"2023-08-27T11:25:24.903505+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903505+0000","last_undegraded":"2023-08-27T11:25:24.903505+0000","last_fullsized":"2023-08-27T11:25:24.903505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907278+0000","last_change":"2023-08-27T11:25:24.907278+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907278+0000","last_undegraded":"2023-08-27T11:25:24.907278+0000","last_fullsized":"2023-08-27T11:25:24.907278+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901779+0000","last_change":"2023-08-27T11:25:24.901779+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901779+0000","last_undegraded":"2023-08-27T11:25:24.901779+0000","last_fullsized":"2023-08-27T11:25:24.901779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.904458+0000","last_change":"2023-08-27T11:25:24.904458+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.904458+0000","last_undegraded":"2023-08-27T11:25:24.904458+0000","last_fullsized":"2023-08-27T11:25:24.904458+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911655+0000","last_change":"2023-08-27T11:25:24.911655+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911655+0000","last_undegraded":"2023-08-27T11:25:24.911655+0000","last_fullsized":"2023-08-27T11:25:24.911655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903036+0000","last_change":"2023-08-27T11:25:24.903036+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903036+0000","last_undegraded":"2023-08-27T11:25:24.903036+0000","last_fullsized":"2023-08-27T11:25:24.903036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912134+0000","last_change":"2023-08-27T11:25:24.912134+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912134+0000","last_undegraded":"2023-08-27T11:25:24.912134+0000","last_fullsized":"2023-08-27T11:25:24.912134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908074+0000","last_change":"2023-08-27T11:25:24.908074+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908074+0000","last_undegraded":"2023-08-27T11:25:24.908074+0000","last_fullsized":"2023-08-27T11:25:24.908074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910917+0000","last_change":"2023-08-27T11:25:24.910917+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910917+0000","last_undegraded":"2023-08-27T11:25:24.910917+0000","last_fullsized":"2023-08-27T11:25:24.910917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911838+0000","last_change":"2023-08-27T11:25:24.911838+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911838+0000","last_undegraded":"2023-08-27T11:25:24.911838+0000","last_fullsized":"2023-08-27T11:25:24.911838+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907876+0000","last_change":"2023-08-27T11:25:24.907876+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907876+0000","last_undegraded":"2023-08-27T11:25:24.907876+0000","last_fullsized":"2023-08-27T11:25:24.907876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900826+0000","last_change":"2023-08-27T11:25:24.900826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900826+0000","last_undegraded":"2023-08-27T11:25:24.900826+0000","last_fullsized":"2023-08-27T11:25:24.900826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908266+0000","last_change":"2023-08-27T11:25:24.908266+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908266+0000","last_undegraded":"2023-08-27T11:25:24.908266+0000","last_fullsized":"2023-08-27T11:25:24.908266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906424+0000","last_change":"2023-08-27T11:25:24.906424+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906424+0000","last_undegraded":"2023-08-27T11:25:24.906424+0000","last_fullsized":"2023-08-27T11:25:24.906424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906832+0000","last_change":"2023-08-27T11:25:24.906832+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906832+0000","last_undegraded":"2023-08-27T11:25:24.906832+0000","last_fullsized":"2023-08-27T11:25:24.906832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906565+0000","last_change":"2023-08-27T11:25:24.906565+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906565+0000","last_undegraded":"2023-08-27T11:25:24.906565+0000","last_fullsized":"2023-08-27T11:25:24.906565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911042+0000","last_change":"2023-08-27T11:25:24.911042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911042+0000","last_undegraded":"2023-08-27T11:25:24.911042+0000","last_fullsized":"2023-08-27T11:25:24.911042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913516+0000","last_change":"2023-08-27T11:25:24.908438+0000","last_active":"2023-08-27T11:25:24.913516+0000","last_peered":"2023-08-27T11:25:24.913516+0000","last_clean":"2023-08-27T11:25:24.913516+0000","last_became_active":"2023-08-27T11:25:24.908166+0000","last_became_peered":"2023-08-27T11:25:24.908166+0000","last_unstale":"2023-08-27T11:25:24.913516+0000","last_undegraded":"2023-08-27T11:25:24.913516+0000","last_fullsized":"2023-08-27T11:25:24.913516+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:48:16.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907696+0000","last_change":"2023-08-27T11:25:24.907696+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907696+0000","last_undegraded":"2023-08-27T11:25:24.907696+0000","last_fullsized":"2023-08-27T11:25:24.907696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938563+0000","last_change":"2023-08-27T11:25:24.931041+0000","last_active":"2023-08-27T11:25:24.938563+0000","last_peered":"2023-08-27T11:25:24.938563+0000","last_clean":"2023-08-27T11:25:24.938563+0000","last_became_active":"2023-08-27T11:25:24.930712+0000","last_became_peered":"2023-08-27T11:25:24.930712+0000","last_unstale":"2023-08-27T11:25:24.938563+0000","last_undegraded":"2023-08-27T11:25:24.938563+0000","last_fullsized":"2023-08-27T11:25:24.938563+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:24.612963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910301+0000","last_change":"2023-08-27T11:25:24.910301+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910301+0000","last_undegraded":"2023-08-27T11:25:24.910301+0000","last_fullsized":"2023-08-27T11:25:24.910301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925784+0000","last_change":"2023-08-27T11:25:24.919539+0000","last_active":"2023-08-27T11:25:24.925784+0000","last_peered":"2023-08-27T11:25:24.925784+0000","last_clean":"2023-08-27T11:25:24.925784+0000","last_became_active":"2023-08-27T11:25:24.919241+0000","last_became_peered":"2023-08-27T11:25:24.919241+0000","last_unstale":"2023-08-27T11:25:24.925784+0000","last_undegraded":"2023-08-27T11:25:24.925784+0000","last_fullsized":"2023-08-27T11:25:24.925784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:37:07.671605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911116+0000","last_change":"2023-08-27T11:25:24.911116+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911116+0000","last_undegraded":"2023-08-27T11:25:24.911116+0000","last_fullsized":"2023-08-27T11:25:24.911116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930231+0000","last_change":"2023-08-27T11:25:24.920378+0000","last_active":"2023-08-27T11:25:24.930231+0000","last_peered":"2023-08-27T11:25:24.930231+0000","last_clean":"2023-08-27T11:25:24.930231+0000","last_became_active":"2023-08-27T11:25:24.919551+0000","last_became_peered":"2023-08-27T11:25:24.919551+0000","last_unstale":"2023-08-27T11:25:24.930231+0000","last_undegraded":"2023-08-27T11:25:24.930231+0000","last_fullsized":"2023-08-27T11:25:24.930231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:00.552725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909135+0000","last_change":"2023-08-27T11:25:24.909135+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909135+0000","last_undegraded":"2023-08-27T11:25:24.909135+0000","last_fullsized":"2023-08-27T11:25:24.909135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.927274+0000","last_change":"2023-08-27T11:25:24.923303+0000","last_active":"2023-08-27T11:25:24.927274+0000","last_peered":"2023-08-27T11:25:24.927274+0000","last_clean":"2023-08-27T11:25:24.927274+0000","last_became_active":"2023-08-27T11:25:24.922964+0000","last_became_peered":"2023-08-27T11:25:24.922964+0000","last_unstale":"2023-08-27T11:25:24.927274+0000","last_undegraded":"2023-08-27T11:25:24.927274+0000","last_fullsized":"2023-08-27T11:25:24.927274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:29.347866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907095+0000","last_change":"2023-08-27T11:25:24.907095+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907095+0000","last_undegraded":"2023-08-27T11:25:24.907095+0000","last_fullsized":"2023-08-27T11:25:24.907095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930384+0000","last_change":"2023-08-27T11:25:24.924224+0000","last_active":"2023-08-27T11:25:24.930384+0000","last_peered":"2023-08-27T11:25:24.930384+0000","last_clean":"2023-08-27T11:25:24.930384+0000","last_became_active":"2023-08-27T11:25:24.923933+0000","last_became_peered":"2023-08-27T11:25:24.923933+0000","last_unstale":"2023-08-27T11:25:24.930384+0000","last_undegraded":"2023-08-27T11:25:24.930384+0000","last_fullsized":"2023-08-27T11:25:24.930384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:27:14.972078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910854+0000","last_change":"2023-08-27T11:25:24.910854+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910854+0000","last_undegraded":"2023-08-27T11:25:24.910854+0000","last_fullsized":"2023-08-27T11:25:24.910854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925992+0000","last_change":"2023-08-27T11:25:24.925097+0000","last_active":"2023-08-27T11:25:24.925992+0000","last_peered":"2023-08-27T11:25:24.925992+0000","last_clean":"2023-08-27T11:25:24.925992+0000","last_became_active":"2023-08-27T11:25:24.924803+0000","last_became_peered":"2023-08-27T11:25:24.924803+0000","last_unstale":"2023-08-27T11:25:24.925992+0000","last_undegraded":"2023-08-27T11:25:24.925992+0000","last_fullsized":"2023-08-27T11:25:24.925992+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:21.132856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908271+0000","last_change":"2023-08-27T11:25:24.908271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908271+0000","last_undegraded":"2023-08-27T11:25:24.908271+0000","last_fullsized":"2023-08-27T11:25:24.908271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923380+0000","last_change":"2023-08-27T11:25:24.921040+0000","last_active":"2023-08-27T11:25:24.923380+0000","last_peered":"2023-08-27T11:25:24.923380+0000","last_clean":"2023-08-27T11:25:24.923380+0000","last_became_active":"2023-08-27T11:25:24.920745+0000","last_became_peered":"2023-08-27T11:25:24.920745+0000","last_unstale":"2023-08-27T11:25:24.923380+0000","last_undegraded":"2023-08-27T11:25:24.923380+0000","last_fullsized":"2023-08-27T11:25:24.923380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:13:43.404011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907161+0000","last_change":"2023-08-27T11:25:24.907161+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907161+0000","last_undegraded":"2023-08-27T11:25:24.907161+0000","last_fullsized":"2023-08-27T11:25:24.907161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938590+0000","last_change":"2023-08-27T11:25:24.931138+0000","last_active":"2023-08-27T11:25:24.938590+0000","last_peered":"2023-08-27T11:25:24.938590+0000","last_clean":"2023-08-27T11:25:24.938590+0000","last_became_active":"2023-08-27T11:25:24.930796+0000","last_became_peered":"2023-08-27T11:25:24.930796+0000","last_unstale":"2023-08-27T11:25:24.938590+0000","last_undegraded":"2023-08-27T11:25:24.938590+0000","last_fullsized":"2023-08-27T11:25:24.938590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:48.291105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912052+0000","last_change":"2023-08-27T11:25:24.912052+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912052+0000","last_undegraded":"2023-08-27T11:25:24.912052+0000","last_fullsized":"2023-08-27T11:25:24.912052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930349+0000","last_change":"2023-08-27T11:25:24.923906+0000","last_active":"2023-08-27T11:25:24.930349+0000","last_peered":"2023-08-27T11:25:24.930349+0000","last_clean":"2023-08-27T11:25:24.930349+0000","last_became_active":"2023-08-27T11:25:24.923601+0000","last_became_peered":"2023-08-27T11:25:24.923601+0000","last_unstale":"2023-08-27T11:25:24.930349+0000","last_undegraded":"2023-08-27T11:25:24.930349+0000","last_fullsized":"2023-08-27T11:25:24.930349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:10.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902989+0000","last_change":"2023-08-27T11:25:24.902989+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902989+0000","last_undegraded":"2023-08-27T11:25:24.902989+0000","last_fullsized":"2023-08-27T11:25:24.902989+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922741+0000","last_change":"2023-08-27T11:25:24.918632+0000","last_active":"2023-08-27T11:25:24.922741+0000","last_peered":"2023-08-27T11:25:24.922741+0000","last_clean":"2023-08-27T11:25:24.922741+0000","last_became_active":"2023-08-27T11:25:24.918354+0000","last_became_peered":"2023-08-27T11:25:24.918354+0000","last_unstale":"2023-08-27T11:25:24.922741+0000","last_undegraded":"2023-08-27T11:25:24.922741+0000","last_fullsized":"2023-08-27T11:25:24.922741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:40.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907234+0000","last_change":"2023-08-27T11:25:24.907234+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907234+0000","last_undegraded":"2023-08-27T11:25:24.907234+0000","last_fullsized":"2023-08-27T11:25:24.907234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933117+0000","last_change":"2023-08-27T11:25:24.923843+0000","last_active":"2023-08-27T11:25:24.933117+0000","last_peered":"2023-08-27T11:25:24.933117+0000","last_clean":"2023-08-27T11:25:24.933117+0000","last_became_active":"2023-08-27T11:25:24.923525+0000","last_became_peered":"2023-08-27T11:25:24.923525+0000","last_unstale":"2023-08-27T11:25:24.933117+0000","last_undegraded":"2023-08-27T11:25:24.933117+0000","last_fullsized":"2023-08-27T11:25:24.933117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:44.335083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912737+0000","last_change":"2023-08-27T11:25:24.912737+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912737+0000","last_undegraded":"2023-08-27T11:25:24.912737+0000","last_fullsized":"2023-08-27T11:25:24.912737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930402+0000","last_change":"2023-08-27T11:25:24.925180+0000","last_active":"2023-08-27T11:25:24.930402+0000","last_peered":"2023-08-27T11:25:24.930402+0000","last_clean":"2023-08-27T11:25:24.930402+0000","last_became_active":"2023-08-27T11:25:24.924811+0000","last_became_peered":"2023-08-27T11:25:24.924811+0000","last_unstale":"2023-08-27T11:25:24.930402+0000","last_undegraded":"2023-08-27T11:25:24.930402+0000","last_fullsized":"2023-08-27T11:25:24.930402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:36:42.056591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908182+0000","last_change":"2023-08-27T11:25:24.908182+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908182+0000","last_undegraded":"2023-08-27T11:25:24.908182+0000","last_fullsized":"2023-08-27T11:25:24.908182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925507+0000","last_change":"2023-08-27T11:25:24.921229+0000","last_active":"2023-08-27T11:25:24.925507+0000","last_peered":"2023-08-27T11:25:24.925507+0000","last_clean":"2023-08-27T11:25:24.925507+0000","last_became_active":"2023-08-27T11:25:24.920853+0000","last_became_peered":"2023-08-27T11:25:24.920853+0000","last_unstale":"2023-08-27T11:25:24.925507+0000","last_undegraded":"2023-08-27T11:25:24.925507+0000","last_fullsized":"2023-08-27T11:25:24.925507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:42:03.470213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906401+0000","last_change":"2023-08-27T11:25:24.906401+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906401+0000","last_undegraded":"2023-08-27T11:25:24.906401+0000","last_fullsized":"2023-08-27T11:25:24.906401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913573+0000","last_change":"2023-08-27T11:25:24.906755+0000","last_active":"2023-08-27T11:25:24.913573+0000","last_peered":"2023-08-27T11:25:24.913573+0000","last_clean":"2023-08-27T11:25:24.913573+0000","last_became_active":"2023-08-27T11:25:24.906473+0000","last_became_peered":"2023-08-27T11:25:24.906473+0000","last_unstale":"2023-08-27T11:25:24.913573+0000","last_undegraded":"2023-08-27T11:25:24.913573+0000","last_fullsized":"2023-08-27T11:25:24.913573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:43:43.749717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906530+0000","last_change":"2023-08-27T11:25:24.906530+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906530+0000","last_undegraded":"2023-08-27T11:25:24.906530+0000","last_fullsized":"2023-08-27T11:25:24.906530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925685+0000","last_change":"2023-08-27T11:25:24.923864+0000","last_active":"2023-08-27T11:25:24.925685+0000","last_peered":"2023-08-27T11:25:24.925685+0000","last_clean":"2023-08-27T11:25:24.925685+0000","last_became_active":"2023-08-27T11:25:24.923584+0000","last_became_peered":"2023-08-27T11:25:24.923584+0000","last_unstale":"2023-08-27T11:25:24.925685+0000","last_undegraded":"2023-08-27T11:25:24.925685+0000","last_fullsized":"2023-08-27T11:25:24.925685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:28.497788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910195+0000","last_change":"2023-08-27T11:25:24.910195+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910195+0000","last_undegraded":"2023-08-27T11:25:24.910195+0000","last_fullsized":"2023-08-27T11:25:24.910195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930303+0000","last_change":"2023-08-27T11:25:24.922363+0000","last_active":"2023-08-27T11:25:24.930303+0000","last_peered":"2023-08-27T11:25:24.930303+0000","last_clean":"2023-08-27T11:25:24.930303+0000","last_became_active":"2023-08-27T11:25:24.922020+0000","last_became_peered":"2023-08-27T11:25:24.922020+0000","last_unstale":"2023-08-27T11:25:24.930303+0000","last_undegraded":"2023-08-27T11:25:24.930303+0000","last_fullsized":"2023-08-27T11:25:24.930303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:25:19.168348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908352+0000","last_change":"2023-08-27T11:25:24.908352+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908352+0000","last_undegraded":"2023-08-27T11:25:24.908352+0000","last_fullsized":"2023-08-27T11:25:24.908352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.919782+0000","last_change":"2023-08-27T11:25:24.917472+0000","last_active":"2023-08-27T11:25:24.919782+0000","last_peered":"2023-08-27T11:25:24.919782+0000","last_clean":"2023-08-27T11:25:24.919782+0000","last_became_active":"2023-08-27T11:25:24.917200+0000","last_became_peered":"2023-08-27T11:25:24.917200+0000","last_unstale":"2023-08-27T11:25:24.919782+0000","last_undegraded":"2023-08-27T11:25:24.919782+0000","last_fullsized":"2023-08-27T11:25:24.919782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:22:47.877904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909691+0000","last_change":"2023-08-27T11:25:24.909691+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909691+0000","last_undegraded":"2023-08-27T11:25:24.909691+0000","last_fullsized":"2023-08-27T11:25:24.909691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925808+0000","last_change":"2023-08-27T11:25:24.920783+0000","last_active":"2023-08-27T11:25:24.925808+0000","last_peered":"2023-08-27T11:25:24.925808+0000","last_clean":"2023-08-27T11:25:24.925808+0000","last_became_active":"2023-08-27T11:25:24.920476+0000","last_became_peered":"2023-08-27T11:25:24.920476+0000","last_unstale":"2023-08-27T11:25:24.925808+0000","last_undegraded":"2023-08-27T11:25:24.925808+0000","last_fullsized":"2023-08-27T11:25:24.925808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:35.904348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907859+0000","last_change":"2023-08-27T11:25:24.907859+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907859+0000","last_undegraded":"2023-08-27T11:25:24.907859+0000","last_fullsized":"2023-08-27T11:25:24.907859+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933208+0000","last_change":"2023-08-27T11:25:24.926030+0000","last_active":"2023-08-27T11:25:24.933208+0000","last_peered":"2023-08-27T11:25:24.933208+0000","last_clean":"2023-08-27T11:25:24.933208+0000","last_became_active":"2023-08-27T11:25:24.925704+0000","last_became_peered":"2023-08-27T11:25:24.925704+0000","last_unstale":"2023-08-27T11:25:24.933208+0000","last_undegraded":"2023-08-27T11:25:24.933208+0000","last_fullsized":"2023-08-27T11:25:24.933208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:34.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906973+0000","last_change":"2023-08-27T11:25:24.906973+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906973+0000","last_undegraded":"2023-08-27T11:25:24.906973+0000","last_fullsized":"2023-08-27T11:25:24.906973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930154+0000","last_change":"2023-08-27T11:25:24.919971+0000","last_active":"2023-08-27T11:25:24.930154+0000","last_peered":"2023-08-27T11:25:24.930154+0000","last_clean":"2023-08-27T11:25:24.930154+0000","last_became_active":"2023-08-27T11:25:24.919560+0000","last_became_peered":"2023-08-27T11:25:24.919560+0000","last_unstale":"2023-08-27T11:25:24.930154+0000","last_undegraded":"2023-08-27T11:25:24.930154+0000","last_fullsized":"2023-08-27T11:25:24.930154+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:30:14.218994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907238+0000","last_change":"2023-08-27T11:25:24.907238+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907238+0000","last_undegraded":"2023-08-27T11:25:24.907238+0000","last_fullsized":"2023-08-27T11:25:24.907238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913622+0000","last_change":"2023-08-27T11:25:24.908964+0000","last_active":"2023-08-27T11:25:24.913622+0000","last_peered":"2023-08-27T11:25:24.913622+0000","last_clean":"2023-08-27T11:25:24.913622+0000","last_became_active":"2023-08-27T11:25:24.908673+0000","last_became_peered":"2023-08-27T11:25:24.908673+0000","last_unstale":"2023-08-27T11:25:24.913622+0000","last_undegraded":"2023-08-27T11:25:24.913622+0000","last_fullsized":"2023-08-27T11:25:24.913622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:07:44.263637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906790+0000","last_change":"2023-08-27T11:25:24.906790+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906790+0000","last_undegraded":"2023-08-27T11:25:24.906790+0000","last_fullsized":"2023-08-27T11:25:24.906790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933167+0000","last_change":"2023-08-27T11:25:24.923991+0000","last_active":"2023-08-27T11:25:24.933167+0000","last_peered":"2023-08-27T11:25:24.933167+0000","last_clean":"2023-08-27T11:25:24.933167+0000","last_became_active":"2023-08-27T11:25:24.923644+0000","last_became_peered":"2023-08-27T11:25:24.923644+0000","last_unstale":"2023-08-27T11:25:24.933167+0000","last_undegraded":"2023-08-27T11:25:24.933167+0000","last_fullsized":"2023-08-27T11:25:24.933167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:09.884899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907681+0000","last_change":"2023-08-27T11:25:24.907681+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907681+0000","last_undegraded":"2023-08-27T11:25:24.907681+0000","last_fullsized":"2023-08-27T11:25:24.907681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925536+0000","last_change":"2023-08-27T11:25:24.923852+0000","last_active":"2023-08-27T11:25:24.925536+0000","last_peered":"2023-08-27T11:25:24.925536+0000","last_clean":"2023-08-27T11:25:24.925536+0000","last_became_active":"2023-08-27T11:25:24.923556+0000","last_became_peered":"2023-08-27T11:25:24.923556+0000","last_unstale":"2023-08-27T11:25:24.925536+0000","last_undegraded":"2023-08-27T11:25:24.925536+0000","last_fullsized":"2023-08-27T11:25:24.925536+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:37:53.371732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900830+0000","last_change":"2023-08-27T11:25:24.900830+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900830+0000","last_undegraded":"2023-08-27T11:25:24.900830+0000","last_fullsized":"2023-08-27T11:25:24.900830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923277+0000","last_change":"2023-08-27T11:25:24.920647+0000","last_active":"2023-08-27T11:25:24.923277+0000","last_peered":"2023-08-27T11:25:24.923277+0000","last_clean":"2023-08-27T11:25:24.923277+0000","last_became_active":"2023-08-27T11:25:24.920179+0000","last_became_peered":"2023-08-27T11:25:24.920179+0000","last_unstale":"2023-08-27T11:25:24.923277+0000","last_undegraded":"2023-08-27T11:25:24.923277+0000","last_fullsized":"2023-08-27T11:25:24.923277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:23.867540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.914871+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:25:24.914871+0000","last_peered":"2023-08-27T11:25:24.914871+0000","last_clean":"2023-08-27T11:25:24.914871+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:25:24.914871+0000","last_undegraded":"2023-08-27T11:25:24.914871+0000","last_fullsized":"2023-08-27T11:25:24.914871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:27.315983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902693+0000","last_change":"2023-08-27T11:25:24.902693+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902693+0000","last_undegraded":"2023-08-27T11:25:24.902693+0000","last_fullsized":"2023-08-27T11:25:24.902693+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.918762+0000","last_change":"2023-08-27T11:25:24.916105+0000","last_active":"2023-08-27T11:25:24.918762+0000","last_peered":"2023-08-27T11:25:24.918762+0000","last_clean":"2023-08-27T11:25:24.918762+0000","last_became_active":"2023-08-27T11:25:24.915828+0000","last_became_peered":"2023-08-27T11:25:24.915828+0000","last_unstale":"2023-08-27T11:25:24.918762+0000","last_undegraded":"2023-08-27T11:25:24.918762+0000","last_fullsized":"2023-08-27T11:25:24.918762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:48:57.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.915313+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:25:24.915313+0000","last_peered":"2023-08-27T11:25:24.915313+0000","last_clean":"2023-08-27T11:25:24.915313+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:25:24.915313+0000","last_undegraded":"2023-08-27T11:25:24.915313+0000","last_fullsized":"2023-08-27T11:25:24.915313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:35.315388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908695+0000","last_change":"2023-08-27T11:25:24.908695+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908695+0000","last_undegraded":"2023-08-27T11:25:24.908695+0000","last_fullsized":"2023-08-27T11:25:24.908695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922896+0000","last_change":"2023-08-27T11:25:24.918132+0000","last_active":"2023-08-27T11:25:24.922896+0000","last_peered":"2023-08-27T11:25:24.922896+0000","last_clean":"2023-08-27T11:25:24.922896+0000","last_became_active":"2023-08-27T11:25:24.917778+0000","last_became_peered":"2023-08-27T11:25:24.917778+0000","last_unstale":"2023-08-27T11:25:24.922896+0000","last_undegraded":"2023-08-27T11:25:24.922896+0000","last_fullsized":"2023-08-27T11:25:24.922896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:09:31.700567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912353+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:25:24.912353+0000","last_peered":"2023-08-27T11:25:24.912353+0000","last_clean":"2023-08-27T11:25:24.912353+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:25:24.912353+0000","last_undegraded":"2023-08-27T11:25:24.912353+0000","last_fullsized":"2023-08-27T11:25:24.912353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:46.491417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907465+0000","last_change":"2023-08-27T11:25:24.907465+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907465+0000","last_undegraded":"2023-08-27T11:25:24.907465+0000","last_fullsized":"2023-08-27T11:25:24.907465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925010+0000","last_change":"2023-08-27T11:25:24.919858+0000","last_active":"2023-08-27T11:25:24.925010+0000","last_peered":"2023-08-27T11:25:24.925010+0000","last_clean":"2023-08-27T11:25:24.925010+0000","last_became_active":"2023-08-27T11:25:24.919538+0000","last_became_peered":"2023-08-27T11:25:24.919538+0000","last_unstale":"2023-08-27T11:25:24.925010+0000","last_undegraded":"2023-08-27T11:25:24.925010+0000","last_fullsized":"2023-08-27T11:25:24.925010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:36.569893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908412+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:25:24.908412+0000","last_peered":"2023-08-27T11:25:24.908412+0000","last_clean":"2023-08-27T11:25:24.908412+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:25:24.908412+0000","last_undegraded":"2023-08-27T11:25:24.908412+0000","last_fullsized":"2023-08-27T11:25:24.908412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:49.505429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907104+0000","last_change":"2023-08-27T11:25:24.907104+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907104+0000","last_undegraded":"2023-08-27T11:25:24.907104+0000","last_fullsized":"2023-08-27T11:25:24.907104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923000+0000","last_change":"2023-08-27T11:25:24.912962+0000","last_active":"2023-08-27T11:25:24.923000+0000","last_peered":"2023-08-27T11:25:24.923000+0000","last_clean":"2023-08-27T11:25:24.923000+0000","last_became_active":"2023-08-27T11:25:24.912591+0000","last_became_peered":"2023-08-27T11:25:24.912591+0000","last_unstale":"2023-08-27T11:25:24.923000+0000","last_undegraded":"2023-08-27T11:25:24.923000+0000","last_fullsized":"2023-08-27T11:25:24.923000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:40.589564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.909416+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:25:24.909416+0000","last_peered":"2023-08-27T11:25:24.909416+0000","last_clean":"2023-08-27T11:25:24.909416+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:25:24.909416+0000","last_undegraded":"2023-08-27T11:25:24.909416+0000","last_fullsized":"2023-08-27T11:25:24.909416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:21.136228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910460+0000","last_change":"2023-08-27T11:25:24.910460+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910460+0000","last_undegraded":"2023-08-27T11:25:24.910460+0000","last_fullsized":"2023-08-27T11:25:24.910460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925390+0000","last_change":"2023-08-27T11:25:24.919759+0000","last_active":"2023-08-27T11:25:24.925390+0000","last_peered":"2023-08-27T11:25:24.925390+0000","last_clean":"2023-08-27T11:25:24.925390+0000","last_became_active":"2023-08-27T11:25:24.919456+0000","last_became_peered":"2023-08-27T11:25:24.919456+0000","last_unstale":"2023-08-27T11:25:24.925390+0000","last_undegraded":"2023-08-27T11:25:24.925390+0000","last_fullsized":"2023-08-27T11:25:24.925390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:52.084751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":246,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908237+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:25:24.908237+0000","last_peered":"2023-08-27T11:25:24.908237+0000","last_clean":"2023-08-27T11:25:24.908237+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:25:24.908237+0000","last_undegraded":"2023-08-27T11:25:24.908237+0000","last_fullsized":"2023-08-27T11:25:24.908237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:42.306664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912691+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:25:24.912691+0000","last_peered":"2023-08-27T11:25:24.912691+0000","last_clean":"2023-08-27T11:25:24.912691+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:25:24.912691+0000","last_undegraded":"2023-08-27T11:25:24.912691+0000","last_fullsized":"2023-08-27T11:25:24.912691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:28.567657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900797+0000","last_change":"2023-08-27T11:25:24.900797+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900797+0000","last_undegraded":"2023-08-27T11:25:24.900797+0000","last_fullsized":"2023-08-27T11:25:24.900797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.926508+0000","last_change":"2023-08-27T11:25:24.920798+0000","last_active":"2023-08-27T11:25:24.926508+0000","last_peered":"2023-08-27T11:25:24.926508+0000","last_clean":"2023-08-27T11:25:24.926508+0000","last_became_active":"2023-08-27T11:25:24.920323+0000","last_became_peered":"2023-08-27T11:25:24.920323+0000","last_unstale":"2023-08-27T11:25:24.926508+0000","last_undegraded":"2023-08-27T11:25:24.926508+0000","last_fullsized":"2023-08-27T11:25:24.926508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:16.520166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.904792+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:25:24.904792+0000","last_peered":"2023-08-27T11:25:24.904792+0000","last_clean":"2023-08-27T11:25:24.904792+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:25:24.904792+0000","last_undegraded":"2023-08-27T11:25:24.904792+0000","last_fullsized":"2023-08-27T11:25:24.904792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:16.030989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901271+0000","last_change":"2023-08-27T11:25:24.901271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901271+0000","last_undegraded":"2023-08-27T11:25:24.901271+0000","last_fullsized":"2023-08-27T11:25:24.901271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925398+0000","last_change":"2023-08-27T11:25:24.919905+0000","last_active":"2023-08-27T11:25:24.925398+0000","last_peered":"2023-08-27T11:25:24.925398+0000","last_clean":"2023-08-27T11:25:24.925398+0000","last_became_active":"2023-08-27T11:25:24.919452+0000","last_became_peered":"2023-08-27T11:25:24.919452+0000","last_unstale":"2023-08-27T11:25:24.925398+0000","last_undegraded":"2023-08-27T11:25:24.925398+0000","last_fullsized":"2023-08-27T11:25:24.925398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:47.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.916000+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:25:24.916000+0000","last_peered":"2023-08-27T11:25:24.916000+0000","last_clean":"2023-08-27T11:25:24.916000+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:25:24.916000+0000","last_undegraded":"2023-08-27T11:25:24.916000+0000","last_fullsized":"2023-08-27T11:25:24.916000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:44.816245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":1.018},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.97399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":1.032},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.087},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.82299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.871}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.94099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.372},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.434}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.439},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69299999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.92800000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:25:30.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:25:31.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.092+0000 7fcf51fff700 1 Processor -- start 2023-08-27T11:25:31.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.093+0000 7fcf51fff700 1 -- start start 2023-08-27T11:25:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 0x7fcf4c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c06ad70 0x7fcf4c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c06c4e0 con 0x7fcf4c0c4630 2023-08-27T11:25:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c155370 con 0x7fcf4c151a90 2023-08-27T11:25:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf51fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c151e70 con 0x7fcf4c06ad70 2023-08-27T11:25:31.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38496/0 (socket says 172.21.15.43:38496) 2023-08-27T11:25:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 -- 172.21.15.43:0/4075430555 learned_addr learned my addr 172.21.15.43:0/4075430555 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 -- 172.21.15.43:0/4075430555 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c06ad70 msgr2=0x7fcf4c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 --2- 172.21.15.43:0/4075430555 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c06ad70 0x7fcf4c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4affd700 1 -- 172.21.15.43:0/4075430555 >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 msgr2=0x7fcf4c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.094+0000 7fcf4b7fe700 1 --2- 172.21.15.43:0/4075430555 >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 0x7fcf4c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4affd700 1 --2- 172.21.15.43:0/4075430555 >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 0x7fcf4c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4affd700 1 -- 172.21.15.43:0/4075430555 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c154480 con 0x7fcf4c0c4630 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4b7fe700 1 --2- 172.21.15.43:0/4075430555 >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 0x7fcf4c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4affd700 1 --2- 172.21.15.43:0/4075430555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c067710 tx=0x7fcf40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddac9c896829c91 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4a7fc700 1 -- 172.21.15.43:0/4075430555 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000b870 con 0x7fcf4c0c4630 2023-08-27T11:25:31.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4a7fc700 1 -- 172.21.15.43:0/4075430555 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4000b9d0 con 0x7fcf4c0c4630 2023-08-27T11:25:31.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.095+0000 7fcf4a7fc700 1 -- 172.21.15.43:0/4075430555 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000bd60 con 0x7fcf4c0c4630 2023-08-27T11:25:31.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 -- 172.21.15.43:0/4075430555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c0c4630 msgr2=0x7fcf4c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 --2- 172.21.15.43:0/4075430555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c067710 tx=0x7fcf40009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 -- 172.21.15.43:0/4075430555 shutdown_connections 2023-08-27T11:25:31.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 --2- 172.21.15.43:0/4075430555 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c06ad70 0x7fcf4c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 --2- 172.21.15.43:0/4075430555 >> v2:172.21.15.57:3300/0 conn(0x7fcf4c151a90 0x7fcf4c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 --2- 172.21.15.43:0/4075430555 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c0c4630 0x7fcf4c0c4a90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 -- 172.21.15.43:0/4075430555 >> 172.21.15.43:0/4075430555 conn(0x7fcf4c0ab820 msgr2=0x7fcf4c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:31.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 -- 172.21.15.43:0/4075430555 shutdown_connections 2023-08-27T11:25:31.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.096+0000 7fcf51fff700 1 -- 172.21.15.43:0/4075430555 wait complete. 2023-08-27T11:25:31.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.098+0000 7fcf51fff700 1 Processor -- start 2023-08-27T11:25:31.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.098+0000 7fcf51fff700 1 -- start start 2023-08-27T11:25:31.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c0c4630 0x7fcf4c1ed360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf4c151a90 0x7fcf4c0c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c148c20 con 0x7fcf4c06ad70 2023-08-27T11:25:31.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1ea1f0 con 0x7fcf4c151a90 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf51fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1ed8a0 con 0x7fcf4c0c4630 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38498/0 (socket says 172.21.15.43:38498) 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4b7fe700 1 -- 172.21.15.43:0/3375493828 learned_addr learned my addr 172.21.15.43:0/3375493828 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4affd700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c0c4630 0x7fcf4c1ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4bfff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf4c151a90 0x7fcf4c0c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4b7fe700 1 -- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c0c4630 msgr2=0x7fcf4c1ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.099+0000 7fcf4b7fe700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c0c4630 0x7fcf4c1ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf4b7fe700 1 -- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf4c151a90 msgr2=0x7fcf4c0c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf4b7fe700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf4c151a90 0x7fcf4c0c0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf4b7fe700 1 -- 172.21.15.43:0/3375493828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40009550 con 0x7fcf4c06ad70 2023-08-27T11:25:31.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf4b7fe700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c820 tx=0x7fcf3c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c011800 con 0x7fcf4c06ad70 2023-08-27T11:25:31.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c011960 con 0x7fcf4c06ad70 2023-08-27T11:25:31.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c011cf0 con 0x7fcf4c06ad70 2023-08-27T11:25:31.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c149430 con 0x7fcf4c06ad70 2023-08-27T11:25:31.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.100+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c149150 con 0x7fcf4c06ad70 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.101+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0c81f0 con 0x7fcf4c06ad70 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.102+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf3c0233a0 con 0x7fcf4c06ad70 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.103+0000 7fcf33fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 0x7fcf3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.103+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf3c088800 con 0x7fcf4c06ad70 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.103+0000 7fcf4affd700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 0x7fcf3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.104+0000 7fcf4affd700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 0x7fcf3806c5a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.108+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf3c053e60 con 0x7fcf4c06ad70 2023-08-27T11:25:31.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.311+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf4c154a40 con 0x7fcf3806a0e0 2023-08-27T11:25:31.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.322+0000 7fcf33fff700 1 -- 172.21.15.43:0/3375493828 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306255 (secure 0 0 0) 0x7fcf4000bcf0 con 0x7fcf3806a0e0 2023-08-27T11:25:31.328 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:31.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 msgr2=0x7fcf3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 0x7fcf3806c5a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40008030 comp rx=0 tx=0).stop 2023-08-27T11:25:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 msgr2=0x7fcf4c0c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c00c820 tx=0x7fcf3c00cb30 comp rx=0 tx=0).stop 2023-08-27T11:25:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 shutdown_connections 2023-08-27T11:25:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf3806a0e0 0x7fcf3806c5a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf4c151a90 0x7fcf4c0c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf4c06ad70 0x7fcf4c0c3570 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 --2- 172.21.15.43:0/3375493828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf4c0c4630 0x7fcf4c1ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 >> 172.21.15.43:0/3375493828 conn(0x7fcf4c0ab820 msgr2=0x7fcf4c14e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 shutdown_connections 2023-08-27T11:25:31.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.326+0000 7fcf51fff700 1 -- 172.21.15.43:0/3375493828 wait complete. 2023-08-27T11:25:31.333 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:25:31.346 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-08-27T11:25:30.346279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223560,"kb_used_data":7392,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754751160,"statfs":{"total":773094113280,"available":772865187840,"internally_reserved":0,"allocated":7569408,"data_stored":4098632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000975"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908291+0000","last_change":"2023-08-27T11:25:24.908291+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908291+0000","last_undegraded":"2023-08-27T11:25:24.908291+0000","last_fullsized":"2023-08-27T11:25:24.908291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910924+0000","last_change":"2023-08-27T11:25:24.910924+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910924+0000","last_undegraded":"2023-08-27T11:25:24.910924+0000","last_fullsized":"2023-08-27T11:25:24.910924+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911420+0000","last_change":"2023-08-27T11:25:24.911420+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911420+0000","last_undegraded":"2023-08-27T11:25:24.911420+0000","last_fullsized":"2023-08-27T11:25:24.911420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.915042+0000","last_change":"2023-08-27T11:25:24.915042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.915042+0000","last_undegraded":"2023-08-27T11:25:24.915042+0000","last_fullsized":"2023-08-27T11:25:24.915042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903993+0000","last_change":"2023-08-27T11:25:24.903993+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903993+0000","last_undegraded":"2023-08-27T11:25:24.903993+0000","last_fullsized":"2023-08-27T11:25:24.903993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903826+0000","last_change":"2023-08-27T11:25:24.903826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903826+0000","last_undegraded":"2023-08-27T11:25:24.903826+0000","last_fullsized":"2023-08-27T11:25:24.903826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908844+0000","last_change":"2023-08-27T11:25:24.908844+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908844+0000","last_undegraded":"2023-08-27T11:25:24.908844+0000","last_fullsized":"2023-08-27T11:25:24.908844+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903260+0000","last_change":"2023-08-27T11:25:24.903260+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903260+0000","last_undegraded":"2023-08-27T11:25:24.903260+0000","last_fullsized":"2023-08-27T11:25:24.903260+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912894+0000","last_change":"2023-08-27T11:25:24.912894+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912894+0000","last_undegraded":"2023-08-27T11:25:24.912894+0000","last_fullsized":"2023-08-27T11:25:24.912894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912390+0000","last_change":"2023-08-27T11:25:24.912390+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912390+0000","last_undegraded":"2023-08-27T11:25:24.912390+0000","last_fullsized":"2023-08-27T11:25:24.912390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907613+0000","last_change":"2023-08-27T11:25:24.907613+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907613+0000","last_undegraded":"2023-08-27T11:25:24.907613+0000","last_fullsized":"2023-08-27T11:25:24.907613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.914370+0000","last_change":"2023-08-27T11:25:24.914370+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.914370+0000","last_undegraded":"2023-08-27T11:25:24.914370+0000","last_fullsized":"2023-08-27T11:25:24.914370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903560+0000","last_change":"2023-08-27T11:25:24.903560+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903560+0000","last_undegraded":"2023-08-27T11:25:24.903560+0000","last_fullsized":"2023-08-27T11:25:24.903560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903415+0000","last_change":"2023-08-27T11:25:24.903415+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903415+0000","last_undegraded":"2023-08-27T11:25:24.903415+0000","last_fullsized":"2023-08-27T11:25:24.903415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908170+0000","last_change":"2023-08-27T11:25:24.908170+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908170+0000","last_undegraded":"2023-08-27T11:25:24.908170+0000","last_fullsized":"2023-08-27T11:25:24.908170+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907020+0000","last_change":"2023-08-27T11:25:24.907020+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907020+0000","last_undegraded":"2023-08-27T11:25:24.907020+0000","last_fullsized":"2023-08-27T11:25:24.907020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903505+0000","last_change":"2023-08-27T11:25:24.903505+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903505+0000","last_undegraded":"2023-08-27T11:25:24.903505+0000","last_fullsized":"2023-08-27T11:25:24.903505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907278+0000","last_change":"2023-08-27T11:25:24.907278+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907278+0000","last_undegraded":"2023-08-27T11:25:24.907278+0000","last_fullsized":"2023-08-27T11:25:24.907278+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901779+0000","last_change":"2023-08-27T11:25:24.901779+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901779+0000","last_undegraded":"2023-08-27T11:25:24.901779+0000","last_fullsized":"2023-08-27T11:25:24.901779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.904458+0000","last_change":"2023-08-27T11:25:24.904458+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.904458+0000","last_undegraded":"2023-08-27T11:25:24.904458+0000","last_fullsized":"2023-08-27T11:25:24.904458+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911655+0000","last_change":"2023-08-27T11:25:24.911655+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911655+0000","last_undegraded":"2023-08-27T11:25:24.911655+0000","last_fullsized":"2023-08-27T11:25:24.911655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.903036+0000","last_change":"2023-08-27T11:25:24.903036+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.903036+0000","last_undegraded":"2023-08-27T11:25:24.903036+0000","last_fullsized":"2023-08-27T11:25:24.903036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912134+0000","last_change":"2023-08-27T11:25:24.912134+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912134+0000","last_undegraded":"2023-08-27T11:25:24.912134+0000","last_fullsized":"2023-08-27T11:25:24.912134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908074+0000","last_change":"2023-08-27T11:25:24.908074+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908074+0000","last_undegraded":"2023-08-27T11:25:24.908074+0000","last_fullsized":"2023-08-27T11:25:24.908074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910917+0000","last_change":"2023-08-27T11:25:24.910917+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910917+0000","last_undegraded":"2023-08-27T11:25:24.910917+0000","last_fullsized":"2023-08-27T11:25:24.910917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911838+0000","last_change":"2023-08-27T11:25:24.911838+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911838+0000","last_undegraded":"2023-08-27T11:25:24.911838+0000","last_fullsized":"2023-08-27T11:25:24.911838+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907876+0000","last_change":"2023-08-27T11:25:24.907876+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907876+0000","last_undegraded":"2023-08-27T11:25:24.907876+0000","last_fullsized":"2023-08-27T11:25:24.907876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900826+0000","last_change":"2023-08-27T11:25:24.900826+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900826+0000","last_undegraded":"2023-08-27T11:25:24.900826+0000","last_fullsized":"2023-08-27T11:25:24.900826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908266+0000","last_change":"2023-08-27T11:25:24.908266+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908266+0000","last_undegraded":"2023-08-27T11:25:24.908266+0000","last_fullsized":"2023-08-27T11:25:24.908266+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906424+0000","last_change":"2023-08-27T11:25:24.906424+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906424+0000","last_undegraded":"2023-08-27T11:25:24.906424+0000","last_fullsized":"2023-08-27T11:25:24.906424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906832+0000","last_change":"2023-08-27T11:25:24.906832+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906832+0000","last_undegraded":"2023-08-27T11:25:24.906832+0000","last_fullsized":"2023-08-27T11:25:24.906832+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906565+0000","last_change":"2023-08-27T11:25:24.906565+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906565+0000","last_undegraded":"2023-08-27T11:25:24.906565+0000","last_fullsized":"2023-08-27T11:25:24.906565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911042+0000","last_change":"2023-08-27T11:25:24.911042+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911042+0000","last_undegraded":"2023-08-27T11:25:24.911042+0000","last_fullsized":"2023-08-27T11:25:24.911042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913516+0000","last_change":"2023-08-27T11:25:24.908438+0000","last_active":"2023-08-27T11:25:24.913516+0000","last_peered":"2023-08-27T11:25:24.913516+0000","last_clean":"2023-08-27T11:25:24.913516+0000","last_became_active":"2023-08-27T11:25:24.908166+0000","last_became_peered":"2023-08-27T11:25:24.908166+0000","last_unstale":"2023-08-27T11:25:24.913516+0000","last_undegraded":"2023-08-27T11:25:24.913516+0000","last_fullsized":"2023-08-27T11:25:24.913516+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:48:16.059779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907696+0000","last_change":"2023-08-27T11:25:24.907696+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907696+0000","last_undegraded":"2023-08-27T11:25:24.907696+0000","last_fullsized":"2023-08-27T11:25:24.907696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938563+0000","last_change":"2023-08-27T11:25:24.931041+0000","last_active":"2023-08-27T11:25:24.938563+0000","last_peered":"2023-08-27T11:25:24.938563+0000","last_clean":"2023-08-27T11:25:24.938563+0000","last_became_active":"2023-08-27T11:25:24.930712+0000","last_became_peered":"2023-08-27T11:25:24.930712+0000","last_unstale":"2023-08-27T11:25:24.938563+0000","last_undegraded":"2023-08-27T11:25:24.938563+0000","last_fullsized":"2023-08-27T11:25:24.938563+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:01:24.612963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910301+0000","last_change":"2023-08-27T11:25:24.910301+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910301+0000","last_undegraded":"2023-08-27T11:25:24.910301+0000","last_fullsized":"2023-08-27T11:25:24.910301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925784+0000","last_change":"2023-08-27T11:25:24.919539+0000","last_active":"2023-08-27T11:25:24.925784+0000","last_peered":"2023-08-27T11:25:24.925784+0000","last_clean":"2023-08-27T11:25:24.925784+0000","last_became_active":"2023-08-27T11:25:24.919241+0000","last_became_peered":"2023-08-27T11:25:24.919241+0000","last_unstale":"2023-08-27T11:25:24.925784+0000","last_undegraded":"2023-08-27T11:25:24.925784+0000","last_fullsized":"2023-08-27T11:25:24.925784+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:37:07.671605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.911116+0000","last_change":"2023-08-27T11:25:24.911116+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.911116+0000","last_undegraded":"2023-08-27T11:25:24.911116+0000","last_fullsized":"2023-08-27T11:25:24.911116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930231+0000","last_change":"2023-08-27T11:25:24.920378+0000","last_active":"2023-08-27T11:25:24.930231+0000","last_peered":"2023-08-27T11:25:24.930231+0000","last_clean":"2023-08-27T11:25:24.930231+0000","last_became_active":"2023-08-27T11:25:24.919551+0000","last_became_peered":"2023-08-27T11:25:24.919551+0000","last_unstale":"2023-08-27T11:25:24.930231+0000","last_undegraded":"2023-08-27T11:25:24.930231+0000","last_fullsized":"2023-08-27T11:25:24.930231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:00.552725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909135+0000","last_change":"2023-08-27T11:25:24.909135+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909135+0000","last_undegraded":"2023-08-27T11:25:24.909135+0000","last_fullsized":"2023-08-27T11:25:24.909135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.927274+0000","last_change":"2023-08-27T11:25:24.923303+0000","last_active":"2023-08-27T11:25:24.927274+0000","last_peered":"2023-08-27T11:25:24.927274+0000","last_clean":"2023-08-27T11:25:24.927274+0000","last_became_active":"2023-08-27T11:25:24.922964+0000","last_became_peered":"2023-08-27T11:25:24.922964+0000","last_unstale":"2023-08-27T11:25:24.927274+0000","last_undegraded":"2023-08-27T11:25:24.927274+0000","last_fullsized":"2023-08-27T11:25:24.927274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:29.347866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907095+0000","last_change":"2023-08-27T11:25:24.907095+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907095+0000","last_undegraded":"2023-08-27T11:25:24.907095+0000","last_fullsized":"2023-08-27T11:25:24.907095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930384+0000","last_change":"2023-08-27T11:25:24.924224+0000","last_active":"2023-08-27T11:25:24.930384+0000","last_peered":"2023-08-27T11:25:24.930384+0000","last_clean":"2023-08-27T11:25:24.930384+0000","last_became_active":"2023-08-27T11:25:24.923933+0000","last_became_peered":"2023-08-27T11:25:24.923933+0000","last_unstale":"2023-08-27T11:25:24.930384+0000","last_undegraded":"2023-08-27T11:25:24.930384+0000","last_fullsized":"2023-08-27T11:25:24.930384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:27:14.972078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910854+0000","last_change":"2023-08-27T11:25:24.910854+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910854+0000","last_undegraded":"2023-08-27T11:25:24.910854+0000","last_fullsized":"2023-08-27T11:25:24.910854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925992+0000","last_change":"2023-08-27T11:25:24.925097+0000","last_active":"2023-08-27T11:25:24.925992+0000","last_peered":"2023-08-27T11:25:24.925992+0000","last_clean":"2023-08-27T11:25:24.925992+0000","last_became_active":"2023-08-27T11:25:24.924803+0000","last_became_peered":"2023-08-27T11:25:24.924803+0000","last_unstale":"2023-08-27T11:25:24.925992+0000","last_undegraded":"2023-08-27T11:25:24.925992+0000","last_fullsized":"2023-08-27T11:25:24.925992+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:21.132856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908271+0000","last_change":"2023-08-27T11:25:24.908271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908271+0000","last_undegraded":"2023-08-27T11:25:24.908271+0000","last_fullsized":"2023-08-27T11:25:24.908271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923380+0000","last_change":"2023-08-27T11:25:24.921040+0000","last_active":"2023-08-27T11:25:24.923380+0000","last_peered":"2023-08-27T11:25:24.923380+0000","last_clean":"2023-08-27T11:25:24.923380+0000","last_became_active":"2023-08-27T11:25:24.920745+0000","last_became_peered":"2023-08-27T11:25:24.920745+0000","last_unstale":"2023-08-27T11:25:24.923380+0000","last_undegraded":"2023-08-27T11:25:24.923380+0000","last_fullsized":"2023-08-27T11:25:24.923380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:13:43.404011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907161+0000","last_change":"2023-08-27T11:25:24.907161+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907161+0000","last_undegraded":"2023-08-27T11:25:24.907161+0000","last_fullsized":"2023-08-27T11:25:24.907161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.938590+0000","last_change":"2023-08-27T11:25:24.931138+0000","last_active":"2023-08-27T11:25:24.938590+0000","last_peered":"2023-08-27T11:25:24.938590+0000","last_clean":"2023-08-27T11:25:24.938590+0000","last_became_active":"2023-08-27T11:25:24.930796+0000","last_became_peered":"2023-08-27T11:25:24.930796+0000","last_unstale":"2023-08-27T11:25:24.938590+0000","last_undegraded":"2023-08-27T11:25:24.938590+0000","last_fullsized":"2023-08-27T11:25:24.938590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:48.291105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912052+0000","last_change":"2023-08-27T11:25:24.912052+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912052+0000","last_undegraded":"2023-08-27T11:25:24.912052+0000","last_fullsized":"2023-08-27T11:25:24.912052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930349+0000","last_change":"2023-08-27T11:25:24.923906+0000","last_active":"2023-08-27T11:25:24.930349+0000","last_peered":"2023-08-27T11:25:24.930349+0000","last_clean":"2023-08-27T11:25:24.930349+0000","last_became_active":"2023-08-27T11:25:24.923601+0000","last_became_peered":"2023-08-27T11:25:24.923601+0000","last_unstale":"2023-08-27T11:25:24.930349+0000","last_undegraded":"2023-08-27T11:25:24.930349+0000","last_fullsized":"2023-08-27T11:25:24.930349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:10.258846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902989+0000","last_change":"2023-08-27T11:25:24.902989+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902989+0000","last_undegraded":"2023-08-27T11:25:24.902989+0000","last_fullsized":"2023-08-27T11:25:24.902989+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922741+0000","last_change":"2023-08-27T11:25:24.918632+0000","last_active":"2023-08-27T11:25:24.922741+0000","last_peered":"2023-08-27T11:25:24.922741+0000","last_clean":"2023-08-27T11:25:24.922741+0000","last_became_active":"2023-08-27T11:25:24.918354+0000","last_became_peered":"2023-08-27T11:25:24.918354+0000","last_unstale":"2023-08-27T11:25:24.922741+0000","last_undegraded":"2023-08-27T11:25:24.922741+0000","last_fullsized":"2023-08-27T11:25:24.922741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:40.874810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907234+0000","last_change":"2023-08-27T11:25:24.907234+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907234+0000","last_undegraded":"2023-08-27T11:25:24.907234+0000","last_fullsized":"2023-08-27T11:25:24.907234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933117+0000","last_change":"2023-08-27T11:25:24.923843+0000","last_active":"2023-08-27T11:25:24.933117+0000","last_peered":"2023-08-27T11:25:24.933117+0000","last_clean":"2023-08-27T11:25:24.933117+0000","last_became_active":"2023-08-27T11:25:24.923525+0000","last_became_peered":"2023-08-27T11:25:24.923525+0000","last_unstale":"2023-08-27T11:25:24.933117+0000","last_undegraded":"2023-08-27T11:25:24.933117+0000","last_fullsized":"2023-08-27T11:25:24.933117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:44.335083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.912737+0000","last_change":"2023-08-27T11:25:24.912737+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.912737+0000","last_undegraded":"2023-08-27T11:25:24.912737+0000","last_fullsized":"2023-08-27T11:25:24.912737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930402+0000","last_change":"2023-08-27T11:25:24.925180+0000","last_active":"2023-08-27T11:25:24.930402+0000","last_peered":"2023-08-27T11:25:24.930402+0000","last_clean":"2023-08-27T11:25:24.930402+0000","last_became_active":"2023-08-27T11:25:24.924811+0000","last_became_peered":"2023-08-27T11:25:24.924811+0000","last_unstale":"2023-08-27T11:25:24.930402+0000","last_undegraded":"2023-08-27T11:25:24.930402+0000","last_fullsized":"2023-08-27T11:25:24.930402+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:36:42.056591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908182+0000","last_change":"2023-08-27T11:25:24.908182+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908182+0000","last_undegraded":"2023-08-27T11:25:24.908182+0000","last_fullsized":"2023-08-27T11:25:24.908182+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925507+0000","last_change":"2023-08-27T11:25:24.921229+0000","last_active":"2023-08-27T11:25:24.925507+0000","last_peered":"2023-08-27T11:25:24.925507+0000","last_clean":"2023-08-27T11:25:24.925507+0000","last_became_active":"2023-08-27T11:25:24.920853+0000","last_became_peered":"2023-08-27T11:25:24.920853+0000","last_unstale":"2023-08-27T11:25:24.925507+0000","last_undegraded":"2023-08-27T11:25:24.925507+0000","last_fullsized":"2023-08-27T11:25:24.925507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:42:03.470213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906401+0000","last_change":"2023-08-27T11:25:24.906401+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906401+0000","last_undegraded":"2023-08-27T11:25:24.906401+0000","last_fullsized":"2023-08-27T11:25:24.906401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913573+0000","last_change":"2023-08-27T11:25:24.906755+0000","last_active":"2023-08-27T11:25:24.913573+0000","last_peered":"2023-08-27T11:25:24.913573+0000","last_clean":"2023-08-27T11:25:24.913573+0000","last_became_active":"2023-08-27T11:25:24.906473+0000","last_became_peered":"2023-08-27T11:25:24.906473+0000","last_unstale":"2023-08-27T11:25:24.913573+0000","last_undegraded":"2023-08-27T11:25:24.913573+0000","last_fullsized":"2023-08-27T11:25:24.913573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:43:43.749717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906530+0000","last_change":"2023-08-27T11:25:24.906530+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906530+0000","last_undegraded":"2023-08-27T11:25:24.906530+0000","last_fullsized":"2023-08-27T11:25:24.906530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925685+0000","last_change":"2023-08-27T11:25:24.923864+0000","last_active":"2023-08-27T11:25:24.925685+0000","last_peered":"2023-08-27T11:25:24.925685+0000","last_clean":"2023-08-27T11:25:24.925685+0000","last_became_active":"2023-08-27T11:25:24.923584+0000","last_became_peered":"2023-08-27T11:25:24.923584+0000","last_unstale":"2023-08-27T11:25:24.925685+0000","last_undegraded":"2023-08-27T11:25:24.925685+0000","last_fullsized":"2023-08-27T11:25:24.925685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:52:28.497788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910195+0000","last_change":"2023-08-27T11:25:24.910195+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910195+0000","last_undegraded":"2023-08-27T11:25:24.910195+0000","last_fullsized":"2023-08-27T11:25:24.910195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930303+0000","last_change":"2023-08-27T11:25:24.922363+0000","last_active":"2023-08-27T11:25:24.930303+0000","last_peered":"2023-08-27T11:25:24.930303+0000","last_clean":"2023-08-27T11:25:24.930303+0000","last_became_active":"2023-08-27T11:25:24.922020+0000","last_became_peered":"2023-08-27T11:25:24.922020+0000","last_unstale":"2023-08-27T11:25:24.930303+0000","last_undegraded":"2023-08-27T11:25:24.930303+0000","last_fullsized":"2023-08-27T11:25:24.930303+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:25:19.168348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908352+0000","last_change":"2023-08-27T11:25:24.908352+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908352+0000","last_undegraded":"2023-08-27T11:25:24.908352+0000","last_fullsized":"2023-08-27T11:25:24.908352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.919782+0000","last_change":"2023-08-27T11:25:24.917472+0000","last_active":"2023-08-27T11:25:24.919782+0000","last_peered":"2023-08-27T11:25:24.919782+0000","last_clean":"2023-08-27T11:25:24.919782+0000","last_became_active":"2023-08-27T11:25:24.917200+0000","last_became_peered":"2023-08-27T11:25:24.917200+0000","last_unstale":"2023-08-27T11:25:24.919782+0000","last_undegraded":"2023-08-27T11:25:24.919782+0000","last_fullsized":"2023-08-27T11:25:24.919782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:22:47.877904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.909691+0000","last_change":"2023-08-27T11:25:24.909691+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.909691+0000","last_undegraded":"2023-08-27T11:25:24.909691+0000","last_fullsized":"2023-08-27T11:25:24.909691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925808+0000","last_change":"2023-08-27T11:25:24.920783+0000","last_active":"2023-08-27T11:25:24.925808+0000","last_peered":"2023-08-27T11:25:24.925808+0000","last_clean":"2023-08-27T11:25:24.925808+0000","last_became_active":"2023-08-27T11:25:24.920476+0000","last_became_peered":"2023-08-27T11:25:24.920476+0000","last_unstale":"2023-08-27T11:25:24.925808+0000","last_undegraded":"2023-08-27T11:25:24.925808+0000","last_fullsized":"2023-08-27T11:25:24.925808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:35.904348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907859+0000","last_change":"2023-08-27T11:25:24.907859+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907859+0000","last_undegraded":"2023-08-27T11:25:24.907859+0000","last_fullsized":"2023-08-27T11:25:24.907859+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933208+0000","last_change":"2023-08-27T11:25:24.926030+0000","last_active":"2023-08-27T11:25:24.933208+0000","last_peered":"2023-08-27T11:25:24.933208+0000","last_clean":"2023-08-27T11:25:24.933208+0000","last_became_active":"2023-08-27T11:25:24.925704+0000","last_became_peered":"2023-08-27T11:25:24.925704+0000","last_unstale":"2023-08-27T11:25:24.933208+0000","last_undegraded":"2023-08-27T11:25:24.933208+0000","last_fullsized":"2023-08-27T11:25:24.933208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:50:34.551259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906973+0000","last_change":"2023-08-27T11:25:24.906973+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906973+0000","last_undegraded":"2023-08-27T11:25:24.906973+0000","last_fullsized":"2023-08-27T11:25:24.906973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.930154+0000","last_change":"2023-08-27T11:25:24.919971+0000","last_active":"2023-08-27T11:25:24.930154+0000","last_peered":"2023-08-27T11:25:24.930154+0000","last_clean":"2023-08-27T11:25:24.930154+0000","last_became_active":"2023-08-27T11:25:24.919560+0000","last_became_peered":"2023-08-27T11:25:24.919560+0000","last_unstale":"2023-08-27T11:25:24.930154+0000","last_undegraded":"2023-08-27T11:25:24.930154+0000","last_fullsized":"2023-08-27T11:25:24.930154+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:30:14.218994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907238+0000","last_change":"2023-08-27T11:25:24.907238+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907238+0000","last_undegraded":"2023-08-27T11:25:24.907238+0000","last_fullsized":"2023-08-27T11:25:24.907238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.913622+0000","last_change":"2023-08-27T11:25:24.908964+0000","last_active":"2023-08-27T11:25:24.913622+0000","last_peered":"2023-08-27T11:25:24.913622+0000","last_clean":"2023-08-27T11:25:24.913622+0000","last_became_active":"2023-08-27T11:25:24.908673+0000","last_became_peered":"2023-08-27T11:25:24.908673+0000","last_unstale":"2023-08-27T11:25:24.913622+0000","last_undegraded":"2023-08-27T11:25:24.913622+0000","last_fullsized":"2023-08-27T11:25:24.913622+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:07:44.263637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.906790+0000","last_change":"2023-08-27T11:25:24.906790+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.906790+0000","last_undegraded":"2023-08-27T11:25:24.906790+0000","last_fullsized":"2023-08-27T11:25:24.906790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.933167+0000","last_change":"2023-08-27T11:25:24.923991+0000","last_active":"2023-08-27T11:25:24.933167+0000","last_peered":"2023-08-27T11:25:24.933167+0000","last_clean":"2023-08-27T11:25:24.933167+0000","last_became_active":"2023-08-27T11:25:24.923644+0000","last_became_peered":"2023-08-27T11:25:24.923644+0000","last_unstale":"2023-08-27T11:25:24.933167+0000","last_undegraded":"2023-08-27T11:25:24.933167+0000","last_fullsized":"2023-08-27T11:25:24.933167+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:09.884899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907681+0000","last_change":"2023-08-27T11:25:24.907681+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907681+0000","last_undegraded":"2023-08-27T11:25:24.907681+0000","last_fullsized":"2023-08-27T11:25:24.907681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925536+0000","last_change":"2023-08-27T11:25:24.923852+0000","last_active":"2023-08-27T11:25:24.925536+0000","last_peered":"2023-08-27T11:25:24.925536+0000","last_clean":"2023-08-27T11:25:24.925536+0000","last_became_active":"2023-08-27T11:25:24.923556+0000","last_became_peered":"2023-08-27T11:25:24.923556+0000","last_unstale":"2023-08-27T11:25:24.925536+0000","last_undegraded":"2023-08-27T11:25:24.925536+0000","last_fullsized":"2023-08-27T11:25:24.925536+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:37:53.371732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900830+0000","last_change":"2023-08-27T11:25:24.900830+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900830+0000","last_undegraded":"2023-08-27T11:25:24.900830+0000","last_fullsized":"2023-08-27T11:25:24.900830+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923277+0000","last_change":"2023-08-27T11:25:24.920647+0000","last_active":"2023-08-27T11:25:24.923277+0000","last_peered":"2023-08-27T11:25:24.923277+0000","last_clean":"2023-08-27T11:25:24.923277+0000","last_became_active":"2023-08-27T11:25:24.920179+0000","last_became_peered":"2023-08-27T11:25:24.920179+0000","last_unstale":"2023-08-27T11:25:24.923277+0000","last_undegraded":"2023-08-27T11:25:24.923277+0000","last_fullsized":"2023-08-27T11:25:24.923277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:23.867540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.914871+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:25:24.914871+0000","last_peered":"2023-08-27T11:25:24.914871+0000","last_clean":"2023-08-27T11:25:24.914871+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:25:24.914871+0000","last_undegraded":"2023-08-27T11:25:24.914871+0000","last_fullsized":"2023-08-27T11:25:24.914871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:27.315983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.902693+0000","last_change":"2023-08-27T11:25:24.902693+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.902693+0000","last_undegraded":"2023-08-27T11:25:24.902693+0000","last_fullsized":"2023-08-27T11:25:24.902693+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.918762+0000","last_change":"2023-08-27T11:25:24.916105+0000","last_active":"2023-08-27T11:25:24.918762+0000","last_peered":"2023-08-27T11:25:24.918762+0000","last_clean":"2023-08-27T11:25:24.918762+0000","last_became_active":"2023-08-27T11:25:24.915828+0000","last_became_peered":"2023-08-27T11:25:24.915828+0000","last_unstale":"2023-08-27T11:25:24.918762+0000","last_undegraded":"2023-08-27T11:25:24.918762+0000","last_fullsized":"2023-08-27T11:25:24.918762+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:48:57.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.915313+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:25:24.915313+0000","last_peered":"2023-08-27T11:25:24.915313+0000","last_clean":"2023-08-27T11:25:24.915313+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:25:24.915313+0000","last_undegraded":"2023-08-27T11:25:24.915313+0000","last_fullsized":"2023-08-27T11:25:24.915313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:16:35.315388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.908695+0000","last_change":"2023-08-27T11:25:24.908695+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.908695+0000","last_undegraded":"2023-08-27T11:25:24.908695+0000","last_fullsized":"2023-08-27T11:25:24.908695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.922896+0000","last_change":"2023-08-27T11:25:24.918132+0000","last_active":"2023-08-27T11:25:24.922896+0000","last_peered":"2023-08-27T11:25:24.922896+0000","last_clean":"2023-08-27T11:25:24.922896+0000","last_became_active":"2023-08-27T11:25:24.917778+0000","last_became_peered":"2023-08-27T11:25:24.917778+0000","last_unstale":"2023-08-27T11:25:24.922896+0000","last_undegraded":"2023-08-27T11:25:24.922896+0000","last_fullsized":"2023-08-27T11:25:24.922896+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:09:31.700567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":106,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912353+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:25:24.912353+0000","last_peered":"2023-08-27T11:25:24.912353+0000","last_clean":"2023-08-27T11:25:24.912353+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:25:24.912353+0000","last_undegraded":"2023-08-27T11:25:24.912353+0000","last_fullsized":"2023-08-27T11:25:24.912353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:46.491417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907465+0000","last_change":"2023-08-27T11:25:24.907465+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907465+0000","last_undegraded":"2023-08-27T11:25:24.907465+0000","last_fullsized":"2023-08-27T11:25:24.907465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925010+0000","last_change":"2023-08-27T11:25:24.919858+0000","last_active":"2023-08-27T11:25:24.925010+0000","last_peered":"2023-08-27T11:25:24.925010+0000","last_clean":"2023-08-27T11:25:24.925010+0000","last_became_active":"2023-08-27T11:25:24.919538+0000","last_became_peered":"2023-08-27T11:25:24.919538+0000","last_unstale":"2023-08-27T11:25:24.925010+0000","last_undegraded":"2023-08-27T11:25:24.925010+0000","last_fullsized":"2023-08-27T11:25:24.925010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:36.569893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908412+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:25:24.908412+0000","last_peered":"2023-08-27T11:25:24.908412+0000","last_clean":"2023-08-27T11:25:24.908412+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:25:24.908412+0000","last_undegraded":"2023-08-27T11:25:24.908412+0000","last_fullsized":"2023-08-27T11:25:24.908412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:49.505429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.907104+0000","last_change":"2023-08-27T11:25:24.907104+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.907104+0000","last_undegraded":"2023-08-27T11:25:24.907104+0000","last_fullsized":"2023-08-27T11:25:24.907104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.923000+0000","last_change":"2023-08-27T11:25:24.912962+0000","last_active":"2023-08-27T11:25:24.923000+0000","last_peered":"2023-08-27T11:25:24.923000+0000","last_clean":"2023-08-27T11:25:24.923000+0000","last_became_active":"2023-08-27T11:25:24.912591+0000","last_became_peered":"2023-08-27T11:25:24.912591+0000","last_unstale":"2023-08-27T11:25:24.923000+0000","last_undegraded":"2023-08-27T11:25:24.923000+0000","last_fullsized":"2023-08-27T11:25:24.923000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:40.589564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.909416+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:25:24.909416+0000","last_peered":"2023-08-27T11:25:24.909416+0000","last_clean":"2023-08-27T11:25:24.909416+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:25:24.909416+0000","last_undegraded":"2023-08-27T11:25:24.909416+0000","last_fullsized":"2023-08-27T11:25:24.909416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:21.136228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.910460+0000","last_change":"2023-08-27T11:25:24.910460+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.910460+0000","last_undegraded":"2023-08-27T11:25:24.910460+0000","last_fullsized":"2023-08-27T11:25:24.910460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925390+0000","last_change":"2023-08-27T11:25:24.919759+0000","last_active":"2023-08-27T11:25:24.925390+0000","last_peered":"2023-08-27T11:25:24.925390+0000","last_clean":"2023-08-27T11:25:24.925390+0000","last_became_active":"2023-08-27T11:25:24.919456+0000","last_became_peered":"2023-08-27T11:25:24.919456+0000","last_unstale":"2023-08-27T11:25:24.925390+0000","last_undegraded":"2023-08-27T11:25:24.925390+0000","last_fullsized":"2023-08-27T11:25:24.925390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:05:52.084751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":246,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.908237+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:25:24.908237+0000","last_peered":"2023-08-27T11:25:24.908237+0000","last_clean":"2023-08-27T11:25:24.908237+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:25:24.908237+0000","last_undegraded":"2023-08-27T11:25:24.908237+0000","last_fullsized":"2023-08-27T11:25:24.908237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:42.306664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.912691+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:25:24.912691+0000","last_peered":"2023-08-27T11:25:24.912691+0000","last_clean":"2023-08-27T11:25:24.912691+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:25:24.912691+0000","last_undegraded":"2023-08-27T11:25:24.912691+0000","last_fullsized":"2023-08-27T11:25:24.912691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:28.567657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.900797+0000","last_change":"2023-08-27T11:25:24.900797+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.900797+0000","last_undegraded":"2023-08-27T11:25:24.900797+0000","last_fullsized":"2023-08-27T11:25:24.900797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.926508+0000","last_change":"2023-08-27T11:25:24.920798+0000","last_active":"2023-08-27T11:25:24.926508+0000","last_peered":"2023-08-27T11:25:24.926508+0000","last_clean":"2023-08-27T11:25:24.926508+0000","last_became_active":"2023-08-27T11:25:24.920323+0000","last_became_peered":"2023-08-27T11:25:24.920323+0000","last_unstale":"2023-08-27T11:25:24.926508+0000","last_undegraded":"2023-08-27T11:25:24.926508+0000","last_fullsized":"2023-08-27T11:25:24.926508+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:43:16.520166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":100,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.904792+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:25:24.904792+0000","last_peered":"2023-08-27T11:25:24.904792+0000","last_clean":"2023-08-27T11:25:24.904792+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:25:24.904792+0000","last_undegraded":"2023-08-27T11:25:24.904792+0000","last_fullsized":"2023-08-27T11:25:24.904792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:16.030989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-08-27T11:25:24.901271+0000","last_change":"2023-08-27T11:25:24.901271+0000","last_active":"2023-08-27T11:25:24.889126+0000","last_peered":"2023-08-27T11:25:24.889126+0000","last_clean":"2023-08-27T11:25:24.889126+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:25:24.901271+0000","last_undegraded":"2023-08-27T11:25:24.901271+0000","last_fullsized":"2023-08-27T11:25:24.901271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.925398+0000","last_change":"2023-08-27T11:25:24.919905+0000","last_active":"2023-08-27T11:25:24.925398+0000","last_peered":"2023-08-27T11:25:24.925398+0000","last_clean":"2023-08-27T11:25:24.925398+0000","last_became_active":"2023-08-27T11:25:24.919452+0000","last_became_peered":"2023-08-27T11:25:24.919452+0000","last_unstale":"2023-08-27T11:25:24.925398+0000","last_undegraded":"2023-08-27T11:25:24.925398+0000","last_fullsized":"2023-08-27T11:25:24.925398+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:47.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":104,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-08-27T11:25:24.916000+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:25:24.916000+0000","last_peered":"2023-08-27T11:25:24.916000+0000","last_clean":"2023-08-27T11:25:24.916000+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:25:24.916000+0000","last_undegraded":"2023-08-27T11:25:24.916000+0000","last_fullsized":"2023-08-27T11:25:24.916000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:50:44.816245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":1.018},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.97399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":1.032},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.087},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.626},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.71999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.749},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.82299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28388,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343452,"statfs":{"total":96636764160,"available":96607694848,"internally_reserved":0,"allocated":1396736,"data_stored":957255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83699999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.871}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.94099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.372},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.434}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.71799999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":365901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.439},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.41299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.66600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":366887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.84799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69299999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82399999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92400000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":359273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.92800000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.88300000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.86599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.90500000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:25:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-08-27T11:25:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908291+0000', 'last_change': '2023-08-27T11:25:24.908291+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908291+0000', 'last_undegraded': '2023-08-27T11:25:24.908291+0000', 'last_fullsized': '2023-08-27T11:25:24.908291+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-08-27T11:25:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910924+0000', 'last_change': '2023-08-27T11:25:24.910924+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910924+0000', 'last_undegraded': '2023-08-27T11:25:24.910924+0000', 'last_fullsized': '2023-08-27T11:25:24.910924+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-08-27T11:25:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.911420+0000', 'last_change': '2023-08-27T11:25:24.911420+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.911420+0000', 'last_undegraded': '2023-08-27T11:25:24.911420+0000', 'last_fullsized': '2023-08-27T11:25:24.911420+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-08-27T11:25:31.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.915042+0000', 'last_change': '2023-08-27T11:25:24.915042+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.915042+0000', 'last_undegraded': '2023-08-27T11:25:24.915042+0000', 'last_fullsized': '2023-08-27T11:25:24.915042+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-08-27T11:25:31.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903993+0000', 'last_change': '2023-08-27T11:25:24.903993+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903993+0000', 'last_undegraded': '2023-08-27T11:25:24.903993+0000', 'last_fullsized': '2023-08-27T11:25:24.903993+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-08-27T11:25:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903826+0000', 'last_change': '2023-08-27T11:25:24.903826+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903826+0000', 'last_undegraded': '2023-08-27T11:25:24.903826+0000', 'last_fullsized': '2023-08-27T11:25:24.903826+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-08-27T11:25:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908844+0000', 'last_change': '2023-08-27T11:25:24.908844+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908844+0000', 'last_undegraded': '2023-08-27T11:25:24.908844+0000', 'last_fullsized': '2023-08-27T11:25:24.908844+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-08-27T11:25:31.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903260+0000', 'last_change': '2023-08-27T11:25:24.903260+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903260+0000', 'last_undegraded': '2023-08-27T11:25:24.903260+0000', 'last_fullsized': '2023-08-27T11:25:24.903260+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-08-27T11:25:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.912894+0000', 'last_change': '2023-08-27T11:25:24.912894+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.912894+0000', 'last_undegraded': '2023-08-27T11:25:24.912894+0000', 'last_fullsized': '2023-08-27T11:25:24.912894+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-08-27T11:25:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.912390+0000', 'last_change': '2023-08-27T11:25:24.912390+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.912390+0000', 'last_undegraded': '2023-08-27T11:25:24.912390+0000', 'last_fullsized': '2023-08-27T11:25:24.912390+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-08-27T11:25:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907613+0000', 'last_change': '2023-08-27T11:25:24.907613+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907613+0000', 'last_undegraded': '2023-08-27T11:25:24.907613+0000', 'last_fullsized': '2023-08-27T11:25:24.907613+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-08-27T11:25:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.914370+0000', 'last_change': '2023-08-27T11:25:24.914370+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.914370+0000', 'last_undegraded': '2023-08-27T11:25:24.914370+0000', 'last_fullsized': '2023-08-27T11:25:24.914370+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-08-27T11:25:31.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903560+0000', 'last_change': '2023-08-27T11:25:24.903560+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903560+0000', 'last_undegraded': '2023-08-27T11:25:24.903560+0000', 'last_fullsized': '2023-08-27T11:25:24.903560+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-08-27T11:25:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903415+0000', 'last_change': '2023-08-27T11:25:24.903415+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903415+0000', 'last_undegraded': '2023-08-27T11:25:24.903415+0000', 'last_fullsized': '2023-08-27T11:25:24.903415+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-08-27T11:25:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908170+0000', 'last_change': '2023-08-27T11:25:24.908170+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908170+0000', 'last_undegraded': '2023-08-27T11:25:24.908170+0000', 'last_fullsized': '2023-08-27T11:25:24.908170+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-08-27T11:25:31.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907020+0000', 'last_change': '2023-08-27T11:25:24.907020+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907020+0000', 'last_undegraded': '2023-08-27T11:25:24.907020+0000', 'last_fullsized': '2023-08-27T11:25:24.907020+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-08-27T11:25:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903505+0000', 'last_change': '2023-08-27T11:25:24.903505+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903505+0000', 'last_undegraded': '2023-08-27T11:25:24.903505+0000', 'last_fullsized': '2023-08-27T11:25:24.903505+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-08-27T11:25:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907278+0000', 'last_change': '2023-08-27T11:25:24.907278+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907278+0000', 'last_undegraded': '2023-08-27T11:25:24.907278+0000', 'last_fullsized': '2023-08-27T11:25:24.907278+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-08-27T11:25:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.901779+0000', 'last_change': '2023-08-27T11:25:24.901779+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.901779+0000', 'last_undegraded': '2023-08-27T11:25:24.901779+0000', 'last_fullsized': '2023-08-27T11:25:24.901779+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-08-27T11:25:31.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.904458+0000', 'last_change': '2023-08-27T11:25:24.904458+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.904458+0000', 'last_undegraded': '2023-08-27T11:25:24.904458+0000', 'last_fullsized': '2023-08-27T11:25:24.904458+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-08-27T11:25:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.911655+0000', 'last_change': '2023-08-27T11:25:24.911655+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.911655+0000', 'last_undegraded': '2023-08-27T11:25:24.911655+0000', 'last_fullsized': '2023-08-27T11:25:24.911655+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-08-27T11:25:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.903036+0000', 'last_change': '2023-08-27T11:25:24.903036+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.903036+0000', 'last_undegraded': '2023-08-27T11:25:24.903036+0000', 'last_fullsized': '2023-08-27T11:25:24.903036+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-08-27T11:25:31.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.912134+0000', 'last_change': '2023-08-27T11:25:24.912134+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.912134+0000', 'last_undegraded': '2023-08-27T11:25:24.912134+0000', 'last_fullsized': '2023-08-27T11:25:24.912134+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-08-27T11:25:31.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908074+0000', 'last_change': '2023-08-27T11:25:24.908074+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908074+0000', 'last_undegraded': '2023-08-27T11:25:24.908074+0000', 'last_fullsized': '2023-08-27T11:25:24.908074+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-08-27T11:25:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910917+0000', 'last_change': '2023-08-27T11:25:24.910917+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910917+0000', 'last_undegraded': '2023-08-27T11:25:24.910917+0000', 'last_fullsized': '2023-08-27T11:25:24.910917+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-08-27T11:25:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.911838+0000', 'last_change': '2023-08-27T11:25:24.911838+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.911838+0000', 'last_undegraded': '2023-08-27T11:25:24.911838+0000', 'last_fullsized': '2023-08-27T11:25:24.911838+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-08-27T11:25:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907876+0000', 'last_change': '2023-08-27T11:25:24.907876+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907876+0000', 'last_undegraded': '2023-08-27T11:25:24.907876+0000', 'last_fullsized': '2023-08-27T11:25:24.907876+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-08-27T11:25:31.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.900826+0000', 'last_change': '2023-08-27T11:25:24.900826+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.900826+0000', 'last_undegraded': '2023-08-27T11:25:24.900826+0000', 'last_fullsized': '2023-08-27T11:25:24.900826+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-08-27T11:25:31.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908266+0000', 'last_change': '2023-08-27T11:25:24.908266+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908266+0000', 'last_undegraded': '2023-08-27T11:25:24.908266+0000', 'last_fullsized': '2023-08-27T11:25:24.908266+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-08-27T11:25:31.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906424+0000', 'last_change': '2023-08-27T11:25:24.906424+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906424+0000', 'last_undegraded': '2023-08-27T11:25:24.906424+0000', 'last_fullsized': '2023-08-27T11:25:24.906424+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-08-27T11:25:31.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906832+0000', 'last_change': '2023-08-27T11:25:24.906832+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906832+0000', 'last_undegraded': '2023-08-27T11:25:24.906832+0000', 'last_fullsized': '2023-08-27T11:25:24.906832+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-08-27T11:25:31.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906565+0000', 'last_change': '2023-08-27T11:25:24.906565+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906565+0000', 'last_undegraded': '2023-08-27T11:25:24.906565+0000', 'last_fullsized': '2023-08-27T11:25:24.906565+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-08-27T11:25:31.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.911042+0000', 'last_change': '2023-08-27T11:25:24.911042+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.911042+0000', 'last_undegraded': '2023-08-27T11:25:24.911042+0000', 'last_fullsized': '2023-08-27T11:25:24.911042+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-08-27T11:25:31.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907696+0000', 'last_change': '2023-08-27T11:25:24.907696+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907696+0000', 'last_undegraded': '2023-08-27T11:25:24.907696+0000', 'last_fullsized': '2023-08-27T11:25:24.907696+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-08-27T11:25:31.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910301+0000', 'last_change': '2023-08-27T11:25:24.910301+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910301+0000', 'last_undegraded': '2023-08-27T11:25:24.910301+0000', 'last_fullsized': '2023-08-27T11:25:24.910301+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-08-27T11:25:31.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.911116+0000', 'last_change': '2023-08-27T11:25:24.911116+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.911116+0000', 'last_undegraded': '2023-08-27T11:25:24.911116+0000', 'last_fullsized': '2023-08-27T11:25:24.911116+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-08-27T11:25:31.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.909135+0000', 'last_change': '2023-08-27T11:25:24.909135+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.909135+0000', 'last_undegraded': '2023-08-27T11:25:24.909135+0000', 'last_fullsized': '2023-08-27T11:25:24.909135+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-08-27T11:25:31.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907095+0000', 'last_change': '2023-08-27T11:25:24.907095+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907095+0000', 'last_undegraded': '2023-08-27T11:25:24.907095+0000', 'last_fullsized': '2023-08-27T11:25:24.907095+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-08-27T11:25:31.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910854+0000', 'last_change': '2023-08-27T11:25:24.910854+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910854+0000', 'last_undegraded': '2023-08-27T11:25:24.910854+0000', 'last_fullsized': '2023-08-27T11:25:24.910854+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-08-27T11:25:31.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908271+0000', 'last_change': '2023-08-27T11:25:24.908271+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908271+0000', 'last_undegraded': '2023-08-27T11:25:24.908271+0000', 'last_fullsized': '2023-08-27T11:25:24.908271+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-08-27T11:25:31.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907161+0000', 'last_change': '2023-08-27T11:25:24.907161+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907161+0000', 'last_undegraded': '2023-08-27T11:25:24.907161+0000', 'last_fullsized': '2023-08-27T11:25:24.907161+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-08-27T11:25:31.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.912052+0000', 'last_change': '2023-08-27T11:25:24.912052+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.912052+0000', 'last_undegraded': '2023-08-27T11:25:24.912052+0000', 'last_fullsized': '2023-08-27T11:25:24.912052+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-08-27T11:25:31.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.902989+0000', 'last_change': '2023-08-27T11:25:24.902989+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.902989+0000', 'last_undegraded': '2023-08-27T11:25:24.902989+0000', 'last_fullsized': '2023-08-27T11:25:24.902989+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-08-27T11:25:31.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907234+0000', 'last_change': '2023-08-27T11:25:24.907234+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907234+0000', 'last_undegraded': '2023-08-27T11:25:24.907234+0000', 'last_fullsized': '2023-08-27T11:25:24.907234+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-08-27T11:25:31.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.912737+0000', 'last_change': '2023-08-27T11:25:24.912737+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.912737+0000', 'last_undegraded': '2023-08-27T11:25:24.912737+0000', 'last_fullsized': '2023-08-27T11:25:24.912737+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:25:31.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-08-27T11:25:31.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908182+0000', 'last_change': '2023-08-27T11:25:24.908182+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908182+0000', 'last_undegraded': '2023-08-27T11:25:24.908182+0000', 'last_fullsized': '2023-08-27T11:25:24.908182+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-08-27T11:25:31.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906401+0000', 'last_change': '2023-08-27T11:25:24.906401+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906401+0000', 'last_undegraded': '2023-08-27T11:25:24.906401+0000', 'last_fullsized': '2023-08-27T11:25:24.906401+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-08-27T11:25:31.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906530+0000', 'last_change': '2023-08-27T11:25:24.906530+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906530+0000', 'last_undegraded': '2023-08-27T11:25:24.906530+0000', 'last_fullsized': '2023-08-27T11:25:24.906530+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-08-27T11:25:31.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910195+0000', 'last_change': '2023-08-27T11:25:24.910195+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910195+0000', 'last_undegraded': '2023-08-27T11:25:24.910195+0000', 'last_fullsized': '2023-08-27T11:25:24.910195+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-08-27T11:25:31.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908352+0000', 'last_change': '2023-08-27T11:25:24.908352+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908352+0000', 'last_undegraded': '2023-08-27T11:25:24.908352+0000', 'last_fullsized': '2023-08-27T11:25:24.908352+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-08-27T11:25:31.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.909691+0000', 'last_change': '2023-08-27T11:25:24.909691+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.909691+0000', 'last_undegraded': '2023-08-27T11:25:24.909691+0000', 'last_fullsized': '2023-08-27T11:25:24.909691+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:25:31.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-08-27T11:25:31.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907859+0000', 'last_change': '2023-08-27T11:25:24.907859+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907859+0000', 'last_undegraded': '2023-08-27T11:25:24.907859+0000', 'last_fullsized': '2023-08-27T11:25:24.907859+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-08-27T11:25:31.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906973+0000', 'last_change': '2023-08-27T11:25:24.906973+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906973+0000', 'last_undegraded': '2023-08-27T11:25:24.906973+0000', 'last_fullsized': '2023-08-27T11:25:24.906973+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-08-27T11:25:31.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907238+0000', 'last_change': '2023-08-27T11:25:24.907238+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907238+0000', 'last_undegraded': '2023-08-27T11:25:24.907238+0000', 'last_fullsized': '2023-08-27T11:25:24.907238+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-08-27T11:25:31.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.906790+0000', 'last_change': '2023-08-27T11:25:24.906790+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.906790+0000', 'last_undegraded': '2023-08-27T11:25:24.906790+0000', 'last_fullsized': '2023-08-27T11:25:24.906790+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-08-27T11:25:31.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907681+0000', 'last_change': '2023-08-27T11:25:24.907681+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907681+0000', 'last_undegraded': '2023-08-27T11:25:24.907681+0000', 'last_fullsized': '2023-08-27T11:25:24.907681+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:25:31.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-08-27T11:25:31.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.900830+0000', 'last_change': '2023-08-27T11:25:24.900830+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.900830+0000', 'last_undegraded': '2023-08-27T11:25:24.900830+0000', 'last_fullsized': '2023-08-27T11:25:24.900830+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-08-27T11:25:31.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.902693+0000', 'last_change': '2023-08-27T11:25:24.902693+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.902693+0000', 'last_undegraded': '2023-08-27T11:25:24.902693+0000', 'last_fullsized': '2023-08-27T11:25:24.902693+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-08-27T11:25:31.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.908695+0000', 'last_change': '2023-08-27T11:25:24.908695+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.908695+0000', 'last_undegraded': '2023-08-27T11:25:24.908695+0000', 'last_fullsized': '2023-08-27T11:25:24.908695+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-08-27T11:25:31.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907465+0000', 'last_change': '2023-08-27T11:25:24.907465+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907465+0000', 'last_undegraded': '2023-08-27T11:25:24.907465+0000', 'last_fullsized': '2023-08-27T11:25:24.907465+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:25:31.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-08-27T11:25:31.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.907104+0000', 'last_change': '2023-08-27T11:25:24.907104+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.907104+0000', 'last_undegraded': '2023-08-27T11:25:24.907104+0000', 'last_fullsized': '2023-08-27T11:25:24.907104+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:25:31.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-08-27T11:25:31.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.910460+0000', 'last_change': '2023-08-27T11:25:24.910460+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.910460+0000', 'last_undegraded': '2023-08-27T11:25:24.910460+0000', 'last_fullsized': '2023-08-27T11:25:24.910460+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:25:31.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-08-27T11:25:31.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.900797+0000', 'last_change': '2023-08-27T11:25:24.900797+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.900797+0000', 'last_undegraded': '2023-08-27T11:25:24.900797+0000', 'last_fullsized': '2023-08-27T11:25:24.900797+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:25:31.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-08-27T11:25:31.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:25:24.901271+0000', 'last_change': '2023-08-27T11:25:24.901271+0000', 'last_active': '2023-08-27T11:25:24.889126+0000', 'last_peered': '2023-08-27T11:25:24.889126+0000', 'last_clean': '2023-08-27T11:25:24.889126+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:25:24.901271+0000', 'last_undegraded': '2023-08-27T11:25:24.901271+0000', 'last_fullsized': '2023-08-27T11:25:24.901271+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'last_clean_scrub_stamp': '2023-08-27T11:25:24.889126+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:25:31.401 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-27T11:25:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.599+0000 7ff0163ff700 1 Processor -- start 2023-08-27T11:25:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.600+0000 7ff0163ff700 1 -- start start 2023-08-27T11:25:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff0163ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff0100aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff0163ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0100c0bb0 0x7ff0100ab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff0163ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100c1310 con 0x7ff0100c0660 2023-08-27T11:25:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff0163ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0100c10a0 con 0x7ff0100c0bb0 2023-08-27T11:25:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff0163ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff010152390 con 0x7ff01014fb60 2023-08-27T11:25:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0100c0bb0 0x7ff0100ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0100c0bb0 0x7ff0100ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38506/0 (socket says 172.21.15.43:38506) 2023-08-27T11:25:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 -- 172.21.15.43:0/108882913 learned_addr learned my addr 172.21.15.43:0/108882913 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00ffff700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff0100aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 -- 172.21.15.43:0/108882913 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 msgr2=0x7ff0100aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff0100aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 -- 172.21.15.43:0/108882913 >> v1:172.21.15.57:6789/0 conn(0x7ff0100c0660 legacy=0x7ff010152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00f7fe700 1 -- 172.21.15.43:0/108882913 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100a9510 con 0x7ff0100c0bb0 2023-08-27T11:25:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.601+0000 7ff00ffff700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff0100aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.602+0000 7ff00f7fe700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0bb0 0x7ff0100ab460 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098f0 tx=0x7ff004009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d458aa30c0e2aa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.602+0000 7ff00effd700 1 -- 172.21.15.43:0/108882913 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004004230 con 0x7ff0100c0bb0 2023-08-27T11:25:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.602+0000 7ff00effd700 1 -- 172.21.15.43:0/108882913 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff004004390 con 0x7ff0100c0bb0 2023-08-27T11:25:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.602+0000 7ff00effd700 1 -- 172.21.15.43:0/108882913 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040036a0 con 0x7ff0100c0bb0 2023-08-27T11:25:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 -- 172.21.15.43:0/108882913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0bb0 msgr2=0x7ff0100ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0bb0 0x7ff0100ab460 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098f0 tx=0x7ff004009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 -- 172.21.15.43:0/108882913 shutdown_connections 2023-08-27T11:25:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff0100aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 --2- 172.21.15.43:0/108882913 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0bb0 0x7ff0100ab460 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 -- 172.21.15.43:0/108882913 >> 172.21.15.43:0/108882913 conn(0x7ff0100c2320 msgr2=0x7ff0100c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 -- 172.21.15.43:0/108882913 shutdown_connections 2023-08-27T11:25:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.603+0000 7ff0163ff700 1 -- 172.21.15.43:0/108882913 wait complete. 2023-08-27T11:25:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.604+0000 7ff0163ff700 1 Processor -- start 2023-08-27T11:25:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 -- start start 2023-08-27T11:25:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100c0bb0 0x7ff01014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff01014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101ebca0 con 0x7ff0100c0660 2023-08-27T11:25:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101eb700 con 0x7ff0100c0bb0 2023-08-27T11:25:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.605+0000 7ff0163ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101eb9c0 con 0x7ff01014fb60 2023-08-27T11:25:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38520/0 (socket says 172.21.15.43:38520) 2023-08-27T11:25:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 -- 172.21.15.43:0/3776244496 learned_addr learned my addr 172.21.15.43:0/3776244496 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00f7fe700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100c0bb0 0x7ff01014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff01499c700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff01014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 -- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 msgr2=0x7ff01014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff01014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 -- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100c0bb0 msgr2=0x7ff01014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100c0bb0 0x7ff01014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 -- 172.21.15.43:0/3776244496 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004009550 con 0x7ff0100c0660 2023-08-27T11:25:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff01499c700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff01014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.606+0000 7ff00ffff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c7f0 tx=0x7ff00000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.607+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011800 con 0x7ff0100c0660 2023-08-27T11:25:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.607+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011960 con 0x7ff0100c0660 2023-08-27T11:25:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.607+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011cf0 con 0x7ff0100c0660 2023-08-27T11:25:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.607+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010154550 con 0x7ff0100c0660 2023-08-27T11:25:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.607+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0101dc5d0 con 0x7ff0100c0660 2023-08-27T11:25:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.608+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100674e0 con 0x7ff0100c0660 2023-08-27T11:25:31.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.609+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff000018360 con 0x7ff0100c0660 2023-08-27T11:25:31.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.609+0000 7ff00cff9700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 0x7feffc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:31.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.610+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0000885b0 con 0x7ff0100c0660 2023-08-27T11:25:31.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.610+0000 7ff00f7fe700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 0x7feffc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:31.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.610+0000 7ff00f7fe700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 0x7feffc06c5a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff0100a8db0 tx=0x7ff004008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:31.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.614+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff000053c10 con 0x7ff0100c0660 2023-08-27T11:25:31.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.909+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff0101543b0 con 0x7ff0100c0660 2023-08-27T11:25:31.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.910+0000 7ff00cff9700 1 -- 172.21.15.43:0/3776244496 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1453 (secure 0 0 0) 0x7ff0101543b0 con 0x7ff0100c0660 2023-08-27T11:25:31.911 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:31.912 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1693135354,"num_in_osds":8,"osd_in_since":1693135346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":228925440,"bytes_avail":772865187840,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":58,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6195}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-27T11:24:54.339592+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-27T11:25:31.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 msgr2=0x7feffc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 0x7feffc06c5a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff0100a8db0 tx=0x7ff004008030 comp rx=0 tx=0).stop 2023-08-27T11:25:31.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 msgr2=0x7ff0101dc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:31.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c7f0 tx=0x7ff00000cb00 comp rx=0 tx=0).stop 2023-08-27T11:25:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 shutdown_connections 2023-08-27T11:25:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feffc06a0e0 0x7feffc06c5a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff01014fb60 0x7ff01014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0100c0660 0x7ff0101dc090 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 --2- 172.21.15.43:0/3776244496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0100c0bb0 0x7ff01014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 >> 172.21.15.43:0/3776244496 conn(0x7ff0100c2320 msgr2=0x7ff0100a6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 shutdown_connections 2023-08-27T11:25:31.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:31.912+0000 7ff0163ff700 1 -- 172.21.15.43:0/3776244496 wait complete. 2023-08-27T11:25:31.932 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-27T11:25:31.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:25:32.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.132+0000 7fcf897ff700 1 Processor -- start 2023-08-27T11:25:32.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.133+0000 7fcf897ff700 1 -- start start 2023-08-27T11:25:32.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf897ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf840c4630 0x7fcf840c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf897ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf8406ad70 0x7fcf8406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf897ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8406c4e0 con 0x7fcf84151a90 2023-08-27T11:25:32.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf897ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf84155370 con 0x7fcf8406ad70 2023-08-27T11:25:32.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf897ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840c82c0 con 0x7fcf840c4630 2023-08-27T11:25:32.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf837fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf8406ad70 0x7fcf8406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf837fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcf8406ad70 0x7fcf8406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38534/0 (socket says 172.21.15.43:38534) 2023-08-27T11:25:32.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf837fe700 1 -- 172.21.15.43:0/1356923902 learned_addr learned my addr 172.21.15.43:0/1356923902 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:32.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.134+0000 7fcf827fc700 1 --2- 172.21.15.43:0/1356923902 >> v2:172.21.15.57:3300/0 conn(0x7fcf840c4630 0x7fcf840c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf837fe700 1 -- 172.21.15.43:0/1356923902 >> v2:172.21.15.57:3300/0 conn(0x7fcf840c4630 msgr2=0x7fcf840c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf837fe700 1 --2- 172.21.15.43:0/1356923902 >> v2:172.21.15.57:3300/0 conn(0x7fcf840c4630 0x7fcf840c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf837fe700 1 -- 172.21.15.43:0/1356923902 >> v1:172.21.15.57:6789/0 conn(0x7fcf84151a90 legacy=0x7fcf840c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf837fe700 1 -- 172.21.15.43:0/1356923902 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84151e70 con 0x7fcf8406ad70 2023-08-27T11:25:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf837fe700 1 --2- 172.21.15.43:0/1356923902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8406ad70 0x7fcf8406b200 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcf840c7740 tx=0x7fcf7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ce7b280ab9861 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:32.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf81ffb700 1 -- 172.21.15.43:0/1356923902 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00e070 con 0x7fcf8406ad70 2023-08-27T11:25:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf81ffb700 1 -- 172.21.15.43:0/1356923902 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00b910 con 0x7fcf8406ad70 2023-08-27T11:25:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.135+0000 7fcf81ffb700 1 -- 172.21.15.43:0/1356923902 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00bcc0 con 0x7fcf8406ad70 2023-08-27T11:25:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 -- 172.21.15.43:0/1356923902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8406ad70 msgr2=0x7fcf8406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1356923902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8406ad70 0x7fcf8406b200 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fcf840c7740 tx=0x7fcf7c00b330 comp rx=0 tx=0).stop 2023-08-27T11:25:32.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 -- 172.21.15.43:0/1356923902 shutdown_connections 2023-08-27T11:25:32.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1356923902 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf8406ad70 0x7fcf8406b200 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1356923902 >> v2:172.21.15.57:3300/0 conn(0x7fcf840c4630 0x7fcf840c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 -- 172.21.15.43:0/1356923902 >> 172.21.15.43:0/1356923902 conn(0x7fcf840ab820 msgr2=0x7fcf840abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:32.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 -- 172.21.15.43:0/1356923902 shutdown_connections 2023-08-27T11:25:32.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.136+0000 7fcf897ff700 1 -- 172.21.15.43:0/1356923902 wait complete. 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.138+0000 7fcf897ff700 1 Processor -- start 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.138+0000 7fcf897ff700 1 -- start start 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf8406ad70 0x7fcf840c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf84151a90 0x7fcf840c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf841edb40 con 0x7fcf840c4630 2023-08-27T11:25:32.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c1300 con 0x7fcf8406ad70 2023-08-27T11:25:32.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf897ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c3d10 con 0x7fcf84151a90 2023-08-27T11:25:32.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38550/0 (socket says 172.21.15.43:38550) 2023-08-27T11:25:32.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 -- 172.21.15.43:0/1307384761 learned_addr learned my addr 172.21.15.43:0/1307384761 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf82ffd700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf8406ad70 0x7fcf840c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf837fe700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf84151a90 0x7fcf840c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 -- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf84151a90 msgr2=0x7fcf840c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf84151a90 0x7fcf840c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.139+0000 7fcf827fc700 1 -- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf8406ad70 msgr2=0x7fcf840c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf827fc700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf8406ad70 0x7fcf840c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf827fc700 1 -- 172.21.15.43:0/1307384761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c009b30 con 0x7fcf840c4630 2023-08-27T11:25:32.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf827fc700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800ea10 tx=0x7fcf7800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:32.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78009710 con 0x7fcf840c4630 2023-08-27T11:25:32.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800c850 con 0x7fcf840c4630 2023-08-27T11:25:32.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800cbc0 con 0x7fcf840c4630 2023-08-27T11:25:32.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf841ecf00 con 0x7fcf840c4630 2023-08-27T11:25:32.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.140+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf841ed480 con 0x7fcf840c4630 2023-08-27T11:25:32.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.141+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf841edc80 con 0x7fcf840c4630 2023-08-27T11:25:32.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.142+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf7800cd20 con 0x7fcf840c4630 2023-08-27T11:25:32.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.143+0000 7fcf6b7fe700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 0x7fcf7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:32.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.143+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf78088970 con 0x7fcf840c4630 2023-08-27T11:25:32.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.144+0000 7fcf82ffd700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 0x7fcf7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:32.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.144+0000 7fcf82ffd700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 0x7fcf7006c5a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcf74007fd0 tx=0x7fcf74009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:32.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.147+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf841edc80 con 0x7fcf840c4630 2023-08-27T11:25:32.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.354+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf84154760 con 0x7fcf7006a0e0 2023-08-27T11:25:32.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.365+0000 7fcf6b7fe700 1 -- 172.21.15.43:0/1307384761 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311580 (secure 0 0 0) 0x7fcf74001cc0 con 0x7fcf7006a0e0 2023-08-27T11:25:32.370 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:32.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 msgr2=0x7fcf7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 0x7fcf7006c5a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcf74007fd0 tx=0x7fcf74009040 comp rx=0 tx=0).stop 2023-08-27T11:25:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 msgr2=0x7fcf840c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800ea10 tx=0x7fcf7800ed20 comp rx=0 tx=0).stop 2023-08-27T11:25:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 shutdown_connections 2023-08-27T11:25:32.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf7006a0e0 0x7fcf7006c5a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf84151a90 0x7fcf840c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf8406ad70 0x7fcf840c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 --2- 172.21.15.43:0/1307384761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf840c4630 0x7fcf840c3290 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 >> 172.21.15.43:0/1307384761 conn(0x7fcf840ab820 msgr2=0x7fcf8414f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:32.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 shutdown_connections 2023-08-27T11:25:32.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:32.369+0000 7fcf897ff700 1 -- 172.21.15.43:0/1307384761 wait complete. 2023-08-27T11:25:32.377 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:25:32.389 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2023-08-27T11:25:32.346579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223888,"kb_used_data":7672,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754750832,"statfs":{"total":773094113280,"available":772864851968,"internally_reserved":0,"allocated":7856128,"data_stored":4226956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.450851"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919558+0000","last_change":"2023-08-27T11:25:25.924775+0000","last_active":"2023-08-27T11:25:26.919558+0000","last_peered":"2023-08-27T11:25:26.919558+0000","last_clean":"2023-08-27T11:25:26.919558+0000","last_became_active":"2023-08-27T11:25:25.924543+0000","last_became_peered":"2023-08-27T11:25:25.924543+0000","last_unstale":"2023-08-27T11:25:26.919558+0000","last_undegraded":"2023-08-27T11:25:26.919558+0000","last_fullsized":"2023-08-27T11:25:26.919558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:51.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238535+0000","last_change":"2023-08-27T11:25:25.936513+0000","last_active":"2023-08-27T11:25:27.238535+0000","last_peered":"2023-08-27T11:25:27.238535+0000","last_clean":"2023-08-27T11:25:27.238535+0000","last_became_active":"2023-08-27T11:25:25.935704+0000","last_became_peered":"2023-08-27T11:25:25.935704+0000","last_unstale":"2023-08-27T11:25:27.238535+0000","last_undegraded":"2023-08-27T11:25:27.238535+0000","last_fullsized":"2023-08-27T11:25:27.238535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:04.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238348+0000","last_change":"2023-08-27T11:25:25.936829+0000","last_active":"2023-08-27T11:25:27.238348+0000","last_peered":"2023-08-27T11:25:27.238348+0000","last_clean":"2023-08-27T11:25:27.238348+0000","last_became_active":"2023-08-27T11:25:25.930044+0000","last_became_peered":"2023-08-27T11:25:25.930044+0000","last_unstale":"2023-08-27T11:25:27.238348+0000","last_undegraded":"2023-08-27T11:25:27.238348+0000","last_fullsized":"2023-08-27T11:25:27.238348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:10.828528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237273+0000","last_change":"2023-08-27T11:25:25.915301+0000","last_active":"2023-08-27T11:25:27.237273+0000","last_peered":"2023-08-27T11:25:27.237273+0000","last_clean":"2023-08-27T11:25:27.237273+0000","last_became_active":"2023-08-27T11:25:25.915027+0000","last_became_peered":"2023-08-27T11:25:25.915027+0000","last_unstale":"2023-08-27T11:25:27.237273+0000","last_undegraded":"2023-08-27T11:25:27.237273+0000","last_fullsized":"2023-08-27T11:25:27.237273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:26:32.126370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237905+0000","last_change":"2023-08-27T11:25:25.920168+0000","last_active":"2023-08-27T11:25:27.237905+0000","last_peered":"2023-08-27T11:25:27.237905+0000","last_clean":"2023-08-27T11:25:27.237905+0000","last_became_active":"2023-08-27T11:25:25.919843+0000","last_became_peered":"2023-08-27T11:25:25.919843+0000","last_unstale":"2023-08-27T11:25:27.237905+0000","last_undegraded":"2023-08-27T11:25:27.237905+0000","last_fullsized":"2023-08-27T11:25:27.237905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:43:38.296820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238532+0000","last_change":"2023-08-27T11:25:25.933280+0000","last_active":"2023-08-27T11:25:27.238532+0000","last_peered":"2023-08-27T11:25:27.238532+0000","last_clean":"2023-08-27T11:25:27.238532+0000","last_became_active":"2023-08-27T11:25:25.932917+0000","last_became_peered":"2023-08-27T11:25:25.932917+0000","last_unstale":"2023-08-27T11:25:27.238532+0000","last_undegraded":"2023-08-27T11:25:27.238532+0000","last_fullsized":"2023-08-27T11:25:27.238532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:01.889854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917369+0000","last_change":"2023-08-27T11:25:25.916867+0000","last_active":"2023-08-27T11:25:26.917369+0000","last_peered":"2023-08-27T11:25:26.917369+0000","last_clean":"2023-08-27T11:25:26.917369+0000","last_became_active":"2023-08-27T11:25:25.916574+0000","last_became_peered":"2023-08-27T11:25:25.916574+0000","last_unstale":"2023-08-27T11:25:26.917369+0000","last_undegraded":"2023-08-27T11:25:26.917369+0000","last_fullsized":"2023-08-27T11:25:26.917369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:45.756160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.236956+0000","last_change":"2023-08-27T11:25:25.921722+0000","last_active":"2023-08-27T11:25:27.236956+0000","last_peered":"2023-08-27T11:25:27.236956+0000","last_clean":"2023-08-27T11:25:27.236956+0000","last_became_active":"2023-08-27T11:25:25.919902+0000","last_became_peered":"2023-08-27T11:25:25.919902+0000","last_unstale":"2023-08-27T11:25:27.236956+0000","last_undegraded":"2023-08-27T11:25:27.236956+0000","last_fullsized":"2023-08-27T11:25:27.236956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:18:16.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919626+0000","last_change":"2023-08-27T11:25:25.922370+0000","last_active":"2023-08-27T11:25:26.919626+0000","last_peered":"2023-08-27T11:25:26.919626+0000","last_clean":"2023-08-27T11:25:26.919626+0000","last_became_active":"2023-08-27T11:25:25.922069+0000","last_became_peered":"2023-08-27T11:25:25.922069+0000","last_unstale":"2023-08-27T11:25:26.919626+0000","last_undegraded":"2023-08-27T11:25:26.919626+0000","last_fullsized":"2023-08-27T11:25:26.919626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:49:14.842054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237139+0000","last_change":"2023-08-27T11:25:25.924547+0000","last_active":"2023-08-27T11:25:27.237139+0000","last_peered":"2023-08-27T11:25:27.237139+0000","last_clean":"2023-08-27T11:25:27.237139+0000","last_became_active":"2023-08-27T11:25:25.924217+0000","last_became_peered":"2023-08-27T11:25:25.924217+0000","last_unstale":"2023-08-27T11:25:27.237139+0000","last_undegraded":"2023-08-27T11:25:27.237139+0000","last_fullsized":"2023-08-27T11:25:27.237139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:11:36.814269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238783+0000","last_change":"2023-08-27T11:25:25.940827+0000","last_active":"2023-08-27T11:25:27.238783+0000","last_peered":"2023-08-27T11:25:27.238783+0000","last_clean":"2023-08-27T11:25:27.238783+0000","last_became_active":"2023-08-27T11:25:25.940536+0000","last_became_peered":"2023-08-27T11:25:25.940536+0000","last_unstale":"2023-08-27T11:25:27.238783+0000","last_undegraded":"2023-08-27T11:25:27.238783+0000","last_fullsized":"2023-08-27T11:25:27.238783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:18.158403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237274+0000","last_change":"2023-08-27T11:25:25.921298+0000","last_active":"2023-08-27T11:25:27.237274+0000","last_peered":"2023-08-27T11:25:27.237274+0000","last_clean":"2023-08-27T11:25:27.237274+0000","last_became_active":"2023-08-27T11:25:25.920627+0000","last_became_peered":"2023-08-27T11:25:25.920627+0000","last_unstale":"2023-08-27T11:25:27.237274+0000","last_undegraded":"2023-08-27T11:25:27.237274+0000","last_fullsized":"2023-08-27T11:25:27.237274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:56:21.244045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238035+0000","last_change":"2023-08-27T11:25:25.918763+0000","last_active":"2023-08-27T11:25:27.238035+0000","last_peered":"2023-08-27T11:25:27.238035+0000","last_clean":"2023-08-27T11:25:27.238035+0000","last_became_active":"2023-08-27T11:25:25.918457+0000","last_became_peered":"2023-08-27T11:25:25.918457+0000","last_unstale":"2023-08-27T11:25:27.238035+0000","last_undegraded":"2023-08-27T11:25:27.238035+0000","last_fullsized":"2023-08-27T11:25:27.238035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:04.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238415+0000","last_change":"2023-08-27T11:25:25.928674+0000","last_active":"2023-08-27T11:25:27.238415+0000","last_peered":"2023-08-27T11:25:27.238415+0000","last_clean":"2023-08-27T11:25:27.238415+0000","last_became_active":"2023-08-27T11:25:25.927654+0000","last_became_peered":"2023-08-27T11:25:25.927654+0000","last_unstale":"2023-08-27T11:25:27.238415+0000","last_undegraded":"2023-08-27T11:25:27.238415+0000","last_fullsized":"2023-08-27T11:25:27.238415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:42.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238314+0000","last_change":"2023-08-27T11:25:25.939668+0000","last_active":"2023-08-27T11:25:27.238314+0000","last_peered":"2023-08-27T11:25:27.238314+0000","last_clean":"2023-08-27T11:25:27.238314+0000","last_became_active":"2023-08-27T11:25:25.939401+0000","last_became_peered":"2023-08-27T11:25:25.939401+0000","last_unstale":"2023-08-27T11:25:27.238314+0000","last_undegraded":"2023-08-27T11:25:27.238314+0000","last_fullsized":"2023-08-27T11:25:27.238314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:07.947767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919622+0000","last_change":"2023-08-27T11:25:25.918860+0000","last_active":"2023-08-27T11:25:26.919622+0000","last_peered":"2023-08-27T11:25:26.919622+0000","last_clean":"2023-08-27T11:25:26.919622+0000","last_became_active":"2023-08-27T11:25:25.918188+0000","last_became_peered":"2023-08-27T11:25:25.918188+0000","last_unstale":"2023-08-27T11:25:26.919622+0000","last_undegraded":"2023-08-27T11:25:26.919622+0000","last_fullsized":"2023-08-27T11:25:26.919622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:27:02.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238955+0000","last_change":"2023-08-27T11:25:25.917354+0000","last_active":"2023-08-27T11:25:27.238955+0000","last_peered":"2023-08-27T11:25:27.238955+0000","last_clean":"2023-08-27T11:25:27.238955+0000","last_became_active":"2023-08-27T11:25:25.916987+0000","last_became_peered":"2023-08-27T11:25:25.916987+0000","last_unstale":"2023-08-27T11:25:27.238955+0000","last_undegraded":"2023-08-27T11:25:27.238955+0000","last_fullsized":"2023-08-27T11:25:27.238955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:52.709527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237248+0000","last_change":"2023-08-27T11:25:25.918560+0000","last_active":"2023-08-27T11:25:27.237248+0000","last_peered":"2023-08-27T11:25:27.237248+0000","last_clean":"2023-08-27T11:25:27.237248+0000","last_became_active":"2023-08-27T11:25:25.917764+0000","last_became_peered":"2023-08-27T11:25:25.917764+0000","last_unstale":"2023-08-27T11:25:27.237248+0000","last_undegraded":"2023-08-27T11:25:27.237248+0000","last_fullsized":"2023-08-27T11:25:27.237248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:04.499768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.239064+0000","last_change":"2023-08-27T11:25:25.939650+0000","last_active":"2023-08-27T11:25:27.239064+0000","last_peered":"2023-08-27T11:25:27.239064+0000","last_clean":"2023-08-27T11:25:27.239064+0000","last_became_active":"2023-08-27T11:25:25.939319+0000","last_became_peered":"2023-08-27T11:25:25.939319+0000","last_unstale":"2023-08-27T11:25:27.239064+0000","last_undegraded":"2023-08-27T11:25:27.239064+0000","last_fullsized":"2023-08-27T11:25:27.239064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:51:37.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238116+0000","last_change":"2023-08-27T11:25:25.914574+0000","last_active":"2023-08-27T11:25:27.238116+0000","last_peered":"2023-08-27T11:25:27.238116+0000","last_clean":"2023-08-27T11:25:27.238116+0000","last_became_active":"2023-08-27T11:25:25.914276+0000","last_became_peered":"2023-08-27T11:25:25.914276+0000","last_unstale":"2023-08-27T11:25:27.238116+0000","last_undegraded":"2023-08-27T11:25:27.238116+0000","last_fullsized":"2023-08-27T11:25:27.238116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:00.312703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919876+0000","last_change":"2023-08-27T11:25:25.920187+0000","last_active":"2023-08-27T11:25:26.919876+0000","last_peered":"2023-08-27T11:25:26.919876+0000","last_clean":"2023-08-27T11:25:26.919876+0000","last_became_active":"2023-08-27T11:25:25.919190+0000","last_became_peered":"2023-08-27T11:25:25.919190+0000","last_unstale":"2023-08-27T11:25:26.919876+0000","last_undegraded":"2023-08-27T11:25:26.919876+0000","last_fullsized":"2023-08-27T11:25:26.919876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:42.879824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237631+0000","last_change":"2023-08-27T11:25:25.929953+0000","last_active":"2023-08-27T11:25:27.237631+0000","last_peered":"2023-08-27T11:25:27.237631+0000","last_clean":"2023-08-27T11:25:27.237631+0000","last_became_active":"2023-08-27T11:25:25.929649+0000","last_became_peered":"2023-08-27T11:25:25.929649+0000","last_unstale":"2023-08-27T11:25:27.237631+0000","last_undegraded":"2023-08-27T11:25:27.237631+0000","last_fullsized":"2023-08-27T11:25:27.237631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:40.812447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919106+0000","last_change":"2023-08-27T11:25:25.911733+0000","last_active":"2023-08-27T11:25:26.919106+0000","last_peered":"2023-08-27T11:25:26.919106+0000","last_clean":"2023-08-27T11:25:26.919106+0000","last_became_active":"2023-08-27T11:25:25.911316+0000","last_became_peered":"2023-08-27T11:25:25.911316+0000","last_unstale":"2023-08-27T11:25:26.919106+0000","last_undegraded":"2023-08-27T11:25:26.919106+0000","last_fullsized":"2023-08-27T11:25:26.919106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:24.297771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237382+0000","last_change":"2023-08-27T11:25:25.929197+0000","last_active":"2023-08-27T11:25:27.237382+0000","last_peered":"2023-08-27T11:25:27.237382+0000","last_clean":"2023-08-27T11:25:27.237382+0000","last_became_active":"2023-08-27T11:25:25.928787+0000","last_became_peered":"2023-08-27T11:25:25.928787+0000","last_unstale":"2023-08-27T11:25:27.237382+0000","last_undegraded":"2023-08-27T11:25:27.237382+0000","last_fullsized":"2023-08-27T11:25:27.237382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:55:52.295478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238277+0000","last_change":"2023-08-27T11:25:25.929003+0000","last_active":"2023-08-27T11:25:27.238277+0000","last_peered":"2023-08-27T11:25:27.238277+0000","last_clean":"2023-08-27T11:25:27.238277+0000","last_became_active":"2023-08-27T11:25:25.928698+0000","last_became_peered":"2023-08-27T11:25:25.928698+0000","last_unstale":"2023-08-27T11:25:27.238277+0000","last_undegraded":"2023-08-27T11:25:27.238277+0000","last_fullsized":"2023-08-27T11:25:27.238277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:57:59.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237306+0000","last_change":"2023-08-27T11:25:25.921127+0000","last_active":"2023-08-27T11:25:27.237306+0000","last_peered":"2023-08-27T11:25:27.237306+0000","last_clean":"2023-08-27T11:25:27.237306+0000","last_became_active":"2023-08-27T11:25:25.920708+0000","last_became_peered":"2023-08-27T11:25:25.920708+0000","last_unstale":"2023-08-27T11:25:27.237306+0000","last_undegraded":"2023-08-27T11:25:27.237306+0000","last_fullsized":"2023-08-27T11:25:27.237306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:59:54.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919519+0000","last_change":"2023-08-27T11:25:25.917676+0000","last_active":"2023-08-27T11:25:26.919519+0000","last_peered":"2023-08-27T11:25:26.919519+0000","last_clean":"2023-08-27T11:25:26.919519+0000","last_became_active":"2023-08-27T11:25:25.917397+0000","last_became_peered":"2023-08-27T11:25:25.917397+0000","last_unstale":"2023-08-27T11:25:26.919519+0000","last_undegraded":"2023-08-27T11:25:26.919519+0000","last_fullsized":"2023-08-27T11:25:26.919519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:48:03.414485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238157+0000","last_change":"2023-08-27T11:25:25.913903+0000","last_active":"2023-08-27T11:25:27.238157+0000","last_peered":"2023-08-27T11:25:27.238157+0000","last_clean":"2023-08-27T11:25:27.238157+0000","last_became_active":"2023-08-27T11:25:25.913538+0000","last_became_peered":"2023-08-27T11:25:25.913538+0000","last_unstale":"2023-08-27T11:25:27.238157+0000","last_undegraded":"2023-08-27T11:25:27.238157+0000","last_fullsized":"2023-08-27T11:25:27.238157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:24.786907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237659+0000","last_change":"2023-08-27T11:25:25.921968+0000","last_active":"2023-08-27T11:25:27.237659+0000","last_peered":"2023-08-27T11:25:27.237659+0000","last_clean":"2023-08-27T11:25:27.237659+0000","last_became_active":"2023-08-27T11:25:25.921599+0000","last_became_peered":"2023-08-27T11:25:25.921599+0000","last_unstale":"2023-08-27T11:25:27.237659+0000","last_undegraded":"2023-08-27T11:25:27.237659+0000","last_fullsized":"2023-08-27T11:25:27.237659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:22:08.772762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919930+0000","last_change":"2023-08-27T11:25:25.918906+0000","last_active":"2023-08-27T11:25:26.919930+0000","last_peered":"2023-08-27T11:25:26.919930+0000","last_clean":"2023-08-27T11:25:26.919930+0000","last_became_active":"2023-08-27T11:25:25.918611+0000","last_became_peered":"2023-08-27T11:25:25.918611+0000","last_unstale":"2023-08-27T11:25:26.919930+0000","last_undegraded":"2023-08-27T11:25:26.919930+0000","last_fullsized":"2023-08-27T11:25:26.919930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:33:47.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237415+0000","last_change":"2023-08-27T11:25:25.918833+0000","last_active":"2023-08-27T11:25:27.237415+0000","last_peered":"2023-08-27T11:25:27.237415+0000","last_clean":"2023-08-27T11:25:27.237415+0000","last_became_active":"2023-08-27T11:25:25.918563+0000","last_became_peered":"2023-08-27T11:25:25.918563+0000","last_unstale":"2023-08-27T11:25:27.237415+0000","last_undegraded":"2023-08-27T11:25:27.237415+0000","last_fullsized":"2023-08-27T11:25:27.237415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:45.338582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919779+0000","last_change":"2023-08-27T11:25:25.919078+0000","last_active":"2023-08-27T11:25:26.919779+0000","last_peered":"2023-08-27T11:25:26.919779+0000","last_clean":"2023-08-27T11:25:26.919779+0000","last_became_active":"2023-08-27T11:25:25.918526+0000","last_became_peered":"2023-08-27T11:25:25.918526+0000","last_unstale":"2023-08-27T11:25:26.919779+0000","last_undegraded":"2023-08-27T11:25:26.919779+0000","last_fullsized":"2023-08-27T11:25:26.919779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:02.248547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237037+0000","last_change":"2023-08-27T11:25:25.919258+0000","last_active":"2023-08-27T11:25:27.237037+0000","last_peered":"2023-08-27T11:25:27.237037+0000","last_clean":"2023-08-27T11:25:27.237037+0000","last_became_active":"2023-08-27T11:25:25.917907+0000","last_became_peered":"2023-08-27T11:25:25.917907+0000","last_unstale":"2023-08-27T11:25:27.237037+0000","last_undegraded":"2023-08-27T11:25:27.237037+0000","last_fullsized":"2023-08-27T11:25:27.237037+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:43:34.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"67'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238791+0000","last_change":"2023-08-27T11:25:24.908438+0000","last_active":"2023-08-27T11:25:27.238791+0000","last_peered":"2023-08-27T11:25:27.238791+0000","last_clean":"2023-08-27T11:25:27.238791+0000","last_became_active":"2023-08-27T11:25:24.908166+0000","last_became_peered":"2023-08-27T11:25:24.908166+0000","last_unstale":"2023-08-27T11:25:27.238791+0000","last_undegraded":"2023-08-27T11:25:27.238791+0000","last_fullsized":"2023-08-27T11:25:27.238791+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:04.621001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238459+0000","last_change":"2023-08-27T11:25:25.924057+0000","last_active":"2023-08-27T11:25:27.238459+0000","last_peered":"2023-08-27T11:25:27.238459+0000","last_clean":"2023-08-27T11:25:27.238459+0000","last_became_active":"2023-08-27T11:25:25.923777+0000","last_became_peered":"2023-08-27T11:25:25.923777+0000","last_unstale":"2023-08-27T11:25:27.238459+0000","last_undegraded":"2023-08-27T11:25:27.238459+0000","last_fullsized":"2023-08-27T11:25:27.238459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:57.323241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919362+0000","last_change":"2023-08-27T11:25:24.931041+0000","last_active":"2023-08-27T11:25:26.919362+0000","last_peered":"2023-08-27T11:25:26.919362+0000","last_clean":"2023-08-27T11:25:26.919362+0000","last_became_active":"2023-08-27T11:25:24.930712+0000","last_became_peered":"2023-08-27T11:25:24.930712+0000","last_unstale":"2023-08-27T11:25:26.919362+0000","last_undegraded":"2023-08-27T11:25:26.919362+0000","last_fullsized":"2023-08-27T11:25:26.919362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:53:56.471080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919340+0000","last_change":"2023-08-27T11:25:25.929146+0000","last_active":"2023-08-27T11:25:26.919340+0000","last_peered":"2023-08-27T11:25:26.919340+0000","last_clean":"2023-08-27T11:25:26.919340+0000","last_became_active":"2023-08-27T11:25:25.928546+0000","last_became_peered":"2023-08-27T11:25:25.928546+0000","last_unstale":"2023-08-27T11:25:26.919340+0000","last_undegraded":"2023-08-27T11:25:26.919340+0000","last_fullsized":"2023-08-27T11:25:26.919340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:03.583844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919848+0000","last_change":"2023-08-27T11:25:24.919539+0000","last_active":"2023-08-27T11:25:26.919848+0000","last_peered":"2023-08-27T11:25:26.919848+0000","last_clean":"2023-08-27T11:25:26.919848+0000","last_became_active":"2023-08-27T11:25:24.919241+0000","last_became_peered":"2023-08-27T11:25:24.919241+0000","last_unstale":"2023-08-27T11:25:26.919848+0000","last_undegraded":"2023-08-27T11:25:26.919848+0000","last_fullsized":"2023-08-27T11:25:26.919848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:55.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919980+0000","last_change":"2023-08-27T11:25:25.919986+0000","last_active":"2023-08-27T11:25:26.919980+0000","last_peered":"2023-08-27T11:25:26.919980+0000","last_clean":"2023-08-27T11:25:26.919980+0000","last_became_active":"2023-08-27T11:25:25.918819+0000","last_became_peered":"2023-08-27T11:25:25.918819+0000","last_unstale":"2023-08-27T11:25:26.919980+0000","last_undegraded":"2023-08-27T11:25:26.919980+0000","last_fullsized":"2023-08-27T11:25:26.919980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:12:48.152083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917746+0000","last_change":"2023-08-27T11:25:24.920378+0000","last_active":"2023-08-27T11:25:26.917746+0000","last_peered":"2023-08-27T11:25:26.917746+0000","last_clean":"2023-08-27T11:25:26.917746+0000","last_became_active":"2023-08-27T11:25:24.919551+0000","last_became_peered":"2023-08-27T11:25:24.919551+0000","last_unstale":"2023-08-27T11:25:26.917746+0000","last_undegraded":"2023-08-27T11:25:26.917746+0000","last_fullsized":"2023-08-27T11:25:26.917746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:15:21.085319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238063+0000","last_change":"2023-08-27T11:25:25.936331+0000","last_active":"2023-08-27T11:25:27.238063+0000","last_peered":"2023-08-27T11:25:27.238063+0000","last_clean":"2023-08-27T11:25:27.238063+0000","last_became_active":"2023-08-27T11:25:25.936024+0000","last_became_peered":"2023-08-27T11:25:25.936024+0000","last_unstale":"2023-08-27T11:25:27.238063+0000","last_undegraded":"2023-08-27T11:25:27.238063+0000","last_fullsized":"2023-08-27T11:25:27.238063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:28:20.219883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920123+0000","last_change":"2023-08-27T11:25:24.923303+0000","last_active":"2023-08-27T11:25:26.920123+0000","last_peered":"2023-08-27T11:25:26.920123+0000","last_clean":"2023-08-27T11:25:26.920123+0000","last_became_active":"2023-08-27T11:25:24.922964+0000","last_became_peered":"2023-08-27T11:25:24.922964+0000","last_unstale":"2023-08-27T11:25:26.920123+0000","last_undegraded":"2023-08-27T11:25:26.920123+0000","last_fullsized":"2023-08-27T11:25:26.920123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:51:34.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238855+0000","last_change":"2023-08-27T11:25:25.940542+0000","last_active":"2023-08-27T11:25:27.238855+0000","last_peered":"2023-08-27T11:25:27.238855+0000","last_clean":"2023-08-27T11:25:27.238855+0000","last_became_active":"2023-08-27T11:25:25.940163+0000","last_became_peered":"2023-08-27T11:25:25.940163+0000","last_unstale":"2023-08-27T11:25:27.238855+0000","last_undegraded":"2023-08-27T11:25:27.238855+0000","last_fullsized":"2023-08-27T11:25:27.238855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:42.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237569+0000","last_change":"2023-08-27T11:25:24.924224+0000","last_active":"2023-08-27T11:25:27.237569+0000","last_peered":"2023-08-27T11:25:27.237569+0000","last_clean":"2023-08-27T11:25:27.237569+0000","last_became_active":"2023-08-27T11:25:24.923933+0000","last_became_peered":"2023-08-27T11:25:24.923933+0000","last_unstale":"2023-08-27T11:25:27.237569+0000","last_undegraded":"2023-08-27T11:25:27.237569+0000","last_fullsized":"2023-08-27T11:25:27.237569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:15.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919716+0000","last_change":"2023-08-27T11:25:25.923264+0000","last_active":"2023-08-27T11:25:26.919716+0000","last_peered":"2023-08-27T11:25:26.919716+0000","last_clean":"2023-08-27T11:25:26.919716+0000","last_became_active":"2023-08-27T11:25:25.922923+0000","last_became_peered":"2023-08-27T11:25:25.922923+0000","last_unstale":"2023-08-27T11:25:26.919716+0000","last_undegraded":"2023-08-27T11:25:26.919716+0000","last_fullsized":"2023-08-27T11:25:26.919716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:41.015367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238663+0000","last_change":"2023-08-27T11:25:24.925097+0000","last_active":"2023-08-27T11:25:27.238663+0000","last_peered":"2023-08-27T11:25:27.238663+0000","last_clean":"2023-08-27T11:25:27.238663+0000","last_became_active":"2023-08-27T11:25:24.924803+0000","last_became_peered":"2023-08-27T11:25:24.924803+0000","last_unstale":"2023-08-27T11:25:27.238663+0000","last_undegraded":"2023-08-27T11:25:27.238663+0000","last_fullsized":"2023-08-27T11:25:27.238663+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:20.311999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917540+0000","last_change":"2023-08-27T11:25:25.935610+0000","last_active":"2023-08-27T11:25:26.917540+0000","last_peered":"2023-08-27T11:25:26.917540+0000","last_clean":"2023-08-27T11:25:26.917540+0000","last_became_active":"2023-08-27T11:25:25.935339+0000","last_became_peered":"2023-08-27T11:25:25.935339+0000","last_unstale":"2023-08-27T11:25:26.917540+0000","last_undegraded":"2023-08-27T11:25:26.917540+0000","last_fullsized":"2023-08-27T11:25:26.917540+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:22.043829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237089+0000","last_change":"2023-08-27T11:25:24.921040+0000","last_active":"2023-08-27T11:25:27.237089+0000","last_peered":"2023-08-27T11:25:27.237089+0000","last_clean":"2023-08-27T11:25:27.237089+0000","last_became_active":"2023-08-27T11:25:24.920745+0000","last_became_peered":"2023-08-27T11:25:24.920745+0000","last_unstale":"2023-08-27T11:25:27.237089+0000","last_undegraded":"2023-08-27T11:25:27.237089+0000","last_fullsized":"2023-08-27T11:25:27.237089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:51.396944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237526+0000","last_change":"2023-08-27T11:25:25.920135+0000","last_active":"2023-08-27T11:25:27.237526+0000","last_peered":"2023-08-27T11:25:27.237526+0000","last_clean":"2023-08-27T11:25:27.237526+0000","last_became_active":"2023-08-27T11:25:25.919843+0000","last_became_peered":"2023-08-27T11:25:25.919843+0000","last_unstale":"2023-08-27T11:25:27.237526+0000","last_undegraded":"2023-08-27T11:25:27.237526+0000","last_fullsized":"2023-08-27T11:25:27.237526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:24.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919785+0000","last_change":"2023-08-27T11:25:24.931138+0000","last_active":"2023-08-27T11:25:26.919785+0000","last_peered":"2023-08-27T11:25:26.919785+0000","last_clean":"2023-08-27T11:25:26.919785+0000","last_became_active":"2023-08-27T11:25:24.930796+0000","last_became_peered":"2023-08-27T11:25:24.930796+0000","last_unstale":"2023-08-27T11:25:26.919785+0000","last_undegraded":"2023-08-27T11:25:26.919785+0000","last_fullsized":"2023-08-27T11:25:26.919785+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:02.594976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.236995+0000","last_change":"2023-08-27T11:25:25.914817+0000","last_active":"2023-08-27T11:25:27.236995+0000","last_peered":"2023-08-27T11:25:27.236995+0000","last_clean":"2023-08-27T11:25:27.236995+0000","last_became_active":"2023-08-27T11:25:25.914450+0000","last_became_peered":"2023-08-27T11:25:25.914450+0000","last_unstale":"2023-08-27T11:25:27.236995+0000","last_undegraded":"2023-08-27T11:25:27.236995+0000","last_fullsized":"2023-08-27T11:25:27.236995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:08.028200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237465+0000","last_change":"2023-08-27T11:25:24.923906+0000","last_active":"2023-08-27T11:25:27.237465+0000","last_peered":"2023-08-27T11:25:27.237465+0000","last_clean":"2023-08-27T11:25:27.237465+0000","last_became_active":"2023-08-27T11:25:24.923601+0000","last_became_peered":"2023-08-27T11:25:24.923601+0000","last_unstale":"2023-08-27T11:25:27.237465+0000","last_undegraded":"2023-08-27T11:25:27.237465+0000","last_fullsized":"2023-08-27T11:25:27.237465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:09.160833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238279+0000","last_change":"2023-08-27T11:25:25.942147+0000","last_active":"2023-08-27T11:25:27.238279+0000","last_peered":"2023-08-27T11:25:27.238279+0000","last_clean":"2023-08-27T11:25:27.238279+0000","last_became_active":"2023-08-27T11:25:25.941848+0000","last_became_peered":"2023-08-27T11:25:25.941848+0000","last_unstale":"2023-08-27T11:25:27.238279+0000","last_undegraded":"2023-08-27T11:25:27.238279+0000","last_fullsized":"2023-08-27T11:25:27.238279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:18.158403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"67'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237462+0000","last_change":"2023-08-27T11:25:24.918632+0000","last_active":"2023-08-27T11:25:27.237462+0000","last_peered":"2023-08-27T11:25:27.237462+0000","last_clean":"2023-08-27T11:25:27.237462+0000","last_became_active":"2023-08-27T11:25:24.918354+0000","last_became_peered":"2023-08-27T11:25:24.918354+0000","last_unstale":"2023-08-27T11:25:27.237462+0000","last_undegraded":"2023-08-27T11:25:27.237462+0000","last_fullsized":"2023-08-27T11:25:27.237462+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:26.584618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237568+0000","last_change":"2023-08-27T11:25:25.935940+0000","last_active":"2023-08-27T11:25:27.237568+0000","last_peered":"2023-08-27T11:25:27.237568+0000","last_clean":"2023-08-27T11:25:27.237568+0000","last_became_active":"2023-08-27T11:25:25.929593+0000","last_became_peered":"2023-08-27T11:25:25.929593+0000","last_unstale":"2023-08-27T11:25:27.237568+0000","last_undegraded":"2023-08-27T11:25:27.237568+0000","last_fullsized":"2023-08-27T11:25:27.237568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:01.556223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"67'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917763+0000","last_change":"2023-08-27T11:25:24.923843+0000","last_active":"2023-08-27T11:25:26.917763+0000","last_peered":"2023-08-27T11:25:26.917763+0000","last_clean":"2023-08-27T11:25:26.917763+0000","last_became_active":"2023-08-27T11:25:24.923525+0000","last_became_peered":"2023-08-27T11:25:24.923525+0000","last_unstale":"2023-08-27T11:25:26.917763+0000","last_undegraded":"2023-08-27T11:25:26.917763+0000","last_fullsized":"2023-08-27T11:25:26.917763+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:07.024701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237442+0000","last_change":"2023-08-27T11:25:25.932714+0000","last_active":"2023-08-27T11:25:27.237442+0000","last_peered":"2023-08-27T11:25:27.237442+0000","last_clean":"2023-08-27T11:25:27.237442+0000","last_became_active":"2023-08-27T11:25:25.932379+0000","last_became_peered":"2023-08-27T11:25:25.932379+0000","last_unstale":"2023-08-27T11:25:27.237442+0000","last_undegraded":"2023-08-27T11:25:27.237442+0000","last_fullsized":"2023-08-27T11:25:27.237442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:26:05.456538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237069+0000","last_change":"2023-08-27T11:25:24.925180+0000","last_active":"2023-08-27T11:25:27.237069+0000","last_peered":"2023-08-27T11:25:27.237069+0000","last_clean":"2023-08-27T11:25:27.237069+0000","last_became_active":"2023-08-27T11:25:24.924811+0000","last_became_peered":"2023-08-27T11:25:24.924811+0000","last_unstale":"2023-08-27T11:25:27.237069+0000","last_undegraded":"2023-08-27T11:25:27.237069+0000","last_fullsized":"2023-08-27T11:25:27.237069+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:14.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917508+0000","last_change":"2023-08-27T11:25:25.933637+0000","last_active":"2023-08-27T11:25:26.917508+0000","last_peered":"2023-08-27T11:25:26.917508+0000","last_clean":"2023-08-27T11:25:26.917508+0000","last_became_active":"2023-08-27T11:25:25.933336+0000","last_became_peered":"2023-08-27T11:25:25.933336+0000","last_unstale":"2023-08-27T11:25:26.917508+0000","last_undegraded":"2023-08-27T11:25:26.917508+0000","last_fullsized":"2023-08-27T11:25:26.917508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:40.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920091+0000","last_change":"2023-08-27T11:25:24.921229+0000","last_active":"2023-08-27T11:25:26.920091+0000","last_peered":"2023-08-27T11:25:26.920091+0000","last_clean":"2023-08-27T11:25:26.920091+0000","last_became_active":"2023-08-27T11:25:24.920853+0000","last_became_peered":"2023-08-27T11:25:24.920853+0000","last_unstale":"2023-08-27T11:25:26.920091+0000","last_undegraded":"2023-08-27T11:25:26.920091+0000","last_fullsized":"2023-08-27T11:25:26.920091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:10.472800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917544+0000","last_change":"2023-08-27T11:25:25.917984+0000","last_active":"2023-08-27T11:25:26.917544+0000","last_peered":"2023-08-27T11:25:26.917544+0000","last_clean":"2023-08-27T11:25:26.917544+0000","last_became_active":"2023-08-27T11:25:25.917528+0000","last_became_peered":"2023-08-27T11:25:25.917528+0000","last_unstale":"2023-08-27T11:25:26.917544+0000","last_undegraded":"2023-08-27T11:25:26.917544+0000","last_fullsized":"2023-08-27T11:25:26.917544+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:31.755452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237407+0000","last_change":"2023-08-27T11:25:24.906755+0000","last_active":"2023-08-27T11:25:27.237407+0000","last_peered":"2023-08-27T11:25:27.237407+0000","last_clean":"2023-08-27T11:25:27.237407+0000","last_became_active":"2023-08-27T11:25:24.906473+0000","last_became_peered":"2023-08-27T11:25:24.906473+0000","last_unstale":"2023-08-27T11:25:27.237407+0000","last_undegraded":"2023-08-27T11:25:27.237407+0000","last_fullsized":"2023-08-27T11:25:27.237407+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:25.255081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917928+0000","last_change":"2023-08-27T11:25:25.931767+0000","last_active":"2023-08-27T11:25:26.917928+0000","last_peered":"2023-08-27T11:25:26.917928+0000","last_clean":"2023-08-27T11:25:26.917928+0000","last_became_active":"2023-08-27T11:25:25.931485+0000","last_became_peered":"2023-08-27T11:25:25.931485+0000","last_unstale":"2023-08-27T11:25:26.917928+0000","last_undegraded":"2023-08-27T11:25:26.917928+0000","last_fullsized":"2023-08-27T11:25:26.917928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:16.000149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"67'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237660+0000","last_change":"2023-08-27T11:25:24.923864+0000","last_active":"2023-08-27T11:25:27.237660+0000","last_peered":"2023-08-27T11:25:27.237660+0000","last_clean":"2023-08-27T11:25:27.237660+0000","last_became_active":"2023-08-27T11:25:24.923584+0000","last_became_peered":"2023-08-27T11:25:24.923584+0000","last_unstale":"2023-08-27T11:25:27.237660+0000","last_undegraded":"2023-08-27T11:25:27.237660+0000","last_fullsized":"2023-08-27T11:25:27.237660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:22.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.918919+0000","last_change":"2023-08-27T11:25:25.917014+0000","last_active":"2023-08-27T11:25:26.918919+0000","last_peered":"2023-08-27T11:25:26.918919+0000","last_clean":"2023-08-27T11:25:26.918919+0000","last_became_active":"2023-08-27T11:25:25.916541+0000","last_became_peered":"2023-08-27T11:25:25.916541+0000","last_unstale":"2023-08-27T11:25:26.918919+0000","last_undegraded":"2023-08-27T11:25:26.918919+0000","last_fullsized":"2023-08-27T11:25:26.918919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:16.298366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237330+0000","last_change":"2023-08-27T11:25:24.922363+0000","last_active":"2023-08-27T11:25:27.237330+0000","last_peered":"2023-08-27T11:25:27.237330+0000","last_clean":"2023-08-27T11:25:27.237330+0000","last_became_active":"2023-08-27T11:25:24.922020+0000","last_became_peered":"2023-08-27T11:25:24.922020+0000","last_unstale":"2023-08-27T11:25:27.237330+0000","last_undegraded":"2023-08-27T11:25:27.237330+0000","last_fullsized":"2023-08-27T11:25:27.237330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:34:16.735217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917146+0000","last_change":"2023-08-27T11:25:25.931703+0000","last_active":"2023-08-27T11:25:26.917146+0000","last_peered":"2023-08-27T11:25:26.917146+0000","last_clean":"2023-08-27T11:25:26.917146+0000","last_became_active":"2023-08-27T11:25:25.931332+0000","last_became_peered":"2023-08-27T11:25:25.931332+0000","last_unstale":"2023-08-27T11:25:26.917146+0000","last_undegraded":"2023-08-27T11:25:26.917146+0000","last_fullsized":"2023-08-27T11:25:26.917146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:01:36.528681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238732+0000","last_change":"2023-08-27T11:25:24.917472+0000","last_active":"2023-08-27T11:25:27.238732+0000","last_peered":"2023-08-27T11:25:27.238732+0000","last_clean":"2023-08-27T11:25:27.238732+0000","last_became_active":"2023-08-27T11:25:24.917200+0000","last_became_peered":"2023-08-27T11:25:24.917200+0000","last_unstale":"2023-08-27T11:25:27.238732+0000","last_undegraded":"2023-08-27T11:25:27.238732+0000","last_fullsized":"2023-08-27T11:25:27.238732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:46:28.540835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919347+0000","last_change":"2023-08-27T11:25:25.928906+0000","last_active":"2023-08-27T11:25:26.919347+0000","last_peered":"2023-08-27T11:25:26.919347+0000","last_clean":"2023-08-27T11:25:26.919347+0000","last_became_active":"2023-08-27T11:25:25.928450+0000","last_became_peered":"2023-08-27T11:25:25.928450+0000","last_unstale":"2023-08-27T11:25:26.919347+0000","last_undegraded":"2023-08-27T11:25:26.919347+0000","last_fullsized":"2023-08-27T11:25:26.919347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:10.828528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920013+0000","last_change":"2023-08-27T11:25:24.920783+0000","last_active":"2023-08-27T11:25:26.920013+0000","last_peered":"2023-08-27T11:25:26.920013+0000","last_clean":"2023-08-27T11:25:26.920013+0000","last_became_active":"2023-08-27T11:25:24.920476+0000","last_became_peered":"2023-08-27T11:25:24.920476+0000","last_unstale":"2023-08-27T11:25:26.920013+0000","last_undegraded":"2023-08-27T11:25:26.920013+0000","last_fullsized":"2023-08-27T11:25:26.920013+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:10.879990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237811+0000","last_change":"2023-08-27T11:25:25.922672+0000","last_active":"2023-08-27T11:25:27.237811+0000","last_peered":"2023-08-27T11:25:27.237811+0000","last_clean":"2023-08-27T11:25:27.237811+0000","last_became_active":"2023-08-27T11:25:25.922274+0000","last_became_peered":"2023-08-27T11:25:25.922274+0000","last_unstale":"2023-08-27T11:25:27.237811+0000","last_undegraded":"2023-08-27T11:25:27.237811+0000","last_fullsized":"2023-08-27T11:25:27.237811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:06.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919359+0000","last_change":"2023-08-27T11:25:24.926030+0000","last_active":"2023-08-27T11:25:26.919359+0000","last_peered":"2023-08-27T11:25:26.919359+0000","last_clean":"2023-08-27T11:25:26.919359+0000","last_became_active":"2023-08-27T11:25:24.925704+0000","last_became_peered":"2023-08-27T11:25:24.925704+0000","last_unstale":"2023-08-27T11:25:26.919359+0000","last_undegraded":"2023-08-27T11:25:26.919359+0000","last_fullsized":"2023-08-27T11:25:26.919359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:07.612958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917409+0000","last_change":"2023-08-27T11:25:25.931926+0000","last_active":"2023-08-27T11:25:26.917409+0000","last_peered":"2023-08-27T11:25:26.917409+0000","last_clean":"2023-08-27T11:25:26.917409+0000","last_became_active":"2023-08-27T11:25:25.931526+0000","last_became_peered":"2023-08-27T11:25:25.931526+0000","last_unstale":"2023-08-27T11:25:26.917409+0000","last_undegraded":"2023-08-27T11:25:26.917409+0000","last_fullsized":"2023-08-27T11:25:26.917409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:34.408450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917446+0000","last_change":"2023-08-27T11:25:24.919971+0000","last_active":"2023-08-27T11:25:26.917446+0000","last_peered":"2023-08-27T11:25:26.917446+0000","last_clean":"2023-08-27T11:25:26.917446+0000","last_became_active":"2023-08-27T11:25:24.919560+0000","last_became_peered":"2023-08-27T11:25:24.919560+0000","last_unstale":"2023-08-27T11:25:26.917446+0000","last_undegraded":"2023-08-27T11:25:26.917446+0000","last_fullsized":"2023-08-27T11:25:26.917446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:41.429689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917686+0000","last_change":"2023-08-27T11:25:25.935524+0000","last_active":"2023-08-27T11:25:26.917686+0000","last_peered":"2023-08-27T11:25:26.917686+0000","last_clean":"2023-08-27T11:25:26.917686+0000","last_became_active":"2023-08-27T11:25:25.935234+0000","last_became_peered":"2023-08-27T11:25:25.935234+0000","last_unstale":"2023-08-27T11:25:26.917686+0000","last_undegraded":"2023-08-27T11:25:26.917686+0000","last_fullsized":"2023-08-27T11:25:26.917686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:58.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237898+0000","last_change":"2023-08-27T11:25:24.908964+0000","last_active":"2023-08-27T11:25:27.237898+0000","last_peered":"2023-08-27T11:25:27.237898+0000","last_clean":"2023-08-27T11:25:27.237898+0000","last_became_active":"2023-08-27T11:25:24.908673+0000","last_became_peered":"2023-08-27T11:25:24.908673+0000","last_unstale":"2023-08-27T11:25:27.237898+0000","last_undegraded":"2023-08-27T11:25:27.237898+0000","last_fullsized":"2023-08-27T11:25:27.237898+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:59.327312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237406+0000","last_change":"2023-08-27T11:25:25.918600+0000","last_active":"2023-08-27T11:25:27.237406+0000","last_peered":"2023-08-27T11:25:27.237406+0000","last_clean":"2023-08-27T11:25:27.237406+0000","last_became_active":"2023-08-27T11:25:25.918312+0000","last_became_peered":"2023-08-27T11:25:25.918312+0000","last_unstale":"2023-08-27T11:25:27.237406+0000","last_undegraded":"2023-08-27T11:25:27.237406+0000","last_fullsized":"2023-08-27T11:25:27.237406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:10.888398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917743+0000","last_change":"2023-08-27T11:25:24.923991+0000","last_active":"2023-08-27T11:25:26.917743+0000","last_peered":"2023-08-27T11:25:26.917743+0000","last_clean":"2023-08-27T11:25:26.917743+0000","last_became_active":"2023-08-27T11:25:24.923644+0000","last_became_peered":"2023-08-27T11:25:24.923644+0000","last_unstale":"2023-08-27T11:25:26.917743+0000","last_undegraded":"2023-08-27T11:25:26.917743+0000","last_fullsized":"2023-08-27T11:25:26.917743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:21:51.460522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238237+0000","last_change":"2023-08-27T11:25:25.921172+0000","last_active":"2023-08-27T11:25:27.238237+0000","last_peered":"2023-08-27T11:25:27.238237+0000","last_clean":"2023-08-27T11:25:27.238237+0000","last_became_active":"2023-08-27T11:25:25.920800+0000","last_became_peered":"2023-08-27T11:25:25.920800+0000","last_unstale":"2023-08-27T11:25:27.238237+0000","last_undegraded":"2023-08-27T11:25:27.238237+0000","last_fullsized":"2023-08-27T11:25:27.238237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:24.297771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237170+0000","last_change":"2023-08-27T11:25:24.923852+0000","last_active":"2023-08-27T11:25:27.237170+0000","last_peered":"2023-08-27T11:25:27.237170+0000","last_clean":"2023-08-27T11:25:27.237170+0000","last_became_active":"2023-08-27T11:25:24.923556+0000","last_became_peered":"2023-08-27T11:25:24.923556+0000","last_unstale":"2023-08-27T11:25:27.237170+0000","last_undegraded":"2023-08-27T11:25:27.237170+0000","last_fullsized":"2023-08-27T11:25:27.237170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:30.082503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237771+0000","last_change":"2023-08-27T11:25:25.921147+0000","last_active":"2023-08-27T11:25:27.237771+0000","last_peered":"2023-08-27T11:25:27.237771+0000","last_clean":"2023-08-27T11:25:27.237771+0000","last_became_active":"2023-08-27T11:25:25.920865+0000","last_became_peered":"2023-08-27T11:25:25.920865+0000","last_unstale":"2023-08-27T11:25:27.237771+0000","last_undegraded":"2023-08-27T11:25:27.237771+0000","last_fullsized":"2023-08-27T11:25:27.237771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:44.577319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237689+0000","last_change":"2023-08-27T11:25:24.920647+0000","last_active":"2023-08-27T11:25:27.237689+0000","last_peered":"2023-08-27T11:25:27.237689+0000","last_clean":"2023-08-27T11:25:27.237689+0000","last_became_active":"2023-08-27T11:25:24.920179+0000","last_became_peered":"2023-08-27T11:25:24.920179+0000","last_unstale":"2023-08-27T11:25:27.237689+0000","last_undegraded":"2023-08-27T11:25:27.237689+0000","last_fullsized":"2023-08-27T11:25:27.237689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:45.119170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917926+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:25:26.917926+0000","last_peered":"2023-08-27T11:25:26.917926+0000","last_clean":"2023-08-27T11:25:26.917926+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:25:26.917926+0000","last_undegraded":"2023-08-27T11:25:26.917926+0000","last_fullsized":"2023-08-27T11:25:26.917926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:08:47.831886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238015+0000","last_change":"2023-08-27T11:25:25.939685+0000","last_active":"2023-08-27T11:25:27.238015+0000","last_peered":"2023-08-27T11:25:27.238015+0000","last_clean":"2023-08-27T11:25:27.238015+0000","last_became_active":"2023-08-27T11:25:25.939347+0000","last_became_peered":"2023-08-27T11:25:25.939347+0000","last_unstale":"2023-08-27T11:25:27.238015+0000","last_undegraded":"2023-08-27T11:25:27.238015+0000","last_fullsized":"2023-08-27T11:25:27.238015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:05.194996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237781+0000","last_change":"2023-08-27T11:25:24.916105+0000","last_active":"2023-08-27T11:25:27.237781+0000","last_peered":"2023-08-27T11:25:27.237781+0000","last_clean":"2023-08-27T11:25:27.237781+0000","last_became_active":"2023-08-27T11:25:24.915828+0000","last_became_peered":"2023-08-27T11:25:24.915828+0000","last_unstale":"2023-08-27T11:25:27.237781+0000","last_undegraded":"2023-08-27T11:25:27.237781+0000","last_fullsized":"2023-08-27T11:25:27.237781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:15.294867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917667+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:25:26.917667+0000","last_peered":"2023-08-27T11:25:26.917667+0000","last_clean":"2023-08-27T11:25:26.917667+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:25:26.917667+0000","last_undegraded":"2023-08-27T11:25:26.917667+0000","last_fullsized":"2023-08-27T11:25:26.917667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:12.072398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238275+0000","last_change":"2023-08-27T11:25:25.921131+0000","last_active":"2023-08-27T11:25:27.238275+0000","last_peered":"2023-08-27T11:25:27.238275+0000","last_clean":"2023-08-27T11:25:27.238275+0000","last_became_active":"2023-08-27T11:25:25.920806+0000","last_became_peered":"2023-08-27T11:25:25.920806+0000","last_unstale":"2023-08-27T11:25:27.238275+0000","last_undegraded":"2023-08-27T11:25:27.238275+0000","last_fullsized":"2023-08-27T11:25:27.238275+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:50.875046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238156+0000","last_change":"2023-08-27T11:25:24.918132+0000","last_active":"2023-08-27T11:25:27.238156+0000","last_peered":"2023-08-27T11:25:27.238156+0000","last_clean":"2023-08-27T11:25:27.238156+0000","last_became_active":"2023-08-27T11:25:24.917778+0000","last_became_peered":"2023-08-27T11:25:24.917778+0000","last_unstale":"2023-08-27T11:25:27.238156+0000","last_undegraded":"2023-08-27T11:25:27.238156+0000","last_fullsized":"2023-08-27T11:25:27.238156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:46:28.540835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":110,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237161+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:25:27.237161+0000","last_peered":"2023-08-27T11:25:27.237161+0000","last_clean":"2023-08-27T11:25:27.237161+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:25:27.237161+0000","last_undegraded":"2023-08-27T11:25:27.237161+0000","last_fullsized":"2023-08-27T11:25:27.237161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:08.998725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919688+0000","last_change":"2023-08-27T11:25:25.921627+0000","last_active":"2023-08-27T11:25:26.919688+0000","last_peered":"2023-08-27T11:25:26.919688+0000","last_clean":"2023-08-27T11:25:26.919688+0000","last_became_active":"2023-08-27T11:25:25.920921+0000","last_became_peered":"2023-08-27T11:25:25.920921+0000","last_unstale":"2023-08-27T11:25:26.919688+0000","last_undegraded":"2023-08-27T11:25:26.919688+0000","last_fullsized":"2023-08-27T11:25:26.919688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:31:17.013170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238077+0000","last_change":"2023-08-27T11:25:24.919858+0000","last_active":"2023-08-27T11:25:27.238077+0000","last_peered":"2023-08-27T11:25:27.238077+0000","last_clean":"2023-08-27T11:25:27.238077+0000","last_became_active":"2023-08-27T11:25:24.919538+0000","last_became_peered":"2023-08-27T11:25:24.919538+0000","last_unstale":"2023-08-27T11:25:27.238077+0000","last_undegraded":"2023-08-27T11:25:27.238077+0000","last_fullsized":"2023-08-27T11:25:27.238077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:20.311999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920360+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:25:26.920360+0000","last_peered":"2023-08-27T11:25:26.920360+0000","last_clean":"2023-08-27T11:25:26.920360+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:25:26.920360+0000","last_undegraded":"2023-08-27T11:25:26.920360+0000","last_fullsized":"2023-08-27T11:25:26.920360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:39.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917753+0000","last_change":"2023-08-27T11:25:25.918035+0000","last_active":"2023-08-27T11:25:26.917753+0000","last_peered":"2023-08-27T11:25:26.917753+0000","last_clean":"2023-08-27T11:25:26.917753+0000","last_became_active":"2023-08-27T11:25:25.917588+0000","last_became_peered":"2023-08-27T11:25:25.917588+0000","last_unstale":"2023-08-27T11:25:26.917753+0000","last_undegraded":"2023-08-27T11:25:26.917753+0000","last_fullsized":"2023-08-27T11:25:26.917753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:05:58.119531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237377+0000","last_change":"2023-08-27T11:25:24.912962+0000","last_active":"2023-08-27T11:25:27.237377+0000","last_peered":"2023-08-27T11:25:27.237377+0000","last_clean":"2023-08-27T11:25:27.237377+0000","last_became_active":"2023-08-27T11:25:24.912591+0000","last_became_peered":"2023-08-27T11:25:24.912591+0000","last_unstale":"2023-08-27T11:25:27.237377+0000","last_undegraded":"2023-08-27T11:25:27.237377+0000","last_fullsized":"2023-08-27T11:25:27.237377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:56.319742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920205+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:25:26.920205+0000","last_peered":"2023-08-27T11:25:26.920205+0000","last_clean":"2023-08-27T11:25:26.920205+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:25:26.920205+0000","last_undegraded":"2023-08-27T11:25:26.920205+0000","last_fullsized":"2023-08-27T11:25:26.920205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:51.961771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238551+0000","last_change":"2023-08-27T11:25:25.914690+0000","last_active":"2023-08-27T11:25:27.238551+0000","last_peered":"2023-08-27T11:25:27.238551+0000","last_clean":"2023-08-27T11:25:27.238551+0000","last_became_active":"2023-08-27T11:25:25.914377+0000","last_became_peered":"2023-08-27T11:25:25.914377+0000","last_unstale":"2023-08-27T11:25:27.238551+0000","last_undegraded":"2023-08-27T11:25:27.238551+0000","last_fullsized":"2023-08-27T11:25:27.238551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:05.194996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237705+0000","last_change":"2023-08-27T11:25:24.919759+0000","last_active":"2023-08-27T11:25:27.237705+0000","last_peered":"2023-08-27T11:25:27.237705+0000","last_clean":"2023-08-27T11:25:27.237705+0000","last_became_active":"2023-08-27T11:25:24.919456+0000","last_became_peered":"2023-08-27T11:25:24.919456+0000","last_unstale":"2023-08-27T11:25:27.237705+0000","last_undegraded":"2023-08-27T11:25:27.237705+0000","last_fullsized":"2023-08-27T11:25:27.237705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:03.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":250,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920151+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:25:26.920151+0000","last_peered":"2023-08-27T11:25:26.920151+0000","last_clean":"2023-08-27T11:25:26.920151+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:25:26.920151+0000","last_undegraded":"2023-08-27T11:25:26.920151+0000","last_fullsized":"2023-08-27T11:25:26.920151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:29.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237648+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:25:27.237648+0000","last_peered":"2023-08-27T11:25:27.237648+0000","last_clean":"2023-08-27T11:25:27.237648+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:25:27.237648+0000","last_undegraded":"2023-08-27T11:25:27.237648+0000","last_fullsized":"2023-08-27T11:25:27.237648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:27:26.240110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237265+0000","last_change":"2023-08-27T11:25:25.917348+0000","last_active":"2023-08-27T11:25:27.237265+0000","last_peered":"2023-08-27T11:25:27.237265+0000","last_clean":"2023-08-27T11:25:27.237265+0000","last_became_active":"2023-08-27T11:25:25.916972+0000","last_became_peered":"2023-08-27T11:25:25.916972+0000","last_unstale":"2023-08-27T11:25:27.237265+0000","last_undegraded":"2023-08-27T11:25:27.237265+0000","last_fullsized":"2023-08-27T11:25:27.237265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:03.435348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919988+0000","last_change":"2023-08-27T11:25:24.920798+0000","last_active":"2023-08-27T11:25:26.919988+0000","last_peered":"2023-08-27T11:25:26.919988+0000","last_clean":"2023-08-27T11:25:26.919988+0000","last_became_active":"2023-08-27T11:25:24.920323+0000","last_became_peered":"2023-08-27T11:25:24.920323+0000","last_unstale":"2023-08-27T11:25:26.919988+0000","last_undegraded":"2023-08-27T11:25:26.919988+0000","last_fullsized":"2023-08-27T11:25:26.919988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:09.497973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238892+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:25:27.238892+0000","last_peered":"2023-08-27T11:25:27.238892+0000","last_clean":"2023-08-27T11:25:27.238892+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:25:27.238892+0000","last_undegraded":"2023-08-27T11:25:27.238892+0000","last_fullsized":"2023-08-27T11:25:27.238892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:17:18.305063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237257+0000","last_change":"2023-08-27T11:25:25.935366+0000","last_active":"2023-08-27T11:25:27.237257+0000","last_peered":"2023-08-27T11:25:27.237257+0000","last_clean":"2023-08-27T11:25:27.237257+0000","last_became_active":"2023-08-27T11:25:25.935071+0000","last_became_peered":"2023-08-27T11:25:25.935071+0000","last_unstale":"2023-08-27T11:25:27.237257+0000","last_undegraded":"2023-08-27T11:25:27.237257+0000","last_fullsized":"2023-08-27T11:25:27.237257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:07.947767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919935+0000","last_change":"2023-08-27T11:25:24.919905+0000","last_active":"2023-08-27T11:25:26.919935+0000","last_peered":"2023-08-27T11:25:26.919935+0000","last_clean":"2023-08-27T11:25:26.919935+0000","last_became_active":"2023-08-27T11:25:24.919452+0000","last_became_peered":"2023-08-27T11:25:24.919452+0000","last_unstale":"2023-08-27T11:25:26.919935+0000","last_undegraded":"2023-08-27T11:25:26.919935+0000","last_fullsized":"2023-08-27T11:25:26.919935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:46.380973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919501+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:25:26.919501+0000","last_peered":"2023-08-27T11:25:26.919501+0000","last_clean":"2023-08-27T11:25:26.919501+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:25:26.919501+0000","last_undegraded":"2023-08-27T11:25:26.919501+0000","last_fullsized":"2023-08-27T11:25:26.919501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:59.442851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1425408,"data_stored":971058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85499999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79500000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.754}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.03}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.875},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28420,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343420,"statfs":{"total":96636764160,"available":96607662080,"internally_reserved":0,"allocated":1429504,"data_stored":971148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.77200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":379682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":381410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.504}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.378},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.57899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.62},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":380264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.379},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.629},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.90700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":847872,"data_stored":382384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.751}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.82799999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":379716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.749},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.83599999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:25:35.396 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:25:35.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.607+0000 7f32537ff700 1 Processor -- start 2023-08-27T11:25:35.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.607+0000 7f32537ff700 1 -- start start 2023-08-27T11:25:35.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f32537ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f324c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f32537ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c06c4e0 con 0x7f324c0c4630 2023-08-27T11:25:35.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f32537ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c155370 con 0x7f324c0c4a90 2023-08-27T11:25:35.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f32537ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c151e70 con 0x7f324c151a90 2023-08-27T11:25:35.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f3250d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f324c0c4630 0x7f324c06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41504/0 (socket says 172.21.15.43:41504) 2023-08-27T11:25:35.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.608+0000 7f3250d9a700 1 -- 172.21.15.43:0/249158367 learned_addr learned my addr 172.21.15.43:0/249158367 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f325159b700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f324c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660844050 0 0) 0x7f324c06c4e0 con 0x7f324c0c4630 2023-08-27T11:25:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32380035b0 con 0x7f324c0c4630 2023-08-27T11:25:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318210752 0 0) 0x7f32380035b0 con 0x7f324c0c4630 2023-08-27T11:25:35.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 msgr2=0x7f324c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f324c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 >> v1:172.21.15.57:6789/0 conn(0x7f324c0c4a90 legacy=0x7f324c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c154480 con 0x7f324c0c4630 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f323c001670 con 0x7f324c0c4630 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 >> v1:172.21.15.43:6789/0 conn(0x7f324c0c4630 legacy=0x7f324c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3238003a30 0x7f3238003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32380043e0 0x7f32380048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f32380051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c151e70 con 0x7f32380043e0 2023-08-27T11:25:35.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323800bac0 con 0x7f3238003a30 2023-08-27T11:25:35.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.609+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323800bc80 con 0x7f324c151a90 2023-08-27T11:25:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32380043e0 0x7f32380048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f325159b700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3238003a30 0x7f3238003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3251d9c700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f32380051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 -- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 msgr2=0x7f32380051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:35.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f324c151a90 0x7f32380051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 -- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3238003a30 msgr2=0x7f3238003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:35.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3238003a30 0x7f3238003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 -- 172.21.15.43:0/249158367 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32380035b0 con 0x7f32380043e0 2023-08-27T11:25:35.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3250d9a700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32380043e0 0x7f32380048b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c240 tx=0x7f3238005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea492a3aa9c5e6dd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:35.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.610+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c00cd80 con 0x7f32380043e0 2023-08-27T11:25:35.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c005960 con 0x7f32380043e0 2023-08-27T11:25:35.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f3243fff700 1 -- 172.21.15.43:0/249158367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c005d10 con 0x7f32380043e0 2023-08-27T11:25:35.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 -- 172.21.15.43:0/249158367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32380043e0 msgr2=0x7f32380048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 --2- 172.21.15.43:0/249158367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32380043e0 0x7f32380048b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c240 tx=0x7f3238005880 comp rx=0 tx=0).stop 2023-08-27T11:25:35.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f3251d9c700 1 -- 172.21.15.43:0/249158367 reap_dead start 2023-08-27T11:25:35.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 -- 172.21.15.43:0/249158367 shutdown_connections 2023-08-27T11:25:35.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 -- 172.21.15.43:0/249158367 >> 172.21.15.43:0/249158367 conn(0x7f324c0ab820 msgr2=0x7f324c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:35.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 -- 172.21.15.43:0/249158367 shutdown_connections 2023-08-27T11:25:35.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.611+0000 7f32537ff700 1 -- 172.21.15.43:0/249158367 wait complete. 2023-08-27T11:25:35.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.613+0000 7f32537ff700 1 Processor -- start 2023-08-27T11:25:35.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.613+0000 7f32537ff700 1 -- start start 2023-08-27T11:25:35.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32380043e0 0x7f324c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324c14cc20 0x7f324c0bb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c157be0 con 0x7f324c0c3a40 2023-08-27T11:25:35.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c157ec0 con 0x7f324c14cc20 2023-08-27T11:25:35.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f32537ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c1557b0 con 0x7f32380043e0 2023-08-27T11:25:35.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f3250d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f3250d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38568/0 (socket says 172.21.15.43:38568) 2023-08-27T11:25:35.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.614+0000 7f3250d9a700 1 -- 172.21.15.43:0/1901352129 learned_addr learned my addr 172.21.15.43:0/1901352129 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:35.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f325159b700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32380043e0 0x7f324c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3251d9c700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324c14cc20 0x7f324c0bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 -- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32380043e0 msgr2=0x7f324c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32380043e0 0x7f324c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 -- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324c14cc20 msgr2=0x7f324c0bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324c14cc20 0x7f324c0bb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 -- 172.21.15.43:0/1901352129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c155a50 con 0x7f324c0c3a40 2023-08-27T11:25:35.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3250d9a700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c830 tx=0x7f323c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c004870 con 0x7f324c0c3a40 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c0049f0 con 0x7f324c0c3a40 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c1ed890 con 0x7f324c0c3a40 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c004da0 con 0x7f324c0c3a40 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.615+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c1ed590 con 0x7f324c0c3a40 2023-08-27T11:25:35.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.616+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c04ee70 con 0x7f324c0c3a40 2023-08-27T11:25:35.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.617+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f323c019070 con 0x7f324c0c3a40 2023-08-27T11:25:35.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.618+0000 7f3241ffb700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 0x7f323006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:35.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.618+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f323c089430 con 0x7f324c0c3a40 2023-08-27T11:25:35.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.618+0000 7f325159b700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 0x7f323006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:35.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.619+0000 7f325159b700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 0x7f323006c5a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3248009ba0 tx=0x7f3248008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:35.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.623+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f323c054c30 con 0x7f324c0c3a40 2023-08-27T11:25:35.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.825+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f324c154a40 con 0x7f323006a0e0 2023-08-27T11:25:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.836+0000 7f3241ffb700 1 -- 172.21.15.43:0/1901352129 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311580 (secure 0 0 0) 0x7f32480097f0 con 0x7f323006a0e0 2023-08-27T11:25:35.841 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:35.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 msgr2=0x7f323006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 0x7f323006c5a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3248009ba0 tx=0x7f3248008040 comp rx=0 tx=0).stop 2023-08-27T11:25:35.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 msgr2=0x7f324c1ed050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:35.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c830 tx=0x7f323c001980 comp rx=0 tx=0).stop 2023-08-27T11:25:35.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 shutdown_connections 2023-08-27T11:25:35.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f323006a0e0 0x7f323006c5a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f324c14cc20 0x7f324c0bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32380043e0 0x7f324c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 --2- 172.21.15.43:0/1901352129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f324c0c3a40 0x7f324c1ed050 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:35.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 >> 172.21.15.43:0/1901352129 conn(0x7f324c0ab820 msgr2=0x7f324c150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:35.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 shutdown_connections 2023-08-27T11:25:35.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:35.840+0000 7f32537ff700 1 -- 172.21.15.43:0/1901352129 wait complete. 2023-08-27T11:25:35.849 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:25:35.860 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-08-27T11:25:34.347138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223888,"kb_used_data":7672,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754750832,"statfs":{"total":773094113280,"available":772864851968,"internally_reserved":0,"allocated":7856128,"data_stored":4226956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.448975"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919558+0000","last_change":"2023-08-27T11:25:25.924775+0000","last_active":"2023-08-27T11:25:26.919558+0000","last_peered":"2023-08-27T11:25:26.919558+0000","last_clean":"2023-08-27T11:25:26.919558+0000","last_became_active":"2023-08-27T11:25:25.924543+0000","last_became_peered":"2023-08-27T11:25:25.924543+0000","last_unstale":"2023-08-27T11:25:26.919558+0000","last_undegraded":"2023-08-27T11:25:26.919558+0000","last_fullsized":"2023-08-27T11:25:26.919558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:51.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238535+0000","last_change":"2023-08-27T11:25:25.936513+0000","last_active":"2023-08-27T11:25:27.238535+0000","last_peered":"2023-08-27T11:25:27.238535+0000","last_clean":"2023-08-27T11:25:27.238535+0000","last_became_active":"2023-08-27T11:25:25.935704+0000","last_became_peered":"2023-08-27T11:25:25.935704+0000","last_unstale":"2023-08-27T11:25:27.238535+0000","last_undegraded":"2023-08-27T11:25:27.238535+0000","last_fullsized":"2023-08-27T11:25:27.238535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:04.065139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238348+0000","last_change":"2023-08-27T11:25:25.936829+0000","last_active":"2023-08-27T11:25:27.238348+0000","last_peered":"2023-08-27T11:25:27.238348+0000","last_clean":"2023-08-27T11:25:27.238348+0000","last_became_active":"2023-08-27T11:25:25.930044+0000","last_became_peered":"2023-08-27T11:25:25.930044+0000","last_unstale":"2023-08-27T11:25:27.238348+0000","last_undegraded":"2023-08-27T11:25:27.238348+0000","last_fullsized":"2023-08-27T11:25:27.238348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:10.828528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237273+0000","last_change":"2023-08-27T11:25:25.915301+0000","last_active":"2023-08-27T11:25:27.237273+0000","last_peered":"2023-08-27T11:25:27.237273+0000","last_clean":"2023-08-27T11:25:27.237273+0000","last_became_active":"2023-08-27T11:25:25.915027+0000","last_became_peered":"2023-08-27T11:25:25.915027+0000","last_unstale":"2023-08-27T11:25:27.237273+0000","last_undegraded":"2023-08-27T11:25:27.237273+0000","last_fullsized":"2023-08-27T11:25:27.237273+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:26:32.126370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237905+0000","last_change":"2023-08-27T11:25:25.920168+0000","last_active":"2023-08-27T11:25:27.237905+0000","last_peered":"2023-08-27T11:25:27.237905+0000","last_clean":"2023-08-27T11:25:27.237905+0000","last_became_active":"2023-08-27T11:25:25.919843+0000","last_became_peered":"2023-08-27T11:25:25.919843+0000","last_unstale":"2023-08-27T11:25:27.237905+0000","last_undegraded":"2023-08-27T11:25:27.237905+0000","last_fullsized":"2023-08-27T11:25:27.237905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:43:38.296820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238532+0000","last_change":"2023-08-27T11:25:25.933280+0000","last_active":"2023-08-27T11:25:27.238532+0000","last_peered":"2023-08-27T11:25:27.238532+0000","last_clean":"2023-08-27T11:25:27.238532+0000","last_became_active":"2023-08-27T11:25:25.932917+0000","last_became_peered":"2023-08-27T11:25:25.932917+0000","last_unstale":"2023-08-27T11:25:27.238532+0000","last_undegraded":"2023-08-27T11:25:27.238532+0000","last_fullsized":"2023-08-27T11:25:27.238532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:53:01.889854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917369+0000","last_change":"2023-08-27T11:25:25.916867+0000","last_active":"2023-08-27T11:25:26.917369+0000","last_peered":"2023-08-27T11:25:26.917369+0000","last_clean":"2023-08-27T11:25:26.917369+0000","last_became_active":"2023-08-27T11:25:25.916574+0000","last_became_peered":"2023-08-27T11:25:25.916574+0000","last_unstale":"2023-08-27T11:25:26.917369+0000","last_undegraded":"2023-08-27T11:25:26.917369+0000","last_fullsized":"2023-08-27T11:25:26.917369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:45.756160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.236956+0000","last_change":"2023-08-27T11:25:25.921722+0000","last_active":"2023-08-27T11:25:27.236956+0000","last_peered":"2023-08-27T11:25:27.236956+0000","last_clean":"2023-08-27T11:25:27.236956+0000","last_became_active":"2023-08-27T11:25:25.919902+0000","last_became_peered":"2023-08-27T11:25:25.919902+0000","last_unstale":"2023-08-27T11:25:27.236956+0000","last_undegraded":"2023-08-27T11:25:27.236956+0000","last_fullsized":"2023-08-27T11:25:27.236956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:18:16.605086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919626+0000","last_change":"2023-08-27T11:25:25.922370+0000","last_active":"2023-08-27T11:25:26.919626+0000","last_peered":"2023-08-27T11:25:26.919626+0000","last_clean":"2023-08-27T11:25:26.919626+0000","last_became_active":"2023-08-27T11:25:25.922069+0000","last_became_peered":"2023-08-27T11:25:25.922069+0000","last_unstale":"2023-08-27T11:25:26.919626+0000","last_undegraded":"2023-08-27T11:25:26.919626+0000","last_fullsized":"2023-08-27T11:25:26.919626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:49:14.842054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237139+0000","last_change":"2023-08-27T11:25:25.924547+0000","last_active":"2023-08-27T11:25:27.237139+0000","last_peered":"2023-08-27T11:25:27.237139+0000","last_clean":"2023-08-27T11:25:27.237139+0000","last_became_active":"2023-08-27T11:25:25.924217+0000","last_became_peered":"2023-08-27T11:25:25.924217+0000","last_unstale":"2023-08-27T11:25:27.237139+0000","last_undegraded":"2023-08-27T11:25:27.237139+0000","last_fullsized":"2023-08-27T11:25:27.237139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:11:36.814269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238783+0000","last_change":"2023-08-27T11:25:25.940827+0000","last_active":"2023-08-27T11:25:27.238783+0000","last_peered":"2023-08-27T11:25:27.238783+0000","last_clean":"2023-08-27T11:25:27.238783+0000","last_became_active":"2023-08-27T11:25:25.940536+0000","last_became_peered":"2023-08-27T11:25:25.940536+0000","last_unstale":"2023-08-27T11:25:27.238783+0000","last_undegraded":"2023-08-27T11:25:27.238783+0000","last_fullsized":"2023-08-27T11:25:27.238783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:18.158403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237274+0000","last_change":"2023-08-27T11:25:25.921298+0000","last_active":"2023-08-27T11:25:27.237274+0000","last_peered":"2023-08-27T11:25:27.237274+0000","last_clean":"2023-08-27T11:25:27.237274+0000","last_became_active":"2023-08-27T11:25:25.920627+0000","last_became_peered":"2023-08-27T11:25:25.920627+0000","last_unstale":"2023-08-27T11:25:27.237274+0000","last_undegraded":"2023-08-27T11:25:27.237274+0000","last_fullsized":"2023-08-27T11:25:27.237274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:56:21.244045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238035+0000","last_change":"2023-08-27T11:25:25.918763+0000","last_active":"2023-08-27T11:25:27.238035+0000","last_peered":"2023-08-27T11:25:27.238035+0000","last_clean":"2023-08-27T11:25:27.238035+0000","last_became_active":"2023-08-27T11:25:25.918457+0000","last_became_peered":"2023-08-27T11:25:25.918457+0000","last_unstale":"2023-08-27T11:25:27.238035+0000","last_undegraded":"2023-08-27T11:25:27.238035+0000","last_fullsized":"2023-08-27T11:25:27.238035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:04.955308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238415+0000","last_change":"2023-08-27T11:25:25.928674+0000","last_active":"2023-08-27T11:25:27.238415+0000","last_peered":"2023-08-27T11:25:27.238415+0000","last_clean":"2023-08-27T11:25:27.238415+0000","last_became_active":"2023-08-27T11:25:25.927654+0000","last_became_peered":"2023-08-27T11:25:25.927654+0000","last_unstale":"2023-08-27T11:25:27.238415+0000","last_undegraded":"2023-08-27T11:25:27.238415+0000","last_fullsized":"2023-08-27T11:25:27.238415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:42.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238314+0000","last_change":"2023-08-27T11:25:25.939668+0000","last_active":"2023-08-27T11:25:27.238314+0000","last_peered":"2023-08-27T11:25:27.238314+0000","last_clean":"2023-08-27T11:25:27.238314+0000","last_became_active":"2023-08-27T11:25:25.939401+0000","last_became_peered":"2023-08-27T11:25:25.939401+0000","last_unstale":"2023-08-27T11:25:27.238314+0000","last_undegraded":"2023-08-27T11:25:27.238314+0000","last_fullsized":"2023-08-27T11:25:27.238314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:07.947767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919622+0000","last_change":"2023-08-27T11:25:25.918860+0000","last_active":"2023-08-27T11:25:26.919622+0000","last_peered":"2023-08-27T11:25:26.919622+0000","last_clean":"2023-08-27T11:25:26.919622+0000","last_became_active":"2023-08-27T11:25:25.918188+0000","last_became_peered":"2023-08-27T11:25:25.918188+0000","last_unstale":"2023-08-27T11:25:26.919622+0000","last_undegraded":"2023-08-27T11:25:26.919622+0000","last_fullsized":"2023-08-27T11:25:26.919622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:27:02.871139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238955+0000","last_change":"2023-08-27T11:25:25.917354+0000","last_active":"2023-08-27T11:25:27.238955+0000","last_peered":"2023-08-27T11:25:27.238955+0000","last_clean":"2023-08-27T11:25:27.238955+0000","last_became_active":"2023-08-27T11:25:25.916987+0000","last_became_peered":"2023-08-27T11:25:25.916987+0000","last_unstale":"2023-08-27T11:25:27.238955+0000","last_undegraded":"2023-08-27T11:25:27.238955+0000","last_fullsized":"2023-08-27T11:25:27.238955+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:52.709527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237248+0000","last_change":"2023-08-27T11:25:25.918560+0000","last_active":"2023-08-27T11:25:27.237248+0000","last_peered":"2023-08-27T11:25:27.237248+0000","last_clean":"2023-08-27T11:25:27.237248+0000","last_became_active":"2023-08-27T11:25:25.917764+0000","last_became_peered":"2023-08-27T11:25:25.917764+0000","last_unstale":"2023-08-27T11:25:27.237248+0000","last_undegraded":"2023-08-27T11:25:27.237248+0000","last_fullsized":"2023-08-27T11:25:27.237248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:04.499768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.239064+0000","last_change":"2023-08-27T11:25:25.939650+0000","last_active":"2023-08-27T11:25:27.239064+0000","last_peered":"2023-08-27T11:25:27.239064+0000","last_clean":"2023-08-27T11:25:27.239064+0000","last_became_active":"2023-08-27T11:25:25.939319+0000","last_became_peered":"2023-08-27T11:25:25.939319+0000","last_unstale":"2023-08-27T11:25:27.239064+0000","last_undegraded":"2023-08-27T11:25:27.239064+0000","last_fullsized":"2023-08-27T11:25:27.239064+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:51:37.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238116+0000","last_change":"2023-08-27T11:25:25.914574+0000","last_active":"2023-08-27T11:25:27.238116+0000","last_peered":"2023-08-27T11:25:27.238116+0000","last_clean":"2023-08-27T11:25:27.238116+0000","last_became_active":"2023-08-27T11:25:25.914276+0000","last_became_peered":"2023-08-27T11:25:25.914276+0000","last_unstale":"2023-08-27T11:25:27.238116+0000","last_undegraded":"2023-08-27T11:25:27.238116+0000","last_fullsized":"2023-08-27T11:25:27.238116+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:00.312703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919876+0000","last_change":"2023-08-27T11:25:25.920187+0000","last_active":"2023-08-27T11:25:26.919876+0000","last_peered":"2023-08-27T11:25:26.919876+0000","last_clean":"2023-08-27T11:25:26.919876+0000","last_became_active":"2023-08-27T11:25:25.919190+0000","last_became_peered":"2023-08-27T11:25:25.919190+0000","last_unstale":"2023-08-27T11:25:26.919876+0000","last_undegraded":"2023-08-27T11:25:26.919876+0000","last_fullsized":"2023-08-27T11:25:26.919876+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:13:42.879824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237631+0000","last_change":"2023-08-27T11:25:25.929953+0000","last_active":"2023-08-27T11:25:27.237631+0000","last_peered":"2023-08-27T11:25:27.237631+0000","last_clean":"2023-08-27T11:25:27.237631+0000","last_became_active":"2023-08-27T11:25:25.929649+0000","last_became_peered":"2023-08-27T11:25:25.929649+0000","last_unstale":"2023-08-27T11:25:27.237631+0000","last_undegraded":"2023-08-27T11:25:27.237631+0000","last_fullsized":"2023-08-27T11:25:27.237631+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:40.812447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919106+0000","last_change":"2023-08-27T11:25:25.911733+0000","last_active":"2023-08-27T11:25:26.919106+0000","last_peered":"2023-08-27T11:25:26.919106+0000","last_clean":"2023-08-27T11:25:26.919106+0000","last_became_active":"2023-08-27T11:25:25.911316+0000","last_became_peered":"2023-08-27T11:25:25.911316+0000","last_unstale":"2023-08-27T11:25:26.919106+0000","last_undegraded":"2023-08-27T11:25:26.919106+0000","last_fullsized":"2023-08-27T11:25:26.919106+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:24.297771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237382+0000","last_change":"2023-08-27T11:25:25.929197+0000","last_active":"2023-08-27T11:25:27.237382+0000","last_peered":"2023-08-27T11:25:27.237382+0000","last_clean":"2023-08-27T11:25:27.237382+0000","last_became_active":"2023-08-27T11:25:25.928787+0000","last_became_peered":"2023-08-27T11:25:25.928787+0000","last_unstale":"2023-08-27T11:25:27.237382+0000","last_undegraded":"2023-08-27T11:25:27.237382+0000","last_fullsized":"2023-08-27T11:25:27.237382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:55:52.295478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238277+0000","last_change":"2023-08-27T11:25:25.929003+0000","last_active":"2023-08-27T11:25:27.238277+0000","last_peered":"2023-08-27T11:25:27.238277+0000","last_clean":"2023-08-27T11:25:27.238277+0000","last_became_active":"2023-08-27T11:25:25.928698+0000","last_became_peered":"2023-08-27T11:25:25.928698+0000","last_unstale":"2023-08-27T11:25:27.238277+0000","last_undegraded":"2023-08-27T11:25:27.238277+0000","last_fullsized":"2023-08-27T11:25:27.238277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:57:59.452979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237306+0000","last_change":"2023-08-27T11:25:25.921127+0000","last_active":"2023-08-27T11:25:27.237306+0000","last_peered":"2023-08-27T11:25:27.237306+0000","last_clean":"2023-08-27T11:25:27.237306+0000","last_became_active":"2023-08-27T11:25:25.920708+0000","last_became_peered":"2023-08-27T11:25:25.920708+0000","last_unstale":"2023-08-27T11:25:27.237306+0000","last_undegraded":"2023-08-27T11:25:27.237306+0000","last_fullsized":"2023-08-27T11:25:27.237306+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:59:54.804947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919519+0000","last_change":"2023-08-27T11:25:25.917676+0000","last_active":"2023-08-27T11:25:26.919519+0000","last_peered":"2023-08-27T11:25:26.919519+0000","last_clean":"2023-08-27T11:25:26.919519+0000","last_became_active":"2023-08-27T11:25:25.917397+0000","last_became_peered":"2023-08-27T11:25:25.917397+0000","last_unstale":"2023-08-27T11:25:26.919519+0000","last_undegraded":"2023-08-27T11:25:26.919519+0000","last_fullsized":"2023-08-27T11:25:26.919519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:48:03.414485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238157+0000","last_change":"2023-08-27T11:25:25.913903+0000","last_active":"2023-08-27T11:25:27.238157+0000","last_peered":"2023-08-27T11:25:27.238157+0000","last_clean":"2023-08-27T11:25:27.238157+0000","last_became_active":"2023-08-27T11:25:25.913538+0000","last_became_peered":"2023-08-27T11:25:25.913538+0000","last_unstale":"2023-08-27T11:25:27.238157+0000","last_undegraded":"2023-08-27T11:25:27.238157+0000","last_fullsized":"2023-08-27T11:25:27.238157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:24.786907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237659+0000","last_change":"2023-08-27T11:25:25.921968+0000","last_active":"2023-08-27T11:25:27.237659+0000","last_peered":"2023-08-27T11:25:27.237659+0000","last_clean":"2023-08-27T11:25:27.237659+0000","last_became_active":"2023-08-27T11:25:25.921599+0000","last_became_peered":"2023-08-27T11:25:25.921599+0000","last_unstale":"2023-08-27T11:25:27.237659+0000","last_undegraded":"2023-08-27T11:25:27.237659+0000","last_fullsized":"2023-08-27T11:25:27.237659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:22:08.772762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919930+0000","last_change":"2023-08-27T11:25:25.918906+0000","last_active":"2023-08-27T11:25:26.919930+0000","last_peered":"2023-08-27T11:25:26.919930+0000","last_clean":"2023-08-27T11:25:26.919930+0000","last_became_active":"2023-08-27T11:25:25.918611+0000","last_became_peered":"2023-08-27T11:25:25.918611+0000","last_unstale":"2023-08-27T11:25:26.919930+0000","last_undegraded":"2023-08-27T11:25:26.919930+0000","last_fullsized":"2023-08-27T11:25:26.919930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:33:47.478012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237415+0000","last_change":"2023-08-27T11:25:25.918833+0000","last_active":"2023-08-27T11:25:27.237415+0000","last_peered":"2023-08-27T11:25:27.237415+0000","last_clean":"2023-08-27T11:25:27.237415+0000","last_became_active":"2023-08-27T11:25:25.918563+0000","last_became_peered":"2023-08-27T11:25:25.918563+0000","last_unstale":"2023-08-27T11:25:27.237415+0000","last_undegraded":"2023-08-27T11:25:27.237415+0000","last_fullsized":"2023-08-27T11:25:27.237415+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:45.338582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919779+0000","last_change":"2023-08-27T11:25:25.919078+0000","last_active":"2023-08-27T11:25:26.919779+0000","last_peered":"2023-08-27T11:25:26.919779+0000","last_clean":"2023-08-27T11:25:26.919779+0000","last_became_active":"2023-08-27T11:25:25.918526+0000","last_became_peered":"2023-08-27T11:25:25.918526+0000","last_unstale":"2023-08-27T11:25:26.919779+0000","last_undegraded":"2023-08-27T11:25:26.919779+0000","last_fullsized":"2023-08-27T11:25:26.919779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:02.248547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237037+0000","last_change":"2023-08-27T11:25:25.919258+0000","last_active":"2023-08-27T11:25:27.237037+0000","last_peered":"2023-08-27T11:25:27.237037+0000","last_clean":"2023-08-27T11:25:27.237037+0000","last_became_active":"2023-08-27T11:25:25.917907+0000","last_became_peered":"2023-08-27T11:25:25.917907+0000","last_unstale":"2023-08-27T11:25:27.237037+0000","last_undegraded":"2023-08-27T11:25:27.237037+0000","last_fullsized":"2023-08-27T11:25:27.237037+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:43:34.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"67'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238791+0000","last_change":"2023-08-27T11:25:24.908438+0000","last_active":"2023-08-27T11:25:27.238791+0000","last_peered":"2023-08-27T11:25:27.238791+0000","last_clean":"2023-08-27T11:25:27.238791+0000","last_became_active":"2023-08-27T11:25:24.908166+0000","last_became_peered":"2023-08-27T11:25:24.908166+0000","last_unstale":"2023-08-27T11:25:27.238791+0000","last_undegraded":"2023-08-27T11:25:27.238791+0000","last_fullsized":"2023-08-27T11:25:27.238791+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:04.621001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238459+0000","last_change":"2023-08-27T11:25:25.924057+0000","last_active":"2023-08-27T11:25:27.238459+0000","last_peered":"2023-08-27T11:25:27.238459+0000","last_clean":"2023-08-27T11:25:27.238459+0000","last_became_active":"2023-08-27T11:25:25.923777+0000","last_became_peered":"2023-08-27T11:25:25.923777+0000","last_unstale":"2023-08-27T11:25:27.238459+0000","last_undegraded":"2023-08-27T11:25:27.238459+0000","last_fullsized":"2023-08-27T11:25:27.238459+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:57.323241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919362+0000","last_change":"2023-08-27T11:25:24.931041+0000","last_active":"2023-08-27T11:25:26.919362+0000","last_peered":"2023-08-27T11:25:26.919362+0000","last_clean":"2023-08-27T11:25:26.919362+0000","last_became_active":"2023-08-27T11:25:24.930712+0000","last_became_peered":"2023-08-27T11:25:24.930712+0000","last_unstale":"2023-08-27T11:25:26.919362+0000","last_undegraded":"2023-08-27T11:25:26.919362+0000","last_fullsized":"2023-08-27T11:25:26.919362+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:53:56.471080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919340+0000","last_change":"2023-08-27T11:25:25.929146+0000","last_active":"2023-08-27T11:25:26.919340+0000","last_peered":"2023-08-27T11:25:26.919340+0000","last_clean":"2023-08-27T11:25:26.919340+0000","last_became_active":"2023-08-27T11:25:25.928546+0000","last_became_peered":"2023-08-27T11:25:25.928546+0000","last_unstale":"2023-08-27T11:25:26.919340+0000","last_undegraded":"2023-08-27T11:25:26.919340+0000","last_fullsized":"2023-08-27T11:25:26.919340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:03.583844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919848+0000","last_change":"2023-08-27T11:25:24.919539+0000","last_active":"2023-08-27T11:25:26.919848+0000","last_peered":"2023-08-27T11:25:26.919848+0000","last_clean":"2023-08-27T11:25:26.919848+0000","last_became_active":"2023-08-27T11:25:24.919241+0000","last_became_peered":"2023-08-27T11:25:24.919241+0000","last_unstale":"2023-08-27T11:25:26.919848+0000","last_undegraded":"2023-08-27T11:25:26.919848+0000","last_fullsized":"2023-08-27T11:25:26.919848+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:55.594237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919980+0000","last_change":"2023-08-27T11:25:25.919986+0000","last_active":"2023-08-27T11:25:26.919980+0000","last_peered":"2023-08-27T11:25:26.919980+0000","last_clean":"2023-08-27T11:25:26.919980+0000","last_became_active":"2023-08-27T11:25:25.918819+0000","last_became_peered":"2023-08-27T11:25:25.918819+0000","last_unstale":"2023-08-27T11:25:26.919980+0000","last_undegraded":"2023-08-27T11:25:26.919980+0000","last_fullsized":"2023-08-27T11:25:26.919980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:12:48.152083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917746+0000","last_change":"2023-08-27T11:25:24.920378+0000","last_active":"2023-08-27T11:25:26.917746+0000","last_peered":"2023-08-27T11:25:26.917746+0000","last_clean":"2023-08-27T11:25:26.917746+0000","last_became_active":"2023-08-27T11:25:24.919551+0000","last_became_peered":"2023-08-27T11:25:24.919551+0000","last_unstale":"2023-08-27T11:25:26.917746+0000","last_undegraded":"2023-08-27T11:25:26.917746+0000","last_fullsized":"2023-08-27T11:25:26.917746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:15:21.085319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238063+0000","last_change":"2023-08-27T11:25:25.936331+0000","last_active":"2023-08-27T11:25:27.238063+0000","last_peered":"2023-08-27T11:25:27.238063+0000","last_clean":"2023-08-27T11:25:27.238063+0000","last_became_active":"2023-08-27T11:25:25.936024+0000","last_became_peered":"2023-08-27T11:25:25.936024+0000","last_unstale":"2023-08-27T11:25:27.238063+0000","last_undegraded":"2023-08-27T11:25:27.238063+0000","last_fullsized":"2023-08-27T11:25:27.238063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:28:20.219883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920123+0000","last_change":"2023-08-27T11:25:24.923303+0000","last_active":"2023-08-27T11:25:26.920123+0000","last_peered":"2023-08-27T11:25:26.920123+0000","last_clean":"2023-08-27T11:25:26.920123+0000","last_became_active":"2023-08-27T11:25:24.922964+0000","last_became_peered":"2023-08-27T11:25:24.922964+0000","last_unstale":"2023-08-27T11:25:26.920123+0000","last_undegraded":"2023-08-27T11:25:26.920123+0000","last_fullsized":"2023-08-27T11:25:26.920123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:51:34.537219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238855+0000","last_change":"2023-08-27T11:25:25.940542+0000","last_active":"2023-08-27T11:25:27.238855+0000","last_peered":"2023-08-27T11:25:27.238855+0000","last_clean":"2023-08-27T11:25:27.238855+0000","last_became_active":"2023-08-27T11:25:25.940163+0000","last_became_peered":"2023-08-27T11:25:25.940163+0000","last_unstale":"2023-08-27T11:25:27.238855+0000","last_undegraded":"2023-08-27T11:25:27.238855+0000","last_fullsized":"2023-08-27T11:25:27.238855+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:42.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237569+0000","last_change":"2023-08-27T11:25:24.924224+0000","last_active":"2023-08-27T11:25:27.237569+0000","last_peered":"2023-08-27T11:25:27.237569+0000","last_clean":"2023-08-27T11:25:27.237569+0000","last_became_active":"2023-08-27T11:25:24.923933+0000","last_became_peered":"2023-08-27T11:25:24.923933+0000","last_unstale":"2023-08-27T11:25:27.237569+0000","last_undegraded":"2023-08-27T11:25:27.237569+0000","last_fullsized":"2023-08-27T11:25:27.237569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:15.187129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919716+0000","last_change":"2023-08-27T11:25:25.923264+0000","last_active":"2023-08-27T11:25:26.919716+0000","last_peered":"2023-08-27T11:25:26.919716+0000","last_clean":"2023-08-27T11:25:26.919716+0000","last_became_active":"2023-08-27T11:25:25.922923+0000","last_became_peered":"2023-08-27T11:25:25.922923+0000","last_unstale":"2023-08-27T11:25:26.919716+0000","last_undegraded":"2023-08-27T11:25:26.919716+0000","last_fullsized":"2023-08-27T11:25:26.919716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:41.015367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238663+0000","last_change":"2023-08-27T11:25:24.925097+0000","last_active":"2023-08-27T11:25:27.238663+0000","last_peered":"2023-08-27T11:25:27.238663+0000","last_clean":"2023-08-27T11:25:27.238663+0000","last_became_active":"2023-08-27T11:25:24.924803+0000","last_became_peered":"2023-08-27T11:25:24.924803+0000","last_unstale":"2023-08-27T11:25:27.238663+0000","last_undegraded":"2023-08-27T11:25:27.238663+0000","last_fullsized":"2023-08-27T11:25:27.238663+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:20.311999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917540+0000","last_change":"2023-08-27T11:25:25.935610+0000","last_active":"2023-08-27T11:25:26.917540+0000","last_peered":"2023-08-27T11:25:26.917540+0000","last_clean":"2023-08-27T11:25:26.917540+0000","last_became_active":"2023-08-27T11:25:25.935339+0000","last_became_peered":"2023-08-27T11:25:25.935339+0000","last_unstale":"2023-08-27T11:25:26.917540+0000","last_undegraded":"2023-08-27T11:25:26.917540+0000","last_fullsized":"2023-08-27T11:25:26.917540+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:22.043829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237089+0000","last_change":"2023-08-27T11:25:24.921040+0000","last_active":"2023-08-27T11:25:27.237089+0000","last_peered":"2023-08-27T11:25:27.237089+0000","last_clean":"2023-08-27T11:25:27.237089+0000","last_became_active":"2023-08-27T11:25:24.920745+0000","last_became_peered":"2023-08-27T11:25:24.920745+0000","last_unstale":"2023-08-27T11:25:27.237089+0000","last_undegraded":"2023-08-27T11:25:27.237089+0000","last_fullsized":"2023-08-27T11:25:27.237089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:51.396944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237526+0000","last_change":"2023-08-27T11:25:25.920135+0000","last_active":"2023-08-27T11:25:27.237526+0000","last_peered":"2023-08-27T11:25:27.237526+0000","last_clean":"2023-08-27T11:25:27.237526+0000","last_became_active":"2023-08-27T11:25:25.919843+0000","last_became_peered":"2023-08-27T11:25:25.919843+0000","last_unstale":"2023-08-27T11:25:27.237526+0000","last_undegraded":"2023-08-27T11:25:27.237526+0000","last_fullsized":"2023-08-27T11:25:27.237526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:24.092400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919785+0000","last_change":"2023-08-27T11:25:24.931138+0000","last_active":"2023-08-27T11:25:26.919785+0000","last_peered":"2023-08-27T11:25:26.919785+0000","last_clean":"2023-08-27T11:25:26.919785+0000","last_became_active":"2023-08-27T11:25:24.930796+0000","last_became_peered":"2023-08-27T11:25:24.930796+0000","last_unstale":"2023-08-27T11:25:26.919785+0000","last_undegraded":"2023-08-27T11:25:26.919785+0000","last_fullsized":"2023-08-27T11:25:26.919785+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:02.594976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.236995+0000","last_change":"2023-08-27T11:25:25.914817+0000","last_active":"2023-08-27T11:25:27.236995+0000","last_peered":"2023-08-27T11:25:27.236995+0000","last_clean":"2023-08-27T11:25:27.236995+0000","last_became_active":"2023-08-27T11:25:25.914450+0000","last_became_peered":"2023-08-27T11:25:25.914450+0000","last_unstale":"2023-08-27T11:25:27.236995+0000","last_undegraded":"2023-08-27T11:25:27.236995+0000","last_fullsized":"2023-08-27T11:25:27.236995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:08.028200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237465+0000","last_change":"2023-08-27T11:25:24.923906+0000","last_active":"2023-08-27T11:25:27.237465+0000","last_peered":"2023-08-27T11:25:27.237465+0000","last_clean":"2023-08-27T11:25:27.237465+0000","last_became_active":"2023-08-27T11:25:24.923601+0000","last_became_peered":"2023-08-27T11:25:24.923601+0000","last_unstale":"2023-08-27T11:25:27.237465+0000","last_undegraded":"2023-08-27T11:25:27.237465+0000","last_fullsized":"2023-08-27T11:25:27.237465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:09.160833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238279+0000","last_change":"2023-08-27T11:25:25.942147+0000","last_active":"2023-08-27T11:25:27.238279+0000","last_peered":"2023-08-27T11:25:27.238279+0000","last_clean":"2023-08-27T11:25:27.238279+0000","last_became_active":"2023-08-27T11:25:25.941848+0000","last_became_peered":"2023-08-27T11:25:25.941848+0000","last_unstale":"2023-08-27T11:25:27.238279+0000","last_undegraded":"2023-08-27T11:25:27.238279+0000","last_fullsized":"2023-08-27T11:25:27.238279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:18.158403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"67'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237462+0000","last_change":"2023-08-27T11:25:24.918632+0000","last_active":"2023-08-27T11:25:27.237462+0000","last_peered":"2023-08-27T11:25:27.237462+0000","last_clean":"2023-08-27T11:25:27.237462+0000","last_became_active":"2023-08-27T11:25:24.918354+0000","last_became_peered":"2023-08-27T11:25:24.918354+0000","last_unstale":"2023-08-27T11:25:27.237462+0000","last_undegraded":"2023-08-27T11:25:27.237462+0000","last_fullsized":"2023-08-27T11:25:27.237462+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:26.584618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237568+0000","last_change":"2023-08-27T11:25:25.935940+0000","last_active":"2023-08-27T11:25:27.237568+0000","last_peered":"2023-08-27T11:25:27.237568+0000","last_clean":"2023-08-27T11:25:27.237568+0000","last_became_active":"2023-08-27T11:25:25.929593+0000","last_became_peered":"2023-08-27T11:25:25.929593+0000","last_unstale":"2023-08-27T11:25:27.237568+0000","last_undegraded":"2023-08-27T11:25:27.237568+0000","last_fullsized":"2023-08-27T11:25:27.237568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:01.556223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"67'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917763+0000","last_change":"2023-08-27T11:25:24.923843+0000","last_active":"2023-08-27T11:25:26.917763+0000","last_peered":"2023-08-27T11:25:26.917763+0000","last_clean":"2023-08-27T11:25:26.917763+0000","last_became_active":"2023-08-27T11:25:24.923525+0000","last_became_peered":"2023-08-27T11:25:24.923525+0000","last_unstale":"2023-08-27T11:25:26.917763+0000","last_undegraded":"2023-08-27T11:25:26.917763+0000","last_fullsized":"2023-08-27T11:25:26.917763+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:07.024701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237442+0000","last_change":"2023-08-27T11:25:25.932714+0000","last_active":"2023-08-27T11:25:27.237442+0000","last_peered":"2023-08-27T11:25:27.237442+0000","last_clean":"2023-08-27T11:25:27.237442+0000","last_became_active":"2023-08-27T11:25:25.932379+0000","last_became_peered":"2023-08-27T11:25:25.932379+0000","last_unstale":"2023-08-27T11:25:27.237442+0000","last_undegraded":"2023-08-27T11:25:27.237442+0000","last_fullsized":"2023-08-27T11:25:27.237442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:26:05.456538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237069+0000","last_change":"2023-08-27T11:25:24.925180+0000","last_active":"2023-08-27T11:25:27.237069+0000","last_peered":"2023-08-27T11:25:27.237069+0000","last_clean":"2023-08-27T11:25:27.237069+0000","last_became_active":"2023-08-27T11:25:24.924811+0000","last_became_peered":"2023-08-27T11:25:24.924811+0000","last_unstale":"2023-08-27T11:25:27.237069+0000","last_undegraded":"2023-08-27T11:25:27.237069+0000","last_fullsized":"2023-08-27T11:25:27.237069+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:14.996650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917508+0000","last_change":"2023-08-27T11:25:25.933637+0000","last_active":"2023-08-27T11:25:26.917508+0000","last_peered":"2023-08-27T11:25:26.917508+0000","last_clean":"2023-08-27T11:25:26.917508+0000","last_became_active":"2023-08-27T11:25:25.933336+0000","last_became_peered":"2023-08-27T11:25:25.933336+0000","last_unstale":"2023-08-27T11:25:26.917508+0000","last_undegraded":"2023-08-27T11:25:26.917508+0000","last_fullsized":"2023-08-27T11:25:26.917508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:40.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920091+0000","last_change":"2023-08-27T11:25:24.921229+0000","last_active":"2023-08-27T11:25:26.920091+0000","last_peered":"2023-08-27T11:25:26.920091+0000","last_clean":"2023-08-27T11:25:26.920091+0000","last_became_active":"2023-08-27T11:25:24.920853+0000","last_became_peered":"2023-08-27T11:25:24.920853+0000","last_unstale":"2023-08-27T11:25:26.920091+0000","last_undegraded":"2023-08-27T11:25:26.920091+0000","last_fullsized":"2023-08-27T11:25:26.920091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:10.472800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917544+0000","last_change":"2023-08-27T11:25:25.917984+0000","last_active":"2023-08-27T11:25:26.917544+0000","last_peered":"2023-08-27T11:25:26.917544+0000","last_clean":"2023-08-27T11:25:26.917544+0000","last_became_active":"2023-08-27T11:25:25.917528+0000","last_became_peered":"2023-08-27T11:25:25.917528+0000","last_unstale":"2023-08-27T11:25:26.917544+0000","last_undegraded":"2023-08-27T11:25:26.917544+0000","last_fullsized":"2023-08-27T11:25:26.917544+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:31.755452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237407+0000","last_change":"2023-08-27T11:25:24.906755+0000","last_active":"2023-08-27T11:25:27.237407+0000","last_peered":"2023-08-27T11:25:27.237407+0000","last_clean":"2023-08-27T11:25:27.237407+0000","last_became_active":"2023-08-27T11:25:24.906473+0000","last_became_peered":"2023-08-27T11:25:24.906473+0000","last_unstale":"2023-08-27T11:25:27.237407+0000","last_undegraded":"2023-08-27T11:25:27.237407+0000","last_fullsized":"2023-08-27T11:25:27.237407+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:25.255081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917928+0000","last_change":"2023-08-27T11:25:25.931767+0000","last_active":"2023-08-27T11:25:26.917928+0000","last_peered":"2023-08-27T11:25:26.917928+0000","last_clean":"2023-08-27T11:25:26.917928+0000","last_became_active":"2023-08-27T11:25:25.931485+0000","last_became_peered":"2023-08-27T11:25:25.931485+0000","last_unstale":"2023-08-27T11:25:26.917928+0000","last_undegraded":"2023-08-27T11:25:26.917928+0000","last_fullsized":"2023-08-27T11:25:26.917928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:31:16.000149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"67'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237660+0000","last_change":"2023-08-27T11:25:24.923864+0000","last_active":"2023-08-27T11:25:27.237660+0000","last_peered":"2023-08-27T11:25:27.237660+0000","last_clean":"2023-08-27T11:25:27.237660+0000","last_became_active":"2023-08-27T11:25:24.923584+0000","last_became_peered":"2023-08-27T11:25:24.923584+0000","last_unstale":"2023-08-27T11:25:27.237660+0000","last_undegraded":"2023-08-27T11:25:27.237660+0000","last_fullsized":"2023-08-27T11:25:27.237660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:22.940403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.918919+0000","last_change":"2023-08-27T11:25:25.917014+0000","last_active":"2023-08-27T11:25:26.918919+0000","last_peered":"2023-08-27T11:25:26.918919+0000","last_clean":"2023-08-27T11:25:26.918919+0000","last_became_active":"2023-08-27T11:25:25.916541+0000","last_became_peered":"2023-08-27T11:25:25.916541+0000","last_unstale":"2023-08-27T11:25:26.918919+0000","last_undegraded":"2023-08-27T11:25:26.918919+0000","last_fullsized":"2023-08-27T11:25:26.918919+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:16.298366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237330+0000","last_change":"2023-08-27T11:25:24.922363+0000","last_active":"2023-08-27T11:25:27.237330+0000","last_peered":"2023-08-27T11:25:27.237330+0000","last_clean":"2023-08-27T11:25:27.237330+0000","last_became_active":"2023-08-27T11:25:24.922020+0000","last_became_peered":"2023-08-27T11:25:24.922020+0000","last_unstale":"2023-08-27T11:25:27.237330+0000","last_undegraded":"2023-08-27T11:25:27.237330+0000","last_fullsized":"2023-08-27T11:25:27.237330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:34:16.735217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917146+0000","last_change":"2023-08-27T11:25:25.931703+0000","last_active":"2023-08-27T11:25:26.917146+0000","last_peered":"2023-08-27T11:25:26.917146+0000","last_clean":"2023-08-27T11:25:26.917146+0000","last_became_active":"2023-08-27T11:25:25.931332+0000","last_became_peered":"2023-08-27T11:25:25.931332+0000","last_unstale":"2023-08-27T11:25:26.917146+0000","last_undegraded":"2023-08-27T11:25:26.917146+0000","last_fullsized":"2023-08-27T11:25:26.917146+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:01:36.528681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238732+0000","last_change":"2023-08-27T11:25:24.917472+0000","last_active":"2023-08-27T11:25:27.238732+0000","last_peered":"2023-08-27T11:25:27.238732+0000","last_clean":"2023-08-27T11:25:27.238732+0000","last_became_active":"2023-08-27T11:25:24.917200+0000","last_became_peered":"2023-08-27T11:25:24.917200+0000","last_unstale":"2023-08-27T11:25:27.238732+0000","last_undegraded":"2023-08-27T11:25:27.238732+0000","last_fullsized":"2023-08-27T11:25:27.238732+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:46:28.540835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919347+0000","last_change":"2023-08-27T11:25:25.928906+0000","last_active":"2023-08-27T11:25:26.919347+0000","last_peered":"2023-08-27T11:25:26.919347+0000","last_clean":"2023-08-27T11:25:26.919347+0000","last_became_active":"2023-08-27T11:25:25.928450+0000","last_became_peered":"2023-08-27T11:25:25.928450+0000","last_unstale":"2023-08-27T11:25:26.919347+0000","last_undegraded":"2023-08-27T11:25:26.919347+0000","last_fullsized":"2023-08-27T11:25:26.919347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:10.828528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920013+0000","last_change":"2023-08-27T11:25:24.920783+0000","last_active":"2023-08-27T11:25:26.920013+0000","last_peered":"2023-08-27T11:25:26.920013+0000","last_clean":"2023-08-27T11:25:26.920013+0000","last_became_active":"2023-08-27T11:25:24.920476+0000","last_became_peered":"2023-08-27T11:25:24.920476+0000","last_unstale":"2023-08-27T11:25:26.920013+0000","last_undegraded":"2023-08-27T11:25:26.920013+0000","last_fullsized":"2023-08-27T11:25:26.920013+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:10.879990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237811+0000","last_change":"2023-08-27T11:25:25.922672+0000","last_active":"2023-08-27T11:25:27.237811+0000","last_peered":"2023-08-27T11:25:27.237811+0000","last_clean":"2023-08-27T11:25:27.237811+0000","last_became_active":"2023-08-27T11:25:25.922274+0000","last_became_peered":"2023-08-27T11:25:25.922274+0000","last_unstale":"2023-08-27T11:25:27.237811+0000","last_undegraded":"2023-08-27T11:25:27.237811+0000","last_fullsized":"2023-08-27T11:25:27.237811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:06.480353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919359+0000","last_change":"2023-08-27T11:25:24.926030+0000","last_active":"2023-08-27T11:25:26.919359+0000","last_peered":"2023-08-27T11:25:26.919359+0000","last_clean":"2023-08-27T11:25:26.919359+0000","last_became_active":"2023-08-27T11:25:24.925704+0000","last_became_peered":"2023-08-27T11:25:24.925704+0000","last_unstale":"2023-08-27T11:25:26.919359+0000","last_undegraded":"2023-08-27T11:25:26.919359+0000","last_fullsized":"2023-08-27T11:25:26.919359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:07.612958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917409+0000","last_change":"2023-08-27T11:25:25.931926+0000","last_active":"2023-08-27T11:25:26.917409+0000","last_peered":"2023-08-27T11:25:26.917409+0000","last_clean":"2023-08-27T11:25:26.917409+0000","last_became_active":"2023-08-27T11:25:25.931526+0000","last_became_peered":"2023-08-27T11:25:25.931526+0000","last_unstale":"2023-08-27T11:25:26.917409+0000","last_undegraded":"2023-08-27T11:25:26.917409+0000","last_fullsized":"2023-08-27T11:25:26.917409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:34.408450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917446+0000","last_change":"2023-08-27T11:25:24.919971+0000","last_active":"2023-08-27T11:25:26.917446+0000","last_peered":"2023-08-27T11:25:26.917446+0000","last_clean":"2023-08-27T11:25:26.917446+0000","last_became_active":"2023-08-27T11:25:24.919560+0000","last_became_peered":"2023-08-27T11:25:24.919560+0000","last_unstale":"2023-08-27T11:25:26.917446+0000","last_undegraded":"2023-08-27T11:25:26.917446+0000","last_fullsized":"2023-08-27T11:25:26.917446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:40:41.429689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917686+0000","last_change":"2023-08-27T11:25:25.935524+0000","last_active":"2023-08-27T11:25:26.917686+0000","last_peered":"2023-08-27T11:25:26.917686+0000","last_clean":"2023-08-27T11:25:26.917686+0000","last_became_active":"2023-08-27T11:25:25.935234+0000","last_became_peered":"2023-08-27T11:25:25.935234+0000","last_unstale":"2023-08-27T11:25:26.917686+0000","last_undegraded":"2023-08-27T11:25:26.917686+0000","last_fullsized":"2023-08-27T11:25:26.917686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:58.710906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237898+0000","last_change":"2023-08-27T11:25:24.908964+0000","last_active":"2023-08-27T11:25:27.237898+0000","last_peered":"2023-08-27T11:25:27.237898+0000","last_clean":"2023-08-27T11:25:27.237898+0000","last_became_active":"2023-08-27T11:25:24.908673+0000","last_became_peered":"2023-08-27T11:25:24.908673+0000","last_unstale":"2023-08-27T11:25:27.237898+0000","last_undegraded":"2023-08-27T11:25:27.237898+0000","last_fullsized":"2023-08-27T11:25:27.237898+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:59.327312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237406+0000","last_change":"2023-08-27T11:25:25.918600+0000","last_active":"2023-08-27T11:25:27.237406+0000","last_peered":"2023-08-27T11:25:27.237406+0000","last_clean":"2023-08-27T11:25:27.237406+0000","last_became_active":"2023-08-27T11:25:25.918312+0000","last_became_peered":"2023-08-27T11:25:25.918312+0000","last_unstale":"2023-08-27T11:25:27.237406+0000","last_undegraded":"2023-08-27T11:25:27.237406+0000","last_fullsized":"2023-08-27T11:25:27.237406+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:10.888398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917743+0000","last_change":"2023-08-27T11:25:24.923991+0000","last_active":"2023-08-27T11:25:26.917743+0000","last_peered":"2023-08-27T11:25:26.917743+0000","last_clean":"2023-08-27T11:25:26.917743+0000","last_became_active":"2023-08-27T11:25:24.923644+0000","last_became_peered":"2023-08-27T11:25:24.923644+0000","last_unstale":"2023-08-27T11:25:26.917743+0000","last_undegraded":"2023-08-27T11:25:26.917743+0000","last_fullsized":"2023-08-27T11:25:26.917743+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:21:51.460522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238237+0000","last_change":"2023-08-27T11:25:25.921172+0000","last_active":"2023-08-27T11:25:27.238237+0000","last_peered":"2023-08-27T11:25:27.238237+0000","last_clean":"2023-08-27T11:25:27.238237+0000","last_became_active":"2023-08-27T11:25:25.920800+0000","last_became_peered":"2023-08-27T11:25:25.920800+0000","last_unstale":"2023-08-27T11:25:27.238237+0000","last_undegraded":"2023-08-27T11:25:27.238237+0000","last_fullsized":"2023-08-27T11:25:27.238237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:24.297771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237170+0000","last_change":"2023-08-27T11:25:24.923852+0000","last_active":"2023-08-27T11:25:27.237170+0000","last_peered":"2023-08-27T11:25:27.237170+0000","last_clean":"2023-08-27T11:25:27.237170+0000","last_became_active":"2023-08-27T11:25:24.923556+0000","last_became_peered":"2023-08-27T11:25:24.923556+0000","last_unstale":"2023-08-27T11:25:27.237170+0000","last_undegraded":"2023-08-27T11:25:27.237170+0000","last_fullsized":"2023-08-27T11:25:27.237170+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:30.082503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237771+0000","last_change":"2023-08-27T11:25:25.921147+0000","last_active":"2023-08-27T11:25:27.237771+0000","last_peered":"2023-08-27T11:25:27.237771+0000","last_clean":"2023-08-27T11:25:27.237771+0000","last_became_active":"2023-08-27T11:25:25.920865+0000","last_became_peered":"2023-08-27T11:25:25.920865+0000","last_unstale":"2023-08-27T11:25:27.237771+0000","last_undegraded":"2023-08-27T11:25:27.237771+0000","last_fullsized":"2023-08-27T11:25:27.237771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:44.577319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237689+0000","last_change":"2023-08-27T11:25:24.920647+0000","last_active":"2023-08-27T11:25:27.237689+0000","last_peered":"2023-08-27T11:25:27.237689+0000","last_clean":"2023-08-27T11:25:27.237689+0000","last_became_active":"2023-08-27T11:25:24.920179+0000","last_became_peered":"2023-08-27T11:25:24.920179+0000","last_unstale":"2023-08-27T11:25:27.237689+0000","last_undegraded":"2023-08-27T11:25:27.237689+0000","last_fullsized":"2023-08-27T11:25:27.237689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:45.119170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917926+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:25:26.917926+0000","last_peered":"2023-08-27T11:25:26.917926+0000","last_clean":"2023-08-27T11:25:26.917926+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:25:26.917926+0000","last_undegraded":"2023-08-27T11:25:26.917926+0000","last_fullsized":"2023-08-27T11:25:26.917926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:08:47.831886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238015+0000","last_change":"2023-08-27T11:25:25.939685+0000","last_active":"2023-08-27T11:25:27.238015+0000","last_peered":"2023-08-27T11:25:27.238015+0000","last_clean":"2023-08-27T11:25:27.238015+0000","last_became_active":"2023-08-27T11:25:25.939347+0000","last_became_peered":"2023-08-27T11:25:25.939347+0000","last_unstale":"2023-08-27T11:25:27.238015+0000","last_undegraded":"2023-08-27T11:25:27.238015+0000","last_fullsized":"2023-08-27T11:25:27.238015+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:05.194996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237781+0000","last_change":"2023-08-27T11:25:24.916105+0000","last_active":"2023-08-27T11:25:27.237781+0000","last_peered":"2023-08-27T11:25:27.237781+0000","last_clean":"2023-08-27T11:25:27.237781+0000","last_became_active":"2023-08-27T11:25:24.915828+0000","last_became_peered":"2023-08-27T11:25:24.915828+0000","last_unstale":"2023-08-27T11:25:27.237781+0000","last_undegraded":"2023-08-27T11:25:27.237781+0000","last_fullsized":"2023-08-27T11:25:27.237781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:15.294867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917667+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:25:26.917667+0000","last_peered":"2023-08-27T11:25:26.917667+0000","last_clean":"2023-08-27T11:25:26.917667+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:25:26.917667+0000","last_undegraded":"2023-08-27T11:25:26.917667+0000","last_fullsized":"2023-08-27T11:25:26.917667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:12.072398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238275+0000","last_change":"2023-08-27T11:25:25.921131+0000","last_active":"2023-08-27T11:25:27.238275+0000","last_peered":"2023-08-27T11:25:27.238275+0000","last_clean":"2023-08-27T11:25:27.238275+0000","last_became_active":"2023-08-27T11:25:25.920806+0000","last_became_peered":"2023-08-27T11:25:25.920806+0000","last_unstale":"2023-08-27T11:25:27.238275+0000","last_undegraded":"2023-08-27T11:25:27.238275+0000","last_fullsized":"2023-08-27T11:25:27.238275+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:50.875046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238156+0000","last_change":"2023-08-27T11:25:24.918132+0000","last_active":"2023-08-27T11:25:27.238156+0000","last_peered":"2023-08-27T11:25:27.238156+0000","last_clean":"2023-08-27T11:25:27.238156+0000","last_became_active":"2023-08-27T11:25:24.917778+0000","last_became_peered":"2023-08-27T11:25:24.917778+0000","last_unstale":"2023-08-27T11:25:27.238156+0000","last_undegraded":"2023-08-27T11:25:27.238156+0000","last_fullsized":"2023-08-27T11:25:27.238156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:46:28.540835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":110,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237161+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:25:27.237161+0000","last_peered":"2023-08-27T11:25:27.237161+0000","last_clean":"2023-08-27T11:25:27.237161+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:25:27.237161+0000","last_undegraded":"2023-08-27T11:25:27.237161+0000","last_fullsized":"2023-08-27T11:25:27.237161+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:08.998725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919688+0000","last_change":"2023-08-27T11:25:25.921627+0000","last_active":"2023-08-27T11:25:26.919688+0000","last_peered":"2023-08-27T11:25:26.919688+0000","last_clean":"2023-08-27T11:25:26.919688+0000","last_became_active":"2023-08-27T11:25:25.920921+0000","last_became_peered":"2023-08-27T11:25:25.920921+0000","last_unstale":"2023-08-27T11:25:26.919688+0000","last_undegraded":"2023-08-27T11:25:26.919688+0000","last_fullsized":"2023-08-27T11:25:26.919688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:31:17.013170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238077+0000","last_change":"2023-08-27T11:25:24.919858+0000","last_active":"2023-08-27T11:25:27.238077+0000","last_peered":"2023-08-27T11:25:27.238077+0000","last_clean":"2023-08-27T11:25:27.238077+0000","last_became_active":"2023-08-27T11:25:24.919538+0000","last_became_peered":"2023-08-27T11:25:24.919538+0000","last_unstale":"2023-08-27T11:25:27.238077+0000","last_undegraded":"2023-08-27T11:25:27.238077+0000","last_fullsized":"2023-08-27T11:25:27.238077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:38:20.311999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920360+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:25:26.920360+0000","last_peered":"2023-08-27T11:25:26.920360+0000","last_clean":"2023-08-27T11:25:26.920360+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:25:26.920360+0000","last_undegraded":"2023-08-27T11:25:26.920360+0000","last_fullsized":"2023-08-27T11:25:26.920360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:39.855060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.917753+0000","last_change":"2023-08-27T11:25:25.918035+0000","last_active":"2023-08-27T11:25:26.917753+0000","last_peered":"2023-08-27T11:25:26.917753+0000","last_clean":"2023-08-27T11:25:26.917753+0000","last_became_active":"2023-08-27T11:25:25.917588+0000","last_became_peered":"2023-08-27T11:25:25.917588+0000","last_unstale":"2023-08-27T11:25:26.917753+0000","last_undegraded":"2023-08-27T11:25:26.917753+0000","last_fullsized":"2023-08-27T11:25:26.917753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:05:58.119531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237377+0000","last_change":"2023-08-27T11:25:24.912962+0000","last_active":"2023-08-27T11:25:27.237377+0000","last_peered":"2023-08-27T11:25:27.237377+0000","last_clean":"2023-08-27T11:25:27.237377+0000","last_became_active":"2023-08-27T11:25:24.912591+0000","last_became_peered":"2023-08-27T11:25:24.912591+0000","last_unstale":"2023-08-27T11:25:27.237377+0000","last_undegraded":"2023-08-27T11:25:27.237377+0000","last_fullsized":"2023-08-27T11:25:27.237377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:56.319742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920205+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:25:26.920205+0000","last_peered":"2023-08-27T11:25:26.920205+0000","last_clean":"2023-08-27T11:25:26.920205+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:25:26.920205+0000","last_undegraded":"2023-08-27T11:25:26.920205+0000","last_fullsized":"2023-08-27T11:25:26.920205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:51.961771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238551+0000","last_change":"2023-08-27T11:25:25.914690+0000","last_active":"2023-08-27T11:25:27.238551+0000","last_peered":"2023-08-27T11:25:27.238551+0000","last_clean":"2023-08-27T11:25:27.238551+0000","last_became_active":"2023-08-27T11:25:25.914377+0000","last_became_peered":"2023-08-27T11:25:25.914377+0000","last_unstale":"2023-08-27T11:25:27.238551+0000","last_undegraded":"2023-08-27T11:25:27.238551+0000","last_fullsized":"2023-08-27T11:25:27.238551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:05.194996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237705+0000","last_change":"2023-08-27T11:25:24.919759+0000","last_active":"2023-08-27T11:25:27.237705+0000","last_peered":"2023-08-27T11:25:27.237705+0000","last_clean":"2023-08-27T11:25:27.237705+0000","last_became_active":"2023-08-27T11:25:24.919456+0000","last_became_peered":"2023-08-27T11:25:24.919456+0000","last_unstale":"2023-08-27T11:25:27.237705+0000","last_undegraded":"2023-08-27T11:25:27.237705+0000","last_fullsized":"2023-08-27T11:25:27.237705+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:03.061641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":250,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.920151+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:25:26.920151+0000","last_peered":"2023-08-27T11:25:26.920151+0000","last_clean":"2023-08-27T11:25:26.920151+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:25:26.920151+0000","last_undegraded":"2023-08-27T11:25:26.920151+0000","last_fullsized":"2023-08-27T11:25:26.920151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:29.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237648+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:25:27.237648+0000","last_peered":"2023-08-27T11:25:27.237648+0000","last_clean":"2023-08-27T11:25:27.237648+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:25:27.237648+0000","last_undegraded":"2023-08-27T11:25:27.237648+0000","last_fullsized":"2023-08-27T11:25:27.237648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:27:26.240110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237265+0000","last_change":"2023-08-27T11:25:25.917348+0000","last_active":"2023-08-27T11:25:27.237265+0000","last_peered":"2023-08-27T11:25:27.237265+0000","last_clean":"2023-08-27T11:25:27.237265+0000","last_became_active":"2023-08-27T11:25:25.916972+0000","last_became_peered":"2023-08-27T11:25:25.916972+0000","last_unstale":"2023-08-27T11:25:27.237265+0000","last_undegraded":"2023-08-27T11:25:27.237265+0000","last_fullsized":"2023-08-27T11:25:27.237265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:03.435348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919988+0000","last_change":"2023-08-27T11:25:24.920798+0000","last_active":"2023-08-27T11:25:26.919988+0000","last_peered":"2023-08-27T11:25:26.919988+0000","last_clean":"2023-08-27T11:25:26.919988+0000","last_became_active":"2023-08-27T11:25:24.920323+0000","last_became_peered":"2023-08-27T11:25:24.920323+0000","last_unstale":"2023-08-27T11:25:26.919988+0000","last_undegraded":"2023-08-27T11:25:26.919988+0000","last_fullsized":"2023-08-27T11:25:26.919988+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:09.497973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.238892+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:25:27.238892+0000","last_peered":"2023-08-27T11:25:27.238892+0000","last_clean":"2023-08-27T11:25:27.238892+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:25:27.238892+0000","last_undegraded":"2023-08-27T11:25:27.238892+0000","last_fullsized":"2023-08-27T11:25:27.238892+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:17:18.305063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:27.237257+0000","last_change":"2023-08-27T11:25:25.935366+0000","last_active":"2023-08-27T11:25:27.237257+0000","last_peered":"2023-08-27T11:25:27.237257+0000","last_clean":"2023-08-27T11:25:27.237257+0000","last_became_active":"2023-08-27T11:25:25.935071+0000","last_became_peered":"2023-08-27T11:25:25.935071+0000","last_unstale":"2023-08-27T11:25:27.237257+0000","last_undegraded":"2023-08-27T11:25:27.237257+0000","last_fullsized":"2023-08-27T11:25:27.237257+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:24.889126+0000","last_clean_scrub_stamp":"2023-08-27T11:25:24.889126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:07.947767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919935+0000","last_change":"2023-08-27T11:25:24.919905+0000","last_active":"2023-08-27T11:25:26.919935+0000","last_peered":"2023-08-27T11:25:26.919935+0000","last_clean":"2023-08-27T11:25:26.919935+0000","last_became_active":"2023-08-27T11:25:24.919452+0000","last_became_peered":"2023-08-27T11:25:24.919452+0000","last_unstale":"2023-08-27T11:25:26.919935+0000","last_undegraded":"2023-08-27T11:25:26.919935+0000","last_fullsized":"2023-08-27T11:25:26.919935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:25:23.885627+0000","last_clean_scrub_stamp":"2023-08-27T11:25:23.885627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:14:46.380973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-08-27T11:25:26.919501+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:25:26.919501+0000","last_peered":"2023-08-27T11:25:26.919501+0000","last_clean":"2023-08-27T11:25:26.919501+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:25:26.919501+0000","last_undegraded":"2023-08-27T11:25:26.919501+0000","last_fullsized":"2023-08-27T11:25:26.919501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:59.442851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1425408,"data_stored":971058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.92800000000000005,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65200000000000002},"min":{"1min":0.47399999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.82399999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.85499999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.71199999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0449999999999999,"5min":1.173,"15min":1.173},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.65500000000000003,"15min":0.63700000000000001},"min":{"1min":0.56599999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79500000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45400000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.1739999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.754}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1879999999999999,"5min":1.397,"15min":1.397},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.4139999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.03}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.875,"15min":0.88100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.119,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2070000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.89500000000000002,"15min":0.93700000000000006},"min":{"1min":0.40899999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88300000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77800000000000002,"15min":0.79600000000000004},"min":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":3.472,"15min":3.472},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.95599999999999996,"15min":1.01},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.80600000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.78800000000000003,"15min":0.81299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80300000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.83599999999999997,"15min":0.85899999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.89700000000000002,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.97099999999999997,"15min":1.016},"min":{"1min":0.55900000000000005,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.875},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.85599999999999998,"15min":0.88400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92600000000000005,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":1.234,"15min":1.234},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.437,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92000000000000004,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.93500000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.46100000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":1.135,"15min":1.135},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.84299999999999997,"15min":0.85299999999999998},"min":{"1min":0.63,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.91100000000000003,"5min":1.127,"15min":1.127},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.88500000000000001,"15min":0.89900000000000002},"min":{"1min":0.66500000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.95099999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85999999999999999,"15min":0.876},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97599999999999998,"5min":1.27,"15min":1.27},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28420,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343420,"statfs":{"total":96636764160,"available":96607662080,"internally_reserved":0,"allocated":1429504,"data_stored":971148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40200000000000002,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.749,"15min":0.749},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"min":{"1min":0.33900000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.628,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56100000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"min":{"1min":0.34899999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.64100000000000001,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.66000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.97399999999999998,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97699999999999998,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.79300000000000004},"min":{"1min":0.60199999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0329999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.04,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.995,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80100000000000005,"15min":0.80300000000000005},"min":{"1min":0.66700000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.97599999999999998,"5min":1.383,"15min":1.383},"last":0.77200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.61599999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.91300000000000003,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.66500000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.018,"5min":1.427,"15min":1.427},"last":0.69899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":823296,"data_stored":379682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.504},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58399999999999996,"15min":0.58999999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95899999999999996,"5min":1.355,"15min":1.355},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.749,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.73899999999999999,"15min":0.73299999999999998},"min":{"1min":0.60599999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0629999999999999,"5min":1.123,"15min":1.123},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.78100000000000003,"15min":0.78700000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0449999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92900000000000005,"5min":1.329,"15min":1.329},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.89000000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.80700000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97699999999999998,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.96499999999999997,"5min":1.288,"15min":1.288},"last":0.63700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":381410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.52200000000000002,"15min":0.53400000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74099999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55900000000000005,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59199999999999997,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.504}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67200000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.57599999999999996,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.66400000000000003,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.57699999999999996,"15min":0.59499999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72599999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.378},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.68600000000000005,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.68300000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82499999999999996,"15min":0.83099999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.92900000000000005,"5min":1.669,"15min":1.669},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.25,"5min":1.994,"15min":1.994},"last":0.57899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.83299999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2110000000000001,"5min":2.036,"15min":2.036},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0009999999999999,"5min":1.26,"15min":1.26},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.048,"5min":1.321,"15min":1.321},"last":0.62},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1160000000000001,"5min":1.627,"15min":1.627},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86399999999999999,"15min":0.876},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1579999999999999,"5min":2.073,"15min":2.073},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.874,"15min":0.88200000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1000000000000001,"5min":1.323,"15min":1.323},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":380264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.62,"15min":0.65200000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.75600000000000001,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.379},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":1.2110000000000001,"15min":1.335},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.58599999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.68999999999999995,"15min":0.72299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.69799999999999995,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.71699999999999997,"15min":0.745},"min":{"1min":0.40600000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76200000000000001,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1140000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.54400000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.92600000000000005,"5min":1.429,"15min":1.429},"last":0.629},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.995,"15min":1.0309999999999999},"min":{"1min":0.61599999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.073,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.97399999999999998,"15min":1.008},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0149999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.96199999999999997,"15min":0.998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.0289999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:24:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.97999999999999998,"15min":1.0109999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0349999999999999,"5min":5,"15min":5},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83199999999999996},"min":{"1min":0.59899999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0920000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.90700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":847872,"data_stored":382384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.44500000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.751}]},{"osd":1,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.52800000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73299999999999998,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98999999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.58699999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.56499999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.82799999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:24:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75,"15min":0.73799999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.58599999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":379716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63400000000000001,"15min":0.62},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63200000000000001,"15min":0.622},"min":{"1min":0.48599999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.749},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.64400000000000002},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.53300000000000003,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.02,"5min":1.097,"15min":1.097},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.034,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73899999999999999,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71399999999999997,"15min":0.69999999999999996},"min":{"1min":0.60399999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95299999999999996,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.46300000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.744,"15min":1.744},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77500000000000002,"15min":0.77700000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0149999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0600000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0800000000000001,"5min":1.663,"15min":1.663},"last":0.83599999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0940000000000001,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.89800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:25:35.867 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:25:35.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:25:36.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.108+0000 7f2ff4fff700 1 Processor -- start 2023-08-27T11:25:36.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.109+0000 7f2ff4fff700 1 -- start start 2023-08-27T11:25:36.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2ff4fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2ff006a790 0x7f2ff00c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2ff4fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff00c4c50 0x7f2ff015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2ff4fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff00ac7e0 con 0x7f2ff0151d20 2023-08-27T11:25:36.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2ff4fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff00c86a0 con 0x7f2ff006a790 2023-08-27T11:25:36.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2ff4fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0155030 con 0x7f2ff00c4c50 2023-08-27T11:25:36.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2ff006a790 0x7f2ff00c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2ff006a790 0x7f2ff00c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38572/0 (socket says 172.21.15.43:38572) 2023-08-27T11:25:36.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 -- 172.21.15.43:0/1002642240 learned_addr learned my addr 172.21.15.43:0/1002642240 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:36.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2feed9d700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff00c4c50 0x7f2ff015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 -- 172.21.15.43:0/1002642240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff00c4c50 msgr2=0x7f2ff015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:36.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff00c4c50 0x7f2ff015ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 -- 172.21.15.43:0/1002642240 >> v1:172.21.15.57:6789/0 conn(0x7f2ff0151d20 legacy=0x7f2ff00c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:36.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.110+0000 7f2fe7fff700 1 -- 172.21.15.43:0/1002642240 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00c99f0 con 0x7f2ff006a790 2023-08-27T11:25:36.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2fe7fff700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff006a790 0x7f2ff00c4710 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009920 tx=0x7f2fd8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9841dc11b6a93aed server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2fedd9b700 1 -- 172.21.15.43:0/1002642240 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004230 con 0x7f2ff006a790 2023-08-27T11:25:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2fedd9b700 1 -- 172.21.15.43:0/1002642240 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8004390 con 0x7f2ff006a790 2023-08-27T11:25:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2fedd9b700 1 -- 172.21.15.43:0/1002642240 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8009e70 con 0x7f2ff006a790 2023-08-27T11:25:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2ff4fff700 1 -- 172.21.15.43:0/1002642240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff006a790 msgr2=0x7f2ff00c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.111+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff006a790 0x7f2ff00c4710 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009920 tx=0x7f2fd8009c30 comp rx=0 tx=0).stop 2023-08-27T11:25:36.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 -- 172.21.15.43:0/1002642240 shutdown_connections 2023-08-27T11:25:36.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff00c4c50 0x7f2ff015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/1002642240 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff006a790 0x7f2ff00c4710 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 -- 172.21.15.43:0/1002642240 >> 172.21.15.43:0/1002642240 conn(0x7f2ff00ab880 msgr2=0x7f2ff00abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 -- 172.21.15.43:0/1002642240 shutdown_connections 2023-08-27T11:25:36.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.112+0000 7f2ff4fff700 1 -- 172.21.15.43:0/1002642240 wait complete. 2023-08-27T11:25:36.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.113+0000 7f2ff4fff700 1 Processor -- start 2023-08-27T11:25:36.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.113+0000 7f2ff4fff700 1 -- start start 2023-08-27T11:25:36.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff006a790 0x7f2ff014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 0x7f2ff014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0156470 con 0x7f2ff00c4c50 2023-08-27T11:25:36.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01e9a30 con 0x7f2ff0151d20 2023-08-27T11:25:36.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.114+0000 7f2ff4fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01e9d10 con 0x7f2ff006a790 2023-08-27T11:25:36.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fee59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff006a790 0x7f2ff014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38586/0 (socket says 172.21.15.43:38586) 2023-08-27T11:25:36.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 -- 172.21.15.43:0/4273227840 learned_addr learned my addr 172.21.15.43:0/4273227840 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:36.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2feed9d700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 0x7f2ff014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 -- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff006a790 msgr2=0x7f2ff014d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff006a790 0x7f2ff014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 -- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 msgr2=0x7f2ff014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 0x7f2ff014b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 -- 172.21.15.43:0/4273227840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8009550 con 0x7f2ff00c4c50 2023-08-27T11:25:36.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2feed9d700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 0x7f2ff014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:36.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.115+0000 7f2fe7fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.116+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd800bba0 con 0x7f2ff00c4c50 2023-08-27T11:25:36.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.116+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd801f070 con 0x7f2ff00c4c50 2023-08-27T11:25:36.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.116+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff01e9ff0 con 0x7f2ff00c4c50 2023-08-27T11:25:36.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.116+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80036a0 con 0x7f2ff00c4c50 2023-08-27T11:25:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.116+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff01ea5b0 con 0x7f2ff00c4c50 2023-08-27T11:25:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.117+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff0074680 con 0x7f2ff00c4c50 2023-08-27T11:25:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.118+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2fd8021030 con 0x7f2ff00c4c50 2023-08-27T11:25:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.119+0000 7f2fe6ffd700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 0x7f2fd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.119+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fd8089b60 con 0x7f2ff00c4c50 2023-08-27T11:25:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.119+0000 7f2fee59c700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 0x7f2fd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.119+0000 7f2fee59c700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 0x7f2fd006c5a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009960 tx=0x7f2fe00090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.123+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2fd8055240 con 0x7f2ff00c4c50 2023-08-27T11:25:36.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.416+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2ff0074680 con 0x7f2ff00c4c50 2023-08-27T11:25:36.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.421+0000 7f2fe6ffd700 1 -- 172.21.15.43:0/4273227840 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2fd8058860 con 0x7f2ff00c4c50 2023-08-27T11:25:36.422 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:25:36.423 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:25:36.423 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:25:36.423 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:25:36.423 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:25:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 msgr2=0x7f2fd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 0x7f2fd006c5a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009960 tx=0x7f2fe00090e0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 msgr2=0x7f2ff01e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009870 tx=0x7f2fd8004750 comp rx=0 tx=0).stop 2023-08-27T11:25:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 shutdown_connections 2023-08-27T11:25:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2fd006a0e0 0x7f2fd006c5a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ff0151d20 0x7f2ff014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ff006a790 0x7f2ff014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 --2- 172.21.15.43:0/4273227840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2ff00c4c50 0x7f2ff01e0530 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 >> 172.21.15.43:0/4273227840 conn(0x7f2ff00ab880 msgr2=0x7f2ff00c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:36.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 shutdown_connections 2023-08-27T11:25:36.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.423+0000 7f2ff4fff700 1 -- 172.21.15.43:0/4273227840 wait complete. 2023-08-27T11:25:36.428 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:25:36.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.643+0000 7fb2e73ff700 1 Processor -- start 2023-08-27T11:25:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.643+0000 7fb2e73ff700 1 -- start start 2023-08-27T11:25:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e73ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2e00c4630 0x7fb2e00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e73ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2e006ad70 0x7fb2e006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e73ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e006c4e0 con 0x7fb2e0151a90 2023-08-27T11:25:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e73ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e0155370 con 0x7fb2e00c4630 2023-08-27T11:25:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e73ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00c82c0 con 0x7fb2e006ad70 2023-08-27T11:25:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2e00c4630 0x7fb2e00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2e00c4630 0x7fb2e00c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38598/0 (socket says 172.21.15.43:38598) 2023-08-27T11:25:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 -- 172.21.15.43:0/3466278858 learned_addr learned my addr 172.21.15.43:0/3466278858 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e599c700 1 --2- 172.21.15.43:0/3466278858 >> v2:172.21.15.57:3300/0 conn(0x7fb2e006ad70 0x7fb2e006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 -- 172.21.15.43:0/3466278858 >> v2:172.21.15.57:3300/0 conn(0x7fb2e006ad70 msgr2=0x7fb2e006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 --2- 172.21.15.43:0/3466278858 >> v2:172.21.15.57:3300/0 conn(0x7fb2e006ad70 0x7fb2e006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 -- 172.21.15.43:0/3466278858 >> v1:172.21.15.57:6789/0 conn(0x7fb2e0151a90 legacy=0x7fb2e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.645+0000 7fb2e499a700 1 -- 172.21.15.43:0/3466278858 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0151e70 con 0x7fb2e00c4630 2023-08-27T11:25:36.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2e499a700 1 --2- 172.21.15.43:0/3466278858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e00c4a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00c4270 tx=0x7fb2d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bafaa0624ffd91 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2d7fff700 1 -- 172.21.15.43:0/3466278858 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011830 con 0x7fb2e00c4630 2023-08-27T11:25:36.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2d7fff700 1 -- 172.21.15.43:0/3466278858 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0011990 con 0x7fb2e00c4630 2023-08-27T11:25:36.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2d7fff700 1 -- 172.21.15.43:0/3466278858 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0011d20 con 0x7fb2e00c4630 2023-08-27T11:25:36.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2e73ff700 1 -- 172.21.15.43:0/3466278858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 msgr2=0x7fb2e00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.646+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/3466278858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e00c4a90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00c4270 tx=0x7fb2d0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 -- 172.21.15.43:0/3466278858 shutdown_connections 2023-08-27T11:25:36.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/3466278858 >> v2:172.21.15.57:3300/0 conn(0x7fb2e006ad70 0x7fb2e006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/3466278858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e00c4a90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 -- 172.21.15.43:0/3466278858 >> 172.21.15.43:0/3466278858 conn(0x7fb2e00ab820 msgr2=0x7fb2e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:36.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 -- 172.21.15.43:0/3466278858 shutdown_connections 2023-08-27T11:25:36.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.647+0000 7fb2e73ff700 1 -- 172.21.15.43:0/3466278858 wait complete. 2023-08-27T11:25:36.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.648+0000 7fb2e73ff700 1 Processor -- start 2023-08-27T11:25:36.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.649+0000 7fb2e73ff700 1 -- start start 2023-08-27T11:25:36.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.649+0000 7fb2e73ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e006ad70 0x7fb2e00c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.649+0000 7fb2e73ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.649+0000 7fb2e73ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e0151a90 0x7fb2e014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e73ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e014cb40 con 0x7fb2e00c4630 2023-08-27T11:25:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e73ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0146bf0 con 0x7fb2e0151a90 2023-08-27T11:25:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e73ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e014c830 con 0x7fb2e006ad70 2023-08-27T11:25:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38608/0 (socket says 172.21.15.43:38608) 2023-08-27T11:25:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 -- 172.21.15.43:0/2779918745 learned_addr learned my addr 172.21.15.43:0/2779918745 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e519b700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e006ad70 0x7fb2e00c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e599c700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e0151a90 0x7fb2e014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 -- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e006ad70 msgr2=0x7fb2e00c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e006ad70 0x7fb2e00c2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 -- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e0151a90 msgr2=0x7fb2e014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e0151a90 0x7fb2e014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 -- 172.21.15.43:0/2779918745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009550 con 0x7fb2e00c4630 2023-08-27T11:25:36.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.650+0000 7fb2e499a700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009c10 tx=0x7fb2d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.651+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0004400 con 0x7fb2e00c4630 2023-08-27T11:25:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.651+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d001f070 con 0x7fb2e00c4630 2023-08-27T11:25:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.651+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00038e0 con 0x7fb2e00c4630 2023-08-27T11:25:36.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.651+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e00c3390 con 0x7fb2e00c4630 2023-08-27T11:25:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.651+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e0146e70 con 0x7fb2e00c4630 2023-08-27T11:25:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.652+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e004ee70 con 0x7fb2e00c4630 2023-08-27T11:25:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.653+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2d0021030 con 0x7fb2e00c4630 2023-08-27T11:25:36.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.654+0000 7fb2d5ffb700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 0x7fb2c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:36.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.654+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2d00899a0 con 0x7fb2e00c4630 2023-08-27T11:25:36.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.654+0000 7fb2e519b700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 0x7fb2c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:36.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.655+0000 7fb2e519b700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 0x7fb2c406c5a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb2e014f900 tx=0x7fb2dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:36.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.658+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2d0055080 con 0x7fb2e00c4630 2023-08-27T11:25:36.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.913+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e006c130 con 0x7fb2e00c4630 2023-08-27T11:25:36.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.913+0000 7fb2d5ffb700 1 -- 172.21.15.43:0/2779918745 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4871 (secure 0 0 0) 0x7fb2d0015090 con 0x7fb2e00c4630 2023-08-27T11:25:36.916 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:36.916 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:28.924409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/497941784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":497941784},{"type":"v1","addr":"172.21.15.43:6837","nonce":497941784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:36.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 msgr2=0x7fb2c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 0x7fb2c406c5a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb2e014f900 tx=0x7fb2dc009040 comp rx=0 tx=0).stop 2023-08-27T11:25:36.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 msgr2=0x7fb2e014cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:36.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009c10 tx=0x7fb2d0004750 comp rx=0 tx=0).stop 2023-08-27T11:25:36.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 shutdown_connections 2023-08-27T11:25:36.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb2c406a0e0 0x7fb2c406c5a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e0151a90 0x7fb2e014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e006ad70 0x7fb2e00c2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 --2- 172.21.15.43:0/2779918745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2e00c4630 0x7fb2e014cfd0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 >> 172.21.15.43:0/2779918745 conn(0x7fb2e00ab820 msgr2=0x7fb2e014ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 shutdown_connections 2023-08-27T11:25:36.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:36.916+0000 7fb2e73ff700 1 -- 172.21.15.43:0/2779918745 wait complete. 2023-08-27T11:25:36.920 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2023-08-27T11:25:37.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:25:25.420723+0000', 'modified': '2023-08-27T11:25:28.924409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6195}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6195': {'gid': 6195, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/497941784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 497941784}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 497941784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:25:37.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:25:37.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:25:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.543+0000 7fddcafff700 1 Processor -- start 2023-08-27T11:25:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.543+0000 7fddcafff700 1 -- start start 2023-08-27T11:25:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.544+0000 7fddcafff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddc406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.544+0000 7fddcafff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc406c4e0 con 0x7fddc4151a90 2023-08-27T11:25:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.544+0000 7fddcafff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc4155370 con 0x7fddc40c4630 2023-08-27T11:25:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.544+0000 7fddcafff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40c82c0 con 0x7fddc40c4a90 2023-08-27T11:25:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc8d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fddc4151a90 0x7fddc40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41510/0 (socket says 172.21.15.43:41510) 2023-08-27T11:25:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc8d9b700 1 -- 172.21.15.43:0/2302789642 learned_addr learned my addr 172.21.15.43:0/2302789642 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc959c700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddc406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525107592 0 0) 0x7fddc406c4e0 con 0x7fddc4151a90 2023-08-27T11:25:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb40035b0 con 0x7fddc4151a90 2023-08-27T11:25:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119526217 0 0) 0x7fddb40035b0 con 0x7fddc4151a90 2023-08-27T11:25:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 msgr2=0x7fddc406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddc406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 >> v1:172.21.15.57:6789/0 conn(0x7fddc40c4630 legacy=0x7fddc406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4151e70 con 0x7fddc4151a90 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.545+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fddb8001670 con 0x7fddc4151a90 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 >> v1:172.21.15.43:6789/0 conn(0x7fddc4151a90 legacy=0x7fddc40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddb4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb4004d90 0x7fddb4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40c82c0 con 0x7fddb4003f70 2023-08-27T11:25:37.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb400bb20 con 0x7fddb4004d90 2023-08-27T11:25:37.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb400bce0 con 0x7fddc40c4a90 2023-08-27T11:25:37.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddb4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc959c700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb4004d90 0x7fddb4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 -- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 msgr2=0x7fddb4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40c4a90 0x7fddb4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 -- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb4004d90 msgr2=0x7fddb4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddb4004d90 0x7fddb4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.546+0000 7fddc3fff700 1 -- 172.21.15.43:0/2302789642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40035b0 con 0x7fddb4003f70 2023-08-27T11:25:37.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddc3fff700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddb4004850 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fddb00018d0 tx=0x7fddb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596ba5416eafabc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000c690 con 0x7fddb4003f70 2023-08-27T11:25:37.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000c7f0 con 0x7fddb4003f70 2023-08-27T11:25:37.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddc37fe700 1 -- 172.21.15.43:0/2302789642 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000cba0 con 0x7fddb4003f70 2023-08-27T11:25:37.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddcafff700 1 -- 172.21.15.43:0/2302789642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 msgr2=0x7fddb4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddcafff700 1 --2- 172.21.15.43:0/2302789642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddb4004850 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fddb00018d0 tx=0x7fddb4005880 comp rx=0 tx=0).stop 2023-08-27T11:25:37.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddc959c700 1 -- 172.21.15.43:0/2302789642 reap_dead start 2023-08-27T11:25:37.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddcafff700 1 -- 172.21.15.43:0/2302789642 shutdown_connections 2023-08-27T11:25:37.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.547+0000 7fddcafff700 1 -- 172.21.15.43:0/2302789642 >> 172.21.15.43:0/2302789642 conn(0x7fddc40ab820 msgr2=0x7fddc40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.548+0000 7fddcafff700 1 -- 172.21.15.43:0/2302789642 shutdown_connections 2023-08-27T11:25:37.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.548+0000 7fddcafff700 1 -- 172.21.15.43:0/2302789642 wait complete. 2023-08-27T11:25:37.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.549+0000 7fddcafff700 1 Processor -- start 2023-08-27T11:25:37.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.549+0000 7fddcafff700 1 -- start start 2023-08-27T11:25:37.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 0x7fddc414d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 0x7fddc4153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc414c600 con 0x7fddb4003f70 2023-08-27T11:25:37.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc41ea480 con 0x7fddc414dc30 2023-08-27T11:25:37.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.550+0000 7fddcafff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40aa680 con 0x7fddc41537f0 2023-08-27T11:25:37.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38618/0 (socket says 172.21.15.43:38618) 2023-08-27T11:25:37.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 -- 172.21.15.43:0/3940078439 learned_addr learned my addr 172.21.15.43:0/3940078439 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 0x7fddc414d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc959c700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 0x7fddc4153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 -- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 msgr2=0x7fddc4153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 0x7fddc4153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 -- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 msgr2=0x7fddc414d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 0x7fddc414d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 -- 172.21.15.43:0/3940078439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40aa960 con 0x7fddb4003f70 2023-08-27T11:25:37.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 0x7fddc414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:37.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc959c700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 0x7fddc4153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:37.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fddb8007090 tx=0x7fddb8007450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.551+0000 7fddc17fa700 1 -- 172.21.15.43:0/3940078439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb80010b0 con 0x7fddb4003f70 2023-08-27T11:25:37.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.552+0000 7fddc17fa700 1 -- 172.21.15.43:0/3940078439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb800f5e0 con 0x7fddb4003f70 2023-08-27T11:25:37.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.552+0000 7fddc17fa700 1 -- 172.21.15.43:0/3940078439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb800f990 con 0x7fddb4003f70 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.552+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc40aac40 con 0x7fddb4003f70 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.552+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc41541c0 con 0x7fddb4003f70 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.554+0000 7fddc17fa700 1 -- 172.21.15.43:0/3940078439 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fddb800faf0 con 0x7fddb4003f70 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.556+0000 7fddc17fa700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 0x7fdda806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.556+0000 7fddc17fa700 1 -- 172.21.15.43:0/3940078439 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddb8088530 con 0x7fddb4003f70 2023-08-27T11:25:37.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.556+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 0x7fdda806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.557+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 0x7fdda806c5a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000c00 tx=0x7fddb0005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.558+0000 7fddde893b80 1 Processor -- start 2023-08-27T11:25:37.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.558+0000 7fddde893b80 1 -- start start 2023-08-27T11:25:37.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb0bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eaeefe0 0x55878eb0c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878ea46730 con 0x55878eae92e0 2023-08-27T11:25:37.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878ea44050 con 0x55878eae8f00 2023-08-27T11:25:37.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55878ea3f940 con 0x55878eaeefe0 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38626/0 (socket says 172.21.15.43:38626) 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 -- 172.21.15.43:0/2792715598 learned_addr learned my addr 172.21.15.43:0/2792715598 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb0bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc3fff700 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eaeefe0 0x55878eb0c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 -- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eaeefe0 msgr2=0x55878eb0c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eaeefe0 0x55878eb0c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 -- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 msgr2=0x55878eb0bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb0bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.559+0000 7fddc959c700 1 -- 172.21.15.43:0/2792715598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55878e8bf5e0 con 0x55878eae92e0 2023-08-27T11:25:37.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddc959c700 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ac390 tx=0x7fddbc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acc442f85f1ca6f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddae7fc700 1 -- 172.21.15.43:0/2792715598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e040 con 0x55878eae92e0 2023-08-27T11:25:37.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddae7fc700 1 -- 172.21.15.43:0/2792715598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00f040 con 0x55878eae92e0 2023-08-27T11:25:37.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddae7fc700 1 -- 172.21.15.43:0/2792715598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc007b40 con 0x55878eae92e0 2023-08-27T11:25:37.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddde893b80 1 -- 172.21.15.43:0/2792715598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 msgr2=0x55878eb21500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.560+0000 7fddde893b80 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ac390 tx=0x7fddbc009750 comp rx=0 tx=0).stop 2023-08-27T11:25:37.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 -- 172.21.15.43:0/2792715598 shutdown_connections 2023-08-27T11:25:37.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb21500 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb0bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 --2- 172.21.15.43:0/2792715598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eaeefe0 0x55878eb0c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 -- 172.21.15.43:0/2792715598 >> 172.21.15.43:0/2792715598 conn(0x55878ea4bc30 msgr2=0x55878eaeb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 -- 172.21.15.43:0/2792715598 shutdown_connections 2023-08-27T11:25:37.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 -- 172.21.15.43:0/2792715598 wait complete. 2023-08-27T11:25:37.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.561+0000 7fddde893b80 1 -- start start 2023-08-27T11:25:37.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.562+0000 7fddde893b80 1 Processor -- start 2023-08-27T11:25:37.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.562+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb12120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.562+0000 7fddde893b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 0x55878eb3c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddde893b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878e9ddb60 con 0x55878eae92e0 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878e9dd860 con 0x55878eae8f00 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55878e8c18d0 con 0x55878eb2dc10 2023-08-27T11:25:37.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddde893b80 10 client.0 _ll_register_callbacks cb 0x55878e9db630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:37.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38642/0 (socket says 172.21.15.43:38642) 2023-08-27T11:25:37.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 -- 172.21.15.43:0/3682234917 learned_addr learned my addr 172.21.15.43:0/3682234917 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb12120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 -- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 msgr2=0x55878eb3c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc959c700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 0x55878eb3c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 0x55878eb3c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 -- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 msgr2=0x55878eb12120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb12120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 -- 172.21.15.43:0/3682234917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc009d60 con 0x55878eae92e0 2023-08-27T11:25:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb12120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc959c700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 0x55878eb3c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.563+0000 7fddc3fff700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fddb400baf0 tx=0x7fddb000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5098c755fa2bfa21 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:37.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0006c70 con 0x55878eae92e0 2023-08-27T11:25:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55878eae04f0 con 0x55878eae92e0 2023-08-27T11:25:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddb0006dd0 con 0x55878eae92e0 2023-08-27T11:25:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddb0007050 con 0x55878eae92e0 2023-08-27T11:25:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 10 client.6357 fetch_fsmap learned FSMap version 58 2023-08-27T11:25:37.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55878ea57750 con 0x55878eae92e0 2023-08-27T11:25:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55878eae04f0 con 0x55878eae92e0 2023-08-27T11:25:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fddb00071b0 con 0x55878eae92e0 2023-08-27T11:25:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 10 client.6357 fetch_fsmap finished waiting for FSMap version 58 2023-08-27T11:25:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 10 client.6357 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:25:37.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 20 client.6357 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.564+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb39450 0x55878eb39830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.565+0000 7fddde893b80 4 client.6357 mds_command: new command op to 6195 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:25:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.565+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 --> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55878ea38920 con 0x55878eb39450 2023-08-27T11:25:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.565+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb39450 0x55878eb39830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.565+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb39450 0x55878eb39830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c627159947630c9 server_cookie=d7807802088f241e in_seq=0 out_seq=0 2023-08-27T11:25:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.565+0000 7fdda37fe700 10 client.6357 ms_handle_connect on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fdda37fe700 1 -- 172.21.15.43:0/3682234917 <== mds.0 v2:172.21.15.43:6835/497941784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55878ea38920 con 0x55878eb39450 2023-08-27T11:25:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fdda37fe700 10 client.6357 handle_command_reply: tid=0 2023-08-27T11:25:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 client.6357 shutdown 2023-08-27T11:25:37.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 msgr2=0x55878eb10280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fddb400baf0 tx=0x7fddb000f000 comp rx=0 tx=0).stop 2023-08-27T11:25:37.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 shutdown_connections 2023-08-27T11:25:37.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb39450 0x55878eb39830 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eb2dc10 0x55878eb3c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae8f00 0x55878eb12120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 --2- 172.21.15.43:0/3682234917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eb10280 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fdda37fe700 0 client.6357 ms_handle_reset on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 >> 172.21.15.43:0/3682234917 conn(0x55878ea4bc30 msgr2=0x55878eae6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 shutdown_connections 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.566+0000 7fddde893b80 1 -- 172.21.15.43:0/3682234917 wait complete. 2023-08-27T11:25:37.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.567+0000 7fddde893b80 20 client.6357 trim_cache size 0 max 16384 2023-08-27T11:25:37.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.585+0000 7fddde893b80 1 Processor -- start 2023-08-27T11:25:37.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.585+0000 7fddde893b80 1 -- start start 2023-08-27T11:25:37.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb39a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eb2dc10 0x55878eae70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878eaca560 con 0x55878eae92e0 2023-08-27T11:25:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878eaec460 con 0x55878eb2dc10 2023-08-27T11:25:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55878ea38920 con 0x55878eae8f00 2023-08-27T11:25:37.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38658/0 (socket says 172.21.15.43:38658) 2023-08-27T11:25:37.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 -- 172.21.15.43:0/1172371228 learned_addr learned my addr 172.21.15.43:0/1172371228 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb39a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc959c700 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eb2dc10 0x55878eae70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 -- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 msgr2=0x55878eb39a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb39a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 -- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eb2dc10 msgr2=0x55878eae70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eb2dc10 0x55878eae70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.586+0000 7fddc3fff700 1 -- 172.21.15.43:0/1172371228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55878eae9b60 con 0x55878eae92e0 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddc3fff700 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000f90 tx=0x7fddb002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed26943b4b1b1ee server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddaeffd700 1 -- 172.21.15.43:0/1172371228 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0007670 con 0x55878eae92e0 2023-08-27T11:25:37.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddaeffd700 1 -- 172.21.15.43:0/1172371228 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb00077d0 con 0x55878eae92e0 2023-08-27T11:25:37.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddaeffd700 1 -- 172.21.15.43:0/1172371228 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003880 con 0x55878eae92e0 2023-08-27T11:25:37.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddde893b80 1 -- 172.21.15.43:0/1172371228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 msgr2=0x55878eae6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddde893b80 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000f90 tx=0x7fddb002b000 comp rx=0 tx=0).stop 2023-08-27T11:25:37.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.587+0000 7fddde893b80 1 -- 172.21.15.43:0/1172371228 shutdown_connections 2023-08-27T11:25:37.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eb2dc10 0x55878eae70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb39a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 --2- 172.21.15.43:0/1172371228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eae92e0 0x55878eae6b60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 -- 172.21.15.43:0/1172371228 >> 172.21.15.43:0/1172371228 conn(0x55878ea4bc30 msgr2=0x55878eb4c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 -- 172.21.15.43:0/1172371228 shutdown_connections 2023-08-27T11:25:37.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 -- 172.21.15.43:0/1172371228 wait complete. 2023-08-27T11:25:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 -- start start 2023-08-27T11:25:37.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.588+0000 7fddde893b80 1 Processor -- start 2023-08-27T11:25:37.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb2cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae92e0 0x55878eb09e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878eb2d500 con 0x55878eb2dc10 2023-08-27T11:25:37.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55878eae6c00 con 0x55878eae92e0 2023-08-27T11:25:37.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55878eb2d070 con 0x55878eae8f00 2023-08-27T11:25:37.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.589+0000 7fddde893b80 10 client.0 _ll_register_callbacks cb 0x55878e9db630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:37.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38674/0 (socket says 172.21.15.43:38674) 2023-08-27T11:25:37.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 -- 172.21.15.43:0/1904071221 learned_addr learned my addr 172.21.15.43:0/1904071221 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb2cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc3fff700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae92e0 0x55878eb09e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 -- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 msgr2=0x55878eb2cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb2cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 -- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae92e0 msgr2=0x55878eb09e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae92e0 0x55878eb09e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 -- 172.21.15.43:0/1904071221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55878ea57750 con 0x55878eb2dc10 2023-08-27T11:25:37.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fddc959c700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fddbc019000 tx=0x7fddbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e528646f69159247 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.590+0000 7fdda37fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc026040 con 0x55878eb2dc10 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddbc01f860 con 0x55878eb2dc10 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddbc00f040 con 0x55878eb2dc10 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddbc00e040 con 0x55878eb2dc10 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 10 client.6363 fetch_fsmap learned FSMap version 58 2023-08-27T11:25:37.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55878e86bd90 con 0x55878eb2dc10 2023-08-27T11:25:37.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00f040 con 0x55878eb2dc10 2023-08-27T11:25:37.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fddbc01fa20 con 0x55878eb2dc10 2023-08-27T11:25:37.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 10 client.6363 fetch_fsmap finished waiting for FSMap version 58 2023-08-27T11:25:37.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 10 client.6363 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:25:37.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 20 client.6363 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:37.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb8dbf0 0x55878eb10960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 4 client.6363 mds_command: new command op to 6195 tid=0[{"prefix": "status"}] 2023-08-27T11:25:37.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 --> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55878e9f9000 con 0x55878eb8dbf0 2023-08-27T11:25:37.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.591+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb8dbf0 0x55878eb10960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fdda37fe700 10 client.6363 ms_handle_connect on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:37.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddc8d9b700 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb8dbf0 0x55878eb10960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304503fec4ff5986 server_cookie=8c61089ebb77f4da in_seq=0 out_seq=0 2023-08-27T11:25:37.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fdda37fe700 1 -- 172.21.15.43:0/1904071221 <== mds.0 v2:172.21.15.43:6835/497941784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55878e9f9000 con 0x55878eb8dbf0 2023-08-27T11:25:37.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fdda37fe700 10 client.6363 handle_command_reply: tid=0 2023-08-27T11:25:37.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 client.6363 shutdown 2023-08-27T11:25:37.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 msgr2=0x55878eb39e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fddbc019000 tx=0x7fddbc016000 comp rx=0 tx=0).stop 2023-08-27T11:25:37.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 shutdown_connections 2023-08-27T11:25:37.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55878eb8dbf0 0x55878eb10960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55878eb2dc10 0x55878eb39e40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55878eae8f00 0x55878eb2cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fdda37fe700 0 client.6363 ms_handle_reset on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 --2- 172.21.15.43:0/1904071221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55878eae92e0 0x55878eb09e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.592+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 >> 172.21.15.43:0/1904071221 conn(0x55878ea4bc30 msgr2=0x55878eb27480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 shutdown_connections 2023-08-27T11:25:37.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddde893b80 1 -- 172.21.15.43:0/1904071221 wait complete. 2023-08-27T11:25:37.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddde893b80 20 client.6363 trim_cache size 0 max 16384 2023-08-27T11:25:37.609 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:25:37.609 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:25:37.610 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:25:37.610 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6195, 2023-08-27T11:25:37.610 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:25:37.610 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:25:37.610 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 11.69526173, 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 58, 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 68, 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 68, 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.625586758000001 2023-08-27T11:25:37.611 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:25:37.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 msgr2=0x7fdda806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 0x7fdda806c5a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fddb0000c00 tx=0x7fddb0005040 comp rx=0 tx=0).stop 2023-08-27T11:25:37.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 msgr2=0x7fddc41e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fddb8007090 tx=0x7fddb8007450 comp rx=0 tx=0).stop 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 shutdown_connections 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdda806a0e0 0x7fdda806c5a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc41537f0 0x7fddc4153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fddb4003f70 0x7fddc41e9f40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 --2- 172.21.15.43:0/3940078439 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc414dc30 0x7fddc414d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 >> 172.21.15.43:0/3940078439 conn(0x7fddc40ab820 msgr2=0x7fddc414a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 shutdown_connections 2023-08-27T11:25:37.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.593+0000 7fddcafff700 1 -- 172.21.15.43:0/3940078439 wait complete. 2023-08-27T11:25:37.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:37.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.816+0000 7f099f7ff700 1 Processor -- start 2023-08-27T11:25:37.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.817+0000 7f099f7ff700 1 -- start start 2023-08-27T11:25:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09980c51a0 0x7f099806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f099806ca60 0x7f09980aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980ab040 0x7f0998155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09981530b0 con 0x7f099806ca60 2023-08-27T11:25:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099814c860 con 0x7f09980c51a0 2023-08-27T11:25:37.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099806d700 con 0x7f09980ab040 2023-08-27T11:25:37.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099cd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f099806ca60 0x7f09980aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099cd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f099806ca60 0x7f09980aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38684/0 (socket says 172.21.15.43:38684) 2023-08-27T11:25:37.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099cd9a700 1 -- 172.21.15.43:0/1141335485 learned_addr learned my addr 172.21.15.43:0/1141335485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099dd9c700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980ab040 0x7f0998155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.818+0000 7f099d59b700 1 --2- 172.21.15.43:0/1141335485 >> v2:172.21.15.57:3300/0 conn(0x7f09980c51a0 0x7f099806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 -- 172.21.15.43:0/1141335485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980ab040 msgr2=0x7f0998155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980ab040 0x7f0998155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 -- 172.21.15.43:0/1141335485 >> v2:172.21.15.57:3300/0 conn(0x7f09980c51a0 msgr2=0x7f099806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1141335485 >> v2:172.21.15.57:3300/0 conn(0x7f09980c51a0 0x7f099806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 -- 172.21.15.43:0/1141335485 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998152430 con 0x7f099806ca60 2023-08-27T11:25:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f099806ca60 0x7f09980aab00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f099806db90 tx=0x7f0988009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8029d27c752b09 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f098ffff700 1 -- 172.21.15.43:0/1141335485 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800b9e0 con 0x7f099806ca60 2023-08-27T11:25:37.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f098ffff700 1 -- 172.21.15.43:0/1141335485 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800bb40 con 0x7f099806ca60 2023-08-27T11:25:37.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.819+0000 7f098ffff700 1 -- 172.21.15.43:0/1141335485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988009e70 con 0x7f099806ca60 2023-08-27T11:25:37.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 -- 172.21.15.43:0/1141335485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f099806ca60 msgr2=0x7f09980aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f099806ca60 0x7f09980aab00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f099806db90 tx=0x7f0988009c30 comp rx=0 tx=0).stop 2023-08-27T11:25:37.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 -- 172.21.15.43:0/1141335485 shutdown_connections 2023-08-27T11:25:37.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980ab040 0x7f0998155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1141335485 >> v2:172.21.15.57:3300/0 conn(0x7f09980c51a0 0x7f099806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1141335485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f099806ca60 0x7f09980aab00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 -- 172.21.15.43:0/1141335485 >> 172.21.15.43:0/1141335485 conn(0x7f099806aa50 msgr2=0x7f09980c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:37.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 -- 172.21.15.43:0/1141335485 shutdown_connections 2023-08-27T11:25:37.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.820+0000 7f099f7ff700 1 -- 172.21.15.43:0/1141335485 wait complete. 2023-08-27T11:25:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.822+0000 7f099f7ff700 1 Processor -- start 2023-08-27T11:25:37.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.822+0000 7f099f7ff700 1 -- start start 2023-08-27T11:25:37.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.822+0000 7f099f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099806ca60 0x7f09980a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 0x7f09981482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981544f0 con 0x7f09980ab040 2023-08-27T11:25:37.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099806f580 con 0x7f099806ca60 2023-08-27T11:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099806f820 con 0x7f09980c51a0 2023-08-27T11:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38686/0 (socket says 172.21.15.43:38686) 2023-08-27T11:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 -- 172.21.15.43:0/1656055778 learned_addr learned my addr 172.21.15.43:0/1656055778 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:37.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099d59b700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099806ca60 0x7f09980a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099dd9c700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 0x7f09981482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 -- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 msgr2=0x7f09981482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 0x7f09981482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 -- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099806ca60 msgr2=0x7f09980a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:37.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099806ca60 0x7f09980a69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:37.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099cd9a700 1 -- 172.21.15.43:0/1656055778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009550 con 0x7f09980ab040 2023-08-27T11:25:37.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.823+0000 7f099dd9c700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 0x7f09981482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:37.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f099cd9a700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0988009c70 tx=0x7f0988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988004380 con 0x7f09980ab040 2023-08-27T11:25:37.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098801f070 con 0x7f09980ab040 2023-08-27T11:25:37.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099806fb00 con 0x7f09980ab040 2023-08-27T11:25:37.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880036a0 con 0x7f09980ab040 2023-08-27T11:25:37.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.824+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0998154a20 con 0x7f09980ab040 2023-08-27T11:25:37.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.825+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0998154c10 con 0x7f09980ab040 2023-08-27T11:25:37.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.826+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0988021030 con 0x7f09980ab040 2023-08-27T11:25:37.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.827+0000 7f098dffb700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:37.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.828+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09880899d0 con 0x7f09980ab040 2023-08-27T11:25:37.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.828+0000 7f099d59b700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:37.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.828+0000 7f099d59b700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0994006b20 tx=0x7f0994008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:37.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:37.832+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0988055150 con 0x7f09980ab040 2023-08-27T11:25:38.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.090+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f099806fc90 con 0x7f09980ab040 2023-08-27T11:25:38.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.090+0000 7f098dffb700 1 -- 172.21.15.43:0/1656055778 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4871 (secure 0 0 0) 0x7f0988058770 con 0x7f09980ab040 2023-08-27T11:25:38.092 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:38.092 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:28.924409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/497941784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":497941784},{"type":"v1","addr":"172.21.15.43:6837","nonce":497941784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:38.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.092+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 msgr2=0x7f097c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.092+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0994006b20 tx=0x7f0994008040 comp rx=0 tx=0).stop 2023-08-27T11:25:38.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.092+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 msgr2=0x7f0998147d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.092+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0988009c70 tx=0x7f0988004750 comp rx=0 tx=0).stop 2023-08-27T11:25:38.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 shutdown_connections 2023-08-27T11:25:38.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09980c51a0 0x7f09981482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099806ca60 0x7f09980a69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 --2- 172.21.15.43:0/1656055778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09980ab040 0x7f0998147d90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 >> 172.21.15.43:0/1656055778 conn(0x7f099806aa50 msgr2=0x7f099814bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:38.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 shutdown_connections 2023-08-27T11:25:38.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.093+0000 7f099f7ff700 1 -- 172.21.15.43:0/1656055778 wait complete. 2023-08-27T11:25:38.097 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2023-08-27T11:25:38.113 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 5, "epoch": 58, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 5, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:25:25.420723+0000", "damaged": [], "data_pools": [ 12 ], "enabled": true, "epoch": 58, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6195": { "addr": "172.21.15.43:6837/497941784", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 497941784, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 497941784, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6195, "incarnation": 54, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 11, "modified": "2023-08-27T11:25:28.924409+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6195 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/2049507141", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2049507141, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2049507141, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 53, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5534, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/229501658", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 229501658, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 229501658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 53, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5968, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/2813047028", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 2813047028, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 2813047028, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 52, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6192, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:25:38.113 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:25:38.114 INFO:tasks.cephfs.test_failover:current = [{'gid': 6192, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/2813047028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 2813047028}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 2813047028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 52}, {'gid': 5968, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/229501658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 229501658}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 229501658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 53}, {'gid': 6195, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/497941784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 497941784}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 497941784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5534, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2049507141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2049507141}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2049507141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 53}] 2023-08-27T11:25:38.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.d mds_join_fs cephfs 2023-08-27T11:25:38.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.317+0000 7f07691ff700 1 Processor -- start 2023-08-27T11:25:38.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.318+0000 7f07691ff700 1 -- start start 2023-08-27T11:25:38.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f07691ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0764151b70 0x7f07641550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f07691ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640c6040 con 0x7f07640c4780 2023-08-27T11:25:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f07691ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640c7d00 con 0x7f07640c9720 2023-08-27T11:25:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f07691ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640c8510 con 0x7f0764151b70 2023-08-27T11:25:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f0762d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0764151b70 0x7f07641550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f076259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f07640c4780 0x7f07640c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41526/0 (socket says 172.21.15.43:41526) 2023-08-27T11:25:38.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f076259c700 1 -- 172.21.15.43:0/2148344287 learned_addr learned my addr 172.21.15.43:0/2148344287 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f0762d9d700 1 -- 172.21.15.43:0/2148344287 >> v1:172.21.15.57:6789/0 conn(0x7f07640c9720 legacy=0x7f076415efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.319+0000 7f0762d9d700 1 -- 172.21.15.43:0/2148344287 >> v1:172.21.15.43:6789/0 conn(0x7f07640c4780 legacy=0x7f07640c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0762d9d700 1 -- 172.21.15.43:0/2148344287 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640c8b80 con 0x7f0764151b70 2023-08-27T11:25:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0761d9b700 1 -- 172.21.15.43:0/2148344287 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211339636 0 0) 0x7f07640c6040 con 0x7f07640c4780 2023-08-27T11:25:38.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0762d9d700 1 --2- 172.21.15.43:0/2148344287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0764151b70 0x7f07641550a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0754009840 tx=0x7f0754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6802aac46e299d3c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0761d9b700 1 -- 172.21.15.43:0/2148344287 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011830 con 0x7f0764151b70 2023-08-27T11:25:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0761d9b700 1 -- 172.21.15.43:0/2148344287 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754011990 con 0x7f0764151b70 2023-08-27T11:25:38.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f0761d9b700 1 -- 172.21.15.43:0/2148344287 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011d20 con 0x7f0764151b70 2023-08-27T11:25:38.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f07691ff700 1 -- 172.21.15.43:0/2148344287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0764151b70 msgr2=0x7f07641550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.320+0000 7f07691ff700 1 --2- 172.21.15.43:0/2148344287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0764151b70 0x7f07641550a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0754009840 tx=0x7f0754009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:38.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.321+0000 7f07691ff700 1 -- 172.21.15.43:0/2148344287 shutdown_connections 2023-08-27T11:25:38.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.321+0000 7f07691ff700 1 --2- 172.21.15.43:0/2148344287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0764151b70 0x7f07641550a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.321+0000 7f07691ff700 1 -- 172.21.15.43:0/2148344287 >> 172.21.15.43:0/2148344287 conn(0x7f07640ab8f0 msgr2=0x7f07640abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:38.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.321+0000 7f07691ff700 1 -- 172.21.15.43:0/2148344287 shutdown_connections 2023-08-27T11:25:38.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.321+0000 7f07691ff700 1 -- 172.21.15.43:0/2148344287 wait complete. 2023-08-27T11:25:38.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.323+0000 7f07691ff700 1 Processor -- start 2023-08-27T11:25:38.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.323+0000 7f07691ff700 1 -- start start 2023-08-27T11:25:38.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07640c4780 0x7f07641ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0764151b70 0x7f0764155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07641edb10 con 0x7f07640c9720 2023-08-27T11:25:38.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c0240 con 0x7f0764151b70 2023-08-27T11:25:38.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.324+0000 7f07691ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640afd10 con 0x7f07640c4780 2023-08-27T11:25:38.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38702/0 (socket says 172.21.15.43:38702) 2023-08-27T11:25:38.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 -- 172.21.15.43:0/1783300707 learned_addr learned my addr 172.21.15.43:0/1783300707 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:38.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f0762d9d700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07640c4780 0x7f07641ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076359e700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0764151b70 0x7f0764155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 -- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07640c4780 msgr2=0x7f07641ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07640c4780 0x7f07641ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 -- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0764151b70 msgr2=0x7f0764155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0764151b70 0x7f0764155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 -- 172.21.15.43:0/1783300707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540094a0 con 0x7f07640c9720 2023-08-27T11:25:38.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.325+0000 7f076259c700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f075800c520 tx=0x7f075800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.326+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758004c80 con 0x7f07640c9720 2023-08-27T11:25:38.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.326+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0758004e00 con 0x7f07640c9720 2023-08-27T11:25:38.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.326+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758007310 con 0x7f07640c9720 2023-08-27T11:25:38.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.326+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07641ed830 con 0x7f07640c9720 2023-08-27T11:25:38.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.326+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640bfed0 con 0x7f07640c9720 2023-08-27T11:25:38.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.327+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076404ee70 con 0x7f07640c9720 2023-08-27T11:25:38.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.328+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0758007470 con 0x7f07640c9720 2023-08-27T11:25:38.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.329+0000 7f074b7fe700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 0x7f075006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.329+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0758088120 con 0x7f07640c9720 2023-08-27T11:25:38.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.329+0000 7f0762d9d700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 0x7f075006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.330+0000 7f0762d9d700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 0x7f075006c5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f07540090b0 tx=0x7f075401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.333+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0758053800 con 0x7f07640c9720 2023-08-27T11:25:38.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.545+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f07640ac4a0 con 0x7f07640c9720 2023-08-27T11:25:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.549+0000 7f074b7fe700 1 -- 172.21.15.43:0/1783300707 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v24)=0 v24) v1 ==== 116+0+0 (secure 0 0 0) 0x7f0758056e20 con 0x7f07640c9720 2023-08-27T11:25:38.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.551+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 msgr2=0x7f075006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.551+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 0x7f075006c5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f07540090b0 tx=0x7f075401c040 comp rx=0 tx=0).stop 2023-08-27T11:25:38.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.551+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 msgr2=0x7f0764155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.551+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f075800c520 tx=0x7f075800c830 comp rx=0 tx=0).stop 2023-08-27T11:25:38.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 shutdown_connections 2023-08-27T11:25:38.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f075006a110 0x7f075006c5d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0764151b70 0x7f0764155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07640c4780 0x7f07641ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 --2- 172.21.15.43:0/1783300707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f07640c9720 0x7f0764155ab0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 >> 172.21.15.43:0/1783300707 conn(0x7f07640ab8f0 msgr2=0x7f076406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:38.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 shutdown_connections 2023-08-27T11:25:38.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.552+0000 7f07691ff700 1 -- 172.21.15.43:0/1783300707 wait complete. 2023-08-27T11:25:38.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.771+0000 7fe3a9dff700 1 Processor -- start 2023-08-27T11:25:38.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.771+0000 7fe3a9dff700 1 -- start start 2023-08-27T11:25:38.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a9dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3a40c51a0 0x7fe3a40c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a9dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40c5ae0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a9dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40c1190 con 0x7fe3a4151910 2023-08-27T11:25:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a9dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a4072900 con 0x7fe3a40c51a0 2023-08-27T11:25:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe3a40c15e0 0x7fe3a415ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41536/0 (socket says 172.21.15.43:41536) 2023-08-27T11:25:38.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a3fff700 1 -- 172.21.15.43:0/2604101092 learned_addr learned my addr 172.21.15.43:0/2604101092 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:38.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.772+0000 7fe3a2ffd700 1 --2- 172.21.15.43:0/2604101092 >> v2:172.21.15.57:3300/0 conn(0x7fe3a40c51a0 0x7fe3a40c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910410051 0 0) 0x7fe3a40c5ae0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe38c0035b0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486826381 0 0) 0x7fe3a40c1190 con 0x7fe3a4151910 2023-08-27T11:25:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a40c5ae0 con 0x7fe3a4151910 2023-08-27T11:25:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a2ffd700 1 -- 172.21.15.43:0/2604101092 >> v1:172.21.15.57:6789/0 conn(0x7fe3a4151910 legacy=0x7fe3a4157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a2ffd700 1 -- 172.21.15.43:0/2604101092 >> v1:172.21.15.43:6789/0 conn(0x7fe3a40c15e0 legacy=0x7fe3a415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a2ffd700 1 -- 172.21.15.43:0/2604101092 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40c6c00 con 0x7fe3a40c51a0 2023-08-27T11:25:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.773+0000 7fe3a2ffd700 1 --2- 172.21.15.43:0/2604101092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a40c51a0 0x7fe3a40c5f70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe398009840 tx=0x7fe398009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4dfb58d6294fc30 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011830 con 0x7fe3a40c51a0 2023-08-27T11:25:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398011990 con 0x7fe3a40c51a0 2023-08-27T11:25:38.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a27fc700 1 -- 172.21.15.43:0/2604101092 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011d20 con 0x7fe3a40c51a0 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2604101092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a40c51a0 msgr2=0x7fe3a40c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2604101092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a40c51a0 0x7fe3a40c5f70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe398009840 tx=0x7fe398009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2604101092 shutdown_connections 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2604101092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a40c51a0 0x7fe3a40c5f70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2604101092 >> 172.21.15.43:0/2604101092 conn(0x7fe3a40a9740 msgr2=0x7fe3a40a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:38.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2604101092 shutdown_connections 2023-08-27T11:25:38.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.774+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2604101092 wait complete. 2023-08-27T11:25:38.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.776+0000 7fe3a9dff700 1 Processor -- start 2023-08-27T11:25:38.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.776+0000 7fe3a9dff700 1 -- start start 2023-08-27T11:25:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3a40c51a0 0x7fe3a41de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a4151910 0x7fe3a41dee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a406d3f0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a406d9b0 con 0x7fe3a4151910 2023-08-27T11:25:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a9dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a41ee230 con 0x7fe3a40c51a0 2023-08-27T11:25:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38718/0 (socket says 172.21.15.43:38718) 2023-08-27T11:25:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.777+0000 7fe3a37fe700 1 -- 172.21.15.43:0/2299146145 learned_addr learned my addr 172.21.15.43:0/2299146145 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:38.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a2ffd700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3a40c51a0 0x7fe3a41de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a3fff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a4151910 0x7fe3a41dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 -- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3a40c51a0 msgr2=0x7fe3a41de8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3a40c51a0 0x7fe3a41de8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 -- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a4151910 msgr2=0x7fe3a41dee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:38.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a4151910 0x7fe3a41dee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 -- 172.21.15.43:0/2299146145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980094a0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.778+0000 7fe3a37fe700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c520 tx=0x7fe39400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.779+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940052d0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.779+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394005430 con 0x7fe3a40c15e0 2023-08-27T11:25:38.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.779+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940038c0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.779+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a41ee4d0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.779+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a41edf30 con 0x7fe3a40c15e0 2023-08-27T11:25:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.780+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a4074680 con 0x7fe3a40c15e0 2023-08-27T11:25:38.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.781+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe394003a20 con 0x7fe3a40c15e0 2023-08-27T11:25:38.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.782+0000 7fe38bfff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 0x7fe39006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:38.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.782+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3940879a0 con 0x7fe3a40c15e0 2023-08-27T11:25:38.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.782+0000 7fe3a2ffd700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 0x7fe39006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:38.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.783+0000 7fe3a2ffd700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 0x7fe39006c5a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe398009fd0 tx=0x7fe39801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:38.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:38.786+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe394053080 con 0x7fe3a40c15e0 2023-08-27T11:25:39.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.040+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a40a8b80 con 0x7fe3a40c15e0 2023-08-27T11:25:39.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.041+0000 7fe38bfff700 1 -- 172.21.15.43:0/2299146145 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4871 (secure 0 0 0) 0x7fe3940566a0 con 0x7fe3a40c15e0 2023-08-27T11:25:39.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:39.043 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":58,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5534,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:28.924409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6195":{"gid":6195,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/497941784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":497941784},{"type":"v1","addr":"172.21.15.43:6837","nonce":497941784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:39.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 msgr2=0x7fe39006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 0x7fe39006c5a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe398009fd0 tx=0x7fe39801c040 comp rx=0 tx=0).stop 2023-08-27T11:25:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 msgr2=0x7fe3a41ed9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe39400c520 tx=0x7fe39400c830 comp rx=0 tx=0).stop 2023-08-27T11:25:39.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 shutdown_connections 2023-08-27T11:25:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe39006a0e0 0x7fe39006c5a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3a4151910 0x7fe3a41dee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3a40c15e0 0x7fe3a41ed9f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 --2- 172.21.15.43:0/2299146145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3a40c51a0 0x7fe3a41de8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 >> 172.21.15.43:0/2299146145 conn(0x7fe3a40a9740 msgr2=0x7fe3a40c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 shutdown_connections 2023-08-27T11:25:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.044+0000 7fe3a9dff700 1 -- 172.21.15.43:0/2299146145 wait complete. 2023-08-27T11:25:39.048 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 58 2023-08-27T11:25:39.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:25:25.420723+0000', 'modified': '2023-08-27T11:25:28.924409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6195}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6195': {'gid': 6195, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/497941784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 497941784}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 497941784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:25:39.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:25:39.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:25:39.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.670+0000 7f4e23dff700 1 Processor -- start 2023-08-27T11:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.670+0000 7f4e23dff700 1 -- start start 2023-08-27T11:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e23dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c151a90 0x7f4e1c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e23dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e1c0c4a90 0x7f4e1c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e23dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1c06c4e0 con 0x7f4e1c0c4630 2023-08-27T11:25:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e23dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1c155370 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e23dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c151e70 con 0x7f4e1c151a90 2023-08-27T11:25:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e2239c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e1c0c4a90 0x7f4e1c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e2239c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e1c0c4a90 0x7f4e1c06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39074/0 (socket says 172.21.15.43:39074) 2023-08-27T11:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.671+0000 7f4e2239c700 1 -- 172.21.15.43:0/676735678 learned_addr learned my addr 172.21.15.43:0/676735678 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c151a90 0x7f4e1c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e2239c700 1 -- 172.21.15.43:0/676735678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c151a90 msgr2=0x7f4e1c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e2239c700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c151a90 0x7f4e1c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e2239c700 1 -- 172.21.15.43:0/676735678 >> v1:172.21.15.57:6789/0 conn(0x7f4e1c0c4630 legacy=0x7f4e1c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e2239c700 1 -- 172.21.15.43:0/676735678 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c154480 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e2239c700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4a90 0x7f4e1c06b480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009e50 tx=0x7f4e1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe92f44a49bcd7b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e20b99700 1 -- 172.21.15.43:0/676735678 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400e070 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e20b99700 1 -- 172.21.15.43:0/676735678 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1400b910 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.672+0000 7f4e20b99700 1 -- 172.21.15.43:0/676735678 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400bcc0 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 -- 172.21.15.43:0/676735678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4a90 msgr2=0x7f4e1c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4a90 0x7f4e1c06b480 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009e50 tx=0x7f4e1400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 -- 172.21.15.43:0/676735678 shutdown_connections 2023-08-27T11:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4a90 0x7f4e1c06b480 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 --2- 172.21.15.43:0/676735678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c151a90 0x7f4e1c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 -- 172.21.15.43:0/676735678 >> 172.21.15.43:0/676735678 conn(0x7f4e1c0ab820 msgr2=0x7f4e1c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 -- 172.21.15.43:0/676735678 shutdown_connections 2023-08-27T11:25:39.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.673+0000 7f4e23dff700 1 -- 172.21.15.43:0/676735678 wait complete. 2023-08-27T11:25:39.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.675+0000 7f4e23dff700 1 Processor -- start 2023-08-27T11:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.676+0000 7f4e23dff700 1 -- start start 2023-08-27T11:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 0x7f4e1c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 0x7f4e1c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c158560 con 0x7f4e1c0c4630 2023-08-27T11:25:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c158280 con 0x7f4e1c151a90 2023-08-27T11:25:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e23dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1c0aa500 con 0x7f4e1c0c4a90 2023-08-27T11:25:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39084/0 (socket says 172.21.15.43:39084) 2023-08-27T11:25:39.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e21b9b700 1 -- 172.21.15.43:0/641322230 learned_addr learned my addr 172.21.15.43:0/641322230 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.677+0000 7f4e2139a700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 0x7f4e1c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e2239c700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 0x7f4e1c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 -- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 msgr2=0x7f4e1c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 0x7f4e1c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 -- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 msgr2=0x7f4e1c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 0x7f4e1c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 -- 172.21.15.43:0/641322230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009b30 con 0x7f4e1c0c4630 2023-08-27T11:25:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e2239c700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 0x7f4e1c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e2139a700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 0x7f4e1c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:39.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800e870 tx=0x7f4e1800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e127fc700 1 -- 172.21.15.43:0/641322230 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18009590 con 0x7f4e1c0c4630 2023-08-27T11:25:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e127fc700 1 -- 172.21.15.43:0/641322230 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800ee70 con 0x7f4e1c0c4630 2023-08-27T11:25:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e127fc700 1 -- 172.21.15.43:0/641322230 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800ca50 con 0x7f4e1c0c4630 2023-08-27T11:25:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1c0aa7e0 con 0x7f4e1c0c4630 2023-08-27T11:25:39.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.678+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c157f10 con 0x7f4e1c0c4630 2023-08-27T11:25:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.680+0000 7f4e127fc700 1 -- 172.21.15.43:0/641322230 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e1800cbb0 con 0x7f4e1c0c4630 2023-08-27T11:25:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.681+0000 7f4e127fc700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 0x7f4e0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.681+0000 7f4e127fc700 1 -- 172.21.15.43:0/641322230 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e18088630 con 0x7f4e1c0c4630 2023-08-27T11:25:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.682+0000 7f4e2139a700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 0x7f4e0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.682+0000 7f4e2139a700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 0x7f4e0006c5a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c14e9f0 tx=0x7f4e0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.683+0000 7f4e37662b80 1 Processor -- start 2023-08-27T11:25:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.684+0000 7f4e37662b80 1 -- start start 2023-08-27T11:25:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 0x55dc62885d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc6289b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc627c0730 con 0x55dc62868fe0 2023-08-27T11:25:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc627be050 con 0x55dc628632e0 2023-08-27T11:25:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc627b9940 con 0x55dc62862f00 2023-08-27T11:25:39.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e2139a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e2139a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39086/0 (socket says 172.21.15.43:39086) 2023-08-27T11:25:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e2139a700 1 -- 172.21.15.43:0/3150233190 learned_addr learned my addr 172.21.15.43:0/3150233190 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 0x55dc62885d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.685+0000 7f4e2239c700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc6289b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 -- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 msgr2=0x55dc62885d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 0x55dc62885d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 -- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 msgr2=0x55dc6289b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc6289b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 -- 172.21.15.43:0/3150233190 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc626395e0 con 0x55dc62868fe0 2023-08-27T11:25:39.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 0x55dc62885d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4e2139a700 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0146c0 tx=0x7f4e0c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9497ac5e110e5122 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4dff7fe700 1 -- 172.21.15.43:0/3150233190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0127e0 con 0x55dc62868fe0 2023-08-27T11:25:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4dff7fe700 1 -- 172.21.15.43:0/3150233190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c012940 con 0x55dc62868fe0 2023-08-27T11:25:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.686+0000 7f4dff7fe700 1 -- 172.21.15.43:0/3150233190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c012cd0 con 0x55dc62868fe0 2023-08-27T11:25:39.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 -- 172.21.15.43:0/3150233190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 msgr2=0x55dc628862b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0146c0 tx=0x7f4e0c010000 comp rx=0 tx=0).stop 2023-08-27T11:25:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 -- 172.21.15.43:0/3150233190 shutdown_connections 2023-08-27T11:25:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc6289b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc62862f00 0x55dc62885d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3150233190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62868fe0 0x55dc628862b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 -- 172.21.15.43:0/3150233190 >> 172.21.15.43:0/3150233190 conn(0x55dc627c5c30 msgr2=0x55dc628656e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 -- 172.21.15.43:0/3150233190 shutdown_connections 2023-08-27T11:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.687+0000 7f4e37662b80 1 -- 172.21.15.43:0/3150233190 wait complete. 2023-08-27T11:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.688+0000 7f4e37662b80 1 -- start start 2023-08-27T11:25:39.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.688+0000 7f4e37662b80 1 Processor -- start 2023-08-27T11:25:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc628632e0 0x55dc628a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 0x55dc628a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc62757b60 con 0x55dc62862f00 2023-08-27T11:25:39.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc62757860 con 0x55dc6288a7a0 2023-08-27T11:25:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc6263b8d0 con 0x55dc628632e0 2023-08-27T11:25:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e37662b80 10 client.0 _ll_register_callbacks cb 0x55dc62755630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39096/0 (socket says 172.21.15.43:39096) 2023-08-27T11:25:39.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 -- 172.21.15.43:0/4264484609 learned_addr learned my addr 172.21.15.43:0/4264484609 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e2239c700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 0x55dc628a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e2139a700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc628632e0 0x55dc628a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 -- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc628632e0 msgr2=0x55dc628a75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc628632e0 0x55dc628a75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 -- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 msgr2=0x55dc628a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 0x55dc628a58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e21b9b700 1 -- 172.21.15.43:0/4264484609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1c06c4e0 con 0x55dc62862f00 2023-08-27T11:25:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.689+0000 7f4e2239c700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 0x55dc628a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c430 tx=0x7f4e1805f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461119b20118d1ec server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:39.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18053730 con 0x55dc62862f00 2023-08-27T11:25:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e18053890 con 0x55dc62862f00 2023-08-27T11:25:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc6285a4f0 con 0x55dc62862f00 2023-08-27T11:25:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e18053a50 con 0x55dc62862f00 2023-08-27T11:25:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 10 client.6396 fetch_fsmap learned FSMap version 58 2023-08-27T11:25:39.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55dc627d1750 con 0x55dc62862f00 2023-08-27T11:25:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc6285a4f0 con 0x55dc62862f00 2023-08-27T11:25:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4e1805b170 con 0x55dc62862f00 2023-08-27T11:25:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 10 client.6396 fetch_fsmap finished waiting for FSMap version 58 2023-08-27T11:25:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 10 client.6396 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:25:39.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.690+0000 7f4e37662b80 20 client.6396 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc628a6430 0x55dc6288b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4e37662b80 4 client.6396 mds_command: new command op to 6195 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 --> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc627b2920 con 0x55dc628a6430 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4e2139a700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc628a6430 0x55dc6288b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4e2139a700 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc628a6430 0x55dc6288b390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=165c1b6f18aa13ac server_cookie=45ed6014aec991c0 in_seq=0 out_seq=0 2023-08-27T11:25:39.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.691+0000 7f4dfcff9700 10 client.6396 ms_handle_connect on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4dfcff9700 1 -- 172.21.15.43:0/4264484609 <== mds.0 v2:172.21.15.43:6835/497941784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc627b2920 con 0x55dc628a6430 2023-08-27T11:25:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4dfcff9700 10 client.6396 handle_command_reply: tid=0 2023-08-27T11:25:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 client.6396 shutdown 2023-08-27T11:25:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 msgr2=0x55dc628b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c430 tx=0x7f4e1805f700 comp rx=0 tx=0).stop 2023-08-27T11:25:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 shutdown_connections 2023-08-27T11:25:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc628a6430 0x55dc6288b390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc6288a7a0 0x55dc628a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc628b6be0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 --2- 172.21.15.43:0/4264484609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc628632e0 0x55dc628a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4dfcff9700 0 client.6396 ms_handle_reset on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.692+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 >> 172.21.15.43:0/4264484609 conn(0x55dc627c5c30 msgr2=0x55dc62867160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.693+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 shutdown_connections 2023-08-27T11:25:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.693+0000 7f4e37662b80 1 -- 172.21.15.43:0/4264484609 wait complete. 2023-08-27T11:25:39.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.693+0000 7f4e37662b80 20 client.6396 trim_cache size 0 max 16384 2023-08-27T11:25:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.711+0000 7f4e37662b80 1 Processor -- start 2023-08-27T11:25:39.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.711+0000 7f4e37662b80 1 -- start start 2023-08-27T11:25:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc62867040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62867580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc62889dd0 con 0x55dc62862f00 2023-08-27T11:25:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc62868a40 con 0x55dc628632e0 2023-08-27T11:25:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc62864e20 con 0x55dc6288a7a0 2023-08-27T11:25:39.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39102/0 (socket says 172.21.15.43:39102) 2023-08-27T11:25:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 -- 172.21.15.43:0/1529844431 learned_addr learned my addr 172.21.15.43:0/1529844431 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e2239c700 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62867580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e2139a700 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc62867040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 -- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 msgr2=0x55dc62867580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62867580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 -- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 msgr2=0x55dc62867040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc62867040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.712+0000 7f4e21b9b700 1 -- 172.21.15.43:0/1529844431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc62861ec0 con 0x55dc62862f00 2023-08-27T11:25:39.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4e18057640 tx=0x7f4e1805d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cedac811c354b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4dfffff700 1 -- 172.21.15.43:0/1529844431 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18057710 con 0x55dc62862f00 2023-08-27T11:25:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4dfffff700 1 -- 172.21.15.43:0/1529844431 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1805b170 con 0x55dc62862f00 2023-08-27T11:25:39.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4dfffff700 1 -- 172.21.15.43:0/1529844431 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18053930 con 0x55dc62862f00 2023-08-27T11:25:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4e37662b80 1 -- 172.21.15.43:0/1529844431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 msgr2=0x55dc62866280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.713+0000 7f4e37662b80 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4e18057640 tx=0x7f4e1805d050 comp rx=0 tx=0).stop 2023-08-27T11:25:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 -- 172.21.15.43:0/1529844431 shutdown_connections 2023-08-27T11:25:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62867580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62866280 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 --2- 172.21.15.43:0/1529844431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc62867040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 -- 172.21.15.43:0/1529844431 >> 172.21.15.43:0/1529844431 conn(0x55dc627c5c30 msgr2=0x55dc6285e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 -- 172.21.15.43:0/1529844431 shutdown_connections 2023-08-27T11:25:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 -- 172.21.15.43:0/1529844431 wait complete. 2023-08-27T11:25:39.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 -- start start 2023-08-27T11:25:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.714+0000 7f4e37662b80 1 Processor -- start 2023-08-27T11:25:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc628850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62881fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc6287b880 con 0x55dc62862f00 2023-08-27T11:25:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc6287b610 con 0x55dc628632e0 2023-08-27T11:25:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc6287f730 con 0x55dc6288a7a0 2023-08-27T11:25:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.715+0000 7f4e37662b80 10 client.0 _ll_register_callbacks cb 0x55dc62755630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:39.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39112/0 (socket says 172.21.15.43:39112) 2023-08-27T11:25:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 -- 172.21.15.43:0/3088998377 learned_addr learned my addr 172.21.15.43:0/3088998377 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e2139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc628850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e2239c700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62881fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 -- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 msgr2=0x55dc62881fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62881fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 -- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 msgr2=0x55dc628850c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc628850c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 -- 172.21.15.43:0/3088998377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc627d1750 con 0x55dc62862f00 2023-08-27T11:25:39.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4e21b9b700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4e1805b8c0 tx=0x7f4e18086830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5488b9c2669762a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4dfcff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.716+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18056aa0 con 0x55dc62862f00 2023-08-27T11:25:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e18056c00 con 0x55dc62862f00 2023-08-27T11:25:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc628b6670 con 0x55dc62862f00 2023-08-27T11:25:39.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e1805b2e0 con 0x55dc62862f00 2023-08-27T11:25:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 10 client.6402 fetch_fsmap learned FSMap version 58 2023-08-27T11:25:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55dc625e5d90 con 0x55dc62862f00 2023-08-27T11:25:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dc628b6670 con 0x55dc62862f00 2023-08-27T11:25:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4e1807e070 con 0x55dc62862f00 2023-08-27T11:25:39.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 10 client.6402 fetch_fsmap finished waiting for FSMap version 58 2023-08-27T11:25:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 10 client.6402 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:25:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 20 client.6402 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc62885600 0x55dc628991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 4 client.6402 mds_command: new command op to 6195 tid=0[{"prefix": "status"}] 2023-08-27T11:25:39.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 --> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f4e0c012940 con 0x55dc62885600 2023-08-27T11:25:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.717+0000 7f4e2139a700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc62885600 0x55dc628991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e2139a700 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc62885600 0x55dc628991d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82d4baa12d00a748 server_cookie=97b170eba615cf5d in_seq=0 out_seq=0 2023-08-27T11:25:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4dfcff9700 10 client.6402 ms_handle_connect on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4dfcff9700 1 -- 172.21.15.43:0/3088998377 <== mds.0 v2:172.21.15.43:6835/497941784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f4e0c012940 con 0x55dc62885600 2023-08-27T11:25:39.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4dfcff9700 10 client.6402 handle_command_reply: tid=0 2023-08-27T11:25:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 client.6402 shutdown 2023-08-27T11:25:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 msgr2=0x55dc62908830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4e1805b8c0 tx=0x7f4e18086830 comp rx=0 tx=0).stop 2023-08-27T11:25:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 shutdown_connections 2023-08-27T11:25:39.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:6835/497941784,v1:172.21.15.43:6837/497941784] conn(0x55dc62885600 0x55dc628991d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dc6288a7a0 0x55dc62881fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dc62862f00 0x55dc62908830 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4dfcff9700 0 client.6402 ms_handle_reset on v2:172.21.15.43:6835/497941784 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 --2- 172.21.15.43:0/3088998377 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dc628632e0 0x55dc628850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 >> 172.21.15.43:0/3088998377 conn(0x55dc627c5c30 msgr2=0x55dc62866280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.718+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 shutdown_connections 2023-08-27T11:25:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e37662b80 1 -- 172.21.15.43:0/3088998377 wait complete. 2023-08-27T11:25:39.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e37662b80 20 client.6402 trim_cache size 0 max 16384 2023-08-27T11:25:39.735 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:25:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:25:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:25:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6195, 2023-08-27T11:25:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:25:39.736 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:25:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:25:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 13.821187992, 2023-08-27T11:25:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 58, 2023-08-27T11:25:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 68, 2023-08-27T11:25:39.737 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 68, 2023-08-27T11:25:39.738 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 20.751513000999999 2023-08-27T11:25:39.738 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:25:39.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 msgr2=0x7f4e0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 0x7f4e0006c5a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c14e9f0 tx=0x7f4e0c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:39.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 msgr2=0x7f4e1c0bfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:39.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800e870 tx=0x7f4e1800ec30 comp rx=0 tx=0).stop 2023-08-27T11:25:39.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 shutdown_connections 2023-08-27T11:25:39.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e0006a0e0 0x7f4e0006c5a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1c151a90 0x7f4e1c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e1c0c4630 0x7f4e1c0bfe50 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 --2- 172.21.15.43:0/641322230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e1c0c4a90 0x7f4e1c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 >> 172.21.15.43:0/641322230 conn(0x7f4e1c0ab820 msgr2=0x7f4e1c14ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.719+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 shutdown_connections 2023-08-27T11:25:39.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:39.720+0000 7f4e23dff700 1 -- 172.21.15.43:0/641322230 wait complete. 2023-08-27T11:25:39.742 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 5, "epoch": 58, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 5, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:25:25.420723+0000", "damaged": [], "data_pools": [ 12 ], "enabled": true, "epoch": 58, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6195": { "addr": "172.21.15.43:6837/497941784", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 497941784, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 497941784, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6195, "incarnation": 54, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 11, "modified": "2023-08-27T11:25:28.924409+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6195 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/2049507141", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2049507141, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2049507141, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 53, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5534, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/229501658", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 229501658, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 229501658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 53, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5968, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/2813047028", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 2813047028, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 2813047028, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 52, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6192, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:25:39.743 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': 5, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:25:39.743 INFO:tasks.cephfs.test_failover:current = [{'gid': 6192, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/2813047028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 2813047028}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 2813047028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 52}, {'gid': 5968, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/229501658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 229501658}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 229501658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 53}, {'gid': 6195, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/497941784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 497941784}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 497941784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 5534, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2049507141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2049507141}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2049507141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 53}] 2023-08-27T11:25:39.744 DEBUG:tasks.cephfs.test_failover:5 != -1 2023-08-27T11:25:39.744 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:25:39.980 INFO:tasks.ceph.mds.c.smithi043.stderr: -313> 2023-08-27T11:25:30.151+0000 7f0f777f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:25:40.026 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:25:40.685 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:25:40.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:25:44.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:44.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.957+0000 7fd76efff700 1 Processor -- start 2023-08-27T11:25:44.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.958+0000 7fd76efff700 1 -- start start 2023-08-27T11:25:44.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76efff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd76806b320 0x7fd76814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76efff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 0x7fd76814e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76efff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7681546f0 con 0x7fd7680c4600 2023-08-27T11:25:44.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76efff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7680c4bb0 con 0x7fd76806b320 2023-08-27T11:25:44.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76efff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680c4e90 con 0x7fd76806c690 2023-08-27T11:25:44.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76d59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd7680c4600 0x7fd7680c5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41562/0 (socket says 172.21.15.43:41562) 2023-08-27T11:25:44.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76d59c700 1 -- 172.21.15.43:0/2846995521 learned_addr learned my addr 172.21.15.43:0/2846995521 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:44.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd76cd9b700 1 --2- 172.21.15.43:0/2846995521 >> v2:172.21.15.43:3300/0 conn(0x7fd76806b320 0x7fd76814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:44.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd767fff700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 0x7fd76814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.959+0000 7fd7677fe700 1 -- 172.21.15.43:0/2846995521 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239610708 0 0) 0x7fd7681546f0 con 0x7fd7680c4600 2023-08-27T11:25:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd7677fe700 1 -- 172.21.15.43:0/2846995521 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7580035b0 con 0x7fd7680c4600 2023-08-27T11:25:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd76cd9b700 1 -- 172.21.15.43:0/2846995521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 msgr2=0x7fd76814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd76cd9b700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 0x7fd76814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:44.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd76cd9b700 1 -- 172.21.15.43:0/2846995521 >> v1:172.21.15.43:6789/0 conn(0x7fd7680c4600 legacy=0x7fd7680c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:44.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd76cd9b700 1 -- 172.21.15.43:0/2846995521 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7680c5170 con 0x7fd76806b320 2023-08-27T11:25:44.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd767fff700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 0x7fd76814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:44.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd76cd9b700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806b320 0x7fd76814dfd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009840 tx=0x7fd75c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5678827aaa5f70 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:44.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd7677fe700 1 -- 172.21.15.43:0/2846995521 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011830 con 0x7fd76806b320 2023-08-27T11:25:44.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd7677fe700 1 -- 172.21.15.43:0/2846995521 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c011990 con 0x7fd76806b320 2023-08-27T11:25:44.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.960+0000 7fd7677fe700 1 -- 172.21.15.43:0/2846995521 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c011d20 con 0x7fd76806b320 2023-08-27T11:25:44.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 -- 172.21.15.43:0/2846995521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806b320 msgr2=0x7fd76814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806b320 0x7fd76814dfd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009840 tx=0x7fd75c009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 -- 172.21.15.43:0/2846995521 shutdown_connections 2023-08-27T11:25:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806b320 0x7fd76814dfd0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 --2- 172.21.15.43:0/2846995521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806c690 0x7fd76814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 -- 172.21.15.43:0/2846995521 >> 172.21.15.43:0/2846995521 conn(0x7fd7680c9c80 msgr2=0x7fd7680ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 -- 172.21.15.43:0/2846995521 shutdown_connections 2023-08-27T11:25:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.961+0000 7fd76efff700 1 -- 172.21.15.43:0/2846995521 wait complete. 2023-08-27T11:25:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.963+0000 7fd76efff700 1 Processor -- start 2023-08-27T11:25:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.964+0000 7fd76efff700 1 -- start start 2023-08-27T11:25:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806b320 0x7fd7681eadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7680c4600 0x7fd7681ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680c30c0 con 0x7fd76806c690 2023-08-27T11:25:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681561a0 con 0x7fd7680c4600 2023-08-27T11:25:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd76efff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd768156480 con 0x7fd76806b320 2023-08-27T11:25:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39138/0 (socket says 172.21.15.43:39138) 2023-08-27T11:25:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 -- 172.21.15.43:0/761383833 learned_addr learned my addr 172.21.15.43:0/761383833 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 -- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806b320 msgr2=0x7fd7681eadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806b320 0x7fd7681eadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 -- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7680c4600 msgr2=0x7fd7681ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7680c4600 0x7fd7681ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.965+0000 7fd767fff700 1 -- 172.21.15.43:0/761383833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0094a0 con 0x7fd76806c690 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd767fff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e810 tx=0x7fd75400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754013610 con 0x7fd76806c690 2023-08-27T11:25:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd754013770 con 0x7fd76806c690 2023-08-27T11:25:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7681587c0 con 0x7fd76806c690 2023-08-27T11:25:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd754013b20 con 0x7fd76806c690 2023-08-27T11:25:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.966+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd768157e80 con 0x7fd76806c690 2023-08-27T11:25:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.967+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76804ee70 con 0x7fd76806c690 2023-08-27T11:25:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.968+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd754013c80 con 0x7fd76806c690 2023-08-27T11:25:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.969+0000 7fd7657fa700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 0x7fd74c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.969+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd754088200 con 0x7fd76806c690 2023-08-27T11:25:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.969+0000 7fd76cd9b700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 0x7fd74c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.970+0000 7fd76cd9b700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 0x7fd74c06c5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0090b0 tx=0x7fd75c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:44.973+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd754057290 con 0x7fd76806c690 2023-08-27T11:25:45.152 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:25:45.150+0000 7ff7fc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:25:45.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.231+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7681565f0 con 0x7fd76806c690 2023-08-27T11:25:45.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.231+0000 7fd7657fa700 1 -- 172.21.15.43:0/761383833 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fd754056e20 con 0x7fd76806c690 2023-08-27T11:25:45.233 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:45.234 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":63,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:43.000619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5534":{"gid":5534,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":5,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:45.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 msgr2=0x7fd74c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 0x7fd74c06c5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0090b0 tx=0x7fd75c010000 comp rx=0 tx=0).stop 2023-08-27T11:25:45.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 msgr2=0x7fd768156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e810 tx=0x7fd75400ebd0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 shutdown_connections 2023-08-27T11:25:45.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd74c06a110 0x7fd74c06c5d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7680c4600 0x7fd7681ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd76806b320 0x7fd7681eadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 --2- 172.21.15.43:0/761383833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd76806c690 0x7fd768156910 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 >> 172.21.15.43:0/761383833 conn(0x7fd7680c9c80 msgr2=0x7fd768152140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 shutdown_connections 2023-08-27T11:25:45.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.234+0000 7fd76efff700 1 -- 172.21.15.43:0/761383833 wait complete. 2023-08-27T11:25:45.238 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 63 2023-08-27T11:25:45.656 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:25:25.420723+0000', 'modified': '2023-08-27T11:25:43.000619+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5534}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5534': {'gid': 5534, 'name': 'd', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6835/2049507141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2049507141}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2049507141}]}, 'join_fscid': 5, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:25:45.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:25:45.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:25:45.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.860+0000 7fe3379ff700 1 Processor -- start 2023-08-27T11:25:45.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.860+0000 7fe3379ff700 1 -- start start 2023-08-27T11:25:45.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe3379ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 0x7fe3300c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe3379ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe33006ad70 0x7fe33006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe3379ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33006c4e0 con 0x7fe330151a90 2023-08-27T11:25:45.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe3379ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe330155370 con 0x7fe33006ad70 2023-08-27T11:25:45.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe3379ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300c82c0 con 0x7fe3300c4630 2023-08-27T11:25:45.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe33006ad70 0x7fe33006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe33006ad70 0x7fe33006b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39144/0 (socket says 172.21.15.43:39144) 2023-08-27T11:25:45.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 -- 172.21.15.43:0/1859949662 learned_addr learned my addr 172.21.15.43:0/1859949662 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe334f9a700 1 --2- 172.21.15.43:0/1859949662 >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 0x7fe3300c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 -- 172.21.15.43:0/1859949662 >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 msgr2=0x7fe3300c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 --2- 172.21.15.43:0/1859949662 >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 0x7fe3300c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 -- 172.21.15.43:0/1859949662 >> v1:172.21.15.57:6789/0 conn(0x7fe330151a90 legacy=0x7fe3300c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.862+0000 7fe335f9c700 1 -- 172.21.15.43:0/1859949662 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330151e70 con 0x7fe33006ad70 2023-08-27T11:25:45.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe334f9a700 1 --2- 172.21.15.43:0/1859949662 >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 0x7fe3300c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:45.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe335f9c700 1 --2- 172.21.15.43:0/1859949662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33006ad70 0x7fe33006b200 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe3300c7740 tx=0x7fe32800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35da1232a859d4a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe327fff700 1 -- 172.21.15.43:0/1859949662 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32800e070 con 0x7fe33006ad70 2023-08-27T11:25:45.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe327fff700 1 -- 172.21.15.43:0/1859949662 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe328003a20 con 0x7fe33006ad70 2023-08-27T11:25:45.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe327fff700 1 -- 172.21.15.43:0/1859949662 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328003dd0 con 0x7fe33006ad70 2023-08-27T11:25:45.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe3379ff700 1 -- 172.21.15.43:0/1859949662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33006ad70 msgr2=0x7fe33006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.863+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1859949662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33006ad70 0x7fe33006b200 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe3300c7740 tx=0x7fe32800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:45.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 -- 172.21.15.43:0/1859949662 shutdown_connections 2023-08-27T11:25:45.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1859949662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe33006ad70 0x7fe33006b200 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1859949662 >> v2:172.21.15.57:3300/0 conn(0x7fe3300c4630 0x7fe3300c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 -- 172.21.15.43:0/1859949662 >> 172.21.15.43:0/1859949662 conn(0x7fe3300ab820 msgr2=0x7fe3300abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 -- 172.21.15.43:0/1859949662 shutdown_connections 2023-08-27T11:25:45.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.864+0000 7fe3379ff700 1 -- 172.21.15.43:0/1859949662 wait complete. 2023-08-27T11:25:45.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.865+0000 7fe3379ff700 1 Processor -- start 2023-08-27T11:25:45.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.865+0000 7fe3379ff700 1 -- start start 2023-08-27T11:25:45.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe33006ad70 0x7fe3300c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe330151a90 0x7fe330146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300bcd90 con 0x7fe3300c4630 2023-08-27T11:25:45.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33014c740 con 0x7fe33006ad70 2023-08-27T11:25:45.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.866+0000 7fe3379ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33014ca20 con 0x7fe330151a90 2023-08-27T11:25:45.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39158/0 (socket says 172.21.15.43:39158) 2023-08-27T11:25:45.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 -- 172.21.15.43:0/1483259598 learned_addr learned my addr 172.21.15.43:0/1483259598 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe335f9c700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe330151a90 0x7fe330146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 -- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe330151a90 msgr2=0x7fe330146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe330151a90 0x7fe330146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 -- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe33006ad70 msgr2=0x7fe3300c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe33006ad70 0x7fe3300c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 -- 172.21.15.43:0/1483259598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009b30 con 0x7fe3300c4630 2023-08-27T11:25:45.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe334f9a700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e810 tx=0x7fe32000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe325ffb700 1 -- 172.21.15.43:0/1483259598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320013610 con 0x7fe3300c4630 2023-08-27T11:25:45.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.867+0000 7fe325ffb700 1 -- 172.21.15.43:0/1483259598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320013770 con 0x7fe3300c4630 2023-08-27T11:25:45.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.868+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3300c0e20 con 0x7fe3300c4630 2023-08-27T11:25:45.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.868+0000 7fe325ffb700 1 -- 172.21.15.43:0/1483259598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320013b20 con 0x7fe3300c4630 2023-08-27T11:25:45.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.868+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3300c13e0 con 0x7fe3300c4630 2023-08-27T11:25:45.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.870+0000 7fe325ffb700 1 -- 172.21.15.43:0/1483259598 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe320013c80 con 0x7fe3300c4630 2023-08-27T11:25:45.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.871+0000 7fe325ffb700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.871+0000 7fe325ffb700 1 -- 172.21.15.43:0/1483259598 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe3200882a0 con 0x7fe3300c4630 2023-08-27T11:25:45.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.871+0000 7fe33579b700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.871+0000 7fe33579b700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 0x7fe31406c5a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0096f0 tx=0x7fe32c006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.873+0000 7fe34b3b3b80 1 Processor -- start 2023-08-27T11:25:45.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.873+0000 7fe34b3b3b80 1 -- start start 2023-08-27T11:25:45.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5567847eaf00 0x55678480dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556784748730 con 0x5567847f0fe0 2023-08-27T11:25:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556784746050 con 0x5567847eaf00 2023-08-27T11:25:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556784741940 con 0x5567847eb2e0 2023-08-27T11:25:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39164/0 (socket says 172.21.15.43:39164) 2023-08-27T11:25:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 -- 172.21.15.43:0/3371678844 learned_addr learned my addr 172.21.15.43:0/3371678844 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe335f9c700 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe33579b700 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5567847eaf00 0x55678480dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 -- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 msgr2=0x556784823500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 -- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5567847eaf00 msgr2=0x55678480dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5567847eaf00 0x55678480dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.874+0000 7fe334f9a700 1 -- 172.21.15.43:0/3371678844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567845c15e0 con 0x5567847f0fe0 2023-08-27T11:25:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe32005edc0 tx=0x7fe32005b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72041f0e1116e13e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe31affd700 1 -- 172.21.15.43:0/3371678844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32005b170 con 0x5567847f0fe0 2023-08-27T11:25:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe31affd700 1 -- 172.21.15.43:0/3371678844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320055980 con 0x5567847f0fe0 2023-08-27T11:25:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe31affd700 1 -- 172.21.15.43:0/3371678844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32005ee60 con 0x5567847f0fe0 2023-08-27T11:25:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3371678844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 msgr2=0x55678480e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.875+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe32005edc0 tx=0x7fe32005b3a0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3371678844 shutdown_connections 2023-08-27T11:25:45.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5567847eaf00 0x55678480dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3371678844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847f0fe0 0x55678480e2b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3371678844 >> 172.21.15.43:0/3371678844 conn(0x55678474dc30 msgr2=0x5567847ed6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3371678844 shutdown_connections 2023-08-27T11:25:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3371678844 wait complete. 2023-08-27T11:25:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.876+0000 7fe34b3b3b80 1 -- start start 2023-08-27T11:25:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.877+0000 7fe34b3b3b80 1 Processor -- start 2023-08-27T11:25:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eaf00 0x556784829c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x55678480cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567846dfb60 con 0x5567847eb2e0 2023-08-27T11:25:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567846df860 con 0x55678482ae50 2023-08-27T11:25:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567845c38d0 con 0x5567847eaf00 2023-08-27T11:25:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe34b3b3b80 10 client.0 _ll_register_callbacks cb 0x5567846dd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39170/0 (socket says 172.21.15.43:39170) 2023-08-27T11:25:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 -- 172.21.15.43:0/2655097002 learned_addr learned my addr 172.21.15.43:0/2655097002 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe33579b700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eaf00 0x556784829c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe335f9c700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x55678480cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 -- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eaf00 msgr2=0x556784829c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eaf00 0x556784829c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 -- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 msgr2=0x55678480cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x55678480cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.878+0000 7fe334f9a700 1 -- 172.21.15.43:0/2655097002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3300c13e0 con 0x5567847eb2e0 2023-08-27T11:25:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe334f9a700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e7e0 tx=0x7fe320000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70653baa4b0b494 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320053920 con 0x5567847eb2e0 2023-08-27T11:25:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567847e24f0 con 0x5567847eb2e0 2023-08-27T11:25:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe32005b170 con 0x5567847eb2e0 2023-08-27T11:25:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe32006aba0 con 0x5567847eb2e0 2023-08-27T11:25:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 10 client.6432 fetch_fsmap learned FSMap version 63 2023-08-27T11:25:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x556784759750 con 0x5567847eb2e0 2023-08-27T11:25:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320079080 con 0x5567847eb2e0 2023-08-27T11:25:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe32006ad00 con 0x5567847eb2e0 2023-08-27T11:25:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 10 client.6432 fetch_fsmap finished waiting for FSMap version 63 2023-08-27T11:25:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 10 client.6432 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:25:45.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 20 client.6432 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:45.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x55678480d2f0 0x55678483edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 4 client.6432 mds_command: new command op to 5534 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:25:45.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.879+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 --> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55678473a920 con 0x55678480d2f0 2023-08-27T11:25:45.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.880+0000 7fe33579b700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x55678480d2f0 0x55678483edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.880+0000 7fe33579b700 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x55678480d2f0 0x55678483edb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8e602b485e1e01d server_cookie=a3625ae70ef5308e in_seq=0 out_seq=0 2023-08-27T11:25:45.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.880+0000 7fe30ffff700 10 client.6432 ms_handle_connect on v2:172.21.15.57:6833/2049507141 2023-08-27T11:25:45.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.881+0000 7fe30ffff700 1 -- 172.21.15.43:0/2655097002 <== mds.0 v2:172.21.15.57:6833/2049507141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55678473a920 con 0x55678480d2f0 2023-08-27T11:25:45.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.881+0000 7fe30ffff700 10 client.6432 handle_command_reply: tid=0 2023-08-27T11:25:45.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.881+0000 7fe34b3b3b80 1 client.6432 shutdown 2023-08-27T11:25:45.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 msgr2=0x5567848275b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e7e0 tx=0x7fe320000bc0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 shutdown_connections 2023-08-27T11:25:45.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x55678480d2f0 0x55678483edb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x55678480cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eaf00 0x556784829c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/2655097002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eb2e0 0x5567848275b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe30ffff700 0 client.6432 ms_handle_reset on v2:172.21.15.57:6833/2049507141 2023-08-27T11:25:45.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 >> 172.21.15.43:0/2655097002 conn(0x55678474dc30 msgr2=0x55678480db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 shutdown_connections 2023-08-27T11:25:45.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/2655097002 wait complete. 2023-08-27T11:25:45.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.882+0000 7fe34b3b3b80 20 client.6432 trim_cache size 0 max 16384 2023-08-27T11:25:45.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.900+0000 7fe34b3b3b80 1 Processor -- start 2023-08-27T11:25:45.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 -- start start 2023-08-27T11:25:45.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x5567848242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x556784824800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556784828640 con 0x5567847eaf00 2023-08-27T11:25:45.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567847f0460 con 0x55678482ae50 2023-08-27T11:25:45.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.901+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55678482fbb0 con 0x5567847eb2e0 2023-08-27T11:25:45.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39182/0 (socket says 172.21.15.43:39182) 2023-08-27T11:25:45.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 -- 172.21.15.43:0/786063906 learned_addr learned my addr 172.21.15.43:0/786063906 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe335f9c700 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x556784824800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe334f9a700 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x5567848242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 -- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 msgr2=0x5567848242c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x5567848242c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 -- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 msgr2=0x556784824800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x556784824800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 -- 172.21.15.43:0/786063906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55678456dd90 con 0x5567847eaf00 2023-08-27T11:25:45.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe33579b700 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009e40 tx=0x7fe32c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75519930aafc1bc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.902+0000 7fe31b7fe700 1 -- 172.21.15.43:0/786063906 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c024d30 con 0x5567847eaf00 2023-08-27T11:25:45.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe31b7fe700 1 -- 172.21.15.43:0/786063906 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c01b040 con 0x5567847eaf00 2023-08-27T11:25:45.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe31b7fe700 1 -- 172.21.15.43:0/786063906 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0242e0 con 0x5567847eaf00 2023-08-27T11:25:45.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/786063906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 msgr2=0x5567847ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009e40 tx=0x7fe32c012000 comp rx=0 tx=0).stop 2023-08-27T11:25:45.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/786063906 shutdown_connections 2023-08-27T11:25:45.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x556784824800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x5567847ea060 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/786063906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x5567848242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/786063906 >> 172.21.15.43:0/786063906 conn(0x55678474dc30 msgr2=0x5567847e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/786063906 shutdown_connections 2023-08-27T11:25:45.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.903+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/786063906 wait complete. 2023-08-27T11:25:45.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.904+0000 7fe34b3b3b80 1 -- start start 2023-08-27T11:25:45.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.904+0000 7fe34b3b3b80 1 Processor -- start 2023-08-27T11:25:45.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x5567847e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567848238b0 con 0x5567847eaf00 2023-08-27T11:25:45.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556784823ce0 con 0x55678482ae50 2023-08-27T11:25:45.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556784825540 con 0x5567847eb2e0 2023-08-27T11:25:45.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe34b3b3b80 10 client.0 _ll_register_callbacks cb 0x5567846dd630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:25:45.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe33579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe33579b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39192/0 (socket says 172.21.15.43:39192) 2023-08-27T11:25:45.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe33579b700 1 -- 172.21.15.43:0/3537673871 learned_addr learned my addr 172.21.15.43:0/3537673871 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:45.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.905+0000 7fe335f9c700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x5567847e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 -- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 msgr2=0x556784823370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 -- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 msgr2=0x5567847e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:45.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x5567847e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 -- 172.21.15.43:0/3537673871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c0135b0 con 0x5567847eaf00 2023-08-27T11:25:45.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:45.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe33579b700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0095b0 tx=0x7fe32c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71aad119449cb29 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:45.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe30ffff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:25:45.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c004020 con 0x5567847eaf00 2023-08-27T11:25:45.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe320055980 con 0x5567847eaf00 2023-08-27T11:25:45.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe32c004180 con 0x5567847eaf00 2023-08-27T11:25:45.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe32c004340 con 0x5567847eaf00 2023-08-27T11:25:45.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe34b3b3b80 10 client.6438 fetch_fsmap learned FSMap version 63 2023-08-27T11:25:45.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.906+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x556784556c10 con 0x5567847eaf00 2023-08-27T11:25:45.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320055980 con 0x5567847eaf00 2023-08-27T11:25:45.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe32c003680 con 0x5567847eaf00 2023-08-27T11:25:45.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 10 client.6438 fetch_fsmap finished waiting for FSMap version 63 2023-08-27T11:25:45.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 10 client.6438 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:25:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 20 client.6438 populate_metadata read hostname 'smithi043' 2023-08-27T11:25:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x5567847e90a0 0x5567847e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 4 client.6438 mds_command: new command op to 5534 tid=0[{"prefix": "status"}] 2023-08-27T11:25:45.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 --> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5567846fb000 con 0x5567847e90a0 2023-08-27T11:25:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.907+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x5567847e90a0 0x5567847e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.908+0000 7fe334f9a700 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x5567847e90a0 0x5567847e9480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ede50b95f926e184 server_cookie=ace62c9e43607e36 in_seq=0 out_seq=0 2023-08-27T11:25:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.908+0000 7fe30ffff700 10 client.6438 ms_handle_connect on v2:172.21.15.57:6833/2049507141 2023-08-27T11:25:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.908+0000 7fe30ffff700 1 -- 172.21.15.43:0/3537673871 <== mds.0 v2:172.21.15.57:6833/2049507141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5567846fb000 con 0x5567847e90a0 2023-08-27T11:25:45.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.908+0000 7fe30ffff700 10 client.6438 handle_command_reply: tid=0 2023-08-27T11:25:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.908+0000 7fe34b3b3b80 1 client.6438 shutdown 2023-08-27T11:25:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 msgr2=0x556784845600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0095b0 tx=0x7fe32c0047f0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 shutdown_connections 2023-08-27T11:25:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:6833/2049507141,v1:172.21.15.57:6835/2049507141] conn(0x5567847e90a0 0x5567847e9480 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55678482ae50 0x5567847e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5567847eaf00 0x556784845600 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe30ffff700 0 client.6438 ms_handle_reset on v2:172.21.15.57:6833/2049507141 2023-08-27T11:25:45.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 --2- 172.21.15.43:0/3537673871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5567847eb2e0 0x556784823370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 >> 172.21.15.43:0/3537673871 conn(0x55678474dc30 msgr2=0x5567847ea060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 shutdown_connections 2023-08-27T11:25:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 1 -- 172.21.15.43:0/3537673871 wait complete. 2023-08-27T11:25:45.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe34b3b3b80 20 client.6438 trim_cache size 0 max 16384 2023-08-27T11:25:45.934 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:25:45.934 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:25:45.934 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:25:45.935 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 5534, 2023-08-27T11:25:45.935 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:25:45.935 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:25:45.935 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:25:45.935 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 5.9350565660000001, 2023-08-27T11:25:45.936 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 63, 2023-08-27T11:25:45.936 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 69, 2023-08-27T11:25:45.936 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 69, 2023-08-27T11:25:45.936 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 26.932172166000001 2023-08-27T11:25:45.936 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:25:45.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 msgr2=0x7fe31406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 0x7fe31406c5a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0096f0 tx=0x7fe32c006c50 comp rx=0 tx=0).stop 2023-08-27T11:25:45.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 msgr2=0x7fe330146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:45.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.909+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe32000e810 tx=0x7fe32000ebd0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 shutdown_connections 2023-08-27T11:25:45.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe330151a90 0x7fe330146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe33006ad70 0x7fe3300c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 --2- 172.21.15.43:0/1483259598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe3300c4630 0x7fe330146a40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:45.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 >> 172.21.15.43:0/1483259598 conn(0x7fe3300ab820 msgr2=0x7fe330150410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:45.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 shutdown_connections 2023-08-27T11:25:45.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:45.910+0000 7fe3379ff700 1 -- 172.21.15.43:0/1483259598 wait complete. 2023-08-27T11:25:45.941 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 5, "epoch": 63, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 5, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:25:25.420723+0000", "damaged": [], "data_pools": [ 12 ], "enabled": true, "epoch": 63, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5534": { "addr": "172.21.15.57:6835/2049507141", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2049507141, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2049507141, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5534, "incarnation": 60, "join_fscid": 5, "name": "d", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 69, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 11, "modified": "2023-08-27T11:25:43.000619+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5534 } } } ], "standbys": [ { "addr": "172.21.15.57:6834/229501658", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 229501658, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 229501658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 53, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5968, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/2813047028", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 2813047028, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 2813047028, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 52, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6192, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/3725831326", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 3725831326, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 3725831326, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 61, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6411, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:25:45.943 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': 5, 'name': 'd', 'state': 'up:active'}] 2023-08-27T11:25:45.943 INFO:tasks.cephfs.test_failover:current = [{'gid': 6192, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/2813047028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 2813047028}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 2813047028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 52}, {'gid': 5968, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/229501658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 229501658}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 229501658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 53}, {'gid': 6411, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/3725831326', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3725831326}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3725831326}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 61}, {'gid': 5534, 'name': 'd', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.57:6835/2049507141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2049507141}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2049507141}]}, 'join_fscid': 5, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:25:45.944 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:25:45.944 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:25:45.945 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:25:46.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:25:46.157 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:25:46.158 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:25:46.158 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:25:46.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:25:46.202 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:25:46.203 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:25:46.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:25:46.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:46.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.448+0000 7fc9aafff700 1 Processor -- start 2023-08-27T11:25:46.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.449+0000 7fc9aafff700 1 -- start start 2023-08-27T11:25:46.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9aafff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9aafff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9aafff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a406c4e0 con 0x7fc9a4151a90 2023-08-27T11:25:46.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9aafff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a4155370 con 0x7fc9a406ad70 2023-08-27T11:25:46.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9aafff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c82c0 con 0x7fc9a40c4630 2023-08-27T11:25:46.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a8d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc9a4151a90 0x7fc9a40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41566/0 (socket says 172.21.15.43:41566) 2023-08-27T11:25:46.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a8d9b700 1 -- 172.21.15.43:0/2254777976 learned_addr learned my addr 172.21.15.43:0/2254777976 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:46.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a959c700 1 --2- 172.21.15.43:0/2254777976 >> v2:172.21.15.57:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586258838 0 0) 0x7fc9a406c4e0 con 0x7fc9a4151a90 2023-08-27T11:25:46.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.450+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9940035b0 con 0x7fc9a4151a90 2023-08-27T11:25:46.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2358940315 0 0) 0x7fc9940035b0 con 0x7fc9a4151a90 2023-08-27T11:25:46.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 msgr2=0x7fc9a40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:46.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 >> v2:172.21.15.57:3300/0 conn(0x7fc9a406ad70 msgr2=0x7fc9a406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:46.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 --2- 172.21.15.43:0/2254777976 >> v2:172.21.15.57:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4151e70 con 0x7fc9a4151a90 2023-08-27T11:25:46.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fc998001670 con 0x7fc9a4151a90 2023-08-27T11:25:46.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a959c700 1 --2- 172.21.15.43:0/2254777976 >> v2:172.21.15.57:3300/0 conn(0x7fc9a406ad70 0x7fc9a406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc9a40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 >> v1:172.21.15.43:6789/0 conn(0x7fc9a4151a90 legacy=0x7fc9a40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc994003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc994003f90 0x7fc994004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc994004d90 0x7fc994005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4155370 con 0x7fc994003f90 2023-08-27T11:25:46.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c82c0 con 0x7fc994004d90 2023-08-27T11:25:46.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99400ba60 con 0x7fc9a40c4630 2023-08-27T11:25:46.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc994003f90 0x7fc994004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a8d9b700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc994003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.451+0000 7fc9a959c700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc994004d90 0x7fc994005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 -- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 msgr2=0x7fc994003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:46.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9a40c4630 0x7fc994003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 -- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc994004d90 msgr2=0x7fc994005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:46.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc994004d90 0x7fc994005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 -- 172.21.15.43:0/2254777976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9900094a0 con 0x7fc994003f90 2023-08-27T11:25:46.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc994003f90 0x7fc994004850 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d30 tx=0x7fc994005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c1335bc9245544 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990009e80 con 0x7fc994003f90 2023-08-27T11:25:46.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99000e9a0 con 0x7fc994003f90 2023-08-27T11:25:46.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.452+0000 7fc9a37fe700 1 -- 172.21.15.43:0/2254777976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000ed10 con 0x7fc994003f90 2023-08-27T11:25:46.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 -- 172.21.15.43:0/2254777976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc994003f90 msgr2=0x7fc994004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 --2- 172.21.15.43:0/2254777976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc994003f90 0x7fc994004850 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d30 tx=0x7fc994005880 comp rx=0 tx=0).stop 2023-08-27T11:25:46.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9a959c700 1 -- 172.21.15.43:0/2254777976 reap_dead start 2023-08-27T11:25:46.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 -- 172.21.15.43:0/2254777976 shutdown_connections 2023-08-27T11:25:46.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 -- 172.21.15.43:0/2254777976 >> 172.21.15.43:0/2254777976 conn(0x7fc9a40ab820 msgr2=0x7fc9a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:46.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 -- 172.21.15.43:0/2254777976 shutdown_connections 2023-08-27T11:25:46.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.453+0000 7fc9aafff700 1 -- 172.21.15.43:0/2254777976 wait complete. 2023-08-27T11:25:46.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.455+0000 7fc9aafff700 1 Processor -- start 2023-08-27T11:25:46.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.455+0000 7fc9aafff700 1 -- start start 2023-08-27T11:25:46.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc994003f90 0x7fc9a40ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a41e6dc0 0x7fc9a41e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a41edd20 con 0x7fc9a40aa810 2023-08-27T11:25:46.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a41e7780 con 0x7fc9a41e6dc0 2023-08-27T11:25:46.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9aafff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a414def0 con 0x7fc994003f90 2023-08-27T11:25:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39220/0 (socket says 172.21.15.43:39220) 2023-08-27T11:25:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 -- 172.21.15.43:0/3746301645 learned_addr learned my addr 172.21.15.43:0/3746301645 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a8d9b700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc994003f90 0x7fc9a40ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a959c700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a41e6dc0 0x7fc9a41e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 -- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc994003f90 msgr2=0x7fc9a40ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc994003f90 0x7fc9a40ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 -- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a41e6dc0 msgr2=0x7fc9a41e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a41e6dc0 0x7fc9a41e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.456+0000 7fc9a3fff700 1 -- 172.21.15.43:0/3746301645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a41ed150 con 0x7fc9a40aa810 2023-08-27T11:25:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9a3fff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc9940047a0 tx=0x7fc9900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990003ab0 con 0x7fc9a40aa810 2023-08-27T11:25:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990003c10 con 0x7fc9a40aa810 2023-08-27T11:25:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990009e80 con 0x7fc9a40aa810 2023-08-27T11:25:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a41ed3f0 con 0x7fc9a40aa810 2023-08-27T11:25:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.457+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a41ed9b0 con 0x7fc9a40aa810 2023-08-27T11:25:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.458+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a41edb70 con 0x7fc9a40aa810 2023-08-27T11:25:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.459+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc990013470 con 0x7fc9a40aa810 2023-08-27T11:25:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.460+0000 7fc9a17fa700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.460+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc990089fc0 con 0x7fc9a40aa810 2023-08-27T11:25:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.461+0000 7fc9a8d9b700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.461+0000 7fc9a8d9b700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc998000c00 tx=0x7fc998001dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.465+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc990055640 con 0x7fc9a40aa810 2023-08-27T11:25:46.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.715+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a414e7e0 con 0x7fc9a40aa810 2023-08-27T11:25:46.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.716+0000 7fc9a17fa700 1 -- 172.21.15.43:0/3746301645 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fc990017090 con 0x7fc9a40aa810 2023-08-27T11:25:46.719 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:46.719 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":63,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:43.000619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5534":{"gid":5534,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":5,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:46.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 msgr2=0x7fc98806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc998000c00 tx=0x7fc998001dd0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 msgr2=0x7fc9a40aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc9940047a0 tx=0x7fc9900047c0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 shutdown_connections 2023-08-27T11:25:46.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc98806a0e0 0x7fc98806c5a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9a41e6dc0 0x7fc9a41e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc994003f90 0x7fc9a40ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 --2- 172.21.15.43:0/3746301645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9a40aa810 0x7fc9a40aac90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.718+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 >> 172.21.15.43:0/3746301645 conn(0x7fc9a40ab820 msgr2=0x7fc9a414ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:46.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.719+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 shutdown_connections 2023-08-27T11:25:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.719+0000 7fc9aafff700 1 -- 172.21.15.43:0/3746301645 wait complete. 2023-08-27T11:25:46.725 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 63 2023-08-27T11:25:46.740 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:46.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.938+0000 7f85fc9ff700 1 Processor -- start 2023-08-27T11:25:46.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.938+0000 7f85fc9ff700 1 -- start start 2023-08-27T11:25:46.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.939+0000 7f85fc9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 0x7f85f80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.939+0000 7f85fc9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f85f80c50d0 0x7f85f80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.939+0000 7f85fc9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f8154d00 con 0x7f85f80a79c0 2023-08-27T11:25:46.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.939+0000 7f85fc9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80baf30 con 0x7f85f80c50d0 2023-08-27T11:25:46.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.939+0000 7f85fc9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8154fe0 con 0x7f85f814e960 2023-08-27T11:25:46.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f85f80c50d0 0x7f85f80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f5d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f85f80a79c0 0x7f85f80c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41570/0 (socket says 172.21.15.43:41570) 2023-08-27T11:25:46.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f5d9b700 1 -- 172.21.15.43:0/3067216844 learned_addr learned my addr 172.21.15.43:0/3067216844 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:46.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f659c700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 0x7f85f80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 -- 172.21.15.43:0/3067216844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 msgr2=0x7f85f80a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:46.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 0x7f85f80a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 -- 172.21.15.43:0/3067216844 >> v1:172.21.15.43:6789/0 conn(0x7f85f80a79c0 legacy=0x7f85f80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 -- 172.21.15.43:0/3067216844 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f81552c0 con 0x7f85f80c50d0 2023-08-27T11:25:46.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f659c700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 0x7f85f80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:46.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f559a700 1 -- 172.21.15.43:0/3067216844 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914701028 0 0) 0x7f85f8154d00 con 0x7f85f80a79c0 2023-08-27T11:25:46.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.940+0000 7f85f6d9d700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f80c50d0 0x7f85f80c43d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47847795757d61ac server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85f559a700 1 -- 172.21.15.43:0/3067216844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000e070 con 0x7f85f80c50d0 2023-08-27T11:25:46.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85f559a700 1 -- 172.21.15.43:0/3067216844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000bbd0 con 0x7f85f80c50d0 2023-08-27T11:25:46.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85f559a700 1 -- 172.21.15.43:0/3067216844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0012430 con 0x7f85f80c50d0 2023-08-27T11:25:46.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 -- 172.21.15.43:0/3067216844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f80c50d0 msgr2=0x7f85f80c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f80c50d0 0x7f85f80c43d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f000b330 comp rx=0 tx=0).stop 2023-08-27T11:25:46.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 -- 172.21.15.43:0/3067216844 shutdown_connections 2023-08-27T11:25:46.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f80c50d0 0x7f85f80c43d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/3067216844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f814e960 0x7f85f80a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 -- 172.21.15.43:0/3067216844 >> 172.21.15.43:0/3067216844 conn(0x7f85f806aa50 msgr2=0x7f85f80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:46.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 -- 172.21.15.43:0/3067216844 shutdown_connections 2023-08-27T11:25:46.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.941+0000 7f85fc9ff700 1 -- 172.21.15.43:0/3067216844 wait complete. 2023-08-27T11:25:46.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.943+0000 7f85fc9ff700 1 Processor -- start 2023-08-27T11:25:46.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.943+0000 7f85fc9ff700 1 -- start start 2023-08-27T11:25:46.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f80a79c0 0x7f85f80ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85f80c50d0 0x7f85f8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8150130 con 0x7f85f814e960 2023-08-27T11:25:46.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80ab070 con 0x7f85f80c50d0 2023-08-27T11:25:46.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85fc9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f814fb90 con 0x7f85f80a79c0 2023-08-27T11:25:46.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39242/0 (socket says 172.21.15.43:39242) 2023-08-27T11:25:46.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.944+0000 7f85f6d9d700 1 -- 172.21.15.43:0/2831614255 learned_addr learned my addr 172.21.15.43:0/2831614255 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:46.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f659c700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f80a79c0 0x7f85f80ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f5d9b700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85f80c50d0 0x7f85f8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 -- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f80a79c0 msgr2=0x7f85f80ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f80a79c0 0x7f85f80ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 -- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85f80c50d0 msgr2=0x7f85f8153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85f80c50d0 0x7f85f8153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 -- 172.21.15.43:0/2831614255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0009a70 con 0x7f85f814e960 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.945+0000 7f85f6d9d700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f85f806de20 tx=0x7f85f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.946+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0012430 con 0x7f85f814e960 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.946+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0020070 con 0x7f85f814e960 2023-08-27T11:25:46.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.946+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0004280 con 0x7f85f814e960 2023-08-27T11:25:46.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.946+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8151c60 con 0x7f85f814e960 2023-08-27T11:25:46.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.946+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f8153d40 con 0x7f85f814e960 2023-08-27T11:25:46.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.947+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f80bb390 con 0x7f85f814e960 2023-08-27T11:25:46.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.948+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85f00043e0 con 0x7f85f814e960 2023-08-27T11:25:46.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.948+0000 7f85e6ffd700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 0x7f85d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:46.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.949+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f85f0022070 con 0x7f85f814e960 2023-08-27T11:25:46.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.949+0000 7f85f659c700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 0x7f85d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:46.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.949+0000 7f85f659c700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 0x7f85d806c5a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85f8071d80 tx=0x7f85e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:46.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:46.953+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f85f0055cd0 con 0x7f85f814e960 2023-08-27T11:25:47.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.163+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85f80ab1e0 con 0x7f85f814e960 2023-08-27T11:25:47.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.164+0000 7f85e6ffd700 1 -- 172.21.15.43:0/2831614255 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f85f80ab1e0 con 0x7f85f814e960 2023-08-27T11:25:47.167 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:47.167 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":69,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:39.971957+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/497941784":"2023-08-28T11:25:39.971908+0000","172.21.15.43:6835/497941784":"2023-08-28T11:25:39.971908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 msgr2=0x7f85d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 0x7f85d806c5a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f85f8071d80 tx=0x7f85e8008040 comp rx=0 tx=0).stop 2023-08-27T11:25:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 msgr2=0x7f85f80a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f85f806de20 tx=0x7f85f0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 shutdown_connections 2023-08-27T11:25:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f85d806a0e0 0x7f85d806c5a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85f814e960 0x7f85f80a87f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85f80a79c0 0x7f85f80ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 --2- 172.21.15.43:0/2831614255 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85f80c50d0 0x7f85f8153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 >> 172.21.15.43:0/2831614255 conn(0x7f85f806aa50 msgr2=0x7f85f80a6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:47.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 shutdown_connections 2023-08-27T11:25:47.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.167+0000 7f85fc9ff700 1 -- 172.21.15.43:0/2831614255 wait complete. 2023-08-27T11:25:47.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:25:23.005792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:25:24.403156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:25:47.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:25:47.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.392+0000 7f2c745ff700 1 Processor -- start 2023-08-27T11:25:47.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.392+0000 7f2c745ff700 1 -- start start 2023-08-27T11:25:47.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.393+0000 7f2c745ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.393+0000 7f2c745ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c6c06c230 0x7f2c6c154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.393+0000 7f2c745ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c1588f0 con 0x7f2c6c0c6d60 2023-08-27T11:25:47.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.393+0000 7f2c745ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c0c4e90 con 0x7f2c6c06c230 2023-08-27T11:25:47.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.393+0000 7f2c745ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0c3b50 con 0x7f2c6c151e40 2023-08-27T11:25:47.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2c6c06c230 0x7f2c6c154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c71b9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2c6c0c6d60 0x7f2c6c154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:41580/0 (socket says 172.21.15.43:41580) 2023-08-27T11:25:47.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c71b9a700 1 -- 172.21.15.43:0/2917746977 learned_addr learned my addr 172.21.15.43:0/2917746977 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:47.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c7239b700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 -- 172.21.15.43:0/2917746977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 msgr2=0x7f2c6c06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:47.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c06bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 -- 172.21.15.43:0/2917746977 >> v1:172.21.15.43:6789/0 conn(0x7f2c6c0c6d60 legacy=0x7f2c6c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 -- 172.21.15.43:0/2917746977 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c157ce0 con 0x7f2c6c06c230 2023-08-27T11:25:47.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c71399700 1 -- 172.21.15.43:0/2917746977 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118554394 0 0) 0x7f2c6c1588f0 con 0x7f2c6c0c6d60 2023-08-27T11:25:47.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.394+0000 7f2c72b9c700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c154d60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21321e5c3e067ff1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c71399700 1 -- 172.21.15.43:0/2917746977 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e070 con 0x7f2c6c06c230 2023-08-27T11:25:47.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c71399700 1 -- 172.21.15.43:0/2917746977 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400bae0 con 0x7f2c6c06c230 2023-08-27T11:25:47.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c71399700 1 -- 172.21.15.43:0/2917746977 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400be90 con 0x7f2c6c06c230 2023-08-27T11:25:47.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 -- 172.21.15.43:0/2917746977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 msgr2=0x7f2c6c154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c154d60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009dc0 tx=0x7f2c6400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:47.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 -- 172.21.15.43:0/2917746977 shutdown_connections 2023-08-27T11:25:47.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c154d60 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2917746977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c06bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 -- 172.21.15.43:0/2917746977 >> 172.21.15.43:0/2917746977 conn(0x7f2c6c065fe0 msgr2=0x7f2c6c0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:47.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.395+0000 7f2c745ff700 1 -- 172.21.15.43:0/2917746977 shutdown_connections 2023-08-27T11:25:47.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.396+0000 7f2c745ff700 1 -- 172.21.15.43:0/2917746977 wait complete. 2023-08-27T11:25:47.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.397+0000 7f2c745ff700 1 Processor -- start 2023-08-27T11:25:47.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.397+0000 7f2c745ff700 1 -- start start 2023-08-27T11:25:47.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 0x7f2c6c0ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0ab190 con 0x7f2c6c06c230 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0adf60 con 0x7f2c6c0c6d60 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c745ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c150460 con 0x7f2c6c151e40 2023-08-27T11:25:47.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c7239b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c7239b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39268/0 (socket says 172.21.15.43:39268) 2023-08-27T11:25:47.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.398+0000 7f2c7239b700 1 -- 172.21.15.43:0/2900030531 learned_addr learned my addr 172.21.15.43:0/2900030531 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:47.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c72b9c700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 -- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 msgr2=0x7f2c6c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 -- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 msgr2=0x7f2c6c0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c71b9a700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 0x7f2c6c0ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 0x7f2c6c0ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 -- 172.21.15.43:0/2900030531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009a70 con 0x7f2c6c06c230 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c72b9c700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:47.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c71b9a700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 0x7f2c6c0ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:47.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c7239b700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800e990 tx=0x7f2c6800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680096f0 con 0x7f2c6c06c230 2023-08-27T11:25:47.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800c850 con 0x7f2c6c06c230 2023-08-27T11:25:47.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0ae930 con 0x7f2c6c06c230 2023-08-27T11:25:47.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.399+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800cbc0 con 0x7f2c6c06c230 2023-08-27T11:25:47.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.400+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0aa680 con 0x7f2c6c06c230 2023-08-27T11:25:47.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.401+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c0ae240 con 0x7f2c6c06c230 2023-08-27T11:25:47.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.402+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c6800cd20 con 0x7f2c6c06c230 2023-08-27T11:25:47.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.402+0000 7f2c62ffd700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 0x7f2c5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.403+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2c680889d0 con 0x7f2c6c06c230 2023-08-27T11:25:47.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.403+0000 7f2c71b9a700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 0x7f2c5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.403+0000 7f2c71b9a700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 0x7f2c5006c5a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c007fd0 tx=0x7f2c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.407+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2c680540f0 con 0x7f2c6c06c230 2023-08-27T11:25:47.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.616+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c6c04ee70 con 0x7f2c6c06c230 2023-08-27T11:25:47.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.616+0000 7f2c62ffd700 1 -- 172.21.15.43:0/2900030531 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c68021020 con 0x7f2c6c06c230 2023-08-27T11:25:47.619 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:25:47.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 msgr2=0x7f2c5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 0x7f2c5006c5a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c007fd0 tx=0x7f2c5c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:47.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 msgr2=0x7f2c6c14ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800e990 tx=0x7f2c6800ed50 comp rx=0 tx=0).stop 2023-08-27T11:25:47.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 shutdown_connections 2023-08-27T11:25:47.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2c5006a0e0 0x7f2c5006c5a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c6c151e40 0x7f2c6c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2c6c06c230 0x7f2c6c14ff20 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 --2- 172.21.15.43:0/2900030531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c6c0c6d60 0x7f2c6c0ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 >> 172.21.15.43:0/2900030531 conn(0x7f2c6c065fe0 msgr2=0x7f2c6c155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:47.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 shutdown_connections 2023-08-27T11:25:47.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.619+0000 7f2c745ff700 1 -- 172.21.15.43:0/2900030531 wait complete. 2023-08-27T11:25:47.640 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:25:47.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.841+0000 7fbff5fff700 1 Processor -- start 2023-08-27T11:25:47.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.841+0000 7fbff5fff700 1 -- start start 2023-08-27T11:25:47.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00c5230 0x7fbff006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 0x7fbff00aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbff00ab190 0x7fbff0155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff0152290 con 0x7fbff00ab190 2023-08-27T11:25:47.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff006d7a0 con 0x7fbff006c5e0 2023-08-27T11:25:47.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbff5fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0152550 con 0x7fbff00c5230 2023-08-27T11:25:47.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbff00ab190 0x7fbff0155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbff00ab190 0x7fbff0155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39272/0 (socket says 172.21.15.43:39272) 2023-08-27T11:25:47.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 -- 172.21.15.43:0/3863085281 learned_addr learned my addr 172.21.15.43:0/3863085281 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfef7fe700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00c5230 0x7fbff006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeeffd700 1 --2- 172.21.15.43:0/3863085281 >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 0x7fbff00aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 -- 172.21.15.43:0/3863085281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00c5230 msgr2=0x7fbff006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00c5230 0x7fbff006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 -- 172.21.15.43:0/3863085281 >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 msgr2=0x7fbff00aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:47.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 --2- 172.21.15.43:0/3863085281 >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 0x7fbff00aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeffff700 1 -- 172.21.15.43:0/3863085281 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0152830 con 0x7fbff00ab190 2023-08-27T11:25:47.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.843+0000 7fbfeeffd700 1 --2- 172.21.15.43:0/3863085281 >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 0x7fbff00aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:47.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbfeffff700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff00ab190 0x7fbff0155880 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbff006b3a0 tx=0x7fbfe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aade5bbb2d4fff5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbfee7fc700 1 -- 172.21.15.43:0/3863085281 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800e070 con 0x7fbff00ab190 2023-08-27T11:25:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbfee7fc700 1 -- 172.21.15.43:0/3863085281 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe800b9c0 con 0x7fbff00ab190 2023-08-27T11:25:47.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbfee7fc700 1 -- 172.21.15.43:0/3863085281 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe800bd70 con 0x7fbff00ab190 2023-08-27T11:25:47.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbff5fff700 1 -- 172.21.15.43:0/3863085281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff00ab190 msgr2=0x7fbff0155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbff5fff700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff00ab190 0x7fbff0155880 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbff006b3a0 tx=0x7fbfe800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:47.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbff5fff700 1 -- 172.21.15.43:0/3863085281 shutdown_connections 2023-08-27T11:25:47.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.844+0000 7fbff5fff700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff00ab190 0x7fbff0155880 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.845+0000 7fbff5fff700 1 --2- 172.21.15.43:0/3863085281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00c5230 0x7fbff006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.845+0000 7fbff5fff700 1 --2- 172.21.15.43:0/3863085281 >> v2:172.21.15.57:3300/0 conn(0x7fbff006c5e0 0x7fbff00aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.845+0000 7fbff5fff700 1 -- 172.21.15.43:0/3863085281 >> 172.21.15.43:0/3863085281 conn(0x7fbff00c5b10 msgr2=0x7fbff00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:47.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.845+0000 7fbff5fff700 1 -- 172.21.15.43:0/3863085281 shutdown_connections 2023-08-27T11:25:47.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.845+0000 7fbff5fff700 1 -- 172.21.15.43:0/3863085281 wait complete. 2023-08-27T11:25:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.847+0000 7fbff5fff700 1 Processor -- start 2023-08-27T11:25:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.847+0000 7fbff5fff700 1 -- start start 2023-08-27T11:25:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.848+0000 7fbff5fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.848+0000 7fbff5fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00ab190 0x7fbff014a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.848+0000 7fbff5fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 0x7fbff014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.848+0000 7fbff5fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01ed290 con 0x7fbff006c5e0 2023-08-27T11:25:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbff5fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff01ed570 con 0x7fbff00c5230 2023-08-27T11:25:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbff5fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff0151960 con 0x7fbff00ab190 2023-08-27T11:25:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39278/0 (socket says 172.21.15.43:39278) 2023-08-27T11:25:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 -- 172.21.15.43:0/2469776943 learned_addr learned my addr 172.21.15.43:0/2469776943 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 -- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00ab190 msgr2=0x7fbff014a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00ab190 0x7fbff014a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfeffff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 0x7fbff014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 -- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 msgr2=0x7fbff014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 0x7fbff014aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 -- 172.21.15.43:0/2469776943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8009b30 con 0x7fbff006c5e0 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfeffff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 0x7fbff014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.849+0000 7fbfef7fe700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000d800 tx=0x7fbfe000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.850+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00125f0 con 0x7fbff006c5e0 2023-08-27T11:25:47.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.850+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0012750 con 0x7fbff006c5e0 2023-08-27T11:25:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.850+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0012b00 con 0x7fbff006c5e0 2023-08-27T11:25:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.850+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff0151c40 con 0x7fbff006c5e0 2023-08-27T11:25:47.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.850+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff0071a10 con 0x7fbff006c5e0 2023-08-27T11:25:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.851+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff014c950 con 0x7fbff006c5e0 2023-08-27T11:25:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.852+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbfe0012c60 con 0x7fbff006c5e0 2023-08-27T11:25:47.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.853+0000 7fbfd7fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 0x7fbfdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:47.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.853+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fbfe0088a10 con 0x7fbff006c5e0 2023-08-27T11:25:47.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.854+0000 7fbfeeffd700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 0x7fbfdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:47.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.854+0000 7fbfeeffd700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 0x7fbfdc06c5a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbff00c65a0 tx=0x7fbfe4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:47.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:47.858+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbfe0054000 con 0x7fbff006c5e0 2023-08-27T11:25:48.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.065+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbff0152ae0 con 0x7fbff006c5e0 2023-08-27T11:25:48.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.066+0000 7fbfd7fff700 1 -- 172.21.15.43:0/2469776943 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfe0057620 con 0x7fbff006c5e0 2023-08-27T11:25:48.069 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:25:48.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 msgr2=0x7fbfdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 0x7fbfdc06c5a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbff00c65a0 tx=0x7fbfe4008040 comp rx=0 tx=0).stop 2023-08-27T11:25:48.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 msgr2=0x7fbff00714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000d800 tx=0x7fbfe000dbc0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 shutdown_connections 2023-08-27T11:25:48.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbfdc06a0e0 0x7fbfdc06c5a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbff00c5230 0x7fbff014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbff006c5e0 0x7fbff00714d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 --2- 172.21.15.43:0/2469776943 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbff00ab190 0x7fbff014a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 >> 172.21.15.43:0/2469776943 conn(0x7fbff00c5b10 msgr2=0x7fbff0155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:48.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 shutdown_connections 2023-08-27T11:25:48.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.068+0000 7fbff5fff700 1 -- 172.21.15.43:0/2469776943 wait complete. 2023-08-27T11:25:48.089 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:25:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.292+0000 7f7c417ff700 1 Processor -- start 2023-08-27T11:25:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.292+0000 7f7c417ff700 1 -- start start 2023-08-27T11:25:48.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c417ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c417ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c3c0c4230 0x7f7c3c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c417ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c06d5c0 con 0x7f7c3c0c3830 2023-08-27T11:25:48.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c417ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c151fa0 con 0x7f7c3c0c4230 2023-08-27T11:25:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c417ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c1550d0 con 0x7f7c3c151bc0 2023-08-27T11:25:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.293+0000 7f7c3b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c3c0c4230 0x7f7c3c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7c3c0c4230 0x7f7c3c154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39286/0 (socket says 172.21.15.43:39286) 2023-08-27T11:25:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 -- 172.21.15.43:0/3619062598 learned_addr learned my addr 172.21.15.43:0/3619062598 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3affd700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 -- 172.21.15.43:0/3619062598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 msgr2=0x7f7c3c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 -- 172.21.15.43:0/3619062598 >> v1:172.21.15.57:6789/0 conn(0x7f7c3c0c3830 legacy=0x7f7c3c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 -- 172.21.15.43:0/3619062598 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0bf4b0 con 0x7f7c3c0c4230 2023-08-27T11:25:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.294+0000 7f7c3b7fe700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c154b90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009e50 tx=0x7f7c3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69393732b1f304c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c3a7fc700 1 -- 172.21.15.43:0/3619062598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400e070 con 0x7f7c3c0c4230 2023-08-27T11:25:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c3a7fc700 1 -- 172.21.15.43:0/3619062598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400b910 con 0x7f7c3c0c4230 2023-08-27T11:25:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c3a7fc700 1 -- 172.21.15.43:0/3619062598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400bcc0 con 0x7f7c3c0c4230 2023-08-27T11:25:48.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 -- 172.21.15.43:0/3619062598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c4230 msgr2=0x7f7c3c154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c154b90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009e50 tx=0x7f7c3400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:48.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 -- 172.21.15.43:0/3619062598 shutdown_connections 2023-08-27T11:25:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c154b90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 --2- 172.21.15.43:0/3619062598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 -- 172.21.15.43:0/3619062598 >> 172.21.15.43:0/3619062598 conn(0x7f7c3c0c5b10 msgr2=0x7f7c3c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 -- 172.21.15.43:0/3619062598 shutdown_connections 2023-08-27T11:25:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.295+0000 7f7c417ff700 1 -- 172.21.15.43:0/3619062598 wait complete. 2023-08-27T11:25:48.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.297+0000 7f7c417ff700 1 Processor -- start 2023-08-27T11:25:48.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.297+0000 7f7c417ff700 1 -- start start 2023-08-27T11:25:48.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c0a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a9be0 con 0x7f7c3c0c3830 2023-08-27T11:25:48.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0ab540 con 0x7f7c3c0c4230 2023-08-27T11:25:48.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c417ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0a88d0 con 0x7f7c3c151bc0 2023-08-27T11:25:48.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c3affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39298/0 (socket says 172.21.15.43:39298) 2023-08-27T11:25:48.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.298+0000 7f7c3affd700 1 -- 172.21.15.43:0/823265184 learned_addr learned my addr 172.21.15.43:0/823265184 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:48.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3b7fe700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c33fff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c0a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 -- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 msgr2=0x7f7c3c0a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 -- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 msgr2=0x7f7c3c0a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c0a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 -- 172.21.15.43:0/823265184 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34009b30 con 0x7f7c3c0c3830 2023-08-27T11:25:48.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3b7fe700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:48.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c33fff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c0a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:48.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c3affd700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e870 tx=0x7f7c2c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c009590 con 0x7f7c3c0c3830 2023-08-27T11:25:48.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00ee70 con 0x7f7c3c0c3830 2023-08-27T11:25:48.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c0a8bb0 con 0x7f7c3c0c3830 2023-08-27T11:25:48.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ca50 con 0x7f7c3c0c3830 2023-08-27T11:25:48.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.299+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c1510b0 con 0x7f7c3c0c3830 2023-08-27T11:25:48.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.300+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3c0a5990 con 0x7f7c3c0c3830 2023-08-27T11:25:48.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.301+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c2c00cbb0 con 0x7f7c3c0c3830 2023-08-27T11:25:48.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.303+0000 7f7c337fe700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 0x7f7c1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.303+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7c2c088540 con 0x7f7c3c0c3830 2023-08-27T11:25:48.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.303+0000 7f7c33fff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 0x7f7c1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.303+0000 7f7c33fff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 0x7f7c1c06c5a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0a6e30 tx=0x7f7c24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.308+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7c2c057650 con 0x7f7c3c0c3830 2023-08-27T11:25:48.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.519+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c3c0a8730 con 0x7f7c3c0c3830 2023-08-27T11:25:48.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.519+0000 7f7c337fe700 1 -- 172.21.15.43:0/823265184 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c3c0a8730 con 0x7f7c3c0c3830 2023-08-27T11:25:48.522 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:25:48.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.521+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 msgr2=0x7f7c1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.521+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 0x7f7c1c06c5a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0a6e30 tx=0x7f7c24009040 comp rx=0 tx=0).stop 2023-08-27T11:25:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.521+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 msgr2=0x7f7c3c149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.521+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00e870 tx=0x7f7c2c00ec30 comp rx=0 tx=0).stop 2023-08-27T11:25:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.521+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 shutdown_connections 2023-08-27T11:25:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7c1c06a0e0 0x7f7c1c06c5a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c3c151bc0 0x7f7c3c0a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7c3c0c3830 0x7f7c3c149f60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 --2- 172.21.15.43:0/823265184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c3c0c4230 0x7f7c3c0a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 >> 172.21.15.43:0/823265184 conn(0x7f7c3c0c5b10 msgr2=0x7f7c3c14eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 shutdown_connections 2023-08-27T11:25:48.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.522+0000 7f7c417ff700 1 -- 172.21.15.43:0/823265184 wait complete. 2023-08-27T11:25:48.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:25:48.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.743+0000 7f7d21bff700 1 Processor -- start 2023-08-27T11:25:48.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.743+0000 7f7d21bff700 1 -- start start 2023-08-27T11:25:48.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.744+0000 7f7d21bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d1c0c0020 0x7f7d1c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.744+0000 7f7d21bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d1c071f70 0x7f7d1c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.744+0000 7f7d21bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1c157af0 con 0x7f7d1c0724c0 2023-08-27T11:25:48.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d21bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c158a80 con 0x7f7d1c071f70 2023-08-27T11:25:48.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d21bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d1c0a6040 con 0x7f7d1c0c0020 2023-08-27T11:25:48.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d1c071f70 0x7f7d1c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7d1c071f70 0x7f7d1c1518b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39300/0 (socket says 172.21.15.43:39300) 2023-08-27T11:25:48.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 -- 172.21.15.43:0/2791216900 learned_addr learned my addr 172.21.15.43:0/2791216900 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:48.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1b7fe700 1 --2- 172.21.15.43:0/2791216900 >> v2:172.21.15.57:3300/0 conn(0x7f7d1c0c0020 0x7f7d1c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 -- 172.21.15.43:0/2791216900 >> v2:172.21.15.57:3300/0 conn(0x7f7d1c0c0020 msgr2=0x7f7d1c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:48.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 --2- 172.21.15.43:0/2791216900 >> v2:172.21.15.57:3300/0 conn(0x7f7d1c0c0020 0x7f7d1c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 -- 172.21.15.43:0/2791216900 >> v1:172.21.15.57:6789/0 conn(0x7f7d1c0724c0 legacy=0x7f7d1c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:48.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.745+0000 7f7d1affd700 1 -- 172.21.15.43:0/2791216900 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c0a6320 con 0x7f7d1c071f70 2023-08-27T11:25:48.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d1affd700 1 --2- 172.21.15.43:0/2791216900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c1518b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0c1060 tx=0x7f7d10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693e846b69fdf86 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d1a7fc700 1 -- 172.21.15.43:0/2791216900 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10004230 con 0x7f7d1c071f70 2023-08-27T11:25:48.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d1a7fc700 1 -- 172.21.15.43:0/2791216900 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10004390 con 0x7f7d1c071f70 2023-08-27T11:25:48.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d1a7fc700 1 -- 172.21.15.43:0/2791216900 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100036a0 con 0x7f7d1c071f70 2023-08-27T11:25:48.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d21bff700 1 -- 172.21.15.43:0/2791216900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 msgr2=0x7f7d1c1518b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d21bff700 1 --2- 172.21.15.43:0/2791216900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c1518b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0c1060 tx=0x7f7d10009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.746+0000 7f7d21bff700 1 -- 172.21.15.43:0/2791216900 shutdown_connections 2023-08-27T11:25:48.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.747+0000 7f7d21bff700 1 --2- 172.21.15.43:0/2791216900 >> v2:172.21.15.57:3300/0 conn(0x7f7d1c0c0020 0x7f7d1c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.747+0000 7f7d21bff700 1 --2- 172.21.15.43:0/2791216900 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c1518b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.747+0000 7f7d21bff700 1 -- 172.21.15.43:0/2791216900 >> 172.21.15.43:0/2791216900 conn(0x7f7d1c0c6a40 msgr2=0x7f7d1c0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:48.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.747+0000 7f7d21bff700 1 -- 172.21.15.43:0/2791216900 shutdown_connections 2023-08-27T11:25:48.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.747+0000 7f7d21bff700 1 -- 172.21.15.43:0/2791216900 wait complete. 2023-08-27T11:25:48.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.748+0000 7f7d21bff700 1 Processor -- start 2023-08-27T11:25:48.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.748+0000 7f7d21bff700 1 -- start start 2023-08-27T11:25:48.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d1c0724c0 0x7f7d1c0a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 0x7f7d1c1e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c154e90 con 0x7f7d1c071f70 2023-08-27T11:25:48.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c153d40 con 0x7f7d1c0c0020 2023-08-27T11:25:48.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.749+0000 7f7d21bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c155130 con 0x7f7d1c0724c0 2023-08-27T11:25:48.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:39308/0 (socket says 172.21.15.43:39308) 2023-08-27T11:25:48.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 -- 172.21.15.43:0/3713135156 learned_addr learned my addr 172.21.15.43:0/3713135156 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:48.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1affd700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d1c0724c0 0x7f7d1c0a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1bfff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 0x7f7d1c1e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 -- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d1c0724c0 msgr2=0x7f7d1c0a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d1c0724c0 0x7f7d1c0a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 -- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 msgr2=0x7f7d1c1e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 0x7f7d1c1e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 -- 172.21.15.43:0/3713135156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009550 con 0x7f7d1c071f70 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1bfff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 0x7f7d1c1e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:48.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.750+0000 7f7d1b7fe700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00e810 tx=0x7f7d0c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.751+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c013610 con 0x7f7d1c071f70 2023-08-27T11:25:48.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.751+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c013770 con 0x7f7d1c071f70 2023-08-27T11:25:48.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.751+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c013b20 con 0x7f7d1c071f70 2023-08-27T11:25:48.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.751+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c153fe0 con 0x7f7d1c071f70 2023-08-27T11:25:48.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.751+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c06b780 con 0x7f7d1c071f70 2023-08-27T11:25:48.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.752+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c0c4af0 con 0x7f7d1c071f70 2023-08-27T11:25:48.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.753+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d0c013c80 con 0x7f7d1c071f70 2023-08-27T11:25:48.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.754+0000 7f7d03fff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 0x7f7d0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:48.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.754+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7d0c088290 con 0x7f7d1c071f70 2023-08-27T11:25:48.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.754+0000 7f7d1affd700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 0x7f7d0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:48.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.755+0000 7f7d1affd700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 0x7f7d0806c5a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009130 tx=0x7f7d10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:48.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.758+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d0c057320 con 0x7f7d1c071f70 2023-08-27T11:25:48.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.968+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d1c04ee70 con 0x7f7d1c071f70 2023-08-27T11:25:48.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.968+0000 7f7d03fff700 1 -- 172.21.15.43:0/3713135156 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d0c056eb0 con 0x7f7d1c071f70 2023-08-27T11:25:48.971 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:25:48.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.970+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 msgr2=0x7f7d0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.970+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 0x7f7d0806c5a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009130 tx=0x7f7d10008030 comp rx=0 tx=0).stop 2023-08-27T11:25:48.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.970+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 msgr2=0x7f7d1c154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:48.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.970+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00e810 tx=0x7f7d0c00eb20 comp rx=0 tx=0).stop 2023-08-27T11:25:48.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 shutdown_connections 2023-08-27T11:25:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0806a0e0 0x7f7d0806c5a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d1c0c0020 0x7f7d1c1e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d1c071f70 0x7f7d1c154500 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 --2- 172.21.15.43:0/3713135156 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d1c0724c0 0x7f7d1c0a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 >> 172.21.15.43:0/3713135156 conn(0x7f7d1c0c6a40 msgr2=0x7f7d1c06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 shutdown_connections 2023-08-27T11:25:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:48.971+0000 7f7d21bff700 1 -- 172.21.15.43:0/3713135156 wait complete. 2023-08-27T11:25:48.993 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:49.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.192+0000 7fb20bfff700 1 Processor -- start 2023-08-27T11:25:49.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.192+0000 7fb20bfff700 1 -- start start 2023-08-27T11:25:49.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2040a76f0 0x7fb204153df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb204150f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb204154d20 con 0x7fb204151480 2023-08-27T11:25:49.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040c3ec0 con 0x7fb2040a76f0 2023-08-27T11:25:49.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204154480 con 0x7fb2040bad90 2023-08-27T11:25:49.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2040a76f0 0x7fb204153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20a59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb204151480 0x7fb2040bb680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37190/0 (socket says 172.21.15.43:37190) 2023-08-27T11:25:49.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20a59c700 1 -- 172.21.15.43:0/3444640761 learned_addr learned my addr 172.21.15.43:0/3444640761 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:49.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20959a700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb204150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 -- 172.21.15.43:0/3444640761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 msgr2=0x7fb204150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:49.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb204150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 -- 172.21.15.43:0/3444640761 >> v1:172.21.15.43:6789/0 conn(0x7fb204151480 legacy=0x7fb2040bb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 -- 172.21.15.43:0/3444640761 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204154760 con 0x7fb2040a76f0 2023-08-27T11:25:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb208d99700 1 -- 172.21.15.43:0/3444640761 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178492269 0 0) 0x7fb204154d20 con 0x7fb204151480 2023-08-27T11:25:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb209d9b700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2040a76f0 0x7fb204153df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb200009840 tx=0x7fb200009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22239e59985438b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb208d99700 1 -- 172.21.15.43:0/3444640761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011830 con 0x7fb2040a76f0 2023-08-27T11:25:49.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb208d99700 1 -- 172.21.15.43:0/3444640761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200011990 con 0x7fb2040a76f0 2023-08-27T11:25:49.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb208d99700 1 -- 172.21.15.43:0/3444640761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011d20 con 0x7fb2040a76f0 2023-08-27T11:25:49.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 -- 172.21.15.43:0/3444640761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2040a76f0 msgr2=0x7fb204153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.195+0000 7fb20bfff700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2040a76f0 0x7fb204153df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fb200009840 tx=0x7fb200009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:49.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 -- 172.21.15.43:0/3444640761 shutdown_connections 2023-08-27T11:25:49.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2040a76f0 0x7fb204153df0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 --2- 172.21.15.43:0/3444640761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb204150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 -- 172.21.15.43:0/3444640761 >> 172.21.15.43:0/3444640761 conn(0x7fb20406aa50 msgr2=0x7fb2040c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:49.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 -- 172.21.15.43:0/3444640761 shutdown_connections 2023-08-27T11:25:49.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.196+0000 7fb20bfff700 1 -- 172.21.15.43:0/3444640761 wait complete. 2023-08-27T11:25:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.197+0000 7fb20bfff700 1 Processor -- start 2023-08-27T11:25:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 -- start start 2023-08-27T11:25:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2040a76f0 0x7fb2040a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb20414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204072420 con 0x7fb204151480 2023-08-27T11:25:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204070c20 con 0x7fb2040a76f0 2023-08-27T11:25:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.198+0000 7fb20bfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204070f00 con 0x7fb2040bad90 2023-08-27T11:25:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20959a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb20414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb209d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2040a76f0 0x7fb2040a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20959a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb20414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:56950/0 (socket says 172.21.15.43:56950) 2023-08-27T11:25:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20959a700 1 -- 172.21.15.43:0/1562229109 learned_addr learned my addr 172.21.15.43:0/1562229109 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53238/0 (socket says 172.21.15.43:53238) 2023-08-27T11:25:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 -- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 msgr2=0x7fb20414cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb20414cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 -- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2040a76f0 msgr2=0x7fb2040a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2040a76f0 0x7fb2040a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 -- 172.21.15.43:0/1562229109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000094a0 con 0x7fb204151480 2023-08-27T11:25:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.199+0000 7fb20a59c700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00caf0 tx=0x7fb1fc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.200+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00a9e0 con 0x7fb204151480 2023-08-27T11:25:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.200+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc00ab60 con 0x7fb204151480 2023-08-27T11:25:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.200+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20414d490 con 0x7fb204151480 2023-08-27T11:25:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.200+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0070d0 con 0x7fb204151480 2023-08-27T11:25:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.200+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040a8340 con 0x7fb204151480 2023-08-27T11:25:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.201+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb204070a80 con 0x7fb204151480 2023-08-27T11:25:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.202+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1fc007230 con 0x7fb204151480 2023-08-27T11:25:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.203+0000 7fb1fa7fc700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 0x7fb1e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.203+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb1fc088350 con 0x7fb204151480 2023-08-27T11:25:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.203+0000 7fb209d9b700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 0x7fb1e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.204+0000 7fb209d9b700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 0x7fb1e806c5a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb2000090b0 tx=0x7fb200008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.207+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb1fc053a50 con 0x7fb204151480 2023-08-27T11:25:49.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.459+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2040a8d00 con 0x7fb204151480 2023-08-27T11:25:49.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.460+0000 7fb1fa7fc700 1 -- 172.21.15.43:0/1562229109 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fb2040a8d00 con 0x7fb204151480 2023-08-27T11:25:49.463 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:49.463 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":63,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:43.000619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5534":{"gid":5534,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":5,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:49.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 msgr2=0x7fb1e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 0x7fb1e806c5a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb2000090b0 tx=0x7fb200008030 comp rx=0 tx=0).stop 2023-08-27T11:25:49.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 msgr2=0x7fb2040aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00caf0 tx=0x7fb1fc00ce00 comp rx=0 tx=0).stop 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 shutdown_connections 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb1e806a0e0 0x7fb1e806c5a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb204151480 0x7fb2040aa920 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2040a76f0 0x7fb2040a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 --2- 172.21.15.43:0/1562229109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2040bad90 0x7fb20414cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 >> 172.21.15.43:0/1562229109 conn(0x7fb20406aa50 msgr2=0x7fb2040a6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:49.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 shutdown_connections 2023-08-27T11:25:49.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.462+0000 7fb20bfff700 1 -- 172.21.15.43:0/1562229109 wait complete. 2023-08-27T11:25:49.468 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 63 2023-08-27T11:25:49.483 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:49.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.682+0000 7f8e007ff700 1 Processor -- start 2023-08-27T11:25:49.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.682+0000 7f8e007ff700 1 -- start start 2023-08-27T11:25:49.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.683+0000 7f8e007ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.683+0000 7f8e007ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 0x7f8df80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.683+0000 7f8e007ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df806c4e0 con 0x7f8df806ad70 2023-08-27T11:25:49.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.683+0000 7f8e007ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df8155370 con 0x7f8df80c4630 2023-08-27T11:25:49.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.683+0000 7f8e007ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8151e70 con 0x7f8df8151a90 2023-08-27T11:25:49.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfdd9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 0x7f8df80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:56954/0 (socket says 172.21.15.43:56954) 2023-08-27T11:25:49.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 -- 172.21.15.43:0/1940094591 learned_addr learned my addr 172.21.15.43:0/1940094591 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:49.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfdd9a700 1 --2- 172.21.15.43:0/1940094591 >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 0x7f8df80c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:47444/0 (socket says 172.21.15.43:47444) 2023-08-27T11:25:49.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 -- 172.21.15.43:0/1940094591 >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 msgr2=0x7f8df80c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:49.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 --2- 172.21.15.43:0/1940094591 >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 0x7f8df80c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 -- 172.21.15.43:0/1940094591 >> v1:172.21.15.57:6789/0 conn(0x7f8df806ad70 legacy=0x7f8df806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 -- 172.21.15.43:0/1940094591 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8154480 con 0x7f8df8151a90 2023-08-27T11:25:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.684+0000 7f8dfe59b700 1 --2- 172.21.15.43:0/1940094591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8df40098f0 tx=0x7f8df4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b5ed5c5f0d4a29 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8dfd599700 1 -- 172.21.15.43:0/1940094591 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4011830 con 0x7f8df8151a90 2023-08-27T11:25:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8dfd599700 1 -- 172.21.15.43:0/1940094591 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df4011990 con 0x7f8df8151a90 2023-08-27T11:25:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8dfd599700 1 -- 172.21.15.43:0/1940094591 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4011d20 con 0x7f8df8151a90 2023-08-27T11:25:49.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 -- 172.21.15.43:0/1940094591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 msgr2=0x7f8df80c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 --2- 172.21.15.43:0/1940094591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8df40098f0 tx=0x7f8df4009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 -- 172.21.15.43:0/1940094591 shutdown_connections 2023-08-27T11:25:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 --2- 172.21.15.43:0/1940094591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df80c7bb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 --2- 172.21.15.43:0/1940094591 >> v2:172.21.15.57:3300/0 conn(0x7f8df80c4630 0x7f8df80c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 -- 172.21.15.43:0/1940094591 >> 172.21.15.43:0/1940094591 conn(0x7f8df80ab820 msgr2=0x7f8df80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:49.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 -- 172.21.15.43:0/1940094591 shutdown_connections 2023-08-27T11:25:49.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.685+0000 7f8e007ff700 1 -- 172.21.15.43:0/1940094591 wait complete. 2023-08-27T11:25:49.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.687+0000 7f8e007ff700 1 Processor -- start 2023-08-27T11:25:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.687+0000 7f8e007ff700 1 -- start start 2023-08-27T11:25:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8df806ad70 0x7f8df8146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df81e9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df814fd70 con 0x7f8df80c4630 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8150e30 con 0x7f8df806ad70 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8e007ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8154320 con 0x7f8df8151a90 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8dfdd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8dfe59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8df806ad70 0x7f8df8146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8dfdd9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53246/0 (socket says 172.21.15.43:53246) 2023-08-27T11:25:49.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.688+0000 7f8dfdd9a700 1 -- 172.21.15.43:0/450408216 learned_addr learned my addr 172.21.15.43:0/450408216 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfed9c700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df81e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 -- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 msgr2=0x7f8df81e9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df81e9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 -- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8df806ad70 msgr2=0x7f8df8146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8df806ad70 0x7f8df8146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 -- 172.21.15.43:0/450408216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4009550 con 0x7f8df80c4630 2023-08-27T11:25:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8dfdd9a700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8de800e9b0 tx=0x7f8de800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de8009710 con 0x7f8df80c4630 2023-08-27T11:25:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de800ee50 con 0x7f8df80c4630 2023-08-27T11:25:49.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800ca50 con 0x7f8df80c4630 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.689+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df81587e0 con 0x7f8df80c4630 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.690+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df8151250 con 0x7f8df80c4630 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.690+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df804ee70 con 0x7f8df80c4630 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.691+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8de800cbb0 con 0x7f8df80c4630 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.692+0000 7f8deeffd700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 0x7f8ddc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:49.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.692+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8de8088590 con 0x7f8df80c4630 2023-08-27T11:25:49.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.693+0000 7f8dfe59b700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 0x7f8ddc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:49.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.693+0000 7f8dfe59b700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 0x7f8ddc06c5a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009c40 tx=0x7f8df4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:49.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.698+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8de80576a0 con 0x7f8df80c4630 2023-08-27T11:25:49.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.912+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8df806c130 con 0x7f8df80c4630 2023-08-27T11:25:49.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.913+0000 7f8deeffd700 1 -- 172.21.15.43:0/450408216 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f8de800ce60 con 0x7f8df80c4630 2023-08-27T11:25:49.916 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:49.917 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":69,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:39.971957+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/497941784":"2023-08-28T11:25:39.971908+0000","172.21.15.43:6835/497941784":"2023-08-28T11:25:39.971908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 msgr2=0x7f8ddc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 0x7f8ddc06c5a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009c40 tx=0x7f8df4008030 comp rx=0 tx=0).stop 2023-08-27T11:25:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 msgr2=0x7f8df81e6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:49.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8de800e9b0 tx=0x7f8de800ecc0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 shutdown_connections 2023-08-27T11:25:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ddc06a0e0 0x7f8ddc06c5a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8df8151a90 0x7f8df81e9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8df806ad70 0x7f8df8146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 --2- 172.21.15.43:0/450408216 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8df80c4630 0x7f8df81e6d30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 >> 172.21.15.43:0/450408216 conn(0x7f8df80ab820 msgr2=0x7f8df814e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 shutdown_connections 2023-08-27T11:25:49.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:49.916+0000 7f8e007ff700 1 -- 172.21.15.43:0/450408216 wait complete. 2023-08-27T11:25:49.940 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:25:49.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:50.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.142+0000 7ff130dff700 1 Processor -- start 2023-08-27T11:25:50.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.142+0000 7ff130dff700 1 -- start start 2023-08-27T11:25:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff12c151910 0x7ff12c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 0x7ff12c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c158480 con 0x7ff12c151910 2023-08-27T11:25:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0c5ae0 con 0x7ff12c0c15e0 2023-08-27T11:25:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff130dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c1190 con 0x7ff12c0c51a0 2023-08-27T11:25:50.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff12c151910 0x7ff12c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff12c151910 0x7ff12c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53250/0 (socket says 172.21.15.43:53250) 2023-08-27T11:25:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 -- 172.21.15.43:0/2331285417 learned_addr learned my addr 172.21.15.43:0/2331285417 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff123fff700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12ad9d700 1 --2- 172.21.15.43:0/2331285417 >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 0x7ff12c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 -- 172.21.15.43:0/2331285417 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 msgr2=0x7ff12c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 -- 172.21.15.43:0/2331285417 >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 msgr2=0x7ff12c0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:50.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 --2- 172.21.15.43:0/2331285417 >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 0x7ff12c0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 -- 172.21.15.43:0/2331285417 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c072900 con 0x7ff12c151910 2023-08-27T11:25:50.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12ad9d700 1 --2- 172.21.15.43:0/2331285417 >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 0x7ff12c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.143+0000 7ff12a59c700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c157a00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff12c067650 tx=0x7ff11c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80ea250b14e2eff server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff129d9b700 1 -- 172.21.15.43:0/2331285417 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c011830 con 0x7ff12c151910 2023-08-27T11:25:50.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff129d9b700 1 -- 172.21.15.43:0/2331285417 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c011990 con 0x7ff12c151910 2023-08-27T11:25:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff129d9b700 1 -- 172.21.15.43:0/2331285417 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c011d20 con 0x7ff12c151910 2023-08-27T11:25:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 -- 172.21.15.43:0/2331285417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 msgr2=0x7ff12c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c157a00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff12c067650 tx=0x7ff11c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 -- 172.21.15.43:0/2331285417 shutdown_connections 2023-08-27T11:25:50.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 --2- 172.21.15.43:0/2331285417 >> v2:172.21.15.57:3300/0 conn(0x7ff12c0c15e0 0x7ff12c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c157a00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 --2- 172.21.15.43:0/2331285417 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 -- 172.21.15.43:0/2331285417 >> 172.21.15.43:0/2331285417 conn(0x7ff12c0a9740 msgr2=0x7ff12c0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:50.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 -- 172.21.15.43:0/2331285417 shutdown_connections 2023-08-27T11:25:50.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.145+0000 7ff130dff700 1 -- 172.21.15.43:0/2331285417 wait complete. 2023-08-27T11:25:50.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.147+0000 7ff130dff700 1 Processor -- start 2023-08-27T11:25:50.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.147+0000 7ff130dff700 1 -- start start 2023-08-27T11:25:50.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff12c0c15e0 0x7ff12c0a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c152280 con 0x7ff12c151910 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c06d230 con 0x7ff12c0c15e0 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c1edb10 con 0x7ff12c0c51a0 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53252/0 (socket says 172.21.15.43:53252) 2023-08-27T11:25:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 -- 172.21.15.43:0/1665643292 learned_addr learned my addr 172.21.15.43:0/1665643292 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12a59c700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff12c0c15e0 0x7ff12c0a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff123fff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 -- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 msgr2=0x7ff12c1ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c1ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 -- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff12c0c15e0 msgr2=0x7ff12c0a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff12c0c15e0 0x7ff12c0a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 -- 172.21.15.43:0/1665643292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009550 con 0x7ff12c151910 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff12ad9d700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff124007e40 tx=0x7ff12400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400dd20 con 0x7ff12c151910 2023-08-27T11:25:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12400f040 con 0x7ff12c151910 2023-08-27T11:25:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c1eddf0 con 0x7ff12c151910 2023-08-27T11:25:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.149+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400dea0 con 0x7ff12c151910 2023-08-27T11:25:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.151+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c1ed810 con 0x7ff12c151910 2023-08-27T11:25:50.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.152+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c06dea0 con 0x7ff12c151910 2023-08-27T11:25:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.152+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff124003c60 con 0x7ff12c151910 2023-08-27T11:25:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.152+0000 7ff122ffd700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 0x7ff10c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.153+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ff124088580 con 0x7ff12c151910 2023-08-27T11:25:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.153+0000 7ff12a59c700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 0x7ff10c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.153+0000 7ff12a59c700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 0x7ff10c06c5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c10 tx=0x7ff11c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.158+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff12c06dea0 con 0x7ff12c151910 2023-08-27T11:25:50.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.418+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff12c06dea0 con 0x7ff12c151910 2023-08-27T11:25:50.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.419+0000 7ff122ffd700 1 -- 172.21.15.43:0/1665643292 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4874 (secure 0 0 0) 0x7ff12c06dea0 con 0x7ff12c151910 2023-08-27T11:25:50.421 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:50.421 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":63,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:43.000619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5534":{"gid":5534,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":5,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:50.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 msgr2=0x7ff10c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 0x7ff10c06c5a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c10 tx=0x7ff11c008030 comp rx=0 tx=0).stop 2023-08-27T11:25:50.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 msgr2=0x7ff12c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff124007e40 tx=0x7ff12400d3b0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 shutdown_connections 2023-08-27T11:25:50.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff10c06a0e0 0x7ff10c06c5a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff12c151910 0x7ff12c152f50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff12c0c15e0 0x7ff12c0a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.421+0000 7ff130dff700 1 --2- 172.21.15.43:0/1665643292 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff12c0c51a0 0x7ff12c1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.422+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 >> 172.21.15.43:0/1665643292 conn(0x7ff12c0a9740 msgr2=0x7ff12c0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:50.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.422+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 shutdown_connections 2023-08-27T11:25:50.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.422+0000 7ff130dff700 1 -- 172.21.15.43:0/1665643292 wait complete. 2023-08-27T11:25:50.426 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 63 2023-08-27T11:25:50.442 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:25:50.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.642+0000 7fc9ef3ff700 1 Processor -- start 2023-08-27T11:25:50.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.642+0000 7fc9ef3ff700 1 -- start start 2023-08-27T11:25:50.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ef3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9e80c4630 0x7fc9e80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ef3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9e806ad70 0x7fc9e806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ef3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e806c4e0 con 0x7fc9e8151a90 2023-08-27T11:25:50.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ef3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e8155370 con 0x7fc9e80c4630 2023-08-27T11:25:50.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ef3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80c82c0 con 0x7fc9e806ad70 2023-08-27T11:25:50.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ec99a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc9e80c4630 0x7fc9e80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ed19b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc9e8151a90 0x7fc9e80c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37192/0 (socket says 172.21.15.43:37192) 2023-08-27T11:25:50.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.643+0000 7fc9ed19b700 1 -- 172.21.15.43:0/3096593524 learned_addr learned my addr 172.21.15.43:0/3096593524 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:50.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ed99c700 1 --2- 172.21.15.43:0/3096593524 >> v2:172.21.15.57:3300/0 conn(0x7fc9e806ad70 0x7fc9e806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3096593524 >> v2:172.21.15.57:3300/0 conn(0x7fc9e806ad70 msgr2=0x7fc9e806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:50.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ec99a700 1 --2- 172.21.15.43:0/3096593524 >> v2:172.21.15.57:3300/0 conn(0x7fc9e806ad70 0x7fc9e806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3096593524 >> v1:172.21.15.43:6789/0 conn(0x7fc9e8151a90 legacy=0x7fc9e80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3096593524 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e8151e70 con 0x7fc9e80c4630 2023-08-27T11:25:50.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9dffff700 1 -- 172.21.15.43:0/3096593524 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473695127 0 0) 0x7fc9e806c4e0 con 0x7fc9e8151a90 2023-08-27T11:25:50.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9ec99a700 1 --2- 172.21.15.43:0/3096593524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e80c4a90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80c4270 tx=0x7fc9d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c499a3ed73a114 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9dffff700 1 -- 172.21.15.43:0/3096593524 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011830 con 0x7fc9e80c4630 2023-08-27T11:25:50.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9dffff700 1 -- 172.21.15.43:0/3096593524 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8011990 con 0x7fc9e80c4630 2023-08-27T11:25:50.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.644+0000 7fc9dffff700 1 -- 172.21.15.43:0/3096593524 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011d20 con 0x7fc9e80c4630 2023-08-27T11:25:50.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3096593524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 msgr2=0x7fc9e80c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3096593524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e80c4a90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80c4270 tx=0x7fc9d8009b20 comp rx=0 tx=0).stop 2023-08-27T11:25:50.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3096593524 shutdown_connections 2023-08-27T11:25:50.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3096593524 >> v2:172.21.15.57:3300/0 conn(0x7fc9e806ad70 0x7fc9e806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3096593524 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e80c4a90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3096593524 >> 172.21.15.43:0/3096593524 conn(0x7fc9e80ab820 msgr2=0x7fc9e80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:50.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3096593524 shutdown_connections 2023-08-27T11:25:50.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.645+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3096593524 wait complete. 2023-08-27T11:25:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.647+0000 7fc9ef3ff700 1 Processor -- start 2023-08-27T11:25:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.647+0000 7fc9ef3ff700 1 -- start start 2023-08-27T11:25:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 0x7fc9e81e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e8151a90 0x7fc9e814a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80ab5d0 con 0x7fc9e80c4630 2023-08-27T11:25:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e814cfe0 con 0x7fc9e8151a90 2023-08-27T11:25:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ef3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8146e70 con 0x7fc9e806ad70 2023-08-27T11:25:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ec99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ec99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53274/0 (socket says 172.21.15.43:53274) 2023-08-27T11:25:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3931181092 learned_addr learned my addr 172.21.15.43:0/3931181092 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ed99c700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e8151a90 0x7fc9e814a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.648+0000 7fc9ed19b700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 0x7fc9e81e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 msgr2=0x7fc9e81e9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 0x7fc9e81e9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e8151a90 msgr2=0x7fc9e814a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e8151a90 0x7fc9e814a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 -- 172.21.15.43:0/3931181092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d80094a0 con 0x7fc9e80c4630 2023-08-27T11:25:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ed19b700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 0x7fc9e81e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:50.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ec99a700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000c00 tx=0x7fc9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80045d0 con 0x7fc9e80c4630 2023-08-27T11:25:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d801f070 con 0x7fc9e80c4630 2023-08-27T11:25:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d80038e0 con 0x7fc9e80c4630 2023-08-27T11:25:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e81e98b0 con 0x7fc9e80c4630 2023-08-27T11:25:50.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.649+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e81468b0 con 0x7fc9e80c4630 2023-08-27T11:25:50.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.650+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e804ee70 con 0x7fc9e80c4630 2023-08-27T11:25:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.651+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc9d8003a40 con 0x7fc9e80c4630 2023-08-27T11:25:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.652+0000 7fc9ddffb700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 0x7fc9cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.652+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc9d8021070 con 0x7fc9e80c4630 2023-08-27T11:25:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.652+0000 7fc9ed19b700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 0x7fc9cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:50.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.653+0000 7fc9ed19b700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 0x7fc9cc06c5a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000f60 tx=0x7fc9e4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:50.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.656+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc9d80555e0 con 0x7fc9e80c4630 2023-08-27T11:25:50.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.909+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9e806c130 con 0x7fc9e80c4630 2023-08-27T11:25:50.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.910+0000 7fc9ddffb700 1 -- 172.21.15.43:0/3931181092 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fc9d802b090 con 0x7fc9e80c4630 2023-08-27T11:25:50.912 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:50.912 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":63,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:25:25.420723+0000","modified":"2023-08-27T11:25:43.000619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5534":{"gid":5534,"name":"d","rank":0,"incarnation":60,"state":"up:active","state_seq":9,"addr":"172.21.15.57:6835/2049507141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2049507141},{"type":"v1","addr":"172.21.15.57:6835","nonce":2049507141}]},"join_fscid":5,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-27T11:25:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 msgr2=0x7fc9cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 0x7fc9cc06c5a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4000f60 tx=0x7fc9e4007d30 comp rx=0 tx=0).stop 2023-08-27T11:25:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 msgr2=0x7fc9e8143c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000c00 tx=0x7fc9d8004750 comp rx=0 tx=0).stop 2023-08-27T11:25:50.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 shutdown_connections 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc9cc06a0e0 0x7fc9cc06c5a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9e8151a90 0x7fc9e814a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9e806ad70 0x7fc9e81e9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 --2- 172.21.15.43:0/3931181092 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc9e80c4630 0x7fc9e8143c40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 >> 172.21.15.43:0/3931181092 conn(0x7fc9e80ab820 msgr2=0x7fc9e80c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:50.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 shutdown_connections 2023-08-27T11:25:50.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:50.912+0000 7fc9ef3ff700 1 -- 172.21.15.43:0/3931181092 wait complete. 2023-08-27T11:25:50.916 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 63 2023-08-27T11:25:50.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:51.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.132+0000 7febb89ff700 1 Processor -- start 2023-08-27T11:25:51.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.132+0000 7febb89ff700 1 -- start start 2023-08-27T11:25:51.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb89ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7febb40c4630 0x7febb40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb89ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 0x7febb406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb89ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb406c4e0 con 0x7febb4151a90 2023-08-27T11:25:51.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb89ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb4155370 con 0x7febb40c4630 2023-08-27T11:25:51.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb89ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb40c82c0 con 0x7febb406ad70 2023-08-27T11:25:51.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febabfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7febb40c4630 0x7febb40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febabfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7febb40c4630 0x7febb40c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53280/0 (socket says 172.21.15.43:53280) 2023-08-27T11:25:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febabfff700 1 -- 172.21.15.43:0/2670563634 learned_addr learned my addr 172.21.15.43:0/2670563634 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.133+0000 7febb2d9d700 1 --2- 172.21.15.43:0/2670563634 >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 0x7febb406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febabfff700 1 -- 172.21.15.43:0/2670563634 >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 msgr2=0x7febb406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febabfff700 1 --2- 172.21.15.43:0/2670563634 >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 0x7febb406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febabfff700 1 -- 172.21.15.43:0/2670563634 >> v1:172.21.15.57:6789/0 conn(0x7febb4151a90 legacy=0x7febb40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febabfff700 1 -- 172.21.15.43:0/2670563634 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4151e70 con 0x7febb40c4630 2023-08-27T11:25:51.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febb2d9d700 1 --2- 172.21.15.43:0/2670563634 >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 0x7febb406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:51.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febabfff700 1 --2- 172.21.15.43:0/2670563634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb40c4630 0x7febb40c4a90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7febb40c4270 tx=0x7feb9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c074ea73773520 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febb1d9b700 1 -- 172.21.15.43:0/2670563634 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00b870 con 0x7febb40c4630 2023-08-27T11:25:51.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febb1d9b700 1 -- 172.21.15.43:0/2670563634 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c00b9d0 con 0x7febb40c4630 2023-08-27T11:25:51.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.134+0000 7febb1d9b700 1 -- 172.21.15.43:0/2670563634 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00bd60 con 0x7febb40c4630 2023-08-27T11:25:51.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 -- 172.21.15.43:0/2670563634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb40c4630 msgr2=0x7febb40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 --2- 172.21.15.43:0/2670563634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb40c4630 0x7febb40c4a90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7febb40c4270 tx=0x7feb9c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 -- 172.21.15.43:0/2670563634 shutdown_connections 2023-08-27T11:25:51.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 --2- 172.21.15.43:0/2670563634 >> v2:172.21.15.57:3300/0 conn(0x7febb406ad70 0x7febb406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 --2- 172.21.15.43:0/2670563634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb40c4630 0x7febb40c4a90 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 -- 172.21.15.43:0/2670563634 >> 172.21.15.43:0/2670563634 conn(0x7febb40ab820 msgr2=0x7febb40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 -- 172.21.15.43:0/2670563634 shutdown_connections 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.135+0000 7febb89ff700 1 -- 172.21.15.43:0/2670563634 wait complete. 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.137+0000 7febb89ff700 1 Processor -- start 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.137+0000 7febb89ff700 1 -- start start 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb406ad70 0x7febb4147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febb40c4630 0x7febb414a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb41479b0 con 0x7febb4151a90 2023-08-27T11:25:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb41ea000 con 0x7febb406ad70 2023-08-27T11:25:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb41ea2e0 con 0x7febb40c4630 2023-08-27T11:25:51.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53290/0 (socket says 172.21.15.43:53290) 2023-08-27T11:25:51.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 -- 172.21.15.43:0/190025467 learned_addr learned my addr 172.21.15.43:0/190025467 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:51.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febabfff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febb40c4630 0x7febb414a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb259c700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb406ad70 0x7febb4147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 -- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febb40c4630 msgr2=0x7febb414a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febb40c4630 0x7febb414a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 -- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb406ad70 msgr2=0x7febb4147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb406ad70 0x7febb4147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.138+0000 7febb2d9d700 1 -- 172.21.15.43:0/190025467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009550 con 0x7febb4151a90 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febb2d9d700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7febac009fa0 tx=0x7febac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00de60 con 0x7febb4151a90 2023-08-27T11:25:51.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00f040 con 0x7febb4151a90 2023-08-27T11:25:51.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb4147360 con 0x7febb4151a90 2023-08-27T11:25:51.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac003c80 con 0x7febb4151a90 2023-08-27T11:25:51.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.139+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb414a550 con 0x7febb4151a90 2023-08-27T11:25:51.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.140+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb4072450 con 0x7febb4151a90 2023-08-27T11:25:51.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.141+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7febac004030 con 0x7febb4151a90 2023-08-27T11:25:51.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.142+0000 7febaaffd700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 0x7feb9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.142+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7febac088750 con 0x7febb4151a90 2023-08-27T11:25:51.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.142+0000 7febb259c700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 0x7feb9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.143+0000 7febb259c700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 0x7feb9406c5a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feba4000f60 tx=0x7feba4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.146+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7febac053dd0 con 0x7febb4151a90 2023-08-27T11:25:51.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.357+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febb404ee70 con 0x7febb4151a90 2023-08-27T11:25:51.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.359+0000 7febaaffd700 1 -- 172.21.15.43:0/190025467 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+18363 (secure 0 0 0) 0x7febac0573f0 con 0x7febb4151a90 2023-08-27T11:25:51.360 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:51.361 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":69,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:39.971957+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:25:23.005792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-27T11:25:24.403156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/497941784":"2023-08-28T11:25:39.971908+0000","172.21.15.43:6835/497941784":"2023-08-28T11:25:39.971908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:51.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 msgr2=0x7feb9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 0x7feb9406c5a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feba4000f60 tx=0x7feba4009040 comp rx=0 tx=0).stop 2023-08-27T11:25:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 msgr2=0x7febb40be320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7febac009fa0 tx=0x7febac00d3b0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 shutdown_connections 2023-08-27T11:25:51.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb9406a0e0 0x7feb9406c5a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7febb4151a90 0x7febb40be320 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7febb406ad70 0x7febb4147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 --2- 172.21.15.43:0/190025467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7febb40c4630 0x7febb414a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 >> 172.21.15.43:0/190025467 conn(0x7febb40ab820 msgr2=0x7febb414e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:51.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 shutdown_connections 2023-08-27T11:25:51.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.361+0000 7febb89ff700 1 -- 172.21.15.43:0/190025467 wait complete. 2023-08-27T11:25:51.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:25:51.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.581+0000 7f5c4c3ff700 1 Processor -- start 2023-08-27T11:25:51.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.581+0000 7f5c4c3ff700 1 -- start start 2023-08-27T11:25:51.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.582+0000 7f5c4c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 0x7f5c44152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.582+0000 7f5c4c3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 0x7f5c4406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4c3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4414fcb0 con 0x7f5c4406e290 2023-08-27T11:25:51.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4c3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c44072960 con 0x7f5c44071890 2023-08-27T11:25:51.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440c4f80 con 0x7f5c440c4ba0 2023-08-27T11:25:51.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4a99c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5c4406e290 0x7f5c440c5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37194/0 (socket says 172.21.15.43:37194) 2023-08-27T11:25:51.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4a99c700 1 -- 172.21.15.43:0/1722873903 learned_addr learned my addr 172.21.15.43:0/1722873903 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:51.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4999a700 1 --2- 172.21.15.43:0/1722873903 >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 0x7f5c4406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/1722873903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 0x7f5c44152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c49199700 1 -- 172.21.15.43:0/1722873903 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084845366 0 0) 0x7f5c4414fcb0 con 0x7f5c4406e290 2023-08-27T11:25:51.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.583+0000 7f5c49199700 1 -- 172.21.15.43:0/1722873903 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c300035b0 con 0x7f5c4406e290 2023-08-27T11:25:51.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4a19b700 1 -- 172.21.15.43:0/1722873903 >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 msgr2=0x7f5c4406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:51.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/1722873903 >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 0x7f5c4406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4a19b700 1 -- 172.21.15.43:0/1722873903 >> v1:172.21.15.43:6789/0 conn(0x7f5c4406e290 legacy=0x7f5c440c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4a19b700 1 -- 172.21.15.43:0/1722873903 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44071de0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4999a700 1 --2- 172.21.15.43:0/1722873903 >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 0x7f5c4406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:51.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/1722873903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 0x7f5c44152230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009840 tx=0x7f5c40009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f68383068e140260 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c49199700 1 -- 172.21.15.43:0/1722873903 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40011830 con 0x7f5c440c4ba0 2023-08-27T11:25:51.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c49199700 1 -- 172.21.15.43:0/1722873903 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40011990 con 0x7f5c440c4ba0 2023-08-27T11:25:51.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.584+0000 7f5c49199700 1 -- 172.21.15.43:0/1722873903 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40011d20 con 0x7f5c440c4ba0 2023-08-27T11:25:51.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/1722873903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 msgr2=0x7f5c44152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/1722873903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 0x7f5c44152230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009840 tx=0x7f5c40009b50 comp rx=0 tx=0).stop 2023-08-27T11:25:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/1722873903 shutdown_connections 2023-08-27T11:25:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/1722873903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c440c4ba0 0x7f5c44152230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/1722873903 >> v2:172.21.15.57:3300/0 conn(0x7f5c44071890 0x7f5c4406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/1722873903 >> 172.21.15.43:0/1722873903 conn(0x7f5c440a9740 msgr2=0x7f5c440a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/1722873903 shutdown_connections 2023-08-27T11:25:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.585+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/1722873903 wait complete. 2023-08-27T11:25:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.587+0000 7f5c4c3ff700 1 Processor -- start 2023-08-27T11:25:51.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.587+0000 7f5c4c3ff700 1 -- start start 2023-08-27T11:25:51.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c4406e290 0x7f5c441ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c44071890 0x7f5c441eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44153780 con 0x7f5c440c4ba0 2023-08-27T11:25:51.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c44153a60 con 0x7f5c44071890 2023-08-27T11:25:51.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4c3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441ecb80 con 0x7f5c4406e290 2023-08-27T11:25:51.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53294/0 (socket says 172.21.15.43:53294) 2023-08-27T11:25:51.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a99c700 1 -- 172.21.15.43:0/571382863 learned_addr learned my addr 172.21.15.43:0/571382863 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:51.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c4406e290 0x7f5c441ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4999a700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c44071890 0x7f5c441eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a99c700 1 -- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c4406e290 msgr2=0x7f5c441ea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.588+0000 7f5c4a99c700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c4406e290 0x7f5c441ea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4a99c700 1 -- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c44071890 msgr2=0x7f5c441eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4a99c700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c44071890 0x7f5c441eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4a99c700 1 -- 172.21.15.43:0/571382863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340094a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4a99c700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00caa0 tx=0x7f5c3c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00a9e0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00ab40 con 0x7f5c440c4ba0 2023-08-27T11:25:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400094a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012400 con 0x7f5c440c4ba0 2023-08-27T11:25:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.589+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c44152220 con 0x7f5c440c4ba0 2023-08-27T11:25:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.590+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c441ed0a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.591+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c3c01b3b0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.593+0000 7f5c3affd700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 0x7f5c2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:51.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.593+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5c3c088100 con 0x7f5c440c4ba0 2023-08-27T11:25:51.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.593+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 0x7f5c2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:51.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.594+0000 7f5c4a19b700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 0x7f5c2806c5a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009fd0 tx=0x7f5c4001d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:51.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.597+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5c441ed0a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.854+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5c441ed0a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.856 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:25:51.855+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:25:51.873 INFO:tasks.ceph.mds.d.smithi057.stderr: -187> 2023-08-27T11:25:45.150+0000 7ff7fc9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:25:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.859+0000 7f5c3affd700 1 -- 172.21.15.43:0/571382863 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5c441ed0a0 con 0x7f5c440c4ba0 2023-08-27T11:25:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 msgr2=0x7f5c2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 0x7f5c2806c5a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009fd0 tx=0x7f5c4001d040 comp rx=0 tx=0).stop 2023-08-27T11:25:51.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 msgr2=0x7f5c44151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:51.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00caa0 tx=0x7f5c3c00cdb0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 shutdown_connections 2023-08-27T11:25:51.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5c2806a0e0 0x7f5c2806c5a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5c440c4ba0 0x7f5c44151ce0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c4406e290 0x7f5c441ea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 --2- 172.21.15.43:0/571382863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c44071890 0x7f5c441eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:51.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 >> 172.21.15.43:0/571382863 conn(0x7f5c440a9740 msgr2=0x7f5c440c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:51.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 shutdown_connections 2023-08-27T11:25:51.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:51.862+0000 7f5c4c3ff700 1 -- 172.21.15.43:0/571382863 wait complete. 2023-08-27T11:25:51.877 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:25:51.882 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:25:51.918 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:25:52.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.086+0000 7fa5559ff700 1 Processor -- start 2023-08-27T11:25:52.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.086+0000 7fa5559ff700 1 -- start start 2023-08-27T11:25:52.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.087+0000 7fa5559ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 0x7fa5500c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:52.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa5559ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5500c82c0 con 0x7fa550151b20 2023-08-27T11:25:52.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa5559ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55006c450 con 0x7fa55006ad70 2023-08-27T11:25:52.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa5559ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa550151f00 con 0x7fa5500c4630 2023-08-27T11:25:52.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa54effd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa550151b20 0x7fa5500c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37208/0 (socket says 172.21.15.43:37208) 2023-08-27T11:25:52.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa54effd700 1 -- 172.21.15.43:0/2254616789 learned_addr learned my addr 172.21.15.43:0/2254616789 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:25:52.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa54e7fc700 1 --2- 172.21.15.43:0/2254616789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 0x7fa5500c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:52.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109648211 0 0) 0x7fa5500c82c0 con 0x7fa550151b20 2023-08-27T11:25:52.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.088+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5380035b0 con 0x7fa550151b20 2023-08-27T11:25:52.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524726583 0 0) 0x7fa55006c450 con 0x7fa55006ad70 2023-08-27T11:25:52.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5500c82c0 con 0x7fa55006ad70 2023-08-27T11:25:52.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54e7fc700 1 -- 172.21.15.43:0/2254616789 >> v1:172.21.15.57:6789/0 conn(0x7fa55006ad70 legacy=0x7fa55006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3826680410 0 0) 0x7fa5380035b0 con 0x7fa550151b20 2023-08-27T11:25:52.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54e7fc700 1 -- 172.21.15.43:0/2254616789 >> v1:172.21.15.43:6789/0 conn(0x7fa550151b20 legacy=0x7fa5500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54e7fc700 1 -- 172.21.15.43:0/2254616789 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550154760 con 0x7fa5500c4630 2023-08-27T11:25:52.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54e7fc700 1 --2- 172.21.15.43:0/2254616789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 0x7fa5500c4ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa544009850 tx=0x7fa544009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5cccb0ad91c19da server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:52.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540001670 con 0x7fa5500c4630 2023-08-27T11:25:52.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544005c30 con 0x7fa5500c4630 2023-08-27T11:25:52.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.089+0000 7fa54dffb700 1 -- 172.21.15.43:0/2254616789 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544004030 con 0x7fa5500c4630 2023-08-27T11:25:52.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 -- 172.21.15.43:0/2254616789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 msgr2=0x7fa5500c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 --2- 172.21.15.43:0/2254616789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 0x7fa5500c4ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa544009850 tx=0x7fa544009b60 comp rx=0 tx=0).stop 2023-08-27T11:25:52.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 -- 172.21.15.43:0/2254616789 shutdown_connections 2023-08-27T11:25:52.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 --2- 172.21.15.43:0/2254616789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa5500c4630 0x7fa5500c4ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 -- 172.21.15.43:0/2254616789 >> 172.21.15.43:0/2254616789 conn(0x7fa5500ab820 msgr2=0x7fa5500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:52.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 -- 172.21.15.43:0/2254616789 shutdown_connections 2023-08-27T11:25:52.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.090+0000 7fa5559ff700 1 -- 172.21.15.43:0/2254616789 wait complete. 2023-08-27T11:25:52.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.092+0000 7fa5559ff700 1 Processor -- start 2023-08-27T11:25:52.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.092+0000 7fa5559ff700 1 -- start start 2023-08-27T11:25:52.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55006ad70 0x7fa5500bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:52.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:52.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 0x7fa5500c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:52.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500bee40 con 0x7fa5500c4630 2023-08-27T11:25:52.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500be150 con 0x7fa55006ad70 2023-08-27T11:25:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa5559ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5501eeca0 con 0x7fa550151b20 2023-08-27T11:25:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53302/0 (socket says 172.21.15.43:53302) 2023-08-27T11:25:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 -- 172.21.15.43:0/1599970482 learned_addr learned my addr 172.21.15.43:0/1599970482 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:52.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54effd700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55006ad70 0x7fa5500bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54f7fe700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 0x7fa5500c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 -- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 msgr2=0x7fa5500c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 0x7fa5500c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 -- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55006ad70 msgr2=0x7fa5500bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55006ad70 0x7fa5500bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54e7fc700 1 -- 172.21.15.43:0/1599970482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544009430 con 0x7fa5500c4630 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.093+0000 7fa54f7fe700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 0x7fa5500c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa54e7fc700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa544009eb0 tx=0x7fa544004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544003ab0 con 0x7fa5500c4630 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544003c10 con 0x7fa5500c4630 2023-08-27T11:25:52.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5500be380 con 0x7fa5500c4630 2023-08-27T11:25:52.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54401d430 con 0x7fa5500c4630 2023-08-27T11:25:52.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.094+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5501ef220 con 0x7fa5500c4630 2023-08-27T11:25:52.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.095+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55004ee70 con 0x7fa5500c4630 2023-08-27T11:25:52.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.096+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa54401d590 con 0x7fa5500c4630 2023-08-27T11:25:52.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.097+0000 7fa537fff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 0x7fa53c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:52.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.097+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fa544089960 con 0x7fa5500c4630 2023-08-27T11:25:52.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.097+0000 7fa54effd700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 0x7fa53c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:52.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.098+0000 7fa54effd700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 0x7fa53c06c5a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa540000f60 tx=0x7fa540001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:52.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.102+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa5440550b0 con 0x7fa5500c4630 2023-08-27T11:25:52.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.361+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa55006c130 con 0x7fa5500c4630 2023-08-27T11:25:52.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.862+0000 7fa537fff700 1 -- 172.21.15.43:0/1599970482 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa5440586d0 con 0x7fa5500c4630 2023-08-27T11:25:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 msgr2=0x7fa53c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 0x7fa53c06c5a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa540000f60 tx=0x7fa540001690 comp rx=0 tx=0).stop 2023-08-27T11:25:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 msgr2=0x7fa5501534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:52.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa544009eb0 tx=0x7fa544004750 comp rx=0 tx=0).stop 2023-08-27T11:25:52.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 shutdown_connections 2023-08-27T11:25:52.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa53c06a0e0 0x7fa53c06c5a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa550151b20 0x7fa5500c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa55006ad70 0x7fa5500bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 --2- 172.21.15.43:0/1599970482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa5500c4630 0x7fa5501534b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:52.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 >> 172.21.15.43:0/1599970482 conn(0x7fa5500ab820 msgr2=0x7fa5500c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:52.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 shutdown_connections 2023-08-27T11:25:52.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:52.865+0000 7fa5559ff700 1 -- 172.21.15.43:0/1599970482 wait complete. 2023-08-27T11:25:52.889 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:25:53.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.100+0000 7f3bf49ff700 1 Processor -- start 2023-08-27T11:25:53.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.100+0000 7f3bf49ff700 1 -- start start 2023-08-27T11:25:53.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.101+0000 7f3bf49ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3bf00a77d0 0x7f3bf014e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.101+0000 7f3bf49ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3bf00c50f0 0x7f3bf00c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3bf49ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0152140 con 0x7f3bf00a5090 2023-08-27T11:25:53.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3bf49ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf01515c0 con 0x7f3bf00c50f0 2023-08-27T11:25:53.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3bf49ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf01518a0 con 0x7f3bf00a77d0 2023-08-27T11:25:53.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3bf00c50f0 0x7f3bf00c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3bf00c50f0 0x7f3bf00c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53310/0 (socket says 172.21.15.43:53310) 2023-08-27T11:25:53.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 -- 172.21.15.43:0/3309467479 learned_addr learned my addr 172.21.15.43:0/3309467479 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:53.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3bee59c700 1 --2- 172.21.15.43:0/3309467479 >> v2:172.21.15.57:3300/0 conn(0x7f3bf00a77d0 0x7f3bf014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 -- 172.21.15.43:0/3309467479 >> v2:172.21.15.57:3300/0 conn(0x7f3bf00a77d0 msgr2=0x7f3bf014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:53.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 --2- 172.21.15.43:0/3309467479 >> v2:172.21.15.57:3300/0 conn(0x7f3bf00a77d0 0x7f3bf014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:53.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 -- 172.21.15.43:0/3309467479 >> v1:172.21.15.57:6789/0 conn(0x7f3bf00a5090 legacy=0x7f3bf014e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:53.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.102+0000 7f3beed9d700 1 -- 172.21.15.43:0/3309467479 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0151b80 con 0x7f3bf00c50f0 2023-08-27T11:25:53.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3beed9d700 1 --2- 172.21.15.43:0/3309467479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00c50f0 0x7f3bf00c3b60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c3360 tx=0x7f3be800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3418961ba636aa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:53.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3bedd9b700 1 -- 172.21.15.43:0/3309467479 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8003c20 con 0x7f3bf00c50f0 2023-08-27T11:25:53.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3bedd9b700 1 -- 172.21.15.43:0/3309467479 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8003d80 con 0x7f3bf00c50f0 2023-08-27T11:25:53.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3bedd9b700 1 -- 172.21.15.43:0/3309467479 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be800bbc0 con 0x7f3bf00c50f0 2023-08-27T11:25:53.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3bf49ff700 1 -- 172.21.15.43:0/3309467479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00c50f0 msgr2=0x7f3bf00c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:53.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.103+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/3309467479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00c50f0 0x7f3bf00c3b60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00c3360 tx=0x7f3be800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:53.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 -- 172.21.15.43:0/3309467479 shutdown_connections 2023-08-27T11:25:53.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/3309467479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00c50f0 0x7f3bf00c3b60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:53.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/3309467479 >> v2:172.21.15.57:3300/0 conn(0x7f3bf00a77d0 0x7f3bf014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:53.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 -- 172.21.15.43:0/3309467479 >> 172.21.15.43:0/3309467479 conn(0x7f3bf00c2400 msgr2=0x7f3bf00c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:53.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 -- 172.21.15.43:0/3309467479 shutdown_connections 2023-08-27T11:25:53.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.104+0000 7f3bf49ff700 1 -- 172.21.15.43:0/3309467479 wait complete. 2023-08-27T11:25:53.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.106+0000 7f3bf49ff700 1 Processor -- start 2023-08-27T11:25:53.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.106+0000 7f3bf49ff700 1 -- start start 2023-08-27T11:25:53.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.107+0000 7f3bf49ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.107+0000 7f3bf49ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bf00a77d0 0x7f3bf014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.107+0000 7f3bf49ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 0x7f3bf01505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bf49ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0150150 con 0x7f3bf00a5090 2023-08-27T11:25:53.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bf49ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014f3b0 con 0x7f3bf00c50f0 2023-08-27T11:25:53.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bf49ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf01ecf70 con 0x7f3bf00a77d0 2023-08-27T11:25:53.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53326/0 (socket says 172.21.15.43:53326) 2023-08-27T11:25:53.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 -- 172.21.15.43:0/1067220768 learned_addr learned my addr 172.21.15.43:0/1067220768 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3be7fff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bf00a77d0 0x7f3bf014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3beed9d700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 0x7f3bf01505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 -- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bf00a77d0 msgr2=0x7f3bf014d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bf00a77d0 0x7f3bf014d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 -- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 msgr2=0x7f3bf01505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 0x7f3bf01505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3bee59c700 1 -- 172.21.15.43:0/1067220768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009b30 con 0x7f3bf00a5090 2023-08-27T11:25:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.108+0000 7f3beed9d700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 0x7f3bf01505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3bee59c700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e810 tx=0x7f3be000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0013610 con 0x7f3bf00a5090 2023-08-27T11:25:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0013770 con 0x7f3bf00a5090 2023-08-27T11:25:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0013b20 con 0x7f3bf00a5090 2023-08-27T11:25:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01ed250 con 0x7f3bf00a5090 2023-08-27T11:25:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.109+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf014daf0 con 0x7f3bf00a5090 2023-08-27T11:25:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.110+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf01ed770 con 0x7f3bf00a5090 2023-08-27T11:25:53.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.111+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3be0013c80 con 0x7f3bf00a5090 2023-08-27T11:25:53.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.112+0000 7f3be6ffd700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 0x7f3bd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:53.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.112+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f3be0088330 con 0x7f3bf00a5090 2023-08-27T11:25:53.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.112+0000 7f3be7fff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 0x7f3bd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:53.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.113+0000 7f3be7fff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 0x7f3bd006c5a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3bf01ea430 tx=0x7f3bd8007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:53.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.117+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3bf01ed770 con 0x7f3bf00a5090 2023-08-27T11:25:53.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:53.326+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bf01ed770 con 0x7f3bf00a5090 2023-08-27T11:25:54.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.063+0000 7f3be6ffd700 1 -- 172.21.15.43:0/1067220768 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3bf01ed770 con 0x7f3bf00a5090 2023-08-27T11:25:54.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.069+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 msgr2=0x7f3bd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.069+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 0x7f3bd006c5a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3bf01ea430 tx=0x7f3bd8007ec0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.069+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 msgr2=0x7f3bf01ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.069+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e810 tx=0x7f3be000eb20 comp rx=0 tx=0).stop 2023-08-27T11:25:54.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 shutdown_connections 2023-08-27T11:25:54.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3bd006a0e0 0x7f3bd006c5a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3bf00c50f0 0x7f3bf01505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3bf00a5090 0x7f3bf01ec870 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 --2- 172.21.15.43:0/1067220768 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3bf00a77d0 0x7f3bf014d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 >> 172.21.15.43:0/1067220768 conn(0x7f3bf00c2400 msgr2=0x7f3bf00a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:54.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 shutdown_connections 2023-08-27T11:25:54.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.070+0000 7f3bf49ff700 1 -- 172.21.15.43:0/1067220768 wait complete. 2023-08-27T11:25:54.074 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:25:54.094 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:25:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.304+0000 7fbb56dff700 1 Processor -- start 2023-08-27T11:25:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.305+0000 7fbb56dff700 1 -- start start 2023-08-27T11:25:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb56dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb500c4700 0x7fbb500c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb56dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb5006b780 0x7fbb5006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb56dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb50154730 con 0x7fbb50151a40 2023-08-27T11:25:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb56dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb50154520 con 0x7fbb5006b780 2023-08-27T11:25:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb56dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb50154a10 con 0x7fbb500c4700 2023-08-27T11:25:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb5539c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb5006b780 0x7fbb5006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb5539c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbb5006b780 0x7fbb5006bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53340/0 (socket says 172.21.15.43:53340) 2023-08-27T11:25:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb5539c700 1 -- 172.21.15.43:0/2029478918 learned_addr learned my addr 172.21.15.43:0/2029478918 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.306+0000 7fbb4ffff700 1 --2- 172.21.15.43:0/2029478918 >> v2:172.21.15.57:3300/0 conn(0x7fbb500c4700 0x7fbb500c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb5539c700 1 -- 172.21.15.43:0/2029478918 >> v2:172.21.15.57:3300/0 conn(0x7fbb500c4700 msgr2=0x7fbb500c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb5539c700 1 --2- 172.21.15.43:0/2029478918 >> v2:172.21.15.57:3300/0 conn(0x7fbb500c4700 0x7fbb500c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb5539c700 1 -- 172.21.15.43:0/2029478918 >> v1:172.21.15.57:6789/0 conn(0x7fbb50151a40 legacy=0x7fbb500c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb5539c700 1 -- 172.21.15.43:0/2029478918 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50154cf0 con 0x7fbb5006b780 2023-08-27T11:25:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb5539c700 1 --2- 172.21.15.43:0/2029478918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb5006b780 0x7fbb5006bb90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ac640 tx=0x7fbb4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f929afba5d3032 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb4f7fe700 1 -- 172.21.15.43:0/2029478918 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800e070 con 0x7fbb5006b780 2023-08-27T11:25:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb4f7fe700 1 -- 172.21.15.43:0/2029478918 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4800b910 con 0x7fbb5006b780 2023-08-27T11:25:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.307+0000 7fbb4f7fe700 1 -- 172.21.15.43:0/2029478918 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800bcc0 con 0x7fbb5006b780 2023-08-27T11:25:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 -- 172.21.15.43:0/2029478918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb5006b780 msgr2=0x7fbb5006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 --2- 172.21.15.43:0/2029478918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb5006b780 0x7fbb5006bb90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ac640 tx=0x7fbb4800b330 comp rx=0 tx=0).stop 2023-08-27T11:25:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 -- 172.21.15.43:0/2029478918 shutdown_connections 2023-08-27T11:25:54.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 --2- 172.21.15.43:0/2029478918 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb5006b780 0x7fbb5006bb90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 --2- 172.21.15.43:0/2029478918 >> v2:172.21.15.57:3300/0 conn(0x7fbb500c4700 0x7fbb500c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 -- 172.21.15.43:0/2029478918 >> 172.21.15.43:0/2029478918 conn(0x7fbb500ab890 msgr2=0x7fbb500abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:54.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 -- 172.21.15.43:0/2029478918 shutdown_connections 2023-08-27T11:25:54.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.308+0000 7fbb56dff700 1 -- 172.21.15.43:0/2029478918 wait complete. 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.310+0000 7fbb56dff700 1 Processor -- start 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.310+0000 7fbb56dff700 1 -- start start 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb5006b780 0x7fbb50150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbb500c4700 0x7fbb501ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb501edd30 con 0x7fbb50151a40 2023-08-27T11:25:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb500c38c0 con 0x7fbb5006b780 2023-08-27T11:25:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb56dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5014d840 con 0x7fbb500c4700 2023-08-27T11:25:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53342/0 (socket says 172.21.15.43:53342) 2023-08-27T11:25:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 -- 172.21.15.43:0/4146354130 learned_addr learned my addr 172.21.15.43:0/4146354130 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb4ffff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbb500c4700 0x7fbb501ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb54b9b700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb5006b780 0x7fbb50150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 -- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbb500c4700 msgr2=0x7fbb501ed2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbb500c4700 0x7fbb501ed2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 -- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb5006b780 msgr2=0x7fbb50150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:54.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb5006b780 0x7fbb50150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:54.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.311+0000 7fbb5539c700 1 -- 172.21.15.43:0/4146354130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb48009b30 con 0x7fbb50151a40 2023-08-27T11:25:54.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb5539c700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbb50067780 tx=0x7fbb48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:54.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48004880 con 0x7fbb50151a40 2023-08-27T11:25:54.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb480099b0 con 0x7fbb50151a40 2023-08-27T11:25:54.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb500c2f90 con 0x7fbb50151a40 2023-08-27T11:25:54.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4801c680 con 0x7fbb50151a40 2023-08-27T11:25:54.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.312+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb500c3550 con 0x7fbb50151a40 2023-08-27T11:25:54.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.313+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb500c3a70 con 0x7fbb50151a40 2023-08-27T11:25:54.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.314+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbb4801c7e0 con 0x7fbb50151a40 2023-08-27T11:25:54.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.315+0000 7fbb4d7fa700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 0x7fbb3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:54.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.316+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5796+0+0 (secure 0 0 0) 0x7fbb4808a090 con 0x7fbb50151a40 2023-08-27T11:25:54.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.316+0000 7fbb54b9b700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 0x7fbb3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:54.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.316+0000 7fbb54b9b700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 0x7fbb3406c5a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb44007fd0 tx=0x7fbb44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:54.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.320+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbb500c3a70 con 0x7fbb50151a40 2023-08-27T11:25:54.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:54.531+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb500c3a30 con 0x7fbb50151a40 2023-08-27T11:25:55.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.081+0000 7fbb4d7fa700 1 -- 172.21.15.43:0/4146354130 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbb48055870 con 0x7fbb50151a40 2023-08-27T11:25:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.087+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 msgr2=0x7fbb3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.087+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 0x7fbb3406c5a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbb44007fd0 tx=0x7fbb44009040 comp rx=0 tx=0).stop 2023-08-27T11:25:55.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.087+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 msgr2=0x7fbb501ed7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.087+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbb50067780 tx=0x7fbb48004ad0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 shutdown_connections 2023-08-27T11:25:55.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbb3406a0e0 0x7fbb3406c5a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbb50151a40 0x7fbb501ed7f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb5006b780 0x7fbb50150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 --2- 172.21.15.43:0/4146354130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbb500c4700 0x7fbb501ed2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.088+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 >> 172.21.15.43:0/4146354130 conn(0x7fbb500ab890 msgr2=0x7fbb500c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:55.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.089+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 shutdown_connections 2023-08-27T11:25:55.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.090+0000 7fbb56dff700 1 -- 172.21.15.43:0/4146354130 wait complete. 2023-08-27T11:25:55.094 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:25:55.114 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:25:55.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.319+0000 7ff0e83ff700 1 Processor -- start 2023-08-27T11:25:55.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.319+0000 7ff0e83ff700 1 -- start start 2023-08-27T11:25:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.320+0000 7ff0e83ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0e00c4630 0x7ff0e00c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e83ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff0e006ad70 0x7ff0e006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e83ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00c82c0 con 0x7ff0e0151b20 2023-08-27T11:25:55.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e83ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e0151f00 con 0x7ff0e00c4630 2023-08-27T11:25:55.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e83ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e006c450 con 0x7ff0e006ad70 2023-08-27T11:25:55.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0e00c4630 0x7ff0e00c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff0e00c4630 0x7ff0e00c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53346/0 (socket says 172.21.15.43:53346) 2023-08-27T11:25:55.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 -- 172.21.15.43:0/1494518843 learned_addr learned my addr 172.21.15.43:0/1494518843 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:55.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e699c700 1 --2- 172.21.15.43:0/1494518843 >> v2:172.21.15.57:3300/0 conn(0x7ff0e006ad70 0x7ff0e006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 -- 172.21.15.43:0/1494518843 >> v2:172.21.15.57:3300/0 conn(0x7ff0e006ad70 msgr2=0x7ff0e006b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:55.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 --2- 172.21.15.43:0/1494518843 >> v2:172.21.15.57:3300/0 conn(0x7ff0e006ad70 0x7ff0e006b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 -- 172.21.15.43:0/1494518843 >> v1:172.21.15.57:6789/0 conn(0x7ff0e0151b20 legacy=0x7ff0e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.321+0000 7ff0e599a700 1 -- 172.21.15.43:0/1494518843 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0154760 con 0x7ff0e00c4630 2023-08-27T11:25:55.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e599a700 1 --2- 172.21.15.43:0/1494518843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e00c4630 0x7ff0e00c4ae0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00c3e40 tx=0x7ff0d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178d5f6526aedda7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e5199700 1 -- 172.21.15.43:0/1494518843 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0005e30 con 0x7ff0e00c4630 2023-08-27T11:25:55.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e5199700 1 -- 172.21.15.43:0/1494518843 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d0004030 con 0x7ff0e00c4630 2023-08-27T11:25:55.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e5199700 1 -- 172.21.15.43:0/1494518843 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00043e0 con 0x7ff0e00c4630 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 -- 172.21.15.43:0/1494518843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e00c4630 msgr2=0x7ff0e00c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/1494518843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e00c4630 0x7ff0e00c4ae0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff0e00c3e40 tx=0x7ff0d0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 -- 172.21.15.43:0/1494518843 shutdown_connections 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/1494518843 >> v2:172.21.15.57:3300/0 conn(0x7ff0e006ad70 0x7ff0e006b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/1494518843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e00c4630 0x7ff0e00c4ae0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.322+0000 7ff0e83ff700 1 -- 172.21.15.43:0/1494518843 >> 172.21.15.43:0/1494518843 conn(0x7ff0e00ab820 msgr2=0x7ff0e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:55.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.323+0000 7ff0e83ff700 1 -- 172.21.15.43:0/1494518843 shutdown_connections 2023-08-27T11:25:55.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.323+0000 7ff0e83ff700 1 -- 172.21.15.43:0/1494518843 wait complete. 2023-08-27T11:25:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.324+0000 7ff0e83ff700 1 Processor -- start 2023-08-27T11:25:55.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.324+0000 7ff0e83ff700 1 -- start start 2023-08-27T11:25:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0e00c4630 0x7ff0e01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 0x7ff0e0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0158250 con 0x7ff0e006ad70 2023-08-27T11:25:55.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c1790 con 0x7ff0e00c4630 2023-08-27T11:25:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e83ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c1d50 con 0x7ff0e0151b20 2023-08-27T11:25:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.325+0000 7ff0e619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53352/0 (socket says 172.21.15.43:53352) 2023-08-27T11:25:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 -- 172.21.15.43:0/672353019 learned_addr learned my addr 172.21.15.43:0/672353019 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:55.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e599a700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0e00c4630 0x7ff0e01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e699c700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 0x7ff0e0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 -- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 msgr2=0x7ff0e0155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 0x7ff0e0155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 -- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0e00c4630 msgr2=0x7ff0e01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0e00c4630 0x7ff0e01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 -- 172.21.15.43:0/672353019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009500 con 0x7ff0e006ad70 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e699c700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 0x7ff0e0155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0e619b700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c480 tx=0x7ff0dc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0052d0 con 0x7ff0e006ad70 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.326+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc005430 con 0x7ff0e006ad70 2023-08-27T11:25:55.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.327+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc0038c0 con 0x7ff0e006ad70 2023-08-27T11:25:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.327+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0158480 con 0x7ff0e006ad70 2023-08-27T11:25:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.327+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0158720 con 0x7ff0e006ad70 2023-08-27T11:25:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.328+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0072450 con 0x7ff0e006ad70 2023-08-27T11:25:55.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.329+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0dc003a20 con 0x7ff0e006ad70 2023-08-27T11:25:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.329+0000 7ff0d6ffd700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 0x7ff0c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.330+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ff0dc087650 con 0x7ff0e006ad70 2023-08-27T11:25:55.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.330+0000 7ff0e599a700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 0x7ff0c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.330+0000 7ff0e599a700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 0x7ff0c406c5a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c10 tx=0x7ff0d0008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.334+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff0dc052fd0 con 0x7ff0e006ad70 2023-08-27T11:25:55.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.544+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff0e004ee70 con 0x7ff0e006ad70 2023-08-27T11:25:55.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.548+0000 7ff0d6ffd700 1 -- 172.21.15.43:0/672353019 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0dc0565f0 con 0x7ff0e006ad70 2023-08-27T11:25:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 msgr2=0x7ff0c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 0x7ff0c406c5a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c10 tx=0x7ff0d0008070 comp rx=0 tx=0).stop 2023-08-27T11:25:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 msgr2=0x7ff0e00c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00c480 tx=0x7ff0dc00c790 comp rx=0 tx=0).stop 2023-08-27T11:25:55.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 shutdown_connections 2023-08-27T11:25:55.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff0c406a0e0 0x7ff0c406c5a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff0e0151b20 0x7ff0e0155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff0e006ad70 0x7ff0e00c24b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 --2- 172.21.15.43:0/672353019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff0e00c4630 0x7ff0e01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 >> 172.21.15.43:0/672353019 conn(0x7ff0e00ab820 msgr2=0x7ff0e00a9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:55.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 shutdown_connections 2023-08-27T11:25:55.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.551+0000 7ff0e83ff700 1 -- 172.21.15.43:0/672353019 wait complete. 2023-08-27T11:25:55.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.d mds_join_fs 2023-08-27T11:25:55.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.774+0000 7fee933ff700 1 Processor -- start 2023-08-27T11:25:55.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.774+0000 7fee933ff700 1 -- start start 2023-08-27T11:25:55.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee933ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c0c4630 0x7fee8c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee933ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee8c06ad70 0x7fee8c06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee933ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0c82c0 con 0x7fee8c151b20 2023-08-27T11:25:55.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee933ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c151f00 con 0x7fee8c06ad70 2023-08-27T11:25:55.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee933ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c06c450 con 0x7fee8c0c4630 2023-08-27T11:25:55.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.775+0000 7fee9199c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee8c06ad70 0x7fee8c06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fee8c06ad70 0x7fee8c06b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53356/0 (socket says 172.21.15.43:53356) 2023-08-27T11:25:55.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 -- 172.21.15.43:0/2335064415 learned_addr learned my addr 172.21.15.43:0/2335064415 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:55.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9099a700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c0c4630 0x7fee8c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 -- 172.21.15.43:0/2335064415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c0c4630 msgr2=0x7fee8c0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:55.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c0c4630 0x7fee8c0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 -- 172.21.15.43:0/2335064415 >> v1:172.21.15.57:6789/0 conn(0x7fee8c151b20 legacy=0x7fee8c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 -- 172.21.15.43:0/2335064415 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c154760 con 0x7fee8c06ad70 2023-08-27T11:25:55.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee9199c700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c06ad70 0x7fee8c06b1c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fee84009e50 tx=0x7fee8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c833d252661995 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.776+0000 7fee83fff700 1 -- 172.21.15.43:0/2335064415 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400e070 con 0x7fee8c06ad70 2023-08-27T11:25:55.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee83fff700 1 -- 172.21.15.43:0/2335064415 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400b910 con 0x7fee8c06ad70 2023-08-27T11:25:55.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee83fff700 1 -- 172.21.15.43:0/2335064415 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400bcc0 con 0x7fee8c06ad70 2023-08-27T11:25:55.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 -- 172.21.15.43:0/2335064415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c06ad70 msgr2=0x7fee8c06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c06ad70 0x7fee8c06b1c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fee84009e50 tx=0x7fee8400b330 comp rx=0 tx=0).stop 2023-08-27T11:25:55.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 -- 172.21.15.43:0/2335064415 shutdown_connections 2023-08-27T11:25:55.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c06ad70 0x7fee8c06b1c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 --2- 172.21.15.43:0/2335064415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c0c4630 0x7fee8c0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 -- 172.21.15.43:0/2335064415 >> 172.21.15.43:0/2335064415 conn(0x7fee8c0ab820 msgr2=0x7fee8c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:55.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 -- 172.21.15.43:0/2335064415 shutdown_connections 2023-08-27T11:25:55.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.777+0000 7fee933ff700 1 -- 172.21.15.43:0/2335064415 wait complete. 2023-08-27T11:25:55.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.779+0000 7fee933ff700 1 Processor -- start 2023-08-27T11:25:55.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.779+0000 7fee933ff700 1 -- start start 2023-08-27T11:25:55.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 0x7fee8c0aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee8c151b20 0x7fee8c156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0c2860 con 0x7fee8c0c4630 2023-08-27T11:25:55.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c156b70 con 0x7fee8c151b20 2023-08-27T11:25:55.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee933ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0c0d80 con 0x7fee8c06ad70 2023-08-27T11:25:55.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee9099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee9099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53364/0 (socket says 172.21.15.43:53364) 2023-08-27T11:25:55.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee9099a700 1 -- 172.21.15.43:0/2857384273 learned_addr learned my addr 172.21.15.43:0/2857384273 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.780+0000 7fee9119b700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 0x7fee8c0aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9199c700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee8c151b20 0x7fee8c156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 -- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 msgr2=0x7fee8c0aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 0x7fee8c0aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 -- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee8c151b20 msgr2=0x7fee8c156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:55.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee8c151b20 0x7fee8c156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:55.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 -- 172.21.15.43:0/2857384273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009b30 con 0x7fee8c0c4630 2023-08-27T11:25:55.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9119b700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 0x7fee8c0aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:55.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee9099a700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e9c0 tx=0x7fee7c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c0096f0 con 0x7fee8c0c4630 2023-08-27T11:25:55.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c00c850 con 0x7fee8c0c4630 2023-08-27T11:25:55.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00cbc0 con 0x7fee8c0c4630 2023-08-27T11:25:55.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0c12b0 con 0x7fee8c0c4630 2023-08-27T11:25:55.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.781+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c0c37a0 con 0x7fee8c0c4630 2023-08-27T11:25:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.782+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c155900 con 0x7fee8c0c4630 2023-08-27T11:25:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.784+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee7c00cd20 con 0x7fee8c0c4630 2023-08-27T11:25:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.785+0000 7fee81ffb700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 0x7fee7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.785+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fee7c0886e0 con 0x7fee8c0c4630 2023-08-27T11:25:55.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.785+0000 7fee9119b700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 0x7fee7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:55.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.785+0000 7fee9119b700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 0x7fee7006c5a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f60 tx=0x7fee88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:55.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.789+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fee8c155900 con 0x7fee8c0c4630 2023-08-27T11:25:56.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:55.999+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"} v 0) v1 -- 0x7fee8c155900 con 0x7fee8c0c4630 2023-08-27T11:25:56.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.003+0000 7fee81ffb700 1 -- 172.21.15.43:0/2857384273 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"}]=0 v26) v1 ==== 96+0+0 (secure 0 0 0) 0x7fee8c155900 con 0x7fee8c0c4630 2023-08-27T11:25:56.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 msgr2=0x7fee7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:56.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 0x7fee7006c5a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fee88000f60 tx=0x7fee88009040 comp rx=0 tx=0).stop 2023-08-27T11:25:56.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 msgr2=0x7fee8c155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:56.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00e9c0 tx=0x7fee7c00ed80 comp rx=0 tx=0).stop 2023-08-27T11:25:56.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 shutdown_connections 2023-08-27T11:25:56.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee7006a0e0 0x7fee7006c5a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee8c151b20 0x7fee8c156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee8c06ad70 0x7fee8c0aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 --2- 172.21.15.43:0/2857384273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee8c0c4630 0x7fee8c155be0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 >> 172.21.15.43:0/2857384273 conn(0x7fee8c0ab820 msgr2=0x7fee8c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:56.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 shutdown_connections 2023-08-27T11:25:56.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.006+0000 7fee933ff700 1 -- 172.21.15.43:0/2857384273 wait complete. 2023-08-27T11:25:56.025 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime' 2023-08-27T11:25:56.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.228+0000 7fcdbf5ff700 1 Processor -- start 2023-08-27T11:25:56.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.228+0000 7fcdbf5ff700 1 -- start start 2023-08-27T11:25:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcdb806ca60 0x7fcdb80aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcdb80ab040 0x7fcdb8155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb81530b0 con 0x7fcdb806ca60 2023-08-27T11:25:56.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb814c860 con 0x7fcdb80ab040 2023-08-27T11:25:56.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbf5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb806d700 con 0x7fcdb80c51a0 2023-08-27T11:25:56.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbcb9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcdb806ca60 0x7fcdb80aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbcb9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcdb806ca60 0x7fcdb80aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53368/0 (socket says 172.21.15.43:53368) 2023-08-27T11:25:56.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/3423118663 learned_addr learned my addr 172.21.15.43:0/3423118663 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:56.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.229+0000 7fcdbd39b700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbdb9c700 1 --2- 172.21.15.43:0/3423118663 >> v2:172.21.15.57:3300/0 conn(0x7fcdb80ab040 0x7fcdb8155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/3423118663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 msgr2=0x7fcdb806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:56.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/3423118663 >> v2:172.21.15.57:3300/0 conn(0x7fcdb80ab040 msgr2=0x7fcdb8155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:56.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/3423118663 >> v2:172.21.15.57:3300/0 conn(0x7fcdb80ab040 0x7fcdb8155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/3423118663 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8152430 con 0x7fcdb806ca60 2023-08-27T11:25:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbd39b700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb806ca60 0x7fcdb80aab00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8072b20 tx=0x7fcda8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a69121566b7289 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdaffff700 1 -- 172.21.15.43:0/3423118663 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011830 con 0x7fcdb806ca60 2023-08-27T11:25:56.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdaffff700 1 -- 172.21.15.43:0/3423118663 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8011990 con 0x7fcdb806ca60 2023-08-27T11:25:56.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.230+0000 7fcdaffff700 1 -- 172.21.15.43:0/3423118663 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011d20 con 0x7fcdb806ca60 2023-08-27T11:25:56.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/3423118663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb806ca60 msgr2=0x7fcdb80aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:56.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb806ca60 0x7fcdb80aab00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8072b20 tx=0x7fcda8009c30 comp rx=0 tx=0).stop 2023-08-27T11:25:56.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/3423118663 shutdown_connections 2023-08-27T11:25:56.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/3423118663 >> v2:172.21.15.57:3300/0 conn(0x7fcdb80ab040 0x7fcdb8155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/3423118663 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb806ca60 0x7fcdb80aab00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/3423118663 >> 172.21.15.43:0/3423118663 conn(0x7fcdb806aa50 msgr2=0x7fcdb80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:56.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/3423118663 shutdown_connections 2023-08-27T11:25:56.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.231+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/3423118663 wait complete. 2023-08-27T11:25:56.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.233+0000 7fcdbf5ff700 1 Processor -- start 2023-08-27T11:25:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.233+0000 7fcdbf5ff700 1 -- start start 2023-08-27T11:25:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdb806ca60 0x7fcdb806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8151c00 con 0x7fcdb80ab040 2023-08-27T11:25:56.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81521c0 con 0x7fcdb806ca60 2023-08-27T11:25:56.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbf5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb81e9f40 con 0x7fcdb80c51a0 2023-08-27T11:25:56.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbcb9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbcb9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53380/0 (socket says 172.21.15.43:53380) 2023-08-27T11:25:56.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.234+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/430962391 learned_addr learned my addr 172.21.15.43:0/430962391 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:56.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbd39b700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdb806ca60 0x7fcdb806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbdb9c700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 msgr2=0x7fcdb814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:56.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdb806ca60 msgr2=0x7fcdb806f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:56.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdb806ca60 0x7fcdb806f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:56.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 -- 172.21.15.43:0/430962391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8009550 con 0x7fcdb80ab040 2023-08-27T11:25:56.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbdb9c700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:25:56.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbcb9a700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:56.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8004400 con 0x7fcdb80ab040 2023-08-27T11:25:56.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda801f070 con 0x7fcdb80ab040 2023-08-27T11:25:56.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80038e0 con 0x7fcdb80ab040 2023-08-27T11:25:56.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb81ea220 con 0x7fcdb80ab040 2023-08-27T11:25:56.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.235+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb814b940 con 0x7fcdb80ab040 2023-08-27T11:25:56.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.236+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb804ee70 con 0x7fcdb80ab040 2023-08-27T11:25:56.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.238+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcda8021030 con 0x7fcdb80ab040 2023-08-27T11:25:56.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.239+0000 7fcdadffb700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 0x7fcd9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:56.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.239+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fcda8089640 con 0x7fcdb80ab040 2023-08-27T11:25:56.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.239+0000 7fcdbd39b700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 0x7fcd9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:56.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.241+0000 7fcdbd39b700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 0x7fcd9c06c5a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400c900 tx=0x7fcdb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:56.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.246+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcda8054fc0 con 0x7fcdb80ab040 2023-08-27T11:25:56.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:56.540+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime"]} v 0) v1 -- 0x7fcdb806c840 con 0x7fcdb80ab040 2023-08-27T11:25:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.084+0000 7fcdadffb700 1 -- 172.21.15.43:0/430962391 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_runtime"]}]=0 v196) v1 ==== 146+0+0 (secure 0 0 0) 0x7fcda80585e0 con 0x7fcdb80ab040 2023-08-27T11:25:57.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.087+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 msgr2=0x7fcd9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:57.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.087+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 0x7fcd9c06c5a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400c900 tx=0x7fcdb4008040 comp rx=0 tx=0).stop 2023-08-27T11:25:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.087+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 msgr2=0x7fcdb814aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.087+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcda8000c00 tx=0x7fcda8004750 comp rx=0 tx=0).stop 2023-08-27T11:25:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 shutdown_connections 2023-08-27T11:25:57.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd9c06a0e0 0x7fcd9c06c5a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcdb80c51a0 0x7fcdb814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdb806ca60 0x7fcdb806f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 --2- 172.21.15.43:0/430962391 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcdb80ab040 0x7fcdb814aec0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 >> 172.21.15.43:0/430962391 conn(0x7fcdb806aa50 msgr2=0x7fcdb8155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:57.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 shutdown_connections 2023-08-27T11:25:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.088+0000 7fcdbf5ff700 1 -- 172.21.15.43:0/430962391 wait complete. 2023-08-27T11:25:57.110 INFO:tasks.cephfs_test_runner:That setting mds_join_fs at runtime affects the cluster layout. ... ok 2023-08-27T11:25:57.110 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_standby_replay (tasks.cephfs.test_failover.TestClusterAffinity) That a standby-replay daemon with weak affinity is replaced by a stronger one. 2023-08-27T11:25:57.111 INFO:tasks.cephfs_test_runner:test_join_fs_standby_replay (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:25:57.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay' 2023-08-27T11:25:57.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.316+0000 7efff95ff700 1 Processor -- start 2023-08-27T11:25:57.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.317+0000 7efff95ff700 1 -- start start 2023-08-27T11:25:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff95ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efff4151a90 0x7efff40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff95ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efff40c4a90 0x7efff406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff95ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff406c4e0 con 0x7efff40c4630 2023-08-27T11:25:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff95ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4155370 con 0x7efff4151a90 2023-08-27T11:25:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff95ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff4151e70 con 0x7efff40c4a90 2023-08-27T11:25:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efff4151a90 0x7efff40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efff4151a90 0x7efff40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53384/0 (socket says 172.21.15.43:53384) 2023-08-27T11:25:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 -- 172.21.15.43:0/1679085969 learned_addr learned my addr 172.21.15.43:0/1679085969 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff37fe700 1 --2- 172.21.15.43:0/1679085969 >> v2:172.21.15.57:3300/0 conn(0x7efff40c4a90 0x7efff406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 -- 172.21.15.43:0/1679085969 >> v2:172.21.15.57:3300/0 conn(0x7efff40c4a90 msgr2=0x7efff406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 --2- 172.21.15.43:0/1679085969 >> v2:172.21.15.57:3300/0 conn(0x7efff40c4a90 0x7efff406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 -- 172.21.15.43:0/1679085969 >> v1:172.21.15.57:6789/0 conn(0x7efff40c4630 legacy=0x7efff406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.318+0000 7efff2ffd700 1 -- 172.21.15.43:0/1679085969 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4154480 con 0x7efff4151a90 2023-08-27T11:25:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff2ffd700 1 --2- 172.21.15.43:0/1679085969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff4151a90 0x7efff40c7bb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efff40c4270 tx=0x7effe4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa66db97e4566f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:57.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff1ffb700 1 -- 172.21.15.43:0/1679085969 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4004230 con 0x7efff4151a90 2023-08-27T11:25:57.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff1ffb700 1 -- 172.21.15.43:0/1679085969 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4004390 con 0x7efff4151a90 2023-08-27T11:25:57.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff1ffb700 1 -- 172.21.15.43:0/1679085969 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe40036a0 con 0x7efff4151a90 2023-08-27T11:25:57.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff95ff700 1 -- 172.21.15.43:0/1679085969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff4151a90 msgr2=0x7efff40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:57.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.319+0000 7efff95ff700 1 --2- 172.21.15.43:0/1679085969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff4151a90 0x7efff40c7bb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efff40c4270 tx=0x7effe4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 -- 172.21.15.43:0/1679085969 shutdown_connections 2023-08-27T11:25:57.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 --2- 172.21.15.43:0/1679085969 >> v2:172.21.15.57:3300/0 conn(0x7efff40c4a90 0x7efff406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 --2- 172.21.15.43:0/1679085969 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff4151a90 0x7efff40c7bb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 -- 172.21.15.43:0/1679085969 >> 172.21.15.43:0/1679085969 conn(0x7efff40ab820 msgr2=0x7efff40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:57.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 -- 172.21.15.43:0/1679085969 shutdown_connections 2023-08-27T11:25:57.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.320+0000 7efff95ff700 1 -- 172.21.15.43:0/1679085969 wait complete. 2023-08-27T11:25:57.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.321+0000 7efff95ff700 1 Processor -- start 2023-08-27T11:25:57.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.321+0000 7efff95ff700 1 -- start start 2023-08-27T11:25:57.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 0x7efff40bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 0x7efff40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff40c3600 con 0x7efff40c4630 2023-08-27T11:25:57.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff4158230 con 0x7efff4151a90 2023-08-27T11:25:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.322+0000 7efff95ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff40c3a20 con 0x7efff40c4a90 2023-08-27T11:25:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53386/0 (socket says 172.21.15.43:53386) 2023-08-27T11:25:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 -- 172.21.15.43:0/141245674 learned_addr learned my addr 172.21.15.43:0/141245674 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:57.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff27fc700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 0x7efff40bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff37fe700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 0x7efff40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 -- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 msgr2=0x7efff40bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 0x7efff40bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 -- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 msgr2=0x7efff40c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 0x7efff40c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:57.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 -- 172.21.15.43:0/141245674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe4009550 con 0x7efff40c4630 2023-08-27T11:25:57.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff27fc700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 0x7efff40bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:57.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff37fe700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 0x7efff40c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:57.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.323+0000 7efff2ffd700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7effe4009130 tx=0x7effe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:57.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.324+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011630 con 0x7efff40c4630 2023-08-27T11:25:57.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.324+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe4011790 con 0x7efff40c4630 2023-08-27T11:25:57.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.324+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe4011b40 con 0x7efff40c4630 2023-08-27T11:25:57.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.324+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff40c95f0 con 0x7efff40c4630 2023-08-27T11:25:57.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.324+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff40c3220 con 0x7efff40c4630 2023-08-27T11:25:57.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.325+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff40c33b0 con 0x7efff40c4630 2023-08-27T11:25:57.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.326+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effe4011ca0 con 0x7efff40c4630 2023-08-27T11:25:57.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.327+0000 7effdb7fe700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 0x7effe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:57.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.327+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7effe4089850 con 0x7efff40c4630 2023-08-27T11:25:57.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.327+0000 7efff27fc700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 0x7effe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:57.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.328+0000 7efff27fc700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 0x7effe006c5a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efff4140c70 tx=0x7effe8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:57.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.332+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effe4055280 con 0x7efff40c4630 2023-08-27T11:25:57.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:57.626+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay"]} v 0) v1 -- 0x7efff40c3870 con 0x7efff40c4630 2023-08-27T11:25:58.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.087+0000 7effdb7fe700 1 -- 172.21.15.43:0/141245674 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay"]}]=0 v197) v1 ==== 156+0+0 (secure 0 0 0) 0x7effe40588a0 con 0x7efff40c4630 2023-08-27T11:25:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 msgr2=0x7effe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 0x7effe006c5a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efff4140c70 tx=0x7effe8009040 comp rx=0 tx=0).stop 2023-08-27T11:25:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 msgr2=0x7efff40bbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7effe4009130 tx=0x7effe4004750 comp rx=0 tx=0).stop 2023-08-27T11:25:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 shutdown_connections 2023-08-27T11:25:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effe006a0e0 0x7effe006c5a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efff4151a90 0x7efff40c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efff40c4630 0x7efff40bbec0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 --2- 172.21.15.43:0/141245674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efff40c4a90 0x7efff40bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 >> 172.21.15.43:0/141245674 conn(0x7efff40ab820 msgr2=0x7efff41508d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 shutdown_connections 2023-08-27T11:25:58.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.090+0000 7efff95ff700 1 -- 172.21.15.43:0/141245674 wait complete. 2023-08-27T11:25:58.112 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:25:58.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.316+0000 7fba78dff700 1 Processor -- start 2023-08-27T11:25:58.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.316+0000 7fba78dff700 1 -- start start 2023-08-27T11:25:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 0x7fba740c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fba740c4630 0x7fba740c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 0x7fba7406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7406c4e0 con 0x7fba740c4630 2023-08-27T11:25:58.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba74155370 con 0x7fba7406ad70 2023-08-27T11:25:58.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba78dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba74151e70 con 0x7fba74151a90 2023-08-27T11:25:58.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba71d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fba740c4630 0x7fba740c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba71d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fba740c4630 0x7fba740c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53388/0 (socket says 172.21.15.43:53388) 2023-08-27T11:25:58.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.317+0000 7fba71d9b700 1 -- 172.21.15.43:0/2800942815 learned_addr learned my addr 172.21.15.43:0/2800942815 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:58.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba7259c700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 0x7fba740c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba72d9d700 1 --2- 172.21.15.43:0/2800942815 >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 0x7fba7406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 -- 172.21.15.43:0/2800942815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 msgr2=0x7fba740c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 0x7fba740c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 -- 172.21.15.43:0/2800942815 >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 msgr2=0x7fba7406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 --2- 172.21.15.43:0/2800942815 >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 0x7fba7406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 -- 172.21.15.43:0/2800942815 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74154480 con 0x7fba740c4630 2023-08-27T11:25:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba72d9d700 1 --2- 172.21.15.43:0/2800942815 >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 0x7fba7406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba7259c700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 0x7fba740c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba71d9b700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba740c4630 0x7fba740c4a90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fba740bd700 tx=0x7fba68009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f326b0551592eee server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba7159a700 1 -- 172.21.15.43:0/2800942815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800b870 con 0x7fba740c4630 2023-08-27T11:25:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba7159a700 1 -- 172.21.15.43:0/2800942815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6800b9d0 con 0x7fba740c4630 2023-08-27T11:25:58.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.318+0000 7fba7159a700 1 -- 172.21.15.43:0/2800942815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6800bd60 con 0x7fba740c4630 2023-08-27T11:25:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 -- 172.21.15.43:0/2800942815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba740c4630 msgr2=0x7fba740c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba740c4630 0x7fba740c4a90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fba740bd700 tx=0x7fba68009bd0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 -- 172.21.15.43:0/2800942815 shutdown_connections 2023-08-27T11:25:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 --2- 172.21.15.43:0/2800942815 >> v2:172.21.15.57:3300/0 conn(0x7fba7406ad70 0x7fba7406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba74151a90 0x7fba740c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 --2- 172.21.15.43:0/2800942815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba740c4630 0x7fba740c4a90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 -- 172.21.15.43:0/2800942815 >> 172.21.15.43:0/2800942815 conn(0x7fba740ab820 msgr2=0x7fba740abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 -- 172.21.15.43:0/2800942815 shutdown_connections 2023-08-27T11:25:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.319+0000 7fba78dff700 1 -- 172.21.15.43:0/2800942815 wait complete. 2023-08-27T11:25:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.321+0000 7fba78dff700 1 Processor -- start 2023-08-27T11:25:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.321+0000 7fba78dff700 1 -- start start 2023-08-27T11:25:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 0x7fba74152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba740c4630 0x7fba740be410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74151fe0 con 0x7fba74151a90 2023-08-27T11:25:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74152f70 con 0x7fba740c4630 2023-08-27T11:25:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba78dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba741e9f90 con 0x7fba7406ad70 2023-08-27T11:25:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba72d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba72d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53390/0 (socket says 172.21.15.43:53390) 2023-08-27T11:25:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.322+0000 7fba72d9d700 1 -- 172.21.15.43:0/3434822433 learned_addr learned my addr 172.21.15.43:0/3434822433 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba7259c700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 0x7fba74152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba71d9b700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba740c4630 0x7fba740be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 -- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 msgr2=0x7fba74152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 0x7fba74152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 -- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba740c4630 msgr2=0x7fba740be410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba740c4630 0x7fba740be410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 -- 172.21.15.43:0/3434822433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba68009550 con 0x7fba74151a90 2023-08-27T11:25:58.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba7259c700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 0x7fba74152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba72d9d700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fba6c007e10 tx=0x7fba6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00de90 con 0x7fba74151a90 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00f040 con 0x7fba74151a90 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c003c60 con 0x7fba74151a90 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.323+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba741ea270 con 0x7fba74151a90 2023-08-27T11:25:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.324+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba74152510 con 0x7fba74151a90 2023-08-27T11:25:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.324+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba74152700 con 0x7fba74151a90 2023-08-27T11:25:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.325+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba6c004030 con 0x7fba74151a90 2023-08-27T11:25:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.326+0000 7fba62ffd700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 0x7fba5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.326+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fba6c088470 con 0x7fba74151a90 2023-08-27T11:25:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.327+0000 7fba7259c700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 0x7fba5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.327+0000 7fba7259c700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 0x7fba5406c5a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fba640099b0 tx=0x7fba64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.331+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba6c053df0 con 0x7fba74151a90 2023-08-27T11:25:58.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.546+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba7404ee70 con 0x7fba74151a90 2023-08-27T11:25:58.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.547+0000 7fba62ffd700 1 -- 172.21.15.43:0/3434822433 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+14779 (secure 0 0 0) 0x7fba6c086e60 con 0x7fba74151a90 2023-08-27T11:25:58.548 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:25:58.549 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":72,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:25:55.069531+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6835/2049507141":"2023-08-28T11:25:51.855823+0000","172.21.15.57:6833/2049507141":"2023-08-28T11:25:51.855823+0000","172.21.15.43:6837/497941784":"2023-08-28T11:25:39.971908+0000","172.21.15.43:6835/497941784":"2023-08-28T11:25:39.971908+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:25:58.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.549+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 msgr2=0x7fba5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.549+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 0x7fba5406c5a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fba640099b0 tx=0x7fba64008040 comp rx=0 tx=0).stop 2023-08-27T11:25:58.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.549+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 msgr2=0x7fba7414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.549+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fba6c007e10 tx=0x7fba6c00d3b0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 shutdown_connections 2023-08-27T11:25:58.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fba5406a0e0 0x7fba5406c5a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fba74151a90 0x7fba7414a2b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fba7406ad70 0x7fba74152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 --2- 172.21.15.43:0/3434822433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fba740c4630 0x7fba740be410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 >> 172.21.15.43:0/3434822433 conn(0x7fba740ab820 msgr2=0x7fba7414d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:58.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 shutdown_connections 2023-08-27T11:25:58.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.550+0000 7fba78dff700 1 -- 172.21.15.43:0/3434822433 wait complete. 2023-08-27T11:25:58.570 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:25:58.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:25:58.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.772+0000 7f4bfabff700 1 Processor -- start 2023-08-27T11:25:58.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.772+0000 7f4bfabff700 1 -- start start 2023-08-27T11:25:58.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bfabff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bfabff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bf406cc00 0x7f4bf406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bfabff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf4137330 con 0x7f4bf4136f50 2023-08-27T11:25:58.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bfabff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf4154450 con 0x7f4bf406cc00 2023-08-27T11:25:58.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bfabff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4158840 con 0x7f4bf4158340 2023-08-27T11:25:58.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bf3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.774+0000 7f4bf919c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bf406cc00 0x7f4bf406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bf406cc00 0x7f4bf406d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:47642/0 (socket says 172.21.15.43:47642) 2023-08-27T11:25:58.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:57156/0 (socket says 172.21.15.43:57156) 2023-08-27T11:25:58.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 -- 172.21.15.43:0/420310227 learned_addr learned my addr 172.21.15.43:0/420310227 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:58.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 -- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 msgr2=0x7f4bf40c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:58.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 -- 172.21.15.43:0/420310227 >> v1:172.21.15.57:6789/0 conn(0x7f4bf4136f50 legacy=0x7f4bf406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 -- 172.21.15.43:0/420310227 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf41546f0 con 0x7f4bf406cc00 2023-08-27T11:25:58.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf3fff700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:58.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.775+0000 7f4bf919c700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf406d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009e50 tx=0x7f4bec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678a0f2693aac714 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bf37fe700 1 -- 172.21.15.43:0/420310227 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00e070 con 0x7f4bf406cc00 2023-08-27T11:25:58.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bf37fe700 1 -- 172.21.15.43:0/420310227 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec00b910 con 0x7f4bf406cc00 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bf37fe700 1 -- 172.21.15.43:0/420310227 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00bcc0 con 0x7f4bf406cc00 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 -- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 msgr2=0x7f4bf406d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf406d0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009e50 tx=0x7f4bec00b330 comp rx=0 tx=0).stop 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 -- 172.21.15.43:0/420310227 shutdown_connections 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf406d0b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 --2- 172.21.15.43:0/420310227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf40c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 -- 172.21.15.43:0/420310227 >> 172.21.15.43:0/420310227 conn(0x7f4bf406a310 msgr2=0x7f4bf406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 -- 172.21.15.43:0/420310227 shutdown_connections 2023-08-27T11:25:58.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.776+0000 7f4bfabff700 1 -- 172.21.15.43:0/420310227 wait complete. 2023-08-27T11:25:58.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.778+0000 7f4bfabff700 1 Processor -- start 2023-08-27T11:25:58.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.778+0000 7f4bfabff700 1 -- start start 2023-08-27T11:25:58.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf40c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf41515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41ea610 con 0x7f4bf4136f50 2023-08-27T11:25:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41e9a90 con 0x7f4bf406cc00 2023-08-27T11:25:58.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bfabff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41e9d70 con 0x7f4bf4158340 2023-08-27T11:25:58.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bf3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bf3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53402/0 (socket says 172.21.15.43:53402) 2023-08-27T11:25:58.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.779+0000 7f4bf3fff700 1 -- 172.21.15.43:0/1586125483 learned_addr learned my addr 172.21.15.43:0/1586125483 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:58.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf919c700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf41515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf899b700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf40c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 -- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 msgr2=0x7f4bf41515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf41515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 -- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 msgr2=0x7f4bf40c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:58.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf40c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 -- 172.21.15.43:0/1586125483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00094a0 con 0x7f4bf4136f50 2023-08-27T11:25:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf899b700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf40c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf3fff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4be000ebe0 tx=0x7f4be000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000c850 con 0x7f4bf4136f50 2023-08-27T11:25:58.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be000c9b0 con 0x7f4bf4136f50 2023-08-27T11:25:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec009b30 con 0x7f4bf4136f50 2023-08-27T11:25:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.780+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000cd40 con 0x7f4bf4136f50 2023-08-27T11:25:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.781+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf41ea330 con 0x7f4bf4136f50 2023-08-27T11:25:58.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.782+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf41ecdb0 con 0x7f4bf4136f50 2023-08-27T11:25:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.782+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4be0013470 con 0x7f4bf4136f50 2023-08-27T11:25:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.783+0000 7f4bf17fa700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 0x7f4bd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.784+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4be0088370 con 0x7f4bf4136f50 2023-08-27T11:25:58.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.784+0000 7f4bf899b700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 0x7f4bd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.784+0000 7f4bf899b700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 0x7f4bd806c5a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4be8000f60 tx=0x7f4be8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:58.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.788+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4be0053cf0 con 0x7f4bf4136f50 2023-08-27T11:25:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.997+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4bf404ee70 con 0x7f4bf4136f50 2023-08-27T11:25:58.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.997+0000 7f4bf17fa700 1 -- 172.21.15.43:0/1586125483 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4be000cea0 con 0x7f4bf4136f50 2023-08-27T11:25:58.999 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:25:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 msgr2=0x7f4bd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 0x7f4bd806c5a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4be8000f60 tx=0x7f4be8009040 comp rx=0 tx=0).stop 2023-08-27T11:25:59.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 msgr2=0x7f4bf4151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f4be000ebe0 tx=0x7f4be000eef0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 shutdown_connections 2023-08-27T11:25:59.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4bd806a0e0 0x7f4bd806c5a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf4158340 0x7f4bf41515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf406cc00 0x7f4bf40c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 --2- 172.21.15.43:0/1586125483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4bf4136f50 0x7f4bf4151060 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:58.999+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 >> 172.21.15.43:0/1586125483 conn(0x7f4bf406a310 msgr2=0x7f4bf4135710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:59.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.000+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 shutdown_connections 2023-08-27T11:25:59.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.000+0000 7f4bfabff700 1 -- 172.21.15.43:0/1586125483 wait complete. 2023-08-27T11:25:59.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:25:59.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.223+0000 7fedee5ff700 1 Processor -- start 2023-08-27T11:25:59.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.223+0000 7fedee5ff700 1 -- start start 2023-08-27T11:25:59.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.224+0000 7fedee5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.224+0000 7fedee5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fede80c7c00 0x7fede80ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.224+0000 7fedee5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede8154660 con 0x7fede80abcc0 2023-08-27T11:25:59.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.224+0000 7fedee5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede80c5750 con 0x7fede80c7c00 2023-08-27T11:25:59.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.224+0000 7fedee5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede8154940 con 0x7fede8151d20 2023-08-27T11:25:59.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fede80c7c00 0x7fede80ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fede80c7c00 0x7fede80ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:54324/0 (socket says 172.21.15.43:54324) 2023-08-27T11:25:59.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede80c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:51648/0 (socket says 172.21.15.43:51648) 2023-08-27T11:25:59.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 -- 172.21.15.43:0/945191757 learned_addr learned my addr 172.21.15.43:0/945191757 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:59.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 -- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 msgr2=0x7fede80c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:59.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 --2- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede80c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 -- 172.21.15.43:0/945191757 >> v1:172.21.15.57:6789/0 conn(0x7fede80abcc0 legacy=0x7fede806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.225+0000 7fede77fe700 1 -- 172.21.15.43:0/945191757 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8154c20 con 0x7fede80c7c00 2023-08-27T11:25:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.226+0000 7fede77fe700 1 --2- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80c7c00 0x7fede80ab780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feddc0098f0 tx=0x7feddc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6146a697c5ad5a51 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.226+0000 7fede6ffd700 1 -- 172.21.15.43:0/945191757 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc011830 con 0x7fede80c7c00 2023-08-27T11:25:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.226+0000 7fede6ffd700 1 -- 172.21.15.43:0/945191757 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc011990 con 0x7fede80c7c00 2023-08-27T11:25:59.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.226+0000 7fede6ffd700 1 -- 172.21.15.43:0/945191757 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc011d20 con 0x7fede80c7c00 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 -- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80c7c00 msgr2=0x7fede80ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 --2- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80c7c00 0x7fede80ab780 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feddc0098f0 tx=0x7feddc009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 -- 172.21.15.43:0/945191757 shutdown_connections 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 --2- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede80c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 --2- 172.21.15.43:0/945191757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80c7c00 0x7fede80ab780 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 -- 172.21.15.43:0/945191757 >> 172.21.15.43:0/945191757 conn(0x7fede80c9d00 msgr2=0x7fede80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:59.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 -- 172.21.15.43:0/945191757 shutdown_connections 2023-08-27T11:25:59.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.227+0000 7fedee5ff700 1 -- 172.21.15.43:0/945191757 wait complete. 2023-08-27T11:25:59.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.228+0000 7fedee5ff700 1 Processor -- start 2023-08-27T11:25:59.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.229+0000 7fedee5ff700 1 -- start start 2023-08-27T11:25:59.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.229+0000 7fedee5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 0x7fede81586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedee5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedee5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede81ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedee5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81ece30 con 0x7fede80c7c00 2023-08-27T11:25:59.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedee5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede80c84a0 con 0x7fede80abcc0 2023-08-27T11:25:59.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedee5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede80c07b0 con 0x7fede8151d20 2023-08-27T11:25:59.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 0x7fede81586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51364/0 (socket says 172.21.15.43:51364) 2023-08-27T11:25:59.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede77fe700 1 -- 172.21.15.43:0/1230215885 learned_addr learned my addr 172.21.15.43:0/1230215885 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:59.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fedecb9c700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede81ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 -- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 msgr2=0x7fede81ed540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede81ed540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 -- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 msgr2=0x7fede8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede7fff700 1 -- 172.21.15.43:0/1230215885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009550 con 0x7fede80abcc0 2023-08-27T11:25:59.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.230+0000 7fede77fe700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:25:59.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fede7fff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 0x7fede81586a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e870 tx=0x7fedd800eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8013680 con 0x7fede80abcc0 2023-08-27T11:25:59.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd80137e0 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede80c04d0 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8013b90 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.231+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede80c29f0 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.232+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede804ee70 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.233+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedd8013cf0 con 0x7fede80abcc0 2023-08-27T11:25:59.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.234+0000 7fede4ff9700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 0x7fedd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.234+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fedd8088160 con 0x7fede80abcc0 2023-08-27T11:25:59.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.234+0000 7fede77fe700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 0x7fedd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.235+0000 7fede77fe700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 0x7fedd406c5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fede8150f50 tx=0x7feddc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.240+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fedd8053ae0 con 0x7fede80abcc0 2023-08-27T11:25:59.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.448+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fede80ac650 con 0x7fede80abcc0 2023-08-27T11:25:59.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.449+0000 7fede4ff9700 1 -- 172.21.15.43:0/1230215885 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedd8057100 con 0x7fede80abcc0 2023-08-27T11:25:59.451 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:25:59.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 msgr2=0x7fedd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 0x7fedd406c5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fede8150f50 tx=0x7feddc008030 comp rx=0 tx=0).stop 2023-08-27T11:25:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 msgr2=0x7fede81586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 0x7fede81586a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e870 tx=0x7fedd800eb80 comp rx=0 tx=0).stop 2023-08-27T11:25:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 shutdown_connections 2023-08-27T11:25:59.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd406a0e0 0x7fedd406c5a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fede8151d20 0x7fede81ed540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fede80abcc0 0x7fede81586a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 --2- 172.21.15.43:0/1230215885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fede80c7c00 0x7fede8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 >> 172.21.15.43:0/1230215885 conn(0x7fede80c9d00 msgr2=0x7fede814e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:59.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 shutdown_connections 2023-08-27T11:25:59.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.452+0000 7fedee5ff700 1 -- 172.21.15.43:0/1230215885 wait complete. 2023-08-27T11:25:59.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:25:59.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.674+0000 7f04419ff700 1 Processor -- start 2023-08-27T11:25:59.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.674+0000 7f04419ff700 1 -- start start 2023-08-27T11:25:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f04419ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f043c0c7c00 0x7f043c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f04419ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c06ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f04419ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c154660 con 0x7f043c151d20 2023-08-27T11:25:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f04419ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0c5750 con 0x7f043c0c7c00 2023-08-27T11:25:59.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f04419ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c154940 con 0x7f043c06a8e0 2023-08-27T11:25:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f0433fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f043c0c7c00 0x7f043c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f0433fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f043c0c7c00 0x7f043c0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51368/0 (socket says 172.21.15.43:51368) 2023-08-27T11:25:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.675+0000 7f0433fff700 1 -- 172.21.15.43:0/1067925995 learned_addr learned my addr 172.21.15.43:0/1067925995 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f043b7fe700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c06ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f0433fff700 1 -- 172.21.15.43:0/1067925995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 msgr2=0x7f043c06ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f0433fff700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c06ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f0433fff700 1 -- 172.21.15.43:0/1067925995 >> v1:172.21.15.57:6789/0 conn(0x7f043c151d20 legacy=0x7f043c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:25:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f0433fff700 1 -- 172.21.15.43:0/1067925995 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c154c20 con 0x7f043c0c7c00 2023-08-27T11:25:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f0433fff700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c0c7c00 0x7f043c0c8110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f04240098f0 tx=0x7f0424009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bcca8d123a5f3b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f043a7fc700 1 -- 172.21.15.43:0/1067925995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400b8a0 con 0x7f043c0c7c00 2023-08-27T11:25:59.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f043a7fc700 1 -- 172.21.15.43:0/1067925995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042400ba00 con 0x7f043c0c7c00 2023-08-27T11:25:59.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.676+0000 7f043a7fc700 1 -- 172.21.15.43:0/1067925995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042400bd90 con 0x7f043c0c7c00 2023-08-27T11:25:59.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 -- 172.21.15.43:0/1067925995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c0c7c00 msgr2=0x7f043c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c0c7c00 0x7f043c0c8110 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f04240098f0 tx=0x7f0424009c00 comp rx=0 tx=0).stop 2023-08-27T11:25:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 -- 172.21.15.43:0/1067925995 shutdown_connections 2023-08-27T11:25:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c06ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 --2- 172.21.15.43:0/1067925995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c0c7c00 0x7f043c0c8110 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 -- 172.21.15.43:0/1067925995 >> 172.21.15.43:0/1067925995 conn(0x7f043c0c9d00 msgr2=0x7f043c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 -- 172.21.15.43:0/1067925995 shutdown_connections 2023-08-27T11:25:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.677+0000 7f04419ff700 1 -- 172.21.15.43:0/1067925995 wait complete. 2023-08-27T11:25:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.679+0000 7f04419ff700 1 Processor -- start 2023-08-27T11:25:59.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.679+0000 7f04419ff700 1 -- start start 2023-08-27T11:25:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 0x7f043c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1584c0 con 0x7f043c151d20 2023-08-27T11:25:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c14e610 con 0x7f043c0c7c00 2023-08-27T11:25:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f04419ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c14dad0 con 0x7f043c06a8e0 2023-08-27T11:25:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51382/0 (socket says 172.21.15.43:51382) 2023-08-27T11:25:59.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 -- 172.21.15.43:0/1413153161 learned_addr learned my addr 172.21.15.43:0/1413153161 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:25:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043affd700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f0433fff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 0x7f043c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 -- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 msgr2=0x7f043c1ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c1ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 -- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 msgr2=0x7f043c0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 0x7f043c0aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f043b7fe700 1 -- 172.21.15.43:0/1413153161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424009550 con 0x7f043c151d20 2023-08-27T11:25:59.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.680+0000 7f0433fff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 0x7f043c0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:25:59.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f043b7fe700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0434007e40 tx=0x7f043400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043400eea0 con 0x7f043c151d20 2023-08-27T11:25:59.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434014420 con 0x7f043c151d20 2023-08-27T11:25:59.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340147b0 con 0x7f043c151d20 2023-08-27T11:25:59.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c1edcd0 con 0x7f043c151d20 2023-08-27T11:25:59.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.681+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c148960 con 0x7f043c151d20 2023-08-27T11:25:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.682+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c04ee70 con 0x7f043c151d20 2023-08-27T11:25:59.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.683+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0434014910 con 0x7f043c151d20 2023-08-27T11:25:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.684+0000 7f0438ff9700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 0x7f041c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:25:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.684+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f0434088a60 con 0x7f043c151d20 2023-08-27T11:25:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.684+0000 7f043affd700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 0x7f041c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:25:59.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.685+0000 7f043affd700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 0x7f041c06c5a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f042c000f60 tx=0x7f042c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:25:59.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.688+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f04340543e0 con 0x7f043c151d20 2023-08-27T11:25:59.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.897+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f043c0c0b00 con 0x7f043c151d20 2023-08-27T11:25:59.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.901+0000 7f0438ff9700 1 -- 172.21.15.43:0/1413153161 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v27)=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0434057a00 con 0x7f043c151d20 2023-08-27T11:25:59.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.903+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 msgr2=0x7f041c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 0x7f041c06c5a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f042c000f60 tx=0x7f042c009040 comp rx=0 tx=0).stop 2023-08-27T11:25:59.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 msgr2=0x7f043c147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:25:59.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0434007e40 tx=0x7f043400e3c0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 shutdown_connections 2023-08-27T11:25:59.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f041c06a0e0 0x7f041c06c5a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f043c151d20 0x7f043c147aa0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f043c06a8e0 0x7f043c1ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 --2- 172.21.15.43:0/1413153161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f043c0c7c00 0x7f043c0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:25:59.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 >> 172.21.15.43:0/1413153161 conn(0x7f043c0c9d00 msgr2=0x7f043c150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:25:59.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 shutdown_connections 2023-08-27T11:25:59.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:25:59.904+0000 7f04419ff700 1 -- 172.21.15.43:0/1413153161 wait complete. 2023-08-27T11:25:59.924 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:25:59.924 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:00.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:00.130 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:26:00.130 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:26:00.131 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:00.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:26:00.175 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:26:00.175 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:00.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:26:00.221 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:26:00.221 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:00.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.421+0000 7f4f9d7ff700 1 Processor -- start 2023-08-27T11:26:00.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.421+0000 7f4f9d7ff700 1 -- start start 2023-08-27T11:26:00.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f9d7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4f980c4a90 0x7f4f9806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:00.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f9d7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9806c4e0 con 0x7f4f980c4630 2023-08-27T11:26:00.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f9d7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f98155370 con 0x7f4f98151a90 2023-08-27T11:26:00.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f9d7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f980c82c0 con 0x7f4f980c4a90 2023-08-27T11:26:00.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f8ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4f980c4630 0x7f4f9806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52958/0 (socket says 172.21.15.43:52958) 2023-08-27T11:26:00.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f8ffff700 1 -- 172.21.15.43:0/405026321 learned_addr learned my addr 172.21.15.43:0/405026321 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:00.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f977fe700 1 --2- 172.21.15.43:0/405026321 >> v2:172.21.15.43:3300/0 conn(0x7f4f980c4a90 0x7f4f9806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:00.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f977fe700 1 -- 172.21.15.43:0/405026321 >> v1:172.21.15.57:6789/0 conn(0x7f4f98151a90 legacy=0x7f4f980c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:00.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f977fe700 1 -- 172.21.15.43:0/405026321 >> v1:172.21.15.43:6789/0 conn(0x7f4f980c4630 legacy=0x7f4f9806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.423+0000 7f4f977fe700 1 -- 172.21.15.43:0/405026321 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98151e70 con 0x7f4f980c4a90 2023-08-27T11:26:00.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f977fe700 1 --2- 172.21.15.43:0/405026321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f980c4a90 0x7f4f9806b480 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009d90 tx=0x7f4f9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbe04c469605db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:00.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f967fc700 1 -- 172.21.15.43:0/405026321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000e070 con 0x7f4f980c4a90 2023-08-27T11:26:00.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f967fc700 1 -- 172.21.15.43:0/405026321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9000bb90 con 0x7f4f980c4a90 2023-08-27T11:26:00.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f967fc700 1 -- 172.21.15.43:0/405026321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90003a20 con 0x7f4f980c4a90 2023-08-27T11:26:00.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/405026321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f980c4a90 msgr2=0x7f4f9806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/405026321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f980c4a90 0x7f4f9806b480 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009d90 tx=0x7f4f9000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:00.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/405026321 shutdown_connections 2023-08-27T11:26:00.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/405026321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f980c4a90 0x7f4f9806b480 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.424+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/405026321 >> 172.21.15.43:0/405026321 conn(0x7f4f980ab820 msgr2=0x7f4f980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:00.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.425+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/405026321 shutdown_connections 2023-08-27T11:26:00.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.425+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/405026321 wait complete. 2023-08-27T11:26:00.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.426+0000 7f4f9d7ff700 1 Processor -- start 2023-08-27T11:26:00.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.426+0000 7f4f9d7ff700 1 -- start start 2023-08-27T11:26:00.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f980c4630 0x7f4f981e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:00.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 0x7f4f980c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:00.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:00.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9814be60 con 0x7f4f98151a90 2023-08-27T11:26:00.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981ea4f0 con 0x7f4f980c4630 2023-08-27T11:26:00.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f9d7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981e9c50 con 0x7f4f980c4a90 2023-08-27T11:26:00.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f977fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:00.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.427+0000 7f4f977fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51404/0 (socket says 172.21.15.43:51404) 2023-08-27T11:26:00.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 -- 172.21.15.43:0/2048280147 learned_addr learned my addr 172.21.15.43:0/2048280147 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:00.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f96ffd700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f980c4630 0x7f4f981e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:00.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f8ffff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 0x7f4f980c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:00.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 -- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 msgr2=0x7f4f980c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 0x7f4f980c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 -- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f980c4630 msgr2=0x7f4f981e95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f980c4630 0x7f4f981e95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 -- 172.21.15.43:0/2048280147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009a70 con 0x7f4f98151a90 2023-08-27T11:26:00.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f8ffff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 0x7f4f980c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f977fe700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ac6e0 tx=0x7f4f90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.428+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012630 con 0x7f4f98151a90 2023-08-27T11:26:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.429+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900127b0 con 0x7f4f98151a90 2023-08-27T11:26:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.429+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f981e9f30 con 0x7f4f98151a90 2023-08-27T11:26:00.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.429+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90012b60 con 0x7f4f98151a90 2023-08-27T11:26:00.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.429+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f980c0680 con 0x7f4f98151a90 2023-08-27T11:26:00.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.430+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9804ee70 con 0x7f4f98151a90 2023-08-27T11:26:00.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.431+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f90012cc0 con 0x7f4f98151a90 2023-08-27T11:26:00.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.431+0000 7f4f8f7fe700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 0x7f4f7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:00.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.431+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f4f9008a830 con 0x7f4f98151a90 2023-08-27T11:26:00.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.432+0000 7f4f96ffd700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 0x7f4f7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:00.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.432+0000 7f4f96ffd700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 0x7f4f7806c5a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009960 tx=0x7f4f880090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:00.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.436+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f900561b0 con 0x7f4f98151a90 2023-08-27T11:26:00.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.691+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f9814bfa0 con 0x7f4f98151a90 2023-08-27T11:26:00.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.692+0000 7f4f8f7fe700 1 -- 172.21.15.43:0/2048280147 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f4f9002ae80 con 0x7f4f98151a90 2023-08-27T11:26:00.694 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:00.694 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/229501658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":229501658},{"type":"v1","addr":"172.21.15.57:6834","nonce":229501658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":6192,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2813047028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2813047028},{"type":"v1","addr":"172.21.15.43:6836","nonce":2813047028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":6411,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3725831326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3725831326},{"type":"v1","addr":"172.21.15.43:6837","nonce":3725831326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":6525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2419656781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2419656781},{"type":"v1","addr":"172.21.15.57:6835","nonce":2419656781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":65}],"filesystems":[]} 2023-08-27T11:26:00.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 msgr2=0x7f4f7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 0x7f4f7806c5a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009960 tx=0x7f4f880090e0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 msgr2=0x7f4f9814a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:00.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ac6e0 tx=0x7f4f90004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 shutdown_connections 2023-08-27T11:26:00.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f7806a0e0 0x7f4f7806c5a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f98151a90 0x7f4f9814a010 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f980c4630 0x7f4f981e95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 --2- 172.21.15.43:0/2048280147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f980c4a90 0x7f4f980c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:00.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 >> 172.21.15.43:0/2048280147 conn(0x7f4f980ab820 msgr2=0x7f4f9814ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:00.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 shutdown_connections 2023-08-27T11:26:00.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:00.694+0000 7f4f9d7ff700 1 -- 172.21.15.43:0/2048280147 wait complete. 2023-08-27T11:26:00.699 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 65 2023-08-27T11:26:00.714 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:26:00.715 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:26:00.715 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:26:00.715 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:00.715 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:26:00.716 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:26:00.716 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:26:00.716 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:00.717 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:26:00.717 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:26:00.717 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:26:00.717 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:00.718 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:26:00.718 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:26:00.718 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:26:00.719 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:00.728 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:26:00.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:26:00.730 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:26:00.730 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:26:00.739 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:26:00.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:26:00.774 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:26:00.775 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:00.778 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:26:00.778 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:00.784 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:26:00.785 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:00.922 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:26:00.923 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:26:00.939 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:26:05.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-08-27T11:26:06.739 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:26:06.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:26:06.745 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:26:06.745 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:06.746 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:26:06.899 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:26:06.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.959+0000 7f71165ff700 1 Processor -- start 2023-08-27T11:26:06.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.960+0000 7f71165ff700 1 -- start start 2023-08-27T11:26:06.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f71165ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f711006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:06.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f71165ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711006d700 con 0x7f7110155910 2023-08-27T11:26:06.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f71165ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7110152430 con 0x7f711006ca60 2023-08-27T11:26:06.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f71165ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71101530b0 con 0x7f71100c51a0 2023-08-27T11:26:06.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f7114b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7110155910 0x7f7110155da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52974/0 (socket says 172.21.15.43:52974) 2023-08-27T11:26:06.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f7114b9c700 1 -- 172.21.15.43:0/1264925817 learned_addr learned my addr 172.21.15.43:0/1264925817 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:06.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f710ffff700 1 --2- 172.21.15.43:0/1264925817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f711006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:06.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.961+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310714958 0 0) 0x7f711006d700 con 0x7f7110155910 2023-08-27T11:26:06.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f80035b0 con 0x7f7110155910 2023-08-27T11:26:06.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685474980 0 0) 0x7f7110152430 con 0x7f711006ca60 2023-08-27T11:26:06.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f711006d700 con 0x7f711006ca60 2023-08-27T11:26:06.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710ffff700 1 -- 172.21.15.43:0/1264925817 >> v1:172.21.15.57:6789/0 conn(0x7f711006ca60 legacy=0x7f71100aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710ffff700 1 -- 172.21.15.43:0/1264925817 >> v1:172.21.15.43:6789/0 conn(0x7f7110155910 legacy=0x7f7110155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710ffff700 1 -- 172.21.15.43:0/1264925817 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110152710 con 0x7f71100c51a0 2023-08-27T11:26:06.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710ffff700 1 --2- 172.21.15.43:0/1264925817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f711006d1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7100009870 tx=0x7f7100009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c281d454a937589 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100011830 con 0x7f71100c51a0 2023-08-27T11:26:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100011990 con 0x7f71100c51a0 2023-08-27T11:26:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.962+0000 7f710effd700 1 -- 172.21.15.43:0/1264925817 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100011d20 con 0x7f71100c51a0 2023-08-27T11:26:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 -- 172.21.15.43:0/1264925817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 msgr2=0x7f711006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:06.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 --2- 172.21.15.43:0/1264925817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f711006d1c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7100009870 tx=0x7f7100009b80 comp rx=0 tx=0).stop 2023-08-27T11:26:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 -- 172.21.15.43:0/1264925817 shutdown_connections 2023-08-27T11:26:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 --2- 172.21.15.43:0/1264925817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f711006d1c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 -- 172.21.15.43:0/1264925817 >> 172.21.15.43:0/1264925817 conn(0x7f711006aa50 msgr2=0x7f71100c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:06.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 -- 172.21.15.43:0/1264925817 shutdown_connections 2023-08-27T11:26:06.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.963+0000 7f71165ff700 1 -- 172.21.15.43:0/1264925817 wait complete. 2023-08-27T11:26:06.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.965+0000 7f71165ff700 1 Processor -- start 2023-08-27T11:26:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.965+0000 7f71165ff700 1 -- start start 2023-08-27T11:26:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f71101e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7110155910 0x7f71101e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:06.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71100a7240 con 0x7f711006ca60 2023-08-27T11:26:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71101ecc40 con 0x7f7110155910 2023-08-27T11:26:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f71165ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71101ecf20 con 0x7f71100c51a0 2023-08-27T11:26:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f710ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:06.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f710ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51448/0 (socket says 172.21.15.43:51448) 2023-08-27T11:26:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f710ffff700 1 -- 172.21.15.43:0/1994209433 learned_addr learned my addr 172.21.15.43:0/1994209433 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f7114b9c700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7110155910 0x7f71101e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.966+0000 7f710f7fe700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f71101e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 -- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 msgr2=0x7f71101e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:06.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f71101e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 -- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7110155910 msgr2=0x7f71101e9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7110155910 0x7f71101e9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 -- 172.21.15.43:0/1994209433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000094a0 con 0x7f711006ca60 2023-08-27T11:26:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710ffff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f71000090b0 tx=0x7f7100004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:06.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710001a6e0 con 0x7f711006ca60 2023-08-27T11:26:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710001a840 con 0x7f711006ca60 2023-08-27T11:26:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71101ed200 con 0x7f711006ca60 2023-08-27T11:26:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710001abb0 con 0x7f711006ca60 2023-08-27T11:26:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.967+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7110153a60 con 0x7f711006ca60 2023-08-27T11:26:06.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.969+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71101e9540 con 0x7f711006ca60 2023-08-27T11:26:06.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.970+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7100022070 con 0x7f711006ca60 2023-08-27T11:26:06.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.970+0000 7f710cff9700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 0x7f70fc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:06.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.971+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f71000892f0 con 0x7f711006ca60 2023-08-27T11:26:06.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.971+0000 7f710f7fe700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 0x7f70fc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:06.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.971+0000 7f710f7fe700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 0x7f70fc06c5d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f71100bc710 tx=0x7f7104009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:06.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:06.975+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7100054e30 con 0x7f711006ca60 2023-08-27T11:26:07.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:07.208+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f711014c840 con 0x7f711006ca60 2023-08-27T11:26:08.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.142+0000 7f710cff9700 1 -- 172.21.15.43:0/1994209433 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f711014c840 con 0x7f711006ca60 2023-08-27T11:26:08.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 msgr2=0x7f70fc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 0x7f70fc06c5d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f71100bc710 tx=0x7f7104009040 comp rx=0 tx=0).stop 2023-08-27T11:26:08.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 msgr2=0x7f71100bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f71000090b0 tx=0x7f7100004750 comp rx=0 tx=0).stop 2023-08-27T11:26:08.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 shutdown_connections 2023-08-27T11:26:08.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70fc06a110 0x7f70fc06c5d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7110155910 0x7f71101e9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f711006ca60 0x7f71100bcb50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 --2- 172.21.15.43:0/1994209433 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71100c51a0 0x7f71101e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 >> 172.21.15.43:0/1994209433 conn(0x7f711006aa50 msgr2=0x7f7110154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:08.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 shutdown_connections 2023-08-27T11:26:08.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.145+0000 7f71165ff700 1 -- 172.21.15.43:0/1994209433 wait complete. 2023-08-27T11:26:08.150 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:26:08.168 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:26:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.373+0000 7fd9917ff700 1 Processor -- start 2023-08-27T11:26:08.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.373+0000 7fd9917ff700 1 -- start start 2023-08-27T11:26:08.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.374+0000 7fd9917ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd98c0c4630 0x7fd98c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd9917ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 0x7fd98c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd9917ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c06c4e0 con 0x7fd98c151a90 2023-08-27T11:26:08.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd9917ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c155370 con 0x7fd98c0c4630 2023-08-27T11:26:08.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd9917ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c0c82c0 con 0x7fd98c06ad70 2023-08-27T11:26:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98a7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd98c0c4630 0x7fd98c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd98c151a90 0x7fd98c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52984/0 (socket says 172.21.15.43:52984) 2023-08-27T11:26:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98affd700 1 -- 172.21.15.43:0/1360448416 learned_addr learned my addr 172.21.15.43:0/1360448416 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98b7fe700 1 --2- 172.21.15.43:0/1360448416 >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 0x7fd98c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98a7fc700 1 -- 172.21.15.43:0/1360448416 >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 msgr2=0x7fd98c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98a7fc700 1 --2- 172.21.15.43:0/1360448416 >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 0x7fd98c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98a7fc700 1 -- 172.21.15.43:0/1360448416 >> v1:172.21.15.43:6789/0 conn(0x7fd98c151a90 legacy=0x7fd98c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98a7fc700 1 -- 172.21.15.43:0/1360448416 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c151e70 con 0x7fd98c0c4630 2023-08-27T11:26:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd98b7fe700 1 --2- 172.21.15.43:0/1360448416 >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 0x7fd98c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:08.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.375+0000 7fd989ffb700 1 -- 172.21.15.43:0/1360448416 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495851113 0 0) 0x7fd98c06c4e0 con 0x7fd98c151a90 2023-08-27T11:26:08.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd98a7fc700 1 --2- 172.21.15.43:0/1360448416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c0c4a90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0c4270 tx=0x7fd980009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd805fa2b8250c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd989ffb700 1 -- 172.21.15.43:0/1360448416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980011830 con 0x7fd98c0c4630 2023-08-27T11:26:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd989ffb700 1 -- 172.21.15.43:0/1360448416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980011990 con 0x7fd98c0c4630 2023-08-27T11:26:08.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd989ffb700 1 -- 172.21.15.43:0/1360448416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980011d20 con 0x7fd98c0c4630 2023-08-27T11:26:08.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 -- 172.21.15.43:0/1360448416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 msgr2=0x7fd98c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 --2- 172.21.15.43:0/1360448416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c0c4a90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0c4270 tx=0x7fd980009b20 comp rx=0 tx=0).stop 2023-08-27T11:26:08.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 -- 172.21.15.43:0/1360448416 shutdown_connections 2023-08-27T11:26:08.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 --2- 172.21.15.43:0/1360448416 >> v2:172.21.15.57:3300/0 conn(0x7fd98c06ad70 0x7fd98c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 --2- 172.21.15.43:0/1360448416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c0c4a90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 -- 172.21.15.43:0/1360448416 >> 172.21.15.43:0/1360448416 conn(0x7fd98c0ab820 msgr2=0x7fd98c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:08.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.376+0000 7fd9917ff700 1 -- 172.21.15.43:0/1360448416 shutdown_connections 2023-08-27T11:26:08.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.377+0000 7fd9917ff700 1 -- 172.21.15.43:0/1360448416 wait complete. 2023-08-27T11:26:08.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.378+0000 7fd9917ff700 1 Processor -- start 2023-08-27T11:26:08.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.378+0000 7fd9917ff700 1 -- start start 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd98c06ad70 0x7fd98c0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c151a90 0x7fd98c1ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14d0a0 con 0x7fd98c0c4630 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14dbd0 con 0x7fd98c151a90 2023-08-27T11:26:08.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd9917ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c14c9e0 con 0x7fd98c06ad70 2023-08-27T11:26:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd98a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd98a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:51468/0 (socket says 172.21.15.43:51468) 2023-08-27T11:26:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.379+0000 7fd98a7fc700 1 -- 172.21.15.43:0/3653544679 learned_addr learned my addr 172.21.15.43:0/3653544679 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98affd700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd98c06ad70 0x7fd98c0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98b7fe700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c151a90 0x7fd98c1ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 -- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd98c06ad70 msgr2=0x7fd98c0c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd98c06ad70 0x7fd98c0c1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 -- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c151a90 msgr2=0x7fd98c1ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c151a90 0x7fd98c1ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 -- 172.21.15.43:0/3653544679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800094a0 con 0x7fd98c0c4630 2023-08-27T11:26:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd98a7fc700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd980000c00 tx=0x7fd980004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9800038a0 con 0x7fd98c0c4630 2023-08-27T11:26:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98001f070 con 0x7fd98c0c4630 2023-08-27T11:26:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd980003c40 con 0x7fd98c0c4630 2023-08-27T11:26:08.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.380+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c14ccc0 con 0x7fd98c0c4630 2023-08-27T11:26:08.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.381+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c1ea5a0 con 0x7fd98c0c4630 2023-08-27T11:26:08.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.382+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c14c840 con 0x7fd98c0c4630 2023-08-27T11:26:08.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.383+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd980026480 con 0x7fd98c0c4630 2023-08-27T11:26:08.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.383+0000 7fd9737fe700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 0x7fd97806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.383+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd980021070 con 0x7fd98c0c4630 2023-08-27T11:26:08.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.384+0000 7fd98affd700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 0x7fd97806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.384+0000 7fd98affd700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 0x7fd97806c5a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000f60 tx=0x7fd97c007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.388+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd98c14c840 con 0x7fd98c0c4630 2023-08-27T11:26:08.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.679+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd98c14c840 con 0x7fd98c0c4630 2023-08-27T11:26:08.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.679+0000 7fd9737fe700 1 -- 172.21.15.43:0/3653544679 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+4724 (secure 0 0 0) 0x7fd98c14c840 con 0x7fd98c0c4630 2023-08-27T11:26:08.682 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:08.682 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:08.683 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:26:08.683 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.683 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:26:08.683 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:26:08.683 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.684 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.684 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:08.684 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:08.684 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.684 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.685 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.685 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.685 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:26:08.685 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:26:08.685 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.686 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.686 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:08.686 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:08.686 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.686 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.687 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.687 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.687 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:26:08.687 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:26:08.687 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.688 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.688 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:08.688 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:08.688 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.688 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.689 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.689 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.689 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:26:08.690 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:26:08.690 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.690 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.691 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:08.691 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:08.691 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.692 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.692 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.693 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:26:08.696 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:26:08.696 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.696 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.697 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.697 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.697 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.698 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.698 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.698 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:26:08.698 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:26:08.698 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.699 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.699 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.699 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.699 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.700 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.700 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.700 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:26:08.700 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:26:08.700 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.701 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.701 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.701 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.702 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.702 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.702 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.703 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:26:08.703 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:26:08.703 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.704 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.704 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.704 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.705 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.705 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.705 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.705 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:26:08.706 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:26:08.706 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.706 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.706 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.707 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.707 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.707 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.708 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.708 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:26:08.708 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:26:08.708 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.709 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.709 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.709 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.709 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.710 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.710 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.710 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:26:08.710 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:26:08.711 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.711 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.711 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.711 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:26:08.712 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:26:08.713 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.713 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:08.713 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:08.713 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.713 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.714 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.714 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.714 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:26:08.715 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:26:08.715 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.715 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.715 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:26:08.715 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:26:08.716 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.716 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.716 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.716 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:26:08.717 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:26:08.717 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.717 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:08.717 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:26:08.717 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:26:08.718 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:26:08.718 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.718 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.718 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.718 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:08.719 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.720 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.720 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.720 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.720 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:26:08.721 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:26:08.721 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.721 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:08.721 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:26:08.722 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:26:08.723 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:08.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:08.723 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:26:08.723 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:08.723 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.724 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:08.724 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:26:08.724 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 msgr2=0x7fd97806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 0x7fd97806c5a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000f60 tx=0x7fd97c007c90 comp rx=0 tx=0).stop 2023-08-27T11:26:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 msgr2=0x7fd98c1e9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd980000c00 tx=0x7fd980004750 comp rx=0 tx=0).stop 2023-08-27T11:26:08.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 shutdown_connections 2023-08-27T11:26:08.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.681+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd97806a0e0 0x7fd97806c5a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd98c151a90 0x7fd98c1ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd98c06ad70 0x7fd98c0c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 --2- 172.21.15.43:0/3653544679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98c0c4630 0x7fd98c1e9b20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 >> 172.21.15.43:0/3653544679 conn(0x7fd98c0ab820 msgr2=0x7fd98c0732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:08.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 shutdown_connections 2023-08-27T11:26:08.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.682+0000 7fd9917ff700 1 -- 172.21.15.43:0/3653544679 wait complete. 2023-08-27T11:26:08.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:08.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.928+0000 7f28f19ff700 1 Processor -- start 2023-08-27T11:26:08.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.928+0000 7f28f19ff700 1 -- start start 2023-08-27T11:26:08.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.929+0000 7f28f19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 0x7f28ec0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.929+0000 7f28f19ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f28ec0c4a90 0x7f28ec06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.929+0000 7f28f19ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec06c4e0 con 0x7f28ec0c4630 2023-08-27T11:26:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.929+0000 7f28f19ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec155370 con 0x7f28ec0c4a90 2023-08-27T11:26:08.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.929+0000 7f28f19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec151e70 con 0x7f28ec151a90 2023-08-27T11:26:08.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f28ec0c4a90 0x7f28ec06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28ea7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f28ec0c4630 0x7f28ec06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53696/0 (socket says 172.21.15.43:53696) 2023-08-27T11:26:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f28ec0c4a90 0x7f28ec06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:59326/0 (socket says 172.21.15.43:59326) 2023-08-27T11:26:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28ea7fc700 1 -- 172.21.15.43:0/2668583683 learned_addr learned my addr 172.21.15.43:0/2668583683 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eaffd700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 0x7f28ec0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28e9ffb700 1 -- 172.21.15.43:0/2668583683 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008941934 0 0) 0x7f28ec06c4e0 con 0x7f28ec0c4630 2023-08-27T11:26:08.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28e9ffb700 1 -- 172.21.15.43:0/2668583683 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d40035b0 con 0x7f28ec0c4630 2023-08-27T11:26:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 -- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 msgr2=0x7f28ec0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 0x7f28ec0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 -- 172.21.15.43:0/2668583683 >> v1:172.21.15.57:6789/0 conn(0x7f28ec0c4630 legacy=0x7f28ec06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eb7fe700 1 -- 172.21.15.43:0/2668583683 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec154480 con 0x7f28ec0c4a90 2023-08-27T11:26:08.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.930+0000 7f28eaffd700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 0x7f28ec0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.931+0000 7f28eb7fe700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec0c4a90 0x7f28ec06b480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009d90 tx=0x7f28e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb2ce06811d0e33f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.931+0000 7f28e9ffb700 1 -- 172.21.15.43:0/2668583683 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400e070 con 0x7f28ec0c4a90 2023-08-27T11:26:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.931+0000 7f28e9ffb700 1 -- 172.21.15.43:0/2668583683 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400bb20 con 0x7f28ec0c4a90 2023-08-27T11:26:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.931+0000 7f28e9ffb700 1 -- 172.21.15.43:0/2668583683 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4012430 con 0x7f28ec0c4a90 2023-08-27T11:26:08.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 -- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec0c4a90 msgr2=0x7f28ec06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec0c4a90 0x7f28ec06b480 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009d90 tx=0x7f28e400b330 comp rx=0 tx=0).stop 2023-08-27T11:26:08.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 -- 172.21.15.43:0/2668583683 shutdown_connections 2023-08-27T11:26:08.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec0c4a90 0x7f28ec06b480 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 --2- 172.21.15.43:0/2668583683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec151a90 0x7f28ec0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 -- 172.21.15.43:0/2668583683 >> 172.21.15.43:0/2668583683 conn(0x7f28ec0ab820 msgr2=0x7f28ec0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 -- 172.21.15.43:0/2668583683 shutdown_connections 2023-08-27T11:26:08.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.932+0000 7f28f19ff700 1 -- 172.21.15.43:0/2668583683 wait complete. 2023-08-27T11:26:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.933+0000 7f28f19ff700 1 Processor -- start 2023-08-27T11:26:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.934+0000 7f28f19ff700 1 -- start start 2023-08-27T11:26:08.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.934+0000 7f28f19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 0x7f28ec153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.934+0000 7f28f19ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 0x7f28ec0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.934+0000 7f28f19ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec151a90 0x7f28ec145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28f19ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c7dc0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28f19ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0aaef0 con 0x7f28ec151a90 2023-08-27T11:26:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28f19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0ab420 con 0x7f28ec0c4630 2023-08-27T11:26:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28eaffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 0x7f28ec153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 0x7f28ec0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28eaffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 0x7f28ec153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37308/0 (socket says 172.21.15.43:37308) 2023-08-27T11:26:08.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28eaffd700 1 -- 172.21.15.43:0/565955531 learned_addr learned my addr 172.21.15.43:0/565955531 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:08.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28eb7fe700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec151a90 0x7f28ec145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 -- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 msgr2=0x7f28ec153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 0x7f28ec153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 -- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec151a90 msgr2=0x7f28ec145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:08.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec151a90 0x7f28ec145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.935+0000 7f28ea7fc700 1 -- 172.21.15.43:0/565955531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0094a0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28ea7fc700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 0x7f28ec0c7880 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c490 tx=0x7f28e000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0005d70 con 0x7f28ec0c4a90 2023-08-27T11:26:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e00070d0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0007440 con 0x7f28ec0c4a90 2023-08-27T11:26:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e4009a70 con 0x7f28ec0c4a90 2023-08-27T11:26:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.936+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec1ea100 con 0x7f28ec0c4a90 2023-08-27T11:26:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.937+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec1542f0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.938+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f28e00075a0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.939+0000 7f28d3fff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 0x7f28d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.939+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f28e00874c0 con 0x7f28ec0c4a90 2023-08-27T11:26:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.939+0000 7f28eaffd700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 0x7f28d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:08.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.940+0000 7f28eaffd700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 0x7f28d806c5a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f28ec146530 tx=0x7f28dc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:08.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:08.943+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f28e0052fa0 con 0x7f28ec0c4a90 2023-08-27T11:26:09.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.159+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28ec153ad0 con 0x7f28ec0c4a90 2023-08-27T11:26:09.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.160+0000 7f28d3fff700 1 -- 172.21.15.43:0/565955531 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14522 (secure 0 0 0) 0x7f28ec153ad0 con 0x7f28ec0c4a90 2023-08-27T11:26:09.162 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:09.162 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":77,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:08.139271+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:09.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 msgr2=0x7f28d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 0x7f28d806c5a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f28ec146530 tx=0x7f28dc009210 comp rx=0 tx=0).stop 2023-08-27T11:26:09.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 msgr2=0x7f28ec0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 0x7f28ec0c7880 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c490 tx=0x7f28e000c7a0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 shutdown_connections 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f28d806a0e0 0x7f28d806c5a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28ec151a90 0x7f28ec145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f28ec0c4630 0x7f28ec153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 --2- 172.21.15.43:0/565955531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f28ec0c4a90 0x7f28ec0c7880 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 >> 172.21.15.43:0/565955531 conn(0x7f28ec0ab820 msgr2=0x7f28ec0c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:09.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 shutdown_connections 2023-08-27T11:26:09.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.163+0000 7f28f19ff700 1 -- 172.21.15.43:0/565955531 wait complete. 2023-08-27T11:26:09.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:26:09.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:26:09.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.386+0000 7f1f773ff700 1 Processor -- start 2023-08-27T11:26:09.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.386+0000 7f1f773ff700 1 -- start start 2023-08-27T11:26:09.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.387+0000 7f1f773ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.387+0000 7f1f773ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.387+0000 7f1f773ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f70154660 con 0x7f1f700c7c00 2023-08-27T11:26:09.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.387+0000 7f1f773ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700c5750 con 0x7f1f7006a8e0 2023-08-27T11:26:09.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.387+0000 7f1f773ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70154940 con 0x7f1f70151d20 2023-08-27T11:26:09.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7599c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7499a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1f700c7c00 0x7f1f700ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53708/0 (socket says 172.21.15.43:53708) 2023-08-27T11:26:09.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7499a700 1 -- 172.21.15.43:0/363786162 learned_addr learned my addr 172.21.15.43:0/363786162 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:09.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7599c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:59348/0 (socket says 172.21.15.43:59348) 2023-08-27T11:26:09.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37314/0 (socket says 172.21.15.43:37314) 2023-08-27T11:26:09.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 -- 172.21.15.43:0/363786162 >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 msgr2=0x7f1f7006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 --2- 172.21.15.43:0/363786162 >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 -- 172.21.15.43:0/363786162 >> v1:172.21.15.57:6789/0 conn(0x7f1f700c7c00 legacy=0x7f1f700ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7519b700 1 -- 172.21.15.43:0/363786162 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70154c20 con 0x7f1f70151d20 2023-08-27T11:26:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.388+0000 7f1f7599c700 1 --2- 172.21.15.43:0/363786162 >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:09.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.389+0000 7f1f7519b700 1 --2- 172.21.15.43:0/363786162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009840 tx=0x7f1f6c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431cffbabd3fa6d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.389+0000 7f1f67fff700 1 -- 172.21.15.43:0/363786162 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c011830 con 0x7f1f70151d20 2023-08-27T11:26:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.389+0000 7f1f67fff700 1 -- 172.21.15.43:0/363786162 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c011990 con 0x7f1f70151d20 2023-08-27T11:26:09.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.389+0000 7f1f67fff700 1 -- 172.21.15.43:0/363786162 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c011d20 con 0x7f1f70151d20 2023-08-27T11:26:09.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 -- 172.21.15.43:0/363786162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 msgr2=0x7f1f700c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 --2- 172.21.15.43:0/363786162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009840 tx=0x7f1f6c009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:09.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 -- 172.21.15.43:0/363786162 shutdown_connections 2023-08-27T11:26:09.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 --2- 172.21.15.43:0/363786162 >> v2:172.21.15.57:3300/0 conn(0x7f1f7006a8e0 0x7f1f7006ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 --2- 172.21.15.43:0/363786162 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f700c8110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 -- 172.21.15.43:0/363786162 >> 172.21.15.43:0/363786162 conn(0x7f1f700c9d00 msgr2=0x7f1f700ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:09.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 -- 172.21.15.43:0/363786162 shutdown_connections 2023-08-27T11:26:09.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.390+0000 7f1f773ff700 1 -- 172.21.15.43:0/363786162 wait complete. 2023-08-27T11:26:09.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.391+0000 7f1f773ff700 1 Processor -- start 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.392+0000 7f1f773ff700 1 -- start start 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.392+0000 7f1f773ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f773ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f700c7c00 0x7f1f701ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f773ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f701ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f773ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700c37e0 con 0x7f1f7006a8e0 2023-08-27T11:26:09.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f773ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700c3d10 con 0x7f1f700c7c00 2023-08-27T11:26:09.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f773ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700c29c0 con 0x7f1f70151d20 2023-08-27T11:26:09.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56856/0 (socket says 172.21.15.43:56856) 2023-08-27T11:26:09.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 -- 172.21.15.43:0/1594744383 learned_addr learned my addr 172.21.15.43:0/1594744383 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:09.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7499a700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f700c7c00 0x7f1f701ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7599c700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f701ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 -- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 msgr2=0x7f1f701ea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f701ea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 -- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f700c7c00 msgr2=0x7f1f701ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f700c7c00 0x7f1f701ea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.393+0000 7f1f7519b700 1 -- 172.21.15.43:0/1594744383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68009a70 con 0x7f1f7006a8e0 2023-08-27T11:26:09.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f7519b700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c014040 tx=0x7f1f6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0045d0 con 0x7f1f7006a8e0 2023-08-27T11:26:09.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c01f070 con 0x7f1f7006a8e0 2023-08-27T11:26:09.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c0094a0 con 0x7f1f7006a8e0 2023-08-27T11:26:09.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0038a0 con 0x7f1f7006a8e0 2023-08-27T11:26:09.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.394+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f700c3a30 con 0x7f1f7006a8e0 2023-08-27T11:26:09.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.395+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7004e710 con 0x7f1f7006a8e0 2023-08-27T11:26:09.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.396+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f6c003a00 con 0x7f1f7006a8e0 2023-08-27T11:26:09.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.397+0000 7f1f65ffb700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 0x7f1f5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.397+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1f6c021070 con 0x7f1f7006a8e0 2023-08-27T11:26:09.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.397+0000 7f1f7499a700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 0x7f1f5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.397+0000 7f1f7499a700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 0x7f1f5406c5a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1f7014b970 tx=0x7f1f60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.401+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1f6c055460 con 0x7f1f7006a8e0 2023-08-27T11:26:09.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.609+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f7004ee70 con 0x7f1f7006a8e0 2023-08-27T11:26:09.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.610+0000 7f1f65ffb700 1 -- 172.21.15.43:0/1594744383 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f6c0150a0 con 0x7f1f7006a8e0 2023-08-27T11:26:09.612 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:26:09.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 msgr2=0x7f1f5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 0x7f1f5406c5a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1f7014b970 tx=0x7f1f60009040 comp rx=0 tx=0).stop 2023-08-27T11:26:09.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 msgr2=0x7f1f70156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c014040 tx=0x7f1f6c004750 comp rx=0 tx=0).stop 2023-08-27T11:26:09.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 shutdown_connections 2023-08-27T11:26:09.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f5406a0e0 0x7f1f5406c5a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1f70151d20 0x7f1f701ea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f7006a8e0 0x7f1f70156cc0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 --2- 172.21.15.43:0/1594744383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f700c7c00 0x7f1f701ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 >> 172.21.15.43:0/1594744383 conn(0x7f1f700c9d00 msgr2=0x7f1f700ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:09.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 shutdown_connections 2023-08-27T11:26:09.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.612+0000 7f1f773ff700 1 -- 172.21.15.43:0/1594744383 wait complete. 2023-08-27T11:26:09.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:26:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.835+0000 7f32595ff700 1 Processor -- start 2023-08-27T11:26:09.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.835+0000 7f32595ff700 1 -- start start 2023-08-27T11:26:09.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32595ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32540c9690 0x7f325415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32595ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32540c80c0 con 0x7f32540ac410 2023-08-27T11:26:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32595ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32541552c0 con 0x7f32540c49f0 2023-08-27T11:26:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32595ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32541555a0 con 0x7f32540c9690 2023-08-27T11:26:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32537fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32540c9690 0x7f325415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32527fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f32540ac410 0x7f32540c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59548/0 (socket says 172.21.15.43:59548) 2023-08-27T11:26:09.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32537fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f32540c9690 0x7f325415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56866/0 (socket says 172.21.15.43:56866) 2023-08-27T11:26:09.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.836+0000 7f32527fc700 1 -- 172.21.15.43:0/2043490895 learned_addr learned my addr 172.21.15.43:0/2043490895 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f32537fe700 1 -- 172.21.15.43:0/2043490895 >> v1:172.21.15.57:6789/0 conn(0x7f32540c49f0 legacy=0x7f3254151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f32537fe700 1 -- 172.21.15.43:0/2043490895 >> v1:172.21.15.43:6789/0 conn(0x7f32540ac410 legacy=0x7f32540c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f32537fe700 1 -- 172.21.15.43:0/2043490895 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540c8360 con 0x7f32540c9690 2023-08-27T11:26:09.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f3251ffb700 1 -- 172.21.15.43:0/2043490895 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198243408 0 0) 0x7f32540c80c0 con 0x7f32540ac410 2023-08-27T11:26:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f32537fe700 1 --2- 172.21.15.43:0/2043490895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c9690 0x7f325415fef0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f324c009d90 tx=0x7f324c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236b7b8b3d4a7ecf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f3251ffb700 1 -- 172.21.15.43:0/2043490895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00e070 con 0x7f32540c9690 2023-08-27T11:26:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f3251ffb700 1 -- 172.21.15.43:0/2043490895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00bbd0 con 0x7f32540c9690 2023-08-27T11:26:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.837+0000 7f3251ffb700 1 -- 172.21.15.43:0/2043490895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c012430 con 0x7f32540c9690 2023-08-27T11:26:09.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 -- 172.21.15.43:0/2043490895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c9690 msgr2=0x7f325415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 --2- 172.21.15.43:0/2043490895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c9690 0x7f325415fef0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f324c009d90 tx=0x7f324c00b330 comp rx=0 tx=0).stop 2023-08-27T11:26:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 -- 172.21.15.43:0/2043490895 shutdown_connections 2023-08-27T11:26:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 --2- 172.21.15.43:0/2043490895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c9690 0x7f325415fef0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 -- 172.21.15.43:0/2043490895 >> 172.21.15.43:0/2043490895 conn(0x7f32540ab8f0 msgr2=0x7f32540abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:09.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 -- 172.21.15.43:0/2043490895 shutdown_connections 2023-08-27T11:26:09.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.838+0000 7f32595ff700 1 -- 172.21.15.43:0/2043490895 wait complete. 2023-08-27T11:26:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.840+0000 7f32595ff700 1 Processor -- start 2023-08-27T11:26:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.841+0000 7f32595ff700 1 -- start start 2023-08-27T11:26:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32540ac410 0x7f32540c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.846 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32540c9690 0x7f32540c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32541e9a90 con 0x7f32540c49f0 2023-08-27T11:26:09.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540aa9b0 con 0x7f32540ac410 2023-08-27T11:26:09.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32595ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3254153cc0 con 0x7f32540c9690 2023-08-27T11:26:09.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56874/0 (socket says 172.21.15.43:56874) 2023-08-27T11:26:09.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32527fc700 1 -- 172.21.15.43:0/1160966828 learned_addr learned my addr 172.21.15.43:0/1160966828 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f3252ffd700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32540ac410 0x7f32540c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.842+0000 7f32537fe700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32540c9690 0x7f32540c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 -- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32540c9690 msgr2=0x7f32540c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32540c9690 0x7f32540c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 -- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32540ac410 msgr2=0x7f32540c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32540ac410 0x7f32540c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 -- 172.21.15.43:0/1160966828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c009a70 con 0x7f32540c49f0 2023-08-27T11:26:09.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32527fc700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3248001eb0 tx=0x7f324800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248004c80 con 0x7f32540c49f0 2023-08-27T11:26:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3248004de0 con 0x7f32540c49f0 2023-08-27T11:26:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248007310 con 0x7f32540c49f0 2023-08-27T11:26:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3254153420 con 0x7f32540c49f0 2023-08-27T11:26:09.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.843+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32541539e0 con 0x7f32540c49f0 2023-08-27T11:26:09.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.844+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32540afe10 con 0x7f32540c49f0 2023-08-27T11:26:09.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.845+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3248007470 con 0x7f32540c49f0 2023-08-27T11:26:09.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.846+0000 7f323b7fe700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 0x7f324006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:09.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.846+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3248087e50 con 0x7f32540c49f0 2023-08-27T11:26:09.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.846+0000 7f3252ffd700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 0x7f324006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:09.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.847+0000 7f3252ffd700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 0x7f324006c5a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3254151f20 tx=0x7f3244009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:09.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:09.851+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3248053880 con 0x7f32540c49f0 2023-08-27T11:26:10.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.059+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32541e9bd0 con 0x7f32540c49f0 2023-08-27T11:26:10.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.060+0000 7f323b7fe700 1 -- 172.21.15.43:0/1160966828 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32541e9bd0 con 0x7f32540c49f0 2023-08-27T11:26:10.062 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:26:10.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 msgr2=0x7f324006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 0x7f324006c5a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3254151f20 tx=0x7f3244009040 comp rx=0 tx=0).stop 2023-08-27T11:26:10.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 msgr2=0x7f3254155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3248001eb0 tx=0x7f324800c800 comp rx=0 tx=0).stop 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 shutdown_connections 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324006a0e0 0x7f324006c5a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32540c9690 0x7f32540c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f32540ac410 0x7f32540c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 --2- 172.21.15.43:0/1160966828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32540c49f0 0x7f3254155950 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 >> 172.21.15.43:0/1160966828 conn(0x7f32540ab8f0 msgr2=0x7f325406a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:10.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 shutdown_connections 2023-08-27T11:26:10.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.062+0000 7f32595ff700 1 -- 172.21.15.43:0/1160966828 wait complete. 2023-08-27T11:26:10.082 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:26:10.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.283+0000 7f0e83bff700 1 Processor -- start 2023-08-27T11:26:10.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.283+0000 7f0e83bff700 1 -- start start 2023-08-27T11:26:10.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.284+0000 7f0e83bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e7c14e960 0x7f0e7c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.284+0000 7f0e83bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 0x7f0e7c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.284+0000 7f0e83bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c154d00 con 0x7f0e7c0c50d0 2023-08-27T11:26:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.284+0000 7f0e83bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0baf30 con 0x7f0e7c14e960 2023-08-27T11:26:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.284+0000 7f0e83bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c154fe0 con 0x7f0e7c0a79c0 2023-08-27T11:26:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e7c14e960 0x7f0e7c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0e7c14e960 0x7f0e7c0a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56878/0 (socket says 172.21.15.43:56878) 2023-08-27T11:26:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 -- 172.21.15.43:0/2047786710 learned_addr learned my addr 172.21.15.43:0/2047786710 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8119a700 1 --2- 172.21.15.43:0/2047786710 >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 0x7f0e7c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 -- 172.21.15.43:0/2047786710 >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 msgr2=0x7f0e7c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:10.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 --2- 172.21.15.43:0/2047786710 >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 0x7f0e7c0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 -- 172.21.15.43:0/2047786710 >> v1:172.21.15.43:6789/0 conn(0x7f0e7c0c50d0 legacy=0x7f0e7c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 -- 172.21.15.43:0/2047786710 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c1552c0 con 0x7f0e7c14e960 2023-08-27T11:26:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8119a700 1 --2- 172.21.15.43:0/2047786710 >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 0x7f0e7c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.285+0000 7f0e8199b700 1 --2- 172.21.15.43:0/2047786710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c0a7480 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c072b00 tx=0x7f0e78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0ec06d74bf07e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e80999700 1 -- 172.21.15.43:0/2047786710 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800b870 con 0x7f0e7c14e960 2023-08-27T11:26:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e80999700 1 -- 172.21.15.43:0/2047786710 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7800b9d0 con 0x7f0e7c14e960 2023-08-27T11:26:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e80999700 1 -- 172.21.15.43:0/2047786710 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800bd60 con 0x7f0e7c14e960 2023-08-27T11:26:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 -- 172.21.15.43:0/2047786710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 msgr2=0x7f0e7c0a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 --2- 172.21.15.43:0/2047786710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c0a7480 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c072b00 tx=0x7f0e78009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 -- 172.21.15.43:0/2047786710 shutdown_connections 2023-08-27T11:26:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 --2- 172.21.15.43:0/2047786710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c0a7480 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 --2- 172.21.15.43:0/2047786710 >> v2:172.21.15.57:3300/0 conn(0x7f0e7c0a79c0 0x7f0e7c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 -- 172.21.15.43:0/2047786710 >> 172.21.15.43:0/2047786710 conn(0x7f0e7c06aa50 msgr2=0x7f0e7c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 -- 172.21.15.43:0/2047786710 shutdown_connections 2023-08-27T11:26:10.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.286+0000 7f0e83bff700 1 -- 172.21.15.43:0/2047786710 wait complete. 2023-08-27T11:26:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.288+0000 7f0e83bff700 1 Processor -- start 2023-08-27T11:26:10.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.288+0000 7f0e83bff700 1 -- start start 2023-08-27T11:26:10.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e7c0a79c0 0x7f0e7c0a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e7c0c50d0 0x7f0e7c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c150d00 con 0x7f0e7c14e960 2023-08-27T11:26:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c153e10 con 0x7f0e7c0a79c0 2023-08-27T11:26:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e83bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c153570 con 0x7f0e7c0c50d0 2023-08-27T11:26:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e8219c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e8219c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56882/0 (socket says 172.21.15.43:56882) 2023-08-27T11:26:10.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.289+0000 7f0e8219c700 1 -- 172.21.15.43:0/563983194 learned_addr learned my addr 172.21.15.43:0/563983194 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:10.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8199b700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e7c0a79c0 0x7f0e7c0a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8119a700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e7c0c50d0 0x7f0e7c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 -- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e7c0c50d0 msgr2=0x7f0e7c14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e7c0c50d0 0x7f0e7c14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 -- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e7c0a79c0 msgr2=0x7f0e7c0a6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e7c0a79c0 0x7f0e7c0a6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 -- 172.21.15.43:0/563983194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009550 con 0x7f0e7c14e960 2023-08-27T11:26:10.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e8219c700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400cc50 tx=0x7f0e7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74003c00 con 0x7f0e7c14e960 2023-08-27T11:26:10.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74003d60 con 0x7f0e7c14e960 2023-08-27T11:26:10.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c1ed170 con 0x7f0e7c14e960 2023-08-27T11:26:10.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400ab60 con 0x7f0e7c14e960 2023-08-27T11:26:10.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.290+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c153aa0 con 0x7f0e7c14e960 2023-08-27T11:26:10.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.292+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c0bb390 con 0x7f0e7c14e960 2023-08-27T11:26:10.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.292+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e7400acc0 con 0x7f0e7c14e960 2023-08-27T11:26:10.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.293+0000 7f0e727fc700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.293+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0e740882a0 con 0x7f0e7c14e960 2023-08-27T11:26:10.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.294+0000 7f0e8199b700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.294+0000 7f0e8199b700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0e78014040 tx=0x7f0e78008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.298+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e74053cd0 con 0x7f0e7c14e960 2023-08-27T11:26:10.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.511+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0e7c153fc0 con 0x7f0e7c14e960 2023-08-27T11:26:10.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.511+0000 7f0e727fc700 1 -- 172.21.15.43:0/563983194 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0e7c153fc0 con 0x7f0e7c14e960 2023-08-27T11:26:10.513 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:10.514 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:26:10.514 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:10.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:26:10.514 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:26:10.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:10.515 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:10.515 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:26:10.515 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:26:10.515 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:10.515 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:26:10.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 msgr2=0x7f0e6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0e78014040 tx=0x7f0e78008030 comp rx=0 tx=0).stop 2023-08-27T11:26:10.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 msgr2=0x7f0e7c13c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400cc50 tx=0x7f0e7400cf60 comp rx=0 tx=0).stop 2023-08-27T11:26:10.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 shutdown_connections 2023-08-27T11:26:10.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0e6006a0e0 0x7f0e6006c5a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0e7c14e960 0x7f0e7c13c640 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e7c0a79c0 0x7f0e7c0a6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 --2- 172.21.15.43:0/563983194 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e7c0c50d0 0x7f0e7c14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 >> 172.21.15.43:0/563983194 conn(0x7f0e7c06aa50 msgr2=0x7f0e7c0c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:10.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 shutdown_connections 2023-08-27T11:26:10.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.514+0000 7f0e83bff700 1 -- 172.21.15.43:0/563983194 wait complete. 2023-08-27T11:26:10.534 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:26:10.534 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:26:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.738+0000 7fdde73ff700 1 Processor -- start 2023-08-27T11:26:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.738+0000 7fdde73ff700 1 -- start start 2023-08-27T11:26:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde73ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdde00c4b80 0x7fdde006be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde73ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde00c4f80 con 0x7fdde0151a40 2023-08-27T11:26:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde73ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde0154730 con 0x7fdde00c4700 2023-08-27T11:26:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde73ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde0154520 con 0x7fdde00c4b80 2023-08-27T11:26:10.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde519b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdde0151a40 0x7fdde00c7c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59576/0 (socket says 172.21.15.43:59576) 2023-08-27T11:26:10.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.739+0000 7fdde519b700 1 -- 172.21.15.43:0/3170364318 learned_addr learned my addr 172.21.15.43:0/3170364318 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:10.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fdde599c700 1 --2- 172.21.15.43:0/3170364318 >> v2:172.21.15.57:3300/0 conn(0x7fdde00c4b80 0x7fdde006be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824995230 0 0) 0x7fdde00c4f80 con 0x7fdde0151a40 2023-08-27T11:26:10.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddcc0035b0 con 0x7fdde0151a40 2023-08-27T11:26:10.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804495986 0 0) 0x7fdde0154730 con 0x7fdde00c4700 2023-08-27T11:26:10.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde00c4f80 con 0x7fdde00c4700 2023-08-27T11:26:10.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fdde599c700 1 -- 172.21.15.43:0/3170364318 >> v1:172.21.15.57:6789/0 conn(0x7fdde00c4700 legacy=0x7fdde006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fdde599c700 1 -- 172.21.15.43:0/3170364318 >> v1:172.21.15.43:6789/0 conn(0x7fdde0151a40 legacy=0x7fdde00c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fdde599c700 1 -- 172.21.15.43:0/3170364318 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0154a10 con 0x7fdde00c4b80 2023-08-27T11:26:10.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.740+0000 7fdde599c700 1 --2- 172.21.15.43:0/3170364318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4b80 0x7fdde006be90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009d90 tx=0x7fddd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b412611174fec975 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800e070 con 0x7fdde00c4b80 2023-08-27T11:26:10.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd800bb20 con 0x7fdde00c4b80 2023-08-27T11:26:10.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fddd7fff700 1 -- 172.21.15.43:0/3170364318 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8012430 con 0x7fdde00c4b80 2023-08-27T11:26:10.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 -- 172.21.15.43:0/3170364318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4b80 msgr2=0x7fdde006be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 --2- 172.21.15.43:0/3170364318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4b80 0x7fdde006be90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009d90 tx=0x7fddd800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:10.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 -- 172.21.15.43:0/3170364318 shutdown_connections 2023-08-27T11:26:10.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 --2- 172.21.15.43:0/3170364318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4b80 0x7fdde006be90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 -- 172.21.15.43:0/3170364318 >> 172.21.15.43:0/3170364318 conn(0x7fdde00ab890 msgr2=0x7fdde00abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:10.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.741+0000 7fdde73ff700 1 -- 172.21.15.43:0/3170364318 shutdown_connections 2023-08-27T11:26:10.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.742+0000 7fdde73ff700 1 -- 172.21.15.43:0/3170364318 wait complete. 2023-08-27T11:26:10.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.743+0000 7fdde73ff700 1 Processor -- start 2023-08-27T11:26:10.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.743+0000 7fdde73ff700 1 -- start start 2023-08-27T11:26:10.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4700 0x7fdde0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdde00c4b80 0x7fdde00c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde01ea710 con 0x7fdde0151a40 2023-08-27T11:26:10.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde00c1c00 con 0x7fdde00c4700 2023-08-27T11:26:10.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde73ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde0155ff0 con 0x7fdde00c4b80 2023-08-27T11:26:10.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.744+0000 7fdde599c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56890/0 (socket says 172.21.15.43:56890) 2023-08-27T11:26:10.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 -- 172.21.15.43:0/4103332122 learned_addr learned my addr 172.21.15.43:0/4103332122 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:10.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde519b700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4700 0x7fdde0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde499a700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdde00c4b80 0x7fdde00c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 -- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdde00c4b80 msgr2=0x7fdde00c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdde00c4b80 0x7fdde00c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 -- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4700 msgr2=0x7fdde0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:10.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4700 0x7fdde0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:10.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 -- 172.21.15.43:0/4103332122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8009a70 con 0x7fdde0151a40 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fdde599c700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fddd8014040 tx=0x7fddd8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.745+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd801b810 con 0x7fdde0151a40 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.746+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8020070 con 0x7fdde0151a40 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.746+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde00c3820 con 0x7fdde0151a40 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.746+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd801bb90 con 0x7fdde0151a40 2023-08-27T11:26:10.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.746+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde01e9e70 con 0x7fdde0151a40 2023-08-27T11:26:10.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.747+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde004ee70 con 0x7fdde0151a40 2023-08-27T11:26:10.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.748+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fddd801bcf0 con 0x7fdde0151a40 2023-08-27T11:26:10.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.749+0000 7fddd5ffb700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 0x7fddc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:10.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.749+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fddd8022070 con 0x7fdde0151a40 2023-08-27T11:26:10.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.749+0000 7fdde519b700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 0x7fddc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:10.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.750+0000 7fdde519b700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 0x7fddc406c5a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdddc007fd0 tx=0x7fdddc007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:10.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.753+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fddd8055ff0 con 0x7fdde0151a40 2023-08-27T11:26:10.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:26:10.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:26:10.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:10.973+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdde006cc80 con 0x7fdde0151a40 2023-08-27T11:26:11.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.158+0000 7fddd5ffb700 1 -- 172.21.15.43:0/4103332122 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7fddd8059610 con 0x7fdde0151a40 2023-08-27T11:26:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 msgr2=0x7fddc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 0x7fddc406c5a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdddc007fd0 tx=0x7fdddc007e00 comp rx=0 tx=0).stop 2023-08-27T11:26:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 msgr2=0x7fdde00c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fddd8014040 tx=0x7fddd8004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 shutdown_connections 2023-08-27T11:26:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fddc406a0e0 0x7fddc406c5a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdde0151a40 0x7fdde00c32e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdde00c4700 0x7fdde0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 --2- 172.21.15.43:0/4103332122 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdde00c4b80 0x7fdde00c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 >> 172.21.15.43:0/4103332122 conn(0x7fdde00ab890 msgr2=0x7fdde0143750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:11.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 shutdown_connections 2023-08-27T11:26:11.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.160+0000 7fdde73ff700 1 -- 172.21.15.43:0/4103332122 wait complete. 2023-08-27T11:26:11.164 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:26:11.184 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:26:11.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.392+0000 7f4d21fff700 1 Processor -- start 2023-08-27T11:26:11.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.392+0000 7f4d21fff700 1 -- start start 2023-08-27T11:26:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d21fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d1c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d21fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d1c157ee0 0x7f4d1c158370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d21fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0c5250 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d21fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c4710 con 0x7f4d1c157ee0 2023-08-27T11:26:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d21fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c4920 con 0x7f4d1c151a70 2023-08-27T11:26:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d1affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4d1c0c7c90 0x7f4d1c0c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59592/0 (socket says 172.21.15.43:59592) 2023-08-27T11:26:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d1affd700 1 -- 172.21.15.43:0/3026580050 learned_addr learned my addr 172.21.15.43:0/3026580050 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d1c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.394+0000 7f4d1bfff700 1 --2- 172.21.15.43:0/3026580050 >> v2:172.21.15.57:3300/0 conn(0x7f4d1c157ee0 0x7f4d1c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828053400 0 0) 0x7f4d1c0c5250 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d040035b0 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2316707320 0 0) 0x7f4d040035b0 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 msgr2=0x7f4d1c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d1c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 >> v2:172.21.15.57:3300/0 conn(0x7f4d1c157ee0 msgr2=0x7f4d1c158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:11.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 --2- 172.21.15.43:0/3026580050 >> v2:172.21.15.57:3300/0 conn(0x7f4d1c157ee0 0x7f4d1c158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0c4c00 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f4d10001670 con 0x7f4d1c0c7c90 2023-08-27T11:26:11.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 >> v1:172.21.15.43:6789/0 conn(0x7f4d1c0c7c90 legacy=0x7f4d1c0c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04004850 0x7f4d04004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c4710 con 0x7f4d04003a00 2023-08-27T11:26:11.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0c4920 con 0x7f4d04004850 2023-08-27T11:26:11.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.395+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0400ba90 con 0x7f4d1c151a70 2023-08-27T11:26:11.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d04003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1affd700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04004850 0x7f4d04004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1bfff700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 msgr2=0x7f4d04005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:11.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d04005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04004850 msgr2=0x7f4d04004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:11.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04004850 0x7f4d04004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/3026580050 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040035b0 con 0x7f4d04003a00 2023-08-27T11:26:11.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1bfff700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c151a70 0x7f4d04005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:11.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d04003e20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009b40 tx=0x7f4d04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1d6e778e0abeda server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:11.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c005a20 con 0x7f4d04003a00 2023-08-27T11:26:11.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c005b80 con 0x7f4d04003a00 2023-08-27T11:26:11.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.396+0000 7f4d1a7fc700 1 -- 172.21.15.43:0/3026580050 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00e6c0 con 0x7f4d04003a00 2023-08-27T11:26:11.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 -- 172.21.15.43:0/3026580050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 msgr2=0x7f4d04003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 --2- 172.21.15.43:0/3026580050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d04003e20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009b40 tx=0x7f4d04005880 comp rx=0 tx=0).stop 2023-08-27T11:26:11.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d1bfff700 1 -- 172.21.15.43:0/3026580050 reap_dead start 2023-08-27T11:26:11.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 -- 172.21.15.43:0/3026580050 shutdown_connections 2023-08-27T11:26:11.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 -- 172.21.15.43:0/3026580050 >> 172.21.15.43:0/3026580050 conn(0x7f4d1c0c9d90 msgr2=0x7f4d1c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:11.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 -- 172.21.15.43:0/3026580050 shutdown_connections 2023-08-27T11:26:11.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.397+0000 7f4d21fff700 1 -- 172.21.15.43:0/3026580050 wait complete. 2023-08-27T11:26:11.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.399+0000 7f4d21fff700 1 Processor -- start 2023-08-27T11:26:11.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.399+0000 7f4d21fff700 1 -- start start 2023-08-27T11:26:11.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 0x7f4d1c144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c144580 0x7f4d1c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c150d20 con 0x7f4d04003a00 2023-08-27T11:26:11.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c14f9c0 con 0x7f4d1c157290 2023-08-27T11:26:11.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d21fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c150510 con 0x7f4d1c144580 2023-08-27T11:26:11.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56908/0 (socket says 172.21.15.43:56908) 2023-08-27T11:26:11.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.400+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/1636481132 learned_addr learned my addr 172.21.15.43:0/1636481132 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:11.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1affd700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 0x7f4d1c144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1bfff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c144580 0x7f4d1c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c144580 msgr2=0x7f4d1c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c144580 0x7f4d1c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 msgr2=0x7f4d1c144040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:11.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 0x7f4d1c144040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:11.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 -- 172.21.15.43:0/1636481132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c1ea6e0 con 0x7f4d04003a00 2023-08-27T11:26:11.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1affd700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 0x7f4d1c144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:11.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d1b7fe700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00ff40 tx=0x7f4d0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:11.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c020070 con 0x7f4d04003a00 2023-08-27T11:26:11.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c005e30 con 0x7f4d04003a00 2023-08-27T11:26:11.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c004480 con 0x7f4d04003a00 2023-08-27T11:26:11.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.401+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c150760 con 0x7f4d04003a00 2023-08-27T11:26:11.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.402+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c157710 con 0x7f4d04003a00 2023-08-27T11:26:11.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.402+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c146820 con 0x7f4d04003a00 2023-08-27T11:26:11.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.404+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d0c0036a0 con 0x7f4d04003a00 2023-08-27T11:26:11.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.405+0000 7f4d03fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 0x7f4d0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:11.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.405+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4d0c0898e0 con 0x7f4d04003a00 2023-08-27T11:26:11.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.405+0000 7f4d1affd700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 0x7f4d0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:11.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.405+0000 7f4d1affd700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 0x7f4d0806c5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0bd050 tx=0x7f4d10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:11.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.408+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d0c055220 con 0x7f4d04003a00 2023-08-27T11:26:11.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:11.619+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4d1c146820 con 0x7f4d04003a00 2023-08-27T11:26:12.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-08-27T11:26:12.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.165+0000 7f4d03fff700 1 -- 172.21.15.43:0/1636481132 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4d1c146820 con 0x7f4d04003a00 2023-08-27T11:26:12.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 msgr2=0x7f4d0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 0x7f4d0806c5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0bd050 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2023-08-27T11:26:12.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 msgr2=0x7f4d1c156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00ff40 tx=0x7f4d0c0047c0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 shutdown_connections 2023-08-27T11:26:12.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0806a0e0 0x7f4d0806c5a0 secure :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0bd050 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2023-08-27T11:26:12.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d1c144580 0x7f4d1c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d04003a00 0x7f4d1c156d50 secure :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00ff40 tx=0x7f4d0c0047c0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 --2- 172.21.15.43:0/1636481132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d1c157290 0x7f4d1c144040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.169+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 >> 172.21.15.43:0/1636481132 conn(0x7f4d1c0c9d90 msgr2=0x7f4d1c14bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:12.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.170+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 shutdown_connections 2023-08-27T11:26:12.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.170+0000 7f4d21fff700 1 -- 172.21.15.43:0/1636481132 wait complete. 2023-08-27T11:26:12.176 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:26:12.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:26:12.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.407+0000 7f3b0b9ff700 1 Processor -- start 2023-08-27T11:26:12.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.407+0000 7f3b0b9ff700 1 -- start start 2023-08-27T11:26:12.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b0b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 0x7f3b040c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b0b9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b04154660 con 0x7f3b040c7c00 2023-08-27T11:26:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b0b9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b04154940 con 0x7f3b04151d20 2023-08-27T11:26:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b0b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c5750 con 0x7f3b0406aff0 2023-08-27T11:26:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b08f9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3b040c7c00 0x7f3b0406a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59608/0 (socket says 172.21.15.43:59608) 2023-08-27T11:26:12.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.408+0000 7f3b08f9a700 1 -- 172.21.15.43:0/2265904936 learned_addr learned my addr 172.21.15.43:0/2265904936 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:12.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3b09f9c700 1 --2- 172.21.15.43:0/2265904936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 0x7f3b040c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:12.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162384131 0 0) 0x7f3b04154660 con 0x7f3b040c7c00 2023-08-27T11:26:12.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af00035b0 con 0x7f3b040c7c00 2023-08-27T11:26:12.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901798159 0 0) 0x7f3b04154940 con 0x7f3b04151d20 2023-08-27T11:26:12.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04154660 con 0x7f3b04151d20 2023-08-27T11:26:12.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3b09f9c700 1 -- 172.21.15.43:0/2265904936 >> v1:172.21.15.57:6789/0 conn(0x7f3b04151d20 legacy=0x7f3b040ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3b09f9c700 1 -- 172.21.15.43:0/2265904936 >> v1:172.21.15.43:6789/0 conn(0x7f3b040c7c00 legacy=0x7f3b0406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3b09f9c700 1 -- 172.21.15.43:0/2265904936 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04154c20 con 0x7f3b0406aff0 2023-08-27T11:26:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.409+0000 7f3b09f9c700 1 --2- 172.21.15.43:0/2265904936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 0x7f3b040c8110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009dc0 tx=0x7f3afc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1dc313f16ffa06 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00e070 con 0x7f3b0406aff0 2023-08-27T11:26:12.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00bb20 con 0x7f3b0406aff0 2023-08-27T11:26:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3afbfff700 1 -- 172.21.15.43:0/2265904936 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc012430 con 0x7f3b0406aff0 2023-08-27T11:26:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/2265904936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 msgr2=0x7f3b040c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/2265904936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 0x7f3b040c8110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009dc0 tx=0x7f3afc00b330 comp rx=0 tx=0).stop 2023-08-27T11:26:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/2265904936 shutdown_connections 2023-08-27T11:26:12.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/2265904936 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0406aff0 0x7f3b040c8110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.410+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/2265904936 >> 172.21.15.43:0/2265904936 conn(0x7f3b040c9d00 msgr2=0x7f3b040ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:12.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.411+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/2265904936 shutdown_connections 2023-08-27T11:26:12.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.411+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/2265904936 wait complete. 2023-08-27T11:26:12.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.412+0000 7f3b0b9ff700 1 Processor -- start 2023-08-27T11:26:12.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.412+0000 7f3b0b9ff700 1 -- start start 2023-08-27T11:26:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b040c7c00 0x7f3b040c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b04151d20 0x7f3b04150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041ea220 con 0x7f3b0406aff0 2023-08-27T11:26:12.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c22d0 con 0x7f3b04151d20 2023-08-27T11:26:12.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041588e0 con 0x7f3b040c7c00 2023-08-27T11:26:12.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0979b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:12.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0979b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56916/0 (socket says 172.21.15.43:56916) 2023-08-27T11:26:12.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.413+0000 7f3b0979b700 1 -- 172.21.15.43:0/3642055423 learned_addr learned my addr 172.21.15.43:0/3642055423 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:12.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b09f9c700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b04151d20 0x7f3b04150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b08f9a700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b040c7c00 0x7f3b040c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 -- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b040c7c00 msgr2=0x7f3b040c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b040c7c00 0x7f3b040c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 -- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b04151d20 msgr2=0x7f3b04150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:12.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b04151d20 0x7f3b04150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:12.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 -- 172.21.15.43:0/3642055423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009a70 con 0x7f3b0406aff0 2023-08-27T11:26:12.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3b0979b700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c500 tx=0x7f3b0000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:12.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000052d0 con 0x7f3b0406aff0 2023-08-27T11:26:12.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00005450 con 0x7f3b0406aff0 2023-08-27T11:26:12.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.414+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000038c0 con 0x7f3b0406aff0 2023-08-27T11:26:12.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.415+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040c2f70 con 0x7f3b0406aff0 2023-08-27T11:26:12.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.415+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b041ea430 con 0x7f3b0406aff0 2023-08-27T11:26:12.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.416+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404ee70 con 0x7f3b0406aff0 2023-08-27T11:26:12.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.417+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b00003a20 con 0x7f3b0406aff0 2023-08-27T11:26:12.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.418+0000 7f3af9ffb700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 0x7f3ae806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:12.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.418+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3b00087880 con 0x7f3b0406aff0 2023-08-27T11:26:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.418+0000 7f3b08f9a700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 0x7f3ae806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.419+0000 7f3b08f9a700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 0x7f3ae806c5a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b041e75e0 tx=0x7f3af4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:12.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.423+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b00052fd0 con 0x7f3b0406aff0 2023-08-27T11:26:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:12.676+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b040ac650 con 0x7f3b0406aff0 2023-08-27T11:26:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.172+0000 7f3af9ffb700 1 -- 172.21.15.43:0/3642055423 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v69) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3b000565f0 con 0x7f3b0406aff0 2023-08-27T11:26:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.176+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 msgr2=0x7f3ae806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.176+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 0x7f3ae806c5a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b041e75e0 tx=0x7f3af4007dc0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.176+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 msgr2=0x7f3b040c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.176+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c500 tx=0x7f3b0000c810 comp rx=0 tx=0).stop 2023-08-27T11:26:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 shutdown_connections 2023-08-27T11:26:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3ae806a0e0 0x7f3ae806c5a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b04151d20 0x7f3b04150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b0406aff0 0x7f3b040c1d90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 --2- 172.21.15.43:0/3642055423 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b040c7c00 0x7f3b040c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 >> 172.21.15.43:0/3642055423 conn(0x7f3b040c9d00 msgr2=0x7f3b040ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 shutdown_connections 2023-08-27T11:26:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.177+0000 7f3b0b9ff700 1 -- 172.21.15.43:0/3642055423 wait complete. 2023-08-27T11:26:13.181 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 13 and data pool 14 2023-08-27T11:26:13.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:13.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.403+0000 7feb825ff700 1 Processor -- start 2023-08-27T11:26:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.403+0000 7feb825ff700 1 -- start start 2023-08-27T11:26:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.404+0000 7feb825ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb7c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.404+0000 7feb825ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c154d00 con 0x7feb7c0a79c0 2023-08-27T11:26:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.404+0000 7feb825ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c154fe0 con 0x7feb7c0c50d0 2023-08-27T11:26:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.404+0000 7feb825ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0baf30 con 0x7feb7c14e960 2023-08-27T11:26:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feb7c0a79c0 0x7feb7c0c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59624/0 (socket says 172.21.15.43:59624) 2023-08-27T11:26:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7b7fe700 1 -- 172.21.15.43:0/2603027924 learned_addr learned my addr 172.21.15.43:0/2603027924 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7bfff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb7c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32935523 0 0) 0x7feb7c154d00 con 0x7feb7c0a79c0 2023-08-27T11:26:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb640035b0 con 0x7feb7c0a79c0 2023-08-27T11:26:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204966505 0 0) 0x7feb640035b0 con 0x7feb7c0a79c0 2023-08-27T11:26:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 msgr2=0x7feb7c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:13.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb7c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 >> v1:172.21.15.57:6789/0 conn(0x7feb7c0c50d0 legacy=0x7feb7c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c1552c0 con 0x7feb7c0a79c0 2023-08-27T11:26:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.405+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7feb70001670 con 0x7feb7c0a79c0 2023-08-27T11:26:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 >> v1:172.21.15.43:6789/0 conn(0x7feb7c0a79c0 legacy=0x7feb7c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb64003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64003f70 0x7feb64004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb64004d90 0x7feb64005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0baf30 con 0x7feb64003f70 2023-08-27T11:26:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6400bbd0 con 0x7feb64004d90 2023-08-27T11:26:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6400bd90 con 0x7feb7c14e960 2023-08-27T11:26:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64003f70 0x7feb64004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb64003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb80b9c700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb64004d90 0x7feb64005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 -- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb64004d90 msgr2=0x7feb64005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb64004d90 0x7feb64005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 -- 172.21.15.43:0/2603027924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64003f70 msgr2=0x7feb64004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb64003f70 0x7feb64004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.406+0000 7feb7bfff700 1 -- 172.21.15.43:0/2603027924 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640035b0 con 0x7feb7c14e960 2023-08-27T11:26:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb7bfff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb64003a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0096f0 tx=0x7feb64005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518e02633e483dd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e6c0 con 0x7feb7c14e960 2023-08-27T11:26:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c00e820 con 0x7feb7c14e960 2023-08-27T11:26:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb7affd700 1 -- 172.21.15.43:0/2603027924 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00ebb0 con 0x7feb7c14e960 2023-08-27T11:26:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb825ff700 1 -- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 msgr2=0x7feb64003a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb825ff700 1 --2- 172.21.15.43:0/2603027924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c14e960 0x7feb64003a30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0096f0 tx=0x7feb64005880 comp rx=0 tx=0).stop 2023-08-27T11:26:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb80b9c700 1 -- 172.21.15.43:0/2603027924 reap_dead start 2023-08-27T11:26:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb825ff700 1 -- 172.21.15.43:0/2603027924 shutdown_connections 2023-08-27T11:26:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.407+0000 7feb825ff700 1 -- 172.21.15.43:0/2603027924 >> 172.21.15.43:0/2603027924 conn(0x7feb7c06aa50 msgr2=0x7feb7c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.408+0000 7feb825ff700 1 -- 172.21.15.43:0/2603027924 shutdown_connections 2023-08-27T11:26:13.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.408+0000 7feb825ff700 1 -- 172.21.15.43:0/2603027924 wait complete. 2023-08-27T11:26:13.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.409+0000 7feb825ff700 1 Processor -- start 2023-08-27T11:26:13.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.409+0000 7feb825ff700 1 -- start start 2023-08-27T11:26:13.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb7c14e960 0x7feb7c14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 0x7feb7c1ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1edd40 con 0x7feb7c1ecf10 2023-08-27T11:26:13.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1ea920 con 0x7feb7c14e960 2023-08-27T11:26:13.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.410+0000 7feb825ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c1ed410 con 0x7feb7c0a4730 2023-08-27T11:26:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56936/0 (socket says 172.21.15.43:56936) 2023-08-27T11:26:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 -- 172.21.15.43:0/1472052416 learned_addr learned my addr 172.21.15.43:0/1472052416 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb80b9c700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 0x7feb7c1ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7bfff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb7c14e960 0x7feb7c14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 -- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 msgr2=0x7feb7c1ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 0x7feb7c1ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 -- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb7c14e960 msgr2=0x7feb7c14f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb7c14e960 0x7feb7c14f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 -- 172.21.15.43:0/1472052416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c1ed6f0 con 0x7feb7c1ecf10 2023-08-27T11:26:13.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb80b9c700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 0x7feb7c1ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:13.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb7b7fe700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb700072c0 tx=0x7feb700075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000f6c0 con 0x7feb7c1ecf10 2023-08-27T11:26:13.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.411+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000f840 con 0x7feb7c1ecf10 2023-08-27T11:26:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.412+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000fbf0 con 0x7feb7c1ecf10 2023-08-27T11:26:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.412+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c1ed9d0 con 0x7feb7c1ecf10 2023-08-27T11:26:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.412+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c146e20 con 0x7feb7c1ecf10 2023-08-27T11:26:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.413+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c04ee70 con 0x7feb7c1ecf10 2023-08-27T11:26:13.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.414+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb7000fd50 con 0x7feb7c1ecf10 2023-08-27T11:26:13.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.415+0000 7feb78ff9700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 0x7feb6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.415+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb70088530 con 0x7feb7c1ecf10 2023-08-27T11:26:13.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.415+0000 7feb7bfff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 0x7feb6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.416+0000 7feb7bfff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 0x7feb6806c5a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01c040 tx=0x7feb6c011040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.419+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb70053c10 con 0x7feb7c1ecf10 2023-08-27T11:26:13.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.633+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb7c0c1050 con 0x7feb7c1ecf10 2023-08-27T11:26:13.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.635+0000 7feb78ff9700 1 -- 172.21.15.43:0/1472052416 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18189 (secure 0 0 0) 0x7feb70057230 con 0x7feb7c1ecf10 2023-08-27T11:26:13.636 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:13.637 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:12.678072+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:13.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 msgr2=0x7feb6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 0x7feb6806c5a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01c040 tx=0x7feb6c011040 comp rx=0 tx=0).stop 2023-08-27T11:26:13.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 msgr2=0x7feb7c1e9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb700072c0 tx=0x7feb700075d0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 shutdown_connections 2023-08-27T11:26:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feb6806a0e0 0x7feb6806c5a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feb7c0a4730 0x7feb7c1ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feb7c14e960 0x7feb7c14f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 --2- 172.21.15.43:0/1472052416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb7c1ecf10 0x7feb7c1e9ea0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.637+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 >> 172.21.15.43:0/1472052416 conn(0x7feb7c06aa50 msgr2=0x7feb7c152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.638+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 shutdown_connections 2023-08-27T11:26:13.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.638+0000 7feb825ff700 1 -- 172.21.15.43:0/1472052416 wait complete. 2023-08-27T11:26:13.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:13.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.857+0000 7f1963bff700 1 Processor -- start 2023-08-27T11:26:13.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.857+0000 7f1963bff700 1 -- start start 2023-08-27T11:26:13.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f195c06ca60 0x7f195c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f195c0ab040 0x7f195c155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c1530b0 con 0x7f195c06ca60 2023-08-27T11:26:13.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c14c860 con 0x7f195c0ab040 2023-08-27T11:26:13.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f1963bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c06d700 con 0x7f195c0c51a0 2023-08-27T11:26:13.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.858+0000 7f196119a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f195c06ca60 0x7f195c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f195c06ca60 0x7f195c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56940/0 (socket says 172.21.15.43:56940) 2023-08-27T11:26:13.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 -- 172.21.15.43:0/2621905864 learned_addr learned my addr 172.21.15.43:0/2621905864 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:13.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196199b700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196219c700 1 --2- 172.21.15.43:0/2621905864 >> v2:172.21.15.57:3300/0 conn(0x7f195c0ab040 0x7f195c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 -- 172.21.15.43:0/2621905864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 msgr2=0x7f195c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:13.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 -- 172.21.15.43:0/2621905864 >> v2:172.21.15.57:3300/0 conn(0x7f195c0ab040 msgr2=0x7f195c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:13.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 --2- 172.21.15.43:0/2621905864 >> v2:172.21.15.57:3300/0 conn(0x7f195c0ab040 0x7f195c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 -- 172.21.15.43:0/2621905864 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c152430 con 0x7f195c06ca60 2023-08-27T11:26:13.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.859+0000 7f196119a700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c0aab00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f195c072b20 tx=0x7f194c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f39fad0d2477dc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1960999700 1 -- 172.21.15.43:0/2621905864 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011830 con 0x7f195c06ca60 2023-08-27T11:26:13.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1960999700 1 -- 172.21.15.43:0/2621905864 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c011990 con 0x7f195c06ca60 2023-08-27T11:26:13.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1960999700 1 -- 172.21.15.43:0/2621905864 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c011d20 con 0x7f195c06ca60 2023-08-27T11:26:13.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 -- 172.21.15.43:0/2621905864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 msgr2=0x7f195c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c0aab00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f195c072b20 tx=0x7f194c009c30 comp rx=0 tx=0).stop 2023-08-27T11:26:13.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 -- 172.21.15.43:0/2621905864 shutdown_connections 2023-08-27T11:26:13.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 --2- 172.21.15.43:0/2621905864 >> v2:172.21.15.57:3300/0 conn(0x7f195c0ab040 0x7f195c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 --2- 172.21.15.43:0/2621905864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c0aab00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 -- 172.21.15.43:0/2621905864 >> 172.21.15.43:0/2621905864 conn(0x7f195c06aa50 msgr2=0x7f195c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:13.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 -- 172.21.15.43:0/2621905864 shutdown_connections 2023-08-27T11:26:13.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.860+0000 7f1963bff700 1 -- 172.21.15.43:0/2621905864 wait complete. 2023-08-27T11:26:13.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.862+0000 7f1963bff700 1 Processor -- start 2023-08-27T11:26:13.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.862+0000 7f1963bff700 1 -- start start 2023-08-27T11:26:13.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 0x7f195c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0a6920 con 0x7f195c06ca60 2023-08-27T11:26:13.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0a6c00 con 0x7f195c0ab040 2023-08-27T11:26:13.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f1963bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0a6ee0 con 0x7f195c0c51a0 2023-08-27T11:26:13.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f196199b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f196199b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56954/0 (socket says 172.21.15.43:56954) 2023-08-27T11:26:13.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.863+0000 7f196199b700 1 -- 172.21.15.43:0/1267819147 learned_addr learned my addr 172.21.15.43:0/1267819147 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:13.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196219c700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196119a700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 0x7f195c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 -- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 msgr2=0x7f195c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 -- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 msgr2=0x7f195c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:13.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 0x7f195c06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:13.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 -- 172.21.15.43:0/1267819147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c009550 con 0x7f195c06ca60 2023-08-27T11:26:13.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196219c700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:13.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196119a700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 0x7f195c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:13.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f196199b700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f195800e870 tx=0x7f195800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958009590 con 0x7f195c06ca60 2023-08-27T11:26:13.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800ee70 con 0x7f195c06ca60 2023-08-27T11:26:13.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800ca50 con 0x7f195c06ca60 2023-08-27T11:26:13.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195c0a71c0 con 0x7f195c06ca60 2023-08-27T11:26:13.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.864+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c070090 con 0x7f195c06ca60 2023-08-27T11:26:13.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.866+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c04ee70 con 0x7f195c06ca60 2023-08-27T11:26:13.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.867+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f195800cbb0 con 0x7f195c06ca60 2023-08-27T11:26:13.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.867+0000 7f19527fc700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 0x7f194006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:13.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.868+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1958088500 con 0x7f195c06ca60 2023-08-27T11:26:13.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.868+0000 7f196119a700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 0x7f194006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:13.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.868+0000 7f196119a700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 0x7f194006c5a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f194c000c00 tx=0x7f194c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:13.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:13.872+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1958057710 con 0x7f195c06ca60 2023-08-27T11:26:14.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.085+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f195c06c840 con 0x7f195c06ca60 2023-08-27T11:26:14.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.086+0000 7f19527fc700 1 -- 172.21.15.43:0/1267819147 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18176 (secure 0 0 0) 0x7f195800ce60 con 0x7f195c06ca60 2023-08-27T11:26:14.088 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:14.088 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":81,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:13.897528+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:14.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.088+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 msgr2=0x7f194006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.088+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 0x7f194006c5a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f194c000c00 tx=0x7f194c008030 comp rx=0 tx=0).stop 2023-08-27T11:26:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.088+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 msgr2=0x7f195c1e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.088+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f195800e870 tx=0x7f195800ec30 comp rx=0 tx=0).stop 2023-08-27T11:26:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 shutdown_connections 2023-08-27T11:26:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f194006a0e0 0x7f194006c5a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f195c0c51a0 0x7f195c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f195c06ca60 0x7f195c1e7540 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 --2- 172.21.15.43:0/1267819147 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f195c0ab040 0x7f195c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 >> 172.21.15.43:0/1267819147 conn(0x7f195c06aa50 msgr2=0x7f195c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 shutdown_connections 2023-08-27T11:26:14.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.089+0000 7f1963bff700 1 -- 172.21.15.43:0/1267819147 wait complete. 2023-08-27T11:26:14.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:26:14.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.313+0000 7f92089ff700 1 Processor -- start 2023-08-27T11:26:14.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.313+0000 7f92089ff700 1 -- start start 2023-08-27T11:26:14.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.314+0000 7f92089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f92089ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f920414eb60 0x7f92040c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f92089ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92040c03e0 con 0x7f92040c5150 2023-08-27T11:26:14.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f92089ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9204151900 con 0x7f920414eb60 2023-08-27T11:26:14.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f92089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9204151be0 con 0x7f920414e780 2023-08-27T11:26:14.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f920259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f9202d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f920414eb60 0x7f92040c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f920259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37456/0 (socket says 172.21.15.43:37456) 2023-08-27T11:26:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.315+0000 7f920259c700 1 -- 172.21.15.43:0/2666014645 learned_addr learned my addr 172.21.15.43:0/2666014645 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.316+0000 7f920259c700 1 -- 172.21.15.43:0/2666014645 >> v2:172.21.15.57:3300/0 conn(0x7f920414eb60 msgr2=0x7f92040c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.316+0000 7f920259c700 1 --2- 172.21.15.43:0/2666014645 >> v2:172.21.15.57:3300/0 conn(0x7f920414eb60 0x7f92040c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.316+0000 7f920259c700 1 -- 172.21.15.43:0/2666014645 >> v1:172.21.15.57:6789/0 conn(0x7f92040c5150 legacy=0x7f920406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.316+0000 7f920259c700 1 -- 172.21.15.43:0/2666014645 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9204151ec0 con 0x7f920414e780 2023-08-27T11:26:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.316+0000 7f920259c700 1 --2- 172.21.15.43:0/2666014645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f91f40098f0 tx=0x7f91f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b97b5549bd2ab5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:14.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f9201d9b700 1 -- 172.21.15.43:0/2666014645 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4011830 con 0x7f920414e780 2023-08-27T11:26:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f9201d9b700 1 -- 172.21.15.43:0/2666014645 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f4011990 con 0x7f920414e780 2023-08-27T11:26:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f9201d9b700 1 -- 172.21.15.43:0/2666014645 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f4011d20 con 0x7f920414e780 2023-08-27T11:26:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 -- 172.21.15.43:0/2666014645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 msgr2=0x7f92041512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 --2- 172.21.15.43:0/2666014645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f91f40098f0 tx=0x7f91f4009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:14.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 -- 172.21.15.43:0/2666014645 shutdown_connections 2023-08-27T11:26:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 --2- 172.21.15.43:0/2666014645 >> v2:172.21.15.57:3300/0 conn(0x7f920414eb60 0x7f92040c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 --2- 172.21.15.43:0/2666014645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414e780 0x7f92041512b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.317+0000 7f92089ff700 1 -- 172.21.15.43:0/2666014645 >> 172.21.15.43:0/2666014645 conn(0x7f92040c5b10 msgr2=0x7f92040c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.318+0000 7f92089ff700 1 -- 172.21.15.43:0/2666014645 shutdown_connections 2023-08-27T11:26:14.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.318+0000 7f92089ff700 1 -- 172.21.15.43:0/2666014645 wait complete. 2023-08-27T11:26:14.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.320+0000 7f92089ff700 1 Processor -- start 2023-08-27T11:26:14.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.320+0000 7f92089ff700 1 -- start start 2023-08-27T11:26:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 0x7f92040c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414eb60 0x7f9204142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92041453b0 con 0x7f920414e780 2023-08-27T11:26:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92040a6440 con 0x7f92040c5150 2023-08-27T11:26:14.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f92089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92041442f0 con 0x7f920414eb60 2023-08-27T11:26:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f91fbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56964/0 (socket says 172.21.15.43:56964) 2023-08-27T11:26:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f91fbfff700 1 -- 172.21.15.43:0/1843171729 learned_addr learned my addr 172.21.15.43:0/1843171729 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f920259c700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 0x7f92040c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.321+0000 7f9202d9d700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414eb60 0x7f9204142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 -- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414eb60 msgr2=0x7f9204142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414eb60 0x7f9204142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 -- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 msgr2=0x7f92040c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:14.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 0x7f92040c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:14.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 -- 172.21.15.43:0/1843171729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f4009550 con 0x7f920414e780 2023-08-27T11:26:14.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f920259c700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 0x7f92040c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:14.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91fbfff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c4e0 tx=0x7f91ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:14.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0052d0 con 0x7f920414e780 2023-08-27T11:26:14.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec005430 con 0x7f920414e780 2023-08-27T11:26:14.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9204144cf0 con 0x7f920414e780 2023-08-27T11:26:14.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0038c0 con 0x7f920414e780 2023-08-27T11:26:14.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.322+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9204143f80 con 0x7f920414e780 2023-08-27T11:26:14.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.324+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920404e620 con 0x7f920414e780 2023-08-27T11:26:14.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.325+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91ec003a20 con 0x7f920414e780 2023-08-27T11:26:14.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.325+0000 7f91faffd700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 0x7f91e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.326+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91ec087980 con 0x7f920414e780 2023-08-27T11:26:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.326+0000 7f920259c700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 0x7f91e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.326+0000 7f920259c700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 0x7f91e406c5a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009c40 tx=0x7f91f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:14.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.330+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91ec052fe0 con 0x7f920414e780 2023-08-27T11:26:14.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:14.583+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f920404ee70 con 0x7f920414e780 2023-08-27T11:26:15.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.194+0000 7f91faffd700 1 -- 172.21.15.43:0/1843171729 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91ec056600 con 0x7f920414e780 2023-08-27T11:26:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 msgr2=0x7f91e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 0x7f91e406c5a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009c40 tx=0x7f91f4008030 comp rx=0 tx=0).stop 2023-08-27T11:26:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 msgr2=0x7f9204141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c4e0 tx=0x7f91ec00c7f0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 shutdown_connections 2023-08-27T11:26:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f91e406a0e0 0x7f91e406c5a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f920414eb60 0x7f9204142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92040c5150 0x7f92040c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 --2- 172.21.15.43:0/1843171729 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f920414e780 0x7f9204141f50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 >> 172.21.15.43:0/1843171729 conn(0x7f92040c5b10 msgr2=0x7f920414a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 shutdown_connections 2023-08-27T11:26:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.197+0000 7f92089ff700 1 -- 172.21.15.43:0/1843171729 wait complete. 2023-08-27T11:26:15.220 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:26:15.220 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:26:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.429+0000 7fa255fff700 1 Processor -- start 2023-08-27T11:26:15.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.429+0000 7fa255fff700 1 -- start start 2023-08-27T11:26:15.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa250155250 0x7fa2500ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2500bac30 0x7fa2500c12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2500c1820 0x7fa2500a7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa250155630 con 0x7fa2500c1820 2023-08-27T11:26:15.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2500a5400 con 0x7fa250155250 2023-08-27T11:26:15.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa255fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2500a56e0 con 0x7fa2500bac30 2023-08-27T11:26:15.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa24ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2500c1820 0x7fa2500a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa24ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa2500c1820 0x7fa2500a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56974/0 (socket says 172.21.15.43:56974) 2023-08-27T11:26:15.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa24ffff700 1 -- 172.21.15.43:0/1898774735 learned_addr learned my addr 172.21.15.43:0/1898774735 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:15.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa24f7fe700 1 --2- 172.21.15.43:0/1898774735 >> v2:172.21.15.57:3300/0 conn(0x7fa250155250 0x7fa2500ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.430+0000 7fa247fff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2500bac30 0x7fa2500c12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 -- 172.21.15.43:0/1898774735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2500bac30 msgr2=0x7fa2500c12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:15.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2500bac30 0x7fa2500c12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 -- 172.21.15.43:0/1898774735 >> v2:172.21.15.57:3300/0 conn(0x7fa250155250 msgr2=0x7fa2500ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:15.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 --2- 172.21.15.43:0/1898774735 >> v2:172.21.15.57:3300/0 conn(0x7fa250155250 0x7fa2500ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 -- 172.21.15.43:0/1898774735 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500a59c0 con 0x7fa2500c1820 2023-08-27T11:26:15.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24ffff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500a7910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa25006d710 tx=0x7fa24800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13249fd2c65f8148 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:15.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24effd700 1 -- 172.21.15.43:0/1898774735 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800e070 con 0x7fa2500c1820 2023-08-27T11:26:15.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24effd700 1 -- 172.21.15.43:0/1898774735 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800b9c0 con 0x7fa2500c1820 2023-08-27T11:26:15.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.431+0000 7fa24effd700 1 -- 172.21.15.43:0/1898774735 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800bd70 con 0x7fa2500c1820 2023-08-27T11:26:15.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 -- 172.21.15.43:0/1898774735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 msgr2=0x7fa2500a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:15.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500a7910 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa25006d710 tx=0x7fa24800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:15.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 -- 172.21.15.43:0/1898774735 shutdown_connections 2023-08-27T11:26:15.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500a7910 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 --2- 172.21.15.43:0/1898774735 >> v2:172.21.15.57:3300/0 conn(0x7fa250155250 0x7fa2500ba6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 --2- 172.21.15.43:0/1898774735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2500bac30 0x7fa2500c12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 -- 172.21.15.43:0/1898774735 >> 172.21.15.43:0/1898774735 conn(0x7fa2500c5850 msgr2=0x7fa2500c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:15.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 -- 172.21.15.43:0/1898774735 shutdown_connections 2023-08-27T11:26:15.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.432+0000 7fa255fff700 1 -- 172.21.15.43:0/1898774735 wait complete. 2023-08-27T11:26:15.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.434+0000 7fa255fff700 1 Processor -- start 2023-08-27T11:26:15.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.434+0000 7fa255fff700 1 -- start start 2023-08-27T11:26:15.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2500bac30 0x7fa2500c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa250155250 0x7fa250147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25014c810 con 0x7fa2500c1820 2023-08-27T11:26:15.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501eae50 con 0x7fa2500bac30 2023-08-27T11:26:15.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa255fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501eb130 con 0x7fa250155250 2023-08-27T11:26:15.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56990/0 (socket says 172.21.15.43:56990) 2023-08-27T11:26:15.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 -- 172.21.15.43:0/2322254466 learned_addr learned my addr 172.21.15.43:0/2322254466 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:15.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa24f7fe700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2500bac30 0x7fa2500c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa24ffff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa250155250 0x7fa250147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 -- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa250155250 msgr2=0x7fa250147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:15.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa250155250 0x7fa250147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 -- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2500bac30 msgr2=0x7fa2500c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:15.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2500bac30 0x7fa2500c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:15.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.435+0000 7fa247fff700 1 -- 172.21.15.43:0/2322254466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248009b30 con 0x7fa2500c1820 2023-08-27T11:26:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa247fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e7e0 tx=0x7fa23800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800c070 con 0x7fa2500c1820 2023-08-27T11:26:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa238013610 con 0x7fa2500c1820 2023-08-27T11:26:15.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238013980 con 0x7fa2500c1820 2023-08-27T11:26:15.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2501eb410 con 0x7fa2500c1820 2023-08-27T11:26:15.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.436+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2500c4c20 con 0x7fa2500c1820 2023-08-27T11:26:15.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.437+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25004ee70 con 0x7fa2500c1820 2023-08-27T11:26:15.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.438+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa238013ae0 con 0x7fa2500c1820 2023-08-27T11:26:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.439+0000 7fa24cff9700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:15.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.439+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa238088380 con 0x7fa2500c1820 2023-08-27T11:26:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.439+0000 7fa24f7fe700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.440+0000 7fa24f7fe700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 0x7fa23006c5a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa240006b20 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:15.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.443+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2380539e0 con 0x7fa2500c1820 2023-08-27T11:26:15.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:15.696+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa2500bb600 con 0x7fa2500c1820 2023-08-27T11:26:16.111 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-08-27T11:26:16.109+0000 7f2d3bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:26:16.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.196+0000 7fa24cff9700 1 -- 172.21.15.43:0/2322254466 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa238057000 con 0x7fa2500c1820 2023-08-27T11:26:16.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 msgr2=0x7fa23006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 0x7fa23006c5a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa240006b20 tx=0x7fa240008040 comp rx=0 tx=0).stop 2023-08-27T11:26:16.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 msgr2=0x7fa2500bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e7e0 tx=0x7fa23800eaf0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 shutdown_connections 2023-08-27T11:26:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa23006a0e0 0x7fa23006c5a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa250155250 0x7fa250147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2500bac30 0x7fa2500c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 --2- 172.21.15.43:0/2322254466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa2500c1820 0x7fa2500bd9e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 >> 172.21.15.43:0/2322254466 conn(0x7fa2500c5850 msgr2=0x7fa2501de5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 shutdown_connections 2023-08-27T11:26:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.199+0000 7fa255fff700 1 -- 172.21.15.43:0/2322254466 wait complete. 2023-08-27T11:26:16.222 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:26:16.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:16.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.426+0000 7fbe12bff700 1 Processor -- start 2023-08-27T11:26:16.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.427+0000 7fbe12bff700 1 -- start start 2023-08-27T11:26:16.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe12bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0c51a0 0x7fbe0c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe12bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c06ca60 0x7fbe0c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe12bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0c06d700 con 0x7fbe0c0ab040 2023-08-27T11:26:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe12bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c1530b0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe12bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0c14c860 con 0x7fbe0c0c51a0 2023-08-27T11:26:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe0bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c06ca60 0x7fbe0c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe0bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe0c06ca60 0x7fbe0c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56994/0 (socket says 172.21.15.43:56994) 2023-08-27T11:26:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe0bfff700 1 -- 172.21.15.43:0/2437096930 learned_addr learned my addr 172.21.15.43:0/2437096930 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.428+0000 7fbe1099b700 1 --2- 172.21.15.43:0/2437096930 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0c51a0 0x7fbe0c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0bfff700 1 -- 172.21.15.43:0/2437096930 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0c51a0 msgr2=0x7fbe0c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/2437096930 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0c51a0 0x7fbe0c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0bfff700 1 -- 172.21.15.43:0/2437096930 >> v1:172.21.15.43:6789/0 conn(0x7fbe0c0ab040 legacy=0x7fbe0c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0bfff700 1 -- 172.21.15.43:0/2437096930 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c152430 con 0x7fbe0c06ca60 2023-08-27T11:26:16.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2437096930 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048433272 0 0) 0x7fbe0c06d700 con 0x7fbe0c0ab040 2023-08-27T11:26:16.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/2437096930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c0aab00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c06db90 tx=0x7fbdf8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e679b55ce9d2a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2437096930 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800b860 con 0x7fbe0c06ca60 2023-08-27T11:26:16.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2437096930 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800b9c0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.429+0000 7fbe0b7fe700 1 -- 172.21.15.43:0/2437096930 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800bd50 con 0x7fbe0c06ca60 2023-08-27T11:26:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 -- 172.21.15.43:0/2437096930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 msgr2=0x7fbe0c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 --2- 172.21.15.43:0/2437096930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c0aab00 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c06db90 tx=0x7fbdf8009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 -- 172.21.15.43:0/2437096930 shutdown_connections 2023-08-27T11:26:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 --2- 172.21.15.43:0/2437096930 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0c51a0 0x7fbe0c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 --2- 172.21.15.43:0/2437096930 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c0aab00 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 -- 172.21.15.43:0/2437096930 >> 172.21.15.43:0/2437096930 conn(0x7fbe0c06aa50 msgr2=0x7fbe0c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 -- 172.21.15.43:0/2437096930 shutdown_connections 2023-08-27T11:26:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.430+0000 7fbe12bff700 1 -- 172.21.15.43:0/2437096930 wait complete. 2023-08-27T11:26:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.432+0000 7fbe12bff700 1 Processor -- start 2023-08-27T11:26:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.432+0000 7fbe12bff700 1 -- start start 2023-08-27T11:26:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 0x7fbe0c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 0x7fbe0c1ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c06f9c0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c1e7760 con 0x7fbe0c0c51a0 2023-08-27T11:26:16.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe12bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c070160 con 0x7fbe0c0ab040 2023-08-27T11:26:16.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57004/0 (socket says 172.21.15.43:57004) 2023-08-27T11:26:16.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 -- 172.21.15.43:0/3225446784 learned_addr learned my addr 172.21.15.43:0/3225446784 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:16.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 0x7fbe0c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1119c700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 0x7fbe0c1ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 -- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 msgr2=0x7fbe0c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 0x7fbe0c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 -- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 msgr2=0x7fbe0c1ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 0x7fbe0c1ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1099b700 1 -- 172.21.15.43:0/3225446784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009550 con 0x7fbe0c06ca60 2023-08-27T11:26:16.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 0x7fbe0c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:16.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.433+0000 7fbe1119c700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 0x7fbe0c1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:16.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe1099b700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000d800 tx=0x7fbe0000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000125f0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe00012750 con 0x7fbe0c06ca60 2023-08-27T11:26:16.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00012b00 con 0x7fbe0c06ca60 2023-08-27T11:26:16.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c06fba0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.434+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c0a93a0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.435+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0c0a9530 con 0x7fbe0c06ca60 2023-08-27T11:26:16.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.436+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe00012c60 con 0x7fbe0c06ca60 2023-08-27T11:26:16.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.437+0000 7fbe097fa700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 0x7fbdf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.437+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe000888c0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.438+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 0x7fbdf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.438+0000 7fbe0bfff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 0x7fbdf006c5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c151620 tx=0x7fbdf8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.442+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbe00053fa0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.693+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe0c074680 con 0x7fbe0c06ca60 2023-08-27T11:26:16.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.694+0000 7fbe097fa700 1 -- 172.21.15.43:0/3225446784 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fbe000575c0 con 0x7fbe0c06ca60 2023-08-27T11:26:16.696 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:16.696 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:16.193725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6603},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6603":{"gid":6603,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6836/1292748157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1292748157},{"type":"v1","addr":"172.21.15.43:6836","nonce":1292748157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:16.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 msgr2=0x7fbdf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 0x7fbdf006c5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c151620 tx=0x7fbdf8008030 comp rx=0 tx=0).stop 2023-08-27T11:26:16.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 msgr2=0x7fbe0c1e7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000d800 tx=0x7fbe0000dbc0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 shutdown_connections 2023-08-27T11:26:16.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdf006a0e0 0x7fbdf006c5a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0c51a0 0x7fbe0c1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe0c06ca60 0x7fbe0c1e7220 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 --2- 172.21.15.43:0/3225446784 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe0c0ab040 0x7fbe0c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 >> 172.21.15.43:0/3225446784 conn(0x7fbe0c06aa50 msgr2=0x7fbe0c0c29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:16.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 shutdown_connections 2023-08-27T11:26:16.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.696+0000 7fbe12bff700 1 -- 172.21.15.43:0/3225446784 wait complete. 2023-08-27T11:26:16.700 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 73 2023-08-27T11:26:16.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.917+0000 7f6337fff700 1 Processor -- start 2023-08-27T11:26:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.917+0000 7f6337fff700 1 -- start start 2023-08-27T11:26:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6337fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63300c51a0 0x7f633006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6337fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 0x7f6330155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6337fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633006d700 con 0x7f633006ca60 2023-08-27T11:26:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6337fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63301530b0 con 0x7f63300c51a0 2023-08-27T11:26:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6337fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633014c860 con 0x7f6330155910 2023-08-27T11:26:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6335d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63300c51a0 0x7f633006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6335d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f63300c51a0 0x7f633006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57018/0 (socket says 172.21.15.43:57018) 2023-08-27T11:26:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f6335d9b700 1 -- 172.21.15.43:0/481515018 learned_addr learned my addr 172.21.15.43:0/481515018 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.918+0000 7f633559a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f633006ca60 0x7f63300aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59644/0 (socket says 172.21.15.43:59644) 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f633659c700 1 --2- 172.21.15.43:0/481515018 >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 0x7f6330155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6335d9b700 1 -- 172.21.15.43:0/481515018 >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 msgr2=0x7f6330155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6335d9b700 1 --2- 172.21.15.43:0/481515018 >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 0x7f6330155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6335d9b700 1 -- 172.21.15.43:0/481515018 >> v1:172.21.15.43:6789/0 conn(0x7f633006ca60 legacy=0x7f63300aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6335d9b700 1 -- 172.21.15.43:0/481515018 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330152430 con 0x7f63300c51a0 2023-08-27T11:26:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f633659c700 1 --2- 172.21.15.43:0/481515018 >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 0x7f6330155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6335d9b700 1 --2- 172.21.15.43:0/481515018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63300c51a0 0x7f633006d1c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6330153440 tx=0x7f632c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea49ba79f3c017b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6334d99700 1 -- 172.21.15.43:0/481515018 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00b860 con 0x7f63300c51a0 2023-08-27T11:26:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6334d99700 1 -- 172.21.15.43:0/481515018 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00b9c0 con 0x7f63300c51a0 2023-08-27T11:26:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.919+0000 7f6334d99700 1 -- 172.21.15.43:0/481515018 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00bd50 con 0x7f63300c51a0 2023-08-27T11:26:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 -- 172.21.15.43:0/481515018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63300c51a0 msgr2=0x7f633006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 --2- 172.21.15.43:0/481515018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63300c51a0 0x7f633006d1c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f6330153440 tx=0x7f632c009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 -- 172.21.15.43:0/481515018 shutdown_connections 2023-08-27T11:26:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 --2- 172.21.15.43:0/481515018 >> v2:172.21.15.57:3300/0 conn(0x7f6330155910 0x7f6330155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 --2- 172.21.15.43:0/481515018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f63300c51a0 0x7f633006d1c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 -- 172.21.15.43:0/481515018 >> 172.21.15.43:0/481515018 conn(0x7f633006aa50 msgr2=0x7f63300c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:16.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 -- 172.21.15.43:0/481515018 shutdown_connections 2023-08-27T11:26:16.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.920+0000 7f6337fff700 1 -- 172.21.15.43:0/481515018 wait complete. 2023-08-27T11:26:16.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.922+0000 7f6337fff700 1 Processor -- start 2023-08-27T11:26:16.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.922+0000 7f6337fff700 1 -- start start 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63300c51a0 0x7f63300c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330155910 0x7f63301ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301e97e0 con 0x7f633006ca60 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300aa230 con 0x7f6330155910 2023-08-27T11:26:16.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6337fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300a9a20 con 0x7f63300c51a0 2023-08-27T11:26:16.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6335d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6335d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57026/0 (socket says 172.21.15.43:57026) 2023-08-27T11:26:16.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6335d9b700 1 -- 172.21.15.43:0/1683638551 learned_addr learned my addr 172.21.15.43:0/1683638551 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:16.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6335d9b700 1 -- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63300c51a0 msgr2=0x7f63300c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.923+0000 7f6335d9b700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63300c51a0 0x7f63300c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6335d9b700 1 -- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330155910 msgr2=0x7f63301ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:16.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6335d9b700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330155910 0x7f63301ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:16.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6335d9b700 1 -- 172.21.15.43:0/1683638551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009550 con 0x7f633006ca60 2023-08-27T11:26:16.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6335d9b700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c004530 con 0x7f633006ca60 2023-08-27T11:26:16.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c01f070 con 0x7f633006ca60 2023-08-27T11:26:16.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63301ea730 con 0x7f633006ca60 2023-08-27T11:26:16.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0038e0 con 0x7f633006ca60 2023-08-27T11:26:16.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.924+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63300a9f50 con 0x7f633006ca60 2023-08-27T11:26:16.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.925+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633004ee70 con 0x7f633006ca60 2023-08-27T11:26:16.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.926+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f632c021030 con 0x7f633006ca60 2023-08-27T11:26:16.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.927+0000 7f63267fc700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 0x7f631406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:16.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.927+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f632c089a80 con 0x7f633006ca60 2023-08-27T11:26:16.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.927+0000 7f633559a700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 0x7f631406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:16.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.928+0000 7f633559a700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 0x7f631406c5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63300c1fd0 tx=0x7f6320007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:16.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:16.932+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f632c055160 con 0x7f633006ca60 2023-08-27T11:26:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.142+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633006c840 con 0x7f633006ca60 2023-08-27T11:26:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.144+0000 7f63267fc700 1 -- 172.21.15.43:0/1683638551 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18176 (secure 0 0 0) 0x7f632c058780 con 0x7f633006ca60 2023-08-27T11:26:17.145 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:17.146 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":81,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:13.897528+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 msgr2=0x7f631406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 0x7f631406c5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63300c1fd0 tx=0x7f6320007a50 comp rx=0 tx=0).stop 2023-08-27T11:26:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 msgr2=0x7f63301ea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c004750 comp rx=0 tx=0).stop 2023-08-27T11:26:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 shutdown_connections 2023-08-27T11:26:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f631406a0e0 0x7f631406c5a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6330155910 0x7f63301ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f633006ca60 0x7f63301ea1f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 --2- 172.21.15.43:0/1683638551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f63300c51a0 0x7f63300c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 >> 172.21.15.43:0/1683638551 conn(0x7f633006aa50 msgr2=0x7f6330150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:17.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 shutdown_connections 2023-08-27T11:26:17.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.146+0000 7f6337fff700 1 -- 172.21.15.43:0/1683638551 wait complete. 2023-08-27T11:26:17.167 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:26:17.167 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:26:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.367+0000 7f1658bff700 1 Processor -- start 2023-08-27T11:26:17.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.367+0000 7f1658bff700 1 -- start start 2023-08-27T11:26:17.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.368+0000 7f1658bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1654151a90 0x7f16540c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.368+0000 7f1658bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 0x7f16540c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.368+0000 7f1658bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165406c4e0 con 0x7f165406ad70 2023-08-27T11:26:17.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.368+0000 7f1658bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1654155370 con 0x7f1654151a90 2023-08-27T11:26:17.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.368+0000 7f1658bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654151e70 con 0x7f16540c4630 2023-08-27T11:26:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1654151a90 0x7f16540c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f1651d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 0x7f16540c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f1652d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f165406ad70 0x7f165406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53744/0 (socket says 172.21.15.43:53744) 2023-08-27T11:26:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f1651d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 0x7f16540c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37512/0 (socket says 172.21.15.43:37512) 2023-08-27T11:26:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f1652d9d700 1 -- 172.21.15.43:0/4187525596 learned_addr learned my addr 172.21.15.43:0/4187525596 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1654151a90 0x7f16540c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:59598/0 (socket says 172.21.15.43:59598) 2023-08-27T11:26:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 -- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 msgr2=0x7f16540c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 --2- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 0x7f16540c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 -- 172.21.15.43:0/4187525596 >> v1:172.21.15.57:6789/0 conn(0x7f165406ad70 legacy=0x7f165406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 -- 172.21.15.43:0/4187525596 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654154480 con 0x7f1654151a90 2023-08-27T11:26:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165159a700 1 -- 172.21.15.43:0/4187525596 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863738563 0 0) 0x7f165406c4e0 con 0x7f165406ad70 2023-08-27T11:26:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.369+0000 7f165259c700 1 --2- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1654151a90 0x7f16540c7bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1644009840 tx=0x7f1644009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4061c4a8a420911 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f165159a700 1 -- 172.21.15.43:0/4187525596 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644011830 con 0x7f1654151a90 2023-08-27T11:26:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f165159a700 1 -- 172.21.15.43:0/4187525596 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644011990 con 0x7f1654151a90 2023-08-27T11:26:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f165159a700 1 -- 172.21.15.43:0/4187525596 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644011d20 con 0x7f1654151a90 2023-08-27T11:26:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 -- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1654151a90 msgr2=0x7f16540c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 --2- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1654151a90 0x7f16540c7bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1644009840 tx=0x7f1644009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 -- 172.21.15.43:0/4187525596 shutdown_connections 2023-08-27T11:26:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 --2- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1654151a90 0x7f16540c7bb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 --2- 172.21.15.43:0/4187525596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f16540c4630 0x7f16540c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 -- 172.21.15.43:0/4187525596 >> 172.21.15.43:0/4187525596 conn(0x7f16540ab820 msgr2=0x7f16540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.370+0000 7f1658bff700 1 -- 172.21.15.43:0/4187525596 shutdown_connections 2023-08-27T11:26:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.371+0000 7f1658bff700 1 -- 172.21.15.43:0/4187525596 wait complete. 2023-08-27T11:26:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.372+0000 7f1658bff700 1 Processor -- start 2023-08-27T11:26:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.372+0000 7f1658bff700 1 -- start start 2023-08-27T11:26:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16540c4630 0x7f1654152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 0x7f16541527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654144420 con 0x7f165406ad70 2023-08-27T11:26:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541ea330 con 0x7f16540c4630 2023-08-27T11:26:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f1658bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16541ea860 con 0x7f1654151a90 2023-08-27T11:26:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f165259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f165259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57032/0 (socket says 172.21.15.43:57032) 2023-08-27T11:26:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.373+0000 7f165259c700 1 -- 172.21.15.43:0/2120901859 learned_addr learned my addr 172.21.15.43:0/2120901859 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1652d9d700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 0x7f16541527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1651d9b700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16540c4630 0x7f1654152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 -- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 msgr2=0x7f16541527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 0x7f16541527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 -- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16540c4630 msgr2=0x7f1654152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16540c4630 0x7f1654152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 -- 172.21.15.43:0/2120901859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16440094a0 con 0x7f165406ad70 2023-08-27T11:26:17.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1652d9d700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 0x7f16541527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:17.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f165259c700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1644009b90 tx=0x7f1644004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440036a0 con 0x7f165406ad70 2023-08-27T11:26:17.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164401e070 con 0x7f165406ad70 2023-08-27T11:26:17.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.374+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541469d0 con 0x7f165406ad70 2023-08-27T11:26:17.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.375+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644003a20 con 0x7f165406ad70 2023-08-27T11:26:17.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.375+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1654153720 con 0x7f165406ad70 2023-08-27T11:26:17.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.376+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165404ee70 con 0x7f165406ad70 2023-08-27T11:26:17.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.377+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1644003b80 con 0x7f165406ad70 2023-08-27T11:26:17.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.378+0000 7f1642ffd700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 0x7f163406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.378+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1644089510 con 0x7f165406ad70 2023-08-27T11:26:17.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.378+0000 7f1651d9b700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 0x7f163406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.379+0000 7f1651d9b700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 0x7f163406c5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16540ab210 tx=0x7f1648009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.382+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1644054bf0 con 0x7f165406ad70 2023-08-27T11:26:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.587+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1654154a40 con 0x7f163406a0e0 2023-08-27T11:26:17.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.598+0000 7f1642ffd700 1 -- 172.21.15.43:0/2120901859 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311504 (secure 0 0 0) 0x7f1648011830 con 0x7f163406a0e0 2023-08-27T11:26:17.603 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 msgr2=0x7f163406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 0x7f163406c5a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16540ab210 tx=0x7f1648009210 comp rx=0 tx=0).stop 2023-08-27T11:26:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 msgr2=0x7f16540aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1644009b90 tx=0x7f1644004750 comp rx=0 tx=0).stop 2023-08-27T11:26:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 shutdown_connections 2023-08-27T11:26:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f163406a0e0 0x7f163406c5a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1654151a90 0x7f16541527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f165406ad70 0x7f16540aa8d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 --2- 172.21.15.43:0/2120901859 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f16540c4630 0x7f1654152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 >> 172.21.15.43:0/2120901859 conn(0x7f16540ab820 msgr2=0x7f165414cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 shutdown_connections 2023-08-27T11:26:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.602+0000 7f1658bff700 1 -- 172.21.15.43:0/2120901859 wait complete. 2023-08-27T11:26:17.608 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:26:17.622 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2023-08-27T11:26:16.355386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225164,"kb_used_data":8984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754749556,"statfs":{"total":773094113280,"available":772863545344,"internally_reserved":0,"allocated":9199616,"data_stored":4865812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198428"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320439+0000","last_change":"2023-08-27T11:26:12.916607+0000","last_active":"2023-08-27T11:26:14.320439+0000","last_peered":"2023-08-27T11:26:14.320439+0000","last_clean":"2023-08-27T11:26:14.320439+0000","last_became_active":"2023-08-27T11:26:12.916349+0000","last_became_peered":"2023-08-27T11:26:12.916349+0000","last_unstale":"2023-08-27T11:26:14.320439+0000","last_undegraded":"2023-08-27T11:26:14.320439+0000","last_fullsized":"2023-08-27T11:26:14.320439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:33:51.331557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320498+0000","last_change":"2023-08-27T11:26:12.928726+0000","last_active":"2023-08-27T11:26:14.320498+0000","last_peered":"2023-08-27T11:26:14.320498+0000","last_clean":"2023-08-27T11:26:14.320498+0000","last_became_active":"2023-08-27T11:26:12.928396+0000","last_became_peered":"2023-08-27T11:26:12.928396+0000","last_unstale":"2023-08-27T11:26:14.320498+0000","last_undegraded":"2023-08-27T11:26:14.320498+0000","last_fullsized":"2023-08-27T11:26:14.320498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:55.562340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320348+0000","last_change":"2023-08-27T11:26:12.914867+0000","last_active":"2023-08-27T11:26:14.320348+0000","last_peered":"2023-08-27T11:26:14.320348+0000","last_clean":"2023-08-27T11:26:14.320348+0000","last_became_active":"2023-08-27T11:26:12.914515+0000","last_became_peered":"2023-08-27T11:26:12.914515+0000","last_unstale":"2023-08-27T11:26:14.320348+0000","last_undegraded":"2023-08-27T11:26:14.320348+0000","last_fullsized":"2023-08-27T11:26:14.320348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:57:12.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904005+0000","last_change":"2023-08-27T11:26:12.920589+0000","last_active":"2023-08-27T11:26:13.904005+0000","last_peered":"2023-08-27T11:26:13.904005+0000","last_clean":"2023-08-27T11:26:13.904005+0000","last_became_active":"2023-08-27T11:26:12.919638+0000","last_became_peered":"2023-08-27T11:26:12.919638+0000","last_unstale":"2023-08-27T11:26:13.904005+0000","last_undegraded":"2023-08-27T11:26:13.904005+0000","last_fullsized":"2023-08-27T11:26:13.904005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:52.324182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904827+0000","last_change":"2023-08-27T11:26:12.913228+0000","last_active":"2023-08-27T11:26:13.904827+0000","last_peered":"2023-08-27T11:26:13.904827+0000","last_clean":"2023-08-27T11:26:13.904827+0000","last_became_active":"2023-08-27T11:26:12.912924+0000","last_became_peered":"2023-08-27T11:26:12.912924+0000","last_unstale":"2023-08-27T11:26:13.904827+0000","last_undegraded":"2023-08-27T11:26:13.904827+0000","last_fullsized":"2023-08-27T11:26:13.904827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:34:34.746044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319605+0000","last_change":"2023-08-27T11:26:12.925740+0000","last_active":"2023-08-27T11:26:14.319605+0000","last_peered":"2023-08-27T11:26:14.319605+0000","last_clean":"2023-08-27T11:26:14.319605+0000","last_became_active":"2023-08-27T11:26:12.925309+0000","last_became_peered":"2023-08-27T11:26:12.925309+0000","last_unstale":"2023-08-27T11:26:14.319605+0000","last_undegraded":"2023-08-27T11:26:14.319605+0000","last_fullsized":"2023-08-27T11:26:14.319605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:43.627847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321393+0000","last_change":"2023-08-27T11:26:12.916797+0000","last_active":"2023-08-27T11:26:14.321393+0000","last_peered":"2023-08-27T11:26:14.321393+0000","last_clean":"2023-08-27T11:26:14.321393+0000","last_became_active":"2023-08-27T11:26:12.916479+0000","last_became_peered":"2023-08-27T11:26:12.916479+0000","last_unstale":"2023-08-27T11:26:14.321393+0000","last_undegraded":"2023-08-27T11:26:14.321393+0000","last_fullsized":"2023-08-27T11:26:14.321393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:40:47.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903871+0000","last_change":"2023-08-27T11:26:12.918994+0000","last_active":"2023-08-27T11:26:13.903871+0000","last_peered":"2023-08-27T11:26:13.903871+0000","last_clean":"2023-08-27T11:26:13.903871+0000","last_became_active":"2023-08-27T11:26:12.918692+0000","last_became_peered":"2023-08-27T11:26:12.918692+0000","last_unstale":"2023-08-27T11:26:13.903871+0000","last_undegraded":"2023-08-27T11:26:13.903871+0000","last_fullsized":"2023-08-27T11:26:13.903871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:11.916602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904877+0000","last_change":"2023-08-27T11:26:12.926121+0000","last_active":"2023-08-27T11:26:13.904877+0000","last_peered":"2023-08-27T11:26:13.904877+0000","last_clean":"2023-08-27T11:26:13.904877+0000","last_became_active":"2023-08-27T11:26:12.925759+0000","last_became_peered":"2023-08-27T11:26:12.925759+0000","last_unstale":"2023-08-27T11:26:13.904877+0000","last_undegraded":"2023-08-27T11:26:13.904877+0000","last_fullsized":"2023-08-27T11:26:13.904877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:55.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901737+0000","last_change":"2023-08-27T11:26:12.922280+0000","last_active":"2023-08-27T11:26:13.901737+0000","last_peered":"2023-08-27T11:26:13.901737+0000","last_clean":"2023-08-27T11:26:13.901737+0000","last_became_active":"2023-08-27T11:26:12.921889+0000","last_became_peered":"2023-08-27T11:26:12.921889+0000","last_unstale":"2023-08-27T11:26:13.901737+0000","last_undegraded":"2023-08-27T11:26:13.901737+0000","last_fullsized":"2023-08-27T11:26:13.901737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:35.866836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905210+0000","last_change":"2023-08-27T11:26:12.914693+0000","last_active":"2023-08-27T11:26:13.905210+0000","last_peered":"2023-08-27T11:26:13.905210+0000","last_clean":"2023-08-27T11:26:13.905210+0000","last_became_active":"2023-08-27T11:26:12.913750+0000","last_became_peered":"2023-08-27T11:26:12.913750+0000","last_unstale":"2023-08-27T11:26:13.905210+0000","last_undegraded":"2023-08-27T11:26:13.905210+0000","last_fullsized":"2023-08-27T11:26:13.905210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:08.908416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901379+0000","last_change":"2023-08-27T11:26:12.905408+0000","last_active":"2023-08-27T11:26:13.901379+0000","last_peered":"2023-08-27T11:26:13.901379+0000","last_clean":"2023-08-27T11:26:13.901379+0000","last_became_active":"2023-08-27T11:26:12.905139+0000","last_became_peered":"2023-08-27T11:26:12.905139+0000","last_unstale":"2023-08-27T11:26:13.901379+0000","last_undegraded":"2023-08-27T11:26:13.901379+0000","last_fullsized":"2023-08-27T11:26:13.901379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:13:11.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904028+0000","last_change":"2023-08-27T11:26:12.924207+0000","last_active":"2023-08-27T11:26:13.904028+0000","last_peered":"2023-08-27T11:26:13.904028+0000","last_clean":"2023-08-27T11:26:13.904028+0000","last_became_active":"2023-08-27T11:26:12.923868+0000","last_became_peered":"2023-08-27T11:26:12.923868+0000","last_unstale":"2023-08-27T11:26:13.904028+0000","last_undegraded":"2023-08-27T11:26:13.904028+0000","last_fullsized":"2023-08-27T11:26:13.904028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:10:31.458764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904369+0000","last_change":"2023-08-27T11:26:12.926421+0000","last_active":"2023-08-27T11:26:13.904369+0000","last_peered":"2023-08-27T11:26:13.904369+0000","last_clean":"2023-08-27T11:26:13.904369+0000","last_became_active":"2023-08-27T11:26:12.926101+0000","last_became_peered":"2023-08-27T11:26:12.926101+0000","last_unstale":"2023-08-27T11:26:13.904369+0000","last_undegraded":"2023-08-27T11:26:13.904369+0000","last_fullsized":"2023-08-27T11:26:13.904369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:27:50.139171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903858+0000","last_change":"2023-08-27T11:26:12.920244+0000","last_active":"2023-08-27T11:26:13.903858+0000","last_peered":"2023-08-27T11:26:13.903858+0000","last_clean":"2023-08-27T11:26:13.903858+0000","last_became_active":"2023-08-27T11:26:12.919934+0000","last_became_peered":"2023-08-27T11:26:12.919934+0000","last_unstale":"2023-08-27T11:26:13.903858+0000","last_undegraded":"2023-08-27T11:26:13.903858+0000","last_fullsized":"2023-08-27T11:26:13.903858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:38.175581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319474+0000","last_change":"2023-08-27T11:26:12.920807+0000","last_active":"2023-08-27T11:26:14.319474+0000","last_peered":"2023-08-27T11:26:14.319474+0000","last_clean":"2023-08-27T11:26:14.319474+0000","last_became_active":"2023-08-27T11:26:12.920101+0000","last_became_peered":"2023-08-27T11:26:12.920101+0000","last_unstale":"2023-08-27T11:26:14.319474+0000","last_undegraded":"2023-08-27T11:26:14.319474+0000","last_fullsized":"2023-08-27T11:26:14.319474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:30.116304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320380+0000","last_change":"2023-08-27T11:26:12.917056+0000","last_active":"2023-08-27T11:26:14.320380+0000","last_peered":"2023-08-27T11:26:14.320380+0000","last_clean":"2023-08-27T11:26:14.320380+0000","last_became_active":"2023-08-27T11:26:12.916769+0000","last_became_peered":"2023-08-27T11:26:12.916769+0000","last_unstale":"2023-08-27T11:26:14.320380+0000","last_undegraded":"2023-08-27T11:26:14.320380+0000","last_fullsized":"2023-08-27T11:26:14.320380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:34.556956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320031+0000","last_change":"2023-08-27T11:26:12.925714+0000","last_active":"2023-08-27T11:26:14.320031+0000","last_peered":"2023-08-27T11:26:14.320031+0000","last_clean":"2023-08-27T11:26:14.320031+0000","last_became_active":"2023-08-27T11:26:12.925443+0000","last_became_peered":"2023-08-27T11:26:12.925443+0000","last_unstale":"2023-08-27T11:26:14.320031+0000","last_undegraded":"2023-08-27T11:26:14.320031+0000","last_fullsized":"2023-08-27T11:26:14.320031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:01:43.450519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904931+0000","last_change":"2023-08-27T11:26:12.924879+0000","last_active":"2023-08-27T11:26:13.904931+0000","last_peered":"2023-08-27T11:26:13.904931+0000","last_clean":"2023-08-27T11:26:13.904931+0000","last_became_active":"2023-08-27T11:26:12.924609+0000","last_became_peered":"2023-08-27T11:26:12.924609+0000","last_unstale":"2023-08-27T11:26:13.904931+0000","last_undegraded":"2023-08-27T11:26:13.904931+0000","last_fullsized":"2023-08-27T11:26:13.904931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:04.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903856+0000","last_change":"2023-08-27T11:26:12.921182+0000","last_active":"2023-08-27T11:26:13.903856+0000","last_peered":"2023-08-27T11:26:13.903856+0000","last_clean":"2023-08-27T11:26:13.903856+0000","last_became_active":"2023-08-27T11:26:12.920765+0000","last_became_peered":"2023-08-27T11:26:12.920765+0000","last_unstale":"2023-08-27T11:26:13.903856+0000","last_undegraded":"2023-08-27T11:26:13.903856+0000","last_fullsized":"2023-08-27T11:26:13.903856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:50.717591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904682+0000","last_change":"2023-08-27T11:26:12.916179+0000","last_active":"2023-08-27T11:26:13.904682+0000","last_peered":"2023-08-27T11:26:13.904682+0000","last_clean":"2023-08-27T11:26:13.904682+0000","last_became_active":"2023-08-27T11:26:12.915621+0000","last_became_peered":"2023-08-27T11:26:12.915621+0000","last_unstale":"2023-08-27T11:26:13.904682+0000","last_undegraded":"2023-08-27T11:26:13.904682+0000","last_fullsized":"2023-08-27T11:26:13.904682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:50.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904437+0000","last_change":"2023-08-27T11:26:12.925717+0000","last_active":"2023-08-27T11:26:13.904437+0000","last_peered":"2023-08-27T11:26:13.904437+0000","last_clean":"2023-08-27T11:26:13.904437+0000","last_became_active":"2023-08-27T11:26:12.925401+0000","last_became_peered":"2023-08-27T11:26:12.925401+0000","last_unstale":"2023-08-27T11:26:13.904437+0000","last_undegraded":"2023-08-27T11:26:13.904437+0000","last_fullsized":"2023-08-27T11:26:13.904437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:49.516580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319884+0000","last_change":"2023-08-27T11:26:12.925559+0000","last_active":"2023-08-27T11:26:14.319884+0000","last_peered":"2023-08-27T11:26:14.319884+0000","last_clean":"2023-08-27T11:26:14.319884+0000","last_became_active":"2023-08-27T11:26:12.925246+0000","last_became_peered":"2023-08-27T11:26:12.925246+0000","last_unstale":"2023-08-27T11:26:14.319884+0000","last_undegraded":"2023-08-27T11:26:14.319884+0000","last_fullsized":"2023-08-27T11:26:14.319884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:30.016959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319435+0000","last_change":"2023-08-27T11:26:12.921640+0000","last_active":"2023-08-27T11:26:14.319435+0000","last_peered":"2023-08-27T11:26:14.319435+0000","last_clean":"2023-08-27T11:26:14.319435+0000","last_became_active":"2023-08-27T11:26:12.921360+0000","last_became_peered":"2023-08-27T11:26:12.921360+0000","last_unstale":"2023-08-27T11:26:14.319435+0000","last_undegraded":"2023-08-27T11:26:14.319435+0000","last_fullsized":"2023-08-27T11:26:14.319435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:33.705877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320850+0000","last_change":"2023-08-27T11:26:12.924720+0000","last_active":"2023-08-27T11:26:14.320850+0000","last_peered":"2023-08-27T11:26:14.320850+0000","last_clean":"2023-08-27T11:26:14.320850+0000","last_became_active":"2023-08-27T11:26:12.924423+0000","last_became_peered":"2023-08-27T11:26:12.924423+0000","last_unstale":"2023-08-27T11:26:14.320850+0000","last_undegraded":"2023-08-27T11:26:14.320850+0000","last_fullsized":"2023-08-27T11:26:14.320850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:49:19.543788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904854+0000","last_change":"2023-08-27T11:26:12.925928+0000","last_active":"2023-08-27T11:26:13.904854+0000","last_peered":"2023-08-27T11:26:13.904854+0000","last_clean":"2023-08-27T11:26:13.904854+0000","last_became_active":"2023-08-27T11:26:12.925454+0000","last_became_peered":"2023-08-27T11:26:12.925454+0000","last_unstale":"2023-08-27T11:26:13.904854+0000","last_undegraded":"2023-08-27T11:26:13.904854+0000","last_fullsized":"2023-08-27T11:26:13.904854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:34.652504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901532+0000","last_change":"2023-08-27T11:26:12.912775+0000","last_active":"2023-08-27T11:26:13.901532+0000","last_peered":"2023-08-27T11:26:13.901532+0000","last_clean":"2023-08-27T11:26:13.901532+0000","last_became_active":"2023-08-27T11:26:12.912497+0000","last_became_peered":"2023-08-27T11:26:12.912497+0000","last_unstale":"2023-08-27T11:26:13.901532+0000","last_undegraded":"2023-08-27T11:26:13.901532+0000","last_fullsized":"2023-08-27T11:26:13.901532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:47.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903892+0000","last_change":"2023-08-27T11:26:12.920783+0000","last_active":"2023-08-27T11:26:13.903892+0000","last_peered":"2023-08-27T11:26:13.903892+0000","last_clean":"2023-08-27T11:26:13.903892+0000","last_became_active":"2023-08-27T11:26:12.920318+0000","last_became_peered":"2023-08-27T11:26:12.920318+0000","last_unstale":"2023-08-27T11:26:13.903892+0000","last_undegraded":"2023-08-27T11:26:13.903892+0000","last_fullsized":"2023-08-27T11:26:13.903892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:11.018859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321608+0000","last_change":"2023-08-27T11:26:12.919233+0000","last_active":"2023-08-27T11:26:14.321608+0000","last_peered":"2023-08-27T11:26:14.321608+0000","last_clean":"2023-08-27T11:26:14.321608+0000","last_became_active":"2023-08-27T11:26:12.918788+0000","last_became_peered":"2023-08-27T11:26:12.918788+0000","last_unstale":"2023-08-27T11:26:14.321608+0000","last_undegraded":"2023-08-27T11:26:14.321608+0000","last_fullsized":"2023-08-27T11:26:14.321608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:16.704996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904978+0000","last_change":"2023-08-27T11:26:12.922607+0000","last_active":"2023-08-27T11:26:13.904978+0000","last_peered":"2023-08-27T11:26:13.904978+0000","last_clean":"2023-08-27T11:26:13.904978+0000","last_became_active":"2023-08-27T11:26:12.922244+0000","last_became_peered":"2023-08-27T11:26:12.922244+0000","last_unstale":"2023-08-27T11:26:13.904978+0000","last_undegraded":"2023-08-27T11:26:13.904978+0000","last_fullsized":"2023-08-27T11:26:13.904978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:16.105475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320099+0000","last_change":"2023-08-27T11:26:12.928926+0000","last_active":"2023-08-27T11:26:14.320099+0000","last_peered":"2023-08-27T11:26:14.320099+0000","last_clean":"2023-08-27T11:26:14.320099+0000","last_became_active":"2023-08-27T11:26:12.927534+0000","last_became_peered":"2023-08-27T11:26:12.927534+0000","last_unstale":"2023-08-27T11:26:14.320099+0000","last_undegraded":"2023-08-27T11:26:14.320099+0000","last_fullsized":"2023-08-27T11:26:14.320099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:38:14.726578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319611+0000","last_change":"2023-08-27T11:26:12.920608+0000","last_active":"2023-08-27T11:26:14.319611+0000","last_peered":"2023-08-27T11:26:14.319611+0000","last_clean":"2023-08-27T11:26:14.319611+0000","last_became_active":"2023-08-27T11:26:12.919617+0000","last_became_peered":"2023-08-27T11:26:12.919617+0000","last_unstale":"2023-08-27T11:26:14.319611+0000","last_undegraded":"2023-08-27T11:26:14.319611+0000","last_fullsized":"2023-08-27T11:26:14.319611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:48.072023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320285+0000","last_change":"2023-08-27T11:26:12.919321+0000","last_active":"2023-08-27T11:26:14.320285+0000","last_peered":"2023-08-27T11:26:14.320285+0000","last_clean":"2023-08-27T11:26:14.320285+0000","last_became_active":"2023-08-27T11:26:12.918601+0000","last_became_peered":"2023-08-27T11:26:12.918601+0000","last_unstale":"2023-08-27T11:26:14.320285+0000","last_undegraded":"2023-08-27T11:26:14.320285+0000","last_fullsized":"2023-08-27T11:26:14.320285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:19.399497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"80'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320826+0000","last_change":"2023-08-27T11:26:12.186993+0000","last_active":"2023-08-27T11:26:14.320826+0000","last_peered":"2023-08-27T11:26:14.320826+0000","last_clean":"2023-08-27T11:26:14.320826+0000","last_became_active":"2023-08-27T11:26:12.186672+0000","last_became_peered":"2023-08-27T11:26:12.186672+0000","last_unstale":"2023-08-27T11:26:14.320826+0000","last_undegraded":"2023-08-27T11:26:14.320826+0000","last_fullsized":"2023-08-27T11:26:14.320826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:58.503144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319784+0000","last_change":"2023-08-27T11:26:12.916020+0000","last_active":"2023-08-27T11:26:14.319784+0000","last_peered":"2023-08-27T11:26:14.319784+0000","last_clean":"2023-08-27T11:26:14.319784+0000","last_became_active":"2023-08-27T11:26:12.915714+0000","last_became_peered":"2023-08-27T11:26:12.915714+0000","last_unstale":"2023-08-27T11:26:14.319784+0000","last_undegraded":"2023-08-27T11:26:14.319784+0000","last_fullsized":"2023-08-27T11:26:14.319784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:29:38.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905016+0000","last_change":"2023-08-27T11:26:12.185898+0000","last_active":"2023-08-27T11:26:13.905016+0000","last_peered":"2023-08-27T11:26:13.905016+0000","last_clean":"2023-08-27T11:26:13.905016+0000","last_became_active":"2023-08-27T11:26:12.185621+0000","last_became_peered":"2023-08-27T11:26:12.185621+0000","last_unstale":"2023-08-27T11:26:13.905016+0000","last_undegraded":"2023-08-27T11:26:13.905016+0000","last_fullsized":"2023-08-27T11:26:13.905016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:29.341596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321607+0000","last_change":"2023-08-27T11:26:12.925252+0000","last_active":"2023-08-27T11:26:14.321607+0000","last_peered":"2023-08-27T11:26:14.321607+0000","last_clean":"2023-08-27T11:26:14.321607+0000","last_became_active":"2023-08-27T11:26:12.924916+0000","last_became_peered":"2023-08-27T11:26:12.924916+0000","last_unstale":"2023-08-27T11:26:14.321607+0000","last_undegraded":"2023-08-27T11:26:14.321607+0000","last_fullsized":"2023-08-27T11:26:14.321607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:19:48.349663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321533+0000","last_change":"2023-08-27T11:26:12.185569+0000","last_active":"2023-08-27T11:26:14.321533+0000","last_peered":"2023-08-27T11:26:14.321533+0000","last_clean":"2023-08-27T11:26:14.321533+0000","last_became_active":"2023-08-27T11:26:12.185241+0000","last_became_peered":"2023-08-27T11:26:12.185241+0000","last_unstale":"2023-08-27T11:26:14.321533+0000","last_undegraded":"2023-08-27T11:26:14.321533+0000","last_fullsized":"2023-08-27T11:26:14.321533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:03.449328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320526+0000","last_change":"2023-08-27T11:26:12.917690+0000","last_active":"2023-08-27T11:26:14.320526+0000","last_peered":"2023-08-27T11:26:14.320526+0000","last_clean":"2023-08-27T11:26:14.320526+0000","last_became_active":"2023-08-27T11:26:12.917382+0000","last_became_peered":"2023-08-27T11:26:12.917382+0000","last_unstale":"2023-08-27T11:26:14.320526+0000","last_undegraded":"2023-08-27T11:26:14.320526+0000","last_fullsized":"2023-08-27T11:26:14.320526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:49.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320783+0000","last_change":"2023-08-27T11:26:12.184729+0000","last_active":"2023-08-27T11:26:14.320783+0000","last_peered":"2023-08-27T11:26:14.320783+0000","last_clean":"2023-08-27T11:26:14.320783+0000","last_became_active":"2023-08-27T11:26:12.183644+0000","last_became_peered":"2023-08-27T11:26:12.183644+0000","last_unstale":"2023-08-27T11:26:14.320783+0000","last_undegraded":"2023-08-27T11:26:14.320783+0000","last_fullsized":"2023-08-27T11:26:14.320783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:35:04.622743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903983+0000","last_change":"2023-08-27T11:26:12.918014+0000","last_active":"2023-08-27T11:26:13.903983+0000","last_peered":"2023-08-27T11:26:13.903983+0000","last_clean":"2023-08-27T11:26:13.903983+0000","last_became_active":"2023-08-27T11:26:12.911290+0000","last_became_peered":"2023-08-27T11:26:12.911290+0000","last_unstale":"2023-08-27T11:26:13.903983+0000","last_undegraded":"2023-08-27T11:26:13.903983+0000","last_fullsized":"2023-08-27T11:26:13.903983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:16:43.994656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904907+0000","last_change":"2023-08-27T11:26:12.180512+0000","last_active":"2023-08-27T11:26:13.904907+0000","last_peered":"2023-08-27T11:26:13.904907+0000","last_clean":"2023-08-27T11:26:13.904907+0000","last_became_active":"2023-08-27T11:26:12.180204+0000","last_became_peered":"2023-08-27T11:26:12.180204+0000","last_unstale":"2023-08-27T11:26:13.904907+0000","last_undegraded":"2023-08-27T11:26:13.904907+0000","last_fullsized":"2023-08-27T11:26:13.904907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:57.737942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319948+0000","last_change":"2023-08-27T11:26:12.914306+0000","last_active":"2023-08-27T11:26:14.319948+0000","last_peered":"2023-08-27T11:26:14.319948+0000","last_clean":"2023-08-27T11:26:14.319948+0000","last_became_active":"2023-08-27T11:26:12.913986+0000","last_became_peered":"2023-08-27T11:26:12.913986+0000","last_unstale":"2023-08-27T11:26:14.319948+0000","last_undegraded":"2023-08-27T11:26:14.319948+0000","last_fullsized":"2023-08-27T11:26:14.319948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:17:50.193171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904298+0000","last_change":"2023-08-27T11:26:12.182827+0000","last_active":"2023-08-27T11:26:13.904298+0000","last_peered":"2023-08-27T11:26:13.904298+0000","last_clean":"2023-08-27T11:26:13.904298+0000","last_became_active":"2023-08-27T11:26:12.182507+0000","last_became_peered":"2023-08-27T11:26:12.182507+0000","last_unstale":"2023-08-27T11:26:13.904298+0000","last_undegraded":"2023-08-27T11:26:13.904298+0000","last_fullsized":"2023-08-27T11:26:13.904298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:22.223259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319857+0000","last_change":"2023-08-27T11:26:12.925562+0000","last_active":"2023-08-27T11:26:14.319857+0000","last_peered":"2023-08-27T11:26:14.319857+0000","last_clean":"2023-08-27T11:26:14.319857+0000","last_became_active":"2023-08-27T11:26:12.924914+0000","last_became_peered":"2023-08-27T11:26:12.924914+0000","last_unstale":"2023-08-27T11:26:14.319857+0000","last_undegraded":"2023-08-27T11:26:14.319857+0000","last_fullsized":"2023-08-27T11:26:14.319857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:05:54.663669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319729+0000","last_change":"2023-08-27T11:26:12.177930+0000","last_active":"2023-08-27T11:26:14.319729+0000","last_peered":"2023-08-27T11:26:14.319729+0000","last_clean":"2023-08-27T11:26:14.319729+0000","last_became_active":"2023-08-27T11:26:12.177665+0000","last_became_peered":"2023-08-27T11:26:12.177665+0000","last_unstale":"2023-08-27T11:26:14.319729+0000","last_undegraded":"2023-08-27T11:26:14.319729+0000","last_fullsized":"2023-08-27T11:26:14.319729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:58:25.609029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903867+0000","last_change":"2023-08-27T11:26:12.919704+0000","last_active":"2023-08-27T11:26:13.903867+0000","last_peered":"2023-08-27T11:26:13.903867+0000","last_clean":"2023-08-27T11:26:13.903867+0000","last_became_active":"2023-08-27T11:26:12.919430+0000","last_became_peered":"2023-08-27T11:26:12.919430+0000","last_unstale":"2023-08-27T11:26:13.903867+0000","last_undegraded":"2023-08-27T11:26:13.903867+0000","last_fullsized":"2023-08-27T11:26:13.903867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:24.764491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320976+0000","last_change":"2023-08-27T11:26:12.189747+0000","last_active":"2023-08-27T11:26:14.320976+0000","last_peered":"2023-08-27T11:26:14.320976+0000","last_clean":"2023-08-27T11:26:14.320976+0000","last_became_active":"2023-08-27T11:26:12.189215+0000","last_became_peered":"2023-08-27T11:26:12.189215+0000","last_unstale":"2023-08-27T11:26:14.320976+0000","last_undegraded":"2023-08-27T11:26:14.320976+0000","last_fullsized":"2023-08-27T11:26:14.320976+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:17:44.212448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904793+0000","last_change":"2023-08-27T11:26:12.914580+0000","last_active":"2023-08-27T11:26:13.904793+0000","last_peered":"2023-08-27T11:26:13.904793+0000","last_clean":"2023-08-27T11:26:13.904793+0000","last_became_active":"2023-08-27T11:26:12.914302+0000","last_became_peered":"2023-08-27T11:26:12.914302+0000","last_unstale":"2023-08-27T11:26:13.904793+0000","last_undegraded":"2023-08-27T11:26:13.904793+0000","last_fullsized":"2023-08-27T11:26:13.904793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:48:43.865768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321154+0000","last_change":"2023-08-27T11:26:12.188629+0000","last_active":"2023-08-27T11:26:14.321154+0000","last_peered":"2023-08-27T11:26:14.321154+0000","last_clean":"2023-08-27T11:26:14.321154+0000","last_became_active":"2023-08-27T11:26:12.188334+0000","last_became_peered":"2023-08-27T11:26:12.188334+0000","last_unstale":"2023-08-27T11:26:14.321154+0000","last_undegraded":"2023-08-27T11:26:14.321154+0000","last_fullsized":"2023-08-27T11:26:14.321154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:51.028558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321237+0000","last_change":"2023-08-27T11:26:12.918378+0000","last_active":"2023-08-27T11:26:14.321237+0000","last_peered":"2023-08-27T11:26:14.321237+0000","last_clean":"2023-08-27T11:26:14.321237+0000","last_became_active":"2023-08-27T11:26:12.918095+0000","last_became_peered":"2023-08-27T11:26:12.918095+0000","last_unstale":"2023-08-27T11:26:14.321237+0000","last_undegraded":"2023-08-27T11:26:14.321237+0000","last_fullsized":"2023-08-27T11:26:14.321237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:48:34.809087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320217+0000","last_change":"2023-08-27T11:26:12.184118+0000","last_active":"2023-08-27T11:26:14.320217+0000","last_peered":"2023-08-27T11:26:14.320217+0000","last_clean":"2023-08-27T11:26:14.320217+0000","last_became_active":"2023-08-27T11:26:12.183835+0000","last_became_peered":"2023-08-27T11:26:12.183835+0000","last_unstale":"2023-08-27T11:26:14.320217+0000","last_undegraded":"2023-08-27T11:26:14.320217+0000","last_fullsized":"2023-08-27T11:26:14.320217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:35.916104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320159+0000","last_change":"2023-08-27T11:26:12.913926+0000","last_active":"2023-08-27T11:26:14.320159+0000","last_peered":"2023-08-27T11:26:14.320159+0000","last_clean":"2023-08-27T11:26:14.320159+0000","last_became_active":"2023-08-27T11:26:12.913615+0000","last_became_peered":"2023-08-27T11:26:12.913615+0000","last_unstale":"2023-08-27T11:26:14.320159+0000","last_undegraded":"2023-08-27T11:26:14.320159+0000","last_fullsized":"2023-08-27T11:26:14.320159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:24.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"80'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904904+0000","last_change":"2023-08-27T11:26:12.189833+0000","last_active":"2023-08-27T11:26:13.904904+0000","last_peered":"2023-08-27T11:26:13.904904+0000","last_clean":"2023-08-27T11:26:13.904904+0000","last_became_active":"2023-08-27T11:26:12.189531+0000","last_became_peered":"2023-08-27T11:26:12.189531+0000","last_unstale":"2023-08-27T11:26:13.904904+0000","last_undegraded":"2023-08-27T11:26:13.904904+0000","last_fullsized":"2023-08-27T11:26:13.904904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:58.145133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903993+0000","last_change":"2023-08-27T11:26:12.922969+0000","last_active":"2023-08-27T11:26:13.903993+0000","last_peered":"2023-08-27T11:26:13.903993+0000","last_clean":"2023-08-27T11:26:13.903993+0000","last_became_active":"2023-08-27T11:26:12.922669+0000","last_became_peered":"2023-08-27T11:26:12.922669+0000","last_unstale":"2023-08-27T11:26:13.903993+0000","last_undegraded":"2023-08-27T11:26:13.903993+0000","last_fullsized":"2023-08-27T11:26:13.903993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:17.936034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"80'6","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320432+0000","last_change":"2023-08-27T11:26:12.187784+0000","last_active":"2023-08-27T11:26:14.320432+0000","last_peered":"2023-08-27T11:26:14.320432+0000","last_clean":"2023-08-27T11:26:14.320432+0000","last_became_active":"2023-08-27T11:26:12.187503+0000","last_became_peered":"2023-08-27T11:26:12.187503+0000","last_unstale":"2023-08-27T11:26:14.320432+0000","last_undegraded":"2023-08-27T11:26:14.320432+0000","last_fullsized":"2023-08-27T11:26:14.320432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:39.941827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903585+0000","last_change":"2023-08-27T11:26:12.923385+0000","last_active":"2023-08-27T11:26:13.903585+0000","last_peered":"2023-08-27T11:26:13.903585+0000","last_clean":"2023-08-27T11:26:13.903585+0000","last_became_active":"2023-08-27T11:26:12.923117+0000","last_became_peered":"2023-08-27T11:26:12.923117+0000","last_unstale":"2023-08-27T11:26:13.903585+0000","last_undegraded":"2023-08-27T11:26:13.903585+0000","last_fullsized":"2023-08-27T11:26:13.903585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:44:41.217844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321601+0000","last_change":"2023-08-27T11:26:12.190527+0000","last_active":"2023-08-27T11:26:14.321601+0000","last_peered":"2023-08-27T11:26:14.321601+0000","last_clean":"2023-08-27T11:26:14.321601+0000","last_became_active":"2023-08-27T11:26:12.190223+0000","last_became_peered":"2023-08-27T11:26:12.190223+0000","last_unstale":"2023-08-27T11:26:14.321601+0000","last_undegraded":"2023-08-27T11:26:14.321601+0000","last_fullsized":"2023-08-27T11:26:14.321601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:14.185653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904372+0000","last_change":"2023-08-27T11:26:12.917926+0000","last_active":"2023-08-27T11:26:13.904372+0000","last_peered":"2023-08-27T11:26:13.904372+0000","last_clean":"2023-08-27T11:26:13.904372+0000","last_became_active":"2023-08-27T11:26:12.917619+0000","last_became_peered":"2023-08-27T11:26:12.917619+0000","last_unstale":"2023-08-27T11:26:13.904372+0000","last_undegraded":"2023-08-27T11:26:13.904372+0000","last_fullsized":"2023-08-27T11:26:13.904372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:32:04.281203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319724+0000","last_change":"2023-08-27T11:26:12.189867+0000","last_active":"2023-08-27T11:26:14.319724+0000","last_peered":"2023-08-27T11:26:14.319724+0000","last_clean":"2023-08-27T11:26:14.319724+0000","last_became_active":"2023-08-27T11:26:12.189367+0000","last_became_peered":"2023-08-27T11:26:12.189367+0000","last_unstale":"2023-08-27T11:26:14.319724+0000","last_undegraded":"2023-08-27T11:26:14.319724+0000","last_fullsized":"2023-08-27T11:26:14.319724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:23:53.335334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901351+0000","last_change":"2023-08-27T11:26:12.911423+0000","last_active":"2023-08-27T11:26:13.901351+0000","last_peered":"2023-08-27T11:26:13.901351+0000","last_clean":"2023-08-27T11:26:13.901351+0000","last_became_active":"2023-08-27T11:26:12.911081+0000","last_became_peered":"2023-08-27T11:26:12.911081+0000","last_unstale":"2023-08-27T11:26:13.901351+0000","last_undegraded":"2023-08-27T11:26:13.901351+0000","last_fullsized":"2023-08-27T11:26:13.901351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:35.621885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903801+0000","last_change":"2023-08-27T11:26:12.183743+0000","last_active":"2023-08-27T11:26:13.903801+0000","last_peered":"2023-08-27T11:26:13.903801+0000","last_clean":"2023-08-27T11:26:13.903801+0000","last_became_active":"2023-08-27T11:26:12.183461+0000","last_became_peered":"2023-08-27T11:26:12.183461+0000","last_unstale":"2023-08-27T11:26:13.903801+0000","last_undegraded":"2023-08-27T11:26:13.903801+0000","last_fullsized":"2023-08-27T11:26:13.903801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:17.212183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901573+0000","last_change":"2023-08-27T11:26:12.916178+0000","last_active":"2023-08-27T11:26:13.901573+0000","last_peered":"2023-08-27T11:26:13.901573+0000","last_clean":"2023-08-27T11:26:13.901573+0000","last_became_active":"2023-08-27T11:26:12.915880+0000","last_became_peered":"2023-08-27T11:26:12.915880+0000","last_unstale":"2023-08-27T11:26:13.901573+0000","last_undegraded":"2023-08-27T11:26:13.901573+0000","last_fullsized":"2023-08-27T11:26:13.901573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:45:42.369485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903614+0000","last_change":"2023-08-27T11:26:12.182877+0000","last_active":"2023-08-27T11:26:13.903614+0000","last_peered":"2023-08-27T11:26:13.903614+0000","last_clean":"2023-08-27T11:26:13.903614+0000","last_became_active":"2023-08-27T11:26:12.182613+0000","last_became_peered":"2023-08-27T11:26:12.182613+0000","last_unstale":"2023-08-27T11:26:13.903614+0000","last_undegraded":"2023-08-27T11:26:13.903614+0000","last_fullsized":"2023-08-27T11:26:13.903614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:44:28.511894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321449+0000","last_change":"2023-08-27T11:26:12.916988+0000","last_active":"2023-08-27T11:26:14.321449+0000","last_peered":"2023-08-27T11:26:14.321449+0000","last_clean":"2023-08-27T11:26:14.321449+0000","last_became_active":"2023-08-27T11:26:12.916651+0000","last_became_peered":"2023-08-27T11:26:12.916651+0000","last_unstale":"2023-08-27T11:26:14.321449+0000","last_undegraded":"2023-08-27T11:26:14.321449+0000","last_fullsized":"2023-08-27T11:26:14.321449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:31.221632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321302+0000","last_change":"2023-08-27T11:26:12.185221+0000","last_active":"2023-08-27T11:26:14.321302+0000","last_peered":"2023-08-27T11:26:14.321302+0000","last_clean":"2023-08-27T11:26:14.321302+0000","last_became_active":"2023-08-27T11:26:12.184917+0000","last_became_peered":"2023-08-27T11:26:12.184917+0000","last_unstale":"2023-08-27T11:26:14.321302+0000","last_undegraded":"2023-08-27T11:26:14.321302+0000","last_fullsized":"2023-08-27T11:26:14.321302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:12.369735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319919+0000","last_change":"2023-08-27T11:26:12.919598+0000","last_active":"2023-08-27T11:26:14.319919+0000","last_peered":"2023-08-27T11:26:14.319919+0000","last_clean":"2023-08-27T11:26:14.319919+0000","last_became_active":"2023-08-27T11:26:12.919289+0000","last_became_peered":"2023-08-27T11:26:12.919289+0000","last_unstale":"2023-08-27T11:26:14.319919+0000","last_undegraded":"2023-08-27T11:26:14.319919+0000","last_fullsized":"2023-08-27T11:26:14.319919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:20:16.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905082+0000","last_change":"2023-08-27T11:26:12.184555+0000","last_active":"2023-08-27T11:26:13.905082+0000","last_peered":"2023-08-27T11:26:13.905082+0000","last_clean":"2023-08-27T11:26:13.905082+0000","last_became_active":"2023-08-27T11:26:12.184260+0000","last_became_peered":"2023-08-27T11:26:12.184260+0000","last_unstale":"2023-08-27T11:26:13.905082+0000","last_undegraded":"2023-08-27T11:26:13.905082+0000","last_fullsized":"2023-08-27T11:26:13.905082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:36:33.267211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320487+0000","last_change":"2023-08-27T11:26:12.921934+0000","last_active":"2023-08-27T11:26:14.320487+0000","last_peered":"2023-08-27T11:26:14.320487+0000","last_clean":"2023-08-27T11:26:14.320487+0000","last_became_active":"2023-08-27T11:26:12.917145+0000","last_became_peered":"2023-08-27T11:26:12.917145+0000","last_unstale":"2023-08-27T11:26:14.320487+0000","last_undegraded":"2023-08-27T11:26:14.320487+0000","last_fullsized":"2023-08-27T11:26:14.320487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:54:15.365870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905285+0000","last_change":"2023-08-27T11:26:12.190280+0000","last_active":"2023-08-27T11:26:13.905285+0000","last_peered":"2023-08-27T11:26:13.905285+0000","last_clean":"2023-08-27T11:26:13.905285+0000","last_became_active":"2023-08-27T11:26:12.189982+0000","last_became_peered":"2023-08-27T11:26:12.189982+0000","last_unstale":"2023-08-27T11:26:13.905285+0000","last_undegraded":"2023-08-27T11:26:13.905285+0000","last_fullsized":"2023-08-27T11:26:13.905285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:45.874544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321023+0000","last_change":"2023-08-27T11:26:12.924686+0000","last_active":"2023-08-27T11:26:14.321023+0000","last_peered":"2023-08-27T11:26:14.321023+0000","last_clean":"2023-08-27T11:26:14.321023+0000","last_became_active":"2023-08-27T11:26:12.924315+0000","last_became_peered":"2023-08-27T11:26:12.924315+0000","last_unstale":"2023-08-27T11:26:14.321023+0000","last_undegraded":"2023-08-27T11:26:14.321023+0000","last_fullsized":"2023-08-27T11:26:14.321023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:48:45.873093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320933+0000","last_change":"2023-08-27T11:26:12.178153+0000","last_active":"2023-08-27T11:26:14.320933+0000","last_peered":"2023-08-27T11:26:14.320933+0000","last_clean":"2023-08-27T11:26:14.320933+0000","last_became_active":"2023-08-27T11:26:12.177829+0000","last_became_peered":"2023-08-27T11:26:12.177829+0000","last_unstale":"2023-08-27T11:26:14.320933+0000","last_undegraded":"2023-08-27T11:26:14.320933+0000","last_fullsized":"2023-08-27T11:26:14.320933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:56.795145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901211+0000","last_change":"2023-08-27T11:26:12.916464+0000","last_active":"2023-08-27T11:26:13.901211+0000","last_peered":"2023-08-27T11:26:13.901211+0000","last_clean":"2023-08-27T11:26:13.901211+0000","last_became_active":"2023-08-27T11:26:12.916146+0000","last_became_peered":"2023-08-27T11:26:12.916146+0000","last_unstale":"2023-08-27T11:26:13.901211+0000","last_undegraded":"2023-08-27T11:26:13.901211+0000","last_fullsized":"2023-08-27T11:26:13.901211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:01.480357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320129+0000","last_change":"2023-08-27T11:26:12.186703+0000","last_active":"2023-08-27T11:26:14.320129+0000","last_peered":"2023-08-27T11:26:14.320129+0000","last_clean":"2023-08-27T11:26:14.320129+0000","last_became_active":"2023-08-27T11:26:12.186395+0000","last_became_peered":"2023-08-27T11:26:12.186395+0000","last_unstale":"2023-08-27T11:26:14.320129+0000","last_undegraded":"2023-08-27T11:26:14.320129+0000","last_fullsized":"2023-08-27T11:26:14.320129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:27.695163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319608+0000","last_change":"2023-08-27T11:26:12.913789+0000","last_active":"2023-08-27T11:26:14.319608+0000","last_peered":"2023-08-27T11:26:14.319608+0000","last_clean":"2023-08-27T11:26:14.319608+0000","last_became_active":"2023-08-27T11:26:12.913497+0000","last_became_peered":"2023-08-27T11:26:12.913497+0000","last_unstale":"2023-08-27T11:26:14.319608+0000","last_undegraded":"2023-08-27T11:26:14.319608+0000","last_fullsized":"2023-08-27T11:26:14.319608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:24.373890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320579+0000","last_change":"2023-08-27T11:26:12.185709+0000","last_active":"2023-08-27T11:26:14.320579+0000","last_peered":"2023-08-27T11:26:14.320579+0000","last_clean":"2023-08-27T11:26:14.320579+0000","last_became_active":"2023-08-27T11:26:12.185386+0000","last_became_peered":"2023-08-27T11:26:12.185386+0000","last_unstale":"2023-08-27T11:26:14.320579+0000","last_undegraded":"2023-08-27T11:26:14.320579+0000","last_fullsized":"2023-08-27T11:26:14.320579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:47.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320160+0000","last_change":"2023-08-27T11:26:12.912019+0000","last_active":"2023-08-27T11:26:14.320160+0000","last_peered":"2023-08-27T11:26:14.320160+0000","last_clean":"2023-08-27T11:26:14.320160+0000","last_became_active":"2023-08-27T11:26:12.911666+0000","last_became_peered":"2023-08-27T11:26:12.911666+0000","last_unstale":"2023-08-27T11:26:14.320160+0000","last_undegraded":"2023-08-27T11:26:14.320160+0000","last_fullsized":"2023-08-27T11:26:14.320160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:57:08.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320042+0000","last_change":"2023-08-27T11:26:12.178283+0000","last_active":"2023-08-27T11:26:14.320042+0000","last_peered":"2023-08-27T11:26:14.320042+0000","last_clean":"2023-08-27T11:26:14.320042+0000","last_became_active":"2023-08-27T11:26:12.177991+0000","last_became_peered":"2023-08-27T11:26:12.177991+0000","last_unstale":"2023-08-27T11:26:14.320042+0000","last_undegraded":"2023-08-27T11:26:14.320042+0000","last_fullsized":"2023-08-27T11:26:14.320042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:44:48.919916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320154+0000","last_change":"2023-08-27T11:26:12.917787+0000","last_active":"2023-08-27T11:26:14.320154+0000","last_peered":"2023-08-27T11:26:14.320154+0000","last_clean":"2023-08-27T11:26:14.320154+0000","last_became_active":"2023-08-27T11:26:12.917198+0000","last_became_peered":"2023-08-27T11:26:12.917198+0000","last_unstale":"2023-08-27T11:26:14.320154+0000","last_undegraded":"2023-08-27T11:26:14.320154+0000","last_fullsized":"2023-08-27T11:26:14.320154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:28:16.667846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321150+0000","last_change":"2023-08-27T11:26:12.187741+0000","last_active":"2023-08-27T11:26:14.321150+0000","last_peered":"2023-08-27T11:26:14.321150+0000","last_clean":"2023-08-27T11:26:14.321150+0000","last_became_active":"2023-08-27T11:26:12.187469+0000","last_became_peered":"2023-08-27T11:26:12.187469+0000","last_unstale":"2023-08-27T11:26:14.321150+0000","last_undegraded":"2023-08-27T11:26:14.321150+0000","last_fullsized":"2023-08-27T11:26:14.321150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:33.602848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319743+0000","last_change":"2023-08-27T11:26:12.924485+0000","last_active":"2023-08-27T11:26:14.319743+0000","last_peered":"2023-08-27T11:26:14.319743+0000","last_clean":"2023-08-27T11:26:14.319743+0000","last_became_active":"2023-08-27T11:26:12.924215+0000","last_became_peered":"2023-08-27T11:26:12.924215+0000","last_unstale":"2023-08-27T11:26:14.319743+0000","last_undegraded":"2023-08-27T11:26:14.319743+0000","last_fullsized":"2023-08-27T11:26:14.319743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:03:56.487034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320368+0000","last_change":"2023-08-27T11:26:12.189781+0000","last_active":"2023-08-27T11:26:14.320368+0000","last_peered":"2023-08-27T11:26:14.320368+0000","last_clean":"2023-08-27T11:26:14.320368+0000","last_became_active":"2023-08-27T11:26:12.189444+0000","last_became_peered":"2023-08-27T11:26:12.189444+0000","last_unstale":"2023-08-27T11:26:14.320368+0000","last_undegraded":"2023-08-27T11:26:14.320368+0000","last_fullsized":"2023-08-27T11:26:14.320368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:41:19.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320961+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:14.320961+0000","last_peered":"2023-08-27T11:26:14.320961+0000","last_clean":"2023-08-27T11:26:14.320961+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:14.320961+0000","last_undegraded":"2023-08-27T11:26:14.320961+0000","last_fullsized":"2023-08-27T11:26:14.320961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:19:39.314165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321193+0000","last_change":"2023-08-27T11:26:12.925979+0000","last_active":"2023-08-27T11:26:14.321193+0000","last_peered":"2023-08-27T11:26:14.321193+0000","last_clean":"2023-08-27T11:26:14.321193+0000","last_became_active":"2023-08-27T11:26:12.925663+0000","last_became_peered":"2023-08-27T11:26:12.925663+0000","last_unstale":"2023-08-27T11:26:14.321193+0000","last_undegraded":"2023-08-27T11:26:14.321193+0000","last_fullsized":"2023-08-27T11:26:14.321193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:49:19.449494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901371+0000","last_change":"2023-08-27T11:26:12.186791+0000","last_active":"2023-08-27T11:26:13.901371+0000","last_peered":"2023-08-27T11:26:13.901371+0000","last_clean":"2023-08-27T11:26:13.901371+0000","last_became_active":"2023-08-27T11:26:12.185655+0000","last_became_peered":"2023-08-27T11:26:12.185655+0000","last_unstale":"2023-08-27T11:26:13.901371+0000","last_undegraded":"2023-08-27T11:26:13.901371+0000","last_fullsized":"2023-08-27T11:26:13.901371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:58.832585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320628+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:14.320628+0000","last_peered":"2023-08-27T11:26:14.320628+0000","last_clean":"2023-08-27T11:26:14.320628+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:14.320628+0000","last_undegraded":"2023-08-27T11:26:14.320628+0000","last_fullsized":"2023-08-27T11:26:14.320628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:49:36.264774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904953+0000","last_change":"2023-08-27T11:26:12.920215+0000","last_active":"2023-08-27T11:26:13.904953+0000","last_peered":"2023-08-27T11:26:13.904953+0000","last_clean":"2023-08-27T11:26:13.904953+0000","last_became_active":"2023-08-27T11:26:12.919914+0000","last_became_peered":"2023-08-27T11:26:12.919914+0000","last_unstale":"2023-08-27T11:26:13.904953+0000","last_undegraded":"2023-08-27T11:26:13.904953+0000","last_fullsized":"2023-08-27T11:26:13.904953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:28.212186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905136+0000","last_change":"2023-08-27T11:26:12.187481+0000","last_active":"2023-08-27T11:26:13.905136+0000","last_peered":"2023-08-27T11:26:13.905136+0000","last_clean":"2023-08-27T11:26:13.905136+0000","last_became_active":"2023-08-27T11:26:12.187148+0000","last_became_peered":"2023-08-27T11:26:12.187148+0000","last_unstale":"2023-08-27T11:26:13.905136+0000","last_undegraded":"2023-08-27T11:26:13.905136+0000","last_fullsized":"2023-08-27T11:26:13.905136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:52:14.858510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320249+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:14.320249+0000","last_peered":"2023-08-27T11:26:14.320249+0000","last_clean":"2023-08-27T11:26:14.320249+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:14.320249+0000","last_undegraded":"2023-08-27T11:26:14.320249+0000","last_fullsized":"2023-08-27T11:26:14.320249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:42.468015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321224+0000","last_change":"2023-08-27T11:26:12.917018+0000","last_active":"2023-08-27T11:26:14.321224+0000","last_peered":"2023-08-27T11:26:14.321224+0000","last_clean":"2023-08-27T11:26:14.321224+0000","last_became_active":"2023-08-27T11:26:12.916669+0000","last_became_peered":"2023-08-27T11:26:12.916669+0000","last_unstale":"2023-08-27T11:26:14.321224+0000","last_undegraded":"2023-08-27T11:26:14.321224+0000","last_fullsized":"2023-08-27T11:26:14.321224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:03.918030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904155+0000","last_change":"2023-08-27T11:26:12.185478+0000","last_active":"2023-08-27T11:26:13.904155+0000","last_peered":"2023-08-27T11:26:13.904155+0000","last_clean":"2023-08-27T11:26:13.904155+0000","last_became_active":"2023-08-27T11:26:12.185036+0000","last_became_peered":"2023-08-27T11:26:12.185036+0000","last_unstale":"2023-08-27T11:26:13.904155+0000","last_undegraded":"2023-08-27T11:26:13.904155+0000","last_fullsized":"2023-08-27T11:26:13.904155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:31:38.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321237+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:14.321237+0000","last_peered":"2023-08-27T11:26:14.321237+0000","last_clean":"2023-08-27T11:26:14.321237+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:14.321237+0000","last_undegraded":"2023-08-27T11:26:14.321237+0000","last_fullsized":"2023-08-27T11:26:14.321237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:13:03.859452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320574+0000","last_change":"2023-08-27T11:26:12.922566+0000","last_active":"2023-08-27T11:26:14.320574+0000","last_peered":"2023-08-27T11:26:14.320574+0000","last_clean":"2023-08-27T11:26:14.320574+0000","last_became_active":"2023-08-27T11:26:12.922275+0000","last_became_peered":"2023-08-27T11:26:12.922275+0000","last_unstale":"2023-08-27T11:26:14.320574+0000","last_undegraded":"2023-08-27T11:26:14.320574+0000","last_fullsized":"2023-08-27T11:26:14.320574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:21.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321440+0000","last_change":"2023-08-27T11:26:12.187352+0000","last_active":"2023-08-27T11:26:14.321440+0000","last_peered":"2023-08-27T11:26:14.321440+0000","last_clean":"2023-08-27T11:26:14.321440+0000","last_became_active":"2023-08-27T11:26:12.187029+0000","last_became_peered":"2023-08-27T11:26:12.187029+0000","last_unstale":"2023-08-27T11:26:14.321440+0000","last_undegraded":"2023-08-27T11:26:14.321440+0000","last_fullsized":"2023-08-27T11:26:14.321440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:58:05.671663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321086+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:14.321086+0000","last_peered":"2023-08-27T11:26:14.321086+0000","last_clean":"2023-08-27T11:26:14.321086+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:14.321086+0000","last_undegraded":"2023-08-27T11:26:14.321086+0000","last_fullsized":"2023-08-27T11:26:14.321086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:56:05.447724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320288+0000","last_change":"2023-08-27T11:26:12.919419+0000","last_active":"2023-08-27T11:26:14.320288+0000","last_peered":"2023-08-27T11:26:14.320288+0000","last_clean":"2023-08-27T11:26:14.320288+0000","last_became_active":"2023-08-27T11:26:12.919043+0000","last_became_peered":"2023-08-27T11:26:12.919043+0000","last_unstale":"2023-08-27T11:26:14.320288+0000","last_undegraded":"2023-08-27T11:26:14.320288+0000","last_fullsized":"2023-08-27T11:26:14.320288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:03.149158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320838+0000","last_change":"2023-08-27T11:26:12.182881+0000","last_active":"2023-08-27T11:26:14.320838+0000","last_peered":"2023-08-27T11:26:14.320838+0000","last_clean":"2023-08-27T11:26:14.320838+0000","last_became_active":"2023-08-27T11:26:12.182521+0000","last_became_peered":"2023-08-27T11:26:12.182521+0000","last_unstale":"2023-08-27T11:26:14.320838+0000","last_undegraded":"2023-08-27T11:26:14.320838+0000","last_fullsized":"2023-08-27T11:26:14.320838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:16.802436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":272,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319762+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:14.319762+0000","last_peered":"2023-08-27T11:26:14.319762+0000","last_clean":"2023-08-27T11:26:14.319762+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:14.319762+0000","last_undegraded":"2023-08-27T11:26:14.319762+0000","last_fullsized":"2023-08-27T11:26:14.319762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:04:09.770367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903999+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:13.903999+0000","last_peered":"2023-08-27T11:26:13.903999+0000","last_clean":"2023-08-27T11:26:13.903999+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:13.903999+0000","last_undegraded":"2023-08-27T11:26:13.903999+0000","last_fullsized":"2023-08-27T11:26:13.903999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:53:12.750654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319984+0000","last_change":"2023-08-27T11:26:12.919084+0000","last_active":"2023-08-27T11:26:14.319984+0000","last_peered":"2023-08-27T11:26:14.319984+0000","last_clean":"2023-08-27T11:26:14.319984+0000","last_became_active":"2023-08-27T11:26:12.918779+0000","last_became_peered":"2023-08-27T11:26:12.918779+0000","last_unstale":"2023-08-27T11:26:14.319984+0000","last_undegraded":"2023-08-27T11:26:14.319984+0000","last_fullsized":"2023-08-27T11:26:14.319984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:13:35.886790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901249+0000","last_change":"2023-08-27T11:26:12.187932+0000","last_active":"2023-08-27T11:26:13.901249+0000","last_peered":"2023-08-27T11:26:13.901249+0000","last_clean":"2023-08-27T11:26:13.901249+0000","last_became_active":"2023-08-27T11:26:12.187665+0000","last_became_peered":"2023-08-27T11:26:12.187665+0000","last_unstale":"2023-08-27T11:26:13.901249+0000","last_undegraded":"2023-08-27T11:26:13.901249+0000","last_fullsized":"2023-08-27T11:26:13.901249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:28:13.133945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320169+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:14.320169+0000","last_peered":"2023-08-27T11:26:14.320169+0000","last_clean":"2023-08-27T11:26:14.320169+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:14.320169+0000","last_undegraded":"2023-08-27T11:26:14.320169+0000","last_fullsized":"2023-08-27T11:26:14.320169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:15:09.429476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320381+0000","last_change":"2023-08-27T11:26:12.927419+0000","last_active":"2023-08-27T11:26:14.320381+0000","last_peered":"2023-08-27T11:26:14.320381+0000","last_clean":"2023-08-27T11:26:14.320381+0000","last_became_active":"2023-08-27T11:26:12.927060+0000","last_became_peered":"2023-08-27T11:26:12.927060+0000","last_unstale":"2023-08-27T11:26:14.320381+0000","last_undegraded":"2023-08-27T11:26:14.320381+0000","last_fullsized":"2023-08-27T11:26:14.320381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:08.377025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320132+0000","last_change":"2023-08-27T11:26:12.189785+0000","last_active":"2023-08-27T11:26:14.320132+0000","last_peered":"2023-08-27T11:26:14.320132+0000","last_clean":"2023-08-27T11:26:14.320132+0000","last_became_active":"2023-08-27T11:26:12.189427+0000","last_became_peered":"2023-08-27T11:26:12.189427+0000","last_unstale":"2023-08-27T11:26:14.320132+0000","last_undegraded":"2023-08-27T11:26:14.320132+0000","last_fullsized":"2023-08-27T11:26:14.320132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:27.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905299+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:13.905299+0000","last_peered":"2023-08-27T11:26:13.905299+0000","last_clean":"2023-08-27T11:26:13.905299+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:13.905299+0000","last_undegraded":"2023-08-27T11:26:13.905299+0000","last_fullsized":"2023-08-27T11:26:13.905299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:34:38.476163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1597440,"data_stored":1050949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.018,"5min":1.173,"15min":1.173},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.64500000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.083,"15min":1.083},"last":0.496},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97899999999999998,"5min":1.135,"15min":1.135},"last":0.56100000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.397,"15min":1.397},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0609999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.087,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0980000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":461755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.82899999999999996,"15min":0.91500000000000004},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.81999999999999995,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77800000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.79000000000000004},"min":{"1min":0.54000000000000004,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":3.472,"15min":3.472},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.88800000000000001,"15min":0.98799999999999999},"min":{"1min":0.48899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.89700000000000002,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.80300000000000005,"15min":0.84799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85599999999999998,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.90500000000000003,"15min":0.99399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.875,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.81299999999999994,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1100000000000001,"5min":1.234,"15min":1.234},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.98299999999999998,"5min":1.135,"15min":1.135},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.59299999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.073,"5min":1.127,"15min":1.127},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.86599999999999999,"15min":0.89300000000000002},"min":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99199999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92700000000000005,"5min":1.27,"15min":1.27},"last":0.873}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343264,"statfs":{"total":96636764160,"available":96607502336,"internally_reserved":0,"allocated":1593344,"data_stored":1050963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.30499999999999999,"5min":0.253,"15min":0.253},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.39600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.35099999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.47899999999999998,"5min":0.435,"15min":0.435},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.504},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.23,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.62,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.8410000000000002,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":461857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.78300000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.441}]},{"osd":2,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.376},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51400000000000001},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.433},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68600000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.355,"15min":1.355},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88600000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96099999999999997,"5min":1.329,"15min":1.329},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.871,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90500000000000003,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98799999999999999,"5min":1.288,"15min":1.288},"last":0.77500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":460525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48999999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54900000000000004,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.53200000000000003,"15min":0.56499999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66300000000000003,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54900000000000004,"15min":0.57899999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60299999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55000000000000004,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.64800000000000002,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68500000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.996,"5min":1.669,"15min":1.669},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.877,"5min":1.994,"15min":1.994},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79800000000000004,"15min":0.82499999999999996},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.94999999999999996,"5min":2.036,"15min":2.036},"last":0.628},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.26,"15min":1.26},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":1.321,"15min":1.321},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.82899999999999996,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.028,"5min":1.627,"15min":1.627},"last":0.77800000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83699999999999997,"15min":0.86699999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96499999999999997,"5min":2.073,"15min":2.073},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.84099999999999997,"15min":0.871},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97099999999999997,"5min":1.323,"15min":1.323},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.56299999999999994,"15min":0.63300000000000001},"min":{"1min":0.27400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.72799999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.5,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.376}]},{"osd":1,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":1.0169999999999999,"15min":1.27},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.60199999999999998,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.63700000000000001,"15min":0.70499999999999996},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.44}]},{"osd":2,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56499999999999995,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.67000000000000004,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.872,"15min":0.93300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0289999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.81299999999999994},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91700000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0449999999999999,"5min":1.429,"15min":1.429},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.92800000000000005,"15min":1.0089999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90400000000000003,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.91800000000000004,"15min":0.98899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95599999999999996,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.98099999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.93000000000000005,"15min":0.99399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":5,"15min":5},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":460685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":1.161,"15min":1.161},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.48399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":1,"15min":1},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.876,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96799999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93400000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.874},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":1.105,"15min":1.105},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92800000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0720000000000001,"5min":1.097,"15min":1.097},"last":0.628},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.70399999999999996},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.744,"15min":1.744},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.069,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58399999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.99099999999999999,"5min":1.663,"15min":1.663},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.129,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.82799999999999996,"15min":0.81599999999999995},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:26:17.629 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:26:17.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.861+0000 7f77e61ff700 1 Processor -- start 2023-08-27T11:26:17.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.862+0000 7f77e61ff700 1 -- start start 2023-08-27T11:26:17.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77e61ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77e0151a90 0x7f77e00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77e61ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e00c4a90 0x7f77e006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77e61ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e006c4e0 con 0x7f77e00c4630 2023-08-27T11:26:17.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77e61ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e0155370 con 0x7f77e0151a90 2023-08-27T11:26:17.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77e61ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0151e70 con 0x7f77e00c4a90 2023-08-27T11:26:17.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77deffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f77e00c4630 0x7f77e006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59652/0 (socket says 172.21.15.43:59652) 2023-08-27T11:26:17.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77deffd700 1 -- 172.21.15.43:0/3121962388 learned_addr learned my addr 172.21.15.43:0/3121962388 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:17.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77df7fe700 1 --2- 172.21.15.43:0/3121962388 >> v2:172.21.15.57:3300/0 conn(0x7f77e0151a90 0x7f77e00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77dffff700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e00c4a90 0x7f77e006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.863+0000 7f77de7fc700 1 -- 172.21.15.43:0/3121962388 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233218873 0 0) 0x7f77e006c4e0 con 0x7f77e00c4630 2023-08-27T11:26:17.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77de7fc700 1 -- 172.21.15.43:0/3121962388 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c80035b0 con 0x7f77e00c4630 2023-08-27T11:26:17.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77df7fe700 1 -- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e00c4a90 msgr2=0x7f77e006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:17.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77df7fe700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e00c4a90 0x7f77e006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77df7fe700 1 -- 172.21.15.43:0/3121962388 >> v1:172.21.15.43:6789/0 conn(0x7f77e00c4630 legacy=0x7f77e006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77df7fe700 1 -- 172.21.15.43:0/3121962388 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0154480 con 0x7f77e0151a90 2023-08-27T11:26:17.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77df7fe700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e0151a90 0x7f77e00c7bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009840 tx=0x7f77d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8c45332ff56842b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77de7fc700 1 -- 172.21.15.43:0/3121962388 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011830 con 0x7f77e0151a90 2023-08-27T11:26:17.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77de7fc700 1 -- 172.21.15.43:0/3121962388 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0011990 con 0x7f77e0151a90 2023-08-27T11:26:17.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.864+0000 7f77de7fc700 1 -- 172.21.15.43:0/3121962388 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011d20 con 0x7f77e0151a90 2023-08-27T11:26:17.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 -- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e0151a90 msgr2=0x7f77e00c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e0151a90 0x7f77e00c7bb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009840 tx=0x7f77d0009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:17.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 -- 172.21.15.43:0/3121962388 shutdown_connections 2023-08-27T11:26:17.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e00c4a90 0x7f77e006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 --2- 172.21.15.43:0/3121962388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e0151a90 0x7f77e00c7bb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 -- 172.21.15.43:0/3121962388 >> 172.21.15.43:0/3121962388 conn(0x7f77e00ab820 msgr2=0x7f77e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 -- 172.21.15.43:0/3121962388 shutdown_connections 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.865+0000 7f77e61ff700 1 -- 172.21.15.43:0/3121962388 wait complete. 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.866+0000 7f77e61ff700 1 Processor -- start 2023-08-27T11:26:17.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.867+0000 7f77e61ff700 1 -- start start 2023-08-27T11:26:17.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.867+0000 7f77e61ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e00c4630 0x7f77e0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77e61ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77e61ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e0151a90 0x7f77e00c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77e61ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c0d80 con 0x7f77e00c4a90 2023-08-27T11:26:17.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77e61ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01525f0 con 0x7f77e00c4630 2023-08-27T11:26:17.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77e61ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00c0f90 con 0x7f77e0151a90 2023-08-27T11:26:17.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57038/0 (socket says 172.21.15.43:57038) 2023-08-27T11:26:17.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 -- 172.21.15.43:0/1715193837 learned_addr learned my addr 172.21.15.43:0/1715193837 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:17.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77df7fe700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e00c4630 0x7f77e0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77dffff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e0151a90 0x7f77e00c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 -- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e0151a90 msgr2=0x7f77e00c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e0151a90 0x7f77e00c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 -- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e00c4630 msgr2=0x7f77e0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:17.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e00c4630 0x7f77e0153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:17.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.868+0000 7f77deffd700 1 -- 172.21.15.43:0/1715193837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00094a0 con 0x7f77e00c4a90 2023-08-27T11:26:17.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77deffd700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c700 tx=0x7f77d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4005d70 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40070d0 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e00c1270 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4007440 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.869+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e00c21e0 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.870+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e004ee70 con 0x7f77e00c4a90 2023-08-27T11:26:17.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.871+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f77d40075a0 con 0x7f77e00c4a90 2023-08-27T11:26:17.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.872+0000 7f77c7fff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 0x7f77cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:17.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.872+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77d40879a0 con 0x7f77e00c4a90 2023-08-27T11:26:17.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.872+0000 7f77df7fe700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 0x7f77cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:17.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.873+0000 7f77df7fe700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 0x7f77cc06c5a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:17.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:17.876+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f77d40530a0 con 0x7f77e00c4a90 2023-08-27T11:26:18.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.080+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77e0154a40 con 0x7f77cc06a0e0 2023-08-27T11:26:18.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.091+0000 7f77c7fff700 1 -- 172.21.15.43:0/1715193837 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311504 (secure 0 0 0) 0x7f77d0011bb0 con 0x7f77cc06a0e0 2023-08-27T11:26:18.097 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:18.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 msgr2=0x7f77cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 0x7f77cc06c5a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f77d0000c00 tx=0x7f77d001c040 comp rx=0 tx=0).stop 2023-08-27T11:26:18.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 msgr2=0x7f77e01eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c700 tx=0x7f77d400ca10 comp rx=0 tx=0).stop 2023-08-27T11:26:18.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 shutdown_connections 2023-08-27T11:26:18.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f77cc06a0e0 0x7f77cc06c5a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f77e0151a90 0x7f77e00c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f77e00c4630 0x7f77e0153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 --2- 172.21.15.43:0/1715193837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77e00c4a90 0x7f77e01eda10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 >> 172.21.15.43:0/1715193837 conn(0x7f77e00ab820 msgr2=0x7f77e0150c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:18.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 shutdown_connections 2023-08-27T11:26:18.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.096+0000 7f77e61ff700 1 -- 172.21.15.43:0/1715193837 wait complete. 2023-08-27T11:26:18.102 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:26:18.116 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2023-08-27T11:26:16.355386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225164,"kb_used_data":8984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754749556,"statfs":{"total":773094113280,"available":772863545344,"internally_reserved":0,"allocated":9199616,"data_stored":4865812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198428"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320439+0000","last_change":"2023-08-27T11:26:12.916607+0000","last_active":"2023-08-27T11:26:14.320439+0000","last_peered":"2023-08-27T11:26:14.320439+0000","last_clean":"2023-08-27T11:26:14.320439+0000","last_became_active":"2023-08-27T11:26:12.916349+0000","last_became_peered":"2023-08-27T11:26:12.916349+0000","last_unstale":"2023-08-27T11:26:14.320439+0000","last_undegraded":"2023-08-27T11:26:14.320439+0000","last_fullsized":"2023-08-27T11:26:14.320439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:33:51.331557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320498+0000","last_change":"2023-08-27T11:26:12.928726+0000","last_active":"2023-08-27T11:26:14.320498+0000","last_peered":"2023-08-27T11:26:14.320498+0000","last_clean":"2023-08-27T11:26:14.320498+0000","last_became_active":"2023-08-27T11:26:12.928396+0000","last_became_peered":"2023-08-27T11:26:12.928396+0000","last_unstale":"2023-08-27T11:26:14.320498+0000","last_undegraded":"2023-08-27T11:26:14.320498+0000","last_fullsized":"2023-08-27T11:26:14.320498+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:55.562340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320348+0000","last_change":"2023-08-27T11:26:12.914867+0000","last_active":"2023-08-27T11:26:14.320348+0000","last_peered":"2023-08-27T11:26:14.320348+0000","last_clean":"2023-08-27T11:26:14.320348+0000","last_became_active":"2023-08-27T11:26:12.914515+0000","last_became_peered":"2023-08-27T11:26:12.914515+0000","last_unstale":"2023-08-27T11:26:14.320348+0000","last_undegraded":"2023-08-27T11:26:14.320348+0000","last_fullsized":"2023-08-27T11:26:14.320348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:57:12.084255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904005+0000","last_change":"2023-08-27T11:26:12.920589+0000","last_active":"2023-08-27T11:26:13.904005+0000","last_peered":"2023-08-27T11:26:13.904005+0000","last_clean":"2023-08-27T11:26:13.904005+0000","last_became_active":"2023-08-27T11:26:12.919638+0000","last_became_peered":"2023-08-27T11:26:12.919638+0000","last_unstale":"2023-08-27T11:26:13.904005+0000","last_undegraded":"2023-08-27T11:26:13.904005+0000","last_fullsized":"2023-08-27T11:26:13.904005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:52.324182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904827+0000","last_change":"2023-08-27T11:26:12.913228+0000","last_active":"2023-08-27T11:26:13.904827+0000","last_peered":"2023-08-27T11:26:13.904827+0000","last_clean":"2023-08-27T11:26:13.904827+0000","last_became_active":"2023-08-27T11:26:12.912924+0000","last_became_peered":"2023-08-27T11:26:12.912924+0000","last_unstale":"2023-08-27T11:26:13.904827+0000","last_undegraded":"2023-08-27T11:26:13.904827+0000","last_fullsized":"2023-08-27T11:26:13.904827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:34:34.746044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319605+0000","last_change":"2023-08-27T11:26:12.925740+0000","last_active":"2023-08-27T11:26:14.319605+0000","last_peered":"2023-08-27T11:26:14.319605+0000","last_clean":"2023-08-27T11:26:14.319605+0000","last_became_active":"2023-08-27T11:26:12.925309+0000","last_became_peered":"2023-08-27T11:26:12.925309+0000","last_unstale":"2023-08-27T11:26:14.319605+0000","last_undegraded":"2023-08-27T11:26:14.319605+0000","last_fullsized":"2023-08-27T11:26:14.319605+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:43.627847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321393+0000","last_change":"2023-08-27T11:26:12.916797+0000","last_active":"2023-08-27T11:26:14.321393+0000","last_peered":"2023-08-27T11:26:14.321393+0000","last_clean":"2023-08-27T11:26:14.321393+0000","last_became_active":"2023-08-27T11:26:12.916479+0000","last_became_peered":"2023-08-27T11:26:12.916479+0000","last_unstale":"2023-08-27T11:26:14.321393+0000","last_undegraded":"2023-08-27T11:26:14.321393+0000","last_fullsized":"2023-08-27T11:26:14.321393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:40:47.668331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903871+0000","last_change":"2023-08-27T11:26:12.918994+0000","last_active":"2023-08-27T11:26:13.903871+0000","last_peered":"2023-08-27T11:26:13.903871+0000","last_clean":"2023-08-27T11:26:13.903871+0000","last_became_active":"2023-08-27T11:26:12.918692+0000","last_became_peered":"2023-08-27T11:26:12.918692+0000","last_unstale":"2023-08-27T11:26:13.903871+0000","last_undegraded":"2023-08-27T11:26:13.903871+0000","last_fullsized":"2023-08-27T11:26:13.903871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:11.916602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904877+0000","last_change":"2023-08-27T11:26:12.926121+0000","last_active":"2023-08-27T11:26:13.904877+0000","last_peered":"2023-08-27T11:26:13.904877+0000","last_clean":"2023-08-27T11:26:13.904877+0000","last_became_active":"2023-08-27T11:26:12.925759+0000","last_became_peered":"2023-08-27T11:26:12.925759+0000","last_unstale":"2023-08-27T11:26:13.904877+0000","last_undegraded":"2023-08-27T11:26:13.904877+0000","last_fullsized":"2023-08-27T11:26:13.904877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:55.884489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901737+0000","last_change":"2023-08-27T11:26:12.922280+0000","last_active":"2023-08-27T11:26:13.901737+0000","last_peered":"2023-08-27T11:26:13.901737+0000","last_clean":"2023-08-27T11:26:13.901737+0000","last_became_active":"2023-08-27T11:26:12.921889+0000","last_became_peered":"2023-08-27T11:26:12.921889+0000","last_unstale":"2023-08-27T11:26:13.901737+0000","last_undegraded":"2023-08-27T11:26:13.901737+0000","last_fullsized":"2023-08-27T11:26:13.901737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:35.866836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905210+0000","last_change":"2023-08-27T11:26:12.914693+0000","last_active":"2023-08-27T11:26:13.905210+0000","last_peered":"2023-08-27T11:26:13.905210+0000","last_clean":"2023-08-27T11:26:13.905210+0000","last_became_active":"2023-08-27T11:26:12.913750+0000","last_became_peered":"2023-08-27T11:26:12.913750+0000","last_unstale":"2023-08-27T11:26:13.905210+0000","last_undegraded":"2023-08-27T11:26:13.905210+0000","last_fullsized":"2023-08-27T11:26:13.905210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:08.908416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901379+0000","last_change":"2023-08-27T11:26:12.905408+0000","last_active":"2023-08-27T11:26:13.901379+0000","last_peered":"2023-08-27T11:26:13.901379+0000","last_clean":"2023-08-27T11:26:13.901379+0000","last_became_active":"2023-08-27T11:26:12.905139+0000","last_became_peered":"2023-08-27T11:26:12.905139+0000","last_unstale":"2023-08-27T11:26:13.901379+0000","last_undegraded":"2023-08-27T11:26:13.901379+0000","last_fullsized":"2023-08-27T11:26:13.901379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:13:11.120328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904028+0000","last_change":"2023-08-27T11:26:12.924207+0000","last_active":"2023-08-27T11:26:13.904028+0000","last_peered":"2023-08-27T11:26:13.904028+0000","last_clean":"2023-08-27T11:26:13.904028+0000","last_became_active":"2023-08-27T11:26:12.923868+0000","last_became_peered":"2023-08-27T11:26:12.923868+0000","last_unstale":"2023-08-27T11:26:13.904028+0000","last_undegraded":"2023-08-27T11:26:13.904028+0000","last_fullsized":"2023-08-27T11:26:13.904028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:10:31.458764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904369+0000","last_change":"2023-08-27T11:26:12.926421+0000","last_active":"2023-08-27T11:26:13.904369+0000","last_peered":"2023-08-27T11:26:13.904369+0000","last_clean":"2023-08-27T11:26:13.904369+0000","last_became_active":"2023-08-27T11:26:12.926101+0000","last_became_peered":"2023-08-27T11:26:12.926101+0000","last_unstale":"2023-08-27T11:26:13.904369+0000","last_undegraded":"2023-08-27T11:26:13.904369+0000","last_fullsized":"2023-08-27T11:26:13.904369+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:27:50.139171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903858+0000","last_change":"2023-08-27T11:26:12.920244+0000","last_active":"2023-08-27T11:26:13.903858+0000","last_peered":"2023-08-27T11:26:13.903858+0000","last_clean":"2023-08-27T11:26:13.903858+0000","last_became_active":"2023-08-27T11:26:12.919934+0000","last_became_peered":"2023-08-27T11:26:12.919934+0000","last_unstale":"2023-08-27T11:26:13.903858+0000","last_undegraded":"2023-08-27T11:26:13.903858+0000","last_fullsized":"2023-08-27T11:26:13.903858+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:38.175581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319474+0000","last_change":"2023-08-27T11:26:12.920807+0000","last_active":"2023-08-27T11:26:14.319474+0000","last_peered":"2023-08-27T11:26:14.319474+0000","last_clean":"2023-08-27T11:26:14.319474+0000","last_became_active":"2023-08-27T11:26:12.920101+0000","last_became_peered":"2023-08-27T11:26:12.920101+0000","last_unstale":"2023-08-27T11:26:14.319474+0000","last_undegraded":"2023-08-27T11:26:14.319474+0000","last_fullsized":"2023-08-27T11:26:14.319474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:02:30.116304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320380+0000","last_change":"2023-08-27T11:26:12.917056+0000","last_active":"2023-08-27T11:26:14.320380+0000","last_peered":"2023-08-27T11:26:14.320380+0000","last_clean":"2023-08-27T11:26:14.320380+0000","last_became_active":"2023-08-27T11:26:12.916769+0000","last_became_peered":"2023-08-27T11:26:12.916769+0000","last_unstale":"2023-08-27T11:26:14.320380+0000","last_undegraded":"2023-08-27T11:26:14.320380+0000","last_fullsized":"2023-08-27T11:26:14.320380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:34.556956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320031+0000","last_change":"2023-08-27T11:26:12.925714+0000","last_active":"2023-08-27T11:26:14.320031+0000","last_peered":"2023-08-27T11:26:14.320031+0000","last_clean":"2023-08-27T11:26:14.320031+0000","last_became_active":"2023-08-27T11:26:12.925443+0000","last_became_peered":"2023-08-27T11:26:12.925443+0000","last_unstale":"2023-08-27T11:26:14.320031+0000","last_undegraded":"2023-08-27T11:26:14.320031+0000","last_fullsized":"2023-08-27T11:26:14.320031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:01:43.450519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904931+0000","last_change":"2023-08-27T11:26:12.924879+0000","last_active":"2023-08-27T11:26:13.904931+0000","last_peered":"2023-08-27T11:26:13.904931+0000","last_clean":"2023-08-27T11:26:13.904931+0000","last_became_active":"2023-08-27T11:26:12.924609+0000","last_became_peered":"2023-08-27T11:26:12.924609+0000","last_unstale":"2023-08-27T11:26:13.904931+0000","last_undegraded":"2023-08-27T11:26:13.904931+0000","last_fullsized":"2023-08-27T11:26:13.904931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:04.329581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903856+0000","last_change":"2023-08-27T11:26:12.921182+0000","last_active":"2023-08-27T11:26:13.903856+0000","last_peered":"2023-08-27T11:26:13.903856+0000","last_clean":"2023-08-27T11:26:13.903856+0000","last_became_active":"2023-08-27T11:26:12.920765+0000","last_became_peered":"2023-08-27T11:26:12.920765+0000","last_unstale":"2023-08-27T11:26:13.903856+0000","last_undegraded":"2023-08-27T11:26:13.903856+0000","last_fullsized":"2023-08-27T11:26:13.903856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:50.717591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904682+0000","last_change":"2023-08-27T11:26:12.916179+0000","last_active":"2023-08-27T11:26:13.904682+0000","last_peered":"2023-08-27T11:26:13.904682+0000","last_clean":"2023-08-27T11:26:13.904682+0000","last_became_active":"2023-08-27T11:26:12.915621+0000","last_became_peered":"2023-08-27T11:26:12.915621+0000","last_unstale":"2023-08-27T11:26:13.904682+0000","last_undegraded":"2023-08-27T11:26:13.904682+0000","last_fullsized":"2023-08-27T11:26:13.904682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:50.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904437+0000","last_change":"2023-08-27T11:26:12.925717+0000","last_active":"2023-08-27T11:26:13.904437+0000","last_peered":"2023-08-27T11:26:13.904437+0000","last_clean":"2023-08-27T11:26:13.904437+0000","last_became_active":"2023-08-27T11:26:12.925401+0000","last_became_peered":"2023-08-27T11:26:12.925401+0000","last_unstale":"2023-08-27T11:26:13.904437+0000","last_undegraded":"2023-08-27T11:26:13.904437+0000","last_fullsized":"2023-08-27T11:26:13.904437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:49.516580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319884+0000","last_change":"2023-08-27T11:26:12.925559+0000","last_active":"2023-08-27T11:26:14.319884+0000","last_peered":"2023-08-27T11:26:14.319884+0000","last_clean":"2023-08-27T11:26:14.319884+0000","last_became_active":"2023-08-27T11:26:12.925246+0000","last_became_peered":"2023-08-27T11:26:12.925246+0000","last_unstale":"2023-08-27T11:26:14.319884+0000","last_undegraded":"2023-08-27T11:26:14.319884+0000","last_fullsized":"2023-08-27T11:26:14.319884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:30.016959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319435+0000","last_change":"2023-08-27T11:26:12.921640+0000","last_active":"2023-08-27T11:26:14.319435+0000","last_peered":"2023-08-27T11:26:14.319435+0000","last_clean":"2023-08-27T11:26:14.319435+0000","last_became_active":"2023-08-27T11:26:12.921360+0000","last_became_peered":"2023-08-27T11:26:12.921360+0000","last_unstale":"2023-08-27T11:26:14.319435+0000","last_undegraded":"2023-08-27T11:26:14.319435+0000","last_fullsized":"2023-08-27T11:26:14.319435+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:47:33.705877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320850+0000","last_change":"2023-08-27T11:26:12.924720+0000","last_active":"2023-08-27T11:26:14.320850+0000","last_peered":"2023-08-27T11:26:14.320850+0000","last_clean":"2023-08-27T11:26:14.320850+0000","last_became_active":"2023-08-27T11:26:12.924423+0000","last_became_peered":"2023-08-27T11:26:12.924423+0000","last_unstale":"2023-08-27T11:26:14.320850+0000","last_undegraded":"2023-08-27T11:26:14.320850+0000","last_fullsized":"2023-08-27T11:26:14.320850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:49:19.543788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904854+0000","last_change":"2023-08-27T11:26:12.925928+0000","last_active":"2023-08-27T11:26:13.904854+0000","last_peered":"2023-08-27T11:26:13.904854+0000","last_clean":"2023-08-27T11:26:13.904854+0000","last_became_active":"2023-08-27T11:26:12.925454+0000","last_became_peered":"2023-08-27T11:26:12.925454+0000","last_unstale":"2023-08-27T11:26:13.904854+0000","last_undegraded":"2023-08-27T11:26:13.904854+0000","last_fullsized":"2023-08-27T11:26:13.904854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:34.652504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901532+0000","last_change":"2023-08-27T11:26:12.912775+0000","last_active":"2023-08-27T11:26:13.901532+0000","last_peered":"2023-08-27T11:26:13.901532+0000","last_clean":"2023-08-27T11:26:13.901532+0000","last_became_active":"2023-08-27T11:26:12.912497+0000","last_became_peered":"2023-08-27T11:26:12.912497+0000","last_unstale":"2023-08-27T11:26:13.901532+0000","last_undegraded":"2023-08-27T11:26:13.901532+0000","last_fullsized":"2023-08-27T11:26:13.901532+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:47.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903892+0000","last_change":"2023-08-27T11:26:12.920783+0000","last_active":"2023-08-27T11:26:13.903892+0000","last_peered":"2023-08-27T11:26:13.903892+0000","last_clean":"2023-08-27T11:26:13.903892+0000","last_became_active":"2023-08-27T11:26:12.920318+0000","last_became_peered":"2023-08-27T11:26:12.920318+0000","last_unstale":"2023-08-27T11:26:13.903892+0000","last_undegraded":"2023-08-27T11:26:13.903892+0000","last_fullsized":"2023-08-27T11:26:13.903892+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:11.018859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321608+0000","last_change":"2023-08-27T11:26:12.919233+0000","last_active":"2023-08-27T11:26:14.321608+0000","last_peered":"2023-08-27T11:26:14.321608+0000","last_clean":"2023-08-27T11:26:14.321608+0000","last_became_active":"2023-08-27T11:26:12.918788+0000","last_became_peered":"2023-08-27T11:26:12.918788+0000","last_unstale":"2023-08-27T11:26:14.321608+0000","last_undegraded":"2023-08-27T11:26:14.321608+0000","last_fullsized":"2023-08-27T11:26:14.321608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:16.704996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904978+0000","last_change":"2023-08-27T11:26:12.922607+0000","last_active":"2023-08-27T11:26:13.904978+0000","last_peered":"2023-08-27T11:26:13.904978+0000","last_clean":"2023-08-27T11:26:13.904978+0000","last_became_active":"2023-08-27T11:26:12.922244+0000","last_became_peered":"2023-08-27T11:26:12.922244+0000","last_unstale":"2023-08-27T11:26:13.904978+0000","last_undegraded":"2023-08-27T11:26:13.904978+0000","last_fullsized":"2023-08-27T11:26:13.904978+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:16.105475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320099+0000","last_change":"2023-08-27T11:26:12.928926+0000","last_active":"2023-08-27T11:26:14.320099+0000","last_peered":"2023-08-27T11:26:14.320099+0000","last_clean":"2023-08-27T11:26:14.320099+0000","last_became_active":"2023-08-27T11:26:12.927534+0000","last_became_peered":"2023-08-27T11:26:12.927534+0000","last_unstale":"2023-08-27T11:26:14.320099+0000","last_undegraded":"2023-08-27T11:26:14.320099+0000","last_fullsized":"2023-08-27T11:26:14.320099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:38:14.726578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319611+0000","last_change":"2023-08-27T11:26:12.920608+0000","last_active":"2023-08-27T11:26:14.319611+0000","last_peered":"2023-08-27T11:26:14.319611+0000","last_clean":"2023-08-27T11:26:14.319611+0000","last_became_active":"2023-08-27T11:26:12.919617+0000","last_became_peered":"2023-08-27T11:26:12.919617+0000","last_unstale":"2023-08-27T11:26:14.319611+0000","last_undegraded":"2023-08-27T11:26:14.319611+0000","last_fullsized":"2023-08-27T11:26:14.319611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:08:48.072023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320285+0000","last_change":"2023-08-27T11:26:12.919321+0000","last_active":"2023-08-27T11:26:14.320285+0000","last_peered":"2023-08-27T11:26:14.320285+0000","last_clean":"2023-08-27T11:26:14.320285+0000","last_became_active":"2023-08-27T11:26:12.918601+0000","last_became_peered":"2023-08-27T11:26:12.918601+0000","last_unstale":"2023-08-27T11:26:14.320285+0000","last_undegraded":"2023-08-27T11:26:14.320285+0000","last_fullsized":"2023-08-27T11:26:14.320285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:19.399497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"80'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320826+0000","last_change":"2023-08-27T11:26:12.186993+0000","last_active":"2023-08-27T11:26:14.320826+0000","last_peered":"2023-08-27T11:26:14.320826+0000","last_clean":"2023-08-27T11:26:14.320826+0000","last_became_active":"2023-08-27T11:26:12.186672+0000","last_became_peered":"2023-08-27T11:26:12.186672+0000","last_unstale":"2023-08-27T11:26:14.320826+0000","last_undegraded":"2023-08-27T11:26:14.320826+0000","last_fullsized":"2023-08-27T11:26:14.320826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:58.503144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319784+0000","last_change":"2023-08-27T11:26:12.916020+0000","last_active":"2023-08-27T11:26:14.319784+0000","last_peered":"2023-08-27T11:26:14.319784+0000","last_clean":"2023-08-27T11:26:14.319784+0000","last_became_active":"2023-08-27T11:26:12.915714+0000","last_became_peered":"2023-08-27T11:26:12.915714+0000","last_unstale":"2023-08-27T11:26:14.319784+0000","last_undegraded":"2023-08-27T11:26:14.319784+0000","last_fullsized":"2023-08-27T11:26:14.319784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:29:38.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905016+0000","last_change":"2023-08-27T11:26:12.185898+0000","last_active":"2023-08-27T11:26:13.905016+0000","last_peered":"2023-08-27T11:26:13.905016+0000","last_clean":"2023-08-27T11:26:13.905016+0000","last_became_active":"2023-08-27T11:26:12.185621+0000","last_became_peered":"2023-08-27T11:26:12.185621+0000","last_unstale":"2023-08-27T11:26:13.905016+0000","last_undegraded":"2023-08-27T11:26:13.905016+0000","last_fullsized":"2023-08-27T11:26:13.905016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:29.341596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321607+0000","last_change":"2023-08-27T11:26:12.925252+0000","last_active":"2023-08-27T11:26:14.321607+0000","last_peered":"2023-08-27T11:26:14.321607+0000","last_clean":"2023-08-27T11:26:14.321607+0000","last_became_active":"2023-08-27T11:26:12.924916+0000","last_became_peered":"2023-08-27T11:26:12.924916+0000","last_unstale":"2023-08-27T11:26:14.321607+0000","last_undegraded":"2023-08-27T11:26:14.321607+0000","last_fullsized":"2023-08-27T11:26:14.321607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:19:48.349663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321533+0000","last_change":"2023-08-27T11:26:12.185569+0000","last_active":"2023-08-27T11:26:14.321533+0000","last_peered":"2023-08-27T11:26:14.321533+0000","last_clean":"2023-08-27T11:26:14.321533+0000","last_became_active":"2023-08-27T11:26:12.185241+0000","last_became_peered":"2023-08-27T11:26:12.185241+0000","last_unstale":"2023-08-27T11:26:14.321533+0000","last_undegraded":"2023-08-27T11:26:14.321533+0000","last_fullsized":"2023-08-27T11:26:14.321533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:03.449328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320526+0000","last_change":"2023-08-27T11:26:12.917690+0000","last_active":"2023-08-27T11:26:14.320526+0000","last_peered":"2023-08-27T11:26:14.320526+0000","last_clean":"2023-08-27T11:26:14.320526+0000","last_became_active":"2023-08-27T11:26:12.917382+0000","last_became_peered":"2023-08-27T11:26:12.917382+0000","last_unstale":"2023-08-27T11:26:14.320526+0000","last_undegraded":"2023-08-27T11:26:14.320526+0000","last_fullsized":"2023-08-27T11:26:14.320526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:49.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320783+0000","last_change":"2023-08-27T11:26:12.184729+0000","last_active":"2023-08-27T11:26:14.320783+0000","last_peered":"2023-08-27T11:26:14.320783+0000","last_clean":"2023-08-27T11:26:14.320783+0000","last_became_active":"2023-08-27T11:26:12.183644+0000","last_became_peered":"2023-08-27T11:26:12.183644+0000","last_unstale":"2023-08-27T11:26:14.320783+0000","last_undegraded":"2023-08-27T11:26:14.320783+0000","last_fullsized":"2023-08-27T11:26:14.320783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:35:04.622743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903983+0000","last_change":"2023-08-27T11:26:12.918014+0000","last_active":"2023-08-27T11:26:13.903983+0000","last_peered":"2023-08-27T11:26:13.903983+0000","last_clean":"2023-08-27T11:26:13.903983+0000","last_became_active":"2023-08-27T11:26:12.911290+0000","last_became_peered":"2023-08-27T11:26:12.911290+0000","last_unstale":"2023-08-27T11:26:13.903983+0000","last_undegraded":"2023-08-27T11:26:13.903983+0000","last_fullsized":"2023-08-27T11:26:13.903983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:16:43.994656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904907+0000","last_change":"2023-08-27T11:26:12.180512+0000","last_active":"2023-08-27T11:26:13.904907+0000","last_peered":"2023-08-27T11:26:13.904907+0000","last_clean":"2023-08-27T11:26:13.904907+0000","last_became_active":"2023-08-27T11:26:12.180204+0000","last_became_peered":"2023-08-27T11:26:12.180204+0000","last_unstale":"2023-08-27T11:26:13.904907+0000","last_undegraded":"2023-08-27T11:26:13.904907+0000","last_fullsized":"2023-08-27T11:26:13.904907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:57.737942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319948+0000","last_change":"2023-08-27T11:26:12.914306+0000","last_active":"2023-08-27T11:26:14.319948+0000","last_peered":"2023-08-27T11:26:14.319948+0000","last_clean":"2023-08-27T11:26:14.319948+0000","last_became_active":"2023-08-27T11:26:12.913986+0000","last_became_peered":"2023-08-27T11:26:12.913986+0000","last_unstale":"2023-08-27T11:26:14.319948+0000","last_undegraded":"2023-08-27T11:26:14.319948+0000","last_fullsized":"2023-08-27T11:26:14.319948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:17:50.193171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904298+0000","last_change":"2023-08-27T11:26:12.182827+0000","last_active":"2023-08-27T11:26:13.904298+0000","last_peered":"2023-08-27T11:26:13.904298+0000","last_clean":"2023-08-27T11:26:13.904298+0000","last_became_active":"2023-08-27T11:26:12.182507+0000","last_became_peered":"2023-08-27T11:26:12.182507+0000","last_unstale":"2023-08-27T11:26:13.904298+0000","last_undegraded":"2023-08-27T11:26:13.904298+0000","last_fullsized":"2023-08-27T11:26:13.904298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:22.223259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319857+0000","last_change":"2023-08-27T11:26:12.925562+0000","last_active":"2023-08-27T11:26:14.319857+0000","last_peered":"2023-08-27T11:26:14.319857+0000","last_clean":"2023-08-27T11:26:14.319857+0000","last_became_active":"2023-08-27T11:26:12.924914+0000","last_became_peered":"2023-08-27T11:26:12.924914+0000","last_unstale":"2023-08-27T11:26:14.319857+0000","last_undegraded":"2023-08-27T11:26:14.319857+0000","last_fullsized":"2023-08-27T11:26:14.319857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:05:54.663669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319729+0000","last_change":"2023-08-27T11:26:12.177930+0000","last_active":"2023-08-27T11:26:14.319729+0000","last_peered":"2023-08-27T11:26:14.319729+0000","last_clean":"2023-08-27T11:26:14.319729+0000","last_became_active":"2023-08-27T11:26:12.177665+0000","last_became_peered":"2023-08-27T11:26:12.177665+0000","last_unstale":"2023-08-27T11:26:14.319729+0000","last_undegraded":"2023-08-27T11:26:14.319729+0000","last_fullsized":"2023-08-27T11:26:14.319729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:58:25.609029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903867+0000","last_change":"2023-08-27T11:26:12.919704+0000","last_active":"2023-08-27T11:26:13.903867+0000","last_peered":"2023-08-27T11:26:13.903867+0000","last_clean":"2023-08-27T11:26:13.903867+0000","last_became_active":"2023-08-27T11:26:12.919430+0000","last_became_peered":"2023-08-27T11:26:12.919430+0000","last_unstale":"2023-08-27T11:26:13.903867+0000","last_undegraded":"2023-08-27T11:26:13.903867+0000","last_fullsized":"2023-08-27T11:26:13.903867+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:24.764491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320976+0000","last_change":"2023-08-27T11:26:12.189747+0000","last_active":"2023-08-27T11:26:14.320976+0000","last_peered":"2023-08-27T11:26:14.320976+0000","last_clean":"2023-08-27T11:26:14.320976+0000","last_became_active":"2023-08-27T11:26:12.189215+0000","last_became_peered":"2023-08-27T11:26:12.189215+0000","last_unstale":"2023-08-27T11:26:14.320976+0000","last_undegraded":"2023-08-27T11:26:14.320976+0000","last_fullsized":"2023-08-27T11:26:14.320976+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:17:44.212448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904793+0000","last_change":"2023-08-27T11:26:12.914580+0000","last_active":"2023-08-27T11:26:13.904793+0000","last_peered":"2023-08-27T11:26:13.904793+0000","last_clean":"2023-08-27T11:26:13.904793+0000","last_became_active":"2023-08-27T11:26:12.914302+0000","last_became_peered":"2023-08-27T11:26:12.914302+0000","last_unstale":"2023-08-27T11:26:13.904793+0000","last_undegraded":"2023-08-27T11:26:13.904793+0000","last_fullsized":"2023-08-27T11:26:13.904793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:48:43.865768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321154+0000","last_change":"2023-08-27T11:26:12.188629+0000","last_active":"2023-08-27T11:26:14.321154+0000","last_peered":"2023-08-27T11:26:14.321154+0000","last_clean":"2023-08-27T11:26:14.321154+0000","last_became_active":"2023-08-27T11:26:12.188334+0000","last_became_peered":"2023-08-27T11:26:12.188334+0000","last_unstale":"2023-08-27T11:26:14.321154+0000","last_undegraded":"2023-08-27T11:26:14.321154+0000","last_fullsized":"2023-08-27T11:26:14.321154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:17:51.028558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321237+0000","last_change":"2023-08-27T11:26:12.918378+0000","last_active":"2023-08-27T11:26:14.321237+0000","last_peered":"2023-08-27T11:26:14.321237+0000","last_clean":"2023-08-27T11:26:14.321237+0000","last_became_active":"2023-08-27T11:26:12.918095+0000","last_became_peered":"2023-08-27T11:26:12.918095+0000","last_unstale":"2023-08-27T11:26:14.321237+0000","last_undegraded":"2023-08-27T11:26:14.321237+0000","last_fullsized":"2023-08-27T11:26:14.321237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:48:34.809087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320217+0000","last_change":"2023-08-27T11:26:12.184118+0000","last_active":"2023-08-27T11:26:14.320217+0000","last_peered":"2023-08-27T11:26:14.320217+0000","last_clean":"2023-08-27T11:26:14.320217+0000","last_became_active":"2023-08-27T11:26:12.183835+0000","last_became_peered":"2023-08-27T11:26:12.183835+0000","last_unstale":"2023-08-27T11:26:14.320217+0000","last_undegraded":"2023-08-27T11:26:14.320217+0000","last_fullsized":"2023-08-27T11:26:14.320217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:35.916104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320159+0000","last_change":"2023-08-27T11:26:12.913926+0000","last_active":"2023-08-27T11:26:14.320159+0000","last_peered":"2023-08-27T11:26:14.320159+0000","last_clean":"2023-08-27T11:26:14.320159+0000","last_became_active":"2023-08-27T11:26:12.913615+0000","last_became_peered":"2023-08-27T11:26:12.913615+0000","last_unstale":"2023-08-27T11:26:14.320159+0000","last_undegraded":"2023-08-27T11:26:14.320159+0000","last_fullsized":"2023-08-27T11:26:14.320159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:24.731901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"80'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904904+0000","last_change":"2023-08-27T11:26:12.189833+0000","last_active":"2023-08-27T11:26:13.904904+0000","last_peered":"2023-08-27T11:26:13.904904+0000","last_clean":"2023-08-27T11:26:13.904904+0000","last_became_active":"2023-08-27T11:26:12.189531+0000","last_became_peered":"2023-08-27T11:26:12.189531+0000","last_unstale":"2023-08-27T11:26:13.904904+0000","last_undegraded":"2023-08-27T11:26:13.904904+0000","last_fullsized":"2023-08-27T11:26:13.904904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:31:58.145133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903993+0000","last_change":"2023-08-27T11:26:12.922969+0000","last_active":"2023-08-27T11:26:13.903993+0000","last_peered":"2023-08-27T11:26:13.903993+0000","last_clean":"2023-08-27T11:26:13.903993+0000","last_became_active":"2023-08-27T11:26:12.922669+0000","last_became_peered":"2023-08-27T11:26:12.922669+0000","last_unstale":"2023-08-27T11:26:13.903993+0000","last_undegraded":"2023-08-27T11:26:13.903993+0000","last_fullsized":"2023-08-27T11:26:13.903993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:17.936034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"80'6","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320432+0000","last_change":"2023-08-27T11:26:12.187784+0000","last_active":"2023-08-27T11:26:14.320432+0000","last_peered":"2023-08-27T11:26:14.320432+0000","last_clean":"2023-08-27T11:26:14.320432+0000","last_became_active":"2023-08-27T11:26:12.187503+0000","last_became_peered":"2023-08-27T11:26:12.187503+0000","last_unstale":"2023-08-27T11:26:14.320432+0000","last_undegraded":"2023-08-27T11:26:14.320432+0000","last_fullsized":"2023-08-27T11:26:14.320432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:39.941827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903585+0000","last_change":"2023-08-27T11:26:12.923385+0000","last_active":"2023-08-27T11:26:13.903585+0000","last_peered":"2023-08-27T11:26:13.903585+0000","last_clean":"2023-08-27T11:26:13.903585+0000","last_became_active":"2023-08-27T11:26:12.923117+0000","last_became_peered":"2023-08-27T11:26:12.923117+0000","last_unstale":"2023-08-27T11:26:13.903585+0000","last_undegraded":"2023-08-27T11:26:13.903585+0000","last_fullsized":"2023-08-27T11:26:13.903585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:44:41.217844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321601+0000","last_change":"2023-08-27T11:26:12.190527+0000","last_active":"2023-08-27T11:26:14.321601+0000","last_peered":"2023-08-27T11:26:14.321601+0000","last_clean":"2023-08-27T11:26:14.321601+0000","last_became_active":"2023-08-27T11:26:12.190223+0000","last_became_peered":"2023-08-27T11:26:12.190223+0000","last_unstale":"2023-08-27T11:26:14.321601+0000","last_undegraded":"2023-08-27T11:26:14.321601+0000","last_fullsized":"2023-08-27T11:26:14.321601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:14.185653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904372+0000","last_change":"2023-08-27T11:26:12.917926+0000","last_active":"2023-08-27T11:26:13.904372+0000","last_peered":"2023-08-27T11:26:13.904372+0000","last_clean":"2023-08-27T11:26:13.904372+0000","last_became_active":"2023-08-27T11:26:12.917619+0000","last_became_peered":"2023-08-27T11:26:12.917619+0000","last_unstale":"2023-08-27T11:26:13.904372+0000","last_undegraded":"2023-08-27T11:26:13.904372+0000","last_fullsized":"2023-08-27T11:26:13.904372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:32:04.281203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319724+0000","last_change":"2023-08-27T11:26:12.189867+0000","last_active":"2023-08-27T11:26:14.319724+0000","last_peered":"2023-08-27T11:26:14.319724+0000","last_clean":"2023-08-27T11:26:14.319724+0000","last_became_active":"2023-08-27T11:26:12.189367+0000","last_became_peered":"2023-08-27T11:26:12.189367+0000","last_unstale":"2023-08-27T11:26:14.319724+0000","last_undegraded":"2023-08-27T11:26:14.319724+0000","last_fullsized":"2023-08-27T11:26:14.319724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:23:53.335334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901351+0000","last_change":"2023-08-27T11:26:12.911423+0000","last_active":"2023-08-27T11:26:13.901351+0000","last_peered":"2023-08-27T11:26:13.901351+0000","last_clean":"2023-08-27T11:26:13.901351+0000","last_became_active":"2023-08-27T11:26:12.911081+0000","last_became_peered":"2023-08-27T11:26:12.911081+0000","last_unstale":"2023-08-27T11:26:13.901351+0000","last_undegraded":"2023-08-27T11:26:13.901351+0000","last_fullsized":"2023-08-27T11:26:13.901351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:39:35.621885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903801+0000","last_change":"2023-08-27T11:26:12.183743+0000","last_active":"2023-08-27T11:26:13.903801+0000","last_peered":"2023-08-27T11:26:13.903801+0000","last_clean":"2023-08-27T11:26:13.903801+0000","last_became_active":"2023-08-27T11:26:12.183461+0000","last_became_peered":"2023-08-27T11:26:12.183461+0000","last_unstale":"2023-08-27T11:26:13.903801+0000","last_undegraded":"2023-08-27T11:26:13.903801+0000","last_fullsized":"2023-08-27T11:26:13.903801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:17.212183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901573+0000","last_change":"2023-08-27T11:26:12.916178+0000","last_active":"2023-08-27T11:26:13.901573+0000","last_peered":"2023-08-27T11:26:13.901573+0000","last_clean":"2023-08-27T11:26:13.901573+0000","last_became_active":"2023-08-27T11:26:12.915880+0000","last_became_peered":"2023-08-27T11:26:12.915880+0000","last_unstale":"2023-08-27T11:26:13.901573+0000","last_undegraded":"2023-08-27T11:26:13.901573+0000","last_fullsized":"2023-08-27T11:26:13.901573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:45:42.369485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903614+0000","last_change":"2023-08-27T11:26:12.182877+0000","last_active":"2023-08-27T11:26:13.903614+0000","last_peered":"2023-08-27T11:26:13.903614+0000","last_clean":"2023-08-27T11:26:13.903614+0000","last_became_active":"2023-08-27T11:26:12.182613+0000","last_became_peered":"2023-08-27T11:26:12.182613+0000","last_unstale":"2023-08-27T11:26:13.903614+0000","last_undegraded":"2023-08-27T11:26:13.903614+0000","last_fullsized":"2023-08-27T11:26:13.903614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:44:28.511894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321449+0000","last_change":"2023-08-27T11:26:12.916988+0000","last_active":"2023-08-27T11:26:14.321449+0000","last_peered":"2023-08-27T11:26:14.321449+0000","last_clean":"2023-08-27T11:26:14.321449+0000","last_became_active":"2023-08-27T11:26:12.916651+0000","last_became_peered":"2023-08-27T11:26:12.916651+0000","last_unstale":"2023-08-27T11:26:14.321449+0000","last_undegraded":"2023-08-27T11:26:14.321449+0000","last_fullsized":"2023-08-27T11:26:14.321449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:31.221632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321302+0000","last_change":"2023-08-27T11:26:12.185221+0000","last_active":"2023-08-27T11:26:14.321302+0000","last_peered":"2023-08-27T11:26:14.321302+0000","last_clean":"2023-08-27T11:26:14.321302+0000","last_became_active":"2023-08-27T11:26:12.184917+0000","last_became_peered":"2023-08-27T11:26:12.184917+0000","last_unstale":"2023-08-27T11:26:14.321302+0000","last_undegraded":"2023-08-27T11:26:14.321302+0000","last_fullsized":"2023-08-27T11:26:14.321302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:12.369735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319919+0000","last_change":"2023-08-27T11:26:12.919598+0000","last_active":"2023-08-27T11:26:14.319919+0000","last_peered":"2023-08-27T11:26:14.319919+0000","last_clean":"2023-08-27T11:26:14.319919+0000","last_became_active":"2023-08-27T11:26:12.919289+0000","last_became_peered":"2023-08-27T11:26:12.919289+0000","last_unstale":"2023-08-27T11:26:14.319919+0000","last_undegraded":"2023-08-27T11:26:14.319919+0000","last_fullsized":"2023-08-27T11:26:14.319919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:20:16.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905082+0000","last_change":"2023-08-27T11:26:12.184555+0000","last_active":"2023-08-27T11:26:13.905082+0000","last_peered":"2023-08-27T11:26:13.905082+0000","last_clean":"2023-08-27T11:26:13.905082+0000","last_became_active":"2023-08-27T11:26:12.184260+0000","last_became_peered":"2023-08-27T11:26:12.184260+0000","last_unstale":"2023-08-27T11:26:13.905082+0000","last_undegraded":"2023-08-27T11:26:13.905082+0000","last_fullsized":"2023-08-27T11:26:13.905082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:36:33.267211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320487+0000","last_change":"2023-08-27T11:26:12.921934+0000","last_active":"2023-08-27T11:26:14.320487+0000","last_peered":"2023-08-27T11:26:14.320487+0000","last_clean":"2023-08-27T11:26:14.320487+0000","last_became_active":"2023-08-27T11:26:12.917145+0000","last_became_peered":"2023-08-27T11:26:12.917145+0000","last_unstale":"2023-08-27T11:26:14.320487+0000","last_undegraded":"2023-08-27T11:26:14.320487+0000","last_fullsized":"2023-08-27T11:26:14.320487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:54:15.365870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905285+0000","last_change":"2023-08-27T11:26:12.190280+0000","last_active":"2023-08-27T11:26:13.905285+0000","last_peered":"2023-08-27T11:26:13.905285+0000","last_clean":"2023-08-27T11:26:13.905285+0000","last_became_active":"2023-08-27T11:26:12.189982+0000","last_became_peered":"2023-08-27T11:26:12.189982+0000","last_unstale":"2023-08-27T11:26:13.905285+0000","last_undegraded":"2023-08-27T11:26:13.905285+0000","last_fullsized":"2023-08-27T11:26:13.905285+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:46:45.874544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321023+0000","last_change":"2023-08-27T11:26:12.924686+0000","last_active":"2023-08-27T11:26:14.321023+0000","last_peered":"2023-08-27T11:26:14.321023+0000","last_clean":"2023-08-27T11:26:14.321023+0000","last_became_active":"2023-08-27T11:26:12.924315+0000","last_became_peered":"2023-08-27T11:26:12.924315+0000","last_unstale":"2023-08-27T11:26:14.321023+0000","last_undegraded":"2023-08-27T11:26:14.321023+0000","last_fullsized":"2023-08-27T11:26:14.321023+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:48:45.873093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320933+0000","last_change":"2023-08-27T11:26:12.178153+0000","last_active":"2023-08-27T11:26:14.320933+0000","last_peered":"2023-08-27T11:26:14.320933+0000","last_clean":"2023-08-27T11:26:14.320933+0000","last_became_active":"2023-08-27T11:26:12.177829+0000","last_became_peered":"2023-08-27T11:26:12.177829+0000","last_unstale":"2023-08-27T11:26:14.320933+0000","last_undegraded":"2023-08-27T11:26:14.320933+0000","last_fullsized":"2023-08-27T11:26:14.320933+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:56.795145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901211+0000","last_change":"2023-08-27T11:26:12.916464+0000","last_active":"2023-08-27T11:26:13.901211+0000","last_peered":"2023-08-27T11:26:13.901211+0000","last_clean":"2023-08-27T11:26:13.901211+0000","last_became_active":"2023-08-27T11:26:12.916146+0000","last_became_peered":"2023-08-27T11:26:12.916146+0000","last_unstale":"2023-08-27T11:26:13.901211+0000","last_undegraded":"2023-08-27T11:26:13.901211+0000","last_fullsized":"2023-08-27T11:26:13.901211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:01.480357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320129+0000","last_change":"2023-08-27T11:26:12.186703+0000","last_active":"2023-08-27T11:26:14.320129+0000","last_peered":"2023-08-27T11:26:14.320129+0000","last_clean":"2023-08-27T11:26:14.320129+0000","last_became_active":"2023-08-27T11:26:12.186395+0000","last_became_peered":"2023-08-27T11:26:12.186395+0000","last_unstale":"2023-08-27T11:26:14.320129+0000","last_undegraded":"2023-08-27T11:26:14.320129+0000","last_fullsized":"2023-08-27T11:26:14.320129+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:27.695163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319608+0000","last_change":"2023-08-27T11:26:12.913789+0000","last_active":"2023-08-27T11:26:14.319608+0000","last_peered":"2023-08-27T11:26:14.319608+0000","last_clean":"2023-08-27T11:26:14.319608+0000","last_became_active":"2023-08-27T11:26:12.913497+0000","last_became_peered":"2023-08-27T11:26:12.913497+0000","last_unstale":"2023-08-27T11:26:14.319608+0000","last_undegraded":"2023-08-27T11:26:14.319608+0000","last_fullsized":"2023-08-27T11:26:14.319608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:24.373890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320579+0000","last_change":"2023-08-27T11:26:12.185709+0000","last_active":"2023-08-27T11:26:14.320579+0000","last_peered":"2023-08-27T11:26:14.320579+0000","last_clean":"2023-08-27T11:26:14.320579+0000","last_became_active":"2023-08-27T11:26:12.185386+0000","last_became_peered":"2023-08-27T11:26:12.185386+0000","last_unstale":"2023-08-27T11:26:14.320579+0000","last_undegraded":"2023-08-27T11:26:14.320579+0000","last_fullsized":"2023-08-27T11:26:14.320579+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:47.247320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320160+0000","last_change":"2023-08-27T11:26:12.912019+0000","last_active":"2023-08-27T11:26:14.320160+0000","last_peered":"2023-08-27T11:26:14.320160+0000","last_clean":"2023-08-27T11:26:14.320160+0000","last_became_active":"2023-08-27T11:26:12.911666+0000","last_became_peered":"2023-08-27T11:26:12.911666+0000","last_unstale":"2023-08-27T11:26:14.320160+0000","last_undegraded":"2023-08-27T11:26:14.320160+0000","last_fullsized":"2023-08-27T11:26:14.320160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:57:08.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320042+0000","last_change":"2023-08-27T11:26:12.178283+0000","last_active":"2023-08-27T11:26:14.320042+0000","last_peered":"2023-08-27T11:26:14.320042+0000","last_clean":"2023-08-27T11:26:14.320042+0000","last_became_active":"2023-08-27T11:26:12.177991+0000","last_became_peered":"2023-08-27T11:26:12.177991+0000","last_unstale":"2023-08-27T11:26:14.320042+0000","last_undegraded":"2023-08-27T11:26:14.320042+0000","last_fullsized":"2023-08-27T11:26:14.320042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:44:48.919916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320154+0000","last_change":"2023-08-27T11:26:12.917787+0000","last_active":"2023-08-27T11:26:14.320154+0000","last_peered":"2023-08-27T11:26:14.320154+0000","last_clean":"2023-08-27T11:26:14.320154+0000","last_became_active":"2023-08-27T11:26:12.917198+0000","last_became_peered":"2023-08-27T11:26:12.917198+0000","last_unstale":"2023-08-27T11:26:14.320154+0000","last_undegraded":"2023-08-27T11:26:14.320154+0000","last_fullsized":"2023-08-27T11:26:14.320154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:28:16.667846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321150+0000","last_change":"2023-08-27T11:26:12.187741+0000","last_active":"2023-08-27T11:26:14.321150+0000","last_peered":"2023-08-27T11:26:14.321150+0000","last_clean":"2023-08-27T11:26:14.321150+0000","last_became_active":"2023-08-27T11:26:12.187469+0000","last_became_peered":"2023-08-27T11:26:12.187469+0000","last_unstale":"2023-08-27T11:26:14.321150+0000","last_undegraded":"2023-08-27T11:26:14.321150+0000","last_fullsized":"2023-08-27T11:26:14.321150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:33.602848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319743+0000","last_change":"2023-08-27T11:26:12.924485+0000","last_active":"2023-08-27T11:26:14.319743+0000","last_peered":"2023-08-27T11:26:14.319743+0000","last_clean":"2023-08-27T11:26:14.319743+0000","last_became_active":"2023-08-27T11:26:12.924215+0000","last_became_peered":"2023-08-27T11:26:12.924215+0000","last_unstale":"2023-08-27T11:26:14.319743+0000","last_undegraded":"2023-08-27T11:26:14.319743+0000","last_fullsized":"2023-08-27T11:26:14.319743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:03:56.487034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320368+0000","last_change":"2023-08-27T11:26:12.189781+0000","last_active":"2023-08-27T11:26:14.320368+0000","last_peered":"2023-08-27T11:26:14.320368+0000","last_clean":"2023-08-27T11:26:14.320368+0000","last_became_active":"2023-08-27T11:26:12.189444+0000","last_became_peered":"2023-08-27T11:26:12.189444+0000","last_unstale":"2023-08-27T11:26:14.320368+0000","last_undegraded":"2023-08-27T11:26:14.320368+0000","last_fullsized":"2023-08-27T11:26:14.320368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:41:19.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320961+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:14.320961+0000","last_peered":"2023-08-27T11:26:14.320961+0000","last_clean":"2023-08-27T11:26:14.320961+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:14.320961+0000","last_undegraded":"2023-08-27T11:26:14.320961+0000","last_fullsized":"2023-08-27T11:26:14.320961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:19:39.314165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321193+0000","last_change":"2023-08-27T11:26:12.925979+0000","last_active":"2023-08-27T11:26:14.321193+0000","last_peered":"2023-08-27T11:26:14.321193+0000","last_clean":"2023-08-27T11:26:14.321193+0000","last_became_active":"2023-08-27T11:26:12.925663+0000","last_became_peered":"2023-08-27T11:26:12.925663+0000","last_unstale":"2023-08-27T11:26:14.321193+0000","last_undegraded":"2023-08-27T11:26:14.321193+0000","last_fullsized":"2023-08-27T11:26:14.321193+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:49:19.449494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901371+0000","last_change":"2023-08-27T11:26:12.186791+0000","last_active":"2023-08-27T11:26:13.901371+0000","last_peered":"2023-08-27T11:26:13.901371+0000","last_clean":"2023-08-27T11:26:13.901371+0000","last_became_active":"2023-08-27T11:26:12.185655+0000","last_became_peered":"2023-08-27T11:26:12.185655+0000","last_unstale":"2023-08-27T11:26:13.901371+0000","last_undegraded":"2023-08-27T11:26:13.901371+0000","last_fullsized":"2023-08-27T11:26:13.901371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:58.832585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320628+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:14.320628+0000","last_peered":"2023-08-27T11:26:14.320628+0000","last_clean":"2023-08-27T11:26:14.320628+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:14.320628+0000","last_undegraded":"2023-08-27T11:26:14.320628+0000","last_fullsized":"2023-08-27T11:26:14.320628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:49:36.264774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904953+0000","last_change":"2023-08-27T11:26:12.920215+0000","last_active":"2023-08-27T11:26:13.904953+0000","last_peered":"2023-08-27T11:26:13.904953+0000","last_clean":"2023-08-27T11:26:13.904953+0000","last_became_active":"2023-08-27T11:26:12.919914+0000","last_became_peered":"2023-08-27T11:26:12.919914+0000","last_unstale":"2023-08-27T11:26:13.904953+0000","last_undegraded":"2023-08-27T11:26:13.904953+0000","last_fullsized":"2023-08-27T11:26:13.904953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:28.212186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905136+0000","last_change":"2023-08-27T11:26:12.187481+0000","last_active":"2023-08-27T11:26:13.905136+0000","last_peered":"2023-08-27T11:26:13.905136+0000","last_clean":"2023-08-27T11:26:13.905136+0000","last_became_active":"2023-08-27T11:26:12.187148+0000","last_became_peered":"2023-08-27T11:26:12.187148+0000","last_unstale":"2023-08-27T11:26:13.905136+0000","last_undegraded":"2023-08-27T11:26:13.905136+0000","last_fullsized":"2023-08-27T11:26:13.905136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:52:14.858510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320249+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:14.320249+0000","last_peered":"2023-08-27T11:26:14.320249+0000","last_clean":"2023-08-27T11:26:14.320249+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:14.320249+0000","last_undegraded":"2023-08-27T11:26:14.320249+0000","last_fullsized":"2023-08-27T11:26:14.320249+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:42.468015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321224+0000","last_change":"2023-08-27T11:26:12.917018+0000","last_active":"2023-08-27T11:26:14.321224+0000","last_peered":"2023-08-27T11:26:14.321224+0000","last_clean":"2023-08-27T11:26:14.321224+0000","last_became_active":"2023-08-27T11:26:12.916669+0000","last_became_peered":"2023-08-27T11:26:12.916669+0000","last_unstale":"2023-08-27T11:26:14.321224+0000","last_undegraded":"2023-08-27T11:26:14.321224+0000","last_fullsized":"2023-08-27T11:26:14.321224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:03.918030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.904155+0000","last_change":"2023-08-27T11:26:12.185478+0000","last_active":"2023-08-27T11:26:13.904155+0000","last_peered":"2023-08-27T11:26:13.904155+0000","last_clean":"2023-08-27T11:26:13.904155+0000","last_became_active":"2023-08-27T11:26:12.185036+0000","last_became_peered":"2023-08-27T11:26:12.185036+0000","last_unstale":"2023-08-27T11:26:13.904155+0000","last_undegraded":"2023-08-27T11:26:13.904155+0000","last_fullsized":"2023-08-27T11:26:13.904155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:31:38.899024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321237+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:14.321237+0000","last_peered":"2023-08-27T11:26:14.321237+0000","last_clean":"2023-08-27T11:26:14.321237+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:14.321237+0000","last_undegraded":"2023-08-27T11:26:14.321237+0000","last_fullsized":"2023-08-27T11:26:14.321237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:13:03.859452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320574+0000","last_change":"2023-08-27T11:26:12.922566+0000","last_active":"2023-08-27T11:26:14.320574+0000","last_peered":"2023-08-27T11:26:14.320574+0000","last_clean":"2023-08-27T11:26:14.320574+0000","last_became_active":"2023-08-27T11:26:12.922275+0000","last_became_peered":"2023-08-27T11:26:12.922275+0000","last_unstale":"2023-08-27T11:26:14.320574+0000","last_undegraded":"2023-08-27T11:26:14.320574+0000","last_fullsized":"2023-08-27T11:26:14.320574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:40:21.901800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321440+0000","last_change":"2023-08-27T11:26:12.187352+0000","last_active":"2023-08-27T11:26:14.321440+0000","last_peered":"2023-08-27T11:26:14.321440+0000","last_clean":"2023-08-27T11:26:14.321440+0000","last_became_active":"2023-08-27T11:26:12.187029+0000","last_became_peered":"2023-08-27T11:26:12.187029+0000","last_unstale":"2023-08-27T11:26:14.321440+0000","last_undegraded":"2023-08-27T11:26:14.321440+0000","last_fullsized":"2023-08-27T11:26:14.321440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:58:05.671663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.321086+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:14.321086+0000","last_peered":"2023-08-27T11:26:14.321086+0000","last_clean":"2023-08-27T11:26:14.321086+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:14.321086+0000","last_undegraded":"2023-08-27T11:26:14.321086+0000","last_fullsized":"2023-08-27T11:26:14.321086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:56:05.447724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320288+0000","last_change":"2023-08-27T11:26:12.919419+0000","last_active":"2023-08-27T11:26:14.320288+0000","last_peered":"2023-08-27T11:26:14.320288+0000","last_clean":"2023-08-27T11:26:14.320288+0000","last_became_active":"2023-08-27T11:26:12.919043+0000","last_became_peered":"2023-08-27T11:26:12.919043+0000","last_unstale":"2023-08-27T11:26:14.320288+0000","last_undegraded":"2023-08-27T11:26:14.320288+0000","last_fullsized":"2023-08-27T11:26:14.320288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:03.149158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320838+0000","last_change":"2023-08-27T11:26:12.182881+0000","last_active":"2023-08-27T11:26:14.320838+0000","last_peered":"2023-08-27T11:26:14.320838+0000","last_clean":"2023-08-27T11:26:14.320838+0000","last_became_active":"2023-08-27T11:26:12.182521+0000","last_became_peered":"2023-08-27T11:26:12.182521+0000","last_unstale":"2023-08-27T11:26:14.320838+0000","last_undegraded":"2023-08-27T11:26:14.320838+0000","last_fullsized":"2023-08-27T11:26:14.320838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:16.802436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":272,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319762+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:14.319762+0000","last_peered":"2023-08-27T11:26:14.319762+0000","last_clean":"2023-08-27T11:26:14.319762+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:14.319762+0000","last_undegraded":"2023-08-27T11:26:14.319762+0000","last_fullsized":"2023-08-27T11:26:14.319762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:04:09.770367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":126,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.903999+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:13.903999+0000","last_peered":"2023-08-27T11:26:13.903999+0000","last_clean":"2023-08-27T11:26:13.903999+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:13.903999+0000","last_undegraded":"2023-08-27T11:26:13.903999+0000","last_fullsized":"2023-08-27T11:26:13.903999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:53:12.750654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.319984+0000","last_change":"2023-08-27T11:26:12.919084+0000","last_active":"2023-08-27T11:26:14.319984+0000","last_peered":"2023-08-27T11:26:14.319984+0000","last_clean":"2023-08-27T11:26:14.319984+0000","last_became_active":"2023-08-27T11:26:12.918779+0000","last_became_peered":"2023-08-27T11:26:12.918779+0000","last_unstale":"2023-08-27T11:26:14.319984+0000","last_undegraded":"2023-08-27T11:26:14.319984+0000","last_fullsized":"2023-08-27T11:26:14.319984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:13:35.886790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.901249+0000","last_change":"2023-08-27T11:26:12.187932+0000","last_active":"2023-08-27T11:26:13.901249+0000","last_peered":"2023-08-27T11:26:13.901249+0000","last_clean":"2023-08-27T11:26:13.901249+0000","last_became_active":"2023-08-27T11:26:12.187665+0000","last_became_peered":"2023-08-27T11:26:12.187665+0000","last_unstale":"2023-08-27T11:26:13.901249+0000","last_undegraded":"2023-08-27T11:26:13.901249+0000","last_fullsized":"2023-08-27T11:26:13.901249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:28:13.133945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320169+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:14.320169+0000","last_peered":"2023-08-27T11:26:14.320169+0000","last_clean":"2023-08-27T11:26:14.320169+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:14.320169+0000","last_undegraded":"2023-08-27T11:26:14.320169+0000","last_fullsized":"2023-08-27T11:26:14.320169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:15:09.429476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320381+0000","last_change":"2023-08-27T11:26:12.927419+0000","last_active":"2023-08-27T11:26:14.320381+0000","last_peered":"2023-08-27T11:26:14.320381+0000","last_clean":"2023-08-27T11:26:14.320381+0000","last_became_active":"2023-08-27T11:26:12.927060+0000","last_became_peered":"2023-08-27T11:26:12.927060+0000","last_unstale":"2023-08-27T11:26:14.320381+0000","last_undegraded":"2023-08-27T11:26:14.320381+0000","last_fullsized":"2023-08-27T11:26:14.320381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:12.157158+0000","last_clean_scrub_stamp":"2023-08-27T11:26:12.157158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:08.377025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:14.320132+0000","last_change":"2023-08-27T11:26:12.189785+0000","last_active":"2023-08-27T11:26:14.320132+0000","last_peered":"2023-08-27T11:26:14.320132+0000","last_clean":"2023-08-27T11:26:14.320132+0000","last_became_active":"2023-08-27T11:26:12.189427+0000","last_became_peered":"2023-08-27T11:26:12.189427+0000","last_unstale":"2023-08-27T11:26:14.320132+0000","last_undegraded":"2023-08-27T11:26:14.320132+0000","last_fullsized":"2023-08-27T11:26:14.320132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:11.150770+0000","last_clean_scrub_stamp":"2023-08-27T11:26:11.150770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:27.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-08-27T11:26:13.905299+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:13.905299+0000","last_peered":"2023-08-27T11:26:13.905299+0000","last_clean":"2023-08-27T11:26:13.905299+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:13.905299+0000","last_undegraded":"2023-08-27T11:26:13.905299+0000","last_fullsized":"2023-08-27T11:26:13.905299+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:34:38.476163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28580,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343260,"statfs":{"total":96636764160,"available":96607498240,"internally_reserved":0,"allocated":1597440,"data_stored":1050949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.58399999999999996},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68899999999999995,"15min":0.68200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65000000000000002,"15min":0.63600000000000001},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85199999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.018,"5min":1.173,"15min":1.173},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.64500000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69399999999999995,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92300000000000004,"5min":1.083,"15min":1.083},"last":0.496},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.627,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97899999999999998,"5min":1.135,"15min":1.135},"last":0.56100000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70299999999999996},"min":{"1min":0.51000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94199999999999995,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94799999999999995,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77000000000000002},"min":{"1min":0.54000000000000004,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0760000000000001,"5min":1.397,"15min":1.397},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.80200000000000005},"min":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0609999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.87,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.087,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0980000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":461755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.82899999999999996,"15min":0.91500000000000004},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.81999999999999995,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77800000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76000000000000001,"15min":0.79000000000000004},"min":{"1min":0.54000000000000004,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":3.472,"15min":3.472},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.88800000000000001,"15min":0.98799999999999999},"min":{"1min":0.48899999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.89700000000000002,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.752,"15min":0.80100000000000005},"min":{"1min":0.48999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81899999999999995,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.80300000000000005,"15min":0.84799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85599999999999998,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.90500000000000003,"15min":0.99399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.875,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.81299999999999994,"15min":0.87},"min":{"1min":0.55400000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.77900000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.51200000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1100000000000001,"5min":1.234,"15min":1.234},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78300000000000003,"15min":0.80900000000000005},"min":{"1min":0.54000000000000004,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96399999999999997,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.69999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.48699999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.98299999999999998,"5min":1.135,"15min":1.135},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.59299999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.073,"5min":1.127,"15min":1.127},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.86599999999999999,"15min":0.89300000000000002},"min":{"1min":0.59899999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.99199999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.84499999999999997,"15min":0.871},"min":{"1min":0.57399999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.92700000000000005,"5min":1.27,"15min":1.27},"last":0.873}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343264,"statfs":{"total":96636764160,"available":96607502336,"internally_reserved":0,"allocated":1593344,"data_stored":1050963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40999999999999998,"15min":0.40200000000000002},"min":{"1min":0.27200000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.30499999999999999,"5min":0.253,"15min":0.253},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.39600000000000002,"5min":0.313,"15min":0.313},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.35099999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.39500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.77700000000000002},"min":{"1min":0.47899999999999998,"5min":0.435,"15min":0.435},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.504},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.80800000000000005,"15min":0.81299999999999994},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.359,"5min":3.359,"15min":3.359},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.23,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79400000000000004,"15min":0.78700000000000003},"min":{"1min":0.62,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":2.6800000000000002,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.85199999999999998,"15min":0.83399999999999996},"min":{"1min":0.60899999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.8410000000000002,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":461857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.432,"15min":0.434},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.373,"15min":0.373},"max":{"1min":0.78300000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.441}]},{"osd":2,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.33600000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.376},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.498,"15min":0.504},"min":{"1min":0.33600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51400000000000001},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.433},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68600000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.70799999999999996},"min":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91300000000000003,"5min":1.355,"15min":1.355},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.54100000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88600000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94399999999999995,"5min":1.123,"15min":1.123},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95999999999999996,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96099999999999997,"5min":1.329,"15min":1.329},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.80400000000000005},"min":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.871,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.85999999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.80200000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90500000000000003,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.624,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.98799999999999999,"5min":1.288,"15min":1.288},"last":0.77500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":460525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.48999999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.54900000000000004,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.53200000000000003,"15min":0.56499999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66300000000000003,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53900000000000003,"15min":0.55700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68000000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54900000000000004,"15min":0.57899999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.60299999999999998,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.55000000000000004,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67000000000000004,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.64800000000000002,"15min":0.69399999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68500000000000005,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.80000000000000004,"15min":0.82199999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.996,"5min":1.669,"15min":1.669},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.877,"5min":1.994,"15min":1.994},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79800000000000004,"15min":0.82499999999999996},"min":{"1min":0.52900000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.94999999999999996,"5min":2.036,"15min":2.036},"last":0.628},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.79300000000000004,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89700000000000002,"5min":1.26,"15min":1.26},"last":0.76600000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81299999999999994,"15min":0.83499999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.94999999999999996,"5min":1.321,"15min":1.321},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.82899999999999996,"15min":0.85599999999999998},"min":{"1min":0.58899999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.028,"5min":1.627,"15min":1.627},"last":0.77800000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83699999999999997,"15min":0.86699999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96499999999999997,"5min":2.073,"15min":2.073},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.84099999999999997,"15min":0.871},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97099999999999997,"5min":1.323,"15min":1.323},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.56299999999999994,"15min":0.63300000000000001},"min":{"1min":0.27400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.72799999999999998,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.5,"15min":0.52900000000000003},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.376}]},{"osd":1,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":1.0169999999999999,"15min":1.27},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.60199999999999998,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.63700000000000001,"15min":0.70499999999999996},"min":{"1min":0.36499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.44}]},{"osd":2,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.56499999999999995,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70599999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.67000000000000004,"15min":0.72999999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.78900000000000003,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.872,"15min":0.93300000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0289999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.78900000000000003,"15min":0.81299999999999994},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91700000000000004,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80300000000000005,"15min":0.83299999999999996},"min":{"1min":0.56499999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0449999999999999,"5min":1.429,"15min":1.429},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.92800000000000005,"15min":1.0089999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.90400000000000003,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.91800000000000004,"15min":0.98899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95599999999999996,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.91100000000000003,"15min":0.98099999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94599999999999995,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.93000000000000005,"15min":0.99399999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0629999999999999,"5min":5,"15min":5},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96899999999999997,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.753}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1003520,"data_stored":460685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.39500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":1.161,"15min":1.161},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.48399999999999999,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.85299999999999998,"5min":1,"15min":1},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.876,"5min":1.022,"15min":1.022},"last":0.72999999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.54500000000000004,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.748,"15min":0.76000000000000001},"min":{"1min":0.52400000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89800000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.71999999999999997,"15min":0.69599999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96799999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:25:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.74199999999999999},"min":{"1min":0.59799999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93400000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.874},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79700000000000004,"15min":0.79600000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0029999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":459539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85899999999999999,"5min":1.105,"15min":1.105},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92800000000000005,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66900000000000004,"15min":0.64800000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91600000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.68600000000000005},"min":{"1min":0.51200000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0720000000000001,"5min":1.097,"15min":1.097},"last":0.628},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.96799999999999997,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.70399999999999996},"min":{"1min":0.56399999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.73599999999999999},"min":{"1min":0.54300000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89200000000000002,"5min":1.744,"15min":1.744},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76800000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.93200000000000005,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.53000000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.069,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.58399999999999996,"5min":0.443,"15min":0.443},"max":{"1min":0.99099999999999999,"5min":1.663,"15min":1.663},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:25:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83699999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.129,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.82799999999999996,"15min":0.81599999999999995},"min":{"1min":0.55400000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.75800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:26:18.122 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:26:18.123 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:26:18.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.364+0000 7fd1031ff700 1 Processor -- start 2023-08-27T11:26:18.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.364+0000 7fd1031ff700 1 -- start start 2023-08-27T11:26:18.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd1031ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd0fc151d20 0x7fd0fc06a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd1031ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd0fc0c92e0 0x7fd0fc0c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd1031ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0ac7e0 con 0x7fd0fc0c9750 2023-08-27T11:26:18.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd1031ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c86a0 con 0x7fd0fc151d20 2023-08-27T11:26:18.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd1031ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc155030 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd0fc151d20 0x7fd0fc06a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd0fc151d20 0x7fd0fc06a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57048/0 (socket says 172.21.15.43:57048) 2023-08-27T11:26:18.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 -- 172.21.15.43:0/4063444178 learned_addr learned my addr 172.21.15.43:0/4063444178 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:18.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd0fbfff700 1 --2- 172.21.15.43:0/4063444178 >> v2:172.21.15.57:3300/0 conn(0x7fd0fc0c92e0 0x7fd0fc0c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 -- 172.21.15.43:0/4063444178 >> v2:172.21.15.57:3300/0 conn(0x7fd0fc0c92e0 msgr2=0x7fd0fc0c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:18.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 --2- 172.21.15.43:0/4063444178 >> v2:172.21.15.57:3300/0 conn(0x7fd0fc0c92e0 0x7fd0fc0c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 -- 172.21.15.43:0/4063444178 >> v1:172.21.15.57:6789/0 conn(0x7fd0fc0c9750 legacy=0x7fd0fc0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:18.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.365+0000 7fd100f9b700 1 -- 172.21.15.43:0/4063444178 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc155220 con 0x7fd0fc151d20 2023-08-27T11:26:18.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.366+0000 7fd100f9b700 1 --2- 172.21.15.43:0/4063444178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc151d20 0x7fd0fc06a790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06c7e0 tx=0x7fd0f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957796f866d53231 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.366+0000 7fd0fb7fe700 1 -- 172.21.15.43:0/4063444178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0004230 con 0x7fd0fc151d20 2023-08-27T11:26:18.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.366+0000 7fd0fb7fe700 1 -- 172.21.15.43:0/4063444178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0004390 con 0x7fd0fc151d20 2023-08-27T11:26:18.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.366+0000 7fd0fb7fe700 1 -- 172.21.15.43:0/4063444178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00036a0 con 0x7fd0fc151d20 2023-08-27T11:26:18.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 -- 172.21.15.43:0/4063444178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc151d20 msgr2=0x7fd0fc06a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 --2- 172.21.15.43:0/4063444178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc151d20 0x7fd0fc06a790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06c7e0 tx=0x7fd0f0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 -- 172.21.15.43:0/4063444178 shutdown_connections 2023-08-27T11:26:18.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 --2- 172.21.15.43:0/4063444178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc151d20 0x7fd0fc06a790 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 --2- 172.21.15.43:0/4063444178 >> v2:172.21.15.57:3300/0 conn(0x7fd0fc0c92e0 0x7fd0fc0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 -- 172.21.15.43:0/4063444178 >> 172.21.15.43:0/4063444178 conn(0x7fd0fc0ab880 msgr2=0x7fd0fc0abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:18.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 -- 172.21.15.43:0/4063444178 shutdown_connections 2023-08-27T11:26:18.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.367+0000 7fd1031ff700 1 -- 172.21.15.43:0/4063444178 wait complete. 2023-08-27T11:26:18.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.368+0000 7fd1031ff700 1 Processor -- start 2023-08-27T11:26:18.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 -- start start 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 0x7fd0fc1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 0x7fd0fc148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c2410 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c2c90 con 0x7fd0fc0c9750 2023-08-27T11:26:18.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.369+0000 7fd1031ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc153d80 con 0x7fd0fc151d20 2023-08-27T11:26:18.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57064/0 (socket says 172.21.15.43:57064) 2023-08-27T11:26:18.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 -- 172.21.15.43:0/2302974309 learned_addr learned my addr 172.21.15.43:0/2302974309 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:18.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd10179c700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 0x7fd0fc148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd0fbfff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 0x7fd0fc1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 -- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 msgr2=0x7fd0fc148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 0x7fd0fc148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 -- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 msgr2=0x7fd0fc1483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 0x7fd0fc1483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 -- 172.21.15.43:0/2302974309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f0009550 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd10179c700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 0x7fd0fc148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:18.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd0fbfff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 0x7fd0fc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:18.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.370+0000 7fd100f9b700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc068880 tx=0x7fd0f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.371+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011630 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.371+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0011790 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.371+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011b40 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.371+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc1ed8d0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.371+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc0c2030 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.372+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc148eb0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.373+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0f0011ca0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.374+0000 7fd0f97fa700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 0x7fd0e006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.374+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0f0089b20 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.375+0000 7fd0fbfff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 0x7fd0e006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.375+0000 7fd0fbfff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 0x7fd0e006c5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0c3ed0 tx=0x7fd0e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.379+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0f00552b0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.668+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd0fc0c8ab0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.672+0000 7fd0f97fa700 1 -- 172.21.15.43:0/2302974309 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd0f001f0e0 con 0x7fd0fc0c92e0 2023-08-27T11:26:18.674 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:26:18.674 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:26:18.674 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:26:18.674 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:26:18.675 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:26:18.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 msgr2=0x7fd0e006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 0x7fd0e006c5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0c3ed0 tx=0x7fd0e8008040 comp rx=0 tx=0).stop 2023-08-27T11:26:18.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 msgr2=0x7fd0fc0aaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc068880 tx=0x7fd0f0004750 comp rx=0 tx=0).stop 2023-08-27T11:26:18.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 shutdown_connections 2023-08-27T11:26:18.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e006a110 0x7fd0e006c5d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0fc151d20 0x7fd0fc148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0fc0c92e0 0x7fd0fc0aaea0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 --2- 172.21.15.43:0/2302974309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd0fc0c9750 0x7fd0fc1483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 >> 172.21.15.43:0/2302974309 conn(0x7fd0fc0ab880 msgr2=0x7fd0fc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:18.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 shutdown_connections 2023-08-27T11:26:18.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.674+0000 7fd1031ff700 1 -- 172.21.15.43:0/2302974309 wait complete. 2023-08-27T11:26:18.678 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:26:18.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:18.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.894+0000 7fb8ea5ff700 1 Processor -- start 2023-08-27T11:26:18.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.894+0000 7fb8ea5ff700 1 -- start start 2023-08-27T11:26:18.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.895+0000 7fb8ea5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4151a90 0x7fb8e40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.895+0000 7fb8ea5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.895+0000 7fb8ea5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e406c4e0 con 0x7fb8e40c4630 2023-08-27T11:26:18.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.895+0000 7fb8ea5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e4155370 con 0x7fb8e4151a90 2023-08-27T11:26:18.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.895+0000 7fb8ea5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4151e70 con 0x7fb8e40c4a90 2023-08-27T11:26:18.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4151a90 0x7fb8e40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e8b9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4151a90 0x7fb8e40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:42092/0 (socket says 172.21.15.43:42092) 2023-08-27T11:26:18.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 -- 172.21.15.43:0/1500818855 learned_addr learned my addr 172.21.15.43:0/1500818855 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:18.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 -- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 msgr2=0x7fb8e406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:18.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 --2- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 -- 172.21.15.43:0/1500818855 >> v1:172.21.15.57:6789/0 conn(0x7fb8e40c4630 legacy=0x7fb8e406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e3fff700 1 -- 172.21.15.43:0/1500818855 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4154480 con 0x7fb8e4151a90 2023-08-27T11:26:18.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.896+0000 7fb8e2ffd700 1 -- 172.21.15.43:0/1500818855 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597466277 0 0) 0x7fb8e406c4e0 con 0x7fb8e40c4630 2023-08-27T11:26:18.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8e3fff700 1 --2- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40c7bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098f0 tx=0x7fb8d4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594b5e25e0f80b2d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8e2ffd700 1 -- 172.21.15.43:0/1500818855 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4011830 con 0x7fb8e4151a90 2023-08-27T11:26:18.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8e2ffd700 1 -- 172.21.15.43:0/1500818855 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4011990 con 0x7fb8e4151a90 2023-08-27T11:26:18.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8e2ffd700 1 -- 172.21.15.43:0/1500818855 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4011d20 con 0x7fb8e4151a90 2023-08-27T11:26:18.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 msgr2=0x7fb8e40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.897+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40c7bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb8d40098f0 tx=0x7fb8d4009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:18.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/1500818855 shutdown_connections 2023-08-27T11:26:18.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/1500818855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40c7bb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/1500818855 >> 172.21.15.43:0/1500818855 conn(0x7fb8e40ab820 msgr2=0x7fb8e40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:18.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/1500818855 shutdown_connections 2023-08-27T11:26:18.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.898+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/1500818855 wait complete. 2023-08-27T11:26:18.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.899+0000 7fb8ea5ff700 1 Processor -- start 2023-08-27T11:26:18.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.900+0000 7fb8ea5ff700 1 -- start start 2023-08-27T11:26:18.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40be140 con 0x7fb8e40c4630 2023-08-27T11:26:18.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40be990 con 0x7fb8e4151a90 2023-08-27T11:26:18.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8ea5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4152280 con 0x7fb8e40c4a90 2023-08-27T11:26:18.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56318/0 (socket says 172.21.15.43:56318) 2023-08-27T11:26:18.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 -- 172.21.15.43:0/331949484 learned_addr learned my addr 172.21.15.43:0/331949484 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:18.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e37fe700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e8b9c700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 -- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 msgr2=0x7fb8e4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 -- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 msgr2=0x7fb8e40bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:18.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40bbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:18.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e3fff700 1 -- 172.21.15.43:0/331949484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009550 con 0x7fb8e40c4630 2023-08-27T11:26:18.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.901+0000 7fb8e37fe700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:18.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8e3fff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009c40 tx=0x7fb8d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40036a0 con 0x7fb8e40c4630 2023-08-27T11:26:18.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d401e070 con 0x7fb8e40c4630 2023-08-27T11:26:18.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e4152560 con 0x7fb8e40c4630 2023-08-27T11:26:18.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4003a20 con 0x7fb8e40c4630 2023-08-27T11:26:18.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.902+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e41e9da0 con 0x7fb8e40c4630 2023-08-27T11:26:18.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.903+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e404ee70 con 0x7fb8e40c4630 2023-08-27T11:26:18.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.904+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8d4003b80 con 0x7fb8e40c4630 2023-08-27T11:26:18.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.905+0000 7fb8e0ff9700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:18.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.905+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8d4089540 con 0x7fb8e40c4630 2023-08-27T11:26:18.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.905+0000 7fb8e37fe700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:18.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.906+0000 7fb8e37fe700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4151190 tx=0x7fb8d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:18.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:18.909+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb8d4054c20 con 0x7fb8e40c4630 2023-08-27T11:26:19.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.170+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8e406c130 con 0x7fb8e40c4630 2023-08-27T11:26:19.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.170+0000 7fb8e0ff9700 1 -- 172.21.15.43:0/331949484 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fb8d4058240 con 0x7fb8e40c4630 2023-08-27T11:26:19.172 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:19.173 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:16.193725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6603},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6603":{"gid":6603,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6836/1292748157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1292748157},{"type":"v1","addr":"172.21.15.43:6836","nonce":1292748157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:19.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 msgr2=0x7fb8d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4151190 tx=0x7fb8d8009040 comp rx=0 tx=0).stop 2023-08-27T11:26:19.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 msgr2=0x7fb8e41e95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009c40 tx=0x7fb8d4004750 comp rx=0 tx=0).stop 2023-08-27T11:26:19.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 shutdown_connections 2023-08-27T11:26:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb8d006a0e0 0x7fb8d006c5a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4151a90 0x7fb8e40bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb8e40c4630 0x7fb8e41e95c0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 --2- 172.21.15.43:0/331949484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e40c4a90 0x7fb8e4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 >> 172.21.15.43:0/331949484 conn(0x7fb8e40ab820 msgr2=0x7fb8e414e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 shutdown_connections 2023-08-27T11:26:19.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.173+0000 7fb8ea5ff700 1 -- 172.21.15.43:0/331949484 wait complete. 2023-08-27T11:26:19.177 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 73 2023-08-27T11:26:19.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:16.193725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6603}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6603': {'gid': 6603, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.43:6836/1292748157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1292748157}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1292748157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:19.596 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:26:19.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-27T11:26:19.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.800+0000 7fc383dff700 1 Processor -- start 2023-08-27T11:26:19.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.800+0000 7fc383dff700 1 -- start start 2023-08-27T11:26:19.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.801+0000 7fc383dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c14e960 0x7fc37c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.801+0000 7fc383dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.801+0000 7fc383dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c154d00 con 0x7fc37c0c50d0 2023-08-27T11:26:19.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.801+0000 7fc383dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0baf30 con 0x7fc37c0a79c0 2023-08-27T11:26:19.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.801+0000 7fc383dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c154fe0 con 0x7fc37c14e960 2023-08-27T11:26:19.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56332/0 (socket says 172.21.15.43:56332) 2023-08-27T11:26:19.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 -- 172.21.15.43:0/1986948932 learned_addr learned my addr 172.21.15.43:0/1986948932 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc381b9b700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c14e960 0x7fc37c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 -- 172.21.15.43:0/1986948932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c14e960 msgr2=0x7fc37c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c14e960 0x7fc37c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 -- 172.21.15.43:0/1986948932 >> v1:172.21.15.57:6789/0 conn(0x7fc37c0c50d0 legacy=0x7fc37c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 -- 172.21.15.43:0/1986948932 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c1552c0 con 0x7fc37c0a79c0 2023-08-27T11:26:19.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.802+0000 7fc38139a700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098f0 tx=0x7fc36c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3c9e2c9a78232b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc380b99700 1 -- 172.21.15.43:0/1986948932 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c011830 con 0x7fc37c0a79c0 2023-08-27T11:26:19.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc380b99700 1 -- 172.21.15.43:0/1986948932 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c011990 con 0x7fc37c0a79c0 2023-08-27T11:26:19.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc380b99700 1 -- 172.21.15.43:0/1986948932 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c011d20 con 0x7fc37c0a79c0 2023-08-27T11:26:19.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 -- 172.21.15.43:0/1986948932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c0a79c0 msgr2=0x7fc37c0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0098f0 tx=0x7fc36c009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:19.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 -- 172.21.15.43:0/1986948932 shutdown_connections 2023-08-27T11:26:19.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c14e960 0x7fc37c0a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 --2- 172.21.15.43:0/1986948932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c0a79c0 0x7fc37c0c3cc0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 -- 172.21.15.43:0/1986948932 >> 172.21.15.43:0/1986948932 conn(0x7fc37c06aa50 msgr2=0x7fc37c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 -- 172.21.15.43:0/1986948932 shutdown_connections 2023-08-27T11:26:19.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.803+0000 7fc383dff700 1 -- 172.21.15.43:0/1986948932 wait complete. 2023-08-27T11:26:19.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.806+0000 7fc383dff700 1 Processor -- start 2023-08-27T11:26:19.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.806+0000 7fc383dff700 1 -- start start 2023-08-27T11:26:19.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c0a79c0 0x7fc37c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0c50d0 0x7fc37c0aa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0a87f0 con 0x7fc37c14e960 2023-08-27T11:26:19.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c1ebcc0 con 0x7fc37c0c50d0 2023-08-27T11:26:19.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc383dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0aa3f0 con 0x7fc37c0a79c0 2023-08-27T11:26:19.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.807+0000 7fc38239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56338/0 (socket says 172.21.15.43:56338) 2023-08-27T11:26:19.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 -- 172.21.15.43:0/3467879720 learned_addr learned my addr 172.21.15.43:0/3467879720 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c0a79c0 0x7fc37c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38139a700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0c50d0 0x7fc37c0aa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 -- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c0a79c0 msgr2=0x7fc37c14a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c0a79c0 0x7fc37c14a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 -- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0c50d0 msgr2=0x7fc37c0aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0c50d0 0x7fc37c0aa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 -- 172.21.15.43:0/3467879720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c009550 con 0x7fc37c14e960 2023-08-27T11:26:19.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc38239c700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc37400cc50 tx=0x7fc37400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.808+0000 7fc3727fc700 1 -- 172.21.15.43:0/3467879720 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374003c00 con 0x7fc37c14e960 2023-08-27T11:26:19.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.809+0000 7fc3727fc700 1 -- 172.21.15.43:0/3467879720 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374003d60 con 0x7fc37c14e960 2023-08-27T11:26:19.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.809+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c152eb0 con 0x7fc37c14e960 2023-08-27T11:26:19.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.809+0000 7fc3727fc700 1 -- 172.21.15.43:0/3467879720 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400aab0 con 0x7fc37c14e960 2023-08-27T11:26:19.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.809+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c0a8a40 con 0x7fc37c14e960 2023-08-27T11:26:19.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.811+0000 7fc3727fc700 1 -- 172.21.15.43:0/3467879720 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc37400ac10 con 0x7fc37c14e960 2023-08-27T11:26:19.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.812+0000 7fc3727fc700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 0x7fc36006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.812+0000 7fc3727fc700 1 -- 172.21.15.43:0/3467879720 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc374088510 con 0x7fc37c14e960 2023-08-27T11:26:19.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.812+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 0x7fc36006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.813+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 0x7fc36006c5a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0c6850 tx=0x7fc378009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.814+0000 7fc3976acb80 1 Processor -- start 2023-08-27T11:26:19.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.814+0000 7fc3976acb80 1 -- start start 2023-08-27T11:26:19.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5b9f00 0x558b2b5dcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b5f2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b517730 con 0x558b2b5bffe0 2023-08-27T11:26:19.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b515050 con 0x558b2b5b9f00 2023-08-27T11:26:19.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2b510940 con 0x558b2b5ba2e0 2023-08-27T11:26:19.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56354/0 (socket says 172.21.15.43:56354) 2023-08-27T11:26:19.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 -- 172.21.15.43:0/2801508882 learned_addr learned my addr 172.21.15.43:0/2801508882 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc381b9b700 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5b9f00 0x558b2b5dcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 -- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 msgr2=0x558b2b5f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b5f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 -- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5b9f00 msgr2=0x558b2b5dcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5b9f00 0x558b2b5dcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.815+0000 7fc38139a700 1 -- 172.21.15.43:0/2801508882 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2b3905e0 con 0x558b2b5bffe0 2023-08-27T11:26:19.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.816+0000 7fc38139a700 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009130 tx=0x7fc36c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd131f3810bcff0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.816+0000 7fc35f7fe700 1 -- 172.21.15.43:0/2801508882 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01f070 con 0x558b2b5bffe0 2023-08-27T11:26:19.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.816+0000 7fc35f7fe700 1 -- 172.21.15.43:0/2801508882 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c011b00 con 0x558b2b5bffe0 2023-08-27T11:26:19.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.816+0000 7fc35f7fe700 1 -- 172.21.15.43:0/2801508882 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c004040 con 0x558b2b5bffe0 2023-08-27T11:26:19.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 -- 172.21.15.43:0/2801508882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 msgr2=0x558b2b5dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009130 tx=0x7fc36c010000 comp rx=0 tx=0).stop 2023-08-27T11:26:19.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 -- 172.21.15.43:0/2801508882 shutdown_connections 2023-08-27T11:26:19.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b5f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5b9f00 0x558b2b5dcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 --2- 172.21.15.43:0/2801508882 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5bffe0 0x558b2b5dd2b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 -- 172.21.15.43:0/2801508882 >> 172.21.15.43:0/2801508882 conn(0x558b2b51cc30 msgr2=0x558b2b5bc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 -- 172.21.15.43:0/2801508882 shutdown_connections 2023-08-27T11:26:19.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.817+0000 7fc3976acb80 1 -- 172.21.15.43:0/2801508882 wait complete. 2023-08-27T11:26:19.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.818+0000 7fc3976acb80 1 -- start start 2023-08-27T11:26:19.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.818+0000 7fc3976acb80 1 Processor -- start 2023-08-27T11:26:19.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.819+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5b9f00 0x558b2b5dbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b60cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b4aeb60 con 0x558b2b5d2c80 2023-08-27T11:26:19.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b4ae860 con 0x558b2b5ba2e0 2023-08-27T11:26:19.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2b3928d0 con 0x558b2b5b9f00 2023-08-27T11:26:19.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc3976acb80 10 client.0 _ll_register_callbacks cb 0x558b2b4ac630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:19.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56370/0 (socket says 172.21.15.43:56370) 2023-08-27T11:26:19.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 -- 172.21.15.43:0/320063876 learned_addr learned my addr 172.21.15.43:0/320063876 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38139a700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b60cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc381b9b700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5b9f00 0x558b2b5dbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 -- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5b9f00 msgr2=0x558b2b5dbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5b9f00 0x558b2b5dbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 -- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 msgr2=0x558b2b60cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b60cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.820+0000 7fc38239c700 1 -- 172.21.15.43:0/320063876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c1552c0 con 0x558b2b5d2c80 2023-08-27T11:26:19.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc38239c700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc37405f090 tx=0x7fc374058030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc00936e639f9b99 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:19.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374056fa0 con 0x558b2b5d2c80 2023-08-27T11:26:19.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3740880c0 con 0x558b2b5d2c80 2023-08-27T11:26:19.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b2b5b14f0 con 0x558b2b5d2c80 2023-08-27T11:26:19.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc374088280 con 0x558b2b5d2c80 2023-08-27T11:26:19.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 10 client.6747 fetch_fsmap learned FSMap version 73 2023-08-27T11:26:19.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x558b2b528750 con 0x558b2b5d2c80 2023-08-27T11:26:19.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc374072080 con 0x558b2b5d2c80 2023-08-27T11:26:19.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc37405f130 con 0x558b2b5d2c80 2023-08-27T11:26:19.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 10 client.6747 fetch_fsmap finished waiting for FSMap version 73 2023-08-27T11:26:19.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 10 client.6747 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:26:19.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 20 client.6747 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:19.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b60d740 0x558b2b60db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 4 client.6747 mds_command: new command op to 6603 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:26:19.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.821+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 --> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b2b509920 con 0x558b2b60d740 2023-08-27T11:26:19.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.822+0000 7fc381b9b700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b60d740 0x558b2b60db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.822+0000 7fc381b9b700 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b60d740 0x558b2b60db20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f9e52a6682bcfe server_cookie=fbc139c1266c8acf in_seq=0 out_seq=0 2023-08-27T11:26:19.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.822+0000 7fc35cff9700 10 client.6747 ms_handle_connect on v2:172.21.15.43:6834/1292748157 2023-08-27T11:26:19.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc35cff9700 1 -- 172.21.15.43:0/320063876 <== mds.0 v2:172.21.15.43:6834/1292748157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b2b509920 con 0x558b2b60d740 2023-08-27T11:26:19.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc35cff9700 10 client.6747 handle_command_reply: tid=0 2023-08-27T11:26:19.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 client.6747 shutdown 2023-08-27T11:26:19.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 msgr2=0x558b2b5d43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc37405f090 tx=0x7fc374058030 comp rx=0 tx=0).stop 2023-08-27T11:26:19.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 shutdown_connections 2023-08-27T11:26:19.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b60d740 0x558b2b60db20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5d2c80 0x558b2b5d43a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5b9f00 0x558b2b5dbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc35cff9700 0 client.6747 ms_handle_reset on v2:172.21.15.43:6834/1292748157 2023-08-27T11:26:19.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 --2- 172.21.15.43:0/320063876 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b60cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 >> 172.21.15.43:0/320063876 conn(0x558b2b51cc30 msgr2=0x558b2b5be160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 shutdown_connections 2023-08-27T11:26:19.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.823+0000 7fc3976acb80 1 -- 172.21.15.43:0/320063876 wait complete. 2023-08-27T11:26:19.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.824+0000 7fc3976acb80 20 client.6747 trim_cache size 0 max 16384 2023-08-27T11:26:19.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.842+0000 7fc3976acb80 1 Processor -- start 2023-08-27T11:26:19.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.842+0000 7fc3976acb80 1 -- start start 2023-08-27T11:26:19.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b614280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 0x558b2b60bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b59b560 con 0x558b2b5b9f00 2023-08-27T11:26:19.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b528750 con 0x558b2b5d2c80 2023-08-27T11:26:19.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2b5bc030 con 0x558b2b5ba2e0 2023-08-27T11:26:19.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc381b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc381b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56386/0 (socket says 172.21.15.43:56386) 2023-08-27T11:26:19.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc381b9b700 1 -- 172.21.15.43:0/3514916462 learned_addr learned my addr 172.21.15.43:0/3514916462 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc38239c700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 0x558b2b60bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.843+0000 7fc381b9b700 1 -- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 msgr2=0x558b2b614280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc38139a700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b614280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b614280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc381b9b700 1 -- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 msgr2=0x558b2b60bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 0x558b2b60bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc381b9b700 1 -- 172.21.15.43:0/3514916462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b2b33cd90 con 0x558b2b5b9f00 2023-08-27T11:26:19.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc38239c700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 0x558b2b60bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:19.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc38139a700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b614280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:19.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc378011f70 tx=0x7fc378018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc63c2400166f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc35ffff700 1 -- 172.21.15.43:0/3514916462 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378025070 con 0x558b2b5b9f00 2023-08-27T11:26:19.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc35ffff700 1 -- 172.21.15.43:0/3514916462 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378026040 con 0x558b2b5b9f00 2023-08-27T11:26:19.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.844+0000 7fc35ffff700 1 -- 172.21.15.43:0/3514916462 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37802cb80 con 0x558b2b5b9f00 2023-08-27T11:26:19.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 -- 172.21.15.43:0/3514916462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 msgr2=0x558b2b613d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc378011f70 tx=0x7fc378018000 comp rx=0 tx=0).stop 2023-08-27T11:26:19.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 -- 172.21.15.43:0/3514916462 shutdown_connections 2023-08-27T11:26:19.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5d2c80 0x558b2b60bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b613d40 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3514916462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5ba2e0 0x558b2b614280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 -- 172.21.15.43:0/3514916462 >> 172.21.15.43:0/3514916462 conn(0x558b2b51cc30 msgr2=0x558b2b5dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 -- 172.21.15.43:0/3514916462 shutdown_connections 2023-08-27T11:26:19.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.845+0000 7fc3976acb80 1 -- 172.21.15.43:0/3514916462 wait complete. 2023-08-27T11:26:19.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.846+0000 7fc3976acb80 1 -- start start 2023-08-27T11:26:19.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.846+0000 7fc3976acb80 1 Processor -- start 2023-08-27T11:26:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b656740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5d2c80 0x558b2b651840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b665b60 con 0x558b2b5b9f00 2023-08-27T11:26:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b2b657230 con 0x558b2b5ba2e0 2023-08-27T11:26:19.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b2b6595f0 con 0x558b2b5d2c80 2023-08-27T11:26:19.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc3976acb80 10 client.0 _ll_register_callbacks cb 0x558b2b4ac630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:19.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc38139a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b656740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56388/0 (socket says 172.21.15.43:56388) 2023-08-27T11:26:19.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 -- 172.21.15.43:0/3058137915 learned_addr learned my addr 172.21.15.43:0/3058137915 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:19.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc38239c700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5d2c80 0x558b2b651840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 -- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5d2c80 msgr2=0x558b2b651840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5d2c80 0x558b2b651840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 -- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 msgr2=0x558b2b656740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:19.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.847+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b656740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc381b9b700 1 -- 172.21.15.43:0/3058137915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc378011ca0 con 0x558b2b5b9f00 2023-08-27T11:26:19.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc381b9b700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc378009740 tx=0x7fc3780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a841f66a64877e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:19.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc35cff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:19.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378025030 con 0x558b2b5b9f00 2023-08-27T11:26:19.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc36c011b00 con 0x558b2b5b9f00 2023-08-27T11:26:19.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc37802cd90 con 0x558b2b5b9f00 2023-08-27T11:26:19.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc37802c030 con 0x558b2b5b9f00 2023-08-27T11:26:19.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc3976acb80 10 client.6753 fetch_fsmap learned FSMap version 73 2023-08-27T11:26:19.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.848+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x558b2b325c10 con 0x558b2b5b9f00 2023-08-27T11:26:19.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c011b00 con 0x558b2b5b9f00 2023-08-27T11:26:19.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 73) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc378034040 con 0x558b2b5b9f00 2023-08-27T11:26:19.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 10 client.6753 fetch_fsmap finished waiting for FSMap version 73 2023-08-27T11:26:19.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 10 client.6753 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:26:19.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 20 client.6753 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:19.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b651d80 0x558b2b5b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:19.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 4 client.6753 mds_command: new command op to 6603 tid=0[{"prefix": "status"}] 2023-08-27T11:26:19.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 --> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558b2b4ca000 con 0x558b2b651d80 2023-08-27T11:26:19.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc38139a700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b651d80 0x558b2b5b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:19.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc38139a700 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b651d80 0x558b2b5b7b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2945dc96af0bf2 server_cookie=a516db37eacb7b12 in_seq=0 out_seq=0 2023-08-27T11:26:19.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.849+0000 7fc35cff9700 10 client.6753 ms_handle_connect on v2:172.21.15.43:6834/1292748157 2023-08-27T11:26:19.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc35cff9700 1 -- 172.21.15.43:0/3058137915 <== mds.0 v2:172.21.15.43:6834/1292748157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558b2b4ca000 con 0x558b2b651d80 2023-08-27T11:26:19.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc35cff9700 10 client.6753 handle_command_reply: tid=0 2023-08-27T11:26:19.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 client.6753 shutdown 2023-08-27T11:26:19.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 msgr2=0x558b2b60c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc378009740 tx=0x7fc3780047c0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 shutdown_connections 2023-08-27T11:26:19.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558b2b5d2c80 0x558b2b651840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:6834/1292748157,v1:172.21.15.43:6836/1292748157] conn(0x558b2b651d80 0x558b2b5b7b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558b2b5b9f00 0x558b2b60c540 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 --2- 172.21.15.43:0/3058137915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558b2b5ba2e0 0x558b2b656740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc35cff9700 0 client.6753 ms_handle_reset on v2:172.21.15.43:6834/1292748157 2023-08-27T11:26:19.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 >> 172.21.15.43:0/3058137915 conn(0x558b2b51cc30 msgr2=0x558b2b5dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 shutdown_connections 2023-08-27T11:26:19.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 1 -- 172.21.15.43:0/3058137915 wait complete. 2023-08-27T11:26:19.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.850+0000 7fc3976acb80 20 client.6753 trim_cache size 0 max 16384 2023-08-27T11:26:19.884 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:19.884 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:26:19.885 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:26:19.885 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6603, 2023-08-27T11:26:19.885 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:26:19.885 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.6792047669999999, 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 73, 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 81, 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 81, 2023-08-27T11:26:19.886 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.923869052000001 2023-08-27T11:26:19.887 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:19.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 msgr2=0x7fc36006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 0x7fc36006c5a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0c6850 tx=0x7fc378009210 comp rx=0 tx=0).stop 2023-08-27T11:26:19.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 msgr2=0x7fc37c0aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:19.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc37400cc50 tx=0x7fc37400cf60 comp rx=0 tx=0).stop 2023-08-27T11:26:19.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 shutdown_connections 2023-08-27T11:26:19.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc36006a0e0 0x7fc36006c5a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc37c14e960 0x7fc37c0aadc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc37c0a79c0 0x7fc37c14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 --2- 172.21.15.43:0/3467879720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc37c0c50d0 0x7fc37c0aa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:19.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 >> 172.21.15.43:0/3467879720 conn(0x7fc37c06aa50 msgr2=0x7fc37c1524d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:19.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 shutdown_connections 2023-08-27T11:26:19.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:19.851+0000 7fc383dff700 1 -- 172.21.15.43:0/3467879720 wait complete. 2023-08-27T11:26:19.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:20.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.091+0000 7f91439ff700 1 Processor -- start 2023-08-27T11:26:20.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.091+0000 7f91439ff700 1 -- start start 2023-08-27T11:26:20.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.092+0000 7f91439ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f913c151a90 0x7f913c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f91439ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f913c0c4a90 0x7f913c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f91439ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c06c4e0 con 0x7f913c0c4630 2023-08-27T11:26:20.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f91439ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c155370 con 0x7f913c0c4a90 2023-08-27T11:26:20.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f91439ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c151e70 con 0x7f913c151a90 2023-08-27T11:26:20.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f913c0c4a90 0x7f913c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f913c0c4a90 0x7f913c06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56390/0 (socket says 172.21.15.43:56390) 2023-08-27T11:26:20.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 -- 172.21.15.43:0/1607810950 learned_addr learned my addr 172.21.15.43:0/1607810950 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:20.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f914179b700 1 --2- 172.21.15.43:0/1607810950 >> v2:172.21.15.57:3300/0 conn(0x7f913c151a90 0x7f913c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 -- 172.21.15.43:0/1607810950 >> v2:172.21.15.57:3300/0 conn(0x7f913c151a90 msgr2=0x7f913c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:20.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 --2- 172.21.15.43:0/1607810950 >> v2:172.21.15.57:3300/0 conn(0x7f913c151a90 0x7f913c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 -- 172.21.15.43:0/1607810950 >> v1:172.21.15.57:6789/0 conn(0x7f913c0c4630 legacy=0x7f913c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:20.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.093+0000 7f9141f9c700 1 -- 172.21.15.43:0/1607810950 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c154480 con 0x7f913c0c4a90 2023-08-27T11:26:20.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f9141f9c700 1 --2- 172.21.15.43:0/1607810950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c0c4a90 0x7f913c06b480 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f913c067710 tx=0x7f913400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8823e308b78f5125 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f9133fff700 1 -- 172.21.15.43:0/1607810950 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400e070 con 0x7f913c0c4a90 2023-08-27T11:26:20.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f9133fff700 1 -- 172.21.15.43:0/1607810950 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134003a20 con 0x7f913c0c4a90 2023-08-27T11:26:20.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f9133fff700 1 -- 172.21.15.43:0/1607810950 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134003dd0 con 0x7f913c0c4a90 2023-08-27T11:26:20.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f91439ff700 1 -- 172.21.15.43:0/1607810950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c0c4a90 msgr2=0x7f913c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.094+0000 7f91439ff700 1 --2- 172.21.15.43:0/1607810950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c0c4a90 0x7f913c06b480 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f913c067710 tx=0x7f913400b330 comp rx=0 tx=0).stop 2023-08-27T11:26:20.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 -- 172.21.15.43:0/1607810950 shutdown_connections 2023-08-27T11:26:20.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 --2- 172.21.15.43:0/1607810950 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c0c4a90 0x7f913c06b480 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 --2- 172.21.15.43:0/1607810950 >> v2:172.21.15.57:3300/0 conn(0x7f913c151a90 0x7f913c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 -- 172.21.15.43:0/1607810950 >> 172.21.15.43:0/1607810950 conn(0x7f913c0ab820 msgr2=0x7f913c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:20.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 -- 172.21.15.43:0/1607810950 shutdown_connections 2023-08-27T11:26:20.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.095+0000 7f91439ff700 1 -- 172.21.15.43:0/1607810950 wait complete. 2023-08-27T11:26:20.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.096+0000 7f91439ff700 1 Processor -- start 2023-08-27T11:26:20.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.096+0000 7f91439ff700 1 -- start start 2023-08-27T11:26:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f913c0c4630 0x7f913c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f913c0c4a90 0x7f913c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c152390 con 0x7f913c151a90 2023-08-27T11:26:20.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1e7640 con 0x7f913c0c4a90 2023-08-27T11:26:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.097+0000 7f91439ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1eddc0 con 0x7f913c0c4630 2023-08-27T11:26:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56402/0 (socket says 172.21.15.43:56402) 2023-08-27T11:26:20.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 -- 172.21.15.43:0/1270867763 learned_addr learned my addr 172.21.15.43:0/1270867763 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:20.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f914179b700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f913c0c4630 0x7f913c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9140f9a700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f913c0c4a90 0x7f913c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 -- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f913c0c4630 msgr2=0x7f913c0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f913c0c4630 0x7f913c0aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 -- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f913c0c4a90 msgr2=0x7f913c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f913c0c4a90 0x7f913c152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 -- 172.21.15.43:0/1270867763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9134009b30 con 0x7f913c151a90 2023-08-27T11:26:20.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.098+0000 7f9141f9c700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f913400b370 tx=0x7f9134004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.099+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134004440 con 0x7f913c151a90 2023-08-27T11:26:20.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.099+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91340045a0 con 0x7f913c151a90 2023-08-27T11:26:20.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.099+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134004950 con 0x7f913c151a90 2023-08-27T11:26:20.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.099+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c153ba0 con 0x7f913c151a90 2023-08-27T11:26:20.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.099+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c154160 con 0x7f913c151a90 2023-08-27T11:26:20.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.100+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c04ee70 con 0x7f913c151a90 2023-08-27T11:26:20.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.101+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9134019030 con 0x7f913c151a90 2023-08-27T11:26:20.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.102+0000 7f9131ffb700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 0x7f912006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.102+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9134089610 con 0x7f913c151a90 2023-08-27T11:26:20.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.102+0000 7f914179b700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 0x7f912006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.103+0000 7f914179b700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 0x7f912006c5a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9138006b20 tx=0x7f9138008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.106+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9134054d90 con 0x7f913c151a90 2023-08-27T11:26:20.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.366+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f913c06c130 con 0x7f913c151a90 2023-08-27T11:26:20.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.367+0000 7f9131ffb700 1 -- 172.21.15.43:0/1270867763 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4874 (secure 0 0 0) 0x7f91340583b0 con 0x7f913c151a90 2023-08-27T11:26:20.369 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:20.369 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:16.193725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6603},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6603":{"gid":6603,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6836/1292748157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1292748157},{"type":"v1","addr":"172.21.15.43:6836","nonce":1292748157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:20.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 msgr2=0x7f912006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 0x7f912006c5a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9138006b20 tx=0x7f9138008040 comp rx=0 tx=0).stop 2023-08-27T11:26:20.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 msgr2=0x7f913c152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f913400b370 tx=0x7f9134004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 shutdown_connections 2023-08-27T11:26:20.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f912006a0e0 0x7f912006c5a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f913c151a90 0x7f913c152cd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f913c0c4630 0x7f913c0aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 --2- 172.21.15.43:0/1270867763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f913c0c4a90 0x7f913c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 >> 172.21.15.43:0/1270867763 conn(0x7f913c0ab820 msgr2=0x7f913c14dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:20.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 shutdown_connections 2023-08-27T11:26:20.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.369+0000 7f91439ff700 1 -- 172.21.15.43:0/1270867763 wait complete. 2023-08-27T11:26:20.374 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 73 2023-08-27T11:26:20.389 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 6, "epoch": 73, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 6, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:12.678531+0000", "damaged": [], "data_pools": [ 14 ], "enabled": true, "epoch": 73, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6603": { "addr": "172.21.15.43:6836/1292748157", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1292748157, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 1292748157, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6603, "incarnation": 69, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 5 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 13, "modified": "2023-08-27T11:26:16.193725+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6603 } } } ], "standbys": [ { "addr": "172.21.15.43:6837/3998632195", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 3998632195, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 3998632195, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 67, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6322, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6833/1640307202", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 1640307202, "type": "v2" }, { "addr": "172.21.15.57:6833", "nonce": 1640307202, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 67, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6328, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/432356370", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6834", "nonce": 432356370, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 432356370, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 68, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6334, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:26:20.392 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:26:20.392 INFO:tasks.cephfs.test_failover:current = [{'gid': 6603, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.43:6836/1292748157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1292748157}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1292748157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6334, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/432356370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 432356370}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 432356370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 68}, {'gid': 6322, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 67}, {'gid': 6328, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6833/1640307202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1640307202}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1640307202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 67}] 2023-08-27T11:26:20.393 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.c mds_join_fs cephfs 2023-08-27T11:26:20.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.597+0000 7f80bd5ff700 1 Processor -- start 2023-08-27T11:26:20.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.597+0000 7f80bd5ff700 1 -- start start 2023-08-27T11:26:20.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80bd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80b80c9690 0x7f80b815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80bd5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b80c80c0 con 0x7f80b80ac410 2023-08-27T11:26:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80bd5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b81552c0 con 0x7f80b80c49f0 2023-08-27T11:26:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80bd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b81555a0 con 0x7f80b80c9690 2023-08-27T11:26:20.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80b67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f80b80ac410 0x7f80b80c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52278/0 (socket says 172.21.15.43:52278) 2023-08-27T11:26:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.598+0000 7f80b67fc700 1 -- 172.21.15.43:0/864720800 learned_addr learned my addr 172.21.15.43:0/864720800 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b77fe700 1 --2- 172.21.15.43:0/864720800 >> v2:172.21.15.57:3300/0 conn(0x7f80b80c9690 0x7f80b815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263295435 0 0) 0x7f80b80c80c0 con 0x7f80b80ac410 2023-08-27T11:26:20.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a00035b0 con 0x7f80b80ac410 2023-08-27T11:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79229665 0 0) 0x7f80b81552c0 con 0x7f80b80c49f0 2023-08-27T11:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b80c80c0 con 0x7f80b80c49f0 2023-08-27T11:26:20.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2133482794 0 0) 0x7f80a00035b0 con 0x7f80b80ac410 2023-08-27T11:26:20.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 >> v2:172.21.15.57:3300/0 conn(0x7f80b80c9690 msgr2=0x7f80b815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:20.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 --2- 172.21.15.43:0/864720800 >> v2:172.21.15.57:3300/0 conn(0x7f80b80c9690 0x7f80b815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 >> v1:172.21.15.57:6789/0 conn(0x7f80b80c49f0 legacy=0x7f80b8151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c8360 con 0x7f80b80ac410 2023-08-27T11:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f80ac001670 con 0x7f80b80ac410 2023-08-27T11:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 >> v1:172.21.15.43:6789/0 conn(0x7f80b80ac410 legacy=0x7f80b80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 0x7f80a0004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0004850 0x7f80a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80a0005320 0x7f80a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b81555a0 con 0x7f80a0005320 2023-08-27T11:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a000c230 con 0x7f80a0004850 2023-08-27T11:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a000c3f0 con 0x7f80a0003c00 2023-08-27T11:26:20.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.599+0000 7f80b77fe700 1 --2- 172.21.15.43:0/864720800 >> v2:172.21.15.57:3300/0 conn(0x7f80b80c9690 0x7f80b815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 0x7f80a0004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b67fc700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0004850 0x7f80a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b77fe700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80a0005320 0x7f80a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 -- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0004850 msgr2=0x7f80a0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:20.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0004850 0x7f80a0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 -- 172.21.15.43:0/864720800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80a0005320 msgr2=0x7f80a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:20.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80a0005320 0x7f80a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 -- 172.21.15.43:0/864720800 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00035b0 con 0x7f80a0003c00 2023-08-27T11:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b77fe700 1 -- 172.21.15.43:0/864720800 reap_dead start 2023-08-27T11:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.600+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 0x7f80a0004000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80a8001930 tx=0x7f80a0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3687841d1bc7c29d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80052d0 con 0x7f80a0003c00 2023-08-27T11:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8005430 con 0x7f80a0003c00 2023-08-27T11:26:20.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80b5ffb700 1 -- 172.21.15.43:0/864720800 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80038a0 con 0x7f80a0003c00 2023-08-27T11:26:20.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 -- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 msgr2=0x7f80a0004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 0x7f80a0004000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80a8001930 tx=0x7f80a0005880 comp rx=0 tx=0).stop 2023-08-27T11:26:20.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 -- 172.21.15.43:0/864720800 shutdown_connections 2023-08-27T11:26:20.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/864720800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a0003c00 0x7f80a0004000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 -- 172.21.15.43:0/864720800 >> 172.21.15.43:0/864720800 conn(0x7f80b80ab8f0 msgr2=0x7f80b80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 -- 172.21.15.43:0/864720800 shutdown_connections 2023-08-27T11:26:20.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.601+0000 7f80bd5ff700 1 -- 172.21.15.43:0/864720800 wait complete. 2023-08-27T11:26:20.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.604+0000 7f80bd5ff700 1 Processor -- start 2023-08-27T11:26:20.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.604+0000 7f80bd5ff700 1 -- start start 2023-08-27T11:26:20.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0003c00 0x7f80b8155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 0x7f80b806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80afcb0 con 0x7f80b8158170 2023-08-27T11:26:20.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8155e90 con 0x7f80a0003c00 2023-08-27T11:26:20.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80bd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80ad810 con 0x7f80b80ad310 2023-08-27T11:26:20.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.605+0000 7f80b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56426/0 (socket says 172.21.15.43:56426) 2023-08-27T11:26:20.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 -- 172.21.15.43:0/3014013988 learned_addr learned my addr 172.21.15.43:0/3014013988 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:20.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b67fc700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 0x7f80b806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0003c00 0x7f80b8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 -- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 msgr2=0x7f80b806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 0x7f80b806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 -- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0003c00 msgr2=0x7f80b8155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0003c00 0x7f80b8155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 -- 172.21.15.43:0/3014013988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80adaf0 con 0x7f80b8158170 2023-08-27T11:26:20.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b67fc700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 0x7f80b806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:20.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.606+0000 7f80b77fe700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f80b806cfa0 tx=0x7f80b000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.607+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000e040 con 0x7f80b8158170 2023-08-27T11:26:20.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.607+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000f040 con 0x7f80b8158170 2023-08-27T11:26:20.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.607+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0015430 con 0x7f80b8158170 2023-08-27T11:26:20.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.607+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b81e9560 con 0x7f80b8158170 2023-08-27T11:26:20.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.607+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80addd0 con 0x7f80b8158170 2023-08-27T11:26:20.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.608+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b81e93c0 con 0x7f80b8158170 2023-08-27T11:26:20.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.609+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80b0015590 con 0x7f80b8158170 2023-08-27T11:26:20.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.610+0000 7f809f7fe700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 0x7f80a406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:20.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.610+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80b0088ee0 con 0x7f80b8158170 2023-08-27T11:26:20.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.611+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 0x7f80a406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:20.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.611+0000 7f80b6ffd700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 0x7f80a406c5f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:20.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.615+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80b81e93c0 con 0x7f80b8158170 2023-08-27T11:26:20.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.826+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f80b81e93c0 con 0x7f80b8158170 2023-08-27T11:26:20.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.830+0000 7f809f7fe700 1 -- 172.21.15.43:0/3014013988 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v28)=0 v28) v1 ==== 116+0+0 (secure 0 0 0) 0x7f80b81e93c0 con 0x7f80b8158170 2023-08-27T11:26:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 msgr2=0x7f80a406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 0x7f80a406c5f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a8009030 comp rx=0 tx=0).stop 2023-08-27T11:26:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 msgr2=0x7f80b81e9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f80b806cfa0 tx=0x7f80b000f490 comp rx=0 tx=0).stop 2023-08-27T11:26:20.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 shutdown_connections 2023-08-27T11:26:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f80a406a130 0x7f80a406c5f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80b8158170 0x7f80b81e9d60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a0003c00 0x7f80b8155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 --2- 172.21.15.43:0/3014013988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80b80ad310 0x7f80b806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 >> 172.21.15.43:0/3014013988 conn(0x7f80b80ab8f0 msgr2=0x7f80b80aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 shutdown_connections 2023-08-27T11:26:20.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:20.833+0000 7f80bd5ff700 1 -- 172.21.15.43:0/3014013988 wait complete. 2023-08-27T11:26:20.852 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:21.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.056+0000 7f9a86bff700 1 Processor -- start 2023-08-27T11:26:21.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.056+0000 7f9a86bff700 1 -- start start 2023-08-27T11:26:21.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.057+0000 7f9a86bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a80151a90 0x7f9a800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.057+0000 7f9a86bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 0x7f9a800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a86bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8006c4e0 con 0x7f9a8006ad70 2023-08-27T11:26:21.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a86bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80155370 con 0x7f9a80151a90 2023-08-27T11:26:21.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a86bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80151e70 con 0x7f9a800c4630 2023-08-27T11:26:21.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a80151a90 0x7f9a800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9a80151a90 0x7f9a800c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56432/0 (socket says 172.21.15.43:56432) 2023-08-27T11:26:21.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 -- 172.21.15.43:0/2700039619 learned_addr learned my addr 172.21.15.43:0/2700039619 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:21.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8519c700 1 --1- 172.21.15.43:0/2700039619 >> v1:172.21.15.43:6789/0 conn(0x7f9a8006ad70 0x7f9a8006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52288/0 (socket says 172.21.15.43:52288) 2023-08-27T11:26:21.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 0x7f9a800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 -- 172.21.15.43:0/2700039619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 msgr2=0x7f9a800c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:21.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 0x7f9a800c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 -- 172.21.15.43:0/2700039619 >> v1:172.21.15.43:6789/0 conn(0x7f9a8006ad70 legacy=0x7f9a8006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a8499b700 1 -- 172.21.15.43:0/2700039619 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80154480 con 0x7f9a80151a90 2023-08-27T11:26:21.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 0x7f9a800c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:21.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.058+0000 7f9a7f7fe700 1 -- 172.21.15.43:0/2700039619 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992869421 0 0) 0x7f9a8006c4e0 con 0x7f9a8006ad70 2023-08-27T11:26:21.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a8499b700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a80151a90 0x7f9a800c7bb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098f0 tx=0x7f9a74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bf22d6ae197eb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a7f7fe700 1 -- 172.21.15.43:0/2700039619 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400b8a0 con 0x7f9a80151a90 2023-08-27T11:26:21.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a7f7fe700 1 -- 172.21.15.43:0/2700039619 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400ba00 con 0x7f9a80151a90 2023-08-27T11:26:21.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a7f7fe700 1 -- 172.21.15.43:0/2700039619 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400bd90 con 0x7f9a80151a90 2023-08-27T11:26:21.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a86bff700 1 -- 172.21.15.43:0/2700039619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a80151a90 msgr2=0x7f9a800c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a86bff700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a80151a90 0x7f9a800c7bb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098f0 tx=0x7f9a74009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:21.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.059+0000 7f9a86bff700 1 -- 172.21.15.43:0/2700039619 shutdown_connections 2023-08-27T11:26:21.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.060+0000 7f9a86bff700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a80151a90 0x7f9a800c7bb0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.060+0000 7f9a86bff700 1 --2- 172.21.15.43:0/2700039619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a800c4630 0x7f9a800c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.060+0000 7f9a86bff700 1 -- 172.21.15.43:0/2700039619 >> 172.21.15.43:0/2700039619 conn(0x7f9a800ab820 msgr2=0x7f9a800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.060+0000 7f9a86bff700 1 -- 172.21.15.43:0/2700039619 shutdown_connections 2023-08-27T11:26:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.060+0000 7f9a86bff700 1 -- 172.21.15.43:0/2700039619 wait complete. 2023-08-27T11:26:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.061+0000 7f9a86bff700 1 Processor -- start 2023-08-27T11:26:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.061+0000 7f9a86bff700 1 -- start start 2023-08-27T11:26:21.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 0x7f9a80152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 0x7f9a800bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800c1750 con 0x7f9a8006ad70 2023-08-27T11:26:21.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801524b0 con 0x7f9a800c4630 2023-08-27T11:26:21.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a86bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80154260 con 0x7f9a80151a90 2023-08-27T11:26:21.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a8499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a8499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56446/0 (socket says 172.21.15.43:56446) 2023-08-27T11:26:21.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.062+0000 7f9a8499b700 1 -- 172.21.15.43:0/400690163 learned_addr learned my addr 172.21.15.43:0/400690163 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:21.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 0x7f9a80152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8519c700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 0x7f9a800bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 -- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 msgr2=0x7f9a800bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 0x7f9a800bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 -- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 msgr2=0x7f9a80152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 0x7f9a80152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 -- 172.21.15.43:0/400690163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74009550 con 0x7f9a8006ad70 2023-08-27T11:26:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 0x7f9a80152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8519c700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 0x7f9a800bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a8499b700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009c40 tx=0x7f9a74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740036a0 con 0x7f9a8006ad70 2023-08-27T11:26:21.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7401e070 con 0x7f9a8006ad70 2023-08-27T11:26:21.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.063+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003a20 con 0x7f9a8006ad70 2023-08-27T11:26:21.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.064+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a80153ca0 con 0x7f9a8006ad70 2023-08-27T11:26:21.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.064+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a800c2560 con 0x7f9a8006ad70 2023-08-27T11:26:21.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.065+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80152280 con 0x7f9a8006ad70 2023-08-27T11:26:21.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.066+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a74003b80 con 0x7f9a8006ad70 2023-08-27T11:26:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.067+0000 7f9a7d7fa700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 0x7f9a6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.067+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a74020070 con 0x7f9a8006ad70 2023-08-27T11:26:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.067+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 0x7f9a6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.068+0000 7f9a7ffff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 0x7f9a6406c5a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9a8014a840 tx=0x7f9a6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.071+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9a740551a0 con 0x7f9a8006ad70 2023-08-27T11:26:21.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.327+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a80154730 con 0x7f9a8006ad70 2023-08-27T11:26:21.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.328+0000 7f9a7d7fa700 1 -- 172.21.15.43:0/400690163 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4874 (secure 0 0 0) 0x7f9a74015090 con 0x7f9a8006ad70 2023-08-27T11:26:21.330 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:21.330 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6322,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:16.193725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6603},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6603":{"gid":6603,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":5,"addr":"172.21.15.43:6836/1292748157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1292748157},{"type":"v1","addr":"172.21.15.43:6836","nonce":1292748157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:21.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 msgr2=0x7f9a6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 0x7f9a6406c5a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9a8014a840 tx=0x7f9a6c008040 comp rx=0 tx=0).stop 2023-08-27T11:26:21.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 msgr2=0x7f9a80152940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009c40 tx=0x7f9a74004750 comp rx=0 tx=0).stop 2023-08-27T11:26:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 shutdown_connections 2023-08-27T11:26:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9a6406a0e0 0x7f9a6406c5a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a80151a90 0x7f9a800bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9a8006ad70 0x7f9a80152940 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 --2- 172.21.15.43:0/400690163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a800c4630 0x7f9a80152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.330+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 >> 172.21.15.43:0/400690163 conn(0x7f9a800ab820 msgr2=0x7f9a8014d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:21.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.331+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 shutdown_connections 2023-08-27T11:26:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.331+0000 7f9a86bff700 1 -- 172.21.15.43:0/400690163 wait complete. 2023-08-27T11:26:21.335 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 73 2023-08-27T11:26:21.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:16.193725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6603}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6603': {'gid': 6603, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.43:6836/1292748157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1292748157}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1292748157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:21.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:26:21.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-27T11:26:21.937 INFO:tasks.ceph.mds.a.smithi043.stderr: -197> 2023-08-27T11:26:16.109+0000 7f2d3bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:26:21.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.969+0000 7f0f3bfff700 1 Processor -- start 2023-08-27T11:26:21.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.969+0000 7f0f3bfff700 1 -- start start 2023-08-27T11:26:21.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.971+0000 7f0f3bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0f340c4c40 0x7f0f340bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.971+0000 7f0f3bfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340c17f0 con 0x7f0f340c0390 2023-08-27T11:26:21.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.971+0000 7f0f3bfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340c0900 con 0x7f0f3414e0d0 2023-08-27T11:26:21.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.971+0000 7f0f3bfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340c21a0 con 0x7f0f340c4c40 2023-08-27T11:26:21.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3959a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0f340c4c40 0x7f0f340bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3a59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0f340c0390 0x7f0f340bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52304/0 (socket says 172.21.15.43:52304) 2023-08-27T11:26:21.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3a59c700 1 -- 172.21.15.43:0/2610904633 learned_addr learned my addr 172.21.15.43:0/2610904633 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f38d99700 1 -- 172.21.15.43:0/2610904633 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026307487 0 0) 0x7f0f340c17f0 con 0x7f0f340c0390 2023-08-27T11:26:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3959a700 1 -- 172.21.15.43:0/2610904633 >> v1:172.21.15.57:6789/0 conn(0x7f0f3414e0d0 legacy=0x7f0f340c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3959a700 1 -- 172.21.15.43:0/2610904633 >> v1:172.21.15.43:6789/0 conn(0x7f0f340c0390 legacy=0x7f0f340bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3959a700 1 -- 172.21.15.43:0/2610904633 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340c0be0 con 0x7f0f340c4c40 2023-08-27T11:26:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.972+0000 7f0f3959a700 1 --2- 172.21.15.43:0/2610904633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f340c4c40 0x7f0f340bb5c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe3f944007594ac server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f38d99700 1 -- 172.21.15.43:0/2610904633 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400f940 con 0x7f0f340c4c40 2023-08-27T11:26:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f38d99700 1 -- 172.21.15.43:0/2610904633 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2400faa0 con 0x7f0f340c4c40 2023-08-27T11:26:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f38d99700 1 -- 172.21.15.43:0/2610904633 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400fe30 con 0x7f0f340c4c40 2023-08-27T11:26:21.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f3bfff700 1 -- 172.21.15.43:0/2610904633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f340c4c40 msgr2=0x7f0f340bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f3bfff700 1 --2- 172.21.15.43:0/2610904633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f340c4c40 0x7f0f340bb5c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009840 tx=0x7f0f24009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f3bfff700 1 -- 172.21.15.43:0/2610904633 shutdown_connections 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f3bfff700 1 --2- 172.21.15.43:0/2610904633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f340c4c40 0x7f0f340bb5c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.973+0000 7f0f3bfff700 1 -- 172.21.15.43:0/2610904633 >> 172.21.15.43:0/2610904633 conn(0x7f0f3406aa50 msgr2=0x7f0f340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.974+0000 7f0f3bfff700 1 -- 172.21.15.43:0/2610904633 shutdown_connections 2023-08-27T11:26:21.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.974+0000 7f0f3bfff700 1 -- 172.21.15.43:0/2610904633 wait complete. 2023-08-27T11:26:21.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.975+0000 7f0f3bfff700 1 Processor -- start 2023-08-27T11:26:21.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.975+0000 7f0f3bfff700 1 -- start start 2023-08-27T11:26:21.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 0x7f0f34144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f340c4c40 0x7f0f340a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3414e0d0 0x7f0f340a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34148b80 con 0x7f0f3414e0d0 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340a4810 con 0x7f0f340c0390 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.976+0000 7f0f3bfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340a4ad0 con 0x7f0f340c4c40 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f39d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 0x7f0f34144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3414e0d0 0x7f0f340a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f39d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 0x7f0f34144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:42232/0 (socket says 172.21.15.43:42232) 2023-08-27T11:26:21.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f39d9b700 1 -- 172.21.15.43:0/368624198 learned_addr learned my addr 172.21.15.43:0/368624198 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:21.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3959a700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f340c4c40 0x7f0f340a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 -- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f340c4c40 msgr2=0x7f0f340a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f340c4c40 0x7f0f340a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 -- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 msgr2=0x7f0f34144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 0x7f0f34144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3a59c700 1 -- 172.21.15.43:0/368624198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240094a0 con 0x7f0f3414e0d0 2023-08-27T11:26:21.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f340c0390 0x7f0f34144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:21.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.977+0000 7f0f3959a700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f340c4c40 0x7f0f340a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:21.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f3414e0d0 0x7f0f340a6ff0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00cbe0 tx=0x7f0f2c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f2a7fc700 1 -- 172.21.15.43:0/368624198 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00aa40 con 0x7f0f3414e0d0 2023-08-27T11:26:21.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f2a7fc700 1 -- 172.21.15.43:0/368624198 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00abc0 con 0x7f0f3414e0d0 2023-08-27T11:26:21.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f3bfff700 1 -- 172.21.15.43:0/368624198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f34148410 con 0x7f0f3414e0d0 2023-08-27T11:26:21.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f2a7fc700 1 -- 172.21.15.43:0/368624198 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0070d0 con 0x7f0f3414e0d0 2023-08-27T11:26:21.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.978+0000 7f0f3bfff700 1 -- 172.21.15.43:0/368624198 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341452a0 con 0x7f0f3414e0d0 2023-08-27T11:26:21.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.980+0000 7f0f2a7fc700 1 -- 172.21.15.43:0/368624198 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f2c007230 con 0x7f0f3414e0d0 2023-08-27T11:26:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.982+0000 7f0f2a7fc700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f1806a0e0 0x7f0f1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.982+0000 7f0f2a7fc700 1 -- 172.21.15.43:0/368624198 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0f2c0882c0 con 0x7f0f3414e0d0 2023-08-27T11:26:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.982+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f1806a0e0 0x7f0f1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.983+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/368624198 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f1806a0e0 0x7f0f1806c5a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001c70 tx=0x7f0f30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.984+0000 7f0f4f99eb80 1 Processor -- start 2023-08-27T11:26:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.984+0000 7f0f4f99eb80 1 -- start start 2023-08-27T11:26:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc10f00 0x56152dc33d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc112e0 0x56152dc49500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:21.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152db6e730 con 0x56152dc16fe0 2023-08-27T11:26:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152db6c050 con 0x56152dc112e0 2023-08-27T11:26:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.985+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56152db67940 con 0x56152dc10f00 2023-08-27T11:26:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56498/0 (socket says 172.21.15.43:56498) 2023-08-27T11:26:21.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 -- 172.21.15.43:0/1422576068 learned_addr learned my addr 172.21.15.43:0/1422576068 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc10f00 0x56152dc33d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc112e0 0x56152dc49500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:21.991 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:26:21.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 -- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc10f00 msgr2=0x56152dc33d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:21.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc10f00 0x56152dc33d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 -- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc112e0 msgr2=0x56152dc49500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:21.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc112e0 0x56152dc49500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 -- 172.21.15.43:0/1422576068 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56152d9e75e0 con 0x56152dc16fe0 2023-08-27T11:26:21.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.986+0000 7f0f3959a700 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0f240090b0 tx=0x7f0f24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d5e3d8f16d51a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:21.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.987+0000 7f0f177fe700 1 -- 172.21.15.43:0/1422576068 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400fe10 con 0x56152dc16fe0 2023-08-27T11:26:21.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.987+0000 7f0f177fe700 1 -- 172.21.15.43:0/1422576068 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f240177d0 con 0x56152dc16fe0 2023-08-27T11:26:21.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.987+0000 7f0f177fe700 1 -- 172.21.15.43:0/1422576068 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24017b40 con 0x56152dc16fe0 2023-08-27T11:26:21.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.987+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1422576068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 msgr2=0x56152dc342b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.987+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0f240090b0 tx=0x7f0f24012000 comp rx=0 tx=0).stop 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1422576068 shutdown_connections 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc112e0 0x56152dc49500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc10f00 0x56152dc33d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1422576068 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc16fe0 0x56152dc342b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:21.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1422576068 >> 172.21.15.43:0/1422576068 conn(0x56152db73c30 msgr2=0x56152dc136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:21.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1422576068 shutdown_connections 2023-08-27T11:26:21.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1422576068 wait complete. 2023-08-27T11:26:21.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.988+0000 7f0f4f99eb80 1 -- start start 2023-08-27T11:26:21.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.989+0000 7f0f4f99eb80 1 Processor -- start 2023-08-27T11:26:21.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:22.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc112e0 0x56152dc515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:22.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 0x56152dc37eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:22.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152db05b60 con 0x56152dc10f00 2023-08-27T11:26:22.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56152db05860 con 0x56152dc51b10 2023-08-27T11:26:22.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56152d9e98d0 con 0x56152dc112e0 2023-08-27T11:26:22.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f4f99eb80 10 client.0 _ll_register_callbacks cb 0x56152db03630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:22.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:22.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56504/0 (socket says 172.21.15.43:56504) 2023-08-27T11:26:22.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 -- 172.21.15.43:0/1973207282 learned_addr learned my addr 172.21.15.43:0/1973207282 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:22.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f3959a700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc112e0 0x56152dc515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:22.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 0x56152dc37eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:22.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 -- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc112e0 msgr2=0x56152dc515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:22.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc112e0 0x56152dc515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:22.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 -- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 msgr2=0x56152dc37eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:22.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 0x56152dc37eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f39d9b700 1 -- 172.21.15.43:0/1973207282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f340c0be0 con 0x56152dc10f00 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.990+0000 7f0f3a59c700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 0x56152dc37eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f39d9b700 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0f30014a00 tx=0x7f0f30001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d668eb0faceddc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f14ff9700 1 -- 172.21.15.43:0/1973207282 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3000fea0 con 0x56152dc10f00 2023-08-27T11:26:22.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56152dc084f0 con 0x56152dc10f00 2023-08-27T11:26:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f14ff9700 1 -- 172.21.15.43:0/1973207282 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f0f3001c040 con 0x56152dc10f00 2023-08-27T11:26:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f14ff9700 1 -- 172.21.15.43:0/1973207282 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f300135c0 con 0x56152dc10f00 2023-08-27T11:26:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f4f99eb80 10 client.6795 fetch_fsmap learned FSMap version 75 2023-08-27T11:26:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.991+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x56152db7f750 con 0x56152dc10f00 2023-08-27T11:26:22.004 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f14ff9700 1 -- 172.21.15.43:0/1973207282 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56152dc084f0 con 0x56152dc10f00 2023-08-27T11:26:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f14ff9700 1 -- 172.21.15.43:0/1973207282 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 75) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f0f30013720 con 0x56152dc10f00 2023-08-27T11:26:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f4f99eb80 10 client.6795 fetch_fsmap finished waiting for FSMap version 75 2023-08-27T11:26:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f4f99eb80 -1 client.6795 resolve_mds: no MDS daemons found by name `a' 2023-08-27T11:26:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f4f99eb80 -1 client.6795 FSMap: cephfs:1/1 {0=c=up:replay} 2 up:standby 2023-08-27T11:26:22.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.992+0000 7f0f4f99eb80 1 client.6795 shutdown 2023-08-27T11:26:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 msgr2=0x56152dc32790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0f30014a00 tx=0x7f0f30001080 comp rx=0 tx=0).stop 2023-08-27T11:26:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 shutdown_connections 2023-08-27T11:26:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56152dc51b10 0x56152dc37eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:22.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56152dc10f00 0x56152dc32790 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 --2- 172.21.15.43:0/1973207282 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56152dc112e0 0x56152dc515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 >> 172.21.15.43:0/1973207282 conn(0x56152db73c30 msgr2=0x56152dc33b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 shutdown_connections 2023-08-27T11:26:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 1 -- 172.21.15.43:0/1973207282 wait complete. 2023-08-27T11:26:22.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:21.993+0000 7f0f4f99eb80 20 client.6795 trim_cache size 0 max 16384 2023-08-27T11:26:22.008 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENOENT: problem getting command descriptions from mds.a 2023-08-27T11:26:22.008 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-27T11:26:23.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:23.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.221+0000 7f13c33ff700 1 Processor -- start 2023-08-27T11:26:23.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.222+0000 7f13c33ff700 1 -- start start 2023-08-27T11:26:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c33ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13bc151a90 0x7f13bc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c33ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc06c4e0 con 0x7f13bc0c4a90 2023-08-27T11:26:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c33ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc155370 con 0x7f13bc0c4630 2023-08-27T11:26:23.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c33ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc151e70 con 0x7f13bc151a90 2023-08-27T11:26:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c199c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f13bc0c4a90 0x7f13bc06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52318/0 (socket says 172.21.15.43:52318) 2023-08-27T11:26:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c199c700 1 -- 172.21.15.43:0/1013994044 learned_addr learned my addr 172.21.15.43:0/1013994044 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.223+0000 7f13c119b700 1 --2- 172.21.15.43:0/1013994044 >> v2:172.21.15.57:3300/0 conn(0x7f13bc151a90 0x7f13bc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983663369 0 0) 0x7f13bc06c4e0 con 0x7f13bc0c4a90 2023-08-27T11:26:23.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a80035b0 con 0x7f13bc0c4a90 2023-08-27T11:26:23.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042472216 0 0) 0x7f13a80035b0 con 0x7f13bc0c4a90 2023-08-27T11:26:23.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 >> v2:172.21.15.57:3300/0 conn(0x7f13bc151a90 msgr2=0x7f13bc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:23.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 --2- 172.21.15.43:0/1013994044 >> v2:172.21.15.57:3300/0 conn(0x7f13bc151a90 0x7f13bc0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 >> v1:172.21.15.57:6789/0 conn(0x7f13bc0c4630 legacy=0x7f13bc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc154480 con 0x7f13bc0c4a90 2023-08-27T11:26:23.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f13b40019f0 con 0x7f13bc0c4a90 2023-08-27T11:26:23.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 >> v1:172.21.15.43:6789/0 conn(0x7f13bc0c4a90 legacy=0x7f13bc06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8003a50 0x7f13a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13a8004850 0x7f13a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 0x7f13a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc151e70 con 0x7f13a8005260 2023-08-27T11:26:23.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a800c1b0 con 0x7f13a8004850 2023-08-27T11:26:23.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a800c370 con 0x7f13a8003a50 2023-08-27T11:26:23.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13c199c700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 0x7f13a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13c119b700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8003a50 0x7f13a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.224+0000 7f13c099a700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13a8004850 0x7f13a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 -- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8003a50 msgr2=0x7f13a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:23.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8003a50 0x7f13a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 -- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13a8004850 msgr2=0x7f13a8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:23.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13a8004850 0x7f13a8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 -- 172.21.15.43:0/1013994044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80035b0 con 0x7f13a8005260 2023-08-27T11:26:23.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 -- 172.21.15.43:0/1013994044 reap_dead start 2023-08-27T11:26:23.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13c199c700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 0x7f13a800ba10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f13b4002230 tx=0x7f13a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fa8e920962925b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:23.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b400a250 con 0x7f13a8005260 2023-08-27T11:26:23.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b40072d0 con 0x7f13a8005260 2023-08-27T11:26:23.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.225+0000 7f13b3fff700 1 -- 172.21.15.43:0/1013994044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4007680 con 0x7f13a8005260 2023-08-27T11:26:23.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 -- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 msgr2=0x7f13a800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 0x7f13a800ba10 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f13b4002230 tx=0x7f13a8005880 comp rx=0 tx=0).stop 2023-08-27T11:26:23.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 -- 172.21.15.43:0/1013994044 shutdown_connections 2023-08-27T11:26:23.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1013994044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13a8005260 0x7f13a800ba10 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 -- 172.21.15.43:0/1013994044 >> 172.21.15.43:0/1013994044 conn(0x7f13bc0ab820 msgr2=0x7f13bc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:23.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 -- 172.21.15.43:0/1013994044 shutdown_connections 2023-08-27T11:26:23.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.226+0000 7f13c33ff700 1 -- 172.21.15.43:0/1013994044 wait complete. 2023-08-27T11:26:23.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.228+0000 7f13c33ff700 1 Processor -- start 2023-08-27T11:26:23.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.228+0000 7f13c33ff700 1 -- start start 2023-08-27T11:26:23.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 0x7f13bc153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc1e96d0 0x7f13bc1e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0ab670 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0ab1e0 con 0x7f13bc1e96d0 2023-08-27T11:26:23.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c33ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc0c1160 con 0x7f13a8005260 2023-08-27T11:26:23.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56526/0 (socket says 172.21.15.43:56526) 2023-08-27T11:26:23.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 -- 172.21.15.43:0/1737859851 learned_addr learned my addr 172.21.15.43:0/1737859851 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:23.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c199c700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc1e96d0 0x7f13bc1e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c119b700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 0x7f13bc153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 -- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 msgr2=0x7f13bc153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 0x7f13bc153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 -- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc1e96d0 msgr2=0x7f13bc1e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc1e96d0 0x7f13bc1e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c099a700 1 -- 172.21.15.43:0/1737859851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0aaeb0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.229+0000 7f13c119b700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 0x7f13bc153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:23.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13c099a700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00f880 tx=0x7f13ac00fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:23.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac0050d0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac005230 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc1ed7d0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac003680 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.230+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc1edab0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.231+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc150f60 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.232+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f13ac0037e0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.234+0000 7f13b1ffb700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 0x7f13a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:23.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.234+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f13ac088350 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.234+0000 7f13c119b700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 0x7f13a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:23.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.234+0000 7f13c119b700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 0x7f13a006c5a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009470 tx=0x7f13b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:23.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.238+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f13ac0539d0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.492+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13bc04ee70 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.493+0000 7f13b1ffb700 1 -- 172.21.15.43:0/1737859851 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f13ac056ff0 con 0x7f13bc0c8aa0 2023-08-27T11:26:23.495 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:23.495 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6798,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3766683255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3766683255},{"type":"v1","addr":"172.21.15.43:6836","nonce":3766683255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:22.927725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:reconnect","state_seq":7,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 msgr2=0x7f13a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 0x7f13a006c5a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009470 tx=0x7f13b8008040 comp rx=0 tx=0).stop 2023-08-27T11:26:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 msgr2=0x7f13bc0c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00f880 tx=0x7f13ac00fc40 comp rx=0 tx=0).stop 2023-08-27T11:26:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 shutdown_connections 2023-08-27T11:26:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f13a006a0e0 0x7f13a006c5a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13bc1e96d0 0x7f13bc1e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13a8005260 0x7f13bc153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 --2- 172.21.15.43:0/1737859851 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f13bc0c8aa0 0x7f13bc0c8f20 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 >> 172.21.15.43:0/1737859851 conn(0x7f13bc0ab820 msgr2=0x7f13bc14a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 shutdown_connections 2023-08-27T11:26:23.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:23.495+0000 7f13c33ff700 1 -- 172.21.15.43:0/1737859851 wait complete. 2023-08-27T11:26:23.500 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 76 2023-08-27T11:26:23.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:22.927725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:reconnect', 'state_seq': 7, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:23.918 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6322:up:reconnect 2023-08-27T11:26:24.919 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:25.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.132+0000 7fb4a17ff700 1 Processor -- start 2023-08-27T11:26:25.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.133+0000 7fb4a17ff700 1 -- start start 2023-08-27T11:26:25.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb4a17ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb49c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb4a17ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb49c06ca60 0x7fb49c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb4a17ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49c06d700 con 0x7fb49c0ab040 2023-08-27T11:26:25.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb4a17ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49c1530b0 con 0x7fb49c06ca60 2023-08-27T11:26:25.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb4a17ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c14c860 con 0x7fb49c0c51a0 2023-08-27T11:26:25.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb49b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb49c0ab040 0x7fb49c155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52322/0 (socket says 172.21.15.43:52322) 2023-08-27T11:26:25.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.134+0000 7fb49b7fe700 1 -- 172.21.15.43:0/1083137380 learned_addr learned my addr 172.21.15.43:0/1083137380 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:25.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/1083137380 >> v2:172.21.15.57:3300/0 conn(0x7fb49c06ca60 0x7fb49c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb49affd700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb49c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670141681 0 0) 0x7fb49c06d700 con 0x7fb49c0ab040 2023-08-27T11:26:25.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4840035b0 con 0x7fb49c0ab040 2023-08-27T11:26:25.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122622388 0 0) 0x7fb4840035b0 con 0x7fb49c0ab040 2023-08-27T11:26:25.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 msgr2=0x7fb49c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:25.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb49c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 >> v2:172.21.15.57:3300/0 conn(0x7fb49c06ca60 msgr2=0x7fb49c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:25.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 --2- 172.21.15.43:0/1083137380 >> v2:172.21.15.57:3300/0 conn(0x7fb49c06ca60 0x7fb49c0aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c152430 con 0x7fb49c0ab040 2023-08-27T11:26:25.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb4940019f0 con 0x7fb49c0ab040 2023-08-27T11:26:25.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/1083137380 >> v2:172.21.15.57:3300/0 conn(0x7fb49c06ca60 0x7fb49c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:25.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 >> v1:172.21.15.43:6789/0 conn(0x7fb49c0ab040 legacy=0x7fb49c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb484003a30 0x7fb484003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb484004850 0x7fb484004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb484005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c1530b0 con 0x7fb484003a30 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c14c860 con 0x7fb484004850 2023-08-27T11:26:25.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48400ba90 con 0x7fb49c0c51a0 2023-08-27T11:26:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.135+0000 7fb49affd700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb484003a30 0x7fb484003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb484004850 0x7fb484004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49b7fe700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb484005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 -- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 msgr2=0x7fb484005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:25.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb484005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 -- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb484004850 msgr2=0x7fb484004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb484004850 0x7fb484004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 -- 172.21.15.43:0/1083137380 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840035b0 con 0x7fb484003a30 2023-08-27T11:26:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49b7fe700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb49c0c51a0 0x7fb484005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:25.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb49affd700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb484003a30 0x7fb484003e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009b60 tx=0x7fb484005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d83b629ae4bef22 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00e6c0 con 0x7fb484003a30 2023-08-27T11:26:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00e820 con 0x7fb484003a30 2023-08-27T11:26:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.136+0000 7fb499ffb700 1 -- 172.21.15.43:0/1083137380 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00eb90 con 0x7fb484003a30 2023-08-27T11:26:25.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 -- 172.21.15.43:0/1083137380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb484003a30 msgr2=0x7fb484003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/1083137380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb484003a30 0x7fb484003e50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009b60 tx=0x7fb484005880 comp rx=0 tx=0).stop 2023-08-27T11:26:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb49b7fe700 1 -- 172.21.15.43:0/1083137380 reap_dead start 2023-08-27T11:26:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 -- 172.21.15.43:0/1083137380 shutdown_connections 2023-08-27T11:26:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 -- 172.21.15.43:0/1083137380 >> 172.21.15.43:0/1083137380 conn(0x7fb49c06aa50 msgr2=0x7fb49c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:25.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 -- 172.21.15.43:0/1083137380 shutdown_connections 2023-08-27T11:26:25.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.137+0000 7fb4a17ff700 1 -- 172.21.15.43:0/1083137380 wait complete. 2023-08-27T11:26:25.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.139+0000 7fb4a17ff700 1 Processor -- start 2023-08-27T11:26:25.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.139+0000 7fb4a17ff700 1 -- start start 2023-08-27T11:26:25.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb484003a30 0x7fb49c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb49c14a260 0x7fb49c1e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c1ea1b0 con 0x7fb49c149e10 2023-08-27T11:26:25.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c0c5a30 con 0x7fb49c14a260 2023-08-27T11:26:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb4a17ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49c1ea3c0 con 0x7fb484003a30 2023-08-27T11:26:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56548/0 (socket says 172.21.15.43:56548) 2023-08-27T11:26:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 -- 172.21.15.43:0/945603449 learned_addr learned my addr 172.21.15.43:0/945603449 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:25.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49b7fe700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb49c14a260 0x7fb49c1e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49affd700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb484003a30 0x7fb49c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 -- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb484003a30 msgr2=0x7fb49c1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb484003a30 0x7fb49c1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 -- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb49c14a260 msgr2=0x7fb49c1e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb49c14a260 0x7fb49c1e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.140+0000 7fb49a7fc700 1 -- 172.21.15.43:0/945603449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c1e8690 con 0x7fb49c149e10 2023-08-27T11:26:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb49a7fc700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb490011c50 tx=0x7fb49000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490011e50 con 0x7fb49c149e10 2023-08-27T11:26:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000fd40 con 0x7fb49c149e10 2023-08-27T11:26:25.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49c1e8970 con 0x7fb49c149e10 2023-08-27T11:26:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490004240 con 0x7fb49c149e10 2023-08-27T11:26:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.141+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49c1e8f30 con 0x7fb49c149e10 2023-08-27T11:26:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.142+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49c04ee70 con 0x7fb49c149e10 2023-08-27T11:26:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.143+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb4900043a0 con 0x7fb49c149e10 2023-08-27T11:26:25.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.144+0000 7fb4837fe700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.144+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb490088c60 con 0x7fb49c149e10 2023-08-27T11:26:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.144+0000 7fb49affd700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.145+0000 7fb49affd700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000c00 tx=0x7fb48c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:25.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.149+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb490054250 con 0x7fb49c149e10 2023-08-27T11:26:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.403+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb49c06c840 con 0x7fb49c149e10 2023-08-27T11:26:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.404+0000 7fb4837fe700 1 -- 172.21.15.43:0/945603449 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4874 (secure 0 0 0) 0x7fb490022020 con 0x7fb49c149e10 2023-08-27T11:26:25.406 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:25.406 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6798,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3766683255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3766683255},{"type":"v1","addr":"172.21.15.43:6836","nonce":3766683255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:24.946782+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 msgr2=0x7fb48806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000c00 tx=0x7fb48c008030 comp rx=0 tx=0).stop 2023-08-27T11:26:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 msgr2=0x7fb49c1e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb490011c50 tx=0x7fb49000f520 comp rx=0 tx=0).stop 2023-08-27T11:26:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 shutdown_connections 2023-08-27T11:26:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb49c14a260 0x7fb49c1e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb484003a30 0x7fb49c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 --2- 172.21.15.43:0/945603449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb49c149e10 0x7fb49c1e9730 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:25.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 >> 172.21.15.43:0/945603449 conn(0x7fb49c06aa50 msgr2=0x7fb49c14bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:25.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 shutdown_connections 2023-08-27T11:26:25.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:25.406+0000 7fb4a17ff700 1 -- 172.21.15.43:0/945603449 wait complete. 2023-08-27T11:26:25.410 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 78 2023-08-27T11:26:25.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:24.946782+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:25.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:26:25.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:26:26.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.037+0000 7f9c47fff700 1 Processor -- start 2023-08-27T11:26:26.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.037+0000 7f9c47fff700 1 -- start start 2023-08-27T11:26:26.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.038+0000 7f9c47fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c400c50d0 0x7f9c400c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.038+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c40154740 0x7f9c400c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.038+0000 7f9c47fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c40154d00 con 0x7f9c4014e960 2023-08-27T11:26:26.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.038+0000 7f9c47fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c400baf30 con 0x7f9c400c50d0 2023-08-27T11:26:26.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.038+0000 7f9c47fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40154fe0 con 0x7f9c40154740 2023-08-27T11:26:26.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c400c50d0 0x7f9c400c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c40154740 0x7f9c400c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c400c50d0 0x7f9c400c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:42308/0 (socket says 172.21.15.43:42308) 2023-08-27T11:26:26.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 -- 172.21.15.43:0/1682132553 learned_addr learned my addr 172.21.15.43:0/1682132553 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c45d9b700 1 --1- 172.21.15.43:0/1682132553 >> v1:172.21.15.57:6789/0 conn(0x7f9c4014e960 0x7f9c400a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:57532/0 (socket says 172.21.15.43:57532) 2023-08-27T11:26:26.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 -- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c40154740 msgr2=0x7f9c400c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 --2- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c40154740 0x7f9c400c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 -- 172.21.15.43:0/1682132553 >> v1:172.21.15.57:6789/0 conn(0x7f9c4014e960 legacy=0x7f9c400a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.039+0000 7f9c4559a700 1 -- 172.21.15.43:0/1682132553 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c401552c0 con 0x7f9c400c50d0 2023-08-27T11:26:26.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.040+0000 7f9c4559a700 1 --2- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c400c50d0 0x7f9c400c3cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9c300098f0 tx=0x7f9c30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ccaca89387f17f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.040+0000 7f9c44d99700 1 -- 172.21.15.43:0/1682132553 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011830 con 0x7f9c400c50d0 2023-08-27T11:26:26.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.040+0000 7f9c44d99700 1 -- 172.21.15.43:0/1682132553 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30011990 con 0x7f9c400c50d0 2023-08-27T11:26:26.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.040+0000 7f9c44d99700 1 -- 172.21.15.43:0/1682132553 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30011d20 con 0x7f9c400c50d0 2023-08-27T11:26:26.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 -- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c400c50d0 msgr2=0x7f9c400c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 --2- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c400c50d0 0x7f9c400c3cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9c300098f0 tx=0x7f9c30009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:26.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 -- 172.21.15.43:0/1682132553 shutdown_connections 2023-08-27T11:26:26.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 --2- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c40154740 0x7f9c400c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 --2- 172.21.15.43:0/1682132553 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c400c50d0 0x7f9c400c3cc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 -- 172.21.15.43:0/1682132553 >> 172.21.15.43:0/1682132553 conn(0x7f9c4006aa50 msgr2=0x7f9c400c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 -- 172.21.15.43:0/1682132553 shutdown_connections 2023-08-27T11:26:26.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.041+0000 7f9c47fff700 1 -- 172.21.15.43:0/1682132553 wait complete. 2023-08-27T11:26:26.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.042+0000 7f9c47fff700 1 Processor -- start 2023-08-27T11:26:26.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 -- start start 2023-08-27T11:26:26.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c400c50d0 0x7f9c40146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 0x7f9c4014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40143aa0 con 0x7f9c40154740 2023-08-27T11:26:26.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4014f000 con 0x7f9c4014e960 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.043+0000 7f9c47fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40143cb0 con 0x7f9c400c50d0 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4559a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 0x7f9c4014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4559a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:42322/0 (socket says 172.21.15.43:42322) 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4559a700 1 -- 172.21.15.43:0/337916968 learned_addr learned my addr 172.21.15.43:0/337916968 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c400c50d0 0x7f9c40146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 -- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c400c50d0 msgr2=0x7f9c40146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c400c50d0 0x7f9c40146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 -- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 msgr2=0x7f9c4014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4659c700 1 -- 172.21.15.43:0/337916968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30009550 con 0x7f9c40154740 2023-08-27T11:26:26.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.044+0000 7f9c4559a700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:26.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c4659c700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 0x7f9c4014f770 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009d90 tx=0x7f9c3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c367fc700 1 -- 172.21.15.43:0/337916968 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38009c00 con 0x7f9c40154740 2023-08-27T11:26:26.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c367fc700 1 -- 172.21.15.43:0/337916968 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800f040 con 0x7f9c40154740 2023-08-27T11:26:26.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c40143f90 con 0x7f9c40154740 2023-08-27T11:26:26.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c367fc700 1 -- 172.21.15.43:0/337916968 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38014480 con 0x7f9c40154740 2023-08-27T11:26:26.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.045+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4014f250 con 0x7f9c40154740 2023-08-27T11:26:26.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.047+0000 7f9c367fc700 1 -- 172.21.15.43:0/337916968 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c380145e0 con 0x7f9c40154740 2023-08-27T11:26:26.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.048+0000 7f9c367fc700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 0x7f9c2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.048+0000 7f9c367fc700 1 -- 172.21.15.43:0/337916968 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9c380890f0 con 0x7f9c40154740 2023-08-27T11:26:26.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.048+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 0x7f9c2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.049+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 0x7f9c2406c5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f60 tx=0x7f9c3c007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.050+0000 7f9c5b888b80 1 Processor -- start 2023-08-27T11:26:26.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.050+0000 7f9c5b888b80 1 -- start start 2023-08-27T11:26:26.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3ffe0 0x562441d5d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441c97730 con 0x562441d3a2e0 2023-08-27T11:26:26.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441c95050 con 0x562441d39f00 2023-08-27T11:26:26.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562441c90940 con 0x562441d3ffe0 2023-08-27T11:26:26.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56564/0 (socket says 172.21.15.43:56564) 2023-08-27T11:26:26.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c4659c700 1 -- 172.21.15.43:0/1208104722 learned_addr learned my addr 172.21.15.43:0/1208104722 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.051+0000 7f9c4559a700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3ffe0 0x562441d5d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 -- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3ffe0 msgr2=0x562441d5d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3ffe0 0x562441d5d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 -- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 msgr2=0x562441d5cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d5cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 -- 172.21.15.43:0/1208104722 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562441b105e0 con 0x562441d3a2e0 2023-08-27T11:26:26.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d5cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9c38054930 tx=0x7f9c380580a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ef384276f3b5a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c237fe700 1 -- 172.21.15.43:0/1208104722 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3805e0c0 con 0x562441d3a2e0 2023-08-27T11:26:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c237fe700 1 -- 172.21.15.43:0/1208104722 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c380567d0 con 0x562441d3a2e0 2023-08-27T11:26:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.052+0000 7f9c237fe700 1 -- 172.21.15.43:0/1208104722 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38057b20 con 0x562441d3a2e0 2023-08-27T11:26:26.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1208104722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 msgr2=0x562441d72500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9c38054930 tx=0x7f9c380580a0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1208104722 shutdown_connections 2023-08-27T11:26:26.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d3a2e0 0x562441d72500 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d5cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1208104722 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3ffe0 0x562441d5d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1208104722 >> 172.21.15.43:0/1208104722 conn(0x562441c9cc30 msgr2=0x562441d3c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1208104722 shutdown_connections 2023-08-27T11:26:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.053+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1208104722 wait complete. 2023-08-27T11:26:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.054+0000 7f9c5b888b80 1 -- start start 2023-08-27T11:26:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.054+0000 7f9c5b888b80 1 Processor -- start 2023-08-27T11:26:26.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d8a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d7a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441c2eb60 con 0x562441d79400 2023-08-27T11:26:26.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441c2e860 con 0x562441d39f00 2023-08-27T11:26:26.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562441b128d0 con 0x562441d3a2e0 2023-08-27T11:26:26.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c5b888b80 10 client.0 _ll_register_callbacks cb 0x562441c2c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:26.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56578/0 (socket says 172.21.15.43:56578) 2023-08-27T11:26:26.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 -- 172.21.15.43:0/2006016957 learned_addr learned my addr 172.21.15.43:0/2006016957 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4559a700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d7a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d8a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 -- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 msgr2=0x562441d7a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d7a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 -- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 msgr2=0x562441d8a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d8a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.055+0000 7f9c4659c700 1 -- 172.21.15.43:0/2006016957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4014f250 con 0x562441d79400 2023-08-27T11:26:26.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c4659c700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9c38012020 tx=0x7f9c38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631d9653ca7bdc8c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:26.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3805e0c0 con 0x562441d79400 2023-08-27T11:26:26.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9c380870d0 con 0x562441d79400 2023-08-27T11:26:26.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562441d314f0 con 0x562441d79400 2023-08-27T11:26:26.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c38076b10 con 0x562441d79400 2023-08-27T11:26:26.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 10 client.6819 fetch_fsmap learned FSMap version 78 2023-08-27T11:26:26.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562441ca8750 con 0x562441d79400 2023-08-27T11:26:26.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562441d314f0 con 0x562441d79400 2023-08-27T11:26:26.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9c38054220 con 0x562441d79400 2023-08-27T11:26:26.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 10 client.6819 fetch_fsmap finished waiting for FSMap version 78 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 10 client.6819 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 20 client.6819 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441d5bf30 0x562441d8d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 4 client.6819 mds_command: new command op to 6322 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.056+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562441c89920 con 0x562441d5bf30 2023-08-27T11:26:26.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.057+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441d5bf30 0x562441d8d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.057+0000 7f9c20ff9700 10 client.6819 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:26.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.057+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441d5bf30 0x562441d8d530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1e192f03967fc9d server_cookie=b6633be60058cac2 in_seq=0 out_seq=0 2023-08-27T11:26:26.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c20ff9700 1 -- 172.21.15.43:0/2006016957 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562441c89920 con 0x562441d5bf30 2023-08-27T11:26:26.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c20ff9700 10 client.6819 handle_command_reply: tid=0 2023-08-27T11:26:26.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 client.6819 shutdown 2023-08-27T11:26:26.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 msgr2=0x562441d5b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9c38012020 tx=0x7f9c38004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 shutdown_connections 2023-08-27T11:26:26.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441d5bf30 0x562441d8d530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d5b9f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d39f00 0x562441d8a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.058+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/2006016957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d7a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.059+0000 7f9c20ff9700 0 client.6819 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:26.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.059+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 >> 172.21.15.43:0/2006016957 conn(0x562441c9cc30 msgr2=0x562441d37b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.059+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 shutdown_connections 2023-08-27T11:26:26.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.059+0000 7f9c5b888b80 1 -- 172.21.15.43:0/2006016957 wait complete. 2023-08-27T11:26:26.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.059+0000 7f9c5b888b80 20 client.6819 trim_cache size 0 max 16384 2023-08-27T11:26:26.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.077+0000 7f9c5b888b80 1 Processor -- start 2023-08-27T11:26:26.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.077+0000 7f9c5b888b80 1 -- start start 2023-08-27T11:26:26.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d39f00 0x562441d3c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 0x562441d3e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441d87370 con 0x562441d79400 2023-08-27T11:26:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441d314b0 con 0x562441d3a2e0 2023-08-27T11:26:26.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562441d8ac50 con 0x562441d39f00 2023-08-27T11:26:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56588/0 (socket says 172.21.15.43:56588) 2023-08-27T11:26:26.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 -- 172.21.15.43:0/1789815660 learned_addr learned my addr 172.21.15.43:0/1789815660 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4559a700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 0x562441d3e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d39f00 0x562441d3c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 -- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d39f00 msgr2=0x562441d3c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d39f00 0x562441d3c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 -- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 msgr2=0x562441d3e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 0x562441d3e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4659c700 1 -- 172.21.15.43:0/1789815660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562441d3d910 con 0x562441d79400 2023-08-27T11:26:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.078+0000 7f9c4559a700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 0x562441d3e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c4659c700 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9c3805fc10 tx=0x7f9c3806d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64da76dbf1fa9f4a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c23fff700 1 -- 172.21.15.43:0/1789815660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38076b10 con 0x562441d79400 2023-08-27T11:26:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c23fff700 1 -- 172.21.15.43:0/1789815660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3805e0c0 con 0x562441d79400 2023-08-27T11:26:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c23fff700 1 -- 172.21.15.43:0/1789815660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c380870d0 con 0x562441d79400 2023-08-27T11:26:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1789815660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 msgr2=0x562441d3ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9c3805fc10 tx=0x7f9c3806d070 comp rx=0 tx=0).stop 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1789815660 shutdown_connections 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d79400 0x562441d3ea40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d39f00 0x562441d3c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.079+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/1789815660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d3a2e0 0x562441d3e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.080+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1789815660 >> 172.21.15.43:0/1789815660 conn(0x562441c9cc30 msgr2=0x562441d8a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.080+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1789815660 shutdown_connections 2023-08-27T11:26:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.080+0000 7f9c5b888b80 1 -- 172.21.15.43:0/1789815660 wait complete. 2023-08-27T11:26:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.080+0000 7f9c5b888b80 1 -- start start 2023-08-27T11:26:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.081+0000 7f9c5b888b80 1 Processor -- start 2023-08-27T11:26:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d3e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d79400 0x562441dde740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441d3f0b0 con 0x562441d39f00 2023-08-27T11:26:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562441d5a4a0 con 0x562441d79400 2023-08-27T11:26:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562441d5a640 con 0x562441d3a2e0 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c5b888b80 10 client.0 _ll_register_callbacks cb 0x562441c2c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c45d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c45d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56590/0 (socket says 172.21.15.43:56590) 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.082+0000 7f9c45d9b700 1 -- 172.21.15.43:0/3854300947 learned_addr learned my addr 172.21.15.43:0/3854300947 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c4659c700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d79400 0x562441dde740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c4559a700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d3e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 -- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 msgr2=0x562441d3e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d3e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 -- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d79400 msgr2=0x562441dde740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d79400 0x562441dde740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 -- 172.21.15.43:0/3854300947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562441ca8750 con 0x562441d39f00 2023-08-27T11:26:26.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c45d9b700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c026f20 tx=0x7f9c3c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66239b05bea0511a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c026050 con 0x562441d39f00 2023-08-27T11:26:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f9c3c01b040 con 0x562441d39f00 2023-08-27T11:26:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.083+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562441c4a000 con 0x562441d39f00 2023-08-27T11:26:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c3c0261b0 con 0x562441d39f00 2023-08-27T11:26:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 10 client.6825 fetch_fsmap learned FSMap version 78 2023-08-27T11:26:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562441abcd90 con 0x562441d39f00 2023-08-27T11:26:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562441c4a000 con 0x562441d39f00 2023-08-27T11:26:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9c3c026310 con 0x562441d39f00 2023-08-27T11:26:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 10 client.6825 fetch_fsmap finished waiting for FSMap version 78 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 10 client.6825 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 20 client.6825 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441ddec80 0x562441d5f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 4 client.6825 mds_command: new command op to 6322 tid=0[{"prefix": "status"}] 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562441addf20 con 0x562441ddec80 2023-08-27T11:26:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.084+0000 7f9c4559a700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441ddec80 0x562441d5f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c20ff9700 10 client.6825 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c4559a700 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441ddec80 0x562441d5f970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0158b3aec7c31dd server_cookie=f2e42208f36101e in_seq=0 out_seq=0 2023-08-27T11:26:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c20ff9700 1 -- 172.21.15.43:0/3854300947 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562441addf20 con 0x562441ddec80 2023-08-27T11:26:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c20ff9700 10 client.6825 handle_command_reply: tid=0 2023-08-27T11:26:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 client.6825 shutdown 2023-08-27T11:26:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 msgr2=0x562441d7a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c026f20 tx=0x7f9c3c012000 comp rx=0 tx=0).stop 2023-08-27T11:26:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 shutdown_connections 2023-08-27T11:26:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562441d79400 0x562441dde740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562441ddec80 0x562441d5f970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562441d39f00 0x562441d7a250 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 --2- 172.21.15.43:0/3854300947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562441d3a2e0 0x562441d3e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c20ff9700 0 client.6825 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.085+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 >> 172.21.15.43:0/3854300947 conn(0x562441c9cc30 msgr2=0x562441d5b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 shutdown_connections 2023-08-27T11:26:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c5b888b80 1 -- 172.21.15.43:0/3854300947 wait complete. 2023-08-27T11:26:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c5b888b80 20 client.6825 trim_cache size 0 max 16384 2023-08-27T11:26:26.182 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:26.183 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:26:26.183 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:26:26.183 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6322, 2023-08-27T11:26:26.183 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:26:26.183 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 4.1579355830000004, 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 78, 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 82, 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 82, 2023-08-27T11:26:26.184 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 25.157574887999999 2023-08-27T11:26:26.185 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:26.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 msgr2=0x7f9c2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 0x7f9c2406c5a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c000f60 tx=0x7f9c3c007ed0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 msgr2=0x7f9c4014f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 0x7f9c4014f770 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009d90 tx=0x7f9c3800c3a0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 shutdown_connections 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9c2406a0e0 0x7f9c2406c5a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9c40154740 0x7f9c4014f770 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c400c50d0 0x7f9c40146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 --2- 172.21.15.43:0/337916968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c4014e960 0x7f9c4014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.086+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 >> 172.21.15.43:0/337916968 conn(0x7f9c4006aa50 msgr2=0x7f9c400a7700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.087+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 shutdown_connections 2023-08-27T11:26:26.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.087+0000 7f9c47fff700 1 -- 172.21.15.43:0/337916968 wait complete. 2023-08-27T11:26:26.188 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 6, "epoch": 78, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 6, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:12.678531+0000", "damaged": [], "data_pools": [ 14 ], "enabled": true, "epoch": 78, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6322": { "addr": "172.21.15.43:6837/3998632195", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 3998632195, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 3998632195, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6322, "incarnation": 75, "join_fscid": 6, "name": "c", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 82, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 13, "modified": "2023-08-27T11:26:24.946782+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6322 } } } ], "standbys": [ { "addr": "172.21.15.57:6833/1640307202", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 1640307202, "type": "v2" }, { "addr": "172.21.15.57:6833", "nonce": 1640307202, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 67, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6328, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/432356370", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6834", "nonce": 432356370, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 432356370, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 68, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6334, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/3766683255", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3766683255, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3766683255, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 76, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6798, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:26:26.190 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 6, 'name': 'c', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:26:26.190 INFO:tasks.cephfs.test_failover:current = [{'gid': 6798, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/3766683255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3766683255}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3766683255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 76}, {'gid': 6334, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/432356370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 432356370}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 432356370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 68}, {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6328, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6833/1640307202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1640307202}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1640307202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 67}] 2023-08-27T11:26:26.191 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-27T11:26:26.191 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-08-27T11:26:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.395+0000 7f2b1b9ff700 1 Processor -- start 2023-08-27T11:26:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.396+0000 7f2b1b9ff700 1 -- start start 2023-08-27T11:26:26.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1b9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b140c7c00 0x7f2b140c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1b9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2b1406a8e0 0x7f2b1406acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1b9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b14154660 con 0x7f2b14151d20 2023-08-27T11:26:26.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1b9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b140c5750 con 0x7f2b1406a8e0 2023-08-27T11:26:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1b9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b14154940 con 0x7f2b140c7c00 2023-08-27T11:26:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b19f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2b1406a8e0 0x7f2b1406acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1979b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2b14151d20 0x7f2b140ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52336/0 (socket says 172.21.15.43:52336) 2023-08-27T11:26:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b1979b700 1 -- 172.21.15.43:0/3165879199 learned_addr learned my addr 172.21.15.43:0/3165879199 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:26.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b18f9a700 1 --2- 172.21.15.43:0/3165879199 >> v2:172.21.15.57:3300/0 conn(0x7f2b140c7c00 0x7f2b140c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b0bfff700 1 -- 172.21.15.43:0/3165879199 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173192044 0 0) 0x7f2b14154660 con 0x7f2b14151d20 2023-08-27T11:26:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b19f9c700 1 -- 172.21.15.43:0/3165879199 >> v2:172.21.15.57:3300/0 conn(0x7f2b140c7c00 msgr2=0x7f2b140c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b19f9c700 1 --2- 172.21.15.43:0/3165879199 >> v2:172.21.15.57:3300/0 conn(0x7f2b140c7c00 0x7f2b140c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b19f9c700 1 -- 172.21.15.43:0/3165879199 >> v1:172.21.15.43:6789/0 conn(0x7f2b14151d20 legacy=0x7f2b140ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.397+0000 7f2b19f9c700 1 -- 172.21.15.43:0/3165879199 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14154c20 con 0x7f2b1406a8e0 2023-08-27T11:26:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b19f9c700 1 --2- 172.21.15.43:0/3165879199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1406a8e0 0x7f2b1406acf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2b140cac40 tx=0x7f2b0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e9dd2555c4d9fe server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b0bfff700 1 -- 172.21.15.43:0/3165879199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00e070 con 0x7f2b1406a8e0 2023-08-27T11:26:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b0bfff700 1 -- 172.21.15.43:0/3165879199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00bb20 con 0x7f2b1406a8e0 2023-08-27T11:26:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b0bfff700 1 -- 172.21.15.43:0/3165879199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c012430 con 0x7f2b1406a8e0 2023-08-27T11:26:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/3165879199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1406a8e0 msgr2=0x7f2b1406acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.398+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/3165879199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1406a8e0 0x7f2b1406acf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2b140cac40 tx=0x7f2b0c00b330 comp rx=0 tx=0).stop 2023-08-27T11:26:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/3165879199 shutdown_connections 2023-08-27T11:26:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/3165879199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b1406a8e0 0x7f2b1406acf0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/3165879199 >> v2:172.21.15.57:3300/0 conn(0x7f2b140c7c00 0x7f2b140c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/3165879199 >> 172.21.15.43:0/3165879199 conn(0x7f2b140c9d00 msgr2=0x7f2b140ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/3165879199 shutdown_connections 2023-08-27T11:26:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.399+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/3165879199 wait complete. 2023-08-27T11:26:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.401+0000 7f2b1b9ff700 1 Processor -- start 2023-08-27T11:26:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.401+0000 7f2b1b9ff700 1 -- start start 2023-08-27T11:26:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b1406a8e0 0x7f2b140c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b14151d20 0x7f2b14149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c2870 con 0x7f2b140c7c00 2023-08-27T11:26:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b141ea4f0 con 0x7f2b1406a8e0 2023-08-27T11:26:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.402+0000 7f2b1b9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140c1910 con 0x7f2b14151d20 2023-08-27T11:26:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56612/0 (socket says 172.21.15.43:56612) 2023-08-27T11:26:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 -- 172.21.15.43:0/4083894272 learned_addr learned my addr 172.21.15.43:0/4083894272 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b1979b700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b1406a8e0 0x7f2b140c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b19f9c700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b14151d20 0x7f2b14149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 -- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b14151d20 msgr2=0x7f2b14149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b14151d20 0x7f2b14149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 -- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b1406a8e0 msgr2=0x7f2b140c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b1406a8e0 0x7f2b140c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 -- 172.21.15.43:0/4083894272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009a70 con 0x7f2b140c7c00 2023-08-27T11:26:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.403+0000 7f2b18f9a700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9b0 tx=0x7f2b0400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.404+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04009710 con 0x7f2b140c7c00 2023-08-27T11:26:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.404+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400ee50 con 0x7f2b140c7c00 2023-08-27T11:26:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.404+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b140c1bf0 con 0x7f2b140c7c00 2023-08-27T11:26:26.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.404+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400ca50 con 0x7f2b140c7c00 2023-08-27T11:26:26.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.404+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b140c21b0 con 0x7f2b140c7c00 2023-08-27T11:26:26.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.405+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1404ee70 con 0x7f2b140c7c00 2023-08-27T11:26:26.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.406+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b0400cbb0 con 0x7f2b140c7c00 2023-08-27T11:26:26.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.407+0000 7f2b09ffb700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 0x7f2af806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:26.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.407+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f2b04088590 con 0x7f2b140c7c00 2023-08-27T11:26:26.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.407+0000 7f2b1979b700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 0x7f2af806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:26.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.408+0000 7f2b1979b700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 0x7f2af806c5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000f60 tx=0x7f2b10007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:26.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.411+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2b040576a0 con 0x7f2b140c7c00 2023-08-27T11:26:26.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.669+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f2b140ac650 con 0x7f2b140c7c00 2023-08-27T11:26:26.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.970+0000 7f2b09ffb700 1 -- 172.21.15.43:0/4083894272 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v79) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2b0400ce60 con 0x7f2b140c7c00 2023-08-27T11:26:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 msgr2=0x7f2af806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 0x7f2af806c5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000f60 tx=0x7f2b10007e70 comp rx=0 tx=0).stop 2023-08-27T11:26:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 msgr2=0x7f2b140c0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9b0 tx=0x7f2b0400ecc0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 shutdown_connections 2023-08-27T11:26:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2af806a0e0 0x7f2af806c5a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b14151d20 0x7f2b14149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b1406a8e0 0x7f2b140c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 --2- 172.21.15.43:0/4083894272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2b140c7c00 0x7f2b140c0d40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 >> 172.21.15.43:0/4083894272 conn(0x7f2b140c9d00 msgr2=0x7f2b140bcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 shutdown_connections 2023-08-27T11:26:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:26.974+0000 7f2b1b9ff700 1 -- 172.21.15.43:0/4083894272 wait complete. 2023-08-27T11:26:26.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:27.119 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:26:27.118+0000 7f2a131f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:26:27.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.196+0000 7f75fafff700 1 Processor -- start 2023-08-27T11:26:27.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.196+0000 7f75fafff700 1 -- start start 2023-08-27T11:26:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.197+0000 7f75fafff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75f40c51a0 0x7f75f406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.197+0000 7f75fafff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f406d700 con 0x7f75f406ca60 2023-08-27T11:26:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.197+0000 7f75fafff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f4152430 con 0x7f75f4155910 2023-08-27T11:26:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.197+0000 7f75fafff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f41530b0 con 0x7f75f40c51a0 2023-08-27T11:26:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f75f406ca60 0x7f75f40aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52340/0 (socket says 172.21.15.43:52340) 2023-08-27T11:26:27.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f3fff700 1 -- 172.21.15.43:0/2542137532 learned_addr learned my addr 172.21.15.43:0/2542137532 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:27.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f8d9b700 1 --2- 172.21.15.43:0/2542137532 >> v2:172.21.15.57:3300/0 conn(0x7f75f40c51a0 0x7f75f406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277269090 0 0) 0x7f75f406d700 con 0x7f75f406ca60 2023-08-27T11:26:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e40035b0 con 0x7f75f406ca60 2023-08-27T11:26:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f8d9b700 1 -- 172.21.15.43:0/2542137532 >> v1:172.21.15.57:6789/0 conn(0x7f75f4155910 legacy=0x7f75f4155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f8d9b700 1 -- 172.21.15.43:0/2542137532 >> v1:172.21.15.43:6789/0 conn(0x7f75f406ca60 legacy=0x7f75f40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608013735 0 0) 0x7f75e40035b0 con 0x7f75f406ca60 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.198+0000 7f75f8d9b700 1 -- 172.21.15.43:0/2542137532 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4152710 con 0x7f75f40c51a0 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75f8d9b700 1 --2- 172.21.15.43:0/2542137532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f40c51a0 0x7f75f406d1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009840 tx=0x7f75e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49bb9a845075899 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0001670 con 0x7f75f40c51a0 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8004030 con 0x7f75f40c51a0 2023-08-27T11:26:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75f37fe700 1 -- 172.21.15.43:0/2542137532 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80043a0 con 0x7f75f40c51a0 2023-08-27T11:26:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75fafff700 1 -- 172.21.15.43:0/2542137532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f40c51a0 msgr2=0x7f75f406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.199+0000 7f75fafff700 1 --2- 172.21.15.43:0/2542137532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f40c51a0 0x7f75f406d1c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009840 tx=0x7f75e8009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.200+0000 7f75fafff700 1 -- 172.21.15.43:0/2542137532 shutdown_connections 2023-08-27T11:26:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.200+0000 7f75fafff700 1 --2- 172.21.15.43:0/2542137532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f40c51a0 0x7f75f406d1c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.200+0000 7f75fafff700 1 -- 172.21.15.43:0/2542137532 >> 172.21.15.43:0/2542137532 conn(0x7f75f406aa50 msgr2=0x7f75f40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.200+0000 7f75fafff700 1 -- 172.21.15.43:0/2542137532 shutdown_connections 2023-08-27T11:26:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.200+0000 7f75fafff700 1 -- 172.21.15.43:0/2542137532 wait complete. 2023-08-27T11:26:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.202+0000 7f75fafff700 1 Processor -- start 2023-08-27T11:26:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.202+0000 7f75fafff700 1 -- start start 2023-08-27T11:26:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.203+0000 7f75fafff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.203+0000 7f75fafff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75f40c51a0 0x7f75f40bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75fafff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f4155910 0x7f75f40bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75fafff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40bf2a0 con 0x7f75f406ca60 2023-08-27T11:26:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75fafff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40a8280 con 0x7f75f4155910 2023-08-27T11:26:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75fafff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40bc8e0 con 0x7f75f40c51a0 2023-08-27T11:26:27.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56628/0 (socket says 172.21.15.43:56628) 2023-08-27T11:26:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 -- 172.21.15.43:0/3573693309 learned_addr learned my addr 172.21.15.43:0/3573693309 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 -- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75f40c51a0 msgr2=0x7f75f40bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75f40c51a0 0x7f75f40bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 -- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f4155910 msgr2=0x7f75f40bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f4155910 0x7f75f40bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 -- 172.21.15.43:0/3573693309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80094a0 con 0x7f75f406ca60 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.204+0000 7f75f8d9b700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b90 tx=0x7f75e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.205+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8011630 con 0x7f75f406ca60 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.205+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e801f070 con 0x7f75f406ca60 2023-08-27T11:26:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.205+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f41eb290 con 0x7f75f406ca60 2023-08-27T11:26:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.205+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80119f0 con 0x7f75f406ca60 2023-08-27T11:26:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.205+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f4150030 con 0x7f75f406ca60 2023-08-27T11:26:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.206+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f404ee70 con 0x7f75f406ca60 2023-08-27T11:26:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.207+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75e8011b50 con 0x7f75f406ca60 2023-08-27T11:26:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.208+0000 7f75f17fa700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 0x7f75d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.208+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f75e8021070 con 0x7f75f406ca60 2023-08-27T11:26:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.208+0000 7f75f3fff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 0x7f75d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.209+0000 7f75f3fff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 0x7f75d806c5a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f75e0001eb0 tx=0x7f75e0001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.212+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75e80556c0 con 0x7f75f406ca60 2023-08-27T11:26:27.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.468+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f406c840 con 0x7f75f406ca60 2023-08-27T11:26:27.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.468+0000 7f75f17fa700 1 -- 172.21.15.43:0/3573693309 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4881 (secure 0 0 0) 0x7f75e802b090 con 0x7f75f406ca60 2023-08-27T11:26:27.470 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:27.470 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":80,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:26.971666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6798":{"gid":6798,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6836/3766683255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3766683255},{"type":"v1","addr":"172.21.15.43:6836","nonce":3766683255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 msgr2=0x7f75d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 0x7f75d806c5a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f75e0001eb0 tx=0x7f75e0001a20 comp rx=0 tx=0).stop 2023-08-27T11:26:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 msgr2=0x7f75f40bbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b90 tx=0x7f75e8004750 comp rx=0 tx=0).stop 2023-08-27T11:26:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 shutdown_connections 2023-08-27T11:26:27.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f75d806a0e0 0x7f75d806c5a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75f4155910 0x7f75f40bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f406ca60 0x7f75f40bbb50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 --2- 172.21.15.43:0/3573693309 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f75f40c51a0 0x7f75f40bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 >> 172.21.15.43:0/3573693309 conn(0x7f75f406aa50 msgr2=0x7f75f41514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 shutdown_connections 2023-08-27T11:26:27.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.471+0000 7f75fafff700 1 -- 172.21.15.43:0/3573693309 wait complete. 2023-08-27T11:26:27.475 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 80 2023-08-27T11:26:27.490 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.d mds_join_fs cephfs 2023-08-27T11:26:27.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.693+0000 7fdcae7ff700 1 Processor -- start 2023-08-27T11:26:27.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.693+0000 7fdcae7ff700 1 -- start start 2023-08-27T11:26:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcae7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdca80c9690 0x7fdca815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcae7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80c80c0 con 0x7fdca80ac410 2023-08-27T11:26:27.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcae7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca81552c0 con 0x7fdca80c49f0 2023-08-27T11:26:27.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcae7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca81555a0 con 0x7fdca80c9690 2023-08-27T11:26:27.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdca77fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdca80ac410 0x7fdca80c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52346/0 (socket says 172.21.15.43:52346) 2023-08-27T11:26:27.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdca77fe700 1 -- 172.21.15.43:0/2530689129 learned_addr learned my addr 172.21.15.43:0/2530689129 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:27.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcacd9c700 1 --2- 172.21.15.43:0/2530689129 >> v2:172.21.15.43:3300/0 conn(0x7fdca80c9690 0x7fdca815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdca6ffd700 1 -- 172.21.15.43:0/2530689129 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477190648 0 0) 0x7fdca80c80c0 con 0x7fdca80ac410 2023-08-27T11:26:27.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcacd9c700 1 -- 172.21.15.43:0/2530689129 >> v1:172.21.15.57:6789/0 conn(0x7fdca80c49f0 legacy=0x7fdca8151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcacd9c700 1 -- 172.21.15.43:0/2530689129 >> v1:172.21.15.43:6789/0 conn(0x7fdca80ac410 legacy=0x7fdca80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.695+0000 7fdcacd9c700 1 -- 172.21.15.43:0/2530689129 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80c8360 con 0x7fdca80c9690 2023-08-27T11:26:27.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdcacd9c700 1 --2- 172.21.15.43:0/2530689129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca815fef0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61c0f441fef915b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdca6ffd700 1 -- 172.21.15.43:0/2530689129 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000e070 con 0x7fdca80c9690 2023-08-27T11:26:27.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdca6ffd700 1 -- 172.21.15.43:0/2530689129 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000bbd0 con 0x7fdca80c9690 2023-08-27T11:26:27.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdca6ffd700 1 -- 172.21.15.43:0/2530689129 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0012430 con 0x7fdca80c9690 2023-08-27T11:26:27.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdcae7ff700 1 -- 172.21.15.43:0/2530689129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 msgr2=0x7fdca815fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.696+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/2530689129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca815fef0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:27.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.697+0000 7fdcae7ff700 1 -- 172.21.15.43:0/2530689129 shutdown_connections 2023-08-27T11:26:27.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.697+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/2530689129 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca815fef0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.697+0000 7fdcae7ff700 1 -- 172.21.15.43:0/2530689129 >> 172.21.15.43:0/2530689129 conn(0x7fdca80ab8f0 msgr2=0x7fdca80abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:27.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.697+0000 7fdcae7ff700 1 -- 172.21.15.43:0/2530689129 shutdown_connections 2023-08-27T11:26:27.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.697+0000 7fdcae7ff700 1 -- 172.21.15.43:0/2530689129 wait complete. 2023-08-27T11:26:27.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.698+0000 7fdcae7ff700 1 Processor -- start 2023-08-27T11:26:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.699+0000 7fdcae7ff700 1 -- start start 2023-08-27T11:26:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80ac410 0x7fdca80c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdca80c49f0 0x7fdca8155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81e9a90 con 0x7fdca80c9690 2023-08-27T11:26:27.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80aa9b0 con 0x7fdca80ac410 2023-08-27T11:26:27.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcae7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8153cc0 con 0x7fdca80c49f0 2023-08-27T11:26:27.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56642/0 (socket says 172.21.15.43:56642) 2023-08-27T11:26:27.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 -- 172.21.15.43:0/343341990 learned_addr learned my addr 172.21.15.43:0/343341990 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdca7fff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80ac410 0x7fdca80c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdca77fe700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdca80c49f0 0x7fdca8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 -- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdca80c49f0 msgr2=0x7fdca8155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdca80c49f0 0x7fdca8155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 -- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80ac410 msgr2=0x7fdca80c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80ac410 0x7fdca80c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.700+0000 7fdcacd9c700 1 -- 172.21.15.43:0/343341990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009a70 con 0x7fdca80c9690 2023-08-27T11:26:27.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdcacd9c700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdca0014040 tx=0x7fdca0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca001b8a0 con 0x7fdca80c9690 2023-08-27T11:26:27.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0020070 con 0x7fdca80c9690 2023-08-27T11:26:27.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca001bc40 con 0x7fdca80c9690 2023-08-27T11:26:27.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca8153420 con 0x7fdca80c9690 2023-08-27T11:26:27.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.701+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca81539e0 con 0x7fdca80c9690 2023-08-27T11:26:27.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.702+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca80afe10 con 0x7fdca80c9690 2023-08-27T11:26:27.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.703+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdca0026400 con 0x7fdca80c9690 2023-08-27T11:26:27.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.704+0000 7fdca4ff9700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:27.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.704+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fdca008a4d0 con 0x7fdca80c9690 2023-08-27T11:26:27.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.704+0000 7fdca7fff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:27.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.705+0000 7fdca7fff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdca8151f20 tx=0x7fdc98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:27.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.708+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdca0059690 con 0x7fdca80c9690 2023-08-27T11:26:27.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.916+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7fdca81e9bd0 con 0x7fdca80c9690 2023-08-27T11:26:27.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.920+0000 7fdca4ff9700 1 -- 172.21.15.43:0/343341990 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v29)=0 v29) v1 ==== 116+0+0 (secure 0 0 0) 0x7fdca0059220 con 0x7fdca80c9690 2023-08-27T11:26:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 msgr2=0x7fdc9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdca8151f20 tx=0x7fdc98009040 comp rx=0 tx=0).stop 2023-08-27T11:26:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 msgr2=0x7fdca80c10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:27.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdca0014040 tx=0x7fdca0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 shutdown_connections 2023-08-27T11:26:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdc9406a0e0 0x7fdc9406c5a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdca80c9690 0x7fdca80c10b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdca80ac410 0x7fdca80c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 --2- 172.21.15.43:0/343341990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdca80c49f0 0x7fdca8155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 >> 172.21.15.43:0/343341990 conn(0x7fdca80ab8f0 msgr2=0x7fdca806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 shutdown_connections 2023-08-27T11:26:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:27.922+0000 7fdcae7ff700 1 -- 172.21.15.43:0/343341990 wait complete. 2023-08-27T11:26:27.942 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:28.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.142+0000 7fb555bff700 1 Processor -- start 2023-08-27T11:26:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.142+0000 7fb555bff700 1 -- start start 2023-08-27T11:26:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.143+0000 7fb555bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb55006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.143+0000 7fb555bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55006c4e0 con 0x7fb550151a90 2023-08-27T11:26:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.143+0000 7fb555bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb550155370 con 0x7fb5500c4630 2023-08-27T11:26:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.143+0000 7fb555bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c82c0 con 0x7fb5500c4a90 2023-08-27T11:26:28.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb550151a90 0x7fb5500c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:52362/0 (socket says 172.21.15.43:52362) 2023-08-27T11:26:28.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54f7fe700 1 -- 172.21.15.43:0/3985596306 learned_addr learned my addr 172.21.15.43:0/3985596306 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:28.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54ffff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb55006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080769657 0 0) 0x7fb55006c4e0 con 0x7fb550151a90 2023-08-27T11:26:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5380035b0 con 0x7fb550151a90 2023-08-27T11:26:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287025452 0 0) 0x7fb5380035b0 con 0x7fb550151a90 2023-08-27T11:26:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 msgr2=0x7fb55006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb55006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 >> v1:172.21.15.57:6789/0 conn(0x7fb5500c4630 legacy=0x7fb55006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550151e70 con 0x7fb550151a90 2023-08-27T11:26:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb540001670 con 0x7fb550151a90 2023-08-27T11:26:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.144+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 >> v1:172.21.15.43:6789/0 conn(0x7fb550151a90 legacy=0x7fb5500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb538003a30 0x7fb538003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb538004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb538004d90 0x7fb538005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500c82c0 con 0x7fb538004d90 2023-08-27T11:26:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53800baf0 con 0x7fb538003a30 2023-08-27T11:26:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53800bcb0 con 0x7fb5500c4a90 2023-08-27T11:26:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb538004d90 0x7fb538005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54f7fe700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb538003a30 0x7fb538003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54effd700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb538004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 -- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 msgr2=0x7fb538004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb5500c4a90 0x7fb538004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 -- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb538003a30 msgr2=0x7fb538003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb538003a30 0x7fb538003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54ffff700 1 -- 172.21.15.43:0/3985596306 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380035b0 con 0x7fb538004d90 2023-08-27T11:26:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.145+0000 7fb54f7fe700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb538003a30 0x7fb538003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb54ffff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb538004d90 0x7fb538005210 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb538005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d53c0e839b11 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54800ec30 con 0x7fb538004d90 2023-08-27T11:26:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54800f040 con 0x7fb538004d90 2023-08-27T11:26:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb54e7fc700 1 -- 172.21.15.43:0/3985596306 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548014480 con 0x7fb538004d90 2023-08-27T11:26:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 -- 172.21.15.43:0/3985596306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb538004d90 msgr2=0x7fb538005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 --2- 172.21.15.43:0/3985596306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb538004d90 0x7fb538005210 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb548009fc0 tx=0x7fb538005880 comp rx=0 tx=0).stop 2023-08-27T11:26:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb54ffff700 1 -- 172.21.15.43:0/3985596306 reap_dead start 2023-08-27T11:26:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 -- 172.21.15.43:0/3985596306 shutdown_connections 2023-08-27T11:26:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 -- 172.21.15.43:0/3985596306 >> 172.21.15.43:0/3985596306 conn(0x7fb5500ab820 msgr2=0x7fb5500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 -- 172.21.15.43:0/3985596306 shutdown_connections 2023-08-27T11:26:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.146+0000 7fb555bff700 1 -- 172.21.15.43:0/3985596306 wait complete. 2023-08-27T11:26:28.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.148+0000 7fb555bff700 1 Processor -- start 2023-08-27T11:26:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.148+0000 7fb555bff700 1 -- start start 2023-08-27T11:26:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb538004d90 0x7fb5501ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb550148ae0 0x7fb550148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501ede50 con 0x7fb55014e0e0 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5501565b0 con 0x7fb550148ae0 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb555bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550156890 con 0x7fb538004d90 2023-08-27T11:26:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.149+0000 7fb54effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56650/0 (socket says 172.21.15.43:56650) 2023-08-27T11:26:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 -- 172.21.15.43:0/1910447982 learned_addr learned my addr 172.21.15.43:0/1910447982 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54ffff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb550148ae0 0x7fb550148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54f7fe700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb538004d90 0x7fb5501ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 -- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb538004d90 msgr2=0x7fb5501ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb538004d90 0x7fb5501ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 -- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb550148ae0 msgr2=0x7fb550148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb550148ae0 0x7fb550148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 -- 172.21.15.43:0/1910447982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55014d870 con 0x7fb55014e0e0 2023-08-27T11:26:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb54effd700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e800 tx=0x7fb54400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440052e0 con 0x7fb55014e0e0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544005460 con 0x7fb55014e0e0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5501494d0 con 0x7fb55014e0e0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.150+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440038c0 con 0x7fb55014e0e0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.151+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550158620 con 0x7fb55014e0e0 2023-08-27T11:26:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.151+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb550156410 con 0x7fb55014e0e0 2023-08-27T11:26:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.153+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb544003a20 con 0x7fb55014e0e0 2023-08-27T11:26:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.153+0000 7fb537fff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 0x7fb53c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.153+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fb544088220 con 0x7fb55014e0e0 2023-08-27T11:26:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.154+0000 7fb54f7fe700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 0x7fb53c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.154+0000 7fb54f7fe700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 0x7fb53c06c5a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb540005a80 tx=0x7fb540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:28.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.158+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb550156410 con 0x7fb55014e0e0 2023-08-27T11:26:28.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.414+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb550156410 con 0x7fb55014e0e0 2023-08-27T11:26:28.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.415+0000 7fb537fff700 1 -- 172.21.15.43:0/1910447982 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fb550156410 con 0x7fb55014e0e0 2023-08-27T11:26:28.417 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:28.417 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":80,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6328,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":67},{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":80,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:26.971666+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6798":{"gid":6798,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.43:6836/3766683255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3766683255},{"type":"v1","addr":"172.21.15.43:6836","nonce":3766683255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:28.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 msgr2=0x7fb53c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 0x7fb53c06c5a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb540005a80 tx=0x7fb540009040 comp rx=0 tx=0).stop 2023-08-27T11:26:28.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 msgr2=0x7fb5501ed830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb54400e800 tx=0x7fb54400eb10 comp rx=0 tx=0).stop 2023-08-27T11:26:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 shutdown_connections 2023-08-27T11:26:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb53c06a0e0 0x7fb53c06c5a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb550148ae0 0x7fb550148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb538004d90 0x7fb5501ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 --2- 172.21.15.43:0/1910447982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb55014e0e0 0x7fb5501ed830 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:28.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 >> 172.21.15.43:0/1910447982 conn(0x7fb5500ab820 msgr2=0x7fb55014b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:28.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.417+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 shutdown_connections 2023-08-27T11:26:28.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:28.418+0000 7fb555bff700 1 -- 172.21.15.43:0/1910447982 wait complete. 2023-08-27T11:26:28.422 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 80 2023-08-27T11:26:28.839 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:26.971666+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_6798': {'gid': 6798, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6836/3766683255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3766683255}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3766683255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:28.840 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:26:28.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:26:29.037 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:26:29.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.054+0000 7fc3399ff700 1 Processor -- start 2023-08-27T11:26:29.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.054+0000 7fc3399ff700 1 -- start start 2023-08-27T11:26:29.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.055+0000 7fc3399ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 0x7fc3340c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.055+0000 7fc3399ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc334154740 0x7fc3340c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.055+0000 7fc3399ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc334154d00 con 0x7fc33414e960 2023-08-27T11:26:29.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.055+0000 7fc3399ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3340baf30 con 0x7fc334154740 2023-08-27T11:26:29.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.055+0000 7fc3399ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc334154fe0 con 0x7fc3340c50d0 2023-08-27T11:26:29.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc332ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc33414e960 0x7fc3340a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42170/0 (socket says 172.21.15.43:42170) 2023-08-27T11:26:29.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc332ffd700 1 -- 172.21.15.43:0/786274447 learned_addr learned my addr 172.21.15.43:0/786274447 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:29.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3327fc700 1 --2- 172.21.15.43:0/786274447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 0x7fc3340c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3337fe700 1 --2- 172.21.15.43:0/786274447 >> v2:172.21.15.57:3300/0 conn(0x7fc334154740 0x7fc3340c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc331ffb700 1 -- 172.21.15.43:0/786274447 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573339980 0 0) 0x7fc334154d00 con 0x7fc33414e960 2023-08-27T11:26:29.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc331ffb700 1 -- 172.21.15.43:0/786274447 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc31c0035b0 con 0x7fc33414e960 2023-08-27T11:26:29.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3327fc700 1 -- 172.21.15.43:0/786274447 >> v2:172.21.15.57:3300/0 conn(0x7fc334154740 msgr2=0x7fc3340c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3327fc700 1 --2- 172.21.15.43:0/786274447 >> v2:172.21.15.57:3300/0 conn(0x7fc334154740 0x7fc3340c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3327fc700 1 -- 172.21.15.43:0/786274447 >> v1:172.21.15.43:6789/0 conn(0x7fc33414e960 legacy=0x7fc3340a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.056+0000 7fc3327fc700 1 -- 172.21.15.43:0/786274447 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3341552c0 con 0x7fc3340c50d0 2023-08-27T11:26:29.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.057+0000 7fc3327fc700 1 --2- 172.21.15.43:0/786274447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 0x7fc3340c3cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc328009840 tx=0x7fc328009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20119b8f47b1c887 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.057+0000 7fc331ffb700 1 -- 172.21.15.43:0/786274447 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011830 con 0x7fc3340c50d0 2023-08-27T11:26:29.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.057+0000 7fc331ffb700 1 -- 172.21.15.43:0/786274447 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328011990 con 0x7fc3340c50d0 2023-08-27T11:26:29.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.057+0000 7fc331ffb700 1 -- 172.21.15.43:0/786274447 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328011d20 con 0x7fc3340c50d0 2023-08-27T11:26:29.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 -- 172.21.15.43:0/786274447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 msgr2=0x7fc3340c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 --2- 172.21.15.43:0/786274447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 0x7fc3340c3cc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc328009840 tx=0x7fc328009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:29.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 -- 172.21.15.43:0/786274447 shutdown_connections 2023-08-27T11:26:29.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 --2- 172.21.15.43:0/786274447 >> v2:172.21.15.57:3300/0 conn(0x7fc334154740 0x7fc3340c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 --2- 172.21.15.43:0/786274447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc3340c50d0 0x7fc3340c3cc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 -- 172.21.15.43:0/786274447 >> 172.21.15.43:0/786274447 conn(0x7fc33406aa50 msgr2=0x7fc3340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 -- 172.21.15.43:0/786274447 shutdown_connections 2023-08-27T11:26:29.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.058+0000 7fc3399ff700 1 -- 172.21.15.43:0/786274447 wait complete. 2023-08-27T11:26:29.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.060+0000 7fc3399ff700 1 Processor -- start 2023-08-27T11:26:29.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.060+0000 7fc3399ff700 1 -- start start 2023-08-27T11:26:29.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.061+0000 7fc3399ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3340c50d0 0x7fc3340a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.061+0000 7fc3399ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3399ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc334154740 0x7fc33413dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3399ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc334152760 con 0x7fc33414e960 2023-08-27T11:26:29.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3399ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340a9670 con 0x7fc3340c50d0 2023-08-27T11:26:29.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3399ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3340a9370 con 0x7fc334154740 2023-08-27T11:26:29.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56310/0 (socket says 172.21.15.43:56310) 2023-08-27T11:26:29.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 -- 172.21.15.43:0/2927340694 learned_addr learned my addr 172.21.15.43:0/2927340694 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:29.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3340c50d0 0x7fc3340a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3337fe700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc334154740 0x7fc33413dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 -- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc334154740 msgr2=0x7fc33413dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc334154740 0x7fc33413dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 -- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3340c50d0 msgr2=0x7fc3340a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3340c50d0 0x7fc3340a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.062+0000 7fc3327fc700 1 -- 172.21.15.43:0/2927340694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280094a0 con 0x7fc33414e960 2023-08-27T11:26:29.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc31bfff700 1 -- 172.21.15.43:0/2927340694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328004590 con 0x7fc33414e960 2023-08-27T11:26:29.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc31bfff700 1 -- 172.21.15.43:0/2927340694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32801f070 con 0x7fc33414e960 2023-08-27T11:26:29.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc31bfff700 1 -- 172.21.15.43:0/2927340694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280038e0 con 0x7fc33414e960 2023-08-27T11:26:29.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc334142d00 con 0x7fc33414e960 2023-08-27T11:26:29.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.063+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc334146ed0 con 0x7fc33414e960 2023-08-27T11:26:29.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.065+0000 7fc31bfff700 1 -- 172.21.15.43:0/2927340694 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc328003a40 con 0x7fc33414e960 2023-08-27T11:26:29.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.066+0000 7fc31bfff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 0x7fc32006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.066+0000 7fc31bfff700 1 -- 172.21.15.43:0/2927340694 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc328021070 con 0x7fc33414e960 2023-08-27T11:26:29.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.066+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 0x7fc32006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.067+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 0x7fc32006c5a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fd0 tx=0x7fc324007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.068+0000 7fc34d3b5b80 1 Processor -- start 2023-08-27T11:26:29.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.068+0000 7fc34d3b5b80 1 -- start start 2023-08-27T11:26:29.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 0x562669d242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d39500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669c5e730 con 0x562669d00f00 2023-08-27T11:26:29.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669c5c050 con 0x562669d012e0 2023-08-27T11:26:29.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562669c57940 con 0x562669d06fe0 2023-08-27T11:26:29.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56322/0 (socket says 172.21.15.43:56322) 2023-08-27T11:26:29.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.069+0000 7fc332ffd700 1 -- 172.21.15.43:0/235841334 learned_addr learned my addr 172.21.15.43:0/235841334 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:29.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3337fe700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d39500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3327fc700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 0x562669d242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 -- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 msgr2=0x562669d242b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 0x562669d242b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 -- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 msgr2=0x562669d39500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d39500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 -- 172.21.15.43:0/235841334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562669ad75e0 con 0x562669d00f00 2023-08-27T11:26:29.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3337fe700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d39500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:29.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3327fc700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 0x562669d242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:29.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc332ffd700 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fa0 tx=0x7fc324012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c8dde4939dc547 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3197fa700 1 -- 172.21.15.43:0/235841334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324006340 con 0x562669d00f00 2023-08-27T11:26:29.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3197fa700 1 -- 172.21.15.43:0/235841334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3240064a0 con 0x562669d00f00 2023-08-27T11:26:29.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.070+0000 7fc3197fa700 1 -- 172.21.15.43:0/235841334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324006810 con 0x562669d00f00 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/235841334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 msgr2=0x562669d23d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fa0 tx=0x7fc324012000 comp rx=0 tx=0).stop 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/235841334 shutdown_connections 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d39500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d23d70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/235841334 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d06fe0 0x562669d242b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/235841334 >> 172.21.15.43:0/235841334 conn(0x562669c63c30 msgr2=0x562669d036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/235841334 shutdown_connections 2023-08-27T11:26:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.071+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/235841334 wait complete. 2023-08-27T11:26:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.072+0000 7fc34d3b5b80 1 -- start start 2023-08-27T11:26:29.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.072+0000 7fc34d3b5b80 1 Processor -- start 2023-08-27T11:26:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d3cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d54ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669bf5b60 con 0x562669d3d4e0 2023-08-27T11:26:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669bf5860 con 0x562669d012e0 2023-08-27T11:26:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562669ad98d0 con 0x562669d00f00 2023-08-27T11:26:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc34d3b5b80 10 client.0 _ll_register_callbacks cb 0x562669bf3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:29.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56334/0 (socket says 172.21.15.43:56334) 2023-08-27T11:26:29.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.074+0000 7fc3337fe700 1 -- 172.21.15.43:0/2976304606 learned_addr learned my addr 172.21.15.43:0/2976304606 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:29.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d3cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d54ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 -- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 msgr2=0x562669d3cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d3cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 -- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 msgr2=0x562669d54ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d54ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 -- 172.21.15.43:0/2976304606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0035b0 con 0x562669d3d4e0 2023-08-27T11:26:29.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3337fe700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007dd0 tx=0x7fc32c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5376f71800d61126 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3127fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:29.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00e040 con 0x562669d3d4e0 2023-08-27T11:26:29.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562669cf84f0 con 0x562669d3d4e0 2023-08-27T11:26:29.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.075+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc32c003c20 con 0x562669d3d4e0 2023-08-27T11:26:29.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc32c003de0 con 0x562669d3d4e0 2023-08-27T11:26:29.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 10 client.6873 fetch_fsmap learned FSMap version 82 2023-08-27T11:26:29.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x562669c6f750 con 0x562669d3d4e0 2023-08-27T11:26:29.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562669cf84f0 con 0x562669d3d4e0 2023-08-27T11:26:29.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 82) v1 ==== 2707+0+0 (secure 0 0 0) 0x7fc32c013960 con 0x562669d3d4e0 2023-08-27T11:26:29.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 10 client.6873 fetch_fsmap finished waiting for FSMap version 82 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 10 client.6873 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 20 client.6873 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d41730 0x562669d21d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 4 client.6873 mds_command: new command op to 6322 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562669c50920 con 0x562669d41730 2023-08-27T11:26:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.076+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d41730 0x562669d21d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.077+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d41730 0x562669d21d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a94fe4b0d5ad48 server_cookie=a3b3b42f4728d7b1 in_seq=0 out_seq=0 2023-08-27T11:26:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.077+0000 7fc3127fc700 10 client.6873 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.077+0000 7fc3127fc700 1 -- 172.21.15.43:0/2976304606 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562669c50920 con 0x562669d41730 2023-08-27T11:26:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.077+0000 7fc3127fc700 10 client.6873 handle_command_reply: tid=0 2023-08-27T11:26:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 client.6873 shutdown 2023-08-27T11:26:29.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 msgr2=0x562669d55220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc32c007dd0 tx=0x7fc32c007eb0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 shutdown_connections 2023-08-27T11:26:29.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d41730 0x562669d21d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d3d4e0 0x562669d55220 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d3cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2976304606 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d54ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc3127fc700 0 client.6873 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 >> 172.21.15.43:0/2976304606 conn(0x562669c63c30 msgr2=0x562669cfeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 shutdown_connections 2023-08-27T11:26:29.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2976304606 wait complete. 2023-08-27T11:26:29.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.078+0000 7fc34d3b5b80 20 client.6873 trim_cache size 0 max 16384 2023-08-27T11:26:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.096+0000 7fc34d3b5b80 1 Processor -- start 2023-08-27T11:26:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.096+0000 7fc34d3b5b80 1 -- start start 2023-08-27T11:26:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d54ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 0x562669d3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669d016c0 con 0x562669d012e0 2023-08-27T11:26:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669d00b70 con 0x562669d3d4e0 2023-08-27T11:26:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.097+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562669d555e0 con 0x562669d00f00 2023-08-27T11:26:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56340/0 (socket says 172.21.15.43:56340) 2023-08-27T11:26:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 -- 172.21.15.43:0/1074548123 learned_addr learned my addr 172.21.15.43:0/1074548123 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 -- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 msgr2=0x562669d54ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc332ffd700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d54ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3337fe700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 0x562669d3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d54ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 -- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 msgr2=0x562669d3c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 0x562669d3c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 -- 172.21.15.43:0/1074548123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562669a83d90 con 0x562669d012e0 2023-08-27T11:26:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc332ffd700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d54ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3337fe700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 0x562669d3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:29.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc3327fc700 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc328088010 tx=0x7fc328059f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3de974425c893c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc319ffb700 1 -- 172.21.15.43:0/1074548123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328059680 con 0x562669d012e0 2023-08-27T11:26:29.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc319ffb700 1 -- 172.21.15.43:0/1074548123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32805cdb0 con 0x562669d012e0 2023-08-27T11:26:29.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.098+0000 7fc319ffb700 1 -- 172.21.15.43:0/1074548123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328060d00 con 0x562669d012e0 2023-08-27T11:26:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/1074548123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 msgr2=0x562669d3c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc328088010 tx=0x7fc328059f90 comp rx=0 tx=0).stop 2023-08-27T11:26:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/1074548123 shutdown_connections 2023-08-27T11:26:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d3d4e0 0x562669d3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d00f00 0x562669d54ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/1074548123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d012e0 0x562669d3c1b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/1074548123 >> 172.21.15.43:0/1074548123 conn(0x562669c63c30 msgr2=0x562669cfc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/1074548123 shutdown_connections 2023-08-27T11:26:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.099+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/1074548123 wait complete. 2023-08-27T11:26:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.100+0000 7fc34d3b5b80 1 -- start start 2023-08-27T11:26:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.100+0000 7fc34d3b5b80 1 Processor -- start 2023-08-27T11:26:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d3af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d3d4e0 0x562669d21b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669d3c030 con 0x562669d00f00 2023-08-27T11:26:29.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562669d3bc10 con 0x562669d012e0 2023-08-27T11:26:29.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562669d05d80 con 0x562669d3d4e0 2023-08-27T11:26:29.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc34d3b5b80 10 client.0 _ll_register_callbacks cb 0x562669bf3630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc332ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56342/0 (socket says 172.21.15.43:56342) 2023-08-27T11:26:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc332ffd700 1 -- 172.21.15.43:0/2442612272 learned_addr learned my addr 172.21.15.43:0/2442612272 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc3337fe700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d3d4e0 0x562669d21b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.101+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d3af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 -- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d3d4e0 msgr2=0x562669d21b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d3d4e0 0x562669d21b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 -- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 msgr2=0x562669d3af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d3af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 -- 172.21.15.43:0/2442612272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc334146ed0 con 0x562669d00f00 2023-08-27T11:26:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc332ffd700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc32401f000 tx=0x7fc324000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c2858be294a518 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc3127fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324034070 con 0x562669d00f00 2023-08-27T11:26:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3240064a0 con 0x562669d00f00 2023-08-27T11:26:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fc32401b050 con 0x562669d00f00 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.102+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc324006340 con 0x562669d00f00 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 10 client.6879 fetch_fsmap learned FSMap version 82 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x562669a6cc10 con 0x562669d00f00 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3240064a0 con 0x562669d00f00 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 82) v1 ==== 2707+0+0 (secure 0 0 0) 0x7fc324012070 con 0x562669d00f00 2023-08-27T11:26:29.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 10 client.6879 fetch_fsmap finished waiting for FSMap version 82 2023-08-27T11:26:29.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 10 client.6879 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:29.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 20 client.6879 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:29.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d220a0 0x562669d22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:29.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 4 client.6879 mds_command: new command op to 6322 tid=0[{"prefix": "status"}] 2023-08-27T11:26:29.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562669c11000 con 0x562669d220a0 2023-08-27T11:26:29.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.103+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d220a0 0x562669d22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:29.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc3327fc700 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d220a0 0x562669d22480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd1fcb1a7038a57 server_cookie=380c041c59948287 in_seq=0 out_seq=0 2023-08-27T11:26:29.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc3127fc700 10 client.6879 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:29.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc3127fc700 1 -- 172.21.15.43:0/2442612272 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x562669c11000 con 0x562669d220a0 2023-08-27T11:26:29.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc3127fc700 10 client.6879 handle_command_reply: tid=0 2023-08-27T11:26:29.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 client.6879 shutdown 2023-08-27T11:26:29.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 msgr2=0x562669d44f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc32401f000 tx=0x7fc324000ed0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 shutdown_connections 2023-08-27T11:26:29.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562669d3d4e0 0x562669d21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x562669d220a0 0x562669d22480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562669d00f00 0x562669d44f30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 --2- 172.21.15.43:0/2442612272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562669d012e0 0x562669d3af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 >> 172.21.15.43:0/2442612272 conn(0x562669c63c30 msgr2=0x562669d54ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc3127fc700 0 client.6879 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:29.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 shutdown_connections 2023-08-27T11:26:29.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.104+0000 7fc34d3b5b80 1 -- 172.21.15.43:0/2442612272 wait complete. 2023-08-27T11:26:29.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc34d3b5b80 20 client.6879 trim_cache size 0 max 16384 2023-08-27T11:26:29.121 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:26:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:26:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6322, 2023-08-27T11:26:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:26:29.122 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 7.17670238, 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 82, 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 82, 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 82, 2023-08-27T11:26:29.123 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 28.176344131 2023-08-27T11:26:29.124 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 msgr2=0x7fc32006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 0x7fc32006c5a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fd0 tx=0x7fc324007dc0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 msgr2=0x7fc334146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328004750 comp rx=0 tx=0).stop 2023-08-27T11:26:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 shutdown_connections 2023-08-27T11:26:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc32006a0e0 0x7fc32006c5a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc334154740 0x7fc33413dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3340c50d0 0x7fc3340a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 --2- 172.21.15.43:0/2927340694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc33414e960 0x7fc334146990 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:29.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 >> 172.21.15.43:0/2927340694 conn(0x7fc33406aa50 msgr2=0x7fc3340c3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:29.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 shutdown_connections 2023-08-27T11:26:29.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:29.105+0000 7fc3399ff700 1 -- 172.21.15.43:0/2927340694 wait complete. 2023-08-27T11:26:29.128 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 6, "epoch": 80, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 6, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:12.678531+0000", "damaged": [], "data_pools": [ 14 ], "enabled": true, "epoch": 80, "ever_allowed_features": 32, "explicitly_allowed_features": 32, "failed": [], "flags": 50, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": true, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6322": { "addr": "172.21.15.43:6837/3998632195", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 3998632195, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 3998632195, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6322, "incarnation": 75, "join_fscid": 6, "name": "c", "rank": 0, "state": "up:active", "state_seq": 9 }, "gid_6798": { "addr": "172.21.15.43:6836/3766683255", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3766683255, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3766683255, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6798, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:standby-replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 82, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 13, "modified": "2023-08-27T11:26:26.971666+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6322 } } } ], "standbys": [ { "addr": "172.21.15.57:6833/1640307202", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 1640307202, "type": "v2" }, { "addr": "172.21.15.57:6833", "nonce": 1640307202, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 67, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6328, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/432356370", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6834", "nonce": 432356370, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 432356370, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 68, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6334, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:26:29.129 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 6, 'name': 'c', 'state': 'up:active'}, {'join_fscid': 6, 'name': 'd', 'state': 'up:standby-replay'}] 2023-08-27T11:26:29.129 INFO:tasks.cephfs.test_failover:current = [{'gid': 6798, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.43:6836/3766683255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3766683255}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3766683255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6334, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/432356370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 432356370}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 432356370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 68}, {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6328, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6833/1640307202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1640307202}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1640307202}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 67}] 2023-08-27T11:26:29.130 DEBUG:tasks.cephfs.test_failover:6 != -1 2023-08-27T11:26:29.130 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:26:34.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:34.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.345+0000 7fb38a3ff700 1 Processor -- start 2023-08-27T11:26:34.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.345+0000 7fb38a3ff700 1 -- start start 2023-08-27T11:26:34.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.346+0000 7fb38a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb38406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.346+0000 7fb38a3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb384155910 0x7fb384155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.346+0000 7fb38a3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38406d700 con 0x7fb38406ca60 2023-08-27T11:26:34.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.346+0000 7fb38a3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3841530b0 con 0x7fb384155910 2023-08-27T11:26:34.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.346+0000 7fb38a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38414c860 con 0x7fb3840c51a0 2023-08-27T11:26:34.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb384155910 0x7fb384155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb384155910 0x7fb384155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:34598/0 (socket says 172.21.15.43:34598) 2023-08-27T11:26:34.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb3837fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb38406ca60 0x7fb3840aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:37642/0 (socket says 172.21.15.43:37642) 2023-08-27T11:26:34.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 -- 172.21.15.43:0/3010029437 learned_addr learned my addr 172.21.15.43:0/3010029437 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:34.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb383fff700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb38406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 -- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 msgr2=0x7fb38406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:34.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb38406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 -- 172.21.15.43:0/3010029437 >> v1:172.21.15.57:6789/0 conn(0x7fb38406ca60 legacy=0x7fb3840aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 -- 172.21.15.43:0/3010029437 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384152430 con 0x7fb384155910 2023-08-27T11:26:34.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.347+0000 7fb38899c700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb384155910 0x7fb384155da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e80 tx=0x7fb37c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a139b76a238cf535 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:34.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb382ffd700 1 -- 172.21.15.43:0/3010029437 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00e070 con 0x7fb384155910 2023-08-27T11:26:34.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb382ffd700 1 -- 172.21.15.43:0/3010029437 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c00b8d0 con 0x7fb384155910 2023-08-27T11:26:34.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb382ffd700 1 -- 172.21.15.43:0/3010029437 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00bc80 con 0x7fb384155910 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 -- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb384155910 msgr2=0x7fb384155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb384155910 0x7fb384155da0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009e80 tx=0x7fb37c00b330 comp rx=0 tx=0).stop 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 -- 172.21.15.43:0/3010029437 shutdown_connections 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb384155910 0x7fb384155da0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/3010029437 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb38406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 -- 172.21.15.43:0/3010029437 >> 172.21.15.43:0/3010029437 conn(0x7fb38406aa50 msgr2=0x7fb3840c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:34.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 -- 172.21.15.43:0/3010029437 shutdown_connections 2023-08-27T11:26:34.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.348+0000 7fb38a3ff700 1 -- 172.21.15.43:0/3010029437 wait complete. 2023-08-27T11:26:34.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.350+0000 7fb38a3ff700 1 Processor -- start 2023-08-27T11:26:34.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.350+0000 7fb38a3ff700 1 -- start start 2023-08-27T11:26:34.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb38406ca60 0x7fb384150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb3840a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840a5600 con 0x7fb384155910 2023-08-27T11:26:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840a6b10 con 0x7fb38406ca60 2023-08-27T11:26:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.351+0000 7fb38a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3840aa4d0 con 0x7fb3840c51a0 2023-08-27T11:26:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56356/0 (socket says 172.21.15.43:56356) 2023-08-27T11:26:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 -- 172.21.15.43:0/2730916774 learned_addr learned my addr 172.21.15.43:0/2730916774 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb383fff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb38406ca60 0x7fb384150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb3837fe700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb3840a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 -- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 msgr2=0x7fb3840a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb3840a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 -- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb38406ca60 msgr2=0x7fb384150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb38406ca60 0x7fb384150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 -- 172.21.15.43:0/2730916774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c009b30 con 0x7fb384155910 2023-08-27T11:26:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb38899c700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb38406de40 tx=0x7fb37c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:34.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.352+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c0048b0 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.353+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37c0092e0 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.353+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3840a8360 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.353+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37c01b650 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.353+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3840a8080 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.354+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3840a5740 con 0x7fb384155910 2023-08-27T11:26:34.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.355+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb37c01b7b0 con 0x7fb384155910 2023-08-27T11:26:34.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.356+0000 7fb380ff9700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 0x7fb37006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:34.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.356+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fb37c089c60 con 0x7fb384155910 2023-08-27T11:26:34.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.356+0000 7fb383fff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 0x7fb37006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:34.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.357+0000 7fb383fff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 0x7fb37006c5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb374009be0 tx=0x7fb374009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:34.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.361+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb37c055270 con 0x7fb384155910 2023-08-27T11:26:34.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.615+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb38404ee70 con 0x7fb384155910 2023-08-27T11:26:34.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.616+0000 7fb380ff9700 1 -- 172.21.15.43:0/2730916774 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4879 (secure 0 0 0) 0x7fb37c058890 con 0x7fb384155910 2023-08-27T11:26:34.618 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:34.618 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":82,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:28.986106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6328":{"gid":6328,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":8,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:34.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.618+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 msgr2=0x7fb37006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.618+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 0x7fb37006c5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb374009be0 tx=0x7fb374009210 comp rx=0 tx=0).stop 2023-08-27T11:26:34.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.618+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 msgr2=0x7fb3840a5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:34.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.618+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb38406de40 tx=0x7fb37c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 shutdown_connections 2023-08-27T11:26:34.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37006a0e0 0x7fb37006c5a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb384155910 0x7fb3840a5f60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb38406ca60 0x7fb384150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 --2- 172.21.15.43:0/2730916774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3840c51a0 0x7fb3840a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:34.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 >> 172.21.15.43:0/2730916774 conn(0x7fb38406aa50 msgr2=0x7fb3840aab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:34.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 shutdown_connections 2023-08-27T11:26:34.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:34.619+0000 7fb38a3ff700 1 -- 172.21.15.43:0/2730916774 wait complete. 2023-08-27T11:26:34.623 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 83 2023-08-27T11:26:35.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-08-27T11:26:12.678531+0000', 'modified': '2023-08-27T11:26:28.986106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6322': {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_6328': {'gid': 6328, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 8, 'addr': '172.21.15.57:6833/1640307202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1640307202}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1640307202}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:26:35.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:26:35.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:26:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.243+0000 7f97359ff700 1 Processor -- start 2023-08-27T11:26:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.243+0000 7f97359ff700 1 -- start start 2023-08-27T11:26:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.244+0000 7f97359ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f973006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f97359ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973006d700 con 0x7f973006ca60 2023-08-27T11:26:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f97359ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9730152430 con 0x7f9730155910 2023-08-27T11:26:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f97359ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97301530b0 con 0x7f97300c51a0 2023-08-27T11:26:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f9727fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f973006ca60 0x7f97300aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42178/0 (socket says 172.21.15.43:42178) 2023-08-27T11:26:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f9727fff700 1 -- 172.21.15.43:0/2540373772 learned_addr learned my addr 172.21.15.43:0/2540373772 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f972effd700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f973006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583008364 0 0) 0x7f973006d700 con 0x7f973006ca60 2023-08-27T11:26:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.245+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c0035b0 con 0x7f973006ca60 2023-08-27T11:26:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4177631166 0 0) 0x7f971c0035b0 con 0x7f973006ca60 2023-08-27T11:26:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 msgr2=0x7f973006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f973006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 >> v1:172.21.15.57:6789/0 conn(0x7f9730155910 legacy=0x7f9730155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730152710 con 0x7f973006ca60 2023-08-27T11:26:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f9718001670 con 0x7f973006ca60 2023-08-27T11:26:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 >> v1:172.21.15.43:6789/0 conn(0x7f973006ca60 legacy=0x7f97300aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f971c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f971c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c004d90 0x7f971c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301530b0 con 0x7f971c003a30 2023-08-27T11:26:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c00bba0 con 0x7f971c004d90 2023-08-27T11:26:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c00bd60 con 0x7f97300c51a0 2023-08-27T11:26:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f971c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f9727fff700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f971c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972f7fe700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c004d90 0x7f971c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 -- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 msgr2=0x7f971c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f971c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 -- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c004d90 msgr2=0x7f971c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c004d90 0x7f971c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972effd700 1 -- 172.21.15.43:0/2540373772 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0035b0 con 0x7f971c003a30 2023-08-27T11:26:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f972f7fe700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f971c004d90 0x7f971c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.246+0000 7f9727fff700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300c51a0 0x7f971c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f972effd700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f971c003e50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9720009b60 tx=0x7f971c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef7dc4f096427f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972000e6c0 con 0x7f971c003a30 2023-08-27T11:26:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972000e820 con 0x7f971c003a30 2023-08-27T11:26:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f972e7fc700 1 -- 172.21.15.43:0/2540373772 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972000eb90 con 0x7f971c003a30 2023-08-27T11:26:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f97359ff700 1 -- 172.21.15.43:0/2540373772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 msgr2=0x7f971c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f97359ff700 1 --2- 172.21.15.43:0/2540373772 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f971c003e50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9720009b60 tx=0x7f971c005880 comp rx=0 tx=0).stop 2023-08-27T11:26:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f972f7fe700 1 -- 172.21.15.43:0/2540373772 reap_dead start 2023-08-27T11:26:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f97359ff700 1 -- 172.21.15.43:0/2540373772 shutdown_connections 2023-08-27T11:26:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.247+0000 7f97359ff700 1 -- 172.21.15.43:0/2540373772 >> 172.21.15.43:0/2540373772 conn(0x7f973006aa50 msgr2=0x7f97300c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.248+0000 7f97359ff700 1 -- 172.21.15.43:0/2540373772 shutdown_connections 2023-08-27T11:26:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.248+0000 7f97359ff700 1 -- 172.21.15.43:0/2540373772 wait complete. 2023-08-27T11:26:35.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.249+0000 7f97359ff700 1 Processor -- start 2023-08-27T11:26:35.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.249+0000 7f97359ff700 1 -- start start 2023-08-27T11:26:35.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300bc8e0 0x7f97300be750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97300bec90 0x7f97301eac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730149a60 con 0x7f971c003a30 2023-08-27T11:26:35.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301eb6a0 con 0x7f97300bec90 2023-08-27T11:26:35.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f97359ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300bdf50 con 0x7f97300bc8e0 2023-08-27T11:26:35.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.250+0000 7f972effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56372/0 (socket says 172.21.15.43:56372) 2023-08-27T11:26:35.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 -- 172.21.15.43:0/426564607 learned_addr learned my addr 172.21.15.43:0/426564607 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972f7fe700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97300bec90 0x7f97301eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f9727fff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300bc8e0 0x7f97300be750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 -- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300bc8e0 msgr2=0x7f97300be750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300bc8e0 0x7f97300be750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 -- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97300bec90 msgr2=0x7f97301eac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97300bec90 0x7f97301eac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 -- 172.21.15.43:0/426564607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300be230 con 0x7f971c003a30 2023-08-27T11:26:35.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972effd700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f971c005810 tx=0x7f97200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972cff9700 1 -- 172.21.15.43:0/426564607 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720021070 con 0x7f971c003a30 2023-08-27T11:26:35.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.251+0000 7f972cff9700 1 -- 172.21.15.43:0/426564607 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200045d0 con 0x7f971c003a30 2023-08-27T11:26:35.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.252+0000 7f972cff9700 1 -- 172.21.15.43:0/426564607 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972000e6c0 con 0x7f971c003a30 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.252+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973014fc90 con 0x7f971c003a30 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.252+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97301eb340 con 0x7f971c003a30 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.254+0000 7f972cff9700 1 -- 172.21.15.43:0/426564607 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9720025070 con 0x7f971c003a30 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.254+0000 7f972cff9700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 0x7f971006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.255+0000 7f972cff9700 1 -- 172.21.15.43:0/426564607 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f97200896a0 con 0x7f971c003a30 2023-08-27T11:26:35.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.255+0000 7f9727fff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 0x7f971006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.255+0000 7f9727fff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 0x7f971006c5a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97300c60b0 tx=0x7f9718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.256+0000 7f974925cb80 1 Processor -- start 2023-08-27T11:26:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 -- start start 2023-08-27T11:26:35.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e95fe0 0x558452eb32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 0x558452ec8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452ded730 con 0x558452e8ff00 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452deb050 con 0x558452e95fe0 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.257+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558452de6940 con 0x558452e902e0 2023-08-27T11:26:35.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56392/0 (socket says 172.21.15.43:56392) 2023-08-27T11:26:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 -- 172.21.15.43:0/267417094 learned_addr learned my addr 172.21.15.43:0/267417094 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f9727fff700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e95fe0 0x558452eb32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972f7fe700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 0x558452ec8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 -- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 msgr2=0x558452ec8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 0x558452ec8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 -- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e95fe0 msgr2=0x558452eb32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e95fe0 0x558452eb32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 -- 172.21.15.43:0/267417094 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558452c665e0 con 0x558452e8ff00 2023-08-27T11:26:35.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972f7fe700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 0x558452ec8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:35.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.258+0000 7f972effd700 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9720060270 tx=0x7f97200583f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06778e510c9770b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f97257fa700 1 -- 172.21.15.43:0/267417094 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972005c850 con 0x558452e8ff00 2023-08-27T11:26:35.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f97257fa700 1 -- 172.21.15.43:0/267417094 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200607a0 con 0x558452e8ff00 2023-08-27T11:26:35.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f97257fa700 1 -- 172.21.15.43:0/267417094 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9720009630 con 0x558452e8ff00 2023-08-27T11:26:35.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 -- 172.21.15.43:0/267417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 msgr2=0x558452eb2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9720060270 tx=0x7f97200583f0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 -- 172.21.15.43:0/267417094 shutdown_connections 2023-08-27T11:26:35.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e902e0 0x558452ec8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e8ff00 0x558452eb2d70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 --2- 172.21.15.43:0/267417094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e95fe0 0x558452eb32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.259+0000 7f974925cb80 1 -- 172.21.15.43:0/267417094 >> 172.21.15.43:0/267417094 conn(0x558452df2c30 msgr2=0x558452e926e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.260+0000 7f974925cb80 1 -- 172.21.15.43:0/267417094 shutdown_connections 2023-08-27T11:26:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.260+0000 7f974925cb80 1 -- 172.21.15.43:0/267417094 wait complete. 2023-08-27T11:26:35.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.260+0000 7f974925cb80 1 -- start start 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.261+0000 7f974925cb80 1 Processor -- start 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452ea8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452d84b60 con 0x558452e902e0 2023-08-27T11:26:35.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452d84860 con 0x558452ee8860 2023-08-27T11:26:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558452c688d0 con 0x558452e8ff00 2023-08-27T11:26:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f974925cb80 10 client.0 _ll_register_callbacks cb 0x558452d82630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56394/0 (socket says 172.21.15.43:56394) 2023-08-27T11:26:35.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 -- 172.21.15.43:0/3542189028 learned_addr learned my addr 172.21.15.43:0/3542189028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f972f7fe700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452ea8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f972effd700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 -- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 msgr2=0x558452ed9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 -- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 msgr2=0x558452ea8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452ea8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.262+0000 7f9727fff700 1 -- 172.21.15.43:0/3542189028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97301eb340 con 0x558452e902e0 2023-08-27T11:26:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f9727fff700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9718005430 tx=0x7f9730152fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3737b2c576cda29 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:35.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718010ec0 con 0x558452e902e0 2023-08-27T11:26:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f971801c070 con 0x558452e902e0 2023-08-27T11:26:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558452e874f0 con 0x558452e902e0 2023-08-27T11:26:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9718005740 con 0x558452e902e0 2023-08-27T11:26:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f974925cb80 10 client.6894 fetch_fsmap learned FSMap version 83 2023-08-27T11:26:35.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x558452dfe750 con 0x558452e902e0 2023-08-27T11:26:35.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558452e874f0 con 0x558452e902e0 2023-08-27T11:26:35.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 83) v1 ==== 3282+0+0 (secure 0 0 0) 0x7f971802d460 con 0x558452e902e0 2023-08-27T11:26:35.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.263+0000 7f974925cb80 10 client.6894 fetch_fsmap finished waiting for FSMap version 83 2023-08-27T11:26:35.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f974925cb80 10 client.6894 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:35.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f974925cb80 20 client.6894 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452ea92f0 0x558452eaba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f974925cb80 4 client.6894 mds_command: new command op to 6322 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:26:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558452ddf920 con 0x558452ea92f0 2023-08-27T11:26:35.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f972effd700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452ea92f0 0x558452eaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f972effd700 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452ea92f0 0x558452eaba90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856aaaf5a6535fdc server_cookie=633ef4e5e79239 in_seq=0 out_seq=0 2023-08-27T11:26:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.264+0000 7f970e7fc700 10 client.6894 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f970e7fc700 1 -- 172.21.15.43:0/3542189028 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558452ddf920 con 0x558452ea92f0 2023-08-27T11:26:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f970e7fc700 10 client.6894 handle_command_reply: tid=0 2023-08-27T11:26:35.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 client.6894 shutdown 2023-08-27T11:26:35.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 msgr2=0x558452ee46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9718005430 tx=0x7f9730152fb0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 shutdown_connections 2023-08-27T11:26:35.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452ea8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452ea92f0 0x558452eaba90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 --2- 172.21.15.43:0/3542189028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ee46e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f970e7fc700 0 client.6894 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:35.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 >> 172.21.15.43:0/3542189028 conn(0x558452df2c30 msgr2=0x558452e8db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 shutdown_connections 2023-08-27T11:26:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.265+0000 7f974925cb80 1 -- 172.21.15.43:0/3542189028 wait complete. 2023-08-27T11:26:35.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.266+0000 7f974925cb80 20 client.6894 trim_cache size 0 max 16384 2023-08-27T11:26:35.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.284+0000 7f974925cb80 1 Processor -- start 2023-08-27T11:26:35.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.284+0000 7f974925cb80 1 -- start start 2023-08-27T11:26:35.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e8ff00 0x558452e8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452ee8860 0x558452ec7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452eb3340 con 0x558452e902e0 2023-08-27T11:26:35.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452e91a10 con 0x558452e8ff00 2023-08-27T11:26:35.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558452e91420 con 0x558452ee8860 2023-08-27T11:26:35.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56406/0 (socket says 172.21.15.43:56406) 2023-08-27T11:26:35.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 -- 172.21.15.43:0/4002765364 learned_addr learned my addr 172.21.15.43:0/4002765364 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f972f7fe700 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452ee8860 0x558452ec7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f972effd700 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e8ff00 0x558452e8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 -- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452ee8860 msgr2=0x558452ec7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452ee8860 0x558452ec7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 -- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e8ff00 msgr2=0x558452e8e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e8ff00 0x558452e8e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.285+0000 7f9727fff700 1 -- 172.21.15.43:0/4002765364 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558452c12d90 con 0x558452e902e0 2023-08-27T11:26:35.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f9727fff700 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f97180048a0 tx=0x7f9718022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba77a4019f853b0a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f9725ffb700 1 -- 172.21.15.43:0/4002765364 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971803e070 con 0x558452e902e0 2023-08-27T11:26:35.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f9725ffb700 1 -- 172.21.15.43:0/4002765364 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718005740 con 0x558452e902e0 2023-08-27T11:26:35.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f9725ffb700 1 -- 172.21.15.43:0/4002765364 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971802d460 con 0x558452e902e0 2023-08-27T11:26:35.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f974925cb80 1 -- 172.21.15.43:0/4002765364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 msgr2=0x558452ec71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.286+0000 7f974925cb80 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f97180048a0 tx=0x7f9718022000 comp rx=0 tx=0).stop 2023-08-27T11:26:35.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 -- 172.21.15.43:0/4002765364 shutdown_connections 2023-08-27T11:26:35.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452ee8860 0x558452ec7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452e8ff00 0x558452e8e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 --2- 172.21.15.43:0/4002765364 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ec71e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 -- 172.21.15.43:0/4002765364 >> 172.21.15.43:0/4002765364 conn(0x558452df2c30 msgr2=0x558452ea8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 -- 172.21.15.43:0/4002765364 shutdown_connections 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 -- 172.21.15.43:0/4002765364 wait complete. 2023-08-27T11:26:35.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.287+0000 7f974925cb80 1 -- start start 2023-08-27T11:26:35.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.288+0000 7f974925cb80 1 Processor -- start 2023-08-27T11:26:35.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.288+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.288+0000 7f974925cb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.288+0000 7f974925cb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452eaaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f974925cb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452eb2010 con 0x558452e902e0 2023-08-27T11:26:35.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x558452ed1300 con 0x558452ee8860 2023-08-27T11:26:35.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f974925cb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x558452eb1e00 con 0x558452e8ff00 2023-08-27T11:26:35.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f974925cb80 10 client.0 _ll_register_callbacks cb 0x558452d82630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:26:35.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56420/0 (socket says 172.21.15.43:56420) 2023-08-27T11:26:35.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 -- 172.21.15.43:0/578797297 learned_addr learned my addr 172.21.15.43:0/578797297 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f972effd700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f972f7fe700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452eaaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 -- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 msgr2=0x558452ed0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 -- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 msgr2=0x558452eaaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452eaaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.289+0000 7f9727fff700 1 -- 172.21.15.43:0/578797297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558452dfe750 con 0x558452e902e0 2023-08-27T11:26:35.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f9727fff700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f9718000ff0 tx=0x7f9718014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736cfebfa3df607f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:26:35.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971803e040 con 0x558452e902e0 2023-08-27T11:26:35.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f9718046d40 con 0x558452e902e0 2023-08-27T11:26:35.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97200607a0 con 0x558452e902e0 2023-08-27T11:26:35.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9718039620 con 0x558452e902e0 2023-08-27T11:26:35.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 10 client.6900 fetch_fsmap learned FSMap version 83 2023-08-27T11:26:35.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x558452bfbc10 con 0x558452e902e0 2023-08-27T11:26:35.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97200607a0 con 0x558452e902e0 2023-08-27T11:26:35.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 83) v1 ==== 3282+0+0 (secure 0 0 0) 0x7f9718039a50 con 0x558452e902e0 2023-08-27T11:26:35.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 10 client.6900 fetch_fsmap finished waiting for FSMap version 83 2023-08-27T11:26:35.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 10 client.6900 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 20 client.6900 populate_metadata read hostname 'smithi043' 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452eab6d0 0x558452eabab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 4 client.6900 mds_command: new command op to 6322 tid=0[{"prefix": "status"}] 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.290+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 --> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558452da0000 con 0x558452eab6d0 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f972effd700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452eab6d0 0x558452eabab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f972effd700 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452eab6d0 0x558452eabab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfa16f3b00bfa7b server_cookie=23daf74de9d8ccfa in_seq=0 out_seq=0 2023-08-27T11:26:35.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f970e7fc700 10 client.6900 ms_handle_connect on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:35.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f970e7fc700 1 -- 172.21.15.43:0/578797297 <== mds.0 v2:172.21.15.43:6835/3998632195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558452da0000 con 0x558452eab6d0 2023-08-27T11:26:35.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f970e7fc700 10 client.6900 handle_command_reply: tid=0 2023-08-27T11:26:35.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f974925cb80 1 client.6900 shutdown 2023-08-27T11:26:35.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 msgr2=0x558452ecd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.291+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f9718000ff0 tx=0x7f9718014000 comp rx=0 tx=0).stop 2023-08-27T11:26:35.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 shutdown_connections 2023-08-27T11:26:35.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x558452ee8860 0x558452eaaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x558452e8ff00 0x558452ed0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:6835/3998632195,v1:172.21.15.43:6837/3998632195] conn(0x558452eab6d0 0x558452eabab0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 --2- 172.21.15.43:0/578797297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558452e902e0 0x558452ecd740 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f970e7fc700 0 client.6900 ms_handle_reset on v2:172.21.15.43:6835/3998632195 2023-08-27T11:26:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 >> 172.21.15.43:0/578797297 conn(0x558452df2c30 msgr2=0x558452e8e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 shutdown_connections 2023-08-27T11:26:35.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 1 -- 172.21.15.43:0/578797297 wait complete. 2023-08-27T11:26:35.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f974925cb80 20 client.6900 trim_cache size 0 max 16384 2023-08-27T11:26:35.313 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:35.313 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:26:35.313 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:26:35.314 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6322, 2023-08-27T11:26:35.314 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:26:35.314 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:26:35.314 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:26:35.315 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 13.364186823000001, 2023-08-27T11:26:35.315 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 82, 2023-08-27T11:26:35.315 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 84, 2023-08-27T11:26:35.315 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 82, 2023-08-27T11:26:35.315 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 34.363826934000002 2023-08-27T11:26:35.316 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.292+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 msgr2=0x7f971006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 0x7f971006c5a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f97300c60b0 tx=0x7f9718009040 comp rx=0 tx=0).stop 2023-08-27T11:26:35.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 msgr2=0x7f97300a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f971c005810 tx=0x7f97200047c0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 shutdown_connections 2023-08-27T11:26:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f971006a0e0 0x7f971006c5a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97300bec90 0x7f97301eac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f971c003a30 0x7f97300a5460 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 --2- 172.21.15.43:0/426564607 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97300bc8e0 0x7f97300be750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 >> 172.21.15.43:0/426564607 conn(0x7f973006aa50 msgr2=0x7f97301540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 shutdown_connections 2023-08-27T11:26:35.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.293+0000 7f97359ff700 1 -- 172.21.15.43:0/426564607 wait complete. 2023-08-27T11:26:35.320 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 6, "epoch": 83, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 6, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:12.678531+0000", "damaged": [], "data_pools": [ 14 ], "enabled": true, "epoch": 82, "ever_allowed_features": 32, "explicitly_allowed_features": 32, "failed": [], "flags": 50, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": true, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6322": { "addr": "172.21.15.43:6837/3998632195", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 3998632195, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 3998632195, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6322, "incarnation": 75, "join_fscid": 6, "name": "c", "rank": 0, "state": "up:active", "state_seq": 9 }, "gid_6328": { "addr": "172.21.15.57:6833/1640307202", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 1640307202, "type": "v2" }, { "addr": "172.21.15.57:6833", "nonce": 1640307202, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6328, "incarnation": 0, "join_fscid": 6, "name": "d", "rank": 0, "state": "up:standby-replay", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 13, "modified": "2023-08-27T11:26:28.986106+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6322 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/432356370", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6834", "nonce": 432356370, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 432356370, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 68, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6334, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6836/3307996452", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3307996452, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 3307996452, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 83, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6861, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:26:35.321 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 6, 'name': 'c', 'state': 'up:active'}, {'join_fscid': 6, 'name': 'd', 'state': 'up:standby-replay'}] 2023-08-27T11:26:35.321 INFO:tasks.cephfs.test_failover:current = [{'gid': 6861, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6836/3307996452', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3307996452}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 3307996452}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 83}, {'gid': 6334, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/432356370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6834', 'nonce': 432356370}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 432356370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 68}, {'gid': 6322, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/3998632195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 3998632195}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 3998632195}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6328, 'name': 'd', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 8, 'addr': '172.21.15.57:6833/1640307202', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 1640307202}, {'type': 'v1', 'addr': '172.21.15.57:6833', 'nonce': 1640307202}]}, 'join_fscid': 6, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:26:35.322 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:26:35.322 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:26:35.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:35.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:35.534 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:26:35.535 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:26:35.535 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:35.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:26:35.579 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:26:35.580 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:35.624 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:26:35.625 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:35.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.824+0000 7f58567ff700 1 Processor -- start 2023-08-27T11:26:35.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.824+0000 7f58567ff700 1 -- start start 2023-08-27T11:26:35.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.825+0000 7f58567ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.825+0000 7f58567ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f58500c4630 0x7f58500c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f58567ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585006c4e0 con 0x7f585006ad70 2023-08-27T11:26:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f58567ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5850155370 con 0x7f58500c4630 2023-08-27T11:26:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f58567ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5850151e70 con 0x7f5850151a90 2023-08-27T11:26:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f58500c4630 0x7f58500c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f5854d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f585006ad70 0x7f585006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42194/0 (socket says 172.21.15.43:42194) 2023-08-27T11:26:35.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f58500c4630 0x7f58500c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56424/0 (socket says 172.21.15.43:56424) 2023-08-27T11:26:35.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f5854d9c700 1 -- 172.21.15.43:0/4281115634 learned_addr learned my addr 172.21.15.43:0/4281115634 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:35.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584ffff700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584effd700 1 -- 172.21.15.43:0/4281115634 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613664092 0 0) 0x7f585006c4e0 con 0x7f585006ad70 2023-08-27T11:26:35.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 -- 172.21.15.43:0/4281115634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 msgr2=0x7f58500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:35.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58500c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 -- 172.21.15.43:0/4281115634 >> v1:172.21.15.43:6789/0 conn(0x7f585006ad70 legacy=0x7f585006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.826+0000 7f584f7fe700 1 -- 172.21.15.43:0/4281115634 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850154480 con 0x7f58500c4630 2023-08-27T11:26:35.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f584f7fe700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500c4a90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5844009840 tx=0x7f5844009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fff33705717d27e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f584effd700 1 -- 172.21.15.43:0/4281115634 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844011830 con 0x7f58500c4630 2023-08-27T11:26:35.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f584effd700 1 -- 172.21.15.43:0/4281115634 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5844011990 con 0x7f58500c4630 2023-08-27T11:26:35.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f584effd700 1 -- 172.21.15.43:0/4281115634 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844011d20 con 0x7f58500c4630 2023-08-27T11:26:35.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f58567ff700 1 -- 172.21.15.43:0/4281115634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 msgr2=0x7f58500c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.827+0000 7f58567ff700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500c4a90 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f5844009840 tx=0x7f5844009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:35.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 -- 172.21.15.43:0/4281115634 shutdown_connections 2023-08-27T11:26:35.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 --2- 172.21.15.43:0/4281115634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500c4a90 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 -- 172.21.15.43:0/4281115634 >> 172.21.15.43:0/4281115634 conn(0x7f58500ab820 msgr2=0x7f58500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:35.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 -- 172.21.15.43:0/4281115634 shutdown_connections 2023-08-27T11:26:35.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.828+0000 7f58567ff700 1 -- 172.21.15.43:0/4281115634 wait complete. 2023-08-27T11:26:35.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.829+0000 7f58567ff700 1 Processor -- start 2023-08-27T11:26:35.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.829+0000 7f58567ff700 1 -- start start 2023-08-27T11:26:35.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 0x7f5850153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58501e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c77c0 con 0x7f58500c4630 2023-08-27T11:26:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500c9470 con 0x7f585006ad70 2023-08-27T11:26:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.830+0000 7f58567ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58501edba0 con 0x7f5850151a90 2023-08-27T11:26:35.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56430/0 (socket says 172.21.15.43:56430) 2023-08-27T11:26:35.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 -- 172.21.15.43:0/1441187887 learned_addr learned my addr 172.21.15.43:0/1441187887 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:35.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f5854d9c700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58501e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584ffff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 0x7f5850153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 -- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 msgr2=0x7f58501e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58501e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 -- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 msgr2=0x7f5850153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 0x7f5850153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 -- 172.21.15.43:0/1441187887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440094a0 con 0x7f58500c4630 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f5854d9c700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58501e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:35.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584ffff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 0x7f5850153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:35.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584f7fe700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f58440090b0 tx=0x7f5844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.831+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58440038a0 con 0x7f58500c4630 2023-08-27T11:26:35.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.832+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584401f070 con 0x7f58500c4630 2023-08-27T11:26:35.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.832+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500bdbc0 con 0x7f58500c4630 2023-08-27T11:26:35.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.832+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844003c20 con 0x7f58500c4630 2023-08-27T11:26:35.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.832+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58500bf200 con 0x7f58500c4630 2023-08-27T11:26:35.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.833+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585004ee70 con 0x7f58500c4630 2023-08-27T11:26:35.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.834+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f584401a430 con 0x7f58500c4630 2023-08-27T11:26:35.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.834+0000 7f584cff9700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 0x7f583c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:35.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.835+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f5844021070 con 0x7f58500c4630 2023-08-27T11:26:35.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.835+0000 7f584ffff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 0x7f583c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:35.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.835+0000 7f584ffff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 0x7f583c06c5d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5840007a50 tx=0x7f5840008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:35.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:35.839+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5844055640 con 0x7f58500c4630 2023-08-27T11:26:36.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.097+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f585006c130 con 0x7f58500c4630 2023-08-27T11:26:36.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.098+0000 7f584cff9700 1 -- 172.21.15.43:0/1441187887 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f584402b090 con 0x7f58500c4630 2023-08-27T11:26:36.099 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:36.100 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":82,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:28.986106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6328":{"gid":6328,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":8,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:36.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 msgr2=0x7f583c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 0x7f583c06c5d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5840007a50 tx=0x7f5840008040 comp rx=0 tx=0).stop 2023-08-27T11:26:36.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 msgr2=0x7f58500aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f58440090b0 tx=0x7f5844004750 comp rx=0 tx=0).stop 2023-08-27T11:26:36.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 shutdown_connections 2023-08-27T11:26:36.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f583c06a110 0x7f583c06c5d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5850151a90 0x7f58501e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f585006ad70 0x7f5850153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 --2- 172.21.15.43:0/1441187887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58500c4630 0x7f58500aa8d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 >> 172.21.15.43:0/1441187887 conn(0x7f58500ab820 msgr2=0x7f585014d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:36.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 shutdown_connections 2023-08-27T11:26:36.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.100+0000 7f58567ff700 1 -- 172.21.15.43:0/1441187887 wait complete. 2023-08-27T11:26:36.104 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 83 2023-08-27T11:26:36.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:36.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.321+0000 7fb28f7ff700 1 Processor -- start 2023-08-27T11:26:36.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.321+0000 7fb28f7ff700 1 -- start start 2023-08-27T11:26:36.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 0x7fb2880bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28f7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2880c0390 0x7fb2880bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28f7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880c17f0 con 0x7fb28814e0d0 2023-08-27T11:26:36.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28f7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880c21a0 con 0x7fb2880c0390 2023-08-27T11:26:36.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880c0900 con 0x7fb2880c4c40 2023-08-27T11:26:36.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.322+0000 7fb28dd9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2880c0390 0x7fb2880bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb2880c0390 0x7fb2880bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56438/0 (socket says 172.21.15.43:56438) 2023-08-27T11:26:36.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 -- 172.21.15.43:0/2259842422 learned_addr learned my addr 172.21.15.43:0/2259842422 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:36.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28cd9a700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 0x7fb2880bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 -- 172.21.15.43:0/2259842422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 msgr2=0x7fb2880bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:36.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 0x7fb2880bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 -- 172.21.15.43:0/2259842422 >> v1:172.21.15.57:6789/0 conn(0x7fb28814e0d0 legacy=0x7fb2880c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 -- 172.21.15.43:0/2259842422 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880c0be0 con 0x7fb2880c0390 2023-08-27T11:26:36.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28cd9a700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 0x7fb2880bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:36.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb28dd9c700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2880c0390 0x7fb2880bbb00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb280009e50 tx=0x7fb28000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cea47ad7e7870f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb27ffff700 1 -- 172.21.15.43:0/2259842422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000e070 con 0x7fb2880c0390 2023-08-27T11:26:36.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb27ffff700 1 -- 172.21.15.43:0/2259842422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28000b9c0 con 0x7fb2880c0390 2023-08-27T11:26:36.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.323+0000 7fb27ffff700 1 -- 172.21.15.43:0/2259842422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28000bd70 con 0x7fb2880c0390 2023-08-27T11:26:36.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 -- 172.21.15.43:0/2259842422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2880c0390 msgr2=0x7fb2880bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2880c0390 0x7fb2880bbb00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb280009e50 tx=0x7fb28000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:36.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 -- 172.21.15.43:0/2259842422 shutdown_connections 2023-08-27T11:26:36.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb2880c0390 0x7fb2880bbb00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/2259842422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c4c40 0x7fb2880bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 -- 172.21.15.43:0/2259842422 >> 172.21.15.43:0/2259842422 conn(0x7fb28806aa50 msgr2=0x7fb2880c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:36.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 -- 172.21.15.43:0/2259842422 shutdown_connections 2023-08-27T11:26:36.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.324+0000 7fb28f7ff700 1 -- 172.21.15.43:0/2259842422 wait complete. 2023-08-27T11:26:36.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.326+0000 7fb28f7ff700 1 Processor -- start 2023-08-27T11:26:36.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.326+0000 7fb28f7ff700 1 -- start start 2023-08-27T11:26:36.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 0x7fb2880becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 0x7fb2881e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288149e30 con 0x7fb28814e0d0 2023-08-27T11:26:36.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2881e6410 con 0x7fb2880c4c40 2023-08-27T11:26:36.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880bf5f0 con 0x7fb2880c0390 2023-08-27T11:26:36.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56448/0 (socket says 172.21.15.43:56448) 2023-08-27T11:26:36.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.327+0000 7fb28dd9c700 1 -- 172.21.15.43:0/206323776 learned_addr learned my addr 172.21.15.43:0/206323776 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:36.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28cd9a700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 0x7fb2881e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 -- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 msgr2=0x7fb2880becb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28d59b700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 0x7fb2880becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 0x7fb2880becb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 -- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 msgr2=0x7fb2881e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 0x7fb2881e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 -- 172.21.15.43:0/206323776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009b30 con 0x7fb28814e0d0 2023-08-27T11:26:36.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28cd9a700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 0x7fb2881e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:36.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28d59b700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 0x7fb2880becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:36.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28dd9c700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb28806d970 tx=0x7fb280004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280004960 con 0x7fb28814e0d0 2023-08-27T11:26:36.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2800099b0 con 0x7fb28814e0d0 2023-08-27T11:26:36.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2881e5490 con 0x7fb28814e0d0 2023-08-27T11:26:36.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28001c680 con 0x7fb28814e0d0 2023-08-27T11:26:36.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.328+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28814a360 con 0x7fb28814e0d0 2023-08-27T11:26:36.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.329+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2881e56b0 con 0x7fb28814e0d0 2023-08-27T11:26:36.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.330+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb28001c7e0 con 0x7fb28814e0d0 2023-08-27T11:26:36.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.331+0000 7fb27dffb700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 0x7fb26c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.331+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fb28008a3f0 con 0x7fb28814e0d0 2023-08-27T11:26:36.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.331+0000 7fb28d59b700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 0x7fb26c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.332+0000 7fb28d59b700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 0x7fb26c06c5a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb2881dd0f0 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.335+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2881e56b0 con 0x7fb28814e0d0 2023-08-27T11:26:36.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.545+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb28814a520 con 0x7fb28814e0d0 2023-08-27T11:26:36.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.547+0000 7fb27dffb700 1 -- 172.21.15.43:0/206323776 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18498 (secure 0 0 0) 0x7fb280055a00 con 0x7fb28814e0d0 2023-08-27T11:26:36.549 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:36.549 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:33.029140+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1292748157":"2023-08-28T11:26:21.920637+0000","172.21.15.43:6834/1292748157":"2023-08-28T11:26:21.920637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:36.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 msgr2=0x7fb26c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 0x7fb26c06c5a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb2881dd0f0 tx=0x7fb284009040 comp rx=0 tx=0).stop 2023-08-27T11:26:36.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 msgr2=0x7fb2881e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb28806d970 tx=0x7fb280004ad0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 shutdown_connections 2023-08-27T11:26:36.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb26c06a0e0 0x7fb26c06c5a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb28814e0d0 0x7fb2881e5ed0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2880c0390 0x7fb2880becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 --2- 172.21.15.43:0/206323776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2880c4c40 0x7fb2881e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.549+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 >> 172.21.15.43:0/206323776 conn(0x7fb28806aa50 msgr2=0x7fb288146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:36.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.550+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 shutdown_connections 2023-08-27T11:26:36.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.550+0000 7fb28f7ff700 1 -- 172.21.15.43:0/206323776 wait complete. 2023-08-27T11:26:36.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:26:11.014966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:26:11.661257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:26:36.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:26:36.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.773+0000 7fdb75dff700 1 Processor -- start 2023-08-27T11:26:36.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.773+0000 7fdb75dff700 1 -- start start 2023-08-27T11:26:36.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.774+0000 7fdb75dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb700c3b30 0x7fdb700a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.774+0000 7fdb75dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb70157a30 0x7fdb700c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb75dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb70154600 con 0x7fdb700c72e0 2023-08-27T11:26:36.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb75dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb700c66c0 con 0x7fdb700c3b30 2023-08-27T11:26:36.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb75dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb700700a0 con 0x7fdb70157a30 2023-08-27T11:26:36.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb700c3b30 0x7fdb700a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb700c3b30 0x7fdb700a6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56456/0 (socket says 172.21.15.43:56456) 2023-08-27T11:26:36.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 -- 172.21.15.43:0/717908583 learned_addr learned my addr 172.21.15.43:0/717908583 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:36.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6ffff700 1 --1- 172.21.15.43:0/717908583 >> v1:172.21.15.43:6789/0 conn(0x7fdb700c72e0 0x7fdb70154a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42202/0 (socket says 172.21.15.43:42202) 2023-08-27T11:26:36.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb67fff700 1 --2- 172.21.15.43:0/717908583 >> v2:172.21.15.57:3300/0 conn(0x7fdb70157a30 0x7fdb700c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 -- 172.21.15.43:0/717908583 >> v2:172.21.15.57:3300/0 conn(0x7fdb70157a30 msgr2=0x7fdb700c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:36.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 --2- 172.21.15.43:0/717908583 >> v2:172.21.15.57:3300/0 conn(0x7fdb70157a30 0x7fdb700c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 -- 172.21.15.43:0/717908583 >> v1:172.21.15.43:6789/0 conn(0x7fdb700c72e0 legacy=0x7fdb70154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.775+0000 7fdb6f7fe700 1 -- 172.21.15.43:0/717908583 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7006f800 con 0x7fdb700c3b30 2023-08-27T11:26:36.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb6f7fe700 1 --2- 172.21.15.43:0/717908583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c3b30 0x7fdb700a6d70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdb700c4530 tx=0x7fdb60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4891c58d92789b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb6effd700 1 -- 172.21.15.43:0/717908583 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60011830 con 0x7fdb700c3b30 2023-08-27T11:26:36.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb6effd700 1 -- 172.21.15.43:0/717908583 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60011990 con 0x7fdb700c3b30 2023-08-27T11:26:36.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb6effd700 1 -- 172.21.15.43:0/717908583 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60011d20 con 0x7fdb700c3b30 2023-08-27T11:26:36.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 -- 172.21.15.43:0/717908583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c3b30 msgr2=0x7fdb700a6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 --2- 172.21.15.43:0/717908583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c3b30 0x7fdb700a6d70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fdb700c4530 tx=0x7fdb60009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 -- 172.21.15.43:0/717908583 shutdown_connections 2023-08-27T11:26:36.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 --2- 172.21.15.43:0/717908583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c3b30 0x7fdb700a6d70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 --2- 172.21.15.43:0/717908583 >> v2:172.21.15.57:3300/0 conn(0x7fdb70157a30 0x7fdb700c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 -- 172.21.15.43:0/717908583 >> 172.21.15.43:0/717908583 conn(0x7fdb700a97d0 msgr2=0x7fdb700a9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:36.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 -- 172.21.15.43:0/717908583 shutdown_connections 2023-08-27T11:26:36.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.776+0000 7fdb75dff700 1 -- 172.21.15.43:0/717908583 wait complete. 2023-08-27T11:26:36.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.779+0000 7fdb75dff700 1 Processor -- start 2023-08-27T11:26:36.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.779+0000 7fdb75dff700 1 -- start start 2023-08-27T11:26:36.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb700c3b30 0x7fdb700a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 0x7fdb7006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7006c240 con 0x7fdb700c72e0 2023-08-27T11:26:36.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70156d30 con 0x7fdb70157a30 2023-08-27T11:26:36.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb75dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70157020 con 0x7fdb700c3b30 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb67fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb67fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56460/0 (socket says 172.21.15.43:56460) 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.780+0000 7fdb67fff700 1 -- 172.21.15.43:0/3549971107 learned_addr learned my addr 172.21.15.43:0/3549971107 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6f7fe700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb700c3b30 0x7fdb700a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6ffff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 0x7fdb7006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 -- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb700c3b30 msgr2=0x7fdb700a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb700c3b30 0x7fdb700a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 -- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 msgr2=0x7fdb7006b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:36.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 0x7fdb7006b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:36.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 -- 172.21.15.43:0/3549971107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60009550 con 0x7fdb700c72e0 2023-08-27T11:26:36.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6ffff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 0x7fdb7006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb67fff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800e870 tx=0x7fdb5800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb58009590 con 0x7fdb700c72e0 2023-08-27T11:26:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800ee70 con 0x7fdb700c72e0 2023-08-27T11:26:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800ca50 con 0x7fdb700c72e0 2023-08-27T11:26:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.781+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb701ede20 con 0x7fdb700c72e0 2023-08-27T11:26:36.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.782+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7006bed0 con 0x7fdb700c72e0 2023-08-27T11:26:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.783+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7006c3f0 con 0x7fdb700c72e0 2023-08-27T11:26:36.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.783+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb5800cbb0 con 0x7fdb700c72e0 2023-08-27T11:26:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.785+0000 7fdb6cff9700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 0x7fdb5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.785+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fdb580885b0 con 0x7fdb700c72e0 2023-08-27T11:26:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.785+0000 7fdb6f7fe700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 0x7fdb5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:36.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.786+0000 7fdb6f7fe700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 0x7fdb5006c5a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009c10 tx=0x7fdb60008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:36.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:36.789+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb7006c3f0 con 0x7fdb700c72e0 2023-08-27T11:26:37.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.001+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb7006c3f0 con 0x7fdb700c72e0 2023-08-27T11:26:37.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.001+0000 7fdb6cff9700 1 -- 172.21.15.43:0/3549971107 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb7006c3f0 con 0x7fdb700c72e0 2023-08-27T11:26:37.003 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:26:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 msgr2=0x7fdb5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 0x7fdb5006c5a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009c10 tx=0x7fdb60008030 comp rx=0 tx=0).stop 2023-08-27T11:26:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 msgr2=0x7fdb701dffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdb5800e870 tx=0x7fdb5800ec30 comp rx=0 tx=0).stop 2023-08-27T11:26:37.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 shutdown_connections 2023-08-27T11:26:37.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdb5006a0e0 0x7fdb5006c5a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb70157a30 0x7fdb7006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb700c3b30 0x7fdb700a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 --2- 172.21.15.43:0/3549971107 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb700c72e0 0x7fdb701dffa0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 >> 172.21.15.43:0/3549971107 conn(0x7fdb700a97d0 msgr2=0x7fdb70154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 shutdown_connections 2023-08-27T11:26:37.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.004+0000 7fdb75dff700 1 -- 172.21.15.43:0/3549971107 wait complete. 2023-08-27T11:26:37.023 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:26:37.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.228+0000 7ffa4adff700 1 Processor -- start 2023-08-27T11:26:37.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.229+0000 7ffa4adff700 1 -- start start 2023-08-27T11:26:37.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 0x7ffa441512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4adff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa440c03e0 con 0x7ffa4414eb60 2023-08-27T11:26:37.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4adff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa44151900 con 0x7ffa440c5150 2023-08-27T11:26:37.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa44151be0 con 0x7ffa4414e780 2023-08-27T11:26:37.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4939c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffa4414eb60 0x7ffa440c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42214/0 (socket says 172.21.15.43:42214) 2023-08-27T11:26:37.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa4939c700 1 -- 172.21.15.43:0/2255695567 learned_addr learned my addr 172.21.15.43:0/2255695567 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:37.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa48b9b700 1 --2- 172.21.15.43:0/2255695567 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 0x7ffa441512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.230+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190742923 0 0) 0x7ffa440c03e0 con 0x7ffa4414eb60 2023-08-27T11:26:37.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa340035b0 con 0x7ffa4414eb60 2023-08-27T11:26:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704381066 0 0) 0x7ffa44151900 con 0x7ffa440c5150 2023-08-27T11:26:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa440c03e0 con 0x7ffa440c5150 2023-08-27T11:26:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2187544086 0 0) 0x7ffa340035b0 con 0x7ffa4414eb60 2023-08-27T11:26:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa48b9b700 1 -- 172.21.15.43:0/2255695567 >> v1:172.21.15.57:6789/0 conn(0x7ffa440c5150 legacy=0x7ffa4406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa48b9b700 1 -- 172.21.15.43:0/2255695567 >> v1:172.21.15.43:6789/0 conn(0x7ffa4414eb60 legacy=0x7ffa440c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa48b9b700 1 -- 172.21.15.43:0/2255695567 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44151ec0 con 0x7ffa4414e780 2023-08-27T11:26:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.231+0000 7ffa48b9b700 1 --2- 172.21.15.43:0/2255695567 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 0x7ffa441512b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009870 tx=0x7ffa38009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2e3c20b822b489 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0019f0 con 0x7ffa4414e780 2023-08-27T11:26:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38004030 con 0x7ffa4414e780 2023-08-27T11:26:37.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa437fe700 1 -- 172.21.15.43:0/2255695567 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa380043c0 con 0x7ffa4414e780 2023-08-27T11:26:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 -- 172.21.15.43:0/2255695567 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 msgr2=0x7ffa441512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 --2- 172.21.15.43:0/2255695567 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 0x7ffa441512b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009870 tx=0x7ffa38009b80 comp rx=0 tx=0).stop 2023-08-27T11:26:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 -- 172.21.15.43:0/2255695567 shutdown_connections 2023-08-27T11:26:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 --2- 172.21.15.43:0/2255695567 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa4414e780 0x7ffa441512b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 -- 172.21.15.43:0/2255695567 >> 172.21.15.43:0/2255695567 conn(0x7ffa440c5b10 msgr2=0x7ffa440c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:37.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 -- 172.21.15.43:0/2255695567 shutdown_connections 2023-08-27T11:26:37.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.232+0000 7ffa4adff700 1 -- 172.21.15.43:0/2255695567 wait complete. 2023-08-27T11:26:37.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.234+0000 7ffa4adff700 1 Processor -- start 2023-08-27T11:26:37.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.234+0000 7ffa4adff700 1 -- start start 2023-08-27T11:26:37.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa440c5150 0x7ffa441492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 0x7ffa441deb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441dd410 con 0x7ffa4414e780 2023-08-27T11:26:37.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441ea230 con 0x7ffa4414eb60 2023-08-27T11:26:37.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa4adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441e9d80 con 0x7ffa440c5150 2023-08-27T11:26:37.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56476/0 (socket says 172.21.15.43:56476) 2023-08-27T11:26:37.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.235+0000 7ffa43fff700 1 -- 172.21.15.43:0/880741455 learned_addr learned my addr 172.21.15.43:0/880741455 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:37.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa4939c700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 0x7ffa441deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa48b9b700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa440c5150 0x7ffa441492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 -- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa440c5150 msgr2=0x7ffa441492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa440c5150 0x7ffa441492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 -- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 msgr2=0x7ffa441deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 0x7ffa441deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 -- 172.21.15.43:0/880741455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380094a0 con 0x7ffa4414e780 2023-08-27T11:26:37.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa4939c700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 0x7ffa441deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:37.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa43fff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c550 tx=0x7ffa3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300052d0 con 0x7ffa4414e780 2023-08-27T11:26:37.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30005430 con 0x7ffa4414e780 2023-08-27T11:26:37.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300038c0 con 0x7ffa4414e780 2023-08-27T11:26:37.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.236+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa441d9190 con 0x7ffa4414e780 2023-08-27T11:26:37.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.237+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa441d8860 con 0x7ffa4414e780 2023-08-27T11:26:37.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.237+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4404ee70 con 0x7ffa4414e780 2023-08-27T11:26:37.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.238+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa30003a20 con 0x7ffa4414e780 2023-08-27T11:26:37.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.240+0000 7ffa417fa700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.241+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ffa30087b30 con 0x7ffa4414e780 2023-08-27T11:26:37.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.241+0000 7ffa48b9b700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.241+0000 7ffa48b9b700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffa380090b0 tx=0x7ffa38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.244+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffa300531e0 con 0x7ffa4414e780 2023-08-27T11:26:37.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.452+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa440c5610 con 0x7ffa4414e780 2023-08-27T11:26:37.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.453+0000 7ffa417fa700 1 -- 172.21.15.43:0/880741455 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa30017020 con 0x7ffa4414e780 2023-08-27T11:26:37.455 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:26:37.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 msgr2=0x7ffa2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffa380090b0 tx=0x7ffa38008030 comp rx=0 tx=0).stop 2023-08-27T11:26:37.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 msgr2=0x7ffa441de210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c550 tx=0x7ffa3000c910 comp rx=0 tx=0).stop 2023-08-27T11:26:37.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 shutdown_connections 2023-08-27T11:26:37.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa4414eb60 0x7ffa441deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa440c5150 0x7ffa441492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.455+0000 7ffa4adff700 1 --2- 172.21.15.43:0/880741455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa4414e780 0x7ffa441de210 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.456+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 >> 172.21.15.43:0/880741455 conn(0x7ffa440c5b10 msgr2=0x7ffa440c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.456+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 shutdown_connections 2023-08-27T11:26:37.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.456+0000 7ffa4adff700 1 -- 172.21.15.43:0/880741455 wait complete. 2023-08-27T11:26:37.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:26:37.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.678+0000 7efee05ff700 1 Processor -- start 2023-08-27T11:26:37.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.678+0000 7efee05ff700 1 -- start start 2023-08-27T11:26:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.679+0000 7efee05ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efed806aff0 0x7efed80c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.679+0000 7efee05ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed8154660 con 0x7efed80c7c00 2023-08-27T11:26:37.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efee05ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed8154940 con 0x7efed8151d20 2023-08-27T11:26:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efee05ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80c5750 con 0x7efed806aff0 2023-08-27T11:26:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efeddb9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efed80c7c00 0x7efed806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42220/0 (socket says 172.21.15.43:42220) 2023-08-27T11:26:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efeddb9a700 1 -- 172.21.15.43:0/1478316415 learned_addr learned my addr 172.21.15.43:0/1478316415 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:37.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedeb9c700 1 --2- 172.21.15.43:0/1478316415 >> v2:172.21.15.57:3300/0 conn(0x7efed806aff0 0x7efed80c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedd399700 1 -- 172.21.15.43:0/1478316415 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629320199 0 0) 0x7efed8154660 con 0x7efed80c7c00 2023-08-27T11:26:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedd399700 1 -- 172.21.15.43:0/1478316415 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec40035b0 con 0x7efed80c7c00 2023-08-27T11:26:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedeb9c700 1 -- 172.21.15.43:0/1478316415 >> v1:172.21.15.57:6789/0 conn(0x7efed8151d20 legacy=0x7efed80ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedeb9c700 1 -- 172.21.15.43:0/1478316415 >> v1:172.21.15.43:6789/0 conn(0x7efed80c7c00 legacy=0x7efed806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.680+0000 7efedeb9c700 1 -- 172.21.15.43:0/1478316415 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8154c20 con 0x7efed806aff0 2023-08-27T11:26:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.681+0000 7efedeb9c700 1 --2- 172.21.15.43:0/1478316415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed806aff0 0x7efed80c8110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efed8152140 tx=0x7efed000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554d63304221db9e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.681+0000 7efedd399700 1 -- 172.21.15.43:0/1478316415 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0016070 con 0x7efed806aff0 2023-08-27T11:26:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.681+0000 7efedd399700 1 -- 172.21.15.43:0/1478316415 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000bb20 con 0x7efed806aff0 2023-08-27T11:26:37.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.681+0000 7efedd399700 1 -- 172.21.15.43:0/1478316415 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000e070 con 0x7efed806aff0 2023-08-27T11:26:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 -- 172.21.15.43:0/1478316415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed806aff0 msgr2=0x7efed80c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 --2- 172.21.15.43:0/1478316415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed806aff0 0x7efed80c8110 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efed8152140 tx=0x7efed000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 -- 172.21.15.43:0/1478316415 shutdown_connections 2023-08-27T11:26:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 --2- 172.21.15.43:0/1478316415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed806aff0 0x7efed80c8110 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 -- 172.21.15.43:0/1478316415 >> 172.21.15.43:0/1478316415 conn(0x7efed80c9d00 msgr2=0x7efed80ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 -- 172.21.15.43:0/1478316415 shutdown_connections 2023-08-27T11:26:37.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.682+0000 7efee05ff700 1 -- 172.21.15.43:0/1478316415 wait complete. 2023-08-27T11:26:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.683+0000 7efee05ff700 1 Processor -- start 2023-08-27T11:26:37.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.683+0000 7efee05ff700 1 -- start start 2023-08-27T11:26:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed80c7c00 0x7efed814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efed8151d20 0x7efed814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c2d40 con 0x7efed806aff0 2023-08-27T11:26:37.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81ea6f0 con 0x7efed80c7c00 2023-08-27T11:26:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.684+0000 7efee05ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed81ea9d0 con 0x7efed8151d20 2023-08-27T11:26:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56486/0 (socket says 172.21.15.43:56486) 2023-08-27T11:26:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 -- 172.21.15.43:0/658581986 learned_addr learned my addr 172.21.15.43:0/658581986 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:37.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efeddb9a700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed80c7c00 0x7efed814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efedeb9c700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efed8151d20 0x7efed814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 -- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efed8151d20 msgr2=0x7efed814b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efed8151d20 0x7efed814b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 -- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed80c7c00 msgr2=0x7efed814aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed80c7c00 0x7efed814aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 -- 172.21.15.43:0/658581986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0009a70 con 0x7efed806aff0 2023-08-27T11:26:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efede39b700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efed400c450 tx=0x7efed400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.685+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed40052d0 con 0x7efed806aff0 2023-08-27T11:26:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.686+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed4005430 con 0x7efed806aff0 2023-08-27T11:26:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.686+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed80c29d0 con 0x7efed806aff0 2023-08-27T11:26:37.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.686+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed40038c0 con 0x7efed806aff0 2023-08-27T11:26:37.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.686+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed81580f0 con 0x7efed806aff0 2023-08-27T11:26:37.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.687+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed80c2830 con 0x7efed806aff0 2023-08-27T11:26:37.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.688+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efed4003a20 con 0x7efed806aff0 2023-08-27T11:26:37.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.689+0000 7efeceffd700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 0x7efebc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:37.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.689+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7efed4087a60 con 0x7efed806aff0 2023-08-27T11:26:37.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.689+0000 7efeddb9a700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 0x7efebc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:37.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.689+0000 7efeddb9a700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 0x7efebc06c5a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efed814bd00 tx=0x7efec8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:37.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.693+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efed80c2830 con 0x7efed806aff0 2023-08-27T11:26:37.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.902+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efed80c2830 con 0x7efed806aff0 2023-08-27T11:26:37.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.902+0000 7efeceffd700 1 -- 172.21.15.43:0/658581986 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7efed80c2830 con 0x7efed806aff0 2023-08-27T11:26:37.904 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:26:37.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 msgr2=0x7efebc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 0x7efebc06c5a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efed814bd00 tx=0x7efec8009040 comp rx=0 tx=0).stop 2023-08-27T11:26:37.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 msgr2=0x7efed8153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:37.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efed400c450 tx=0x7efed400c810 comp rx=0 tx=0).stop 2023-08-27T11:26:37.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 shutdown_connections 2023-08-27T11:26:37.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efebc06a0e0 0x7efebc06c5a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efed8151d20 0x7efed814b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efed806aff0 0x7efed8153b50 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 --2- 172.21.15.43:0/658581986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efed80c7c00 0x7efed814aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:37.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 >> 172.21.15.43:0/658581986 conn(0x7efed80c9d00 msgr2=0x7efed814f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:37.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 shutdown_connections 2023-08-27T11:26:37.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:37.906+0000 7efee05ff700 1 -- 172.21.15.43:0/658581986 wait complete. 2023-08-27T11:26:37.926 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:26:38.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.130+0000 7f5f905ff700 1 Processor -- start 2023-08-27T11:26:38.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.130+0000 7f5f905ff700 1 -- start start 2023-08-27T11:26:38.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.131+0000 7f5f905ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5f88151d20 0x7f5f880c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.131+0000 7f5f905ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8806a8e0 0x7f5f8806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.131+0000 7f5f905ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f88154660 con 0x7f5f880c7c00 2023-08-27T11:26:38.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.131+0000 7f5f905ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f880c5750 con 0x7f5f8806a8e0 2023-08-27T11:26:38.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.131+0000 7f5f905ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f88154940 con 0x7f5f88151d20 2023-08-27T11:26:38.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8806a8e0 0x7f5f8806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8806a8e0 0x7f5f8806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56490/0 (socket says 172.21.15.43:56490) 2023-08-27T11:26:38.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 -- 172.21.15.43:0/2969244531 learned_addr learned my addr 172.21.15.43:0/2969244531 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:38.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8e39b700 1 --2- 172.21.15.43:0/2969244531 >> v2:172.21.15.57:3300/0 conn(0x7f5f88151d20 0x7f5f880c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 -- 172.21.15.43:0/2969244531 >> v2:172.21.15.57:3300/0 conn(0x7f5f88151d20 msgr2=0x7f5f880c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:38.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 --2- 172.21.15.43:0/2969244531 >> v2:172.21.15.57:3300/0 conn(0x7f5f88151d20 0x7f5f880c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 -- 172.21.15.43:0/2969244531 >> v1:172.21.15.57:6789/0 conn(0x7f5f880c7c00 legacy=0x7f5f880ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 -- 172.21.15.43:0/2969244531 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88154c20 con 0x7f5f8806a8e0 2023-08-27T11:26:38.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.132+0000 7f5f8eb9c700 1 --2- 172.21.15.43:0/2969244531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8806a8e0 0x7f5f8806acf0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5f880cac10 tx=0x7f5f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cc1b60df03fc0e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f8d399700 1 -- 172.21.15.43:0/2969244531 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000e070 con 0x7f5f8806a8e0 2023-08-27T11:26:38.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f8d399700 1 -- 172.21.15.43:0/2969244531 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8000b9c0 con 0x7f5f8806a8e0 2023-08-27T11:26:38.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f8d399700 1 -- 172.21.15.43:0/2969244531 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000bd70 con 0x7f5f8806a8e0 2023-08-27T11:26:38.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 -- 172.21.15.43:0/2969244531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8806a8e0 msgr2=0x7f5f8806acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 --2- 172.21.15.43:0/2969244531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8806a8e0 0x7f5f8806acf0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5f880cac10 tx=0x7f5f8000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:38.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 -- 172.21.15.43:0/2969244531 shutdown_connections 2023-08-27T11:26:38.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 --2- 172.21.15.43:0/2969244531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8806a8e0 0x7f5f8806acf0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 --2- 172.21.15.43:0/2969244531 >> v2:172.21.15.57:3300/0 conn(0x7f5f88151d20 0x7f5f880c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 -- 172.21.15.43:0/2969244531 >> 172.21.15.43:0/2969244531 conn(0x7f5f880c9d00 msgr2=0x7f5f880ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:38.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.133+0000 7f5f905ff700 1 -- 172.21.15.43:0/2969244531 shutdown_connections 2023-08-27T11:26:38.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.134+0000 7f5f905ff700 1 -- 172.21.15.43:0/2969244531 wait complete. 2023-08-27T11:26:38.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.135+0000 7f5f905ff700 1 Processor -- start 2023-08-27T11:26:38.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.135+0000 7f5f905ff700 1 -- start start 2023-08-27T11:26:38.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 0x7f5f8814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 0x7f5f881536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c2c30 con 0x7f5f880c7c00 2023-08-27T11:26:38.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c0d40 con 0x7f5f8806a8e0 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f905ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f881edad0 con 0x7f5f88151d20 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f8db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f8db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56506/0 (socket says 172.21.15.43:56506) 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.136+0000 7f5f8db9a700 1 -- 172.21.15.43:0/500058911 learned_addr learned my addr 172.21.15.43:0/500058911 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8eb9c700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 0x7f5f881536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8e39b700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 0x7f5f8814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 -- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 msgr2=0x7f5f881536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 0x7f5f881536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 -- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 msgr2=0x7f5f8814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 0x7f5f8814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 -- 172.21.15.43:0/500058911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009b30 con 0x7f5f880c7c00 2023-08-27T11:26:38.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8e39b700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 0x7f5f8814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:38.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8eb9c700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 0x7f5f881536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:38.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f8db9a700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c510 tx=0x7f5f7800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780052d0 con 0x7f5f880c7c00 2023-08-27T11:26:38.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f78005430 con 0x7f5f880c7c00 2023-08-27T11:26:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780038c0 con 0x7f5f880c7c00 2023-08-27T11:26:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8814f0a0 con 0x7f5f880c7c00 2023-08-27T11:26:38.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.137+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8814dfb0 con 0x7f5f880c7c00 2023-08-27T11:26:38.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.138+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8804ee70 con 0x7f5f880c7c00 2023-08-27T11:26:38.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.139+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5f78003a20 con 0x7f5f880c7c00 2023-08-27T11:26:38.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.141+0000 7f5f7effd700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.141+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f5f78087c30 con 0x7f5f880c7c00 2023-08-27T11:26:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.141+0000 7f5f8e39b700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.142+0000 7f5f8e39b700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009820 tx=0x7f5f84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.146+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5f78053120 con 0x7f5f880c7c00 2023-08-27T11:26:38.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.354+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f880ac650 con 0x7f5f880c7c00 2023-08-27T11:26:38.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.354+0000 7f5f7effd700 1 -- 172.21.15.43:0/500058911 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f78017020 con 0x7f5f880c7c00 2023-08-27T11:26:38.356 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:26:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 msgr2=0x7f5f6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009820 tx=0x7f5f84008040 comp rx=0 tx=0).stop 2023-08-27T11:26:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 msgr2=0x7f5f881ed590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800c510 tx=0x7f5f7800c8d0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 shutdown_connections 2023-08-27T11:26:38.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f88151d20 0x7f5f881536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f8806a8e0 0x7f5f8814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 --2- 172.21.15.43:0/500058911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f880c7c00 0x7f5f881ed590 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.356+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 >> 172.21.15.43:0/500058911 conn(0x7f5f880c9d00 msgr2=0x7f5f880bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:38.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.357+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 shutdown_connections 2023-08-27T11:26:38.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.357+0000 7f5f905ff700 1 -- 172.21.15.43:0/500058911 wait complete. 2023-08-27T11:26:38.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:38.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.595+0000 7efe583ff700 1 Processor -- start 2023-08-27T11:26:38.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.595+0000 7efe583ff700 1 -- start start 2023-08-27T11:26:38.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe583ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe50151a90 0x7efe500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe583ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe500c4630 0x7efe500c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe583ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5006c4e0 con 0x7efe5006ad70 2023-08-27T11:26:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe583ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe50155370 con 0x7efe500c4630 2023-08-27T11:26:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe583ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe50151e70 con 0x7efe50151a90 2023-08-27T11:26:38.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe5599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe500c4630 0x7efe500c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe5599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efe500c4630 0x7efe500c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56510/0 (socket says 172.21.15.43:56510) 2023-08-27T11:26:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.596+0000 7efe5599a700 1 -- 172.21.15.43:0/1272928551 learned_addr learned my addr 172.21.15.43:0/1272928551 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5619b700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe50151a90 0x7efe500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5599a700 1 -- 172.21.15.43:0/1272928551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe50151a90 msgr2=0x7efe500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:38.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5599a700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe50151a90 0x7efe500c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5599a700 1 -- 172.21.15.43:0/1272928551 >> v1:172.21.15.43:6789/0 conn(0x7efe5006ad70 legacy=0x7efe5006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5599a700 1 -- 172.21.15.43:0/1272928551 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50154480 con 0x7efe500c4630 2023-08-27T11:26:38.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe5599a700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe500c4630 0x7efe500c4a90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efe400098f0 tx=0x7efe40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63a5d1c8a884e71 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe55199700 1 -- 172.21.15.43:0/1272928551 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4000b8a0 con 0x7efe500c4630 2023-08-27T11:26:38.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe55199700 1 -- 172.21.15.43:0/1272928551 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4000ba00 con 0x7efe500c4630 2023-08-27T11:26:38.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.597+0000 7efe55199700 1 -- 172.21.15.43:0/1272928551 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4000bd90 con 0x7efe500c4630 2023-08-27T11:26:38.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 -- 172.21.15.43:0/1272928551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe500c4630 msgr2=0x7efe500c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe500c4630 0x7efe500c4a90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7efe400098f0 tx=0x7efe40009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:38.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 -- 172.21.15.43:0/1272928551 shutdown_connections 2023-08-27T11:26:38.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe50151a90 0x7efe500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 --2- 172.21.15.43:0/1272928551 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe500c4630 0x7efe500c4a90 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 -- 172.21.15.43:0/1272928551 >> 172.21.15.43:0/1272928551 conn(0x7efe500ab820 msgr2=0x7efe500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:38.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 -- 172.21.15.43:0/1272928551 shutdown_connections 2023-08-27T11:26:38.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.598+0000 7efe583ff700 1 -- 172.21.15.43:0/1272928551 wait complete. 2023-08-27T11:26:38.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.600+0000 7efe583ff700 1 Processor -- start 2023-08-27T11:26:38.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.600+0000 7efe583ff700 1 -- start start 2023-08-27T11:26:38.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe5006ad70 0x7efe501eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe500c4630 0x7efe50149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe50149990 con 0x7efe50151a90 2023-08-27T11:26:38.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe501557b0 con 0x7efe500c4630 2023-08-27T11:26:38.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe583ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500aa390 con 0x7efe5006ad70 2023-08-27T11:26:38.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe5699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe5699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56522/0 (socket says 172.21.15.43:56522) 2023-08-27T11:26:38.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe5699c700 1 -- 172.21.15.43:0/2320579920 learned_addr learned my addr 172.21.15.43:0/2320579920 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:38.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.601+0000 7efe5599a700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe500c4630 0x7efe50149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5619b700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe5006ad70 0x7efe501eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 -- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe5006ad70 msgr2=0x7efe501eac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe5006ad70 0x7efe501eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 -- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe500c4630 msgr2=0x7efe50149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe500c4630 0x7efe50149450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 -- 172.21.15.43:0/2320579920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe40009550 con 0x7efe50151a90 2023-08-27T11:26:38.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe5699c700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efe4800cc50 tx=0x7efe4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800ad80 con 0x7efe50151a90 2023-08-27T11:26:38.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4800ce50 con 0x7efe50151a90 2023-08-27T11:26:38.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48003c40 con 0x7efe50151a90 2023-08-27T11:26:38.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe500c1b20 con 0x7efe50151a90 2023-08-27T11:26:38.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.602+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe50155ce0 con 0x7efe50151a90 2023-08-27T11:26:38.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.603+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe500aa500 con 0x7efe50151a90 2023-08-27T11:26:38.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.604+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe480050d0 con 0x7efe50151a90 2023-08-27T11:26:38.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.605+0000 7efe46ffd700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 0x7efe3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:38.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.605+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7efe48088770 con 0x7efe50151a90 2023-08-27T11:26:38.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.605+0000 7efe5619b700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 0x7efe3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:38.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.606+0000 7efe5619b700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 0x7efe3406c5a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe500ab660 tx=0x7efe4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:38.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.609+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efe48053d80 con 0x7efe50151a90 2023-08-27T11:26:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.862+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe5004ee70 con 0x7efe50151a90 2023-08-27T11:26:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.863+0000 7efe46ffd700 1 -- 172.21.15.43:0/2320579920 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4879 (secure 0 0 0) 0x7efe480573a0 con 0x7efe50151a90 2023-08-27T11:26:38.865 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:38.865 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":82,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:28.986106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6328":{"gid":6328,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":8,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.865+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 msgr2=0x7efe3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.865+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 0x7efe3406c5a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe500ab660 tx=0x7efe4c008040 comp rx=0 tx=0).stop 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.865+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 msgr2=0x7efe500c15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.865+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7efe4800cc50 tx=0x7efe4800a340 comp rx=0 tx=0).stop 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 shutdown_connections 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efe3406a0e0 0x7efe3406c5a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efe50151a90 0x7efe500c15e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe5006ad70 0x7efe501eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 --2- 172.21.15.43:0/2320579920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe500c4630 0x7efe50149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 >> 172.21.15.43:0/2320579920 conn(0x7efe500ab820 msgr2=0x7efe5006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 shutdown_connections 2023-08-27T11:26:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:38.866+0000 7efe583ff700 1 -- 172.21.15.43:0/2320579920 wait complete. 2023-08-27T11:26:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 83 2023-08-27T11:26:38.885 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:39.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.085+0000 7fccd07ff700 1 Processor -- start 2023-08-27T11:26:39.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.085+0000 7fccd07ff700 1 -- start start 2023-08-27T11:26:39.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.086+0000 7fccd07ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fccc80c4630 0x7fccc80c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.086+0000 7fccd07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 0x7fccc806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.086+0000 7fccd07ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc806c4e0 con 0x7fccc8151a90 2023-08-27T11:26:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.086+0000 7fccd07ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc8155370 con 0x7fccc80c4630 2023-08-27T11:26:39.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.086+0000 7fccd07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80c82c0 con 0x7fccc806ad70 2023-08-27T11:26:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fccc80c4630 0x7fccc80c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fccc80c4630 0x7fccc80c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44392/0 (socket says 172.21.15.43:44392) 2023-08-27T11:26:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 -- 172.21.15.43:0/1520877226 learned_addr learned my addr 172.21.15.43:0/1520877226 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fccced9c700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 0x7fccc806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 -- 172.21.15.43:0/1520877226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 msgr2=0x7fccc806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 0x7fccc806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 -- 172.21.15.43:0/1520877226 >> v1:172.21.15.57:6789/0 conn(0x7fccc8151a90 legacy=0x7fccc80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 -- 172.21.15.43:0/1520877226 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8151e70 con 0x7fccc80c4630 2023-08-27T11:26:39.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fccced9c700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 0x7fccc806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.087+0000 7fcccdd9a700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc80c4630 0x7fccc80c4a90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fccb80098f0 tx=0x7fccb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8320683d7cf3ee1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fcccd599700 1 -- 172.21.15.43:0/1520877226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800b8a0 con 0x7fccc80c4630 2023-08-27T11:26:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fcccd599700 1 -- 172.21.15.43:0/1520877226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb800ba00 con 0x7fccc80c4630 2023-08-27T11:26:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fcccd599700 1 -- 172.21.15.43:0/1520877226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb800bd90 con 0x7fccc80c4630 2023-08-27T11:26:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 -- 172.21.15.43:0/1520877226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc80c4630 msgr2=0x7fccc80c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc80c4630 0x7fccc80c4a90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fccb80098f0 tx=0x7fccb8009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 -- 172.21.15.43:0/1520877226 shutdown_connections 2023-08-27T11:26:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc806ad70 0x7fccc806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1520877226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc80c4630 0x7fccc80c4a90 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 -- 172.21.15.43:0/1520877226 >> 172.21.15.43:0/1520877226 conn(0x7fccc80ab820 msgr2=0x7fccc80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 -- 172.21.15.43:0/1520877226 shutdown_connections 2023-08-27T11:26:39.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.088+0000 7fccd07ff700 1 -- 172.21.15.43:0/1520877226 wait complete. 2023-08-27T11:26:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.090+0000 7fccd07ff700 1 Processor -- start 2023-08-27T11:26:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.090+0000 7fccd07ff700 1 -- start start 2023-08-27T11:26:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 0x7fccc814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc80c4630 0x7fccc8148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc81e77c0 con 0x7fccc8151a90 2023-08-27T11:26:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc80c3a10 con 0x7fccc806ad70 2023-08-27T11:26:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccd07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc814de50 con 0x7fccc80c4630 2023-08-27T11:26:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccced9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccced9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44404/0 (socket says 172.21.15.43:44404) 2023-08-27T11:26:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.091+0000 7fccced9c700 1 -- 172.21.15.43:0/1176711910 learned_addr learned my addr 172.21.15.43:0/1176711910 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccce59b700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 0x7fccc814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fcccdd9a700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc80c4630 0x7fccc8148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 -- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc80c4630 msgr2=0x7fccc8148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc80c4630 0x7fccc8148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 -- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 msgr2=0x7fccc814e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 0x7fccc814e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 -- 172.21.15.43:0/1176711910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8009550 con 0x7fccc8151a90 2023-08-27T11:26:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccce59b700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 0x7fccc814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:39.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccced9c700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009fa0 tx=0x7fccc000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0003a20 con 0x7fccc8151a90 2023-08-27T11:26:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc000f040 con 0x7fccc8151a90 2023-08-27T11:26:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc81ea6b0 con 0x7fccc8151a90 2023-08-27T11:26:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.092+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0003de0 con 0x7fccc8151a90 2023-08-27T11:26:39.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.093+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc814bdd0 con 0x7fccc8151a90 2023-08-27T11:26:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.094+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc804ee70 con 0x7fccc8151a90 2023-08-27T11:26:39.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.095+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fccc0004030 con 0x7fccc8151a90 2023-08-27T11:26:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.096+0000 7fccbeffd700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 0x7fccac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.096+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7fccc00887c0 con 0x7fccc8151a90 2023-08-27T11:26:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.096+0000 7fccce59b700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 0x7fccac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.097+0000 7fccce59b700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 0x7fccac06c5a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fccc4000f60 tx=0x7fccc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.101+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fccc0053e70 con 0x7fccc8151a90 2023-08-27T11:26:39.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.311+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccc8154d10 con 0x7fccc8151a90 2023-08-27T11:26:39.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.312+0000 7fccbeffd700 1 -- 172.21.15.43:0/1176711910 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18498 (secure 0 0 0) 0x7fccc0057490 con 0x7fccc8151a90 2023-08-27T11:26:39.314 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:39.314 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:33.029140+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1292748157":"2023-08-28T11:26:21.920637+0000","172.21.15.43:6834/1292748157":"2023-08-28T11:26:21.920637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:39.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 msgr2=0x7fccac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 0x7fccac06c5a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fccc4000f60 tx=0x7fccc4009040 comp rx=0 tx=0).stop 2023-08-27T11:26:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 msgr2=0x7fccc81491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009fa0 tx=0x7fccc000d460 comp rx=0 tx=0).stop 2023-08-27T11:26:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 shutdown_connections 2023-08-27T11:26:39.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fccac06a0e0 0x7fccac06c5a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fccc8151a90 0x7fccc81491d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccc806ad70 0x7fccc814e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 --2- 172.21.15.43:0/1176711910 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccc80c4630 0x7fccc8148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 >> 172.21.15.43:0/1176711910 conn(0x7fccc80ab820 msgr2=0x7fccc806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:39.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 shutdown_connections 2023-08-27T11:26:39.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.315+0000 7fccd07ff700 1 -- 172.21.15.43:0/1176711910 wait complete. 2023-08-27T11:26:39.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:26:39.335 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.535+0000 7f4d1dbff700 1 Processor -- start 2023-08-27T11:26:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.536+0000 7f4d1dbff700 1 -- start start 2023-08-27T11:26:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d1dbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d180c51a0 0x7f4d180c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d1dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d180c15e0 0x7f4d180c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d1dbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d180c5ae0 con 0x7f4d18151910 2023-08-27T11:26:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d1dbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180c69f0 con 0x7f4d180c51a0 2023-08-27T11:26:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d1dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180c1190 con 0x7f4d180c15e0 2023-08-27T11:26:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d16ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d180c51a0 0x7f4d180c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d16ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4d180c51a0 0x7f4d180c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44414/0 (socket says 172.21.15.43:44414) 2023-08-27T11:26:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d16ffd700 1 -- 172.21.15.43:0/1955890026 learned_addr learned my addr 172.21.15.43:0/1955890026 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.537+0000 7f4d17fff700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d180c15e0 0x7f4d180c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d16ffd700 1 -- 172.21.15.43:0/1955890026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d180c15e0 msgr2=0x7f4d180c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d16ffd700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d180c15e0 0x7f4d180c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d16ffd700 1 -- 172.21.15.43:0/1955890026 >> v1:172.21.15.57:6789/0 conn(0x7f4d18151910 legacy=0x7f4d18157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d16ffd700 1 -- 172.21.15.43:0/1955890026 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18072900 con 0x7f4d180c51a0 2023-08-27T11:26:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d16ffd700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d180c5f70 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098f0 tx=0x7f4d0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18d3d04990fb41d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d167fc700 1 -- 172.21.15.43:0/1955890026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00b8a0 con 0x7f4d180c51a0 2023-08-27T11:26:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d167fc700 1 -- 172.21.15.43:0/1955890026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00ba00 con 0x7f4d180c51a0 2023-08-27T11:26:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.538+0000 7f4d167fc700 1 -- 172.21.15.43:0/1955890026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00bd90 con 0x7f4d180c51a0 2023-08-27T11:26:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 -- 172.21.15.43:0/1955890026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 msgr2=0x7f4d180c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d180c5f70 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098f0 tx=0x7f4d0c009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 -- 172.21.15.43:0/1955890026 shutdown_connections 2023-08-27T11:26:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d180c15e0 0x7f4d180c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/1955890026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d180c5f70 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 -- 172.21.15.43:0/1955890026 >> 172.21.15.43:0/1955890026 conn(0x7f4d180a9740 msgr2=0x7f4d180a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:39.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 -- 172.21.15.43:0/1955890026 shutdown_connections 2023-08-27T11:26:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.539+0000 7f4d1dbff700 1 -- 172.21.15.43:0/1955890026 wait complete. 2023-08-27T11:26:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.541+0000 7f4d1dbff700 1 Processor -- start 2023-08-27T11:26:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.541+0000 7f4d1dbff700 1 -- start start 2023-08-27T11:26:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 0x7f4d18152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 0x7f4d1806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180ab840 con 0x7f4d180c51a0 2023-08-27T11:26:39.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1806e700 con 0x7f4d180c15e0 2023-08-27T11:26:39.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d1dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d181eab70 con 0x7f4d18151910 2023-08-27T11:26:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44430/0 (socket says 172.21.15.43:44430) 2023-08-27T11:26:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 -- 172.21.15.43:0/3640644944 learned_addr learned my addr 172.21.15.43:0/3640644944 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d177fe700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 0x7f4d18152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 -- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 msgr2=0x7f4d1806e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d17fff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 0x7f4d1806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 0x7f4d1806e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 -- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 msgr2=0x7f4d18152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 0x7f4d18152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d16ffd700 1 -- 172.21.15.43:0/3640644944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009550 con 0x7f4d180c51a0 2023-08-27T11:26:39.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d177fe700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 0x7f4d18152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.542+0000 7f4d17fff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 0x7f4d1806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4d16ffd700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009c40 tx=0x7f4d0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0036a0 con 0x7f4d180c51a0 2023-08-27T11:26:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c01e070 con 0x7f4d180c51a0 2023-08-27T11:26:39.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c003a60 con 0x7f4d180c51a0 2023-08-27T11:26:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d181eae50 con 0x7f4d180c51a0 2023-08-27T11:26:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.543+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d180abd70 con 0x7f4d180c51a0 2023-08-27T11:26:39.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.544+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d180c5680 con 0x7f4d180c51a0 2023-08-27T11:26:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.545+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d0c003bc0 con 0x7f4d180c51a0 2023-08-27T11:26:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.546+0000 7f4cfffff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 0x7f4d0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:39.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.546+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f4d0c020070 con 0x7f4d180c51a0 2023-08-27T11:26:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.546+0000 7f4d177fe700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 0x7f4d0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.547+0000 7f4d177fe700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 0x7f4d0406c5a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d08000f60 tx=0x7f4d08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:39.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.551+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d0c0550f0 con 0x7f4d180c51a0 2023-08-27T11:26:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.804+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d1804ee70 con 0x7f4d180c51a0 2023-08-27T11:26:39.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.805+0000 7f4cfffff700 1 -- 172.21.15.43:0/3640644944 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4879 (secure 0 0 0) 0x7f4d0c058710 con 0x7f4d180c51a0 2023-08-27T11:26:39.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:39.807 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":82,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:28.986106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6328":{"gid":6328,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":8,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:39.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.807+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 msgr2=0x7f4d0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.807+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 0x7f4d0406c5a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d08000f60 tx=0x7f4d08009040 comp rx=0 tx=0).stop 2023-08-27T11:26:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 msgr2=0x7f4d1806dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009c40 tx=0x7f4d0c004750 comp rx=0 tx=0).stop 2023-08-27T11:26:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 shutdown_connections 2023-08-27T11:26:39.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4d0406a0e0 0x7f4d0406c5a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4d18151910 0x7f4d1806e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d180c15e0 0x7f4d18152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 --2- 172.21.15.43:0/3640644944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4d180c51a0 0x7f4d1806dc80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 >> 172.21.15.43:0/3640644944 conn(0x7f4d180a9740 msgr2=0x7f4d18071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:39.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 shutdown_connections 2023-08-27T11:26:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:39.808+0000 7f4d1dbff700 1 -- 172.21.15.43:0/3640644944 wait complete. 2023-08-27T11:26:39.812 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 83 2023-08-27T11:26:39.827 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.027+0000 7ff5493ff700 1 Processor -- start 2023-08-27T11:26:40.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.027+0000 7ff5493ff700 1 -- start start 2023-08-27T11:26:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.028+0000 7ff5493ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 0x7ff5440c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.028+0000 7ff5493ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544154d00 con 0x7ff544154740 2023-08-27T11:26:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.028+0000 7ff5493ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff544154fe0 con 0x7ff54414e960 2023-08-27T11:26:40.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.028+0000 7ff5493ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440baf30 con 0x7ff5440c50d0 2023-08-27T11:26:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5437fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff544154740 0x7ff5440c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46194/0 (socket says 172.21.15.43:46194) 2023-08-27T11:26:40.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5437fe700 1 -- 172.21.15.43:0/3390453354 learned_addr learned my addr 172.21.15.43:0/3390453354 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5427fc700 1 --2- 172.21.15.43:0/3390453354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 0x7ff5440c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795518188 0 0) 0x7ff544154d00 con 0x7ff544154740 2023-08-27T11:26:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c0035b0 con 0x7ff544154740 2023-08-27T11:26:40.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003480773 0 0) 0x7ff544154fe0 con 0x7ff54414e960 2023-08-27T11:26:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff544154d00 con 0x7ff54414e960 2023-08-27T11:26:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5427fc700 1 -- 172.21.15.43:0/3390453354 >> v1:172.21.15.57:6789/0 conn(0x7ff54414e960 legacy=0x7ff5440a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5427fc700 1 -- 172.21.15.43:0/3390453354 >> v1:172.21.15.43:6789/0 conn(0x7ff544154740 legacy=0x7ff5440c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.029+0000 7ff5427fc700 1 -- 172.21.15.43:0/3390453354 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5441552c0 con 0x7ff5440c50d0 2023-08-27T11:26:40.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff5427fc700 1 --2- 172.21.15.43:0/3390453354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 0x7ff5440c3cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff538009870 tx=0x7ff538009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c35a3441a0fab14 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538011830 con 0x7ff5440c50d0 2023-08-27T11:26:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538011990 con 0x7ff5440c50d0 2023-08-27T11:26:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff541ffb700 1 -- 172.21.15.43:0/3390453354 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538011d20 con 0x7ff5440c50d0 2023-08-27T11:26:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff5493ff700 1 -- 172.21.15.43:0/3390453354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 msgr2=0x7ff5440c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.030+0000 7ff5493ff700 1 --2- 172.21.15.43:0/3390453354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 0x7ff5440c3cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff538009870 tx=0x7ff538009b80 comp rx=0 tx=0).stop 2023-08-27T11:26:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.031+0000 7ff5493ff700 1 -- 172.21.15.43:0/3390453354 shutdown_connections 2023-08-27T11:26:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.031+0000 7ff5493ff700 1 --2- 172.21.15.43:0/3390453354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5440c50d0 0x7ff5440c3cc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.031+0000 7ff5493ff700 1 -- 172.21.15.43:0/3390453354 >> 172.21.15.43:0/3390453354 conn(0x7ff54406aa50 msgr2=0x7ff5440c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.031+0000 7ff5493ff700 1 -- 172.21.15.43:0/3390453354 shutdown_connections 2023-08-27T11:26:40.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.031+0000 7ff5493ff700 1 -- 172.21.15.43:0/3390453354 wait complete. 2023-08-27T11:26:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.033+0000 7ff5493ff700 1 Processor -- start 2023-08-27T11:26:40.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.033+0000 7ff5493ff700 1 -- start start 2023-08-27T11:26:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.034+0000 7ff5493ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.034+0000 7ff5493ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54414e960 0x7ff544150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.034+0000 7ff5493ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff544154740 0x7ff54414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff5493ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440a4b70 con 0x7ff5440c50d0 2023-08-27T11:26:40.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff5493ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5441508e0 con 0x7ff54414e960 2023-08-27T11:26:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff5493ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5440a8d30 con 0x7ff544154740 2023-08-27T11:26:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44444/0 (socket says 172.21.15.43:44444) 2023-08-27T11:26:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 -- 172.21.15.43:0/913089448 learned_addr learned my addr 172.21.15.43:0/913089448 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:40.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 -- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff544154740 msgr2=0x7ff54414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff544154740 0x7ff54414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 -- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54414e960 msgr2=0x7ff544150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54414e960 0x7ff544150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 -- 172.21.15.43:0/913089448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380094a0 con 0x7ff5440c50d0 2023-08-27T11:26:40.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.035+0000 7ff542ffd700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c580 tx=0x7ff53400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.036+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340052d0 con 0x7ff5440c50d0 2023-08-27T11:26:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.036+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534005430 con 0x7ff5440c50d0 2023-08-27T11:26:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.036+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340038c0 con 0x7ff5440c50d0 2023-08-27T11:26:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.036+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff544151ba0 con 0x7ff5440c50d0 2023-08-27T11:26:40.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.036+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff544151e40 con 0x7ff5440c50d0 2023-08-27T11:26:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.037+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff544151a00 con 0x7ff5440c50d0 2023-08-27T11:26:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.038+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff534003a20 con 0x7ff5440c50d0 2023-08-27T11:26:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.038+0000 7ff52b7fe700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 0x7ff53006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.039+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7ff534087ba0 con 0x7ff5440c50d0 2023-08-27T11:26:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.039+0000 7ff5427fc700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 0x7ff53006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.039+0000 7ff5427fc700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 0x7ff53006c5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff538009870 tx=0x7ff538010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.043+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff544151a00 con 0x7ff5440c50d0 2023-08-27T11:26:40.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.299+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff544151a00 con 0x7ff5440c50d0 2023-08-27T11:26:40.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.300+0000 7ff52b7fe700 1 -- 172.21.15.43:0/913089448 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4879 (secure 0 0 0) 0x7ff544151a00 con 0x7ff5440c50d0 2023-08-27T11:26:40.302 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:40.302 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":83,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":82,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-08-27T11:26:12.678531+0000","modified":"2023-08-27T11:26:28.986106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6322":{"gid":6322,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/3998632195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":3998632195},{"type":"v1","addr":"172.21.15.43:6837","nonce":3998632195}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_6328":{"gid":6328,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":8,"addr":"172.21.15.57:6833/1640307202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1640307202},{"type":"v1","addr":"172.21.15.57:6833","nonce":1640307202}]},"join_fscid":6,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-27T11:26:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 msgr2=0x7ff53006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 0x7ff53006c5a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff538009870 tx=0x7ff538010000 comp rx=0 tx=0).stop 2023-08-27T11:26:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 msgr2=0x7ff5440a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c580 tx=0x7ff53400c940 comp rx=0 tx=0).stop 2023-08-27T11:26:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 shutdown_connections 2023-08-27T11:26:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff53006a0e0 0x7ff53006c5a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff544154740 0x7ff54414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5440c50d0 0x7ff5440a87f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 --2- 172.21.15.43:0/913089448 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff54414e960 0x7ff544150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 >> 172.21.15.43:0/913089448 conn(0x7ff54406aa50 msgr2=0x7ff5440c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 shutdown_connections 2023-08-27T11:26:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.302+0000 7ff5493ff700 1 -- 172.21.15.43:0/913089448 wait complete. 2023-08-27T11:26:40.306 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 83 2023-08-27T11:26:40.322 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:40.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.523+0000 7f3e0edff700 1 Processor -- start 2023-08-27T11:26:40.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.523+0000 7f3e0edff700 1 -- start start 2023-08-27T11:26:40.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0edff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 0x7f3e080c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0edff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3e08072150 0x7f3e080c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0edff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e080c4160 con 0x7f3e0814e990 2023-08-27T11:26:40.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0edff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080c1520 con 0x7f3e08072150 2023-08-27T11:26:40.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0edff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0806c780 con 0x7f3e0814e5b0 2023-08-27T11:26:40.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e07fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3e0814e990 0x7f3e08071a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46204/0 (socket says 172.21.15.43:46204) 2023-08-27T11:26:40.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e07fff700 1 -- 172.21.15.43:0/375890097 learned_addr learned my addr 172.21.15.43:0/375890097 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:40.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.524+0000 7f3e0d39c700 1 --2- 172.21.15.43:0/375890097 >> v2:172.21.15.43:3300/0 conn(0x7f3e08072150 0x7f3e080c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0cb9b700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 0x7f3e080c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e077fe700 1 -- 172.21.15.43:0/375890097 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030476242 0 0) 0x7f3e080c4160 con 0x7f3e0814e990 2023-08-27T11:26:40.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e077fe700 1 -- 172.21.15.43:0/375890097 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df80035b0 con 0x7f3e0814e990 2023-08-27T11:26:40.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0d39c700 1 -- 172.21.15.43:0/375890097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 msgr2=0x7f3e080c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:40.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0d39c700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 0x7f3e080c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0d39c700 1 -- 172.21.15.43:0/375890097 >> v1:172.21.15.43:6789/0 conn(0x7f3e0814e990 legacy=0x7f3e08071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0d39c700 1 -- 172.21.15.43:0/375890097 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080c2180 con 0x7f3e08072150 2023-08-27T11:26:40.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0cb9b700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 0x7f3e080c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:40.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e0d39c700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e08072150 0x7f3e080c5080 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91641a4c409e846 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e077fe700 1 -- 172.21.15.43:0/375890097 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000e070 con 0x7f3e08072150 2023-08-27T11:26:40.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e077fe700 1 -- 172.21.15.43:0/375890097 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000bb20 con 0x7f3e08072150 2023-08-27T11:26:40.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.525+0000 7f3e077fe700 1 -- 172.21.15.43:0/375890097 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00012430 con 0x7f3e08072150 2023-08-27T11:26:40.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 -- 172.21.15.43:0/375890097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e08072150 msgr2=0x7f3e080c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e08072150 0x7f3e080c5080 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0000b330 comp rx=0 tx=0).stop 2023-08-27T11:26:40.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 -- 172.21.15.43:0/375890097 shutdown_connections 2023-08-27T11:26:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e08072150 0x7f3e080c5080 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 --2- 172.21.15.43:0/375890097 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814e5b0 0x7f3e080c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 -- 172.21.15.43:0/375890097 >> 172.21.15.43:0/375890097 conn(0x7f3e080c2860 msgr2=0x7f3e080c2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 -- 172.21.15.43:0/375890097 shutdown_connections 2023-08-27T11:26:40.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.526+0000 7f3e0edff700 1 -- 172.21.15.43:0/375890097 wait complete. 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.528+0000 7f3e0edff700 1 Processor -- start 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.528+0000 7f3e0edff700 1 -- start start 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0814e990 0x7f3e081528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814cad0 0x7f3e080bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080b9d50 con 0x7f3e0814e5b0 2023-08-27T11:26:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080bea70 con 0x7f3e0814e990 2023-08-27T11:26:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0edff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080bae30 con 0x7f3e0814cad0 2023-08-27T11:26:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44454/0 (socket says 172.21.15.43:44454) 2023-08-27T11:26:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 -- 172.21.15.43:0/210457642 learned_addr learned my addr 172.21.15.43:0/210457642 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e07fff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0814e990 0x7f3e081528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0d39c700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814cad0 0x7f3e080bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 -- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814cad0 msgr2=0x7f3e080bef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814cad0 0x7f3e080bef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 -- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0814e990 msgr2=0x7f3e081528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0814e990 0x7f3e081528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.529+0000 7f3e0cb9b700 1 -- 172.21.15.43:0/210457642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00009a70 con 0x7f3e0814e5b0 2023-08-27T11:26:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e0cb9b700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00e810 tx=0x7f3dfc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc013610 con 0x7f3e0814e5b0 2023-08-27T11:26:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc013770 con 0x7f3e0814e5b0 2023-08-27T11:26:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e081ea240 con 0x7f3e0814e5b0 2023-08-27T11:26:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc013b20 con 0x7f3e0814e5b0 2023-08-27T11:26:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.530+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e080be420 con 0x7f3e0814e5b0 2023-08-27T11:26:40.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.531+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e080be260 con 0x7f3e0814e5b0 2023-08-27T11:26:40.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.532+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3dfc013c80 con 0x7f3e0814e5b0 2023-08-27T11:26:40.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.534+0000 7f3e057fa700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 0x7f3dec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.534+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f3dfc088230 con 0x7f3e0814e5b0 2023-08-27T11:26:40.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.534+0000 7f3e07fff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 0x7f3dec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.535+0000 7f3e07fff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 0x7f3dec06c5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806df70 tx=0x7f3df4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.538+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3dfc057240 con 0x7f3e0814e5b0 2023-08-27T11:26:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.750+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e080bed50 con 0x7f3e0814e5b0 2023-08-27T11:26:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.751+0000 7f3e057fa700 1 -- 172.21.15.43:0/210457642 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18498 (secure 0 0 0) 0x7f3dfc056dd0 con 0x7f3e0814e5b0 2023-08-27T11:26:40.753 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:40.753 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":84,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:33.029140+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:11.014966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:11.661257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.8","mappings":[{"from":1,"to":2}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.29","mappings":[{"from":1,"to":5}]},{"pgid":"14.2a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1292748157":"2023-08-28T11:26:21.920637+0000","172.21.15.43:6834/1292748157":"2023-08-28T11:26:21.920637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:40.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 msgr2=0x7f3dec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 0x7f3dec06c5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e0806df70 tx=0x7f3df4007dc0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 msgr2=0x7f3e0814c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00e810 tx=0x7f3dfc00eb20 comp rx=0 tx=0).stop 2023-08-27T11:26:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 shutdown_connections 2023-08-27T11:26:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dec06a0e0 0x7f3dec06c5a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e0814cad0 0x7f3e080bef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3e0814e5b0 0x7f3e0814c590 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 --2- 172.21.15.43:0/210457642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e0814e990 0x7f3e081528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.753+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 >> 172.21.15.43:0/210457642 conn(0x7f3e080c2860 msgr2=0x7f3e08070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.754+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 shutdown_connections 2023-08-27T11:26:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.754+0000 7f3e0edff700 1 -- 172.21.15.43:0/210457642 wait complete. 2023-08-27T11:26:40.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:26:40.915 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:26:40.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:26:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.982+0000 7f364c5ff700 1 Processor -- start 2023-08-27T11:26:40.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.983+0000 7f364c5ff700 1 -- start start 2023-08-27T11:26:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f364414fb40 0x7f36440c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364c5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440c3370 con 0x7f36440c51c0 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440c3650 con 0x7f364406dd00 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364414ff20 con 0x7f364414fb40 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f364414fb40 0x7f36440c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f364414fb40 0x7f36440c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44466/0 (socket says 172.21.15.43:44466) 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364ab9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f36440c51c0 0x7f36441560e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46218/0 (socket says 172.21.15.43:46218) 2023-08-27T11:26:40.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.984+0000 7f364a39b700 1 -- 172.21.15.43:0/1138149146 learned_addr learned my addr 172.21.15.43:0/1138149146 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f364a39b700 1 -- 172.21.15.43:0/1138149146 >> v1:172.21.15.57:6789/0 conn(0x7f364406dd00 legacy=0x7f36441559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f364a39b700 1 -- 172.21.15.43:0/1138149146 >> v1:172.21.15.43:6789/0 conn(0x7f36440c51c0 legacy=0x7f36441560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f364a39b700 1 -- 172.21.15.43:0/1138149146 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36440c3930 con 0x7f364414fb40 2023-08-27T11:26:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f364a39b700 1 --2- 172.21.15.43:0/1138149146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f36440c6aa0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f3640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b5b609e4af1854 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f3649399700 1 -- 172.21.15.43:0/1138149146 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000b8a0 con 0x7f364414fb40 2023-08-27T11:26:40.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f3649399700 1 -- 172.21.15.43:0/1138149146 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000ba00 con 0x7f364414fb40 2023-08-27T11:26:40.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.985+0000 7f3649399700 1 -- 172.21.15.43:0/1138149146 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000bd90 con 0x7f364414fb40 2023-08-27T11:26:40.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 -- 172.21.15.43:0/1138149146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 msgr2=0x7f36440c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1138149146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f36440c6aa0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f36400098f0 tx=0x7f3640009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:40.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 -- 172.21.15.43:0/1138149146 shutdown_connections 2023-08-27T11:26:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1138149146 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f36440c6aa0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 -- 172.21.15.43:0/1138149146 >> 172.21.15.43:0/1138149146 conn(0x7f36440a9740 msgr2=0x7f36440a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 -- 172.21.15.43:0/1138149146 shutdown_connections 2023-08-27T11:26:40.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.986+0000 7f364c5ff700 1 -- 172.21.15.43:0/1138149146 wait complete. 2023-08-27T11:26:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.989+0000 7f364c5ff700 1 Processor -- start 2023-08-27T11:26:40.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.989+0000 7f364c5ff700 1 -- start start 2023-08-27T11:26:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.990+0000 7f364c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36440c51c0 0x7f36440a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.990+0000 7f364c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.990+0000 7f364c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f364406ba60 0x7f36441500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f364c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36441540e0 con 0x7f364414fb40 2023-08-27T11:26:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f364c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364406c920 con 0x7f36440c51c0 2023-08-27T11:26:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f364c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364406cc00 con 0x7f364406ba60 2023-08-27T11:26:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44468/0 (socket says 172.21.15.43:44468) 2023-08-27T11:26:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 -- 172.21.15.43:0/1758141267 learned_addr learned my addr 172.21.15.43:0/1758141267 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f364a39b700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36440c51c0 0x7f36440a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f364ab9c700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f364406ba60 0x7f36441500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 -- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f364406ba60 msgr2=0x7f36441500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f364406ba60 0x7f36441500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 -- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36440c51c0 msgr2=0x7f36440a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36440c51c0 0x7f36440a8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.991+0000 7f3649b9a700 1 -- 172.21.15.43:0/1758141267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009550 con 0x7f364414fb40 2023-08-27T11:26:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f3649b9a700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4e0 tx=0x7f363400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:40.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340052d0 con 0x7f364414fb40 2023-08-27T11:26:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634005430 con 0x7f364414fb40 2023-08-27T11:26:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340038c0 con 0x7f364414fb40 2023-08-27T11:26:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364406cee0 con 0x7f364414fb40 2023-08-27T11:26:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.992+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36440a9120 con 0x7f364414fb40 2023-08-27T11:26:40.997 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.993+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364406d400 con 0x7f364414fb40 2023-08-27T11:26:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.994+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3634003a20 con 0x7f364414fb40 2023-08-27T11:26:40.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.995+0000 7f363affd700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 0x7f362806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.996+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6264+0+0 (secure 0 0 0) 0x7f36340879f0 con 0x7f364414fb40 2023-08-27T11:26:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.996+0000 7f364a39b700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 0x7f362806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:40.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:40.996+0000 7f364a39b700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 0x7f362806c5a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3640014040 tx=0x7f3640008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:41.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.000+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f364406d400 con 0x7f364414fb40 2023-08-27T11:26:41.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.260+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f364406d400 con 0x7f364414fb40 2023-08-27T11:26:41.262 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:26:41.261+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:26:41.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.267+0000 7f363affd700 1 -- 172.21.15.43:0/1758141267 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7f364406d400 con 0x7f364414fb40 2023-08-27T11:26:41.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 msgr2=0x7f362806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 0x7f362806c5a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3640014040 tx=0x7f3640008030 comp rx=0 tx=0).stop 2023-08-27T11:26:41.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 msgr2=0x7f364406b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4e0 tx=0x7f363400c7f0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 shutdown_connections 2023-08-27T11:26:41.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f362806a0e0 0x7f362806c5a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f364406ba60 0x7f36441500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36440c51c0 0x7f36440a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 --2- 172.21.15.43:0/1758141267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f364414fb40 0x7f364406b520 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 >> 172.21.15.43:0/1758141267 conn(0x7f36440a9740 msgr2=0x7f3644071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:41.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.270+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 shutdown_connections 2023-08-27T11:26:41.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.271+0000 7f364c5ff700 1 -- 172.21.15.43:0/1758141267 wait complete. 2023-08-27T11:26:41.275 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:26:41.276 INFO:tasks.ceph.mds.c.smithi043.stderr: -451> 2023-08-27T11:26:27.118+0000 7f2a131f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:26:41.291 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:26:41.313 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:26:41.317 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:26:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.495+0000 7f4406bff700 1 Processor -- start 2023-08-27T11:26:41.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.496+0000 7f4406bff700 1 -- start start 2023-08-27T11:26:41.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f4406bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f4406bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 0x7f44000c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f4406bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440006c4e0 con 0x7f440006ad70 2023-08-27T11:26:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f4406bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4400155370 con 0x7f44000c4630 2023-08-27T11:26:41.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f4406bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4400151e70 con 0x7f4400151a90 2023-08-27T11:26:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f43fffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 0x7f44000c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f440499b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f440499b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:33176/0 (socket says 172.21.15.43:33176) 2023-08-27T11:26:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f440499b700 1 -- 172.21.15.43:0/352664553 learned_addr learned my addr 172.21.15.43:0/352664553 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:41.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.497+0000 7f43fffff700 1 --2- 172.21.15.43:0/352664553 >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 0x7f44000c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45650/0 (socket says 172.21.15.43:45650) 2023-08-27T11:26:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f440499b700 1 -- 172.21.15.43:0/352664553 >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 msgr2=0x7f44000c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f440499b700 1 --2- 172.21.15.43:0/352664553 >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 0x7f44000c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f440499b700 1 -- 172.21.15.43:0/352664553 >> v1:172.21.15.57:6789/0 conn(0x7f440006ad70 legacy=0x7f440006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f440499b700 1 -- 172.21.15.43:0/352664553 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400154480 con 0x7f4400151a90 2023-08-27T11:26:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f440499b700 1 --2- 172.21.15.43:0/352664553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098f0 tx=0x7f43f4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c8c12132dbdf58b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f43ff7fe700 1 -- 172.21.15.43:0/352664553 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4011830 con 0x7f4400151a90 2023-08-27T11:26:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f43ff7fe700 1 -- 172.21.15.43:0/352664553 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f4011990 con 0x7f4400151a90 2023-08-27T11:26:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.498+0000 7f43ff7fe700 1 -- 172.21.15.43:0/352664553 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4011d20 con 0x7f4400151a90 2023-08-27T11:26:41.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 -- 172.21.15.43:0/352664553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 msgr2=0x7f44000c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 --2- 172.21.15.43:0/352664553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43f40098f0 tx=0x7f43f4009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 -- 172.21.15.43:0/352664553 shutdown_connections 2023-08-27T11:26:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 --2- 172.21.15.43:0/352664553 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4400151a90 0x7f44000c7bb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 --2- 172.21.15.43:0/352664553 >> v2:172.21.15.57:3300/0 conn(0x7f44000c4630 0x7f44000c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 -- 172.21.15.43:0/352664553 >> 172.21.15.43:0/352664553 conn(0x7f44000ab820 msgr2=0x7f44000abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 -- 172.21.15.43:0/352664553 shutdown_connections 2023-08-27T11:26:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.499+0000 7f4406bff700 1 -- 172.21.15.43:0/352664553 wait complete. 2023-08-27T11:26:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.501+0000 7f4406bff700 1 Processor -- start 2023-08-27T11:26:41.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.501+0000 7f4406bff700 1 -- start start 2023-08-27T11:26:41.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f440006ad70 0x7f44001ed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44000c4630 0x7f4400153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44001562e0 con 0x7f4400151a90 2023-08-27T11:26:41.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44001ecbd0 con 0x7f440006ad70 2023-08-27T11:26:41.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f4406bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44001eceb0 con 0x7f44000c4630 2023-08-27T11:26:41.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44494/0 (socket says 172.21.15.43:44494) 2023-08-27T11:26:41.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 -- 172.21.15.43:0/3045788442 learned_addr learned my addr 172.21.15.43:0/3045788442 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:41.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440499b700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f440006ad70 0x7f44001ed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f43fffff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44000c4630 0x7f4400153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 -- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44000c4630 msgr2=0x7f4400153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44000c4630 0x7f4400153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 -- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f440006ad70 msgr2=0x7f44001ed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f440006ad70 0x7f44001ed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.502+0000 7f440519c700 1 -- 172.21.15.43:0/3045788442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009550 con 0x7f4400151a90 2023-08-27T11:26:41.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f440519c700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f43f800cc50 tx=0x7f43f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:41.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003c00 con 0x7f4400151a90 2023-08-27T11:26:41.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f8003d60 con 0x7f4400151a90 2023-08-27T11:26:41.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800ab60 con 0x7f4400151a90 2023-08-27T11:26:41.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44001ed190 con 0x7f4400151a90 2023-08-27T11:26:41.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.503+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44001586b0 con 0x7f4400151a90 2023-08-27T11:26:41.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.504+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44001ed3b0 con 0x7f4400151a90 2023-08-27T11:26:41.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.505+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f43f800acc0 con 0x7f4400151a90 2023-08-27T11:26:41.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.506+0000 7f43fd7fa700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 0x7f43e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:41.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.507+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6350+0+0 (secure 0 0 0) 0x7f43f80887e0 con 0x7f4400151a90 2023-08-27T11:26:41.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.507+0000 7f440499b700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 0x7f43e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:41.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.507+0000 7f440499b700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 0x7f43e406c5a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009c40 tx=0x7f43f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:41.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.511+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43f8053d10 con 0x7f4400151a90 2023-08-27T11:26:41.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:41.770+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f440004ee70 con 0x7f4400151a90 2023-08-27T11:26:42.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.267+0000 7f43fd7fa700 1 -- 172.21.15.43:0/3045788442 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43f8057330 con 0x7f4400151a90 2023-08-27T11:26:42.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 msgr2=0x7f43e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 0x7f43e406c5a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009c40 tx=0x7f43f4008030 comp rx=0 tx=0).stop 2023-08-27T11:26:42.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 msgr2=0x7f4400147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f43f800cc50 tx=0x7f43f800cf60 comp rx=0 tx=0).stop 2023-08-27T11:26:42.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 shutdown_connections 2023-08-27T11:26:42.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f43e406a0e0 0x7f43e406c5a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4400151a90 0x7f4400147b50 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f440006ad70 0x7f44001ed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 --2- 172.21.15.43:0/3045788442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44000c4630 0x7f4400153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 >> 172.21.15.43:0/3045788442 conn(0x7f44000ab820 msgr2=0x7f440014d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:42.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.270+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 shutdown_connections 2023-08-27T11:26:42.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.271+0000 7f4406bff700 1 -- 172.21.15.43:0/3045788442 wait complete. 2023-08-27T11:26:42.294 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:26:42.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.541+0000 7fd52c1ff700 1 Processor -- start 2023-08-27T11:26:42.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.541+0000 7fd52c1ff700 1 -- start start 2023-08-27T11:26:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.542+0000 7fd52c1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd524151a40 0x7fd5240c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd52c1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524154730 con 0x7fd5240c81c0 2023-08-27T11:26:42.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd52c1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd524154a10 con 0x7fd52406b780 2023-08-27T11:26:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd52c1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524154520 con 0x7fd524151a40 2023-08-27T11:26:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd529f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd524151a40 0x7fd5240c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:42.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd52979a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd5240c81c0 0x7fd5240c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46234/0 (socket says 172.21.15.43:46234) 2023-08-27T11:26:42.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd52979a700 1 -- 172.21.15.43:0/1689700387 learned_addr learned my addr 172.21.15.43:0/1689700387 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:42.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd529f9b700 1 -- 172.21.15.43:0/1689700387 >> v1:172.21.15.57:6789/0 conn(0x7fd52406b780 legacy=0x7fd52406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd528f99700 1 -- 172.21.15.43:0/1689700387 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896576178 0 0) 0x7fd524154730 con 0x7fd5240c81c0 2023-08-27T11:26:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd529f9b700 1 -- 172.21.15.43:0/1689700387 >> v1:172.21.15.43:6789/0 conn(0x7fd5240c81c0 legacy=0x7fd5240c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.543+0000 7fd529f9b700 1 -- 172.21.15.43:0/1689700387 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524154cf0 con 0x7fd524151a40 2023-08-27T11:26:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd529f9b700 1 --2- 172.21.15.43:0/1689700387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd5240c7c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd520009840 tx=0x7fd520009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f61e9116cc6269 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:42.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd528f99700 1 -- 172.21.15.43:0/1689700387 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520011830 con 0x7fd524151a40 2023-08-27T11:26:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd528f99700 1 -- 172.21.15.43:0/1689700387 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520011990 con 0x7fd524151a40 2023-08-27T11:26:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd528f99700 1 -- 172.21.15.43:0/1689700387 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520011d20 con 0x7fd524151a40 2023-08-27T11:26:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1689700387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 msgr2=0x7fd5240c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.544+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1689700387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd5240c7c80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd520009840 tx=0x7fd520009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.545+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1689700387 shutdown_connections 2023-08-27T11:26:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.545+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1689700387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd5240c7c80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.545+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1689700387 >> 172.21.15.43:0/1689700387 conn(0x7fd5240ab890 msgr2=0x7fd5240abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:42.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.545+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1689700387 shutdown_connections 2023-08-27T11:26:42.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.545+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1689700387 wait complete. 2023-08-27T11:26:42.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.546+0000 7fd52c1ff700 1 Processor -- start 2023-08-27T11:26:42.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.546+0000 7fd52c1ff700 1 -- start start 2023-08-27T11:26:42.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52406b780 0x7fd524156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:42.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5240c81c0 0x7fd52414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:42.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:42.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240bd580 con 0x7fd524151a40 2023-08-27T11:26:42.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524155b40 con 0x7fd52406b780 2023-08-27T11:26:42.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.547+0000 7fd52c1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240c3db0 con 0x7fd5240c81c0 2023-08-27T11:26:42.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:42.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44516/0 (socket says 172.21.15.43:44516) 2023-08-27T11:26:42.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 -- 172.21.15.43:0/1951183977 learned_addr learned my addr 172.21.15.43:0/1951183977 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:42.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd529f9b700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52406b780 0x7fd524156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:42.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52979a700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5240c81c0 0x7fd52414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:42.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 -- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5240c81c0 msgr2=0x7fd52414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5240c81c0 0x7fd52414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 -- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52406b780 msgr2=0x7fd524156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:42.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52406b780 0x7fd524156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 -- 172.21.15.43:0/1951183977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200094a0 con 0x7fd524151a40 2023-08-27T11:26:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.548+0000 7fd52a79c700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00cc80 tx=0x7fd51c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.549+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c003c00 con 0x7fd524151a40 2023-08-27T11:26:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.549+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c003d60 con 0x7fd524151a40 2023-08-27T11:26:42.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.549+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00ab90 con 0x7fd524151a40 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.549+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240bd2a0 con 0x7fd524151a40 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.549+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5240c3a60 con 0x7fd524151a40 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.550+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd524155910 con 0x7fd524151a40 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.551+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd51c00acf0 con 0x7fd524151a40 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.552+0000 7fd51a7fc700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 0x7fd50806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:42.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.552+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6350+0+0 (secure 0 0 0) 0x7fd51c0887e0 con 0x7fd524151a40 2023-08-27T11:26:42.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.552+0000 7fd529f9b700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 0x7fd50806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:42.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.553+0000 7fd529f9b700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 0x7fd50806c5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5200090b0 tx=0x7fd52001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:42.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.556+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd524155910 con 0x7fd524151a40 2023-08-27T11:26:42.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:42.765+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd524155910 con 0x7fd524151a40 2023-08-27T11:26:43.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.272+0000 7fd51a7fc700 1 -- 172.21.15.43:0/1951183977 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd51c053d10 con 0x7fd524151a40 2023-08-27T11:26:43.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 msgr2=0x7fd50806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 0x7fd50806c5a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5200090b0 tx=0x7fd52001c040 comp rx=0 tx=0).stop 2023-08-27T11:26:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 msgr2=0x7fd524155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00cc80 tx=0x7fd51c00cf90 comp rx=0 tx=0).stop 2023-08-27T11:26:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 shutdown_connections 2023-08-27T11:26:43.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd50806a0e0 0x7fd50806c5a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd524151a40 0x7fd524155fd0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52406b780 0x7fd524156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 --2- 172.21.15.43:0/1951183977 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5240c81c0 0x7fd52414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 >> 172.21.15.43:0/1951183977 conn(0x7fd5240ab890 msgr2=0x7fd524153780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:43.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 shutdown_connections 2023-08-27T11:26:43.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.276+0000 7fd52c1ff700 1 -- 172.21.15.43:0/1951183977 wait complete. 2023-08-27T11:26:43.280 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:26:43.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:26:43.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.510+0000 7fea825ff700 1 Processor -- start 2023-08-27T11:26:43.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.510+0000 7fea825ff700 1 -- start start 2023-08-27T11:26:43.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea825ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c06a580 0x7fea7c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea825ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea7c151900 0x7fea7c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea825ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7c155500 con 0x7fea7c0c4f10 2023-08-27T11:26:43.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea825ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7c1522a0 con 0x7fea7c151900 2023-08-27T11:26:43.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea825ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c06e080 con 0x7fea7c06a580 2023-08-27T11:26:43.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea7b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea7c151900 0x7fea7c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c06a580 0x7fea7c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea7b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea7c151900 0x7fea7c151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45686/0 (socket says 172.21.15.43:45686) 2023-08-27T11:26:43.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.512+0000 7fea7b7fe700 1 -- 172.21.15.43:0/2652485399 learned_addr learned my addr 172.21.15.43:0/2652485399 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:43.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7b7fe700 1 -- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c06a580 msgr2=0x7fea7c154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:43.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7b7fe700 1 --2- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c06a580 0x7fea7c154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7b7fe700 1 -- 172.21.15.43:0/2652485399 >> v1:172.21.15.57:6789/0 conn(0x7fea7c0c4f10 legacy=0x7fea7c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7b7fe700 1 -- 172.21.15.43:0/2652485399 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c06e360 con 0x7fea7c151900 2023-08-27T11:26:43.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7b7fe700 1 --2- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c151900 0x7fea7c151d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fea700098f0 tx=0x7fea70009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2fba676a2f01a3f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:43.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7affd700 1 -- 172.21.15.43:0/2652485399 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011830 con 0x7fea7c151900 2023-08-27T11:26:43.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7affd700 1 -- 172.21.15.43:0/2652485399 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea70011990 con 0x7fea7c151900 2023-08-27T11:26:43.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.513+0000 7fea7affd700 1 -- 172.21.15.43:0/2652485399 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011d20 con 0x7fea7c151900 2023-08-27T11:26:43.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 -- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c151900 msgr2=0x7fea7c151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 --2- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c151900 0x7fea7c151d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fea700098f0 tx=0x7fea70009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:43.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 -- 172.21.15.43:0/2652485399 shutdown_connections 2023-08-27T11:26:43.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 --2- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c06a580 0x7fea7c154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 --2- 172.21.15.43:0/2652485399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c151900 0x7fea7c151d60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 -- 172.21.15.43:0/2652485399 >> 172.21.15.43:0/2652485399 conn(0x7fea7c0c6a90 msgr2=0x7fea7c0c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:43.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 -- 172.21.15.43:0/2652485399 shutdown_connections 2023-08-27T11:26:43.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.514+0000 7fea825ff700 1 -- 172.21.15.43:0/2652485399 wait complete. 2023-08-27T11:26:43.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.516+0000 7fea825ff700 1 Processor -- start 2023-08-27T11:26:43.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.516+0000 7fea825ff700 1 -- start start 2023-08-27T11:26:43.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 0x7fea7c1ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c0c4f10 0x7fea7c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0be810 con 0x7fea7c151900 2023-08-27T11:26:43.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c14d7a0 con 0x7fea7c06a580 2023-08-27T11:26:43.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea825ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c0c0d10 con 0x7fea7c0c4f10 2023-08-27T11:26:43.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea7bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 0x7fea7c1ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44518/0 (socket says 172.21.15.43:44518) 2023-08-27T11:26:43.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 -- 172.21.15.43:0/2041272880 learned_addr learned my addr 172.21.15.43:0/2041272880 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:43.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea7b7fe700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c0c4f10 0x7fea7c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 -- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c0c4f10 msgr2=0x7fea7c14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c0c4f10 0x7fea7c14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 -- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 msgr2=0x7fea7c1ec8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:43.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 0x7fea7c1ec8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:43.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea80b9c700 1 -- 172.21.15.43:0/2041272880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70009550 con 0x7fea7c151900 2023-08-27T11:26:43.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.517+0000 7fea7bfff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 0x7fea7c1ec8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:43.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea80b9c700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fea7400cc50 tx=0x7fea7400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:43.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea74003c00 con 0x7fea7c151900 2023-08-27T11:26:43.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea74003d60 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7c152060 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400aab0 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.518+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea7c0aa0a0 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.519+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7c04ee70 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.520+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea7400ac10 con 0x7fea7c151900 2023-08-27T11:26:43.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.521+0000 7fea78ff9700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 0x7fea6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:43.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.521+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fea74088480 con 0x7fea7c151900 2023-08-27T11:26:43.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.521+0000 7fea7bfff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 0x7fea6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:43.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.522+0000 7fea7bfff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 0x7fea6806c5a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:43.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.526+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fea74053bf0 con 0x7fea7c151900 2023-08-27T11:26:43.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:43.737+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea7c073c30 con 0x7fea7c151900 2023-08-27T11:26:44.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.274+0000 7fea78ff9700 1 -- 172.21.15.43:0/2041272880 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7fea74057210 con 0x7fea7c151900 2023-08-27T11:26:44.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 msgr2=0x7fea6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 0x7fea6806c5a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fea6c009fd0 tx=0x7fea6c009210 comp rx=0 tx=0).stop 2023-08-27T11:26:44.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 msgr2=0x7fea7c14cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fea7400cc50 tx=0x7fea7400cf60 comp rx=0 tx=0).stop 2023-08-27T11:26:44.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 shutdown_connections 2023-08-27T11:26:44.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fea6806a0e0 0x7fea6806c5a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fea7c151900 0x7fea7c14cdf0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea7c06a580 0x7fea7c1ec8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 --2- 172.21.15.43:0/2041272880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea7c0c4f10 0x7fea7c14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 >> 172.21.15.43:0/2041272880 conn(0x7fea7c0c6a90 msgr2=0x7fea7c0c5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:44.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 shutdown_connections 2023-08-27T11:26:44.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.279+0000 7fea825ff700 1 -- 172.21.15.43:0/2041272880 wait complete. 2023-08-27T11:26:44.283 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:26:44.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:26:44.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.509+0000 7f1af73ff700 1 Processor -- start 2023-08-27T11:26:44.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.509+0000 7f1af73ff700 1 -- start start 2023-08-27T11:26:44.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.510+0000 7f1af73ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1af0154740 0x7f1af00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.510+0000 7f1af73ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af0154d00 con 0x7f1af00c50d0 2023-08-27T11:26:44.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.510+0000 7f1af73ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af0154fe0 con 0x7f1af014e960 2023-08-27T11:26:44.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.510+0000 7f1af73ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00baf30 con 0x7f1af0154740 2023-08-27T11:26:44.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1af499a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1af00c50d0 0x7f1af00c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46248/0 (socket says 172.21.15.43:46248) 2023-08-27T11:26:44.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1af499a700 1 -- 172.21.15.43:0/1218593113 learned_addr learned my addr 172.21.15.43:0/1218593113 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:44.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1af599c700 1 --2- 172.21.15.43:0/1218593113 >> v2:172.21.15.57:3300/0 conn(0x7f1af0154740 0x7f1af00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774886303 0 0) 0x7f1af0154d00 con 0x7f1af00c50d0 2023-08-27T11:26:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1adc0035b0 con 0x7f1af00c50d0 2023-08-27T11:26:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 916643616 0 0) 0x7f1adc0035b0 con 0x7f1af00c50d0 2023-08-27T11:26:44.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 >> v2:172.21.15.57:3300/0 conn(0x7f1af0154740 msgr2=0x7f1af00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:44.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 --2- 172.21.15.43:0/1218593113 >> v2:172.21.15.57:3300/0 conn(0x7f1af0154740 0x7f1af00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 >> v1:172.21.15.57:6789/0 conn(0x7f1af014e960 legacy=0x7f1af00a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af01552c0 con 0x7f1af00c50d0 2023-08-27T11:26:44.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f1ae0001670 con 0x7f1af00c50d0 2023-08-27T11:26:44.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.511+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 >> v1:172.21.15.43:6789/0 conn(0x7f1af00c50d0 legacy=0x7f1af00c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc003a00 0x7f1adc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 0x7f1adc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1adc005210 0x7f1adc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00baf30 con 0x7f1adc004850 2023-08-27T11:26:44.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc00c1b0 con 0x7f1adc003a00 2023-08-27T11:26:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc00e580 con 0x7f1adc005210 2023-08-27T11:26:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 0x7f1adc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af519b700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc003a00 0x7f1adc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af599c700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1adc005210 0x7f1adc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 -- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1adc005210 msgr2=0x7f1adc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1adc005210 0x7f1adc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 -- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc003a00 msgr2=0x7f1adc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc003a00 0x7f1adc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 -- 172.21.15.43:0/1218593113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0035b0 con 0x7f1adc004850 2023-08-27T11:26:44.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af599c700 1 -- 172.21.15.43:0/1218593113 reap_dead start 2023-08-27T11:26:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.512+0000 7f1af499a700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 0x7f1adc004cd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c210 tx=0x7f1adc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edc19574c98e42a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0007c10 con 0x7f1adc004850 2023-08-27T11:26:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000cdb0 con 0x7f1adc004850 2023-08-27T11:26:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1ae7fff700 1 -- 172.21.15.43:0/1218593113 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0005ba0 con 0x7f1adc004850 2023-08-27T11:26:44.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 -- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 msgr2=0x7f1adc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 0x7f1adc004cd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c210 tx=0x7f1adc005880 comp rx=0 tx=0).stop 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 -- 172.21.15.43:0/1218593113 shutdown_connections 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 --2- 172.21.15.43:0/1218593113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1adc004850 0x7f1adc004cd0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 -- 172.21.15.43:0/1218593113 >> 172.21.15.43:0/1218593113 conn(0x7f1af006aa50 msgr2=0x7f1af00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 -- 172.21.15.43:0/1218593113 shutdown_connections 2023-08-27T11:26:44.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.513+0000 7f1af73ff700 1 -- 172.21.15.43:0/1218593113 wait complete. 2023-08-27T11:26:44.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.515+0000 7f1af73ff700 1 Processor -- start 2023-08-27T11:26:44.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.515+0000 7f1af73ff700 1 -- start start 2023-08-27T11:26:44.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc004850 0x7f1af00ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1af01ed1f0 0x7f1af014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00a8e40 con 0x7f1af01507c0 2023-08-27T11:26:44.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00ab7c0 con 0x7f1adc004850 2023-08-27T11:26:44.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af73ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00aad80 con 0x7f1af01ed1f0 2023-08-27T11:26:44.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.516+0000 7f1af499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44530/0 (socket says 172.21.15.43:44530) 2023-08-27T11:26:44.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 -- 172.21.15.43:0/37383858 learned_addr learned my addr 172.21.15.43:0/37383858 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:44.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af519b700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc004850 0x7f1af00ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af599c700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1af01ed1f0 0x7f1af014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 -- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1af01ed1f0 msgr2=0x7f1af014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1af01ed1f0 0x7f1af014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 -- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc004850 msgr2=0x7f1af00ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc004850 0x7f1af00ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 -- 172.21.15.43:0/37383858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00a8b60 con 0x7f1af01507c0 2023-08-27T11:26:44.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1af499a700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c800 tx=0x7f1ae0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.517+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0001800 con 0x7f1af01507c0 2023-08-27T11:26:44.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.518+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0000ed0 con 0x7f1af01507c0 2023-08-27T11:26:44.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.518+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af00a42c0 con 0x7f1af01507c0 2023-08-27T11:26:44.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.518+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00072d0 con 0x7f1af01507c0 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.518+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af00a9be0 con 0x7f1af01507c0 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.519+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af00a4120 con 0x7f1af01507c0 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.520+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1ae0007430 con 0x7f1af01507c0 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.521+0000 7f1ae5ffb700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 0x7f1ad406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.521+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f1ae0089480 con 0x7f1af01507c0 2023-08-27T11:26:44.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.521+0000 7f1af519b700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 0x7f1ad406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.522+0000 7f1af519b700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 0x7f1ad406c5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007fd0 tx=0x7f1aec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.525+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1af00a4120 con 0x7f1af01507c0 2023-08-27T11:26:44.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.736+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1af00a4120 con 0x7f1af01507c0 2023-08-27T11:26:44.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.740+0000 7f1ae5ffb700 1 -- 172.21.15.43:0/37383858 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1af00a4120 con 0x7f1af01507c0 2023-08-27T11:26:44.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 msgr2=0x7f1ad406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 0x7f1ad406c5d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1aec007fd0 tx=0x7f1aec009040 comp rx=0 tx=0).stop 2023-08-27T11:26:44.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 msgr2=0x7f1af01eccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f1ae000c800 tx=0x7f1ae0001a00 comp rx=0 tx=0).stop 2023-08-27T11:26:44.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 shutdown_connections 2023-08-27T11:26:44.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1ad406a110 0x7f1ad406c5d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1af01ed1f0 0x7f1af014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1adc004850 0x7f1af00ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 --2- 172.21.15.43:0/37383858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1af01507c0 0x7f1af01eccb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 >> 172.21.15.43:0/37383858 conn(0x7f1af006aa50 msgr2=0x7f1af0153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 shutdown_connections 2023-08-27T11:26:44.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.743+0000 7f1af73ff700 1 -- 172.21.15.43:0/37383858 wait complete. 2023-08-27T11:26:44.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.c mds_join_fs 2023-08-27T11:26:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.968+0000 7f93a77ff700 1 Processor -- start 2023-08-27T11:26:44.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.968+0000 7f93a77ff700 1 -- start start 2023-08-27T11:26:44.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.969+0000 7f93a77ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 0x7f93a006a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a77ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00c6820 con 0x7f93a006a310 2023-08-27T11:26:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a77ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a00c4a50 con 0x7f93a0158190 2023-08-27T11:26:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a77ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00c23a0 con 0x7f93a006e360 2023-08-27T11:26:44.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a559b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f93a006a310 0x7f93a0157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46250/0 (socket says 172.21.15.43:46250) 2023-08-27T11:26:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a559b700 1 -- 172.21.15.43:0/2985258970 learned_addr learned my addr 172.21.15.43:0/2985258970 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f93a4d9a700 1 --2- 172.21.15.43:0/2985258970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 0x7f93a006a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625323883 0 0) 0x7f93a00c6820 con 0x7f93a006a310 2023-08-27T11:26:44.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c0035b0 con 0x7f93a006a310 2023-08-27T11:26:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135934514 0 0) 0x7f93a00c4a50 con 0x7f93a0158190 2023-08-27T11:26:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.970+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93a00c6820 con 0x7f93a0158190 2023-08-27T11:26:44.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f93a4d9a700 1 -- 172.21.15.43:0/2985258970 >> v1:172.21.15.57:6789/0 conn(0x7f93a0158190 legacy=0x7f93a015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203797829 0 0) 0x7f938c0035b0 con 0x7f93a006a310 2023-08-27T11:26:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f93a4d9a700 1 -- 172.21.15.43:0/2985258970 >> v1:172.21.15.43:6789/0 conn(0x7f93a006a310 legacy=0x7f93a0157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f93a4d9a700 1 -- 172.21.15.43:0/2985258970 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00c4d30 con 0x7f93a006e360 2023-08-27T11:26:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f93a4d9a700 1 --2- 172.21.15.43:0/2985258970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 0x7f93a006a6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f9390009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1401d4b4b860717f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c001670 con 0x7f93a006e360 2023-08-27T11:26:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390004030 con 0x7f93a006e360 2023-08-27T11:26:44.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.971+0000 7f9397fff700 1 -- 172.21.15.43:0/2985258970 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93900043c0 con 0x7f93a006e360 2023-08-27T11:26:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 -- 172.21.15.43:0/2985258970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 msgr2=0x7f93a006a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 --2- 172.21.15.43:0/2985258970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 0x7f93a006a6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f9390009b80 comp rx=0 tx=0).stop 2023-08-27T11:26:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 -- 172.21.15.43:0/2985258970 shutdown_connections 2023-08-27T11:26:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 --2- 172.21.15.43:0/2985258970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006e360 0x7f93a006a6f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 -- 172.21.15.43:0/2985258970 >> 172.21.15.43:0/2985258970 conn(0x7f93a00a85e0 msgr2=0x7f93a00a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 -- 172.21.15.43:0/2985258970 shutdown_connections 2023-08-27T11:26:44.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.972+0000 7f93a77ff700 1 -- 172.21.15.43:0/2985258970 wait complete. 2023-08-27T11:26:44.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.974+0000 7f93a77ff700 1 Processor -- start 2023-08-27T11:26:44.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.974+0000 7f93a77ff700 1 -- start start 2023-08-27T11:26:44.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 0x7f93a01e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a006e360 0x7f93a0156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01e9ad0 con 0x7f93a0158190 2023-08-27T11:26:44.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00abf80 con 0x7f93a006e360 2023-08-27T11:26:44.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a77ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0072540 con 0x7f93a006a310 2023-08-27T11:26:44.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44542/0 (socket says 172.21.15.43:44542) 2023-08-27T11:26:44.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 -- 172.21.15.43:0/1736232036 learned_addr learned my addr 172.21.15.43:0/1736232036 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:44.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a559b700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 0x7f93a01e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a4d9a700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a006e360 0x7f93a0156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 -- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 msgr2=0x7f93a01e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 0x7f93a01e9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 -- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a006e360 msgr2=0x7f93a0156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:44.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a006e360 0x7f93a0156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:44.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a5d9c700 1 -- 172.21.15.43:0/1736232036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094a0 con 0x7f93a0158190 2023-08-27T11:26:44.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.975+0000 7f93a559b700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 0x7f93a01e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:44.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f93a5d9c700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f939800cbc0 tx=0x7f939800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398003c00 con 0x7f93a0158190 2023-08-27T11:26:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398003d60 con 0x7f93a0158190 2023-08-27T11:26:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a0157640 con 0x7f93a0158190 2023-08-27T11:26:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939800abb0 con 0x7f93a0158190 2023-08-27T11:26:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.976+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a0156da0 con 0x7f93a0158190 2023-08-27T11:26:44.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.977+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a00ac0f0 con 0x7f93a0158190 2023-08-27T11:26:44.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.978+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f939800ad10 con 0x7f93a0158190 2023-08-27T11:26:44.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.979+0000 7f9395ffb700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 0x7f938406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:44.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.979+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9398088450 con 0x7f93a0158190 2023-08-27T11:26:44.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.979+0000 7f93a559b700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 0x7f938406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:44.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.980+0000 7f93a559b700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 0x7f938406c5a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f939c001eb0 tx=0x7f939c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:44.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:44.983+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9398053dd0 con 0x7f93a0158190 2023-08-27T11:26:45.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.191+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"} v 0) v1 -- 0x7f93a004ee70 con 0x7f93a0158190 2023-08-27T11:26:45.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.195+0000 7f9395ffb700 1 -- 172.21.15.43:0/1736232036 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"}]=0 v31) v1 ==== 96+0+0 (secure 0 0 0) 0x7f93980573f0 con 0x7f93a0158190 2023-08-27T11:26:45.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 msgr2=0x7f938406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 0x7f938406c5a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f939c001eb0 tx=0x7f939c009040 comp rx=0 tx=0).stop 2023-08-27T11:26:45.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 msgr2=0x7f93a00ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f939800cbc0 tx=0x7f939800cf80 comp rx=0 tx=0).stop 2023-08-27T11:26:45.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 shutdown_connections 2023-08-27T11:26:45.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f938406a0e0 0x7f938406c5a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93a0158190 0x7f93a00ac410 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93a006a310 0x7f93a01e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 --2- 172.21.15.43:0/1736232036 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93a006e360 0x7f93a0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 >> 172.21.15.43:0/1736232036 conn(0x7f93a00a85e0 msgr2=0x7f93a00a6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 shutdown_connections 2023-08-27T11:26:45.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.198+0000 7f93a77ff700 1 -- 172.21.15.43:0/1736232036 wait complete. 2023-08-27T11:26:45.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.d mds_join_fs 2023-08-27T11:26:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.424+0000 7fd68d5ff700 1 Processor -- start 2023-08-27T11:26:45.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.425+0000 7fd68d5ff700 1 -- start start 2023-08-27T11:26:45.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd68d5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd68806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd68d5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd68806ca60 0x7fd6880aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd68d5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68806d700 con 0x7fd6880ab040 2023-08-27T11:26:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd68d5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6881530b0 con 0x7fd68806ca60 2023-08-27T11:26:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd68d5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68814c860 con 0x7fd6880c51a0 2023-08-27T11:26:45.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd6877fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd6880ab040 0x7fd688155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46260/0 (socket says 172.21.15.43:46260) 2023-08-27T11:26:45.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd6877fe700 1 -- 172.21.15.43:0/2143110001 learned_addr learned my addr 172.21.15.43:0/2143110001 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:45.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd686ffd700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd68806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd6867fc700 1 --2- 172.21.15.43:0/2143110001 >> v2:172.21.15.57:3300/0 conn(0x7fd68806ca60 0x7fd6880aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662050156 0 0) 0x7fd68806d700 con 0x7fd6880ab040 2023-08-27T11:26:45.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.426+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6700035b0 con 0x7fd6880ab040 2023-08-27T11:26:45.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623446737 0 0) 0x7fd6700035b0 con 0x7fd6880ab040 2023-08-27T11:26:45.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 msgr2=0x7fd68806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:45.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd68806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 >> v2:172.21.15.57:3300/0 conn(0x7fd68806ca60 msgr2=0x7fd6880aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:45.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 --2- 172.21.15.43:0/2143110001 >> v2:172.21.15.57:3300/0 conn(0x7fd68806ca60 0x7fd6880aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688152430 con 0x7fd6880ab040 2023-08-27T11:26:45.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fd6800019f0 con 0x7fd6880ab040 2023-08-27T11:26:45.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 >> v1:172.21.15.43:6789/0 conn(0x7fd6880ab040 legacy=0x7fd688155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd670003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd670004000 0x7fd670004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004d90 0x7fd670005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881530b0 con 0x7fd670004000 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68814c860 con 0x7fd670004d90 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67000baf0 con 0x7fd6880c51a0 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd6867fc700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd670004000 0x7fd670004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd686ffd700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd670003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.427+0000 7fd6877fe700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004d90 0x7fd670005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 -- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 msgr2=0x7fd670003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:45.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd6880c51a0 0x7fd670003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 -- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004d90 msgr2=0x7fd670005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:45.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004d90 0x7fd670005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 -- 172.21.15.43:0/2143110001 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700035b0 con 0x7fd670004000 2023-08-27T11:26:45.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd6867fc700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd670004000 0x7fd670004850 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009b60 tx=0x7fd670005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d0a33c09eedf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00e6c0 con 0x7fd670004000 2023-08-27T11:26:45.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00e820 con 0x7fd670004000 2023-08-27T11:26:45.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.428+0000 7fd685ffb700 1 -- 172.21.15.43:0/2143110001 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00eb90 con 0x7fd670004000 2023-08-27T11:26:45.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 -- 172.21.15.43:0/2143110001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd670004000 msgr2=0x7fd670004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/2143110001 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd670004000 0x7fd670004850 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009b60 tx=0x7fd670005880 comp rx=0 tx=0).stop 2023-08-27T11:26:45.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd6877fe700 1 -- 172.21.15.43:0/2143110001 reap_dead start 2023-08-27T11:26:45.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 -- 172.21.15.43:0/2143110001 shutdown_connections 2023-08-27T11:26:45.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 -- 172.21.15.43:0/2143110001 >> 172.21.15.43:0/2143110001 conn(0x7fd68806aa50 msgr2=0x7fd6880c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:45.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 -- 172.21.15.43:0/2143110001 shutdown_connections 2023-08-27T11:26:45.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.429+0000 7fd68d5ff700 1 -- 172.21.15.43:0/2143110001 wait complete. 2023-08-27T11:26:45.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.431+0000 7fd68d5ff700 1 Processor -- start 2023-08-27T11:26:45.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.431+0000 7fd68d5ff700 1 -- start start 2023-08-27T11:26:45.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004000 0x7fd6880a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd688148f10 0x7fd6881e5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880a5ee0 con 0x7fd6881e5050 2023-08-27T11:26:45.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880a60c0 con 0x7fd670004000 2023-08-27T11:26:45.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd68d5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880a63a0 con 0x7fd688148f10 2023-08-27T11:26:45.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44558/0 (socket says 172.21.15.43:44558) 2023-08-27T11:26:45.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 -- 172.21.15.43:0/1059449118 learned_addr learned my addr 172.21.15.43:0/1059449118 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:45.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd686ffd700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004000 0x7fd6880a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6877fe700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd688148f10 0x7fd6881e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 -- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd688148f10 msgr2=0x7fd6881e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd688148f10 0x7fd6881e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 -- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004000 msgr2=0x7fd6880a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004000 0x7fd6880a7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.432+0000 7fd6867fc700 1 -- 172.21.15.43:0/1059449118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880a6680 con 0x7fd6881e5050 2023-08-27T11:26:45.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd6867fc700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0090b0 tx=0x7fd67c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c021070 con 0x7fd6881e5050 2023-08-27T11:26:45.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c004460 con 0x7fd6881e5050 2023-08-27T11:26:45.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00e6c0 con 0x7fd6881e5050 2023-08-27T11:26:45.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6880a6960 con 0x7fd6881e5050 2023-08-27T11:26:45.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.433+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6881e5bd0 con 0x7fd6881e5050 2023-08-27T11:26:45.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.434+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68804ee70 con 0x7fd6881e5050 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.435+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd67c025070 con 0x7fd6881e5050 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.436+0000 7fd66f7fe700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 0x7fd67406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.436+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fd67c0893b0 con 0x7fd6881e5050 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.436+0000 7fd686ffd700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 0x7fd67406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.437+0000 7fd686ffd700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 0x7fd67406c5a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6880bfb30 tx=0x7fd678009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.440+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd67c054e50 con 0x7fd6881e5050 2023-08-27T11:26:45.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.654+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"} v 0) v1 -- 0x7fd68806c840 con 0x7fd6881e5050 2023-08-27T11:26:45.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.659+0000 7fd66f7fe700 1 -- 172.21.15.43:0/1059449118 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.d", "name": "mds_join_fs"}]=0 v32) v1 ==== 96+0+0 (secure 0 0 0) 0x7fd67c058470 con 0x7fd6881e5050 2023-08-27T11:26:45.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.661+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 msgr2=0x7fd67406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.661+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 0x7fd67406c5a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6880bfb30 tx=0x7fd678009210 comp rx=0 tx=0).stop 2023-08-27T11:26:45.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 msgr2=0x7fd68814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0090b0 tx=0x7fd67c0047c0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 shutdown_connections 2023-08-27T11:26:45.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd67406a0e0 0x7fd67406c5a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd688148f10 0x7fd6881e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd670004000 0x7fd6880a7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 --2- 172.21.15.43:0/1059449118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd6881e5050 0x7fd68814f5f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 >> 172.21.15.43:0/1059449118 conn(0x7fd68806aa50 msgr2=0x7fd68814b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:45.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 shutdown_connections 2023-08-27T11:26:45.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.662+0000 7fd68d5ff700 1 -- 172.21.15.43:0/1059449118 wait complete. 2023-08-27T11:26:45.681 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay' 2023-08-27T11:26:45.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.883+0000 7efdb79ff700 1 Processor -- start 2023-08-27T11:26:45.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.883+0000 7efdb79ff700 1 -- start start 2023-08-27T11:26:45.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.884+0000 7efdb79ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.884+0000 7efdb79ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 0x7efdb006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.884+0000 7efdb79ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb006c4e0 con 0x7efdb0151a90 2023-08-27T11:26:45.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.884+0000 7efdb79ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb0155370 con 0x7efdb00c4630 2023-08-27T11:26:45.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.884+0000 7efdb79ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c82c0 con 0x7efdb006ad70 2023-08-27T11:26:45.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb4f9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb5f9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 0x7efdb006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb4f9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45724/0 (socket says 172.21.15.43:45724) 2023-08-27T11:26:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb4f9a700 1 -- 172.21.15.43:0/3351313496 learned_addr learned my addr 172.21.15.43:0/3351313496 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb579b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efdb0151a90 0x7efdb00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:47688/0 (socket says 172.21.15.43:47688) 2023-08-27T11:26:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb5f9c700 1 -- 172.21.15.43:0/3351313496 >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 msgr2=0x7efdb00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:45.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb5f9c700 1 --2- 172.21.15.43:0/3351313496 >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb5f9c700 1 -- 172.21.15.43:0/3351313496 >> v1:172.21.15.57:6789/0 conn(0x7efdb0151a90 legacy=0x7efdb00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb5f9c700 1 -- 172.21.15.43:0/3351313496 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0151e70 con 0x7efdb006ad70 2023-08-27T11:26:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.885+0000 7efdb4f9a700 1 --2- 172.21.15.43:0/3351313496 >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efdb5f9c700 1 --2- 172.21.15.43:0/3351313496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 0x7efdb006b200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=340b2da043950a94 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efda7fff700 1 -- 172.21.15.43:0/3351313496 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda800e070 con 0x7efdb006ad70 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efda7fff700 1 -- 172.21.15.43:0/3351313496 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800bb20 con 0x7efdb006ad70 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efda7fff700 1 -- 172.21.15.43:0/3351313496 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8012430 con 0x7efdb006ad70 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efdb79ff700 1 -- 172.21.15.43:0/3351313496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 msgr2=0x7efdb006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.886+0000 7efdb79ff700 1 --2- 172.21.15.43:0/3351313496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 0x7efdb006b200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efda8009d90 tx=0x7efda800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 -- 172.21.15.43:0/3351313496 shutdown_connections 2023-08-27T11:26:45.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 --2- 172.21.15.43:0/3351313496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb006ad70 0x7efdb006b200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 --2- 172.21.15.43:0/3351313496 >> v2:172.21.15.57:3300/0 conn(0x7efdb00c4630 0x7efdb00c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 -- 172.21.15.43:0/3351313496 >> 172.21.15.43:0/3351313496 conn(0x7efdb00ab820 msgr2=0x7efdb00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 -- 172.21.15.43:0/3351313496 shutdown_connections 2023-08-27T11:26:45.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.887+0000 7efdb79ff700 1 -- 172.21.15.43:0/3351313496 wait complete. 2023-08-27T11:26:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.888+0000 7efdb79ff700 1 Processor -- start 2023-08-27T11:26:45.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.889+0000 7efdb79ff700 1 -- start start 2023-08-27T11:26:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.889+0000 7efdb79ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.889+0000 7efdb79ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb00c4630 0x7efdb014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.889+0000 7efdb79ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb79ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01e9d20 con 0x7efdb0151a90 2023-08-27T11:26:45.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb79ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01e9450 con 0x7efdb006ad70 2023-08-27T11:26:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb79ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c3a80 con 0x7efdb00c4630 2023-08-27T11:26:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb5f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb4f9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb00c4630 0x7efdb014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45726/0 (socket says 172.21.15.43:45726) 2023-08-27T11:26:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 -- 172.21.15.43:0/736949150 learned_addr learned my addr 172.21.15.43:0/736949150 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb5f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44562/0 (socket says 172.21.15.43:44562) 2023-08-27T11:26:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 -- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb00c4630 msgr2=0x7efdb014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb00c4630 0x7efdb014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 -- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 msgr2=0x7efdb014c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb579b700 1 -- 172.21.15.43:0/736949150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009550 con 0x7efdb006ad70 2023-08-27T11:26:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.890+0000 7efdb5f9c700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efdb579b700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c530 tx=0x7efdac00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00cea0 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac005cb0 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda8009a70 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0072d0 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.891+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb01e9940 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.892+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb004ee70 con 0x7efdb006ad70 2023-08-27T11:26:45.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.893+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efdac007430 con 0x7efdb006ad70 2023-08-27T11:26:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.894+0000 7efda5ffb700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 0x7efd9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:45.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.894+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7efdac087470 con 0x7efdb006ad70 2023-08-27T11:26:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.894+0000 7efdb4f9a700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 0x7efd9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.895+0000 7efdb4f9a700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 0x7efd9406c5a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efdb014ba80 tx=0x7efda00092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:45.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:45.900+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efdac052ea0 con 0x7efdb006ad70 2023-08-27T11:26:46.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.194+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay"]} v 0) v1 -- 0x7efdb006c130 con 0x7efdb006ad70 2023-08-27T11:26:46.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.301+0000 7efda5ffb700 1 -- 172.21.15.43:0/736949150 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_standby_replay"]}]=0 v243) v1 ==== 153+0+0 (secure 0 0 0) 0x7efdac085e60 con 0x7efdb006ad70 2023-08-27T11:26:46.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 msgr2=0x7efd9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 0x7efd9406c5a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7efdb014ba80 tx=0x7efda00092c0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 msgr2=0x7efdb006b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efdac00c530 tx=0x7efdac00c840 comp rx=0 tx=0).stop 2023-08-27T11:26:46.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 shutdown_connections 2023-08-27T11:26:46.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efd9406a0e0 0x7efd9406c5a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efdb0151a90 0x7efdb014c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efdb006ad70 0x7efdb006b3c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 --2- 172.21.15.43:0/736949150 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efdb00c4630 0x7efdb014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 >> 172.21.15.43:0/736949150 conn(0x7efdb00ab820 msgr2=0x7efdb00bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:46.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 shutdown_connections 2023-08-27T11:26:46.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.303+0000 7efdb79ff700 1 -- 172.21.15.43:0/736949150 wait complete. 2023-08-27T11:26:46.323 INFO:tasks.cephfs_test_runner:That a standby-replay daemon with weak affinity is replaced by a stronger one. ... ok 2023-08-27T11:26:46.324 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_steady (tasks.cephfs.test_failover.TestClusterAffinity) That a sole MDS with mds_join_fs set will come back as active eventually even after failover. 2023-08-27T11:26:46.324 INFO:tasks.cephfs_test_runner:test_join_fs_steady (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:26:46.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady' 2023-08-27T11:26:46.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.527+0000 7faf567ff700 1 Processor -- start 2023-08-27T11:26:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.527+0000 7faf567ff700 1 -- start start 2023-08-27T11:26:46.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.528+0000 7faf567ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.528+0000 7faf567ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.528+0000 7faf567ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5006c4e0 con 0x7faf5006ad70 2023-08-27T11:26:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.528+0000 7faf567ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf50155370 con 0x7faf50151a90 2023-08-27T11:26:46.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.528+0000 7faf567ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50151e70 con 0x7faf500c4630 2023-08-27T11:26:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:45742/0 (socket says 172.21.15.43:45742) 2023-08-27T11:26:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4ffff700 1 -- 172.21.15.43:0/1219877527 learned_addr learned my addr 172.21.15.43:0/1219877527 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:33328/0 (socket says 172.21.15.43:33328) 2023-08-27T11:26:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf54d9c700 1 --1- 172.21.15.43:0/1219877527 >> v1:172.21.15.57:6789/0 conn(0x7faf5006ad70 0x7faf5006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:47704/0 (socket says 172.21.15.43:47704) 2023-08-27T11:26:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 -- 172.21.15.43:0/1219877527 >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 msgr2=0x7faf500c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:46.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 --2- 172.21.15.43:0/1219877527 >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 -- 172.21.15.43:0/1219877527 >> v1:172.21.15.57:6789/0 conn(0x7faf5006ad70 legacy=0x7faf5006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 -- 172.21.15.43:0/1219877527 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50154480 con 0x7faf500c4630 2023-08-27T11:26:46.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4ffff700 1 --2- 172.21.15.43:0/1219877527 >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:46.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.529+0000 7faf4f7fe700 1 --2- 172.21.15.43:0/1219877527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf44009840 tx=0x7faf44009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6ea3fde1ea2407 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:46.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf4effd700 1 -- 172.21.15.43:0/1219877527 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44011830 con 0x7faf500c4630 2023-08-27T11:26:46.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf4effd700 1 -- 172.21.15.43:0/1219877527 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44011990 con 0x7faf500c4630 2023-08-27T11:26:46.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf4effd700 1 -- 172.21.15.43:0/1219877527 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44011d20 con 0x7faf500c4630 2023-08-27T11:26:46.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 -- 172.21.15.43:0/1219877527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 msgr2=0x7faf500c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 --2- 172.21.15.43:0/1219877527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf44009840 tx=0x7faf44009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:46.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 -- 172.21.15.43:0/1219877527 shutdown_connections 2023-08-27T11:26:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 --2- 172.21.15.43:0/1219877527 >> v2:172.21.15.57:3300/0 conn(0x7faf50151a90 0x7faf500c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 --2- 172.21.15.43:0/1219877527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf500c4630 0x7faf500c4a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 -- 172.21.15.43:0/1219877527 >> 172.21.15.43:0/1219877527 conn(0x7faf500ab820 msgr2=0x7faf500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 -- 172.21.15.43:0/1219877527 shutdown_connections 2023-08-27T11:26:46.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.530+0000 7faf567ff700 1 -- 172.21.15.43:0/1219877527 wait complete. 2023-08-27T11:26:46.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.532+0000 7faf567ff700 1 Processor -- start 2023-08-27T11:26:46.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.532+0000 7faf567ff700 1 -- start start 2023-08-27T11:26:46.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf5006ad70 0x7faf500aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 0x7faf501e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500c1640 con 0x7faf500c4630 2023-08-27T11:26:46.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500c2980 con 0x7faf50151a90 2023-08-27T11:26:46.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf567ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf500ab200 con 0x7faf5006ad70 2023-08-27T11:26:46.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf4f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44570/0 (socket says 172.21.15.43:44570) 2023-08-27T11:26:46.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.533+0000 7faf4f7fe700 1 -- 172.21.15.43:0/630680330 learned_addr learned my addr 172.21.15.43:0/630680330 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:46.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4ffff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf5006ad70 0x7faf500aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf54d9c700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 0x7faf501e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 -- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf5006ad70 msgr2=0x7faf500aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf5006ad70 0x7faf500aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 -- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 msgr2=0x7faf501e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:46.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 0x7faf501e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 -- 172.21.15.43:0/630680330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009550 con 0x7faf500c4630 2023-08-27T11:26:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf54d9c700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 0x7faf501e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4f7fe700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7faf44009fd0 tx=0x7faf44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440036a0 con 0x7faf500c4630 2023-08-27T11:26:46.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4401f070 con 0x7faf500c4630 2023-08-27T11:26:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44003a60 con 0x7faf500c4630 2023-08-27T11:26:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.534+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440094a0 con 0x7faf500c4630 2023-08-27T11:26:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.535+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf501523b0 con 0x7faf500c4630 2023-08-27T11:26:46.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.536+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5004ee70 con 0x7faf500c4630 2023-08-27T11:26:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.536+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf44003bc0 con 0x7faf500c4630 2023-08-27T11:26:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.537+0000 7faf4cff9700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 0x7faf3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.537+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7faf44021070 con 0x7faf500c4630 2023-08-27T11:26:46.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.538+0000 7faf4ffff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 0x7faf3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:46.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.538+0000 7faf4ffff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 0x7faf3c06c5a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faf50144360 tx=0x7faf400092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:46.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.542+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf44055550 con 0x7faf500c4630 2023-08-27T11:26:46.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:46.841+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady"]} v 0) v1 -- 0x7faf5006c130 con 0x7faf500c4630 2023-08-27T11:26:47.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.295+0000 7faf4cff9700 1 -- 172.21.15.43:0/630680330 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady"]}]=0 v244) v1 ==== 148+0+0 (secure 0 0 0) 0x7faf4402b0d0 con 0x7faf500c4630 2023-08-27T11:26:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.298+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 msgr2=0x7faf3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.298+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 0x7faf3c06c5a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7faf50144360 tx=0x7faf400092c0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.298+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 msgr2=0x7faf500c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.298+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7faf44009fd0 tx=0x7faf44004750 comp rx=0 tx=0).stop 2023-08-27T11:26:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 shutdown_connections 2023-08-27T11:26:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faf3c06a0e0 0x7faf3c06c5a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf50151a90 0x7faf501e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf5006ad70 0x7faf500aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 --2- 172.21.15.43:0/630680330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf500c4630 0x7faf500c2440 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 >> 172.21.15.43:0/630680330 conn(0x7faf500ab820 msgr2=0x7faf5014cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 shutdown_connections 2023-08-27T11:26:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.299+0000 7faf567ff700 1 -- 172.21.15.43:0/630680330 wait complete. 2023-08-27T11:26:47.321 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:47.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.523+0000 7f97a41ff700 1 Processor -- start 2023-08-27T11:26:47.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.524+0000 7f97a41ff700 1 -- start start 2023-08-27T11:26:47.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a41ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f979c0c4630 0x7f979c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a41ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f979c06ad70 0x7f979c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a41ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c06c4e0 con 0x7f979c151a90 2023-08-27T11:26:47.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a41ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c155370 con 0x7f979c0c4630 2023-08-27T11:26:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a41ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c0c82c0 con 0x7f979c06ad70 2023-08-27T11:26:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a1f9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f979c151a90 0x7f979c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46276/0 (socket says 172.21.15.43:46276) 2023-08-27T11:26:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a1f9b700 1 -- 172.21.15.43:0/3999301331 learned_addr learned my addr 172.21.15.43:0/3999301331 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:47.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a179a700 1 --2- 172.21.15.43:0/3999301331 >> v2:172.21.15.43:3300/0 conn(0x7f979c0c4630 0x7f979c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a279c700 1 --2- 172.21.15.43:0/3999301331 >> v2:172.21.15.57:3300/0 conn(0x7f979c06ad70 0x7f979c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.525+0000 7f97a0f99700 1 -- 172.21.15.43:0/3999301331 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245929142 0 0) 0x7f979c06c4e0 con 0x7f979c151a90 2023-08-27T11:26:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a179a700 1 -- 172.21.15.43:0/3999301331 >> v2:172.21.15.57:3300/0 conn(0x7f979c06ad70 msgr2=0x7f979c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:47.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a179a700 1 --2- 172.21.15.43:0/3999301331 >> v2:172.21.15.57:3300/0 conn(0x7f979c06ad70 0x7f979c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a179a700 1 -- 172.21.15.43:0/3999301331 >> v1:172.21.15.43:6789/0 conn(0x7f979c151a90 legacy=0x7f979c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a179a700 1 -- 172.21.15.43:0/3999301331 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c151e70 con 0x7f979c0c4630 2023-08-27T11:26:47.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a179a700 1 --2- 172.21.15.43:0/3999301331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c0c4630 0x7f979c0c4a90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f979c0c4270 tx=0x7f978c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7055f1137336659c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a0f99700 1 -- 172.21.15.43:0/3999301331 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011830 con 0x7f979c0c4630 2023-08-27T11:26:47.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a0f99700 1 -- 172.21.15.43:0/3999301331 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c011990 con 0x7f979c0c4630 2023-08-27T11:26:47.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.526+0000 7f97a0f99700 1 -- 172.21.15.43:0/3999301331 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011d20 con 0x7f979c0c4630 2023-08-27T11:26:47.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 -- 172.21.15.43:0/3999301331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c0c4630 msgr2=0x7f979c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3999301331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c0c4630 0x7f979c0c4a90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f979c0c4270 tx=0x7f978c009b20 comp rx=0 tx=0).stop 2023-08-27T11:26:47.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 -- 172.21.15.43:0/3999301331 shutdown_connections 2023-08-27T11:26:47.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3999301331 >> v2:172.21.15.57:3300/0 conn(0x7f979c06ad70 0x7f979c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3999301331 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c0c4630 0x7f979c0c4a90 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 -- 172.21.15.43:0/3999301331 >> 172.21.15.43:0/3999301331 conn(0x7f979c0ab820 msgr2=0x7f979c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:47.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 -- 172.21.15.43:0/3999301331 shutdown_connections 2023-08-27T11:26:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.527+0000 7f97a41ff700 1 -- 172.21.15.43:0/3999301331 wait complete. 2023-08-27T11:26:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.528+0000 7f97a41ff700 1 Processor -- start 2023-08-27T11:26:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.529+0000 7f97a41ff700 1 -- start start 2023-08-27T11:26:47.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.529+0000 7f97a41ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.529+0000 7f97a41ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f979c0c4630 0x7f979c1ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a41ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 0x7f979c148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a41ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c14db50 con 0x7f979c06ad70 2023-08-27T11:26:47.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a41ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1567b0 con 0x7f979c151a90 2023-08-27T11:26:47.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a41ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1ea620 con 0x7f979c0c4630 2023-08-27T11:26:47.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44584/0 (socket says 172.21.15.43:44584) 2023-08-27T11:26:47.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 -- 172.21.15.43:0/3169778152 learned_addr learned my addr 172.21.15.43:0/3169778152 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:47.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a179a700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f979c0c4630 0x7f979c1ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a279c700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 0x7f979c148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 -- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f979c0c4630 msgr2=0x7f979c1ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f979c0c4630 0x7f979c1ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 -- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 msgr2=0x7f979c148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 0x7f979c148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 -- 172.21.15.43:0/3169778152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0094a0 con 0x7f979c06ad70 2023-08-27T11:26:47.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a279c700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 0x7f979c148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:47.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.530+0000 7f97a1f9b700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f979800c580 tx=0x7f979800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.531+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798004c80 con 0x7f979c06ad70 2023-08-27T11:26:47.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.531+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798004e00 con 0x7f979c06ad70 2023-08-27T11:26:47.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.531+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c0c2e50 con 0x7f979c06ad70 2023-08-27T11:26:47.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.531+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798007310 con 0x7f979c06ad70 2023-08-27T11:26:47.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.531+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c157c00 con 0x7f979c06ad70 2023-08-27T11:26:47.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.532+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c14f2b0 con 0x7f979c06ad70 2023-08-27T11:26:47.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.533+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9798007470 con 0x7f979c06ad70 2023-08-27T11:26:47.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.534+0000 7f97927fc700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 0x7f978006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.534+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f9798087fc0 con 0x7f979c06ad70 2023-08-27T11:26:47.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.534+0000 7f97a179a700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 0x7f978006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.535+0000 7f97a179a700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 0x7f978006c5a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f978c0090b0 tx=0x7f978c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.538+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9798053970 con 0x7f979c06ad70 2023-08-27T11:26:47.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.749+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f979c04ee70 con 0x7f979c06ad70 2023-08-27T11:26:47.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.750+0000 7f97927fc700 1 -- 172.21.15.43:0/3169778152 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+14781 (secure 0 0 0) 0x7f9798056f90 con 0x7f979c06ad70 2023-08-27T11:26:47.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:47.752 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":87,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:44.271180+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/3998632195":"2023-08-28T11:26:41.262051+0000","172.21.15.43:6835/3998632195":"2023-08-28T11:26:41.262051+0000","172.21.15.43:6836/1292748157":"2023-08-28T11:26:21.920637+0000","172.21.15.43:6834/1292748157":"2023-08-28T11:26:21.920637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:47.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 msgr2=0x7f978006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 0x7f978006c5a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f978c0090b0 tx=0x7f978c008030 comp rx=0 tx=0).stop 2023-08-27T11:26:47.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 msgr2=0x7f979c1575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f979800c580 tx=0x7f979800c890 comp rx=0 tx=0).stop 2023-08-27T11:26:47.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 shutdown_connections 2023-08-27T11:26:47.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f978006a0e0 0x7f978006c5a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f979c151a90 0x7f979c148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f979c06ad70 0x7f979c1575b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 --2- 172.21.15.43:0/3169778152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f979c0c4630 0x7f979c1ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 >> 172.21.15.43:0/3169778152 conn(0x7f979c0ab820 msgr2=0x7f979c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:47.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 shutdown_connections 2023-08-27T11:26:47.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.752+0000 7f97a41ff700 1 -- 172.21.15.43:0/3169778152 wait complete. 2023-08-27T11:26:47.772 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:26:47.773 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:26:47.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.976+0000 7fe4ef9ff700 1 Processor -- start 2023-08-27T11:26:47.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.976+0000 7fe4ef9ff700 1 -- start start 2023-08-27T11:26:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ef9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4e80c5230 0x7fe4e806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ef9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4e806c5e0 0x7fe4e80aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ef9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e8152290 con 0x7fe4e80ab190 2023-08-27T11:26:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ef9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e806d7a0 con 0x7fe4e806c5e0 2023-08-27T11:26:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ef9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e8152550 con 0x7fe4e80c5230 2023-08-27T11:26:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.977+0000 7fe4ecf9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4e806c5e0 0x7fe4e80aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4e806c5e0 0x7fe4e80aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44590/0 (socket says 172.21.15.43:44590) 2023-08-27T11:26:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/1575485318 learned_addr learned my addr 172.21.15.43:0/1575485318 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ed79b700 1 --2- 172.21.15.43:0/1575485318 >> v2:172.21.15.57:3300/0 conn(0x7fe4e80c5230 0x7fe4e806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/1575485318 >> v2:172.21.15.57:3300/0 conn(0x7fe4e80c5230 msgr2=0x7fe4e806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 --2- 172.21.15.43:0/1575485318 >> v2:172.21.15.57:3300/0 conn(0x7fe4e80c5230 0x7fe4e806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/1575485318 >> v1:172.21.15.57:6789/0 conn(0x7fe4e80ab190 legacy=0x7fe4e8155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/1575485318 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8152830 con 0x7fe4e806c5e0 2023-08-27T11:26:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4ecf9a700 1 --2- 172.21.15.43:0/1575485318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e806c5e0 0x7fe4e80aac50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe4e806ced0 tx=0x7fe4d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a587b7ba4c5eb96 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.978+0000 7fe4dffff700 1 -- 172.21.15.43:0/1575485318 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8004230 con 0x7fe4e806c5e0 2023-08-27T11:26:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4dffff700 1 -- 172.21.15.43:0/1575485318 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d8004390 con 0x7fe4e806c5e0 2023-08-27T11:26:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4dffff700 1 -- 172.21.15.43:0/1575485318 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80036a0 con 0x7fe4e806c5e0 2023-08-27T11:26:47.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/1575485318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e806c5e0 msgr2=0x7fe4e80aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/1575485318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e806c5e0 0x7fe4e80aac50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe4e806ced0 tx=0x7fe4d8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/1575485318 shutdown_connections 2023-08-27T11:26:47.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/1575485318 >> v2:172.21.15.57:3300/0 conn(0x7fe4e80c5230 0x7fe4e806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/1575485318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e806c5e0 0x7fe4e80aac50 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/1575485318 >> 172.21.15.43:0/1575485318 conn(0x7fe4e80c5b10 msgr2=0x7fe4e80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/1575485318 shutdown_connections 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.979+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/1575485318 wait complete. 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.981+0000 7fe4ef9ff700 1 Processor -- start 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.981+0000 7fe4ef9ff700 1 -- start start 2023-08-27T11:26:47.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 0x7fe4e80bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 0x7fe4e80a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80a8e10 con 0x7fe4e80ab190 2023-08-27T11:26:47.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80a8ae0 con 0x7fe4e80c5230 2023-08-27T11:26:47.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ef9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81e9e10 con 0x7fe4e806c5e0 2023-08-27T11:26:47.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ecf9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ecf9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44604/0 (socket says 172.21.15.43:44604) 2023-08-27T11:26:47.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.982+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/2167403363 learned_addr learned my addr 172.21.15.43:0/2167403363 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:47.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ed79b700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 0x7fe4e80bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 msgr2=0x7fe4e80bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4edf9c700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 0x7fe4e80a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 0x7fe4e80bddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 msgr2=0x7fe4e80a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 0x7fe4e80a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:47.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 -- 172.21.15.43:0/2167403363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009550 con 0x7fe4e80ab190 2023-08-27T11:26:47.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ed79b700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 0x7fe4e80bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:47.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4edf9c700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 0x7fe4e80a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:47.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ecf9a700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009130 tx=0x7fe4d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8003d40 con 0x7fe4e80ab190 2023-08-27T11:26:47.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d801f070 con 0x7fe4e80ab190 2023-08-27T11:26:47.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e8072030 con 0x7fe4e80ab190 2023-08-27T11:26:47.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8011870 con 0x7fe4e80ab190 2023-08-27T11:26:47.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.983+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e80aa230 con 0x7fe4e80ab190 2023-08-27T11:26:47.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.984+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80a8c50 con 0x7fe4e80ab190 2023-08-27T11:26:47.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.985+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4d8021030 con 0x7fe4e80ab190 2023-08-27T11:26:47.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.986+0000 7fe4ddffb700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 0x7fe4cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.986+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fe4d8089910 con 0x7fe4e80ab190 2023-08-27T11:26:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.987+0000 7fe4ed79b700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 0x7fe4cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.987+0000 7fe4ed79b700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 0x7fe4cc06c5a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009820 tx=0x7fe4e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:47.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:47.991+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe4e80a8c50 con 0x7fe4e80ab190 2023-08-27T11:26:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.199+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4e80a8c50 con 0x7fe4e80ab190 2023-08-27T11:26:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.200+0000 7fe4ddffb700 1 -- 172.21.15.43:0/2167403363 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4d8029020 con 0x7fe4e80ab190 2023-08-27T11:26:48.202 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:26:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 msgr2=0x7fe4cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 0x7fe4cc06c5a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009820 tx=0x7fe4e4008040 comp rx=0 tx=0).stop 2023-08-27T11:26:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 msgr2=0x7fe4e8071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009130 tx=0x7fe4d8004750 comp rx=0 tx=0).stop 2023-08-27T11:26:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 shutdown_connections 2023-08-27T11:26:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4cc06a0e0 0x7fe4cc06c5a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4e80c5230 0x7fe4e80a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4e806c5e0 0x7fe4e80bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 --2- 172.21.15.43:0/2167403363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4e80ab190 0x7fe4e8071af0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 >> 172.21.15.43:0/2167403363 conn(0x7fe4e80c5b10 msgr2=0x7fe4e80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:48.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 shutdown_connections 2023-08-27T11:26:48.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.202+0000 7fe4ef9ff700 1 -- 172.21.15.43:0/2167403363 wait complete. 2023-08-27T11:26:48.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:26:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.425+0000 7f3d453ff700 1 Processor -- start 2023-08-27T11:26:48.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.425+0000 7f3d453ff700 1 -- start start 2023-08-27T11:26:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d453ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 0x7f3d40158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d453ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 0x7f3d400708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d453ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d40157af0 con 0x7f3d40071f70 2023-08-27T11:26:48.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d453ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d40071e10 con 0x7f3d400c0020 2023-08-27T11:26:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d453ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40158a80 con 0x7f3d40151fc0 2023-08-27T11:26:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d3e7fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3d40071f70 0x7f3d401518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:46284/0 (socket says 172.21.15.43:46284) 2023-08-27T11:26:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.426+0000 7f3d3e7fc700 1 -- 172.21.15.43:0/1278014513 learned_addr learned my addr 172.21.15.43:0/1278014513 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3effd700 1 --2- 172.21.15.43:0/1278014513 >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 0x7f3d40158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 --2- 172.21.15.43:0/1278014513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 0x7f3d400708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3dffb700 1 -- 172.21.15.43:0/1278014513 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767961536 0 0) 0x7f3d40157af0 con 0x7f3d40071f70 2023-08-27T11:26:48.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3dffb700 1 -- 172.21.15.43:0/1278014513 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d280035b0 con 0x7f3d40071f70 2023-08-27T11:26:48.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 -- 172.21.15.43:0/1278014513 >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 msgr2=0x7f3d40158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:48.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 --2- 172.21.15.43:0/1278014513 >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 0x7f3d40158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 -- 172.21.15.43:0/1278014513 >> v1:172.21.15.43:6789/0 conn(0x7f3d40071f70 legacy=0x7f3d401518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 -- 172.21.15.43:0/1278014513 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400a6040 con 0x7f3d40151fc0 2023-08-27T11:26:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3effd700 1 --2- 172.21.15.43:0/1278014513 >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 0x7f3d40158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.427+0000 7f3d3f7fe700 1 --2- 172.21.15.43:0/1278014513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 0x7f3d400708c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009d90 tx=0x7f3d3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4cb130c0d914f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d3dffb700 1 -- 172.21.15.43:0/1278014513 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3800e070 con 0x7f3d40151fc0 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d3dffb700 1 -- 172.21.15.43:0/1278014513 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3800bb20 con 0x7f3d40151fc0 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d3dffb700 1 -- 172.21.15.43:0/1278014513 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38012430 con 0x7f3d40151fc0 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 -- 172.21.15.43:0/1278014513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 msgr2=0x7f3d400708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 --2- 172.21.15.43:0/1278014513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 0x7f3d400708c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009d90 tx=0x7f3d3800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 -- 172.21.15.43:0/1278014513 shutdown_connections 2023-08-27T11:26:48.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 --2- 172.21.15.43:0/1278014513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d40151fc0 0x7f3d400708c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 --2- 172.21.15.43:0/1278014513 >> v2:172.21.15.57:3300/0 conn(0x7f3d400c0020 0x7f3d40158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 -- 172.21.15.43:0/1278014513 >> 172.21.15.43:0/1278014513 conn(0x7f3d400c6a40 msgr2=0x7f3d400c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 -- 172.21.15.43:0/1278014513 shutdown_connections 2023-08-27T11:26:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.428+0000 7f3d453ff700 1 -- 172.21.15.43:0/1278014513 wait complete. 2023-08-27T11:26:48.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.430+0000 7f3d453ff700 1 Processor -- start 2023-08-27T11:26:48.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.430+0000 7f3d453ff700 1 -- start start 2023-08-27T11:26:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 0x7f3d4014c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40151fc0 0x7f3d4014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4006aec0 con 0x7f3d40071f70 2023-08-27T11:26:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4014bbb0 con 0x7f3d40151fc0 2023-08-27T11:26:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d453ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40157820 con 0x7f3d400c0020 2023-08-27T11:26:48.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d3effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44612/0 (socket says 172.21.15.43:44612) 2023-08-27T11:26:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d3effd700 1 -- 172.21.15.43:0/400589800 learned_addr learned my addr 172.21.15.43:0/400589800 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.431+0000 7f3d3f7fe700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40151fc0 0x7f3d4014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3e7fc700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 0x7f3d4014c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 -- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 msgr2=0x7f3d4014c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 0x7f3d4014c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 -- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40151fc0 msgr2=0x7f3d4014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40151fc0 0x7f3d4014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 -- 172.21.15.43:0/400589800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300094a0 con 0x7f3d40071f70 2023-08-27T11:26:48.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3e7fc700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 0x7f3d4014c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d3effd700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000ebe0 tx=0x7f3d3000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30009800 con 0x7f3d40071f70 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000c910 con 0x7f3d40071f70 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000cc80 con 0x7f3d40071f70 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d38009a70 con 0x7f3d40071f70 2023-08-27T11:26:48.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.432+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d401565a0 con 0x7f3d40071f70 2023-08-27T11:26:48.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.433+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4014be90 con 0x7f3d40071f70 2023-08-27T11:26:48.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.434+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d30013470 con 0x7f3d40071f70 2023-08-27T11:26:48.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.435+0000 7f3d277fe700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 0x7f3d2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.435+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f3d30088340 con 0x7f3d40071f70 2023-08-27T11:26:48.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.435+0000 7f3d3e7fc700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 0x7f3d2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.436+0000 7f3d3e7fc700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 0x7f3d2c06c5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3d401510f0 tx=0x7f3d34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.439+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d300577f0 con 0x7f3d40071f70 2023-08-27T11:26:48.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.647+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d400c52c0 con 0x7f3d40071f70 2023-08-27T11:26:48.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.648+0000 7f3d277fe700 1 -- 172.21.15.43:0/400589800 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d30057380 con 0x7f3d40071f70 2023-08-27T11:26:48.650 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:26:48.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 msgr2=0x7f3d2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 0x7f3d2c06c5a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3d401510f0 tx=0x7f3d34009040 comp rx=0 tx=0).stop 2023-08-27T11:26:48.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 msgr2=0x7f3d4006a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000ebe0 tx=0x7f3d3000eef0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 shutdown_connections 2023-08-27T11:26:48.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d2c06a0e0 0x7f3d2c06c5a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d40151fc0 0x7f3d4014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d40071f70 0x7f3d4006a980 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 --2- 172.21.15.43:0/400589800 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d400c0020 0x7f3d4014c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 >> 172.21.15.43:0/400589800 conn(0x7f3d400c6a40 msgr2=0x7f3d40151550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:48.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 shutdown_connections 2023-08-27T11:26:48.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.650+0000 7f3d453ff700 1 -- 172.21.15.43:0/400589800 wait complete. 2023-08-27T11:26:48.670 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:26:48.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.872+0000 7fa726bff700 1 Processor -- start 2023-08-27T11:26:48.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.873+0000 7fa726bff700 1 -- start start 2023-08-27T11:26:48.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa726bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 0x7fa7200c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa726bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 0x7fa72006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa726bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa720154660 con 0x7fa7200c7c00 2023-08-27T11:26:48.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa726bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7200c5750 con 0x7fa720151d20 2023-08-27T11:26:48.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa726bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa720154940 con 0x7fa72006a8e0 2023-08-27T11:26:48.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa72499b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 0x7fa7200c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa72519c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 0x7fa72006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa72499b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 0x7fa7200c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:47196/0 (socket says 172.21.15.43:47196) 2023-08-27T11:26:48.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.874+0000 7fa72499b700 1 -- 172.21.15.43:0/2521711640 learned_addr learned my addr 172.21.15.43:0/2521711640 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:48.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa71f7fe700 1 -- 172.21.15.43:0/2521711640 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333619390 0 0) 0x7fa720154660 con 0x7fa7200c7c00 2023-08-27T11:26:48.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa72519c700 1 -- 172.21.15.43:0/2521711640 >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 msgr2=0x7fa7200c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:48.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa72519c700 1 --2- 172.21.15.43:0/2521711640 >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 0x7fa7200c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa72519c700 1 -- 172.21.15.43:0/2521711640 >> v1:172.21.15.57:6789/0 conn(0x7fa7200c7c00 legacy=0x7fa7200ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa72519c700 1 -- 172.21.15.43:0/2521711640 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720154c20 con 0x7fa72006a8e0 2023-08-27T11:26:48.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.875+0000 7fa72519c700 1 --2- 172.21.15.43:0/2521711640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 0x7fa72006ad30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa718009d90 tx=0x7fa71800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7292b7b0350c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa71f7fe700 1 -- 172.21.15.43:0/2521711640 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800e070 con 0x7fa72006a8e0 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa71f7fe700 1 -- 172.21.15.43:0/2521711640 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800bb20 con 0x7fa72006a8e0 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa71f7fe700 1 -- 172.21.15.43:0/2521711640 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718012430 con 0x7fa72006a8e0 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 -- 172.21.15.43:0/2521711640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 msgr2=0x7fa72006ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 --2- 172.21.15.43:0/2521711640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 0x7fa72006ad30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa718009d90 tx=0x7fa71800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:48.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 -- 172.21.15.43:0/2521711640 shutdown_connections 2023-08-27T11:26:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 --2- 172.21.15.43:0/2521711640 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72006a8e0 0x7fa72006ad30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 --2- 172.21.15.43:0/2521711640 >> v2:172.21.15.57:3300/0 conn(0x7fa720151d20 0x7fa7200c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 -- 172.21.15.43:0/2521711640 >> 172.21.15.43:0/2521711640 conn(0x7fa7200c9d00 msgr2=0x7fa7200ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 -- 172.21.15.43:0/2521711640 shutdown_connections 2023-08-27T11:26:48.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.876+0000 7fa726bff700 1 -- 172.21.15.43:0/2521711640 wait complete. 2023-08-27T11:26:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.879+0000 7fa726bff700 1 Processor -- start 2023-08-27T11:26:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.879+0000 7fa726bff700 1 -- start start 2023-08-27T11:26:48.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa72006a8e0 0x7fa7200c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7200c7c00 0x7fa720153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72014df10 con 0x7fa720151d20 2023-08-27T11:26:48.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa720153dd0 con 0x7fa72006a8e0 2023-08-27T11:26:48.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa726bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72014e1b0 con 0x7fa7200c7c00 2023-08-27T11:26:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa72519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.880+0000 7fa72519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35448/0 (socket says 172.21.15.43:35448) 2023-08-27T11:26:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 -- 172.21.15.43:0/3716806088 learned_addr learned my addr 172.21.15.43:0/3716806088 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72499b700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa72006a8e0 0x7fa7200c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa71ffff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7200c7c00 0x7fa720153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 -- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7200c7c00 msgr2=0x7fa720153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7200c7c00 0x7fa720153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 -- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa72006a8e0 msgr2=0x7fa7200c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa72006a8e0 0x7fa7200c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:48.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 -- 172.21.15.43:0/3716806088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009a70 con 0x7fa720151d20 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa72519c700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa718014040 tx=0x7fa718004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.881+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718012430 con 0x7fa720151d20 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.882+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa718020070 con 0x7fa720151d20 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.882+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72014e490 con 0x7fa720151d20 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.882+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718004280 con 0x7fa720151d20 2023-08-27T11:26:48.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.882+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7200bdb00 con 0x7fa720151d20 2023-08-27T11:26:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.883+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa720151520 con 0x7fa720151d20 2023-08-27T11:26:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.884+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7180043e0 con 0x7fa720151d20 2023-08-27T11:26:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.885+0000 7fa71d7fa700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 0x7fa70406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.885+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fa718022070 con 0x7fa720151d20 2023-08-27T11:26:48.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.885+0000 7fa72499b700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 0x7fa70406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.886+0000 7fa72499b700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 0x7fa70406c5a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa714009b30 tx=0x7fa7140092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:48.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:48.889+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7180558a0 con 0x7fa720151d20 2023-08-27T11:26:49.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.098+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7200bdcf0 con 0x7fa720151d20 2023-08-27T11:26:49.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.102+0000 7fa71d7fa700 1 -- 172.21.15.43:0/3716806088 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v33)=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa71802c0c0 con 0x7fa720151d20 2023-08-27T11:26:49.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 msgr2=0x7fa70406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 0x7fa70406c5a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa714009b30 tx=0x7fa7140092c0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 msgr2=0x7fa7201e9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa718014040 tx=0x7fa718004b20 comp rx=0 tx=0).stop 2023-08-27T11:26:49.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 shutdown_connections 2023-08-27T11:26:49.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa70406a0e0 0x7fa70406c5a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa720151d20 0x7fa7201e9910 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa72006a8e0 0x7fa7200c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 --2- 172.21.15.43:0/3716806088 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7200c7c00 0x7fa720153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 >> 172.21.15.43:0/3716806088 conn(0x7fa7200c9d00 msgr2=0x7fa7200c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:49.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 shutdown_connections 2023-08-27T11:26:49.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.105+0000 7fa726bff700 1 -- 172.21.15.43:0/3716806088 wait complete. 2023-08-27T11:26:49.125 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:26:49.125 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:49.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:26:49.350 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:26:49.351 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:26:49.351 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:49.395 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:26:49.395 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:26:49.397 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:26:49.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:26:49.443 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:26:49.443 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:26:49.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.642+0000 7fdfbbbff700 1 Processor -- start 2023-08-27T11:26:49.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.643+0000 7fdfbbbff700 1 -- start start 2023-08-27T11:26:49.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfbbbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdfb40c4630 0x7fdfb40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:49.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfbbbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb406c4e0 con 0x7fdfb4151a90 2023-08-27T11:26:49.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfbbbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb4155370 con 0x7fdfb406ad70 2023-08-27T11:26:49.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfbbbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40c82c0 con 0x7fdfb40c4630 2023-08-27T11:26:49.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb919a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdfb40c4630 0x7fdfb40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:49.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb999b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdfb4151a90 0x7fdfb40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57254/0 (socket says 172.21.15.43:57254) 2023-08-27T11:26:49.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb999b700 1 -- 172.21.15.43:0/317015916 learned_addr learned my addr 172.21.15.43:0/317015916 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:49.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb919a700 1 -- 172.21.15.43:0/317015916 >> v1:172.21.15.57:6789/0 conn(0x7fdfb406ad70 legacy=0x7fdfb406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:49.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb919a700 1 -- 172.21.15.43:0/317015916 >> v1:172.21.15.43:6789/0 conn(0x7fdfb4151a90 legacy=0x7fdfb40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb919a700 1 -- 172.21.15.43:0/317015916 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4151e70 con 0x7fdfb40c4630 2023-08-27T11:26:49.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.644+0000 7fdfb8999700 1 -- 172.21.15.43:0/317015916 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020564525 0 0) 0x7fdfb406c4e0 con 0x7fdfb4151a90 2023-08-27T11:26:49.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfb919a700 1 --2- 172.21.15.43:0/317015916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb40c4a90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009840 tx=0x7fdfa4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46474db14d5f56d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:49.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfb8999700 1 -- 172.21.15.43:0/317015916 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4004230 con 0x7fdfb40c4630 2023-08-27T11:26:49.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfb8999700 1 -- 172.21.15.43:0/317015916 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa4004390 con 0x7fdfb40c4630 2023-08-27T11:26:49.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfb8999700 1 -- 172.21.15.43:0/317015916 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40036a0 con 0x7fdfb40c4630 2023-08-27T11:26:49.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfbbbff700 1 -- 172.21.15.43:0/317015916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 msgr2=0x7fdfb40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.645+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/317015916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb40c4a90 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009840 tx=0x7fdfa4009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:49.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.646+0000 7fdfbbbff700 1 -- 172.21.15.43:0/317015916 shutdown_connections 2023-08-27T11:26:49.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.646+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/317015916 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb40c4a90 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.646+0000 7fdfbbbff700 1 -- 172.21.15.43:0/317015916 >> 172.21.15.43:0/317015916 conn(0x7fdfb40ab820 msgr2=0x7fdfb40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:49.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.646+0000 7fdfbbbff700 1 -- 172.21.15.43:0/317015916 shutdown_connections 2023-08-27T11:26:49.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.646+0000 7fdfbbbff700 1 -- 172.21.15.43:0/317015916 wait complete. 2023-08-27T11:26:49.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.647+0000 7fdfbbbff700 1 Processor -- start 2023-08-27T11:26:49.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.647+0000 7fdfbbbff700 1 -- start start 2023-08-27T11:26:49.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfb406ad70 0x7fdfb41505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:49.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:49.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfb4151a90 0x7fdfb4146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:49.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb414d920 con 0x7fdfb40c4630 2023-08-27T11:26:49.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb414cc90 con 0x7fdfb406ad70 2023-08-27T11:26:49.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.648+0000 7fdfbbbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb414d250 con 0x7fdfb4151a90 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35480/0 (socket says 172.21.15.43:35480) 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 -- 172.21.15.43:0/130773886 learned_addr learned my addr 172.21.15.43:0/130773886 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb999b700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfb406ad70 0x7fdfb41505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfba19c700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfb4151a90 0x7fdfb4146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:49.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 -- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfb4151a90 msgr2=0x7fdfb4146680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfb4151a90 0x7fdfb4146680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 -- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfb406ad70 msgr2=0x7fdfb41505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfb406ad70 0x7fdfb41505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 -- 172.21.15.43:0/130773886 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40094a0 con 0x7fdfb40c4630 2023-08-27T11:26:49.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfb919a700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40ac6e0 tx=0x7fdfa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:49.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.649+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4011630 con 0x7fdfb40c4630 2023-08-27T11:26:49.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.650+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa401e070 con 0x7fdfb40c4630 2023-08-27T11:26:49.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.650+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40aa2a0 con 0x7fdfb40c4630 2023-08-27T11:26:49.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.650+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40119b0 con 0x7fdfb40c4630 2023-08-27T11:26:49.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.650+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb414cee0 con 0x7fdfb40c4630 2023-08-27T11:26:49.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.651+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb414d0a0 con 0x7fdfb40c4630 2023-08-27T11:26:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.652+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdfa4011b10 con 0x7fdfb40c4630 2023-08-27T11:26:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.653+0000 7fdfaa7fc700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 0x7fdf9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.653+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7fdfa40895d0 con 0x7fdfb40c4630 2023-08-27T11:26:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.653+0000 7fdfb999b700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 0x7fdf9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:49.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.654+0000 7fdfb999b700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 0x7fdf9806c5a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0000f60 tx=0x7fdfb0007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:49.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.657+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdfa4054f50 con 0x7fdfb40c4630 2023-08-27T11:26:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.913+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb404ee70 con 0x7fdfb40c4630 2023-08-27T11:26:49.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.914+0000 7fdfaa7fc700 1 -- 172.21.15.43:0/130773886 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fdfa4058570 con 0x7fdfb40c4630 2023-08-27T11:26:49.916 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:49.916 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/432356370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":432356370},{"type":"v1","addr":"172.21.15.57:6835","nonce":432356370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68},{"gid":6667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6833/1124219147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":1124219147},{"type":"v1","addr":"172.21.15.57:6833","nonce":1124219147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85},{"gid":6861,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/3307996452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3307996452},{"type":"v1","addr":"172.21.15.43:6836","nonce":3307996452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":83},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1871360237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1871360237},{"type":"v1","addr":"172.21.15.43:6837","nonce":1871360237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[]} 2023-08-27T11:26:49.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 msgr2=0x7fdf9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 0x7fdf9806c5a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0000f60 tx=0x7fdfb0007c90 comp rx=0 tx=0).stop 2023-08-27T11:26:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 msgr2=0x7fdfb4146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40ac6e0 tx=0x7fdfa4004750 comp rx=0 tx=0).stop 2023-08-27T11:26:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 shutdown_connections 2023-08-27T11:26:49.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdf9806a0e0 0x7fdf9806c5a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfb4151a90 0x7fdfb4146680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfb406ad70 0x7fdfb41505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 --2- 172.21.15.43:0/130773886 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdfb40c4630 0x7fdfb4146140 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 >> 172.21.15.43:0/130773886 conn(0x7fdfb40ab820 msgr2=0x7fdfb406b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 shutdown_connections 2023-08-27T11:26:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:49.916+0000 7fdfbbbff700 1 -- 172.21.15.43:0/130773886 wait complete. 2023-08-27T11:26:49.921 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 85 2023-08-27T11:26:49.936 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:26:49.936 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:26:49.937 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:26:49.937 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:49.937 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:26:49.938 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:26:49.938 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:26:49.938 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:49.938 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:26:49.939 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:26:49.939 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:26:49.939 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:49.939 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:26:49.940 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:26:49.940 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:26:49.940 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:26:49.951 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:26:49.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:26:49.953 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:26:49.953 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:26:49.960 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:26:49.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:26:49.962 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:26:49.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:26:49.997 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:26:49.998 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:50.001 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:26:50.001 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:50.006 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:26:50.006 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:50.009 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:26:50.009 DEBUG:teuthology.parallel:result is None 2023-08-27T11:26:50.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:26:50.152 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:26:50.153 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:26:50.164 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:26:50.164 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:26:50.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.224+0000 7f8afbdff700 1 Processor -- start 2023-08-27T11:26:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.225+0000 7f8afbdff700 1 -- start start 2023-08-27T11:26:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8afbdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 0x7f8af406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8afbdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af406c4e0 con 0x7f8af40c4630 2023-08-27T11:26:50.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8afbdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af4155370 con 0x7f8af4151a90 2023-08-27T11:26:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8afbdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af40c82c0 con 0x7f8af40c4a90 2023-08-27T11:26:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8af939a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8af40c4630 0x7f8af406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57274/0 (socket says 172.21.15.43:57274) 2023-08-27T11:26:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8af939a700 1 -- 172.21.15.43:0/639923030 learned_addr learned my addr 172.21.15.43:0/639923030 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:50.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8afa39c700 1 --2- 172.21.15.43:0/639923030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 0x7f8af406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:50.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046621222 0 0) 0x7f8af406c4e0 con 0x7f8af40c4630 2023-08-27T11:26:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.226+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae00035b0 con 0x7f8af40c4630 2023-08-27T11:26:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987765614 0 0) 0x7f8af4155370 con 0x7f8af4151a90 2023-08-27T11:26:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af406c4e0 con 0x7f8af4151a90 2023-08-27T11:26:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8afa39c700 1 -- 172.21.15.43:0/639923030 >> v1:172.21.15.57:6789/0 conn(0x7f8af4151a90 legacy=0x7f8af40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:50.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8afa39c700 1 -- 172.21.15.43:0/639923030 >> v1:172.21.15.43:6789/0 conn(0x7f8af40c4630 legacy=0x7f8af406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8afa39c700 1 -- 172.21.15.43:0/639923030 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4151e70 con 0x7f8af40c4a90 2023-08-27T11:26:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8afa39c700 1 --2- 172.21.15.43:0/639923030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 0x7f8af406b480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009dc0 tx=0x7f8aec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd50db49b9a5705 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00e070 con 0x7f8af40c4a90 2023-08-27T11:26:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec00bb20 con 0x7f8af40c4a90 2023-08-27T11:26:50.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.227+0000 7f8af8b99700 1 -- 172.21.15.43:0/639923030 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec012430 con 0x7f8af40c4a90 2023-08-27T11:26:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 -- 172.21.15.43:0/639923030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 msgr2=0x7f8af406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 --2- 172.21.15.43:0/639923030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 0x7f8af406b480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009dc0 tx=0x7f8aec00b330 comp rx=0 tx=0).stop 2023-08-27T11:26:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 -- 172.21.15.43:0/639923030 shutdown_connections 2023-08-27T11:26:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 --2- 172.21.15.43:0/639923030 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af40c4a90 0x7f8af406b480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:50.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 -- 172.21.15.43:0/639923030 >> 172.21.15.43:0/639923030 conn(0x7f8af40ab820 msgr2=0x7f8af40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 -- 172.21.15.43:0/639923030 shutdown_connections 2023-08-27T11:26:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.228+0000 7f8afbdff700 1 -- 172.21.15.43:0/639923030 wait complete. 2023-08-27T11:26:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.230+0000 7f8afbdff700 1 Processor -- start 2023-08-27T11:26:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.230+0000 7f8afbdff700 1 -- start start 2023-08-27T11:26:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 0x7f8af4152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af4151a90 0x7f8af4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4154270 con 0x7f8af40c4630 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af414d870 con 0x7f8af40c4a90 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8afbdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af41ed110 con 0x7f8af4151a90 2023-08-27T11:26:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35544/0 (socket says 172.21.15.43:35544) 2023-08-27T11:26:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 -- 172.21.15.43:0/3762308191 learned_addr learned my addr 172.21.15.43:0/3762308191 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af939a700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 0x7f8af4152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 -- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af4151a90 msgr2=0x7f8af4152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af4151a90 0x7f8af4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 -- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 msgr2=0x7f8af4152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 0x7f8af4152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af9b9b700 1 -- 172.21.15.43:0/3762308191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec009a70 con 0x7f8af40c4630 2023-08-27T11:26:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.231+0000 7f8af939a700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 0x7f8af4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8af9b9b700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c520 tx=0x7f8af000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00052d0 con 0x7f8af40c4630 2023-08-27T11:26:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0005430 con 0x7f8af40c4630 2023-08-27T11:26:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00038c0 con 0x7f8af40c4630 2023-08-27T11:26:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af40bd0b0 con 0x7f8af40c4630 2023-08-27T11:26:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.232+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af4153c20 con 0x7f8af40c4630 2023-08-27T11:26:50.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.233+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af404ee70 con 0x7f8af40c4630 2023-08-27T11:26:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.234+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8af0003a20 con 0x7f8af40c4630 2023-08-27T11:26:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.235+0000 7f8aea7fc700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 0x7f8ad806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.235+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f8af0087870 con 0x7f8af40c4630 2023-08-27T11:26:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.235+0000 7f8af939a700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 0x7f8ad806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.236+0000 7f8af939a700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 0x7f8ad806c5a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8af4158990 tx=0x7f8ae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.239+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8af00531f0 con 0x7f8af40c4630 2023-08-27T11:26:50.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:50.475+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8af406c130 con 0x7f8af40c4630 2023-08-27T11:26:51.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.334+0000 7f8aea7fc700 1 -- 172.21.15.43:0/3762308191 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v92) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8af0056810 con 0x7f8af40c4630 2023-08-27T11:26:51.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 msgr2=0x7f8ad806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 0x7f8ad806c5a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8af4158990 tx=0x7f8ae4009040 comp rx=0 tx=0).stop 2023-08-27T11:26:51.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 msgr2=0x7f8af4149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c520 tx=0x7f8af000c8e0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 shutdown_connections 2023-08-27T11:26:51.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ad806a0e0 0x7f8ad806c5a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8af4151a90 0x7f8af4152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8af40c4630 0x7f8af4149ec0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 --2- 172.21.15.43:0/3762308191 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8af40c4a90 0x7f8af4152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.337+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 >> 172.21.15.43:0/3762308191 conn(0x7f8af40ab820 msgr2=0x7f8af414f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:51.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.338+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 shutdown_connections 2023-08-27T11:26:51.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.338+0000 7f8afbdff700 1 -- 172.21.15.43:0/3762308191 wait complete. 2023-08-27T11:26:51.343 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:26:51.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:26:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.566+0000 7f7cdb5ff700 1 Processor -- start 2023-08-27T11:26:51.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.566+0000 7f7cdb5ff700 1 -- start start 2023-08-27T11:26:51.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.567+0000 7f7cdb5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cd414eaa0 0x7f7cd40c2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.567+0000 7f7cdb5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7cd40c2750 0x7f7cd40c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.567+0000 7f7cdb5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd4152200 con 0x7f7cd40a6d00 2023-08-27T11:26:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.567+0000 7f7cdb5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd4151c80 con 0x7f7cd414eaa0 2023-08-27T11:26:51.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.567+0000 7f7cdb5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd414ee80 con 0x7f7cd40c2750 2023-08-27T11:26:51.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cd414eaa0 0x7f7cd40c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7cd414eaa0 0x7f7cd40c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35550/0 (socket says 172.21.15.43:35550) 2023-08-27T11:26:51.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 -- 172.21.15.43:0/4140543245 learned_addr learned my addr 172.21.15.43:0/4140543245 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:51.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd9b9c700 1 --2- 172.21.15.43:0/4140543245 >> v2:172.21.15.57:3300/0 conn(0x7f7cd40c2750 0x7f7cd40c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 -- 172.21.15.43:0/4140543245 >> v2:172.21.15.57:3300/0 conn(0x7f7cd40c2750 msgr2=0x7f7cd40c12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:51.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 --2- 172.21.15.43:0/4140543245 >> v2:172.21.15.57:3300/0 conn(0x7f7cd40c2750 0x7f7cd40c12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 -- 172.21.15.43:0/4140543245 >> v1:172.21.15.57:6789/0 conn(0x7f7cd40a6d00 legacy=0x7f7cd40c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 -- 172.21.15.43:0/4140543245 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4151f20 con 0x7f7cd414eaa0 2023-08-27T11:26:51.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.568+0000 7f7cd939b700 1 --2- 172.21.15.43:0/4140543245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40c2210 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40c69a0 tx=0x7f7cd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927d423271175be7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:51.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7ccbfff700 1 -- 172.21.15.43:0/4140543245 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000f8a0 con 0x7f7cd414eaa0 2023-08-27T11:26:51.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7ccbfff700 1 -- 172.21.15.43:0/4140543245 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd000fa00 con 0x7f7cd414eaa0 2023-08-27T11:26:51.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7ccbfff700 1 -- 172.21.15.43:0/4140543245 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000fd90 con 0x7f7cd414eaa0 2023-08-27T11:26:51.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/4140543245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 msgr2=0x7f7cd40c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/4140543245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40c2210 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40c69a0 tx=0x7f7cd0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/4140543245 shutdown_connections 2023-08-27T11:26:51.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/4140543245 >> v2:172.21.15.57:3300/0 conn(0x7f7cd40c2750 0x7f7cd40c12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/4140543245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40c2210 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.569+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/4140543245 >> 172.21.15.43:0/4140543245 conn(0x7f7cd406ab90 msgr2=0x7f7cd40a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:51.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.570+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/4140543245 shutdown_connections 2023-08-27T11:26:51.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.570+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/4140543245 wait complete. 2023-08-27T11:26:51.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.572+0000 7f7cdb5ff700 1 Processor -- start 2023-08-27T11:26:51.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.572+0000 7f7cdb5ff700 1 -- start start 2023-08-27T11:26:51.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cd40a6d00 0x7f7cd4148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cd40c2750 0x7f7cd40bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4155720 con 0x7f7cd414eaa0 2023-08-27T11:26:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41dcb70 con 0x7f7cd40c2750 2023-08-27T11:26:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.573+0000 7f7cdb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41e5e80 con 0x7f7cd40a6d00 2023-08-27T11:26:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd8b9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cd40c2750 0x7f7cd40bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35560/0 (socket says 172.21.15.43:35560) 2023-08-27T11:26:51.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 -- 172.21.15.43:0/3459613871 learned_addr learned my addr 172.21.15.43:0/3459613871 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:51.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd939b700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cd40a6d00 0x7f7cd4148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 -- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cd40a6d00 msgr2=0x7f7cd4148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cd40a6d00 0x7f7cd4148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 -- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cd40c2750 msgr2=0x7f7cd40bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cd40c2750 0x7f7cd40bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 -- 172.21.15.43:0/3459613871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0009550 con 0x7f7cd414eaa0 2023-08-27T11:26:51.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.574+0000 7f7cd9b9c700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00efc0 tx=0x7f7ccc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:51.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.575+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc009ea0 con 0x7f7cd414eaa0 2023-08-27T11:26:51.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.575+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00f040 con 0x7f7cd414eaa0 2023-08-27T11:26:51.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.575+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00ce70 con 0x7f7cd414eaa0 2023-08-27T11:26:51.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.575+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd4150bd0 con 0x7f7cd414eaa0 2023-08-27T11:26:51.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.575+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd4151190 con 0x7f7cd414eaa0 2023-08-27T11:26:51.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.576+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd404ee70 con 0x7f7cd414eaa0 2023-08-27T11:26:51.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.577+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ccc014480 con 0x7f7cd414eaa0 2023-08-27T11:26:51.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.578+0000 7f7cc9ffb700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 0x7f7cb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:51.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.578+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7ccc088d50 con 0x7f7cd414eaa0 2023-08-27T11:26:51.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.578+0000 7f7cd939b700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 0x7f7cb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:51.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.579+0000 7f7cd939b700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 0x7f7cb806c5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009c10 tx=0x7f7cd001b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:51.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.583+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ccc0546f0 con 0x7f7cd414eaa0 2023-08-27T11:26:51.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.872+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7cd40c3230 con 0x7f7cd414eaa0 2023-08-27T11:26:51.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.872+0000 7f7cc9ffb700 1 -- 172.21.15.43:0/3459613871 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4724 (secure 0 0 0) 0x7f7ccc018090 con 0x7f7cd414eaa0 2023-08-27T11:26:51.874 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:51.874 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:26:51.874 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:26:51.875 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.875 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:26:51.875 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:26:51.875 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.875 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.876 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:51.876 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:51.876 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.876 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.877 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:51.878 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:51.878 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.878 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.878 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:51.879 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:51.880 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.880 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.880 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.880 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.880 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:26:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:26:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:51.881 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:51.882 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.882 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.882 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.883 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:26:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:26:51.884 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.885 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.885 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.885 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.885 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.886 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.887 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.887 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.887 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.887 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.888 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.889 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.889 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:26:51.889 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:26:51.889 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.890 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.890 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.890 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.890 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.890 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.891 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:26:51.891 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:26:51.891 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.891 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.892 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.892 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.892 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.892 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.893 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:26:51.893 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:26:51.893 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.893 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.893 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:26:51.894 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:26:51.895 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.895 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:26:51.895 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:26:51.895 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.895 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.896 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.897 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:26:51.897 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:26:51.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.897 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.898 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:26:51.898 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:26:51.898 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.898 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:26:51.898 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.899 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:26:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:26:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:26:51.900 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:26:51.901 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.901 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.901 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.901 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.902 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:26:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:26:51.903 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:26:51.904 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:26:51.904 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:26:51.904 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:26:51.904 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.904 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:51.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:26:51.905 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:26:51.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.874+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 msgr2=0x7f7cb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.874+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 0x7f7cb806c5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009c10 tx=0x7f7cd001b040 comp rx=0 tx=0).stop 2023-08-27T11:26:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.874+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 msgr2=0x7f7cd40bbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.874+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00efc0 tx=0x7f7ccc00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 shutdown_connections 2023-08-27T11:26:51.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7cb806a0e0 0x7f7cb806c5a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7cd414eaa0 0x7f7cd40bbd10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7cd40a6d00 0x7f7cd4148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 --2- 172.21.15.43:0/3459613871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7cd40c2750 0x7f7cd40bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 >> 172.21.15.43:0/3459613871 conn(0x7f7cd406ab90 msgr2=0x7f7cd40a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 shutdown_connections 2023-08-27T11:26:51.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:51.875+0000 7f7cdb5ff700 1 -- 172.21.15.43:0/3459613871 wait complete. 2023-08-27T11:26:51.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:52.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.110+0000 7f886ffff700 1 Processor -- start 2023-08-27T11:26:52.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.110+0000 7f886ffff700 1 -- start start 2023-08-27T11:26:52.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88680c51a0 0x7f88680c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88680c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886ffff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88680c5ae0 con 0x7f8868151910 2023-08-27T11:26:52.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886ffff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88680c69f0 con 0x7f88680c51a0 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886ffff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c1190 con 0x7f88680c15e0 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88680c51a0 0x7f88680c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f88680c51a0 0x7f88680c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35572/0 (socket says 172.21.15.43:35572) 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 -- 172.21.15.43:0/1805816791 learned_addr learned my addr 172.21.15.43:0/1805816791 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886e59c700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88680c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 -- 172.21.15.43:0/1805816791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 msgr2=0x7f88680c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:52.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88680c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 -- 172.21.15.43:0/1805816791 >> v1:172.21.15.57:6789/0 conn(0x7f8868151910 legacy=0x7f8868157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.112+0000 7f886d59a700 1 -- 172.21.15.43:0/1805816791 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868072900 con 0x7f88680c51a0 2023-08-27T11:26:52.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886d59a700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88680c51a0 0x7f88680c5f70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f88580098f0 tx=0x7f8858009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27029e3d9dbbe197 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886cd99700 1 -- 172.21.15.43:0/1805816791 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800b8a0 con 0x7f88680c51a0 2023-08-27T11:26:52.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886cd99700 1 -- 172.21.15.43:0/1805816791 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800ba00 con 0x7f88680c51a0 2023-08-27T11:26:52.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886cd99700 1 -- 172.21.15.43:0/1805816791 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800bd90 con 0x7f88680c51a0 2023-08-27T11:26:52.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886ffff700 1 -- 172.21.15.43:0/1805816791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88680c51a0 msgr2=0x7f88680c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.113+0000 7f886ffff700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88680c51a0 0x7f88680c5f70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f88580098f0 tx=0x7f8858009c00 comp rx=0 tx=0).stop 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 -- 172.21.15.43:0/1805816791 shutdown_connections 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88680c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 --2- 172.21.15.43:0/1805816791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f88680c51a0 0x7f88680c5f70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 -- 172.21.15.43:0/1805816791 >> 172.21.15.43:0/1805816791 conn(0x7f88680a9740 msgr2=0x7f88680a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:52.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 -- 172.21.15.43:0/1805816791 shutdown_connections 2023-08-27T11:26:52.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.114+0000 7f886ffff700 1 -- 172.21.15.43:0/1805816791 wait complete. 2023-08-27T11:26:52.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.115+0000 7f886ffff700 1 Processor -- start 2023-08-27T11:26:52.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.115+0000 7f886ffff700 1 -- start start 2023-08-27T11:26:52.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88681ea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88680c51a0 0x7f88680a7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88681ed2b0 con 0x7f8868151910 2023-08-27T11:26:52.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88681ea4a0 con 0x7f88680c51a0 2023-08-27T11:26:52.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886ffff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868157e90 con 0x7f88680c15e0 2023-08-27T11:26:52.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886dd9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88681ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35580/0 (socket says 172.21.15.43:35580) 2023-08-27T11:26:52.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 -- 172.21.15.43:0/1310569475 learned_addr learned my addr 172.21.15.43:0/1310569475 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:52.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886d59a700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88680c51a0 0x7f88680a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 -- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 msgr2=0x7f88681ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88681ea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 -- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88680c51a0 msgr2=0x7f88680a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88680c51a0 0x7f88680a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.117+0000 7f886e59c700 1 -- 172.21.15.43:0/1310569475 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858009550 con 0x7f8868151910 2023-08-27T11:26:52.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f886e59c700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8860009fd0 tx=0x7f886000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860007ea0 con 0x7f8868151910 2023-08-27T11:26:52.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000ed30 con 0x7f8868151910 2023-08-27T11:26:52.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88681e9e50 con 0x7f8868151910 2023-08-27T11:26:52.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000eea0 con 0x7f8868151910 2023-08-27T11:26:52.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.118+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680a7e60 con 0x7f8868151910 2023-08-27T11:26:52.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.119+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88681ea610 con 0x7f8868151910 2023-08-27T11:26:52.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.120+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8860014660 con 0x7f8868151910 2023-08-27T11:26:52.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.121+0000 7f885e7fc700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 0x7f884c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.121+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f88600887d0 con 0x7f8868151910 2023-08-27T11:26:52.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.121+0000 7f886dd9b700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 0x7f884c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.122+0000 7f886dd9b700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 0x7f884c06c5a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8864007fd0 tx=0x7f8864009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.125+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8860057c90 con 0x7f8868151910 2023-08-27T11:26:52.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.336+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886804ee70 con 0x7f8868151910 2023-08-27T11:26:52.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.337+0000 7f885e7fc700 1 -- 172.21.15.43:0/1310569475 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+14522 (secure 0 0 0) 0x7f8860057820 con 0x7f8868151910 2023-08-27T11:26:52.338 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:52.339 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:51.327537+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.339+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 msgr2=0x7f884c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.339+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 0x7f884c06c5a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8864007fd0 tx=0x7f8864009040 comp rx=0 tx=0).stop 2023-08-27T11:26:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.339+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 msgr2=0x7f88680ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.339+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8860009fd0 tx=0x7f886000e3c0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 shutdown_connections 2023-08-27T11:26:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f884c06a0e0 0x7f884c06c5a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8868151910 0x7f88680ab630 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f88680c15e0 0x7f88681ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 --2- 172.21.15.43:0/1310569475 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88680c51a0 0x7f88680a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 >> 172.21.15.43:0/1310569475 conn(0x7f88680a9740 msgr2=0x7f8868150350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 shutdown_connections 2023-08-27T11:26:52.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.340+0000 7f886ffff700 1 -- 172.21.15.43:0/1310569475 wait complete. 2023-08-27T11:26:52.359 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:26:52.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:26:52.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.563+0000 7fa7c51ff700 1 Processor -- start 2023-08-27T11:26:52.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.563+0000 7fa7c51ff700 1 -- start start 2023-08-27T11:26:52.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.564+0000 7fa7c51ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa7c00c5230 0x7fa7c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.564+0000 7fa7c51ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa7c0155880 0x7fa7c0155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.564+0000 7fa7c51ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c01561a0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7c51ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c0152290 con 0x7fa7c0155880 2023-08-27T11:26:52.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7c51ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c006d7a0 con 0x7fa7c00c5230 2023-08-27T11:26:52.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7b7fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa7c006c5e0 0x7fa7c00aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57280/0 (socket says 172.21.15.43:57280) 2023-08-27T11:26:52.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7b7fff700 1 -- 172.21.15.43:0/2447838369 learned_addr learned my addr 172.21.15.43:0/2447838369 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:52.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bf59e700 1 --2- 172.21.15.43:0/2447838369 >> v2:172.21.15.43:3300/0 conn(0x7fa7c0155880 0x7fa7c0155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bed9d700 1 --2- 172.21.15.43:0/2447838369 >> v2:172.21.15.57:3300/0 conn(0x7fa7c00c5230 0x7fa7c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7be59c700 1 -- 172.21.15.43:0/2447838369 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453019110 0 0) 0x7fa7c01561a0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7be59c700 1 -- 172.21.15.43:0/2447838369 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ac0035b0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bf59e700 1 -- 172.21.15.43:0/2447838369 >> v2:172.21.15.57:3300/0 conn(0x7fa7c00c5230 msgr2=0x7fa7c006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bf59e700 1 --2- 172.21.15.43:0/2447838369 >> v2:172.21.15.57:3300/0 conn(0x7fa7c00c5230 0x7fa7c006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bf59e700 1 -- 172.21.15.43:0/2447838369 >> v1:172.21.15.43:6789/0 conn(0x7fa7c006c5e0 legacy=0x7fa7c00aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.565+0000 7fa7bf59e700 1 -- 172.21.15.43:0/2447838369 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0152550 con 0x7fa7c0155880 2023-08-27T11:26:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7bf59e700 1 --2- 172.21.15.43:0/2447838369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c0155880 0x7fa7c0155c60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa7c006ced0 tx=0x7fa7b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5371b8d3507503d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7be59c700 1 -- 172.21.15.43:0/2447838369 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800e070 con 0x7fa7c0155880 2023-08-27T11:26:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7be59c700 1 -- 172.21.15.43:0/2447838369 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b800bb20 con 0x7fa7c0155880 2023-08-27T11:26:52.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7be59c700 1 -- 172.21.15.43:0/2447838369 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8012430 con 0x7fa7c0155880 2023-08-27T11:26:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7c51ff700 1 -- 172.21.15.43:0/2447838369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c0155880 msgr2=0x7fa7c0155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/2447838369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c0155880 0x7fa7c0155c60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fa7c006ced0 tx=0x7fa7b800b330 comp rx=0 tx=0).stop 2023-08-27T11:26:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.566+0000 7fa7c51ff700 1 -- 172.21.15.43:0/2447838369 shutdown_connections 2023-08-27T11:26:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.567+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/2447838369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c0155880 0x7fa7c0155c60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.567+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/2447838369 >> v2:172.21.15.57:3300/0 conn(0x7fa7c00c5230 0x7fa7c006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.567+0000 7fa7c51ff700 1 -- 172.21.15.43:0/2447838369 >> 172.21.15.43:0/2447838369 conn(0x7fa7c00c5b10 msgr2=0x7fa7c00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.567+0000 7fa7c51ff700 1 -- 172.21.15.43:0/2447838369 shutdown_connections 2023-08-27T11:26:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.567+0000 7fa7c51ff700 1 -- 172.21.15.43:0/2447838369 wait complete. 2023-08-27T11:26:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.568+0000 7fa7c51ff700 1 Processor -- start 2023-08-27T11:26:52.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.568+0000 7fa7c51ff700 1 -- start start 2023-08-27T11:26:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 0x7fa7c014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7c0155880 0x7fa7c0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0071b00 con 0x7fa7c006c5e0 2023-08-27T11:26:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c014ea60 con 0x7fa7c00c5230 2023-08-27T11:26:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.569+0000 7fa7c51ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c0151460 con 0x7fa7c0155880 2023-08-27T11:26:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35604/0 (socket says 172.21.15.43:35604) 2023-08-27T11:26:52.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 -- 172.21.15.43:0/4152280781 learned_addr learned my addr 172.21.15.43:0/4152280781 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7b7fff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 0x7fa7c014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bf59e700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7c0155880 0x7fa7c0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 -- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7c0155880 msgr2=0x7fa7c0151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7c0155880 0x7fa7c0151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 -- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 msgr2=0x7fa7c014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 0x7fa7c014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 -- 172.21.15.43:0/4152280781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009a70 con 0x7fa7c006c5e0 2023-08-27T11:26:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7b7fff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 0x7fa7c014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7bed9d700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000e9b0 tx=0x7fa7b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0009710 con 0x7fa7c006c5e0 2023-08-27T11:26:52.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000c7f0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.570+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000cb60 con 0x7fa7c006c5e0 2023-08-27T11:26:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.571+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0070f80 con 0x7fa7c006c5e0 2023-08-27T11:26:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.571+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c0071540 con 0x7fa7c006c5e0 2023-08-27T11:26:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.572+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c00a5ba0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.573+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7b000ccc0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.574+0000 7fa7b77fe700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 0x7fa7a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.574+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7b0088290 con 0x7fa7c006c5e0 2023-08-27T11:26:52.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.574+0000 7fa7b7fff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 0x7fa7a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.575+0000 7fa7b7fff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 0x7fa7a006c5a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80011e0 tx=0x7fa7a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:52.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.579+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7b0057750 con 0x7fa7c006c5e0 2023-08-27T11:26:52.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.787+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7c004ee70 con 0x7fa7c006c5e0 2023-08-27T11:26:52.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.787+0000 7fa7b77fe700 1 -- 172.21.15.43:0/4152280781 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v92) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7b00572e0 con 0x7fa7c006c5e0 2023-08-27T11:26:52.789 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:26:52.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 msgr2=0x7fa7a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 0x7fa7a006c5a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80011e0 tx=0x7fa7a8009040 comp rx=0 tx=0).stop 2023-08-27T11:26:52.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 msgr2=0x7fa7c0150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:52.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000e9b0 tx=0x7fa7b000ed70 comp rx=0 tx=0).stop 2023-08-27T11:26:52.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 shutdown_connections 2023-08-27T11:26:52.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7a006a0e0 0x7fa7a006c5a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa7c0155880 0x7fa7c0151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa7c006c5e0 0x7fa7c0150f20 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 --2- 172.21.15.43:0/4152280781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7c00c5230 0x7fa7c014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:52.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 >> 172.21.15.43:0/4152280781 conn(0x7fa7c00c5b10 msgr2=0x7fa7c00a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:52.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 shutdown_connections 2023-08-27T11:26:52.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:52.790+0000 7fa7c51ff700 1 -- 172.21.15.43:0/4152280781 wait complete. 2023-08-27T11:26:52.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:26:53.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.014+0000 7f97905ff700 1 Processor -- start 2023-08-27T11:26:53.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.014+0000 7f97905ff700 1 -- start start 2023-08-27T11:26:53.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f97905ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97880ac410 0x7f97880c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f97905ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 0x7f978815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f97905ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97880c80c0 con 0x7f97880c49f0 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f97905ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97881555a0 con 0x7f97880ac410 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f97905ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97881552c0 con 0x7f97880c94c0 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97880ac410 0x7f97880c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97880ac410 0x7f97880c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35620/0 (socket says 172.21.15.43:35620) 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 -- 172.21.15.43:0/2314848876 learned_addr learned my addr 172.21.15.43:0/2314848876 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:53.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978eb9c700 1 --2- 172.21.15.43:0/2314848876 >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 0x7f978815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 -- 172.21.15.43:0/2314848876 >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 msgr2=0x7f978815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:53.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 --2- 172.21.15.43:0/2314848876 >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 0x7f978815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 -- 172.21.15.43:0/2314848876 >> v1:172.21.15.57:6789/0 conn(0x7f97880c49f0 legacy=0x7f9788151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978db9a700 1 -- 172.21.15.43:0/2314848876 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880c8360 con 0x7f97880ac410 2023-08-27T11:26:53.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.016+0000 7f978eb9c700 1 --2- 172.21.15.43:0/2314848876 >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 0x7f978815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:53.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f978db9a700 1 --2- 172.21.15.43:0/2314848876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880ac410 0x7f97880c8f80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9788067860 tx=0x7f9778009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ebf18f90d0ef41 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f978d399700 1 -- 172.21.15.43:0/2314848876 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800b870 con 0x7f97880ac410 2023-08-27T11:26:53.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f978d399700 1 -- 172.21.15.43:0/2314848876 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800b9d0 con 0x7f97880ac410 2023-08-27T11:26:53.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f978d399700 1 -- 172.21.15.43:0/2314848876 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800bd60 con 0x7f97880ac410 2023-08-27T11:26:53.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f97905ff700 1 -- 172.21.15.43:0/2314848876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880ac410 msgr2=0x7f97880c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.017+0000 7f97905ff700 1 --2- 172.21.15.43:0/2314848876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880ac410 0x7f97880c8f80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f9788067860 tx=0x7f9778009bd0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 -- 172.21.15.43:0/2314848876 shutdown_connections 2023-08-27T11:26:53.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 --2- 172.21.15.43:0/2314848876 >> v2:172.21.15.57:3300/0 conn(0x7f97880c94c0 0x7f978815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 --2- 172.21.15.43:0/2314848876 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880ac410 0x7f97880c8f80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 -- 172.21.15.43:0/2314848876 >> 172.21.15.43:0/2314848876 conn(0x7f97880ab8f0 msgr2=0x7f97880abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:53.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 -- 172.21.15.43:0/2314848876 shutdown_connections 2023-08-27T11:26:53.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.018+0000 7f97905ff700 1 -- 172.21.15.43:0/2314848876 wait complete. 2023-08-27T11:26:53.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.020+0000 7f97905ff700 1 Processor -- start 2023-08-27T11:26:53.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.020+0000 7f97905ff700 1 -- start start 2023-08-27T11:26:53.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 0x7f97880aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97880c94c0 0x7f97881e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880ad410 con 0x7f97880c49f0 2023-08-27T11:26:53.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788143f20 con 0x7f97880c94c0 2023-08-27T11:26:53.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f97905ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97881ea220 con 0x7f97880ac410 2023-08-27T11:26:53.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f978db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f978db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35636/0 (socket says 172.21.15.43:35636) 2023-08-27T11:26:53.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.021+0000 7f978db9a700 1 -- 172.21.15.43:0/438765287 learned_addr learned my addr 172.21.15.43:0/438765287 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:53.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978eb9c700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97880c94c0 0x7f97881e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978e39b700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 0x7f97880aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 -- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 msgr2=0x7f97880aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 0x7f97880aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 -- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97880c94c0 msgr2=0x7f97881e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97880c94c0 0x7f97881e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 -- 172.21.15.43:0/438765287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009550 con 0x7f97880c49f0 2023-08-27T11:26:53.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978e39b700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 0x7f97880aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:26:53.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f978db9a700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778004540 con 0x7f97880c49f0 2023-08-27T11:26:53.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97780036a0 con 0x7f97880c49f0 2023-08-27T11:26:53.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778003a30 con 0x7f97880c49f0 2023-08-27T11:26:53.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.022+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880af030 con 0x7f97880c49f0 2023-08-27T11:26:53.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.023+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97880af3c0 con 0x7f97880c49f0 2023-08-27T11:26:53.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.024+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880c89e0 con 0x7f97880c49f0 2023-08-27T11:26:53.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.024+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9778021070 con 0x7f97880c49f0 2023-08-27T11:26:53.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.025+0000 7f977effd700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 0x7f976c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.025+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9778089820 con 0x7f97880c49f0 2023-08-27T11:26:53.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.026+0000 7f978e39b700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 0x7f976c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.026+0000 7f978e39b700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 0x7f976c06c5a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9784000f60 tx=0x7f9784009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.030+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9778055370 con 0x7f97880c49f0 2023-08-27T11:26:53.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.240+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f978804ee70 con 0x7f97880c49f0 2023-08-27T11:26:53.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.240+0000 7f977effd700 1 -- 172.21.15.43:0/438765287 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9778058990 con 0x7f97880c49f0 2023-08-27T11:26:53.242 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:26:53.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 msgr2=0x7f976c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 0x7f976c06c5a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9784000f60 tx=0x7f9784009040 comp rx=0 tx=0).stop 2023-08-27T11:26:53.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 msgr2=0x7f97881e97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9778000c00 tx=0x7f9778004750 comp rx=0 tx=0).stop 2023-08-27T11:26:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 shutdown_connections 2023-08-27T11:26:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f976c06a0e0 0x7f976c06c5a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97880c94c0 0x7f97881e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97880ac410 0x7f97880aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 --2- 172.21.15.43:0/438765287 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97880c49f0 0x7f97881e97a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 >> 172.21.15.43:0/438765287 conn(0x7f97880ab8f0 msgr2=0x7f97880a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 shutdown_connections 2023-08-27T11:26:53.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.243+0000 7f97905ff700 1 -- 172.21.15.43:0/438765287 wait complete. 2023-08-27T11:26:53.262 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:26:53.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.464+0000 7f4e3c5ff700 1 Processor -- start 2023-08-27T11:26:53.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.464+0000 7f4e3c5ff700 1 -- start start 2023-08-27T11:26:53.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.465+0000 7f4e3c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e3414e960 0x7f4e340a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.465+0000 7f4e3c5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e340c50d0 0x7f4e340c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.465+0000 7f4e3c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e34154d00 con 0x7f4e340a79c0 2023-08-27T11:26:53.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e340baf30 con 0x7f4e3414e960 2023-08-27T11:26:53.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3c5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e34154fe0 con 0x7f4e340c50d0 2023-08-27T11:26:53.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e3414e960 0x7f4e340a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e3414e960 0x7f4e340a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35648/0 (socket says 172.21.15.43:35648) 2023-08-27T11:26:53.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 -- 172.21.15.43:0/733576787 learned_addr learned my addr 172.21.15.43:0/733576787 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:53.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3ab9c700 1 --2- 172.21.15.43:0/733576787 >> v2:172.21.15.57:3300/0 conn(0x7f4e340c50d0 0x7f4e340c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 -- 172.21.15.43:0/733576787 >> v2:172.21.15.57:3300/0 conn(0x7f4e340c50d0 msgr2=0x7f4e340c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:53.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 --2- 172.21.15.43:0/733576787 >> v2:172.21.15.57:3300/0 conn(0x7f4e340c50d0 0x7f4e340c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 -- 172.21.15.43:0/733576787 >> v1:172.21.15.57:6789/0 conn(0x7f4e340a79c0 legacy=0x7f4e340c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.466+0000 7f4e3a39b700 1 -- 172.21.15.43:0/733576787 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e341552c0 con 0x7f4e3414e960 2023-08-27T11:26:53.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e3a39b700 1 --2- 172.21.15.43:0/733576787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e3414e960 0x7f4e340a7480 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4e341521a0 tx=0x7f4e3000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f6322716d51b6f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e39399700 1 -- 172.21.15.43:0/733576787 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000dc70 con 0x7f4e3414e960 2023-08-27T11:26:53.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e39399700 1 -- 172.21.15.43:0/733576787 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000ddd0 con 0x7f4e3414e960 2023-08-27T11:26:53.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e39399700 1 -- 172.21.15.43:0/733576787 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30010690 con 0x7f4e3414e960 2023-08-27T11:26:53.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/733576787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e3414e960 msgr2=0x7f4e340a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.467+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/733576787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e3414e960 0x7f4e340a7480 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f4e341521a0 tx=0x7f4e3000be70 comp rx=0 tx=0).stop 2023-08-27T11:26:53.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/733576787 shutdown_connections 2023-08-27T11:26:53.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/733576787 >> v2:172.21.15.57:3300/0 conn(0x7f4e340c50d0 0x7f4e340c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/733576787 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e3414e960 0x7f4e340a7480 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/733576787 >> 172.21.15.43:0/733576787 conn(0x7f4e3406aa50 msgr2=0x7f4e340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:53.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/733576787 shutdown_connections 2023-08-27T11:26:53.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.468+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/733576787 wait complete. 2023-08-27T11:26:53.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.469+0000 7f4e3c5ff700 1 Processor -- start 2023-08-27T11:26:53.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.469+0000 7f4e3c5ff700 1 -- start start 2023-08-27T11:26:53.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 0x7f4e341ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 0x7f4e3414c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3414f120 con 0x7f4e340c50d0 2023-08-27T11:26:53.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341edbf0 con 0x7f4e3414e960 2023-08-27T11:26:53.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.470+0000 7f4e3c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341eded0 con 0x7f4e340a79c0 2023-08-27T11:26:53.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e3a39b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 0x7f4e341ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35652/0 (socket says 172.21.15.43:35652) 2023-08-27T11:26:53.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e3a39b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 0x7f4e341ed3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48020/0 (socket says 172.21.15.43:48020) 2023-08-27T11:26:53.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 -- 172.21.15.43:0/1541690649 learned_addr learned my addr 172.21.15.43:0/1541690649 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:53.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e3ab9c700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 0x7f4e3414c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 -- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 msgr2=0x7f4e341ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 0x7f4e341ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 -- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 msgr2=0x7f4e3414c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 0x7f4e3414c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e39b9a700 1 -- 172.21.15.43:0/1541690649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3000b7f0 con 0x7f4e340c50d0 2023-08-27T11:26:53.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.471+0000 7f4e3ab9c700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 0x7f4e3414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e39b9a700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c4e0 tx=0x7f4e2400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240052d0 con 0x7f4e340c50d0 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e24005430 con 0x7f4e340c50d0 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3414f370 con 0x7f4e340c50d0 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240038c0 con 0x7f4e340c50d0 2023-08-27T11:26:53.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.472+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e341ed8f0 con 0x7f4e340c50d0 2023-08-27T11:26:53.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.473+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e340bb390 con 0x7f4e340c50d0 2023-08-27T11:26:53.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.474+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e24003a20 con 0x7f4e340c50d0 2023-08-27T11:26:53.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.475+0000 7f4e2affd700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 0x7f4e1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.475+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4e240875d0 con 0x7f4e340c50d0 2023-08-27T11:26:53.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.475+0000 7f4e3a39b700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 0x7f4e1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.476+0000 7f4e3a39b700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 0x7f4e1806c5a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000beb0 tx=0x7f4e3001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.479+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4e24053000 con 0x7f4e340c50d0 2023-08-27T11:26:53.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.689+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4e341ee090 con 0x7f4e340c50d0 2023-08-27T11:26:53.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.689+0000 7f4e2affd700 1 -- 172.21.15.43:0/1541690649 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v92) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4e341ee090 con 0x7f4e340c50d0 2023-08-27T11:26:53.691 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:53.691 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:26:53.691 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:53.692 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:26:53.692 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:26:53.692 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:26:53.692 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:26:53.692 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:26:53.693 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:26:53.693 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:26:53.693 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:26:53.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 msgr2=0x7f4e1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 0x7f4e1806c5a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000beb0 tx=0x7f4e3001c040 comp rx=0 tx=0).stop 2023-08-27T11:26:53.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 msgr2=0x7f4e3414bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c4e0 tx=0x7f4e2400c7f0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 shutdown_connections 2023-08-27T11:26:53.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e1806a0e0 0x7f4e1806c5a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e3414e960 0x7f4e3414c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e340a79c0 0x7f4e341ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 --2- 172.21.15.43:0/1541690649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e340c50d0 0x7f4e3414bf60 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.691+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 >> 172.21.15.43:0/1541690649 conn(0x7f4e3406aa50 msgr2=0x7f4e34154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:53.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.692+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 shutdown_connections 2023-08-27T11:26:53.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.692+0000 7f4e3c5ff700 1 -- 172.21.15.43:0/1541690649 wait complete. 2023-08-27T11:26:53.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:26:53.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:26:53.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.915+0000 7f5afc9ff700 1 Processor -- start 2023-08-27T11:26:53.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.915+0000 7f5afc9ff700 1 -- start start 2023-08-27T11:26:53.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5afc9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5af8151a40 0x7f5af80c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5afc9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5afc9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af8154730 con 0x7f5af80c4c40 2023-08-27T11:26:53.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5afc9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af8154520 con 0x7f5af8151a40 2023-08-27T11:26:53.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5afc9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8154a10 con 0x7f5af80c81c0 2023-08-27T11:26:53.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5af6d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5af80c4c40 0x7f5af806b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:59172/0 (socket says 172.21.15.43:59172) 2023-08-27T11:26:53.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.917+0000 7f5af659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5af8151a40 0x7f5af80c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af6d9d700 1 -- 172.21.15.43:0/2029267636 learned_addr learned my addr 172.21.15.43:0/2029267636 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:53.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af5d9b700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48022/0 (socket says 172.21.15.43:48022) 2023-08-27T11:26:53.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af559a700 1 -- 172.21.15.43:0/2029267636 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920164731 0 0) 0x7f5af8154730 con 0x7f5af80c4c40 2023-08-27T11:26:53.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af559a700 1 -- 172.21.15.43:0/2029267636 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae00035b0 con 0x7f5af80c4c40 2023-08-27T11:26:53.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af659c700 1 -- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 msgr2=0x7f5af80c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:53.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af659c700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af659c700 1 -- 172.21.15.43:0/2029267636 >> v1:172.21.15.57:6789/0 conn(0x7f5af80c4c40 legacy=0x7f5af806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af659c700 1 -- 172.21.15.43:0/2029267636 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8154cf0 con 0x7f5af8151a40 2023-08-27T11:26:53.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af5d9b700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:53.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.918+0000 7f5af659c700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af80c7c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009840 tx=0x7f5ae8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595d3419869b7e22 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5af559a700 1 -- 172.21.15.43:0/2029267636 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011830 con 0x7f5af8151a40 2023-08-27T11:26:53.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5af559a700 1 -- 172.21.15.43:0/2029267636 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8011990 con 0x7f5af8151a40 2023-08-27T11:26:53.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5af559a700 1 -- 172.21.15.43:0/2029267636 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011d20 con 0x7f5af8151a40 2023-08-27T11:26:53.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 -- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 msgr2=0x7f5af80c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af80c7c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009840 tx=0x7f5ae8009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:53.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 -- 172.21.15.43:0/2029267636 shutdown_connections 2023-08-27T11:26:53.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af80c7c80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/2029267636 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c81c0 0x7f5af80c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 -- 172.21.15.43:0/2029267636 >> 172.21.15.43:0/2029267636 conn(0x7f5af80ab890 msgr2=0x7f5af80abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:53.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 -- 172.21.15.43:0/2029267636 shutdown_connections 2023-08-27T11:26:53.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.919+0000 7f5afc9ff700 1 -- 172.21.15.43:0/2029267636 wait complete. 2023-08-27T11:26:53.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.921+0000 7f5afc9ff700 1 Processor -- start 2023-08-27T11:26:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.921+0000 7f5afc9ff700 1 -- start start 2023-08-27T11:26:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c4c40 0x7f5af80c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af81e9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81569e0 con 0x7f5af80c81c0 2023-08-27T11:26:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81ec910 con 0x7f5af8151a40 2023-08-27T11:26:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5afc9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81565c0 con 0x7f5af80c4c40 2023-08-27T11:26:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.922+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35656/0 (socket says 172.21.15.43:35656) 2023-08-27T11:26:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 -- 172.21.15.43:0/1443694704 learned_addr learned my addr 172.21.15.43:0/1443694704 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af659c700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c4c40 0x7f5af80c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af6d9d700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af81e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 -- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c4c40 msgr2=0x7f5af80c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c4c40 0x7f5af80c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 -- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 msgr2=0x7f5af81e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:53.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af81e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:53.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 -- 172.21.15.43:0/1443694704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0094a0 con 0x7f5af80c81c0 2023-08-27T11:26:53.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5af5d9b700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00ebe0 tx=0x7f5aec00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00c850 con 0x7f5af80c81c0 2023-08-27T11:26:53.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00c9b0 con 0x7f5af80c81c0 2023-08-27T11:26:53.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00cd40 con 0x7f5af80c81c0 2023-08-27T11:26:53.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.923+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae80094a0 con 0x7f5af80c81c0 2023-08-27T11:26:53.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.924+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af81ecbb0 con 0x7f5af80c81c0 2023-08-27T11:26:53.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.925+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af81ec770 con 0x7f5af80c81c0 2023-08-27T11:26:53.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.926+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5aec013470 con 0x7f5af80c81c0 2023-08-27T11:26:53.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.926+0000 7f5ae6ffd700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 0x7f5ad806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:53.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.927+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5aec0882b0 con 0x7f5af80c81c0 2023-08-27T11:26:53.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.927+0000 7f5af659c700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 0x7f5ad806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:53.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.927+0000 7f5af659c700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 0x7f5ad806c5a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8000c00 tx=0x7f5ae801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:53.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:53.931+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5af81ec770 con 0x7f5af80c81c0 2023-08-27T11:26:54.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.141+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5af81ec770 con 0x7f5af80c81c0 2023-08-27T11:26:54.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.333+0000 7f5ae6ffd700 1 -- 172.21.15.43:0/1443694704 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v93) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5af81ec770 con 0x7f5af80c81c0 2023-08-27T11:26:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.338+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 msgr2=0x7f5ad806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.338+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 0x7f5ad806c5a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8000c00 tx=0x7f5ae801c040 comp rx=0 tx=0).stop 2023-08-27T11:26:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.338+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 msgr2=0x7f5af8155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.338+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00ebe0 tx=0x7f5aec00eef0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 shutdown_connections 2023-08-27T11:26:54.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5ad806a0e0 0x7f5ad806c5a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af8151a40 0x7f5af81e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af80c4c40 0x7f5af80c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 --2- 172.21.15.43:0/1443694704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5af80c81c0 0x7f5af8155900 secure :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00ebe0 tx=0x7f5aec00eef0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 >> 172.21.15.43:0/1443694704 conn(0x7f5af80ab890 msgr2=0x7f5af81536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:54.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.339+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 shutdown_connections 2023-08-27T11:26:54.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.340+0000 7f5afc9ff700 1 -- 172.21.15.43:0/1443694704 wait complete. 2023-08-27T11:26:54.343 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:26:54.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:26:54.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.569+0000 7f37583ff700 1 Processor -- start 2023-08-27T11:26:54.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.569+0000 7f37583ff700 1 -- start start 2023-08-27T11:26:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.570+0000 7f37583ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3750151d20 0x7f375006a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.570+0000 7f37583ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37500ac7e0 con 0x7f37500c9720 2023-08-27T11:26:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.570+0000 7f37583ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3750155220 con 0x7f37500c92e0 2023-08-27T11:26:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.570+0000 7f37583ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c86a0 con 0x7f3750151d20 2023-08-27T11:26:54.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f375699c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f37500c9720 0x7f375015ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57288/0 (socket says 172.21.15.43:57288) 2023-08-27T11:26:54.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f375699c700 1 -- 172.21.15.43:0/527936871 learned_addr learned my addr 172.21.15.43:0/527936871 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f375619b700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3750151d20 0x7f375006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775201917 0 0) 0x7f37500ac7e0 con 0x7f37500c9720 2023-08-27T11:26:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c0035b0 con 0x7f37500c9720 2023-08-27T11:26:54.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324001672 0 0) 0x7f3750155220 con 0x7f37500c92e0 2023-08-27T11:26:54.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37500ac7e0 con 0x7f37500c92e0 2023-08-27T11:26:54.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654958655 0 0) 0x7f373c0035b0 con 0x7f37500c9720 2023-08-27T11:26:54.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3750151d20 msgr2=0x7f375006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:54.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3750151d20 0x7f375006a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 >> v1:172.21.15.57:6789/0 conn(0x7f37500c92e0 legacy=0x7f37500c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500c8ae0 con 0x7f37500c9720 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f37480019f0 con 0x7f37500c9720 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 >> v1:172.21.15.43:6789/0 conn(0x7f37500c9720 legacy=0x7f375015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f373c003bc0 0x7f373c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373c004850 0x7f373c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c005210 0x7f373c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c86a0 con 0x7f373c005210 2023-08-27T11:26:54.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c00bf80 con 0x7f373c004850 2023-08-27T11:26:54.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c00c140 con 0x7f373c003bc0 2023-08-27T11:26:54.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.571+0000 7f375619b700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3750151d20 0x7f375006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:54.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375699c700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c005210 0x7f373c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373c004850 0x7f373c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375619b700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f373c003bc0 0x7f373c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 -- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f373c003bc0 msgr2=0x7f373c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:54.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f373c003bc0 0x7f373c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 -- 172.21.15.43:0/527936871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c005210 msgr2=0x7f373c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:54.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c005210 0x7f373c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375599a700 1 -- 172.21.15.43:0/527936871 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0035b0 con 0x7f373c004850 2023-08-27T11:26:54.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.572+0000 7f375699c700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c005210 0x7f373c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:26:54.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f375599a700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373c004850 0x7f373c004cd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3740001940 tx=0x7f373c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c48e6857b20e97 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:54.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740001430 con 0x7f373c004850 2023-08-27T11:26:54.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740001d70 con 0x7f373c004850 2023-08-27T11:26:54.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f3755199700 1 -- 172.21.15.43:0/527936871 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740005510 con 0x7f373c004850 2023-08-27T11:26:54.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f37583ff700 1 -- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373c004850 msgr2=0x7f373c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f37583ff700 1 --2- 172.21.15.43:0/527936871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373c004850 0x7f373c004cd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3740001940 tx=0x7f373c005880 comp rx=0 tx=0).stop 2023-08-27T11:26:54.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f375699c700 1 -- 172.21.15.43:0/527936871 reap_dead start 2023-08-27T11:26:54.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f37583ff700 1 -- 172.21.15.43:0/527936871 shutdown_connections 2023-08-27T11:26:54.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.573+0000 7f37583ff700 1 -- 172.21.15.43:0/527936871 >> 172.21.15.43:0/527936871 conn(0x7f37500ab880 msgr2=0x7f37500abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:54.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.574+0000 7f37583ff700 1 -- 172.21.15.43:0/527936871 shutdown_connections 2023-08-27T11:26:54.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.574+0000 7f37583ff700 1 -- 172.21.15.43:0/527936871 wait complete. 2023-08-27T11:26:54.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.575+0000 7f37583ff700 1 Processor -- start 2023-08-27T11:26:54.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.575+0000 7f37583ff700 1 -- start start 2023-08-27T11:26:54.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 0x7f37501ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37501ed640 0x7f37500bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375014a510 con 0x7f373c004850 2023-08-27T11:26:54.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500bfd20 con 0x7f37501ed640 2023-08-27T11:26:54.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.576+0000 7f37583ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500c0000 con 0x7f375014a090 2023-08-27T11:26:54.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35672/0 (socket says 172.21.15.43:35672) 2023-08-27T11:26:54.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 -- 172.21.15.43:0/2171590249 learned_addr learned my addr 172.21.15.43:0/2171590249 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:54.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375599a700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 0x7f37501ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375699c700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37501ed640 0x7f37500bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 -- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 msgr2=0x7f37501ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 0x7f37501ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 -- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37501ed640 msgr2=0x7f37500bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:54.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37501ed640 0x7f37500bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:54.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 -- 172.21.15.43:0/2171590249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375014b0b0 con 0x7f373c004850 2023-08-27T11:26:54.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375599a700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 0x7f37501ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:54.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.577+0000 7f375619b700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f374c011c00 tx=0x7f374c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:54.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.578+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00fa60 con 0x7f373c004850 2023-08-27T11:26:54.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.578+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c00fbc0 con 0x7f373c004850 2023-08-27T11:26:54.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.578+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c014440 con 0x7f373c004850 2023-08-27T11:26:54.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.578+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375014b390 con 0x7f373c004850 2023-08-27T11:26:54.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.578+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375014c0a0 con 0x7f373c004850 2023-08-27T11:26:54.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.579+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375014b8b0 con 0x7f373c004850 2023-08-27T11:26:54.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.580+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f374c0145a0 con 0x7f373c004850 2023-08-27T11:26:54.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.581+0000 7f3746ffd700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 0x7f373406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:54.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.581+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f374c088b90 con 0x7f373c004850 2023-08-27T11:26:54.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.581+0000 7f375599a700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 0x7f373406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:54.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.582+0000 7f375599a700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 0x7f373406c5d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f375006bd70 tx=0x7f374000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:54.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.586+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f375014b8b0 con 0x7f373c004850 2023-08-27T11:26:54.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:54.795+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f375014b8b0 con 0x7f373c004850 2023-08-27T11:26:55.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.337+0000 7f3746ffd700 1 -- 172.21.15.43:0/2171590249 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v94) v1 ==== 170+0+0 (secure 0 0 0) 0x7f375014b8b0 con 0x7f373c004850 2023-08-27T11:26:55.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.345+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 msgr2=0x7f373406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.345+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 0x7f373406c5d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f375006bd70 tx=0x7f374000a000 comp rx=0 tx=0).stop 2023-08-27T11:26:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.345+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 msgr2=0x7f3750149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.345+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f374c011c00 tx=0x7f374c009ec0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.346+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 shutdown_connections 2023-08-27T11:26:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.346+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f373406a110 0x7f373406c5d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.346+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37501ed640 0x7f37500bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.347+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f373c004850 0x7f3750149b50 secure :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f374c011c00 tx=0x7f374c009ec0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.347+0000 7f37583ff700 1 --2- 172.21.15.43:0/2171590249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f375014a090 0x7f37501ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.347+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 >> 172.21.15.43:0/2171590249 conn(0x7f37500ab880 msgr2=0x7f37500c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:55.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.348+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 shutdown_connections 2023-08-27T11:26:55.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.348+0000 7f37583ff700 1 -- 172.21.15.43:0/2171590249 wait complete. 2023-08-27T11:26:55.359 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:26:55.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:26:55.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.587+0000 7fe0019ff700 1 Processor -- start 2023-08-27T11:26:55.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.587+0000 7fe0019ff700 1 -- start start 2023-08-27T11:26:55.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fe0019ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc06cb60 0x7fdffc0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fe0019ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdffc06b680 0x7fdffc06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fe0019ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0c8330 con 0x7fdffc151b60 2023-08-27T11:26:55.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fe0019ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdffc0c5710 con 0x7fdffc06b680 2023-08-27T11:26:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fe0019ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc1543c0 con 0x7fdffc06cb60 2023-08-27T11:26:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fdffaffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdffc151b60 0x7fdffc0c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57296/0 (socket says 172.21.15.43:57296) 2023-08-27T11:26:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.588+0000 7fdffaffd700 1 -- 172.21.15.43:0/1474276145 learned_addr learned my addr 172.21.15.43:0/1474276145 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 --2- 172.21.15.43:0/1474276145 >> v2:172.21.15.43:3300/0 conn(0x7fdffc06b680 0x7fdffc06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffa7fc700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc06cb60 0x7fdffc0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdff9ffb700 1 -- 172.21.15.43:0/1474276145 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322965211 0 0) 0x7fdffc0c8330 con 0x7fdffc151b60 2023-08-27T11:26:55.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdff9ffb700 1 -- 172.21.15.43:0/1474276145 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe40035b0 con 0x7fdffc151b60 2023-08-27T11:26:55.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 -- 172.21.15.43:0/1474276145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc06cb60 msgr2=0x7fdffc0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:55.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc06cb60 0x7fdffc0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 -- 172.21.15.43:0/1474276145 >> v1:172.21.15.43:6789/0 conn(0x7fdffc151b60 legacy=0x7fdffc0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 -- 172.21.15.43:0/1474276145 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc154640 con 0x7fdffc06b680 2023-08-27T11:26:55.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.589+0000 7fdffb7fe700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc06bb10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009d90 tx=0x7fdff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12545d0077fa7819 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:55.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fdff9ffb700 1 -- 172.21.15.43:0/1474276145 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff400e070 con 0x7fdffc06b680 2023-08-27T11:26:55.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fdff9ffb700 1 -- 172.21.15.43:0/1474276145 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff400bb20 con 0x7fdffc06b680 2023-08-27T11:26:55.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fdff9ffb700 1 -- 172.21.15.43:0/1474276145 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff4012430 con 0x7fdffc06b680 2023-08-27T11:26:55.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 -- 172.21.15.43:0/1474276145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 msgr2=0x7fdffc06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc06bb10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdff4009d90 tx=0x7fdff400b330 comp rx=0 tx=0).stop 2023-08-27T11:26:55.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 -- 172.21.15.43:0/1474276145 shutdown_connections 2023-08-27T11:26:55.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc06bb10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 --2- 172.21.15.43:0/1474276145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc06cb60 0x7fdffc0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 -- 172.21.15.43:0/1474276145 >> 172.21.15.43:0/1474276145 conn(0x7fdffc0ab7e0 msgr2=0x7fdffc0abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:55.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 -- 172.21.15.43:0/1474276145 shutdown_connections 2023-08-27T11:26:55.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.590+0000 7fe0019ff700 1 -- 172.21.15.43:0/1474276145 wait complete. 2023-08-27T11:26:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.593+0000 7fe0019ff700 1 Processor -- start 2023-08-27T11:26:55.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.593+0000 7fe0019ff700 1 -- start start 2023-08-27T11:26:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc06cb60 0x7fdffc14d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc151b60 0x7fdffc147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0ae670 con 0x7fdffc06b680 2023-08-27T11:26:55.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c99b0 con 0x7fdffc06cb60 2023-08-27T11:26:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fe0019ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0ca130 con 0x7fdffc151b60 2023-08-27T11:26:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fdffaffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35694/0 (socket says 172.21.15.43:35694) 2023-08-27T11:26:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.594+0000 7fdffaffd700 1 -- 172.21.15.43:0/2749553371 learned_addr learned my addr 172.21.15.43:0/2749553371 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:55.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffa7fc700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc06cb60 0x7fdffc14d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffb7fe700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc151b60 0x7fdffc147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 -- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc151b60 msgr2=0x7fdffc147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc151b60 0x7fdffc147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 -- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc06cb60 msgr2=0x7fdffc14d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc06cb60 0x7fdffc14d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 -- 172.21.15.43:0/2749553371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff4009a70 con 0x7fdffc06b680 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdffaffd700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c700 tx=0x7fdfec00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec005d70 con 0x7fdffc06b680 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0070d0 con 0x7fdffc06b680 2023-08-27T11:26:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec007460 con 0x7fdffc06b680 2023-08-27T11:26:55.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.595+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc0ca410 con 0x7fdffc06b680 2023-08-27T11:26:55.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.596+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc14d600 con 0x7fdffc06b680 2023-08-27T11:26:55.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.596+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc04ee70 con 0x7fdffc06b680 2023-08-27T11:26:55.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.598+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdfec0075c0 con 0x7fdffc06b680 2023-08-27T11:26:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.599+0000 7fdfe3fff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 0x7fdfe806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.599+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdfec087b80 con 0x7fdffc06b680 2023-08-27T11:26:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.599+0000 7fdffa7fc700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 0x7fdfe806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.599+0000 7fdffa7fc700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 0x7fdfe806c5a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0c5050 tx=0x7fdff0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.603+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdfec053240 con 0x7fdffc06b680 2023-08-27T11:26:55.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:55.858+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdffc0c0ac0 con 0x7fdffc06b680 2023-08-27T11:26:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.367+0000 7fdfe3fff700 1 -- 172.21.15.43:0/2749553371 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdfec056860 con 0x7fdffc06b680 2023-08-27T11:26:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 msgr2=0x7fdfe806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 0x7fdfe806c5a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0c5050 tx=0x7fdff0008040 comp rx=0 tx=0).stop 2023-08-27T11:26:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 msgr2=0x7fdffc1ea060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdfec00c700 tx=0x7fdfec00cac0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 shutdown_connections 2023-08-27T11:26:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdfe806a0e0 0x7fdfe806c5a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdffc151b60 0x7fdffc147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdffc06b680 0x7fdffc1ea060 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 --2- 172.21.15.43:0/2749553371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdffc06cb60 0x7fdffc14d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 >> 172.21.15.43:0/2749553371 conn(0x7fdffc0ab7e0 msgr2=0x7fdffc06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.375+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 shutdown_connections 2023-08-27T11:26:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.376+0000 7fe0019ff700 1 -- 172.21.15.43:0/2749553371 wait complete. 2023-08-27T11:26:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 15 and data pool 16 2023-08-27T11:26:56.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:56.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.622+0000 7f183d3ff700 1 Processor -- start 2023-08-27T11:26:56.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.622+0000 7f183d3ff700 1 -- start start 2023-08-27T11:26:56.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.623+0000 7f183d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 0x7f18380c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:56.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.623+0000 7f183d3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838154d00 con 0x7f1838154740 2023-08-27T11:26:56.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.623+0000 7f183d3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1838154fe0 con 0x7f183814e960 2023-08-27T11:26:56.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.623+0000 7f183d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18380baf30 con 0x7f18380c50d0 2023-08-27T11:26:56.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18377fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1838154740 0x7f18380c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57298/0 (socket says 172.21.15.43:57298) 2023-08-27T11:26:56.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18377fe700 1 -- 172.21.15.43:0/1250150304 learned_addr learned my addr 172.21.15.43:0/1250150304 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:56.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18367fc700 1 --2- 172.21.15.43:0/1250150304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 0x7f18380c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:56.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984288682 0 0) 0x7f1838154d00 con 0x7f1838154740 2023-08-27T11:26:56.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18200035b0 con 0x7f1838154740 2023-08-27T11:26:56.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304884208 0 0) 0x7f1838154fe0 con 0x7f183814e960 2023-08-27T11:26:56.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1838154d00 con 0x7f183814e960 2023-08-27T11:26:56.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18367fc700 1 -- 172.21.15.43:0/1250150304 >> v1:172.21.15.57:6789/0 conn(0x7f183814e960 legacy=0x7f18380a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18367fc700 1 -- 172.21.15.43:0/1250150304 >> v1:172.21.15.43:6789/0 conn(0x7f1838154740 legacy=0x7f18380c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.624+0000 7f18367fc700 1 -- 172.21.15.43:0/1250150304 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18381552c0 con 0x7f18380c50d0 2023-08-27T11:26:56.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f18367fc700 1 --2- 172.21.15.43:0/1250150304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 0x7f18380c3cc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4d2e0240de08bd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c011830 con 0x7f18380c50d0 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c011990 con 0x7f18380c50d0 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f1835ffb700 1 -- 172.21.15.43:0/1250150304 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c011d20 con 0x7f18380c50d0 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f183d3ff700 1 -- 172.21.15.43:0/1250150304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 msgr2=0x7f18380c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.625+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1250150304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 0x7f18380c3cc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c009b80 comp rx=0 tx=0).stop 2023-08-27T11:26:56.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.626+0000 7f183d3ff700 1 -- 172.21.15.43:0/1250150304 shutdown_connections 2023-08-27T11:26:56.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.626+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1250150304 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18380c50d0 0x7f18380c3cc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.626+0000 7f183d3ff700 1 -- 172.21.15.43:0/1250150304 >> 172.21.15.43:0/1250150304 conn(0x7f183806aa50 msgr2=0x7f18380c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:56.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.626+0000 7f183d3ff700 1 -- 172.21.15.43:0/1250150304 shutdown_connections 2023-08-27T11:26:56.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.626+0000 7f183d3ff700 1 -- 172.21.15.43:0/1250150304 wait complete. 2023-08-27T11:26:56.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.627+0000 7f183d3ff700 1 Processor -- start 2023-08-27T11:26:56.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.627+0000 7f183d3ff700 1 -- start start 2023-08-27T11:26:56.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:56.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183814e960 0x7f18380a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:56.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1838154740 0x7f183814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:56.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380a9d10 con 0x7f18380c50d0 2023-08-27T11:26:56.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381504e0 con 0x7f183814e960 2023-08-27T11:26:56.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.628+0000 7f183d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838151fd0 con 0x7f1838154740 2023-08-27T11:26:56.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:56.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35696/0 (socket says 172.21.15.43:35696) 2023-08-27T11:26:56.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 -- 172.21.15.43:0/1530096719 learned_addr learned my addr 172.21.15.43:0/1530096719 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:56.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f18367fc700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183814e960 0x7f18380a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f18377fe700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1838154740 0x7f183814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 -- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1838154740 msgr2=0x7f183814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1838154740 0x7f183814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 -- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183814e960 msgr2=0x7f18380a6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183814e960 0x7f18380a6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 -- 172.21.15.43:0/1530096719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0094a0 con 0x7f18380c50d0 2023-08-27T11:26:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.629+0000 7f1836ffd700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f182800c520 tx=0x7f182800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.630+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280052d0 con 0x7f18380c50d0 2023-08-27T11:26:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.630+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1828005430 con 0x7f18380c50d0 2023-08-27T11:26:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.630+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18280038c0 con 0x7f18380c50d0 2023-08-27T11:26:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.630+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183814fbf0 con 0x7f18380c50d0 2023-08-27T11:26:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.630+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838150170 con 0x7f18380c50d0 2023-08-27T11:26:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.631+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183804ee70 con 0x7f18380c50d0 2023-08-27T11:26:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.632+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1828003a20 con 0x7f18380c50d0 2023-08-27T11:26:56.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.633+0000 7f181f7fe700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 0x7f182406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:56.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.633+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1828087980 con 0x7f18380c50d0 2023-08-27T11:26:56.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.633+0000 7f18367fc700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 0x7f182406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:56.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.634+0000 7f18367fc700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 0x7f182406c5a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:56.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.638+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1828053060 con 0x7f18380c50d0 2023-08-27T11:26:56.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.849+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18381541e0 con 0x7f18380c50d0 2023-08-27T11:26:56.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.851+0000 7f181f7fe700 1 -- 172.21.15.43:0/1530096719 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18177 (secure 0 0 0) 0x7f1828056680 con 0x7f18380c50d0 2023-08-27T11:26:56.853 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:56.853 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:55.859692+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:56.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 msgr2=0x7f182406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 0x7f182406c5a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f182c009870 tx=0x7f182c01c040 comp rx=0 tx=0).stop 2023-08-27T11:26:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 msgr2=0x7f18381519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f182800c520 tx=0x7f182800c830 comp rx=0 tx=0).stop 2023-08-27T11:26:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 shutdown_connections 2023-08-27T11:26:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f182406a0e0 0x7f182406c5a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1838154740 0x7f183814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18380c50d0 0x7f18381519a0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 --2- 172.21.15.43:0/1530096719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f183814e960 0x7f18380a6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:56.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.853+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 >> 172.21.15.43:0/1530096719 conn(0x7f183806aa50 msgr2=0x7f18380c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:56.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.854+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 shutdown_connections 2023-08-27T11:26:56.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:56.854+0000 7f183d3ff700 1 -- 172.21.15.43:0/1530096719 wait complete. 2023-08-27T11:26:56.874 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:26:57.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.074+0000 7f710ebff700 1 Processor -- start 2023-08-27T11:26:57.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.074+0000 7f710ebff700 1 -- start start 2023-08-27T11:26:57.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710ebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71080c4630 0x7f71080c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710ebff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f710806ad70 0x7f710806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710806c4e0 con 0x7f7108151a90 2023-08-27T11:26:57.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710ebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7108155370 con 0x7f71080c4630 2023-08-27T11:26:57.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710ebff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080c82c0 con 0x7f710806ad70 2023-08-27T11:26:57.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710c99b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7108151a90 0x7f71080c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57308/0 (socket says 172.21.15.43:57308) 2023-08-27T11:26:57.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f7107fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f71080c4630 0x7f71080c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710c99b700 1 -- 172.21.15.43:0/3244336936 learned_addr learned my addr 172.21.15.43:0/3244336936 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:57.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.075+0000 7f710d19c700 1 --2- 172.21.15.43:0/3244336936 >> v2:172.21.15.57:3300/0 conn(0x7f710806ad70 0x7f710806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f71077fe700 1 -- 172.21.15.43:0/3244336936 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307988592 0 0) 0x7f710806c4e0 con 0x7f7108151a90 2023-08-27T11:26:57.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f71077fe700 1 -- 172.21.15.43:0/3244336936 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70f80035b0 con 0x7f7108151a90 2023-08-27T11:26:57.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f7107fff700 1 -- 172.21.15.43:0/3244336936 >> v2:172.21.15.57:3300/0 conn(0x7f710806ad70 msgr2=0x7f710806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:57.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f7107fff700 1 --2- 172.21.15.43:0/3244336936 >> v2:172.21.15.57:3300/0 conn(0x7f710806ad70 0x7f710806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f7107fff700 1 -- 172.21.15.43:0/3244336936 >> v1:172.21.15.43:6789/0 conn(0x7f7108151a90 legacy=0x7f71080c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f7107fff700 1 -- 172.21.15.43:0/3244336936 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108151e70 con 0x7f71080c4630 2023-08-27T11:26:57.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f7107fff700 1 --2- 172.21.15.43:0/3244336936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71080c4630 0x7f71080c4a90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f71080c4270 tx=0x7f70f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf327fa81c022d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f71077fe700 1 -- 172.21.15.43:0/3244336936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011830 con 0x7f71080c4630 2023-08-27T11:26:57.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f71077fe700 1 -- 172.21.15.43:0/3244336936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f4011990 con 0x7f71080c4630 2023-08-27T11:26:57.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.076+0000 7f71077fe700 1 -- 172.21.15.43:0/3244336936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4011d20 con 0x7f71080c4630 2023-08-27T11:26:57.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 -- 172.21.15.43:0/3244336936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71080c4630 msgr2=0x7f71080c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 --2- 172.21.15.43:0/3244336936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71080c4630 0x7f71080c4a90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f71080c4270 tx=0x7f70f4009b20 comp rx=0 tx=0).stop 2023-08-27T11:26:57.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 -- 172.21.15.43:0/3244336936 shutdown_connections 2023-08-27T11:26:57.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 --2- 172.21.15.43:0/3244336936 >> v2:172.21.15.57:3300/0 conn(0x7f710806ad70 0x7f710806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 --2- 172.21.15.43:0/3244336936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f71080c4630 0x7f71080c4a90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 -- 172.21.15.43:0/3244336936 >> 172.21.15.43:0/3244336936 conn(0x7f71080ab820 msgr2=0x7f71080abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 -- 172.21.15.43:0/3244336936 shutdown_connections 2023-08-27T11:26:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.077+0000 7f710ebff700 1 -- 172.21.15.43:0/3244336936 wait complete. 2023-08-27T11:26:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.079+0000 7f710ebff700 1 Processor -- start 2023-08-27T11:26:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.079+0000 7f710ebff700 1 -- start start 2023-08-27T11:26:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71080c4630 0x7f710814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7108151a90 0x7f71081e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71080c3cb0 con 0x7f710806ad70 2023-08-27T11:26:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108155c30 con 0x7f71080c4630 2023-08-27T11:26:57.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7108155950 con 0x7f7108151a90 2023-08-27T11:26:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35714/0 (socket says 172.21.15.43:35714) 2023-08-27T11:26:57.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710c99b700 1 -- 172.21.15.43:0/1064964438 learned_addr learned my addr 172.21.15.43:0/1064964438 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f7107fff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71080c4630 0x7f710814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.080+0000 7f710d19c700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7108151a90 0x7f71081e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 -- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7108151a90 msgr2=0x7f71081e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7108151a90 0x7f71081e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 -- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71080c4630 msgr2=0x7f710814a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71080c4630 0x7f710814a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 -- 172.21.15.43:0/1064964438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40094a0 con 0x7f710806ad70 2023-08-27T11:26:57.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710c99b700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c4d0 tx=0x7f70fc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc00cea0 con 0x7f710806ad70 2023-08-27T11:26:57.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc005d70 con 0x7f710806ad70 2023-08-27T11:26:57.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0072f0 con 0x7f710806ad70 2023-08-27T11:26:57.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71081562a0 con 0x7f710806ad70 2023-08-27T11:26:57.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.081+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710814d5f0 con 0x7f710806ad70 2023-08-27T11:26:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.082+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71080c4ea0 con 0x7f710806ad70 2023-08-27T11:26:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.083+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70fc007450 con 0x7f710806ad70 2023-08-27T11:26:57.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.084+0000 7f71057fa700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 0x7f70ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.084+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70fc0878f0 con 0x7f710806ad70 2023-08-27T11:26:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.085+0000 7f7107fff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 0x7f70ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.085+0000 7f7107fff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 0x7f70ec06c5a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f70f40090b0 tx=0x7f70f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.088+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f70fc052fd0 con 0x7f710806ad70 2023-08-27T11:26:57.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.300+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f710804ee70 con 0x7f710806ad70 2023-08-27T11:26:57.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.302+0000 7f71057fa700 1 -- 172.21.15.43:0/1064964438 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18177 (secure 0 0 0) 0x7f70fc017090 con 0x7f710806ad70 2023-08-27T11:26:57.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:26:57.304 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:55.859692+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:26:57.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 msgr2=0x7f70ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 0x7f70ec06c5a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f70f40090b0 tx=0x7f70f4008030 comp rx=0 tx=0).stop 2023-08-27T11:26:57.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 msgr2=0x7f710814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c4d0 tx=0x7f70fc00c7e0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 shutdown_connections 2023-08-27T11:26:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f70ec06a0e0 0x7f70ec06c5a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7108151a90 0x7f71081e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f710806ad70 0x7f710814d0b0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 --2- 172.21.15.43:0/1064964438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71080c4630 0x7f710814a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 >> 172.21.15.43:0/1064964438 conn(0x7f71080ab820 msgr2=0x7f710806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 shutdown_connections 2023-08-27T11:26:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.304+0000 7f710ebff700 1 -- 172.21.15.43:0/1064964438 wait complete. 2023-08-27T11:26:57.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:26:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.532+0000 7f4c1e5ff700 1 Processor -- start 2023-08-27T11:26:57.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.532+0000 7f4c1e5ff700 1 -- start start 2023-08-27T11:26:57.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1e5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c18151d20 0x7f4c180c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1e5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c180c7c00 0x7f4c180ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1e5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c18154660 con 0x7f4c180abcc0 2023-08-27T11:26:57.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1e5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c180c5750 con 0x7f4c18151d20 2023-08-27T11:26:57.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1e5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18154940 con 0x7f4c180c7c00 2023-08-27T11:26:57.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1cb9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4c180abcc0 0x7f4c1806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57318/0 (socket says 172.21.15.43:57318) 2023-08-27T11:26:57.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c1cb9c700 1 -- 172.21.15.43:0/674027544 learned_addr learned my addr 172.21.15.43:0/674027544 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:57.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c17fff700 1 --2- 172.21.15.43:0/674027544 >> v2:172.21.15.57:3300/0 conn(0x7f4c18151d20 0x7f4c180c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.533+0000 7f4c177fe700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c180c7c00 0x7f4c180ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c16ffd700 1 -- 172.21.15.43:0/674027544 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256845638 0 0) 0x7f4c18154660 con 0x7f4c180abcc0 2023-08-27T11:26:57.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c16ffd700 1 -- 172.21.15.43:0/674027544 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c000035b0 con 0x7f4c180abcc0 2023-08-27T11:26:57.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c17fff700 1 -- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c180c7c00 msgr2=0x7f4c180ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:57.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c17fff700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c180c7c00 0x7f4c180ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c17fff700 1 -- 172.21.15.43:0/674027544 >> v1:172.21.15.43:6789/0 conn(0x7f4c180abcc0 legacy=0x7f4c1806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c17fff700 1 -- 172.21.15.43:0/674027544 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18154c20 con 0x7f4c18151d20 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c17fff700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c18151d20 0x7f4c180c8110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009840 tx=0x7f4c08009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98071657928033d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.534+0000 7f4c16ffd700 1 -- 172.21.15.43:0/674027544 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011830 con 0x7f4c18151d20 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c16ffd700 1 -- 172.21.15.43:0/674027544 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08011990 con 0x7f4c18151d20 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c16ffd700 1 -- 172.21.15.43:0/674027544 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08011d20 con 0x7f4c18151d20 2023-08-27T11:26:57.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c18151d20 msgr2=0x7f4c180c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c18151d20 0x7f4c180c8110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009840 tx=0x7f4c08009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:57.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/674027544 shutdown_connections 2023-08-27T11:26:57.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c18151d20 0x7f4c180c8110 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/674027544 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c180c7c00 0x7f4c180ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/674027544 >> 172.21.15.43:0/674027544 conn(0x7f4c180c9d00 msgr2=0x7f4c180ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:57.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/674027544 shutdown_connections 2023-08-27T11:26:57.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.535+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/674027544 wait complete. 2023-08-27T11:26:57.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.537+0000 7f4c1e5ff700 1 Processor -- start 2023-08-27T11:26:57.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.537+0000 7f4c1e5ff700 1 -- start start 2023-08-27T11:26:57.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c180abcc0 0x7f4c181e9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c18151d20 0x7f4c180aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18158a20 con 0x7f4c180c7c00 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181e9230 con 0x7f4c180abcc0 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c1e5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181544f0 con 0x7f4c18151d20 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35728/0 (socket says 172.21.15.43:35728) 2023-08-27T11:26:57.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 -- 172.21.15.43:0/491595445 learned_addr learned my addr 172.21.15.43:0/491595445 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:57.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c17fff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c180abcc0 0x7f4c181e9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 -- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c18151d20 msgr2=0x7f4c180aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c18151d20 0x7f4c180aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 -- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c180abcc0 msgr2=0x7f4c181e9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:57.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c180abcc0 0x7f4c181e9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:57.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.538+0000 7f4c177fe700 1 -- 172.21.15.43:0/491595445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c080094a0 con 0x7f4c180c7c00 2023-08-27T11:26:57.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c177fe700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e9b0 tx=0x7f4c0c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c009710 con 0x7f4c180c7c00 2023-08-27T11:26:57.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00c850 con 0x7f4c180c7c00 2023-08-27T11:26:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00cbc0 con 0x7f4c180c7c00 2023-08-27T11:26:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c180c3780 con 0x7f4c180c7c00 2023-08-27T11:26:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.539+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c181e94f0 con 0x7f4c180c7c00 2023-08-27T11:26:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.540+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1804ee70 con 0x7f4c180c7c00 2023-08-27T11:26:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.541+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c0c00cd20 con 0x7f4c180c7c00 2023-08-27T11:26:57.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.542+0000 7f4c14ff9700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 0x7f4c0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:57.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.542+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c0c0886f0 con 0x7f4c180c7c00 2023-08-27T11:26:57.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.542+0000 7f4c17fff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 0x7f4c0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:57.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.543+0000 7f4c17fff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 0x7f4c0406c5a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c09c0 tx=0x7f4c08008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:57.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.546+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c0c057860 con 0x7f4c180c7c00 2023-08-27T11:26:57.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:57.804+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c18154ed0 con 0x7f4c180c7c00 2023-08-27T11:26:58.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.408+0000 7f4c14ff9700 1 -- 172.21.15.43:0/491595445 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c0c0573f0 con 0x7f4c180c7c00 2023-08-27T11:26:58.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 msgr2=0x7f4c0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 0x7f4c0406c5a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c09c0 tx=0x7f4c08008030 comp rx=0 tx=0).stop 2023-08-27T11:26:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 msgr2=0x7f4c18153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00e9b0 tx=0x7f4c0c00ed70 comp rx=0 tx=0).stop 2023-08-27T11:26:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 shutdown_connections 2023-08-27T11:26:58.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c0406a0e0 0x7f4c0406c5a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4c18151d20 0x7f4c180aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c180abcc0 0x7f4c181e9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 --2- 172.21.15.43:0/491595445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4c180c7c00 0x7f4c18153fb0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 >> 172.21.15.43:0/491595445 conn(0x7f4c180c9d00 msgr2=0x7f4c1814d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:58.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 shutdown_connections 2023-08-27T11:26:58.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.411+0000 7f4c1e5ff700 1 -- 172.21.15.43:0/491595445 wait complete. 2023-08-27T11:26:58.434 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:26:58.434 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:26:58.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.641+0000 7f188ebff700 1 Processor -- start 2023-08-27T11:26:58.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.641+0000 7f188ebff700 1 -- start start 2023-08-27T11:26:58.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.642+0000 7f188ebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1888151d20 0x7f18880c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.642+0000 7f188ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18880c7c00 0x7f18880ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.642+0000 7f188ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1888154660 con 0x7f18880abcc0 2023-08-27T11:26:58.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.642+0000 7f188ebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880c5750 con 0x7f1888151d20 2023-08-27T11:26:58.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.642+0000 7f188ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1888154940 con 0x7f18880c7c00 2023-08-27T11:26:58.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1888151d20 0x7f18880c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188d19c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f18880abcc0 0x7f188806a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57332/0 (socket says 172.21.15.43:57332) 2023-08-27T11:26:58.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188d19c700 1 -- 172.21.15.43:0/1645960286 learned_addr learned my addr 172.21.15.43:0/1645960286 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:26:58.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f1887fff700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18880c7c00 0x7f18880ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f18877fe700 1 -- 172.21.15.43:0/1645960286 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342066541 0 0) 0x7f1888154660 con 0x7f18880abcc0 2023-08-27T11:26:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 -- 172.21.15.43:0/1645960286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18880c7c00 msgr2=0x7f18880ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:26:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18880c7c00 0x7f18880ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 -- 172.21.15.43:0/1645960286 >> v1:172.21.15.43:6789/0 conn(0x7f18880abcc0 legacy=0x7f188806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 -- 172.21.15.43:0/1645960286 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888154c20 con 0x7f1888151d20 2023-08-27T11:26:58.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.643+0000 7f188c99b700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888151d20 0x7f18880c8110 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f187c009840 tx=0x7f187c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53eec050ef6e671b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:58.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f18877fe700 1 -- 172.21.15.43:0/1645960286 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c011830 con 0x7f1888151d20 2023-08-27T11:26:58.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f18877fe700 1 -- 172.21.15.43:0/1645960286 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c011990 con 0x7f1888151d20 2023-08-27T11:26:58.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f18877fe700 1 -- 172.21.15.43:0/1645960286 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c011d20 con 0x7f1888151d20 2023-08-27T11:26:58.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 -- 172.21.15.43:0/1645960286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888151d20 msgr2=0x7f18880c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888151d20 0x7f18880c8110 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f187c009840 tx=0x7f187c009b50 comp rx=0 tx=0).stop 2023-08-27T11:26:58.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 -- 172.21.15.43:0/1645960286 shutdown_connections 2023-08-27T11:26:58.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1888151d20 0x7f18880c8110 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 --2- 172.21.15.43:0/1645960286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18880c7c00 0x7f18880ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 -- 172.21.15.43:0/1645960286 >> 172.21.15.43:0/1645960286 conn(0x7f18880c9d00 msgr2=0x7f18880ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:58.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 -- 172.21.15.43:0/1645960286 shutdown_connections 2023-08-27T11:26:58.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.644+0000 7f188ebff700 1 -- 172.21.15.43:0/1645960286 wait complete. 2023-08-27T11:26:58.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.646+0000 7f188ebff700 1 Processor -- start 2023-08-27T11:26:58.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.646+0000 7f188ebff700 1 -- start start 2023-08-27T11:26:58.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18880abcc0 0x7f188814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 0x7f1888147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18881ecdc0 con 0x7f18880c7c00 2023-08-27T11:26:58.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18881ed010 con 0x7f18880abcc0 2023-08-27T11:26:58.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f188ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18881ed2f0 con 0x7f1888151d20 2023-08-27T11:26:58.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.647+0000 7f1887fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35752/0 (socket says 172.21.15.43:35752) 2023-08-27T11:26:58.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 -- 172.21.15.43:0/3580297242 learned_addr learned my addr 172.21.15.43:0/3580297242 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:26:58.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f188c99b700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18880abcc0 0x7f188814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f188d19c700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 0x7f1888147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 -- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 msgr2=0x7f1888147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 0x7f1888147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 -- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18880abcc0 msgr2=0x7f188814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:58.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18880abcc0 0x7f188814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:58.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 -- 172.21.15.43:0/3580297242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187c0094a0 con 0x7f18880c7c00 2023-08-27T11:26:58.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f188d19c700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 0x7f1888147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:26:58.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f1887fff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f187400e9b0 tx=0x7f187400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:58.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874009710 con 0x7f18880c7c00 2023-08-27T11:26:58.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400c850 con 0x7f18880c7c00 2023-08-27T11:26:58.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.648+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400cbc0 con 0x7f18880c7c00 2023-08-27T11:26:58.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.649+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18881ed5d0 con 0x7f18880c7c00 2023-08-27T11:26:58.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.649+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188814e7c0 con 0x7f18880c7c00 2023-08-27T11:26:58.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.650+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18881edc20 con 0x7f18880c7c00 2023-08-27T11:26:58.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.651+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f187400cd20 con 0x7f18880c7c00 2023-08-27T11:26:58.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.652+0000 7f18857fa700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 0x7f186c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:26:58.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.652+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1874088540 con 0x7f18880c7c00 2023-08-27T11:26:58.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.652+0000 7f188c99b700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 0x7f186c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:26:58.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.653+0000 7f188c99b700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 0x7f186c06c5a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f187c0090b0 tx=0x7f187c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:26:58.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.656+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1874053cc0 con 0x7f18880c7c00 2023-08-27T11:26:58.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:58.914+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f188804ee70 con 0x7f18880c7c00 2023-08-27T11:26:59.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.911+0000 7f18857fa700 1 -- 172.21.15.43:0/3580297242 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18740572e0 con 0x7f18880c7c00 2023-08-27T11:26:59.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 msgr2=0x7f186c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:59.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 0x7f186c06c5a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f187c0090b0 tx=0x7f187c01c040 comp rx=0 tx=0).stop 2023-08-27T11:26:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 msgr2=0x7f18880aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:26:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f187400e9b0 tx=0x7f187400ecc0 comp rx=0 tx=0).stop 2023-08-27T11:26:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 shutdown_connections 2023-08-27T11:26:59.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f186c06a0e0 0x7f186c06c5a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1888151d20 0x7f1888147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18880abcc0 0x7f188814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 --2- 172.21.15.43:0/3580297242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18880c7c00 0x7f18880aa6b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:26:59.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 >> 172.21.15.43:0/3580297242 conn(0x7f18880c9d00 msgr2=0x7f18880c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:26:59.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 shutdown_connections 2023-08-27T11:26:59.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:26:59.915+0000 7f188ebff700 1 -- 172.21.15.43:0/3580297242 wait complete. 2023-08-27T11:26:59.939 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:26:59.940 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:00.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.143+0000 7fe2441ff700 1 Processor -- start 2023-08-27T11:27:00.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.143+0000 7fe2441ff700 1 -- start start 2023-08-27T11:27:00.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.144+0000 7fe2441ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe23c14e960 0x7fe23c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.144+0000 7fe2441ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c154d00 con 0x7fe23c0c50d0 2023-08-27T11:27:00.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.144+0000 7fe2441ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c154fe0 con 0x7fe23c0a79c0 2023-08-27T11:27:00.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.144+0000 7fe2441ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c0baf30 con 0x7fe23c14e960 2023-08-27T11:27:00.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe24279c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe23c0c50d0 0x7fe23c0c43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47440/0 (socket says 172.21.15.43:47440) 2023-08-27T11:27:00.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe24279c700 1 -- 172.21.15.43:0/1715595161 learned_addr learned my addr 172.21.15.43:0/1715595161 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:00.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe241f9b700 1 --2- 172.21.15.43:0/1715595161 >> v2:172.21.15.43:3300/0 conn(0x7fe23c14e960 0x7fe23c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe240f99700 1 -- 172.21.15.43:0/1715595161 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993447698 0 0) 0x7fe23c154d00 con 0x7fe23c0c50d0 2023-08-27T11:27:00.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe241f9b700 1 -- 172.21.15.43:0/1715595161 >> v1:172.21.15.57:6789/0 conn(0x7fe23c0a79c0 legacy=0x7fe23c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe241f9b700 1 -- 172.21.15.43:0/1715595161 >> v1:172.21.15.43:6789/0 conn(0x7fe23c0c50d0 legacy=0x7fe23c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe241f9b700 1 -- 172.21.15.43:0/1715595161 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c1552c0 con 0x7fe23c14e960 2023-08-27T11:27:00.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.145+0000 7fe241f9b700 1 --2- 172.21.15.43:0/1715595161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c0a7480 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe238009840 tx=0x7fe238009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4a62ec88220abf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe240f99700 1 -- 172.21.15.43:0/1715595161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238011830 con 0x7fe23c14e960 2023-08-27T11:27:00.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe240f99700 1 -- 172.21.15.43:0/1715595161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238011990 con 0x7fe23c14e960 2023-08-27T11:27:00.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe240f99700 1 -- 172.21.15.43:0/1715595161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238011d20 con 0x7fe23c14e960 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 -- 172.21.15.43:0/1715595161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 msgr2=0x7fe23c0a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 --2- 172.21.15.43:0/1715595161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c0a7480 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe238009840 tx=0x7fe238009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 -- 172.21.15.43:0/1715595161 shutdown_connections 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 --2- 172.21.15.43:0/1715595161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c0a7480 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 -- 172.21.15.43:0/1715595161 >> 172.21.15.43:0/1715595161 conn(0x7fe23c06aa50 msgr2=0x7fe23c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:00.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 -- 172.21.15.43:0/1715595161 shutdown_connections 2023-08-27T11:27:00.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.146+0000 7fe2441ff700 1 -- 172.21.15.43:0/1715595161 wait complete. 2023-08-27T11:27:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.148+0000 7fe2441ff700 1 Processor -- start 2023-08-27T11:27:00.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.148+0000 7fe2441ff700 1 -- start start 2023-08-27T11:27:00.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe23c0a79c0 0x7fe23c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 0x7fe23c0c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1ed7b0 con 0x7fe23c14e960 2023-08-27T11:27:00.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c1eda90 con 0x7fe23c0a79c0 2023-08-27T11:27:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe2441ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0a8970 con 0x7fe23c0c50d0 2023-08-27T11:27:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe24279c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe24279c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54052/0 (socket says 172.21.15.43:54052) 2023-08-27T11:27:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.149+0000 7fe24279c700 1 -- 172.21.15.43:0/2302073182 learned_addr learned my addr 172.21.15.43:0/2302073182 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:00.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe241f9b700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe23c0a79c0 0x7fe23c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24179a700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 0x7fe23c0c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 -- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 msgr2=0x7fe23c0c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 0x7fe23c0c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 -- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe23c0a79c0 msgr2=0x7fe23c14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe23c0a79c0 0x7fe23c14ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 -- 172.21.15.43:0/2302073182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380094a0 con 0x7fe23c14e960 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24179a700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 0x7fe23c0c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe24279c700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe23400cca0 tx=0x7fe23400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400ac20 con 0x7fe23c14e960 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400ad80 con 0x7fe23c14e960 2023-08-27T11:27:00.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c0a8c50 con 0x7fe23c14e960 2023-08-27T11:27:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.150+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234007310 con 0x7fe23c14e960 2023-08-27T11:27:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.151+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c0c26d0 con 0x7fe23c14e960 2023-08-27T11:27:00.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.151+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c04ee70 con 0x7fe23c14e960 2023-08-27T11:27:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.153+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe234007470 con 0x7fe23c14e960 2023-08-27T11:27:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.153+0000 7fe2327fc700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 0x7fe22006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.153+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2340883a0 con 0x7fe23c14e960 2023-08-27T11:27:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.154+0000 7fe241f9b700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 0x7fe22006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.154+0000 7fe241f9b700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 0x7fe22006c5d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe2380090b0 tx=0x7fe23801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.158+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe234053a80 con 0x7fe23c14e960 2023-08-27T11:27:00.313 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:27:00.312+0000 7f4079bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:00.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.409+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe23c0c02c0 con 0x7fe23c14e960 2023-08-27T11:27:00.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.409+0000 7fe2327fc700 1 -- 172.21.15.43:0/2302073182 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fe2340570a0 con 0x7fe23c14e960 2023-08-27T11:27:00.411 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:00.411 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:26:59.908755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/863801259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":863801259},{"type":"v1","addr":"172.21.15.43:6836","nonce":863801259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.411+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 msgr2=0x7fe22006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.411+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 0x7fe22006c5d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe2380090b0 tx=0x7fe23801c040 comp rx=0 tx=0).stop 2023-08-27T11:27:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.411+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 msgr2=0x7fe23c1eaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.411+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fe23400cca0 tx=0x7fe23400a060 comp rx=0 tx=0).stop 2023-08-27T11:27:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 shutdown_connections 2023-08-27T11:27:00.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe22006a110 0x7fe22006c5d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe23c14e960 0x7fe23c1eaff0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe23c0a79c0 0x7fe23c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 --2- 172.21.15.43:0/2302073182 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe23c0c50d0 0x7fe23c0c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 >> 172.21.15.43:0/2302073182 conn(0x7fe23c06aa50 msgr2=0x7fe23c0a6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:00.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 shutdown_connections 2023-08-27T11:27:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.412+0000 7fe2441ff700 1 -- 172.21.15.43:0/2302073182 wait complete. 2023-08-27T11:27:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 92 2023-08-27T11:27:00.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.632+0000 7fbe97bff700 1 Processor -- start 2023-08-27T11:27:00.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.632+0000 7fbe97bff700 1 -- start start 2023-08-27T11:27:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe97bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 0x7fbe900c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe97bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe900c4a90 0x7fbe9006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe97bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9006c4e0 con 0x7fbe900c4630 2023-08-27T11:27:00.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe97bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe90155370 con 0x7fbe900c4a90 2023-08-27T11:27:00.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe97bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe90151e70 con 0x7fbe90151a90 2023-08-27T11:27:00.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe9619c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe900c4a90 0x7fbe9006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe9619c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbe900c4a90 0x7fbe9006b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54068/0 (socket says 172.21.15.43:54068) 2023-08-27T11:27:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe9619c700 1 -- 172.21.15.43:0/3453326869 learned_addr learned my addr 172.21.15.43:0/3453326869 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.633+0000 7fbe9599b700 1 --2- 172.21.15.43:0/3453326869 >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 0x7fbe900c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9619c700 1 -- 172.21.15.43:0/3453326869 >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 msgr2=0x7fbe900c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9619c700 1 --2- 172.21.15.43:0/3453326869 >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 0x7fbe900c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9619c700 1 -- 172.21.15.43:0/3453326869 >> v1:172.21.15.57:6789/0 conn(0x7fbe900c4630 legacy=0x7fbe9006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9619c700 1 -- 172.21.15.43:0/3453326869 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90154480 con 0x7fbe900c4a90 2023-08-27T11:27:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9599b700 1 --2- 172.21.15.43:0/3453326869 >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 0x7fbe900c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe9619c700 1 --2- 172.21.15.43:0/3453326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe900c4a90 0x7fbe9006b480 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbe90067710 tx=0x7fbe8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df6cce6d433ccf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe94999700 1 -- 172.21.15.43:0/3453326869 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800e070 con 0x7fbe900c4a90 2023-08-27T11:27:00.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe94999700 1 -- 172.21.15.43:0/3453326869 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88003a20 con 0x7fbe900c4a90 2023-08-27T11:27:00.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.634+0000 7fbe94999700 1 -- 172.21.15.43:0/3453326869 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88003dd0 con 0x7fbe900c4a90 2023-08-27T11:27:00.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 -- 172.21.15.43:0/3453326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe900c4a90 msgr2=0x7fbe9006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 --2- 172.21.15.43:0/3453326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe900c4a90 0x7fbe9006b480 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbe90067710 tx=0x7fbe8800b330 comp rx=0 tx=0).stop 2023-08-27T11:27:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 -- 172.21.15.43:0/3453326869 shutdown_connections 2023-08-27T11:27:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 --2- 172.21.15.43:0/3453326869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe900c4a90 0x7fbe9006b480 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 --2- 172.21.15.43:0/3453326869 >> v2:172.21.15.57:3300/0 conn(0x7fbe90151a90 0x7fbe900c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 -- 172.21.15.43:0/3453326869 >> 172.21.15.43:0/3453326869 conn(0x7fbe900ab820 msgr2=0x7fbe900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 -- 172.21.15.43:0/3453326869 shutdown_connections 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.635+0000 7fbe97bff700 1 -- 172.21.15.43:0/3453326869 wait complete. 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.636+0000 7fbe97bff700 1 Processor -- start 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 -- start start 2023-08-27T11:27:00.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 0x7fbe90153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 0x7fbe900bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90155e00 con 0x7fbe90151a90 2023-08-27T11:27:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe901540f0 con 0x7fbe900c4a90 2023-08-27T11:27:00.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.637+0000 7fbe97bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90157a20 con 0x7fbe900c4630 2023-08-27T11:27:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54078/0 (socket says 172.21.15.43:54078) 2023-08-27T11:27:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 -- 172.21.15.43:0/394818645 learned_addr learned my addr 172.21.15.43:0/394818645 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9519a700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 0x7fbe900bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 -- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 msgr2=0x7fbe90153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9599b700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 0x7fbe90153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 0x7fbe90153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 -- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 msgr2=0x7fbe900bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 0x7fbe900bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 -- 172.21.15.43:0/394818645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009b30 con 0x7fbe90151a90 2023-08-27T11:27:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9519a700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 0x7fbe900bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9599b700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 0x7fbe90153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.638+0000 7fbe9619c700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbe900ac6e0 tx=0x7fbe88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.639+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004500 con 0x7fbe90151a90 2023-08-27T11:27:00.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.639+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88004680 con 0x7fbe90151a90 2023-08-27T11:27:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.639+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe90157d00 con 0x7fbe90151a90 2023-08-27T11:27:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.639+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88012430 con 0x7fbe90151a90 2023-08-27T11:27:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.639+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900c9710 con 0x7fbe90151a90 2023-08-27T11:27:00.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.640+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe900c9290 con 0x7fbe90151a90 2023-08-27T11:27:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.641+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe88019030 con 0x7fbe90151a90 2023-08-27T11:27:00.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.642+0000 7fbe867fc700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 0x7fbe7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.642+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe88089c20 con 0x7fbe90151a90 2023-08-27T11:27:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.642+0000 7fbe9599b700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 0x7fbe7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.643+0000 7fbe9599b700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 0x7fbe7406c5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c008910 tx=0x7fbe8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:00.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.646+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbe900c9290 con 0x7fbe90151a90 2023-08-27T11:27:00.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.859+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe900c9290 con 0x7fbe90151a90 2023-08-27T11:27:00.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.861+0000 7fbe867fc700 1 -- 172.21.15.43:0/394818645 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+18164 (secure 0 0 0) 0x7fbe900c9290 con 0x7fbe90151a90 2023-08-27T11:27:00.862 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:00.863 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":96,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:26:57.364829+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:00.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 msgr2=0x7fbe7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 0x7fbe7406c5a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c008910 tx=0x7fbe8c008040 comp rx=0 tx=0).stop 2023-08-27T11:27:00.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 msgr2=0x7fbe900bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:00.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fbe900ac6e0 tx=0x7fbe88004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 shutdown_connections 2023-08-27T11:27:00.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbe7406a0e0 0x7fbe7406c5a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbe90151a90 0x7fbe900bc370 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe900c4630 0x7fbe90153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 --2- 172.21.15.43:0/394818645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe900c4a90 0x7fbe900bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:00.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 >> 172.21.15.43:0/394818645 conn(0x7fbe900ab820 msgr2=0x7fbe9014d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:00.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 shutdown_connections 2023-08-27T11:27:00.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:00.863+0000 7fbe97bff700 1 -- 172.21.15.43:0/394818645 wait complete. 2023-08-27T11:27:00.883 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:27:00.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:01.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.085+0000 7f96967ff700 1 Processor -- start 2023-08-27T11:27:01.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.086+0000 7f96967ff700 1 -- start start 2023-08-27T11:27:01.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9690151a90 0x7f96900c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96900c4630 0x7f96900c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f969006ad70 0x7f969006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969006c4e0 con 0x7f96900c4630 2023-08-27T11:27:01.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9690155370 con 0x7f969006ad70 2023-08-27T11:27:01.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f96967ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9690151e70 con 0x7f9690151a90 2023-08-27T11:27:01.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96900c4630 0x7f96900c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f96900c4630 0x7f96900c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54080/0 (socket says 172.21.15.43:54080) 2023-08-27T11:27:01.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968f7fe700 1 -- 172.21.15.43:0/1488128774 learned_addr learned my addr 172.21.15.43:0/1488128774 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:01.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968ffff700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9690151a90 0x7f96900c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f9694d9c700 1 --2- 172.21.15.43:0/1488128774 >> v2:172.21.15.57:3300/0 conn(0x7f969006ad70 0x7f969006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968f7fe700 1 -- 172.21.15.43:0/1488128774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9690151a90 msgr2=0x7f96900c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:01.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.087+0000 7f968f7fe700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9690151a90 0x7f96900c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968f7fe700 1 -- 172.21.15.43:0/1488128774 >> v2:172.21.15.57:3300/0 conn(0x7f969006ad70 msgr2=0x7f969006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:01.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968f7fe700 1 --2- 172.21.15.43:0/1488128774 >> v2:172.21.15.57:3300/0 conn(0x7f969006ad70 0x7f969006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968f7fe700 1 -- 172.21.15.43:0/1488128774 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690154480 con 0x7f96900c4630 2023-08-27T11:27:01.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968f7fe700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96900c4630 0x7f96900c4a90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f96900bd700 tx=0x7f9684009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242629e57a793538 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968effd700 1 -- 172.21.15.43:0/1488128774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400b870 con 0x7f96900c4630 2023-08-27T11:27:01.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968effd700 1 -- 172.21.15.43:0/1488128774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400b9d0 con 0x7f96900c4630 2023-08-27T11:27:01.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.088+0000 7f968effd700 1 -- 172.21.15.43:0/1488128774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400bd60 con 0x7f96900c4630 2023-08-27T11:27:01.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 -- 172.21.15.43:0/1488128774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96900c4630 msgr2=0x7f96900c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96900c4630 0x7f96900c4a90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f96900bd700 tx=0x7f9684009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 -- 172.21.15.43:0/1488128774 shutdown_connections 2023-08-27T11:27:01.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 --2- 172.21.15.43:0/1488128774 >> v2:172.21.15.57:3300/0 conn(0x7f969006ad70 0x7f969006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9690151a90 0x7f96900c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 --2- 172.21.15.43:0/1488128774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96900c4630 0x7f96900c4a90 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 -- 172.21.15.43:0/1488128774 >> 172.21.15.43:0/1488128774 conn(0x7f96900ab820 msgr2=0x7f96900abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:01.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 -- 172.21.15.43:0/1488128774 shutdown_connections 2023-08-27T11:27:01.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.089+0000 7f96967ff700 1 -- 172.21.15.43:0/1488128774 wait complete. 2023-08-27T11:27:01.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.090+0000 7f96967ff700 1 Processor -- start 2023-08-27T11:27:01.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.091+0000 7f96967ff700 1 -- start start 2023-08-27T11:27:01.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.091+0000 7f96967ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f969006ad70 0x7f9690144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.091+0000 7f96967ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 0x7f9690152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.091+0000 7f96967ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f96967ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690150d30 con 0x7f9690151a90 2023-08-27T11:27:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f96967ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690151240 con 0x7f96900c4630 2023-08-27T11:27:01.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f96967ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9690150f60 con 0x7f969006ad70 2023-08-27T11:27:01.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54084/0 (socket says 172.21.15.43:54084) 2023-08-27T11:27:01.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 -- 172.21.15.43:0/2603475726 learned_addr learned my addr 172.21.15.43:0/2603475726 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:01.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f968ffff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f969006ad70 0x7f9690144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f968f7fe700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 0x7f9690152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 -- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f969006ad70 msgr2=0x7f9690144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f969006ad70 0x7f9690144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 -- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 msgr2=0x7f9690152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 0x7f9690152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 -- 172.21.15.43:0/2603475726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009550 con 0x7f9690151a90 2023-08-27T11:27:01.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f968f7fe700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 0x7f9690152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:01.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.092+0000 7f9694d9c700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9688007e40 tx=0x7f968800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.093+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800eea0 con 0x7f9690151a90 2023-08-27T11:27:01.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.093+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688014420 con 0x7f9690151a90 2023-08-27T11:27:01.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.093+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880147b0 con 0x7f9690151a90 2023-08-27T11:27:01.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.093+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96901523b0 con 0x7f9690151a90 2023-08-27T11:27:01.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.093+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9690152bd0 con 0x7f9690151a90 2023-08-27T11:27:01.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.094+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969004ee70 con 0x7f9690151a90 2023-08-27T11:27:01.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.095+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9688014910 con 0x7f9690151a90 2023-08-27T11:27:01.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.096+0000 7f968cff9700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 0x7f967c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.096+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9688088d10 con 0x7f9690151a90 2023-08-27T11:27:01.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.096+0000 7f968ffff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 0x7f967c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.097+0000 7f968ffff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 0x7f967c06c5a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f96900ab2a0 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.100+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9688057f20 con 0x7f9690151a90 2023-08-27T11:27:01.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.308+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9690154a40 con 0x7f967c06a0e0 2023-08-27T11:27:01.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.319+0000 7f968cff9700 1 -- 172.21.15.43:0/2603475726 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306102 (secure 0 0 0) 0x7f968000bdd0 con 0x7f967c06a0e0 2023-08-27T11:27:01.324 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:01.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 msgr2=0x7f967c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 0x7f967c06c5a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f96900ab2a0 tx=0x7f9680008040 comp rx=0 tx=0).stop 2023-08-27T11:27:01.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 msgr2=0x7f9690153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f9688007e40 tx=0x7f968800e3c0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 shutdown_connections 2023-08-27T11:27:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f967c06a0e0 0x7f967c06c5a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9690151a90 0x7f9690153c50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f969006ad70 0x7f9690144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 --2- 172.21.15.43:0/2603475726 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96900c4630 0x7f9690152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 >> 172.21.15.43:0/2603475726 conn(0x7f96900ab820 msgr2=0x7f969006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.323+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 shutdown_connections 2023-08-27T11:27:01.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.324+0000 7f96967ff700 1 -- 172.21.15.43:0/2603475726 wait complete. 2023-08-27T11:27:01.330 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:01.343 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-08-27T11:27:00.364459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":10136,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":10379264,"data_stored":5446368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001728"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342834+0000","last_change":"2023-08-27T11:26:55.342834+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342834+0000","last_undegraded":"2023-08-27T11:26:55.342834+0000","last_fullsized":"2023-08-27T11:26:55.342834+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346182+0000","last_change":"2023-08-27T11:26:55.346182+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346182+0000","last_undegraded":"2023-08-27T11:26:55.346182+0000","last_fullsized":"2023-08-27T11:26:55.346182+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344276+0000","last_change":"2023-08-27T11:26:55.344276+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344276+0000","last_undegraded":"2023-08-27T11:26:55.344276+0000","last_fullsized":"2023-08-27T11:26:55.344276+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345048+0000","last_change":"2023-08-27T11:26:55.345048+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345048+0000","last_undegraded":"2023-08-27T11:26:55.345048+0000","last_fullsized":"2023-08-27T11:26:55.345048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.352594+0000","last_change":"2023-08-27T11:26:55.352594+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.352594+0000","last_undegraded":"2023-08-27T11:26:55.352594+0000","last_fullsized":"2023-08-27T11:26:55.352594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346488+0000","last_change":"2023-08-27T11:26:55.346488+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346488+0000","last_undegraded":"2023-08-27T11:26:55.346488+0000","last_fullsized":"2023-08-27T11:26:55.346488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342034+0000","last_change":"2023-08-27T11:26:55.342034+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342034+0000","last_undegraded":"2023-08-27T11:26:55.342034+0000","last_fullsized":"2023-08-27T11:26:55.342034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342194+0000","last_change":"2023-08-27T11:26:55.342194+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342194+0000","last_undegraded":"2023-08-27T11:26:55.342194+0000","last_fullsized":"2023-08-27T11:26:55.342194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342841+0000","last_change":"2023-08-27T11:26:55.342841+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342841+0000","last_undegraded":"2023-08-27T11:26:55.342841+0000","last_fullsized":"2023-08-27T11:26:55.342841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350751+0000","last_change":"2023-08-27T11:26:55.350751+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350751+0000","last_undegraded":"2023-08-27T11:26:55.350751+0000","last_fullsized":"2023-08-27T11:26:55.350751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345929+0000","last_change":"2023-08-27T11:26:55.345929+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345929+0000","last_undegraded":"2023-08-27T11:26:55.345929+0000","last_fullsized":"2023-08-27T11:26:55.345929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345286+0000","last_change":"2023-08-27T11:26:55.345286+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345286+0000","last_undegraded":"2023-08-27T11:26:55.345286+0000","last_fullsized":"2023-08-27T11:26:55.345286+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.349504+0000","last_change":"2023-08-27T11:26:55.349504+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.349504+0000","last_undegraded":"2023-08-27T11:26:55.349504+0000","last_fullsized":"2023-08-27T11:26:55.349504+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350360+0000","last_change":"2023-08-27T11:26:55.350360+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350360+0000","last_undegraded":"2023-08-27T11:26:55.350360+0000","last_fullsized":"2023-08-27T11:26:55.350360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348018+0000","last_change":"2023-08-27T11:26:55.348018+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348018+0000","last_undegraded":"2023-08-27T11:26:55.348018+0000","last_fullsized":"2023-08-27T11:26:55.348018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342423+0000","last_change":"2023-08-27T11:26:55.342423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342423+0000","last_undegraded":"2023-08-27T11:26:55.342423+0000","last_fullsized":"2023-08-27T11:26:55.342423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345665+0000","last_change":"2023-08-27T11:26:55.345665+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345665+0000","last_undegraded":"2023-08-27T11:26:55.345665+0000","last_fullsized":"2023-08-27T11:26:55.345665+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343867+0000","last_change":"2023-08-27T11:26:55.343867+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343867+0000","last_undegraded":"2023-08-27T11:26:55.343867+0000","last_fullsized":"2023-08-27T11:26:55.343867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340061+0000","last_change":"2023-08-27T11:26:55.340061+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340061+0000","last_undegraded":"2023-08-27T11:26:55.340061+0000","last_fullsized":"2023-08-27T11:26:55.340061+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342059+0000","last_change":"2023-08-27T11:26:55.342059+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342059+0000","last_undegraded":"2023-08-27T11:26:55.342059+0000","last_fullsized":"2023-08-27T11:26:55.342059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348188+0000","last_change":"2023-08-27T11:26:55.348188+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348188+0000","last_undegraded":"2023-08-27T11:26:55.348188+0000","last_fullsized":"2023-08-27T11:26:55.348188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342123+0000","last_change":"2023-08-27T11:26:55.342123+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342123+0000","last_undegraded":"2023-08-27T11:26:55.342123+0000","last_fullsized":"2023-08-27T11:26:55.342123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351423+0000","last_change":"2023-08-27T11:26:55.351423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351423+0000","last_undegraded":"2023-08-27T11:26:55.351423+0000","last_fullsized":"2023-08-27T11:26:55.351423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340731+0000","last_change":"2023-08-27T11:26:55.340731+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340731+0000","last_undegraded":"2023-08-27T11:26:55.340731+0000","last_fullsized":"2023-08-27T11:26:55.340731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340128+0000","last_change":"2023-08-27T11:26:55.340128+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340128+0000","last_undegraded":"2023-08-27T11:26:55.340128+0000","last_fullsized":"2023-08-27T11:26:55.340128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345394+0000","last_change":"2023-08-27T11:26:55.345394+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345394+0000","last_undegraded":"2023-08-27T11:26:55.345394+0000","last_fullsized":"2023-08-27T11:26:55.345394+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344492+0000","last_change":"2023-08-27T11:26:55.344492+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344492+0000","last_undegraded":"2023-08-27T11:26:55.344492+0000","last_fullsized":"2023-08-27T11:26:55.344492+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341625+0000","last_change":"2023-08-27T11:26:55.341625+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341625+0000","last_undegraded":"2023-08-27T11:26:55.341625+0000","last_fullsized":"2023-08-27T11:26:55.341625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341466+0000","last_change":"2023-08-27T11:26:55.341466+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341466+0000","last_undegraded":"2023-08-27T11:26:55.341466+0000","last_fullsized":"2023-08-27T11:26:55.341466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341527+0000","last_change":"2023-08-27T11:26:55.341527+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341527+0000","last_undegraded":"2023-08-27T11:26:55.341527+0000","last_fullsized":"2023-08-27T11:26:55.341527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341738+0000","last_change":"2023-08-27T11:26:55.341738+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341738+0000","last_undegraded":"2023-08-27T11:26:55.341738+0000","last_fullsized":"2023-08-27T11:26:55.341738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341773+0000","last_change":"2023-08-27T11:26:55.341773+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341773+0000","last_undegraded":"2023-08-27T11:26:55.341773+0000","last_fullsized":"2023-08-27T11:26:55.341773+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363089+0000","last_change":"2023-08-27T11:26:55.361418+0000","last_active":"2023-08-27T11:26:55.363089+0000","last_peered":"2023-08-27T11:26:55.363089+0000","last_clean":"2023-08-27T11:26:55.363089+0000","last_became_active":"2023-08-27T11:26:55.361075+0000","last_became_peered":"2023-08-27T11:26:55.361075+0000","last_unstale":"2023-08-27T11:26:55.363089+0000","last_undegraded":"2023-08-27T11:26:55.363089+0000","last_fullsized":"2023-08-27T11:26:55.363089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:17:29.007239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340858+0000","last_change":"2023-08-27T11:26:55.340858+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340858+0000","last_undegraded":"2023-08-27T11:26:55.340858+0000","last_fullsized":"2023-08-27T11:26:55.340858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363927+0000","last_change":"2023-08-27T11:26:55.360037+0000","last_active":"2023-08-27T11:26:55.363927+0000","last_peered":"2023-08-27T11:26:55.363927+0000","last_clean":"2023-08-27T11:26:55.363927+0000","last_became_active":"2023-08-27T11:26:55.359712+0000","last_became_peered":"2023-08-27T11:26:55.359712+0000","last_unstale":"2023-08-27T11:26:55.363927+0000","last_undegraded":"2023-08-27T11:26:55.363927+0000","last_fullsized":"2023-08-27T11:26:55.363927+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:04.980678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339985+0000","last_change":"2023-08-27T11:26:55.339985+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339985+0000","last_undegraded":"2023-08-27T11:26:55.339985+0000","last_fullsized":"2023-08-27T11:26:55.339985+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361264+0000","last_change":"2023-08-27T11:26:55.353142+0000","last_active":"2023-08-27T11:26:55.361264+0000","last_peered":"2023-08-27T11:26:55.361264+0000","last_clean":"2023-08-27T11:26:55.361264+0000","last_became_active":"2023-08-27T11:26:55.352351+0000","last_became_peered":"2023-08-27T11:26:55.352351+0000","last_unstale":"2023-08-27T11:26:55.361264+0000","last_undegraded":"2023-08-27T11:26:55.361264+0000","last_fullsized":"2023-08-27T11:26:55.361264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.135590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344280+0000","last_change":"2023-08-27T11:26:55.344280+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344280+0000","last_undegraded":"2023-08-27T11:26:55.344280+0000","last_fullsized":"2023-08-27T11:26:55.344280+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.364740+0000","last_change":"2023-08-27T11:26:55.363797+0000","last_active":"2023-08-27T11:26:55.364740+0000","last_peered":"2023-08-27T11:26:55.364740+0000","last_clean":"2023-08-27T11:26:55.364740+0000","last_became_active":"2023-08-27T11:26:55.363472+0000","last_became_peered":"2023-08-27T11:26:55.363472+0000","last_unstale":"2023-08-27T11:26:55.364740+0000","last_undegraded":"2023-08-27T11:26:55.364740+0000","last_fullsized":"2023-08-27T11:26:55.364740+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:45.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344569+0000","last_change":"2023-08-27T11:26:55.344569+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344569+0000","last_undegraded":"2023-08-27T11:26:55.344569+0000","last_fullsized":"2023-08-27T11:26:55.344569+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362032+0000","last_change":"2023-08-27T11:26:55.360072+0000","last_active":"2023-08-27T11:26:55.362032+0000","last_peered":"2023-08-27T11:26:55.362032+0000","last_clean":"2023-08-27T11:26:55.362032+0000","last_became_active":"2023-08-27T11:26:55.359779+0000","last_became_peered":"2023-08-27T11:26:55.359779+0000","last_unstale":"2023-08-27T11:26:55.362032+0000","last_undegraded":"2023-08-27T11:26:55.362032+0000","last_fullsized":"2023-08-27T11:26:55.362032+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:17.884593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342891+0000","last_change":"2023-08-27T11:26:55.342891+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342891+0000","last_undegraded":"2023-08-27T11:26:55.342891+0000","last_fullsized":"2023-08-27T11:26:55.342891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358914+0000","last_change":"2023-08-27T11:26:55.355107+0000","last_active":"2023-08-27T11:26:55.358914+0000","last_peered":"2023-08-27T11:26:55.358914+0000","last_clean":"2023-08-27T11:26:55.358914+0000","last_became_active":"2023-08-27T11:26:55.354728+0000","last_became_peered":"2023-08-27T11:26:55.354728+0000","last_unstale":"2023-08-27T11:26:55.358914+0000","last_undegraded":"2023-08-27T11:26:55.358914+0000","last_fullsized":"2023-08-27T11:26:55.358914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:41.392123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345151+0000","last_change":"2023-08-27T11:26:55.345151+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345151+0000","last_undegraded":"2023-08-27T11:26:55.345151+0000","last_fullsized":"2023-08-27T11:26:55.345151+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361306+0000","last_change":"2023-08-27T11:26:55.353051+0000","last_active":"2023-08-27T11:26:55.361306+0000","last_peered":"2023-08-27T11:26:55.361306+0000","last_clean":"2023-08-27T11:26:55.361306+0000","last_became_active":"2023-08-27T11:26:55.352606+0000","last_became_peered":"2023-08-27T11:26:55.352606+0000","last_unstale":"2023-08-27T11:26:55.361306+0000","last_undegraded":"2023-08-27T11:26:55.361306+0000","last_fullsized":"2023-08-27T11:26:55.361306+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:42:03.018322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344561+0000","last_change":"2023-08-27T11:26:55.344561+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344561+0000","last_undegraded":"2023-08-27T11:26:55.344561+0000","last_fullsized":"2023-08-27T11:26:55.344561+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361810+0000","last_change":"2023-08-27T11:26:55.356739+0000","last_active":"2023-08-27T11:26:55.361810+0000","last_peered":"2023-08-27T11:26:55.361810+0000","last_clean":"2023-08-27T11:26:55.361810+0000","last_became_active":"2023-08-27T11:26:55.356419+0000","last_became_peered":"2023-08-27T11:26:55.356419+0000","last_unstale":"2023-08-27T11:26:55.361810+0000","last_undegraded":"2023-08-27T11:26:55.361810+0000","last_fullsized":"2023-08-27T11:26:55.361810+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:10:58.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344602+0000","last_change":"2023-08-27T11:26:55.344602+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344602+0000","last_undegraded":"2023-08-27T11:26:55.344602+0000","last_fullsized":"2023-08-27T11:26:55.344602+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.352949+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.352563+0000","last_became_peered":"2023-08-27T11:26:55.352563+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350395+0000","last_change":"2023-08-27T11:26:55.350395+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350395+0000","last_undegraded":"2023-08-27T11:26:55.350395+0000","last_fullsized":"2023-08-27T11:26:55.350395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360398+0000","last_change":"2023-08-27T11:26:55.356564+0000","last_active":"2023-08-27T11:26:55.360398+0000","last_peered":"2023-08-27T11:26:55.360398+0000","last_clean":"2023-08-27T11:26:55.360398+0000","last_became_active":"2023-08-27T11:26:55.356302+0000","last_became_peered":"2023-08-27T11:26:55.356302+0000","last_unstale":"2023-08-27T11:26:55.360398+0000","last_undegraded":"2023-08-27T11:26:55.360398+0000","last_fullsized":"2023-08-27T11:26:55.360398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:38.563053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342715+0000","last_change":"2023-08-27T11:26:55.342715+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342715+0000","last_undegraded":"2023-08-27T11:26:55.342715+0000","last_fullsized":"2023-08-27T11:26:55.342715+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361992+0000","last_change":"2023-08-27T11:26:55.359460+0000","last_active":"2023-08-27T11:26:55.361992+0000","last_peered":"2023-08-27T11:26:55.361992+0000","last_clean":"2023-08-27T11:26:55.361992+0000","last_became_active":"2023-08-27T11:26:55.359161+0000","last_became_peered":"2023-08-27T11:26:55.359161+0000","last_unstale":"2023-08-27T11:26:55.361992+0000","last_undegraded":"2023-08-27T11:26:55.361992+0000","last_fullsized":"2023-08-27T11:26:55.361992+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:38.425259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348723+0000","last_change":"2023-08-27T11:26:55.348723+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348723+0000","last_undegraded":"2023-08-27T11:26:55.348723+0000","last_fullsized":"2023-08-27T11:26:55.348723+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360772+0000","last_change":"2023-08-27T11:26:55.358248+0000","last_active":"2023-08-27T11:26:55.360772+0000","last_peered":"2023-08-27T11:26:55.360772+0000","last_clean":"2023-08-27T11:26:55.360772+0000","last_became_active":"2023-08-27T11:26:55.357893+0000","last_became_peered":"2023-08-27T11:26:55.357893+0000","last_unstale":"2023-08-27T11:26:55.360772+0000","last_undegraded":"2023-08-27T11:26:55.360772+0000","last_fullsized":"2023-08-27T11:26:55.360772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:57.363969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343315+0000","last_change":"2023-08-27T11:26:55.343315+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343315+0000","last_undegraded":"2023-08-27T11:26:55.343315+0000","last_fullsized":"2023-08-27T11:26:55.343315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360404+0000","last_change":"2023-08-27T11:26:55.358644+0000","last_active":"2023-08-27T11:26:55.360404+0000","last_peered":"2023-08-27T11:26:55.360404+0000","last_clean":"2023-08-27T11:26:55.360404+0000","last_became_active":"2023-08-27T11:26:55.358327+0000","last_became_peered":"2023-08-27T11:26:55.358327+0000","last_unstale":"2023-08-27T11:26:55.360404+0000","last_undegraded":"2023-08-27T11:26:55.360404+0000","last_fullsized":"2023-08-27T11:26:55.360404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:21:44.354240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341362+0000","last_change":"2023-08-27T11:26:55.341362+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341362+0000","last_undegraded":"2023-08-27T11:26:55.341362+0000","last_fullsized":"2023-08-27T11:26:55.341362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363654+0000","last_change":"2023-08-27T11:26:55.361664+0000","last_active":"2023-08-27T11:26:55.363654+0000","last_peered":"2023-08-27T11:26:55.363654+0000","last_clean":"2023-08-27T11:26:55.363654+0000","last_became_active":"2023-08-27T11:26:55.361207+0000","last_became_peered":"2023-08-27T11:26:55.361207+0000","last_unstale":"2023-08-27T11:26:55.363654+0000","last_undegraded":"2023-08-27T11:26:55.363654+0000","last_fullsized":"2023-08-27T11:26:55.363654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:48:50.318507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346401+0000","last_change":"2023-08-27T11:26:55.346401+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346401+0000","last_undegraded":"2023-08-27T11:26:55.346401+0000","last_fullsized":"2023-08-27T11:26:55.346401+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356904+0000","last_change":"2023-08-27T11:26:55.349997+0000","last_active":"2023-08-27T11:26:55.356904+0000","last_peered":"2023-08-27T11:26:55.356904+0000","last_clean":"2023-08-27T11:26:55.356904+0000","last_became_active":"2023-08-27T11:26:55.349692+0000","last_became_peered":"2023-08-27T11:26:55.349692+0000","last_unstale":"2023-08-27T11:26:55.356904+0000","last_undegraded":"2023-08-27T11:26:55.356904+0000","last_fullsized":"2023-08-27T11:26:55.356904+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:10.455327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341846+0000","last_change":"2023-08-27T11:26:55.341846+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341846+0000","last_undegraded":"2023-08-27T11:26:55.341846+0000","last_fullsized":"2023-08-27T11:26:55.341846+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.353773+0000","last_change":"2023-08-27T11:26:55.348680+0000","last_active":"2023-08-27T11:26:55.353773+0000","last_peered":"2023-08-27T11:26:55.353773+0000","last_clean":"2023-08-27T11:26:55.353773+0000","last_became_active":"2023-08-27T11:26:55.348359+0000","last_became_peered":"2023-08-27T11:26:55.348359+0000","last_unstale":"2023-08-27T11:26:55.353773+0000","last_undegraded":"2023-08-27T11:26:55.353773+0000","last_fullsized":"2023-08-27T11:26:55.353773+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:58.876923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345010+0000","last_change":"2023-08-27T11:26:55.345010+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345010+0000","last_undegraded":"2023-08-27T11:26:55.345010+0000","last_fullsized":"2023-08-27T11:26:55.345010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363187+0000","last_change":"2023-08-27T11:26:55.361849+0000","last_active":"2023-08-27T11:26:55.363187+0000","last_peered":"2023-08-27T11:26:55.363187+0000","last_clean":"2023-08-27T11:26:55.363187+0000","last_became_active":"2023-08-27T11:26:55.361557+0000","last_became_peered":"2023-08-27T11:26:55.361557+0000","last_unstale":"2023-08-27T11:26:55.363187+0000","last_undegraded":"2023-08-27T11:26:55.363187+0000","last_fullsized":"2023-08-27T11:26:55.363187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:13.145297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356857+0000","last_change":"2023-08-27T11:26:55.354496+0000","last_active":"2023-08-27T11:26:55.356857+0000","last_peered":"2023-08-27T11:26:55.356857+0000","last_clean":"2023-08-27T11:26:55.356857+0000","last_became_active":"2023-08-27T11:26:55.354179+0000","last_became_peered":"2023-08-27T11:26:55.354179+0000","last_unstale":"2023-08-27T11:26:55.356857+0000","last_undegraded":"2023-08-27T11:26:55.356857+0000","last_fullsized":"2023-08-27T11:26:55.356857+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:38:08.578329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345373+0000","last_change":"2023-08-27T11:26:55.345373+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345373+0000","last_undegraded":"2023-08-27T11:26:55.345373+0000","last_fullsized":"2023-08-27T11:26:55.345373+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358532+0000","last_change":"2023-08-27T11:26:55.356722+0000","last_active":"2023-08-27T11:26:55.358532+0000","last_peered":"2023-08-27T11:26:55.358532+0000","last_clean":"2023-08-27T11:26:55.358532+0000","last_became_active":"2023-08-27T11:26:55.356411+0000","last_became_peered":"2023-08-27T11:26:55.356411+0000","last_unstale":"2023-08-27T11:26:55.358532+0000","last_undegraded":"2023-08-27T11:26:55.358532+0000","last_fullsized":"2023-08-27T11:26:55.358532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344791+0000","last_change":"2023-08-27T11:26:55.344791+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344791+0000","last_undegraded":"2023-08-27T11:26:55.344791+0000","last_fullsized":"2023-08-27T11:26:55.344791+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362293+0000","last_change":"2023-08-27T11:26:55.359591+0000","last_active":"2023-08-27T11:26:55.362293+0000","last_peered":"2023-08-27T11:26:55.362293+0000","last_clean":"2023-08-27T11:26:55.362293+0000","last_became_active":"2023-08-27T11:26:55.359302+0000","last_became_peered":"2023-08-27T11:26:55.359302+0000","last_unstale":"2023-08-27T11:26:55.362293+0000","last_undegraded":"2023-08-27T11:26:55.362293+0000","last_fullsized":"2023-08-27T11:26:55.362293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:24.927191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344898+0000","last_change":"2023-08-27T11:26:55.344898+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344898+0000","last_undegraded":"2023-08-27T11:26:55.344898+0000","last_fullsized":"2023-08-27T11:26:55.344898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.349533+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.349211+0000","last_became_peered":"2023-08-27T11:26:55.349211+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346688+0000","last_change":"2023-08-27T11:26:55.346688+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346688+0000","last_undegraded":"2023-08-27T11:26:55.346688+0000","last_fullsized":"2023-08-27T11:26:55.346688+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356348+0000","last_change":"2023-08-27T11:26:55.351607+0000","last_active":"2023-08-27T11:26:55.356348+0000","last_peered":"2023-08-27T11:26:55.356348+0000","last_clean":"2023-08-27T11:26:55.356348+0000","last_became_active":"2023-08-27T11:26:55.351289+0000","last_became_peered":"2023-08-27T11:26:55.351289+0000","last_unstale":"2023-08-27T11:26:55.356348+0000","last_undegraded":"2023-08-27T11:26:55.356348+0000","last_fullsized":"2023-08-27T11:26:55.356348+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:50:44.282014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348709+0000","last_change":"2023-08-27T11:26:55.348709+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348709+0000","last_undegraded":"2023-08-27T11:26:55.348709+0000","last_fullsized":"2023-08-27T11:26:55.348709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359500+0000","last_change":"2023-08-27T11:26:55.357412+0000","last_active":"2023-08-27T11:26:55.359500+0000","last_peered":"2023-08-27T11:26:55.359500+0000","last_clean":"2023-08-27T11:26:55.359500+0000","last_became_active":"2023-08-27T11:26:55.357099+0000","last_became_peered":"2023-08-27T11:26:55.357099+0000","last_unstale":"2023-08-27T11:26:55.359500+0000","last_undegraded":"2023-08-27T11:26:55.359500+0000","last_fullsized":"2023-08-27T11:26:55.359500+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:30.521591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346959+0000","last_change":"2023-08-27T11:26:55.346959+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346959+0000","last_undegraded":"2023-08-27T11:26:55.346959+0000","last_fullsized":"2023-08-27T11:26:55.346959+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357108+0000","last_change":"2023-08-27T11:26:55.350845+0000","last_active":"2023-08-27T11:26:55.357108+0000","last_peered":"2023-08-27T11:26:55.357108+0000","last_clean":"2023-08-27T11:26:55.357108+0000","last_became_active":"2023-08-27T11:26:55.350307+0000","last_became_peered":"2023-08-27T11:26:55.350307+0000","last_unstale":"2023-08-27T11:26:55.357108+0000","last_undegraded":"2023-08-27T11:26:55.357108+0000","last_fullsized":"2023-08-27T11:26:55.357108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:32:33.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345795+0000","last_change":"2023-08-27T11:26:55.345795+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345795+0000","last_undegraded":"2023-08-27T11:26:55.345795+0000","last_fullsized":"2023-08-27T11:26:55.345795+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360366+0000","last_change":"2023-08-27T11:26:55.358238+0000","last_active":"2023-08-27T11:26:55.360366+0000","last_peered":"2023-08-27T11:26:55.360366+0000","last_clean":"2023-08-27T11:26:55.360366+0000","last_became_active":"2023-08-27T11:26:55.357924+0000","last_became_peered":"2023-08-27T11:26:55.357924+0000","last_unstale":"2023-08-27T11:26:55.360366+0000","last_undegraded":"2023-08-27T11:26:55.360366+0000","last_fullsized":"2023-08-27T11:26:55.360366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:46.627644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.340442+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:55.340442+0000","last_peered":"2023-08-27T11:26:55.340442+0000","last_clean":"2023-08-27T11:26:55.340442+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:55.340442+0000","last_undegraded":"2023-08-27T11:26:55.340442+0000","last_fullsized":"2023-08-27T11:26:55.340442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:09.713247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345410+0000","last_change":"2023-08-27T11:26:55.345410+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345410+0000","last_undegraded":"2023-08-27T11:26:55.345410+0000","last_fullsized":"2023-08-27T11:26:55.345410+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359760+0000","last_change":"2023-08-27T11:26:55.353113+0000","last_active":"2023-08-27T11:26:55.359760+0000","last_peered":"2023-08-27T11:26:55.359760+0000","last_clean":"2023-08-27T11:26:55.359760+0000","last_became_active":"2023-08-27T11:26:55.352818+0000","last_became_peered":"2023-08-27T11:26:55.352818+0000","last_unstale":"2023-08-27T11:26:55.359760+0000","last_undegraded":"2023-08-27T11:26:55.359760+0000","last_fullsized":"2023-08-27T11:26:55.359760+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:17.865194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.339834+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:55.339834+0000","last_peered":"2023-08-27T11:26:55.339834+0000","last_clean":"2023-08-27T11:26:55.339834+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:55.339834+0000","last_undegraded":"2023-08-27T11:26:55.339834+0000","last_fullsized":"2023-08-27T11:26:55.339834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:40.454581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341294+0000","last_change":"2023-08-27T11:26:55.341294+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341294+0000","last_undegraded":"2023-08-27T11:26:55.341294+0000","last_fullsized":"2023-08-27T11:26:55.341294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357206+0000","last_change":"2023-08-27T11:26:55.347843+0000","last_active":"2023-08-27T11:26:55.357206+0000","last_peered":"2023-08-27T11:26:55.357206+0000","last_clean":"2023-08-27T11:26:55.357206+0000","last_became_active":"2023-08-27T11:26:55.347517+0000","last_became_peered":"2023-08-27T11:26:55.347517+0000","last_unstale":"2023-08-27T11:26:55.357206+0000","last_undegraded":"2023-08-27T11:26:55.357206+0000","last_fullsized":"2023-08-27T11:26:55.357206+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.343966+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:55.343966+0000","last_peered":"2023-08-27T11:26:55.343966+0000","last_clean":"2023-08-27T11:26:55.343966+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:55.343966+0000","last_undegraded":"2023-08-27T11:26:55.343966+0000","last_fullsized":"2023-08-27T11:26:55.343966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:16:48.156023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343664+0000","last_change":"2023-08-27T11:26:55.343664+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343664+0000","last_undegraded":"2023-08-27T11:26:55.343664+0000","last_fullsized":"2023-08-27T11:26:55.343664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362963+0000","last_change":"2023-08-27T11:26:55.356624+0000","last_active":"2023-08-27T11:26:55.362963+0000","last_peered":"2023-08-27T11:26:55.362963+0000","last_clean":"2023-08-27T11:26:55.362963+0000","last_became_active":"2023-08-27T11:26:55.355441+0000","last_became_peered":"2023-08-27T11:26:55.355441+0000","last_unstale":"2023-08-27T11:26:55.362963+0000","last_undegraded":"2023-08-27T11:26:55.362963+0000","last_fullsized":"2023-08-27T11:26:55.362963+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:39.941432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351632+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:55.351632+0000","last_peered":"2023-08-27T11:26:55.351632+0000","last_clean":"2023-08-27T11:26:55.351632+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:55.351632+0000","last_undegraded":"2023-08-27T11:26:55.351632+0000","last_fullsized":"2023-08-27T11:26:55.351632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:53.487197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351828+0000","last_change":"2023-08-27T11:26:55.351828+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351828+0000","last_undegraded":"2023-08-27T11:26:55.351828+0000","last_fullsized":"2023-08-27T11:26:55.351828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362612+0000","last_change":"2023-08-27T11:26:55.360320+0000","last_active":"2023-08-27T11:26:55.362612+0000","last_peered":"2023-08-27T11:26:55.362612+0000","last_clean":"2023-08-27T11:26:55.362612+0000","last_became_active":"2023-08-27T11:26:55.359906+0000","last_became_peered":"2023-08-27T11:26:55.359906+0000","last_unstale":"2023-08-27T11:26:55.362612+0000","last_undegraded":"2023-08-27T11:26:55.362612+0000","last_fullsized":"2023-08-27T11:26:55.362612+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:02.843096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.352880+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:55.352880+0000","last_peered":"2023-08-27T11:26:55.352880+0000","last_clean":"2023-08-27T11:26:55.352880+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:55.352880+0000","last_undegraded":"2023-08-27T11:26:55.352880+0000","last_fullsized":"2023-08-27T11:26:55.352880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:04.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341749+0000","last_change":"2023-08-27T11:26:55.341749+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341749+0000","last_undegraded":"2023-08-27T11:26:55.341749+0000","last_fullsized":"2023-08-27T11:26:55.341749+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.365159+0000","last_change":"2023-08-27T11:26:55.364141+0000","last_active":"2023-08-27T11:26:55.365159+0000","last_peered":"2023-08-27T11:26:55.365159+0000","last_clean":"2023-08-27T11:26:55.365159+0000","last_became_active":"2023-08-27T11:26:55.363814+0000","last_became_peered":"2023-08-27T11:26:55.363814+0000","last_unstale":"2023-08-27T11:26:55.365159+0000","last_undegraded":"2023-08-27T11:26:55.365159+0000","last_fullsized":"2023-08-27T11:26:55.365159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:04:39.207247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":293,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351457+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:55.351457+0000","last_peered":"2023-08-27T11:26:55.351457+0000","last_clean":"2023-08-27T11:26:55.351457+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:55.351457+0000","last_undegraded":"2023-08-27T11:26:55.351457+0000","last_fullsized":"2023-08-27T11:26:55.351457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:40:24.249582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.354505+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:55.354505+0000","last_peered":"2023-08-27T11:26:55.354505+0000","last_clean":"2023-08-27T11:26:55.354505+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:55.354505+0000","last_undegraded":"2023-08-27T11:26:55.354505+0000","last_fullsized":"2023-08-27T11:26:55.354505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:27:09.713560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343383+0000","last_change":"2023-08-27T11:26:55.343383+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343383+0000","last_undegraded":"2023-08-27T11:26:55.343383+0000","last_fullsized":"2023-08-27T11:26:55.343383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363057+0000","last_change":"2023-08-27T11:26:55.356213+0000","last_active":"2023-08-27T11:26:55.363057+0000","last_peered":"2023-08-27T11:26:55.363057+0000","last_clean":"2023-08-27T11:26:55.363057+0000","last_became_active":"2023-08-27T11:26:55.355932+0000","last_became_peered":"2023-08-27T11:26:55.355932+0000","last_unstale":"2023-08-27T11:26:55.363057+0000","last_undegraded":"2023-08-27T11:26:55.363057+0000","last_fullsized":"2023-08-27T11:26:55.363057+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:14:17.592043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.347429+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:55.347429+0000","last_peered":"2023-08-27T11:26:55.347429+0000","last_clean":"2023-08-27T11:26:55.347429+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:55.347429+0000","last_undegraded":"2023-08-27T11:26:55.347429+0000","last_fullsized":"2023-08-27T11:26:55.347429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:36:49.239378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343220+0000","last_change":"2023-08-27T11:26:55.343220+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343220+0000","last_undegraded":"2023-08-27T11:26:55.343220+0000","last_fullsized":"2023-08-27T11:26:55.343220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362936+0000","last_change":"2023-08-27T11:26:55.358596+0000","last_active":"2023-08-27T11:26:55.362936+0000","last_peered":"2023-08-27T11:26:55.362936+0000","last_clean":"2023-08-27T11:26:55.362936+0000","last_became_active":"2023-08-27T11:26:55.358310+0000","last_became_peered":"2023-08-27T11:26:55.358310+0000","last_unstale":"2023-08-27T11:26:55.362936+0000","last_undegraded":"2023-08-27T11:26:55.362936+0000","last_fullsized":"2023-08-27T11:26:55.362936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:15:12.319784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.341989+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:55.341989+0000","last_peered":"2023-08-27T11:26:55.341989+0000","last_clean":"2023-08-27T11:26:55.341989+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:55.341989+0000","last_undegraded":"2023-08-27T11:26:55.341989+0000","last_fullsized":"2023-08-27T11:26:55.341989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:40.447245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":0.878},"last":0.622}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.173,"15min":1.173},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":1.083,"15min":1.083},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.135},"last":0.73699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.397,"15min":1.397},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.006,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.133,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":1.101},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":1.054}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.46899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.502}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.002}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":1.145}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.495},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.51600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63200000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61799999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61199999999999999,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73499999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1459999999999999,"5min":1.669,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.994,"15min":1.994},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.1659999999999999,"5min":2.036,"15min":2.036},"last":0.75},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97199999999999998,"5min":1.26,"15min":1.26},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82999999999999996},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1279999999999999,"5min":1.321,"15min":1.321},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.627,"15min":1.627},"last":0.70799999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0860000000000001,"5min":2.073,"15min":2.073},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.86699999999999999},"min":{"1min":0.64100000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.323,"15min":1.323},"last":0.94899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.748},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.629},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46999999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.1120000000000001,"5min":1.161,"15min":1.161},"last":0.5},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.022},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72899999999999998,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.006}]},{"osd":6,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77400000000000002,"15min":0.746},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.51600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.1240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.105,"15min":1.105},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.53400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92600000000000005,"5min":1.014,"15min":1.014},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97499999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.755}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.874,"5min":1.097,"15min":1.097},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94899999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.56299999999999994,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84999999999999998,"5min":1.744,"15min":1.744},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":1.663,"15min":1.663},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.274,"15min":1.274},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:01.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:01.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.583+0000 7f98883ff700 1 Processor -- start 2023-08-27T11:27:01.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.583+0000 7f98883ff700 1 -- start start 2023-08-27T11:27:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.584+0000 7f98883ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f98800c4630 0x7f98800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.584+0000 7f98883ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988006c4e0 con 0x7f988006ad70 2023-08-27T11:27:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.584+0000 7f98883ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9880155370 con 0x7f9880151a90 2023-08-27T11:27:01.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.584+0000 7f98883ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800c82c0 con 0x7f98800c4630 2023-08-27T11:27:01.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988599a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f98800c4630 0x7f98800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988699c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f988006ad70 0x7f988006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47442/0 (socket says 172.21.15.43:47442) 2023-08-27T11:27:01.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988699c700 1 -- 172.21.15.43:0/1531984765 learned_addr learned my addr 172.21.15.43:0/1531984765 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:01.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988599a700 1 -- 172.21.15.43:0/1531984765 >> v1:172.21.15.57:6789/0 conn(0x7f9880151a90 legacy=0x7f98800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988599a700 1 -- 172.21.15.43:0/1531984765 >> v1:172.21.15.43:6789/0 conn(0x7f988006ad70 legacy=0x7f988006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988599a700 1 -- 172.21.15.43:0/1531984765 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880151e70 con 0x7f98800c4630 2023-08-27T11:27:01.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f9885199700 1 -- 172.21.15.43:0/1531984765 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217176749 0 0) 0x7f988006c4e0 con 0x7f988006ad70 2023-08-27T11:27:01.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.585+0000 7f988599a700 1 --2- 172.21.15.43:0/1531984765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f98800c4a90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9870009840 tx=0x7f9870009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ef28da070a1282 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f9885199700 1 -- 172.21.15.43:0/1531984765 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870011830 con 0x7f98800c4630 2023-08-27T11:27:01.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f9885199700 1 -- 172.21.15.43:0/1531984765 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9870011990 con 0x7f98800c4630 2023-08-27T11:27:01.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f9885199700 1 -- 172.21.15.43:0/1531984765 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9870011d20 con 0x7f98800c4630 2023-08-27T11:27:01.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 -- 172.21.15.43:0/1531984765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 msgr2=0x7f98800c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 --2- 172.21.15.43:0/1531984765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f98800c4a90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9870009840 tx=0x7f9870009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:01.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 -- 172.21.15.43:0/1531984765 shutdown_connections 2023-08-27T11:27:01.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 --2- 172.21.15.43:0/1531984765 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f98800c4a90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 -- 172.21.15.43:0/1531984765 >> 172.21.15.43:0/1531984765 conn(0x7f98800ab820 msgr2=0x7f98800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:01.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 -- 172.21.15.43:0/1531984765 shutdown_connections 2023-08-27T11:27:01.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.586+0000 7f98883ff700 1 -- 172.21.15.43:0/1531984765 wait complete. 2023-08-27T11:27:01.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.588+0000 7f98883ff700 1 Processor -- start 2023-08-27T11:27:01.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.588+0000 7f98883ff700 1 -- start start 2023-08-27T11:27:01.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9880151a90 0x7f9880146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9880152280 con 0x7f98800c4630 2023-08-27T11:27:01.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9880146890 con 0x7f988006ad70 2023-08-27T11:27:01.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.589+0000 7f98883ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98801e9d40 con 0x7f9880151a90 2023-08-27T11:27:01.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988699c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9880151a90 0x7f9880146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988619b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:39710/0 (socket says 172.21.15.43:39710) 2023-08-27T11:27:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988619b700 1 -- 172.21.15.43:0/906399878 learned_addr learned my addr 172.21.15.43:0/906399878 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54112/0 (socket says 172.21.15.43:54112) 2023-08-27T11:27:01.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 -- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9880151a90 msgr2=0x7f9880146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9880151a90 0x7f9880146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 -- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 msgr2=0x7f9880148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 -- 172.21.15.43:0/906399878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700094a0 con 0x7f98800c4630 2023-08-27T11:27:01.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988619b700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:01.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.590+0000 7f988599a700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9870016000 tx=0x7f9870004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.591+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700045d0 con 0x7f98800c4630 2023-08-27T11:27:01.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.591+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987001f070 con 0x7f98800c4630 2023-08-27T11:27:01.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.591+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98801ea020 con 0x7f98800c4630 2023-08-27T11:27:01.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.591+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98700038a0 con 0x7f98800c4630 2023-08-27T11:27:01.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.591+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98801ea5e0 con 0x7f98800c4630 2023-08-27T11:27:01.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.592+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988006a830 con 0x7f98800c4630 2023-08-27T11:27:01.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.593+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9870003a00 con 0x7f98800c4630 2023-08-27T11:27:01.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.594+0000 7f9876ffd700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 0x7f986406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:01.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.594+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9870021070 con 0x7f98800c4630 2023-08-27T11:27:01.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.594+0000 7f988619b700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 0x7f986406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:01.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.594+0000 7f988619b700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 0x7f986406c5a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f987c001c70 tx=0x7f987c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:01.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.598+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f98700554c0 con 0x7f98800c4630 2023-08-27T11:27:01.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.804+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9880154760 con 0x7f986406a0e0 2023-08-27T11:27:01.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.814+0000 7f9876ffd700 1 -- 172.21.15.43:0/906399878 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306102 (secure 0 0 0) 0x7f987c001910 con 0x7f986406a0e0 2023-08-27T11:27:01.820 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:01.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 msgr2=0x7f986406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 0x7f986406c5a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f987c001c70 tx=0x7f987c009040 comp rx=0 tx=0).stop 2023-08-27T11:27:01.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 msgr2=0x7f9880145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:01.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9870016000 tx=0x7f9870004750 comp rx=0 tx=0).stop 2023-08-27T11:27:01.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 shutdown_connections 2023-08-27T11:27:01.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f986406a0e0 0x7f986406c5a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9880151a90 0x7f9880146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f988006ad70 0x7f9880148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 --2- 172.21.15.43:0/906399878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f98800c4630 0x7f9880145e10 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 >> 172.21.15.43:0/906399878 conn(0x7f98800ab820 msgr2=0x7f988014f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 shutdown_connections 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:01.819+0000 7f98883ff700 1 -- 172.21.15.43:0/906399878 wait complete. 2023-08-27T11:27:01.824 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:01.839 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-08-27T11:27:00.364459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":10136,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":10379264,"data_stored":5446368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001728"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342834+0000","last_change":"2023-08-27T11:26:55.342834+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342834+0000","last_undegraded":"2023-08-27T11:26:55.342834+0000","last_fullsized":"2023-08-27T11:26:55.342834+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346182+0000","last_change":"2023-08-27T11:26:55.346182+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346182+0000","last_undegraded":"2023-08-27T11:26:55.346182+0000","last_fullsized":"2023-08-27T11:26:55.346182+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344276+0000","last_change":"2023-08-27T11:26:55.344276+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344276+0000","last_undegraded":"2023-08-27T11:26:55.344276+0000","last_fullsized":"2023-08-27T11:26:55.344276+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345048+0000","last_change":"2023-08-27T11:26:55.345048+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345048+0000","last_undegraded":"2023-08-27T11:26:55.345048+0000","last_fullsized":"2023-08-27T11:26:55.345048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.352594+0000","last_change":"2023-08-27T11:26:55.352594+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.352594+0000","last_undegraded":"2023-08-27T11:26:55.352594+0000","last_fullsized":"2023-08-27T11:26:55.352594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346488+0000","last_change":"2023-08-27T11:26:55.346488+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346488+0000","last_undegraded":"2023-08-27T11:26:55.346488+0000","last_fullsized":"2023-08-27T11:26:55.346488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342034+0000","last_change":"2023-08-27T11:26:55.342034+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342034+0000","last_undegraded":"2023-08-27T11:26:55.342034+0000","last_fullsized":"2023-08-27T11:26:55.342034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342194+0000","last_change":"2023-08-27T11:26:55.342194+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342194+0000","last_undegraded":"2023-08-27T11:26:55.342194+0000","last_fullsized":"2023-08-27T11:26:55.342194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342841+0000","last_change":"2023-08-27T11:26:55.342841+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342841+0000","last_undegraded":"2023-08-27T11:26:55.342841+0000","last_fullsized":"2023-08-27T11:26:55.342841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350751+0000","last_change":"2023-08-27T11:26:55.350751+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350751+0000","last_undegraded":"2023-08-27T11:26:55.350751+0000","last_fullsized":"2023-08-27T11:26:55.350751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345929+0000","last_change":"2023-08-27T11:26:55.345929+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345929+0000","last_undegraded":"2023-08-27T11:26:55.345929+0000","last_fullsized":"2023-08-27T11:26:55.345929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345286+0000","last_change":"2023-08-27T11:26:55.345286+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345286+0000","last_undegraded":"2023-08-27T11:26:55.345286+0000","last_fullsized":"2023-08-27T11:26:55.345286+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.349504+0000","last_change":"2023-08-27T11:26:55.349504+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.349504+0000","last_undegraded":"2023-08-27T11:26:55.349504+0000","last_fullsized":"2023-08-27T11:26:55.349504+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350360+0000","last_change":"2023-08-27T11:26:55.350360+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350360+0000","last_undegraded":"2023-08-27T11:26:55.350360+0000","last_fullsized":"2023-08-27T11:26:55.350360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348018+0000","last_change":"2023-08-27T11:26:55.348018+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348018+0000","last_undegraded":"2023-08-27T11:26:55.348018+0000","last_fullsized":"2023-08-27T11:26:55.348018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342423+0000","last_change":"2023-08-27T11:26:55.342423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342423+0000","last_undegraded":"2023-08-27T11:26:55.342423+0000","last_fullsized":"2023-08-27T11:26:55.342423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345665+0000","last_change":"2023-08-27T11:26:55.345665+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345665+0000","last_undegraded":"2023-08-27T11:26:55.345665+0000","last_fullsized":"2023-08-27T11:26:55.345665+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343867+0000","last_change":"2023-08-27T11:26:55.343867+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343867+0000","last_undegraded":"2023-08-27T11:26:55.343867+0000","last_fullsized":"2023-08-27T11:26:55.343867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340061+0000","last_change":"2023-08-27T11:26:55.340061+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340061+0000","last_undegraded":"2023-08-27T11:26:55.340061+0000","last_fullsized":"2023-08-27T11:26:55.340061+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342059+0000","last_change":"2023-08-27T11:26:55.342059+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342059+0000","last_undegraded":"2023-08-27T11:26:55.342059+0000","last_fullsized":"2023-08-27T11:26:55.342059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348188+0000","last_change":"2023-08-27T11:26:55.348188+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348188+0000","last_undegraded":"2023-08-27T11:26:55.348188+0000","last_fullsized":"2023-08-27T11:26:55.348188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342123+0000","last_change":"2023-08-27T11:26:55.342123+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342123+0000","last_undegraded":"2023-08-27T11:26:55.342123+0000","last_fullsized":"2023-08-27T11:26:55.342123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351423+0000","last_change":"2023-08-27T11:26:55.351423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351423+0000","last_undegraded":"2023-08-27T11:26:55.351423+0000","last_fullsized":"2023-08-27T11:26:55.351423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340731+0000","last_change":"2023-08-27T11:26:55.340731+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340731+0000","last_undegraded":"2023-08-27T11:26:55.340731+0000","last_fullsized":"2023-08-27T11:26:55.340731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340128+0000","last_change":"2023-08-27T11:26:55.340128+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340128+0000","last_undegraded":"2023-08-27T11:26:55.340128+0000","last_fullsized":"2023-08-27T11:26:55.340128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345394+0000","last_change":"2023-08-27T11:26:55.345394+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345394+0000","last_undegraded":"2023-08-27T11:26:55.345394+0000","last_fullsized":"2023-08-27T11:26:55.345394+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344492+0000","last_change":"2023-08-27T11:26:55.344492+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344492+0000","last_undegraded":"2023-08-27T11:26:55.344492+0000","last_fullsized":"2023-08-27T11:26:55.344492+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341625+0000","last_change":"2023-08-27T11:26:55.341625+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341625+0000","last_undegraded":"2023-08-27T11:26:55.341625+0000","last_fullsized":"2023-08-27T11:26:55.341625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341466+0000","last_change":"2023-08-27T11:26:55.341466+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341466+0000","last_undegraded":"2023-08-27T11:26:55.341466+0000","last_fullsized":"2023-08-27T11:26:55.341466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341527+0000","last_change":"2023-08-27T11:26:55.341527+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341527+0000","last_undegraded":"2023-08-27T11:26:55.341527+0000","last_fullsized":"2023-08-27T11:26:55.341527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341738+0000","last_change":"2023-08-27T11:26:55.341738+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341738+0000","last_undegraded":"2023-08-27T11:26:55.341738+0000","last_fullsized":"2023-08-27T11:26:55.341738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341773+0000","last_change":"2023-08-27T11:26:55.341773+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341773+0000","last_undegraded":"2023-08-27T11:26:55.341773+0000","last_fullsized":"2023-08-27T11:26:55.341773+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363089+0000","last_change":"2023-08-27T11:26:55.361418+0000","last_active":"2023-08-27T11:26:55.363089+0000","last_peered":"2023-08-27T11:26:55.363089+0000","last_clean":"2023-08-27T11:26:55.363089+0000","last_became_active":"2023-08-27T11:26:55.361075+0000","last_became_peered":"2023-08-27T11:26:55.361075+0000","last_unstale":"2023-08-27T11:26:55.363089+0000","last_undegraded":"2023-08-27T11:26:55.363089+0000","last_fullsized":"2023-08-27T11:26:55.363089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:17:29.007239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340858+0000","last_change":"2023-08-27T11:26:55.340858+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340858+0000","last_undegraded":"2023-08-27T11:26:55.340858+0000","last_fullsized":"2023-08-27T11:26:55.340858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363927+0000","last_change":"2023-08-27T11:26:55.360037+0000","last_active":"2023-08-27T11:26:55.363927+0000","last_peered":"2023-08-27T11:26:55.363927+0000","last_clean":"2023-08-27T11:26:55.363927+0000","last_became_active":"2023-08-27T11:26:55.359712+0000","last_became_peered":"2023-08-27T11:26:55.359712+0000","last_unstale":"2023-08-27T11:26:55.363927+0000","last_undegraded":"2023-08-27T11:26:55.363927+0000","last_fullsized":"2023-08-27T11:26:55.363927+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:04.980678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339985+0000","last_change":"2023-08-27T11:26:55.339985+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339985+0000","last_undegraded":"2023-08-27T11:26:55.339985+0000","last_fullsized":"2023-08-27T11:26:55.339985+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361264+0000","last_change":"2023-08-27T11:26:55.353142+0000","last_active":"2023-08-27T11:26:55.361264+0000","last_peered":"2023-08-27T11:26:55.361264+0000","last_clean":"2023-08-27T11:26:55.361264+0000","last_became_active":"2023-08-27T11:26:55.352351+0000","last_became_peered":"2023-08-27T11:26:55.352351+0000","last_unstale":"2023-08-27T11:26:55.361264+0000","last_undegraded":"2023-08-27T11:26:55.361264+0000","last_fullsized":"2023-08-27T11:26:55.361264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.135590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344280+0000","last_change":"2023-08-27T11:26:55.344280+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344280+0000","last_undegraded":"2023-08-27T11:26:55.344280+0000","last_fullsized":"2023-08-27T11:26:55.344280+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.364740+0000","last_change":"2023-08-27T11:26:55.363797+0000","last_active":"2023-08-27T11:26:55.364740+0000","last_peered":"2023-08-27T11:26:55.364740+0000","last_clean":"2023-08-27T11:26:55.364740+0000","last_became_active":"2023-08-27T11:26:55.363472+0000","last_became_peered":"2023-08-27T11:26:55.363472+0000","last_unstale":"2023-08-27T11:26:55.364740+0000","last_undegraded":"2023-08-27T11:26:55.364740+0000","last_fullsized":"2023-08-27T11:26:55.364740+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:45.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344569+0000","last_change":"2023-08-27T11:26:55.344569+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344569+0000","last_undegraded":"2023-08-27T11:26:55.344569+0000","last_fullsized":"2023-08-27T11:26:55.344569+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362032+0000","last_change":"2023-08-27T11:26:55.360072+0000","last_active":"2023-08-27T11:26:55.362032+0000","last_peered":"2023-08-27T11:26:55.362032+0000","last_clean":"2023-08-27T11:26:55.362032+0000","last_became_active":"2023-08-27T11:26:55.359779+0000","last_became_peered":"2023-08-27T11:26:55.359779+0000","last_unstale":"2023-08-27T11:26:55.362032+0000","last_undegraded":"2023-08-27T11:26:55.362032+0000","last_fullsized":"2023-08-27T11:26:55.362032+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:17.884593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342891+0000","last_change":"2023-08-27T11:26:55.342891+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342891+0000","last_undegraded":"2023-08-27T11:26:55.342891+0000","last_fullsized":"2023-08-27T11:26:55.342891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358914+0000","last_change":"2023-08-27T11:26:55.355107+0000","last_active":"2023-08-27T11:26:55.358914+0000","last_peered":"2023-08-27T11:26:55.358914+0000","last_clean":"2023-08-27T11:26:55.358914+0000","last_became_active":"2023-08-27T11:26:55.354728+0000","last_became_peered":"2023-08-27T11:26:55.354728+0000","last_unstale":"2023-08-27T11:26:55.358914+0000","last_undegraded":"2023-08-27T11:26:55.358914+0000","last_fullsized":"2023-08-27T11:26:55.358914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:41.392123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345151+0000","last_change":"2023-08-27T11:26:55.345151+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345151+0000","last_undegraded":"2023-08-27T11:26:55.345151+0000","last_fullsized":"2023-08-27T11:26:55.345151+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361306+0000","last_change":"2023-08-27T11:26:55.353051+0000","last_active":"2023-08-27T11:26:55.361306+0000","last_peered":"2023-08-27T11:26:55.361306+0000","last_clean":"2023-08-27T11:26:55.361306+0000","last_became_active":"2023-08-27T11:26:55.352606+0000","last_became_peered":"2023-08-27T11:26:55.352606+0000","last_unstale":"2023-08-27T11:26:55.361306+0000","last_undegraded":"2023-08-27T11:26:55.361306+0000","last_fullsized":"2023-08-27T11:26:55.361306+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:42:03.018322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344561+0000","last_change":"2023-08-27T11:26:55.344561+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344561+0000","last_undegraded":"2023-08-27T11:26:55.344561+0000","last_fullsized":"2023-08-27T11:26:55.344561+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361810+0000","last_change":"2023-08-27T11:26:55.356739+0000","last_active":"2023-08-27T11:26:55.361810+0000","last_peered":"2023-08-27T11:26:55.361810+0000","last_clean":"2023-08-27T11:26:55.361810+0000","last_became_active":"2023-08-27T11:26:55.356419+0000","last_became_peered":"2023-08-27T11:26:55.356419+0000","last_unstale":"2023-08-27T11:26:55.361810+0000","last_undegraded":"2023-08-27T11:26:55.361810+0000","last_fullsized":"2023-08-27T11:26:55.361810+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:10:58.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344602+0000","last_change":"2023-08-27T11:26:55.344602+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344602+0000","last_undegraded":"2023-08-27T11:26:55.344602+0000","last_fullsized":"2023-08-27T11:26:55.344602+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.352949+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.352563+0000","last_became_peered":"2023-08-27T11:26:55.352563+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350395+0000","last_change":"2023-08-27T11:26:55.350395+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350395+0000","last_undegraded":"2023-08-27T11:26:55.350395+0000","last_fullsized":"2023-08-27T11:26:55.350395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360398+0000","last_change":"2023-08-27T11:26:55.356564+0000","last_active":"2023-08-27T11:26:55.360398+0000","last_peered":"2023-08-27T11:26:55.360398+0000","last_clean":"2023-08-27T11:26:55.360398+0000","last_became_active":"2023-08-27T11:26:55.356302+0000","last_became_peered":"2023-08-27T11:26:55.356302+0000","last_unstale":"2023-08-27T11:26:55.360398+0000","last_undegraded":"2023-08-27T11:26:55.360398+0000","last_fullsized":"2023-08-27T11:26:55.360398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:38.563053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342715+0000","last_change":"2023-08-27T11:26:55.342715+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342715+0000","last_undegraded":"2023-08-27T11:26:55.342715+0000","last_fullsized":"2023-08-27T11:26:55.342715+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361992+0000","last_change":"2023-08-27T11:26:55.359460+0000","last_active":"2023-08-27T11:26:55.361992+0000","last_peered":"2023-08-27T11:26:55.361992+0000","last_clean":"2023-08-27T11:26:55.361992+0000","last_became_active":"2023-08-27T11:26:55.359161+0000","last_became_peered":"2023-08-27T11:26:55.359161+0000","last_unstale":"2023-08-27T11:26:55.361992+0000","last_undegraded":"2023-08-27T11:26:55.361992+0000","last_fullsized":"2023-08-27T11:26:55.361992+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:38.425259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348723+0000","last_change":"2023-08-27T11:26:55.348723+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348723+0000","last_undegraded":"2023-08-27T11:26:55.348723+0000","last_fullsized":"2023-08-27T11:26:55.348723+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360772+0000","last_change":"2023-08-27T11:26:55.358248+0000","last_active":"2023-08-27T11:26:55.360772+0000","last_peered":"2023-08-27T11:26:55.360772+0000","last_clean":"2023-08-27T11:26:55.360772+0000","last_became_active":"2023-08-27T11:26:55.357893+0000","last_became_peered":"2023-08-27T11:26:55.357893+0000","last_unstale":"2023-08-27T11:26:55.360772+0000","last_undegraded":"2023-08-27T11:26:55.360772+0000","last_fullsized":"2023-08-27T11:26:55.360772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:57.363969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343315+0000","last_change":"2023-08-27T11:26:55.343315+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343315+0000","last_undegraded":"2023-08-27T11:26:55.343315+0000","last_fullsized":"2023-08-27T11:26:55.343315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360404+0000","last_change":"2023-08-27T11:26:55.358644+0000","last_active":"2023-08-27T11:26:55.360404+0000","last_peered":"2023-08-27T11:26:55.360404+0000","last_clean":"2023-08-27T11:26:55.360404+0000","last_became_active":"2023-08-27T11:26:55.358327+0000","last_became_peered":"2023-08-27T11:26:55.358327+0000","last_unstale":"2023-08-27T11:26:55.360404+0000","last_undegraded":"2023-08-27T11:26:55.360404+0000","last_fullsized":"2023-08-27T11:26:55.360404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:21:44.354240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341362+0000","last_change":"2023-08-27T11:26:55.341362+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341362+0000","last_undegraded":"2023-08-27T11:26:55.341362+0000","last_fullsized":"2023-08-27T11:26:55.341362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363654+0000","last_change":"2023-08-27T11:26:55.361664+0000","last_active":"2023-08-27T11:26:55.363654+0000","last_peered":"2023-08-27T11:26:55.363654+0000","last_clean":"2023-08-27T11:26:55.363654+0000","last_became_active":"2023-08-27T11:26:55.361207+0000","last_became_peered":"2023-08-27T11:26:55.361207+0000","last_unstale":"2023-08-27T11:26:55.363654+0000","last_undegraded":"2023-08-27T11:26:55.363654+0000","last_fullsized":"2023-08-27T11:26:55.363654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:48:50.318507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346401+0000","last_change":"2023-08-27T11:26:55.346401+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346401+0000","last_undegraded":"2023-08-27T11:26:55.346401+0000","last_fullsized":"2023-08-27T11:26:55.346401+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356904+0000","last_change":"2023-08-27T11:26:55.349997+0000","last_active":"2023-08-27T11:26:55.356904+0000","last_peered":"2023-08-27T11:26:55.356904+0000","last_clean":"2023-08-27T11:26:55.356904+0000","last_became_active":"2023-08-27T11:26:55.349692+0000","last_became_peered":"2023-08-27T11:26:55.349692+0000","last_unstale":"2023-08-27T11:26:55.356904+0000","last_undegraded":"2023-08-27T11:26:55.356904+0000","last_fullsized":"2023-08-27T11:26:55.356904+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:10.455327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341846+0000","last_change":"2023-08-27T11:26:55.341846+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341846+0000","last_undegraded":"2023-08-27T11:26:55.341846+0000","last_fullsized":"2023-08-27T11:26:55.341846+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.353773+0000","last_change":"2023-08-27T11:26:55.348680+0000","last_active":"2023-08-27T11:26:55.353773+0000","last_peered":"2023-08-27T11:26:55.353773+0000","last_clean":"2023-08-27T11:26:55.353773+0000","last_became_active":"2023-08-27T11:26:55.348359+0000","last_became_peered":"2023-08-27T11:26:55.348359+0000","last_unstale":"2023-08-27T11:26:55.353773+0000","last_undegraded":"2023-08-27T11:26:55.353773+0000","last_fullsized":"2023-08-27T11:26:55.353773+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:58.876923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345010+0000","last_change":"2023-08-27T11:26:55.345010+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345010+0000","last_undegraded":"2023-08-27T11:26:55.345010+0000","last_fullsized":"2023-08-27T11:26:55.345010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363187+0000","last_change":"2023-08-27T11:26:55.361849+0000","last_active":"2023-08-27T11:26:55.363187+0000","last_peered":"2023-08-27T11:26:55.363187+0000","last_clean":"2023-08-27T11:26:55.363187+0000","last_became_active":"2023-08-27T11:26:55.361557+0000","last_became_peered":"2023-08-27T11:26:55.361557+0000","last_unstale":"2023-08-27T11:26:55.363187+0000","last_undegraded":"2023-08-27T11:26:55.363187+0000","last_fullsized":"2023-08-27T11:26:55.363187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:13.145297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356857+0000","last_change":"2023-08-27T11:26:55.354496+0000","last_active":"2023-08-27T11:26:55.356857+0000","last_peered":"2023-08-27T11:26:55.356857+0000","last_clean":"2023-08-27T11:26:55.356857+0000","last_became_active":"2023-08-27T11:26:55.354179+0000","last_became_peered":"2023-08-27T11:26:55.354179+0000","last_unstale":"2023-08-27T11:26:55.356857+0000","last_undegraded":"2023-08-27T11:26:55.356857+0000","last_fullsized":"2023-08-27T11:26:55.356857+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:38:08.578329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345373+0000","last_change":"2023-08-27T11:26:55.345373+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345373+0000","last_undegraded":"2023-08-27T11:26:55.345373+0000","last_fullsized":"2023-08-27T11:26:55.345373+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358532+0000","last_change":"2023-08-27T11:26:55.356722+0000","last_active":"2023-08-27T11:26:55.358532+0000","last_peered":"2023-08-27T11:26:55.358532+0000","last_clean":"2023-08-27T11:26:55.358532+0000","last_became_active":"2023-08-27T11:26:55.356411+0000","last_became_peered":"2023-08-27T11:26:55.356411+0000","last_unstale":"2023-08-27T11:26:55.358532+0000","last_undegraded":"2023-08-27T11:26:55.358532+0000","last_fullsized":"2023-08-27T11:26:55.358532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344791+0000","last_change":"2023-08-27T11:26:55.344791+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344791+0000","last_undegraded":"2023-08-27T11:26:55.344791+0000","last_fullsized":"2023-08-27T11:26:55.344791+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362293+0000","last_change":"2023-08-27T11:26:55.359591+0000","last_active":"2023-08-27T11:26:55.362293+0000","last_peered":"2023-08-27T11:26:55.362293+0000","last_clean":"2023-08-27T11:26:55.362293+0000","last_became_active":"2023-08-27T11:26:55.359302+0000","last_became_peered":"2023-08-27T11:26:55.359302+0000","last_unstale":"2023-08-27T11:26:55.362293+0000","last_undegraded":"2023-08-27T11:26:55.362293+0000","last_fullsized":"2023-08-27T11:26:55.362293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:24.927191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344898+0000","last_change":"2023-08-27T11:26:55.344898+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344898+0000","last_undegraded":"2023-08-27T11:26:55.344898+0000","last_fullsized":"2023-08-27T11:26:55.344898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.349533+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.349211+0000","last_became_peered":"2023-08-27T11:26:55.349211+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346688+0000","last_change":"2023-08-27T11:26:55.346688+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346688+0000","last_undegraded":"2023-08-27T11:26:55.346688+0000","last_fullsized":"2023-08-27T11:26:55.346688+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356348+0000","last_change":"2023-08-27T11:26:55.351607+0000","last_active":"2023-08-27T11:26:55.356348+0000","last_peered":"2023-08-27T11:26:55.356348+0000","last_clean":"2023-08-27T11:26:55.356348+0000","last_became_active":"2023-08-27T11:26:55.351289+0000","last_became_peered":"2023-08-27T11:26:55.351289+0000","last_unstale":"2023-08-27T11:26:55.356348+0000","last_undegraded":"2023-08-27T11:26:55.356348+0000","last_fullsized":"2023-08-27T11:26:55.356348+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:50:44.282014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348709+0000","last_change":"2023-08-27T11:26:55.348709+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348709+0000","last_undegraded":"2023-08-27T11:26:55.348709+0000","last_fullsized":"2023-08-27T11:26:55.348709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359500+0000","last_change":"2023-08-27T11:26:55.357412+0000","last_active":"2023-08-27T11:26:55.359500+0000","last_peered":"2023-08-27T11:26:55.359500+0000","last_clean":"2023-08-27T11:26:55.359500+0000","last_became_active":"2023-08-27T11:26:55.357099+0000","last_became_peered":"2023-08-27T11:26:55.357099+0000","last_unstale":"2023-08-27T11:26:55.359500+0000","last_undegraded":"2023-08-27T11:26:55.359500+0000","last_fullsized":"2023-08-27T11:26:55.359500+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:30.521591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346959+0000","last_change":"2023-08-27T11:26:55.346959+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346959+0000","last_undegraded":"2023-08-27T11:26:55.346959+0000","last_fullsized":"2023-08-27T11:26:55.346959+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357108+0000","last_change":"2023-08-27T11:26:55.350845+0000","last_active":"2023-08-27T11:26:55.357108+0000","last_peered":"2023-08-27T11:26:55.357108+0000","last_clean":"2023-08-27T11:26:55.357108+0000","last_became_active":"2023-08-27T11:26:55.350307+0000","last_became_peered":"2023-08-27T11:26:55.350307+0000","last_unstale":"2023-08-27T11:26:55.357108+0000","last_undegraded":"2023-08-27T11:26:55.357108+0000","last_fullsized":"2023-08-27T11:26:55.357108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:32:33.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345795+0000","last_change":"2023-08-27T11:26:55.345795+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345795+0000","last_undegraded":"2023-08-27T11:26:55.345795+0000","last_fullsized":"2023-08-27T11:26:55.345795+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360366+0000","last_change":"2023-08-27T11:26:55.358238+0000","last_active":"2023-08-27T11:26:55.360366+0000","last_peered":"2023-08-27T11:26:55.360366+0000","last_clean":"2023-08-27T11:26:55.360366+0000","last_became_active":"2023-08-27T11:26:55.357924+0000","last_became_peered":"2023-08-27T11:26:55.357924+0000","last_unstale":"2023-08-27T11:26:55.360366+0000","last_undegraded":"2023-08-27T11:26:55.360366+0000","last_fullsized":"2023-08-27T11:26:55.360366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:46.627644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.340442+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:55.340442+0000","last_peered":"2023-08-27T11:26:55.340442+0000","last_clean":"2023-08-27T11:26:55.340442+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:55.340442+0000","last_undegraded":"2023-08-27T11:26:55.340442+0000","last_fullsized":"2023-08-27T11:26:55.340442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:09.713247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345410+0000","last_change":"2023-08-27T11:26:55.345410+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345410+0000","last_undegraded":"2023-08-27T11:26:55.345410+0000","last_fullsized":"2023-08-27T11:26:55.345410+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359760+0000","last_change":"2023-08-27T11:26:55.353113+0000","last_active":"2023-08-27T11:26:55.359760+0000","last_peered":"2023-08-27T11:26:55.359760+0000","last_clean":"2023-08-27T11:26:55.359760+0000","last_became_active":"2023-08-27T11:26:55.352818+0000","last_became_peered":"2023-08-27T11:26:55.352818+0000","last_unstale":"2023-08-27T11:26:55.359760+0000","last_undegraded":"2023-08-27T11:26:55.359760+0000","last_fullsized":"2023-08-27T11:26:55.359760+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:17.865194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.339834+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:55.339834+0000","last_peered":"2023-08-27T11:26:55.339834+0000","last_clean":"2023-08-27T11:26:55.339834+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:55.339834+0000","last_undegraded":"2023-08-27T11:26:55.339834+0000","last_fullsized":"2023-08-27T11:26:55.339834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:40.454581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341294+0000","last_change":"2023-08-27T11:26:55.341294+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341294+0000","last_undegraded":"2023-08-27T11:26:55.341294+0000","last_fullsized":"2023-08-27T11:26:55.341294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357206+0000","last_change":"2023-08-27T11:26:55.347843+0000","last_active":"2023-08-27T11:26:55.357206+0000","last_peered":"2023-08-27T11:26:55.357206+0000","last_clean":"2023-08-27T11:26:55.357206+0000","last_became_active":"2023-08-27T11:26:55.347517+0000","last_became_peered":"2023-08-27T11:26:55.347517+0000","last_unstale":"2023-08-27T11:26:55.357206+0000","last_undegraded":"2023-08-27T11:26:55.357206+0000","last_fullsized":"2023-08-27T11:26:55.357206+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.343966+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:55.343966+0000","last_peered":"2023-08-27T11:26:55.343966+0000","last_clean":"2023-08-27T11:26:55.343966+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:55.343966+0000","last_undegraded":"2023-08-27T11:26:55.343966+0000","last_fullsized":"2023-08-27T11:26:55.343966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:16:48.156023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343664+0000","last_change":"2023-08-27T11:26:55.343664+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343664+0000","last_undegraded":"2023-08-27T11:26:55.343664+0000","last_fullsized":"2023-08-27T11:26:55.343664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362963+0000","last_change":"2023-08-27T11:26:55.356624+0000","last_active":"2023-08-27T11:26:55.362963+0000","last_peered":"2023-08-27T11:26:55.362963+0000","last_clean":"2023-08-27T11:26:55.362963+0000","last_became_active":"2023-08-27T11:26:55.355441+0000","last_became_peered":"2023-08-27T11:26:55.355441+0000","last_unstale":"2023-08-27T11:26:55.362963+0000","last_undegraded":"2023-08-27T11:26:55.362963+0000","last_fullsized":"2023-08-27T11:26:55.362963+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:39.941432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351632+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:55.351632+0000","last_peered":"2023-08-27T11:26:55.351632+0000","last_clean":"2023-08-27T11:26:55.351632+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:55.351632+0000","last_undegraded":"2023-08-27T11:26:55.351632+0000","last_fullsized":"2023-08-27T11:26:55.351632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:53.487197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351828+0000","last_change":"2023-08-27T11:26:55.351828+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351828+0000","last_undegraded":"2023-08-27T11:26:55.351828+0000","last_fullsized":"2023-08-27T11:26:55.351828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362612+0000","last_change":"2023-08-27T11:26:55.360320+0000","last_active":"2023-08-27T11:26:55.362612+0000","last_peered":"2023-08-27T11:26:55.362612+0000","last_clean":"2023-08-27T11:26:55.362612+0000","last_became_active":"2023-08-27T11:26:55.359906+0000","last_became_peered":"2023-08-27T11:26:55.359906+0000","last_unstale":"2023-08-27T11:26:55.362612+0000","last_undegraded":"2023-08-27T11:26:55.362612+0000","last_fullsized":"2023-08-27T11:26:55.362612+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:02.843096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.352880+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:55.352880+0000","last_peered":"2023-08-27T11:26:55.352880+0000","last_clean":"2023-08-27T11:26:55.352880+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:55.352880+0000","last_undegraded":"2023-08-27T11:26:55.352880+0000","last_fullsized":"2023-08-27T11:26:55.352880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:04.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341749+0000","last_change":"2023-08-27T11:26:55.341749+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341749+0000","last_undegraded":"2023-08-27T11:26:55.341749+0000","last_fullsized":"2023-08-27T11:26:55.341749+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.365159+0000","last_change":"2023-08-27T11:26:55.364141+0000","last_active":"2023-08-27T11:26:55.365159+0000","last_peered":"2023-08-27T11:26:55.365159+0000","last_clean":"2023-08-27T11:26:55.365159+0000","last_became_active":"2023-08-27T11:26:55.363814+0000","last_became_peered":"2023-08-27T11:26:55.363814+0000","last_unstale":"2023-08-27T11:26:55.365159+0000","last_undegraded":"2023-08-27T11:26:55.365159+0000","last_fullsized":"2023-08-27T11:26:55.365159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:04:39.207247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":293,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351457+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:55.351457+0000","last_peered":"2023-08-27T11:26:55.351457+0000","last_clean":"2023-08-27T11:26:55.351457+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:55.351457+0000","last_undegraded":"2023-08-27T11:26:55.351457+0000","last_fullsized":"2023-08-27T11:26:55.351457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:40:24.249582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.354505+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:55.354505+0000","last_peered":"2023-08-27T11:26:55.354505+0000","last_clean":"2023-08-27T11:26:55.354505+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:55.354505+0000","last_undegraded":"2023-08-27T11:26:55.354505+0000","last_fullsized":"2023-08-27T11:26:55.354505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:27:09.713560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343383+0000","last_change":"2023-08-27T11:26:55.343383+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343383+0000","last_undegraded":"2023-08-27T11:26:55.343383+0000","last_fullsized":"2023-08-27T11:26:55.343383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363057+0000","last_change":"2023-08-27T11:26:55.356213+0000","last_active":"2023-08-27T11:26:55.363057+0000","last_peered":"2023-08-27T11:26:55.363057+0000","last_clean":"2023-08-27T11:26:55.363057+0000","last_became_active":"2023-08-27T11:26:55.355932+0000","last_became_peered":"2023-08-27T11:26:55.355932+0000","last_unstale":"2023-08-27T11:26:55.363057+0000","last_undegraded":"2023-08-27T11:26:55.363057+0000","last_fullsized":"2023-08-27T11:26:55.363057+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:14:17.592043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.347429+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:55.347429+0000","last_peered":"2023-08-27T11:26:55.347429+0000","last_clean":"2023-08-27T11:26:55.347429+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:55.347429+0000","last_undegraded":"2023-08-27T11:26:55.347429+0000","last_fullsized":"2023-08-27T11:26:55.347429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:36:49.239378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343220+0000","last_change":"2023-08-27T11:26:55.343220+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343220+0000","last_undegraded":"2023-08-27T11:26:55.343220+0000","last_fullsized":"2023-08-27T11:26:55.343220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362936+0000","last_change":"2023-08-27T11:26:55.358596+0000","last_active":"2023-08-27T11:26:55.362936+0000","last_peered":"2023-08-27T11:26:55.362936+0000","last_clean":"2023-08-27T11:26:55.362936+0000","last_became_active":"2023-08-27T11:26:55.358310+0000","last_became_peered":"2023-08-27T11:26:55.358310+0000","last_unstale":"2023-08-27T11:26:55.362936+0000","last_undegraded":"2023-08-27T11:26:55.362936+0000","last_fullsized":"2023-08-27T11:26:55.362936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:15:12.319784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.341989+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:55.341989+0000","last_peered":"2023-08-27T11:26:55.341989+0000","last_clean":"2023-08-27T11:26:55.341989+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:55.341989+0000","last_undegraded":"2023-08-27T11:26:55.341989+0000","last_fullsized":"2023-08-27T11:26:55.341989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:40.447245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":0.878},"last":0.622}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.173,"15min":1.173},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":1.083,"15min":1.083},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.135},"last":0.73699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.397,"15min":1.397},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.006,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.133,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":1.101},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":1.054}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.46899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.502}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.002}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":1.145}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.495},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.51600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63200000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61799999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61199999999999999,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73499999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1459999999999999,"5min":1.669,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.994,"15min":1.994},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.1659999999999999,"5min":2.036,"15min":2.036},"last":0.75},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97199999999999998,"5min":1.26,"15min":1.26},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82999999999999996},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1279999999999999,"5min":1.321,"15min":1.321},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.627,"15min":1.627},"last":0.70799999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0860000000000001,"5min":2.073,"15min":2.073},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.86699999999999999},"min":{"1min":0.64100000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.323,"15min":1.323},"last":0.94899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.748},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.629},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46999999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.1120000000000001,"5min":1.161,"15min":1.161},"last":0.5},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.022},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72899999999999998,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.006}]},{"osd":6,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77400000000000002,"15min":0.746},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.51600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.1240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.105,"15min":1.105},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.53400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92600000000000005,"5min":1.014,"15min":1.014},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97499999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.755}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.874,"5min":1.097,"15min":1.097},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94899999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.56299999999999994,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84999999999999998,"5min":1.744,"15min":1.744},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":1.663,"15min":1.663},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.274,"15min":1.274},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:01.845 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.078+0000 7fa0cc1ff700 1 Processor -- start 2023-08-27T11:27:02.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.079+0000 7fa0cc1ff700 1 -- start start 2023-08-27T11:27:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0cc1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa0c406ca60 0x7fa0c406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0cc1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c4155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0cc1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c406d700 con 0x7fa0c40c51a0 2023-08-27T11:27:02.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0cc1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c41530b0 con 0x7fa0c406ca60 2023-08-27T11:27:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0cc1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414c860 con 0x7fa0c4155910 2023-08-27T11:27:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0c9f9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa0c40c51a0 0x7fa0c40aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47452/0 (socket says 172.21.15.43:47452) 2023-08-27T11:27:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0c9f9b700 1 -- 172.21.15.43:0/3862507727 learned_addr learned my addr 172.21.15.43:0/3862507727 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3862507727 >> v2:172.21.15.43:3300/0 conn(0x7fa0c406ca60 0x7fa0c406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.080+0000 7fa0ca79c700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c4155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c979a700 1 -- 172.21.15.43:0/3862507727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 msgr2=0x7fa0c4155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c8f99700 1 -- 172.21.15.43:0/3862507727 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929358769 0 0) 0x7fa0c406d700 con 0x7fa0c40c51a0 2023-08-27T11:27:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c4155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c979a700 1 -- 172.21.15.43:0/3862507727 >> v1:172.21.15.43:6789/0 conn(0x7fa0c40c51a0 legacy=0x7fa0c40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c979a700 1 -- 172.21.15.43:0/3862507727 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c4152430 con 0x7fa0c406ca60 2023-08-27T11:27:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c406d1c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009870 tx=0x7fa0b4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fcda5cdcd573a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c8f99700 1 -- 172.21.15.43:0/3862507727 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011830 con 0x7fa0c406ca60 2023-08-27T11:27:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c8f99700 1 -- 172.21.15.43:0/3862507727 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4011990 con 0x7fa0c406ca60 2023-08-27T11:27:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.081+0000 7fa0c8f99700 1 -- 172.21.15.43:0/3862507727 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011d20 con 0x7fa0c406ca60 2023-08-27T11:27:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3862507727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 msgr2=0x7fa0c406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c406d1c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009870 tx=0x7fa0b4009b80 comp rx=0 tx=0).stop 2023-08-27T11:27:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3862507727 shutdown_connections 2023-08-27T11:27:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c4155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3862507727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c406d1c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3862507727 >> 172.21.15.43:0/3862507727 conn(0x7fa0c406aa50 msgr2=0x7fa0c40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:02.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3862507727 shutdown_connections 2023-08-27T11:27:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.082+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3862507727 wait complete. 2023-08-27T11:27:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.084+0000 7fa0cc1ff700 1 Processor -- start 2023-08-27T11:27:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.084+0000 7fa0cc1ff700 1 -- start start 2023-08-27T11:27:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40c51a0 0x7fa0c40bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c41e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414d490 con 0x7fa0c406ca60 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414ef00 con 0x7fa0c40c51a0 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0cc1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c414e8f0 con 0x7fa0c4155910 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54128/0 (socket says 172.21.15.43:54128) 2023-08-27T11:27:02.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 -- 172.21.15.43:0/3592034273 learned_addr learned my addr 172.21.15.43:0/3592034273 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:02.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40c51a0 0x7fa0c40bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0ca79c700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c41e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 -- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 msgr2=0x7fa0c41e74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c41e74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 -- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40c51a0 msgr2=0x7fa0c40bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40c51a0 0x7fa0c40bbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.085+0000 7fa0c9f9b700 1 -- 172.21.15.43:0/3592034273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40094a0 con 0x7fa0c406ca60 2023-08-27T11:27:02.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0c9f9b700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00011e0 tx=0x7fa0c000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0004c80 con 0x7fa0c406ca60 2023-08-27T11:27:02.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c0004e00 con 0x7fa0c406ca60 2023-08-27T11:27:02.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0007310 con 0x7fa0c406ca60 2023-08-27T11:27:02.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c414ced0 con 0x7fa0c406ca60 2023-08-27T11:27:02.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.086+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c414eb90 con 0x7fa0c406ca60 2023-08-27T11:27:02.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.087+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c40a7160 con 0x7fa0c406ca60 2023-08-27T11:27:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.088+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0c0007470 con 0x7fa0c406ca60 2023-08-27T11:27:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.089+0000 7fa0ba7fc700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 0x7fa0a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.089+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0c0088220 con 0x7fa0c406ca60 2023-08-27T11:27:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.089+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 0x7fa0a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.090+0000 7fa0c979a700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 0x7fa0a806c5a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.093+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa0c0053900 con 0x7fa0c406ca60 2023-08-27T11:27:02.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.298+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0c41529f0 con 0x7fa0a806a0e0 2023-08-27T11:27:02.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.309+0000 7fa0ba7fc700 1 -- 172.21.15.43:0/3592034273 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306102 (secure 0 0 0) 0x7fa0b4011c00 con 0x7fa0a806a0e0 2023-08-27T11:27:02.314 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:02.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 msgr2=0x7fa0a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 0x7fa0a806c5a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40097c0 tx=0x7fa0b4008030 comp rx=0 tx=0).stop 2023-08-27T11:27:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 msgr2=0x7fa0c40a6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00011e0 tx=0x7fa0c000ca30 comp rx=0 tx=0).stop 2023-08-27T11:27:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 shutdown_connections 2023-08-27T11:27:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa0a806a0e0 0x7fa0a806c5a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0c4155910 0x7fa0c41e74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa0c406ca60 0x7fa0c40a6b60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 --2- 172.21.15.43:0/3592034273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0c40c51a0 0x7fa0c40bbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.313+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 >> 172.21.15.43:0/3592034273 conn(0x7fa0c406aa50 msgr2=0x7fa0c4155d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.314+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 shutdown_connections 2023-08-27T11:27:02.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.314+0000 7fa0cc1ff700 1 -- 172.21.15.43:0/3592034273 wait complete. 2023-08-27T11:27:02.319 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:02.333 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-08-27T11:27:00.364459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226296,"kb_used_data":10136,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754748424,"statfs":{"total":773094113280,"available":772862386176,"internally_reserved":0,"allocated":10379264,"data_stored":5446368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001728"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342834+0000","last_change":"2023-08-27T11:26:55.342834+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342834+0000","last_undegraded":"2023-08-27T11:26:55.342834+0000","last_fullsized":"2023-08-27T11:26:55.342834+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346182+0000","last_change":"2023-08-27T11:26:55.346182+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346182+0000","last_undegraded":"2023-08-27T11:26:55.346182+0000","last_fullsized":"2023-08-27T11:26:55.346182+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344276+0000","last_change":"2023-08-27T11:26:55.344276+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344276+0000","last_undegraded":"2023-08-27T11:26:55.344276+0000","last_fullsized":"2023-08-27T11:26:55.344276+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345048+0000","last_change":"2023-08-27T11:26:55.345048+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345048+0000","last_undegraded":"2023-08-27T11:26:55.345048+0000","last_fullsized":"2023-08-27T11:26:55.345048+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.352594+0000","last_change":"2023-08-27T11:26:55.352594+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.352594+0000","last_undegraded":"2023-08-27T11:26:55.352594+0000","last_fullsized":"2023-08-27T11:26:55.352594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346488+0000","last_change":"2023-08-27T11:26:55.346488+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346488+0000","last_undegraded":"2023-08-27T11:26:55.346488+0000","last_fullsized":"2023-08-27T11:26:55.346488+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342034+0000","last_change":"2023-08-27T11:26:55.342034+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342034+0000","last_undegraded":"2023-08-27T11:26:55.342034+0000","last_fullsized":"2023-08-27T11:26:55.342034+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342194+0000","last_change":"2023-08-27T11:26:55.342194+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342194+0000","last_undegraded":"2023-08-27T11:26:55.342194+0000","last_fullsized":"2023-08-27T11:26:55.342194+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342841+0000","last_change":"2023-08-27T11:26:55.342841+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342841+0000","last_undegraded":"2023-08-27T11:26:55.342841+0000","last_fullsized":"2023-08-27T11:26:55.342841+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350751+0000","last_change":"2023-08-27T11:26:55.350751+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350751+0000","last_undegraded":"2023-08-27T11:26:55.350751+0000","last_fullsized":"2023-08-27T11:26:55.350751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345929+0000","last_change":"2023-08-27T11:26:55.345929+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345929+0000","last_undegraded":"2023-08-27T11:26:55.345929+0000","last_fullsized":"2023-08-27T11:26:55.345929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345286+0000","last_change":"2023-08-27T11:26:55.345286+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345286+0000","last_undegraded":"2023-08-27T11:26:55.345286+0000","last_fullsized":"2023-08-27T11:26:55.345286+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.349504+0000","last_change":"2023-08-27T11:26:55.349504+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.349504+0000","last_undegraded":"2023-08-27T11:26:55.349504+0000","last_fullsized":"2023-08-27T11:26:55.349504+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350360+0000","last_change":"2023-08-27T11:26:55.350360+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350360+0000","last_undegraded":"2023-08-27T11:26:55.350360+0000","last_fullsized":"2023-08-27T11:26:55.350360+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348018+0000","last_change":"2023-08-27T11:26:55.348018+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348018+0000","last_undegraded":"2023-08-27T11:26:55.348018+0000","last_fullsized":"2023-08-27T11:26:55.348018+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342423+0000","last_change":"2023-08-27T11:26:55.342423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342423+0000","last_undegraded":"2023-08-27T11:26:55.342423+0000","last_fullsized":"2023-08-27T11:26:55.342423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345665+0000","last_change":"2023-08-27T11:26:55.345665+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345665+0000","last_undegraded":"2023-08-27T11:26:55.345665+0000","last_fullsized":"2023-08-27T11:26:55.345665+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343867+0000","last_change":"2023-08-27T11:26:55.343867+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343867+0000","last_undegraded":"2023-08-27T11:26:55.343867+0000","last_fullsized":"2023-08-27T11:26:55.343867+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340061+0000","last_change":"2023-08-27T11:26:55.340061+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340061+0000","last_undegraded":"2023-08-27T11:26:55.340061+0000","last_fullsized":"2023-08-27T11:26:55.340061+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342059+0000","last_change":"2023-08-27T11:26:55.342059+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342059+0000","last_undegraded":"2023-08-27T11:26:55.342059+0000","last_fullsized":"2023-08-27T11:26:55.342059+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348188+0000","last_change":"2023-08-27T11:26:55.348188+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348188+0000","last_undegraded":"2023-08-27T11:26:55.348188+0000","last_fullsized":"2023-08-27T11:26:55.348188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342123+0000","last_change":"2023-08-27T11:26:55.342123+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342123+0000","last_undegraded":"2023-08-27T11:26:55.342123+0000","last_fullsized":"2023-08-27T11:26:55.342123+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351423+0000","last_change":"2023-08-27T11:26:55.351423+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351423+0000","last_undegraded":"2023-08-27T11:26:55.351423+0000","last_fullsized":"2023-08-27T11:26:55.351423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340731+0000","last_change":"2023-08-27T11:26:55.340731+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340731+0000","last_undegraded":"2023-08-27T11:26:55.340731+0000","last_fullsized":"2023-08-27T11:26:55.340731+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340128+0000","last_change":"2023-08-27T11:26:55.340128+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340128+0000","last_undegraded":"2023-08-27T11:26:55.340128+0000","last_fullsized":"2023-08-27T11:26:55.340128+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345394+0000","last_change":"2023-08-27T11:26:55.345394+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345394+0000","last_undegraded":"2023-08-27T11:26:55.345394+0000","last_fullsized":"2023-08-27T11:26:55.345394+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344492+0000","last_change":"2023-08-27T11:26:55.344492+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344492+0000","last_undegraded":"2023-08-27T11:26:55.344492+0000","last_fullsized":"2023-08-27T11:26:55.344492+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341625+0000","last_change":"2023-08-27T11:26:55.341625+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341625+0000","last_undegraded":"2023-08-27T11:26:55.341625+0000","last_fullsized":"2023-08-27T11:26:55.341625+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341466+0000","last_change":"2023-08-27T11:26:55.341466+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341466+0000","last_undegraded":"2023-08-27T11:26:55.341466+0000","last_fullsized":"2023-08-27T11:26:55.341466+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341527+0000","last_change":"2023-08-27T11:26:55.341527+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341527+0000","last_undegraded":"2023-08-27T11:26:55.341527+0000","last_fullsized":"2023-08-27T11:26:55.341527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341738+0000","last_change":"2023-08-27T11:26:55.341738+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341738+0000","last_undegraded":"2023-08-27T11:26:55.341738+0000","last_fullsized":"2023-08-27T11:26:55.341738+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341773+0000","last_change":"2023-08-27T11:26:55.341773+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341773+0000","last_undegraded":"2023-08-27T11:26:55.341773+0000","last_fullsized":"2023-08-27T11:26:55.341773+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363089+0000","last_change":"2023-08-27T11:26:55.361418+0000","last_active":"2023-08-27T11:26:55.363089+0000","last_peered":"2023-08-27T11:26:55.363089+0000","last_clean":"2023-08-27T11:26:55.363089+0000","last_became_active":"2023-08-27T11:26:55.361075+0000","last_became_peered":"2023-08-27T11:26:55.361075+0000","last_unstale":"2023-08-27T11:26:55.363089+0000","last_undegraded":"2023-08-27T11:26:55.363089+0000","last_fullsized":"2023-08-27T11:26:55.363089+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:17:29.007239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.340858+0000","last_change":"2023-08-27T11:26:55.340858+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.340858+0000","last_undegraded":"2023-08-27T11:26:55.340858+0000","last_fullsized":"2023-08-27T11:26:55.340858+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363927+0000","last_change":"2023-08-27T11:26:55.360037+0000","last_active":"2023-08-27T11:26:55.363927+0000","last_peered":"2023-08-27T11:26:55.363927+0000","last_clean":"2023-08-27T11:26:55.363927+0000","last_became_active":"2023-08-27T11:26:55.359712+0000","last_became_peered":"2023-08-27T11:26:55.359712+0000","last_unstale":"2023-08-27T11:26:55.363927+0000","last_undegraded":"2023-08-27T11:26:55.363927+0000","last_fullsized":"2023-08-27T11:26:55.363927+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:04.980678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339985+0000","last_change":"2023-08-27T11:26:55.339985+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339985+0000","last_undegraded":"2023-08-27T11:26:55.339985+0000","last_fullsized":"2023-08-27T11:26:55.339985+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361264+0000","last_change":"2023-08-27T11:26:55.353142+0000","last_active":"2023-08-27T11:26:55.361264+0000","last_peered":"2023-08-27T11:26:55.361264+0000","last_clean":"2023-08-27T11:26:55.361264+0000","last_became_active":"2023-08-27T11:26:55.352351+0000","last_became_peered":"2023-08-27T11:26:55.352351+0000","last_unstale":"2023-08-27T11:26:55.361264+0000","last_undegraded":"2023-08-27T11:26:55.361264+0000","last_fullsized":"2023-08-27T11:26:55.361264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.135590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344280+0000","last_change":"2023-08-27T11:26:55.344280+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344280+0000","last_undegraded":"2023-08-27T11:26:55.344280+0000","last_fullsized":"2023-08-27T11:26:55.344280+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.364740+0000","last_change":"2023-08-27T11:26:55.363797+0000","last_active":"2023-08-27T11:26:55.364740+0000","last_peered":"2023-08-27T11:26:55.364740+0000","last_clean":"2023-08-27T11:26:55.364740+0000","last_became_active":"2023-08-27T11:26:55.363472+0000","last_became_peered":"2023-08-27T11:26:55.363472+0000","last_unstale":"2023-08-27T11:26:55.364740+0000","last_undegraded":"2023-08-27T11:26:55.364740+0000","last_fullsized":"2023-08-27T11:26:55.364740+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:45.857129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344569+0000","last_change":"2023-08-27T11:26:55.344569+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344569+0000","last_undegraded":"2023-08-27T11:26:55.344569+0000","last_fullsized":"2023-08-27T11:26:55.344569+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362032+0000","last_change":"2023-08-27T11:26:55.360072+0000","last_active":"2023-08-27T11:26:55.362032+0000","last_peered":"2023-08-27T11:26:55.362032+0000","last_clean":"2023-08-27T11:26:55.362032+0000","last_became_active":"2023-08-27T11:26:55.359779+0000","last_became_peered":"2023-08-27T11:26:55.359779+0000","last_unstale":"2023-08-27T11:26:55.362032+0000","last_undegraded":"2023-08-27T11:26:55.362032+0000","last_fullsized":"2023-08-27T11:26:55.362032+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:17.884593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342891+0000","last_change":"2023-08-27T11:26:55.342891+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342891+0000","last_undegraded":"2023-08-27T11:26:55.342891+0000","last_fullsized":"2023-08-27T11:26:55.342891+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358914+0000","last_change":"2023-08-27T11:26:55.355107+0000","last_active":"2023-08-27T11:26:55.358914+0000","last_peered":"2023-08-27T11:26:55.358914+0000","last_clean":"2023-08-27T11:26:55.358914+0000","last_became_active":"2023-08-27T11:26:55.354728+0000","last_became_peered":"2023-08-27T11:26:55.354728+0000","last_unstale":"2023-08-27T11:26:55.358914+0000","last_undegraded":"2023-08-27T11:26:55.358914+0000","last_fullsized":"2023-08-27T11:26:55.358914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:41.392123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345151+0000","last_change":"2023-08-27T11:26:55.345151+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345151+0000","last_undegraded":"2023-08-27T11:26:55.345151+0000","last_fullsized":"2023-08-27T11:26:55.345151+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361306+0000","last_change":"2023-08-27T11:26:55.353051+0000","last_active":"2023-08-27T11:26:55.361306+0000","last_peered":"2023-08-27T11:26:55.361306+0000","last_clean":"2023-08-27T11:26:55.361306+0000","last_became_active":"2023-08-27T11:26:55.352606+0000","last_became_peered":"2023-08-27T11:26:55.352606+0000","last_unstale":"2023-08-27T11:26:55.361306+0000","last_undegraded":"2023-08-27T11:26:55.361306+0000","last_fullsized":"2023-08-27T11:26:55.361306+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:42:03.018322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344561+0000","last_change":"2023-08-27T11:26:55.344561+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344561+0000","last_undegraded":"2023-08-27T11:26:55.344561+0000","last_fullsized":"2023-08-27T11:26:55.344561+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361810+0000","last_change":"2023-08-27T11:26:55.356739+0000","last_active":"2023-08-27T11:26:55.361810+0000","last_peered":"2023-08-27T11:26:55.361810+0000","last_clean":"2023-08-27T11:26:55.361810+0000","last_became_active":"2023-08-27T11:26:55.356419+0000","last_became_peered":"2023-08-27T11:26:55.356419+0000","last_unstale":"2023-08-27T11:26:55.361810+0000","last_undegraded":"2023-08-27T11:26:55.361810+0000","last_fullsized":"2023-08-27T11:26:55.361810+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:10:58.869588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344602+0000","last_change":"2023-08-27T11:26:55.344602+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344602+0000","last_undegraded":"2023-08-27T11:26:55.344602+0000","last_fullsized":"2023-08-27T11:26:55.344602+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.352949+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.352563+0000","last_became_peered":"2023-08-27T11:26:55.352563+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.350395+0000","last_change":"2023-08-27T11:26:55.350395+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.350395+0000","last_undegraded":"2023-08-27T11:26:55.350395+0000","last_fullsized":"2023-08-27T11:26:55.350395+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360398+0000","last_change":"2023-08-27T11:26:55.356564+0000","last_active":"2023-08-27T11:26:55.360398+0000","last_peered":"2023-08-27T11:26:55.360398+0000","last_clean":"2023-08-27T11:26:55.360398+0000","last_became_active":"2023-08-27T11:26:55.356302+0000","last_became_peered":"2023-08-27T11:26:55.356302+0000","last_unstale":"2023-08-27T11:26:55.360398+0000","last_undegraded":"2023-08-27T11:26:55.360398+0000","last_fullsized":"2023-08-27T11:26:55.360398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:38.563053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.342715+0000","last_change":"2023-08-27T11:26:55.342715+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.342715+0000","last_undegraded":"2023-08-27T11:26:55.342715+0000","last_fullsized":"2023-08-27T11:26:55.342715+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361992+0000","last_change":"2023-08-27T11:26:55.359460+0000","last_active":"2023-08-27T11:26:55.361992+0000","last_peered":"2023-08-27T11:26:55.361992+0000","last_clean":"2023-08-27T11:26:55.361992+0000","last_became_active":"2023-08-27T11:26:55.359161+0000","last_became_peered":"2023-08-27T11:26:55.359161+0000","last_unstale":"2023-08-27T11:26:55.361992+0000","last_undegraded":"2023-08-27T11:26:55.361992+0000","last_fullsized":"2023-08-27T11:26:55.361992+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:38.425259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348723+0000","last_change":"2023-08-27T11:26:55.348723+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348723+0000","last_undegraded":"2023-08-27T11:26:55.348723+0000","last_fullsized":"2023-08-27T11:26:55.348723+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360772+0000","last_change":"2023-08-27T11:26:55.358248+0000","last_active":"2023-08-27T11:26:55.360772+0000","last_peered":"2023-08-27T11:26:55.360772+0000","last_clean":"2023-08-27T11:26:55.360772+0000","last_became_active":"2023-08-27T11:26:55.357893+0000","last_became_peered":"2023-08-27T11:26:55.357893+0000","last_unstale":"2023-08-27T11:26:55.360772+0000","last_undegraded":"2023-08-27T11:26:55.360772+0000","last_fullsized":"2023-08-27T11:26:55.360772+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:57.363969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343315+0000","last_change":"2023-08-27T11:26:55.343315+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343315+0000","last_undegraded":"2023-08-27T11:26:55.343315+0000","last_fullsized":"2023-08-27T11:26:55.343315+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360404+0000","last_change":"2023-08-27T11:26:55.358644+0000","last_active":"2023-08-27T11:26:55.360404+0000","last_peered":"2023-08-27T11:26:55.360404+0000","last_clean":"2023-08-27T11:26:55.360404+0000","last_became_active":"2023-08-27T11:26:55.358327+0000","last_became_peered":"2023-08-27T11:26:55.358327+0000","last_unstale":"2023-08-27T11:26:55.360404+0000","last_undegraded":"2023-08-27T11:26:55.360404+0000","last_fullsized":"2023-08-27T11:26:55.360404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:21:44.354240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341362+0000","last_change":"2023-08-27T11:26:55.341362+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341362+0000","last_undegraded":"2023-08-27T11:26:55.341362+0000","last_fullsized":"2023-08-27T11:26:55.341362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363654+0000","last_change":"2023-08-27T11:26:55.361664+0000","last_active":"2023-08-27T11:26:55.363654+0000","last_peered":"2023-08-27T11:26:55.363654+0000","last_clean":"2023-08-27T11:26:55.363654+0000","last_became_active":"2023-08-27T11:26:55.361207+0000","last_became_peered":"2023-08-27T11:26:55.361207+0000","last_unstale":"2023-08-27T11:26:55.363654+0000","last_undegraded":"2023-08-27T11:26:55.363654+0000","last_fullsized":"2023-08-27T11:26:55.363654+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:48:50.318507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346401+0000","last_change":"2023-08-27T11:26:55.346401+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346401+0000","last_undegraded":"2023-08-27T11:26:55.346401+0000","last_fullsized":"2023-08-27T11:26:55.346401+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356904+0000","last_change":"2023-08-27T11:26:55.349997+0000","last_active":"2023-08-27T11:26:55.356904+0000","last_peered":"2023-08-27T11:26:55.356904+0000","last_clean":"2023-08-27T11:26:55.356904+0000","last_became_active":"2023-08-27T11:26:55.349692+0000","last_became_peered":"2023-08-27T11:26:55.349692+0000","last_unstale":"2023-08-27T11:26:55.356904+0000","last_undegraded":"2023-08-27T11:26:55.356904+0000","last_fullsized":"2023-08-27T11:26:55.356904+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:10.455327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341846+0000","last_change":"2023-08-27T11:26:55.341846+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341846+0000","last_undegraded":"2023-08-27T11:26:55.341846+0000","last_fullsized":"2023-08-27T11:26:55.341846+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.353773+0000","last_change":"2023-08-27T11:26:55.348680+0000","last_active":"2023-08-27T11:26:55.353773+0000","last_peered":"2023-08-27T11:26:55.353773+0000","last_clean":"2023-08-27T11:26:55.353773+0000","last_became_active":"2023-08-27T11:26:55.348359+0000","last_became_peered":"2023-08-27T11:26:55.348359+0000","last_unstale":"2023-08-27T11:26:55.353773+0000","last_undegraded":"2023-08-27T11:26:55.353773+0000","last_fullsized":"2023-08-27T11:26:55.353773+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:58.876923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345010+0000","last_change":"2023-08-27T11:26:55.345010+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345010+0000","last_undegraded":"2023-08-27T11:26:55.345010+0000","last_fullsized":"2023-08-27T11:26:55.345010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363187+0000","last_change":"2023-08-27T11:26:55.361849+0000","last_active":"2023-08-27T11:26:55.363187+0000","last_peered":"2023-08-27T11:26:55.363187+0000","last_clean":"2023-08-27T11:26:55.363187+0000","last_became_active":"2023-08-27T11:26:55.361557+0000","last_became_peered":"2023-08-27T11:26:55.361557+0000","last_unstale":"2023-08-27T11:26:55.363187+0000","last_undegraded":"2023-08-27T11:26:55.363187+0000","last_fullsized":"2023-08-27T11:26:55.363187+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:13.145297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.339467+0000","last_change":"2023-08-27T11:26:55.339467+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.339467+0000","last_undegraded":"2023-08-27T11:26:55.339467+0000","last_fullsized":"2023-08-27T11:26:55.339467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356857+0000","last_change":"2023-08-27T11:26:55.354496+0000","last_active":"2023-08-27T11:26:55.356857+0000","last_peered":"2023-08-27T11:26:55.356857+0000","last_clean":"2023-08-27T11:26:55.356857+0000","last_became_active":"2023-08-27T11:26:55.354179+0000","last_became_peered":"2023-08-27T11:26:55.354179+0000","last_unstale":"2023-08-27T11:26:55.356857+0000","last_undegraded":"2023-08-27T11:26:55.356857+0000","last_fullsized":"2023-08-27T11:26:55.356857+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:38:08.578329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345373+0000","last_change":"2023-08-27T11:26:55.345373+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345373+0000","last_undegraded":"2023-08-27T11:26:55.345373+0000","last_fullsized":"2023-08-27T11:26:55.345373+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.358532+0000","last_change":"2023-08-27T11:26:55.356722+0000","last_active":"2023-08-27T11:26:55.358532+0000","last_peered":"2023-08-27T11:26:55.358532+0000","last_clean":"2023-08-27T11:26:55.358532+0000","last_became_active":"2023-08-27T11:26:55.356411+0000","last_became_peered":"2023-08-27T11:26:55.356411+0000","last_unstale":"2023-08-27T11:26:55.358532+0000","last_undegraded":"2023-08-27T11:26:55.358532+0000","last_fullsized":"2023-08-27T11:26:55.358532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344791+0000","last_change":"2023-08-27T11:26:55.344791+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344791+0000","last_undegraded":"2023-08-27T11:26:55.344791+0000","last_fullsized":"2023-08-27T11:26:55.344791+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362293+0000","last_change":"2023-08-27T11:26:55.359591+0000","last_active":"2023-08-27T11:26:55.362293+0000","last_peered":"2023-08-27T11:26:55.362293+0000","last_clean":"2023-08-27T11:26:55.362293+0000","last_became_active":"2023-08-27T11:26:55.359302+0000","last_became_peered":"2023-08-27T11:26:55.359302+0000","last_unstale":"2023-08-27T11:26:55.362293+0000","last_undegraded":"2023-08-27T11:26:55.362293+0000","last_fullsized":"2023-08-27T11:26:55.362293+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:24.927191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.344898+0000","last_change":"2023-08-27T11:26:55.344898+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.344898+0000","last_undegraded":"2023-08-27T11:26:55.344898+0000","last_fullsized":"2023-08-27T11:26:55.344898+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.361268+0000","last_change":"2023-08-27T11:26:55.349533+0000","last_active":"2023-08-27T11:26:55.361268+0000","last_peered":"2023-08-27T11:26:55.361268+0000","last_clean":"2023-08-27T11:26:55.361268+0000","last_became_active":"2023-08-27T11:26:55.349211+0000","last_became_peered":"2023-08-27T11:26:55.349211+0000","last_unstale":"2023-08-27T11:26:55.361268+0000","last_undegraded":"2023-08-27T11:26:55.361268+0000","last_fullsized":"2023-08-27T11:26:55.361268+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:10.213616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346688+0000","last_change":"2023-08-27T11:26:55.346688+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346688+0000","last_undegraded":"2023-08-27T11:26:55.346688+0000","last_fullsized":"2023-08-27T11:26:55.346688+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.356348+0000","last_change":"2023-08-27T11:26:55.351607+0000","last_active":"2023-08-27T11:26:55.356348+0000","last_peered":"2023-08-27T11:26:55.356348+0000","last_clean":"2023-08-27T11:26:55.356348+0000","last_became_active":"2023-08-27T11:26:55.351289+0000","last_became_peered":"2023-08-27T11:26:55.351289+0000","last_unstale":"2023-08-27T11:26:55.356348+0000","last_undegraded":"2023-08-27T11:26:55.356348+0000","last_fullsized":"2023-08-27T11:26:55.356348+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:50:44.282014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.348709+0000","last_change":"2023-08-27T11:26:55.348709+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.348709+0000","last_undegraded":"2023-08-27T11:26:55.348709+0000","last_fullsized":"2023-08-27T11:26:55.348709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359500+0000","last_change":"2023-08-27T11:26:55.357412+0000","last_active":"2023-08-27T11:26:55.359500+0000","last_peered":"2023-08-27T11:26:55.359500+0000","last_clean":"2023-08-27T11:26:55.359500+0000","last_became_active":"2023-08-27T11:26:55.357099+0000","last_became_peered":"2023-08-27T11:26:55.357099+0000","last_unstale":"2023-08-27T11:26:55.359500+0000","last_undegraded":"2023-08-27T11:26:55.359500+0000","last_fullsized":"2023-08-27T11:26:55.359500+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:30.521591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.346959+0000","last_change":"2023-08-27T11:26:55.346959+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.346959+0000","last_undegraded":"2023-08-27T11:26:55.346959+0000","last_fullsized":"2023-08-27T11:26:55.346959+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357108+0000","last_change":"2023-08-27T11:26:55.350845+0000","last_active":"2023-08-27T11:26:55.357108+0000","last_peered":"2023-08-27T11:26:55.357108+0000","last_clean":"2023-08-27T11:26:55.357108+0000","last_became_active":"2023-08-27T11:26:55.350307+0000","last_became_peered":"2023-08-27T11:26:55.350307+0000","last_unstale":"2023-08-27T11:26:55.357108+0000","last_undegraded":"2023-08-27T11:26:55.357108+0000","last_fullsized":"2023-08-27T11:26:55.357108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:32:33.023804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345795+0000","last_change":"2023-08-27T11:26:55.345795+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345795+0000","last_undegraded":"2023-08-27T11:26:55.345795+0000","last_fullsized":"2023-08-27T11:26:55.345795+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.360366+0000","last_change":"2023-08-27T11:26:55.358238+0000","last_active":"2023-08-27T11:26:55.360366+0000","last_peered":"2023-08-27T11:26:55.360366+0000","last_clean":"2023-08-27T11:26:55.360366+0000","last_became_active":"2023-08-27T11:26:55.357924+0000","last_became_peered":"2023-08-27T11:26:55.357924+0000","last_unstale":"2023-08-27T11:26:55.360366+0000","last_undegraded":"2023-08-27T11:26:55.360366+0000","last_fullsized":"2023-08-27T11:26:55.360366+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:46.627644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.340442+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:55.340442+0000","last_peered":"2023-08-27T11:26:55.340442+0000","last_clean":"2023-08-27T11:26:55.340442+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:55.340442+0000","last_undegraded":"2023-08-27T11:26:55.340442+0000","last_fullsized":"2023-08-27T11:26:55.340442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:09.713247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.345410+0000","last_change":"2023-08-27T11:26:55.345410+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.345410+0000","last_undegraded":"2023-08-27T11:26:55.345410+0000","last_fullsized":"2023-08-27T11:26:55.345410+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.359760+0000","last_change":"2023-08-27T11:26:55.353113+0000","last_active":"2023-08-27T11:26:55.359760+0000","last_peered":"2023-08-27T11:26:55.359760+0000","last_clean":"2023-08-27T11:26:55.359760+0000","last_became_active":"2023-08-27T11:26:55.352818+0000","last_became_peered":"2023-08-27T11:26:55.352818+0000","last_unstale":"2023-08-27T11:26:55.359760+0000","last_undegraded":"2023-08-27T11:26:55.359760+0000","last_fullsized":"2023-08-27T11:26:55.359760+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:36:17.865194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.339834+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:55.339834+0000","last_peered":"2023-08-27T11:26:55.339834+0000","last_clean":"2023-08-27T11:26:55.339834+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:55.339834+0000","last_undegraded":"2023-08-27T11:26:55.339834+0000","last_fullsized":"2023-08-27T11:26:55.339834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:40.454581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341294+0000","last_change":"2023-08-27T11:26:55.341294+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341294+0000","last_undegraded":"2023-08-27T11:26:55.341294+0000","last_fullsized":"2023-08-27T11:26:55.341294+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.357206+0000","last_change":"2023-08-27T11:26:55.347843+0000","last_active":"2023-08-27T11:26:55.357206+0000","last_peered":"2023-08-27T11:26:55.357206+0000","last_clean":"2023-08-27T11:26:55.357206+0000","last_became_active":"2023-08-27T11:26:55.347517+0000","last_became_peered":"2023-08-27T11:26:55.347517+0000","last_unstale":"2023-08-27T11:26:55.357206+0000","last_undegraded":"2023-08-27T11:26:55.357206+0000","last_fullsized":"2023-08-27T11:26:55.357206+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:22:17.584627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.343966+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:55.343966+0000","last_peered":"2023-08-27T11:26:55.343966+0000","last_clean":"2023-08-27T11:26:55.343966+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:55.343966+0000","last_undegraded":"2023-08-27T11:26:55.343966+0000","last_fullsized":"2023-08-27T11:26:55.343966+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:16:48.156023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343664+0000","last_change":"2023-08-27T11:26:55.343664+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343664+0000","last_undegraded":"2023-08-27T11:26:55.343664+0000","last_fullsized":"2023-08-27T11:26:55.343664+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362963+0000","last_change":"2023-08-27T11:26:55.356624+0000","last_active":"2023-08-27T11:26:55.362963+0000","last_peered":"2023-08-27T11:26:55.362963+0000","last_clean":"2023-08-27T11:26:55.362963+0000","last_became_active":"2023-08-27T11:26:55.355441+0000","last_became_peered":"2023-08-27T11:26:55.355441+0000","last_unstale":"2023-08-27T11:26:55.362963+0000","last_undegraded":"2023-08-27T11:26:55.362963+0000","last_fullsized":"2023-08-27T11:26:55.362963+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:34:39.941432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351632+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:55.351632+0000","last_peered":"2023-08-27T11:26:55.351632+0000","last_clean":"2023-08-27T11:26:55.351632+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:55.351632+0000","last_undegraded":"2023-08-27T11:26:55.351632+0000","last_fullsized":"2023-08-27T11:26:55.351632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:53.487197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.351828+0000","last_change":"2023-08-27T11:26:55.351828+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.351828+0000","last_undegraded":"2023-08-27T11:26:55.351828+0000","last_fullsized":"2023-08-27T11:26:55.351828+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362612+0000","last_change":"2023-08-27T11:26:55.360320+0000","last_active":"2023-08-27T11:26:55.362612+0000","last_peered":"2023-08-27T11:26:55.362612+0000","last_clean":"2023-08-27T11:26:55.362612+0000","last_became_active":"2023-08-27T11:26:55.359906+0000","last_became_peered":"2023-08-27T11:26:55.359906+0000","last_unstale":"2023-08-27T11:26:55.362612+0000","last_undegraded":"2023-08-27T11:26:55.362612+0000","last_fullsized":"2023-08-27T11:26:55.362612+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:29:02.843096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.352880+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:55.352880+0000","last_peered":"2023-08-27T11:26:55.352880+0000","last_clean":"2023-08-27T11:26:55.352880+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:55.352880+0000","last_undegraded":"2023-08-27T11:26:55.352880+0000","last_fullsized":"2023-08-27T11:26:55.352880+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:04.081390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.341749+0000","last_change":"2023-08-27T11:26:55.341749+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.341749+0000","last_undegraded":"2023-08-27T11:26:55.341749+0000","last_fullsized":"2023-08-27T11:26:55.341749+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.365159+0000","last_change":"2023-08-27T11:26:55.364141+0000","last_active":"2023-08-27T11:26:55.365159+0000","last_peered":"2023-08-27T11:26:55.365159+0000","last_clean":"2023-08-27T11:26:55.365159+0000","last_became_active":"2023-08-27T11:26:55.363814+0000","last_became_peered":"2023-08-27T11:26:55.363814+0000","last_unstale":"2023-08-27T11:26:55.365159+0000","last_undegraded":"2023-08-27T11:26:55.365159+0000","last_fullsized":"2023-08-27T11:26:55.365159+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:04:39.207247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":293,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.351457+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:55.351457+0000","last_peered":"2023-08-27T11:26:55.351457+0000","last_clean":"2023-08-27T11:26:55.351457+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:55.351457+0000","last_undegraded":"2023-08-27T11:26:55.351457+0000","last_fullsized":"2023-08-27T11:26:55.351457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:40:24.249582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.354505+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:55.354505+0000","last_peered":"2023-08-27T11:26:55.354505+0000","last_clean":"2023-08-27T11:26:55.354505+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:55.354505+0000","last_undegraded":"2023-08-27T11:26:55.354505+0000","last_fullsized":"2023-08-27T11:26:55.354505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:27:09.713560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343383+0000","last_change":"2023-08-27T11:26:55.343383+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343383+0000","last_undegraded":"2023-08-27T11:26:55.343383+0000","last_fullsized":"2023-08-27T11:26:55.343383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.363057+0000","last_change":"2023-08-27T11:26:55.356213+0000","last_active":"2023-08-27T11:26:55.363057+0000","last_peered":"2023-08-27T11:26:55.363057+0000","last_clean":"2023-08-27T11:26:55.363057+0000","last_became_active":"2023-08-27T11:26:55.355932+0000","last_became_peered":"2023-08-27T11:26:55.355932+0000","last_unstale":"2023-08-27T11:26:55.363057+0000","last_undegraded":"2023-08-27T11:26:55.363057+0000","last_fullsized":"2023-08-27T11:26:55.363057+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:14:17.592043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.347429+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:55.347429+0000","last_peered":"2023-08-27T11:26:55.347429+0000","last_clean":"2023-08-27T11:26:55.347429+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:55.347429+0000","last_undegraded":"2023-08-27T11:26:55.347429+0000","last_fullsized":"2023-08-27T11:26:55.347429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:36:49.239378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":94,"state":"creating+peering","last_fresh":"2023-08-27T11:26:55.343220+0000","last_change":"2023-08-27T11:26:55.343220+0000","last_active":"2023-08-27T11:26:55.331252+0000","last_peered":"2023-08-27T11:26:55.331252+0000","last_clean":"2023-08-27T11:26:55.331252+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:26:55.343220+0000","last_undegraded":"2023-08-27T11:26:55.343220+0000","last_fullsized":"2023-08-27T11:26:55.343220+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.362936+0000","last_change":"2023-08-27T11:26:55.358596+0000","last_active":"2023-08-27T11:26:55.362936+0000","last_peered":"2023-08-27T11:26:55.362936+0000","last_clean":"2023-08-27T11:26:55.362936+0000","last_became_active":"2023-08-27T11:26:55.358310+0000","last_became_peered":"2023-08-27T11:26:55.358310+0000","last_unstale":"2023-08-27T11:26:55.362936+0000","last_undegraded":"2023-08-27T11:26:55.362936+0000","last_fullsized":"2023-08-27T11:26:55.362936+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:15:12.319784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-08-27T11:26:55.341989+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:55.341989+0000","last_peered":"2023-08-27T11:26:55.341989+0000","last_clean":"2023-08-27T11:26:55.341989+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:55.341989+0000","last_undegraded":"2023-08-27T11:26:55.341989+0000","last_fullsized":"2023-08-27T11:26:55.341989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:40.447245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":0.878},"last":0.622}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.173,"15min":1.173},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":1.083,"15min":1.083},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.135},"last":0.73699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.397,"15min":1.397},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.006,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.133,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.93600000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":1.101},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.95999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":1.054}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.91500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28724,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343116,"statfs":{"total":96636764160,"available":96607350784,"internally_reserved":0,"allocated":1744896,"data_stored":1124065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.46899999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.502}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":1.1240000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.88400000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.002}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":1.145}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.495},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.51600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63200000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.48299999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61799999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61199999999999999,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73499999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1459999999999999,"5min":1.669,"15min":1.669},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.994,"15min":1.994},"last":0.77300000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.1659999999999999,"5min":2.036,"15min":2.036},"last":0.75},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97199999999999998,"5min":1.26,"15min":1.26},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82999999999999996},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1279999999999999,"5min":1.321,"15min":1.321},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.627,"15min":1.627},"last":0.70799999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0860000000000001,"5min":2.073,"15min":2.073},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.86699999999999999},"min":{"1min":0.64100000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.323,"15min":1.323},"last":0.94899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.748},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.629},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.69099999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343696,"statfs":{"total":96636764160,"available":96607944704,"internally_reserved":0,"allocated":1150976,"data_stored":533697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46999999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.1120000000000001,"5min":1.161,"15min":1.161},"last":0.5},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.85599999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.022},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72899999999999998,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.006}]},{"osd":6,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77400000000000002,"15min":0.746},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.51600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":1.1240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343700,"statfs":{"total":96636764160,"available":96607948800,"internally_reserved":0,"allocated":1146880,"data_stored":532711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.105,"15min":1.105},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.53400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92600000000000005,"5min":1.014,"15min":1.014},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97499999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.755}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.874,"5min":1.097,"15min":1.097},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94899999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.56299999999999994,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84999999999999998,"5min":1.744,"15min":1.744},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":1.663,"15min":1.663},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.274,"15min":1.274},"last":0.77100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:02.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-08-27T11:27:02.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342834+0000', 'last_change': '2023-08-27T11:26:55.342834+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342834+0000', 'last_undegraded': '2023-08-27T11:26:55.342834+0000', 'last_fullsized': '2023-08-27T11:26:55.342834+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-08-27T11:27:02.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.346182+0000', 'last_change': '2023-08-27T11:26:55.346182+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.346182+0000', 'last_undegraded': '2023-08-27T11:26:55.346182+0000', 'last_fullsized': '2023-08-27T11:26:55.346182+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-08-27T11:27:02.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344276+0000', 'last_change': '2023-08-27T11:26:55.344276+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344276+0000', 'last_undegraded': '2023-08-27T11:26:55.344276+0000', 'last_fullsized': '2023-08-27T11:26:55.344276+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-08-27T11:27:02.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345048+0000', 'last_change': '2023-08-27T11:26:55.345048+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345048+0000', 'last_undegraded': '2023-08-27T11:26:55.345048+0000', 'last_fullsized': '2023-08-27T11:26:55.345048+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-08-27T11:27:02.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.352594+0000', 'last_change': '2023-08-27T11:26:55.352594+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.352594+0000', 'last_undegraded': '2023-08-27T11:26:55.352594+0000', 'last_fullsized': '2023-08-27T11:26:55.352594+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-08-27T11:27:02.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.346488+0000', 'last_change': '2023-08-27T11:26:55.346488+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.346488+0000', 'last_undegraded': '2023-08-27T11:26:55.346488+0000', 'last_fullsized': '2023-08-27T11:26:55.346488+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-08-27T11:27:02.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342034+0000', 'last_change': '2023-08-27T11:26:55.342034+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342034+0000', 'last_undegraded': '2023-08-27T11:26:55.342034+0000', 'last_fullsized': '2023-08-27T11:26:55.342034+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-08-27T11:27:02.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342194+0000', 'last_change': '2023-08-27T11:26:55.342194+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342194+0000', 'last_undegraded': '2023-08-27T11:26:55.342194+0000', 'last_fullsized': '2023-08-27T11:26:55.342194+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-08-27T11:27:02.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342841+0000', 'last_change': '2023-08-27T11:26:55.342841+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342841+0000', 'last_undegraded': '2023-08-27T11:26:55.342841+0000', 'last_fullsized': '2023-08-27T11:26:55.342841+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-08-27T11:27:02.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.350751+0000', 'last_change': '2023-08-27T11:26:55.350751+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.350751+0000', 'last_undegraded': '2023-08-27T11:26:55.350751+0000', 'last_fullsized': '2023-08-27T11:26:55.350751+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-08-27T11:27:02.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345929+0000', 'last_change': '2023-08-27T11:26:55.345929+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345929+0000', 'last_undegraded': '2023-08-27T11:26:55.345929+0000', 'last_fullsized': '2023-08-27T11:26:55.345929+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-08-27T11:27:02.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.339467+0000', 'last_change': '2023-08-27T11:26:55.339467+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.339467+0000', 'last_undegraded': '2023-08-27T11:26:55.339467+0000', 'last_fullsized': '2023-08-27T11:26:55.339467+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-08-27T11:27:02.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345286+0000', 'last_change': '2023-08-27T11:26:55.345286+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345286+0000', 'last_undegraded': '2023-08-27T11:26:55.345286+0000', 'last_fullsized': '2023-08-27T11:26:55.345286+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-08-27T11:27:02.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.349504+0000', 'last_change': '2023-08-27T11:26:55.349504+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.349504+0000', 'last_undegraded': '2023-08-27T11:26:55.349504+0000', 'last_fullsized': '2023-08-27T11:26:55.349504+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:27:02.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-08-27T11:27:02.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.350360+0000', 'last_change': '2023-08-27T11:26:55.350360+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.350360+0000', 'last_undegraded': '2023-08-27T11:26:55.350360+0000', 'last_fullsized': '2023-08-27T11:26:55.350360+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:27:02.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-08-27T11:27:02.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.348018+0000', 'last_change': '2023-08-27T11:26:55.348018+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.348018+0000', 'last_undegraded': '2023-08-27T11:26:55.348018+0000', 'last_fullsized': '2023-08-27T11:26:55.348018+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:27:02.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-08-27T11:27:02.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342423+0000', 'last_change': '2023-08-27T11:26:55.342423+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342423+0000', 'last_undegraded': '2023-08-27T11:26:55.342423+0000', 'last_fullsized': '2023-08-27T11:26:55.342423+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-08-27T11:27:02.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345665+0000', 'last_change': '2023-08-27T11:26:55.345665+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345665+0000', 'last_undegraded': '2023-08-27T11:26:55.345665+0000', 'last_fullsized': '2023-08-27T11:26:55.345665+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-08-27T11:27:02.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.343867+0000', 'last_change': '2023-08-27T11:26:55.343867+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.343867+0000', 'last_undegraded': '2023-08-27T11:26:55.343867+0000', 'last_fullsized': '2023-08-27T11:26:55.343867+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-08-27T11:27:02.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.340061+0000', 'last_change': '2023-08-27T11:26:55.340061+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.340061+0000', 'last_undegraded': '2023-08-27T11:26:55.340061+0000', 'last_fullsized': '2023-08-27T11:26:55.340061+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-08-27T11:27:02.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342059+0000', 'last_change': '2023-08-27T11:26:55.342059+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342059+0000', 'last_undegraded': '2023-08-27T11:26:55.342059+0000', 'last_fullsized': '2023-08-27T11:26:55.342059+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-08-27T11:27:02.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.348188+0000', 'last_change': '2023-08-27T11:26:55.348188+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.348188+0000', 'last_undegraded': '2023-08-27T11:26:55.348188+0000', 'last_fullsized': '2023-08-27T11:26:55.348188+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-08-27T11:27:02.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342123+0000', 'last_change': '2023-08-27T11:26:55.342123+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342123+0000', 'last_undegraded': '2023-08-27T11:26:55.342123+0000', 'last_fullsized': '2023-08-27T11:26:55.342123+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-08-27T11:27:02.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.351423+0000', 'last_change': '2023-08-27T11:26:55.351423+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.351423+0000', 'last_undegraded': '2023-08-27T11:26:55.351423+0000', 'last_fullsized': '2023-08-27T11:26:55.351423+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-08-27T11:27:02.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.340731+0000', 'last_change': '2023-08-27T11:26:55.340731+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.340731+0000', 'last_undegraded': '2023-08-27T11:26:55.340731+0000', 'last_fullsized': '2023-08-27T11:26:55.340731+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-08-27T11:27:02.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.340128+0000', 'last_change': '2023-08-27T11:26:55.340128+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.340128+0000', 'last_undegraded': '2023-08-27T11:26:55.340128+0000', 'last_fullsized': '2023-08-27T11:26:55.340128+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-08-27T11:27:02.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345394+0000', 'last_change': '2023-08-27T11:26:55.345394+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345394+0000', 'last_undegraded': '2023-08-27T11:26:55.345394+0000', 'last_fullsized': '2023-08-27T11:26:55.345394+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-08-27T11:27:02.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344492+0000', 'last_change': '2023-08-27T11:26:55.344492+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344492+0000', 'last_undegraded': '2023-08-27T11:26:55.344492+0000', 'last_fullsized': '2023-08-27T11:26:55.344492+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-08-27T11:27:02.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341625+0000', 'last_change': '2023-08-27T11:26:55.341625+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341625+0000', 'last_undegraded': '2023-08-27T11:26:55.341625+0000', 'last_fullsized': '2023-08-27T11:26:55.341625+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-08-27T11:27:02.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341466+0000', 'last_change': '2023-08-27T11:26:55.341466+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341466+0000', 'last_undegraded': '2023-08-27T11:26:55.341466+0000', 'last_fullsized': '2023-08-27T11:26:55.341466+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-08-27T11:27:02.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341527+0000', 'last_change': '2023-08-27T11:26:55.341527+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341527+0000', 'last_undegraded': '2023-08-27T11:26:55.341527+0000', 'last_fullsized': '2023-08-27T11:26:55.341527+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-08-27T11:27:02.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341738+0000', 'last_change': '2023-08-27T11:26:55.341738+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341738+0000', 'last_undegraded': '2023-08-27T11:26:55.341738+0000', 'last_fullsized': '2023-08-27T11:26:55.341738+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-08-27T11:27:02.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341773+0000', 'last_change': '2023-08-27T11:26:55.341773+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341773+0000', 'last_undegraded': '2023-08-27T11:26:55.341773+0000', 'last_fullsized': '2023-08-27T11:26:55.341773+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-08-27T11:27:02.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.340858+0000', 'last_change': '2023-08-27T11:26:55.340858+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.340858+0000', 'last_undegraded': '2023-08-27T11:26:55.340858+0000', 'last_fullsized': '2023-08-27T11:26:55.340858+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-08-27T11:27:02.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.339985+0000', 'last_change': '2023-08-27T11:26:55.339985+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.339985+0000', 'last_undegraded': '2023-08-27T11:26:55.339985+0000', 'last_fullsized': '2023-08-27T11:26:55.339985+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-08-27T11:27:02.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344280+0000', 'last_change': '2023-08-27T11:26:55.344280+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344280+0000', 'last_undegraded': '2023-08-27T11:26:55.344280+0000', 'last_fullsized': '2023-08-27T11:26:55.344280+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-08-27T11:27:02.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344569+0000', 'last_change': '2023-08-27T11:26:55.344569+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344569+0000', 'last_undegraded': '2023-08-27T11:26:55.344569+0000', 'last_fullsized': '2023-08-27T11:26:55.344569+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-08-27T11:27:02.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342891+0000', 'last_change': '2023-08-27T11:26:55.342891+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342891+0000', 'last_undegraded': '2023-08-27T11:26:55.342891+0000', 'last_fullsized': '2023-08-27T11:26:55.342891+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-08-27T11:27:02.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345151+0000', 'last_change': '2023-08-27T11:26:55.345151+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345151+0000', 'last_undegraded': '2023-08-27T11:26:55.345151+0000', 'last_fullsized': '2023-08-27T11:26:55.345151+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-08-27T11:27:02.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344561+0000', 'last_change': '2023-08-27T11:26:55.344561+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344561+0000', 'last_undegraded': '2023-08-27T11:26:55.344561+0000', 'last_fullsized': '2023-08-27T11:26:55.344561+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-08-27T11:27:02.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344602+0000', 'last_change': '2023-08-27T11:26:55.344602+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344602+0000', 'last_undegraded': '2023-08-27T11:26:55.344602+0000', 'last_fullsized': '2023-08-27T11:26:55.344602+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-08-27T11:27:02.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.350395+0000', 'last_change': '2023-08-27T11:26:55.350395+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.350395+0000', 'last_undegraded': '2023-08-27T11:26:55.350395+0000', 'last_fullsized': '2023-08-27T11:26:55.350395+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-08-27T11:27:02.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.342715+0000', 'last_change': '2023-08-27T11:26:55.342715+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.342715+0000', 'last_undegraded': '2023-08-27T11:26:55.342715+0000', 'last_fullsized': '2023-08-27T11:26:55.342715+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-08-27T11:27:02.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.348723+0000', 'last_change': '2023-08-27T11:26:55.348723+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.348723+0000', 'last_undegraded': '2023-08-27T11:26:55.348723+0000', 'last_fullsized': '2023-08-27T11:26:55.348723+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-08-27T11:27:02.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.343315+0000', 'last_change': '2023-08-27T11:26:55.343315+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.343315+0000', 'last_undegraded': '2023-08-27T11:26:55.343315+0000', 'last_fullsized': '2023-08-27T11:26:55.343315+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-08-27T11:27:02.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341362+0000', 'last_change': '2023-08-27T11:26:55.341362+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341362+0000', 'last_undegraded': '2023-08-27T11:26:55.341362+0000', 'last_fullsized': '2023-08-27T11:26:55.341362+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-08-27T11:27:02.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.346401+0000', 'last_change': '2023-08-27T11:26:55.346401+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.346401+0000', 'last_undegraded': '2023-08-27T11:26:55.346401+0000', 'last_fullsized': '2023-08-27T11:26:55.346401+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-08-27T11:27:02.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341846+0000', 'last_change': '2023-08-27T11:26:55.341846+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341846+0000', 'last_undegraded': '2023-08-27T11:26:55.341846+0000', 'last_fullsized': '2023-08-27T11:26:55.341846+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-08-27T11:27:02.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345010+0000', 'last_change': '2023-08-27T11:26:55.345010+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345010+0000', 'last_undegraded': '2023-08-27T11:26:55.345010+0000', 'last_fullsized': '2023-08-27T11:26:55.345010+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-08-27T11:27:02.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.339467+0000', 'last_change': '2023-08-27T11:26:55.339467+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.339467+0000', 'last_undegraded': '2023-08-27T11:26:55.339467+0000', 'last_fullsized': '2023-08-27T11:26:55.339467+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:27:02.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-08-27T11:27:02.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345373+0000', 'last_change': '2023-08-27T11:26:55.345373+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345373+0000', 'last_undegraded': '2023-08-27T11:26:55.345373+0000', 'last_fullsized': '2023-08-27T11:26:55.345373+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-08-27T11:27:02.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344791+0000', 'last_change': '2023-08-27T11:26:55.344791+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344791+0000', 'last_undegraded': '2023-08-27T11:26:55.344791+0000', 'last_fullsized': '2023-08-27T11:26:55.344791+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-08-27T11:27:02.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.344898+0000', 'last_change': '2023-08-27T11:26:55.344898+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.344898+0000', 'last_undegraded': '2023-08-27T11:26:55.344898+0000', 'last_fullsized': '2023-08-27T11:26:55.344898+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-08-27T11:27:02.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.346688+0000', 'last_change': '2023-08-27T11:26:55.346688+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.346688+0000', 'last_undegraded': '2023-08-27T11:26:55.346688+0000', 'last_fullsized': '2023-08-27T11:26:55.346688+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-08-27T11:27:02.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.348709+0000', 'last_change': '2023-08-27T11:26:55.348709+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.348709+0000', 'last_undegraded': '2023-08-27T11:26:55.348709+0000', 'last_fullsized': '2023-08-27T11:26:55.348709+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:27:02.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-08-27T11:27:02.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.346959+0000', 'last_change': '2023-08-27T11:26:55.346959+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.346959+0000', 'last_undegraded': '2023-08-27T11:26:55.346959+0000', 'last_fullsized': '2023-08-27T11:26:55.346959+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-08-27T11:27:02.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345795+0000', 'last_change': '2023-08-27T11:26:55.345795+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345795+0000', 'last_undegraded': '2023-08-27T11:26:55.345795+0000', 'last_fullsized': '2023-08-27T11:26:55.345795+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:27:02.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-08-27T11:27:02.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.345410+0000', 'last_change': '2023-08-27T11:26:55.345410+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.345410+0000', 'last_undegraded': '2023-08-27T11:26:55.345410+0000', 'last_fullsized': '2023-08-27T11:26:55.345410+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-08-27T11:27:02.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341294+0000', 'last_change': '2023-08-27T11:26:55.341294+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341294+0000', 'last_undegraded': '2023-08-27T11:26:55.341294+0000', 'last_fullsized': '2023-08-27T11:26:55.341294+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:27:02.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-08-27T11:27:02.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.343664+0000', 'last_change': '2023-08-27T11:26:55.343664+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.343664+0000', 'last_undegraded': '2023-08-27T11:26:55.343664+0000', 'last_fullsized': '2023-08-27T11:26:55.343664+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:27:02.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-08-27T11:27:02.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.351828+0000', 'last_change': '2023-08-27T11:26:55.351828+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.351828+0000', 'last_undegraded': '2023-08-27T11:26:55.351828+0000', 'last_fullsized': '2023-08-27T11:26:55.351828+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:27:02.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-08-27T11:27:02.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.341749+0000', 'last_change': '2023-08-27T11:26:55.341749+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.341749+0000', 'last_undegraded': '2023-08-27T11:26:55.341749+0000', 'last_fullsized': '2023-08-27T11:26:55.341749+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:27:02.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-08-27T11:27:02.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.343383+0000', 'last_change': '2023-08-27T11:26:55.343383+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.343383+0000', 'last_undegraded': '2023-08-27T11:26:55.343383+0000', 'last_fullsized': '2023-08-27T11:26:55.343383+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-08-27T11:27:02.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 94, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:26:55.343220+0000', 'last_change': '2023-08-27T11:26:55.343220+0000', 'last_active': '2023-08-27T11:26:55.331252+0000', 'last_peered': '2023-08-27T11:26:55.331252+0000', 'last_clean': '2023-08-27T11:26:55.331252+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:26:55.343220+0000', 'last_undegraded': '2023-08-27T11:26:55.343220+0000', 'last_fullsized': '2023-08-27T11:26:55.343220+0000', 'mapping_epoch': 94, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 94, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'last_clean_scrub_stamp': '2023-08-27T11:26:55.331252+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:27:02.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-27T11:27:02.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.589+0000 7fee81dff700 1 Processor -- start 2023-08-27T11:27:02.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.589+0000 7fee81dff700 1 -- start start 2023-08-27T11:27:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.590+0000 7fee81dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 0x7fee7c0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.590+0000 7fee81dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c155110 con 0x7fee7c06b4b0 2023-08-27T11:27:02.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.590+0000 7fee81dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7c0ab040 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.590+0000 7fee81dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0ab540 con 0x7fee7c14e920 2023-08-27T11:27:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fee7c06b4b0 0x7fee7c0c37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47462/0 (socket says 172.21.15.43:47462) 2023-08-27T11:27:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7affd700 1 -- 172.21.15.43:0/1675504438 learned_addr learned my addr 172.21.15.43:0/1675504438 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:02.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7b7fe700 1 --2- 172.21.15.43:0/1675504438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 0x7fee7c0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147857364 0 0) 0x7fee7c155110 con 0x7fee7c06b4b0 2023-08-27T11:27:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee640035b0 con 0x7fee7c06b4b0 2023-08-27T11:27:02.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075454821 0 0) 0x7fee7c0ab040 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c155110 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7b7fe700 1 -- 172.21.15.43:0/1675504438 >> v1:172.21.15.57:6789/0 conn(0x7fee7c0a9ef0 legacy=0x7fee7c0aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7b7fe700 1 -- 172.21.15.43:0/1675504438 >> v1:172.21.15.43:6789/0 conn(0x7fee7c06b4b0 legacy=0x7fee7c0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.591+0000 7fee7b7fe700 1 -- 172.21.15.43:0/1675504438 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7c1553b0 con 0x7fee7c14e920 2023-08-27T11:27:02.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.592+0000 7fee7b7fe700 1 --2- 172.21.15.43:0/1675504438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 0x7fee7c0c0220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009870 tx=0x7fee6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8057933ae9a9cd99 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.592+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011830 con 0x7fee7c14e920 2023-08-27T11:27:02.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.592+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c011990 con 0x7fee7c14e920 2023-08-27T11:27:02.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.592+0000 7fee7a7fc700 1 -- 172.21.15.43:0/1675504438 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c011d20 con 0x7fee7c14e920 2023-08-27T11:27:02.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 -- 172.21.15.43:0/1675504438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 msgr2=0x7fee7c0c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 --2- 172.21.15.43:0/1675504438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 0x7fee7c0c0220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee6c009870 tx=0x7fee6c009b80 comp rx=0 tx=0).stop 2023-08-27T11:27:02.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 -- 172.21.15.43:0/1675504438 shutdown_connections 2023-08-27T11:27:02.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 --2- 172.21.15.43:0/1675504438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c14e920 0x7fee7c0c0220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 -- 172.21.15.43:0/1675504438 >> 172.21.15.43:0/1675504438 conn(0x7fee7c0c2320 msgr2=0x7fee7c0c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:02.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 -- 172.21.15.43:0/1675504438 shutdown_connections 2023-08-27T11:27:02.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.593+0000 7fee81dff700 1 -- 172.21.15.43:0/1675504438 wait complete. 2023-08-27T11:27:02.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.594+0000 7fee81dff700 1 Processor -- start 2023-08-27T11:27:02.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 -- start start 2023-08-27T11:27:02.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee7c14e920 0x7fee7c0beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c0c0c10 0x7fee7c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c152900 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c148e20 con 0x7fee7c14e920 2023-08-27T11:27:02.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.595+0000 7fee81dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c0c0820 con 0x7fee7c0c0c10 2023-08-27T11:27:02.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54134/0 (socket says 172.21.15.43:54134) 2023-08-27T11:27:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 -- 172.21.15.43:0/387762845 learned_addr learned my addr 172.21.15.43:0/387762845 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7affd700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee7c14e920 0x7fee7c0beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7bfff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c0c0c10 0x7fee7c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 -- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c0c0c10 msgr2=0x7fee7c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c0c0c10 0x7fee7c147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 -- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee7c14e920 msgr2=0x7fee7c0beec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee7c14e920 0x7fee7c0beec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 -- 172.21.15.43:0/387762845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0094a0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.596+0000 7fee7b7fe700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0090b0 tx=0x7fee6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.597+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c01aa70 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.597+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c01abd0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.597+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0243f0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.597+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c148210 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.597+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c1487d0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.598+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c0674e0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.599+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee6c02d450 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.599+0000 7fee63fff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 0x7fee6806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.599+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee6c089980 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.600+0000 7fee7affd700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 0x7fee6806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:02.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.600+0000 7fee7affd700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 0x7fee6806c5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0a8940 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:02.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.604+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fee6c055060 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.897+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fee7c04ee70 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.898+0000 7fee63fff700 1 -- 172.21.15.43:0/387762845 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1454 (secure 0 0 0) 0x7fee6c0155c0 con 0x7fee7c0a9ef0 2023-08-27T11:27:02.899 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:02.900 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":279,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":96,"num_osds":8,"num_up_osds":8,"osd_up_since":1693135354,"num_in_osds":8,"osd_in_since":1693135346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":231727104,"bytes_avail":772862386176,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":92,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7083}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-08-27T11:26:22.356666+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-27T11:27:02.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 msgr2=0x7fee6806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 0x7fee6806c5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0a8940 tx=0x7fee70009040 comp rx=0 tx=0).stop 2023-08-27T11:27:02.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 msgr2=0x7fee7c0c02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:02.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0090b0 tx=0x7fee6c004750 comp rx=0 tx=0).stop 2023-08-27T11:27:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 shutdown_connections 2023-08-27T11:27:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee6806a110 0x7fee6806c5d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee7c0c0c10 0x7fee7c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fee7c0a9ef0 0x7fee7c0c02e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 --2- 172.21.15.43:0/387762845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee7c14e920 0x7fee7c0beec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:02.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 >> 172.21.15.43:0/387762845 conn(0x7fee7c0c2320 msgr2=0x7fee7c06bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:02.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 shutdown_connections 2023-08-27T11:27:02.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:02.900+0000 7fee81dff700 1 -- 172.21.15.43:0/387762845 wait complete. 2023-08-27T11:27:02.921 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-27T11:27:02.921 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:03.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.122+0000 7f34fb9ff700 1 Processor -- start 2023-08-27T11:27:03.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.122+0000 7f34fb9ff700 1 -- start start 2023-08-27T11:27:03.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.123+0000 7f34fb9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f34f4151a90 0x7f34f40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.123+0000 7f34fb9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f34f40c4a90 0x7f34f406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.123+0000 7f34fb9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f406c4e0 con 0x7f34f40c4630 2023-08-27T11:27:03.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.123+0000 7f34fb9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f4155370 con 0x7f34f4151a90 2023-08-27T11:27:03.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.123+0000 7f34fb9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f4151e70 con 0x7f34f40c4a90 2023-08-27T11:27:03.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f8f9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f34f40c4630 0x7f34f406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47464/0 (socket says 172.21.15.43:47464) 2023-08-27T11:27:03.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f8f9a700 1 -- 172.21.15.43:0/3403201124 learned_addr learned my addr 172.21.15.43:0/3403201124 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:03.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 --2- 172.21.15.43:0/3403201124 >> v2:172.21.15.43:3300/0 conn(0x7f34f4151a90 0x7f34f40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f9f9c700 1 --2- 172.21.15.43:0/3403201124 >> v2:172.21.15.57:3300/0 conn(0x7f34f40c4a90 0x7f34f406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34ebfff700 1 -- 172.21.15.43:0/3403201124 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593473141 0 0) 0x7f34f406c4e0 con 0x7f34f40c4630 2023-08-27T11:27:03.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34ebfff700 1 -- 172.21.15.43:0/3403201124 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e00035b0 con 0x7f34f40c4630 2023-08-27T11:27:03.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 -- 172.21.15.43:0/3403201124 >> v2:172.21.15.57:3300/0 conn(0x7f34f40c4a90 msgr2=0x7f34f406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:03.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 --2- 172.21.15.43:0/3403201124 >> v2:172.21.15.57:3300/0 conn(0x7f34f40c4a90 0x7f34f406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 -- 172.21.15.43:0/3403201124 >> v1:172.21.15.43:6789/0 conn(0x7f34f40c4630 legacy=0x7f34f406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 -- 172.21.15.43:0/3403201124 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4154480 con 0x7f34f4151a90 2023-08-27T11:27:03.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.124+0000 7f34f979b700 1 --2- 172.21.15.43:0/3403201124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f40c7bb0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c4270 tx=0x7f34f0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4478993d0147cf77 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:03.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34ebfff700 1 -- 172.21.15.43:0/3403201124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0011830 con 0x7f34f4151a90 2023-08-27T11:27:03.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34ebfff700 1 -- 172.21.15.43:0/3403201124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0011990 con 0x7f34f4151a90 2023-08-27T11:27:03.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34ebfff700 1 -- 172.21.15.43:0/3403201124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0011d20 con 0x7f34f4151a90 2023-08-27T11:27:03.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3403201124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 msgr2=0x7f34f40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3403201124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f40c7bb0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f34f40c4270 tx=0x7f34f0009b20 comp rx=0 tx=0).stop 2023-08-27T11:27:03.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3403201124 shutdown_connections 2023-08-27T11:27:03.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3403201124 >> v2:172.21.15.57:3300/0 conn(0x7f34f40c4a90 0x7f34f406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3403201124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f40c7bb0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3403201124 >> 172.21.15.43:0/3403201124 conn(0x7f34f40ab820 msgr2=0x7f34f40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:03.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3403201124 shutdown_connections 2023-08-27T11:27:03.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.125+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3403201124 wait complete. 2023-08-27T11:27:03.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.127+0000 7f34fb9ff700 1 Processor -- start 2023-08-27T11:27:03.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.127+0000 7f34fb9ff700 1 -- start start 2023-08-27T11:27:03.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f34f40c4630 0x7f34f41ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34f40c4a90 0x7f34f40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4156490 con 0x7f34f4151a90 2023-08-27T11:27:03.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f4158140 con 0x7f34f40c4a90 2023-08-27T11:27:03.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34fb9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41ecec0 con 0x7f34f40c4630 2023-08-27T11:27:03.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.128+0000 7f34f9f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54146/0 (socket says 172.21.15.43:54146) 2023-08-27T11:27:03.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 -- 172.21.15.43:0/3280717774 learned_addr learned my addr 172.21.15.43:0/3280717774 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:03.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f8f9a700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34f40c4a90 0x7f34f40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f979b700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f34f40c4630 0x7f34f41ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 -- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f34f40c4630 msgr2=0x7f34f41ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f34f40c4630 0x7f34f41ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 -- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34f40c4a90 msgr2=0x7f34f40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34f40c4a90 0x7f34f40aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 -- 172.21.15.43:0/3280717774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00094a0 con 0x7f34f4151a90 2023-08-27T11:27:03.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34f9f9c700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00efc0 tx=0x7f34ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:03.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009ea0 con 0x7f34f4151a90 2023-08-27T11:27:03.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec00f040 con 0x7f34f4151a90 2023-08-27T11:27:03.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.129+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00ced0 con 0x7f34f4151a90 2023-08-27T11:27:03.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.130+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f41ed1a0 con 0x7f34f4151a90 2023-08-27T11:27:03.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.130+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f40aae10 con 0x7f34f4151a90 2023-08-27T11:27:03.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.131+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f41ed6c0 con 0x7f34f4151a90 2023-08-27T11:27:03.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.132+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34ec014480 con 0x7f34f4151a90 2023-08-27T11:27:03.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.133+0000 7f34e9ffb700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 0x7f34d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:03.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.133+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34ec088da0 con 0x7f34f4151a90 2023-08-27T11:27:03.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.133+0000 7f34f979b700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 0x7f34d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:03.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.134+0000 7f34f979b700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 0x7f34d806c5a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f34f00090b0 tx=0x7f34f001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:03.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.138+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f34f41ed6c0 con 0x7f34f4151a90 2023-08-27T11:27:03.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.341+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34f4154a40 con 0x7f34d806a0e0 2023-08-27T11:27:03.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.352+0000 7f34e9ffb700 1 -- 172.21.15.43:0/3280717774 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311453 (secure 0 0 0) 0x7f34f0011b80 con 0x7f34d806a0e0 2023-08-27T11:27:03.357 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:03.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 msgr2=0x7f34d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 0x7f34d806c5a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f34f00090b0 tx=0x7f34f001c040 comp rx=0 tx=0).stop 2023-08-27T11:27:03.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 msgr2=0x7f34f4156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:03.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00efc0 tx=0x7f34ec00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 shutdown_connections 2023-08-27T11:27:03.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f34d806a0e0 0x7f34d806c5a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f34f4151a90 0x7f34f4156fc0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f34f40c4630 0x7f34f41ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 --2- 172.21.15.43:0/3280717774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f34f40c4a90 0x7f34f40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 >> 172.21.15.43:0/3280717774 conn(0x7f34f40ab820 msgr2=0x7f34f414ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.357+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 shutdown_connections 2023-08-27T11:27:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:03.358+0000 7f34fb9ff700 1 -- 172.21.15.43:0/3280717774 wait complete. 2023-08-27T11:27:03.362 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:03.378 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2023-08-27T11:27:02.364841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226696,"kb_used_data":10488,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754748024,"statfs":{"total":773094113280,"available":772861976576,"internally_reserved":0,"allocated":10739712,"data_stored":5614460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.030065"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613978+0000","last_change":"2023-08-27T11:26:56.408592+0000","last_active":"2023-08-27T11:26:57.613978+0000","last_peered":"2023-08-27T11:26:57.613978+0000","last_clean":"2023-08-27T11:26:57.613978+0000","last_became_active":"2023-08-27T11:26:56.407080+0000","last_became_peered":"2023-08-27T11:26:56.407080+0000","last_unstale":"2023-08-27T11:26:57.613978+0000","last_undegraded":"2023-08-27T11:26:57.613978+0000","last_fullsized":"2023-08-27T11:26:57.613978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:39.598717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373830+0000","last_change":"2023-08-27T11:26:56.387743+0000","last_active":"2023-08-27T11:26:57.373830+0000","last_peered":"2023-08-27T11:26:57.373830+0000","last_clean":"2023-08-27T11:26:57.373830+0000","last_became_active":"2023-08-27T11:26:56.387464+0000","last_became_peered":"2023-08-27T11:26:56.387464+0000","last_unstale":"2023-08-27T11:26:57.373830+0000","last_undegraded":"2023-08-27T11:26:57.373830+0000","last_fullsized":"2023-08-27T11:26:57.373830+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:37.280187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613913+0000","last_change":"2023-08-27T11:26:56.408542+0000","last_active":"2023-08-27T11:26:57.613913+0000","last_peered":"2023-08-27T11:26:57.613913+0000","last_clean":"2023-08-27T11:26:57.613913+0000","last_became_active":"2023-08-27T11:26:56.408209+0000","last_became_peered":"2023-08-27T11:26:56.408209+0000","last_unstale":"2023-08-27T11:26:57.613913+0000","last_undegraded":"2023-08-27T11:26:57.613913+0000","last_fullsized":"2023-08-27T11:26:57.613913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:59.589734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868700+0000","last_change":"2023-08-27T11:26:56.402864+0000","last_active":"2023-08-27T11:26:57.868700+0000","last_peered":"2023-08-27T11:26:57.868700+0000","last_clean":"2023-08-27T11:26:57.868700+0000","last_became_active":"2023-08-27T11:26:56.402499+0000","last_became_peered":"2023-08-27T11:26:56.402499+0000","last_unstale":"2023-08-27T11:26:57.868700+0000","last_undegraded":"2023-08-27T11:26:57.868700+0000","last_fullsized":"2023-08-27T11:26:57.868700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:02.936465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868212+0000","last_change":"2023-08-27T11:26:56.404881+0000","last_active":"2023-08-27T11:26:57.868212+0000","last_peered":"2023-08-27T11:26:57.868212+0000","last_clean":"2023-08-27T11:26:57.868212+0000","last_became_active":"2023-08-27T11:26:56.404654+0000","last_became_peered":"2023-08-27T11:26:56.404654+0000","last_unstale":"2023-08-27T11:26:57.868212+0000","last_undegraded":"2023-08-27T11:26:57.868212+0000","last_fullsized":"2023-08-27T11:26:57.868212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:12:17.514190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373417+0000","last_change":"2023-08-27T11:26:56.396886+0000","last_active":"2023-08-27T11:26:57.373417+0000","last_peered":"2023-08-27T11:26:57.373417+0000","last_clean":"2023-08-27T11:26:57.373417+0000","last_became_active":"2023-08-27T11:26:56.396590+0000","last_became_peered":"2023-08-27T11:26:56.396590+0000","last_unstale":"2023-08-27T11:26:57.373417+0000","last_undegraded":"2023-08-27T11:26:57.373417+0000","last_fullsized":"2023-08-27T11:26:57.373417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:02.936465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.372761+0000","last_change":"2023-08-27T11:26:56.405448+0000","last_active":"2023-08-27T11:26:57.372761+0000","last_peered":"2023-08-27T11:26:57.372761+0000","last_clean":"2023-08-27T11:26:57.372761+0000","last_became_active":"2023-08-27T11:26:56.403853+0000","last_became_peered":"2023-08-27T11:26:56.403853+0000","last_unstale":"2023-08-27T11:26:57.372761+0000","last_undegraded":"2023-08-27T11:26:57.372761+0000","last_fullsized":"2023-08-27T11:26:57.372761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524257+0000","last_change":"2023-08-27T11:26:56.397090+0000","last_active":"2023-08-27T11:26:57.524257+0000","last_peered":"2023-08-27T11:26:57.524257+0000","last_clean":"2023-08-27T11:26:57.524257+0000","last_became_active":"2023-08-27T11:26:56.396783+0000","last_became_peered":"2023-08-27T11:26:56.396783+0000","last_unstale":"2023-08-27T11:26:57.524257+0000","last_undegraded":"2023-08-27T11:26:57.524257+0000","last_fullsized":"2023-08-27T11:26:57.524257+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:28.423234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373984+0000","last_change":"2023-08-27T11:26:56.395879+0000","last_active":"2023-08-27T11:26:57.373984+0000","last_peered":"2023-08-27T11:26:57.373984+0000","last_clean":"2023-08-27T11:26:57.373984+0000","last_became_active":"2023-08-27T11:26:56.395371+0000","last_became_peered":"2023-08-27T11:26:56.395371+0000","last_unstale":"2023-08-27T11:26:57.373984+0000","last_undegraded":"2023-08-27T11:26:57.373984+0000","last_fullsized":"2023-08-27T11:26:57.373984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:27:14.704910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868817+0000","last_change":"2023-08-27T11:26:56.395875+0000","last_active":"2023-08-27T11:26:57.868817+0000","last_peered":"2023-08-27T11:26:57.868817+0000","last_clean":"2023-08-27T11:26:57.868817+0000","last_became_active":"2023-08-27T11:26:56.395593+0000","last_became_peered":"2023-08-27T11:26:56.395593+0000","last_unstale":"2023-08-27T11:26:57.868817+0000","last_undegraded":"2023-08-27T11:26:57.868817+0000","last_fullsized":"2023-08-27T11:26:57.868817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:35:09.375324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375039+0000","last_change":"2023-08-27T11:26:56.401898+0000","last_active":"2023-08-27T11:26:57.375039+0000","last_peered":"2023-08-27T11:26:57.375039+0000","last_clean":"2023-08-27T11:26:57.375039+0000","last_became_active":"2023-08-27T11:26:56.401627+0000","last_became_peered":"2023-08-27T11:26:56.401627+0000","last_unstale":"2023-08-27T11:26:57.375039+0000","last_undegraded":"2023-08-27T11:26:57.375039+0000","last_fullsized":"2023-08-27T11:26:57.375039+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:28.191535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376228+0000","last_change":"2023-08-27T11:26:56.403577+0000","last_active":"2023-08-27T11:26:57.376228+0000","last_peered":"2023-08-27T11:26:57.376228+0000","last_clean":"2023-08-27T11:26:57.376228+0000","last_became_active":"2023-08-27T11:26:56.402911+0000","last_became_peered":"2023-08-27T11:26:56.402911+0000","last_unstale":"2023-08-27T11:26:57.376228+0000","last_undegraded":"2023-08-27T11:26:57.376228+0000","last_fullsized":"2023-08-27T11:26:57.376228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:41.290786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868165+0000","last_change":"2023-08-27T11:26:56.409079+0000","last_active":"2023-08-27T11:26:57.868165+0000","last_peered":"2023-08-27T11:26:57.868165+0000","last_clean":"2023-08-27T11:26:57.868165+0000","last_became_active":"2023-08-27T11:26:56.408740+0000","last_became_peered":"2023-08-27T11:26:56.408740+0000","last_unstale":"2023-08-27T11:26:57.868165+0000","last_undegraded":"2023-08-27T11:26:57.868165+0000","last_fullsized":"2023-08-27T11:26:57.868165+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:02.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868519+0000","last_change":"2023-08-27T11:26:56.404726+0000","last_active":"2023-08-27T11:26:57.868519+0000","last_peered":"2023-08-27T11:26:57.868519+0000","last_clean":"2023-08-27T11:26:57.868519+0000","last_became_active":"2023-08-27T11:26:56.404333+0000","last_became_peered":"2023-08-27T11:26:56.404333+0000","last_unstale":"2023-08-27T11:26:57.868519+0000","last_undegraded":"2023-08-27T11:26:57.868519+0000","last_fullsized":"2023-08-27T11:26:57.868519+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:28.078240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868444+0000","last_change":"2023-08-27T11:26:56.401955+0000","last_active":"2023-08-27T11:26:57.868444+0000","last_peered":"2023-08-27T11:26:57.868444+0000","last_clean":"2023-08-27T11:26:57.868444+0000","last_became_active":"2023-08-27T11:26:56.401658+0000","last_became_peered":"2023-08-27T11:26:56.401658+0000","last_unstale":"2023-08-27T11:26:57.868444+0000","last_undegraded":"2023-08-27T11:26:57.868444+0000","last_fullsized":"2023-08-27T11:26:57.868444+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:34:11.294872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868440+0000","last_change":"2023-08-27T11:26:56.388949+0000","last_active":"2023-08-27T11:26:57.868440+0000","last_peered":"2023-08-27T11:26:57.868440+0000","last_clean":"2023-08-27T11:26:57.868440+0000","last_became_active":"2023-08-27T11:26:56.388628+0000","last_became_peered":"2023-08-27T11:26:56.388628+0000","last_unstale":"2023-08-27T11:26:57.868440+0000","last_undegraded":"2023-08-27T11:26:57.868440+0000","last_fullsized":"2023-08-27T11:26:57.868440+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:59.182830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614015+0000","last_change":"2023-08-27T11:26:56.408654+0000","last_active":"2023-08-27T11:26:57.614015+0000","last_peered":"2023-08-27T11:26:57.614015+0000","last_clean":"2023-08-27T11:26:57.614015+0000","last_became_active":"2023-08-27T11:26:56.407924+0000","last_became_peered":"2023-08-27T11:26:56.407924+0000","last_unstale":"2023-08-27T11:26:57.614015+0000","last_undegraded":"2023-08-27T11:26:57.614015+0000","last_fullsized":"2023-08-27T11:26:57.614015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:54.858688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373774+0000","last_change":"2023-08-27T11:26:56.396145+0000","last_active":"2023-08-27T11:26:57.373774+0000","last_peered":"2023-08-27T11:26:57.373774+0000","last_clean":"2023-08-27T11:26:57.373774+0000","last_became_active":"2023-08-27T11:26:56.395680+0000","last_became_peered":"2023-08-27T11:26:56.395680+0000","last_unstale":"2023-08-27T11:26:57.373774+0000","last_undegraded":"2023-08-27T11:26:57.373774+0000","last_fullsized":"2023-08-27T11:26:57.373774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:44:28.732858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613917+0000","last_change":"2023-08-27T11:26:56.400919+0000","last_active":"2023-08-27T11:26:57.613917+0000","last_peered":"2023-08-27T11:26:57.613917+0000","last_clean":"2023-08-27T11:26:57.613917+0000","last_became_active":"2023-08-27T11:26:56.399457+0000","last_became_peered":"2023-08-27T11:26:56.399457+0000","last_unstale":"2023-08-27T11:26:57.613917+0000","last_undegraded":"2023-08-27T11:26:57.613917+0000","last_fullsized":"2023-08-27T11:26:57.613917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:00.367707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376193+0000","last_change":"2023-08-27T11:26:56.399491+0000","last_active":"2023-08-27T11:26:57.376193+0000","last_peered":"2023-08-27T11:26:57.376193+0000","last_clean":"2023-08-27T11:26:57.376193+0000","last_became_active":"2023-08-27T11:26:56.399191+0000","last_became_peered":"2023-08-27T11:26:56.399191+0000","last_unstale":"2023-08-27T11:26:57.376193+0000","last_undegraded":"2023-08-27T11:26:57.376193+0000","last_fullsized":"2023-08-27T11:26:57.376193+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:31.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524697+0000","last_change":"2023-08-27T11:26:56.396546+0000","last_active":"2023-08-27T11:26:57.524697+0000","last_peered":"2023-08-27T11:26:57.524697+0000","last_clean":"2023-08-27T11:26:57.524697+0000","last_became_active":"2023-08-27T11:26:56.396254+0000","last_became_peered":"2023-08-27T11:26:56.396254+0000","last_unstale":"2023-08-27T11:26:57.524697+0000","last_undegraded":"2023-08-27T11:26:57.524697+0000","last_fullsized":"2023-08-27T11:26:57.524697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:48.303878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868234+0000","last_change":"2023-08-27T11:26:56.407165+0000","last_active":"2023-08-27T11:26:57.868234+0000","last_peered":"2023-08-27T11:26:57.868234+0000","last_clean":"2023-08-27T11:26:57.868234+0000","last_became_active":"2023-08-27T11:26:56.406789+0000","last_became_peered":"2023-08-27T11:26:56.406789+0000","last_unstale":"2023-08-27T11:26:57.868234+0000","last_undegraded":"2023-08-27T11:26:57.868234+0000","last_fullsized":"2023-08-27T11:26:57.868234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:21.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613765+0000","last_change":"2023-08-27T11:26:56.408226+0000","last_active":"2023-08-27T11:26:57.613765+0000","last_peered":"2023-08-27T11:26:57.613765+0000","last_clean":"2023-08-27T11:26:57.613765+0000","last_became_active":"2023-08-27T11:26:56.407876+0000","last_became_peered":"2023-08-27T11:26:56.407876+0000","last_unstale":"2023-08-27T11:26:57.613765+0000","last_undegraded":"2023-08-27T11:26:57.613765+0000","last_fullsized":"2023-08-27T11:26:57.613765+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:40.671066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.867954+0000","last_change":"2023-08-27T11:26:56.400275+0000","last_active":"2023-08-27T11:26:57.867954+0000","last_peered":"2023-08-27T11:26:57.867954+0000","last_clean":"2023-08-27T11:26:57.867954+0000","last_became_active":"2023-08-27T11:26:56.399957+0000","last_became_peered":"2023-08-27T11:26:56.399957+0000","last_unstale":"2023-08-27T11:26:57.867954+0000","last_undegraded":"2023-08-27T11:26:57.867954+0000","last_fullsized":"2023-08-27T11:26:57.867954+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:40.764967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375325+0000","last_change":"2023-08-27T11:26:56.415345+0000","last_active":"2023-08-27T11:26:57.375325+0000","last_peered":"2023-08-27T11:26:57.375325+0000","last_clean":"2023-08-27T11:26:57.375325+0000","last_became_active":"2023-08-27T11:26:56.415020+0000","last_became_peered":"2023-08-27T11:26:56.415020+0000","last_unstale":"2023-08-27T11:26:57.375325+0000","last_undegraded":"2023-08-27T11:26:57.375325+0000","last_fullsized":"2023-08-27T11:26:57.375325+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376238+0000","last_change":"2023-08-27T11:26:56.399410+0000","last_active":"2023-08-27T11:26:57.376238+0000","last_peered":"2023-08-27T11:26:57.376238+0000","last_clean":"2023-08-27T11:26:57.376238+0000","last_became_active":"2023-08-27T11:26:56.399060+0000","last_became_peered":"2023-08-27T11:26:56.399060+0000","last_unstale":"2023-08-27T11:26:57.376238+0000","last_undegraded":"2023-08-27T11:26:57.376238+0000","last_fullsized":"2023-08-27T11:26:57.376238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:24.192376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375199+0000","last_change":"2023-08-27T11:26:56.401373+0000","last_active":"2023-08-27T11:26:57.375199+0000","last_peered":"2023-08-27T11:26:57.375199+0000","last_clean":"2023-08-27T11:26:57.375199+0000","last_became_active":"2023-08-27T11:26:56.399634+0000","last_became_peered":"2023-08-27T11:26:56.399634+0000","last_unstale":"2023-08-27T11:26:57.375199+0000","last_undegraded":"2023-08-27T11:26:57.375199+0000","last_fullsized":"2023-08-27T11:26:57.375199+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:47.092124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373376+0000","last_change":"2023-08-27T11:26:56.409257+0000","last_active":"2023-08-27T11:26:57.373376+0000","last_peered":"2023-08-27T11:26:57.373376+0000","last_clean":"2023-08-27T11:26:57.373376+0000","last_became_active":"2023-08-27T11:26:56.408930+0000","last_became_peered":"2023-08-27T11:26:56.408930+0000","last_unstale":"2023-08-27T11:26:57.373376+0000","last_undegraded":"2023-08-27T11:26:57.373376+0000","last_fullsized":"2023-08-27T11:26:57.373376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524671+0000","last_change":"2023-08-27T11:26:56.385683+0000","last_active":"2023-08-27T11:26:57.524671+0000","last_peered":"2023-08-27T11:26:57.524671+0000","last_clean":"2023-08-27T11:26:57.524671+0000","last_became_active":"2023-08-27T11:26:56.385424+0000","last_became_peered":"2023-08-27T11:26:56.385424+0000","last_unstale":"2023-08-27T11:26:57.524671+0000","last_undegraded":"2023-08-27T11:26:57.524671+0000","last_fullsized":"2023-08-27T11:26:57.524671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.719205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375885+0000","last_change":"2023-08-27T11:26:56.415827+0000","last_active":"2023-08-27T11:26:57.375885+0000","last_peered":"2023-08-27T11:26:57.375885+0000","last_clean":"2023-08-27T11:26:57.375885+0000","last_became_active":"2023-08-27T11:26:56.415518+0000","last_became_peered":"2023-08-27T11:26:56.415518+0000","last_unstale":"2023-08-27T11:26:57.375885+0000","last_undegraded":"2023-08-27T11:26:57.375885+0000","last_fullsized":"2023-08-27T11:26:57.375885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:08.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373017+0000","last_change":"2023-08-27T11:26:56.391441+0000","last_active":"2023-08-27T11:26:57.373017+0000","last_peered":"2023-08-27T11:26:57.373017+0000","last_clean":"2023-08-27T11:26:57.373017+0000","last_became_active":"2023-08-27T11:26:56.391035+0000","last_became_peered":"2023-08-27T11:26:56.391035+0000","last_unstale":"2023-08-27T11:26:57.373017+0000","last_undegraded":"2023-08-27T11:26:57.373017+0000","last_fullsized":"2023-08-27T11:26:57.373017+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:10.637907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524239+0000","last_change":"2023-08-27T11:26:56.405208+0000","last_active":"2023-08-27T11:26:57.524239+0000","last_peered":"2023-08-27T11:26:57.524239+0000","last_clean":"2023-08-27T11:26:57.524239+0000","last_became_active":"2023-08-27T11:26:56.404872+0000","last_became_peered":"2023-08-27T11:26:56.404872+0000","last_unstale":"2023-08-27T11:26:57.524239+0000","last_undegraded":"2023-08-27T11:26:57.524239+0000","last_fullsized":"2023-08-27T11:26:57.524239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:13:07.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614000+0000","last_change":"2023-08-27T11:26:56.396892+0000","last_active":"2023-08-27T11:26:57.614000+0000","last_peered":"2023-08-27T11:26:57.614000+0000","last_clean":"2023-08-27T11:26:57.614000+0000","last_became_active":"2023-08-27T11:26:56.395168+0000","last_became_peered":"2023-08-27T11:26:56.395168+0000","last_unstale":"2023-08-27T11:26:57.614000+0000","last_undegraded":"2023-08-27T11:26:57.614000+0000","last_fullsized":"2023-08-27T11:26:57.614000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:08.727201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"95'4","reported_seq":17,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868608+0000","last_change":"2023-08-27T11:26:55.361418+0000","last_active":"2023-08-27T11:26:57.868608+0000","last_peered":"2023-08-27T11:26:57.868608+0000","last_clean":"2023-08-27T11:26:57.868608+0000","last_became_active":"2023-08-27T11:26:55.361075+0000","last_became_peered":"2023-08-27T11:26:55.361075+0000","last_unstale":"2023-08-27T11:26:57.868608+0000","last_undegraded":"2023-08-27T11:26:57.868608+0000","last_fullsized":"2023-08-27T11:26:57.868608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:07.079854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524333+0000","last_change":"2023-08-27T11:26:56.397484+0000","last_active":"2023-08-27T11:26:57.524333+0000","last_peered":"2023-08-27T11:26:57.524333+0000","last_clean":"2023-08-27T11:26:57.524333+0000","last_became_active":"2023-08-27T11:26:56.397082+0000","last_became_peered":"2023-08-27T11:26:56.397082+0000","last_unstale":"2023-08-27T11:26:57.524333+0000","last_undegraded":"2023-08-27T11:26:57.524333+0000","last_fullsized":"2023-08-27T11:26:57.524333+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:28:02.568496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524689+0000","last_change":"2023-08-27T11:26:55.360037+0000","last_active":"2023-08-27T11:26:57.524689+0000","last_peered":"2023-08-27T11:26:57.524689+0000","last_clean":"2023-08-27T11:26:57.524689+0000","last_became_active":"2023-08-27T11:26:55.359712+0000","last_became_peered":"2023-08-27T11:26:55.359712+0000","last_unstale":"2023-08-27T11:26:57.524689+0000","last_undegraded":"2023-08-27T11:26:57.524689+0000","last_fullsized":"2023-08-27T11:26:57.524689+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:25.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375929+0000","last_change":"2023-08-27T11:26:56.404857+0000","last_active":"2023-08-27T11:26:57.375929+0000","last_peered":"2023-08-27T11:26:57.375929+0000","last_clean":"2023-08-27T11:26:57.375929+0000","last_became_active":"2023-08-27T11:26:56.404527+0000","last_became_peered":"2023-08-27T11:26:56.404527+0000","last_unstale":"2023-08-27T11:26:57.375929+0000","last_undegraded":"2023-08-27T11:26:57.375929+0000","last_fullsized":"2023-08-27T11:26:57.375929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:08.307847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374913+0000","last_change":"2023-08-27T11:26:55.353142+0000","last_active":"2023-08-27T11:26:57.374913+0000","last_peered":"2023-08-27T11:26:57.374913+0000","last_clean":"2023-08-27T11:26:57.374913+0000","last_became_active":"2023-08-27T11:26:55.352351+0000","last_became_peered":"2023-08-27T11:26:55.352351+0000","last_unstale":"2023-08-27T11:26:57.374913+0000","last_undegraded":"2023-08-27T11:26:57.374913+0000","last_fullsized":"2023-08-27T11:26:57.374913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:41.683053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375320+0000","last_change":"2023-08-27T11:26:56.407494+0000","last_active":"2023-08-27T11:26:57.375320+0000","last_peered":"2023-08-27T11:26:57.375320+0000","last_clean":"2023-08-27T11:26:57.375320+0000","last_became_active":"2023-08-27T11:26:56.407117+0000","last_became_peered":"2023-08-27T11:26:56.407117+0000","last_unstale":"2023-08-27T11:26:57.375320+0000","last_undegraded":"2023-08-27T11:26:57.375320+0000","last_fullsized":"2023-08-27T11:26:57.375320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:49:17.983180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868713+0000","last_change":"2023-08-27T11:26:55.363797+0000","last_active":"2023-08-27T11:26:57.868713+0000","last_peered":"2023-08-27T11:26:57.868713+0000","last_clean":"2023-08-27T11:26:57.868713+0000","last_became_active":"2023-08-27T11:26:55.363472+0000","last_became_peered":"2023-08-27T11:26:55.363472+0000","last_unstale":"2023-08-27T11:26:57.868713+0000","last_undegraded":"2023-08-27T11:26:57.868713+0000","last_fullsized":"2023-08-27T11:26:57.868713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:22.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868671+0000","last_change":"2023-08-27T11:26:56.401936+0000","last_active":"2023-08-27T11:26:57.868671+0000","last_peered":"2023-08-27T11:26:57.868671+0000","last_clean":"2023-08-27T11:26:57.868671+0000","last_became_active":"2023-08-27T11:26:56.397037+0000","last_became_peered":"2023-08-27T11:26:56.397037+0000","last_unstale":"2023-08-27T11:26:57.868671+0000","last_undegraded":"2023-08-27T11:26:57.868671+0000","last_fullsized":"2023-08-27T11:26:57.868671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868757+0000","last_change":"2023-08-27T11:26:55.360072+0000","last_active":"2023-08-27T11:26:57.868757+0000","last_peered":"2023-08-27T11:26:57.868757+0000","last_clean":"2023-08-27T11:26:57.868757+0000","last_became_active":"2023-08-27T11:26:55.359779+0000","last_became_peered":"2023-08-27T11:26:55.359779+0000","last_unstale":"2023-08-27T11:26:57.868757+0000","last_undegraded":"2023-08-27T11:26:57.868757+0000","last_fullsized":"2023-08-27T11:26:57.868757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:04.985952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614126+0000","last_change":"2023-08-27T11:26:56.400875+0000","last_active":"2023-08-27T11:26:57.614126+0000","last_peered":"2023-08-27T11:26:57.614126+0000","last_clean":"2023-08-27T11:26:57.614126+0000","last_became_active":"2023-08-27T11:26:56.399274+0000","last_became_peered":"2023-08-27T11:26:56.399274+0000","last_unstale":"2023-08-27T11:26:57.614126+0000","last_undegraded":"2023-08-27T11:26:57.614126+0000","last_fullsized":"2023-08-27T11:26:57.614126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:47.528291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374919+0000","last_change":"2023-08-27T11:26:55.355107+0000","last_active":"2023-08-27T11:26:57.374919+0000","last_peered":"2023-08-27T11:26:57.374919+0000","last_clean":"2023-08-27T11:26:57.374919+0000","last_became_active":"2023-08-27T11:26:55.354728+0000","last_became_peered":"2023-08-27T11:26:55.354728+0000","last_unstale":"2023-08-27T11:26:57.374919+0000","last_undegraded":"2023-08-27T11:26:57.374919+0000","last_fullsized":"2023-08-27T11:26:57.374919+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:53.583948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373643+0000","last_change":"2023-08-27T11:26:56.403774+0000","last_active":"2023-08-27T11:26:57.373643+0000","last_peered":"2023-08-27T11:26:57.373643+0000","last_clean":"2023-08-27T11:26:57.373643+0000","last_became_active":"2023-08-27T11:26:56.402255+0000","last_became_peered":"2023-08-27T11:26:56.402255+0000","last_unstale":"2023-08-27T11:26:57.373643+0000","last_undegraded":"2023-08-27T11:26:57.373643+0000","last_fullsized":"2023-08-27T11:26:57.373643+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:31.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376038+0000","last_change":"2023-08-27T11:26:55.353051+0000","last_active":"2023-08-27T11:26:57.376038+0000","last_peered":"2023-08-27T11:26:57.376038+0000","last_clean":"2023-08-27T11:26:57.376038+0000","last_became_active":"2023-08-27T11:26:55.352606+0000","last_became_peered":"2023-08-27T11:26:55.352606+0000","last_unstale":"2023-08-27T11:26:57.376038+0000","last_undegraded":"2023-08-27T11:26:57.376038+0000","last_fullsized":"2023-08-27T11:26:57.376038+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:06.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868781+0000","last_change":"2023-08-27T11:26:56.389555+0000","last_active":"2023-08-27T11:26:57.868781+0000","last_peered":"2023-08-27T11:26:57.868781+0000","last_clean":"2023-08-27T11:26:57.868781+0000","last_became_active":"2023-08-27T11:26:56.389254+0000","last_became_peered":"2023-08-27T11:26:56.389254+0000","last_unstale":"2023-08-27T11:26:57.868781+0000","last_undegraded":"2023-08-27T11:26:57.868781+0000","last_fullsized":"2023-08-27T11:26:57.868781+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:08.307847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868040+0000","last_change":"2023-08-27T11:26:55.356739+0000","last_active":"2023-08-27T11:26:57.868040+0000","last_peered":"2023-08-27T11:26:57.868040+0000","last_clean":"2023-08-27T11:26:57.868040+0000","last_became_active":"2023-08-27T11:26:55.356419+0000","last_became_peered":"2023-08-27T11:26:55.356419+0000","last_unstale":"2023-08-27T11:26:57.868040+0000","last_undegraded":"2023-08-27T11:26:57.868040+0000","last_fullsized":"2023-08-27T11:26:57.868040+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:41.683053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614000+0000","last_change":"2023-08-27T11:26:56.396547+0000","last_active":"2023-08-27T11:26:57.614000+0000","last_peered":"2023-08-27T11:26:57.614000+0000","last_clean":"2023-08-27T11:26:57.614000+0000","last_became_active":"2023-08-27T11:26:56.396286+0000","last_became_peered":"2023-08-27T11:26:56.396286+0000","last_unstale":"2023-08-27T11:26:57.614000+0000","last_undegraded":"2023-08-27T11:26:57.614000+0000","last_fullsized":"2023-08-27T11:26:57.614000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:03.294324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375484+0000","last_change":"2023-08-27T11:26:55.352949+0000","last_active":"2023-08-27T11:26:57.375484+0000","last_peered":"2023-08-27T11:26:57.375484+0000","last_clean":"2023-08-27T11:26:57.375484+0000","last_became_active":"2023-08-27T11:26:55.352563+0000","last_became_peered":"2023-08-27T11:26:55.352563+0000","last_unstale":"2023-08-27T11:26:57.375484+0000","last_undegraded":"2023-08-27T11:26:57.375484+0000","last_fullsized":"2023-08-27T11:26:57.375484+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:30.887349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868153+0000","last_change":"2023-08-27T11:26:56.394195+0000","last_active":"2023-08-27T11:26:57.868153+0000","last_peered":"2023-08-27T11:26:57.868153+0000","last_clean":"2023-08-27T11:26:57.868153+0000","last_became_active":"2023-08-27T11:26:56.393848+0000","last_became_peered":"2023-08-27T11:26:56.393848+0000","last_unstale":"2023-08-27T11:26:57.868153+0000","last_undegraded":"2023-08-27T11:26:57.868153+0000","last_fullsized":"2023-08-27T11:26:57.868153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:43.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614074+0000","last_change":"2023-08-27T11:26:55.356564+0000","last_active":"2023-08-27T11:26:57.614074+0000","last_peered":"2023-08-27T11:26:57.614074+0000","last_clean":"2023-08-27T11:26:57.614074+0000","last_became_active":"2023-08-27T11:26:55.356302+0000","last_became_peered":"2023-08-27T11:26:55.356302+0000","last_unstale":"2023-08-27T11:26:57.614074+0000","last_undegraded":"2023-08-27T11:26:57.614074+0000","last_fullsized":"2023-08-27T11:26:57.614074+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:07:55.952715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524594+0000","last_change":"2023-08-27T11:26:56.394527+0000","last_active":"2023-08-27T11:26:57.524594+0000","last_peered":"2023-08-27T11:26:57.524594+0000","last_clean":"2023-08-27T11:26:57.524594+0000","last_became_active":"2023-08-27T11:26:56.394205+0000","last_became_peered":"2023-08-27T11:26:56.394205+0000","last_unstale":"2023-08-27T11:26:57.524594+0000","last_undegraded":"2023-08-27T11:26:57.524594+0000","last_fullsized":"2023-08-27T11:26:57.524594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:19:46.632754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"95'3","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868576+0000","last_change":"2023-08-27T11:26:55.359460+0000","last_active":"2023-08-27T11:26:57.868576+0000","last_peered":"2023-08-27T11:26:57.868576+0000","last_clean":"2023-08-27T11:26:57.868576+0000","last_became_active":"2023-08-27T11:26:55.359161+0000","last_became_peered":"2023-08-27T11:26:55.359161+0000","last_unstale":"2023-08-27T11:26:57.868576+0000","last_undegraded":"2023-08-27T11:26:57.868576+0000","last_fullsized":"2023-08-27T11:26:57.868576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:33.886165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868500+0000","last_change":"2023-08-27T11:26:56.395072+0000","last_active":"2023-08-27T11:26:57.868500+0000","last_peered":"2023-08-27T11:26:57.868500+0000","last_clean":"2023-08-27T11:26:57.868500+0000","last_became_active":"2023-08-27T11:26:56.394727+0000","last_became_peered":"2023-08-27T11:26:56.394727+0000","last_unstale":"2023-08-27T11:26:57.868500+0000","last_undegraded":"2023-08-27T11:26:57.868500+0000","last_fullsized":"2023-08-27T11:26:57.868500+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:36.567374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"95'6","reported_seq":19,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373709+0000","last_change":"2023-08-27T11:26:55.358248+0000","last_active":"2023-08-27T11:26:57.373709+0000","last_peered":"2023-08-27T11:26:57.373709+0000","last_clean":"2023-08-27T11:26:57.373709+0000","last_became_active":"2023-08-27T11:26:55.357893+0000","last_became_peered":"2023-08-27T11:26:55.357893+0000","last_unstale":"2023-08-27T11:26:57.373709+0000","last_undegraded":"2023-08-27T11:26:57.373709+0000","last_fullsized":"2023-08-27T11:26:57.373709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:40.288620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375149+0000","last_change":"2023-08-27T11:26:56.407746+0000","last_active":"2023-08-27T11:26:57.375149+0000","last_peered":"2023-08-27T11:26:57.375149+0000","last_clean":"2023-08-27T11:26:57.375149+0000","last_became_active":"2023-08-27T11:26:56.407261+0000","last_became_peered":"2023-08-27T11:26:56.407261+0000","last_unstale":"2023-08-27T11:26:57.375149+0000","last_undegraded":"2023-08-27T11:26:57.375149+0000","last_fullsized":"2023-08-27T11:26:57.375149+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:17.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868629+0000","last_change":"2023-08-27T11:26:55.358644+0000","last_active":"2023-08-27T11:26:57.868629+0000","last_peered":"2023-08-27T11:26:57.868629+0000","last_clean":"2023-08-27T11:26:57.868629+0000","last_became_active":"2023-08-27T11:26:55.358327+0000","last_became_peered":"2023-08-27T11:26:55.358327+0000","last_unstale":"2023-08-27T11:26:57.868629+0000","last_undegraded":"2023-08-27T11:26:57.868629+0000","last_fullsized":"2023-08-27T11:26:57.868629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:27.738777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373645+0000","last_change":"2023-08-27T11:26:56.395504+0000","last_active":"2023-08-27T11:26:57.373645+0000","last_peered":"2023-08-27T11:26:57.373645+0000","last_clean":"2023-08-27T11:26:57.373645+0000","last_became_active":"2023-08-27T11:26:56.394879+0000","last_became_peered":"2023-08-27T11:26:56.394879+0000","last_unstale":"2023-08-27T11:26:57.373645+0000","last_undegraded":"2023-08-27T11:26:57.373645+0000","last_fullsized":"2023-08-27T11:26:57.373645+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:24.192376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868614+0000","last_change":"2023-08-27T11:26:55.361664+0000","last_active":"2023-08-27T11:26:57.868614+0000","last_peered":"2023-08-27T11:26:57.868614+0000","last_clean":"2023-08-27T11:26:57.868614+0000","last_became_active":"2023-08-27T11:26:55.361207+0000","last_became_peered":"2023-08-27T11:26:55.361207+0000","last_unstale":"2023-08-27T11:26:57.868614+0000","last_undegraded":"2023-08-27T11:26:57.868614+0000","last_fullsized":"2023-08-27T11:26:57.868614+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:30.887349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524541+0000","last_change":"2023-08-27T11:26:56.402934+0000","last_active":"2023-08-27T11:26:57.524541+0000","last_peered":"2023-08-27T11:26:57.524541+0000","last_clean":"2023-08-27T11:26:57.524541+0000","last_became_active":"2023-08-27T11:26:56.402642+0000","last_became_peered":"2023-08-27T11:26:56.402642+0000","last_unstale":"2023-08-27T11:26:57.524541+0000","last_undegraded":"2023-08-27T11:26:57.524541+0000","last_fullsized":"2023-08-27T11:26:57.524541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:26:40.606458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524401+0000","last_change":"2023-08-27T11:26:55.349997+0000","last_active":"2023-08-27T11:26:57.524401+0000","last_peered":"2023-08-27T11:26:57.524401+0000","last_clean":"2023-08-27T11:26:57.524401+0000","last_became_active":"2023-08-27T11:26:55.349692+0000","last_became_peered":"2023-08-27T11:26:55.349692+0000","last_unstale":"2023-08-27T11:26:57.524401+0000","last_undegraded":"2023-08-27T11:26:57.524401+0000","last_fullsized":"2023-08-27T11:26:57.524401+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:35:47.178676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614154+0000","last_change":"2023-08-27T11:26:56.408766+0000","last_active":"2023-08-27T11:26:57.614154+0000","last_peered":"2023-08-27T11:26:57.614154+0000","last_clean":"2023-08-27T11:26:57.614154+0000","last_became_active":"2023-08-27T11:26:56.408338+0000","last_became_peered":"2023-08-27T11:26:56.408338+0000","last_unstale":"2023-08-27T11:26:57.614154+0000","last_undegraded":"2023-08-27T11:26:57.614154+0000","last_fullsized":"2023-08-27T11:26:57.614154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:50.832278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"95'8","reported_seq":21,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375830+0000","last_change":"2023-08-27T11:26:55.348680+0000","last_active":"2023-08-27T11:26:57.375830+0000","last_peered":"2023-08-27T11:26:57.375830+0000","last_clean":"2023-08-27T11:26:57.375830+0000","last_became_active":"2023-08-27T11:26:55.348359+0000","last_became_peered":"2023-08-27T11:26:55.348359+0000","last_unstale":"2023-08-27T11:26:57.375830+0000","last_undegraded":"2023-08-27T11:26:57.375830+0000","last_fullsized":"2023-08-27T11:26:57.375830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:01.934299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613714+0000","last_change":"2023-08-27T11:26:56.404367+0000","last_active":"2023-08-27T11:26:57.613714+0000","last_peered":"2023-08-27T11:26:57.613714+0000","last_clean":"2023-08-27T11:26:57.613714+0000","last_became_active":"2023-08-27T11:26:56.404085+0000","last_became_peered":"2023-08-27T11:26:56.404085+0000","last_unstale":"2023-08-27T11:26:57.613714+0000","last_undegraded":"2023-08-27T11:26:57.613714+0000","last_fullsized":"2023-08-27T11:26:57.613714+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:27:21.183402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868532+0000","last_change":"2023-08-27T11:26:55.361849+0000","last_active":"2023-08-27T11:26:57.868532+0000","last_peered":"2023-08-27T11:26:57.868532+0000","last_clean":"2023-08-27T11:26:57.868532+0000","last_became_active":"2023-08-27T11:26:55.361557+0000","last_became_peered":"2023-08-27T11:26:55.361557+0000","last_unstale":"2023-08-27T11:26:57.868532+0000","last_undegraded":"2023-08-27T11:26:57.868532+0000","last_fullsized":"2023-08-27T11:26:57.868532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:43.379736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375566+0000","last_change":"2023-08-27T11:26:56.402148+0000","last_active":"2023-08-27T11:26:57.375566+0000","last_peered":"2023-08-27T11:26:57.375566+0000","last_clean":"2023-08-27T11:26:57.375566+0000","last_became_active":"2023-08-27T11:26:56.401832+0000","last_became_peered":"2023-08-27T11:26:56.401832+0000","last_unstale":"2023-08-27T11:26:57.375566+0000","last_undegraded":"2023-08-27T11:26:57.375566+0000","last_fullsized":"2023-08-27T11:26:57.375566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"96'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614072+0000","last_change":"2023-08-27T11:26:55.354496+0000","last_active":"2023-08-27T11:26:57.614072+0000","last_peered":"2023-08-27T11:26:57.614072+0000","last_clean":"2023-08-27T11:26:57.614072+0000","last_became_active":"2023-08-27T11:26:55.354179+0000","last_became_peered":"2023-08-27T11:26:55.354179+0000","last_unstale":"2023-08-27T11:26:57.614072+0000","last_undegraded":"2023-08-27T11:26:57.614072+0000","last_fullsized":"2023-08-27T11:26:57.614072+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:54.064479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868553+0000","last_change":"2023-08-27T11:26:56.394792+0000","last_active":"2023-08-27T11:26:57.868553+0000","last_peered":"2023-08-27T11:26:57.868553+0000","last_clean":"2023-08-27T11:26:57.868553+0000","last_became_active":"2023-08-27T11:26:56.394462+0000","last_became_peered":"2023-08-27T11:26:56.394462+0000","last_unstale":"2023-08-27T11:26:57.868553+0000","last_undegraded":"2023-08-27T11:26:57.868553+0000","last_fullsized":"2023-08-27T11:26:57.868553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:10.637907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373652+0000","last_change":"2023-08-27T11:26:55.356722+0000","last_active":"2023-08-27T11:26:57.373652+0000","last_peered":"2023-08-27T11:26:57.373652+0000","last_clean":"2023-08-27T11:26:57.373652+0000","last_became_active":"2023-08-27T11:26:55.356411+0000","last_became_peered":"2023-08-27T11:26:55.356411+0000","last_unstale":"2023-08-27T11:26:57.373652+0000","last_undegraded":"2023-08-27T11:26:57.373652+0000","last_fullsized":"2023-08-27T11:26:57.373652+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:36:39.024611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375147+0000","last_change":"2023-08-27T11:26:56.399870+0000","last_active":"2023-08-27T11:26:57.375147+0000","last_peered":"2023-08-27T11:26:57.375147+0000","last_clean":"2023-08-27T11:26:57.375147+0000","last_became_active":"2023-08-27T11:26:56.399577+0000","last_became_peered":"2023-08-27T11:26:56.399577+0000","last_unstale":"2023-08-27T11:26:57.375147+0000","last_undegraded":"2023-08-27T11:26:57.375147+0000","last_fullsized":"2023-08-27T11:26:57.375147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:28.392930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868792+0000","last_change":"2023-08-27T11:26:55.359591+0000","last_active":"2023-08-27T11:26:57.868792+0000","last_peered":"2023-08-27T11:26:57.868792+0000","last_clean":"2023-08-27T11:26:57.868792+0000","last_became_active":"2023-08-27T11:26:55.359302+0000","last_became_peered":"2023-08-27T11:26:55.359302+0000","last_unstale":"2023-08-27T11:26:57.868792+0000","last_undegraded":"2023-08-27T11:26:57.868792+0000","last_fullsized":"2023-08-27T11:26:57.868792+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:56.867022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524519+0000","last_change":"2023-08-27T11:26:56.394468+0000","last_active":"2023-08-27T11:26:57.524519+0000","last_peered":"2023-08-27T11:26:57.524519+0000","last_clean":"2023-08-27T11:26:57.524519+0000","last_became_active":"2023-08-27T11:26:56.394104+0000","last_became_peered":"2023-08-27T11:26:56.394104+0000","last_unstale":"2023-08-27T11:26:57.524519+0000","last_undegraded":"2023-08-27T11:26:57.524519+0000","last_fullsized":"2023-08-27T11:26:57.524519+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:35.898665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375384+0000","last_change":"2023-08-27T11:26:55.349533+0000","last_active":"2023-08-27T11:26:57.375384+0000","last_peered":"2023-08-27T11:26:57.375384+0000","last_clean":"2023-08-27T11:26:57.375384+0000","last_became_active":"2023-08-27T11:26:55.349211+0000","last_became_peered":"2023-08-27T11:26:55.349211+0000","last_unstale":"2023-08-27T11:26:57.375384+0000","last_undegraded":"2023-08-27T11:26:57.375384+0000","last_fullsized":"2023-08-27T11:26:57.375384+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:09.635741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.525013+0000","last_change":"2023-08-27T11:26:56.394467+0000","last_active":"2023-08-27T11:26:57.525013+0000","last_peered":"2023-08-27T11:26:57.525013+0000","last_clean":"2023-08-27T11:26:57.525013+0000","last_became_active":"2023-08-27T11:26:56.394158+0000","last_became_peered":"2023-08-27T11:26:56.394158+0000","last_unstale":"2023-08-27T11:26:57.525013+0000","last_undegraded":"2023-08-27T11:26:57.525013+0000","last_fullsized":"2023-08-27T11:26:57.525013+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:44:52.578481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524899+0000","last_change":"2023-08-27T11:26:55.351607+0000","last_active":"2023-08-27T11:26:57.524899+0000","last_peered":"2023-08-27T11:26:57.524899+0000","last_clean":"2023-08-27T11:26:57.524899+0000","last_became_active":"2023-08-27T11:26:55.351289+0000","last_became_peered":"2023-08-27T11:26:55.351289+0000","last_unstale":"2023-08-27T11:26:57.524899+0000","last_undegraded":"2023-08-27T11:26:57.524899+0000","last_fullsized":"2023-08-27T11:26:57.524899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:58.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868879+0000","last_change":"2023-08-27T11:26:56.397449+0000","last_active":"2023-08-27T11:26:57.868879+0000","last_peered":"2023-08-27T11:26:57.868879+0000","last_clean":"2023-08-27T11:26:57.868879+0000","last_became_active":"2023-08-27T11:26:56.397145+0000","last_became_peered":"2023-08-27T11:26:56.397145+0000","last_unstale":"2023-08-27T11:26:57.868879+0000","last_undegraded":"2023-08-27T11:26:57.868879+0000","last_fullsized":"2023-08-27T11:26:57.868879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:35.339972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373610+0000","last_change":"2023-08-27T11:26:55.357412+0000","last_active":"2023-08-27T11:26:57.373610+0000","last_peered":"2023-08-27T11:26:57.373610+0000","last_clean":"2023-08-27T11:26:57.373610+0000","last_became_active":"2023-08-27T11:26:55.357099+0000","last_became_peered":"2023-08-27T11:26:55.357099+0000","last_unstale":"2023-08-27T11:26:57.373610+0000","last_undegraded":"2023-08-27T11:26:57.373610+0000","last_fullsized":"2023-08-27T11:26:57.373610+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:06.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375781+0000","last_change":"2023-08-27T11:26:56.398193+0000","last_active":"2023-08-27T11:26:57.375781+0000","last_peered":"2023-08-27T11:26:57.375781+0000","last_clean":"2023-08-27T11:26:57.375781+0000","last_became_active":"2023-08-27T11:26:56.397790+0000","last_became_peered":"2023-08-27T11:26:56.397790+0000","last_unstale":"2023-08-27T11:26:57.375781+0000","last_undegraded":"2023-08-27T11:26:57.375781+0000","last_fullsized":"2023-08-27T11:26:57.375781+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:41:30.842425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524593+0000","last_change":"2023-08-27T11:26:55.350845+0000","last_active":"2023-08-27T11:26:57.524593+0000","last_peered":"2023-08-27T11:26:57.524593+0000","last_clean":"2023-08-27T11:26:57.524593+0000","last_became_active":"2023-08-27T11:26:55.350307+0000","last_became_peered":"2023-08-27T11:26:55.350307+0000","last_unstale":"2023-08-27T11:26:57.524593+0000","last_undegraded":"2023-08-27T11:26:57.524593+0000","last_fullsized":"2023-08-27T11:26:57.524593+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:21:47.605243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868433+0000","last_change":"2023-08-27T11:26:56.394791+0000","last_active":"2023-08-27T11:26:57.868433+0000","last_peered":"2023-08-27T11:26:57.868433+0000","last_clean":"2023-08-27T11:26:57.868433+0000","last_became_active":"2023-08-27T11:26:56.394489+0000","last_became_peered":"2023-08-27T11:26:56.394489+0000","last_unstale":"2023-08-27T11:26:57.868433+0000","last_undegraded":"2023-08-27T11:26:57.868433+0000","last_fullsized":"2023-08-27T11:26:57.868433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.372995+0000","last_change":"2023-08-27T11:26:55.358238+0000","last_active":"2023-08-27T11:26:57.372995+0000","last_peered":"2023-08-27T11:26:57.372995+0000","last_clean":"2023-08-27T11:26:57.372995+0000","last_became_active":"2023-08-27T11:26:55.357924+0000","last_became_peered":"2023-08-27T11:26:55.357924+0000","last_unstale":"2023-08-27T11:26:57.372995+0000","last_undegraded":"2023-08-27T11:26:57.372995+0000","last_fullsized":"2023-08-27T11:26:57.372995+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:07.079854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374173+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:57.374173+0000","last_peered":"2023-08-27T11:26:57.374173+0000","last_clean":"2023-08-27T11:26:57.374173+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:57.374173+0000","last_undegraded":"2023-08-27T11:26:57.374173+0000","last_fullsized":"2023-08-27T11:26:57.374173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:55.081201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524756+0000","last_change":"2023-08-27T11:26:56.397650+0000","last_active":"2023-08-27T11:26:57.524756+0000","last_peered":"2023-08-27T11:26:57.524756+0000","last_clean":"2023-08-27T11:26:57.524756+0000","last_became_active":"2023-08-27T11:26:56.397306+0000","last_became_peered":"2023-08-27T11:26:56.397306+0000","last_unstale":"2023-08-27T11:26:57.524756+0000","last_undegraded":"2023-08-27T11:26:57.524756+0000","last_fullsized":"2023-08-27T11:26:57.524756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:22.262397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524398+0000","last_change":"2023-08-27T11:26:55.353113+0000","last_active":"2023-08-27T11:26:57.524398+0000","last_peered":"2023-08-27T11:26:57.524398+0000","last_clean":"2023-08-27T11:26:57.524398+0000","last_became_active":"2023-08-27T11:26:55.352818+0000","last_became_peered":"2023-08-27T11:26:55.352818+0000","last_unstale":"2023-08-27T11:26:57.524398+0000","last_undegraded":"2023-08-27T11:26:57.524398+0000","last_fullsized":"2023-08-27T11:26:57.524398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:50.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373595+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:57.373595+0000","last_peered":"2023-08-27T11:26:57.373595+0000","last_clean":"2023-08-27T11:26:57.373595+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:57.373595+0000","last_undegraded":"2023-08-27T11:26:57.373595+0000","last_fullsized":"2023-08-27T11:26:57.373595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:48.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524390+0000","last_change":"2023-08-27T11:26:56.387890+0000","last_active":"2023-08-27T11:26:57.524390+0000","last_peered":"2023-08-27T11:26:57.524390+0000","last_clean":"2023-08-27T11:26:57.524390+0000","last_became_active":"2023-08-27T11:26:56.387578+0000","last_became_peered":"2023-08-27T11:26:56.387578+0000","last_unstale":"2023-08-27T11:26:57.524390+0000","last_undegraded":"2023-08-27T11:26:57.524390+0000","last_fullsized":"2023-08-27T11:26:57.524390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:01:25.247073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374024+0000","last_change":"2023-08-27T11:26:55.347843+0000","last_active":"2023-08-27T11:26:57.374024+0000","last_peered":"2023-08-27T11:26:57.374024+0000","last_clean":"2023-08-27T11:26:57.374024+0000","last_became_active":"2023-08-27T11:26:55.347517+0000","last_became_peered":"2023-08-27T11:26:55.347517+0000","last_unstale":"2023-08-27T11:26:57.374024+0000","last_undegraded":"2023-08-27T11:26:57.374024+0000","last_fullsized":"2023-08-27T11:26:57.374024+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:41.063327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375034+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:57.375034+0000","last_peered":"2023-08-27T11:26:57.375034+0000","last_clean":"2023-08-27T11:26:57.375034+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:57.375034+0000","last_undegraded":"2023-08-27T11:26:57.375034+0000","last_fullsized":"2023-08-27T11:26:57.375034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:29.972742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374873+0000","last_change":"2023-08-27T11:26:56.411255+0000","last_active":"2023-08-27T11:26:57.374873+0000","last_peered":"2023-08-27T11:26:57.374873+0000","last_clean":"2023-08-27T11:26:57.374873+0000","last_became_active":"2023-08-27T11:26:56.410899+0000","last_became_peered":"2023-08-27T11:26:56.410899+0000","last_unstale":"2023-08-27T11:26:57.374873+0000","last_undegraded":"2023-08-27T11:26:57.374873+0000","last_fullsized":"2023-08-27T11:26:57.374873+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:35:09.375324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524742+0000","last_change":"2023-08-27T11:26:55.356624+0000","last_active":"2023-08-27T11:26:57.524742+0000","last_peered":"2023-08-27T11:26:57.524742+0000","last_clean":"2023-08-27T11:26:57.524742+0000","last_became_active":"2023-08-27T11:26:55.355441+0000","last_became_peered":"2023-08-27T11:26:55.355441+0000","last_unstale":"2023-08-27T11:26:57.524742+0000","last_undegraded":"2023-08-27T11:26:57.524742+0000","last_fullsized":"2023-08-27T11:26:57.524742+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:05.776207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":149,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868764+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:57.868764+0000","last_peered":"2023-08-27T11:26:57.868764+0000","last_clean":"2023-08-27T11:26:57.868764+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:57.868764+0000","last_undegraded":"2023-08-27T11:26:57.868764+0000","last_fullsized":"2023-08-27T11:26:57.868764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:20.272115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868362+0000","last_change":"2023-08-27T11:26:56.396051+0000","last_active":"2023-08-27T11:26:57.868362+0000","last_peered":"2023-08-27T11:26:57.868362+0000","last_clean":"2023-08-27T11:26:57.868362+0000","last_became_active":"2023-08-27T11:26:56.395739+0000","last_became_peered":"2023-08-27T11:26:56.395739+0000","last_unstale":"2023-08-27T11:26:57.868362+0000","last_undegraded":"2023-08-27T11:26:57.868362+0000","last_fullsized":"2023-08-27T11:26:57.868362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:57:04.123405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375404+0000","last_change":"2023-08-27T11:26:55.360320+0000","last_active":"2023-08-27T11:26:57.375404+0000","last_peered":"2023-08-27T11:26:57.375404+0000","last_clean":"2023-08-27T11:26:57.375404+0000","last_became_active":"2023-08-27T11:26:55.359906+0000","last_became_peered":"2023-08-27T11:26:55.359906+0000","last_unstale":"2023-08-27T11:26:57.375404+0000","last_undegraded":"2023-08-27T11:26:57.375404+0000","last_fullsized":"2023-08-27T11:26:57.375404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:55.548051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":149,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868561+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:57.868561+0000","last_peered":"2023-08-27T11:26:57.868561+0000","last_clean":"2023-08-27T11:26:57.868561+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:57.868561+0000","last_undegraded":"2023-08-27T11:26:57.868561+0000","last_fullsized":"2023-08-27T11:26:57.868561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:49.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373321+0000","last_change":"2023-08-27T11:26:56.393003+0000","last_active":"2023-08-27T11:26:57.373321+0000","last_peered":"2023-08-27T11:26:57.373321+0000","last_clean":"2023-08-27T11:26:57.373321+0000","last_became_active":"2023-08-27T11:26:56.392692+0000","last_became_peered":"2023-08-27T11:26:56.392692+0000","last_unstale":"2023-08-27T11:26:57.373321+0000","last_undegraded":"2023-08-27T11:26:57.373321+0000","last_fullsized":"2023-08-27T11:26:57.373321+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:31.889515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868782+0000","last_change":"2023-08-27T11:26:55.364141+0000","last_active":"2023-08-27T11:26:57.868782+0000","last_peered":"2023-08-27T11:26:57.868782+0000","last_clean":"2023-08-27T11:26:57.868782+0000","last_became_active":"2023-08-27T11:26:55.363814+0000","last_became_peered":"2023-08-27T11:26:55.363814+0000","last_unstale":"2023-08-27T11:26:57.868782+0000","last_undegraded":"2023-08-27T11:26:57.868782+0000","last_fullsized":"2023-08-27T11:26:57.868782+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:33.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":297,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868429+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:57.868429+0000","last_peered":"2023-08-27T11:26:57.868429+0000","last_clean":"2023-08-27T11:26:57.868429+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:57.868429+0000","last_undegraded":"2023-08-27T11:26:57.868429+0000","last_fullsized":"2023-08-27T11:26:57.868429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:18.126119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":153,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868628+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:57.868628+0000","last_peered":"2023-08-27T11:26:57.868628+0000","last_clean":"2023-08-27T11:26:57.868628+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:57.868628+0000","last_undegraded":"2023-08-27T11:26:57.868628+0000","last_fullsized":"2023-08-27T11:26:57.868628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:59.925681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614160+0000","last_change":"2023-08-27T11:26:56.399741+0000","last_active":"2023-08-27T11:26:57.614160+0000","last_peered":"2023-08-27T11:26:57.614160+0000","last_clean":"2023-08-27T11:26:57.614160+0000","last_became_active":"2023-08-27T11:26:56.398877+0000","last_became_peered":"2023-08-27T11:26:56.398877+0000","last_unstale":"2023-08-27T11:26:57.614160+0000","last_undegraded":"2023-08-27T11:26:57.614160+0000","last_fullsized":"2023-08-27T11:26:57.614160+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:19:11.204144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524788+0000","last_change":"2023-08-27T11:26:55.356213+0000","last_active":"2023-08-27T11:26:57.524788+0000","last_peered":"2023-08-27T11:26:57.524788+0000","last_clean":"2023-08-27T11:26:57.524788+0000","last_became_active":"2023-08-27T11:26:55.355932+0000","last_became_peered":"2023-08-27T11:26:55.355932+0000","last_unstale":"2023-08-27T11:26:57.524788+0000","last_undegraded":"2023-08-27T11:26:57.524788+0000","last_fullsized":"2023-08-27T11:26:57.524788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:42.056991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":155,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868799+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:57.868799+0000","last_peered":"2023-08-27T11:26:57.868799+0000","last_clean":"2023-08-27T11:26:57.868799+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:57.868799+0000","last_undegraded":"2023-08-27T11:26:57.868799+0000","last_fullsized":"2023-08-27T11:26:57.868799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:48.059793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613842+0000","last_change":"2023-08-27T11:26:56.404445+0000","last_active":"2023-08-27T11:26:57.613842+0000","last_peered":"2023-08-27T11:26:57.613842+0000","last_clean":"2023-08-27T11:26:57.613842+0000","last_became_active":"2023-08-27T11:26:56.404123+0000","last_became_peered":"2023-08-27T11:26:56.404123+0000","last_unstale":"2023-08-27T11:26:57.613842+0000","last_undegraded":"2023-08-27T11:26:57.613842+0000","last_fullsized":"2023-08-27T11:26:57.613842+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:20.411946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524864+0000","last_change":"2023-08-27T11:26:55.358596+0000","last_active":"2023-08-27T11:26:57.524864+0000","last_peered":"2023-08-27T11:26:57.524864+0000","last_clean":"2023-08-27T11:26:57.524864+0000","last_became_active":"2023-08-27T11:26:55.358310+0000","last_became_peered":"2023-08-27T11:26:55.358310+0000","last_unstale":"2023-08-27T11:26:57.524864+0000","last_undegraded":"2023-08-27T11:26:57.524864+0000","last_fullsized":"2023-08-27T11:26:57.524864+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:00.777301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":163,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375065+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:57.375065+0000","last_peered":"2023-08-27T11:26:57.375065+0000","last_clean":"2023-08-27T11:26:57.375065+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:57.375065+0000","last_undegraded":"2023-08-27T11:26:57.375065+0000","last_fullsized":"2023-08-27T11:26:57.375065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:42.924026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1789952,"data_stored":1144634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":0.878},"last":0.68300000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.173,"15min":1.173},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.77500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":1.083,"15min":1.083},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.135},"last":0.74199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.45700000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.397,"15min":1.397},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.006,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.133,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.52100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1204224,"data_stored":555336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.623}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":0.69299999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1785856,"data_stored":1144508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.626},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":0.75}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.80900000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.64700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":554822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.372},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.503},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.627}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.66600000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":554140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.51600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63200000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.245},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.36599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61799999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61199999999999999,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73499999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.439}]},{"osd":4,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1459999999999999,"5min":1.669,"15min":1.669},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.994,"15min":1.994},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.1659999999999999,"5min":2.036,"15min":2.036},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97199999999999998,"5min":1.26,"15min":1.26},"last":0.502}]},{"osd":6,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82999999999999996},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1279999999999999,"5min":1.321,"15min":1.321},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.627,"15min":1.627},"last":0.64300000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0860000000000001,"5min":2.073,"15min":2.073},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.86699999999999999},"min":{"1min":0.64100000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.323,"15min":1.323},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":553702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.435}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.496}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.96399999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.93300000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.74299999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.84499999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":554198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46999999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.1120000000000001,"5min":1.161,"15min":1.161},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.79300000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.022},"last":0.82899999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":1.25,"15min":1.25},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72899999999999998,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77400000000000002,"15min":0.746},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.51600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.998}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":553120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.105,"15min":1.105},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.53400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92600000000000005,"5min":1.014,"15min":1.014},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97499999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.89500000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.874,"5min":1.097,"15min":1.097},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.88300000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94899999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.56299999999999994,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.752}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84999999999999998,"5min":1.744,"15min":1.744},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":1.663,"15min":1.663},"last":0.98299999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.274,"15min":1.274},"last":0.92700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:06.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.595+0000 7f3d7f5ff700 1 Processor -- start 2023-08-27T11:27:06.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.596+0000 7f3d7f5ff700 1 -- start start 2023-08-27T11:27:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7f5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3d7806a310 0x7f3d7806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d78157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7f5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d780c4a50 con 0x7f3d78157fc0 2023-08-27T11:27:06.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7f5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d780c23a0 con 0x7f3d7806a310 2023-08-27T11:27:06.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781548c0 con 0x7f3d7806e360 2023-08-27T11:27:06.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7d39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3d7806a310 0x7f3d7806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7db9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3d78157fc0 0x7f3d780c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47468/0 (socket says 172.21.15.43:47468) 2023-08-27T11:27:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7db9c700 1 -- 172.21.15.43:0/3040616463 learned_addr learned my addr 172.21.15.43:0/3040616463 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7cb9a700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d78157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7d39b700 1 -- 172.21.15.43:0/3040616463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 msgr2=0x7f3d78157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7d39b700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d78157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7d39b700 1 -- 172.21.15.43:0/3040616463 >> v1:172.21.15.43:6789/0 conn(0x7f3d78157fc0 legacy=0x7f3d780c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d7d39b700 1 -- 172.21.15.43:0/3040616463 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780c4d30 con 0x7f3d7806a310 2023-08-27T11:27:06.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.597+0000 7f3d6ffff700 1 -- 172.21.15.43:0/3040616463 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612435514 0 0) 0x7f3d780c4a50 con 0x7f3d78157fc0 2023-08-27T11:27:06.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d7d39b700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7806a310 0x7f3d7806a6f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009840 tx=0x7f3d74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd309ff3321c34c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:06.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d6ffff700 1 -- 172.21.15.43:0/3040616463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74011830 con 0x7f3d7806a310 2023-08-27T11:27:06.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d6ffff700 1 -- 172.21.15.43:0/3040616463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74011990 con 0x7f3d7806a310 2023-08-27T11:27:06.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d6ffff700 1 -- 172.21.15.43:0/3040616463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74011d20 con 0x7f3d7806a310 2023-08-27T11:27:06.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/3040616463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7806a310 msgr2=0x7f3d7806a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.598+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7806a310 0x7f3d7806a6f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009840 tx=0x7f3d74009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:06.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/3040616463 shutdown_connections 2023-08-27T11:27:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d7806a310 0x7f3d7806a6f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/3040616463 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d78157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/3040616463 >> 172.21.15.43:0/3040616463 conn(0x7f3d780a85e0 msgr2=0x7f3d780a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/3040616463 shutdown_connections 2023-08-27T11:27:06.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.599+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/3040616463 wait complete. 2023-08-27T11:27:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.600+0000 7f3d7f5ff700 1 Processor -- start 2023-08-27T11:27:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.601+0000 7f3d7f5ff700 1 -- start start 2023-08-27T11:27:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.601+0000 7f3d7f5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7806a310 0x7f3d78071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.601+0000 7f3d7f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d780abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7f5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7f5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780a9af0 con 0x7f3d78157fc0 2023-08-27T11:27:06.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7f5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781e9750 con 0x7f3d7806a310 2023-08-27T11:27:06.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d781ed1c0 con 0x7f3d7806e360 2023-08-27T11:27:06.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54154/0 (socket says 172.21.15.43:54154) 2023-08-27T11:27:06.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7d39b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7806a310 0x7f3d78071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 -- 172.21.15.43:0/2377161702 learned_addr learned my addr 172.21.15.43:0/2377161702 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:06.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7cb9a700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d780abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 -- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 msgr2=0x7f3d780abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d780abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 -- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7806a310 msgr2=0x7f3d78071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7806a310 0x7f3d78071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 -- 172.21.15.43:0/2377161702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740094a0 con 0x7f3d78157fc0 2023-08-27T11:27:06.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.602+0000 7f3d7db9c700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000cba0 tx=0x7f3d7000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:06.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.603+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000aad0 con 0x7f3d78157fc0 2023-08-27T11:27:06.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.603+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000ac50 con 0x7f3d78157fc0 2023-08-27T11:27:06.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.603+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d781ed4a0 con 0x7f3d78157fc0 2023-08-27T11:27:06.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.603+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700070d0 con 0x7f3d78157fc0 2023-08-27T11:27:06.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.603+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d781eda60 con 0x7f3d78157fc0 2023-08-27T11:27:06.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.604+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d780c4fc0 con 0x7f3d78157fc0 2023-08-27T11:27:06.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.605+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3d70007230 con 0x7f3d78157fc0 2023-08-27T11:27:06.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.606+0000 7f3d6dffb700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 0x7f3d5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:06.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.606+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d70087f40 con 0x7f3d78157fc0 2023-08-27T11:27:06.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.606+0000 7f3d7d39b700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 0x7f3d5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:06.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.606+0000 7f3d7d39b700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 0x7f3d5c06c5a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d740090b0 tx=0x7f3d74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:06.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.610+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3d70053620 con 0x7f3d78157fc0 2023-08-27T11:27:06.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.814+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d780c52f0 con 0x7f3d5c06a0e0 2023-08-27T11:27:06.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.825+0000 7f3d6dffb700 1 -- 172.21.15.43:0/2377161702 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311352 (secure 0 0 0) 0x7f3d74011c00 con 0x7f3d5c06a0e0 2023-08-27T11:27:06.830 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:06.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 msgr2=0x7f3d5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 0x7f3d5c06c5a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d740090b0 tx=0x7f3d74008030 comp rx=0 tx=0).stop 2023-08-27T11:27:06.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 msgr2=0x7f3d781e9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:06.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000cba0 tx=0x7f3d7000ceb0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 shutdown_connections 2023-08-27T11:27:06.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3d5c06a0e0 0x7f3d5c06c5a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3d78157fc0 0x7f3d781e9c50 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3d7806a310 0x7f3d78071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 --2- 172.21.15.43:0/2377161702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3d7806e360 0x7f3d780abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:06.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 >> 172.21.15.43:0/2377161702 conn(0x7f3d780a85e0 msgr2=0x7f3d780c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:06.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 shutdown_connections 2023-08-27T11:27:06.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:06.829+0000 7f3d7f5ff700 1 -- 172.21.15.43:0/2377161702 wait complete. 2023-08-27T11:27:06.835 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:06.849 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2023-08-27T11:27:06.365870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226696,"kb_used_data":10488,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754748024,"statfs":{"total":773094113280,"available":772861976576,"internally_reserved":0,"allocated":10739712,"data_stored":5614460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.000213"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613978+0000","last_change":"2023-08-27T11:26:56.408592+0000","last_active":"2023-08-27T11:26:57.613978+0000","last_peered":"2023-08-27T11:26:57.613978+0000","last_clean":"2023-08-27T11:26:57.613978+0000","last_became_active":"2023-08-27T11:26:56.407080+0000","last_became_peered":"2023-08-27T11:26:56.407080+0000","last_unstale":"2023-08-27T11:26:57.613978+0000","last_undegraded":"2023-08-27T11:26:57.613978+0000","last_fullsized":"2023-08-27T11:26:57.613978+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:49:39.598717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373830+0000","last_change":"2023-08-27T11:26:56.387743+0000","last_active":"2023-08-27T11:26:57.373830+0000","last_peered":"2023-08-27T11:26:57.373830+0000","last_clean":"2023-08-27T11:26:57.373830+0000","last_became_active":"2023-08-27T11:26:56.387464+0000","last_became_peered":"2023-08-27T11:26:56.387464+0000","last_unstale":"2023-08-27T11:26:57.373830+0000","last_undegraded":"2023-08-27T11:26:57.373830+0000","last_fullsized":"2023-08-27T11:26:57.373830+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:37.280187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613913+0000","last_change":"2023-08-27T11:26:56.408542+0000","last_active":"2023-08-27T11:26:57.613913+0000","last_peered":"2023-08-27T11:26:57.613913+0000","last_clean":"2023-08-27T11:26:57.613913+0000","last_became_active":"2023-08-27T11:26:56.408209+0000","last_became_peered":"2023-08-27T11:26:56.408209+0000","last_unstale":"2023-08-27T11:26:57.613913+0000","last_undegraded":"2023-08-27T11:26:57.613913+0000","last_fullsized":"2023-08-27T11:26:57.613913+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:57:59.589734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868700+0000","last_change":"2023-08-27T11:26:56.402864+0000","last_active":"2023-08-27T11:26:57.868700+0000","last_peered":"2023-08-27T11:26:57.868700+0000","last_clean":"2023-08-27T11:26:57.868700+0000","last_became_active":"2023-08-27T11:26:56.402499+0000","last_became_peered":"2023-08-27T11:26:56.402499+0000","last_unstale":"2023-08-27T11:26:57.868700+0000","last_undegraded":"2023-08-27T11:26:57.868700+0000","last_fullsized":"2023-08-27T11:26:57.868700+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:02.936465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868212+0000","last_change":"2023-08-27T11:26:56.404881+0000","last_active":"2023-08-27T11:26:57.868212+0000","last_peered":"2023-08-27T11:26:57.868212+0000","last_clean":"2023-08-27T11:26:57.868212+0000","last_became_active":"2023-08-27T11:26:56.404654+0000","last_became_peered":"2023-08-27T11:26:56.404654+0000","last_unstale":"2023-08-27T11:26:57.868212+0000","last_undegraded":"2023-08-27T11:26:57.868212+0000","last_fullsized":"2023-08-27T11:26:57.868212+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:12:17.514190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373417+0000","last_change":"2023-08-27T11:26:56.396886+0000","last_active":"2023-08-27T11:26:57.373417+0000","last_peered":"2023-08-27T11:26:57.373417+0000","last_clean":"2023-08-27T11:26:57.373417+0000","last_became_active":"2023-08-27T11:26:56.396590+0000","last_became_peered":"2023-08-27T11:26:56.396590+0000","last_unstale":"2023-08-27T11:26:57.373417+0000","last_undegraded":"2023-08-27T11:26:57.373417+0000","last_fullsized":"2023-08-27T11:26:57.373417+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:02.936465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.372761+0000","last_change":"2023-08-27T11:26:56.405448+0000","last_active":"2023-08-27T11:26:57.372761+0000","last_peered":"2023-08-27T11:26:57.372761+0000","last_clean":"2023-08-27T11:26:57.372761+0000","last_became_active":"2023-08-27T11:26:56.403853+0000","last_became_peered":"2023-08-27T11:26:56.403853+0000","last_unstale":"2023-08-27T11:26:57.372761+0000","last_undegraded":"2023-08-27T11:26:57.372761+0000","last_fullsized":"2023-08-27T11:26:57.372761+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524257+0000","last_change":"2023-08-27T11:26:56.397090+0000","last_active":"2023-08-27T11:26:57.524257+0000","last_peered":"2023-08-27T11:26:57.524257+0000","last_clean":"2023-08-27T11:26:57.524257+0000","last_became_active":"2023-08-27T11:26:56.396783+0000","last_became_peered":"2023-08-27T11:26:56.396783+0000","last_unstale":"2023-08-27T11:26:57.524257+0000","last_undegraded":"2023-08-27T11:26:57.524257+0000","last_fullsized":"2023-08-27T11:26:57.524257+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:28.423234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373984+0000","last_change":"2023-08-27T11:26:56.395879+0000","last_active":"2023-08-27T11:26:57.373984+0000","last_peered":"2023-08-27T11:26:57.373984+0000","last_clean":"2023-08-27T11:26:57.373984+0000","last_became_active":"2023-08-27T11:26:56.395371+0000","last_became_peered":"2023-08-27T11:26:56.395371+0000","last_unstale":"2023-08-27T11:26:57.373984+0000","last_undegraded":"2023-08-27T11:26:57.373984+0000","last_fullsized":"2023-08-27T11:26:57.373984+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:27:14.704910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868817+0000","last_change":"2023-08-27T11:26:56.395875+0000","last_active":"2023-08-27T11:26:57.868817+0000","last_peered":"2023-08-27T11:26:57.868817+0000","last_clean":"2023-08-27T11:26:57.868817+0000","last_became_active":"2023-08-27T11:26:56.395593+0000","last_became_peered":"2023-08-27T11:26:56.395593+0000","last_unstale":"2023-08-27T11:26:57.868817+0000","last_undegraded":"2023-08-27T11:26:57.868817+0000","last_fullsized":"2023-08-27T11:26:57.868817+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:35:09.375324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375039+0000","last_change":"2023-08-27T11:26:56.401898+0000","last_active":"2023-08-27T11:26:57.375039+0000","last_peered":"2023-08-27T11:26:57.375039+0000","last_clean":"2023-08-27T11:26:57.375039+0000","last_became_active":"2023-08-27T11:26:56.401627+0000","last_became_peered":"2023-08-27T11:26:56.401627+0000","last_unstale":"2023-08-27T11:26:57.375039+0000","last_undegraded":"2023-08-27T11:26:57.375039+0000","last_fullsized":"2023-08-27T11:26:57.375039+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:08:28.191535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376228+0000","last_change":"2023-08-27T11:26:56.403577+0000","last_active":"2023-08-27T11:26:57.376228+0000","last_peered":"2023-08-27T11:26:57.376228+0000","last_clean":"2023-08-27T11:26:57.376228+0000","last_became_active":"2023-08-27T11:26:56.402911+0000","last_became_peered":"2023-08-27T11:26:56.402911+0000","last_unstale":"2023-08-27T11:26:57.376228+0000","last_undegraded":"2023-08-27T11:26:57.376228+0000","last_fullsized":"2023-08-27T11:26:57.376228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:41.290786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868165+0000","last_change":"2023-08-27T11:26:56.409079+0000","last_active":"2023-08-27T11:26:57.868165+0000","last_peered":"2023-08-27T11:26:57.868165+0000","last_clean":"2023-08-27T11:26:57.868165+0000","last_became_active":"2023-08-27T11:26:56.408740+0000","last_became_peered":"2023-08-27T11:26:56.408740+0000","last_unstale":"2023-08-27T11:26:57.868165+0000","last_undegraded":"2023-08-27T11:26:57.868165+0000","last_fullsized":"2023-08-27T11:26:57.868165+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:02.348535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868519+0000","last_change":"2023-08-27T11:26:56.404726+0000","last_active":"2023-08-27T11:26:57.868519+0000","last_peered":"2023-08-27T11:26:57.868519+0000","last_clean":"2023-08-27T11:26:57.868519+0000","last_became_active":"2023-08-27T11:26:56.404333+0000","last_became_peered":"2023-08-27T11:26:56.404333+0000","last_unstale":"2023-08-27T11:26:57.868519+0000","last_undegraded":"2023-08-27T11:26:57.868519+0000","last_fullsized":"2023-08-27T11:26:57.868519+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:28.078240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868444+0000","last_change":"2023-08-27T11:26:56.401955+0000","last_active":"2023-08-27T11:26:57.868444+0000","last_peered":"2023-08-27T11:26:57.868444+0000","last_clean":"2023-08-27T11:26:57.868444+0000","last_became_active":"2023-08-27T11:26:56.401658+0000","last_became_peered":"2023-08-27T11:26:56.401658+0000","last_unstale":"2023-08-27T11:26:57.868444+0000","last_undegraded":"2023-08-27T11:26:57.868444+0000","last_fullsized":"2023-08-27T11:26:57.868444+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:34:11.294872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868440+0000","last_change":"2023-08-27T11:26:56.388949+0000","last_active":"2023-08-27T11:26:57.868440+0000","last_peered":"2023-08-27T11:26:57.868440+0000","last_clean":"2023-08-27T11:26:57.868440+0000","last_became_active":"2023-08-27T11:26:56.388628+0000","last_became_peered":"2023-08-27T11:26:56.388628+0000","last_unstale":"2023-08-27T11:26:57.868440+0000","last_undegraded":"2023-08-27T11:26:57.868440+0000","last_fullsized":"2023-08-27T11:26:57.868440+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:59.182830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614015+0000","last_change":"2023-08-27T11:26:56.408654+0000","last_active":"2023-08-27T11:26:57.614015+0000","last_peered":"2023-08-27T11:26:57.614015+0000","last_clean":"2023-08-27T11:26:57.614015+0000","last_became_active":"2023-08-27T11:26:56.407924+0000","last_became_peered":"2023-08-27T11:26:56.407924+0000","last_unstale":"2023-08-27T11:26:57.614015+0000","last_undegraded":"2023-08-27T11:26:57.614015+0000","last_fullsized":"2023-08-27T11:26:57.614015+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:41:54.858688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373774+0000","last_change":"2023-08-27T11:26:56.396145+0000","last_active":"2023-08-27T11:26:57.373774+0000","last_peered":"2023-08-27T11:26:57.373774+0000","last_clean":"2023-08-27T11:26:57.373774+0000","last_became_active":"2023-08-27T11:26:56.395680+0000","last_became_peered":"2023-08-27T11:26:56.395680+0000","last_unstale":"2023-08-27T11:26:57.373774+0000","last_undegraded":"2023-08-27T11:26:57.373774+0000","last_fullsized":"2023-08-27T11:26:57.373774+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:44:28.732858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613917+0000","last_change":"2023-08-27T11:26:56.400919+0000","last_active":"2023-08-27T11:26:57.613917+0000","last_peered":"2023-08-27T11:26:57.613917+0000","last_clean":"2023-08-27T11:26:57.613917+0000","last_became_active":"2023-08-27T11:26:56.399457+0000","last_became_peered":"2023-08-27T11:26:56.399457+0000","last_unstale":"2023-08-27T11:26:57.613917+0000","last_undegraded":"2023-08-27T11:26:57.613917+0000","last_fullsized":"2023-08-27T11:26:57.613917+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:23:00.367707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376193+0000","last_change":"2023-08-27T11:26:56.399491+0000","last_active":"2023-08-27T11:26:57.376193+0000","last_peered":"2023-08-27T11:26:57.376193+0000","last_clean":"2023-08-27T11:26:57.376193+0000","last_became_active":"2023-08-27T11:26:56.399191+0000","last_became_peered":"2023-08-27T11:26:56.399191+0000","last_unstale":"2023-08-27T11:26:57.376193+0000","last_undegraded":"2023-08-27T11:26:57.376193+0000","last_fullsized":"2023-08-27T11:26:57.376193+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:31.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524697+0000","last_change":"2023-08-27T11:26:56.396546+0000","last_active":"2023-08-27T11:26:57.524697+0000","last_peered":"2023-08-27T11:26:57.524697+0000","last_clean":"2023-08-27T11:26:57.524697+0000","last_became_active":"2023-08-27T11:26:56.396254+0000","last_became_peered":"2023-08-27T11:26:56.396254+0000","last_unstale":"2023-08-27T11:26:57.524697+0000","last_undegraded":"2023-08-27T11:26:57.524697+0000","last_fullsized":"2023-08-27T11:26:57.524697+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:48.303878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868234+0000","last_change":"2023-08-27T11:26:56.407165+0000","last_active":"2023-08-27T11:26:57.868234+0000","last_peered":"2023-08-27T11:26:57.868234+0000","last_clean":"2023-08-27T11:26:57.868234+0000","last_became_active":"2023-08-27T11:26:56.406789+0000","last_became_peered":"2023-08-27T11:26:56.406789+0000","last_unstale":"2023-08-27T11:26:57.868234+0000","last_undegraded":"2023-08-27T11:26:57.868234+0000","last_fullsized":"2023-08-27T11:26:57.868234+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:21.320169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613765+0000","last_change":"2023-08-27T11:26:56.408226+0000","last_active":"2023-08-27T11:26:57.613765+0000","last_peered":"2023-08-27T11:26:57.613765+0000","last_clean":"2023-08-27T11:26:57.613765+0000","last_became_active":"2023-08-27T11:26:56.407876+0000","last_became_peered":"2023-08-27T11:26:56.407876+0000","last_unstale":"2023-08-27T11:26:57.613765+0000","last_undegraded":"2023-08-27T11:26:57.613765+0000","last_fullsized":"2023-08-27T11:26:57.613765+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:57:40.671066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.867954+0000","last_change":"2023-08-27T11:26:56.400275+0000","last_active":"2023-08-27T11:26:57.867954+0000","last_peered":"2023-08-27T11:26:57.867954+0000","last_clean":"2023-08-27T11:26:57.867954+0000","last_became_active":"2023-08-27T11:26:56.399957+0000","last_became_peered":"2023-08-27T11:26:56.399957+0000","last_unstale":"2023-08-27T11:26:57.867954+0000","last_undegraded":"2023-08-27T11:26:57.867954+0000","last_fullsized":"2023-08-27T11:26:57.867954+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:46:40.764967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375325+0000","last_change":"2023-08-27T11:26:56.415345+0000","last_active":"2023-08-27T11:26:57.375325+0000","last_peered":"2023-08-27T11:26:57.375325+0000","last_clean":"2023-08-27T11:26:57.375325+0000","last_became_active":"2023-08-27T11:26:56.415020+0000","last_became_peered":"2023-08-27T11:26:56.415020+0000","last_unstale":"2023-08-27T11:26:57.375325+0000","last_undegraded":"2023-08-27T11:26:57.375325+0000","last_fullsized":"2023-08-27T11:26:57.375325+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376238+0000","last_change":"2023-08-27T11:26:56.399410+0000","last_active":"2023-08-27T11:26:57.376238+0000","last_peered":"2023-08-27T11:26:57.376238+0000","last_clean":"2023-08-27T11:26:57.376238+0000","last_became_active":"2023-08-27T11:26:56.399060+0000","last_became_peered":"2023-08-27T11:26:56.399060+0000","last_unstale":"2023-08-27T11:26:57.376238+0000","last_undegraded":"2023-08-27T11:26:57.376238+0000","last_fullsized":"2023-08-27T11:26:57.376238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:24.192376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375199+0000","last_change":"2023-08-27T11:26:56.401373+0000","last_active":"2023-08-27T11:26:57.375199+0000","last_peered":"2023-08-27T11:26:57.375199+0000","last_clean":"2023-08-27T11:26:57.375199+0000","last_became_active":"2023-08-27T11:26:56.399634+0000","last_became_peered":"2023-08-27T11:26:56.399634+0000","last_unstale":"2023-08-27T11:26:57.375199+0000","last_undegraded":"2023-08-27T11:26:57.375199+0000","last_fullsized":"2023-08-27T11:26:57.375199+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:47.092124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373376+0000","last_change":"2023-08-27T11:26:56.409257+0000","last_active":"2023-08-27T11:26:57.373376+0000","last_peered":"2023-08-27T11:26:57.373376+0000","last_clean":"2023-08-27T11:26:57.373376+0000","last_became_active":"2023-08-27T11:26:56.408930+0000","last_became_peered":"2023-08-27T11:26:56.408930+0000","last_unstale":"2023-08-27T11:26:57.373376+0000","last_undegraded":"2023-08-27T11:26:57.373376+0000","last_fullsized":"2023-08-27T11:26:57.373376+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524671+0000","last_change":"2023-08-27T11:26:56.385683+0000","last_active":"2023-08-27T11:26:57.524671+0000","last_peered":"2023-08-27T11:26:57.524671+0000","last_clean":"2023-08-27T11:26:57.524671+0000","last_became_active":"2023-08-27T11:26:56.385424+0000","last_became_peered":"2023-08-27T11:26:56.385424+0000","last_unstale":"2023-08-27T11:26:57.524671+0000","last_undegraded":"2023-08-27T11:26:57.524671+0000","last_fullsized":"2023-08-27T11:26:57.524671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.719205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375885+0000","last_change":"2023-08-27T11:26:56.415827+0000","last_active":"2023-08-27T11:26:57.375885+0000","last_peered":"2023-08-27T11:26:57.375885+0000","last_clean":"2023-08-27T11:26:57.375885+0000","last_became_active":"2023-08-27T11:26:56.415518+0000","last_became_peered":"2023-08-27T11:26:56.415518+0000","last_unstale":"2023-08-27T11:26:57.375885+0000","last_undegraded":"2023-08-27T11:26:57.375885+0000","last_fullsized":"2023-08-27T11:26:57.375885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:08.082020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373017+0000","last_change":"2023-08-27T11:26:56.391441+0000","last_active":"2023-08-27T11:26:57.373017+0000","last_peered":"2023-08-27T11:26:57.373017+0000","last_clean":"2023-08-27T11:26:57.373017+0000","last_became_active":"2023-08-27T11:26:56.391035+0000","last_became_peered":"2023-08-27T11:26:56.391035+0000","last_unstale":"2023-08-27T11:26:57.373017+0000","last_undegraded":"2023-08-27T11:26:57.373017+0000","last_fullsized":"2023-08-27T11:26:57.373017+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:10.637907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524239+0000","last_change":"2023-08-27T11:26:56.405208+0000","last_active":"2023-08-27T11:26:57.524239+0000","last_peered":"2023-08-27T11:26:57.524239+0000","last_clean":"2023-08-27T11:26:57.524239+0000","last_became_active":"2023-08-27T11:26:56.404872+0000","last_became_peered":"2023-08-27T11:26:56.404872+0000","last_unstale":"2023-08-27T11:26:57.524239+0000","last_undegraded":"2023-08-27T11:26:57.524239+0000","last_fullsized":"2023-08-27T11:26:57.524239+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:13:07.256395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614000+0000","last_change":"2023-08-27T11:26:56.396892+0000","last_active":"2023-08-27T11:26:57.614000+0000","last_peered":"2023-08-27T11:26:57.614000+0000","last_clean":"2023-08-27T11:26:57.614000+0000","last_became_active":"2023-08-27T11:26:56.395168+0000","last_became_peered":"2023-08-27T11:26:56.395168+0000","last_unstale":"2023-08-27T11:26:57.614000+0000","last_undegraded":"2023-08-27T11:26:57.614000+0000","last_fullsized":"2023-08-27T11:26:57.614000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:08.727201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"95'4","reported_seq":17,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868608+0000","last_change":"2023-08-27T11:26:55.361418+0000","last_active":"2023-08-27T11:26:57.868608+0000","last_peered":"2023-08-27T11:26:57.868608+0000","last_clean":"2023-08-27T11:26:57.868608+0000","last_became_active":"2023-08-27T11:26:55.361075+0000","last_became_peered":"2023-08-27T11:26:55.361075+0000","last_unstale":"2023-08-27T11:26:57.868608+0000","last_undegraded":"2023-08-27T11:26:57.868608+0000","last_fullsized":"2023-08-27T11:26:57.868608+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:07.079854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524333+0000","last_change":"2023-08-27T11:26:56.397484+0000","last_active":"2023-08-27T11:26:57.524333+0000","last_peered":"2023-08-27T11:26:57.524333+0000","last_clean":"2023-08-27T11:26:57.524333+0000","last_became_active":"2023-08-27T11:26:56.397082+0000","last_became_peered":"2023-08-27T11:26:56.397082+0000","last_unstale":"2023-08-27T11:26:57.524333+0000","last_undegraded":"2023-08-27T11:26:57.524333+0000","last_fullsized":"2023-08-27T11:26:57.524333+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:28:02.568496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524689+0000","last_change":"2023-08-27T11:26:55.360037+0000","last_active":"2023-08-27T11:26:57.524689+0000","last_peered":"2023-08-27T11:26:57.524689+0000","last_clean":"2023-08-27T11:26:57.524689+0000","last_became_active":"2023-08-27T11:26:55.359712+0000","last_became_peered":"2023-08-27T11:26:55.359712+0000","last_unstale":"2023-08-27T11:26:57.524689+0000","last_undegraded":"2023-08-27T11:26:57.524689+0000","last_fullsized":"2023-08-27T11:26:57.524689+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:25.977530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375929+0000","last_change":"2023-08-27T11:26:56.404857+0000","last_active":"2023-08-27T11:26:57.375929+0000","last_peered":"2023-08-27T11:26:57.375929+0000","last_clean":"2023-08-27T11:26:57.375929+0000","last_became_active":"2023-08-27T11:26:56.404527+0000","last_became_peered":"2023-08-27T11:26:56.404527+0000","last_unstale":"2023-08-27T11:26:57.375929+0000","last_undegraded":"2023-08-27T11:26:57.375929+0000","last_fullsized":"2023-08-27T11:26:57.375929+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:08.307847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374913+0000","last_change":"2023-08-27T11:26:55.353142+0000","last_active":"2023-08-27T11:26:57.374913+0000","last_peered":"2023-08-27T11:26:57.374913+0000","last_clean":"2023-08-27T11:26:57.374913+0000","last_became_active":"2023-08-27T11:26:55.352351+0000","last_became_peered":"2023-08-27T11:26:55.352351+0000","last_unstale":"2023-08-27T11:26:57.374913+0000","last_undegraded":"2023-08-27T11:26:57.374913+0000","last_fullsized":"2023-08-27T11:26:57.374913+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:41.683053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375320+0000","last_change":"2023-08-27T11:26:56.407494+0000","last_active":"2023-08-27T11:26:57.375320+0000","last_peered":"2023-08-27T11:26:57.375320+0000","last_clean":"2023-08-27T11:26:57.375320+0000","last_became_active":"2023-08-27T11:26:56.407117+0000","last_became_peered":"2023-08-27T11:26:56.407117+0000","last_unstale":"2023-08-27T11:26:57.375320+0000","last_undegraded":"2023-08-27T11:26:57.375320+0000","last_fullsized":"2023-08-27T11:26:57.375320+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:49:17.983180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868713+0000","last_change":"2023-08-27T11:26:55.363797+0000","last_active":"2023-08-27T11:26:57.868713+0000","last_peered":"2023-08-27T11:26:57.868713+0000","last_clean":"2023-08-27T11:26:57.868713+0000","last_became_active":"2023-08-27T11:26:55.363472+0000","last_became_peered":"2023-08-27T11:26:55.363472+0000","last_unstale":"2023-08-27T11:26:57.868713+0000","last_undegraded":"2023-08-27T11:26:57.868713+0000","last_fullsized":"2023-08-27T11:26:57.868713+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:22.985842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868671+0000","last_change":"2023-08-27T11:26:56.401936+0000","last_active":"2023-08-27T11:26:57.868671+0000","last_peered":"2023-08-27T11:26:57.868671+0000","last_clean":"2023-08-27T11:26:57.868671+0000","last_became_active":"2023-08-27T11:26:56.397037+0000","last_became_peered":"2023-08-27T11:26:56.397037+0000","last_unstale":"2023-08-27T11:26:57.868671+0000","last_undegraded":"2023-08-27T11:26:57.868671+0000","last_fullsized":"2023-08-27T11:26:57.868671+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868757+0000","last_change":"2023-08-27T11:26:55.360072+0000","last_active":"2023-08-27T11:26:57.868757+0000","last_peered":"2023-08-27T11:26:57.868757+0000","last_clean":"2023-08-27T11:26:57.868757+0000","last_became_active":"2023-08-27T11:26:55.359779+0000","last_became_peered":"2023-08-27T11:26:55.359779+0000","last_unstale":"2023-08-27T11:26:57.868757+0000","last_undegraded":"2023-08-27T11:26:57.868757+0000","last_fullsized":"2023-08-27T11:26:57.868757+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:04.985952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614126+0000","last_change":"2023-08-27T11:26:56.400875+0000","last_active":"2023-08-27T11:26:57.614126+0000","last_peered":"2023-08-27T11:26:57.614126+0000","last_clean":"2023-08-27T11:26:57.614126+0000","last_became_active":"2023-08-27T11:26:56.399274+0000","last_became_peered":"2023-08-27T11:26:56.399274+0000","last_unstale":"2023-08-27T11:26:57.614126+0000","last_undegraded":"2023-08-27T11:26:57.614126+0000","last_fullsized":"2023-08-27T11:26:57.614126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:47.528291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374919+0000","last_change":"2023-08-27T11:26:55.355107+0000","last_active":"2023-08-27T11:26:57.374919+0000","last_peered":"2023-08-27T11:26:57.374919+0000","last_clean":"2023-08-27T11:26:57.374919+0000","last_became_active":"2023-08-27T11:26:55.354728+0000","last_became_peered":"2023-08-27T11:26:55.354728+0000","last_unstale":"2023-08-27T11:26:57.374919+0000","last_undegraded":"2023-08-27T11:26:57.374919+0000","last_fullsized":"2023-08-27T11:26:57.374919+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:53.583948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373643+0000","last_change":"2023-08-27T11:26:56.403774+0000","last_active":"2023-08-27T11:26:57.373643+0000","last_peered":"2023-08-27T11:26:57.373643+0000","last_clean":"2023-08-27T11:26:57.373643+0000","last_became_active":"2023-08-27T11:26:56.402255+0000","last_became_peered":"2023-08-27T11:26:56.402255+0000","last_unstale":"2023-08-27T11:26:57.373643+0000","last_undegraded":"2023-08-27T11:26:57.373643+0000","last_fullsized":"2023-08-27T11:26:57.373643+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:31.337541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.376038+0000","last_change":"2023-08-27T11:26:55.353051+0000","last_active":"2023-08-27T11:26:57.376038+0000","last_peered":"2023-08-27T11:26:57.376038+0000","last_clean":"2023-08-27T11:26:57.376038+0000","last_became_active":"2023-08-27T11:26:55.352606+0000","last_became_peered":"2023-08-27T11:26:55.352606+0000","last_unstale":"2023-08-27T11:26:57.376038+0000","last_undegraded":"2023-08-27T11:26:57.376038+0000","last_fullsized":"2023-08-27T11:26:57.376038+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:06.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868781+0000","last_change":"2023-08-27T11:26:56.389555+0000","last_active":"2023-08-27T11:26:57.868781+0000","last_peered":"2023-08-27T11:26:57.868781+0000","last_clean":"2023-08-27T11:26:57.868781+0000","last_became_active":"2023-08-27T11:26:56.389254+0000","last_became_peered":"2023-08-27T11:26:56.389254+0000","last_unstale":"2023-08-27T11:26:57.868781+0000","last_undegraded":"2023-08-27T11:26:57.868781+0000","last_fullsized":"2023-08-27T11:26:57.868781+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:17:08.307847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868040+0000","last_change":"2023-08-27T11:26:55.356739+0000","last_active":"2023-08-27T11:26:57.868040+0000","last_peered":"2023-08-27T11:26:57.868040+0000","last_clean":"2023-08-27T11:26:57.868040+0000","last_became_active":"2023-08-27T11:26:55.356419+0000","last_became_peered":"2023-08-27T11:26:55.356419+0000","last_unstale":"2023-08-27T11:26:57.868040+0000","last_undegraded":"2023-08-27T11:26:57.868040+0000","last_fullsized":"2023-08-27T11:26:57.868040+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:41.683053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614000+0000","last_change":"2023-08-27T11:26:56.396547+0000","last_active":"2023-08-27T11:26:57.614000+0000","last_peered":"2023-08-27T11:26:57.614000+0000","last_clean":"2023-08-27T11:26:57.614000+0000","last_became_active":"2023-08-27T11:26:56.396286+0000","last_became_peered":"2023-08-27T11:26:56.396286+0000","last_unstale":"2023-08-27T11:26:57.614000+0000","last_undegraded":"2023-08-27T11:26:57.614000+0000","last_fullsized":"2023-08-27T11:26:57.614000+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:09:03.294324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375484+0000","last_change":"2023-08-27T11:26:55.352949+0000","last_active":"2023-08-27T11:26:57.375484+0000","last_peered":"2023-08-27T11:26:57.375484+0000","last_clean":"2023-08-27T11:26:57.375484+0000","last_became_active":"2023-08-27T11:26:55.352563+0000","last_became_peered":"2023-08-27T11:26:55.352563+0000","last_unstale":"2023-08-27T11:26:57.375484+0000","last_undegraded":"2023-08-27T11:26:57.375484+0000","last_fullsized":"2023-08-27T11:26:57.375484+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:30.887349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868153+0000","last_change":"2023-08-27T11:26:56.394195+0000","last_active":"2023-08-27T11:26:57.868153+0000","last_peered":"2023-08-27T11:26:57.868153+0000","last_clean":"2023-08-27T11:26:57.868153+0000","last_became_active":"2023-08-27T11:26:56.393848+0000","last_became_peered":"2023-08-27T11:26:56.393848+0000","last_unstale":"2023-08-27T11:26:57.868153+0000","last_undegraded":"2023-08-27T11:26:57.868153+0000","last_fullsized":"2023-08-27T11:26:57.868153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:43.987225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614074+0000","last_change":"2023-08-27T11:26:55.356564+0000","last_active":"2023-08-27T11:26:57.614074+0000","last_peered":"2023-08-27T11:26:57.614074+0000","last_clean":"2023-08-27T11:26:57.614074+0000","last_became_active":"2023-08-27T11:26:55.356302+0000","last_became_peered":"2023-08-27T11:26:55.356302+0000","last_unstale":"2023-08-27T11:26:57.614074+0000","last_undegraded":"2023-08-27T11:26:57.614074+0000","last_fullsized":"2023-08-27T11:26:57.614074+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:07:55.952715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524594+0000","last_change":"2023-08-27T11:26:56.394527+0000","last_active":"2023-08-27T11:26:57.524594+0000","last_peered":"2023-08-27T11:26:57.524594+0000","last_clean":"2023-08-27T11:26:57.524594+0000","last_became_active":"2023-08-27T11:26:56.394205+0000","last_became_peered":"2023-08-27T11:26:56.394205+0000","last_unstale":"2023-08-27T11:26:57.524594+0000","last_undegraded":"2023-08-27T11:26:57.524594+0000","last_fullsized":"2023-08-27T11:26:57.524594+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:19:46.632754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"95'3","reported_seq":16,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868576+0000","last_change":"2023-08-27T11:26:55.359460+0000","last_active":"2023-08-27T11:26:57.868576+0000","last_peered":"2023-08-27T11:26:57.868576+0000","last_clean":"2023-08-27T11:26:57.868576+0000","last_became_active":"2023-08-27T11:26:55.359161+0000","last_became_peered":"2023-08-27T11:26:55.359161+0000","last_unstale":"2023-08-27T11:26:57.868576+0000","last_undegraded":"2023-08-27T11:26:57.868576+0000","last_fullsized":"2023-08-27T11:26:57.868576+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:33.886165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868500+0000","last_change":"2023-08-27T11:26:56.395072+0000","last_active":"2023-08-27T11:26:57.868500+0000","last_peered":"2023-08-27T11:26:57.868500+0000","last_clean":"2023-08-27T11:26:57.868500+0000","last_became_active":"2023-08-27T11:26:56.394727+0000","last_became_peered":"2023-08-27T11:26:56.394727+0000","last_unstale":"2023-08-27T11:26:57.868500+0000","last_undegraded":"2023-08-27T11:26:57.868500+0000","last_fullsized":"2023-08-27T11:26:57.868500+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:36.567374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"95'6","reported_seq":19,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373709+0000","last_change":"2023-08-27T11:26:55.358248+0000","last_active":"2023-08-27T11:26:57.373709+0000","last_peered":"2023-08-27T11:26:57.373709+0000","last_clean":"2023-08-27T11:26:57.373709+0000","last_became_active":"2023-08-27T11:26:55.357893+0000","last_became_peered":"2023-08-27T11:26:55.357893+0000","last_unstale":"2023-08-27T11:26:57.373709+0000","last_undegraded":"2023-08-27T11:26:57.373709+0000","last_fullsized":"2023-08-27T11:26:57.373709+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:48:40.288620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375149+0000","last_change":"2023-08-27T11:26:56.407746+0000","last_active":"2023-08-27T11:26:57.375149+0000","last_peered":"2023-08-27T11:26:57.375149+0000","last_clean":"2023-08-27T11:26:57.375149+0000","last_became_active":"2023-08-27T11:26:56.407261+0000","last_became_peered":"2023-08-27T11:26:56.407261+0000","last_unstale":"2023-08-27T11:26:57.375149+0000","last_undegraded":"2023-08-27T11:26:57.375149+0000","last_fullsized":"2023-08-27T11:26:57.375149+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:19:17.783330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868629+0000","last_change":"2023-08-27T11:26:55.358644+0000","last_active":"2023-08-27T11:26:57.868629+0000","last_peered":"2023-08-27T11:26:57.868629+0000","last_clean":"2023-08-27T11:26:57.868629+0000","last_became_active":"2023-08-27T11:26:55.358327+0000","last_became_peered":"2023-08-27T11:26:55.358327+0000","last_unstale":"2023-08-27T11:26:57.868629+0000","last_undegraded":"2023-08-27T11:26:57.868629+0000","last_fullsized":"2023-08-27T11:26:57.868629+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:27.738777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373645+0000","last_change":"2023-08-27T11:26:56.395504+0000","last_active":"2023-08-27T11:26:57.373645+0000","last_peered":"2023-08-27T11:26:57.373645+0000","last_clean":"2023-08-27T11:26:57.373645+0000","last_became_active":"2023-08-27T11:26:56.394879+0000","last_became_peered":"2023-08-27T11:26:56.394879+0000","last_unstale":"2023-08-27T11:26:57.373645+0000","last_undegraded":"2023-08-27T11:26:57.373645+0000","last_fullsized":"2023-08-27T11:26:57.373645+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:24.192376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868614+0000","last_change":"2023-08-27T11:26:55.361664+0000","last_active":"2023-08-27T11:26:57.868614+0000","last_peered":"2023-08-27T11:26:57.868614+0000","last_clean":"2023-08-27T11:26:57.868614+0000","last_became_active":"2023-08-27T11:26:55.361207+0000","last_became_peered":"2023-08-27T11:26:55.361207+0000","last_unstale":"2023-08-27T11:26:57.868614+0000","last_undegraded":"2023-08-27T11:26:57.868614+0000","last_fullsized":"2023-08-27T11:26:57.868614+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:30.887349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524541+0000","last_change":"2023-08-27T11:26:56.402934+0000","last_active":"2023-08-27T11:26:57.524541+0000","last_peered":"2023-08-27T11:26:57.524541+0000","last_clean":"2023-08-27T11:26:57.524541+0000","last_became_active":"2023-08-27T11:26:56.402642+0000","last_became_peered":"2023-08-27T11:26:56.402642+0000","last_unstale":"2023-08-27T11:26:57.524541+0000","last_undegraded":"2023-08-27T11:26:57.524541+0000","last_fullsized":"2023-08-27T11:26:57.524541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:26:40.606458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524401+0000","last_change":"2023-08-27T11:26:55.349997+0000","last_active":"2023-08-27T11:26:57.524401+0000","last_peered":"2023-08-27T11:26:57.524401+0000","last_clean":"2023-08-27T11:26:57.524401+0000","last_became_active":"2023-08-27T11:26:55.349692+0000","last_became_peered":"2023-08-27T11:26:55.349692+0000","last_unstale":"2023-08-27T11:26:57.524401+0000","last_undegraded":"2023-08-27T11:26:57.524401+0000","last_fullsized":"2023-08-27T11:26:57.524401+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:35:47.178676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614154+0000","last_change":"2023-08-27T11:26:56.408766+0000","last_active":"2023-08-27T11:26:57.614154+0000","last_peered":"2023-08-27T11:26:57.614154+0000","last_clean":"2023-08-27T11:26:57.614154+0000","last_became_active":"2023-08-27T11:26:56.408338+0000","last_became_peered":"2023-08-27T11:26:56.408338+0000","last_unstale":"2023-08-27T11:26:57.614154+0000","last_undegraded":"2023-08-27T11:26:57.614154+0000","last_fullsized":"2023-08-27T11:26:57.614154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:04:50.832278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"95'8","reported_seq":21,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375830+0000","last_change":"2023-08-27T11:26:55.348680+0000","last_active":"2023-08-27T11:26:57.375830+0000","last_peered":"2023-08-27T11:26:57.375830+0000","last_clean":"2023-08-27T11:26:57.375830+0000","last_became_active":"2023-08-27T11:26:55.348359+0000","last_became_peered":"2023-08-27T11:26:55.348359+0000","last_unstale":"2023-08-27T11:26:57.375830+0000","last_undegraded":"2023-08-27T11:26:57.375830+0000","last_fullsized":"2023-08-27T11:26:57.375830+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:01.934299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613714+0000","last_change":"2023-08-27T11:26:56.404367+0000","last_active":"2023-08-27T11:26:57.613714+0000","last_peered":"2023-08-27T11:26:57.613714+0000","last_clean":"2023-08-27T11:26:57.613714+0000","last_became_active":"2023-08-27T11:26:56.404085+0000","last_became_peered":"2023-08-27T11:26:56.404085+0000","last_unstale":"2023-08-27T11:26:57.613714+0000","last_undegraded":"2023-08-27T11:26:57.613714+0000","last_fullsized":"2023-08-27T11:26:57.613714+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:27:21.183402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868532+0000","last_change":"2023-08-27T11:26:55.361849+0000","last_active":"2023-08-27T11:26:57.868532+0000","last_peered":"2023-08-27T11:26:57.868532+0000","last_clean":"2023-08-27T11:26:57.868532+0000","last_became_active":"2023-08-27T11:26:55.361557+0000","last_became_peered":"2023-08-27T11:26:55.361557+0000","last_unstale":"2023-08-27T11:26:57.868532+0000","last_undegraded":"2023-08-27T11:26:57.868532+0000","last_fullsized":"2023-08-27T11:26:57.868532+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:43.379736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375566+0000","last_change":"2023-08-27T11:26:56.402148+0000","last_active":"2023-08-27T11:26:57.375566+0000","last_peered":"2023-08-27T11:26:57.375566+0000","last_clean":"2023-08-27T11:26:57.375566+0000","last_became_active":"2023-08-27T11:26:56.401832+0000","last_became_peered":"2023-08-27T11:26:56.401832+0000","last_unstale":"2023-08-27T11:26:57.375566+0000","last_undegraded":"2023-08-27T11:26:57.375566+0000","last_fullsized":"2023-08-27T11:26:57.375566+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:43:05.272964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"96'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614072+0000","last_change":"2023-08-27T11:26:55.354496+0000","last_active":"2023-08-27T11:26:57.614072+0000","last_peered":"2023-08-27T11:26:57.614072+0000","last_clean":"2023-08-27T11:26:57.614072+0000","last_became_active":"2023-08-27T11:26:55.354179+0000","last_became_peered":"2023-08-27T11:26:55.354179+0000","last_unstale":"2023-08-27T11:26:57.614072+0000","last_undegraded":"2023-08-27T11:26:57.614072+0000","last_fullsized":"2023-08-27T11:26:57.614072+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:54.064479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868553+0000","last_change":"2023-08-27T11:26:56.394792+0000","last_active":"2023-08-27T11:26:57.868553+0000","last_peered":"2023-08-27T11:26:57.868553+0000","last_clean":"2023-08-27T11:26:57.868553+0000","last_became_active":"2023-08-27T11:26:56.394462+0000","last_became_peered":"2023-08-27T11:26:56.394462+0000","last_unstale":"2023-08-27T11:26:57.868553+0000","last_undegraded":"2023-08-27T11:26:57.868553+0000","last_fullsized":"2023-08-27T11:26:57.868553+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:10.637907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373652+0000","last_change":"2023-08-27T11:26:55.356722+0000","last_active":"2023-08-27T11:26:57.373652+0000","last_peered":"2023-08-27T11:26:57.373652+0000","last_clean":"2023-08-27T11:26:57.373652+0000","last_became_active":"2023-08-27T11:26:55.356411+0000","last_became_peered":"2023-08-27T11:26:55.356411+0000","last_unstale":"2023-08-27T11:26:57.373652+0000","last_undegraded":"2023-08-27T11:26:57.373652+0000","last_fullsized":"2023-08-27T11:26:57.373652+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:36:39.024611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375147+0000","last_change":"2023-08-27T11:26:56.399870+0000","last_active":"2023-08-27T11:26:57.375147+0000","last_peered":"2023-08-27T11:26:57.375147+0000","last_clean":"2023-08-27T11:26:57.375147+0000","last_became_active":"2023-08-27T11:26:56.399577+0000","last_became_peered":"2023-08-27T11:26:56.399577+0000","last_unstale":"2023-08-27T11:26:57.375147+0000","last_undegraded":"2023-08-27T11:26:57.375147+0000","last_fullsized":"2023-08-27T11:26:57.375147+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:28.392930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868792+0000","last_change":"2023-08-27T11:26:55.359591+0000","last_active":"2023-08-27T11:26:57.868792+0000","last_peered":"2023-08-27T11:26:57.868792+0000","last_clean":"2023-08-27T11:26:57.868792+0000","last_became_active":"2023-08-27T11:26:55.359302+0000","last_became_peered":"2023-08-27T11:26:55.359302+0000","last_unstale":"2023-08-27T11:26:57.868792+0000","last_undegraded":"2023-08-27T11:26:57.868792+0000","last_fullsized":"2023-08-27T11:26:57.868792+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:45:56.867022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524519+0000","last_change":"2023-08-27T11:26:56.394468+0000","last_active":"2023-08-27T11:26:57.524519+0000","last_peered":"2023-08-27T11:26:57.524519+0000","last_clean":"2023-08-27T11:26:57.524519+0000","last_became_active":"2023-08-27T11:26:56.394104+0000","last_became_peered":"2023-08-27T11:26:56.394104+0000","last_unstale":"2023-08-27T11:26:57.524519+0000","last_undegraded":"2023-08-27T11:26:57.524519+0000","last_fullsized":"2023-08-27T11:26:57.524519+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:27:35.898665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375384+0000","last_change":"2023-08-27T11:26:55.349533+0000","last_active":"2023-08-27T11:26:57.375384+0000","last_peered":"2023-08-27T11:26:57.375384+0000","last_clean":"2023-08-27T11:26:57.375384+0000","last_became_active":"2023-08-27T11:26:55.349211+0000","last_became_peered":"2023-08-27T11:26:55.349211+0000","last_unstale":"2023-08-27T11:26:57.375384+0000","last_undegraded":"2023-08-27T11:26:57.375384+0000","last_fullsized":"2023-08-27T11:26:57.375384+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:09.635741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.525013+0000","last_change":"2023-08-27T11:26:56.394467+0000","last_active":"2023-08-27T11:26:57.525013+0000","last_peered":"2023-08-27T11:26:57.525013+0000","last_clean":"2023-08-27T11:26:57.525013+0000","last_became_active":"2023-08-27T11:26:56.394158+0000","last_became_peered":"2023-08-27T11:26:56.394158+0000","last_unstale":"2023-08-27T11:26:57.525013+0000","last_undegraded":"2023-08-27T11:26:57.525013+0000","last_fullsized":"2023-08-27T11:26:57.525013+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:44:52.578481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524899+0000","last_change":"2023-08-27T11:26:55.351607+0000","last_active":"2023-08-27T11:26:57.524899+0000","last_peered":"2023-08-27T11:26:57.524899+0000","last_clean":"2023-08-27T11:26:57.524899+0000","last_became_active":"2023-08-27T11:26:55.351289+0000","last_became_peered":"2023-08-27T11:26:55.351289+0000","last_unstale":"2023-08-27T11:26:57.524899+0000","last_undegraded":"2023-08-27T11:26:57.524899+0000","last_fullsized":"2023-08-27T11:26:57.524899+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:53:58.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868879+0000","last_change":"2023-08-27T11:26:56.397449+0000","last_active":"2023-08-27T11:26:57.868879+0000","last_peered":"2023-08-27T11:26:57.868879+0000","last_clean":"2023-08-27T11:26:57.868879+0000","last_became_active":"2023-08-27T11:26:56.397145+0000","last_became_peered":"2023-08-27T11:26:56.397145+0000","last_unstale":"2023-08-27T11:26:57.868879+0000","last_undegraded":"2023-08-27T11:26:57.868879+0000","last_fullsized":"2023-08-27T11:26:57.868879+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:35.339972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373610+0000","last_change":"2023-08-27T11:26:55.357412+0000","last_active":"2023-08-27T11:26:57.373610+0000","last_peered":"2023-08-27T11:26:57.373610+0000","last_clean":"2023-08-27T11:26:57.373610+0000","last_became_active":"2023-08-27T11:26:55.357099+0000","last_became_peered":"2023-08-27T11:26:55.357099+0000","last_unstale":"2023-08-27T11:26:57.373610+0000","last_undegraded":"2023-08-27T11:26:57.373610+0000","last_fullsized":"2023-08-27T11:26:57.373610+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:06.482136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375781+0000","last_change":"2023-08-27T11:26:56.398193+0000","last_active":"2023-08-27T11:26:57.375781+0000","last_peered":"2023-08-27T11:26:57.375781+0000","last_clean":"2023-08-27T11:26:57.375781+0000","last_became_active":"2023-08-27T11:26:56.397790+0000","last_became_peered":"2023-08-27T11:26:56.397790+0000","last_unstale":"2023-08-27T11:26:57.375781+0000","last_undegraded":"2023-08-27T11:26:57.375781+0000","last_fullsized":"2023-08-27T11:26:57.375781+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:41:30.842425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524593+0000","last_change":"2023-08-27T11:26:55.350845+0000","last_active":"2023-08-27T11:26:57.524593+0000","last_peered":"2023-08-27T11:26:57.524593+0000","last_clean":"2023-08-27T11:26:57.524593+0000","last_became_active":"2023-08-27T11:26:55.350307+0000","last_became_peered":"2023-08-27T11:26:55.350307+0000","last_unstale":"2023-08-27T11:26:57.524593+0000","last_undegraded":"2023-08-27T11:26:57.524593+0000","last_fullsized":"2023-08-27T11:26:57.524593+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:21:47.605243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868433+0000","last_change":"2023-08-27T11:26:56.394791+0000","last_active":"2023-08-27T11:26:57.868433+0000","last_peered":"2023-08-27T11:26:57.868433+0000","last_clean":"2023-08-27T11:26:57.868433+0000","last_became_active":"2023-08-27T11:26:56.394489+0000","last_became_peered":"2023-08-27T11:26:56.394489+0000","last_unstale":"2023-08-27T11:26:57.868433+0000","last_undegraded":"2023-08-27T11:26:57.868433+0000","last_fullsized":"2023-08-27T11:26:57.868433+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:10.752091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.372995+0000","last_change":"2023-08-27T11:26:55.358238+0000","last_active":"2023-08-27T11:26:57.372995+0000","last_peered":"2023-08-27T11:26:57.372995+0000","last_clean":"2023-08-27T11:26:57.372995+0000","last_became_active":"2023-08-27T11:26:55.357924+0000","last_became_peered":"2023-08-27T11:26:55.357924+0000","last_unstale":"2023-08-27T11:26:57.372995+0000","last_undegraded":"2023-08-27T11:26:57.372995+0000","last_fullsized":"2023-08-27T11:26:57.372995+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:26:07.079854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374173+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:26:57.374173+0000","last_peered":"2023-08-27T11:26:57.374173+0000","last_clean":"2023-08-27T11:26:57.374173+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:26:57.374173+0000","last_undegraded":"2023-08-27T11:26:57.374173+0000","last_fullsized":"2023-08-27T11:26:57.374173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:55.081201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524756+0000","last_change":"2023-08-27T11:26:56.397650+0000","last_active":"2023-08-27T11:26:57.524756+0000","last_peered":"2023-08-27T11:26:57.524756+0000","last_clean":"2023-08-27T11:26:57.524756+0000","last_became_active":"2023-08-27T11:26:56.397306+0000","last_became_peered":"2023-08-27T11:26:56.397306+0000","last_unstale":"2023-08-27T11:26:57.524756+0000","last_undegraded":"2023-08-27T11:26:57.524756+0000","last_fullsized":"2023-08-27T11:26:57.524756+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:58:22.262397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524398+0000","last_change":"2023-08-27T11:26:55.353113+0000","last_active":"2023-08-27T11:26:57.524398+0000","last_peered":"2023-08-27T11:26:57.524398+0000","last_clean":"2023-08-27T11:26:57.524398+0000","last_became_active":"2023-08-27T11:26:55.352818+0000","last_became_peered":"2023-08-27T11:26:55.352818+0000","last_unstale":"2023-08-27T11:26:57.524398+0000","last_undegraded":"2023-08-27T11:26:57.524398+0000","last_fullsized":"2023-08-27T11:26:57.524398+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:57:50.684005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373595+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:26:57.373595+0000","last_peered":"2023-08-27T11:26:57.373595+0000","last_clean":"2023-08-27T11:26:57.373595+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:26:57.373595+0000","last_undegraded":"2023-08-27T11:26:57.373595+0000","last_fullsized":"2023-08-27T11:26:57.373595+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:48.883338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524390+0000","last_change":"2023-08-27T11:26:56.387890+0000","last_active":"2023-08-27T11:26:57.524390+0000","last_peered":"2023-08-27T11:26:57.524390+0000","last_clean":"2023-08-27T11:26:57.524390+0000","last_became_active":"2023-08-27T11:26:56.387578+0000","last_became_peered":"2023-08-27T11:26:56.387578+0000","last_unstale":"2023-08-27T11:26:57.524390+0000","last_undegraded":"2023-08-27T11:26:57.524390+0000","last_fullsized":"2023-08-27T11:26:57.524390+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:01:25.247073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374024+0000","last_change":"2023-08-27T11:26:55.347843+0000","last_active":"2023-08-27T11:26:57.374024+0000","last_peered":"2023-08-27T11:26:57.374024+0000","last_clean":"2023-08-27T11:26:57.374024+0000","last_became_active":"2023-08-27T11:26:55.347517+0000","last_became_peered":"2023-08-27T11:26:55.347517+0000","last_unstale":"2023-08-27T11:26:57.374024+0000","last_undegraded":"2023-08-27T11:26:57.374024+0000","last_fullsized":"2023-08-27T11:26:57.374024+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:41.063327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":167,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375034+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:26:57.375034+0000","last_peered":"2023-08-27T11:26:57.375034+0000","last_clean":"2023-08-27T11:26:57.375034+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:26:57.375034+0000","last_undegraded":"2023-08-27T11:26:57.375034+0000","last_fullsized":"2023-08-27T11:26:57.375034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:10:29.972742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.374873+0000","last_change":"2023-08-27T11:26:56.411255+0000","last_active":"2023-08-27T11:26:57.374873+0000","last_peered":"2023-08-27T11:26:57.374873+0000","last_clean":"2023-08-27T11:26:57.374873+0000","last_became_active":"2023-08-27T11:26:56.410899+0000","last_became_peered":"2023-08-27T11:26:56.410899+0000","last_unstale":"2023-08-27T11:26:57.374873+0000","last_undegraded":"2023-08-27T11:26:57.374873+0000","last_fullsized":"2023-08-27T11:26:57.374873+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:35:09.375324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524742+0000","last_change":"2023-08-27T11:26:55.356624+0000","last_active":"2023-08-27T11:26:57.524742+0000","last_peered":"2023-08-27T11:26:57.524742+0000","last_clean":"2023-08-27T11:26:57.524742+0000","last_became_active":"2023-08-27T11:26:55.355441+0000","last_became_peered":"2023-08-27T11:26:55.355441+0000","last_unstale":"2023-08-27T11:26:57.524742+0000","last_undegraded":"2023-08-27T11:26:57.524742+0000","last_fullsized":"2023-08-27T11:26:57.524742+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:33:05.776207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":149,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868764+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:26:57.868764+0000","last_peered":"2023-08-27T11:26:57.868764+0000","last_clean":"2023-08-27T11:26:57.868764+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:26:57.868764+0000","last_undegraded":"2023-08-27T11:26:57.868764+0000","last_fullsized":"2023-08-27T11:26:57.868764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:20.272115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868362+0000","last_change":"2023-08-27T11:26:56.396051+0000","last_active":"2023-08-27T11:26:57.868362+0000","last_peered":"2023-08-27T11:26:57.868362+0000","last_clean":"2023-08-27T11:26:57.868362+0000","last_became_active":"2023-08-27T11:26:56.395739+0000","last_became_peered":"2023-08-27T11:26:56.395739+0000","last_unstale":"2023-08-27T11:26:57.868362+0000","last_undegraded":"2023-08-27T11:26:57.868362+0000","last_fullsized":"2023-08-27T11:26:57.868362+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:57:04.123405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375404+0000","last_change":"2023-08-27T11:26:55.360320+0000","last_active":"2023-08-27T11:26:57.375404+0000","last_peered":"2023-08-27T11:26:57.375404+0000","last_clean":"2023-08-27T11:26:57.375404+0000","last_became_active":"2023-08-27T11:26:55.359906+0000","last_became_peered":"2023-08-27T11:26:55.359906+0000","last_unstale":"2023-08-27T11:26:57.375404+0000","last_undegraded":"2023-08-27T11:26:57.375404+0000","last_fullsized":"2023-08-27T11:26:57.375404+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:55.548051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":149,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868561+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:26:57.868561+0000","last_peered":"2023-08-27T11:26:57.868561+0000","last_clean":"2023-08-27T11:26:57.868561+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:26:57.868561+0000","last_undegraded":"2023-08-27T11:26:57.868561+0000","last_fullsized":"2023-08-27T11:26:57.868561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:49.421252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.373321+0000","last_change":"2023-08-27T11:26:56.393003+0000","last_active":"2023-08-27T11:26:57.373321+0000","last_peered":"2023-08-27T11:26:57.373321+0000","last_clean":"2023-08-27T11:26:57.373321+0000","last_became_active":"2023-08-27T11:26:56.392692+0000","last_became_peered":"2023-08-27T11:26:56.392692+0000","last_unstale":"2023-08-27T11:26:57.373321+0000","last_undegraded":"2023-08-27T11:26:57.373321+0000","last_fullsized":"2023-08-27T11:26:57.373321+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:32:31.889515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"95'1","reported_seq":14,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868782+0000","last_change":"2023-08-27T11:26:55.364141+0000","last_active":"2023-08-27T11:26:57.868782+0000","last_peered":"2023-08-27T11:26:57.868782+0000","last_clean":"2023-08-27T11:26:57.868782+0000","last_became_active":"2023-08-27T11:26:55.363814+0000","last_became_peered":"2023-08-27T11:26:55.363814+0000","last_unstale":"2023-08-27T11:26:57.868782+0000","last_undegraded":"2023-08-27T11:26:57.868782+0000","last_fullsized":"2023-08-27T11:26:57.868782+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:33.588154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":297,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868429+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:26:57.868429+0000","last_peered":"2023-08-27T11:26:57.868429+0000","last_clean":"2023-08-27T11:26:57.868429+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:26:57.868429+0000","last_undegraded":"2023-08-27T11:26:57.868429+0000","last_fullsized":"2023-08-27T11:26:57.868429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:19:18.126119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":153,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868628+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:26:57.868628+0000","last_peered":"2023-08-27T11:26:57.868628+0000","last_clean":"2023-08-27T11:26:57.868628+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:26:57.868628+0000","last_undegraded":"2023-08-27T11:26:57.868628+0000","last_fullsized":"2023-08-27T11:26:57.868628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:59.925681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.614160+0000","last_change":"2023-08-27T11:26:56.399741+0000","last_active":"2023-08-27T11:26:57.614160+0000","last_peered":"2023-08-27T11:26:57.614160+0000","last_clean":"2023-08-27T11:26:57.614160+0000","last_became_active":"2023-08-27T11:26:56.398877+0000","last_became_peered":"2023-08-27T11:26:56.398877+0000","last_unstale":"2023-08-27T11:26:57.614160+0000","last_undegraded":"2023-08-27T11:26:57.614160+0000","last_fullsized":"2023-08-27T11:26:57.614160+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:19:11.204144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524788+0000","last_change":"2023-08-27T11:26:55.356213+0000","last_active":"2023-08-27T11:26:57.524788+0000","last_peered":"2023-08-27T11:26:57.524788+0000","last_clean":"2023-08-27T11:26:57.524788+0000","last_became_active":"2023-08-27T11:26:55.355932+0000","last_became_peered":"2023-08-27T11:26:55.355932+0000","last_unstale":"2023-08-27T11:26:57.524788+0000","last_undegraded":"2023-08-27T11:26:57.524788+0000","last_fullsized":"2023-08-27T11:26:57.524788+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:42.056991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":155,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.868799+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:26:57.868799+0000","last_peered":"2023-08-27T11:26:57.868799+0000","last_clean":"2023-08-27T11:26:57.868799+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:26:57.868799+0000","last_undegraded":"2023-08-27T11:26:57.868799+0000","last_fullsized":"2023-08-27T11:26:57.868799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:48.059793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.613842+0000","last_change":"2023-08-27T11:26:56.404445+0000","last_active":"2023-08-27T11:26:57.613842+0000","last_peered":"2023-08-27T11:26:57.613842+0000","last_clean":"2023-08-27T11:26:57.613842+0000","last_became_active":"2023-08-27T11:26:56.404123+0000","last_became_peered":"2023-08-27T11:26:56.404123+0000","last_unstale":"2023-08-27T11:26:57.613842+0000","last_undegraded":"2023-08-27T11:26:57.613842+0000","last_fullsized":"2023-08-27T11:26:57.613842+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:55.331252+0000","last_clean_scrub_stamp":"2023-08-27T11:26:55.331252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:20.411946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"95'2","reported_seq":15,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.524864+0000","last_change":"2023-08-27T11:26:55.358596+0000","last_active":"2023-08-27T11:26:57.524864+0000","last_peered":"2023-08-27T11:26:57.524864+0000","last_clean":"2023-08-27T11:26:57.524864+0000","last_became_active":"2023-08-27T11:26:55.358310+0000","last_became_peered":"2023-08-27T11:26:55.358310+0000","last_unstale":"2023-08-27T11:26:57.524864+0000","last_undegraded":"2023-08-27T11:26:57.524864+0000","last_fullsized":"2023-08-27T11:26:57.524864+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:26:54.329086+0000","last_clean_scrub_stamp":"2023-08-27T11:26:54.329086+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:00.777301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":163,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-08-27T11:26:57.375065+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:26:57.375065+0000","last_peered":"2023-08-27T11:26:57.375065+0000","last_clean":"2023-08-27T11:26:57.375065+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:26:57.375065+0000","last_undegraded":"2023-08-27T11:26:57.375065+0000","last_fullsized":"2023-08-27T11:26:57.375065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:42.924026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28772,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343068,"statfs":{"total":96636764160,"available":96607301632,"internally_reserved":0,"allocated":1789952,"data_stored":1144634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60399999999999998,"15min":0.58299999999999996},"min":{"1min":0.375,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70199999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.91900000000000004,"5min":1.036,"15min":1.036},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65700000000000003,"15min":0.63800000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.65700000000000003},"min":{"1min":0.48099999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83599999999999997,"5min":0.878,"15min":0.878},"last":0.63800000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70199999999999996,"15min":0.70899999999999996},"min":{"1min":0.442,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86099999999999999,"5min":1.173,"15min":1.173},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.51300000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88400000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.70199999999999996,"15min":0.68200000000000005},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":1.083,"15min":1.083},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79100000000000004,"15min":0.78300000000000003},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.135},"last":0.83099999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0189999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.50600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.397,"15min":1.397},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.006,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.747}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85399999999999998,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.133,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79000000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78600000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1204224,"data_stored":555336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":1.01},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.91300000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.98799999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.94799999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":1.044},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.86299999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":0.76000000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.96599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1785856,"data_stored":1144508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.433}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.871},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":0.95199999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89400000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.98199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":1200128,"data_stored":554822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.496}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.88}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.75},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.94699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28192,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343648,"statfs":{"total":96636764160,"available":96607895552,"internally_reserved":0,"allocated":1191936,"data_stored":554140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46600000000000003,"15min":0.51600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63200000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.432},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.50900000000000001,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61399999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.55300000000000005},"min":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69299999999999995,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52800000000000002,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.61799999999999999,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61199999999999999,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73499999999999999,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78900000000000003,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1459999999999999,"5min":1.669,"15min":1.669},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.994,"15min":1.994},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78500000000000003,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.1659999999999999,"5min":2.036,"15min":2.036},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.81100000000000005},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.97199999999999998,"5min":1.26,"15min":1.26},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.79900000000000004,"15min":0.82999999999999996},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1279999999999999,"5min":1.321,"15min":1.321},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.58699999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0900000000000001,"5min":1.627,"15min":1.627},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.85999999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0860000000000001,"5min":2.073,"15min":2.073},"last":0.747},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82699999999999996,"15min":0.86699999999999999},"min":{"1min":0.64100000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.171,"5min":1.323,"15min":1.323},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1187840,"data_stored":553702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.442},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.75800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":554198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.46999999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.1120000000000001,"5min":1.161,"15min":1.161},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68000000000000005,"15min":0.65700000000000003},"min":{"1min":0.41699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.83199999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.55800000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81299999999999994}]},{"osd":2,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.70399999999999996},"min":{"1min":0.443,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.92800000000000005,"5min":1.022,"15min":1.022},"last":0.70799999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.751,"15min":0.76100000000000001},"min":{"1min":0.64800000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96199999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73399999999999999,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98699999999999999,"5min":1.25,"15min":1.25},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72899999999999998,"15min":0.69899999999999995},"min":{"1min":0.55400000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.96499999999999997,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.46300000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.51200000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.629}]},{"osd":7,"last update":"Sun Aug 27 11:26:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.77400000000000002,"15min":0.746},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.51600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.54800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28184,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343656,"statfs":{"total":96636764160,"available":96607903744,"internally_reserved":0,"allocated":1183744,"data_stored":553120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86199999999999999,"5min":1.105,"15min":1.105},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66100000000000003,"15min":0.64300000000000002},"min":{"1min":0.53400000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.0089999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65700000000000003,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92600000000000005,"5min":1.014,"15min":1.014},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.65300000000000002},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97499999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76800000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.874,"5min":1.097,"15min":1.097},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.94499999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.97799999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94899999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73399999999999999,"15min":0.70599999999999996},"min":{"1min":0.56299999999999994,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.84799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.88600000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84999999999999998,"5min":1.744,"15min":1.744},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92100000000000004,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.92300000000000004,"5min":1.663,"15min":1.663},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.67600000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.81399999999999995},"min":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.274,"15min":1.274},"last":1.028}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:06.855 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:27:06.856 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:27:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.096+0000 7fec999ff700 1 Processor -- start 2023-08-27T11:27:07.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.097+0000 7fec999ff700 1 -- start start 2023-08-27T11:27:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec999ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fec940c02c0 0x7fec94151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec999ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec94152350 con 0x7fec940c2120 2023-08-27T11:27:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec999ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec94154d30 con 0x7fec9414e860 2023-08-27T11:27:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec999ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec941558d0 con 0x7fec940c02c0 2023-08-27T11:27:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec937fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fec940c2120 0x7fec9415bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47478/0 (socket says 172.21.15.43:47478) 2023-08-27T11:27:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec927fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fec940c02c0 0x7fec94151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec937fe700 1 -- 172.21.15.43:0/1383100704 learned_addr learned my addr 172.21.15.43:0/1383100704 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec927fc700 1 -- 172.21.15.43:0/1383100704 >> v1:172.21.15.57:6789/0 conn(0x7fec9414e860 legacy=0x7fec941551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec927fc700 1 -- 172.21.15.43:0/1383100704 >> v1:172.21.15.43:6789/0 conn(0x7fec940c2120 legacy=0x7fec9415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.099+0000 7fec927fc700 1 -- 172.21.15.43:0/1383100704 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940c0740 con 0x7fec940c02c0 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.098+0000 7fec91ffb700 1 -- 172.21.15.43:0/1383100704 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829357679 0 0) 0x7fec8c001490 con 0x7fec940c2120 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.099+0000 7fec927fc700 1 --2- 172.21.15.43:0/1383100704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec94151e10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fec88009840 tx=0x7fec88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22aafaf7840eee3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.099+0000 7fec91ffb700 1 -- 172.21.15.43:0/1383100704 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011830 con 0x7fec940c02c0 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.099+0000 7fec91ffb700 1 -- 172.21.15.43:0/1383100704 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88011990 con 0x7fec940c02c0 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.099+0000 7fec91ffb700 1 -- 172.21.15.43:0/1383100704 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011d20 con 0x7fec940c02c0 2023-08-27T11:27:07.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 -- 172.21.15.43:0/1383100704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 msgr2=0x7fec94151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 --2- 172.21.15.43:0/1383100704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec94151e10 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fec88009840 tx=0x7fec88009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 -- 172.21.15.43:0/1383100704 shutdown_connections 2023-08-27T11:27:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 --2- 172.21.15.43:0/1383100704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec94151e10 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 -- 172.21.15.43:0/1383100704 >> 172.21.15.43:0/1383100704 conn(0x7fec9406a310 msgr2=0x7fec9406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:07.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 -- 172.21.15.43:0/1383100704 shutdown_connections 2023-08-27T11:27:07.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.100+0000 7fec999ff700 1 -- 172.21.15.43:0/1383100704 wait complete. 2023-08-27T11:27:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.101+0000 7fec999ff700 1 Processor -- start 2023-08-27T11:27:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.102+0000 7fec999ff700 1 -- start start 2023-08-27T11:27:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec940c2120 0x7fec940703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 0x7fec94070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941537d0 con 0x7fec940c02c0 2023-08-27T11:27:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94153d50 con 0x7fec9414e860 2023-08-27T11:27:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec999ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94153a70 con 0x7fec940c2120 2023-08-27T11:27:07.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54158/0 (socket says 172.21.15.43:54158) 2023-08-27T11:27:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 -- 172.21.15.43:0/3356273499 learned_addr learned my addr 172.21.15.43:0/3356273499 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec937fe700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 0x7fec94070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec927fc700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec940c2120 0x7fec940703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 -- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec940c2120 msgr2=0x7fec940703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec940c2120 0x7fec940703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 -- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 msgr2=0x7fec94070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 0x7fec94070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec92ffd700 1 -- 172.21.15.43:0/3356273499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880094a0 con 0x7fec940c02c0 2023-08-27T11:27:07.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.103+0000 7fec937fe700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 0x7fec94070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec92ffd700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c4e0 tx=0x7fec8400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec840052d0 con 0x7fec940c02c0 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec84005430 con 0x7fec940c02c0 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec840038c0 con 0x7fec940c02c0 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec940bf660 con 0x7fec940c02c0 2023-08-27T11:27:07.111 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.104+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec940bf0f0 con 0x7fec940c02c0 2023-08-27T11:27:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.105+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94074680 con 0x7fec940c02c0 2023-08-27T11:27:07.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.106+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec84003a20 con 0x7fec940c02c0 2023-08-27T11:27:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.107+0000 7fec7bfff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 0x7fec8006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.107+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec84087a50 con 0x7fec940c02c0 2023-08-27T11:27:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.107+0000 7fec927fc700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 0x7fec8006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.108+0000 7fec927fc700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 0x7fec8006c5a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec9406ff80 tx=0x7fec88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.111+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fec84053130 con 0x7fec940c02c0 2023-08-27T11:27:07.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.406+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fec940c4850 con 0x7fec940c02c0 2023-08-27T11:27:07.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.410+0000 7fec7bfff700 1 -- 172.21.15.43:0/3356273499 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fec840170b0 con 0x7fec940c02c0 2023-08-27T11:27:07.411 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:27:07.411 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:27:07.412 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:27:07.412 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:27:07.412 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:27:07.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 msgr2=0x7fec8006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 0x7fec8006c5a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fec9406ff80 tx=0x7fec88008030 comp rx=0 tx=0).stop 2023-08-27T11:27:07.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 msgr2=0x7fec9414abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c4e0 tx=0x7fec8400c8a0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 shutdown_connections 2023-08-27T11:27:07.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec8006a0e0 0x7fec8006c5a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec9414e860 0x7fec94070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec940c02c0 0x7fec9414abc0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 --2- 172.21.15.43:0/3356273499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec940c2120 0x7fec940703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.412+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 >> 172.21.15.43:0/3356273499 conn(0x7fec9406a310 msgr2=0x7fec9406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:07.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.413+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 shutdown_connections 2023-08-27T11:27:07.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.413+0000 7fec999ff700 1 -- 172.21.15.43:0/3356273499 wait complete. 2023-08-27T11:27:07.417 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:27:07.432 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:07.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.631+0000 7f2d6d3ff700 1 Processor -- start 2023-08-27T11:27:07.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.631+0000 7f2d6d3ff700 1 -- start start 2023-08-27T11:27:07.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2d68151a90 0x7f2d680c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2d6806ad70 0x7f2d6806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6806c4e0 con 0x7f2d68151a90 2023-08-27T11:27:07.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d68155370 con 0x7f2d6806ad70 2023-08-27T11:27:07.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.632+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68151e70 con 0x7f2d680c4630 2023-08-27T11:27:07.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2d68151a90 0x7f2d680c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2d68151a90 0x7f2d680c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54160/0 (socket says 172.21.15.43:54160) 2023-08-27T11:27:07.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 -- 172.21.15.43:0/1232584278 learned_addr learned my addr 172.21.15.43:0/1232584278 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d677fe700 1 --2- 172.21.15.43:0/1232584278 >> v2:172.21.15.57:3300/0 conn(0x7f2d6806ad70 0x7f2d6806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d667fc700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 -- 172.21.15.43:0/1232584278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 msgr2=0x7f2d680c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 -- 172.21.15.43:0/1232584278 >> v2:172.21.15.57:3300/0 conn(0x7f2d6806ad70 msgr2=0x7f2d6806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/1232584278 >> v2:172.21.15.57:3300/0 conn(0x7f2d6806ad70 0x7f2d6806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d66ffd700 1 -- 172.21.15.43:0/1232584278 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68154480 con 0x7f2d68151a90 2023-08-27T11:27:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.633+0000 7f2d667fc700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c7bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2d680bd700 tx=0x7f2d58009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b114e30ee0eaf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d65ffb700 1 -- 172.21.15.43:0/1232584278 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5800b870 con 0x7f2d68151a90 2023-08-27T11:27:07.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d65ffb700 1 -- 172.21.15.43:0/1232584278 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5800b9d0 con 0x7f2d68151a90 2023-08-27T11:27:07.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d65ffb700 1 -- 172.21.15.43:0/1232584278 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5800bd60 con 0x7f2d68151a90 2023-08-27T11:27:07.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/1232584278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 msgr2=0x7f2d680c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c7bb0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f2d680bd700 tx=0x7f2d58009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/1232584278 shutdown_connections 2023-08-27T11:27:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/1232584278 >> v2:172.21.15.57:3300/0 conn(0x7f2d6806ad70 0x7f2d6806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c7bb0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/1232584278 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.634+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/1232584278 >> 172.21.15.43:0/1232584278 conn(0x7f2d680ab820 msgr2=0x7f2d680abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.635+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/1232584278 shutdown_connections 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.635+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/1232584278 wait complete. 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.636+0000 7f2d6d3ff700 1 Processor -- start 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.636+0000 7f2d6d3ff700 1 -- start start 2023-08-27T11:27:07.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d6806ad70 0x7f2d680c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680c7d00 con 0x7f2d68151a90 2023-08-27T11:27:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681537f0 con 0x7f2d6806ad70 2023-08-27T11:27:07.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681ea2f0 con 0x7f2d680c4630 2023-08-27T11:27:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.637+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54162/0 (socket says 172.21.15.43:54162) 2023-08-27T11:27:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 -- 172.21.15.43:0/2146435165 learned_addr learned my addr 172.21.15.43:0/2146435165 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d667fc700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d6806ad70 0x7f2d680c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 -- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 msgr2=0x7f2d680aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 -- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d6806ad70 msgr2=0x7f2d680c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d6806ad70 0x7f2d680c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 -- 172.21.15.43:0/2146435165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58009550 con 0x7f2d68151a90 2023-08-27T11:27:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d677fe700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d60007e40 tx=0x7f2d6000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000ed30 con 0x7f2d68151a90 2023-08-27T11:27:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60014420 con 0x7f2d68151a90 2023-08-27T11:27:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.638+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600147d0 con 0x7f2d68151a90 2023-08-27T11:27:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.639+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68153a90 con 0x7f2d68151a90 2023-08-27T11:27:07.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.639+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d680aae10 con 0x7f2d68151a90 2023-08-27T11:27:07.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.640+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68153de0 con 0x7f2d68151a90 2023-08-27T11:27:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.641+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d60014930 con 0x7f2d68151a90 2023-08-27T11:27:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.642+0000 7f2d4f7fe700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.642+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d60088b90 con 0x7f2d68151a90 2023-08-27T11:27:07.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.642+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.643+0000 7f2d66ffd700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d58014040 tx=0x7f2d58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.646+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2d60054310 con 0x7f2d68151a90 2023-08-27T11:27:07.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.901+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d6804ee70 con 0x7f2d68151a90 2023-08-27T11:27:07.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.902+0000 7f2d4f7fe700 1 -- 172.21.15.43:0/2146435165 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f2d60057930 con 0x7f2d68151a90 2023-08-27T11:27:07.904 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:07.904 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:26:59.908755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/863801259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":863801259},{"type":"v1","addr":"172.21.15.43:6836","nonce":863801259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 msgr2=0x7f2d5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2d58014040 tx=0x7f2d58008030 comp rx=0 tx=0).stop 2023-08-27T11:27:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 msgr2=0x7f2d680c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f2d60007e40 tx=0x7f2d6000e3c0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 shutdown_connections 2023-08-27T11:27:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2d68151a90 0x7f2d680c9170 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2d6806ad70 0x7f2d680c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 --2- 172.21.15.43:0/2146435165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2d680c4630 0x7f2d680aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:07.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.904+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 >> 172.21.15.43:0/2146435165 conn(0x7f2d680ab820 msgr2=0x7f2d6814b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:07.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.905+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 shutdown_connections 2023-08-27T11:27:07.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:07.905+0000 7f2d6d3ff700 1 -- 172.21.15.43:0/2146435165 wait complete. 2023-08-27T11:27:07.909 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 92 2023-08-27T11:27:08.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:26:59.908755+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:08.327 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:08.328 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:08.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.533+0000 7f02a19ff700 1 Processor -- start 2023-08-27T11:27:08.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.533+0000 7f02a19ff700 1 -- start start 2023-08-27T11:27:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.534+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 0x7f029c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.534+0000 7f02a19ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f029c154740 0x7f029c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.534+0000 7f02a19ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c154d00 con 0x7f029c14e960 2023-08-27T11:27:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.534+0000 7f02a19ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0baf30 con 0x7f029c154740 2023-08-27T11:27:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.534+0000 7f02a19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c154fe0 con 0x7f029c0c50d0 2023-08-27T11:27:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029affd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f029c14e960 0x7f029c0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47494/0 (socket says 172.21.15.43:47494) 2023-08-27T11:27:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029affd700 1 -- 172.21.15.43:0/1644966853 learned_addr learned my addr 172.21.15.43:0/1644966853 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:08.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029b7fe700 1 --2- 172.21.15.43:0/1644966853 >> v2:172.21.15.57:3300/0 conn(0x7f029c154740 0x7f029c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f0293fff700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 0x7f029c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029a7fc700 1 -- 172.21.15.43:0/1644966853 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308152444 0 0) 0x7f029c154d00 con 0x7f029c14e960 2023-08-27T11:27:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029a7fc700 1 -- 172.21.15.43:0/1644966853 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02880035b0 con 0x7f029c14e960 2023-08-27T11:27:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029b7fe700 1 -- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 msgr2=0x7f029c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029b7fe700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 0x7f029c0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029b7fe700 1 -- 172.21.15.43:0/1644966853 >> v1:172.21.15.43:6789/0 conn(0x7f029c14e960 legacy=0x7f029c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f029b7fe700 1 -- 172.21.15.43:0/1644966853 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c1552c0 con 0x7f029c154740 2023-08-27T11:27:08.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.535+0000 7f0293fff700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 0x7f029c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:08.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.536+0000 7f029b7fe700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c154740 0x7f029c0c4200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd78603ffe0ff5c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.536+0000 7f029a7fc700 1 -- 172.21.15.43:0/1644966853 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400e070 con 0x7f029c154740 2023-08-27T11:27:08.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.536+0000 7f029a7fc700 1 -- 172.21.15.43:0/1644966853 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400bb20 con 0x7f029c154740 2023-08-27T11:27:08.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.536+0000 7f029a7fc700 1 -- 172.21.15.43:0/1644966853 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294012430 con 0x7f029c154740 2023-08-27T11:27:08.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 -- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c154740 msgr2=0x7f029c0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c154740 0x7f029c0c4200 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029400b330 comp rx=0 tx=0).stop 2023-08-27T11:27:08.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 -- 172.21.15.43:0/1644966853 shutdown_connections 2023-08-27T11:27:08.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c154740 0x7f029c0c4200 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 --2- 172.21.15.43:0/1644966853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c0c50d0 0x7f029c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 -- 172.21.15.43:0/1644966853 >> 172.21.15.43:0/1644966853 conn(0x7f029c06aa50 msgr2=0x7f029c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 -- 172.21.15.43:0/1644966853 shutdown_connections 2023-08-27T11:27:08.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.537+0000 7f02a19ff700 1 -- 172.21.15.43:0/1644966853 wait complete. 2023-08-27T11:27:08.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.538+0000 7f02a19ff700 1 Processor -- start 2023-08-27T11:27:08.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 -- start start 2023-08-27T11:27:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c14e960 0x7f029c13fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c154740 0x7f029c140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c149480 con 0x7f029c0c50d0 2023-08-27T11:27:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c145390 con 0x7f029c14e960 2023-08-27T11:27:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.539+0000 7f02a19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1405d0 con 0x7f029c154740 2023-08-27T11:27:08.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54168/0 (socket says 172.21.15.43:54168) 2023-08-27T11:27:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 -- 172.21.15.43:0/3065710996 learned_addr learned my addr 172.21.15.43:0/3065710996 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f0293fff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c14e960 0x7f029c13fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029b7fe700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c154740 0x7f029c140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 -- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c154740 msgr2=0x7f029c140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c154740 0x7f029c140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 -- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c14e960 msgr2=0x7f029c13fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c14e960 0x7f029c13fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 -- 172.21.15.43:0/3065710996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840094a0 con 0x7f029c0c50d0 2023-08-27T11:27:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.540+0000 7f029affd700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c730 tx=0x7f028c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.541+0000 7f0298ff9700 1 -- 172.21.15.43:0/3065710996 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c005d70 con 0x7f029c0c50d0 2023-08-27T11:27:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.541+0000 7f0298ff9700 1 -- 172.21.15.43:0/3065710996 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c0070d0 con 0x7f029c0c50d0 2023-08-27T11:27:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.541+0000 7f0298ff9700 1 -- 172.21.15.43:0/3065710996 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c007460 con 0x7f029c0c50d0 2023-08-27T11:27:08.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.541+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294009a70 con 0x7f029c0c50d0 2023-08-27T11:27:08.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.541+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c144af0 con 0x7f029c0c50d0 2023-08-27T11:27:08.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.543+0000 7f0298ff9700 1 -- 172.21.15.43:0/3065710996 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f028c0075c0 con 0x7f029c0c50d0 2023-08-27T11:27:08.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.544+0000 7f0298ff9700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 0x7f027c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.544+0000 7f0298ff9700 1 -- 172.21.15.43:0/3065710996 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f028c087b90 con 0x7f029c0c50d0 2023-08-27T11:27:08.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.544+0000 7f0293fff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 0x7f027c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.545+0000 7f0293fff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 0x7f027c06c5a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f029c14df60 tx=0x7f0284009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.546+0000 7f02b53d3b80 1 Processor -- start 2023-08-27T11:27:08.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.546+0000 7f02b53d3b80 1 -- start start 2023-08-27T11:27:08.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 0x55913fe6bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe81500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fda6730 con 0x55913fe4efe0 2023-08-27T11:27:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fda4050 con 0x55913fe48f00 2023-08-27T11:27:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55913fd9f940 con 0x55913fe492e0 2023-08-27T11:27:08.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f0293fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f0293fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54170/0 (socket says 172.21.15.43:54170) 2023-08-27T11:27:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f0293fff700 1 -- 172.21.15.43:0/2478129724 learned_addr learned my addr 172.21.15.43:0/2478129724 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.547+0000 7f029b7fe700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe81500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f029affd700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 0x55913fe6bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 -- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 msgr2=0x55913fe81500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe81500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 -- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 msgr2=0x55913fe6bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 0x55913fe6bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 -- 172.21.15.43:0/2478129724 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913fc1f5e0 con 0x55913fe4efe0 2023-08-27T11:27:08.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f029affd700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 0x55913fe6bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:08.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f0293fff700 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0284011ec0 tx=0x7f0284014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b732cfd5f50d5ef7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f02917fa700 1 -- 172.21.15.43:0/2478129724 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284003930 con 0x55913fe4efe0 2023-08-27T11:27:08.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f02917fa700 1 -- 172.21.15.43:0/2478129724 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028401b070 con 0x55913fe4efe0 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.548+0000 7f02917fa700 1 -- 172.21.15.43:0/2478129724 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284003c90 con 0x55913fe4efe0 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2478129724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 msgr2=0x55913fe6c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0284011ec0 tx=0x7f0284014000 comp rx=0 tx=0).stop 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2478129724 shutdown_connections 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe81500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe48f00 0x55913fe6bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2478129724 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe4efe0 0x55913fe6c2b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2478129724 >> 172.21.15.43:0/2478129724 conn(0x55913fdabc30 msgr2=0x55913fe4b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2478129724 shutdown_connections 2023-08-27T11:27:08.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.549+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2478129724 wait complete. 2023-08-27T11:27:08.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.550+0000 7f02b53d3b80 1 -- start start 2023-08-27T11:27:08.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.550+0000 7f02b53d3b80 1 Processor -- start 2023-08-27T11:27:08.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 0x55913fe87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe87d90 0x55913fe89bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fd3db60 con 0x55913fe48f00 2023-08-27T11:27:08.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fd3d860 con 0x55913fe492e0 2023-08-27T11:27:08.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55913fc218d0 con 0x55913fe87d90 2023-08-27T11:27:08.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f02b53d3b80 10 client.0 _ll_register_callbacks cb 0x55913fd3b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:08.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54174/0 (socket says 172.21.15.43:54174) 2023-08-27T11:27:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.551+0000 7f029affd700 1 -- 172.21.15.43:0/2218131839 learned_addr learned my addr 172.21.15.43:0/2218131839 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f0293fff700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 0x55913fe87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029b7fe700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe87d90 0x55913fe89bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 -- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe87d90 msgr2=0x55913fe89bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe87d90 0x55913fe89bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 -- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 msgr2=0x55913fe87850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 0x55913fe87850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 -- 172.21.15.43:0/2218131839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0284011b70 con 0x55913fe48f00 2023-08-27T11:27:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f0293fff700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 0x55913fe87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:08.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f029affd700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f028c0533a0 tx=0x7f028c056670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a55e415f08d89cd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f027a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c052e90 con 0x55913fe48f00 2023-08-27T11:27:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f028c057e40 con 0x55913fe48f00 2023-08-27T11:27:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55913fe404f0 con 0x55913fe48f00 2023-08-27T11:27:08.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f028c052ff0 con 0x55913fe48f00 2023-08-27T11:27:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f02b53d3b80 10 client.7278 fetch_fsmap learned FSMap version 92 2023-08-27T11:27:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.552+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55913fdb7750 con 0x55913fe48f00 2023-08-27T11:27:08.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55913fe404f0 con 0x55913fe48f00 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f028c055e00 con 0x55913fe48f00 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 10 client.7278 fetch_fsmap finished waiting for FSMap version 92 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 10 client.7278 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 20 client.7278 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913fe9cb60 0x55913fe9cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 4 client.7278 mds_command: new command op to 7083 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55913fd98920 con 0x55913fe9cb60 2023-08-27T11:27:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.553+0000 7f0293fff700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913fe9cb60 0x55913fe9cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.554+0000 7f0293fff700 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913fe9cb60 0x55913fe9cf40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfba5b0068a57a0 server_cookie=3499c91ee65fb937 in_seq=0 out_seq=0 2023-08-27T11:27:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.554+0000 7f027a7fc700 10 client.7278 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.554+0000 7f027a7fc700 1 -- 172.21.15.43:0/2218131839 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55913fd98920 con 0x55913fe9cb60 2023-08-27T11:27:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.554+0000 7f027a7fc700 10 client.7278 handle_command_reply: tid=0 2023-08-27T11:27:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.554+0000 7f02b53d3b80 1 client.7278 shutdown 2023-08-27T11:27:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 msgr2=0x55913fe66770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f028c0533a0 tx=0x7f028c056670 comp rx=0 tx=0).stop 2023-08-27T11:27:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 shutdown_connections 2023-08-27T11:27:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe87d90 0x55913fe89bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe66770 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913fe9cb60 0x55913fe9cf40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/2218131839 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe492e0 0x55913fe87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 >> 172.21.15.43:0/2218131839 conn(0x55913fdabc30 msgr2=0x55913fe6bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f027a7fc700 0 client.7278 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 shutdown_connections 2023-08-27T11:27:08.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 1 -- 172.21.15.43:0/2218131839 wait complete. 2023-08-27T11:27:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.555+0000 7f02b53d3b80 20 client.7278 trim_cache size 0 max 16384 2023-08-27T11:27:08.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.573+0000 7f02b53d3b80 1 Processor -- start 2023-08-27T11:27:08.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 -- start start 2023-08-27T11:27:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe46b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913fe4d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fe2a560 con 0x55913fe48f00 2023-08-27T11:27:08.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fe404b0 con 0x55913fe87d90 2023-08-27T11:27:08.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.574+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55913fe42ad0 con 0x55913fe492e0 2023-08-27T11:27:08.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54186/0 (socket says 172.21.15.43:54186) 2023-08-27T11:27:08.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 -- 172.21.15.43:0/3316953294 learned_addr learned my addr 172.21.15.43:0/3316953294 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029b7fe700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913fe4d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f0293fff700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe46b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 -- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 msgr2=0x55913fe46b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe46b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 -- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 msgr2=0x55913fe4d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913fe4d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 -- 172.21.15.43:0/3316953294 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55913fbcbd90 con 0x55913fe48f00 2023-08-27T11:27:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f0293fff700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029b7fe700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913fe4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f029affd700 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f028c001eb0 tx=0x7f028c059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83b1d458113d0c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f0291ffb700 1 -- 172.21.15.43:0/3316953294 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00e040 con 0x55913fe48f00 2023-08-27T11:27:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f0291ffb700 1 -- 172.21.15.43:0/3316953294 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c05ebb0 con 0x55913fe48f00 2023-08-27T11:27:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.575+0000 7f0291ffb700 1 -- 172.21.15.43:0/3316953294 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c052c90 con 0x55913fe48f00 2023-08-27T11:27:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 -- 172.21.15.43:0/3316953294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 msgr2=0x55913fe9d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f028c001eb0 tx=0x7f028c059000 comp rx=0 tx=0).stop 2023-08-27T11:27:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 -- 172.21.15.43:0/3316953294 shutdown_connections 2023-08-27T11:27:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913fe4d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe48f00 0x55913fe9d350 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/3316953294 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe492e0 0x55913fe46b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 -- 172.21.15.43:0/3316953294 >> 172.21.15.43:0/3316953294 conn(0x55913fdabc30 msgr2=0x55913fe44450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 -- 172.21.15.43:0/3316953294 shutdown_connections 2023-08-27T11:27:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.576+0000 7f02b53d3b80 1 -- 172.21.15.43:0/3316953294 wait complete. 2023-08-27T11:27:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.577+0000 7f02b53d3b80 1 -- start start 2023-08-27T11:27:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.577+0000 7f02b53d3b80 1 Processor -- start 2023-08-27T11:27:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe48f00 0x55913fe9d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913feede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fe6b880 con 0x55913fe492e0 2023-08-27T11:27:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55913fe6bcb0 con 0x55913fe87d90 2023-08-27T11:27:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55913fe4c0a0 con 0x55913fe48f00 2023-08-27T11:27:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f02b53d3b80 10 client.0 _ll_register_callbacks cb 0x55913fd3b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f0293fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f0293fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54202/0 (socket says 172.21.15.43:54202) 2023-08-27T11:27:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f0293fff700 1 -- 172.21.15.43:0/754803804 learned_addr learned my addr 172.21.15.43:0/754803804 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f029b7fe700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913feede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f0293fff700 1 -- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe48f00 msgr2=0x55913fe9d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.578+0000 7f0293fff700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe48f00 0x55913fe9d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f0293fff700 1 -- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 msgr2=0x55913feede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f0293fff700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913feede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f0293fff700 1 -- 172.21.15.43:0/754803804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55913fdb7750 con 0x55913fe492e0 2023-08-27T11:27:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f029b7fe700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913feede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f0293fff700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0284024040 tx=0x7f0284016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e92a4214061abbb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f027a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284031050 con 0x55913fe492e0 2023-08-27T11:27:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55913fe80d50 con 0x55913fe492e0 2023-08-27T11:27:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0284003b70 con 0x55913fe492e0 2023-08-27T11:27:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0284003d30 con 0x55913fe492e0 2023-08-27T11:27:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f02b53d3b80 10 client.7284 fetch_fsmap learned FSMap version 92 2023-08-27T11:27:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.579+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55913fbb4c10 con 0x55913fe492e0 2023-08-27T11:27:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55913fe80d50 con 0x55913fe492e0 2023-08-27T11:27:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02840347a0 con 0x55913fe492e0 2023-08-27T11:27:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 10 client.7284 fetch_fsmap finished waiting for FSMap version 92 2023-08-27T11:27:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 10 client.7284 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 20 client.7284 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913feee370 0x55913fe98380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 4 client.7284 mds_command: new command op to 7083 tid=0[{"prefix": "status"}] 2023-08-27T11:27:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f028401b070 con 0x55913feee370 2023-08-27T11:27:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.580+0000 7f029affd700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913feee370 0x55913fe98380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f027a7fc700 10 client.7284 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f029affd700 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913feee370 0x55913fe98380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32ce01d01ab087c server_cookie=171bcddce861f23d in_seq=0 out_seq=0 2023-08-27T11:27:08.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f027a7fc700 1 -- 172.21.15.43:0/754803804 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f028401b070 con 0x55913feee370 2023-08-27T11:27:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f027a7fc700 10 client.7284 handle_command_reply: tid=0 2023-08-27T11:27:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 client.7284 shutdown 2023-08-27T11:27:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 msgr2=0x55913fe6b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0284024040 tx=0x7f0284016000 comp rx=0 tx=0).stop 2023-08-27T11:27:08.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 shutdown_connections 2023-08-27T11:27:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55913feee370 0x55913fe98380 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55913fe87d90 0x55913feede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55913fe48f00 0x55913fe9d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f027a7fc700 0 client.7284 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:08.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 --2- 172.21.15.43:0/754803804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55913fe492e0 0x55913fe6b340 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 >> 172.21.15.43:0/754803804 conn(0x55913fdabc30 msgr2=0x55913fe46f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 shutdown_connections 2023-08-27T11:27:08.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.581+0000 7f02b53d3b80 1 -- 172.21.15.43:0/754803804 wait complete. 2023-08-27T11:27:08.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02b53d3b80 20 client.7284 trim_cache size 0 max 16384 2023-08-27T11:27:08.608 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:08.608 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:08.608 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:08.609 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7083, 2023-08-27T11:27:08.609 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:08.609 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:08.609 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:08.609 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 12.216598269, 2023-08-27T11:27:08.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 92, 2023-08-27T11:27:08.610 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 96, 2023-08-27T11:27:08.610 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 96, 2023-08-27T11:27:08.610 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.426006440999998 2023-08-27T11:27:08.610 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 msgr2=0x7f027c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 0x7f027c06c5a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f029c14df60 tx=0x7f0284009210 comp rx=0 tx=0).stop 2023-08-27T11:27:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 msgr2=0x7f029c145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c730 tx=0x7f028c00ca40 comp rx=0 tx=0).stop 2023-08-27T11:27:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 shutdown_connections 2023-08-27T11:27:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f027c06a0e0 0x7f027c06c5a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f029c154740 0x7f029c140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f029c0c50d0 0x7f029c145b90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 --2- 172.21.15.43:0/3065710996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f029c14e960 0x7f029c13fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 >> 172.21.15.43:0/3065710996 conn(0x7f029c06aa50 msgr2=0x7f029c0a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 shutdown_connections 2023-08-27T11:27:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.582+0000 7f02a19ff700 1 -- 172.21.15.43:0/3065710996 wait complete. 2023-08-27T11:27:08.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.814+0000 7f3b103ff700 1 Processor -- start 2023-08-27T11:27:08.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.815+0000 7f3b103ff700 1 -- start start 2023-08-27T11:27:08.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b103ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b0806e360 0x7f3b0806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b103ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b08158190 0x7f3b0815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b103ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080c6820 con 0x7f3b0806a310 2023-08-27T11:27:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b103ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080c23a0 con 0x7f3b0806e360 2023-08-27T11:27:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b103ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081548c0 con 0x7f3b08158190 2023-08-27T11:27:08.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b0e99c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b08158190 0x7f3b0815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b0d99a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3b0806e360 0x7f3b0806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b0e19b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3b0806a310 0x7f3b08157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:46480/0 (socket says 172.21.15.43:46480) 2023-08-27T11:27:08.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.816+0000 7f3b0e19b700 1 -- 172.21.15.43:0/980719492 learned_addr learned my addr 172.21.15.43:0/980719492 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d99a700 1 -- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b08158190 msgr2=0x7f3b0815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:08.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d99a700 1 --2- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b08158190 0x7f3b0815ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d99a700 1 -- 172.21.15.43:0/980719492 >> v1:172.21.15.57:6789/0 conn(0x7f3b0806a310 legacy=0x7f3b08157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d99a700 1 -- 172.21.15.43:0/980719492 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080c4a50 con 0x7f3b0806e360 2023-08-27T11:27:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d99a700 1 --2- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b0806a6f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009840 tx=0x7f3af8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe7964afada9787 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d199700 1 -- 172.21.15.43:0/980719492 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011830 con 0x7f3b0806e360 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d199700 1 -- 172.21.15.43:0/980719492 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8011990 con 0x7f3b0806e360 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.817+0000 7f3b0d199700 1 -- 172.21.15.43:0/980719492 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8011d20 con 0x7f3b0806e360 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 -- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 msgr2=0x7f3b0806a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 --2- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b0806a6f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009840 tx=0x7f3af8009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 -- 172.21.15.43:0/980719492 shutdown_connections 2023-08-27T11:27:08.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 --2- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b08158190 0x7f3b0815ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 --2- 172.21.15.43:0/980719492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b0806a6f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 -- 172.21.15.43:0/980719492 >> 172.21.15.43:0/980719492 conn(0x7f3b080a85e0 msgr2=0x7f3b080a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 -- 172.21.15.43:0/980719492 shutdown_connections 2023-08-27T11:27:08.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.818+0000 7f3b103ff700 1 -- 172.21.15.43:0/980719492 wait complete. 2023-08-27T11:27:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.820+0000 7f3b103ff700 1 Processor -- start 2023-08-27T11:27:08.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.820+0000 7f3b103ff700 1 -- start start 2023-08-27T11:27:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0806a310 0x7f3b081ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b080a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08157a20 con 0x7f3b08158190 2023-08-27T11:27:08.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081e98c0 con 0x7f3b0806e360 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b103ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081edd80 con 0x7f3b0806a310 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b0e99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b0e99c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54204/0 (socket says 172.21.15.43:54204) 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b0e99c700 1 -- 172.21.15.43:0/433743130 learned_addr learned my addr 172.21.15.43:0/433743130 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b0e19b700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0806a310 0x7f3b081ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.821+0000 7f3b0d99a700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b080a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 -- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0806a310 msgr2=0x7f3b081ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0806a310 0x7f3b081ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 -- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 msgr2=0x7f3b080a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b080a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:08.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 -- 172.21.15.43:0/433743130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80094a0 con 0x7f3b08158190 2023-08-27T11:27:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b0e99c700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000efc0 tx=0x7f3b0000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ca70 con 0x7f3b08158190 2023-08-27T11:27:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0000f040 con 0x7f3b08158190 2023-08-27T11:27:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b080aa100 con 0x7f3b08158190 2023-08-27T11:27:08.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ce10 con 0x7f3b08158190 2023-08-27T11:27:08.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.822+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b081574d0 con 0x7f3b08158190 2023-08-27T11:27:08.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.823+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b081e9a30 con 0x7f3b08158190 2023-08-27T11:27:08.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.824+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b00014480 con 0x7f3b08158190 2023-08-27T11:27:08.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.825+0000 7f3afeffd700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 0x7f3aec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:08.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.825+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b00088d80 con 0x7f3b08158190 2023-08-27T11:27:08.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.825+0000 7f3b0e19b700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 0x7f3aec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:08.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.826+0000 7f3b0e19b700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 0x7f3aec06c5a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005910 tx=0x7f3b04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:08.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:08.830+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b081e9a30 con 0x7f3b08158190 2023-08-27T11:27:09.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.087+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b081e9a30 con 0x7f3b08158190 2023-08-27T11:27:09.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.087+0000 7f3afeffd700 1 -- 172.21.15.43:0/433743130 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4868 (secure 0 0 0) 0x7f3b081e9a30 con 0x7f3b08158190 2023-08-27T11:27:09.089 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:09.089 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:26:59.908755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/863801259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":863801259},{"type":"v1","addr":"172.21.15.43:6836","nonce":863801259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:09.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.089+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 msgr2=0x7f3aec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.089+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 0x7f3aec06c5a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005910 tx=0x7f3b04009040 comp rx=0 tx=0).stop 2023-08-27T11:27:09.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.089+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 msgr2=0x7f3b080bf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.089+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000efc0 tx=0x7f3b0000c0c0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 shutdown_connections 2023-08-27T11:27:09.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3aec06a0e0 0x7f3aec06c5a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3b08158190 0x7f3b080bf9b0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3b0806a310 0x7f3b081ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 --2- 172.21.15.43:0/433743130 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3b0806e360 0x7f3b080a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 >> 172.21.15.43:0/433743130 conn(0x7f3b080a85e0 msgr2=0x7f3b08153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:09.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 shutdown_connections 2023-08-27T11:27:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.090+0000 7f3b103ff700 1 -- 172.21.15.43:0/433743130 wait complete. 2023-08-27T11:27:09.094 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 92 2023-08-27T11:27:09.110 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 7, "epoch": 92, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 7, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:55.860033+0000", "damaged": [], "data_pools": [ 16 ], "enabled": true, "epoch": 92, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7083": { "addr": "172.21.15.43:6836/863801259", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 863801259, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 863801259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7083, "incarnation": 88, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 15, "modified": "2023-08-27T11:26:59.908755+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7083 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/3647973339", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 3647973339, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 3647973339, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6775, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/22508657", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 22508657, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 22508657, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6778, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1648653949", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1648653949, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1648653949, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7080, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:09.110 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:09.110 INFO:tasks.cephfs.test_failover:current = [{'gid': 7080, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1648653949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1648653949}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1648653949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 6778, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/22508657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 22508657}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 22508657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6775, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/3647973339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3647973339}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3647973339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}] 2023-08-27T11:27:09.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.c mds_join_fs cephfs 2023-08-27T11:27:09.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.314+0000 7fcc63bff700 1 Processor -- start 2023-08-27T11:27:09.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.314+0000 7fcc63bff700 1 -- start start 2023-08-27T11:27:09.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.315+0000 7fcc63bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc5c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.315+0000 7fcc63bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0c03e0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc63bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c151900 con 0x7fcc5c14e780 2023-08-27T11:27:09.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc63bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c151be0 con 0x7fcc5c0c5150 2023-08-27T11:27:09.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc6219c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcc5c14eb60 0x7fcc5c0c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36062/0 (socket says 172.21.15.43:36062) 2023-08-27T11:27:09.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc6219c700 1 -- 172.21.15.43:0/3263265691 learned_addr learned my addr 172.21.15.43:0/3263265691 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:09.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378064964 0 0) 0x7fcc5c0c03e0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc480057c0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc6119a700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc5c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2029480079 0 0) 0x7fcc480057c0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 msgr2=0x7fcc5c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc5c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 >> v1:172.21.15.57:6789/0 conn(0x7fcc5c14e780 legacy=0x7fcc5c06a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c151ec0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.316+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fcc540019f0 con 0x7fcc5c14eb60 2023-08-27T11:27:09.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 >> v1:172.21.15.43:6789/0 conn(0x7fcc5c14eb60 legacy=0x7fcc5c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc480060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc48006a60 0x7fcc48006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc480074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c151be0 con 0x7fcc48005cb0 2023-08-27T11:27:09.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800dde0 con 0x7fcc48006a60 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800dfa0 con 0x7fcc5c0c5150 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc480060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6119a700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc48006a60 0x7fcc48006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6219c700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc480074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 -- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 msgr2=0x7fcc480074d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:09.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c0c5150 0x7fcc480074d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 -- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc48006a60 msgr2=0x7fcc48006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc48006a60 0x7fcc48006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.317+0000 7fcc6199b700 1 -- 172.21.15.43:0/3263265691 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480057c0 con 0x7fcc48005cb0 2023-08-27T11:27:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc6199b700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc480060d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcc580017c0 tx=0x7fcc48007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b95f3d695219a3a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580052d0 con 0x7fcc48005cb0 2023-08-27T11:27:09.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58005430 con 0x7fcc48005cb0 2023-08-27T11:27:09.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc60999700 1 -- 172.21.15.43:0/3263265691 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580038c0 con 0x7fcc48005cb0 2023-08-27T11:27:09.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc63bff700 1 -- 172.21.15.43:0/3263265691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 msgr2=0x7fcc480060d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc63bff700 1 --2- 172.21.15.43:0/3263265691 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc480060d0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcc580017c0 tx=0x7fcc48007a90 comp rx=0 tx=0).stop 2023-08-27T11:27:09.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc6219c700 1 -- 172.21.15.43:0/3263265691 reap_dead start 2023-08-27T11:27:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc63bff700 1 -- 172.21.15.43:0/3263265691 shutdown_connections 2023-08-27T11:27:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.318+0000 7fcc63bff700 1 -- 172.21.15.43:0/3263265691 >> 172.21.15.43:0/3263265691 conn(0x7fcc5c0c5b10 msgr2=0x7fcc5c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.319+0000 7fcc63bff700 1 -- 172.21.15.43:0/3263265691 shutdown_connections 2023-08-27T11:27:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.319+0000 7fcc63bff700 1 -- 172.21.15.43:0/3263265691 wait complete. 2023-08-27T11:27:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.320+0000 7fcc63bff700 1 Processor -- start 2023-08-27T11:27:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.320+0000 7fcc63bff700 1 -- start start 2023-08-27T11:27:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c151150 0x7fcc5c14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc5c1d7430 0x7fcc5c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c14f1b0 con 0x7fcc48005cb0 2023-08-27T11:27:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c6020 con 0x7fcc5c1d7430 2023-08-27T11:27:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.321+0000 7fcc63bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0c6300 con 0x7fcc5c151150 2023-08-27T11:27:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54586/0 (socket says 172.21.15.43:54586) 2023-08-27T11:27:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 -- 172.21.15.43:0/1790209917 learned_addr learned my addr 172.21.15.43:0/1790209917 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6219c700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc5c1d7430 0x7fcc5c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6119a700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c151150 0x7fcc5c14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 -- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c151150 msgr2=0x7fcc5c14f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c151150 0x7fcc5c14f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 -- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc5c1d7430 msgr2=0x7fcc5c14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc5c1d7430 0x7fcc5c14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 -- 172.21.15.43:0/1790209917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0c4930 con 0x7fcc48005cb0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc6199b700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800ddb0 tx=0x7fcc58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.322+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58007240 con 0x7fcc48005cb0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.323+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc580073a0 con 0x7fcc48005cb0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.323+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0c4c10 con 0x7fcc48005cb0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.323+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58001290 con 0x7fcc48005cb0 2023-08-27T11:27:09.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.323+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c1500c0 con 0x7fcc48005cb0 2023-08-27T11:27:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.324+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c04ee70 con 0x7fcc48005cb0 2023-08-27T11:27:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.325+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc58003680 con 0x7fcc48005cb0 2023-08-27T11:27:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.325+0000 7fcc527fc700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 0x7fcc4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.326+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc58089440 con 0x7fcc48005cb0 2023-08-27T11:27:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.326+0000 7fcc6119a700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 0x7fcc4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.326+0000 7fcc6119a700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 0x7fcc4006c5a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0c6560 tx=0x7fcc4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.330+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcc58054b20 con 0x7fcc48005cb0 2023-08-27T11:27:09.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.539+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7fcc5c06a970 con 0x7fcc48005cb0 2023-08-27T11:27:09.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.543+0000 7fcc527fc700 1 -- 172.21.15.43:0/1790209917 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v34)=0 v34) v1 ==== 116+0+0 (secure 0 0 0) 0x7fcc58058140 con 0x7fcc48005cb0 2023-08-27T11:27:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 msgr2=0x7fcc4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 0x7fcc4006c5a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0c6560 tx=0x7fcc4c008040 comp rx=0 tx=0).stop 2023-08-27T11:27:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 msgr2=0x7fcc5c1d8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800ddb0 tx=0x7fcc58001120 comp rx=0 tx=0).stop 2023-08-27T11:27:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 shutdown_connections 2023-08-27T11:27:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc4006a0e0 0x7fcc4006c5a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc5c1d7430 0x7fcc5c14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc48005cb0 0x7fcc5c1d8e80 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 --2- 172.21.15.43:0/1790209917 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc5c151150 0x7fcc5c14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 >> 172.21.15.43:0/1790209917 conn(0x7fcc5c0c5b10 msgr2=0x7fcc5c14ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:09.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 shutdown_connections 2023-08-27T11:27:09.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.546+0000 7fcc63bff700 1 -- 172.21.15.43:0/1790209917 wait complete. 2023-08-27T11:27:09.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:09.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.766+0000 7fd5207ff700 1 Processor -- start 2023-08-27T11:27:09.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.766+0000 7fd5207ff700 1 -- start start 2023-08-27T11:27:09.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.767+0000 7fd5207ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5180c4a90 0x7fd51806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.767+0000 7fd5207ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51806c4e0 con 0x7fd5180c4630 2023-08-27T11:27:09.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.767+0000 7fd5207ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd518155370 con 0x7fd518151a90 2023-08-27T11:27:09.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.767+0000 7fd5207ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180c82c0 con 0x7fd5180c4a90 2023-08-27T11:27:09.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51dd9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd5180c4630 0x7fd51806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36066/0 (socket says 172.21.15.43:36066) 2023-08-27T11:27:09.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51dd9a700 1 -- 172.21.15.43:0/2199478762 learned_addr learned my addr 172.21.15.43:0/2199478762 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:09.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51ed9c700 1 --2- 172.21.15.43:0/2199478762 >> v2:172.21.15.43:3300/0 conn(0x7fd5180c4a90 0x7fd51806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51d599700 1 -- 172.21.15.43:0/2199478762 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566430571 0 0) 0x7fd51806c4e0 con 0x7fd5180c4630 2023-08-27T11:27:09.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51d599700 1 -- 172.21.15.43:0/2199478762 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5040035b0 con 0x7fd5180c4630 2023-08-27T11:27:09.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51ed9c700 1 -- 172.21.15.43:0/2199478762 >> v1:172.21.15.57:6789/0 conn(0x7fd518151a90 legacy=0x7fd5180c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51ed9c700 1 -- 172.21.15.43:0/2199478762 >> v1:172.21.15.43:6789/0 conn(0x7fd5180c4630 legacy=0x7fd51806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51ed9c700 1 -- 172.21.15.43:0/2199478762 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518151e70 con 0x7fd5180c4a90 2023-08-27T11:27:09.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.768+0000 7fd51ed9c700 1 --2- 172.21.15.43:0/2199478762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4a90 0x7fd51806b480 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd51000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3218f1fd42d26b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd51d599700 1 -- 172.21.15.43:0/2199478762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000e070 con 0x7fd5180c4a90 2023-08-27T11:27:09.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd51d599700 1 -- 172.21.15.43:0/2199478762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000bb20 con 0x7fd5180c4a90 2023-08-27T11:27:09.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd51d599700 1 -- 172.21.15.43:0/2199478762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510012430 con 0x7fd5180c4a90 2023-08-27T11:27:09.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 -- 172.21.15.43:0/2199478762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4a90 msgr2=0x7fd51806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2199478762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4a90 0x7fd51806b480 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fd510009d90 tx=0x7fd51000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:09.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 -- 172.21.15.43:0/2199478762 shutdown_connections 2023-08-27T11:27:09.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2199478762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4a90 0x7fd51806b480 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 -- 172.21.15.43:0/2199478762 >> 172.21.15.43:0/2199478762 conn(0x7fd5180ab820 msgr2=0x7fd5180abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:09.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 -- 172.21.15.43:0/2199478762 shutdown_connections 2023-08-27T11:27:09.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.769+0000 7fd5207ff700 1 -- 172.21.15.43:0/2199478762 wait complete. 2023-08-27T11:27:09.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.771+0000 7fd5207ff700 1 Processor -- start 2023-08-27T11:27:09.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.771+0000 7fd5207ff700 1 -- start start 2023-08-27T11:27:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 0x7fd518150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 0x7fd5181e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51814e3e0 con 0x7fd5180c4630 2023-08-27T11:27:09.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181edf10 con 0x7fd5180c4a90 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd5207ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181ed210 con 0x7fd518151a90 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd51e59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd51e59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54608/0 (socket says 172.21.15.43:54608) 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.772+0000 7fd51e59b700 1 -- 172.21.15.43:0/2289409948 learned_addr learned my addr 172.21.15.43:0/2289409948 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51dd9a700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 0x7fd518150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 -- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 msgr2=0x7fd5181e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51ed9c700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 0x7fd5181e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 0x7fd5181e9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 -- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 msgr2=0x7fd518150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 0x7fd518150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:09.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 -- 172.21.15.43:0/2289409948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009a70 con 0x7fd5180c4630 2023-08-27T11:27:09.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51dd9a700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 0x7fd518150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:09.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51ed9c700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 0x7fd5181e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:09.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd51e59b700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd51400c450 tx=0x7fd51400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140052d0 con 0x7fd5180c4630 2023-08-27T11:27:09.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514005430 con 0x7fd5180c4630 2023-08-27T11:27:09.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51814db60 con 0x7fd5180c4630 2023-08-27T11:27:09.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140038c0 con 0x7fd5180c4630 2023-08-27T11:27:09.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.773+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51814de20 con 0x7fd5180c4630 2023-08-27T11:27:09.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.774+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5181ed070 con 0x7fd5180c4630 2023-08-27T11:27:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.775+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd514003a20 con 0x7fd5180c4630 2023-08-27T11:27:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.776+0000 7fd50effd700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 0x7fd4fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.776+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5140879b0 con 0x7fd5180c4630 2023-08-27T11:27:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.777+0000 7fd51dd9a700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 0x7fd4fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.777+0000 7fd51dd9a700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 0x7fd4fc06c5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd5080011e0 tx=0x7fd508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:09.781+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd5181ed070 con 0x7fd5180c4630 2023-08-27T11:27:10.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.039+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5181ed070 con 0x7fd5180c4630 2023-08-27T11:27:10.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.040+0000 7fd50effd700 1 -- 172.21.15.43:0/2289409948 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4868 (secure 0 0 0) 0x7fd5181ed070 con 0x7fd5180c4630 2023-08-27T11:27:10.042 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:10.042 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:26:59.908755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6836/863801259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":863801259},{"type":"v1","addr":"172.21.15.43:6836","nonce":863801259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:10.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 msgr2=0x7fd4fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 0x7fd4fc06c5a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd5080011e0 tx=0x7fd508009040 comp rx=0 tx=0).stop 2023-08-27T11:27:10.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 msgr2=0x7fd5181ed9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fd51400c450 tx=0x7fd51400c810 comp rx=0 tx=0).stop 2023-08-27T11:27:10.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 shutdown_connections 2023-08-27T11:27:10.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd4fc06a0e0 0x7fd4fc06c5a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd518151a90 0x7fd5181e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5180c4630 0x7fd5181ed9d0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 --2- 172.21.15.43:0/2289409948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5180c4a90 0x7fd518150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 >> 172.21.15.43:0/2289409948 conn(0x7fd5180ab820 msgr2=0x7fd5180c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 shutdown_connections 2023-08-27T11:27:10.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.043+0000 7fd5207ff700 1 -- 172.21.15.43:0/2289409948 wait complete. 2023-08-27T11:27:10.047 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 92 2023-08-27T11:27:10.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:26:59.908755+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:10.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:10.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.667+0000 7fa6605ff700 1 Processor -- start 2023-08-27T11:27:10.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.667+0000 7fa6605ff700 1 -- start start 2023-08-27T11:27:10.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa6605ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa6580c4630 0x7fa6580c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa6605ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa65806ad70 0x7fa65806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa6605ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65806c4e0 con 0x7fa658151a90 2023-08-27T11:27:10.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa6605ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa658155370 con 0x7fa65806ad70 2023-08-27T11:27:10.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa6605ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6580c82c0 con 0x7fa6580c4630 2023-08-27T11:27:10.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa65806ad70 0x7fa65806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa65806ad70 0x7fa65806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54624/0 (socket says 172.21.15.43:54624) 2023-08-27T11:27:10.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1180614822 learned_addr learned my addr 172.21.15.43:0/1180614822 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65db9a700 1 --2- 172.21.15.43:0/1180614822 >> v2:172.21.15.57:3300/0 conn(0x7fa6580c4630 0x7fa6580c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1180614822 >> v2:172.21.15.57:3300/0 conn(0x7fa6580c4630 msgr2=0x7fa6580c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/1180614822 >> v2:172.21.15.57:3300/0 conn(0x7fa6580c4630 0x7fa6580c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1180614822 >> v1:172.21.15.57:6789/0 conn(0x7fa658151a90 legacy=0x7fa6580c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.669+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1180614822 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658151e70 con 0x7fa65806ad70 2023-08-27T11:27:10.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/1180614822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa65806ad70 0x7fa65806b200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa6580c7740 tx=0x7fa65000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5647aa8f1cffd96f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa65d399700 1 -- 172.21.15.43:0/1180614822 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000e070 con 0x7fa65806ad70 2023-08-27T11:27:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa65d399700 1 -- 172.21.15.43:0/1180614822 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65000b9c0 con 0x7fa65806ad70 2023-08-27T11:27:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa65d399700 1 -- 172.21.15.43:0/1180614822 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000bd70 con 0x7fa65806ad70 2023-08-27T11:27:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa6605ff700 1 -- 172.21.15.43:0/1180614822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa65806ad70 msgr2=0x7fa65806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.670+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1180614822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa65806ad70 0x7fa65806b200 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa6580c7740 tx=0x7fa65000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 -- 172.21.15.43:0/1180614822 shutdown_connections 2023-08-27T11:27:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1180614822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa65806ad70 0x7fa65806b200 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1180614822 >> v2:172.21.15.57:3300/0 conn(0x7fa6580c4630 0x7fa6580c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 -- 172.21.15.43:0/1180614822 >> 172.21.15.43:0/1180614822 conn(0x7fa6580ab820 msgr2=0x7fa6580abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 -- 172.21.15.43:0/1180614822 shutdown_connections 2023-08-27T11:27:10.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.671+0000 7fa6605ff700 1 -- 172.21.15.43:0/1180614822 wait complete. 2023-08-27T11:27:10.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.672+0000 7fa6605ff700 1 Processor -- start 2023-08-27T11:27:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.673+0000 7fa6605ff700 1 -- start start 2023-08-27T11:27:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.673+0000 7fa6605ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa65806ad70 0x7fa6580c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.673+0000 7fa6605ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 0x7fa6580c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa6605ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa6605ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581edb40 con 0x7fa658151a90 2023-08-27T11:27:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa6605ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580c1300 con 0x7fa6580c4630 2023-08-27T11:27:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa6605ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580c3d10 con 0x7fa65806ad70 2023-08-27T11:27:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54628/0 (socket says 172.21.15.43:54628) 2023-08-27T11:27:10.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1500502321 learned_addr learned my addr 172.21.15.43:0/1500502321 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65db9a700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 0x7fa6580c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65e39b700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa65806ad70 0x7fa6580c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa65806ad70 msgr2=0x7fa6580c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa65806ad70 0x7fa6580c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 msgr2=0x7fa6580c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 0x7fa6580c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65eb9c700 1 -- 172.21.15.43:0/1500502321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009b30 con 0x7fa658151a90 2023-08-27T11:27:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.674+0000 7fa65db9a700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 0x7fa6580c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa650004270 tx=0x7fa650004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa64effd700 1 -- 172.21.15.43:0/1500502321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500099b0 con 0x7fa658151a90 2023-08-27T11:27:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa64effd700 1 -- 172.21.15.43:0/1500502321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6500092e0 con 0x7fa658151a90 2023-08-27T11:27:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6581ecf00 con 0x7fa658151a90 2023-08-27T11:27:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa64effd700 1 -- 172.21.15.43:0/1500502321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65001c640 con 0x7fa658151a90 2023-08-27T11:27:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.675+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6581ed480 con 0x7fa658151a90 2023-08-27T11:27:10.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.677+0000 7fa64effd700 1 -- 172.21.15.43:0/1500502321 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa65001c7a0 con 0x7fa658151a90 2023-08-27T11:27:10.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.678+0000 7fa64effd700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 0x7fa63c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.678+0000 7fa64effd700 1 -- 172.21.15.43:0/1500502321 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa650089f50 con 0x7fa658151a90 2023-08-27T11:27:10.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.678+0000 7fa65e39b700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 0x7fa63c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.679+0000 7fa65e39b700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 0x7fa63c06c5a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa654000f60 tx=0x7fa654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.680+0000 7fa673fbbb80 1 Processor -- start 2023-08-27T11:27:10.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.680+0000 7fa673fbbb80 1 -- start start 2023-08-27T11:27:10.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda2401f00 0x55dda2424d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 0x55dda243a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda235f730 con 0x55dda2407fe0 2023-08-27T11:27:10.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda235d050 con 0x55dda24022e0 2023-08-27T11:27:10.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda2358940 con 0x55dda2401f00 2023-08-27T11:27:10.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54640/0 (socket says 172.21.15.43:54640) 2023-08-27T11:27:10.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 -- 172.21.15.43:0/4182139667 learned_addr learned my addr 172.21.15.43:0/4182139667 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 0x55dda243a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 -- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda2401f00 msgr2=0x55dda2424d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda2401f00 0x55dda2424d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 -- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 msgr2=0x55dda243a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 0x55dda243a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65db9a700 1 -- 172.21.15.43:0/4182139667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda21d85e0 con 0x55dda2407fe0 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.681+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 0x55dda243a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa65db9a700 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa648009b50 tx=0x7fa648009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb21d2c966a7de7b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa63bfff700 1 -- 172.21.15.43:0/4182139667 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648010b90 con 0x55dda2407fe0 2023-08-27T11:27:10.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa63bfff700 1 -- 172.21.15.43:0/4182139667 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800c050 con 0x55dda2407fe0 2023-08-27T11:27:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa63bfff700 1 -- 172.21.15.43:0/4182139667 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648015470 con 0x55dda2407fe0 2023-08-27T11:27:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa673fbbb80 1 -- 172.21.15.43:0/4182139667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 msgr2=0x55dda24252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.682+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa648009b50 tx=0x7fa648009e60 comp rx=0 tx=0).stop 2023-08-27T11:27:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 -- 172.21.15.43:0/4182139667 shutdown_connections 2023-08-27T11:27:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda24022e0 0x55dda243a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda2401f00 0x55dda2424d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/4182139667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2407fe0 0x55dda24252b0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 -- 172.21.15.43:0/4182139667 >> 172.21.15.43:0/4182139667 conn(0x55dda2364c30 msgr2=0x55dda24046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 -- 172.21.15.43:0/4182139667 shutdown_connections 2023-08-27T11:27:10.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 -- 172.21.15.43:0/4182139667 wait complete. 2023-08-27T11:27:10.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.683+0000 7fa673fbbb80 1 -- start start 2023-08-27T11:27:10.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.684+0000 7fa673fbbb80 1 Processor -- start 2023-08-27T11:27:10.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.685+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda242a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2442eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda22f6b60 con 0x55dda2401f00 2023-08-27T11:27:10.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda22f6860 con 0x55dda2429a50 2023-08-27T11:27:10.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda21da8d0 con 0x55dda24022e0 2023-08-27T11:27:10.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa673fbbb80 10 client.0 _ll_register_callbacks cb 0x55dda22f4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:10.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54648/0 (socket says 172.21.15.43:54648) 2023-08-27T11:27:10.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 -- 172.21.15.43:0/2706004412 learned_addr learned my addr 172.21.15.43:0/2706004412 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65db9a700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda242a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2442eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 -- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 msgr2=0x55dda242a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda242a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 -- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 msgr2=0x55dda2442eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2442eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.686+0000 7fa65e39b700 1 -- 172.21.15.43:0/2706004412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa648009780 con 0x55dda2401f00 2023-08-27T11:27:10.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa654003990 tx=0x7fa654003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da8ceeab4afda12 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa6397fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:10.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540050d0 con 0x55dda2401f00 2023-08-27T11:27:10.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dda23f94f0 con 0x55dda2401f00 2023-08-27T11:27:10.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa65401fb10 con 0x55dda2401f00 2023-08-27T11:27:10.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6540152e0 con 0x55dda2401f00 2023-08-27T11:27:10.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa673fbbb80 10 client.7314 fetch_fsmap learned FSMap version 92 2023-08-27T11:27:10.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55dda2370750 con 0x55dda2401f00 2023-08-27T11:27:10.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.687+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dda23f94f0 con 0x55dda2401f00 2023-08-27T11:27:10.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa65401fcd0 con 0x55dda2401f00 2023-08-27T11:27:10.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 10 client.7314 fetch_fsmap finished waiting for FSMap version 92 2023-08-27T11:27:10.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 10 client.7314 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:10.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 20 client.7314 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:10.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda24520f0 0x55dda24524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 4 client.7314 mds_command: new command op to 7083 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:10.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dda2351920 con 0x55dda24520f0 2023-08-27T11:27:10.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa65db9a700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda24520f0 0x55dda24524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa6397fa700 10 client.7314 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:10.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.688+0000 7fa65db9a700 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda24520f0 0x55dda24524d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc7d0a72789199a server_cookie=faed61c001a89d5 in_seq=0 out_seq=0 2023-08-27T11:27:10.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa6397fa700 1 -- 172.21.15.43:0/2706004412 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dda2351920 con 0x55dda24520f0 2023-08-27T11:27:10.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa6397fa700 10 client.7314 handle_command_reply: tid=0 2023-08-27T11:27:10.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa673fbbb80 1 client.7314 shutdown 2023-08-27T11:27:10.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 msgr2=0x55dda242b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.689+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa654003990 tx=0x7fa654003ca0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 shutdown_connections 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda24520f0 0x55dda24524d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2442eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242b840 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2706004412 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda242a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa6397fa700 0 client.7314 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:10.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 >> 172.21.15.43:0/2706004412 conn(0x55dda2364c30 msgr2=0x55dda2406160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 shutdown_connections 2023-08-27T11:27:10.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2706004412 wait complete. 2023-08-27T11:27:10.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.690+0000 7fa673fbbb80 20 client.7314 trim_cache size 0 max 16384 2023-08-27T11:27:10.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.708+0000 7fa673fbbb80 1 Processor -- start 2023-08-27T11:27:10.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.708+0000 7fa673fbbb80 1 -- start start 2023-08-27T11:27:10.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda2455760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda243bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda23e3560 con 0x55dda2401f00 2023-08-27T11:27:10.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda2445fa0 con 0x55dda2429a50 2023-08-27T11:27:10.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda24417e0 con 0x55dda24022e0 2023-08-27T11:27:10.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa65e39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa65e39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54652/0 (socket says 172.21.15.43:54652) 2023-08-27T11:27:10.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.709+0000 7fa65e39b700 1 -- 172.21.15.43:0/2221331783 learned_addr learned my addr 172.21.15.43:0/2221331783 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 -- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 msgr2=0x55dda2455760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda2455760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 -- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 msgr2=0x55dda243bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda243bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda243bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 -- 172.21.15.43:0/2221331783 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda2402b60 con 0x55dda2401f00 2023-08-27T11:27:10.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda243bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:10.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa654000fb0 tx=0x7fa65401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2c907aa8d425dd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa64cbff700 1 -- 172.21.15.43:0/2221331783 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654032030 con 0x55dda2401f00 2023-08-27T11:27:10.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa64cbff700 1 -- 172.21.15.43:0/2221331783 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654005070 con 0x55dda2401f00 2023-08-27T11:27:10.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.710+0000 7fa64cbff700 1 -- 172.21.15.43:0/2221331783 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654016d70 con 0x55dda2401f00 2023-08-27T11:27:10.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2221331783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 msgr2=0x55dda242a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa654000fb0 tx=0x7fa65401d000 comp rx=0 tx=0).stop 2023-08-27T11:27:10.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2221331783 shutdown_connections 2023-08-27T11:27:10.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda243bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda2401f00 0x55dda242a620 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2221331783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda2455760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2221331783 >> 172.21.15.43:0/2221331783 conn(0x55dda2364c30 msgr2=0x55dda23fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2221331783 shutdown_connections 2023-08-27T11:27:10.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.711+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2221331783 wait complete. 2023-08-27T11:27:10.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.712+0000 7fa673fbbb80 1 -- start start 2023-08-27T11:27:10.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.712+0000 7fa673fbbb80 1 Processor -- start 2023-08-27T11:27:10.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda24a7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2441a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda2442310 con 0x55dda24524d0 2023-08-27T11:27:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda2453420 con 0x55dda2429a50 2023-08-27T11:27:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda24ae180 con 0x55dda24022e0 2023-08-27T11:27:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa673fbbb80 10 client.0 _ll_register_callbacks cb 0x55dda22f4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54660/0 (socket says 172.21.15.43:54660) 2023-08-27T11:27:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 -- 172.21.15.43:0/2280951263 learned_addr learned my addr 172.21.15.43:0/2280951263 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda24a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65db9a700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2441a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 -- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 msgr2=0x55dda24a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda24a7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 -- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 msgr2=0x55dda2441a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:10.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2441a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.713+0000 7fa65eb9c700 1 -- 172.21.15.43:0/2280951263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dda2370750 con 0x55dda24524d0 2023-08-27T11:27:10.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa65eb9c700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa65000bea0 tx=0x7fa650059a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed2502d07d3dd84 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:10.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6500589e0 con 0x55dda24524d0 2023-08-27T11:27:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa650061000 con 0x55dda24524d0 2023-08-27T11:27:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa64800c050 con 0x55dda24524d0 2023-08-27T11:27:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa650060b70 con 0x55dda24524d0 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 10 client.7320 fetch_fsmap learned FSMap version 92 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) v3 -- 0x55dda2184d90 con 0x55dda24524d0 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800c050 con 0x55dda24524d0 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 92) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa6500701d0 con 0x55dda24524d0 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 10 client.7320 fetch_fsmap finished waiting for FSMap version 92 2023-08-27T11:27:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 10 client.7320 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 20 client.7320 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda23ffb60 0x55dda23fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 4 client.7320 mds_command: new command op to 7083 tid=0[{"prefix": "status"}] 2023-08-27T11:27:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.714+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dda2312000 con 0x55dda23ffb60 2023-08-27T11:27:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda23ffb60 0x55dda23fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa65e39b700 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda23ffb60 0x55dda23fff40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db605101b38cf2 server_cookie=8d47c5dd1101a558 in_seq=0 out_seq=0 2023-08-27T11:27:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa6397fa700 10 client.7320 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa6397fa700 1 -- 172.21.15.43:0/2280951263 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55dda2312000 con 0x55dda23ffb60 2023-08-27T11:27:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa6397fa700 10 client.7320 handle_command_reply: tid=0 2023-08-27T11:27:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.715+0000 7fa673fbbb80 1 client.7320 shutdown 2023-08-27T11:27:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 msgr2=0x55dda243bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa65000bea0 tx=0x7fa650059a40 comp rx=0 tx=0).stop 2023-08-27T11:27:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 shutdown_connections 2023-08-27T11:27:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dda24524d0 0x55dda243bd20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dda24022e0 0x55dda24a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55dda23ffb60 0x55dda23fff40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 --2- 172.21.15.43:0/2280951263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dda2429a50 0x55dda2441a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa6397fa700 0 client.7320 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:10.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 >> 172.21.15.43:0/2280951263 conn(0x55dda2364c30 msgr2=0x55dda2405dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 shutdown_connections 2023-08-27T11:27:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 1 -- 172.21.15.43:0/2280951263 wait complete. 2023-08-27T11:27:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa673fbbb80 20 client.7320 trim_cache size 0 max 16384 2023-08-27T11:27:10.733 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7083, 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:10.734 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:10.735 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 14.352014885999999, 2023-08-27T11:27:10.735 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 92, 2023-08-27T11:27:10.735 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 96, 2023-08-27T11:27:10.735 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 96, 2023-08-27T11:27:10.735 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 20.561423747999999 2023-08-27T11:27:10.736 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 msgr2=0x7fa63c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 0x7fa63c06c5a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa654000f60 tx=0x7fa654009040 comp rx=0 tx=0).stop 2023-08-27T11:27:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 msgr2=0x7fa6580c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.716+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa650004270 tx=0x7fa650004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 shutdown_connections 2023-08-27T11:27:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa63c06a0e0 0x7fa63c06c5a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa658151a90 0x7fa6580c37d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa65806ad70 0x7fa6580c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 --2- 172.21.15.43:0/1500502321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6580c4630 0x7fa6580c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 >> 172.21.15.43:0/1500502321 conn(0x7fa6580ab820 msgr2=0x7fa65814f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 shutdown_connections 2023-08-27T11:27:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:10.717+0000 7fa6605ff700 1 -- 172.21.15.43:0/1500502321 wait complete. 2023-08-27T11:27:10.740 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 7, "epoch": 92, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 7, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:55.860033+0000", "damaged": [], "data_pools": [ 16 ], "enabled": true, "epoch": 92, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7083": { "addr": "172.21.15.43:6836/863801259", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 863801259, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 863801259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7083, "incarnation": 88, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 15, "modified": "2023-08-27T11:26:59.908755+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7083 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/3647973339", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 3647973339, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 3647973339, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6775, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/22508657", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 22508657, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 22508657, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6778, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1648653949", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1648653949, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1648653949, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7080, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:10.741 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 7, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:10.741 INFO:tasks.cephfs.test_failover:current = [{'gid': 7080, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1648653949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1648653949}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1648653949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 6778, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/22508657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 22508657}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 22508657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6775, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/3647973339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3647973339}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3647973339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}] 2023-08-27T11:27:10.742 DEBUG:tasks.cephfs.test_failover:7 != -1 2023-08-27T11:27:10.742 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:27:11.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:27:11.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:27:15.744 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:15.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.954+0000 7fe40bdff700 1 Processor -- start 2023-08-27T11:27:15.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.954+0000 7fe40bdff700 1 -- start start 2023-08-27T11:27:15.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.955+0000 7fe40bdff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe404151a90 0x7fe4040c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40bdff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4040c4a90 0x7fe40406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40bdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40406c4e0 con 0x7fe4040c4630 2023-08-27T11:27:15.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40bdff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe404155370 con 0x7fe4040c4a90 2023-08-27T11:27:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40bdff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe404151e70 con 0x7fe404151a90 2023-08-27T11:27:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4040c4a90 0x7fe40406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe4040c4a90 0x7fe40406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54662/0 (socket says 172.21.15.43:54662) 2023-08-27T11:27:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 -- 172.21.15.43:0/285054040 learned_addr learned my addr 172.21.15.43:0/285054040 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe409b9b700 1 --2- 172.21.15.43:0/285054040 >> v2:172.21.15.57:3300/0 conn(0x7fe404151a90 0x7fe4040c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:15.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 -- 172.21.15.43:0/285054040 >> v2:172.21.15.57:3300/0 conn(0x7fe404151a90 msgr2=0x7fe4040c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:15.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 --2- 172.21.15.43:0/285054040 >> v2:172.21.15.57:3300/0 conn(0x7fe404151a90 0x7fe4040c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:15.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 -- 172.21.15.43:0/285054040 >> v1:172.21.15.57:6789/0 conn(0x7fe4040c4630 legacy=0x7fe40406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:15.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.956+0000 7fe40a39c700 1 -- 172.21.15.43:0/285054040 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404154480 con 0x7fe4040c4a90 2023-08-27T11:27:15.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40a39c700 1 --2- 172.21.15.43:0/285054040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4040c4a90 0x7fe40406b480 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe404067710 tx=0x7fe3fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96dffc063ae3a8a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:15.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe408b99700 1 -- 172.21.15.43:0/285054040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc00e070 con 0x7fe4040c4a90 2023-08-27T11:27:15.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe408b99700 1 -- 172.21.15.43:0/285054040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc00b9c0 con 0x7fe4040c4a90 2023-08-27T11:27:15.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe408b99700 1 -- 172.21.15.43:0/285054040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc00bd70 con 0x7fe4040c4a90 2023-08-27T11:27:15.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 -- 172.21.15.43:0/285054040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4040c4a90 msgr2=0x7fe40406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:15.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 --2- 172.21.15.43:0/285054040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4040c4a90 0x7fe40406b480 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fe404067710 tx=0x7fe3fc00b330 comp rx=0 tx=0).stop 2023-08-27T11:27:15.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 -- 172.21.15.43:0/285054040 shutdown_connections 2023-08-27T11:27:15.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 --2- 172.21.15.43:0/285054040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4040c4a90 0x7fe40406b480 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:15.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 --2- 172.21.15.43:0/285054040 >> v2:172.21.15.57:3300/0 conn(0x7fe404151a90 0x7fe4040c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:15.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 -- 172.21.15.43:0/285054040 >> 172.21.15.43:0/285054040 conn(0x7fe4040ab820 msgr2=0x7fe4040abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 -- 172.21.15.43:0/285054040 shutdown_connections 2023-08-27T11:27:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.957+0000 7fe40bdff700 1 -- 172.21.15.43:0/285054040 wait complete. 2023-08-27T11:27:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.959+0000 7fe40bdff700 1 Processor -- start 2023-08-27T11:27:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.959+0000 7fe40bdff700 1 -- start start 2023-08-27T11:27:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040c4630 0x7fe404156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4040c4a90 0x7fe4041ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe404155f80 con 0x7fe404151a90 2023-08-27T11:27:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4041ea620 con 0x7fe4040c4630 2023-08-27T11:27:15.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40bdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe404152240 con 0x7fe4040c4a90 2023-08-27T11:27:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40a39c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40a39c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54674/0 (socket says 172.21.15.43:54674) 2023-08-27T11:27:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.960+0000 7fe40a39c700 1 -- 172.21.15.43:0/389000921 learned_addr learned my addr 172.21.15.43:0/389000921 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40939a700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4040c4a90 0x7fe4041ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:15.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 -- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4040c4a90 msgr2=0x7fe4041ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4040c4a90 0x7fe4041ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 -- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040c4630 msgr2=0x7fe404156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040c4630 0x7fe404156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 -- 172.21.15.43:0/389000921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc009b30 con 0x7fe404151a90 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40a39c700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00b730 tx=0x7fe3fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:15.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc0099b0 con 0x7fe404151a90 2023-08-27T11:27:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc0092e0 con 0x7fe404151a90 2023-08-27T11:27:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc01c640 con 0x7fe404151a90 2023-08-27T11:27:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.961+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe404152520 con 0x7fe404151a90 2023-08-27T11:27:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.962+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe404153af0 con 0x7fe404151a90 2023-08-27T11:27:15.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.963+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40404ee70 con 0x7fe404151a90 2023-08-27T11:27:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.964+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe3fc01c7a0 con 0x7fe404151a90 2023-08-27T11:27:15.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.965+0000 7fe3fa7fc700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 0x7fe3e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:15.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.965+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3fc089ef0 con 0x7fe404151a90 2023-08-27T11:27:15.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.965+0000 7fe409b9b700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 0x7fe3e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:15.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.966+0000 7fe409b9b700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 0x7fe3e806c5a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098d0 tx=0x7fe400008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:15.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:15.970+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe3fc0555e0 con 0x7fe404151a90 2023-08-27T11:27:16.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.223+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe40406c130 con 0x7fe404151a90 2023-08-27T11:27:16.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.224+0000 7fe3fa7fc700 1 -- 172.21.15.43:0/389000921 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4867 (secure 0 0 0) 0x7fe3fc058c00 con 0x7fe404151a90 2023-08-27T11:27:16.226 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:16.226 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7080,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:12.952474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7083},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7083":{"gid":7083,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6836/863801259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":863801259},{"type":"v1","addr":"172.21.15.43:6836","nonce":863801259}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:16.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 msgr2=0x7fe3e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 0x7fe3e806c5a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098d0 tx=0x7fe400008040 comp rx=0 tx=0).stop 2023-08-27T11:27:16.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 msgr2=0x7fe4040aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00b730 tx=0x7fe3fc004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 shutdown_connections 2023-08-27T11:27:16.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe3e806a0e0 0x7fe3e806c5a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe404151a90 0x7fe4040aae70 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4040c4630 0x7fe404156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.226+0000 7fe40bdff700 1 --2- 172.21.15.43:0/389000921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4040c4a90 0x7fe4041ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.227+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 >> 172.21.15.43:0/389000921 conn(0x7fe4040ab820 msgr2=0x7fe40414e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.227+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 shutdown_connections 2023-08-27T11:27:16.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.227+0000 7fe40bdff700 1 -- 172.21.15.43:0/389000921 wait complete. 2023-08-27T11:27:16.231 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 93 2023-08-27T11:27:16.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:27:12.952474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7083}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7083': {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': 7, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:16.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:16.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:16.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.856+0000 7f1a7c5ff700 1 Processor -- start 2023-08-27T11:27:16.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.857+0000 7f1a7c5ff700 1 -- start start 2023-08-27T11:27:16.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a74151a90 0x7f1a740c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7c5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7406c4e0 con 0x7f1a740c4a90 2023-08-27T11:27:16.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a74155370 con 0x7f1a740c4630 2023-08-27T11:27:16.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a74151e70 con 0x7f1a74151a90 2023-08-27T11:27:16.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1a74151a90 0x7f1a740c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7ab9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1a740c4a90 0x7f1a7406b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36076/0 (socket says 172.21.15.43:36076) 2023-08-27T11:27:16.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.858+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3997659451 learned_addr learned my addr 172.21.15.43:0/3997659451 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:16.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a7a39b700 1 -- 172.21.15.43:0/3997659451 >> v1:172.21.15.57:6789/0 conn(0x7f1a740c4630 legacy=0x7f1a7406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a7a39b700 1 -- 172.21.15.43:0/3997659451 >> v1:172.21.15.43:6789/0 conn(0x7f1a740c4a90 legacy=0x7f1a7406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a7a39b700 1 -- 172.21.15.43:0/3997659451 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74154480 con 0x7f1a74151a90 2023-08-27T11:27:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3997659451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a740c7bb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009840 tx=0x7f1a70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffd6343e90df3e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a79399700 1 -- 172.21.15.43:0/3997659451 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011830 con 0x7f1a74151a90 2023-08-27T11:27:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a79399700 1 -- 172.21.15.43:0/3997659451 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70011990 con 0x7f1a74151a90 2023-08-27T11:27:16.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.859+0000 7f1a79399700 1 -- 172.21.15.43:0/3997659451 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011d20 con 0x7f1a74151a90 2023-08-27T11:27:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3997659451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 msgr2=0x7f1a740c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3997659451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a740c7bb0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009840 tx=0x7f1a70009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3997659451 shutdown_connections 2023-08-27T11:27:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3997659451 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a740c7bb0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3997659451 >> 172.21.15.43:0/3997659451 conn(0x7f1a740ab820 msgr2=0x7f1a740abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3997659451 shutdown_connections 2023-08-27T11:27:16.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.860+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3997659451 wait complete. 2023-08-27T11:27:16.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.861+0000 7f1a7c5ff700 1 Processor -- start 2023-08-27T11:27:16.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.862+0000 7f1a7c5ff700 1 -- start start 2023-08-27T11:27:16.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.862+0000 7f1a7c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740c4630 0x7f1a740aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.862+0000 7f1a7c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a740c4a90 0x7f1a7414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741e98b0 con 0x7f1a74151a90 2023-08-27T11:27:16.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7414db80 con 0x7f1a740c4630 2023-08-27T11:27:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a741ed9d0 con 0x7f1a740c4a90 2023-08-27T11:27:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54694/0 (socket says 172.21.15.43:54694) 2023-08-27T11:27:16.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3074360741 learned_addr learned my addr 172.21.15.43:0/3074360741 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740c4630 0x7f1a740aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a740c4a90 0x7f1a7414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a740c4a90 msgr2=0x7f1a7414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a740c4a90 0x7f1a7414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740c4630 msgr2=0x7f1a740aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740c4630 0x7f1a740aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.863+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3074360741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700094a0 con 0x7f1a74151a90 2023-08-27T11:27:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00cbc0 tx=0x7f1a6c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a6affd700 1 -- 172.21.15.43:0/3074360741 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00a980 con 0x7f1a74151a90 2023-08-27T11:27:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a6affd700 1 -- 172.21.15.43:0/3074360741 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00aae0 con 0x7f1a74151a90 2023-08-27T11:27:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a6affd700 1 -- 172.21.15.43:0/3074360741 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00ae50 con 0x7f1a74151a90 2023-08-27T11:27:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740c2870 con 0x7f1a74151a90 2023-08-27T11:27:16.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.864+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740c0e20 con 0x7f1a74151a90 2023-08-27T11:27:16.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.866+0000 7f1a6affd700 1 -- 172.21.15.43:0/3074360741 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1a6c01b3b0 con 0x7f1a74151a90 2023-08-27T11:27:16.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.867+0000 7f1a6affd700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 0x7f1a5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.867+0000 7f1a6affd700 1 -- 172.21.15.43:0/3074360741 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a6c088060 con 0x7f1a74151a90 2023-08-27T11:27:16.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.867+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 0x7f1a5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.868+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 0x7f1a5806c5a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a700090b0 tx=0x7f1a70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.869+0000 7f1a8ffd9b80 1 Processor -- start 2023-08-27T11:27:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.869+0000 7f1a8ffd9b80 1 -- start start 2023-08-27T11:27:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x557759ff5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd8fe0 0x557759ff62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759f30730 con 0x557759fd32e0 2023-08-27T11:27:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759f2e050 con 0x557759fd8fe0 2023-08-27T11:27:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x557759f29940 con 0x557759fd2f00 2023-08-27T11:27:16.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54698/0 (socket says 172.21.15.43:54698) 2023-08-27T11:27:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3393397757 learned_addr learned my addr 172.21.15.43:0/3393397757 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd8fe0 0x557759ff62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x557759ff5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 msgr2=0x557759ff5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x557759ff5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd8fe0 msgr2=0x557759ff62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd8fe0 0x557759ff62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3393397757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557759da95e0 con 0x557759fd32e0 2023-08-27T11:27:16.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.870+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x557759ff5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:16.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c05eb50 tx=0x7f1a6c05b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a1c282df4c9d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a57fff700 1 -- 172.21.15.43:0/3393397757 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c086560 con 0x557759fd32e0 2023-08-27T11:27:16.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a57fff700 1 -- 172.21.15.43:0/3393397757 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c05ebf0 con 0x557759fd32e0 2023-08-27T11:27:16.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a57fff700 1 -- 172.21.15.43:0/3393397757 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c053210 con 0x557759fd32e0 2023-08-27T11:27:16.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3393397757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 msgr2=0x55775a00b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.871+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c05eb50 tx=0x7f1a6c05b1b0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3393397757 shutdown_connections 2023-08-27T11:27:16.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x55775a00b500 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x557759ff5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3393397757 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd8fe0 0x557759ff62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3393397757 >> 172.21.15.43:0/3393397757 conn(0x557759f35c30 msgr2=0x557759fd56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3393397757 shutdown_connections 2023-08-27T11:27:16.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3393397757 wait complete. 2023-08-27T11:27:16.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.872+0000 7f1a8ffd9b80 1 -- start start 2023-08-27T11:27:16.886 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.873+0000 7f1a8ffd9b80 1 Processor -- start 2023-08-27T11:27:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.873+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x55775a013eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 0x557759ff78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759ec7b60 con 0x557759ff7e00 2023-08-27T11:27:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759ec7860 con 0x557759fd32e0 2023-08-27T11:27:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x557759dab8d0 con 0x557759fd2f00 2023-08-27T11:27:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a8ffd9b80 10 client.0 _ll_register_callbacks cb 0x557759ec5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54712/0 (socket says 172.21.15.43:54712) 2023-08-27T11:27:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3154751181 learned_addr learned my addr 172.21.15.43:0/3154751181 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:16.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 0x557759ff78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x55775a013eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 msgr2=0x55775a013eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x55775a013eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 msgr2=0x557759ff78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 0x557759ff78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 -- 172.21.15.43:0/3154751181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740c0e20 con 0x557759ff7e00 2023-08-27T11:27:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 0x557759ff78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0570d0 tx=0x7f1a6c0012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b96d6c60987dc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.874+0000 7f1a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c072070 con 0x557759ff7e00 2023-08-27T11:27:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557759fca4f0 con 0x557759ff7e00 2023-08-27T11:27:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a6c05ed60 con 0x557759ff7e00 2023-08-27T11:27:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a6c085070 con 0x557759ff7e00 2023-08-27T11:27:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 10 client.7341 fetch_fsmap learned FSMap version 93 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x557759f41750 con 0x557759ff7e00 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c079070 con 0x557759ff7e00 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a6c075030 con 0x557759ff7e00 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 10 client.7341 fetch_fsmap finished waiting for FSMap version 93 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 10 client.7341 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 20 client.7341 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:16.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55775a026740 0x55775a026b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 4 client.7341 mds_command: new command op to 7083 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:16.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557759f22920 con 0x55775a026740 2023-08-27T11:27:16.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.875+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55775a026740 0x55775a026b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.876+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55775a026740 0x55775a026b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe49770d1934e17 server_cookie=905a119fd112a6c in_seq=0 out_seq=0 2023-08-27T11:27:16.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.876+0000 7f1a557fa700 10 client.7341 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:16.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a557fa700 1 -- 172.21.15.43:0/3154751181 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557759f22920 con 0x55775a026740 2023-08-27T11:27:16.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a557fa700 10 client.7341 handle_command_reply: tid=0 2023-08-27T11:27:16.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 client.7341 shutdown 2023-08-27T11:27:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 msgr2=0x557759ffc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0570d0 tx=0x7f1a6c0012c0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 shutdown_connections 2023-08-27T11:27:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759ff7e00 0x557759ffc2c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd2f00 0x55775a013eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x55775a026740 0x55775a026b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/3154751181 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd32e0 0x557759ff78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 >> 172.21.15.43:0/3154751181 conn(0x557759f35c30 msgr2=0x557759fd0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a557fa700 0 client.7341 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:16.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 shutdown_connections 2023-08-27T11:27:16.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/3154751181 wait complete. 2023-08-27T11:27:16.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.877+0000 7f1a8ffd9b80 20 client.7341 trim_cache size 0 max 16384 2023-08-27T11:27:16.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.896+0000 7f1a8ffd9b80 1 Processor -- start 2023-08-27T11:27:16.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.896+0000 7f1a8ffd9b80 1 -- start start 2023-08-27T11:27:16.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd32e0 0x55775a00be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 0x55775a00c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759f22920 con 0x557759fd2f00 2023-08-27T11:27:16.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x557759ffc2a0 con 0x557759ff7e00 2023-08-27T11:27:16.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x557759ff2880 con 0x557759fd32e0 2023-08-27T11:27:16.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a7a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a7a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54718/0 (socket says 172.21.15.43:54718) 2023-08-27T11:27:16.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.897+0000 7f1a7a39b700 1 -- 172.21.15.43:0/2165980720 learned_addr learned my addr 172.21.15.43:0/2165980720 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 0x55775a00c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd32e0 0x55775a00be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 -- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd32e0 msgr2=0x55775a00be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd32e0 0x55775a00be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 -- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 msgr2=0x55775a00c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 0x55775a00c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 -- 172.21.15.43:0/2165980720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557759d55d90 con 0x557759fd2f00 2023-08-27T11:27:16.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7ab9c700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 0x55775a00c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:16.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009f50 tx=0x7f1a70010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b5f6c125dfc449 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a68bff700 1 -- 172.21.15.43:0/2165980720 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7002b040 con 0x557759fd2f00 2023-08-27T11:27:16.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a68bff700 1 -- 172.21.15.43:0/2165980720 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7002c040 con 0x557759fd2f00 2023-08-27T11:27:16.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.898+0000 7f1a68bff700 1 -- 172.21.15.43:0/2165980720 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70020070 con 0x557759fd2f00 2023-08-27T11:27:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/2165980720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 msgr2=0x557759fd0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009f50 tx=0x7f1a70010000 comp rx=0 tx=0).stop 2023-08-27T11:27:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/2165980720 shutdown_connections 2023-08-27T11:27:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759ff7e00 0x55775a00c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd2f00 0x557759fd0b60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/2165980720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759fd32e0 0x55775a00be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/2165980720 >> 172.21.15.43:0/2165980720 conn(0x557759f35c30 msgr2=0x557759fce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/2165980720 shutdown_connections 2023-08-27T11:27:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.899+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/2165980720 wait complete. 2023-08-27T11:27:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.900+0000 7f1a8ffd9b80 1 -- start start 2023-08-27T11:27:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.900+0000 7f1a8ffd9b80 1 Processor -- start 2023-08-27T11:27:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 0x557759ff18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759ff7e00 0x557759ff8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775a011f00 con 0x557759fd32e0 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775a07f040 con 0x557759fd2f00 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x557759fd7970 con 0x557759ff7e00 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a8ffd9b80 10 client.0 _ll_register_callbacks cb 0x557759fd6780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54726/0 (socket says 172.21.15.43:54726) 2023-08-27T11:27:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 -- 172.21.15.43:0/1008780915 learned_addr learned my addr 172.21.15.43:0/1008780915 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:16.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 -- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759ff7e00 msgr2=0x557759ff8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759ff7e00 0x557759ff8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 0x557759ff18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.901+0000 7f1a79b9a700 1 -- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 msgr2=0x557759ff18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:16.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 0x557759ff18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a79b9a700 1 -- 172.21.15.43:0/1008780915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a74154480 con 0x557759fd32e0 2023-08-27T11:27:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 0x557759ff18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a79b9a700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1a64000f60 tx=0x7f1a640015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef841c71d6e9930 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64003ea0 con 0x557759fd32e0 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a64001cc0 con 0x557759fd32e0 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a6c05ebf0 con 0x557759fd32e0 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a64016450 con 0x557759fd32e0 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a8ffd9b80 10 client.7347 fetch_fsmap learned FSMap version 93 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x557759d3ec10 con 0x557759fd32e0 2023-08-27T11:27:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c05ebf0 con 0x557759fd32e0 2023-08-27T11:27:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1a640165b0 con 0x557759fd32e0 2023-08-27T11:27:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a8ffd9b80 10 client.7347 fetch_fsmap finished waiting for FSMap version 93 2023-08-27T11:27:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.902+0000 7f1a8ffd9b80 10 client.7347 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a8ffd9b80 20 client.7347 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x557759ff9110 0x557759ff94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a8ffd9b80 4 client.7347 mds_command: new command op to 7083 tid=0[{"prefix": "status"}] 2023-08-27T11:27:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 --> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557759ee3000 con 0x557759ff9110 2023-08-27T11:27:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x557759ff9110 0x557759ff94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a7a39b700 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x557759ff9110 0x557759ff94f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1cf92055dbc6dcb server_cookie=8ec608811b9ad648 in_seq=0 out_seq=0 2023-08-27T11:27:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a557fa700 10 client.7347 ms_handle_connect on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:16.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a557fa700 1 -- 172.21.15.43:0/1008780915 <== mds.0 v2:172.21.15.43:6835/863801259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557759ee3000 con 0x557759ff9110 2023-08-27T11:27:16.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a557fa700 10 client.7347 handle_command_reply: tid=0 2023-08-27T11:27:16.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.903+0000 7f1a8ffd9b80 1 client.7347 shutdown 2023-08-27T11:27:16.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 msgr2=0x557759fd6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1a64000f60 tx=0x7f1a640015a0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 shutdown_connections 2023-08-27T11:27:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x557759ff7e00 0x557759ff8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:6835/863801259,v1:172.21.15.43:6836/863801259] conn(0x557759ff9110 0x557759ff94f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x557759fd2f00 0x557759ff18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 --2- 172.21.15.43:0/1008780915 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557759fd32e0 0x557759fd6dd0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 >> 172.21.15.43:0/1008780915 conn(0x557759f35c30 msgr2=0x55775a0173e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a557fa700 0 client.7347 ms_handle_reset on v2:172.21.15.43:6835/863801259 2023-08-27T11:27:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 shutdown_connections 2023-08-27T11:27:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 1 -- 172.21.15.43:0/1008780915 wait complete. 2023-08-27T11:27:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.904+0000 7f1a8ffd9b80 20 client.7347 trim_cache size 0 max 16384 2023-08-27T11:27:16.920 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:16.920 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:16.920 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:16.920 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7083, 2023-08-27T11:27:16.921 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:16.921 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:16.921 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:16.921 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 20.539064863, 2023-08-27T11:27:16.921 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 93, 2023-08-27T11:27:16.922 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 96, 2023-08-27T11:27:16.922 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 96, 2023-08-27T11:27:16.922 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 26.748473366999999 2023-08-27T11:27:16.922 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 msgr2=0x7f1a5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 0x7f1a5806c5a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1a700090b0 tx=0x7f1a70008030 comp rx=0 tx=0).stop 2023-08-27T11:27:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 msgr2=0x7f1a7414d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00cbc0 tx=0x7f1a6c00ced0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 shutdown_connections 2023-08-27T11:27:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1a5806a0e0 0x7f1a5806c5a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1a74151a90 0x7f1a7414d640 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a740c4630 0x7f1a740aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 --2- 172.21.15.43:0/3074360741 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a740c4a90 0x7f1a7414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 >> 172.21.15.43:0/3074360741 conn(0x7f1a740ab820 msgr2=0x7f1a740c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 shutdown_connections 2023-08-27T11:27:16.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:16.905+0000 7f1a7c5ff700 1 -- 172.21.15.43:0/3074360741 wait complete. 2023-08-27T11:27:16.926 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 7, "epoch": 93, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 7, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:55.860033+0000", "damaged": [], "data_pools": [ 16 ], "enabled": true, "epoch": 93, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7083": { "addr": "172.21.15.43:6836/863801259", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 863801259, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 863801259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7083, "incarnation": 88, "join_fscid": 7, "name": "c", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 15, "modified": "2023-08-27T11:27:12.952474+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7083 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/3647973339", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 3647973339, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 3647973339, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6775, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/22508657", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 22508657, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 22508657, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6778, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1648653949", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1648653949, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1648653949, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7080, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:16.927 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 7, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:16.928 INFO:tasks.cephfs.test_failover:current = [{'gid': 7080, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1648653949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1648653949}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1648653949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 6778, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/22508657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 22508657}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 22508657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 7083, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6836/863801259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 863801259}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 863801259}]}, 'join_fscid': 7, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6775, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/3647973339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3647973339}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3647973339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}] 2023-08-27T11:27:16.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:27:16.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 7:0 2023-08-27T11:27:17.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.131+0000 7effbd5ff700 1 Processor -- start 2023-08-27T11:27:17.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.131+0000 7effbd5ff700 1 -- start start 2023-08-27T11:27:17.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.132+0000 7effbd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effb80c51a0 0x7effb806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.132+0000 7effbd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.132+0000 7effbd5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb806d700 con 0x7effb80ab040 2023-08-27T11:27:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.132+0000 7effbd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb81530b0 con 0x7effb80c51a0 2023-08-27T11:27:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.132+0000 7effbd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb814c860 con 0x7effb806ca60 2023-08-27T11:27:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb67fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7effb80c51a0 0x7effb806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7effb80ab040 0x7effb8155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:35840/0 (socket says 172.21.15.43:35840) 2023-08-27T11:27:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb77fe700 1 -- 172.21.15.43:0/3861385986 learned_addr learned my addr 172.21.15.43:0/3861385986 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb67fc700 1 -- 172.21.15.43:0/3861385986 >> v2:172.21.15.57:3300/0 conn(0x7effb80c51a0 msgr2=0x7effb806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb67fc700 1 --2- 172.21.15.43:0/3861385986 >> v2:172.21.15.57:3300/0 conn(0x7effb80c51a0 0x7effb806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb67fc700 1 -- 172.21.15.43:0/3861385986 >> v1:172.21.15.57:6789/0 conn(0x7effb80ab040 legacy=0x7effb8155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb67fc700 1 -- 172.21.15.43:0/3861385986 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8152430 con 0x7effb806ca60 2023-08-27T11:27:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.133+0000 7effb5ffb700 1 -- 172.21.15.43:0/3861385986 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731451645 0 0) 0x7effb806d700 con 0x7effb80ab040 2023-08-27T11:27:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effb67fc700 1 --2- 172.21.15.43:0/3861385986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80aab00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effac009840 tx=0x7effac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ee681d343292d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effb5ffb700 1 -- 172.21.15.43:0/3861385986 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011830 con 0x7effb806ca60 2023-08-27T11:27:17.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effb5ffb700 1 -- 172.21.15.43:0/3861385986 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac011990 con 0x7effb806ca60 2023-08-27T11:27:17.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effb5ffb700 1 -- 172.21.15.43:0/3861385986 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011d20 con 0x7effb806ca60 2023-08-27T11:27:17.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 -- 172.21.15.43:0/3861385986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 msgr2=0x7effb80aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3861385986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80aab00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7effac009840 tx=0x7effac009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:17.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 -- 172.21.15.43:0/3861385986 shutdown_connections 2023-08-27T11:27:17.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3861385986 >> v2:172.21.15.57:3300/0 conn(0x7effb80c51a0 0x7effb806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3861385986 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80aab00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.134+0000 7effbd5ff700 1 -- 172.21.15.43:0/3861385986 >> 172.21.15.43:0/3861385986 conn(0x7effb806aa50 msgr2=0x7effb80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:17.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.135+0000 7effbd5ff700 1 -- 172.21.15.43:0/3861385986 shutdown_connections 2023-08-27T11:27:17.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.135+0000 7effbd5ff700 1 -- 172.21.15.43:0/3861385986 wait complete. 2023-08-27T11:27:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.136+0000 7effbd5ff700 1 Processor -- start 2023-08-27T11:27:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.136+0000 7effbd5ff700 1 -- start start 2023-08-27T11:27:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb80c51a0 0x7effb814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb814c9a0 con 0x7effb80ab040 2023-08-27T11:27:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb814cc40 con 0x7effb80c51a0 2023-08-27T11:27:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effbd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb814e030 con 0x7effb806ca60 2023-08-27T11:27:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.137+0000 7effb67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54728/0 (socket says 172.21.15.43:54728) 2023-08-27T11:27:17.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 -- 172.21.15.43:0/3906292806 learned_addr learned my addr 172.21.15.43:0/3906292806 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:17.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb77fe700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb80c51a0 0x7effb814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 -- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 msgr2=0x7effb80c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.146 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 -- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb80c51a0 msgr2=0x7effb814b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb80c51a0 0x7effb814b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 -- 172.21.15.43:0/3906292806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0094a0 con 0x7effb80ab040 2023-08-27T11:27:17.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7effb67fc700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.147 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.138+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac01a7e0 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.139+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac01a940 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.139+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac01acf0 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.139+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb80c3720 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.139+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb814dd50 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.140+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb814dbb0 con 0x7effb80ab040 2023-08-27T11:27:17.148 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.141+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effac022070 con 0x7effb80ab040 2023-08-27T11:27:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.142+0000 7eff9f7fe700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 0x7effa406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.142+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6062+0+0 (secure 0 0 0) 0x7effac089680 con 0x7effb80ab040 2023-08-27T11:27:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.142+0000 7effb6ffd700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 0x7effa406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.143+0000 7effb6ffd700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 0x7effa406c5a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7effa8009b40 tx=0x7effa8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.146+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effb814dbb0 con 0x7effb80ab040 2023-08-27T11:27:17.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.446+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "7:0"} v 0) v1 -- 0x7effb814dbb0 con 0x7effb80ab040 2023-08-27T11:27:17.448 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:27:17.447+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:27:17.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.452+0000 7eff9f7fe700 1 -- 172.21.15.43:0/3906292806 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "7:0"}]=0 failed mds gid 7083 v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7effb814dbb0 con 0x7effb80ab040 2023-08-27T11:27:17.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 msgr2=0x7effa406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 0x7effa406c5a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7effa8009b40 tx=0x7effa8009210 comp rx=0 tx=0).stop 2023-08-27T11:27:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 msgr2=0x7effb814ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac004750 comp rx=0 tx=0).stop 2023-08-27T11:27:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 shutdown_connections 2023-08-27T11:27:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7effa406a0e0 0x7effa406c5a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb80c51a0 0x7effb814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7effb806ca60 0x7effb80c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 --2- 172.21.15.43:0/3906292806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7effb80ab040 0x7effb814ab00 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 >> 172.21.15.43:0/3906292806 conn(0x7effb806aa50 msgr2=0x7effb80c3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 shutdown_connections 2023-08-27T11:27:17.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.455+0000 7effbd5ff700 1 -- 172.21.15.43:0/3906292806 wait complete. 2023-08-27T11:27:17.459 INFO:teuthology.orchestra.run.smithi043.stderr:failed mds gid 7083 2023-08-27T11:27:17.459 INFO:tasks.ceph.mds.c.smithi043.stderr: -554> 2023-08-27T11:27:00.312+0000 7f4079bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:17.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:17.510 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:27:17.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.684+0000 7f8c21fff700 1 Processor -- start 2023-08-27T11:27:17.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.684+0000 7f8c21fff700 1 -- start start 2023-08-27T11:27:17.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.685+0000 7f8c21fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.685+0000 7f8c21fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0c4630 0x7f8c1c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.685+0000 7f8c21fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c06c4e0 con 0x7f8c1c06ad70 2023-08-27T11:27:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.685+0000 7f8c21fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c155370 con 0x7f8c1c151a90 2023-08-27T11:27:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.685+0000 7f8c21fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c151e70 con 0x7f8c1c0c4630 2023-08-27T11:27:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54748/0 (socket says 172.21.15.43:54748) 2023-08-27T11:27:17.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 -- 172.21.15.43:0/1884560507 learned_addr learned my addr 172.21.15.43:0/1884560507 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:17.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1affd700 1 --2- 172.21.15.43:0/1884560507 >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0c4630 0x7f8c1c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 -- 172.21.15.43:0/1884560507 >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0c4630 msgr2=0x7f8c1c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 --2- 172.21.15.43:0/1884560507 >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0c4630 0x7f8c1c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 -- 172.21.15.43:0/1884560507 >> v1:172.21.15.57:6789/0 conn(0x7f8c1c06ad70 legacy=0x7f8c1c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.686+0000 7f8c1b7fe700 1 -- 172.21.15.43:0/1884560507 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c154480 con 0x7f8c1c151a90 2023-08-27T11:27:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c1b7fe700 1 --2- 172.21.15.43:0/1884560507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0c7740 tx=0x7f8c0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9105d31f66ba85e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c1a7fc700 1 -- 172.21.15.43:0/1884560507 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c011830 con 0x7f8c1c151a90 2023-08-27T11:27:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c1a7fc700 1 -- 172.21.15.43:0/1884560507 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c011990 con 0x7f8c1c151a90 2023-08-27T11:27:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c1a7fc700 1 -- 172.21.15.43:0/1884560507 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c011d20 con 0x7f8c1c151a90 2023-08-27T11:27:17.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 -- 172.21.15.43:0/1884560507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c151a90 msgr2=0x7f8c1c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 --2- 172.21.15.43:0/1884560507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0c7740 tx=0x7f8c0c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 -- 172.21.15.43:0/1884560507 shutdown_connections 2023-08-27T11:27:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 --2- 172.21.15.43:0/1884560507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c151a90 0x7f8c1c0c7bb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 --2- 172.21.15.43:0/1884560507 >> v2:172.21.15.57:3300/0 conn(0x7f8c1c0c4630 0x7f8c1c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.687+0000 7f8c21fff700 1 -- 172.21.15.43:0/1884560507 >> 172.21.15.43:0/1884560507 conn(0x7f8c1c0ab820 msgr2=0x7f8c1c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.688+0000 7f8c21fff700 1 -- 172.21.15.43:0/1884560507 shutdown_connections 2023-08-27T11:27:17.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.688+0000 7f8c21fff700 1 -- 172.21.15.43:0/1884560507 wait complete. 2023-08-27T11:27:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.689+0000 7f8c21fff700 1 Processor -- start 2023-08-27T11:27:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.689+0000 7f8c21fff700 1 -- start start 2023-08-27T11:27:17.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c06ad70 0x7f8c1c0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c1c151a90 0x7f8c1c14da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1ed880 con 0x7f8c1c0c4630 2023-08-27T11:27:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c152900 con 0x7f8c1c06ad70 2023-08-27T11:27:17.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c21fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1ec9b0 con 0x7f8c1c151a90 2023-08-27T11:27:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.690+0000 7f8c1affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:54750/0 (socket says 172.21.15.43:54750) 2023-08-27T11:27:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 -- 172.21.15.43:0/3289337116 learned_addr learned my addr 172.21.15.43:0/3289337116 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1b7fe700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c06ad70 0x7f8c1c0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1bfff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c1c151a90 0x7f8c1c14da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 -- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c1c151a90 msgr2=0x7f8c1c14da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c1c151a90 0x7f8c1c14da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 -- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c06ad70 msgr2=0x7f8c1c0aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c06ad70 0x7f8c1c0aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 -- 172.21.15.43:0/3289337116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c009550 con 0x7f8c1c0c4630 2023-08-27T11:27:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c1affd700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000e9e0 tx=0x7f8c1000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.691+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10009710 con 0x7f8c1c0c4630 2023-08-27T11:27:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.692+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000ee80 con 0x7f8c1c0c4630 2023-08-27T11:27:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.692+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000ca50 con 0x7f8c1c0c4630 2023-08-27T11:27:17.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.692+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c1ecc00 con 0x7f8c1c0c4630 2023-08-27T11:27:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.692+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c1ed1c0 con 0x7f8c1c0c4630 2023-08-27T11:27:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.693+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c04ee70 con 0x7f8c1c0c4630 2023-08-27T11:27:17.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.694+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c1000cbb0 con 0x7f8c1c0c4630 2023-08-27T11:27:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.695+0000 7f8c03fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 0x7f8c0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.695+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8c10088620 con 0x7f8c1c0c4630 2023-08-27T11:27:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.695+0000 7f8c1b7fe700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 0x7f8c0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:17.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.696+0000 7f8c1b7fe700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 0x7f8c0806c5a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c014040 tx=0x7f8c0c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:17.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.699+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c100576a0 con 0x7f8c1c0c4630 2023-08-27T11:27:17.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.953+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c1c06c130 con 0x7f8c1c0c4630 2023-08-27T11:27:17.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.953+0000 7f8c03fff700 1 -- 172.21.15.43:0/3289337116 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4081 (secure 0 0 0) 0x7f8c10057230 con 0x7f8c1c0c4630 2023-08-27T11:27:17.955 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:17.955 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":95,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:17.452961+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":95,"state":"up:replay","state_seq":1,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:17.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 msgr2=0x7f8c0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 0x7f8c0806c5a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c014040 tx=0x7f8c0c008030 comp rx=0 tx=0).stop 2023-08-27T11:27:17.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 msgr2=0x7f8c1c14d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:17.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000e9e0 tx=0x7f8c1000ecf0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 shutdown_connections 2023-08-27T11:27:17.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c0806a0e0 0x7f8c0806c5a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c1c151a90 0x7f8c1c14da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c1c06ad70 0x7f8c1c0aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 --2- 172.21.15.43:0/3289337116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c1c0c4630 0x7f8c1c14d4c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 >> 172.21.15.43:0/3289337116 conn(0x7f8c1c0ab820 msgr2=0x7f8c1c0c8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 shutdown_connections 2023-08-27T11:27:17.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:17.956+0000 7f8c21fff700 1 -- 172.21.15.43:0/3289337116 wait complete. 2023-08-27T11:27:17.960 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 95 2023-08-27T11:27:18.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:27:17.452961+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7080}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7080': {'gid': 7080, 'name': 'a', 'rank': 0, 'incarnation': 95, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.43:6837/1648653949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1648653949}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1648653949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:18.378 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7080:up:replay 2023-08-27T11:27:19.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:19.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.592+0000 7f80871ff700 1 Processor -- start 2023-08-27T11:27:19.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.593+0000 7f80871ff700 1 -- start start 2023-08-27T11:27:19.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80800c4630 0x7f80800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 0x7f808006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808006c4e0 con 0x7f80800c4630 2023-08-27T11:27:19.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8080155370 con 0x7f808006ad70 2023-08-27T11:27:19.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f80871ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080151e70 con 0x7f8080151a90 2023-08-27T11:27:19.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f807ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80800c4630 0x7f80800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f807ffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80800c4630 0x7f80800c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37974/0 (socket says 172.21.15.43:37974) 2023-08-27T11:27:19.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f807ffff700 1 -- 172.21.15.43:0/32551594 learned_addr learned my addr 172.21.15.43:0/32551594 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:19.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f8084f9b700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.594+0000 7f808579c700 1 --2- 172.21.15.43:0/32551594 >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 0x7f808006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 -- 172.21.15.43:0/32551594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 msgr2=0x7f80800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:19.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80800c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 -- 172.21.15.43:0/32551594 >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 msgr2=0x7f808006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:19.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 --2- 172.21.15.43:0/32551594 >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 0x7f808006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 -- 172.21.15.43:0/32551594 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080154480 con 0x7f80800c4630 2023-08-27T11:27:19.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f808579c700 1 --2- 172.21.15.43:0/32551594 >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 0x7f808006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:19.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807ffff700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f80800c4a90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f80800bd700 tx=0x7f806c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309027d64e0efc9e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:19.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807f7fe700 1 -- 172.21.15.43:0/32551594 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00b870 con 0x7f80800c4630 2023-08-27T11:27:19.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807f7fe700 1 -- 172.21.15.43:0/32551594 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00b9d0 con 0x7f80800c4630 2023-08-27T11:27:19.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.595+0000 7f807f7fe700 1 -- 172.21.15.43:0/32551594 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00bd60 con 0x7f80800c4630 2023-08-27T11:27:19.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 -- 172.21.15.43:0/32551594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 msgr2=0x7f80800c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:19.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f80800c4a90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f80800bd700 tx=0x7f806c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 -- 172.21.15.43:0/32551594 shutdown_connections 2023-08-27T11:27:19.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 --2- 172.21.15.43:0/32551594 >> v2:172.21.15.57:3300/0 conn(0x7f808006ad70 0x7f808006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80800c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 --2- 172.21.15.43:0/32551594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f80800c4a90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 -- 172.21.15.43:0/32551594 >> 172.21.15.43:0/32551594 conn(0x7f80800ab820 msgr2=0x7f80800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:19.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 -- 172.21.15.43:0/32551594 shutdown_connections 2023-08-27T11:27:19.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.596+0000 7f80871ff700 1 -- 172.21.15.43:0/32551594 wait complete. 2023-08-27T11:27:19.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.597+0000 7f80871ff700 1 Processor -- start 2023-08-27T11:27:19.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.598+0000 7f80871ff700 1 -- start start 2023-08-27T11:27:19.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.598+0000 7f80871ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f808006ad70 0x7f8080152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f80871ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f80871ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80801470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f80871ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080155ac0 con 0x7f80800c4630 2023-08-27T11:27:19.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f80871ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80801557b0 con 0x7f808006ad70 2023-08-27T11:27:19.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f80871ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080153ea0 con 0x7f8080151a90 2023-08-27T11:27:19.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37982/0 (socket says 172.21.15.43:37982) 2023-08-27T11:27:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 -- 172.21.15.43:0/2177199265 learned_addr learned my addr 172.21.15.43:0/2177199265 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f8084f9b700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f808006ad70 0x7f8080152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f808579c700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80801470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 -- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 msgr2=0x7f80801470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:19.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80801470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 -- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f808006ad70 msgr2=0x7f8080152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f808006ad70 0x7f8080152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.599+0000 7f807ffff700 1 -- 172.21.15.43:0/2177199265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009550 con 0x7f80800c4630 2023-08-27T11:27:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f807ffff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f806c000c00 tx=0x7f806c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:19.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c004480 con 0x7f80800c4630 2023-08-27T11:27:19.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c0045e0 con 0x7f80800c4630 2023-08-27T11:27:19.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8080152640 con 0x7f80800c4630 2023-08-27T11:27:19.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c0038e0 con 0x7f80800c4630 2023-08-27T11:27:19.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.600+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80801540f0 con 0x7f80800c4630 2023-08-27T11:27:19.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.601+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808004ee70 con 0x7f80800c4630 2023-08-27T11:27:19.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.602+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f806c021070 con 0x7f80800c4630 2023-08-27T11:27:19.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.603+0000 7f807d7fa700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 0x7f806406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:19.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.603+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f806c089be0 con 0x7f80800c4630 2023-08-27T11:27:19.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.604+0000 7f8084f9b700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 0x7f806406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:19.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.604+0000 7f8084f9b700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 0x7f806406c5a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8074006b20 tx=0x7f8074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:19.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.608+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f806c055260 con 0x7f80800c4630 2023-08-27T11:27:19.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.861+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f808006c130 con 0x7f80800c4630 2023-08-27T11:27:19.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.861+0000 7f807d7fa700 1 -- 172.21.15.43:0/2177199265 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4871 (secure 0 0 0) 0x7f806c015090 con 0x7f80800c4630 2023-08-27T11:27:19.863 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:19.863 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":97,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7359,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:19.459166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":95,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.43:6837/1648653949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1648653949},{"type":"v1","addr":"172.21.15.43:6837","nonce":1648653949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:19.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 msgr2=0x7f806406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 0x7f806406c5a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8074006b20 tx=0x7f8074008040 comp rx=0 tx=0).stop 2023-08-27T11:27:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 msgr2=0x7f8080155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f806c000c00 tx=0x7f806c004750 comp rx=0 tx=0).stop 2023-08-27T11:27:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 shutdown_connections 2023-08-27T11:27:19.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f806406a0e0 0x7f806406c5a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8080151a90 0x7f80801470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f808006ad70 0x7f8080152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 --2- 172.21.15.43:0/2177199265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80800c4630 0x7f8080155ee0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 >> 172.21.15.43:0/2177199265 conn(0x7f80800ab820 msgr2=0x7f808014d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:19.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 shutdown_connections 2023-08-27T11:27:19.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:19.864+0000 7f80871ff700 1 -- 172.21.15.43:0/2177199265 wait complete. 2023-08-27T11:27:19.868 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 97 2023-08-27T11:27:20.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 97, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:27:19.459166+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7080}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7080': {'gid': 7080, 'name': 'a', 'rank': 0, 'incarnation': 95, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.43:6837/1648653949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1648653949}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1648653949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:20.287 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7080:up:rejoin 2023-08-27T11:27:20.555 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:27:21.288 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:21.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.503+0000 7fedfc3ff700 1 Processor -- start 2023-08-27T11:27:21.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.503+0000 7fedfc3ff700 1 -- start start 2023-08-27T11:27:21.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.504+0000 7fedfc3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 0x7fedf406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:21.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedfc3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf406d700 con 0x7fedf4155910 2023-08-27T11:27:21.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedfc3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf4152430 con 0x7fedf40c51a0 2023-08-27T11:27:21.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedfc3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41530b0 con 0x7fedf406ca60 2023-08-27T11:27:21.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedfa99c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fedf4155910 0x7fedf4155da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42654/0 (socket says 172.21.15.43:42654) 2023-08-27T11:27:21.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedfa99c700 1 -- 172.21.15.43:0/3699397038 learned_addr learned my addr 172.21.15.43:0/3699397038 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:21.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedf999a700 1 --2- 172.21.15.43:0/3699397038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 0x7fedf406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:21.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122726690 0 0) 0x7fedf406d700 con 0x7fedf4155910 2023-08-27T11:27:21.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fede00035b0 con 0x7fedf4155910 2023-08-27T11:27:21.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972923205 0 0) 0x7fedf4152430 con 0x7fedf40c51a0 2023-08-27T11:27:21.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.505+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf406d700 con 0x7fedf40c51a0 2023-08-27T11:27:21.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf999a700 1 -- 172.21.15.43:0/3699397038 >> v1:172.21.15.57:6789/0 conn(0x7fedf40c51a0 legacy=0x7fedf40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf999a700 1 -- 172.21.15.43:0/3699397038 >> v1:172.21.15.43:6789/0 conn(0x7fedf4155910 legacy=0x7fedf4155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf999a700 1 -- 172.21.15.43:0/3699397038 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf4152710 con 0x7fedf406ca60 2023-08-27T11:27:21.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf999a700 1 --2- 172.21.15.43:0/3699397038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 0x7fedf406d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd11114f02cdd0ac server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4011830 con 0x7fedf406ca60 2023-08-27T11:27:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4011990 con 0x7fedf406ca60 2023-08-27T11:27:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.506+0000 7fedf9199700 1 -- 172.21.15.43:0/3699397038 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4011d20 con 0x7fedf406ca60 2023-08-27T11:27:21.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 -- 172.21.15.43:0/3699397038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 msgr2=0x7fedf406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/3699397038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 0x7fedf406d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fede4009870 tx=0x7fede4009b80 comp rx=0 tx=0).stop 2023-08-27T11:27:21.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 -- 172.21.15.43:0/3699397038 shutdown_connections 2023-08-27T11:27:21.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/3699397038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf406ca60 0x7fedf406d1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 -- 172.21.15.43:0/3699397038 >> 172.21.15.43:0/3699397038 conn(0x7fedf406aa50 msgr2=0x7fedf40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:21.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 -- 172.21.15.43:0/3699397038 shutdown_connections 2023-08-27T11:27:21.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.507+0000 7fedfc3ff700 1 -- 172.21.15.43:0/3699397038 wait complete. 2023-08-27T11:27:21.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.509+0000 7fedfc3ff700 1 Processor -- start 2023-08-27T11:27:21.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.509+0000 7fedfc3ff700 1 -- start start 2023-08-27T11:27:21.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:21.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 0x7fedf414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:21.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 0x7fedf40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:21.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf414a570 con 0x7fedf406ca60 2023-08-27T11:27:21.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41ed1d0 con 0x7fedf4155910 2023-08-27T11:27:21.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfc3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41ed700 con 0x7fedf40c51a0 2023-08-27T11:27:21.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfa19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:21.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfa19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:37990/0 (socket says 172.21.15.43:37990) 2023-08-27T11:27:21.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.510+0000 7fedfa19b700 1 -- 172.21.15.43:0/578292348 learned_addr learned my addr 172.21.15.43:0/578292348 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:21.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedf999a700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 0x7fedf414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:21.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa99c700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 0x7fedf40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:21.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 -- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 msgr2=0x7fedf414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 0x7fedf414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 -- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 msgr2=0x7fedf40711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 0x7fedf40711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 -- 172.21.15.43:0/578292348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede40094a0 con 0x7fedf406ca60 2023-08-27T11:27:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa99c700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 0x7fedf40711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedf999a700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 0x7fedf414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfa19b700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c550 tx=0x7fedf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:21.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00052d0 con 0x7fedf406ca60 2023-08-27T11:27:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0005430 con 0x7fedf406ca60 2023-08-27T11:27:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00038c0 con 0x7fedf406ca60 2023-08-27T11:27:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf41ed420 con 0x7fedf406ca60 2023-08-27T11:27:21.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.511+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf40a89a0 con 0x7fedf406ca60 2023-08-27T11:27:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.512+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf40c4b70 con 0x7fedf406ca60 2023-08-27T11:27:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.514+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fedf0003a20 con 0x7fedf406ca60 2023-08-27T11:27:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.514+0000 7fedeaffd700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 0x7fedd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.515+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fedf0087b90 con 0x7fedf406ca60 2023-08-27T11:27:21.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.515+0000 7fedf999a700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 0x7fedd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:21.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.515+0000 7fedf999a700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 0x7fedd806c5a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fedf40a52f0 tx=0x7fede401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:21.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.519+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fedf00531c0 con 0x7fedf406ca60 2023-08-27T11:27:21.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.774+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf404ee70 con 0x7fedf406ca60 2023-08-27T11:27:21.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.775+0000 7fedeaffd700 1 -- 172.21.15.43:0/578292348 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4877 (secure 0 0 0) 0x7fedf00567e0 con 0x7fedf406ca60 2023-08-27T11:27:21.777 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:21.777 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":100,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:21.498555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 msgr2=0x7fedd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 0x7fedd806c5a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fedf40a52f0 tx=0x7fede401c040 comp rx=0 tx=0).stop 2023-08-27T11:27:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 msgr2=0x7fedf4149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:21.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c550 tx=0x7fedf000c910 comp rx=0 tx=0).stop 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 shutdown_connections 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fedd806a0e0 0x7fedd806c5a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fedf4155910 0x7fedf40711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fedf406ca60 0x7fedf4149af0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 --2- 172.21.15.43:0/578292348 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fedf40c51a0 0x7fedf414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:21.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 >> 172.21.15.43:0/578292348 conn(0x7fedf406aa50 msgr2=0x7fedf4154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:21.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 shutdown_connections 2023-08-27T11:27:21.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:21.777+0000 7fedfc3ff700 1 -- 172.21.15.43:0/578292348 wait complete. 2023-08-27T11:27:21.782 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 100 2023-08-27T11:27:22.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:27:21.498555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7359': {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 99, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.43:6836/1628131230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 1628131230}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1628131230}]}, 'join_fscid': 7, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:22.200 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7359:up:reconnect 2023-08-27T11:27:23.200 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:23.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.412+0000 7ff5f55ff700 1 Processor -- start 2023-08-27T11:27:23.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.412+0000 7ff5f55ff700 1 -- start start 2023-08-27T11:27:23.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.413+0000 7ff5f55ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5f00c4630 0x7ff5f00c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.413+0000 7ff5f55ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.413+0000 7ff5f55ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00c82c0 con 0x7ff5f0151b20 2023-08-27T11:27:23.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.413+0000 7ff5f55ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f0151f00 con 0x7ff5f00c4630 2023-08-27T11:27:23.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.413+0000 7ff5f55ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f006c450 con 0x7ff5f006ad70 2023-08-27T11:27:23.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37546/0 (socket says 172.21.15.43:37546) 2023-08-27T11:27:23.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 -- 172.21.15.43:0/2774029477 learned_addr learned my addr 172.21.15.43:0/2774029477 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:23.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ee7fc700 1 --2- 172.21.15.43:0/2774029477 >> v2:172.21.15.57:3300/0 conn(0x7ff5f00c4630 0x7ff5f00c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5eeffd700 1 --1- 172.21.15.43:0/2774029477 >> v1:172.21.15.57:6789/0 conn(0x7ff5f0151b20 0x7ff5f00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:59618/0 (socket says 172.21.15.43:59618) 2023-08-27T11:27:23.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 -- 172.21.15.43:0/2774029477 >> v2:172.21.15.57:3300/0 conn(0x7ff5f00c4630 msgr2=0x7ff5f00c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:23.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 --2- 172.21.15.43:0/2774029477 >> v2:172.21.15.57:3300/0 conn(0x7ff5f00c4630 0x7ff5f00c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 -- 172.21.15.43:0/2774029477 >> v1:172.21.15.57:6789/0 conn(0x7ff5f0151b20 legacy=0x7ff5f00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 -- 172.21.15.43:0/2774029477 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0154760 con 0x7ff5f006ad70 2023-08-27T11:27:23.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.414+0000 7ff5ef7fe700 1 --2- 172.21.15.43:0/2774029477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009e50 tx=0x7ff5e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ab814786baff164 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:23.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5edffb700 1 -- 172.21.15.43:0/2774029477 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800e070 con 0x7ff5f006ad70 2023-08-27T11:27:23.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5edffb700 1 -- 172.21.15.43:0/2774029477 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800b910 con 0x7ff5f006ad70 2023-08-27T11:27:23.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5edffb700 1 -- 172.21.15.43:0/2774029477 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800bcc0 con 0x7ff5f006ad70 2023-08-27T11:27:23.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 -- 172.21.15.43:0/2774029477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 msgr2=0x7ff5f006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/2774029477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009e50 tx=0x7ff5e800b330 comp rx=0 tx=0).stop 2023-08-27T11:27:23.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 -- 172.21.15.43:0/2774029477 shutdown_connections 2023-08-27T11:27:23.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/2774029477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f006ad70 0x7ff5f006b1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/2774029477 >> v2:172.21.15.57:3300/0 conn(0x7ff5f00c4630 0x7ff5f00c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 -- 172.21.15.43:0/2774029477 >> 172.21.15.43:0/2774029477 conn(0x7ff5f00ab820 msgr2=0x7ff5f00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:23.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 -- 172.21.15.43:0/2774029477 shutdown_connections 2023-08-27T11:27:23.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.415+0000 7ff5f55ff700 1 -- 172.21.15.43:0/2774029477 wait complete. 2023-08-27T11:27:23.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.417+0000 7ff5f55ff700 1 Processor -- start 2023-08-27T11:27:23.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.417+0000 7ff5f55ff700 1 -- start start 2023-08-27T11:27:23.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5f00c4630 0x7ff5f0145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 0x7ff5f01455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0146e80 con 0x7ff5f006ad70 2023-08-27T11:27:23.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00c3730 con 0x7ff5f00c4630 2023-08-27T11:27:23.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5f55ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0147340 con 0x7ff5f0151b20 2023-08-27T11:27:23.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5eeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38002/0 (socket says 172.21.15.43:38002) 2023-08-27T11:27:23.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.418+0000 7ff5eeffd700 1 -- 172.21.15.43:0/886963761 learned_addr learned my addr 172.21.15.43:0/886963761 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:23.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5ef7fe700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 0x7ff5f01455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5ee7fc700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5f00c4630 0x7ff5f0145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 -- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 msgr2=0x7ff5f01455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 0x7ff5f01455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 -- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5f00c4630 msgr2=0x7ff5f0145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5f00c4630 0x7ff5f0145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 -- 172.21.15.43:0/886963761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009b30 con 0x7ff5f006ad70 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5ef7fe700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 0x7ff5f01455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5eeffd700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c500 tx=0x7ff5e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:23.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0005cb0 con 0x7ff5f006ad70 2023-08-27T11:27:23.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0005e10 con 0x7ff5f006ad70 2023-08-27T11:27:23.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0147870 con 0x7ff5f006ad70 2023-08-27T11:27:23.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00072d0 con 0x7ff5f006ad70 2023-08-27T11:27:23.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.419+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f01edaa0 con 0x7ff5f006ad70 2023-08-27T11:27:23.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.420+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f004ee70 con 0x7ff5f006ad70 2023-08-27T11:27:23.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.421+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5e0007430 con 0x7ff5f006ad70 2023-08-27T11:27:23.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.422+0000 7ff5d77fe700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 0x7ff5dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:23.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.422+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7ff5e0087960 con 0x7ff5f006ad70 2023-08-27T11:27:23.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.423+0000 7ff5ee7fc700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 0x7ff5dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:23.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.423+0000 7ff5ee7fc700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 0x7ff5dc06c5a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff5f01540d0 tx=0x7ff5e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:23.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.427+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff5e0053040 con 0x7ff5f006ad70 2023-08-27T11:27:23.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.689+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5f006c130 con 0x7ff5f006ad70 2023-08-27T11:27:23.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.690+0000 7ff5d77fe700 1 -- 172.21.15.43:0/886963761 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4874 (secure 0 0 0) 0x7ff5e0056660 con 0x7ff5f006ad70 2023-08-27T11:27:23.692 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:23.692 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:23.511980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:23.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 msgr2=0x7ff5dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 0x7ff5dc06c5a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff5f01540d0 tx=0x7ff5e4008040 comp rx=0 tx=0).stop 2023-08-27T11:27:23.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 msgr2=0x7ff5f014d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:23.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000c500 tx=0x7ff5e000c8c0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 shutdown_connections 2023-08-27T11:27:23.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5dc06a0e0 0x7ff5dc06c5a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5f0151b20 0x7ff5f01455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5f006ad70 0x7ff5f014d0f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.692+0000 7ff5f55ff700 1 --2- 172.21.15.43:0/886963761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5f00c4630 0x7ff5f0145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:23.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.693+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 >> 172.21.15.43:0/886963761 conn(0x7ff5f00ab820 msgr2=0x7ff5f01507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:23.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.693+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 shutdown_connections 2023-08-27T11:27:23.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:23.693+0000 7ff5f55ff700 1 -- 172.21.15.43:0/886963761 wait complete. 2023-08-27T11:27:23.699 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 102 2023-08-27T11:27:24.115 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:26:55.860033+0000', 'modified': '2023-08-27T11:27:23.511980+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7359}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7359': {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1628131230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 1628131230}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1628131230}]}, 'join_fscid': 7, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:24.115 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:24.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:24.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.322+0000 7f8c4c9ff700 1 Processor -- start 2023-08-27T11:27:24.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.322+0000 7f8c4c9ff700 1 -- start start 2023-08-27T11:27:24.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4c9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c480c15e0 0x7f8c4815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4c9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c480c5ae0 con 0x7f8c48151910 2023-08-27T11:27:24.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4c9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c480c1190 con 0x7f8c480c51a0 2023-08-27T11:27:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4c9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c48072900 con 0x7f8c480c15e0 2023-08-27T11:27:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8c48151910 0x7f8c48157a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42666/0 (socket says 172.21.15.43:42666) 2023-08-27T11:27:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c4659c700 1 -- 172.21.15.43:0/4010264442 learned_addr learned my addr 172.21.15.43:0/4010264442 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:24.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.323+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/4010264442 >> v2:172.21.15.57:3300/0 conn(0x7f8c480c15e0 0x7f8c4815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754032756 0 0) 0x7f8c480c5ae0 con 0x7f8c48151910 2023-08-27T11:27:24.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c340035b0 con 0x7f8c48151910 2023-08-27T11:27:24.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847738169 0 0) 0x7f8c480c1190 con 0x7f8c480c51a0 2023-08-27T11:27:24.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c480c5ae0 con 0x7f8c480c51a0 2023-08-27T11:27:24.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1802059970 0 0) 0x7f8c340035b0 con 0x7f8c48151910 2023-08-27T11:27:24.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c46d9d700 1 -- 172.21.15.43:0/4010264442 >> v1:172.21.15.57:6789/0 conn(0x7f8c480c51a0 legacy=0x7f8c480c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c46d9d700 1 -- 172.21.15.43:0/4010264442 >> v1:172.21.15.43:6789/0 conn(0x7f8c48151910 legacy=0x7f8c48157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c46d9d700 1 -- 172.21.15.43:0/4010264442 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480c6c00 con 0x7f8c480c15e0 2023-08-27T11:27:24.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.324+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/4010264442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4815fda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6110e833b5df266 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4000e070 con 0x7f8c480c15e0 2023-08-27T11:27:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40003a20 con 0x7f8c480c15e0 2023-08-27T11:27:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c45d9b700 1 -- 172.21.15.43:0/4010264442 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38001670 con 0x7f8c480c15e0 2023-08-27T11:27:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/4010264442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 msgr2=0x7f8c4815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/4010264442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4815fda0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009d90 tx=0x7f8c4000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:24.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/4010264442 shutdown_connections 2023-08-27T11:27:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/4010264442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4815fda0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/4010264442 >> 172.21.15.43:0/4010264442 conn(0x7f8c480a9740 msgr2=0x7f8c480a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/4010264442 shutdown_connections 2023-08-27T11:27:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.325+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/4010264442 wait complete. 2023-08-27T11:27:24.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.327+0000 7f8c4c9ff700 1 Processor -- start 2023-08-27T11:27:24.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.327+0000 7f8c4c9ff700 1 -- start start 2023-08-27T11:27:24.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c480c51a0 0x7f8c480acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480aa7c0 con 0x7f8c48151910 2023-08-27T11:27:24.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480ad810 con 0x7f8c480c15e0 2023-08-27T11:27:24.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c4c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480ab020 con 0x7f8c480c51a0 2023-08-27T11:27:24.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c46d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c46d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38012/0 (socket says 172.21.15.43:38012) 2023-08-27T11:27:24.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.328+0000 7f8c46d9d700 1 -- 172.21.15.43:0/1015838363 learned_addr learned my addr 172.21.15.43:0/1015838363 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c480c51a0 0x7f8c480acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 -- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c480c51a0 msgr2=0x7f8c480acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c480c51a0 0x7f8c480acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 -- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 msgr2=0x7f8c4814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4814ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 -- 172.21.15.43:0/1015838363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40009a70 con 0x7f8c48151910 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8c40015040 tx=0x7f8c40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c3effd700 1 -- 172.21.15.43:0/1015838363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c400044c0 con 0x7f8c48151910 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c3effd700 1 -- 172.21.15.43:0/1015838363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40004620 con 0x7f8c48151910 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c481edb70 con 0x7f8c48151910 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.329+0000 7f8c3effd700 1 -- 172.21.15.43:0/1015838363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40012430 con 0x7f8c48151910 2023-08-27T11:27:24.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.330+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c480aacb0 con 0x7f8c48151910 2023-08-27T11:27:24.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.332+0000 7f8c3effd700 1 -- 172.21.15.43:0/1015838363 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c40012590 con 0x7f8c48151910 2023-08-27T11:27:24.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.333+0000 7f8c3effd700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 0x7f8c2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.333+0000 7f8c3effd700 1 -- 172.21.15.43:0/1015838363 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f8c40089ad0 con 0x7f8c48151910 2023-08-27T11:27:24.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.333+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 0x7f8c2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.334+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 0x7f8c2806c5a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8c38000fd0 tx=0x7f8c38000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.335+0000 7f8c60404b80 1 Processor -- start 2023-08-27T11:27:24.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.335+0000 7f8c60404b80 1 -- start start 2023-08-27T11:27:24.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc2847bfe0 0x55fc284992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 0x55fc284ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc283d3730 con 0x55fc28475f00 2023-08-27T11:27:24.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc283d1050 con 0x55fc284762e0 2023-08-27T11:27:24.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc283cc940 con 0x55fc2847bfe0 2023-08-27T11:27:24.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38018/0 (socket says 172.21.15.43:38018) 2023-08-27T11:27:24.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 -- 172.21.15.43:0/1552037300 learned_addr learned my addr 172.21.15.43:0/1552037300 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc2847bfe0 0x55fc284992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 0x55fc284ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 -- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc2847bfe0 msgr2=0x55fc284992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc2847bfe0 0x55fc284992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 -- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 msgr2=0x55fc284ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 0x55fc284ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c4659c700 1 -- 172.21.15.43:0/1552037300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc2824c5e0 con 0x55fc28475f00 2023-08-27T11:27:24.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.336+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 0x55fc284ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:24.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c4659c700 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8c38001300 tx=0x7f8c38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6510d3ecd3517b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c27fff700 1 -- 172.21.15.43:0/1552037300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38013600 con 0x55fc28475f00 2023-08-27T11:27:24.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c27fff700 1 -- 172.21.15.43:0/1552037300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38013760 con 0x55fc28475f00 2023-08-27T11:27:24.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c27fff700 1 -- 172.21.15.43:0/1552037300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38013ad0 con 0x55fc28475f00 2023-08-27T11:27:24.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c60404b80 1 -- 172.21.15.43:0/1552037300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 msgr2=0x55fc28498d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.337+0000 7f8c60404b80 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8c38001300 tx=0x7f8c38012000 comp rx=0 tx=0).stop 2023-08-27T11:27:24.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 -- 172.21.15.43:0/1552037300 shutdown_connections 2023-08-27T11:27:24.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284762e0 0x55fc284ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc28498d70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 --2- 172.21.15.43:0/1552037300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc2847bfe0 0x55fc284992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 -- 172.21.15.43:0/1552037300 >> 172.21.15.43:0/1552037300 conn(0x55fc283d8c30 msgr2=0x55fc284786e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 -- 172.21.15.43:0/1552037300 shutdown_connections 2023-08-27T11:27:24.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 -- 172.21.15.43:0/1552037300 wait complete. 2023-08-27T11:27:24.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.338+0000 7f8c60404b80 1 -- start start 2023-08-27T11:27:24.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.339+0000 7f8c60404b80 1 Processor -- start 2023-08-27T11:27:24.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc28475f00 0x55fc28473f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2836ab60 con 0x55fc284762e0 2023-08-27T11:27:24.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2836a860 con 0x55fc284b7590 2023-08-27T11:27:24.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc2824e8d0 con 0x55fc28475f00 2023-08-27T11:27:24.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c60404b80 10 client.0 _ll_register_callbacks cb 0x55fc28368630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:24.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c3ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c3ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38034/0 (socket says 172.21.15.43:38034) 2023-08-27T11:27:24.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c3ffff700 1 -- 172.21.15.43:0/3369737333 learned_addr learned my addr 172.21.15.43:0/3369737333 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc28475f00 0x55fc28473f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.340+0000 7f8c3ffff700 1 -- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc28475f00 msgr2=0x55fc28473f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc28475f00 0x55fc28473f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c3ffff700 1 -- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 msgr2=0x55fc284c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c3ffff700 1 -- 172.21.15.43:0/3369737333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3800f7c0 con 0x55fc284762e0 2023-08-27T11:27:24.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8c30003d30 tx=0x7f8c30001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9562069458bcf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3001a070 con 0x55fc284762e0 2023-08-27T11:27:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc2846d4f0 con 0x55fc284762e0 2023-08-27T11:27:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f8c30001c80 con 0x55fc284762e0 2023-08-27T11:27:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c30015430 con 0x55fc284762e0 2023-08-27T11:27:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c60404b80 10 client.7398 fetch_fsmap learned FSMap version 102 2023-08-27T11:27:24.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.341+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55fc283e4750 con 0x55fc284762e0 2023-08-27T11:27:24.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c30024020 con 0x55fc284762e0 2023-08-27T11:27:24.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 102) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8c3001d020 con 0x55fc284762e0 2023-08-27T11:27:24.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 10 client.7398 fetch_fsmap finished waiting for FSMap version 102 2023-08-27T11:27:24.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 10 client.7398 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:24.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 20 client.7398 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:24.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc284b8e00 0x55fc284b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 4 client.7398 mds_command: new command op to 7359 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:24.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 --> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc283c5920 con 0x55fc284b8e00 2023-08-27T11:27:24.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.342+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc284b8e00 0x55fc284b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.343+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc284b8e00 0x55fc284b91e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97610aee6ae2132 server_cookie=6a75831e681237c3 in_seq=0 out_seq=0 2023-08-27T11:27:24.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.343+0000 7f8c257fa700 10 client.7398 ms_handle_connect on v2:172.21.15.43:6835/1628131230 2023-08-27T11:27:24.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.343+0000 7f8c257fa700 1 -- 172.21.15.43:0/3369737333 <== mds.0 v2:172.21.15.43:6835/1628131230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc283c5920 con 0x55fc284b8e00 2023-08-27T11:27:24.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.343+0000 7f8c257fa700 10 client.7398 handle_command_reply: tid=0 2023-08-27T11:27:24.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 client.7398 shutdown 2023-08-27T11:27:24.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 msgr2=0x55fc284c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8c30003d30 tx=0x7f8c30001570 comp rx=0 tx=0).stop 2023-08-27T11:27:24.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 shutdown_connections 2023-08-27T11:27:24.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc284b8e00 0x55fc284b91e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc28475f00 0x55fc28473f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c257fa700 0 client.7398 ms_handle_reset on v2:172.21.15.43:6835/1628131230 2023-08-27T11:27:24.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3369737333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc284762e0 0x55fc284c60c0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 >> 172.21.15.43:0/3369737333 conn(0x55fc283d8c30 msgr2=0x55fc2847a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 shutdown_connections 2023-08-27T11:27:24.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 1 -- 172.21.15.43:0/3369737333 wait complete. 2023-08-27T11:27:24.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.344+0000 7f8c60404b80 20 client.7398 trim_cache size 0 max 16384 2023-08-27T11:27:24.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.362+0000 7f8c60404b80 1 Processor -- start 2023-08-27T11:27:24.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 -- start start 2023-08-27T11:27:24.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc284c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc284757f0 con 0x55fc28475f00 2023-08-27T11:27:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc284ba0b0 con 0x55fc284b7590 2023-08-27T11:27:24.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.363+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc284779f0 con 0x55fc284762e0 2023-08-27T11:27:24.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38046/0 (socket says 172.21.15.43:38046) 2023-08-27T11:27:24.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 -- 172.21.15.43:0/2510954696 learned_addr learned my addr 172.21.15.43:0/2510954696 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc284c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 -- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 msgr2=0x55fc284c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc284c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 -- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 msgr2=0x55fc284c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 -- 172.21.15.43:0/2510954696 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc28476b60 con 0x55fc28475f00 2023-08-27T11:27:24.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:24.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc284c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:24.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c4659c700 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f8c38001500 tx=0x7f8c38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d0163c15886d80 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c3cff9700 1 -- 172.21.15.43:0/2510954696 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38033070 con 0x55fc28475f00 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.364+0000 7f8c3cff9700 1 -- 172.21.15.43:0/2510954696 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c380333d0 con 0x55fc28475f00 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c3cff9700 1 -- 172.21.15.43:0/2510954696 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38013b10 con 0x55fc28475f00 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 -- 172.21.15.43:0/2510954696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 msgr2=0x55fc284788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f8c38001500 tx=0x7f8c38014000 comp rx=0 tx=0).stop 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 -- 172.21.15.43:0/2510954696 shutdown_connections 2023-08-27T11:27:24.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc284c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284788d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 --2- 172.21.15.43:0/2510954696 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc284c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 -- 172.21.15.43:0/2510954696 >> 172.21.15.43:0/2510954696 conn(0x55fc283d8c30 msgr2=0x55fc284c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 -- 172.21.15.43:0/2510954696 shutdown_connections 2023-08-27T11:27:24.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.365+0000 7f8c60404b80 1 -- 172.21.15.43:0/2510954696 wait complete. 2023-08-27T11:27:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.366+0000 7f8c60404b80 1 -- start start 2023-08-27T11:27:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.366+0000 7f8c60404b80 1 Processor -- start 2023-08-27T11:27:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc28522290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc2849bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc284ad2f0 con 0x55fc28475f00 2023-08-27T11:27:24.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2851e8f0 con 0x55fc284b7590 2023-08-27T11:27:24.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc28495110 con 0x55fc284762e0 2023-08-27T11:27:24.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c60404b80 10 client.0 _ll_register_callbacks cb 0x55fc28368630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:24.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38048/0 (socket says 172.21.15.43:38048) 2023-08-27T11:27:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c4659c700 1 -- 172.21.15.43:0/3911417589 learned_addr learned my addr 172.21.15.43:0/3911417589 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc28522290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.367+0000 7f8c46d9d700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc2849bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 -- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 msgr2=0x55fc28522290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc28522290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 -- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 msgr2=0x55fc2849bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc2849bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 -- 172.21.15.43:0/3911417589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc2824c5e0 con 0x55fc28475f00 2023-08-27T11:27:24.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c4659c700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8c38008000 tx=0x7f8c38001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6608a1f61a5e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:24.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38033270 con 0x55fc28475f00 2023-08-27T11:27:24.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c38013760 con 0x55fc28475f00 2023-08-27T11:27:24.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.368+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f8c3801b050 con 0x55fc28475f00 2023-08-27T11:27:24.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c380138d0 con 0x55fc28475f00 2023-08-27T11:27:24.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 10 client.7404 fetch_fsmap learned FSMap version 102 2023-08-27T11:27:24.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x55fc281f8d90 con 0x55fc28475f00 2023-08-27T11:27:24.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38013760 con 0x55fc28475f00 2023-08-27T11:27:24.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 102) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8c38013af0 con 0x55fc28475f00 2023-08-27T11:27:24.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 10 client.7404 fetch_fsmap finished waiting for FSMap version 102 2023-08-27T11:27:24.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 10 client.7404 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:24.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 20 client.7404 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:24.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc2849c040 0x55fc2849c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 4 client.7404 mds_command: new command op to 7359 tid=0[{"prefix": "status"}] 2023-08-27T11:27:24.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 --> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc28386000 con 0x55fc2849c040 2023-08-27T11:27:24.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.369+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc2849c040 0x55fc2849c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c257fa700 10 client.7404 ms_handle_connect on v2:172.21.15.43:6835/1628131230 2023-08-27T11:27:24.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c3ffff700 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc2849c040 0x55fc2849c420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1cef2a18c30306 server_cookie=5ebe39133a32e1eb in_seq=0 out_seq=0 2023-08-27T11:27:24.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c257fa700 1 -- 172.21.15.43:0/3911417589 <== mds.0 v2:172.21.15.43:6835/1628131230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fc28386000 con 0x55fc2849c040 2023-08-27T11:27:24.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c257fa700 10 client.7404 handle_command_reply: tid=0 2023-08-27T11:27:24.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 client.7404 shutdown 2023-08-27T11:27:24.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 msgr2=0x55fc284989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f8c38008000 tx=0x7f8c38001e70 comp rx=0 tx=0).stop 2023-08-27T11:27:24.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 shutdown_connections 2023-08-27T11:27:24.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:6835/1628131230,v1:172.21.15.43:6836/1628131230] conn(0x55fc2849c040 0x55fc2849c420 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55fc284b7590 0x55fc2849bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fc28475f00 0x55fc284989a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 --2- 172.21.15.43:0/3911417589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55fc284762e0 0x55fc28522290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c257fa700 0 client.7404 ms_handle_reset on v2:172.21.15.43:6835/1628131230 2023-08-27T11:27:24.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 >> 172.21.15.43:0/3911417589 conn(0x55fc283d8c30 msgr2=0x55fc284788d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.370+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 shutdown_connections 2023-08-27T11:27:24.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c60404b80 1 -- 172.21.15.43:0/3911417589 wait complete. 2023-08-27T11:27:24.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c60404b80 20 client.7404 trim_cache size 0 max 16384 2023-08-27T11:27:24.392 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7359, 2023-08-27T11:27:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:24.393 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 3.8719070649999998, 2023-08-27T11:27:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 102, 2023-08-27T11:27:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 98, 2023-08-27T11:27:24.394 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 98, 2023-08-27T11:27:24.395 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 6.8570665149999996 2023-08-27T11:27:24.395 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:24.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 msgr2=0x7f8c2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 0x7f8c2806c5a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8c38000fd0 tx=0x7f8c38000ed0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 msgr2=0x7f8c48153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f8c40015040 tx=0x7f8c40004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 shutdown_connections 2023-08-27T11:27:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c2806a0e0 0x7f8c2806c5a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c48151910 0x7f8c48153d90 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c480c15e0 0x7f8c4814ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 --2- 172.21.15.43:0/1015838363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c480c51a0 0x7f8c480acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 >> 172.21.15.43:0/1015838363 conn(0x7f8c480a9740 msgr2=0x7f8c480c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 shutdown_connections 2023-08-27T11:27:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.371+0000 7f8c4c9ff700 1 -- 172.21.15.43:0/1015838363 wait complete. 2023-08-27T11:27:24.399 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 7, "epoch": 102, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 7, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:26:55.860033+0000", "damaged": [], "data_pools": [ 16 ], "enabled": true, "epoch": 102, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7359": { "addr": "172.21.15.43:6836/1628131230", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6835", "nonce": 1628131230, "type": "v2" }, { "addr": "172.21.15.43:6836", "nonce": 1628131230, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7359, "incarnation": 99, "join_fscid": 7, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 98, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 15, "modified": "2023-08-27T11:27:23.511980+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7359 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/3647973339", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 3647973339, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 3647973339, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6775, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/22508657", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 22508657, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 22508657, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6778, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/2721026752", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 2721026752, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 2721026752, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 100, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7377, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:24.400 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': 7, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:24.400 INFO:tasks.cephfs.test_failover:current = [{'gid': 7377, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/2721026752', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 2721026752}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 2721026752}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 100}, {'gid': 6778, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/22508657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 22508657}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 22508657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}, {'gid': 7359, 'name': 'c', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.43:6836/1628131230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6835', 'nonce': 1628131230}, {'type': 'v1', 'addr': '172.21.15.43:6836', 'nonce': 1628131230}]}, 'join_fscid': 7, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 6775, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/3647973339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3647973339}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3647973339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 87}] 2023-08-27T11:27:24.401 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-27T11:27:24.401 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:27:24.402 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:27:24.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:27:24.602 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:27:24.602 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:27:24.602 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:27:24.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:27:24.647 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:27:24.647 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:27:24.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:27:24.694 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:24.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.894+0000 7fadc67ff700 1 Processor -- start 2023-08-27T11:27:24.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.894+0000 7fadc67ff700 1 -- start start 2023-08-27T11:27:24.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc67ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fadc014e0d0 0x7fadc00c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc67ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc00bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc67ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00c17f0 con 0x7fadc00c45c0 2023-08-27T11:27:24.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc67ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00c21a0 con 0x7fadc014e0d0 2023-08-27T11:27:24.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc67ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00bc210 con 0x7fadc00c4c40 2023-08-27T11:27:24.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadbffff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fadc014e0d0 0x7fadc00c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc4d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fadc00c45c0 0x7fadc00bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42674/0 (socket says 172.21.15.43:42674) 2023-08-27T11:27:24.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.896+0000 7fadc4d9c700 1 -- 172.21.15.43:0/3797714573 learned_addr learned my addr 172.21.15.43:0/3797714573 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:24.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbf7fe700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc00bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbffff700 1 -- 172.21.15.43:0/3797714573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 msgr2=0x7fadc00bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbffff700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc00bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbffff700 1 -- 172.21.15.43:0/3797714573 >> v1:172.21.15.43:6789/0 conn(0x7fadc00c45c0 legacy=0x7fadc00bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbeffd700 1 -- 172.21.15.43:0/3797714573 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016690329 0 0) 0x7fadc00c17f0 con 0x7fadc00c45c0 2023-08-27T11:27:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbffff700 1 -- 172.21.15.43:0/3797714573 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00c0900 con 0x7fadc014e0d0 2023-08-27T11:27:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbffff700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc00c4080 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009870 tx=0x7fadb0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a07dd4a8c8caec server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.897+0000 7fadbeffd700 1 -- 172.21.15.43:0/3797714573 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0011830 con 0x7fadc014e0d0 2023-08-27T11:27:24.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadbeffd700 1 -- 172.21.15.43:0/3797714573 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0011990 con 0x7fadc014e0d0 2023-08-27T11:27:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadbeffd700 1 -- 172.21.15.43:0/3797714573 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0011d20 con 0x7fadc014e0d0 2023-08-27T11:27:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 -- 172.21.15.43:0/3797714573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 msgr2=0x7fadc00c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc00c4080 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009870 tx=0x7fadb0009b80 comp rx=0 tx=0).stop 2023-08-27T11:27:24.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 -- 172.21.15.43:0/3797714573 shutdown_connections 2023-08-27T11:27:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc00c4080 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 --2- 172.21.15.43:0/3797714573 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc00bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 -- 172.21.15.43:0/3797714573 >> 172.21.15.43:0/3797714573 conn(0x7fadc006aa50 msgr2=0x7fadc00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:24.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 -- 172.21.15.43:0/3797714573 shutdown_connections 2023-08-27T11:27:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.898+0000 7fadc67ff700 1 -- 172.21.15.43:0/3797714573 wait complete. 2023-08-27T11:27:24.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.900+0000 7fadc67ff700 1 Processor -- start 2023-08-27T11:27:24.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.900+0000 7fadc67ff700 1 -- start start 2023-08-27T11:27:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 0x7fadc01ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00bc9e0 con 0x7fadc014e0d0 2023-08-27T11:27:24.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc01ed8c0 con 0x7fadc00c45c0 2023-08-27T11:27:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc67ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0145140 con 0x7fadc00c4c40 2023-08-27T11:27:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc4d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc4d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38072/0 (socket says 172.21.15.43:38072) 2023-08-27T11:27:24.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.901+0000 7fadc4d9c700 1 -- 172.21.15.43:0/2201659062 learned_addr learned my addr 172.21.15.43:0/2201659062 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:24.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbffff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 0x7fadc01ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbf7fe700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 -- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 msgr2=0x7fadc014a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc014a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 -- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 msgr2=0x7fadc01ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:24.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 0x7fadc01ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:24.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 -- 172.21.15.43:0/2201659062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb00094a0 con 0x7fadc014e0d0 2023-08-27T11:27:24.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbffff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 0x7fadc01ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:24.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbf7fe700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc014a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:24.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc4d9c700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fadb800cc70 tx=0x7fadb800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800ad40 con 0x7fadc014e0d0 2023-08-27T11:27:24.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb800ce70 con 0x7fadc014e0d0 2023-08-27T11:27:24.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80072f0 con 0x7fadc014e0d0 2023-08-27T11:27:24.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc0144e10 con 0x7fadc014e0d0 2023-08-27T11:27:24.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.902+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0142580 con 0x7fadc014e0d0 2023-08-27T11:27:24.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.904+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc004ee70 con 0x7fadc014e0d0 2023-08-27T11:27:24.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.904+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fadb8007450 con 0x7fadc014e0d0 2023-08-27T11:27:24.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.905+0000 7fadbcff9700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 0x7fadac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:24.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.905+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fadb8088130 con 0x7fadc014e0d0 2023-08-27T11:27:24.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.906+0000 7fadbffff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 0x7fadac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:24.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.906+0000 7fadbffff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 0x7fadac06c5a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fadc014b810 tx=0x7fadb0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:24.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:24.910+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fadb8053770 con 0x7fadc014e0d0 2023-08-27T11:27:25.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.169+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadc0145280 con 0x7fadc014e0d0 2023-08-27T11:27:25.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.169+0000 7fadbcff9700 1 -- 172.21.15.43:0/2201659062 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4874 (secure 0 0 0) 0x7fadb8056d90 con 0x7fadc014e0d0 2023-08-27T11:27:25.171 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:25.171 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:23.511980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:25.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 msgr2=0x7fadac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 0x7fadac06c5a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fadc014b810 tx=0x7fadb0008030 comp rx=0 tx=0).stop 2023-08-27T11:27:25.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 msgr2=0x7fadc014a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fadb800cc70 tx=0x7fadb800a340 comp rx=0 tx=0).stop 2023-08-27T11:27:25.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 shutdown_connections 2023-08-27T11:27:25.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fadac06a0e0 0x7fadac06c5a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fadc014e0d0 0x7fadc014a540 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadc00c45c0 0x7fadc01ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 --2- 172.21.15.43:0/2201659062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadc00c4c40 0x7fadc014a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 >> 172.21.15.43:0/2201659062 conn(0x7fadc006aa50 msgr2=0x7fadc00c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:25.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 shutdown_connections 2023-08-27T11:27:25.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.172+0000 7fadc67ff700 1 -- 172.21.15.43:0/2201659062 wait complete. 2023-08-27T11:27:25.176 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 102 2023-08-27T11:27:25.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:25.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.392+0000 7f4ddd9ff700 1 Processor -- start 2023-08-27T11:27:25.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.392+0000 7f4ddd9ff700 1 -- start start 2023-08-27T11:27:25.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.393+0000 7f4ddd9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 0x7f4dd806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.393+0000 7f4ddd9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.393+0000 7f4ddd9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd80c1750 con 0x7f4dd8154da0 2023-08-27T11:27:25.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.393+0000 7f4ddd9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd80c2820 con 0x7f4dd814e380 2023-08-27T11:27:25.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.393+0000 7f4ddd9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8158910 con 0x7f4dd806dff0 2023-08-27T11:27:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 0x7f4dd806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:37612/0 (socket says 172.21.15.43:37612) 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 -- 172.21.15.43:0/3208535341 learned_addr learned my addr 172.21.15.43:0/3208535341 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd67fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4dd8154da0 0x7f4dd8158200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:59626/0 (socket says 172.21.15.43:59626) 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 -- 172.21.15.43:0/3208535341 >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 msgr2=0x7f4dd806ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 --2- 172.21.15.43:0/3208535341 >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 0x7f4dd806ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 -- 172.21.15.43:0/3208535341 >> v1:172.21.15.57:6789/0 conn(0x7f4dd8154da0 legacy=0x7f4dd8158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd77fe700 1 -- 172.21.15.43:0/3208535341 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd80c1a30 con 0x7f4dd806dff0 2023-08-27T11:27:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.394+0000 7f4dd6ffd700 1 --2- 172.21.15.43:0/3208535341 >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 0x7f4dd806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4dd77fe700 1 --2- 172.21.15.43:0/3208535341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009e50 tx=0x7f4dd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5e45f7e711f5aa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4dd5ffb700 1 -- 172.21.15.43:0/3208535341 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000e070 con 0x7f4dd806dff0 2023-08-27T11:27:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4dd5ffb700 1 -- 172.21.15.43:0/3208535341 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000b910 con 0x7f4dd806dff0 2023-08-27T11:27:25.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4dd5ffb700 1 -- 172.21.15.43:0/3208535341 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000bcc0 con 0x7f4dd806dff0 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/3208535341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 msgr2=0x7f4dd806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.395+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/3208535341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009e50 tx=0x7f4dd000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/3208535341 shutdown_connections 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/3208535341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd806dff0 0x7f4dd806e4a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/3208535341 >> v2:172.21.15.57:3300/0 conn(0x7f4dd814e380 0x7f4dd806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/3208535341 >> 172.21.15.43:0/3208535341 conn(0x7f4dd80c2c30 msgr2=0x7f4dd80c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/3208535341 shutdown_connections 2023-08-27T11:27:25.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.396+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/3208535341 wait complete. 2023-08-27T11:27:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.397+0000 7f4ddd9ff700 1 Processor -- start 2023-08-27T11:27:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.397+0000 7f4ddd9ff700 1 -- start start 2023-08-27T11:27:25.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dff0 0x7f4dd814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd8154da0 0x7f4dd8142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153ef0 con 0x7f4dd814e380 2023-08-27T11:27:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8157810 con 0x7f4dd806dff0 2023-08-27T11:27:25.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.398+0000 7f4ddd9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8153270 con 0x7f4dd8154da0 2023-08-27T11:27:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38080/0 (socket says 172.21.15.43:38080) 2023-08-27T11:27:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 -- 172.21.15.43:0/1763553411 learned_addr learned my addr 172.21.15.43:0/1763553411 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:25.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd6ffd700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dff0 0x7f4dd814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd77fe700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd8154da0 0x7f4dd8142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 -- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd8154da0 msgr2=0x7f4dd8142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd8154da0 0x7f4dd8142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 -- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dff0 msgr2=0x7f4dd814c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dff0 0x7f4dd814c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 -- 172.21.15.43:0/1763553411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80094a0 con 0x7f4dd814e380 2023-08-27T11:27:25.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.399+0000 7f4dd67fc700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c520 tx=0x7f4dcc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.400+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc005cb0 con 0x7f4dd814e380 2023-08-27T11:27:25.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.400+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc005e10 con 0x7f4dd814e380 2023-08-27T11:27:25.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.400+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0072d0 con 0x7f4dd814e380 2023-08-27T11:27:25.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.400+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd0009b30 con 0x7f4dd814e380 2023-08-27T11:27:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.400+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd8153830 con 0x7f4dd814e380 2023-08-27T11:27:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.401+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd814c7d0 con 0x7f4dd814e380 2023-08-27T11:27:25.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.402+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4dcc007430 con 0x7f4dd814e380 2023-08-27T11:27:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.403+0000 7f4dbffff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 0x7f4dc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.403+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f4dcc0878a0 con 0x7f4dd814e380 2023-08-27T11:27:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.403+0000 7f4dd6ffd700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 0x7f4dc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.404+0000 7f4dd6ffd700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 0x7f4dc406c5a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009d70 tx=0x7f4dc8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.407+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4dcc052f80 con 0x7f4dd814e380 2023-08-27T11:27:25.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.621+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dd8157980 con 0x7f4dd814e380 2023-08-27T11:27:25.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.622+0000 7f4dbffff700 1 -- 172.21.15.43:0/1763553411 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f4dcc0565a0 con 0x7f4dd814e380 2023-08-27T11:27:25.624 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:25.624 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":98,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:20.488761+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6834/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6836/863801259":"2023-08-28T11:27:17.448197+0000","172.21.15.43:6835/863801259":"2023-08-28T11:27:17.448197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:25.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 msgr2=0x7f4dc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 0x7f4dc406c5a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009d70 tx=0x7f4dc8009210 comp rx=0 tx=0).stop 2023-08-27T11:27:25.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 msgr2=0x7f4dd8155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00c520 tx=0x7f4dcc00c830 comp rx=0 tx=0).stop 2023-08-27T11:27:25.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 shutdown_connections 2023-08-27T11:27:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4dc406a0e0 0x7f4dc406c5a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dd8154da0 0x7f4dd8142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dd806dff0 0x7f4dd814c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 --2- 172.21.15.43:0/1763553411 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4dd814e380 0x7f4dd8155a10 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 >> 172.21.15.43:0/1763553411 conn(0x7f4dd80c2c30 msgr2=0x7f4dd80c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:25.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 shutdown_connections 2023-08-27T11:27:25.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.625+0000 7f4ddd9ff700 1 -- 172.21.15.43:0/1763553411 wait complete. 2023-08-27T11:27:25.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:26:54.182826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:26:54.837398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:27:25.646 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:27:25.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.849+0000 7f586f9ff700 1 Processor -- start 2023-08-27T11:27:25.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.849+0000 7f586f9ff700 1 -- start start 2023-08-27T11:27:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586f9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 0x7f58680c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586f9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58680c94c0 0x7f586815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586f9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58680c80c0 con 0x7f58680c49f0 2023-08-27T11:27:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586f9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58681555a0 con 0x7f58680c94c0 2023-08-27T11:27:25.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586f9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58681552c0 con 0x7f58680ac410 2023-08-27T11:27:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586cf9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 0x7f58680c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586df9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58680c94c0 0x7f586815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586d79b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f58680c49f0 0x7f5868151790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:59642/0 (socket says 172.21.15.43:59642) 2023-08-27T11:27:25.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.850+0000 7f586d79b700 1 -- 172.21.15.43:0/664477113 learned_addr learned my addr 172.21.15.43:0/664477113 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:25.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f585ffff700 1 -- 172.21.15.43:0/664477113 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498517740 0 0) 0x7f58680c80c0 con 0x7f58680c49f0 2023-08-27T11:27:25.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f585ffff700 1 -- 172.21.15.43:0/664477113 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58540035b0 con 0x7f58680c49f0 2023-08-27T11:27:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586df9c700 1 -- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 msgr2=0x7f58680c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586df9c700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 0x7f58680c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586df9c700 1 -- 172.21.15.43:0/664477113 >> v1:172.21.15.57:6789/0 conn(0x7f58680c49f0 legacy=0x7f5868151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586df9c700 1 -- 172.21.15.43:0/664477113 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680c8360 con 0x7f58680c94c0 2023-08-27T11:27:25.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586cf9a700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 0x7f58680c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.851+0000 7f586df9c700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680c94c0 0x7f586815eee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5860009d90 tx=0x7f586000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df4e3d1995e56d10 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f585ffff700 1 -- 172.21.15.43:0/664477113 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000e070 con 0x7f58680c94c0 2023-08-27T11:27:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f585ffff700 1 -- 172.21.15.43:0/664477113 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000bb20 con 0x7f58680c94c0 2023-08-27T11:27:25.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f585ffff700 1 -- 172.21.15.43:0/664477113 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012430 con 0x7f58680c94c0 2023-08-27T11:27:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 -- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680c94c0 msgr2=0x7f586815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680c94c0 0x7f586815eee0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5860009d90 tx=0x7f586000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 -- 172.21.15.43:0/664477113 shutdown_connections 2023-08-27T11:27:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680c94c0 0x7f586815eee0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 --2- 172.21.15.43:0/664477113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680ac410 0x7f58680c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 -- 172.21.15.43:0/664477113 >> 172.21.15.43:0/664477113 conn(0x7f58680ab8f0 msgr2=0x7f58680abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 -- 172.21.15.43:0/664477113 shutdown_connections 2023-08-27T11:27:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.852+0000 7f586f9ff700 1 -- 172.21.15.43:0/664477113 wait complete. 2023-08-27T11:27:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.854+0000 7f586f9ff700 1 Processor -- start 2023-08-27T11:27:25.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.854+0000 7f586f9ff700 1 -- start start 2023-08-27T11:27:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 0x7f5868158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680c49f0 0x7f58680c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868155950 con 0x7f58680c94c0 2023-08-27T11:27:25.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868153ec0 con 0x7f58680ac410 2023-08-27T11:27:25.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586f9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58681e9f60 con 0x7f58680c49f0 2023-08-27T11:27:25.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586df9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586df9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38096/0 (socket says 172.21.15.43:38096) 2023-08-27T11:27:25.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.855+0000 7f586df9c700 1 -- 172.21.15.43:0/508355158 learned_addr learned my addr 172.21.15.43:0/508355158 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:25.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586d79b700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 0x7f5868158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586cf9a700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680c49f0 0x7f58680c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 -- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680c49f0 msgr2=0x7f58680c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680c49f0 0x7f58680c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 -- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 msgr2=0x7f5868158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:25.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 0x7f5868158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 -- 172.21.15.43:0/508355158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580094a0 con 0x7f58680c94c0 2023-08-27T11:27:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586d79b700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 0x7f5868158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586df9c700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5860014040 tx=0x7f5860004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58600129f0 con 0x7f58680c94c0 2023-08-27T11:27:25.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860020070 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012db0 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.856+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860009a70 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.857+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58681ea520 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.858+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58680c89e0 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.858+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5860004040 con 0x7f58680c94c0 2023-08-27T11:27:25.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.859+0000 7f585dffb700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.859+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f5860022070 con 0x7f58680c94c0 2023-08-27T11:27:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.860+0000 7f586d79b700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.860+0000 7f586d79b700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 0x7f584c06c5a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58640011e0 tx=0x7f5864009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:25.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:25.864+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5860055800 con 0x7f58680c94c0 2023-08-27T11:27:26.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.073+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f586804ee70 con 0x7f58680c94c0 2023-08-27T11:27:26.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.073+0000 7f585dffb700 1 -- 172.21.15.43:0/508355158 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f586002c020 con 0x7f58680c94c0 2023-08-27T11:27:26.075 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:27:26.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 msgr2=0x7f584c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 0x7f584c06c5a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58640011e0 tx=0x7f5864009040 comp rx=0 tx=0).stop 2023-08-27T11:27:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 msgr2=0x7f58681e9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5860014040 tx=0x7f5860004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 shutdown_connections 2023-08-27T11:27:26.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f584c06a0e0 0x7f584c06c5a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f58680c94c0 0x7f58681e9710 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58680ac410 0x7f5868158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 --2- 172.21.15.43:0/508355158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58680c49f0 0x7f58680c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 >> 172.21.15.43:0/508355158 conn(0x7f58680ab8f0 msgr2=0x7f5868150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 shutdown_connections 2023-08-27T11:27:26.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.076+0000 7f586f9ff700 1 -- 172.21.15.43:0/508355158 wait complete. 2023-08-27T11:27:26.095 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:27:26.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.298+0000 7f7e483ff700 1 Processor -- start 2023-08-27T11:27:26.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.298+0000 7f7e483ff700 1 -- start start 2023-08-27T11:27:26.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e483ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7e40151d20 0x7f7e400c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e483ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e4006a8e0 0x7f7e4006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e483ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e40154660 con 0x7f7e400c7c00 2023-08-27T11:27:26.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e483ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e400c5750 con 0x7f7e40151d20 2023-08-27T11:27:26.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e483ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e40154940 con 0x7f7e4006a8e0 2023-08-27T11:27:26.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e4619b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7e40151d20 0x7f7e400c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e4619b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7e40151d20 0x7f7e400c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38100/0 (socket says 172.21.15.43:38100) 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e4619b700 1 -- 172.21.15.43:0/1954632946 learned_addr learned my addr 172.21.15.43:0/1954632946 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.299+0000 7f7e4699c700 1 --2- 172.21.15.43:0/1954632946 >> v2:172.21.15.57:3300/0 conn(0x7f7e4006a8e0 0x7f7e4006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e4619b700 1 -- 172.21.15.43:0/1954632946 >> v2:172.21.15.57:3300/0 conn(0x7f7e4006a8e0 msgr2=0x7f7e4006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e4619b700 1 --2- 172.21.15.43:0/1954632946 >> v2:172.21.15.57:3300/0 conn(0x7f7e4006a8e0 0x7f7e4006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e4619b700 1 -- 172.21.15.43:0/1954632946 >> v1:172.21.15.57:6789/0 conn(0x7f7e400c7c00 legacy=0x7f7e400ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e4619b700 1 -- 172.21.15.43:0/1954632946 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40154c20 con 0x7f7e40151d20 2023-08-27T11:27:26.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e4619b700 1 --2- 172.21.15.43:0/1954632946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e40151d20 0x7f7e400c8110 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c4250 tx=0x7f7e3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684e11e819bc984c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e45199700 1 -- 172.21.15.43:0/1954632946 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c011830 con 0x7f7e40151d20 2023-08-27T11:27:26.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e45199700 1 -- 172.21.15.43:0/1954632946 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c011990 con 0x7f7e40151d20 2023-08-27T11:27:26.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.300+0000 7f7e45199700 1 -- 172.21.15.43:0/1954632946 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c011d20 con 0x7f7e40151d20 2023-08-27T11:27:26.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 -- 172.21.15.43:0/1954632946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e40151d20 msgr2=0x7f7e400c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 --2- 172.21.15.43:0/1954632946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e40151d20 0x7f7e400c8110 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c4250 tx=0x7f7e3c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 -- 172.21.15.43:0/1954632946 shutdown_connections 2023-08-27T11:27:26.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 --2- 172.21.15.43:0/1954632946 >> v2:172.21.15.57:3300/0 conn(0x7f7e4006a8e0 0x7f7e4006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 --2- 172.21.15.43:0/1954632946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e40151d20 0x7f7e400c8110 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 -- 172.21.15.43:0/1954632946 >> 172.21.15.43:0/1954632946 conn(0x7f7e400c9d00 msgr2=0x7f7e400ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:26.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 -- 172.21.15.43:0/1954632946 shutdown_connections 2023-08-27T11:27:26.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.301+0000 7f7e483ff700 1 -- 172.21.15.43:0/1954632946 wait complete. 2023-08-27T11:27:26.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.303+0000 7f7e483ff700 1 Processor -- start 2023-08-27T11:27:26.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.303+0000 7f7e483ff700 1 -- start start 2023-08-27T11:27:26.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e4006a8e0 0x7f7e400c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e40151d20 0x7f7e401ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40151320 con 0x7f7e400c7c00 2023-08-27T11:27:26.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40153f80 con 0x7f7e40151d20 2023-08-27T11:27:26.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e483ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40154260 con 0x7f7e4006a8e0 2023-08-27T11:27:26.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38116/0 (socket says 172.21.15.43:38116) 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 -- 172.21.15.43:0/3535015201 learned_addr learned my addr 172.21.15.43:0/3535015201 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4619b700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e4006a8e0 0x7f7e400c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4699c700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e40151d20 0x7f7e401ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 -- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e4006a8e0 msgr2=0x7f7e400c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e4006a8e0 0x7f7e400c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 -- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e40151d20 msgr2=0x7f7e401ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e40151d20 0x7f7e401ed1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.304+0000 7f7e4599a700 1 -- 172.21.15.43:0/3535015201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009550 con 0x7f7e400c7c00 2023-08-27T11:27:26.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e4599a700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c4e0 tx=0x7f7e3000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300052d0 con 0x7f7e400c7c00 2023-08-27T11:27:26.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30005430 con 0x7f7e400c7c00 2023-08-27T11:27:26.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e40152db0 con 0x7f7e400c7c00 2023-08-27T11:27:26.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300038c0 con 0x7f7e400c7c00 2023-08-27T11:27:26.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.305+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e40153370 con 0x7f7e400c7c00 2023-08-27T11:27:26.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.306+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4004ee70 con 0x7f7e400c7c00 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.307+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e30003a20 con 0x7f7e400c7c00 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.308+0000 7f7e36ffd700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 0x7f7e2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.308+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f7e30087990 con 0x7f7e400c7c00 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.308+0000 7f7e4619b700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 0x7f7e2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.309+0000 7f7e4619b700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 0x7f7e2406c5a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c014040 tx=0x7f7e3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.312+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e30052fc0 con 0x7f7e400c7c00 2023-08-27T11:27:26.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.523+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e40158970 con 0x7f7e400c7c00 2023-08-27T11:27:26.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.524+0000 7f7e36ffd700 1 -- 172.21.15.43:0/3535015201 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e30017020 con 0x7f7e400c7c00 2023-08-27T11:27:26.526 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:27:26.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 msgr2=0x7f7e2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 0x7f7e2406c5a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c014040 tx=0x7f7e3c008030 comp rx=0 tx=0).stop 2023-08-27T11:27:26.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 msgr2=0x7f7e400c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f7e3000c4e0 tx=0x7f7e3000c7f0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 shutdown_connections 2023-08-27T11:27:26.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e2406a0e0 0x7f7e2406c5a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e40151d20 0x7f7e401ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e4006a8e0 0x7f7e400c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 --2- 172.21.15.43:0/3535015201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e400c7c00 0x7f7e400c3660 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 >> 172.21.15.43:0/3535015201 conn(0x7f7e400c9d00 msgr2=0x7f7e4006acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:26.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 shutdown_connections 2023-08-27T11:27:26.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.526+0000 7f7e483ff700 1 -- 172.21.15.43:0/3535015201 wait complete. 2023-08-27T11:27:26.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:27:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.749+0000 7f5367dff700 1 Processor -- start 2023-08-27T11:27:26.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.749+0000 7f5367dff700 1 -- start start 2023-08-27T11:27:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.750+0000 7f5367dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53600c5230 0x7f536006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5367dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5360152290 con 0x7f5360155880 2023-08-27T11:27:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5367dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536006d7a0 con 0x7f536006c5e0 2023-08-27T11:27:26.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5367dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5360152550 con 0x7f53600c5230 2023-08-27T11:27:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f536639c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5360155880 0x7f5360155c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42678/0 (socket says 172.21.15.43:42678) 2023-08-27T11:27:26.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f536639c700 1 -- 172.21.15.43:0/1261282385 learned_addr learned my addr 172.21.15.43:0/1261282385 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5365b9b700 1 --2- 172.21.15.43:0/1261282385 >> v2:172.21.15.57:3300/0 conn(0x7f53600c5230 0x7f536006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510683103 0 0) 0x7f5360152290 con 0x7f5360155880 2023-08-27T11:27:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f534c0035b0 con 0x7f5360155880 2023-08-27T11:27:26.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295875565 0 0) 0x7f536006d7a0 con 0x7f536006c5e0 2023-08-27T11:27:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5360152290 con 0x7f536006c5e0 2023-08-27T11:27:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.751+0000 7f5365b9b700 1 -- 172.21.15.43:0/1261282385 >> v1:172.21.15.57:6789/0 conn(0x7f536006c5e0 legacy=0x7f53600aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5365b9b700 1 -- 172.21.15.43:0/1261282385 >> v1:172.21.15.43:6789/0 conn(0x7f5360155880 legacy=0x7f5360155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5365b9b700 1 -- 172.21.15.43:0/1261282385 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360152830 con 0x7f53600c5230 2023-08-27T11:27:26.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5365b9b700 1 --2- 172.21.15.43:0/1261282385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53600c5230 0x7f536006d1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f535c009840 tx=0x7f535c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669dfd7a026264c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c011830 con 0x7f53600c5230 2023-08-27T11:27:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c011990 con 0x7f53600c5230 2023-08-27T11:27:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.752+0000 7f5364b99700 1 -- 172.21.15.43:0/1261282385 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c011d20 con 0x7f53600c5230 2023-08-27T11:27:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 -- 172.21.15.43:0/1261282385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53600c5230 msgr2=0x7f536006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 --2- 172.21.15.43:0/1261282385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53600c5230 0x7f536006d1c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f535c009840 tx=0x7f535c009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 -- 172.21.15.43:0/1261282385 shutdown_connections 2023-08-27T11:27:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 --2- 172.21.15.43:0/1261282385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53600c5230 0x7f536006d1c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 -- 172.21.15.43:0/1261282385 >> 172.21.15.43:0/1261282385 conn(0x7f53600c5b10 msgr2=0x7f53600c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 -- 172.21.15.43:0/1261282385 shutdown_connections 2023-08-27T11:27:26.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.753+0000 7f5367dff700 1 -- 172.21.15.43:0/1261282385 wait complete. 2023-08-27T11:27:26.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.755+0000 7f5367dff700 1 Processor -- start 2023-08-27T11:27:26.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.755+0000 7f5367dff700 1 -- start start 2023-08-27T11:27:26.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53600c5230 0x7f5360154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5360155880 0x7f53601eada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536014f2b0 con 0x7f536006c5e0 2023-08-27T11:27:26.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600c2e40 con 0x7f5360155880 2023-08-27T11:27:26.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5367dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5360154030 con 0x7f53600c5230 2023-08-27T11:27:26.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38128/0 (socket says 172.21.15.43:38128) 2023-08-27T11:27:26.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 -- 172.21.15.43:0/2831178954 learned_addr learned my addr 172.21.15.43:0/2831178954 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:26.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f536639c700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5360155880 0x7f53601eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f536539a700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53600c5230 0x7f5360154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 -- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53600c5230 msgr2=0x7f5360154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53600c5230 0x7f5360154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 -- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5360155880 msgr2=0x7f53601eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5360155880 0x7f53601eada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.756+0000 7f5365b9b700 1 -- 172.21.15.43:0/2831178954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c0094a0 con 0x7f536006c5e0 2023-08-27T11:27:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f5365b9b700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f535c0090b0 tx=0x7f535c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c01a8f0 con 0x7f536006c5e0 2023-08-27T11:27:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c01aa50 con 0x7f536006c5e0 2023-08-27T11:27:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601545f0 con 0x7f536006c5e0 2023-08-27T11:27:26.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c01ade0 con 0x7f536006c5e0 2023-08-27T11:27:26.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.757+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5360154fc0 con 0x7f536006c5e0 2023-08-27T11:27:26.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.758+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53601548d0 con 0x7f536006c5e0 2023-08-27T11:27:26.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.759+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f535c02d450 con 0x7f536006c5e0 2023-08-27T11:27:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.760+0000 7f53567fc700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 0x7f534406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.760+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f535c089800 con 0x7f536006c5e0 2023-08-27T11:27:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.760+0000 7f536539a700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 0x7f534406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:26.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.761+0000 7f536539a700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 0x7f534406c5a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5360072980 tx=0x7f5350009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:26.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.765+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f535c054ed0 con 0x7f536006c5e0 2023-08-27T11:27:26.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.972+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f536004ee70 con 0x7f536006c5e0 2023-08-27T11:27:26.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.972+0000 7f53567fc700 1 -- 172.21.15.43:0/2831178954 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) v1 ==== 104+0+11 (secure 0 0 0) 0x7f535c0584f0 con 0x7f536006c5e0 2023-08-27T11:27:26.974 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:27:26.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.974+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 msgr2=0x7f534406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.974+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 0x7f534406c5a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5360072980 tx=0x7f5350009040 comp rx=0 tx=0).stop 2023-08-27T11:27:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.974+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 msgr2=0x7f53601551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.974+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f535c0090b0 tx=0x7f535c004750 comp rx=0 tx=0).stop 2023-08-27T11:27:26.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 shutdown_connections 2023-08-27T11:27:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534406a0e0 0x7f534406c5a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5360155880 0x7f53601eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f536006c5e0 0x7f53601551d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 --2- 172.21.15.43:0/2831178954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53600c5230 0x7f5360154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:26.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 >> 172.21.15.43:0/2831178954 conn(0x7f53600c5b10 msgr2=0x7f53600a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 shutdown_connections 2023-08-27T11:27:26.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:26.975+0000 7f5367dff700 1 -- 172.21.15.43:0/2831178954 wait complete. 2023-08-27T11:27:26.994 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:27:27.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.198+0000 7f9b31fff700 1 Processor -- start 2023-08-27T11:27:27.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.198+0000 7f9b31fff700 1 -- start start 2023-08-27T11:27:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b2c151d20 0x7f9b2c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 0x7f9b2c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9b2c0abcc0 0x7f9b2c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c5750 con 0x7f9b2c151d20 2023-08-27T11:27:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c154660 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.199+0000 7f9b31fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c154940 con 0x7f9b2c0c7c00 2023-08-27T11:27:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b2c151d20 0x7f9b2c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9b2c151d20 0x7f9b2c0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38138/0 (socket says 172.21.15.43:38138) 2023-08-27T11:27:27.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/666802455 learned_addr learned my addr 172.21.15.43:0/666802455 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2affd700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 0x7f9b2c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2bfff700 1 --2- 172.21.15.43:0/666802455 >> v2:172.21.15.57:3300/0 conn(0x7f9b2c0abcc0 0x7f9b2c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/666802455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 msgr2=0x7f9b2c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 0x7f9b2c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/666802455 >> v2:172.21.15.57:3300/0 conn(0x7f9b2c0abcc0 msgr2=0x7f9b2c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/666802455 >> v2:172.21.15.57:3300/0 conn(0x7f9b2c0abcc0 0x7f9b2c06a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/666802455 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c154c20 con 0x7f9b2c151d20 2023-08-27T11:27:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2affd700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 0x7f9b2c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:27.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c151d20 0x7f9b2c0c8110 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c158be0 tx=0x7f9b1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b497d6e8e6e020c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.200+0000 7f9b2a7fc700 1 -- 172.21.15.43:0/666802455 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00b870 con 0x7f9b2c151d20 2023-08-27T11:27:27.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b2a7fc700 1 -- 172.21.15.43:0/666802455 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00b9d0 con 0x7f9b2c151d20 2023-08-27T11:27:27.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b2a7fc700 1 -- 172.21.15.43:0/666802455 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00bd60 con 0x7f9b2c151d20 2023-08-27T11:27:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 -- 172.21.15.43:0/666802455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c151d20 msgr2=0x7f9b2c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c151d20 0x7f9b2c0c8110 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c158be0 tx=0x7f9b1c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 -- 172.21.15.43:0/666802455 shutdown_connections 2023-08-27T11:27:27.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 --2- 172.21.15.43:0/666802455 >> v2:172.21.15.57:3300/0 conn(0x7f9b2c0abcc0 0x7f9b2c06a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c151d20 0x7f9b2c0c8110 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 --2- 172.21.15.43:0/666802455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c0c7c00 0x7f9b2c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 -- 172.21.15.43:0/666802455 >> 172.21.15.43:0/666802455 conn(0x7f9b2c0c9d00 msgr2=0x7f9b2c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 -- 172.21.15.43:0/666802455 shutdown_connections 2023-08-27T11:27:27.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.201+0000 7f9b31fff700 1 -- 172.21.15.43:0/666802455 wait complete. 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.203+0000 7f9b31fff700 1 Processor -- start 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.203+0000 7f9b31fff700 1 -- start start 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 0x7f9b2c1ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c151d20 0x7f9b2c06ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c2cd0 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c2430 con 0x7f9b2c0c7c00 2023-08-27T11:27:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b31fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0c1e20 con 0x7f9b2c151d20 2023-08-27T11:27:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b2b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38144/0 (socket says 172.21.15.43:38144) 2023-08-27T11:27:27.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/204244647 learned_addr learned my addr 172.21.15.43:0/204244647 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b2affd700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 0x7f9b2c1ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.204+0000 7f9b2bfff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c151d20 0x7f9b2c06ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c151d20 msgr2=0x7f9b2c06ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c151d20 0x7f9b2c06ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 msgr2=0x7f9b2c1ecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 0x7f9b2c1ecce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 -- 172.21.15.43:0/204244647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c009550 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2affd700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 0x7f9b2c1ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b2b7fe700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000c00 tx=0x7f9b1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c004520 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c01e070 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2c0ab690 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0038c0 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.205+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c06b090 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.206+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c04ee70 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.207+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9b1c003a20 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.209+0000 7f9b13fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 0x7f9b1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.209+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f9b1c020070 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.209+0000 7f9b2affd700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 0x7f9b1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.210+0000 7f9b2affd700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 0x7f9b1806c5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0c0ad0 tx=0x7f9b20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.213+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9b1c055230 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.425+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9b2c14df50 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.425+0000 7f9b13fff700 1 -- 172.21.15.43:0/204244647 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9b1c0150a0 con 0x7f9b2c0abcc0 2023-08-27T11:27:27.427 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:27:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.427+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 msgr2=0x7f9b1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.427+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 0x7f9b1806c5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0c0ad0 tx=0x7f9b20008040 comp rx=0 tx=0).stop 2023-08-27T11:27:27.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.427+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 msgr2=0x7f9b2c153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.427+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c000c00 tx=0x7f9b1c004750 comp rx=0 tx=0).stop 2023-08-27T11:27:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 shutdown_connections 2023-08-27T11:27:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9b1806a0e0 0x7f9b1806c5a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9b2c151d20 0x7f9b2c06ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9b2c0abcc0 0x7f9b2c153e20 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 --2- 172.21.15.43:0/204244647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9b2c0c7c00 0x7f9b2c1ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 >> 172.21.15.43:0/204244647 conn(0x7f9b2c0c9d00 msgr2=0x7f9b2c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 shutdown_connections 2023-08-27T11:27:27.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.428+0000 7f9b31fff700 1 -- 172.21.15.43:0/204244647 wait complete. 2023-08-27T11:27:27.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:27.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.648+0000 7f2e9d1ff700 1 Processor -- start 2023-08-27T11:27:27.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.648+0000 7f2e9d1ff700 1 -- start start 2023-08-27T11:27:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 0x7f2e9806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9d1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9806d700 con 0x7f2e9806ca60 2023-08-27T11:27:27.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9d1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e98152430 con 0x7f2e98155910 2023-08-27T11:27:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e981530b0 con 0x7f2e980c51a0 2023-08-27T11:27:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2e9806ca60 0x7f2e980aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42688/0 (socket says 172.21.15.43:42688) 2023-08-27T11:27:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e9659c700 1 -- 172.21.15.43:0/176404743 learned_addr learned my addr 172.21.15.43:0/176404743 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:27.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e96d9d700 1 --2- 172.21.15.43:0/176404743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 0x7f2e9806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463417958 0 0) 0x7f2e9806d700 con 0x7f2e9806ca60 2023-08-27T11:27:27.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e800035b0 con 0x7f2e9806ca60 2023-08-27T11:27:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139289107 0 0) 0x7f2e98152430 con 0x7f2e98155910 2023-08-27T11:27:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.650+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9806d700 con 0x7f2e98155910 2023-08-27T11:27:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e96d9d700 1 -- 172.21.15.43:0/176404743 >> v1:172.21.15.57:6789/0 conn(0x7f2e98155910 legacy=0x7f2e98155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e96d9d700 1 -- 172.21.15.43:0/176404743 >> v1:172.21.15.43:6789/0 conn(0x7f2e9806ca60 legacy=0x7f2e980aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e96d9d700 1 -- 172.21.15.43:0/176404743 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98152710 con 0x7f2e980c51a0 2023-08-27T11:27:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e96d9d700 1 --2- 172.21.15.43:0/176404743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 0x7f2e9806d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54b03fc52b959b69 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88011830 con 0x7f2e980c51a0 2023-08-27T11:27:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88011990 con 0x7f2e980c51a0 2023-08-27T11:27:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.651+0000 7f2e95d9b700 1 -- 172.21.15.43:0/176404743 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88011d20 con 0x7f2e980c51a0 2023-08-27T11:27:27.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/176404743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 msgr2=0x7f2e9806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/176404743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 0x7f2e9806d1c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009870 tx=0x7f2e88009b80 comp rx=0 tx=0).stop 2023-08-27T11:27:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/176404743 shutdown_connections 2023-08-27T11:27:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/176404743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e980c51a0 0x7f2e9806d1c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/176404743 >> 172.21.15.43:0/176404743 conn(0x7f2e9806aa50 msgr2=0x7f2e980c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:27.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/176404743 shutdown_connections 2023-08-27T11:27:27.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.652+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/176404743 wait complete. 2023-08-27T11:27:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.653+0000 7f2e9d1ff700 1 Processor -- start 2023-08-27T11:27:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.654+0000 7f2e9d1ff700 1 -- start start 2023-08-27T11:27:27.660 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.654+0000 7f2e9d1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.654+0000 7f2e9d1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 0x7f2e98147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e98155910 0x7f2e98148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9d1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980bd7b0 con 0x7f2e9806ca60 2023-08-27T11:27:27.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9d1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e981eb190 con 0x7f2e980c51a0 2023-08-27T11:27:27.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e981eb680 con 0x7f2e98155910 2023-08-27T11:27:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38158/0 (socket says 172.21.15.43:38158) 2023-08-27T11:27:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 -- 172.21.15.43:0/1918176262 learned_addr learned my addr 172.21.15.43:0/1918176262 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 -- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e98155910 msgr2=0x7f2e98148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9659c700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 0x7f2e98147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e98155910 0x7f2e98148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 -- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 msgr2=0x7f2e98147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 0x7f2e98147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 -- 172.21.15.43:0/1918176262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880094a0 con 0x7f2e9806ca60 2023-08-27T11:27:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e9659c700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 0x7f2e98147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:27.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.655+0000 7f2e96d9d700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.656+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8801a860 con 0x7f2e9806ca60 2023-08-27T11:27:27.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.656+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8801a9c0 con 0x7f2e9806ca60 2023-08-27T11:27:27.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.656+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8801ad30 con 0x7f2e9806ca60 2023-08-27T11:27:27.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.656+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e980a7e10 con 0x7f2e9806ca60 2023-08-27T11:27:27.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.656+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e980a80b0 con 0x7f2e9806ca60 2023-08-27T11:27:27.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.657+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9814c840 con 0x7f2e9806ca60 2023-08-27T11:27:27.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.658+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e88022070 con 0x7f2e9806ca60 2023-08-27T11:27:27.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.659+0000 7f2e7f7fe700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 0x7f2e8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:27.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.659+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f2e88089250 con 0x7f2e9806ca60 2023-08-27T11:27:27.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.659+0000 7f2e9659c700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 0x7f2e8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:27.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.660+0000 7f2e9659c700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 0x7f2e8406c5a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2e9814b660 tx=0x7f2e8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:27.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.663+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e9814c840 con 0x7f2e9806ca60 2023-08-27T11:27:27.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.921+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e980a82f0 con 0x7f2e9806ca60 2023-08-27T11:27:27.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.921+0000 7f2e7f7fe700 1 -- 172.21.15.43:0/1918176262 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4874 (secure 0 0 0) 0x7f2e980a82f0 con 0x7f2e9806ca60 2023-08-27T11:27:27.923 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:27.923 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:23.511980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:27.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 msgr2=0x7f2e8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 0x7f2e8406c5a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2e9814b660 tx=0x7f2e8c009040 comp rx=0 tx=0).stop 2023-08-27T11:27:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 msgr2=0x7f2e980bcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2e880090b0 tx=0x7f2e88004750 comp rx=0 tx=0).stop 2023-08-27T11:27:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 shutdown_connections 2023-08-27T11:27:27.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e8406a0e0 0x7f2e8406c5a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e98155910 0x7f2e98148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e9806ca60 0x7f2e980bcb50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 --2- 172.21.15.43:0/1918176262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e980c51a0 0x7f2e98147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 >> 172.21.15.43:0/1918176262 conn(0x7f2e9806aa50 msgr2=0x7f2e98155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:27.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 shutdown_connections 2023-08-27T11:27:27.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:27.924+0000 7f2e9d1ff700 1 -- 172.21.15.43:0/1918176262 wait complete. 2023-08-27T11:27:27.928 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 102 2023-08-27T11:27:27.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:28.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.143+0000 7f22d0dff700 1 Processor -- start 2023-08-27T11:27:28.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.143+0000 7f22d0dff700 1 -- start start 2023-08-27T11:27:28.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22d0dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f22cc151a90 0x7f22cc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22d0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc0c4630 0x7f22cc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22d0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc06c4e0 con 0x7f22cc06ad70 2023-08-27T11:27:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22d0dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc155370 con 0x7f22cc151a90 2023-08-27T11:27:28.150 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22d0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc151e70 con 0x7f22cc0c4630 2023-08-27T11:27:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22cad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f22cc06ad70 0x7f22cc06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42704/0 (socket says 172.21.15.43:42704) 2023-08-27T11:27:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22cad9d700 1 -- 172.21.15.43:0/2106647754 learned_addr learned my addr 172.21.15.43:0/2106647754 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.144+0000 7f22ca59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f22cc151a90 0x7f22cc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.151 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22c9d9b700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc0c4630 0x7f22cc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22c959a700 1 -- 172.21.15.43:0/2106647754 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396877482 0 0) 0x7f22cc06c4e0 con 0x7f22cc06ad70 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22ca59c700 1 -- 172.21.15.43:0/2106647754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc0c4630 msgr2=0x7f22cc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22ca59c700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc0c4630 0x7f22cc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22ca59c700 1 -- 172.21.15.43:0/2106647754 >> v1:172.21.15.43:6789/0 conn(0x7f22cc06ad70 legacy=0x7f22cc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22ca59c700 1 -- 172.21.15.43:0/2106647754 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc154480 con 0x7f22cc151a90 2023-08-27T11:27:28.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22ca59c700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc151a90 0x7f22cc0c7bb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009840 tx=0x7f22bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d8d64e9c59cde1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.145+0000 7f22c959a700 1 -- 172.21.15.43:0/2106647754 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011830 con 0x7f22cc151a90 2023-08-27T11:27:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22c959a700 1 -- 172.21.15.43:0/2106647754 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc011990 con 0x7f22cc151a90 2023-08-27T11:27:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22c959a700 1 -- 172.21.15.43:0/2106647754 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011d20 con 0x7f22cc151a90 2023-08-27T11:27:28.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 -- 172.21.15.43:0/2106647754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc151a90 msgr2=0x7f22cc0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc151a90 0x7f22cc0c7bb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009840 tx=0x7f22bc009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 -- 172.21.15.43:0/2106647754 shutdown_connections 2023-08-27T11:27:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc151a90 0x7f22cc0c7bb0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 --2- 172.21.15.43:0/2106647754 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc0c4630 0x7f22cc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 -- 172.21.15.43:0/2106647754 >> 172.21.15.43:0/2106647754 conn(0x7f22cc0ab820 msgr2=0x7f22cc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 -- 172.21.15.43:0/2106647754 shutdown_connections 2023-08-27T11:27:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.146+0000 7f22d0dff700 1 -- 172.21.15.43:0/2106647754 wait complete. 2023-08-27T11:27:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.148+0000 7f22d0dff700 1 Processor -- start 2023-08-27T11:27:28.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.148+0000 7f22d0dff700 1 -- start start 2023-08-27T11:27:28.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 0x7f22cc148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc151a90 0x7f22cc1ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc1e9bc0 con 0x7f22cc0c4630 2023-08-27T11:27:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c0f20 con 0x7f22cc151a90 2023-08-27T11:27:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22d0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c1200 con 0x7f22cc06ad70 2023-08-27T11:27:28.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22c9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22c9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38176/0 (socket says 172.21.15.43:38176) 2023-08-27T11:27:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22c9d9b700 1 -- 172.21.15.43:0/1242390733 learned_addr learned my addr 172.21.15.43:0/1242390733 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22ca59c700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 0x7f22cc148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.149+0000 7f22cad9d700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc151a90 0x7f22cc1ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 -- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 msgr2=0x7f22cc148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 0x7f22cc148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 -- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc151a90 msgr2=0x7f22cc1ea550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc151a90 0x7f22cc1ea550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 -- 172.21.15.43:0/1242390733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0094a0 con 0x7f22cc0c4630 2023-08-27T11:27:28.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22ca59c700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 0x7f22cc148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22c9d9b700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f22c000e9b0 tx=0x7f22c000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0009710 con 0x7f22cc0c4630 2023-08-27T11:27:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000c850 con 0x7f22cc0c4630 2023-08-27T11:27:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000cbc0 con 0x7f22cc0c4630 2023-08-27T11:27:28.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc1edb40 con 0x7f22cc0c4630 2023-08-27T11:27:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.150+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc1491a0 con 0x7f22cc0c4630 2023-08-27T11:27:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.151+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc1ed970 con 0x7f22cc0c4630 2023-08-27T11:27:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.152+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22c000cd20 con 0x7f22cc0c4630 2023-08-27T11:27:28.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.153+0000 7f22baffd700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 0x7f22ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.153+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f22c0088860 con 0x7f22cc0c4630 2023-08-27T11:27:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.153+0000 7f22ca59c700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 0x7f22ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.154+0000 7f22ca59c700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 0x7f22ac06c5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0090b0 tx=0x7f22bc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.158+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f22c0057800 con 0x7f22cc0c4630 2023-08-27T11:27:28.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.369+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22cc150f30 con 0x7f22cc0c4630 2023-08-27T11:27:28.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.370+0000 7f22baffd700 1 -- 172.21.15.43:0/1242390733 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f22c0057390 con 0x7f22cc0c4630 2023-08-27T11:27:28.372 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:28.373 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":98,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:20.488761+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6834/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6836/863801259":"2023-08-28T11:27:17.448197+0000","172.21.15.43:6835/863801259":"2023-08-28T11:27:17.448197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:28.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 msgr2=0x7f22ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 0x7f22ac06c5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0090b0 tx=0x7f22bc01c040 comp rx=0 tx=0).stop 2023-08-27T11:27:28.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 msgr2=0x7f22cc1ea010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f22c000e9b0 tx=0x7f22c000ed70 comp rx=0 tx=0).stop 2023-08-27T11:27:28.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 shutdown_connections 2023-08-27T11:27:28.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f22ac06a0e0 0x7f22ac06c5a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22cc151a90 0x7f22cc1ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22cc06ad70 0x7f22cc148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 --2- 172.21.15.43:0/1242390733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f22cc0c4630 0x7f22cc1ea010 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 >> 172.21.15.43:0/1242390733 conn(0x7f22cc0ab820 msgr2=0x7f22cc150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:28.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 shutdown_connections 2023-08-27T11:27:28.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.373+0000 7f22d0dff700 1 -- 172.21.15.43:0/1242390733 wait complete. 2023-08-27T11:27:28.393 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:27:28.394 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:28.466 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:27:28.465+0000 7f3d6b9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.596+0000 7fd5e85ff700 1 Processor -- start 2023-08-27T11:27:28.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.596+0000 7fd5e85ff700 1 -- start start 2023-08-27T11:27:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e85ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd5e0151a90 0x7fd5e00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e85ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5e00c4630 0x7fd5e00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e85ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e006c4e0 con 0x7fd5e006ad70 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e85ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e0155370 con 0x7fd5e00c4630 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e85ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e0151e70 con 0x7fd5e0151a90 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e5b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5e00c4630 0x7fd5e00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e5b9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5e00c4630 0x7fd5e00c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38182/0 (socket says 172.21.15.43:38182) 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e5b9a700 1 -- 172.21.15.43:0/4080736472 learned_addr learned my addr 172.21.15.43:0/4080736472 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:28.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.597+0000 7fd5e639b700 1 --2- 172.21.15.43:0/4080736472 >> v2:172.21.15.57:3300/0 conn(0x7fd5e0151a90 0x7fd5e00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5b9a700 1 -- 172.21.15.43:0/4080736472 >> v2:172.21.15.57:3300/0 conn(0x7fd5e0151a90 msgr2=0x7fd5e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:28.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5b9a700 1 --2- 172.21.15.43:0/4080736472 >> v2:172.21.15.57:3300/0 conn(0x7fd5e0151a90 0x7fd5e00c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5b9a700 1 -- 172.21.15.43:0/4080736472 >> v1:172.21.15.57:6789/0 conn(0x7fd5e006ad70 legacy=0x7fd5e006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5b9a700 1 -- 172.21.15.43:0/4080736472 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0154480 con 0x7fd5e00c4630 2023-08-27T11:27:28.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5b9a700 1 --2- 172.21.15.43:0/4080736472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e00c4630 0x7fd5e00c4a90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0067710 tx=0x7fd5d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8632c29444404ffa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5399700 1 -- 172.21.15.43:0/4080736472 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0011830 con 0x7fd5e00c4630 2023-08-27T11:27:28.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5399700 1 -- 172.21.15.43:0/4080736472 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0011990 con 0x7fd5e00c4630 2023-08-27T11:27:28.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.598+0000 7fd5e5399700 1 -- 172.21.15.43:0/4080736472 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0011d20 con 0x7fd5e00c4630 2023-08-27T11:27:28.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 -- 172.21.15.43:0/4080736472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e00c4630 msgr2=0x7fd5e00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/4080736472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e00c4630 0x7fd5e00c4a90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0067710 tx=0x7fd5d0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 -- 172.21.15.43:0/4080736472 shutdown_connections 2023-08-27T11:27:28.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/4080736472 >> v2:172.21.15.57:3300/0 conn(0x7fd5e0151a90 0x7fd5e00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/4080736472 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e00c4630 0x7fd5e00c4a90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 -- 172.21.15.43:0/4080736472 >> 172.21.15.43:0/4080736472 conn(0x7fd5e00ab820 msgr2=0x7fd5e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:28.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 -- 172.21.15.43:0/4080736472 shutdown_connections 2023-08-27T11:27:28.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.599+0000 7fd5e85ff700 1 -- 172.21.15.43:0/4080736472 wait complete. 2023-08-27T11:27:28.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.602+0000 7fd5e85ff700 1 Processor -- start 2023-08-27T11:27:28.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.602+0000 7fd5e85ff700 1 -- start start 2023-08-27T11:27:28.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e00c4630 0x7fd5e014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5e0151a90 0x7fd5e00bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00aa600 con 0x7fd5e006ad70 2023-08-27T11:27:28.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00ab100 con 0x7fd5e00c4630 2023-08-27T11:27:28.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e85ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00aab40 con 0x7fd5e0151a90 2023-08-27T11:27:28.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38188/0 (socket says 172.21.15.43:38188) 2023-08-27T11:27:28.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 -- 172.21.15.43:0/922013371 learned_addr learned my addr 172.21.15.43:0/922013371 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:28.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e5b9a700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e00c4630 0x7fd5e014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e6b9c700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5e0151a90 0x7fd5e00bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 -- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5e0151a90 msgr2=0x7fd5e00bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5e0151a90 0x7fd5e00bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 -- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e00c4630 msgr2=0x7fd5e014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e00c4630 0x7fd5e014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.604+0000 7fd5e639b700 1 -- 172.21.15.43:0/922013371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009550 con 0x7fd5e006ad70 2023-08-27T11:27:28.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5e639b700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e870 tx=0x7fd5dc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc009590 con 0x7fd5e006ad70 2023-08-27T11:27:28.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00ee70 con 0x7fd5e006ad70 2023-08-27T11:27:28.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00aae20 con 0x7fd5e006ad70 2023-08-27T11:27:28.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00ca50 con 0x7fd5e006ad70 2023-08-27T11:27:28.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.605+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e014d630 con 0x7fd5e006ad70 2023-08-27T11:27:28.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.606+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e00bf070 con 0x7fd5e006ad70 2023-08-27T11:27:28.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.607+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd5dc00cbb0 con 0x7fd5e006ad70 2023-08-27T11:27:28.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.609+0000 7fd5d6ffd700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 0x7fd5c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:28.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.609+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fd5dc088600 con 0x7fd5e006ad70 2023-08-27T11:27:28.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.609+0000 7fd5e5b9a700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 0x7fd5c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:28.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.610+0000 7fd5e5b9a700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 0x7fd5c406c5a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009c10 tx=0x7fd5d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:28.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.613+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd5dc0576c0 con 0x7fd5e006ad70 2023-08-27T11:27:28.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.866+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5e004ee70 con 0x7fd5e006ad70 2023-08-27T11:27:28.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.866+0000 7fd5d6ffd700 1 -- 172.21.15.43:0/922013371 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4874 (secure 0 0 0) 0x7fd5dc00ce60 con 0x7fd5e006ad70 2023-08-27T11:27:28.869 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:28.870 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:23.511980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:28.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 msgr2=0x7fd5c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 0x7fd5c406c5a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009c10 tx=0x7fd5d0008030 comp rx=0 tx=0).stop 2023-08-27T11:27:28.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 msgr2=0x7fd5e00a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:28.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e870 tx=0x7fd5dc00ec30 comp rx=0 tx=0).stop 2023-08-27T11:27:28.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 shutdown_connections 2023-08-27T11:27:28.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd5c406a0e0 0x7fd5c406c5a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5e0151a90 0x7fd5e00bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5e006ad70 0x7fd5e00a9ff0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 --2- 172.21.15.43:0/922013371 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5e00c4630 0x7fd5e014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 >> 172.21.15.43:0/922013371 conn(0x7fd5e00ab820 msgr2=0x7fd5e00c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 shutdown_connections 2023-08-27T11:27:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:28.869+0000 7fd5e85ff700 1 -- 172.21.15.43:0/922013371 wait complete. 2023-08-27T11:27:28.876 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 102 2023-08-27T11:27:28.890 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:29.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.090+0000 7fbcd45ff700 1 Processor -- start 2023-08-27T11:27:29.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.090+0000 7fbcd45ff700 1 -- start start 2023-08-27T11:27:29.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd45ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbccc151910 0x7fbccc157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd45ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 0x7fbccc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd45ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0c5ae0 con 0x7fbccc0c15e0 2023-08-27T11:27:29.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd45ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc158480 con 0x7fbccc151910 2023-08-27T11:27:29.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd45ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0c1190 con 0x7fbccc0c51a0 2023-08-27T11:27:29.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.091+0000 7fbcd1b9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 0x7fbccc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbccc151910 0x7fbccc157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd2b9c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbccc0c15e0 0x7fbccc0c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:57356/0 (socket says 172.21.15.43:57356) 2023-08-27T11:27:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd2b9c700 1 -- 172.21.15.43:0/1559277771 learned_addr learned my addr 172.21.15.43:0/1559277771 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd1399700 1 -- 172.21.15.43:0/1559277771 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490612163 0 0) 0x7fbccc0c5ae0 con 0x7fbccc0c15e0 2023-08-27T11:27:29.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd1399700 1 -- 172.21.15.43:0/1559277771 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb80035b0 con 0x7fbccc0c15e0 2023-08-27T11:27:29.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 -- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 msgr2=0x7fbccc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:29.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 0x7fbccc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 -- 172.21.15.43:0/1559277771 >> v1:172.21.15.57:6789/0 conn(0x7fbccc0c15e0 legacy=0x7fbccc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 -- 172.21.15.43:0/1559277771 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc072900 con 0x7fbccc151910 2023-08-27T11:27:29.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd1b9a700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 0x7fbccc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.092+0000 7fbcd239b700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc151910 0x7fbccc157a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009840 tx=0x7fbcc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1844a9f126d00edb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd1399700 1 -- 172.21.15.43:0/1559277771 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8011830 con 0x7fbccc151910 2023-08-27T11:27:29.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd1399700 1 -- 172.21.15.43:0/1559277771 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc8011990 con 0x7fbccc151910 2023-08-27T11:27:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd1399700 1 -- 172.21.15.43:0/1559277771 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8011d20 con 0x7fbccc151910 2023-08-27T11:27:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 -- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc151910 msgr2=0x7fbccc157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc151910 0x7fbccc157a00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009840 tx=0x7fbcc8009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:29.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 -- 172.21.15.43:0/1559277771 shutdown_connections 2023-08-27T11:27:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc151910 0x7fbccc157a00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/1559277771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc0c51a0 0x7fbccc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.093+0000 7fbcd45ff700 1 -- 172.21.15.43:0/1559277771 >> 172.21.15.43:0/1559277771 conn(0x7fbccc0a9740 msgr2=0x7fbccc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.094+0000 7fbcd45ff700 1 -- 172.21.15.43:0/1559277771 shutdown_connections 2023-08-27T11:27:29.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.094+0000 7fbcd45ff700 1 -- 172.21.15.43:0/1559277771 wait complete. 2023-08-27T11:27:29.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.095+0000 7fbcd45ff700 1 Processor -- start 2023-08-27T11:27:29.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.095+0000 7fbcd45ff700 1 -- start start 2023-08-27T11:27:29.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc0c15e0 0x7fbccc1e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc151910 0x7fbccc1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc149a40 con 0x7fbccc0c51a0 2023-08-27T11:27:29.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc06bb10 con 0x7fbccc0c15e0 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.096+0000 7fbcd45ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc151fd0 con 0x7fbccc151910 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55670/0 (socket says 172.21.15.43:55670) 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 -- 172.21.15.43:0/3617445593 learned_addr learned my addr 172.21.15.43:0/3617445593 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd2b9c700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc151910 0x7fbccc1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd239b700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc0c15e0 0x7fbccc1e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 -- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc151910 msgr2=0x7fbccc1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc151910 0x7fbccc1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 -- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc0c15e0 msgr2=0x7fbccc1e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc0c15e0 0x7fbccc1e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 -- 172.21.15.43:0/3617445593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0094a0 con 0x7fbccc0c51a0 2023-08-27T11:27:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.097+0000 7fbcd1b9a700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00e9e0 tx=0x7fbcbc00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.098+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00ee80 con 0x7fbccc0c51a0 2023-08-27T11:27:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.098+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00c850 con 0x7fbccc0c51a0 2023-08-27T11:27:29.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.098+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00cc00 con 0x7fbccc0c51a0 2023-08-27T11:27:29.110 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.098+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc80094a0 con 0x7fbccc0c51a0 2023-08-27T11:27:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.098+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc1ea3a0 con 0x7fbccc0c51a0 2023-08-27T11:27:29.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.099+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc04ee70 con 0x7fbccc0c51a0 2023-08-27T11:27:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.100+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbcbc00cd60 con 0x7fbccc0c51a0 2023-08-27T11:27:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.100+0000 7fbcc2ffd700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 0x7fbcb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.101+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fbcbc088260 con 0x7fbccc0c51a0 2023-08-27T11:27:29.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.101+0000 7fbcd239b700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 0x7fbcb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.101+0000 7fbcd239b700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 0x7fbcb006c5a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009fd0 tx=0x7fbcc8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.105+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbcbc053890 con 0x7fbccc0c51a0 2023-08-27T11:27:29.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.364+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbccc0c0dc0 con 0x7fbccc0c51a0 2023-08-27T11:27:29.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.365+0000 7fbcc2ffd700 1 -- 172.21.15.43:0/3617445593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4874 (secure 0 0 0) 0x7fbcbc056eb0 con 0x7fbccc0c51a0 2023-08-27T11:27:29.366 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:29.367 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":102,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:26:55.860033+0000","modified":"2023-08-27T11:27:23.511980+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7359},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7359":{"gid":7359,"name":"c","rank":0,"incarnation":99,"state":"up:active","state_seq":4,"addr":"172.21.15.43:6836/1628131230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1628131230},{"type":"v1","addr":"172.21.15.43:6836","nonce":1628131230}]},"join_fscid":7,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-27T11:27:29.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 msgr2=0x7fbcb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 0x7fbcb006c5a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009fd0 tx=0x7fbcc8008030 comp rx=0 tx=0).stop 2023-08-27T11:27:29.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 msgr2=0x7fbccc154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00e9e0 tx=0x7fbcbc00ecf0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 shutdown_connections 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbcb006a0e0 0x7fbcb006c5a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbccc151910 0x7fbccc1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbccc0c15e0 0x7fbccc1e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 --2- 172.21.15.43:0/3617445593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbccc0c51a0 0x7fbccc154290 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 >> 172.21.15.43:0/3617445593 conn(0x7fbccc0a9740 msgr2=0x7fbccc0c5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:29.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 shutdown_connections 2023-08-27T11:27:29.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.367+0000 7fbcd45ff700 1 -- 172.21.15.43:0/3617445593 wait complete. 2023-08-27T11:27:29.371 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 102 2023-08-27T11:27:29.387 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:29.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.586+0000 7f5db13ff700 1 Processor -- start 2023-08-27T11:27:29.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.586+0000 7f5db13ff700 1 -- start start 2023-08-27T11:27:29.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5db13ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5dac154740 0x7f5dac0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5db13ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac154d00 con 0x7f5dac14e960 2023-08-27T11:27:29.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5db13ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac154fe0 con 0x7f5dac0c50d0 2023-08-27T11:27:29.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5db13ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac0baf30 con 0x7f5dac154740 2023-08-27T11:27:29.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5daaffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5dac14e960 0x7f5dac0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57588/0 (socket says 172.21.15.43:57588) 2023-08-27T11:27:29.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5daaffd700 1 -- 172.21.15.43:0/2564127154 learned_addr learned my addr 172.21.15.43:0/2564127154 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:29.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5dab7fe700 1 --2- 172.21.15.43:0/2564127154 >> v2:172.21.15.57:3300/0 conn(0x7f5dac154740 0x7f5dac0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5da9ffb700 1 -- 172.21.15.43:0/2564127154 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177276867 0 0) 0x7f5dac154d00 con 0x7f5dac14e960 2023-08-27T11:27:29.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.588+0000 7f5da9ffb700 1 -- 172.21.15.43:0/2564127154 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d940035b0 con 0x7f5dac14e960 2023-08-27T11:27:29.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5dab7fe700 1 -- 172.21.15.43:0/2564127154 >> v1:172.21.15.57:6789/0 conn(0x7f5dac0c50d0 legacy=0x7f5dac0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5dab7fe700 1 -- 172.21.15.43:0/2564127154 >> v1:172.21.15.43:6789/0 conn(0x7f5dac14e960 legacy=0x7f5dac0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5dab7fe700 1 -- 172.21.15.43:0/2564127154 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac1552c0 con 0x7f5dac154740 2023-08-27T11:27:29.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5dab7fe700 1 --2- 172.21.15.43:0/2564127154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac0c43d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009d90 tx=0x7f5da400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee64f5a09300a13 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5da9ffb700 1 -- 172.21.15.43:0/2564127154 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400e070 con 0x7f5dac154740 2023-08-27T11:27:29.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5da9ffb700 1 -- 172.21.15.43:0/2564127154 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da400bb20 con 0x7f5dac154740 2023-08-27T11:27:29.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.589+0000 7f5da9ffb700 1 -- 172.21.15.43:0/2564127154 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4012430 con 0x7f5dac154740 2023-08-27T11:27:29.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 -- 172.21.15.43:0/2564127154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 msgr2=0x7f5dac0c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 --2- 172.21.15.43:0/2564127154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac0c43d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009d90 tx=0x7f5da400b330 comp rx=0 tx=0).stop 2023-08-27T11:27:29.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 -- 172.21.15.43:0/2564127154 shutdown_connections 2023-08-27T11:27:29.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 --2- 172.21.15.43:0/2564127154 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac0c43d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 -- 172.21.15.43:0/2564127154 >> 172.21.15.43:0/2564127154 conn(0x7f5dac06aa50 msgr2=0x7f5dac0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:29.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 -- 172.21.15.43:0/2564127154 shutdown_connections 2023-08-27T11:27:29.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.590+0000 7f5db13ff700 1 -- 172.21.15.43:0/2564127154 wait complete. 2023-08-27T11:27:29.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.591+0000 7f5db13ff700 1 Processor -- start 2023-08-27T11:27:29.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.592+0000 7f5db13ff700 1 -- start start 2023-08-27T11:27:29.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.592+0000 7f5db13ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5dac0c50d0 0x7f5dac0aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.592+0000 7f5db13ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.592+0000 7f5db13ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.592+0000 7f5db13ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac151860 con 0x7f5dac14e960 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5db13ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac151b40 con 0x7f5dac154740 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5db13ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0a9b40 con 0x7f5dac0c50d0 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55672/0 (socket says 172.21.15.43:55672) 2023-08-27T11:27:29.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 -- 172.21.15.43:0/76332396 learned_addr learned my addr 172.21.15.43:0/76332396 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:29.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daaffd700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5dac0c50d0 0x7f5dac0aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5dab7fe700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 -- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5dac0c50d0 msgr2=0x7f5dac0aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5dac0c50d0 0x7f5dac0aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 -- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 msgr2=0x7f5dac151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.593+0000 7f5daa7fc700 1 -- 172.21.15.43:0/76332396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009a70 con 0x7f5dac14e960 2023-08-27T11:27:29.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5daa7fc700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c420 tx=0x7f5da000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00052d0 con 0x7f5dac14e960 2023-08-27T11:27:29.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da0005430 con 0x7f5dac14e960 2023-08-27T11:27:29.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac0a9e20 con 0x7f5dac14e960 2023-08-27T11:27:29.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00038c0 con 0x7f5dac14e960 2023-08-27T11:27:29.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.594+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac0ab5e0 con 0x7f5dac14e960 2023-08-27T11:27:29.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.595+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac0aa340 con 0x7f5dac14e960 2023-08-27T11:27:29.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.596+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5da0003a20 con 0x7f5dac14e960 2023-08-27T11:27:29.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.597+0000 7f5d937fe700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 0x7f5d9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:29.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.597+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f5da0087920 con 0x7f5dac14e960 2023-08-27T11:27:29.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.597+0000 7f5daaffd700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 0x7f5d9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:29.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.598+0000 7f5daaffd700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 0x7f5d9806c5a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c007fd0 tx=0x7f5d9c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:29.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.601+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5dac0aa340 con 0x7f5dac14e960 2023-08-27T11:27:29.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.811+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dac0aa340 con 0x7f5dac14e960 2023-08-27T11:27:29.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.813+0000 7f5d937fe700 1 -- 172.21.15.43:0/76332396 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18421 (secure 0 0 0) 0x7f5dac0aa340 con 0x7f5dac14e960 2023-08-27T11:27:29.814 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:29.815 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":98,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:20.488761+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:26:54.182826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-27T11:26:54.837398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6837/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6834/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6836/863801259":"2023-08-28T11:27:17.448197+0000","172.21.15.43:6835/863801259":"2023-08-28T11:27:17.448197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:29.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 msgr2=0x7f5d9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 0x7f5d9806c5a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c007fd0 tx=0x7f5d9c007dc0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 msgr2=0x7f5dac0ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:29.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5da000c420 tx=0x7f5da000c730 comp rx=0 tx=0).stop 2023-08-27T11:27:29.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 shutdown_connections 2023-08-27T11:27:29.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d9806a0e0 0x7f5d9806c5a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5dac154740 0x7f5dac151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5dac0c50d0 0x7f5dac0aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 --2- 172.21.15.43:0/76332396 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5dac14e960 0x7f5dac0ab0a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:29.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 >> 172.21.15.43:0/76332396 conn(0x7f5dac06aa50 msgr2=0x7f5dac152210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:29.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 shutdown_connections 2023-08-27T11:27:29.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:29.815+0000 7f5db13ff700 1 -- 172.21.15.43:0/76332396 wait complete. 2023-08-27T11:27:29.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:27:30.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.038+0000 7fc841bff700 1 Processor -- start 2023-08-27T11:27:30.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.038+0000 7fc841bff700 1 -- start start 2023-08-27T11:27:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0c51a0 0x7fc83c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc83c06ca60 0x7fc83c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc83c0ab040 0x7fc83c155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c1530b0 con 0x7fc83c06ca60 2023-08-27T11:27:30.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c14c860 con 0x7fc83c0ab040 2023-08-27T11:27:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc841bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c06d700 con 0x7fc83c0c51a0 2023-08-27T11:27:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc83affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc83c06ca60 0x7fc83c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc83affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc83c06ca60 0x7fc83c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55674/0 (socket says 172.21.15.43:55674) 2023-08-27T11:27:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc83affd700 1 -- 172.21.15.43:0/70299335 learned_addr learned my addr 172.21.15.43:0/70299335 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:30.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.039+0000 7fc83b7fe700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0c51a0 0x7fc83c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83bfff700 1 --2- 172.21.15.43:0/70299335 >> v2:172.21.15.57:3300/0 conn(0x7fc83c0ab040 0x7fc83c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 -- 172.21.15.43:0/70299335 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0c51a0 msgr2=0x7fc83c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0c51a0 0x7fc83c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 -- 172.21.15.43:0/70299335 >> v2:172.21.15.57:3300/0 conn(0x7fc83c0ab040 msgr2=0x7fc83c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:30.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 --2- 172.21.15.43:0/70299335 >> v2:172.21.15.57:3300/0 conn(0x7fc83c0ab040 0x7fc83c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 -- 172.21.15.43:0/70299335 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c152430 con 0x7fc83c06ca60 2023-08-27T11:27:30.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83affd700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c06ca60 0x7fc83c0aab00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc83c072b20 tx=0x7fc830009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7595bfb39e64053e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83a7fc700 1 -- 172.21.15.43:0/70299335 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011830 con 0x7fc83c06ca60 2023-08-27T11:27:30.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83a7fc700 1 -- 172.21.15.43:0/70299335 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011990 con 0x7fc83c06ca60 2023-08-27T11:27:30.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.040+0000 7fc83a7fc700 1 -- 172.21.15.43:0/70299335 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011d20 con 0x7fc83c06ca60 2023-08-27T11:27:30.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 -- 172.21.15.43:0/70299335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c06ca60 msgr2=0x7fc83c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c06ca60 0x7fc83c0aab00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc83c072b20 tx=0x7fc830009c30 comp rx=0 tx=0).stop 2023-08-27T11:27:30.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 -- 172.21.15.43:0/70299335 shutdown_connections 2023-08-27T11:27:30.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 --2- 172.21.15.43:0/70299335 >> v2:172.21.15.57:3300/0 conn(0x7fc83c0ab040 0x7fc83c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0c51a0 0x7fc83c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 --2- 172.21.15.43:0/70299335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c06ca60 0x7fc83c0aab00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 -- 172.21.15.43:0/70299335 >> 172.21.15.43:0/70299335 conn(0x7fc83c06aa50 msgr2=0x7fc83c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 -- 172.21.15.43:0/70299335 shutdown_connections 2023-08-27T11:27:30.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.041+0000 7fc841bff700 1 -- 172.21.15.43:0/70299335 wait complete. 2023-08-27T11:27:30.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.043+0000 7fc841bff700 1 Processor -- start 2023-08-27T11:27:30.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.043+0000 7fc841bff700 1 -- start start 2023-08-27T11:27:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 0x7fc83c1e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0ab040 0x7fc83c0a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c14c490 con 0x7fc83c0c51a0 2023-08-27T11:27:30.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1e63e0 con 0x7fc83c06ca60 2023-08-27T11:27:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc841bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c1502d0 con 0x7fc83c0ab040 2023-08-27T11:27:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55682/0 (socket says 172.21.15.43:55682) 2023-08-27T11:27:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 -- 172.21.15.43:0/2494433109 learned_addr learned my addr 172.21.15.43:0/2494433109 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:30.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83affd700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0ab040 0x7fc83c0a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83b7fe700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 0x7fc83c1e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 -- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0ab040 msgr2=0x7fc83c0a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0ab040 0x7fc83c0a7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 -- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 msgr2=0x7fc83c1e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 0x7fc83c1e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83bfff700 1 -- 172.21.15.43:0/2494433109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009550 con 0x7fc83c0c51a0 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.044+0000 7fc83b7fe700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 0x7fc83c1e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc83bfff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc834012370 tx=0x7fc834012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834014040 con 0x7fc83c0c51a0 2023-08-27T11:27:30.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400d2d0 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834012e70 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c14fd10 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.045+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0a5590 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.046+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c04ee70 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.047+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc83400b740 con 0x7fc83c0c51a0 2023-08-27T11:27:30.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.048+0000 7fc823fff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 0x7fc82806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.048+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6234+0+0 (secure 0 0 0) 0x7fc83408cad0 con 0x7fc83c0c51a0 2023-08-27T11:27:30.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.048+0000 7fc83b7fe700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 0x7fc82806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.049+0000 7fc83b7fe700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 0x7fc82806c5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009ac0 tx=0x7fc82c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.052+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc8340581a0 con 0x7fc83c0c51a0 2023-08-27T11:27:30.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.311+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc83c06c840 con 0x7fc83c0c51a0 2023-08-27T11:27:30.313 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:27:30.311+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:27:30.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.316+0000 7fc823fff700 1 -- 172.21.15.43:0/2494433109 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v103) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc83400d680 con 0x7fc83c0c51a0 2023-08-27T11:27:30.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 msgr2=0x7fc82806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 0x7fc82806c5d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009ac0 tx=0x7fc82c008040 comp rx=0 tx=0).stop 2023-08-27T11:27:30.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 msgr2=0x7fc83c0a7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc834012370 tx=0x7fc834012730 comp rx=0 tx=0).stop 2023-08-27T11:27:30.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 shutdown_connections 2023-08-27T11:27:30.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc82806a110 0x7fc82806c5d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc83c0c51a0 0x7fc83c0a7e70 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc83c06ca60 0x7fc83c1e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 --2- 172.21.15.43:0/2494433109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc83c0ab040 0x7fc83c0a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.318+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 >> 172.21.15.43:0/2494433109 conn(0x7fc83c06aa50 msgr2=0x7fc83c0bc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:30.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.319+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 shutdown_connections 2023-08-27T11:27:30.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.319+0000 7fc841bff700 1 -- 172.21.15.43:0/2494433109 wait complete. 2023-08-27T11:27:30.323 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:27:30.323 INFO:tasks.ceph.mds.c.smithi043.stderr: -53> 2023-08-27T11:27:28.465+0000 7f3d6b9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:30.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:27:30.364 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:27:30.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.545+0000 7fa8089ff700 1 Processor -- start 2023-08-27T11:27:30.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.545+0000 7fa8089ff700 1 -- start start 2023-08-27T11:27:30.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa8089ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8040c50d0 0x7fa8040c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa8089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa804154740 0x7fa8040c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa8089ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa804154d00 con 0x7fa80414e960 2023-08-27T11:27:30.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa8089ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8040baf30 con 0x7fa8040c50d0 2023-08-27T11:27:30.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa8089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa804154fe0 con 0x7fa804154740 2023-08-27T11:27:30.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa80259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa80414e960 0x7fa8040a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57606/0 (socket says 172.21.15.43:57606) 2023-08-27T11:27:30.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.546+0000 7fa80259c700 1 -- 172.21.15.43:0/1340946505 learned_addr learned my addr 172.21.15.43:0/1340946505 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:30.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa801d9b700 1 --2- 172.21.15.43:0/1340946505 >> v2:172.21.15.57:3300/0 conn(0x7fa8040c50d0 0x7fa8040c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa802d9d700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa804154740 0x7fa8040c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa80159a700 1 -- 172.21.15.43:0/1340946505 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866299872 0 0) 0x7fa804154d00 con 0x7fa80414e960 2023-08-27T11:27:30.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa80159a700 1 -- 172.21.15.43:0/1340946505 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec0035b0 con 0x7fa80414e960 2023-08-27T11:27:30.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa801d9b700 1 -- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa804154740 msgr2=0x7fa8040c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:30.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa801d9b700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa804154740 0x7fa8040c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa801d9b700 1 -- 172.21.15.43:0/1340946505 >> v1:172.21.15.43:6789/0 conn(0x7fa80414e960 legacy=0x7fa8040a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.547+0000 7fa801d9b700 1 -- 172.21.15.43:0/1340946505 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8041552c0 con 0x7fa8040c50d0 2023-08-27T11:27:30.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa801d9b700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8040c50d0 0x7fa8040c3cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009840 tx=0x7fa7f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f787fb9a255522 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa80159a700 1 -- 172.21.15.43:0/1340946505 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8011830 con 0x7fa8040c50d0 2023-08-27T11:27:30.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa80159a700 1 -- 172.21.15.43:0/1340946505 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8011990 con 0x7fa8040c50d0 2023-08-27T11:27:30.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa80159a700 1 -- 172.21.15.43:0/1340946505 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8011d00 con 0x7fa8040c50d0 2023-08-27T11:27:30.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa8089ff700 1 -- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8040c50d0 msgr2=0x7fa8040c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.548+0000 7fa8089ff700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8040c50d0 0x7fa8040c3cc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009840 tx=0x7fa7f8009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:30.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 -- 172.21.15.43:0/1340946505 shutdown_connections 2023-08-27T11:27:30.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa804154740 0x7fa8040c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 --2- 172.21.15.43:0/1340946505 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8040c50d0 0x7fa8040c3cc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 -- 172.21.15.43:0/1340946505 >> 172.21.15.43:0/1340946505 conn(0x7fa80406aa50 msgr2=0x7fa8040c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:30.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 -- 172.21.15.43:0/1340946505 shutdown_connections 2023-08-27T11:27:30.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.549+0000 7fa8089ff700 1 -- 172.21.15.43:0/1340946505 wait complete. 2023-08-27T11:27:30.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.550+0000 7fa8089ff700 1 Processor -- start 2023-08-27T11:27:30.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.551+0000 7fa8089ff700 1 -- start start 2023-08-27T11:27:30.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.551+0000 7fa8089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8040c50d0 0x7fa8040c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.551+0000 7fa8089ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa8089ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa804154740 0x7fa8040be390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa8089ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa804149a60 con 0x7fa80414e960 2023-08-27T11:27:30.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa8089ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041e8110 con 0x7fa804154740 2023-08-27T11:27:30.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa8089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa804151fd0 con 0x7fa8040c50d0 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55706/0 (socket says 172.21.15.43:55706) 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 -- 172.21.15.43:0/3056291860 learned_addr learned my addr 172.21.15.43:0/3056291860 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa80259c700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8040c50d0 0x7fa8040c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa802d9d700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa804154740 0x7fa8040be390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 -- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8040c50d0 msgr2=0x7fa8040c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8040c50d0 0x7fa8040c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 -- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa804154740 msgr2=0x7fa8040be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa804154740 0x7fa8040be390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.552+0000 7fa801d9b700 1 -- 172.21.15.43:0/3056291860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80094a0 con 0x7fa80414e960 2023-08-27T11:27:30.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa801d9b700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80044d0 con 0x7fa80414e960 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f801f070 con 0x7fa80414e960 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80038e0 con 0x7fa80414e960 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8041e85a0 con 0x7fa80414e960 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.553+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8041e7ac0 con 0x7fa80414e960 2023-08-27T11:27:30.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.554+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040bb390 con 0x7fa80414e960 2023-08-27T11:27:30.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.555+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7f8003a40 con 0x7fa80414e960 2023-08-27T11:27:30.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.556+0000 7fa7f2ffd700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:30.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.556+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa7f8021070 con 0x7fa80414e960 2023-08-27T11:27:30.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.556+0000 7fa80259c700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.556+0000 7fa80259c700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4007fd0 tx=0x7fa7f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:30.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.560+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa7f80552f0 con 0x7fa80414e960 2023-08-27T11:27:30.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:30.815+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa8041e82c0 con 0x7fa80414e960 2023-08-27T11:27:31.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.321+0000 7fa7f2ffd700 1 -- 172.21.15.43:0/3056291860 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v104) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8041e82c0 con 0x7fa80414e960 2023-08-27T11:27:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 msgr2=0x7fa7e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4007fd0 tx=0x7fa7f4009040 comp rx=0 tx=0).stop 2023-08-27T11:27:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 msgr2=0x7fa8041515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8000c00 tx=0x7fa7f8004750 comp rx=0 tx=0).stop 2023-08-27T11:27:31.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 shutdown_connections 2023-08-27T11:27:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa7e406a0e0 0x7fa7e406c5a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa804154740 0x7fa8040be390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa8040c50d0 0x7fa8040c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 --2- 172.21.15.43:0/3056291860 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa80414e960 0x7fa8041515f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 >> 172.21.15.43:0/3056291860 conn(0x7fa80406aa50 msgr2=0x7fa80414de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 shutdown_connections 2023-08-27T11:27:31.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.324+0000 7fa8089ff700 1 -- 172.21.15.43:0/3056291860 wait complete. 2023-08-27T11:27:31.347 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:27:31.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.598+0000 7fd10b5ff700 1 Processor -- start 2023-08-27T11:27:31.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.598+0000 7fd10b5ff700 1 -- start start 2023-08-27T11:27:31.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10b5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd1040aae50 0x7fd10406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10b5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 0x7fd10414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10b5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10406cde0 con 0x7fd10414fd20 2023-08-27T11:27:31.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10b5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1041558f0 con 0x7fd1040aae50 2023-08-27T11:27:31.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10b5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd104155b00 con 0x7fd10406d360 2023-08-27T11:27:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10939b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd1040aae50 0x7fd10406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10939b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd1040aae50 0x7fd10406c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55718/0 (socket says 172.21.15.43:55718) 2023-08-27T11:27:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.599+0000 7fd10939b700 1 -- 172.21.15.43:0/2332429564 learned_addr learned my addr 172.21.15.43:0/2332429564 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd108b9a700 1 --2- 172.21.15.43:0/2332429564 >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 0x7fd10414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd10939b700 1 -- 172.21.15.43:0/2332429564 >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 msgr2=0x7fd10414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd10939b700 1 --2- 172.21.15.43:0/2332429564 >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 0x7fd10414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd10939b700 1 -- 172.21.15.43:0/2332429564 >> v1:172.21.15.57:6789/0 conn(0x7fd10414fd20 legacy=0x7fd104152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd10939b700 1 -- 172.21.15.43:0/2332429564 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104155de0 con 0x7fd1040aae50 2023-08-27T11:27:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd108b9a700 1 --2- 172.21.15.43:0/2332429564 >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 0x7fd10414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:31.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd10939b700 1 --2- 172.21.15.43:0/2332429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd10406c8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1040c2360 tx=0x7fd100009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a6f2322432e88c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd0fbfff700 1 -- 172.21.15.43:0/2332429564 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100004230 con 0x7fd1040aae50 2023-08-27T11:27:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd0fbfff700 1 -- 172.21.15.43:0/2332429564 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd100004390 con 0x7fd1040aae50 2023-08-27T11:27:31.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.600+0000 7fd0fbfff700 1 -- 172.21.15.43:0/2332429564 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000036a0 con 0x7fd1040aae50 2023-08-27T11:27:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 -- 172.21.15.43:0/2332429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 msgr2=0x7fd10406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/2332429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd10406c8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1040c2360 tx=0x7fd100009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 -- 172.21.15.43:0/2332429564 shutdown_connections 2023-08-27T11:27:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/2332429564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd10406c8a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/2332429564 >> v2:172.21.15.57:3300/0 conn(0x7fd10406d360 0x7fd10414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 -- 172.21.15.43:0/2332429564 >> 172.21.15.43:0/2332429564 conn(0x7fd1040c2400 msgr2=0x7fd1040c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 -- 172.21.15.43:0/2332429564 shutdown_connections 2023-08-27T11:27:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.601+0000 7fd10b5ff700 1 -- 172.21.15.43:0/2332429564 wait complete. 2023-08-27T11:27:31.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.603+0000 7fd10b5ff700 1 Processor -- start 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.603+0000 7fd10b5ff700 1 -- start start 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 0x7fd1040aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 0x7fd1040a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104150810 con 0x7fd1040aae50 2023-08-27T11:27:31.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104150290 con 0x7fd10406d360 2023-08-27T11:27:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10b5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1041ea000 con 0x7fd10414fd20 2023-08-27T11:27:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55728/0 (socket says 172.21.15.43:55728) 2023-08-27T11:27:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 -- 172.21.15.43:0/3634036758 learned_addr learned my addr 172.21.15.43:0/3634036758 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:31.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10939b700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 0x7fd1040aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd109b9c700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 0x7fd1040a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 -- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 msgr2=0x7fd1040a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 0x7fd1040a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 -- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 msgr2=0x7fd1040aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:31.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 0x7fd1040aa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd108b9a700 1 -- 172.21.15.43:0/3634036758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100009550 con 0x7fd1040aae50 2023-08-27T11:27:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd10939b700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 0x7fd1040aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.604+0000 7fd109b9c700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 0x7fd1040a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd108b9a700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c750 tx=0x7fd0f400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:31.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4011800 con 0x7fd1040aae50 2023-08-27T11:27:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f4011960 con 0x7fd1040aae50 2023-08-27T11:27:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104150530 con 0x7fd1040aae50 2023-08-27T11:27:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4011cd0 con 0x7fd1040aae50 2023-08-27T11:27:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.605+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd104154eb0 con 0x7fd1040aae50 2023-08-27T11:27:31.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.606+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10406d120 con 0x7fd1040aae50 2023-08-27T11:27:31.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.607+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0f4021350 con 0x7fd1040aae50 2023-08-27T11:27:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.608+0000 7fd0f9ffb700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 0x7fd0e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.608+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd0f4088680 con 0x7fd1040aae50 2023-08-27T11:27:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.608+0000 7fd10939b700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 0x7fd0e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.609+0000 7fd10939b700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 0x7fd0e806c5a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd100009c10 tx=0x7fd100008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:31.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.612+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0f4053bf0 con 0x7fd1040aae50 2023-08-27T11:27:31.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:31.823+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1040c50c0 con 0x7fd1040aae50 2023-08-27T11:27:32.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.323+0000 7fd0f9ffb700 1 -- 172.21.15.43:0/3634036758 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v100) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0f4057210 con 0x7fd1040aae50 2023-08-27T11:27:32.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 msgr2=0x7fd0e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 0x7fd0e806c5a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd100009c10 tx=0x7fd100008030 comp rx=0 tx=0).stop 2023-08-27T11:27:32.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 msgr2=0x7fd1041e96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400c750 tx=0x7fd0f400cb10 comp rx=0 tx=0).stop 2023-08-27T11:27:32.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 shutdown_connections 2023-08-27T11:27:32.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd0e806a0e0 0x7fd0e806c5a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd10414fd20 0x7fd1040a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd10406d360 0x7fd1040aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 --2- 172.21.15.43:0/3634036758 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd1040aae50 0x7fd1041e96c0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 >> 172.21.15.43:0/3634036758 conn(0x7fd1040c2400 msgr2=0x7fd1041536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:32.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.328+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 shutdown_connections 2023-08-27T11:27:32.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.329+0000 7fd10b5ff700 1 -- 172.21.15.43:0/3634036758 wait complete. 2023-08-27T11:27:32.333 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:27:32.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:27:32.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.555+0000 7f682d3ff700 1 Processor -- start 2023-08-27T11:27:32.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.555+0000 7f682d3ff700 1 -- start start 2023-08-27T11:27:32.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f682d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a77d0 0x7f682814e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f682d3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f68280c50f0 0x7f68280c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f682d3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6828152140 con 0x7f68280a5090 2023-08-27T11:27:32.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f682d3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68281515c0 con 0x7f68280c50f0 2023-08-27T11:27:32.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f682d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68281518a0 con 0x7f68280a77d0 2023-08-27T11:27:32.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f68267fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f68280a5090 0x7f682814e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57614/0 (socket says 172.21.15.43:57614) 2023-08-27T11:27:32.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.556+0000 7f68267fc700 1 -- 172.21.15.43:0/2896437681 learned_addr learned my addr 172.21.15.43:0/2896437681 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:32.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 --2- 172.21.15.43:0/2896437681 >> v2:172.21.15.43:3300/0 conn(0x7f68280c50f0 0x7f68280c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f6826ffd700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a77d0 0x7f682814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f6825ffb700 1 -- 172.21.15.43:0/2896437681 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046682100 0 0) 0x7f6828152140 con 0x7f68280a5090 2023-08-27T11:27:32.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f6825ffb700 1 -- 172.21.15.43:0/2896437681 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68100035b0 con 0x7f68280a5090 2023-08-27T11:27:32.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 -- 172.21.15.43:0/2896437681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a77d0 msgr2=0x7f682814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:32.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a77d0 0x7f682814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 -- 172.21.15.43:0/2896437681 >> v1:172.21.15.43:6789/0 conn(0x7f68280a5090 legacy=0x7f682814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 -- 172.21.15.43:0/2896437681 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828151b80 con 0x7f68280c50f0 2023-08-27T11:27:32.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.557+0000 7f68277fe700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f68280c3b60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6820009d90 tx=0x7f682000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1b2d611e161b45 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:32.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f6825ffb700 1 -- 172.21.15.43:0/2896437681 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000e070 con 0x7f68280c50f0 2023-08-27T11:27:32.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f6825ffb700 1 -- 172.21.15.43:0/2896437681 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682000bb20 con 0x7f68280c50f0 2023-08-27T11:27:32.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f6825ffb700 1 -- 172.21.15.43:0/2896437681 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820012430 con 0x7f68280c50f0 2023-08-27T11:27:32.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 -- 172.21.15.43:0/2896437681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 msgr2=0x7f68280c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f68280c3b60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6820009d90 tx=0x7f682000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 -- 172.21.15.43:0/2896437681 shutdown_connections 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f68280c3b60 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2896437681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a77d0 0x7f682814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 -- 172.21.15.43:0/2896437681 >> 172.21.15.43:0/2896437681 conn(0x7f68280c2400 msgr2=0x7f68280c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:32.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 -- 172.21.15.43:0/2896437681 shutdown_connections 2023-08-27T11:27:32.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.558+0000 7f682d3ff700 1 -- 172.21.15.43:0/2896437681 wait complete. 2023-08-27T11:27:32.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.560+0000 7f682d3ff700 1 Processor -- start 2023-08-27T11:27:32.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.560+0000 7f682d3ff700 1 -- start start 2023-08-27T11:27:32.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a5090 0x7f6828153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68280a77d0 0x7f6828147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682814d350 con 0x7f68280c50f0 2023-08-27T11:27:32.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68281542e0 con 0x7f68280a77d0 2023-08-27T11:27:32.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f682d3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68281552a0 con 0x7f68280a5090 2023-08-27T11:27:32.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f68277fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f68277fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55752/0 (socket says 172.21.15.43:55752) 2023-08-27T11:27:32.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.561+0000 7f68277fe700 1 -- 172.21.15.43:0/2319614601 learned_addr learned my addr 172.21.15.43:0/2319614601 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:32.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f6826ffd700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a5090 0x7f6828153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68267fc700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68280a77d0 0x7f6828147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 -- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a5090 msgr2=0x7f6828153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a5090 0x7f6828153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 -- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68280a77d0 msgr2=0x7f6828147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:32.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68280a77d0 0x7f6828147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:32.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 -- 172.21.15.43:0/2319614601 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820009a70 con 0x7f68280c50f0 2023-08-27T11:27:32.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.562+0000 7f68277fe700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f682806dd90 tx=0x7f6820004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:32.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.563+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200129f0 con 0x7f68280c50f0 2023-08-27T11:27:32.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.563+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820020070 con 0x7f68280c50f0 2023-08-27T11:27:32.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.563+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820012db0 con 0x7f68280c50f0 2023-08-27T11:27:32.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.563+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68281e9e60 con 0x7f68280c50f0 2023-08-27T11:27:32.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.563+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682814cc90 con 0x7f68280c50f0 2023-08-27T11:27:32.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.564+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682814d490 con 0x7f68280c50f0 2023-08-27T11:27:32.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.565+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6820004040 con 0x7f68280c50f0 2023-08-27T11:27:32.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.565+0000 7f680f7fe700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 0x7f681406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:32.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.566+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6820022070 con 0x7f68280c50f0 2023-08-27T11:27:32.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.566+0000 7f6826ffd700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 0x7f681406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:32.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.566+0000 7f6826ffd700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 0x7f681406c5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6818009be0 tx=0x7f6818009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:32.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.570+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f682814d490 con 0x7f68280c50f0 2023-08-27T11:27:32.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:32.778+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f682814d490 con 0x7f68280c50f0 2023-08-27T11:27:33.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.335+0000 7f680f7fe700 1 -- 172.21.15.43:0/2319614601 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v101) v1 ==== 169+0+0 (secure 0 0 0) 0x7f682814d490 con 0x7f68280c50f0 2023-08-27T11:27:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 msgr2=0x7f681406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 0x7f681406c5a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6818009be0 tx=0x7f6818009210 comp rx=0 tx=0).stop 2023-08-27T11:27:33.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 msgr2=0x7f6828147ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f682806dd90 tx=0x7f6820004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 shutdown_connections 2023-08-27T11:27:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f681406a0e0 0x7f681406c5a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68280c50f0 0x7f6828147ff0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68280a5090 0x7f6828153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 --2- 172.21.15.43:0/2319614601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68280a77d0 0x7f6828147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.339+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 >> 172.21.15.43:0/2319614601 conn(0x7f68280c2400 msgr2=0x7f682806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:33.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.340+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 shutdown_connections 2023-08-27T11:27:33.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.340+0000 7f682d3ff700 1 -- 172.21.15.43:0/2319614601 wait complete. 2023-08-27T11:27:33.344 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:27:33.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:27:33.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.563+0000 7f25ea7ff700 1 Processor -- start 2023-08-27T11:27:33.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.564+0000 7f25ea7ff700 1 -- start start 2023-08-27T11:27:33.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25ea7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25e40c4a90 0x7f25e406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:33.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25ea7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e406c4e0 con 0x7f25e4151a90 2023-08-27T11:27:33.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25ea7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e4155370 con 0x7f25e40c4630 2023-08-27T11:27:33.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25ea7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40c82c0 con 0x7f25e40c4a90 2023-08-27T11:27:33.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25e3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f25e4151a90 0x7f25e40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57630/0 (socket says 172.21.15.43:57630) 2023-08-27T11:27:33.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25e3fff700 1 -- 172.21.15.43:0/4202765753 learned_addr learned my addr 172.21.15.43:0/4202765753 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:33.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.565+0000 7f25e8d9c700 1 --2- 172.21.15.43:0/4202765753 >> v2:172.21.15.43:3300/0 conn(0x7f25e40c4a90 0x7f25e406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e2ffd700 1 -- 172.21.15.43:0/4202765753 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98697199 0 0) 0x7f25e406c4e0 con 0x7f25e4151a90 2023-08-27T11:27:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e2ffd700 1 -- 172.21.15.43:0/4202765753 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25cc0035b0 con 0x7f25e4151a90 2023-08-27T11:27:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e8d9c700 1 -- 172.21.15.43:0/4202765753 >> v1:172.21.15.57:6789/0 conn(0x7f25e40c4630 legacy=0x7f25e406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e8d9c700 1 -- 172.21.15.43:0/4202765753 >> v1:172.21.15.43:6789/0 conn(0x7f25e4151a90 legacy=0x7f25e40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e8d9c700 1 -- 172.21.15.43:0/4202765753 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4151e70 con 0x7f25e40c4a90 2023-08-27T11:27:33.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e8d9c700 1 --2- 172.21.15.43:0/4202765753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e40c4a90 0x7f25e406b480 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009d90 tx=0x7f25dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc08bbf972d6db6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:33.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e2ffd700 1 -- 172.21.15.43:0/4202765753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00e070 con 0x7f25e40c4a90 2023-08-27T11:27:33.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e2ffd700 1 -- 172.21.15.43:0/4202765753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc00bb20 con 0x7f25e40c4a90 2023-08-27T11:27:33.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.566+0000 7f25e2ffd700 1 -- 172.21.15.43:0/4202765753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00be90 con 0x7f25e40c4a90 2023-08-27T11:27:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 -- 172.21.15.43:0/4202765753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e40c4a90 msgr2=0x7f25e406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/4202765753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e40c4a90 0x7f25e406b480 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009d90 tx=0x7f25dc00b330 comp rx=0 tx=0).stop 2023-08-27T11:27:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 -- 172.21.15.43:0/4202765753 shutdown_connections 2023-08-27T11:27:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/4202765753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e40c4a90 0x7f25e406b480 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 -- 172.21.15.43:0/4202765753 >> 172.21.15.43:0/4202765753 conn(0x7f25e40ab820 msgr2=0x7f25e40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 -- 172.21.15.43:0/4202765753 shutdown_connections 2023-08-27T11:27:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.567+0000 7f25ea7ff700 1 -- 172.21.15.43:0/4202765753 wait complete. 2023-08-27T11:27:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.569+0000 7f25ea7ff700 1 Processor -- start 2023-08-27T11:27:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.569+0000 7f25ea7ff700 1 -- start start 2023-08-27T11:27:33.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.569+0000 7f25ea7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e40c4630 0x7f25e4153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:33.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25ea7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 0x7f25e414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:33.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25ea7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:33.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25ea7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4156990 con 0x7f25e4151a90 2023-08-27T11:27:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25ea7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4156c70 con 0x7f25e40c4630 2023-08-27T11:27:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25ea7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4156f50 con 0x7f25e40c4a90 2023-08-27T11:27:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55766/0 (socket says 172.21.15.43:55766) 2023-08-27T11:27:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 -- 172.21.15.43:0/3519726705 learned_addr learned my addr 172.21.15.43:0/3519726705 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e3fff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e40c4630 0x7f25e4153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e37fe700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 0x7f25e414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 -- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 msgr2=0x7f25e414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 0x7f25e414c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 -- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e40c4630 msgr2=0x7f25e4153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e40c4630 0x7f25e4153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e8d9c700 1 -- 172.21.15.43:0/3519726705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009a70 con 0x7f25e4151a90 2023-08-27T11:27:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.570+0000 7f25e37fe700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 0x7f25e414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25e8d9c700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00b370 tx=0x7f25dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc007000 con 0x7f25e4151a90 2023-08-27T11:27:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc012650 con 0x7f25e4151a90 2023-08-27T11:27:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4157230 con 0x7f25e4151a90 2023-08-27T11:27:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc012a00 con 0x7f25e4151a90 2023-08-27T11:27:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.571+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e41540c0 con 0x7f25e4151a90 2023-08-27T11:27:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.572+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e40c38b0 con 0x7f25e4151a90 2023-08-27T11:27:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.573+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25dc012b60 con 0x7f25e4151a90 2023-08-27T11:27:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.574+0000 7f25e0ff9700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 0x7f25d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.574+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f25dc08a5a0 con 0x7f25e4151a90 2023-08-27T11:27:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.574+0000 7f25e3fff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 0x7f25d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.575+0000 7f25e3fff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 0x7f25d006c5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25d4007fd0 tx=0x7f25d4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.578+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f25e40c38b0 con 0x7f25e4151a90 2023-08-27T11:27:33.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.801+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f25e40c38b0 con 0x7f25e4151a90 2023-08-27T11:27:33.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.805+0000 7f25e0ff9700 1 -- 172.21.15.43:0/3519726705 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f25e40c38b0 con 0x7f25e4151a90 2023-08-27T11:27:33.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 msgr2=0x7f25d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 0x7f25d006c5a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f25d4007fd0 tx=0x7f25d4007dc0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 msgr2=0x7f25e4157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00b370 tx=0x7f25dc004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 shutdown_connections 2023-08-27T11:27:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25d006a0e0 0x7f25d006c5a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25e4151a90 0x7f25e4157750 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25e40c4630 0x7f25e4153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 --2- 172.21.15.43:0/3519726705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25e40c4a90 0x7f25e414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:33.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 >> 172.21.15.43:0/3519726705 conn(0x7f25e40ab820 msgr2=0x7f25e414b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:33.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 shutdown_connections 2023-08-27T11:27:33.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:33.808+0000 7f25ea7ff700 1 -- 172.21.15.43:0/3519726705 wait complete. 2023-08-27T11:27:33.828 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.c mds_join_fs 2023-08-27T11:27:34.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.036+0000 7f770f5ff700 1 Processor -- start 2023-08-27T11:27:34.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.037+0000 7f770f5ff700 1 -- start start 2023-08-27T11:27:34.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770f5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 0x7f77080c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770f5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770806c4e0 con 0x7f7708151a90 2023-08-27T11:27:34.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770f5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7708155370 con 0x7f77080c4630 2023-08-27T11:27:34.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c82c0 con 0x7f770806ad70 2023-08-27T11:27:34.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770db9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770cb9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 0x7f77080c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770db9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:53136/0 (socket says 172.21.15.43:53136) 2023-08-27T11:27:34.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770db9c700 1 -- 172.21.15.43:0/66434039 learned_addr learned my addr 172.21.15.43:0/66434039 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:34.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.038+0000 7f770d39b700 1 --1- 172.21.15.43:0/66434039 >> v1:172.21.15.57:6789/0 conn(0x7f7708151a90 0x7f77080c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:57402/0 (socket says 172.21.15.43:57402) 2023-08-27T11:27:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770db9c700 1 -- 172.21.15.43:0/66434039 >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 msgr2=0x7f77080c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770db9c700 1 --2- 172.21.15.43:0/66434039 >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 0x7f77080c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770db9c700 1 -- 172.21.15.43:0/66434039 >> v1:172.21.15.57:6789/0 conn(0x7f7708151a90 legacy=0x7f77080c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770db9c700 1 -- 172.21.15.43:0/66434039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708151e70 con 0x7f770806ad70 2023-08-27T11:27:34.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770cb9a700 1 --2- 172.21.15.43:0/66434039 >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 0x7f77080c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:34.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f770db9c700 1 --2- 172.21.15.43:0/66434039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7700009e50 tx=0x7f770000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ee126d4c40b7d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.039+0000 7f76fffff700 1 -- 172.21.15.43:0/66434039 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000e070 con 0x7f770806ad70 2023-08-27T11:27:34.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f76fffff700 1 -- 172.21.15.43:0/66434039 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000b910 con 0x7f770806ad70 2023-08-27T11:27:34.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f76fffff700 1 -- 172.21.15.43:0/66434039 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000bcc0 con 0x7f770806ad70 2023-08-27T11:27:34.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 -- 172.21.15.43:0/66434039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 msgr2=0x7f770806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 --2- 172.21.15.43:0/66434039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7700009e50 tx=0x7f770000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:34.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 -- 172.21.15.43:0/66434039 shutdown_connections 2023-08-27T11:27:34.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 --2- 172.21.15.43:0/66434039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f770806ad70 0x7f770806b200 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 --2- 172.21.15.43:0/66434039 >> v2:172.21.15.57:3300/0 conn(0x7f77080c4630 0x7f77080c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 -- 172.21.15.43:0/66434039 >> 172.21.15.43:0/66434039 conn(0x7f77080ab820 msgr2=0x7f77080abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 -- 172.21.15.43:0/66434039 shutdown_connections 2023-08-27T11:27:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.040+0000 7f770f5ff700 1 -- 172.21.15.43:0/66434039 wait complete. 2023-08-27T11:27:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.042+0000 7f770f5ff700 1 Processor -- start 2023-08-27T11:27:34.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.042+0000 7f770f5ff700 1 -- start start 2023-08-27T11:27:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 0x7f77080c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 0x7f77081eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c1e60 con 0x7f77080c4630 2023-08-27T11:27:34.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770814e3a0 con 0x7f770806ad70 2023-08-27T11:27:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770f5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770814e0c0 con 0x7f7708151a90 2023-08-27T11:27:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770cb9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770cb9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55770/0 (socket says 172.21.15.43:55770) 2023-08-27T11:27:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.043+0000 7f770cb9a700 1 -- 172.21.15.43:0/3576174018 learned_addr learned my addr 172.21.15.43:0/3576174018 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:34.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770db9c700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 0x7f77081eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770d39b700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 0x7f77080c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 -- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 msgr2=0x7f77081eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 0x7f77081eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 -- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 msgr2=0x7f77080c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 0x7f77080c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 -- 172.21.15.43:0/3576174018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80094a0 con 0x7f77080c4630 2023-08-27T11:27:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770db9c700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 0x7f77081eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770d39b700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 0x7f77080c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770cb9a700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f76f800ebe0 tx=0x7f76f8009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800c910 con 0x7f77080c4630 2023-08-27T11:27:34.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f800ca70 con 0x7f77080c4630 2023-08-27T11:27:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7700009b30 con 0x7f77080c4630 2023-08-27T11:27:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f800cde0 con 0x7f77080c4630 2023-08-27T11:27:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.044+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77080c1190 con 0x7f77080c4630 2023-08-27T11:27:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.045+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770804ee70 con 0x7f77080c4630 2023-08-27T11:27:34.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.046+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76f8013470 con 0x7f77080c4630 2023-08-27T11:27:34.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.047+0000 7f76fdffb700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 0x7f76ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.047+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f76f8088470 con 0x7f77080c4630 2023-08-27T11:27:34.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.047+0000 7f770d39b700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 0x7f76ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.048+0000 7f770d39b700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 0x7f76ec06c5a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7704000f60 tx=0x7f7704009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.052+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76f8053e40 con 0x7f77080c4630 2023-08-27T11:27:34.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.261+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"} v 0) v1 -- 0x7f770806c130 con 0x7f77080c4630 2023-08-27T11:27:34.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.265+0000 7f76fdffb700 1 -- 172.21.15.43:0/3576174018 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"}]=0 v36) v1 ==== 96+0+0 (secure 0 0 0) 0x7f76f8057460 con 0x7f77080c4630 2023-08-27T11:27:34.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 msgr2=0x7f76ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 0x7f76ec06c5a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7704000f60 tx=0x7f7704009040 comp rx=0 tx=0).stop 2023-08-27T11:27:34.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 msgr2=0x7f770814c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f76f800ebe0 tx=0x7f76f8009ec0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 shutdown_connections 2023-08-27T11:27:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76ec06a0e0 0x7f76ec06c5a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7708151a90 0x7f77081eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f770806ad70 0x7f77080c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 --2- 172.21.15.43:0/3576174018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f77080c4630 0x7f770814c440 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 >> 172.21.15.43:0/3576174018 conn(0x7f77080ab820 msgr2=0x7f770814b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:34.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 shutdown_connections 2023-08-27T11:27:34.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.268+0000 7f770f5ff700 1 -- 172.21.15.43:0/3576174018 wait complete. 2023-08-27T11:27:34.288 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady' 2023-08-27T11:27:34.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.490+0000 7f0461dff700 1 Processor -- start 2023-08-27T11:27:34.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.490+0000 7f0461dff700 1 -- start start 2023-08-27T11:27:34.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.491+0000 7f0461dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f045c0c4630 0x7f045c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.491+0000 7f0461dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0461dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c06c4e0 con 0x7f045c151a90 2023-08-27T11:27:34.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0461dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c155370 con 0x7f045c0c4630 2023-08-27T11:27:34.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0461dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0c82c0 con 0x7f045c06ad70 2023-08-27T11:27:34.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f045b7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f045c151a90 0x7f045c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57632/0 (socket says 172.21.15.43:57632) 2023-08-27T11:27:34.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f045b7fe700 1 -- 172.21.15.43:0/294109103 learned_addr learned my addr 172.21.15.43:0/294109103 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:34.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0453fff700 1 --2- 172.21.15.43:0/294109103 >> v2:172.21.15.43:3300/0 conn(0x7f045c0c4630 0x7f045c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f045bfff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f045affd700 1 -- 172.21.15.43:0/294109103 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272033971 0 0) 0x7f045c06c4e0 con 0x7f045c151a90 2023-08-27T11:27:34.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f045affd700 1 -- 172.21.15.43:0/294109103 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04480035b0 con 0x7f045c151a90 2023-08-27T11:27:34.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0453fff700 1 -- 172.21.15.43:0/294109103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 msgr2=0x7f045c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:34.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0453fff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0453fff700 1 -- 172.21.15.43:0/294109103 >> v1:172.21.15.43:6789/0 conn(0x7f045c151a90 legacy=0x7f045c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.492+0000 7f0453fff700 1 -- 172.21.15.43:0/294109103 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c151e70 con 0x7f045c0c4630 2023-08-27T11:27:34.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f0453fff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c0c4630 0x7f045c0c4a90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0444009840 tx=0x7f0444009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f3facadfdcc322 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f045affd700 1 -- 172.21.15.43:0/294109103 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444011830 con 0x7f045c0c4630 2023-08-27T11:27:34.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f045affd700 1 -- 172.21.15.43:0/294109103 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444011990 con 0x7f045c0c4630 2023-08-27T11:27:34.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f045affd700 1 -- 172.21.15.43:0/294109103 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444011d20 con 0x7f045c0c4630 2023-08-27T11:27:34.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f0461dff700 1 -- 172.21.15.43:0/294109103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c0c4630 msgr2=0x7f045c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.493+0000 7f0461dff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c0c4630 0x7f045c0c4a90 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0444009840 tx=0x7f0444009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:34.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 -- 172.21.15.43:0/294109103 shutdown_connections 2023-08-27T11:27:34.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 --2- 172.21.15.43:0/294109103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c0c4630 0x7f045c0c4a90 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 -- 172.21.15.43:0/294109103 >> 172.21.15.43:0/294109103 conn(0x7f045c0ab820 msgr2=0x7f045c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:34.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 -- 172.21.15.43:0/294109103 shutdown_connections 2023-08-27T11:27:34.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.494+0000 7f0461dff700 1 -- 172.21.15.43:0/294109103 wait complete. 2023-08-27T11:27:34.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.495+0000 7f0461dff700 1 Processor -- start 2023-08-27T11:27:34.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.495+0000 7f0461dff700 1 -- start start 2023-08-27T11:27:34.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f045c0c4630 0x7f045c0c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c152a50 con 0x7f045c151a90 2023-08-27T11:27:34.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c152140 con 0x7f045c0c4630 2023-08-27T11:27:34.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.496+0000 7f0461dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c1edb80 con 0x7f045c06ad70 2023-08-27T11:27:34.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55794/0 (socket says 172.21.15.43:55794) 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 -- 172.21.15.43:0/2097563239 learned_addr learned my addr 172.21.15.43:0/2097563239 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045b7fe700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f0453fff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f045c0c4630 0x7f045c0c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 -- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 msgr2=0x7f045c06b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 -- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f045c0c4630 msgr2=0x7f045c0c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f045c0c4630 0x7f045c0c1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 -- 172.21.15.43:0/2097563239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440094a0 con 0x7f045c151a90 2023-08-27T11:27:34.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.497+0000 7f045bfff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0454007e40 tx=0x7f045400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.498+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400ed30 con 0x7f045c151a90 2023-08-27T11:27:34.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.498+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0454014420 con 0x7f045c151a90 2023-08-27T11:27:34.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.498+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c152390 con 0x7f045c151a90 2023-08-27T11:27:34.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.498+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540147d0 con 0x7f045c151a90 2023-08-27T11:27:34.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.498+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c06b9b0 con 0x7f045c151a90 2023-08-27T11:27:34.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.499+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c152b90 con 0x7f045c151a90 2023-08-27T11:27:34.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.500+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0454014930 con 0x7f045c151a90 2023-08-27T11:27:34.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.501+0000 7f0458ff9700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 0x7f043c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:34.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.501+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0454088970 con 0x7f045c151a90 2023-08-27T11:27:34.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.501+0000 7f045b7fe700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 0x7f043c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:34.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.501+0000 7f045b7fe700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 0x7f043c06c5f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f044c007fd0 tx=0x7f044c007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:34.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.505+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f045c152b90 con 0x7f045c151a90 2023-08-27T11:27:34.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.803+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady"]} v 0) v1 -- 0x7f045c152b90 con 0x7f045c151a90 2023-08-27T11:27:34.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.936+0000 7f0458ff9700 1 -- 172.21.15.43:0/2097563239 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_steady"]}]=0 v286) v1 ==== 145+0+0 (secure 0 0 0) 0x7f045c152b90 con 0x7f045c151a90 2023-08-27T11:27:34.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 msgr2=0x7f043c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 0x7f043c06c5f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f044c007fd0 tx=0x7f044c007dc0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 msgr2=0x7f045c0c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:34.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0454007e40 tx=0x7f045400e3c0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 shutdown_connections 2023-08-27T11:27:34.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043c06a130 0x7f043c06c5f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f045c151a90 0x7f045c0c2330 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f045c06ad70 0x7f045c06b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 --2- 172.21.15.43:0/2097563239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f045c0c4630 0x7f045c0c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:34.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.938+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 >> 172.21.15.43:0/2097563239 conn(0x7f045c0ab820 msgr2=0x7f045c14f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:34.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.939+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 shutdown_connections 2023-08-27T11:27:34.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:34.939+0000 7f0461dff700 1 -- 172.21.15.43:0/2097563239 wait complete. 2023-08-27T11:27:34.959 INFO:tasks.cephfs_test_runner:That a sole MDS with mds_join_fs set will come back as active eventually even after failover. ... ok 2023-08-27T11:27:34.959 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_unset (tasks.cephfs.test_failover.TestClusterAffinity) That unsetting mds_join_fs will cause failover if another high-affinity standby exists. 2023-08-27T11:27:34.960 INFO:tasks.cephfs_test_runner:test_join_fs_unset (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:27:34.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset' 2023-08-27T11:27:35.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.162+0000 7f2af3fff700 1 Processor -- start 2023-08-27T11:27:35.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.162+0000 7f2af3fff700 1 -- start start 2023-08-27T11:27:35.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.163+0000 7f2af3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2aec06ca60 0x7f2aec06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.163+0000 7f2af3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2aec155910 0x7f2aec155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.163+0000 7f2af3fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec06d700 con 0x7f2aec0c51a0 2023-08-27T11:27:35.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.163+0000 7f2af3fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec1530b0 con 0x7f2aec06ca60 2023-08-27T11:27:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.163+0000 7f2af3fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec14c860 con 0x7f2aec155910 2023-08-27T11:27:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2aec06ca60 0x7f2aec06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f2aec06ca60 0x7f2aec06d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55796/0 (socket says 172.21.15.43:55796) 2023-08-27T11:27:35.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 -- 172.21.15.43:0/2385439631 learned_addr learned my addr 172.21.15.43:0/2385439631 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af259c700 1 --2- 172.21.15.43:0/2385439631 >> v2:172.21.15.57:3300/0 conn(0x7f2aec155910 0x7f2aec155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 -- 172.21.15.43:0/2385439631 >> v2:172.21.15.57:3300/0 conn(0x7f2aec155910 msgr2=0x7f2aec155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 --2- 172.21.15.43:0/2385439631 >> v2:172.21.15.57:3300/0 conn(0x7f2aec155910 0x7f2aec155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 -- 172.21.15.43:0/2385439631 >> v1:172.21.15.57:6789/0 conn(0x7f2aec0c51a0 legacy=0x7f2aec0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 -- 172.21.15.43:0/2385439631 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec152430 con 0x7f2aec06ca60 2023-08-27T11:27:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.164+0000 7f2af159a700 1 --2- 172.21.15.43:0/2385439631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec06d1c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2aec153440 tx=0x7f2adc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e487bde38841c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af0d99700 1 -- 172.21.15.43:0/2385439631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00b860 con 0x7f2aec06ca60 2023-08-27T11:27:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af0d99700 1 -- 172.21.15.43:0/2385439631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00b9c0 con 0x7f2aec06ca60 2023-08-27T11:27:35.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af0d99700 1 -- 172.21.15.43:0/2385439631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00bd50 con 0x7f2aec06ca60 2023-08-27T11:27:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 -- 172.21.15.43:0/2385439631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 msgr2=0x7f2aec06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 --2- 172.21.15.43:0/2385439631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec06d1c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f2aec153440 tx=0x7f2adc009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 -- 172.21.15.43:0/2385439631 shutdown_connections 2023-08-27T11:27:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 --2- 172.21.15.43:0/2385439631 >> v2:172.21.15.57:3300/0 conn(0x7f2aec155910 0x7f2aec155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 --2- 172.21.15.43:0/2385439631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec06d1c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 -- 172.21.15.43:0/2385439631 >> 172.21.15.43:0/2385439631 conn(0x7f2aec06aa50 msgr2=0x7f2aec0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:35.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.165+0000 7f2af3fff700 1 -- 172.21.15.43:0/2385439631 shutdown_connections 2023-08-27T11:27:35.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.166+0000 7f2af3fff700 1 -- 172.21.15.43:0/2385439631 wait complete. 2023-08-27T11:27:35.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.167+0000 7f2af3fff700 1 Processor -- start 2023-08-27T11:27:35.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.167+0000 7f2af3fff700 1 -- start start 2023-08-27T11:27:35.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 0x7f2aec0a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 0x7f2aec0bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1eb7b0 con 0x7f2aec06ca60 2023-08-27T11:27:35.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec1e7490 con 0x7f2aec0c51a0 2023-08-27T11:27:35.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0bb980 con 0x7f2aec155910 2023-08-27T11:27:35.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55804/0 (socket says 172.21.15.43:55804) 2023-08-27T11:27:35.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.168+0000 7f2af1d9b700 1 -- 172.21.15.43:0/3488536375 learned_addr learned my addr 172.21.15.43:0/3488536375 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:35.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af259c700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 0x7f2aec0bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af159a700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 0x7f2aec0a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 -- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 msgr2=0x7f2aec0bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 0x7f2aec0bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 -- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 msgr2=0x7f2aec0a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 0x7f2aec0a79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 -- 172.21.15.43:0/3488536375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc009550 con 0x7f2aec06ca60 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af259c700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 0x7f2aec0bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af159a700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 0x7f2aec0a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2af1d9b700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c4e0 tx=0x7f2ae800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:35.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80052d0 con 0x7f2aec06ca60 2023-08-27T11:27:35.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae8005430 con 0x7f2aec06ca60 2023-08-27T11:27:35.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.169+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80038c0 con 0x7f2aec06ca60 2023-08-27T11:27:35.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.170+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0bbc60 con 0x7f2aec06ca60 2023-08-27T11:27:35.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.170+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec0bc220 con 0x7f2aec06ca60 2023-08-27T11:27:35.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.171+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec04ee70 con 0x7f2aec06ca60 2023-08-27T11:27:35.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.172+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2ae8003a20 con 0x7f2aec06ca60 2023-08-27T11:27:35.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.173+0000 7f2ae27fc700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 0x7f2ad006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:35.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.173+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f2ae8087800 con 0x7f2aec06ca60 2023-08-27T11:27:35.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.173+0000 7f2af159a700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 0x7f2ad006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:35.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.173+0000 7f2af159a700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 0x7f2ad006c5a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000c00 tx=0x7f2adc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:35.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.177+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2ae8053130 con 0x7f2aec06ca60 2023-08-27T11:27:35.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.472+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset"]} v 0) v1 -- 0x7f2aec06c840 con 0x7f2aec06ca60 2023-08-27T11:27:35.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.939+0000 7f2ae27fc700 1 -- 172.21.15.43:0/3488536375 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset"]}]=0 v287) v1 ==== 147+0+0 (secure 0 0 0) 0x7f2ae8056750 con 0x7f2aec06ca60 2023-08-27T11:27:35.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.941+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 msgr2=0x7f2ad006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.941+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 0x7f2ad006c5a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2adc000c00 tx=0x7f2adc008030 comp rx=0 tx=0).stop 2023-08-27T11:27:35.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.941+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 msgr2=0x7f2aec1eb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:35.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.941+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800c4e0 tx=0x7f2ae800c8a0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 shutdown_connections 2023-08-27T11:27:35.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2ad006a0e0 0x7f2ad006c5a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2aec155910 0x7f2aec0bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2aec06ca60 0x7f2aec1eb270 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 --2- 172.21.15.43:0/3488536375 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2aec0c51a0 0x7f2aec0a79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:35.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 >> 172.21.15.43:0/3488536375 conn(0x7f2aec06aa50 msgr2=0x7f2aec151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:35.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 shutdown_connections 2023-08-27T11:27:35.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:35.942+0000 7f2af3fff700 1 -- 172.21.15.43:0/3488536375 wait complete. 2023-08-27T11:27:35.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:36.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.169+0000 7f7ac57ff700 1 Processor -- start 2023-08-27T11:27:36.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.169+0000 7f7ac57ff700 1 -- start start 2023-08-27T11:27:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.170+0000 7f7ac57ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7ac0151910 0x7f7ac0157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.170+0000 7f7ac57ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ac00c51a0 0x7f7ac0157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.170+0000 7f7ac57ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac00c5ae0 con 0x7f7ac00c15e0 2023-08-27T11:27:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.170+0000 7f7ac57ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac0158480 con 0x7f7ac0151910 2023-08-27T11:27:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.170+0000 7f7ac57ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00c1190 con 0x7f7ac00c51a0 2023-08-27T11:27:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abf7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7ac00c15e0 0x7f7ac00c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57648/0 (socket says 172.21.15.43:57648) 2023-08-27T11:27:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7ac0151910 0x7f7ac0157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abf7fe700 1 -- 172.21.15.43:0/3292090226 learned_addr learned my addr 172.21.15.43:0/3292090226 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abe7fc700 1 --2- 172.21.15.43:0/3292090226 >> v2:172.21.15.57:3300/0 conn(0x7f7ac00c51a0 0x7f7ac0157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 -- 172.21.15.43:0/3292090226 >> v2:172.21.15.57:3300/0 conn(0x7f7ac00c51a0 msgr2=0x7f7ac0157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 --2- 172.21.15.43:0/3292090226 >> v2:172.21.15.57:3300/0 conn(0x7f7ac00c51a0 0x7f7ac0157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 -- 172.21.15.43:0/3292090226 >> v1:172.21.15.43:6789/0 conn(0x7f7ac00c15e0 legacy=0x7f7ac00c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 -- 172.21.15.43:0/3292090226 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0072900 con 0x7f7ac0151910 2023-08-27T11:27:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.171+0000 7f7abeffd700 1 --2- 172.21.15.43:0/3292090226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac0157a00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00c8ac0 tx=0x7f7ab0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820fc74eab8f1925 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7abdffb700 1 -- 172.21.15.43:0/3292090226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0011830 con 0x7f7ac0151910 2023-08-27T11:27:36.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7abdffb700 1 -- 172.21.15.43:0/3292090226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0011990 con 0x7f7ac0151910 2023-08-27T11:27:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7abdffb700 1 -- 172.21.15.43:0/3292090226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0011d20 con 0x7f7ac0151910 2023-08-27T11:27:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3292090226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 msgr2=0x7f7ac0157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3292090226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac0157a00 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00c8ac0 tx=0x7f7ab0009b20 comp rx=0 tx=0).stop 2023-08-27T11:27:36.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3292090226 shutdown_connections 2023-08-27T11:27:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3292090226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac0157a00 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3292090226 >> v2:172.21.15.57:3300/0 conn(0x7f7ac00c51a0 0x7f7ac0157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3292090226 >> 172.21.15.43:0/3292090226 conn(0x7f7ac00a9740 msgr2=0x7f7ac00a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3292090226 shutdown_connections 2023-08-27T11:27:36.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.172+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3292090226 wait complete. 2023-08-27T11:27:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.175+0000 7f7ac57ff700 1 Processor -- start 2023-08-27T11:27:36.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.175+0000 7f7ac57ff700 1 -- start start 2023-08-27T11:27:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ac00c15e0 0x7f7ac006e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 0x7f7ac0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006d230 con 0x7f7ac0151910 2023-08-27T11:27:36.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac01e9c10 con 0x7f7ac00c51a0 2023-08-27T11:27:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7ac57ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00a6990 con 0x7f7ac00c15e0 2023-08-27T11:27:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.176+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55826/0 (socket says 172.21.15.43:55826) 2023-08-27T11:27:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 -- 172.21.15.43:0/3961218043 learned_addr learned my addr 172.21.15.43:0/3961218043 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:36.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abe7fc700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 0x7f7ac0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abeffd700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ac00c15e0 0x7f7ac006e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 -- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ac00c15e0 msgr2=0x7f7ac006e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ac00c15e0 0x7f7ac006e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 -- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 msgr2=0x7f7ac0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 0x7f7ac0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 -- 172.21.15.43:0/3961218043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00094a0 con 0x7f7ac0151910 2023-08-27T11:27:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abe7fc700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 0x7f7ac0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:36.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7abf7fe700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800cb00 tx=0x7f7ab800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800aa80 con 0x7f7ac0151910 2023-08-27T11:27:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800abe0 con 0x7f7ac0151910 2023-08-27T11:27:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.177+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac01527c0 con 0x7f7ac0151910 2023-08-27T11:27:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.178+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8012400 con 0x7f7ac0151910 2023-08-27T11:27:36.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.178+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac01e98e0 con 0x7f7ac0151910 2023-08-27T11:27:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.179+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac004ee70 con 0x7f7ac0151910 2023-08-27T11:27:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.180+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ab801b3b0 con 0x7f7ac0151910 2023-08-27T11:27:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.180+0000 7f7aa77fe700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 0x7f7aac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.181+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7ab8087e40 con 0x7f7ac0151910 2023-08-27T11:27:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.181+0000 7f7abeffd700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 0x7f7aac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.182+0000 7f7abeffd700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 0x7f7aac06c5a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00090b0 tx=0x7f7ab0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.185+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ab8053820 con 0x7f7ac0151910 2023-08-27T11:27:36.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.401+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac01e9d50 con 0x7f7ac0151910 2023-08-27T11:27:36.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.402+0000 7f7aa77fe700 1 -- 172.21.15.43:0/3961218043 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+14911 (secure 0 0 0) 0x7f7ab8056e40 con 0x7f7ac0151910 2023-08-27T11:27:36.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:36.404 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":101,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:33.322356+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1628131230":"2023-08-28T11:27:30.312378+0000","172.21.15.43:6835/1628131230":"2023-08-28T11:27:30.312378+0000","172.21.15.43:6837/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6834/1648653949":"2023-08-28T11:27:20.488723+0000","172.21.15.43:6836/863801259":"2023-08-28T11:27:17.448197+0000","172.21.15.43:6835/863801259":"2023-08-28T11:27:17.448197+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:36.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 msgr2=0x7f7aac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 0x7f7aac06c5a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00090b0 tx=0x7f7ab0008030 comp rx=0 tx=0).stop 2023-08-27T11:27:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 msgr2=0x7f7ac01ea0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800cb00 tx=0x7f7ab800cec0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 shutdown_connections 2023-08-27T11:27:36.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7aac06a0e0 0x7f7aac06c5a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7ac0151910 0x7f7ac01ea0a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ac00c15e0 0x7f7ac006e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 --2- 172.21.15.43:0/3961218043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ac00c51a0 0x7f7ac0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 >> 172.21.15.43:0/3961218043 conn(0x7f7ac00a9740 msgr2=0x7f7ac00c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:36.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 shutdown_connections 2023-08-27T11:27:36.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.405+0000 7f7ac57ff700 1 -- 172.21.15.43:0/3961218043 wait complete. 2023-08-27T11:27:36.424 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:27:36.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:27:36.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.628+0000 7fa4161ff700 1 Processor -- start 2023-08-27T11:27:36.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.628+0000 7fa4161ff700 1 -- start start 2023-08-27T11:27:36.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.629+0000 7fa4161ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 0x7fa410151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.629+0000 7fa4161ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 0x7fa4100c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.629+0000 7fa4161ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4100c80c0 con 0x7fa4100ac410 2023-08-27T11:27:36.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.629+0000 7fa4161ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4100c9bd0 con 0x7fa410151cd0 2023-08-27T11:27:36.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.629+0000 7fa4161ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101555a0 con 0x7fa4100c49f0 2023-08-27T11:27:36.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa4100ac410 0x7fa4100c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57656/0 (socket says 172.21.15.43:57656) 2023-08-27T11:27:36.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40ffff700 1 -- 172.21.15.43:0/3190277750 learned_addr learned my addr 172.21.15.43:0/3190277750 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:36.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40effd700 1 --2- 172.21.15.43:0/3190277750 >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 0x7fa4100c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/3190277750 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 0x7fa410151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40e7fc700 1 -- 172.21.15.43:0/3190277750 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207311745 0 0) 0x7fa4100c80c0 con 0x7fa4100ac410 2023-08-27T11:27:36.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40e7fc700 1 -- 172.21.15.43:0/3190277750 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3f80035b0 con 0x7fa4100ac410 2023-08-27T11:27:36.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40f7fe700 1 -- 172.21.15.43:0/3190277750 >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 msgr2=0x7fa4100c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:36.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/3190277750 >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 0x7fa4100c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40f7fe700 1 -- 172.21.15.43:0/3190277750 >> v1:172.21.15.43:6789/0 conn(0x7fa4100ac410 legacy=0x7fa4100c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40f7fe700 1 -- 172.21.15.43:0/3190277750 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4101552c0 con 0x7fa4100c49f0 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.630+0000 7fa40effd700 1 --2- 172.21.15.43:0/3190277750 >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 0x7fa4100c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.631+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/3190277750 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 0x7fa410151790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa400009840 tx=0x7fa400009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b296b5d8bea3f0a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.631+0000 7fa40e7fc700 1 -- 172.21.15.43:0/3190277750 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400011830 con 0x7fa4100c49f0 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.631+0000 7fa40e7fc700 1 -- 172.21.15.43:0/3190277750 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa400011990 con 0x7fa4100c49f0 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.631+0000 7fa40e7fc700 1 -- 172.21.15.43:0/3190277750 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400011d20 con 0x7fa4100c49f0 2023-08-27T11:27:36.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 -- 172.21.15.43:0/3190277750 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 msgr2=0x7fa410151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 --2- 172.21.15.43:0/3190277750 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 0x7fa410151790 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa400009840 tx=0x7fa400009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:36.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 -- 172.21.15.43:0/3190277750 shutdown_connections 2023-08-27T11:27:36.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 --2- 172.21.15.43:0/3190277750 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa4100c49f0 0x7fa410151790 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 --2- 172.21.15.43:0/3190277750 >> v2:172.21.15.57:3300/0 conn(0x7fa410151cd0 0x7fa4100c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 -- 172.21.15.43:0/3190277750 >> 172.21.15.43:0/3190277750 conn(0x7fa4100ab8f0 msgr2=0x7fa4100abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:36.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 -- 172.21.15.43:0/3190277750 shutdown_connections 2023-08-27T11:27:36.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.632+0000 7fa4161ff700 1 -- 172.21.15.43:0/3190277750 wait complete. 2023-08-27T11:27:36.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.633+0000 7fa4161ff700 1 Processor -- start 2023-08-27T11:27:36.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 -- start start 2023-08-27T11:27:36.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100c49f0 0x7fa4101567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 0x7fa4100c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101e9d30 con 0x7fa4100ac410 2023-08-27T11:27:36.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101e9fa0 con 0x7fa4100c49f0 2023-08-27T11:27:36.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.634+0000 7fa4161ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa410158990 con 0x7fa410151cd0 2023-08-27T11:27:36.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55842/0 (socket says 172.21.15.43:55842) 2023-08-27T11:27:36.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 -- 172.21.15.43:0/1292615850 learned_addr learned my addr 172.21.15.43:0/1292615850 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:36.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40effd700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100c49f0 0x7fa4101567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40ffff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 0x7fa4100c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 -- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 msgr2=0x7fa4100c0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 0x7fa4100c0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 -- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100c49f0 msgr2=0x7fa4101567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100c49f0 0x7fa4101567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 -- 172.21.15.43:0/1292615850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040094a0 con 0x7fa4100ac410 2023-08-27T11:27:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40ffff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 0x7fa4100c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.635+0000 7fa40f7fe700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa400009fd0 tx=0x7fa400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.636+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000036a0 con 0x7fa4100ac410 2023-08-27T11:27:36.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.636+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40001f070 con 0x7fa4100ac410 2023-08-27T11:27:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.636+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4000094a0 con 0x7fa4100ac410 2023-08-27T11:27:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.636+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400003a20 con 0x7fa4100ac410 2023-08-27T11:27:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.636+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410155c30 con 0x7fa4100ac410 2023-08-27T11:27:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.637+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4100c89e0 con 0x7fa4100ac410 2023-08-27T11:27:36.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.638+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa400003b80 con 0x7fa4100ac410 2023-08-27T11:27:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.638+0000 7fa3f7fff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 0x7fa3fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.639+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa400021070 con 0x7fa4100ac410 2023-08-27T11:27:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.639+0000 7fa40effd700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 0x7fa3fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:36.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.639+0000 7fa40effd700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 0x7fa3fc06c5a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa4100c6070 tx=0x7fa404009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:36.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.643+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa400055460 con 0x7fa4100ac410 2023-08-27T11:27:36.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.850+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa41004ee70 con 0x7fa4100ac410 2023-08-27T11:27:36.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.850+0000 7fa3f7fff700 1 -- 172.21.15.43:0/1292615850 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa400015020 con 0x7fa4100ac410 2023-08-27T11:27:36.852 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:27:36.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.852+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 msgr2=0x7fa3fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 0x7fa3fc06c5a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa4100c6070 tx=0x7fa404009210 comp rx=0 tx=0).stop 2023-08-27T11:27:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 msgr2=0x7fa4101ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa400009fd0 tx=0x7fa400004750 comp rx=0 tx=0).stop 2023-08-27T11:27:36.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 shutdown_connections 2023-08-27T11:27:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa3fc06a0e0 0x7fa3fc06c5a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa410151cd0 0x7fa4100c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4100ac410 0x7fa4101ea720 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 --2- 172.21.15.43:0/1292615850 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4100c49f0 0x7fa4101567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:36.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 >> 172.21.15.43:0/1292615850 conn(0x7fa4100ab8f0 msgr2=0x7fa410150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:36.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 shutdown_connections 2023-08-27T11:27:36.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:36.853+0000 7fa4161ff700 1 -- 172.21.15.43:0/1292615850 wait complete. 2023-08-27T11:27:36.872 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:27:37.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.078+0000 7f93e95ff700 1 Processor -- start 2023-08-27T11:27:37.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.078+0000 7f93e95ff700 1 -- start start 2023-08-27T11:27:37.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e95ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93e4151d20 0x7f93e40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e95ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e4154660 con 0x7f93e406a8e0 2023-08-27T11:27:37.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e95ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e4154940 con 0x7f93e40c7c00 2023-08-27T11:27:37.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e95ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40c5750 con 0x7f93e4151d20 2023-08-27T11:27:37.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e37fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f93e406a8e0 0x7f93e406acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:57672/0 (socket says 172.21.15.43:57672) 2023-08-27T11:27:37.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e37fe700 1 -- 172.21.15.43:0/2246354662 learned_addr learned my addr 172.21.15.43:0/2246354662 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:37.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.080+0000 7f93e2ffd700 1 --2- 172.21.15.43:0/2246354662 >> v2:172.21.15.57:3300/0 conn(0x7f93e4151d20 0x7f93e40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628549730 0 0) 0x7f93e4154660 con 0x7f93e406a8e0 2023-08-27T11:27:37.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93cc0035b0 con 0x7f93e406a8e0 2023-08-27T11:27:37.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255803389 0 0) 0x7f93e4154940 con 0x7f93e40c7c00 2023-08-27T11:27:37.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4154660 con 0x7f93e40c7c00 2023-08-27T11:27:37.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e2ffd700 1 -- 172.21.15.43:0/2246354662 >> v1:172.21.15.57:6789/0 conn(0x7f93e40c7c00 legacy=0x7f93e40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e2ffd700 1 -- 172.21.15.43:0/2246354662 >> v1:172.21.15.43:6789/0 conn(0x7f93e406a8e0 legacy=0x7f93e406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e2ffd700 1 -- 172.21.15.43:0/2246354662 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4154c20 con 0x7f93e4151d20 2023-08-27T11:27:37.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.081+0000 7f93e2ffd700 1 --2- 172.21.15.43:0/2246354662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e40c8110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93e4152140 tx=0x7f93d4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2373df510ac5a814 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4004020 con 0x7f93e4151d20 2023-08-27T11:27:37.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4004180 con 0x7f93e4151d20 2023-08-27T11:27:37.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e1ffb700 1 -- 172.21.15.43:0/2246354662 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4004530 con 0x7f93e4151d20 2023-08-27T11:27:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 -- 172.21.15.43:0/2246354662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 msgr2=0x7f93e40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 --2- 172.21.15.43:0/2246354662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e40c8110 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f93e4152140 tx=0x7f93d4009b20 comp rx=0 tx=0).stop 2023-08-27T11:27:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 -- 172.21.15.43:0/2246354662 shutdown_connections 2023-08-27T11:27:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 --2- 172.21.15.43:0/2246354662 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e40c8110 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 -- 172.21.15.43:0/2246354662 >> 172.21.15.43:0/2246354662 conn(0x7f93e40c9d00 msgr2=0x7f93e40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:37.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 -- 172.21.15.43:0/2246354662 shutdown_connections 2023-08-27T11:27:37.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.082+0000 7f93e95ff700 1 -- 172.21.15.43:0/2246354662 wait complete. 2023-08-27T11:27:37.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.085+0000 7f93e95ff700 1 Processor -- start 2023-08-27T11:27:37.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.085+0000 7f93e95ff700 1 -- start start 2023-08-27T11:27:37.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e40c7c00 0x7f93e41ea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e41ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40c3dc0 con 0x7f93e406a8e0 2023-08-27T11:27:37.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41ecb20 con 0x7f93e4151d20 2023-08-27T11:27:37.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e95ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41581a0 con 0x7f93e40c7c00 2023-08-27T11:27:37.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55858/0 (socket says 172.21.15.43:55858) 2023-08-27T11:27:37.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.086+0000 7f93e2ffd700 1 -- 172.21.15.43:0/1216228341 learned_addr learned my addr 172.21.15.43:0/1216228341 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:37.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e37fe700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e41ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e27fc700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e40c7c00 0x7f93e41ea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 -- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e40c7c00 msgr2=0x7f93e41ea0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e40c7c00 0x7f93e41ea0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 -- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 msgr2=0x7f93e41ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e41ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 -- 172.21.15.43:0/1216228341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40094a0 con 0x7f93e406a8e0 2023-08-27T11:27:37.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e37fe700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e41ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:37.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e2ffd700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f93d40090b0 tx=0x7f93d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4011e60 con 0x7f93e406a8e0 2023-08-27T11:27:37.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40036a0 con 0x7f93e406a8e0 2023-08-27T11:27:37.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4003a50 con 0x7f93e406a8e0 2023-08-27T11:27:37.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.087+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e41e9c30 con 0x7f93e406a8e0 2023-08-27T11:27:37.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.088+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41eda60 con 0x7f93e406a8e0 2023-08-27T11:27:37.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.089+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e41e9f10 con 0x7f93e406a8e0 2023-08-27T11:27:37.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.089+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93d4003bb0 con 0x7f93e406a8e0 2023-08-27T11:27:37.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.091+0000 7f93cb7fe700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.091+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f93d4089660 con 0x7f93e406a8e0 2023-08-27T11:27:37.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.091+0000 7f93e27fc700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.092+0000 7f93e27fc700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 0x7f93d006c5a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c09b0 tx=0x7f93d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.095+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93d40550b0 con 0x7f93e406a8e0 2023-08-27T11:27:37.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.307+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e404ee70 con 0x7f93e406a8e0 2023-08-27T11:27:37.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.307+0000 7f93cb7fe700 1 -- 172.21.15.43:0/1216228341 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93d4006cc0 con 0x7f93e406a8e0 2023-08-27T11:27:37.309 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:27:37.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 msgr2=0x7f93d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 0x7f93d006c5a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c09b0 tx=0x7f93d8009040 comp rx=0 tx=0).stop 2023-08-27T11:27:37.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 msgr2=0x7f93e40c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f93d40090b0 tx=0x7f93d4004750 comp rx=0 tx=0).stop 2023-08-27T11:27:37.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 shutdown_connections 2023-08-27T11:27:37.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f93d006a0e0 0x7f93d006c5a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e4151d20 0x7f93e41ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f93e406a8e0 0x7f93e40c2fe0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 --2- 172.21.15.43:0/1216228341 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e40c7c00 0x7f93e41ea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 >> 172.21.15.43:0/1216228341 conn(0x7f93e40c9d00 msgr2=0x7f93e40bcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:37.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 shutdown_connections 2023-08-27T11:27:37.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.310+0000 7f93e95ff700 1 -- 172.21.15.43:0/1216228341 wait complete. 2023-08-27T11:27:37.330 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:27:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.532+0000 7f4b731ff700 1 Processor -- start 2023-08-27T11:27:37.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.532+0000 7f4b731ff700 1 -- start start 2023-08-27T11:27:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.533+0000 7f4b731ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b6c151fc0 0x7f4b6c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b731ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b731ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c157af0 con 0x7f4b6c0c0020 2023-08-27T11:27:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b731ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c071e10 con 0x7f4b6c151fc0 2023-08-27T11:27:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b731ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c158a80 con 0x7f4b6c071f70 2023-08-27T11:27:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b6c151fc0 0x7f4b6c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b7179c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b6c151fc0 0x7f4b6c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:56654/0 (socket says 172.21.15.43:56654) 2023-08-27T11:27:37.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1045532743 learned_addr learned my addr 172.21.15.43:0/1045532743 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:37.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b70f9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4b6c0c0020 0x7f4b6c1518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:57418/0 (socket says 172.21.15.43:57418) 2023-08-27T11:27:37.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 msgr2=0x7f4b6c0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:37.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 --2- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1045532743 >> v1:172.21.15.57:6789/0 conn(0x7f4b6c0c0020 legacy=0x7f4b6c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.534+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1045532743 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0a6040 con 0x7f4b6c151fc0 2023-08-27T11:27:37.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b6bfff700 1 --2- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c158540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b580098f0 tx=0x7f4b58009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d2f696032dd7a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b6b7fe700 1 -- 172.21.15.43:0/1045532743 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011830 con 0x7f4b6c151fc0 2023-08-27T11:27:37.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b6b7fe700 1 -- 172.21.15.43:0/1045532743 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b58011990 con 0x7f4b6c151fc0 2023-08-27T11:27:37.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b6b7fe700 1 -- 172.21.15.43:0/1045532743 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58011d20 con 0x7f4b6c151fc0 2023-08-27T11:27:37.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b731ff700 1 -- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 msgr2=0x7f4b6c158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.535+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c158540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b580098f0 tx=0x7f4b58009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:37.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 -- 172.21.15.43:0/1045532743 shutdown_connections 2023-08-27T11:27:37.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1045532743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c158540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 -- 172.21.15.43:0/1045532743 >> 172.21.15.43:0/1045532743 conn(0x7f4b6c0c6a40 msgr2=0x7f4b6c0c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 -- 172.21.15.43:0/1045532743 shutdown_connections 2023-08-27T11:27:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.536+0000 7f4b731ff700 1 -- 172.21.15.43:0/1045532743 wait complete. 2023-08-27T11:27:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.537+0000 7f4b731ff700 1 Processor -- start 2023-08-27T11:27:37.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.538+0000 7f4b731ff700 1 -- start start 2023-08-27T11:27:37.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.538+0000 7f4b731ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.538+0000 7f4b731ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b731ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c1ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b731ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c154e40 con 0x7f4b6c0c0020 2023-08-27T11:27:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b731ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0c2fe0 con 0x7f4b6c151fc0 2023-08-27T11:27:37.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b731ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c154530 con 0x7f4b6c071f70 2023-08-27T11:27:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b70f9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55866/0 (socket says 172.21.15.43:55866) 2023-08-27T11:27:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1730639988 learned_addr learned my addr 172.21.15.43:0/1730639988 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:37.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b7179c700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c1ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 msgr2=0x7f4b6c14e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c14e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 msgr2=0x7f4b6c1ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c1ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b6bfff700 1 -- 172.21.15.43:0/1730639988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58009550 con 0x7f4b6c0c0020 2023-08-27T11:27:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.539+0000 7f4b70f9b700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c14e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b6bfff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009c40 tx=0x7f4b58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58004240 con 0x7f4b6c0c0020 2023-08-27T11:27:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5801f070 con 0x7f4b6c0c0020 2023-08-27T11:27:37.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c14e6e0 con 0x7f4b6c0c0020 2023-08-27T11:27:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580036a0 con 0x7f4b6c0c0020 2023-08-27T11:27:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.540+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c154780 con 0x7f4b6c0c0020 2023-08-27T11:27:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.541+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c0c4af0 con 0x7f4b6c0c0020 2023-08-27T11:27:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.542+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b58021030 con 0x7f4b6c0c0020 2023-08-27T11:27:37.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.543+0000 7f4b697fa700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.543+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4b58089620 con 0x7f4b6c0c0020 2023-08-27T11:27:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.543+0000 7f4b70f9b700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:37.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.544+0000 7f4b70f9b700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f60 tx=0x7f4b60007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:37.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.547+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b58054f90 con 0x7f4b6c0c0020 2023-08-27T11:27:37.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.757+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4b6c154f80 con 0x7f4b6c0c0020 2023-08-27T11:27:37.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.761+0000 7f4b697fa700 1 -- 172.21.15.43:0/1730639988 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v37)=0 v37) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b6c154f80 con 0x7f4b6c0c0020 2023-08-27T11:27:37.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 msgr2=0x7f4b5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b60000f60 tx=0x7f4b60007ed0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 msgr2=0x7f4b6c152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:37.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009c40 tx=0x7f4b58004750 comp rx=0 tx=0).stop 2023-08-27T11:27:37.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 shutdown_connections 2023-08-27T11:27:37.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4b5006a0e0 0x7f4b5006c5a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b6c151fc0 0x7f4b6c1ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b6c071f70 0x7f4b6c14e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 --2- 172.21.15.43:0/1730639988 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4b6c0c0020 0x7f4b6c152870 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:37.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.763+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 >> 172.21.15.43:0/1730639988 conn(0x7f4b6c0c6a40 msgr2=0x7f4b6c0c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:37.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.764+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 shutdown_connections 2023-08-27T11:27:37.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:37.764+0000 7f4b731ff700 1 -- 172.21.15.43:0/1730639988 wait complete. 2023-08-27T11:27:37.783 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:27:37.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:27:37.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:27:37.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:27:37.982 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:27:37.982 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:27:38.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:27:38.027 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:27:38.028 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:27:38.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:27:38.073 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:27:38.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:38.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.274+0000 7fcd23fff700 1 Processor -- start 2023-08-27T11:27:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.274+0000 7fcd23fff700 1 -- start start 2023-08-27T11:27:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.275+0000 7fcd23fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd1c0c51a0 0x7fcd1c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.275+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 0x7fcd1c0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.275+0000 7fcd23fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c0c5ae0 con 0x7fcd1c151910 2023-08-27T11:27:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.275+0000 7fcd23fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0c69f0 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.275+0000 7fcd23fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0c1190 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 0x7fcd1c0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd1c0c51a0 0x7fcd1c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd21d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcd1c151910 0x7fcd1c157a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:57430/0 (socket says 172.21.15.43:57430) 2023-08-27T11:27:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd21d9b700 1 -- 172.21.15.43:0/474771438 learned_addr learned my addr 172.21.15.43:0/474771438 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 -- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 msgr2=0x7fcd1c0c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 0x7fcd1c0c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 -- 172.21.15.43:0/474771438 >> v1:172.21.15.57:6789/0 conn(0x7fcd1c151910 legacy=0x7fcd1c157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 -- 172.21.15.43:0/474771438 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c072900 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2259c700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 0x7fcd1c0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.276+0000 7fcd2159a700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c0c51a0 0x7fcd1c0c5f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009840 tx=0x7fcd0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6728621f7be7418 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd20d99700 1 -- 172.21.15.43:0/474771438 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c011830 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd20d99700 1 -- 172.21.15.43:0/474771438 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c011990 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd20d99700 1 -- 172.21.15.43:0/474771438 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c011d20 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 -- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c0c51a0 msgr2=0x7fcd1c0c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c0c51a0 0x7fcd1c0c5f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009840 tx=0x7fcd0c009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 -- 172.21.15.43:0/474771438 shutdown_connections 2023-08-27T11:27:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c15e0 0x7fcd1c0c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 --2- 172.21.15.43:0/474771438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c0c51a0 0x7fcd1c0c5f70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 -- 172.21.15.43:0/474771438 >> 172.21.15.43:0/474771438 conn(0x7fcd1c0a9740 msgr2=0x7fcd1c0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.277+0000 7fcd23fff700 1 -- 172.21.15.43:0/474771438 shutdown_connections 2023-08-27T11:27:38.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.278+0000 7fcd23fff700 1 -- 172.21.15.43:0/474771438 wait complete. 2023-08-27T11:27:38.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.279+0000 7fcd23fff700 1 Processor -- start 2023-08-27T11:27:38.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.279+0000 7fcd23fff700 1 -- start start 2023-08-27T11:27:38.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c51a0 0x7fcd1c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c151910 0x7fcd1c06e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0ab840 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c06e700 con 0x7fcd1c151910 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.280+0000 7fcd23fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1eab70 con 0x7fcd1c0c51a0 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55868/0 (socket says 172.21.15.43:55868) 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 -- 172.21.15.43:0/3866575948 learned_addr learned my addr 172.21.15.43:0/3866575948 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd2159a700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c51a0 0x7fcd1c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd2259c700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c151910 0x7fcd1c06e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 -- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c51a0 msgr2=0x7fcd1c06dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c51a0 0x7fcd1c06dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 -- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c151910 msgr2=0x7fcd1c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c151910 0x7fcd1c06e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 -- 172.21.15.43:0/3866575948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009a70 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.281+0000 7fcd21d9b700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c480 tx=0x7fcd1800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.282+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18005d70 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.282+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800ce80 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.282+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180072d0 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.282+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0094a0 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.282+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c0aba90 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.283+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c0c5680 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.284+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcd18007430 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.285+0000 7fcd127fc700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 0x7fcd0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.285+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fcd18087500 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.285+0000 7fcd2159a700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 0x7fcd0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.285+0000 7fcd2159a700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 0x7fcd0006c5a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000c00 tx=0x7fcd0c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.289+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcd18052ee0 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.543+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd1c04ee70 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.543+0000 7fcd127fc700 1 -- 172.21.15.43:0/3866575948 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+3696 (secure 0 0 0) 0x7fcd18017e80 con 0x7fcd1c0c15e0 2023-08-27T11:27:38.545 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:38.545 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":104,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6775,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3647973339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3647973339},{"type":"v1","addr":"172.21.15.57:6835","nonce":3647973339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":6778,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/22508657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":22508657},{"type":"v1","addr":"172.21.15.57:6834","nonce":22508657}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":7377,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/2721026752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2721026752},{"type":"v1","addr":"172.21.15.43:6837","nonce":2721026752}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100},{"gid":7482,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/2351105005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":2351105005},{"type":"v1","addr":"172.21.15.43:6836","nonce":2351105005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":104}],"filesystems":[]} 2023-08-27T11:27:38.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 msgr2=0x7fcd0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 0x7fcd0006c5a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c000c00 tx=0x7fcd0c01c040 comp rx=0 tx=0).stop 2023-08-27T11:27:38.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 msgr2=0x7fcd1c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fcd1800c480 tx=0x7fcd1800c790 comp rx=0 tx=0).stop 2023-08-27T11:27:38.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 shutdown_connections 2023-08-27T11:27:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcd0006a0e0 0x7fcd0006c5a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd1c151910 0x7fcd1c06e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcd1c0c15e0 0x7fcd1c152610 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 --2- 172.21.15.43:0/3866575948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd1c0c51a0 0x7fcd1c06dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 >> 172.21.15.43:0/3866575948 conn(0x7fcd1c0a9740 msgr2=0x7fcd1c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:38.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 shutdown_connections 2023-08-27T11:27:38.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.546+0000 7fcd23fff700 1 -- 172.21.15.43:0/3866575948 wait complete. 2023-08-27T11:27:38.551 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 104 2023-08-27T11:27:38.565 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:27:38.566 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:27:38.566 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:27:38.566 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:27:38.566 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:27:38.567 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:27:38.567 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:27:38.567 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:27:38.568 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:27:38.568 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:27:38.568 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:27:38.568 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:27:38.569 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:27:38.569 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:27:38.569 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:27:38.569 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:27:38.580 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:27:38.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:27:38.582 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:27:38.582 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:27:38.586 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:27:38.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:27:38.587 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:27:38.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:27:38.626 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:27:38.627 DEBUG:teuthology.parallel:result is None 2023-08-27T11:27:38.630 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:27:38.630 DEBUG:teuthology.parallel:result is None 2023-08-27T11:27:38.632 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:27:38.632 DEBUG:teuthology.parallel:result is None 2023-08-27T11:27:38.636 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:27:38.636 DEBUG:teuthology.parallel:result is None 2023-08-27T11:27:38.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:27:38.776 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:27:38.786 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:27:38.793 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:27:38.794 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:27:38.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.850+0000 7f39a83ff700 1 Processor -- start 2023-08-27T11:27:38.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.850+0000 7f39a83ff700 1 -- start start 2023-08-27T11:27:38.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.851+0000 7f39a83ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 0x7f39a00a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.851+0000 7f39a83ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 0x7f39a00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.851+0000 7f39a83ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a0154d00 con 0x7f39a00a79c0 2023-08-27T11:27:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.851+0000 7f39a83ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a00baf30 con 0x7f39a014e960 2023-08-27T11:27:38.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.851+0000 7f39a83ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0154fe0 con 0x7f39a00c50d0 2023-08-27T11:27:38.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a619b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 0x7f39a00a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 0x7f39a00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a599a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f39a00a79c0 0x7f39a00c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:39166/0 (socket says 172.21.15.43:39166) 2023-08-27T11:27:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a599a700 1 -- 172.21.15.43:0/1089246229 learned_addr learned my addr 172.21.15.43:0/1089246229 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a5199700 1 -- 172.21.15.43:0/1089246229 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777528204 0 0) 0x7f39a0154d00 con 0x7f39a00a79c0 2023-08-27T11:27:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a5199700 1 -- 172.21.15.43:0/1089246229 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c0035b0 con 0x7f39a00a79c0 2023-08-27T11:27:38.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 -- 172.21.15.43:0/1089246229 >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 msgr2=0x7f39a00a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:38.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 --2- 172.21.15.43:0/1089246229 >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 0x7f39a00a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 -- 172.21.15.43:0/1089246229 >> v1:172.21.15.57:6789/0 conn(0x7f39a00a79c0 legacy=0x7f39a00c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 -- 172.21.15.43:0/1089246229 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a01552c0 con 0x7f39a00c50d0 2023-08-27T11:27:38.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a619b700 1 --2- 172.21.15.43:0/1089246229 >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 0x7f39a00a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:38.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.852+0000 7f39a699c700 1 --2- 172.21.15.43:0/1089246229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 0x7f39a00c43d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3998009d90 tx=0x7f399800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8db1baeeeadd9a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a5199700 1 -- 172.21.15.43:0/1089246229 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800e070 con 0x7f39a00c50d0 2023-08-27T11:27:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a5199700 1 -- 172.21.15.43:0/1089246229 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800bb20 con 0x7f39a00c50d0 2023-08-27T11:27:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a5199700 1 -- 172.21.15.43:0/1089246229 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998012430 con 0x7f39a00c50d0 2023-08-27T11:27:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 -- 172.21.15.43:0/1089246229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 msgr2=0x7f39a00c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 --2- 172.21.15.43:0/1089246229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 0x7f39a00c43d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3998009d90 tx=0x7f399800b330 comp rx=0 tx=0).stop 2023-08-27T11:27:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 -- 172.21.15.43:0/1089246229 shutdown_connections 2023-08-27T11:27:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 --2- 172.21.15.43:0/1089246229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a00c50d0 0x7f39a00c43d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 --2- 172.21.15.43:0/1089246229 >> v2:172.21.15.57:3300/0 conn(0x7f39a014e960 0x7f39a00a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 -- 172.21.15.43:0/1089246229 >> 172.21.15.43:0/1089246229 conn(0x7f39a006aa50 msgr2=0x7f39a00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:38.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 -- 172.21.15.43:0/1089246229 shutdown_connections 2023-08-27T11:27:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.853+0000 7f39a83ff700 1 -- 172.21.15.43:0/1089246229 wait complete. 2023-08-27T11:27:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.855+0000 7f39a83ff700 1 Processor -- start 2023-08-27T11:27:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.855+0000 7f39a83ff700 1 -- start start 2023-08-27T11:27:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 0x7f39a01ed300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a014e960 0x7f39a014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0071c50 con 0x7f39a00c50d0 2023-08-27T11:27:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a0071080 con 0x7f39a00a79c0 2023-08-27T11:27:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a83ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00720e0 con 0x7f39a014e960 2023-08-27T11:27:38.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60674/0 (socket says 172.21.15.43:60674) 2023-08-27T11:27:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a599a700 1 -- 172.21.15.43:0/2651703017 learned_addr learned my addr 172.21.15.43:0/2651703017 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.856+0000 7f39a619b700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 0x7f39a01ed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a699c700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a014e960 0x7f39a014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 -- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a014e960 msgr2=0x7f39a014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a014e960 0x7f39a014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 -- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 msgr2=0x7f39a01ed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 0x7f39a01ed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 -- 172.21.15.43:0/2651703017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0094a0 con 0x7f39a00c50d0 2023-08-27T11:27:38.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a619b700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 0x7f39a01ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a599a700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f399000c700 tx=0x7f399000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990005d70 con 0x7f39a00c50d0 2023-08-27T11:27:38.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900070d0 con 0x7f39a00c50d0 2023-08-27T11:27:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3998009a70 con 0x7f39a00c50d0 2023-08-27T11:27:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.857+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3990007460 con 0x7f39a00c50d0 2023-08-27T11:27:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.858+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a0071600 con 0x7f39a00c50d0 2023-08-27T11:27:38.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.858+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a006d770 con 0x7f39a00c50d0 2023-08-27T11:27:38.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.860+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39900075c0 con 0x7f39a00c50d0 2023-08-27T11:27:38.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.860+0000 7f3996ffd700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 0x7f398406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.860+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f39900877f0 con 0x7f39a00c50d0 2023-08-27T11:27:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.861+0000 7f39a619b700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 0x7f398406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.861+0000 7f39a619b700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 0x7f398406c5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f399c011380 tx=0x7f399c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:38.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:38.865+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3990053090 con 0x7f39a00c50d0 2023-08-27T11:27:39.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.094+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f39a00bb390 con 0x7f39a00c50d0 2023-08-27T11:27:39.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.970+0000 7f3996ffd700 1 -- 172.21.15.43:0/2651703017 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v106) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39900566b0 con 0x7f39a00c50d0 2023-08-27T11:27:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 msgr2=0x7f398406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 0x7f398406c5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f399c011380 tx=0x7f399c009210 comp rx=0 tx=0).stop 2023-08-27T11:27:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 msgr2=0x7f39a00bcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f399000c700 tx=0x7f399000ca10 comp rx=0 tx=0).stop 2023-08-27T11:27:39.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 shutdown_connections 2023-08-27T11:27:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f398406a0e0 0x7f398406c5a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f39a014e960 0x7f39a014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39a00a79c0 0x7f39a01ed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 --2- 172.21.15.43:0/2651703017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f39a00c50d0 0x7f39a00bcab0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:39.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 >> 172.21.15.43:0/2651703017 conn(0x7f39a006aa50 msgr2=0x7f39a00c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 shutdown_connections 2023-08-27T11:27:39.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:39.973+0000 7f39a83ff700 1 -- 172.21.15.43:0/2651703017 wait complete. 2023-08-27T11:27:39.977 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:27:39.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:27:40.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.200+0000 7faae8dff700 1 Processor -- start 2023-08-27T11:27:40.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.200+0000 7faae8dff700 1 -- start start 2023-08-27T11:27:40.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.201+0000 7faae8dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae4151a90 0x7faae40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.201+0000 7faae8dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faae40c4630 0x7faae40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.201+0000 7faae8dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae406c4e0 con 0x7faae406ad70 2023-08-27T11:27:40.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faae8dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae4155370 con 0x7faae40c4630 2023-08-27T11:27:40.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faae8dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4151e70 con 0x7faae4151a90 2023-08-27T11:27:40.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faadbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faae40c4630 0x7faae40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faae2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faae406ad70 0x7faae406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:39182/0 (socket says 172.21.15.43:39182) 2023-08-27T11:27:40.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faadbfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faae40c4630 0x7faae40c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:48322/0 (socket says 172.21.15.43:48322) 2023-08-27T11:27:40.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faae2d9d700 1 -- 172.21.15.43:0/4170077047 learned_addr learned my addr 172.21.15.43:0/4170077047 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.202+0000 7faae259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae4151a90 0x7faae40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faadbfff700 1 -- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae4151a90 msgr2=0x7faae40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faadbfff700 1 --2- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae4151a90 0x7faae40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faadbfff700 1 -- 172.21.15.43:0/4170077047 >> v1:172.21.15.57:6789/0 conn(0x7faae406ad70 legacy=0x7faae406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faadbfff700 1 -- 172.21.15.43:0/4170077047 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4154480 con 0x7faae40c4630 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faae1d9b700 1 -- 172.21.15.43:0/4170077047 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140506641 0 0) 0x7faae406c4e0 con 0x7faae406ad70 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faadbfff700 1 --2- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae40c4630 0x7faae40c4a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faacc009840 tx=0x7faacc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80a304de1a9f51aa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faae1d9b700 1 -- 172.21.15.43:0/4170077047 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc011830 con 0x7faae40c4630 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faae1d9b700 1 -- 172.21.15.43:0/4170077047 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011990 con 0x7faae40c4630 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.203+0000 7faae1d9b700 1 -- 172.21.15.43:0/4170077047 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc011d20 con 0x7faae40c4630 2023-08-27T11:27:40.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 -- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae40c4630 msgr2=0x7faae40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 --2- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae40c4630 0x7faae40c4a90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faacc009840 tx=0x7faacc009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:40.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 -- 172.21.15.43:0/4170077047 shutdown_connections 2023-08-27T11:27:40.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 --2- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae4151a90 0x7faae40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 --2- 172.21.15.43:0/4170077047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae40c4630 0x7faae40c4a90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 -- 172.21.15.43:0/4170077047 >> 172.21.15.43:0/4170077047 conn(0x7faae40ab820 msgr2=0x7faae40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:40.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 -- 172.21.15.43:0/4170077047 shutdown_connections 2023-08-27T11:27:40.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.204+0000 7faae8dff700 1 -- 172.21.15.43:0/4170077047 wait complete. 2023-08-27T11:27:40.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.206+0000 7faae8dff700 1 Processor -- start 2023-08-27T11:27:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.206+0000 7faae8dff700 1 -- start start 2023-08-27T11:27:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae406ad70 0x7faae41ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae40c4630 0x7faae40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40c99f0 con 0x7faae4151a90 2023-08-27T11:27:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae41587f0 con 0x7faae406ad70 2023-08-27T11:27:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae8dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4150410 con 0x7faae40c4630 2023-08-27T11:27:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60690/0 (socket says 172.21.15.43:60690) 2023-08-27T11:27:40.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae2d9d700 1 -- 172.21.15.43:0/2406243618 learned_addr learned my addr 172.21.15.43:0/2406243618 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:40.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faae259c700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae406ad70 0x7faae41ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.207+0000 7faadbfff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae40c4630 0x7faae40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 -- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae40c4630 msgr2=0x7faae40c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae40c4630 0x7faae40c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 -- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae406ad70 msgr2=0x7faae41ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae406ad70 0x7faae41ece10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 -- 172.21.15.43:0/2406243618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0094a0 con 0x7faae4151a90 2023-08-27T11:27:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae2d9d700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7faadc00cca0 tx=0x7faadc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00ab70 con 0x7faae4151a90 2023-08-27T11:27:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc00acd0 con 0x7faae4151a90 2023-08-27T11:27:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae414e4e0 con 0x7faae4151a90 2023-08-27T11:27:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc007310 con 0x7faae4151a90 2023-08-27T11:27:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.208+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae4150990 con 0x7faae4151a90 2023-08-27T11:27:40.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.209+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae4150b20 con 0x7faae4151a90 2023-08-27T11:27:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.210+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faadc007470 con 0x7faae4151a90 2023-08-27T11:27:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.211+0000 7faadaffd700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 0x7faac406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.211+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faadc087a40 con 0x7faae4151a90 2023-08-27T11:27:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.211+0000 7faae259c700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 0x7faac406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.212+0000 7faae259c700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 0x7faac406c5a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faae4154040 tx=0x7faad4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.216+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faadc053470 con 0x7faae4151a90 2023-08-27T11:27:40.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.509+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faae414e4e0 con 0x7faae4151a90 2023-08-27T11:27:40.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.509+0000 7faadaffd700 1 -- 172.21.15.43:0/2406243618 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4724 (secure 0 0 0) 0x7faae414e4e0 con 0x7faae4151a90 2023-08-27T11:27:40.511 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:40.511 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:40.512 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:27:40.512 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.512 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:27:40.512 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:27:40.512 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:27:40.513 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:27:40.513 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.513 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.514 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.514 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.514 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:27:40.514 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:27:40.514 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:27:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:27:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.515 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.516 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.516 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.516 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:27:40.516 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:27:40.516 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.517 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.517 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:27:40.517 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:27:40.517 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.517 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.518 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.518 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.518 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:27:40.518 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:27:40.518 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.519 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.519 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:27:40.519 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:27:40.519 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.519 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.520 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.521 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.521 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.521 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.521 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.521 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.522 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:27:40.522 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:27:40.522 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.522 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.522 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.523 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.523 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.523 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.523 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.524 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.525 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.525 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.525 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:27:40.525 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:27:40.525 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.526 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.526 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.526 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.526 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.527 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:27:40.528 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:27:40.529 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.529 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.529 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.529 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.529 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.530 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.531 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.531 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.531 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.531 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.531 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.532 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:27:40.532 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:27:40.532 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.532 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:27:40.532 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:27:40.533 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:27:40.534 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.534 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.534 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:27:40.534 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:27:40.534 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.535 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:27:40.536 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:27:40.536 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:27:40.536 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:27:40.536 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:27:40.537 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.538 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.539 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:40.540 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:40.540 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:27:40.540 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:27:40.540 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:27:40.541 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:27:40.541 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:27:40.541 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:27:40.541 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.541 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:40.542 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:27:40.542 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:40.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 msgr2=0x7faac406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 0x7faac406c5a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faae4154040 tx=0x7faad4009210 comp rx=0 tx=0).stop 2023-08-27T11:27:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 msgr2=0x7faae40c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7faadc00cca0 tx=0x7faadc00a060 comp rx=0 tx=0).stop 2023-08-27T11:27:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 shutdown_connections 2023-08-27T11:27:40.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7faac406a0e0 0x7faac406c5a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faae4151a90 0x7faae40c7d00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faae406ad70 0x7faae41ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 --2- 172.21.15.43:0/2406243618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faae40c4630 0x7faae40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 >> 172.21.15.43:0/2406243618 conn(0x7faae40ab820 msgr2=0x7faae414b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:40.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 shutdown_connections 2023-08-27T11:27:40.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.512+0000 7faae8dff700 1 -- 172.21.15.43:0/2406243618 wait complete. 2023-08-27T11:27:40.546 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:40.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.747+0000 7f5f85fff700 1 Processor -- start 2023-08-27T11:27:40.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.747+0000 7f5f85fff700 1 -- start start 2023-08-27T11:27:40.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f85fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8014e960 0x7f5f800a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f85fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 0x7f5f800c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f85fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f80154d00 con 0x7f5f800c50d0 2023-08-27T11:27:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f85fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f800baf30 con 0x7f5f8014e960 2023-08-27T11:27:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f85fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80154fe0 con 0x7f5f800a79c0 2023-08-27T11:27:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f7f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8014e960 0x7f5f800a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f7f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f8014e960 0x7f5f800a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60702/0 (socket says 172.21.15.43:60702) 2023-08-27T11:27:40.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.748+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1831917050 learned_addr learned my addr 172.21.15.43:0/1831917050 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7effd700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 0x7f5f800c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1831917050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 msgr2=0x7f5f800c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7f7fe700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 0x7f5f800c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1831917050 >> v1:172.21.15.57:6789/0 conn(0x7f5f800c50d0 legacy=0x7f5f800c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:40.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1831917050 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f801552c0 con 0x7f5f8014e960 2023-08-27T11:27:40.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7effd700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 0x7f5f800c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:40.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7f7fe700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8014e960 0x7f5f800a7480 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009920 tx=0x7f5f70009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66d736c9db69ac4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7e7fc700 1 -- 172.21.15.43:0/1831917050 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70004230 con 0x7f5f8014e960 2023-08-27T11:27:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7e7fc700 1 -- 172.21.15.43:0/1831917050 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70004390 con 0x7f5f8014e960 2023-08-27T11:27:40.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.749+0000 7f5f7e7fc700 1 -- 172.21.15.43:0/1831917050 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70009e70 con 0x7f5f8014e960 2023-08-27T11:27:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 -- 172.21.15.43:0/1831917050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8014e960 msgr2=0x7f5f800a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8014e960 0x7f5f800a7480 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009920 tx=0x7f5f70009c30 comp rx=0 tx=0).stop 2023-08-27T11:27:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 -- 172.21.15.43:0/1831917050 shutdown_connections 2023-08-27T11:27:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f8014e960 0x7f5f800a7480 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1831917050 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f800a79c0 0x7f5f800c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 -- 172.21.15.43:0/1831917050 >> 172.21.15.43:0/1831917050 conn(0x7f5f8006aa50 msgr2=0x7f5f800c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:40.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 -- 172.21.15.43:0/1831917050 shutdown_connections 2023-08-27T11:27:40.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.750+0000 7f5f85fff700 1 -- 172.21.15.43:0/1831917050 wait complete. 2023-08-27T11:27:40.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.752+0000 7f5f85fff700 1 Processor -- start 2023-08-27T11:27:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.752+0000 7f5f85fff700 1 -- start start 2023-08-27T11:27:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f800c50d0 0x7f5f800bed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f8014e960 0x7f5f800bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f800c14e0 con 0x7f5f800a79c0 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801547b0 con 0x7f5f800c50d0 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f85fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80154a90 con 0x7f5f8014e960 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60714/0 (socket says 172.21.15.43:60714) 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1096478404 learned_addr learned my addr 172.21.15.43:0/1096478404 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:40.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7effd700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f800c50d0 0x7f5f800bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7ffff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f8014e960 0x7f5f800bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f8014e960 msgr2=0x7f5f800bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f8014e960 0x7f5f800bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f800c50d0 msgr2=0x7f5f800bed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f800c50d0 0x7f5f800bed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.753+0000 7f5f7f7fe700 1 -- 172.21.15.43:0/1096478404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70009550 con 0x7f5f800a79c0 2023-08-27T11:27:40.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f7f7fe700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009fd0 tx=0x7f5f70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f700036a0 con 0x7f5f800a79c0 2023-08-27T11:27:40.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f70003800 con 0x7f5f800a79c0 2023-08-27T11:27:40.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f800a9e70 con 0x7f5f800a79c0 2023-08-27T11:27:40.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70003b90 con 0x7f5f800a79c0 2023-08-27T11:27:40.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.754+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f800be240 con 0x7f5f800a79c0 2023-08-27T11:27:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.755+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f800bb390 con 0x7f5f800a79c0 2023-08-27T11:27:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.756+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5f70003cf0 con 0x7f5f800a79c0 2023-08-27T11:27:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.757+0000 7f5f67fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:40.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.757+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5f70089bf0 con 0x7f5f800a79c0 2023-08-27T11:27:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.757+0000 7f5f7effd700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.758+0000 7f5f7effd700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5f800bc550 tx=0x7f5f74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:40.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.761+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5f70055620 con 0x7f5f800a79c0 2023-08-27T11:27:40.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.976+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f800beb90 con 0x7f5f800a79c0 2023-08-27T11:27:40.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.977+0000 7f5f67fff700 1 -- 172.21.15.43:0/1096478404 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+14524 (secure 0 0 0) 0x7f5f7001f090 con 0x7f5f800a79c0 2023-08-27T11:27:40.979 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:40.979 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":106,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:39.963301+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:40.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 msgr2=0x7f5f6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5f800bc550 tx=0x7f5f74008040 comp rx=0 tx=0).stop 2023-08-27T11:27:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 msgr2=0x7f5f8014d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009fd0 tx=0x7f5f70004750 comp rx=0 tx=0).stop 2023-08-27T11:27:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 shutdown_connections 2023-08-27T11:27:40.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5f6c06a0e0 0x7f5f6c06c5a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f8014e960 0x7f5f800bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f800a79c0 0x7f5f8014d4e0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 --2- 172.21.15.43:0/1096478404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f800c50d0 0x7f5f800bed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 >> 172.21.15.43:0/1096478404 conn(0x7f5f8006aa50 msgr2=0x7f5f800c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 shutdown_connections 2023-08-27T11:27:40.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:40.980+0000 7f5f85fff700 1 -- 172.21.15.43:0/1096478404 wait complete. 2023-08-27T11:27:41.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:27:41.001 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:27:41.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:27:41.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:27:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.207+0000 7f0f4a1ff700 1 Processor -- start 2023-08-27T11:27:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.207+0000 7f0f4a1ff700 1 -- start start 2023-08-27T11:27:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f4a1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f44071f70 0x7f0f44158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f4a1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f44157af0 con 0x7f0f440c0020 2023-08-27T11:27:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f4a1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f44158a80 con 0x7f0f44151fc0 2023-08-27T11:27:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f4a1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f440a6040 con 0x7f0f44071f70 2023-08-27T11:27:41.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f437fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0f440c0020 0x7f0f441518b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47570/0 (socket says 172.21.15.43:47570) 2023-08-27T11:27:41.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f437fe700 1 -- 172.21.15.43:0/2291049669 learned_addr learned my addr 172.21.15.43:0/2291049669 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:41.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.208+0000 7f0f43fff700 1 --2- 172.21.15.43:0/2291049669 >> v2:172.21.15.57:3300/0 conn(0x7f0f44071f70 0x7f0f44158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793991562 0 0) 0x7f0f44157af0 con 0x7f0f440c0020 2023-08-27T11:27:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f2c0035b0 con 0x7f0f440c0020 2023-08-27T11:27:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477533031 0 0) 0x7f0f44158a80 con 0x7f0f44151fc0 2023-08-27T11:27:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f44157af0 con 0x7f0f44151fc0 2023-08-27T11:27:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f43fff700 1 -- 172.21.15.43:0/2291049669 >> v1:172.21.15.57:6789/0 conn(0x7f0f44151fc0 legacy=0x7f0f440708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f43fff700 1 -- 172.21.15.43:0/2291049669 >> v1:172.21.15.43:6789/0 conn(0x7f0f440c0020 legacy=0x7f0f441518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331459002 0 0) 0x7f0f2c0035b0 con 0x7f0f440c0020 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.209+0000 7f0f43fff700 1 -- 172.21.15.43:0/2291049669 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f440a6320 con 0x7f0f44071f70 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f43fff700 1 --2- 172.21.15.43:0/2291049669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44071f70 0x7f0f44158540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb1d1b9a7b8cd748 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00e070 con 0x7f0f44071f70 2023-08-27T11:27:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c00bb20 con 0x7f0f44071f70 2023-08-27T11:27:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f427fc700 1 -- 172.21.15.43:0/2291049669 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00bed0 con 0x7f0f44071f70 2023-08-27T11:27:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/2291049669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44071f70 msgr2=0x7f0f44158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.210+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/2291049669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44071f70 0x7f0f44158540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009d90 tx=0x7f0f3c00b330 comp rx=0 tx=0).stop 2023-08-27T11:27:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.211+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/2291049669 shutdown_connections 2023-08-27T11:27:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.211+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/2291049669 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44071f70 0x7f0f44158540 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.211+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/2291049669 >> 172.21.15.43:0/2291049669 conn(0x7f0f440c6a40 msgr2=0x7f0f440c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.211+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/2291049669 shutdown_connections 2023-08-27T11:27:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.211+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/2291049669 wait complete. 2023-08-27T11:27:41.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.212+0000 7f0f4a1ff700 1 Processor -- start 2023-08-27T11:27:41.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.213+0000 7f0f4a1ff700 1 -- start start 2023-08-27T11:27:41.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f440c0020 0x7f0f4406b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44151fc0 0x7f0f4414af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4406b990 con 0x7f0f44071f70 2023-08-27T11:27:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440a79f0 con 0x7f0f44151fc0 2023-08-27T11:27:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f4a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440a7c40 con 0x7f0f440c0020 2023-08-27T11:27:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60730/0 (socket says 172.21.15.43:60730) 2023-08-27T11:27:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f437fe700 1 -- 172.21.15.43:0/1618163312 learned_addr learned my addr 172.21.15.43:0/1618163312 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f42ffd700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f440c0020 0x7f0f4406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.214+0000 7f0f43fff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44151fc0 0x7f0f4414af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 -- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f440c0020 msgr2=0x7f0f4406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f440c0020 0x7f0f4406b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 -- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44151fc0 msgr2=0x7f0f4414af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44151fc0 0x7f0f4414af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 -- 172.21.15.43:0/1618163312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c009a70 con 0x7f0f44071f70 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f437fe700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c750 tx=0x7f0f3400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34005d70 con 0x7f0f44071f70 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340070d0 con 0x7f0f44071f70 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34007460 con 0x7f0f44071f70 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f441ea240 con 0x7f0f44071f70 2023-08-27T11:27:41.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.215+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4414b490 con 0x7f0f44071f70 2023-08-27T11:27:41.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.216+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f440a85a0 con 0x7f0f44071f70 2023-08-27T11:27:41.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.217+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f340075c0 con 0x7f0f44071f70 2023-08-27T11:27:41.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.219+0000 7f0f2bfff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 0x7f0f3006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.219+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f34087720 con 0x7f0f44071f70 2023-08-27T11:27:41.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.219+0000 7f0f42ffd700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 0x7f0f3006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.220+0000 7f0f42ffd700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 0x7f0f3006c5a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f4414abd0 tx=0x7f0f38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.224+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0f34053150 con 0x7f0f44071f70 2023-08-27T11:27:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.442+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f441ea0a0 con 0x7f0f44071f70 2023-08-27T11:27:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.442+0000 7f0f2bfff700 1 -- 172.21.15.43:0/1618163312 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v106) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f441ea0a0 con 0x7f0f44071f70 2023-08-27T11:27:41.444 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:27:41.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 msgr2=0x7f0f3006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 0x7f0f3006c5a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f4414abd0 tx=0x7f0f38009040 comp rx=0 tx=0).stop 2023-08-27T11:27:41.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 msgr2=0x7f0f4414a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400c750 tx=0x7f0f3400ca60 comp rx=0 tx=0).stop 2023-08-27T11:27:41.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 shutdown_connections 2023-08-27T11:27:41.447 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f3006a0e0 0x7f0f3006c5a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f44151fc0 0x7f0f4414af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0f44071f70 0x7f0f4414a440 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 --2- 172.21.15.43:0/1618163312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0f440c0020 0x7f0f4406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 >> 172.21.15.43:0/1618163312 conn(0x7f0f440c6a40 msgr2=0x7f0f4406e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 shutdown_connections 2023-08-27T11:27:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.445+0000 7f0f4a1ff700 1 -- 172.21.15.43:0/1618163312 wait complete. 2023-08-27T11:27:41.464 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:27:41.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.667+0000 7f1fe4fff700 1 Processor -- start 2023-08-27T11:27:41.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.667+0000 7f1fe4fff700 1 -- start start 2023-08-27T11:27:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.668+0000 7f1fe4fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fe00c7c00 0x7f1fe00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fe4fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe0154660 con 0x7f1fe0151d20 2023-08-27T11:27:41.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fe4fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe0154940 con 0x7f1fe006a8e0 2023-08-27T11:27:41.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fe4fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe00c5750 con 0x7f1fe00c7c00 2023-08-27T11:27:41.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fde59c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1fe0151d20 0x7f1fe00ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47582/0 (socket says 172.21.15.43:47582) 2023-08-27T11:27:41.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fde59c700 1 -- 172.21.15.43:0/2557202136 learned_addr learned my addr 172.21.15.43:0/2557202136 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:41.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fddd9b700 1 --2- 172.21.15.43:0/2557202136 >> v2:172.21.15.57:3300/0 conn(0x7f1fe00c7c00 0x7f1fe00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fdd59a700 1 -- 172.21.15.43:0/2557202136 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037414689 0 0) 0x7f1fe0154660 con 0x7f1fe0151d20 2023-08-27T11:27:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.669+0000 7f1fdd59a700 1 -- 172.21.15.43:0/2557202136 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc80035b0 con 0x7f1fe0151d20 2023-08-27T11:27:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fddd9b700 1 -- 172.21.15.43:0/2557202136 >> v1:172.21.15.57:6789/0 conn(0x7f1fe006a8e0 legacy=0x7f1fe006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fddd9b700 1 -- 172.21.15.43:0/2557202136 >> v1:172.21.15.43:6789/0 conn(0x7f1fe0151d20 legacy=0x7f1fe00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fddd9b700 1 -- 172.21.15.43:0/2557202136 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0154c20 con 0x7f1fe00c7c00 2023-08-27T11:27:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fddd9b700 1 --2- 172.21.15.43:0/2557202136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe00c7c00 0x7f1fe00c8110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0152140 tx=0x7f1fd4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44357495121d3ea2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fdd59a700 1 -- 172.21.15.43:0/2557202136 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4004020 con 0x7f1fe00c7c00 2023-08-27T11:27:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fdd59a700 1 -- 172.21.15.43:0/2557202136 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd4004180 con 0x7f1fe00c7c00 2023-08-27T11:27:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.670+0000 7f1fdd59a700 1 -- 172.21.15.43:0/2557202136 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4004530 con 0x7f1fe00c7c00 2023-08-27T11:27:41.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 -- 172.21.15.43:0/2557202136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe00c7c00 msgr2=0x7f1fe00c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/2557202136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe00c7c00 0x7f1fe00c8110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0152140 tx=0x7f1fd4009b20 comp rx=0 tx=0).stop 2023-08-27T11:27:41.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 -- 172.21.15.43:0/2557202136 shutdown_connections 2023-08-27T11:27:41.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/2557202136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe00c7c00 0x7f1fe00c8110 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 -- 172.21.15.43:0/2557202136 >> 172.21.15.43:0/2557202136 conn(0x7f1fe00c9d00 msgr2=0x7f1fe00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:41.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 -- 172.21.15.43:0/2557202136 shutdown_connections 2023-08-27T11:27:41.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.671+0000 7f1fe4fff700 1 -- 172.21.15.43:0/2557202136 wait complete. 2023-08-27T11:27:41.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.672+0000 7f1fe4fff700 1 Processor -- start 2023-08-27T11:27:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.673+0000 7f1fe4fff700 1 -- start start 2023-08-27T11:27:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.673+0000 7f1fe4fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe006a8e0 0x7f1fe00c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.673+0000 7f1fe4fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fe00c7c00 0x7f1fe014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fe4fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fe4fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0150560 con 0x7f1fe0151d20 2023-08-27T11:27:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fe4fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01ed610 con 0x7f1fe006a8e0 2023-08-27T11:27:41.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fe4fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01ecce0 con 0x7f1fe00c7c00 2023-08-27T11:27:41.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60732/0 (socket says 172.21.15.43:60732) 2023-08-27T11:27:41.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 -- 172.21.15.43:0/3389692635 learned_addr learned my addr 172.21.15.43:0/3389692635 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:41.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fde59c700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe006a8e0 0x7f1fe00c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fddd9b700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fe00c7c00 0x7f1fe014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 -- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fe00c7c00 msgr2=0x7f1fe014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fe00c7c00 0x7f1fe014f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 -- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe006a8e0 msgr2=0x7f1fe00c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe006a8e0 0x7f1fe00c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.674+0000 7f1fded9d700 1 -- 172.21.15.43:0/3389692635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40094a0 con 0x7f1fe0151d20 2023-08-27T11:27:41.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fded9d700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800cb90 tx=0x7f1fd800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8003c50 con 0x7f1fe0151d20 2023-08-27T11:27:41.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8003dd0 con 0x7f1fe0151d20 2023-08-27T11:27:41.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe01ecfc0 con 0x7f1fe0151d20 2023-08-27T11:27:41.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800aae0 con 0x7f1fe0151d20 2023-08-27T11:27:41.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.675+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe014fcb0 con 0x7f1fe0151d20 2023-08-27T11:27:41.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.676+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe004ee70 con 0x7f1fe0151d20 2023-08-27T11:27:41.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.677+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1fd800ac40 con 0x7f1fe0151d20 2023-08-27T11:27:41.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.678+0000 7f1fceffd700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 0x7f1fc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:41.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.678+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1fd8088260 con 0x7f1fe0151d20 2023-08-27T11:27:41.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.678+0000 7f1fde59c700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 0x7f1fc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:41.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.679+0000 7f1fde59c700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 0x7f1fc006c5a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:41.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.683+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1fd8053c00 con 0x7f1fe0151d20 2023-08-27T11:27:41.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.891+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fe00ac650 con 0x7f1fe0151d20 2023-08-27T11:27:41.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.892+0000 7f1fceffd700 1 -- 172.21.15.43:0/3389692635 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fd8057220 con 0x7f1fe0151d20 2023-08-27T11:27:41.894 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:27:41.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 msgr2=0x7f1fc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 0x7f1fc006c5a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0007fd0 tx=0x7f1fd0007dc0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 msgr2=0x7f1fe00aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:41.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800cb90 tx=0x7f1fd800cea0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 shutdown_connections 2023-08-27T11:27:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fc006a0e0 0x7f1fc006c5a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fe0151d20 0x7f1fe00aa260 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fe006a8e0 0x7f1fe00c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 --2- 172.21.15.43:0/3389692635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fe00c7c00 0x7f1fe014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 >> 172.21.15.43:0/3389692635 conn(0x7f1fe00c9d00 msgr2=0x7f1fe00bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 shutdown_connections 2023-08-27T11:27:41.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:41.894+0000 7f1fe4fff700 1 -- 172.21.15.43:0/3389692635 wait complete. 2023-08-27T11:27:41.914 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:27:42.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.114+0000 7fb2321ff700 1 Processor -- start 2023-08-27T11:27:42.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.114+0000 7fb2321ff700 1 -- start start 2023-08-27T11:27:42.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb2321ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c0c50d0 0x7fb22c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb2321ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb22c154740 0x7fb22c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb2321ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c154d00 con 0x7fb22c14e960 2023-08-27T11:27:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb2321ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c0baf30 con 0x7fb22c154740 2023-08-27T11:27:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb2321ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c154fe0 con 0x7fb22c0c50d0 2023-08-27T11:27:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb22c154740 0x7fb22c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb22c154740 0x7fb22c0c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60738/0 (socket says 172.21.15.43:60738) 2023-08-27T11:27:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 -- 172.21.15.43:0/2831432760 learned_addr learned my addr 172.21.15.43:0/2831432760 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb223fff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c0c50d0 0x7fb22c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 -- 172.21.15.43:0/2831432760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c0c50d0 msgr2=0x7fb22c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:42.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c0c50d0 0x7fb22c0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 -- 172.21.15.43:0/2831432760 >> v1:172.21.15.57:6789/0 conn(0x7fb22c14e960 legacy=0x7fb22c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.116+0000 7fb22bfff700 1 -- 172.21.15.43:0/2831432760 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c1552c0 con 0x7fb22c154740 2023-08-27T11:27:42.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb22bfff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c0c4200 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fb224009e50 tx=0x7fb22400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9aec02d58de456e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb22affd700 1 -- 172.21.15.43:0/2831432760 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22400e070 con 0x7fb22c154740 2023-08-27T11:27:42.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb22affd700 1 -- 172.21.15.43:0/2831432760 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22400b910 con 0x7fb22c154740 2023-08-27T11:27:42.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb22affd700 1 -- 172.21.15.43:0/2831432760 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22400bcc0 con 0x7fb22c154740 2023-08-27T11:27:42.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb2321ff700 1 -- 172.21.15.43:0/2831432760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 msgr2=0x7fb22c0c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.117+0000 7fb2321ff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c0c4200 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fb224009e50 tx=0x7fb22400b330 comp rx=0 tx=0).stop 2023-08-27T11:27:42.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 -- 172.21.15.43:0/2831432760 shutdown_connections 2023-08-27T11:27:42.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c0c4200 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 --2- 172.21.15.43:0/2831432760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c0c50d0 0x7fb22c0c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 -- 172.21.15.43:0/2831432760 >> 172.21.15.43:0/2831432760 conn(0x7fb22c06aa50 msgr2=0x7fb22c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:42.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 -- 172.21.15.43:0/2831432760 shutdown_connections 2023-08-27T11:27:42.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.118+0000 7fb2321ff700 1 -- 172.21.15.43:0/2831432760 wait complete. 2023-08-27T11:27:42.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.119+0000 7fb2321ff700 1 Processor -- start 2023-08-27T11:27:42.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 -- start start 2023-08-27T11:27:42.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0c50d0 0x7fb22c1eb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c14e960 0x7fb22c0bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c072340 con 0x7fb22c154740 2023-08-27T11:27:42.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c1ead90 con 0x7fb22c0c50d0 2023-08-27T11:27:42.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.120+0000 7fb2321ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0bf6a0 con 0x7fb22c14e960 2023-08-27T11:27:42.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0c50d0 0x7fb22c1eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60746/0 (socket says 172.21.15.43:60746) 2023-08-27T11:27:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 -- 172.21.15.43:0/1822203467 learned_addr learned my addr 172.21.15.43:0/1822203467 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb223fff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c14e960 0x7fb22c0bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 -- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c14e960 msgr2=0x7fb22c0bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c14e960 0x7fb22c0bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 -- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0c50d0 msgr2=0x7fb22c1eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0c50d0 0x7fb22c1eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 -- 172.21.15.43:0/1822203467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009b30 con 0x7fb22c154740 2023-08-27T11:27:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.121+0000 7fb22bfff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06de20 tx=0x7fb224004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.122+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224004800 con 0x7fb22c154740 2023-08-27T11:27:42.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.122+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224004960 con 0x7fb22c154740 2023-08-27T11:27:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.122+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c1e7cb0 con 0x7fb22c154740 2023-08-27T11:27:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.122+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22401b670 con 0x7fb22c154740 2023-08-27T11:27:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.122+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c1eaa20 con 0x7fb22c154740 2023-08-27T11:27:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.123+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c0bb390 con 0x7fb22c154740 2023-08-27T11:27:42.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.124+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb22401b7d0 con 0x7fb22c154740 2023-08-27T11:27:42.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.125+0000 7fb228ff9700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.125+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb2240899c0 con 0x7fb22c154740 2023-08-27T11:27:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.125+0000 7fb22b7fe700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.126+0000 7fb22b7fe700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb22c153d50 tx=0x7fb21c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.130+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2240553f0 con 0x7fb22c154740 2023-08-27T11:27:42.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.341+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb22c04ee70 con 0x7fb22c154740 2023-08-27T11:27:42.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.341+0000 7fb228ff9700 1 -- 172.21.15.43:0/1822203467 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v106) v1 ==== 84+0+126 (secure 0 0 0) 0x7fb22401f090 con 0x7fb22c154740 2023-08-27T11:27:42.343 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:42.344 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:27:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:27:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:27:42.344 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:27:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:27:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:27:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:27:42.345 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:27:42.345 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:27:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 msgr2=0x7fb20c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb22c153d50 tx=0x7fb21c009040 comp rx=0 tx=0).stop 2023-08-27T11:27:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 msgr2=0x7fb22c1e85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06de20 tx=0x7fb224004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 shutdown_connections 2023-08-27T11:27:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb20c06a0e0 0x7fb20c06c5a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb22c154740 0x7fb22c1e85a0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c0c50d0 0x7fb22c1eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 --2- 172.21.15.43:0/1822203467 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb22c14e960 0x7fb22c0bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 >> 172.21.15.43:0/1822203467 conn(0x7fb22c06aa50 msgr2=0x7fb22c0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 shutdown_connections 2023-08-27T11:27:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.344+0000 7fb2321ff700 1 -- 172.21.15.43:0/1822203467 wait complete. 2023-08-27T11:27:42.364 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:27:42.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:27:42.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.569+0000 7fcc9e7ff700 1 Processor -- start 2023-08-27T11:27:42.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.569+0000 7fcc9e7ff700 1 -- start start 2023-08-27T11:27:42.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc9e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc98151a40 0x7fcc980c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc9e7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc980c81c0 0x7fcc980c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc9e7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc98154730 con 0x7fcc980c4c40 2023-08-27T11:27:42.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc9e7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc98154520 con 0x7fcc980c81c0 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc9e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98154a10 con 0x7fcc98151a40 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.570+0000 7fcc977fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc980c81c0 0x7fcc980c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcc980c81c0 0x7fcc980c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60762/0 (socket says 172.21.15.43:60762) 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 -- 172.21.15.43:0/4124189446 learned_addr learned my addr 172.21.15.43:0/4124189446 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc97fff700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc98151a40 0x7fcc980c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 -- 172.21.15.43:0/4124189446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc98151a40 msgr2=0x7fcc980c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:42.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc98151a40 0x7fcc980c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 -- 172.21.15.43:0/4124189446 >> v1:172.21.15.57:6789/0 conn(0x7fcc980c4c40 legacy=0x7fcc9806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 -- 172.21.15.43:0/4124189446 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98154cf0 con 0x7fcc980c81c0 2023-08-27T11:27:42.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc977fe700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc980c81c0 0x7fcc980c4700 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0098f0 tx=0x7fcc8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab38af3180121ee server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.571+0000 7fcc96ffd700 1 -- 172.21.15.43:0/4124189446 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c011830 con 0x7fcc980c81c0 2023-08-27T11:27:42.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc96ffd700 1 -- 172.21.15.43:0/4124189446 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8c011990 con 0x7fcc980c81c0 2023-08-27T11:27:42.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc96ffd700 1 -- 172.21.15.43:0/4124189446 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c011d20 con 0x7fcc980c81c0 2023-08-27T11:27:42.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/4124189446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc980c81c0 msgr2=0x7fcc980c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc980c81c0 0x7fcc980c4700 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0098f0 tx=0x7fcc8c009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:42.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/4124189446 shutdown_connections 2023-08-27T11:27:42.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc98151a40 0x7fcc980c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/4124189446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc980c81c0 0x7fcc980c4700 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/4124189446 >> 172.21.15.43:0/4124189446 conn(0x7fcc980ab890 msgr2=0x7fcc980abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:42.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/4124189446 shutdown_connections 2023-08-27T11:27:42.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.572+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/4124189446 wait complete. 2023-08-27T11:27:42.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.574+0000 7fcc9e7ff700 1 Processor -- start 2023-08-27T11:27:42.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.574+0000 7fcc9e7ff700 1 -- start start 2023-08-27T11:27:42.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc980c4c40 0x7fcc98143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc980c81c0 0x7fcc9814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980aebb0 con 0x7fcc98151a40 2023-08-27T11:27:42.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98150490 con 0x7fcc980c4c40 2023-08-27T11:27:42.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc98150750 con 0x7fcc980c81c0 2023-08-27T11:27:42.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9cd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9cd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60778/0 (socket says 172.21.15.43:60778) 2023-08-27T11:27:42.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc9cd9c700 1 -- 172.21.15.43:0/152303246 learned_addr learned my addr 172.21.15.43:0/152303246 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:42.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.575+0000 7fcc97fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc980c4c40 0x7fcc98143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc977fe700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc980c81c0 0x7fcc9814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 -- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc980c81c0 msgr2=0x7fcc9814f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc980c81c0 0x7fcc9814f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 -- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc980c4c40 msgr2=0x7fcc98143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc980c4c40 0x7fcc98143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 -- 172.21.15.43:0/152303246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c009550 con 0x7fcc98151a40 2023-08-27T11:27:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9cd9c700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000cc50 tx=0x7fcc9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90003c00 con 0x7fcc98151a40 2023-08-27T11:27:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90003d60 con 0x7fcc98151a40 2023-08-27T11:27:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000aab0 con 0x7fcc98151a40 2023-08-27T11:27:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.576+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc980af350 con 0x7fcc98151a40 2023-08-27T11:27:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.577+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc980ac930 con 0x7fcc98151a40 2023-08-27T11:27:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.578+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc980c5bf0 con 0x7fcc98151a40 2023-08-27T11:27:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.579+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcc9000ac10 con 0x7fcc98151a40 2023-08-27T11:27:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.579+0000 7fcc94ff9700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 0x7fcc8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.579+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcc90088250 con 0x7fcc98151a40 2023-08-27T11:27:42.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.580+0000 7fcc97fff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 0x7fcc8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:42.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.580+0000 7fcc97fff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 0x7fcc8406c5a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009b40 tx=0x7fcc88009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:42.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.584+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcc90053bf0 con 0x7fcc98151a40 2023-08-27T11:27:42.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.793+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcc9804ee70 con 0x7fcc98151a40 2023-08-27T11:27:42.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.981+0000 7fcc94ff9700 1 -- 172.21.15.43:0/152303246 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v107) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcc90057210 con 0x7fcc98151a40 2023-08-27T11:27:42.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.984+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 msgr2=0x7fcc8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.984+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 0x7fcc8406c5a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcc88009b40 tx=0x7fcc88009210 comp rx=0 tx=0).stop 2023-08-27T11:27:42.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.984+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 msgr2=0x7fcc9814fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:42.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.984+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000cc50 tx=0x7fcc9000cf60 comp rx=0 tx=0).stop 2023-08-27T11:27:42.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 shutdown_connections 2023-08-27T11:27:42.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcc8406a0e0 0x7fcc8406c5a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcc98151a40 0x7fcc9814fc90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc980c4c40 0x7fcc98143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 --2- 172.21.15.43:0/152303246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcc980c81c0 0x7fcc9814f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 >> 172.21.15.43:0/152303246 conn(0x7fcc980ab890 msgr2=0x7fcc9806b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 shutdown_connections 2023-08-27T11:27:42.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:42.985+0000 7fcc9e7ff700 1 -- 172.21.15.43:0/152303246 wait complete. 2023-08-27T11:27:42.990 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:27:43.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:27:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.215+0000 7f0bdb1ff700 1 Processor -- start 2023-08-27T11:27:43.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.216+0000 7f0bdb1ff700 1 -- start start 2023-08-27T11:27:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bdb1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0bd4151a70 0x7f0bd4154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bdb1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 0x7f0bd4158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bdb1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd40c5250 con 0x7f0bd40c7c90 2023-08-27T11:27:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bdb1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd40c4710 con 0x7f0bd4151a70 2023-08-27T11:27:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bdb1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40c4920 con 0x7f0bd4157ee0 2023-08-27T11:27:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bd3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0bd40c7c90 0x7f0bd40c6740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47594/0 (socket says 172.21.15.43:47594) 2023-08-27T11:27:43.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bd3fff700 1 -- 172.21.15.43:0/935164497 learned_addr learned my addr 172.21.15.43:0/935164497 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:43.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/935164497 >> v2:172.21.15.57:3300/0 conn(0x7f0bd4151a70 0x7f0bd4154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.217+0000 7f0bd979c700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 0x7f0bd4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd37fe700 1 -- 172.21.15.43:0/935164497 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053078220 0 0) 0x7f0bd40c5250 con 0x7f0bd40c7c90 2023-08-27T11:27:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd37fe700 1 -- 172.21.15.43:0/935164497 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc40035b0 con 0x7f0bd40c7c90 2023-08-27T11:27:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd8f9b700 1 -- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 msgr2=0x7f0bd4158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:43.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 0x7f0bd4158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd8f9b700 1 -- 172.21.15.43:0/935164497 >> v1:172.21.15.43:6789/0 conn(0x7f0bd40c7c90 legacy=0x7f0bd40c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd8f9b700 1 -- 172.21.15.43:0/935164497 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40c4c00 con 0x7f0bd4151a70 2023-08-27T11:27:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd979c700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 0x7f0bd4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd4154ff0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009820 tx=0x7f0bc8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d90ff8c3eaf2418 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:43.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.218+0000 7f0bd37fe700 1 -- 172.21.15.43:0/935164497 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8005e30 con 0x7f0bd4151a70 2023-08-27T11:27:43.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bd37fe700 1 -- 172.21.15.43:0/935164497 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc8006030 con 0x7f0bd4151a70 2023-08-27T11:27:43.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bd37fe700 1 -- 172.21.15.43:0/935164497 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80063c0 con 0x7f0bd4151a70 2023-08-27T11:27:43.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 msgr2=0x7f0bd4154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:43.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd4154ff0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009820 tx=0x7f0bc8009b30 comp rx=0 tx=0).stop 2023-08-27T11:27:43.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/935164497 shutdown_connections 2023-08-27T11:27:43.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd4157ee0 0x7f0bd4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:43.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/935164497 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd4154ff0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:43.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/935164497 >> 172.21.15.43:0/935164497 conn(0x7f0bd40c9d90 msgr2=0x7f0bd40ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:43.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/935164497 shutdown_connections 2023-08-27T11:27:43.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.219+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/935164497 wait complete. 2023-08-27T11:27:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.221+0000 7f0bdb1ff700 1 Processor -- start 2023-08-27T11:27:43.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.221+0000 7f0bdb1ff700 1 -- start start 2023-08-27T11:27:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd40c7c90 0x7f0bd41572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40c0690 con 0x7f0bd4157ee0 2023-08-27T11:27:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40c0ed0 con 0x7f0bd4151a70 2023-08-27T11:27:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bdb1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd40bfac0 con 0x7f0bd40c7c90 2023-08-27T11:27:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bd979c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bd979c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60788/0 (socket says 172.21.15.43:60788) 2023-08-27T11:27:43.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bd979c700 1 -- 172.21.15.43:0/1132602751 learned_addr learned my addr 172.21.15.43:0/1132602751 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:43.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bd3fff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.222+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd40c7c90 0x7f0bd41572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 -- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd40c7c90 msgr2=0x7f0bd41572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:43.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd40c7c90 0x7f0bd41572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:43.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 -- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 msgr2=0x7f0bd40c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd40c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 -- 172.21.15.43:0/1132602751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009a70 con 0x7f0bd4157ee0 2023-08-27T11:27:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd979c700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00efc0 tx=0x7f0bcc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00ca90 con 0x7f0bd4157ee0 2023-08-27T11:27:43.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc00f040 con 0x7f0bd4157ee0 2023-08-27T11:27:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc8009430 con 0x7f0bd4157ee0 2023-08-27T11:27:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00ce30 con 0x7f0bd4157ee0 2023-08-27T11:27:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.223+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd40c0040 con 0x7f0bd4157ee0 2023-08-27T11:27:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.224+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd40c0840 con 0x7f0bd4157ee0 2023-08-27T11:27:43.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.226+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0bcc014480 con 0x7f0bd4157ee0 2023-08-27T11:27:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.227+0000 7f0bd17fa700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 0x7f0bb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.227+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f0bcc0889d0 con 0x7f0bd4157ee0 2023-08-27T11:27:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.227+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 0x7f0bb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:43.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.228+0000 7f0bd8f9b700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 0x7f0bb806c5a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000c00 tx=0x7f0bc8008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:43.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.232+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0bd40c0840 con 0x7f0bd4157ee0 2023-08-27T11:27:43.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.443+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0bd40c0840 con 0x7f0bd4157ee0 2023-08-27T11:27:43.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.987+0000 7f0bd17fa700 1 -- 172.21.15.43:0/1132602751 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v108) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0bd40c0840 con 0x7f0bd4157ee0 2023-08-27T11:27:44.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.998+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 msgr2=0x7f0bb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.998+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 0x7f0bb806c5a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000c00 tx=0x7f0bc8008070 comp rx=0 tx=0).stop 2023-08-27T11:27:44.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.998+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 msgr2=0x7f0bd41ecda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.998+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00efc0 tx=0x7f0bcc00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 shutdown_connections 2023-08-27T11:27:44.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bb806a0e0 0x7f0bb806c5a0 secure :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000c00 tx=0x7f0bc8008070 comp rx=0 tx=0).stop 2023-08-27T11:27:44.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bd4157ee0 0x7f0bd41ecda0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bd40c7c90 0x7f0bd41572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 --2- 172.21.15.43:0/1132602751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bd4151a70 0x7f0bd40c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:43.999+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 >> 172.21.15.43:0/1132602751 conn(0x7f0bd40c9d90 msgr2=0x7f0bd40c8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:44.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.004+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 shutdown_connections 2023-08-27T11:27:44.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.004+0000 7f0bdb1ff700 1 -- 172.21.15.43:0/1132602751 wait complete. 2023-08-27T11:27:44.012 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:27:44.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:27:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.240+0000 7f45387ff700 1 Processor -- start 2023-08-27T11:27:44.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.240+0000 7f45387ff700 1 -- start start 2023-08-27T11:27:44.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f45387ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45300c49f0 0x7f4530151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f45387ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4530151cd0 0x7f45300c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f45387ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45300c80c0 con 0x7f45300ac410 2023-08-27T11:27:44.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f45387ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45300c9bd0 con 0x7f45300c49f0 2023-08-27T11:27:44.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f45387ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45301555a0 con 0x7f4530151cd0 2023-08-27T11:27:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f453659b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45300c49f0 0x7f4530151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f4536d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f45300ac410 0x7f45300c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47604/0 (socket says 172.21.15.43:47604) 2023-08-27T11:27:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f453659b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45300c49f0 0x7f4530151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60800/0 (socket says 172.21.15.43:60800) 2023-08-27T11:27:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.241+0000 7f4536d9c700 1 -- 172.21.15.43:0/546964997 learned_addr learned my addr 172.21.15.43:0/546964997 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:44.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f4535d9a700 1 --2- 172.21.15.43:0/546964997 >> v2:172.21.15.57:3300/0 conn(0x7f4530151cd0 0x7f45300c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f453659b700 1 -- 172.21.15.43:0/546964997 >> v2:172.21.15.57:3300/0 conn(0x7f4530151cd0 msgr2=0x7f45300c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:44.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f453659b700 1 --2- 172.21.15.43:0/546964997 >> v2:172.21.15.57:3300/0 conn(0x7f4530151cd0 0x7f45300c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f453659b700 1 -- 172.21.15.43:0/546964997 >> v1:172.21.15.43:6789/0 conn(0x7f45300ac410 legacy=0x7f45300c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f453659b700 1 -- 172.21.15.43:0/546964997 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45301552c0 con 0x7f45300c49f0 2023-08-27T11:27:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f4535599700 1 -- 172.21.15.43:0/546964997 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263068717 0 0) 0x7f45300c80c0 con 0x7f45300ac410 2023-08-27T11:27:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f453659b700 1 --2- 172.21.15.43:0/546964997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45300c49f0 0x7f4530151790 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4530072830 tx=0x7f452c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda1417a35222126 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:44.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f4535599700 1 -- 172.21.15.43:0/546964997 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011830 con 0x7f45300c49f0 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f4535599700 1 -- 172.21.15.43:0/546964997 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c011990 con 0x7f45300c49f0 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.242+0000 7f4535599700 1 -- 172.21.15.43:0/546964997 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c011d20 con 0x7f45300c49f0 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 -- 172.21.15.43:0/546964997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45300c49f0 msgr2=0x7f4530151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 --2- 172.21.15.43:0/546964997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45300c49f0 0x7f4530151790 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4530072830 tx=0x7f452c009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 -- 172.21.15.43:0/546964997 shutdown_connections 2023-08-27T11:27:44.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 --2- 172.21.15.43:0/546964997 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45300c49f0 0x7f4530151790 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 --2- 172.21.15.43:0/546964997 >> v2:172.21.15.57:3300/0 conn(0x7f4530151cd0 0x7f45300c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 -- 172.21.15.43:0/546964997 >> 172.21.15.43:0/546964997 conn(0x7f45300ab8f0 msgr2=0x7f45300abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:44.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 -- 172.21.15.43:0/546964997 shutdown_connections 2023-08-27T11:27:44.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.243+0000 7f45387ff700 1 -- 172.21.15.43:0/546964997 wait complete. 2023-08-27T11:27:44.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.245+0000 7f45387ff700 1 Processor -- start 2023-08-27T11:27:44.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.245+0000 7f45387ff700 1 -- start start 2023-08-27T11:27:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 0x7f45301eac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45300c49f0 0x7f4530156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45301edc40 con 0x7f4530151cd0 2023-08-27T11:27:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453014cac0 con 0x7f45300ac410 2023-08-27T11:27:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f45387ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4530156900 con 0x7f45300c49f0 2023-08-27T11:27:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f4536d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f4536d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60816/0 (socket says 172.21.15.43:60816) 2023-08-27T11:27:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f4536d9c700 1 -- 172.21.15.43:0/545371626 learned_addr learned my addr 172.21.15.43:0/545371626 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f453659b700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 0x7f45301eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.246+0000 7f4535d9a700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45300c49f0 0x7f4530156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 -- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45300c49f0 msgr2=0x7f4530156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45300c49f0 0x7f4530156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 -- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 msgr2=0x7f45301eac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 0x7f45301eac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 -- 172.21.15.43:0/545371626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0094a0 con 0x7f4530151cd0 2023-08-27T11:27:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f453659b700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 0x7f45301eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:44.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4536d9c700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f452800cb90 tx=0x7f452800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452800aad0 con 0x7f4530151cd0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452800ac30 con 0x7f4530151cd0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45301eb140 con 0x7f4530151cd0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45280070d0 con 0x7f4530151cd0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.247+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45301ed960 con 0x7f4530151cd0 2023-08-27T11:27:44.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.248+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4530156430 con 0x7f4530151cd0 2023-08-27T11:27:44.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.250+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4528007230 con 0x7f4530151cd0 2023-08-27T11:27:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.251+0000 7f4526ffd700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 0x7f451406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.251+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4528088410 con 0x7f4530151cd0 2023-08-27T11:27:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.252+0000 7f453659b700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 0x7f451406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.252+0000 7f453659b700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 0x7f451406c5a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f452c0097c0 tx=0x7f452c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:44.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.255+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4528053bd0 con 0x7f4530151cd0 2023-08-27T11:27:44.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:44.510+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4530156430 con 0x7f4530151cd0 2023-08-27T11:27:45.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.007+0000 7f4526ffd700 1 -- 172.21.15.43:0/545371626 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v107) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4530156430 con 0x7f4530151cd0 2023-08-27T11:27:45.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.022+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 msgr2=0x7f451406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.022+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 0x7f451406c5a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f452c0097c0 tx=0x7f452c01c040 comp rx=0 tx=0).stop 2023-08-27T11:27:45.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.022+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 msgr2=0x7f45301ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.022+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f452800cb90 tx=0x7f452800cf50 comp rx=0 tx=0).stop 2023-08-27T11:27:45.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 shutdown_connections 2023-08-27T11:27:45.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f451406a0e0 0x7f451406c5a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4530151cd0 0x7f45301ecf70 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45300ac410 0x7f45301eac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 --2- 172.21.15.43:0/545371626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45300c49f0 0x7f4530156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.026+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 >> 172.21.15.43:0/545371626 conn(0x7f45300ab8f0 msgr2=0x7f45300ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:45.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.032+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 shutdown_connections 2023-08-27T11:27:45.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.032+0000 7f45387ff700 1 -- 172.21.15.43:0/545371626 wait complete. 2023-08-27T11:27:45.041 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 17 and data pool 18 2023-08-27T11:27:45.064 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:45.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.267+0000 7f73f6dff700 1 Processor -- start 2023-08-27T11:27:45.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.267+0000 7f73f6dff700 1 -- start start 2023-08-27T11:27:45.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.268+0000 7f73f6dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.268+0000 7f73f6dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f73f00a79c0 0x7f73f00c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.268+0000 7f73f6dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f0154d00 con 0x7f73f00c50d0 2023-08-27T11:27:45.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.268+0000 7f73f6dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00baf30 con 0x7f73f00a79c0 2023-08-27T11:27:45.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.268+0000 7f73f6dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0154fe0 con 0x7f73f014e960 2023-08-27T11:27:45.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f73f00a79c0 0x7f73f00c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73f539c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f73f00c50d0 0x7f73f00c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47610/0 (socket says 172.21.15.43:47610) 2023-08-27T11:27:45.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f73f00a79c0 0x7f73f00c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60818/0 (socket says 172.21.15.43:60818) 2023-08-27T11:27:45.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73f539c700 1 -- 172.21.15.43:0/1177545072 learned_addr learned my addr 172.21.15.43:0/1177545072 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:45.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73f4b9b700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 -- 172.21.15.43:0/1177545072 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 msgr2=0x7f73f00a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:45.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 -- 172.21.15.43:0/1177545072 >> v1:172.21.15.43:6789/0 conn(0x7f73f00c50d0 legacy=0x7f73f00c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 -- 172.21.15.43:0/1177545072 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f01552c0 con 0x7f73f00a79c0 2023-08-27T11:27:45.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73f4b9b700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:45.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.269+0000 7f73effff700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f00c3cc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009840 tx=0x7f73dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51586cabc365327 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73ef7fe700 1 -- 172.21.15.43:0/1177545072 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011830 con 0x7f73f00a79c0 2023-08-27T11:27:45.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73ef7fe700 1 -- 172.21.15.43:0/1177545072 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc011990 con 0x7f73f00a79c0 2023-08-27T11:27:45.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73ef7fe700 1 -- 172.21.15.43:0/1177545072 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc011d20 con 0x7f73f00a79c0 2023-08-27T11:27:45.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 -- 172.21.15.43:0/1177545072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 msgr2=0x7f73f00c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f00c3cc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009840 tx=0x7f73dc009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:45.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 -- 172.21.15.43:0/1177545072 shutdown_connections 2023-08-27T11:27:45.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 --2- 172.21.15.43:0/1177545072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f00c3cc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 -- 172.21.15.43:0/1177545072 >> 172.21.15.43:0/1177545072 conn(0x7f73f006aa50 msgr2=0x7f73f00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:45.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 -- 172.21.15.43:0/1177545072 shutdown_connections 2023-08-27T11:27:45.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.270+0000 7f73f6dff700 1 -- 172.21.15.43:0/1177545072 wait complete. 2023-08-27T11:27:45.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.272+0000 7f73f6dff700 1 Processor -- start 2023-08-27T11:27:45.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.272+0000 7f73f6dff700 1 -- start start 2023-08-27T11:27:45.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 0x7f73f00a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a8fd0 con 0x7f73f00a79c0 2023-08-27T11:27:45.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0141940 con 0x7f73f00c50d0 2023-08-27T11:27:45.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f6dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ab650 con 0x7f73f014e960 2023-08-27T11:27:45.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f4b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f4b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60824/0 (socket says 172.21.15.43:60824) 2023-08-27T11:27:45.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.273+0000 7f73f4b9b700 1 -- 172.21.15.43:0/2038518372 learned_addr learned my addr 172.21.15.43:0/2038518372 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:45.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73effff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 0x7f73f00a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f539c700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 -- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 msgr2=0x7f73f00ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 -- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 msgr2=0x7f73f00a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 0x7f73f00a87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 -- 172.21.15.43:0/2038518372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0094a0 con 0x7f73f00a79c0 2023-08-27T11:27:45.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73effff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 0x7f73f00a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f4b9b700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e810 tx=0x7f73e400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4004230 con 0x7f73f00a79c0 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4004390 con 0x7f73f00a79c0 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e40036a0 con 0x7f73f00a79c0 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.274+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f0141e70 con 0x7f73f00a79c0 2023-08-27T11:27:45.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.275+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0141b90 con 0x7f73f00a79c0 2023-08-27T11:27:45.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.275+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f00bb390 con 0x7f73f00a79c0 2023-08-27T11:27:45.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.276+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73e4003800 con 0x7f73f00a79c0 2023-08-27T11:27:45.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.278+0000 7f73ed7fa700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 0x7f73d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.278+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73e4088070 con 0x7f73f00a79c0 2023-08-27T11:27:45.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.278+0000 7f73effff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 0x7f73d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.278+0000 7f73effff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 0x7f73d406c5a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0090b0 tx=0x7f73dc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.282+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73e4053750 con 0x7f73f00a79c0 2023-08-27T11:27:45.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.495+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f004ee70 con 0x7f73f00a79c0 2023-08-27T11:27:45.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.496+0000 7f73ed7fa700 1 -- 172.21.15.43:0/2038518372 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f73e4056d70 con 0x7f73f00a79c0 2023-08-27T11:27:45.498 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:45.499 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":109,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:44.511971+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:45.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 msgr2=0x7f73d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 0x7f73d406c5a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0090b0 tx=0x7f73dc01c040 comp rx=0 tx=0).stop 2023-08-27T11:27:45.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 msgr2=0x7f73f01dd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73e400e810 tx=0x7f73e400ebd0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 shutdown_connections 2023-08-27T11:27:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f73d406a0e0 0x7f73d406c5a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73f014e960 0x7f73f00ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f73f00a79c0 0x7f73f01dd040 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 --2- 172.21.15.43:0/2038518372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f73f00c50d0 0x7f73f00a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 >> 172.21.15.43:0/2038518372 conn(0x7f73f006aa50 msgr2=0x7f73f00a61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:45.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 shutdown_connections 2023-08-27T11:27:45.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.499+0000 7f73f6dff700 1 -- 172.21.15.43:0/2038518372 wait complete. 2023-08-27T11:27:45.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:45.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.721+0000 7f17e3fff700 1 Processor -- start 2023-08-27T11:27:45.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.721+0000 7f17e3fff700 1 -- start start 2023-08-27T11:27:45.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17dc154740 0x7f17dc0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e3fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc154d00 con 0x7f17dc14e960 2023-08-27T11:27:45.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e3fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc154fe0 con 0x7f17dc0c50d0 2023-08-27T11:27:45.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e3fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0baf30 con 0x7f17dc154740 2023-08-27T11:27:45.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e1d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f17dc14e960 0x7f17dc0a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47622/0 (socket says 172.21.15.43:47622) 2023-08-27T11:27:45.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e1d9b700 1 -- 172.21.15.43:0/2965532678 learned_addr learned my addr 172.21.15.43:0/2965532678 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:45.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074669664 0 0) 0x7f17dc154d00 con 0x7f17dc14e960 2023-08-27T11:27:45.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e259c700 1 --2- 172.21.15.43:0/2965532678 >> v2:172.21.15.57:3300/0 conn(0x7f17dc154740 0x7f17dc0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.723+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c80035b0 con 0x7f17dc14e960 2023-08-27T11:27:45.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 321559154 0 0) 0x7f17c80035b0 con 0x7f17dc14e960 2023-08-27T11:27:45.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 >> v2:172.21.15.57:3300/0 conn(0x7f17dc154740 msgr2=0x7f17dc0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:45.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 --2- 172.21.15.43:0/2965532678 >> v2:172.21.15.57:3300/0 conn(0x7f17dc154740 0x7f17dc0c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 >> v1:172.21.15.57:6789/0 conn(0x7f17dc0c50d0 legacy=0x7f17dc0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc1552c0 con 0x7f17dc14e960 2023-08-27T11:27:45.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f17d8001670 con 0x7f17dc14e960 2023-08-27T11:27:45.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 >> v1:172.21.15.43:6789/0 conn(0x7f17dc14e960 legacy=0x7f17dc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8003a50 0x7f17c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 0x7f17c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8005260 0x7f17c800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0baf30 con 0x7f17c8004850 2023-08-27T11:27:45.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c800e3c0 con 0x7f17c8005260 2023-08-27T11:27:45.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c800e580 con 0x7f17c8003a50 2023-08-27T11:27:45.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e159a700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 0x7f17c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e1d9b700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8003a50 0x7f17c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.724+0000 7f17e259c700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8005260 0x7f17c800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 -- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8003a50 msgr2=0x7f17c8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:45.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17c8003a50 0x7f17c8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 -- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8005260 msgr2=0x7f17c800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:45.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8005260 0x7f17c800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 -- 172.21.15.43:0/2965532678 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80035b0 con 0x7f17c8004850 2023-08-27T11:27:45.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e259c700 1 -- 172.21.15.43:0/2965532678 reap_dead start 2023-08-27T11:27:45.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e159a700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 0x7f17c8004cd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f17cc007fd0 tx=0x7f17c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b921621198d818a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc005220 con 0x7f17c8004850 2023-08-27T11:27:45.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc0053a0 con 0x7f17c8004850 2023-08-27T11:27:45.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e0d99700 1 -- 172.21.15.43:0/2965532678 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc006aa0 con 0x7f17c8004850 2023-08-27T11:27:45.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e3fff700 1 -- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 msgr2=0x7f17c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.725+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 0x7f17c8004cd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f17cc007fd0 tx=0x7f17c8005880 comp rx=0 tx=0).stop 2023-08-27T11:27:45.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.726+0000 7f17e3fff700 1 -- 172.21.15.43:0/2965532678 shutdown_connections 2023-08-27T11:27:45.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.726+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2965532678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17c8004850 0x7f17c8004cd0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.726+0000 7f17e3fff700 1 -- 172.21.15.43:0/2965532678 >> 172.21.15.43:0/2965532678 conn(0x7f17dc06aa50 msgr2=0x7f17dc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:45.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.726+0000 7f17e3fff700 1 -- 172.21.15.43:0/2965532678 shutdown_connections 2023-08-27T11:27:45.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.726+0000 7f17e3fff700 1 -- 172.21.15.43:0/2965532678 wait complete. 2023-08-27T11:27:45.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.728+0000 7f17e3fff700 1 Processor -- start 2023-08-27T11:27:45.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.728+0000 7f17e3fff700 1 -- start start 2023-08-27T11:27:45.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.729+0000 7f17e3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8004850 0x7f17dc0a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17dc0a6390 0x7f17dc0ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e3fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc14ff80 con 0x7f17dc0ab600 2023-08-27T11:27:45.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc0a9270 con 0x7f17c8004850 2023-08-27T11:27:45.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc145a70 con 0x7f17dc0a6390 2023-08-27T11:27:45.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60850/0 (socket says 172.21.15.43:60850) 2023-08-27T11:27:45.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 -- 172.21.15.43:0/2327950668 learned_addr learned my addr 172.21.15.43:0/2327950668 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:45.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e1d9b700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8004850 0x7f17dc0a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e159a700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17dc0a6390 0x7f17dc0ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 -- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17dc0a6390 msgr2=0x7f17dc0ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17dc0a6390 0x7f17dc0ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 -- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8004850 msgr2=0x7f17dc0a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8004850 0x7f17dc0a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.730+0000 7f17e259c700 1 -- 172.21.15.43:0/2327950668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc0727c0 con 0x7f17dc0ab600 2023-08-27T11:27:45.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17e259c700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0a4cf0 tx=0x7f17d4011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400e040 con 0x7f17dc0ab600 2023-08-27T11:27:45.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d400f040 con 0x7f17dc0ab600 2023-08-27T11:27:45.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400fbe0 con 0x7f17dc0ab600 2023-08-27T11:27:45.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc150190 con 0x7f17dc0ab600 2023-08-27T11:27:45.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.731+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc0a8fa0 con 0x7f17dc0ab600 2023-08-27T11:27:45.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.732+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17dc0aade0 con 0x7f17dc0ab600 2023-08-27T11:27:45.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.733+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f17d400fd40 con 0x7f17dc0ab600 2023-08-27T11:27:45.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.734+0000 7f17d27fc700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 0x7f17c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:45.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.734+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f17d4088b00 con 0x7f17dc0ab600 2023-08-27T11:27:45.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.734+0000 7f17e1d9b700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 0x7f17c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:45.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.735+0000 7f17e1d9b700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 0x7f17c006c5a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17d8001050 tx=0x7f17d8000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:45.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.739+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f17dc0aade0 con 0x7f17dc0ab600 2023-08-27T11:27:45.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.946+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17dc0aade0 con 0x7f17dc0ab600 2023-08-27T11:27:45.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.948+0000 7f17d27fc700 1 -- 172.21.15.43:0/2327950668 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18256 (secure 0 0 0) 0x7f17dc0aade0 con 0x7f17dc0ab600 2023-08-27T11:27:45.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:45.950 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":109,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:44.511971+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:45.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 msgr2=0x7f17c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 0x7f17c006c5a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17d8001050 tx=0x7f17d8000f80 comp rx=0 tx=0).stop 2023-08-27T11:27:45.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 msgr2=0x7f17dc1ed240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:45.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0a4cf0 tx=0x7f17d4011ed0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 shutdown_connections 2023-08-27T11:27:45.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f17c006a0e0 0x7f17c006c5a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f17dc0ab600 0x7f17dc1ed240 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17c8004850 0x7f17dc0a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 --2- 172.21.15.43:0/2327950668 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17dc0a6390 0x7f17dc0ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:45.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 >> 172.21.15.43:0/2327950668 conn(0x7f17dc06aa50 msgr2=0x7f17dc14c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:45.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 shutdown_connections 2023-08-27T11:27:45.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:45.950+0000 7f17e3fff700 1 -- 172.21.15.43:0/2327950668 wait complete. 2023-08-27T11:27:45.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:27:46.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.176+0000 7f8324bff700 1 Processor -- start 2023-08-27T11:27:46.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.176+0000 7f8324bff700 1 -- start start 2023-08-27T11:27:46.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f8324bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 0x7f83200c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f8324bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f83200c7c00 0x7f83200ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f8324bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8320154660 con 0x7f83200abcc0 2023-08-27T11:27:46.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f8324bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200c5750 con 0x7f83200c7c00 2023-08-27T11:27:46.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f8324bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8320154940 con 0x7f8320151d20 2023-08-27T11:27:46.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f831dd9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f83200c7c00 0x7f83200ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f831ed9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f83200abcc0 0x7f832006a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47630/0 (socket says 172.21.15.43:47630) 2023-08-27T11:27:46.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.177+0000 7f831ed9d700 1 -- 172.21.15.43:0/3970293631 learned_addr learned my addr 172.21.15.43:0/3970293631 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:46.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831e59c700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 0x7f83200c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831dd9b700 1 -- 172.21.15.43:0/3970293631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 msgr2=0x7f83200c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:46.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831dd9b700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 0x7f83200c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:46.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831dd9b700 1 -- 172.21.15.43:0/3970293631 >> v1:172.21.15.43:6789/0 conn(0x7f83200abcc0 legacy=0x7f832006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:46.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831dd9b700 1 -- 172.21.15.43:0/3970293631 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320154c20 con 0x7f83200c7c00 2023-08-27T11:27:46.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831e59c700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 0x7f83200c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:46.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831d59a700 1 -- 172.21.15.43:0/3970293631 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220588050 0 0) 0x7f8320154660 con 0x7f83200abcc0 2023-08-27T11:27:46.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831dd9b700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83200ab780 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8314009840 tx=0x7f8314009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6334ae3522612853 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:46.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831d59a700 1 -- 172.21.15.43:0/3970293631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011830 con 0x7f83200c7c00 2023-08-27T11:27:46.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831d59a700 1 -- 172.21.15.43:0/3970293631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314011990 con 0x7f83200c7c00 2023-08-27T11:27:46.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.178+0000 7f831d59a700 1 -- 172.21.15.43:0/3970293631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011d20 con 0x7f83200c7c00 2023-08-27T11:27:46.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 -- 172.21.15.43:0/3970293631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 msgr2=0x7f83200ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:46.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83200ab780 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8314009840 tx=0x7f8314009b50 comp rx=0 tx=0).stop 2023-08-27T11:27:46.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 -- 172.21.15.43:0/3970293631 shutdown_connections 2023-08-27T11:27:46.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8320151d20 0x7f83200c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:46.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 --2- 172.21.15.43:0/3970293631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83200ab780 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:46.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 -- 172.21.15.43:0/3970293631 >> 172.21.15.43:0/3970293631 conn(0x7f83200c9d00 msgr2=0x7f83200ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:46.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 -- 172.21.15.43:0/3970293631 shutdown_connections 2023-08-27T11:27:46.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.179+0000 7f8324bff700 1 -- 172.21.15.43:0/3970293631 wait complete. 2023-08-27T11:27:46.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.181+0000 7f8324bff700 1 Processor -- start 2023-08-27T11:27:46.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.181+0000 7f8324bff700 1 -- start start 2023-08-27T11:27:46.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 0x7f83200c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8320151d20 0x7f83200c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c2480 con 0x7f83200c7c00 2023-08-27T11:27:46.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83201e9fd0 con 0x7f8320151d20 2023-08-27T11:27:46.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f8324bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83201ea500 con 0x7f83200abcc0 2023-08-27T11:27:46.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60868/0 (socket says 172.21.15.43:60868) 2023-08-27T11:27:46.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 -- 172.21.15.43:0/2562762963 learned_addr learned my addr 172.21.15.43:0/2562762963 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831e59c700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 0x7f83200c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831ed9d700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8320151d20 0x7f83200c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 -- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 msgr2=0x7f83200c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 0x7f83200c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 -- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8320151d20 msgr2=0x7f83200c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:46.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8320151d20 0x7f83200c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:46.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831dd9b700 1 -- 172.21.15.43:0/2562762963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140094a0 con 0x7f83200c7c00 2023-08-27T11:27:46.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.182+0000 7f831e59c700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 0x7f83200c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:46.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f831dd9b700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f83140090b0 tx=0x7f8314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:46.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140038a0 con 0x7f83200c7c00 2023-08-27T11:27:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831401f070 con 0x7f83200c7c00 2023-08-27T11:27:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83200c1360 con 0x7f83200c7c00 2023-08-27T11:27:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314003c20 con 0x7f83200c7c00 2023-08-27T11:27:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.183+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83201ea220 con 0x7f83200c7c00 2023-08-27T11:27:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.184+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832004ee70 con 0x7f83200c7c00 2023-08-27T11:27:46.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.185+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8314026480 con 0x7f83200c7c00 2023-08-27T11:27:46.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.186+0000 7f830effd700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 0x7f830006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:46.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.186+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8314021070 con 0x7f83200c7c00 2023-08-27T11:27:46.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.186+0000 7f831e59c700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 0x7f830006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:46.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.187+0000 7f831e59c700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 0x7f830006c5a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f831000c960 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:46.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.190+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f83140555e0 con 0x7f83200c7c00 2023-08-27T11:27:46.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:46.448+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83200ac650 con 0x7f83200c7c00 2023-08-27T11:27:47.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.060+0000 7f830effd700 1 -- 172.21.15.43:0/2562762963 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v110) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8314015020 con 0x7f83200c7c00 2023-08-27T11:27:47.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 msgr2=0x7f830006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:47.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 0x7f830006c5a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f831000c960 tx=0x7f8310008040 comp rx=0 tx=0).stop 2023-08-27T11:27:47.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 msgr2=0x7f83201ea9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:47.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f83140090b0 tx=0x7f8314004750 comp rx=0 tx=0).stop 2023-08-27T11:27:47.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 shutdown_connections 2023-08-27T11:27:47.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f830006a0e0 0x7f830006c5a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8320151d20 0x7f83200c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f83200abcc0 0x7f83200c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 --2- 172.21.15.43:0/2562762963 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f83200c7c00 0x7f83201ea9c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 >> 172.21.15.43:0/2562762963 conn(0x7f83200c9d00 msgr2=0x7f83201507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:47.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 shutdown_connections 2023-08-27T11:27:47.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.063+0000 7f8324bff700 1 -- 172.21.15.43:0/2562762963 wait complete. 2023-08-27T11:27:47.085 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:27:47.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:27:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.290+0000 7fe7b0fff700 1 Processor -- start 2023-08-27T11:27:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.290+0000 7fe7b0fff700 1 -- start start 2023-08-27T11:27:47.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7b0fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7ac151d20 0x7fe7ac0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7b0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0c7c00 0x7fe7ac0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7b0fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac154660 con 0x7fe7ac0abcc0 2023-08-27T11:27:47.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7b0fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac0c5750 con 0x7fe7ac151d20 2023-08-27T11:27:47.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7b0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac154940 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7ac151d20 0x7fe7ac0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7ac151d20 0x7fe7ac0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60870/0 (socket says 172.21.15.43:60870) 2023-08-27T11:27:47.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 -- 172.21.15.43:0/2355313359 learned_addr learned my addr 172.21.15.43:0/2355313359 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:47.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7a3fff700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0c7c00 0x7fe7ac0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 -- 172.21.15.43:0/2355313359 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0c7c00 msgr2=0x7fe7ac0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:47.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0c7c00 0x7fe7ac0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 -- 172.21.15.43:0/2355313359 >> v1:172.21.15.57:6789/0 conn(0x7fe7ac0abcc0 legacy=0x7fe7ac06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:47.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.292+0000 7fe7aa59c700 1 -- 172.21.15.43:0/2355313359 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac154c20 con 0x7fe7ac151d20 2023-08-27T11:27:47.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7aa59c700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac151d20 0x7fe7ac0c8110 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0098f0 tx=0x7fe79c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2be844788c5874b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:47.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7a9d9b700 1 -- 172.21.15.43:0/2355313359 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c004230 con 0x7fe7ac151d20 2023-08-27T11:27:47.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7a9d9b700 1 -- 172.21.15.43:0/2355313359 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c004390 con 0x7fe7ac151d20 2023-08-27T11:27:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7a9d9b700 1 -- 172.21.15.43:0/2355313359 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0036a0 con 0x7fe7ac151d20 2023-08-27T11:27:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2355313359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac151d20 msgr2=0x7fe7ac0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.293+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac151d20 0x7fe7ac0c8110 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0098f0 tx=0x7fe79c009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2355313359 shutdown_connections 2023-08-27T11:27:47.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac151d20 0x7fe7ac0c8110 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2355313359 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0c7c00 0x7fe7ac0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2355313359 >> 172.21.15.43:0/2355313359 conn(0x7fe7ac0c9d00 msgr2=0x7fe7ac0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2355313359 shutdown_connections 2023-08-27T11:27:47.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.294+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2355313359 wait complete. 2023-08-27T11:27:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.295+0000 7fe7b0fff700 1 Processor -- start 2023-08-27T11:27:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.295+0000 7fe7b0fff700 1 -- start start 2023-08-27T11:27:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0abcc0 0x7fe7ac1ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7ac151d20 0x7fe7ac1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac1e9f40 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0aac60 con 0x7fe7ac151d20 2023-08-27T11:27:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.296+0000 7fe7b0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0aaf40 con 0x7fe7ac0abcc0 2023-08-27T11:27:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60876/0 (socket says 172.21.15.43:60876) 2023-08-27T11:27:47.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 -- 172.21.15.43:0/2498341959 learned_addr learned my addr 172.21.15.43:0/2498341959 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:47.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7aa59c700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0abcc0 0x7fe7ac1ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7aad9d700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7ac151d20 0x7fe7ac1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 -- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0abcc0 msgr2=0x7fe7ac1ea3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:47.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0abcc0 0x7fe7ac1ea3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 -- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7ac151d20 msgr2=0x7fe7ac1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7ac151d20 0x7fe7ac1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 -- 172.21.15.43:0/2498341959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c009550 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a3fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e810 tx=0x7fe79400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.297+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794013610 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.298+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794013770 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.298+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac1e9bd0 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.298+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794013b20 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.298+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac1e9880 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.299+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac1e9d60 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.300+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe794013c80 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.301+0000 7fe7a2ffd700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 0x7fe78c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:47.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.301+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7940881b0 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.301+0000 7fe7aa59c700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 0x7fe78c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:47.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.301+0000 7fe7aa59c700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 0x7fe78c06c5a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009130 tx=0x7fe79c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:47.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.305+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe794057340 con 0x7fe7ac0c7c00 2023-08-27T11:27:47.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:47.563+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7ac04ee70 con 0x7fe7ac0c7c00 2023-08-27T11:27:48.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.062+0000 7fe7a2ffd700 1 -- 172.21.15.43:0/2498341959 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v111) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe794056ed0 con 0x7fe7ac0c7c00 2023-08-27T11:27:48.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 msgr2=0x7fe78c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 0x7fe78c06c5a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009130 tx=0x7fe79c008030 comp rx=0 tx=0).stop 2023-08-27T11:27:48.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 msgr2=0x7fe7ac1ed650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe79400e810 tx=0x7fe79400eb20 comp rx=0 tx=0).stop 2023-08-27T11:27:48.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 shutdown_connections 2023-08-27T11:27:48.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe78c06a0e0 0x7fe78c06c5a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7ac151d20 0x7fe7ac1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7ac0abcc0 0x7fe7ac1ea3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 --2- 172.21.15.43:0/2498341959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7ac0c7c00 0x7fe7ac1ed650 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 >> 172.21.15.43:0/2498341959 conn(0x7fe7ac0c9d00 msgr2=0x7fe7ac14df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:48.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.064+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 shutdown_connections 2023-08-27T11:27:48.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.065+0000 7fe7b0fff700 1 -- 172.21.15.43:0/2498341959 wait complete. 2023-08-27T11:27:48.086 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:27:48.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:48.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.288+0000 7f44b77ff700 1 Processor -- start 2023-08-27T11:27:48.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.288+0000 7f44b77ff700 1 -- start start 2023-08-27T11:27:48.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.289+0000 7f44b77ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 0x7f44b00bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b77ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00c17f0 con 0x7f44b014e0d0 2023-08-27T11:27:48.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b77ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b00c0900 con 0x7f44b00c4c40 2023-08-27T11:27:48.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b77ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00c21a0 con 0x7f44b00c0390 2023-08-27T11:27:48.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b559b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f44b014e0d0 0x7f44b00c4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47644/0 (socket says 172.21.15.43:47644) 2023-08-27T11:27:48.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b559b700 1 -- 172.21.15.43:0/2027289716 learned_addr learned my addr 172.21.15.43:0/2027289716 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:48.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b5d9c700 1 --2- 172.21.15.43:0/2027289716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 0x7f44b00bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087029383 0 0) 0x7f44b00c17f0 con 0x7f44b014e0d0 2023-08-27T11:27:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f449c0046c0 con 0x7f44b014e0d0 2023-08-27T11:27:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605536183 0 0) 0x7f44b00c0900 con 0x7f44b00c4c40 2023-08-27T11:27:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b5d9c700 1 -- 172.21.15.43:0/2027289716 >> v1:172.21.15.57:6789/0 conn(0x7f44b00c4c40 legacy=0x7f44b00bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b5d9c700 1 -- 172.21.15.43:0/2027289716 >> v1:172.21.15.43:6789/0 conn(0x7f44b014e0d0 legacy=0x7f44b00c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.290+0000 7f44b5d9c700 1 -- 172.21.15.43:0/2027289716 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b00c0be0 con 0x7f44b00c0390 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.291+0000 7f44b5d9c700 1 --2- 172.21.15.43:0/2027289716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 0x7f44b00bbcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009dc0 tx=0x7f44a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f629d57910586e9d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.291+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800e070 con 0x7f44b00c0390 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.291+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a800bb20 con 0x7f44b00c0390 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.291+0000 7f44a7fff700 1 -- 172.21.15.43:0/2027289716 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800be90 con 0x7f44b00c0390 2023-08-27T11:27:48.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 -- 172.21.15.43:0/2027289716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 msgr2=0x7f44b00bbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 --2- 172.21.15.43:0/2027289716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 0x7f44b00bbcd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44a8009dc0 tx=0x7f44a800b330 comp rx=0 tx=0).stop 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 -- 172.21.15.43:0/2027289716 shutdown_connections 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 --2- 172.21.15.43:0/2027289716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b00c0390 0x7f44b00bbcd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 -- 172.21.15.43:0/2027289716 >> 172.21.15.43:0/2027289716 conn(0x7f44b006aa50 msgr2=0x7f44b00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 -- 172.21.15.43:0/2027289716 shutdown_connections 2023-08-27T11:27:48.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.292+0000 7f44b77ff700 1 -- 172.21.15.43:0/2027289716 wait complete. 2023-08-27T11:27:48.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.293+0000 7f44b77ff700 1 Processor -- start 2023-08-27T11:27:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.294+0000 7f44b77ff700 1 -- start start 2023-08-27T11:27:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.294+0000 7f44b77ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44b00c0390 0x7f44b00be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.294+0000 7f44b77ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.294+0000 7f44b77ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b014e0d0 0x7f44b014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b77ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0151110 con 0x7f44b00c4c40 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b77ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b00bdeb0 con 0x7f44b00c0390 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b77ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b0151900 con 0x7f44b014e0d0 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60882/0 (socket says 172.21.15.43:60882) 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 -- 172.21.15.43:0/1217583520 learned_addr learned my addr 172.21.15.43:0/1217583520 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:48.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b559b700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44b00c0390 0x7f44b00be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b5d9c700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b014e0d0 0x7f44b014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 -- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b014e0d0 msgr2=0x7f44b014e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b014e0d0 0x7f44b014e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 -- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44b00c0390 msgr2=0x7f44b00be340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44b00c0390 0x7f44b00be340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.295+0000 7f44b4d9a700 1 -- 172.21.15.43:0/1217583520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8009a70 con 0x7f44b00c4c40 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44b4d9a700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c500 tx=0x7f44a000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00054e0 con 0x7f44b00c4c40 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a0003680 con 0x7f44b00c4c40 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0003a30 con 0x7f44b00c4c40 2023-08-27T11:27:48.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b00a51d0 con 0x7f44b00c4c40 2023-08-27T11:27:48.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.296+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b0151620 con 0x7f44b00c4c40 2023-08-27T11:27:48.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.297+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b014cc20 con 0x7f44b00c4c40 2023-08-27T11:27:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.298+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44a0003b90 con 0x7f44b00c4c40 2023-08-27T11:27:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.299+0000 7f44a5ffb700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 0x7f449406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.299+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44a0087960 con 0x7f44b00c4c40 2023-08-27T11:27:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.299+0000 7f44b559b700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 0x7f449406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.300+0000 7f44b559b700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 0x7f449406c5a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.303+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f44a0053070 con 0x7f44b00c4c40 2023-08-27T11:27:48.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.559+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44b004ee70 con 0x7f44b00c4c40 2023-08-27T11:27:48.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.560+0000 7f44a5ffb700 1 -- 172.21.15.43:0/1217583520 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4877 (secure 0 0 0) 0x7f44a0017090 con 0x7f44b00c4c40 2023-08-27T11:27:48.562 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:48.562 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105},{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:48.059677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7575":{"gid":7575,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1939845776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1939845776},{"type":"v1","addr":"172.21.15.43:6837","nonce":1939845776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:27:48.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.562+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 msgr2=0x7f449406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.562+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 0x7f449406c5a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007fd0 tx=0x7f44ac009040 comp rx=0 tx=0).stop 2023-08-27T11:27:48.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 msgr2=0x7f44b00a78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f44a000c500 tx=0x7f44a000c810 comp rx=0 tx=0).stop 2023-08-27T11:27:48.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 shutdown_connections 2023-08-27T11:27:48.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f449406a0e0 0x7f449406c5a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f44b014e0d0 0x7f44b014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44b00c0390 0x7f44b00be340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 --2- 172.21.15.43:0/1217583520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f44b00c4c40 0x7f44b00a78a0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 >> 172.21.15.43:0/1217583520 conn(0x7f44b006aa50 msgr2=0x7f44b00c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:48.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 shutdown_connections 2023-08-27T11:27:48.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.563+0000 7f44b77ff700 1 -- 172.21.15.43:0/1217583520 wait complete. 2023-08-27T11:27:48.567 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 111 2023-08-27T11:27:48.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:27:48.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.782+0000 7f044e3ff700 1 Processor -- start 2023-08-27T11:27:48.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.782+0000 7f044e3ff700 1 -- start start 2023-08-27T11:27:48.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0448151a90 0x7f04480c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 0x7f04480c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f044806ad70 0x7f044806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044806c4e0 con 0x7f044806ad70 2023-08-27T11:27:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0448155370 con 0x7f04480c4630 2023-08-27T11:27:48.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044e3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448151e70 con 0x7f0448151a90 2023-08-27T11:27:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.783+0000 7f044c99c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f044806ad70 0x7f044806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f044806ad70 0x7f044806b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60894/0 (socket says 172.21.15.43:60894) 2023-08-27T11:27:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 -- 172.21.15.43:0/1198107753 learned_addr learned my addr 172.21.15.43:0/1198107753 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f0447fff700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0448151a90 0x7f04480c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f04477fe700 1 --2- 172.21.15.43:0/1198107753 >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 0x7f04480c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 -- 172.21.15.43:0/1198107753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0448151a90 msgr2=0x7f04480c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:48.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0448151a90 0x7f04480c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 -- 172.21.15.43:0/1198107753 >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 msgr2=0x7f04480c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:48.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 --2- 172.21.15.43:0/1198107753 >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 0x7f04480c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 -- 172.21.15.43:0/1198107753 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448154480 con 0x7f044806ad70 2023-08-27T11:27:48.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f04477fe700 1 --2- 172.21.15.43:0/1198107753 >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 0x7f04480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:48.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f044c99c700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044806b200 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f04480ac480 tx=0x7f044000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebc82ff3987b212 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.784+0000 7f0446ffd700 1 -- 172.21.15.43:0/1198107753 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000e070 con 0x7f044806ad70 2023-08-27T11:27:48.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f0446ffd700 1 -- 172.21.15.43:0/1198107753 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044000b910 con 0x7f044806ad70 2023-08-27T11:27:48.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f0446ffd700 1 -- 172.21.15.43:0/1198107753 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000bcc0 con 0x7f044806ad70 2023-08-27T11:27:48.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 -- 172.21.15.43:0/1198107753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 msgr2=0x7f044806b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044806b200 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f04480ac480 tx=0x7f044000b330 comp rx=0 tx=0).stop 2023-08-27T11:27:48.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 -- 172.21.15.43:0/1198107753 shutdown_connections 2023-08-27T11:27:48.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044806b200 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 --2- 172.21.15.43:0/1198107753 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0448151a90 0x7f04480c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 --2- 172.21.15.43:0/1198107753 >> v2:172.21.15.57:3300/0 conn(0x7f04480c4630 0x7f04480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 -- 172.21.15.43:0/1198107753 >> 172.21.15.43:0/1198107753 conn(0x7f04480ab820 msgr2=0x7f04480abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:48.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 -- 172.21.15.43:0/1198107753 shutdown_connections 2023-08-27T11:27:48.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.785+0000 7f044e3ff700 1 -- 172.21.15.43:0/1198107753 wait complete. 2023-08-27T11:27:48.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.787+0000 7f044e3ff700 1 Processor -- start 2023-08-27T11:27:48.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.787+0000 7f044e3ff700 1 -- start start 2023-08-27T11:27:48.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 0x7f0448153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 0x7f0448153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04481ea070 con 0x7f044806ad70 2023-08-27T11:27:48.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04481ea500 con 0x7f0448151a90 2023-08-27T11:27:48.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f044e3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04481504f0 con 0x7f04480c4630 2023-08-27T11:27:48.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f0447fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f0447fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:60904/0 (socket says 172.21.15.43:60904) 2023-08-27T11:27:48.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.788+0000 7f0447fff700 1 -- 172.21.15.43:0/325253100 learned_addr learned my addr 172.21.15.43:0/325253100 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:48.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f04477fe700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 0x7f0448153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f044c99c700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 0x7f0448153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 -- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 msgr2=0x7f0448153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 0x7f0448153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 -- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 msgr2=0x7f0448153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:48.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 0x7f0448153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:48.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 -- 172.21.15.43:0/325253100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009b30 con 0x7f044806ad70 2023-08-27T11:27:48.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f044c99c700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 0x7f0448153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:48.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f04477fe700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 0x7f0448153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:48.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0447fff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f043800e870 tx=0x7f043800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438009590 con 0x7f044806ad70 2023-08-27T11:27:48.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043800ee70 con 0x7f044806ad70 2023-08-27T11:27:48.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043800ca50 con 0x7f044806ad70 2023-08-27T11:27:48.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04481e9740 con 0x7f044806ad70 2023-08-27T11:27:48.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.789+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04481e9d00 con 0x7f044806ad70 2023-08-27T11:27:48.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.790+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044804ee70 con 0x7f044806ad70 2023-08-27T11:27:48.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.791+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f043800cbb0 con 0x7f044806ad70 2023-08-27T11:27:48.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.792+0000 7f0444ff9700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 0x7f043406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:48.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.792+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0438088440 con 0x7f044806ad70 2023-08-27T11:27:48.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.792+0000 7f04477fe700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 0x7f043406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:48.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.793+0000 7f04477fe700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 0x7f043406c5a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f044814a110 tx=0x7f043c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:48.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:48.796+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f04380575b0 con 0x7f044806ad70 2023-08-27T11:27:49.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.013+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f044814f860 con 0x7f044806ad70 2023-08-27T11:27:49.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.014+0000 7f0444ff9700 1 -- 172.21.15.43:0/325253100 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18243 (secure 0 0 0) 0x7f043800ce60 con 0x7f044806ad70 2023-08-27T11:27:49.016 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:49.016 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":110,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:27:46.021623+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:27:49.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 msgr2=0x7f043406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 0x7f043406c5a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f044814a110 tx=0x7f043c008040 comp rx=0 tx=0).stop 2023-08-27T11:27:49.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 msgr2=0x7f044814fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f043800e870 tx=0x7f043800ec30 comp rx=0 tx=0).stop 2023-08-27T11:27:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 shutdown_connections 2023-08-27T11:27:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f043406a0e0 0x7f043406c5a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0448151a90 0x7f0448153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f044806ad70 0x7f044814fb60 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.016+0000 7f044e3ff700 1 --2- 172.21.15.43:0/325253100 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04480c4630 0x7f0448153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.017+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 >> 172.21.15.43:0/325253100 conn(0x7f04480ab820 msgr2=0x7f044814d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.017+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 shutdown_connections 2023-08-27T11:27:49.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.017+0000 7f044e3ff700 1 -- 172.21.15.43:0/325253100 wait complete. 2023-08-27T11:27:49.036 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:27:49.037 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:49.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.237+0000 7f99249ff700 1 Processor -- start 2023-08-27T11:27:49.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.237+0000 7f99249ff700 1 -- start start 2023-08-27T11:27:49.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f99249ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f992014e0d0 0x7f99200c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f99249ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f99200c4c40 0x7f99200bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f99249ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200c17f0 con 0x7f99200c45c0 2023-08-27T11:27:49.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f99249ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200c21a0 con 0x7f99200c4c40 2023-08-27T11:27:49.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f99249ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200bc210 con 0x7f992014e0d0 2023-08-27T11:27:49.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f9917fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f99200c4c40 0x7f99200bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f9917fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f99200c4c40 0x7f99200bb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47692/0 (socket says 172.21.15.43:47692) 2023-08-27T11:27:49.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f9917fff700 1 -- 172.21.15.43:0/2374969539 learned_addr learned my addr 172.21.15.43:0/2374969539 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:49.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f991ed9d700 1 --1- 172.21.15.43:0/2374969539 >> v1:172.21.15.43:6789/0 conn(0x7f99200c45c0 0x7f99200bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59890/0 (socket says 172.21.15.43:59890) 2023-08-27T11:27:49.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.239+0000 7f991e59c700 1 --2- 172.21.15.43:0/2374969539 >> v2:172.21.15.57:3300/0 conn(0x7f992014e0d0 0x7f99200c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f9917fff700 1 -- 172.21.15.43:0/2374969539 >> v2:172.21.15.57:3300/0 conn(0x7f992014e0d0 msgr2=0x7f99200c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:49.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f9917fff700 1 --2- 172.21.15.43:0/2374969539 >> v2:172.21.15.57:3300/0 conn(0x7f992014e0d0 0x7f99200c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f9917fff700 1 -- 172.21.15.43:0/2374969539 >> v1:172.21.15.43:6789/0 conn(0x7f99200c45c0 legacy=0x7f99200bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f9917fff700 1 -- 172.21.15.43:0/2374969539 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200c0900 con 0x7f99200c4c40 2023-08-27T11:27:49.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f991dd9b700 1 -- 172.21.15.43:0/2374969539 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517377107 0 0) 0x7f99200c17f0 con 0x7f99200c45c0 2023-08-27T11:27:49.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f9917fff700 1 --2- 172.21.15.43:0/2374969539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c4c40 0x7f99200bb5c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f992006d710 tx=0x7f990800ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c9b7e94d6c1283 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f991dd9b700 1 -- 172.21.15.43:0/2374969539 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800cb30 con 0x7f99200c4c40 2023-08-27T11:27:49.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f991dd9b700 1 -- 172.21.15.43:0/2374969539 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800cc90 con 0x7f99200c4c40 2023-08-27T11:27:49.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.240+0000 7f991dd9b700 1 -- 172.21.15.43:0/2374969539 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9908018400 con 0x7f99200c4c40 2023-08-27T11:27:49.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 -- 172.21.15.43:0/2374969539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c4c40 msgr2=0x7f99200bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 --2- 172.21.15.43:0/2374969539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c4c40 0x7f99200bb5c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f992006d710 tx=0x7f990800ada0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 -- 172.21.15.43:0/2374969539 shutdown_connections 2023-08-27T11:27:49.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 --2- 172.21.15.43:0/2374969539 >> v2:172.21.15.57:3300/0 conn(0x7f992014e0d0 0x7f99200c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 --2- 172.21.15.43:0/2374969539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c4c40 0x7f99200bb5c0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 -- 172.21.15.43:0/2374969539 >> 172.21.15.43:0/2374969539 conn(0x7f992006aa50 msgr2=0x7f99200c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:49.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 -- 172.21.15.43:0/2374969539 shutdown_connections 2023-08-27T11:27:49.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.241+0000 7f99249ff700 1 -- 172.21.15.43:0/2374969539 wait complete. 2023-08-27T11:27:49.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.243+0000 7f99249ff700 1 Processor -- start 2023-08-27T11:27:49.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.243+0000 7f99249ff700 1 -- start start 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99200c4c40 0x7f99200c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f992014e0d0 0x7f99201e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e4f90 con 0x7f99200c45c0 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e5f40 con 0x7f99200c4c40 2023-08-27T11:27:49.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f99249ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99201e5ab0 con 0x7f992014e0d0 2023-08-27T11:27:49.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47702/0 (socket says 172.21.15.43:47702) 2023-08-27T11:27:49.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 -- 172.21.15.43:0/3023283297 learned_addr learned my addr 172.21.15.43:0/3023283297 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:49.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 -- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f992014e0d0 msgr2=0x7f99201e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f992014e0d0 0x7f99201e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 -- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99200c4c40 msgr2=0x7f99200c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99200c4c40 0x7f99200c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.244+0000 7f991e59c700 1 -- 172.21.15.43:0/3023283297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990800a6f0 con 0x7f99200c45c0 2023-08-27T11:27:49.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f991e59c700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f991000e8a0 tx=0x7f991000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910009590 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991000eea0 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000ca50 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992014eef0 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.245+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201e5460 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.246+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99201e5d90 con 0x7f99200c45c0 2023-08-27T11:27:49.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.247+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f991000cbb0 con 0x7f99200c45c0 2023-08-27T11:27:49.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.248+0000 7f9916ffd700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 0x7f990006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.248+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9910088850 con 0x7f99200c45c0 2023-08-27T11:27:49.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.248+0000 7f9917fff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 0x7f990006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.249+0000 7f9917fff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 0x7f990006c5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f99200c50a0 tx=0x7f990801a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.252+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f99100579c0 con 0x7f99200c45c0 2023-08-27T11:27:49.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.458+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99200c0ec0 con 0x7f990006a0e0 2023-08-27T11:27:49.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.469+0000 7f9916ffd700 1 -- 172.21.15.43:0/3023283297 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311811 (secure 0 0 0) 0x7f9908006c60 con 0x7f990006a0e0 2023-08-27T11:27:49.475 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:49.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 msgr2=0x7f990006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 0x7f990006c5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f99200c50a0 tx=0x7f990801a040 comp rx=0 tx=0).stop 2023-08-27T11:27:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 msgr2=0x7f992014e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f991000e8a0 tx=0x7f991000ec60 comp rx=0 tx=0).stop 2023-08-27T11:27:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 shutdown_connections 2023-08-27T11:27:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f990006a0e0 0x7f990006c5a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f992014e0d0 0x7f99201e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99200c45c0 0x7f992014e910 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 --2- 172.21.15.43:0/3023283297 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f99200c4c40 0x7f99200c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 >> 172.21.15.43:0/3023283297 conn(0x7f992006aa50 msgr2=0x7f99200c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:49.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 shutdown_connections 2023-08-27T11:27:49.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.474+0000 7f99249ff700 1 -- 172.21.15.43:0/3023283297 wait complete. 2023-08-27T11:27:49.480 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:49.494 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-08-27T11:27:48.374254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232072,"kb_used_data":11720,"kb_used_omap":13,"kb_used_meta":220210,"kb_avail":754742648,"statfs":{"total":773094113280,"available":772856471552,"internally_reserved":0,"allocated":12001280,"data_stored":6232874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225495128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.394191"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031092+0000","last_change":"2023-08-27T11:27:45.026575+0000","last_active":"2023-08-27T11:27:45.031092+0000","last_peered":"2023-08-27T11:27:45.031092+0000","last_clean":"2023-08-27T11:27:45.031092+0000","last_became_active":"2023-08-27T11:27:45.026229+0000","last_became_peered":"2023-08-27T11:27:45.026229+0000","last_unstale":"2023-08-27T11:27:45.031092+0000","last_undegraded":"2023-08-27T11:27:45.031092+0000","last_fullsized":"2023-08-27T11:27:45.031092+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:34:41.976106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047111+0000","last_change":"2023-08-27T11:27:45.043682+0000","last_active":"2023-08-27T11:27:45.047111+0000","last_peered":"2023-08-27T11:27:45.047111+0000","last_clean":"2023-08-27T11:27:45.047111+0000","last_became_active":"2023-08-27T11:27:45.040495+0000","last_became_peered":"2023-08-27T11:27:45.040495+0000","last_unstale":"2023-08-27T11:27:45.047111+0000","last_undegraded":"2023-08-27T11:27:45.047111+0000","last_fullsized":"2023-08-27T11:27:45.047111+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:22.355760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046855+0000","last_change":"2023-08-27T11:27:45.040690+0000","last_active":"2023-08-27T11:27:45.046855+0000","last_peered":"2023-08-27T11:27:45.046855+0000","last_clean":"2023-08-27T11:27:45.046855+0000","last_became_active":"2023-08-27T11:27:45.040419+0000","last_became_peered":"2023-08-27T11:27:45.040419+0000","last_unstale":"2023-08-27T11:27:45.046855+0000","last_undegraded":"2023-08-27T11:27:45.046855+0000","last_fullsized":"2023-08-27T11:27:45.046855+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:25.195798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031463+0000","last_change":"2023-08-27T11:27:45.023720+0000","last_active":"2023-08-27T11:27:45.031463+0000","last_peered":"2023-08-27T11:27:45.031463+0000","last_clean":"2023-08-27T11:27:45.031463+0000","last_became_active":"2023-08-27T11:27:45.023373+0000","last_became_peered":"2023-08-27T11:27:45.023373+0000","last_unstale":"2023-08-27T11:27:45.031463+0000","last_undegraded":"2023-08-27T11:27:45.031463+0000","last_fullsized":"2023-08-27T11:27:45.031463+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:35:07.482657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040079+0000","last_change":"2023-08-27T11:27:45.035739+0000","last_active":"2023-08-27T11:27:45.040079+0000","last_peered":"2023-08-27T11:27:45.040079+0000","last_clean":"2023-08-27T11:27:45.040079+0000","last_became_active":"2023-08-27T11:27:45.035384+0000","last_became_peered":"2023-08-27T11:27:45.035384+0000","last_unstale":"2023-08-27T11:27:45.040079+0000","last_undegraded":"2023-08-27T11:27:45.040079+0000","last_fullsized":"2023-08-27T11:27:45.040079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:57.494271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.049252+0000","last_change":"2023-08-27T11:27:45.048133+0000","last_active":"2023-08-27T11:27:45.049252+0000","last_peered":"2023-08-27T11:27:45.049252+0000","last_clean":"2023-08-27T11:27:45.049252+0000","last_became_active":"2023-08-27T11:27:45.047824+0000","last_became_peered":"2023-08-27T11:27:45.047824+0000","last_unstale":"2023-08-27T11:27:45.049252+0000","last_undegraded":"2023-08-27T11:27:45.049252+0000","last_fullsized":"2023-08-27T11:27:45.049252+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:39:15.652334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031920+0000","last_change":"2023-08-27T11:27:45.028552+0000","last_active":"2023-08-27T11:27:45.031920+0000","last_peered":"2023-08-27T11:27:45.031920+0000","last_clean":"2023-08-27T11:27:45.031920+0000","last_became_active":"2023-08-27T11:27:45.027383+0000","last_became_peered":"2023-08-27T11:27:45.027383+0000","last_unstale":"2023-08-27T11:27:45.031920+0000","last_undegraded":"2023-08-27T11:27:45.031920+0000","last_fullsized":"2023-08-27T11:27:45.031920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:06.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050811+0000","last_change":"2023-08-27T11:27:45.049508+0000","last_active":"2023-08-27T11:27:45.050811+0000","last_peered":"2023-08-27T11:27:45.050811+0000","last_clean":"2023-08-27T11:27:45.050811+0000","last_became_active":"2023-08-27T11:27:45.048935+0000","last_became_peered":"2023-08-27T11:27:45.048935+0000","last_unstale":"2023-08-27T11:27:45.050811+0000","last_undegraded":"2023-08-27T11:27:45.050811+0000","last_fullsized":"2023-08-27T11:27:45.050811+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:23.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.045649+0000","last_change":"2023-08-27T11:27:45.044233+0000","last_active":"2023-08-27T11:27:45.045649+0000","last_peered":"2023-08-27T11:27:45.045649+0000","last_clean":"2023-08-27T11:27:45.045649+0000","last_became_active":"2023-08-27T11:27:45.043927+0000","last_became_peered":"2023-08-27T11:27:45.043927+0000","last_unstale":"2023-08-27T11:27:45.045649+0000","last_undegraded":"2023-08-27T11:27:45.045649+0000","last_fullsized":"2023-08-27T11:27:45.045649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:21:28.545403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038120+0000","last_change":"2023-08-27T11:27:45.036544+0000","last_active":"2023-08-27T11:27:45.038120+0000","last_peered":"2023-08-27T11:27:45.038120+0000","last_clean":"2023-08-27T11:27:45.038120+0000","last_became_active":"2023-08-27T11:27:45.036262+0000","last_became_peered":"2023-08-27T11:27:45.036262+0000","last_unstale":"2023-08-27T11:27:45.038120+0000","last_undegraded":"2023-08-27T11:27:45.038120+0000","last_fullsized":"2023-08-27T11:27:45.038120+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:10.495482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031764+0000","last_change":"2023-08-27T11:27:45.026675+0000","last_active":"2023-08-27T11:27:45.031764+0000","last_peered":"2023-08-27T11:27:45.031764+0000","last_clean":"2023-08-27T11:27:45.031764+0000","last_became_active":"2023-08-27T11:27:45.026278+0000","last_became_peered":"2023-08-27T11:27:45.026278+0000","last_unstale":"2023-08-27T11:27:45.031764+0000","last_undegraded":"2023-08-27T11:27:45.031764+0000","last_fullsized":"2023-08-27T11:27:45.031764+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:10.778317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042532+0000","last_change":"2023-08-27T11:27:45.031085+0000","last_active":"2023-08-27T11:27:45.042532+0000","last_peered":"2023-08-27T11:27:45.042532+0000","last_clean":"2023-08-27T11:27:45.042532+0000","last_became_active":"2023-08-27T11:27:45.030399+0000","last_became_peered":"2023-08-27T11:27:45.030399+0000","last_unstale":"2023-08-27T11:27:45.042532+0000","last_undegraded":"2023-08-27T11:27:45.042532+0000","last_fullsized":"2023-08-27T11:27:45.042532+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:51.120836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031482+0000","last_change":"2023-08-27T11:27:45.028898+0000","last_active":"2023-08-27T11:27:45.031482+0000","last_peered":"2023-08-27T11:27:45.031482+0000","last_clean":"2023-08-27T11:27:45.031482+0000","last_became_active":"2023-08-27T11:27:45.028616+0000","last_became_peered":"2023-08-27T11:27:45.028616+0000","last_unstale":"2023-08-27T11:27:45.031482+0000","last_undegraded":"2023-08-27T11:27:45.031482+0000","last_fullsized":"2023-08-27T11:27:45.031482+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:07:43.551331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048620+0000","last_change":"2023-08-27T11:27:45.047384+0000","last_active":"2023-08-27T11:27:45.048620+0000","last_peered":"2023-08-27T11:27:45.048620+0000","last_clean":"2023-08-27T11:27:45.048620+0000","last_became_active":"2023-08-27T11:27:45.046774+0000","last_became_peered":"2023-08-27T11:27:45.046774+0000","last_unstale":"2023-08-27T11:27:45.048620+0000","last_undegraded":"2023-08-27T11:27:45.048620+0000","last_fullsized":"2023-08-27T11:27:45.048620+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:57.494271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031034+0000","last_change":"2023-08-27T11:27:45.023377+0000","last_active":"2023-08-27T11:27:45.031034+0000","last_peered":"2023-08-27T11:27:45.031034+0000","last_clean":"2023-08-27T11:27:45.031034+0000","last_became_active":"2023-08-27T11:27:45.023092+0000","last_became_peered":"2023-08-27T11:27:45.023092+0000","last_unstale":"2023-08-27T11:27:45.031034+0000","last_undegraded":"2023-08-27T11:27:45.031034+0000","last_fullsized":"2023-08-27T11:27:45.031034+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:23.238831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042600+0000","last_change":"2023-08-27T11:27:45.032716+0000","last_active":"2023-08-27T11:27:45.042600+0000","last_peered":"2023-08-27T11:27:45.042600+0000","last_clean":"2023-08-27T11:27:45.042600+0000","last_became_active":"2023-08-27T11:27:45.032440+0000","last_became_peered":"2023-08-27T11:27:45.032440+0000","last_unstale":"2023-08-27T11:27:45.042600+0000","last_undegraded":"2023-08-27T11:27:45.042600+0000","last_fullsized":"2023-08-27T11:27:45.042600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:04:52.395285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031605+0000","last_change":"2023-08-27T11:27:45.029100+0000","last_active":"2023-08-27T11:27:45.031605+0000","last_peered":"2023-08-27T11:27:45.031605+0000","last_clean":"2023-08-27T11:27:45.031605+0000","last_became_active":"2023-08-27T11:27:45.028830+0000","last_became_peered":"2023-08-27T11:27:45.028830+0000","last_unstale":"2023-08-27T11:27:45.031605+0000","last_undegraded":"2023-08-27T11:27:45.031605+0000","last_fullsized":"2023-08-27T11:27:45.031605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:24.814912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046003+0000","last_change":"2023-08-27T11:27:45.040805+0000","last_active":"2023-08-27T11:27:45.046003+0000","last_peered":"2023-08-27T11:27:45.046003+0000","last_clean":"2023-08-27T11:27:45.046003+0000","last_became_active":"2023-08-27T11:27:45.035484+0000","last_became_peered":"2023-08-27T11:27:45.035484+0000","last_unstale":"2023-08-27T11:27:45.046003+0000","last_undegraded":"2023-08-27T11:27:45.046003+0000","last_fullsized":"2023-08-27T11:27:45.046003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:59:01.874912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035010+0000","last_change":"2023-08-27T11:27:45.028545+0000","last_active":"2023-08-27T11:27:45.035010+0000","last_peered":"2023-08-27T11:27:45.035010+0000","last_clean":"2023-08-27T11:27:45.035010+0000","last_became_active":"2023-08-27T11:27:45.027711+0000","last_became_peered":"2023-08-27T11:27:45.027711+0000","last_unstale":"2023-08-27T11:27:45.035010+0000","last_undegraded":"2023-08-27T11:27:45.035010+0000","last_fullsized":"2023-08-27T11:27:45.035010+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:51.595009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038690+0000","last_change":"2023-08-27T11:27:45.032816+0000","last_active":"2023-08-27T11:27:45.038690+0000","last_peered":"2023-08-27T11:27:45.038690+0000","last_clean":"2023-08-27T11:27:45.038690+0000","last_became_active":"2023-08-27T11:27:45.032511+0000","last_became_peered":"2023-08-27T11:27:45.032511+0000","last_unstale":"2023-08-27T11:27:45.038690+0000","last_undegraded":"2023-08-27T11:27:45.038690+0000","last_fullsized":"2023-08-27T11:27:45.038690+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:55:44.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038421+0000","last_change":"2023-08-27T11:27:45.029829+0000","last_active":"2023-08-27T11:27:45.038421+0000","last_peered":"2023-08-27T11:27:45.038421+0000","last_clean":"2023-08-27T11:27:45.038421+0000","last_became_active":"2023-08-27T11:27:45.029179+0000","last_became_peered":"2023-08-27T11:27:45.029179+0000","last_unstale":"2023-08-27T11:27:45.038421+0000","last_undegraded":"2023-08-27T11:27:45.038421+0000","last_fullsized":"2023-08-27T11:27:45.038421+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:53.671384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051200+0000","last_change":"2023-08-27T11:27:45.049985+0000","last_active":"2023-08-27T11:27:45.051200+0000","last_peered":"2023-08-27T11:27:45.051200+0000","last_clean":"2023-08-27T11:27:45.051200+0000","last_became_active":"2023-08-27T11:27:45.049341+0000","last_became_peered":"2023-08-27T11:27:45.049341+0000","last_unstale":"2023-08-27T11:27:45.051200+0000","last_undegraded":"2023-08-27T11:27:45.051200+0000","last_fullsized":"2023-08-27T11:27:45.051200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:27:23.988483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051002+0000","last_change":"2023-08-27T11:27:45.050143+0000","last_active":"2023-08-27T11:27:45.051002+0000","last_peered":"2023-08-27T11:27:45.051002+0000","last_clean":"2023-08-27T11:27:45.051002+0000","last_became_active":"2023-08-27T11:27:45.049817+0000","last_became_peered":"2023-08-27T11:27:45.049817+0000","last_unstale":"2023-08-27T11:27:45.051002+0000","last_undegraded":"2023-08-27T11:27:45.051002+0000","last_fullsized":"2023-08-27T11:27:45.051002+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:34:35.674806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039855+0000","last_change":"2023-08-27T11:27:45.035123+0000","last_active":"2023-08-27T11:27:45.039855+0000","last_peered":"2023-08-27T11:27:45.039855+0000","last_clean":"2023-08-27T11:27:45.039855+0000","last_became_active":"2023-08-27T11:27:45.034451+0000","last_became_peered":"2023-08-27T11:27:45.034451+0000","last_unstale":"2023-08-27T11:27:45.039855+0000","last_undegraded":"2023-08-27T11:27:45.039855+0000","last_fullsized":"2023-08-27T11:27:45.039855+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:50:11.269333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030575+0000","last_change":"2023-08-27T11:27:45.022520+0000","last_active":"2023-08-27T11:27:45.030575+0000","last_peered":"2023-08-27T11:27:45.030575+0000","last_clean":"2023-08-27T11:27:45.030575+0000","last_became_active":"2023-08-27T11:27:45.022217+0000","last_became_peered":"2023-08-27T11:27:45.022217+0000","last_unstale":"2023-08-27T11:27:45.030575+0000","last_undegraded":"2023-08-27T11:27:45.030575+0000","last_fullsized":"2023-08-27T11:27:45.030575+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:31.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029605+0000","last_change":"2023-08-27T11:27:45.026399+0000","last_active":"2023-08-27T11:27:45.029605+0000","last_peered":"2023-08-27T11:27:45.029605+0000","last_clean":"2023-08-27T11:27:45.029605+0000","last_became_active":"2023-08-27T11:27:45.025844+0000","last_became_peered":"2023-08-27T11:27:45.025844+0000","last_unstale":"2023-08-27T11:27:45.029605+0000","last_undegraded":"2023-08-27T11:27:45.029605+0000","last_fullsized":"2023-08-27T11:27:45.029605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:33:59.856885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035030+0000","last_change":"2023-08-27T11:27:45.028925+0000","last_active":"2023-08-27T11:27:45.035030+0000","last_peered":"2023-08-27T11:27:45.035030+0000","last_clean":"2023-08-27T11:27:45.035030+0000","last_became_active":"2023-08-27T11:27:45.028155+0000","last_became_peered":"2023-08-27T11:27:45.028155+0000","last_unstale":"2023-08-27T11:27:45.035030+0000","last_undegraded":"2023-08-27T11:27:45.035030+0000","last_fullsized":"2023-08-27T11:27:45.035030+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:31.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042720+0000","last_change":"2023-08-27T11:27:45.036792+0000","last_active":"2023-08-27T11:27:45.042720+0000","last_peered":"2023-08-27T11:27:45.042720+0000","last_clean":"2023-08-27T11:27:45.042720+0000","last_became_active":"2023-08-27T11:27:45.036412+0000","last_became_peered":"2023-08-27T11:27:45.036412+0000","last_unstale":"2023-08-27T11:27:45.042720+0000","last_undegraded":"2023-08-27T11:27:45.042720+0000","last_fullsized":"2023-08-27T11:27:45.042720+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:37.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029678+0000","last_change":"2023-08-27T11:27:45.027199+0000","last_active":"2023-08-27T11:27:45.029678+0000","last_peered":"2023-08-27T11:27:45.029678+0000","last_clean":"2023-08-27T11:27:45.029678+0000","last_became_active":"2023-08-27T11:27:45.024130+0000","last_became_peered":"2023-08-27T11:27:45.024130+0000","last_unstale":"2023-08-27T11:27:45.029678+0000","last_undegraded":"2023-08-27T11:27:45.029678+0000","last_fullsized":"2023-08-27T11:27:45.029678+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:36:44.566241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048599+0000","last_change":"2023-08-27T11:27:45.047152+0000","last_active":"2023-08-27T11:27:45.048599+0000","last_peered":"2023-08-27T11:27:45.048599+0000","last_clean":"2023-08-27T11:27:45.048599+0000","last_became_active":"2023-08-27T11:27:45.046746+0000","last_became_peered":"2023-08-27T11:27:45.046746+0000","last_unstale":"2023-08-27T11:27:45.048599+0000","last_undegraded":"2023-08-27T11:27:45.048599+0000","last_fullsized":"2023-08-27T11:27:45.048599+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:47.831341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033496+0000","last_change":"2023-08-27T11:27:45.029737+0000","last_active":"2023-08-27T11:27:45.033496+0000","last_peered":"2023-08-27T11:27:45.033496+0000","last_clean":"2023-08-27T11:27:45.033496+0000","last_became_active":"2023-08-27T11:27:45.029418+0000","last_became_peered":"2023-08-27T11:27:45.029418+0000","last_unstale":"2023-08-27T11:27:45.033496+0000","last_undegraded":"2023-08-27T11:27:45.033496+0000","last_fullsized":"2023-08-27T11:27:45.033496+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:31.708382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039381+0000","last_change":"2023-08-27T11:27:45.034816+0000","last_active":"2023-08-27T11:27:45.039381+0000","last_peered":"2023-08-27T11:27:45.039381+0000","last_clean":"2023-08-27T11:27:45.039381+0000","last_became_active":"2023-08-27T11:27:45.034043+0000","last_became_peered":"2023-08-27T11:27:45.034043+0000","last_unstale":"2023-08-27T11:27:45.039381+0000","last_undegraded":"2023-08-27T11:27:45.039381+0000","last_fullsized":"2023-08-27T11:27:45.039381+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:10.495482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040590+0000","last_change":"2023-08-27T11:27:45.038565+0000","last_active":"2023-08-27T11:27:45.040590+0000","last_peered":"2023-08-27T11:27:45.040590+0000","last_clean":"2023-08-27T11:27:45.040590+0000","last_became_active":"2023-08-27T11:27:45.038272+0000","last_became_peered":"2023-08-27T11:27:45.038272+0000","last_unstale":"2023-08-27T11:27:45.040590+0000","last_undegraded":"2023-08-27T11:27:45.040590+0000","last_fullsized":"2023-08-27T11:27:45.040590+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:05.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"109'4","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038713+0000","last_change":"2023-08-27T11:27:44.007422+0000","last_active":"2023-08-27T11:27:45.038713+0000","last_peered":"2023-08-27T11:27:45.038713+0000","last_clean":"2023-08-27T11:27:45.038713+0000","last_became_active":"2023-08-27T11:27:44.006689+0000","last_became_peered":"2023-08-27T11:27:44.006689+0000","last_unstale":"2023-08-27T11:27:45.038713+0000","last_undegraded":"2023-08-27T11:27:45.038713+0000","last_fullsized":"2023-08-27T11:27:45.038713+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:55.915984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046544+0000","last_change":"2023-08-27T11:27:45.045468+0000","last_active":"2023-08-27T11:27:45.046544+0000","last_peered":"2023-08-27T11:27:45.046544+0000","last_clean":"2023-08-27T11:27:45.046544+0000","last_became_active":"2023-08-27T11:27:45.045161+0000","last_became_peered":"2023-08-27T11:27:45.045161+0000","last_unstale":"2023-08-27T11:27:45.046544+0000","last_undegraded":"2023-08-27T11:27:45.046544+0000","last_fullsized":"2023-08-27T11:27:45.046544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:50.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029438+0000","last_change":"2023-08-27T11:27:44.007038+0000","last_active":"2023-08-27T11:27:45.029438+0000","last_peered":"2023-08-27T11:27:45.029438+0000","last_clean":"2023-08-27T11:27:45.029438+0000","last_became_active":"2023-08-27T11:27:44.006712+0000","last_became_peered":"2023-08-27T11:27:44.006712+0000","last_unstale":"2023-08-27T11:27:45.029438+0000","last_undegraded":"2023-08-27T11:27:45.029438+0000","last_fullsized":"2023-08-27T11:27:45.029438+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:50:10.264861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039872+0000","last_change":"2023-08-27T11:27:45.035057+0000","last_active":"2023-08-27T11:27:45.039872+0000","last_peered":"2023-08-27T11:27:45.039872+0000","last_clean":"2023-08-27T11:27:45.039872+0000","last_became_active":"2023-08-27T11:27:45.034668+0000","last_became_peered":"2023-08-27T11:27:45.034668+0000","last_unstale":"2023-08-27T11:27:45.039872+0000","last_undegraded":"2023-08-27T11:27:45.039872+0000","last_fullsized":"2023-08-27T11:27:45.039872+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:24.075714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032708+0000","last_change":"2023-08-27T11:27:44.007848+0000","last_active":"2023-08-27T11:27:45.032708+0000","last_peered":"2023-08-27T11:27:45.032708+0000","last_clean":"2023-08-27T11:27:45.032708+0000","last_became_active":"2023-08-27T11:27:44.007529+0000","last_became_peered":"2023-08-27T11:27:44.007529+0000","last_unstale":"2023-08-27T11:27:45.032708+0000","last_undegraded":"2023-08-27T11:27:45.032708+0000","last_fullsized":"2023-08-27T11:27:45.032708+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:42.432850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038346+0000","last_change":"2023-08-27T11:27:45.030412+0000","last_active":"2023-08-27T11:27:45.038346+0000","last_peered":"2023-08-27T11:27:45.038346+0000","last_clean":"2023-08-27T11:27:45.038346+0000","last_became_active":"2023-08-27T11:27:45.030147+0000","last_became_peered":"2023-08-27T11:27:45.030147+0000","last_unstale":"2023-08-27T11:27:45.038346+0000","last_undegraded":"2023-08-27T11:27:45.038346+0000","last_fullsized":"2023-08-27T11:27:45.038346+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:07:11.182991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.044825+0000","last_change":"2023-08-27T11:27:44.011852+0000","last_active":"2023-08-27T11:27:45.044825+0000","last_peered":"2023-08-27T11:27:45.044825+0000","last_clean":"2023-08-27T11:27:45.044825+0000","last_became_active":"2023-08-27T11:27:44.011563+0000","last_became_peered":"2023-08-27T11:27:44.011563+0000","last_unstale":"2023-08-27T11:27:45.044825+0000","last_undegraded":"2023-08-27T11:27:45.044825+0000","last_fullsized":"2023-08-27T11:27:45.044825+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:47:36.826412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039982+0000","last_change":"2023-08-27T11:27:45.036889+0000","last_active":"2023-08-27T11:27:45.039982+0000","last_peered":"2023-08-27T11:27:45.039982+0000","last_clean":"2023-08-27T11:27:45.039982+0000","last_became_active":"2023-08-27T11:27:45.036620+0000","last_became_peered":"2023-08-27T11:27:45.036620+0000","last_unstale":"2023-08-27T11:27:45.039982+0000","last_undegraded":"2023-08-27T11:27:45.039982+0000","last_fullsized":"2023-08-27T11:27:45.039982+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:05.730153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031027+0000","last_change":"2023-08-27T11:27:44.005219+0000","last_active":"2023-08-27T11:27:45.031027+0000","last_peered":"2023-08-27T11:27:45.031027+0000","last_clean":"2023-08-27T11:27:45.031027+0000","last_became_active":"2023-08-27T11:27:44.004928+0000","last_became_peered":"2023-08-27T11:27:44.004928+0000","last_unstale":"2023-08-27T11:27:45.031027+0000","last_undegraded":"2023-08-27T11:27:45.031027+0000","last_fullsized":"2023-08-27T11:27:45.031027+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:15.722279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031059+0000","last_change":"2023-08-27T11:27:45.023988+0000","last_active":"2023-08-27T11:27:45.031059+0000","last_peered":"2023-08-27T11:27:45.031059+0000","last_clean":"2023-08-27T11:27:45.031059+0000","last_became_active":"2023-08-27T11:27:45.023673+0000","last_became_peered":"2023-08-27T11:27:45.023673+0000","last_unstale":"2023-08-27T11:27:45.031059+0000","last_undegraded":"2023-08-27T11:27:45.031059+0000","last_fullsized":"2023-08-27T11:27:45.031059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:54.636629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047568+0000","last_change":"2023-08-27T11:27:44.005378+0000","last_active":"2023-08-27T11:27:45.047568+0000","last_peered":"2023-08-27T11:27:45.047568+0000","last_clean":"2023-08-27T11:27:45.047568+0000","last_became_active":"2023-08-27T11:27:44.005103+0000","last_became_peered":"2023-08-27T11:27:44.005103+0000","last_unstale":"2023-08-27T11:27:45.047568+0000","last_undegraded":"2023-08-27T11:27:45.047568+0000","last_fullsized":"2023-08-27T11:27:45.047568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:27.456736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047228+0000","last_change":"2023-08-27T11:27:45.041000+0000","last_active":"2023-08-27T11:27:45.047228+0000","last_peered":"2023-08-27T11:27:45.047228+0000","last_clean":"2023-08-27T11:27:45.047228+0000","last_became_active":"2023-08-27T11:27:45.035181+0000","last_became_peered":"2023-08-27T11:27:45.035181+0000","last_unstale":"2023-08-27T11:27:45.047228+0000","last_undegraded":"2023-08-27T11:27:45.047228+0000","last_fullsized":"2023-08-27T11:27:45.047228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:54.041302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013850+0000","last_change":"2023-08-27T11:27:44.005290+0000","last_active":"2023-08-27T11:27:45.013850+0000","last_peered":"2023-08-27T11:27:45.013850+0000","last_clean":"2023-08-27T11:27:45.013850+0000","last_became_active":"2023-08-27T11:27:44.004856+0000","last_became_peered":"2023-08-27T11:27:44.004856+0000","last_unstale":"2023-08-27T11:27:45.013850+0000","last_undegraded":"2023-08-27T11:27:45.013850+0000","last_fullsized":"2023-08-27T11:27:45.013850+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:32.419381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046297+0000","last_change":"2023-08-27T11:27:45.045166+0000","last_active":"2023-08-27T11:27:45.046297+0000","last_peered":"2023-08-27T11:27:45.046297+0000","last_clean":"2023-08-27T11:27:45.046297+0000","last_became_active":"2023-08-27T11:27:45.044842+0000","last_became_peered":"2023-08-27T11:27:45.044842+0000","last_unstale":"2023-08-27T11:27:45.046297+0000","last_undegraded":"2023-08-27T11:27:45.046297+0000","last_fullsized":"2023-08-27T11:27:45.046297+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:05.916888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026779+0000","last_change":"2023-08-27T11:27:44.012469+0000","last_active":"2023-08-27T11:27:45.026779+0000","last_peered":"2023-08-27T11:27:45.026779+0000","last_clean":"2023-08-27T11:27:45.026779+0000","last_became_active":"2023-08-27T11:27:44.012188+0000","last_became_peered":"2023-08-27T11:27:44.012188+0000","last_unstale":"2023-08-27T11:27:45.026779+0000","last_undegraded":"2023-08-27T11:27:45.026779+0000","last_fullsized":"2023-08-27T11:27:45.026779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:04.968352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039892+0000","last_change":"2023-08-27T11:27:45.036431+0000","last_active":"2023-08-27T11:27:45.039892+0000","last_peered":"2023-08-27T11:27:45.039892+0000","last_clean":"2023-08-27T11:27:45.039892+0000","last_became_active":"2023-08-27T11:27:45.034565+0000","last_became_peered":"2023-08-27T11:27:45.034565+0000","last_unstale":"2023-08-27T11:27:45.039892+0000","last_undegraded":"2023-08-27T11:27:45.039892+0000","last_fullsized":"2023-08-27T11:27:45.039892+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:56.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029721+0000","last_change":"2023-08-27T11:27:44.010841+0000","last_active":"2023-08-27T11:27:45.029721+0000","last_peered":"2023-08-27T11:27:45.029721+0000","last_clean":"2023-08-27T11:27:45.029721+0000","last_became_active":"2023-08-27T11:27:44.010536+0000","last_became_peered":"2023-08-27T11:27:44.010536+0000","last_unstale":"2023-08-27T11:27:45.029721+0000","last_undegraded":"2023-08-27T11:27:45.029721+0000","last_fullsized":"2023-08-27T11:27:45.029721+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:01.756461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042920+0000","last_change":"2023-08-27T11:27:45.042008+0000","last_active":"2023-08-27T11:27:45.042920+0000","last_peered":"2023-08-27T11:27:45.042920+0000","last_clean":"2023-08-27T11:27:45.042920+0000","last_became_active":"2023-08-27T11:27:45.041614+0000","last_became_peered":"2023-08-27T11:27:45.041614+0000","last_unstale":"2023-08-27T11:27:45.042920+0000","last_undegraded":"2023-08-27T11:27:45.042920+0000","last_fullsized":"2023-08-27T11:27:45.042920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:47.222790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032616+0000","last_change":"2023-08-27T11:27:44.011250+0000","last_active":"2023-08-27T11:27:45.032616+0000","last_peered":"2023-08-27T11:27:45.032616+0000","last_clean":"2023-08-27T11:27:45.032616+0000","last_became_active":"2023-08-27T11:27:44.010875+0000","last_became_peered":"2023-08-27T11:27:44.010875+0000","last_unstale":"2023-08-27T11:27:45.032616+0000","last_undegraded":"2023-08-27T11:27:45.032616+0000","last_fullsized":"2023-08-27T11:27:45.032616+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:49:59.614612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042614+0000","last_change":"2023-08-27T11:27:45.035654+0000","last_active":"2023-08-27T11:27:45.042614+0000","last_peered":"2023-08-27T11:27:45.042614+0000","last_clean":"2023-08-27T11:27:45.042614+0000","last_became_active":"2023-08-27T11:27:45.035381+0000","last_became_peered":"2023-08-27T11:27:45.035381+0000","last_unstale":"2023-08-27T11:27:45.042614+0000","last_undegraded":"2023-08-27T11:27:45.042614+0000","last_fullsized":"2023-08-27T11:27:45.042614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:05.268776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032853+0000","last_change":"2023-08-27T11:27:44.007463+0000","last_active":"2023-08-27T11:27:45.032853+0000","last_peered":"2023-08-27T11:27:45.032853+0000","last_clean":"2023-08-27T11:27:45.032853+0000","last_became_active":"2023-08-27T11:27:44.007075+0000","last_became_peered":"2023-08-27T11:27:44.007075+0000","last_unstale":"2023-08-27T11:27:45.032853+0000","last_undegraded":"2023-08-27T11:27:45.032853+0000","last_fullsized":"2023-08-27T11:27:45.032853+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:04:09.312895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030592+0000","last_change":"2023-08-27T11:27:45.025235+0000","last_active":"2023-08-27T11:27:45.030592+0000","last_peered":"2023-08-27T11:27:45.030592+0000","last_clean":"2023-08-27T11:27:45.030592+0000","last_became_active":"2023-08-27T11:27:45.024921+0000","last_became_peered":"2023-08-27T11:27:45.024921+0000","last_unstale":"2023-08-27T11:27:45.030592+0000","last_undegraded":"2023-08-27T11:27:45.030592+0000","last_fullsized":"2023-08-27T11:27:45.030592+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:47:37.830884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016481+0000","last_change":"2023-08-27T11:27:44.010804+0000","last_active":"2023-08-27T11:27:45.016481+0000","last_peered":"2023-08-27T11:27:45.016481+0000","last_clean":"2023-08-27T11:27:45.016481+0000","last_became_active":"2023-08-27T11:27:44.010517+0000","last_became_peered":"2023-08-27T11:27:44.010517+0000","last_unstale":"2023-08-27T11:27:45.016481+0000","last_undegraded":"2023-08-27T11:27:45.016481+0000","last_fullsized":"2023-08-27T11:27:45.016481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:40:22.018004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042661+0000","last_change":"2023-08-27T11:27:45.035923+0000","last_active":"2023-08-27T11:27:45.042661+0000","last_peered":"2023-08-27T11:27:45.042661+0000","last_clean":"2023-08-27T11:27:45.042661+0000","last_became_active":"2023-08-27T11:27:45.035654+0000","last_became_peered":"2023-08-27T11:27:45.035654+0000","last_unstale":"2023-08-27T11:27:45.042661+0000","last_undegraded":"2023-08-27T11:27:45.042661+0000","last_fullsized":"2023-08-27T11:27:45.042661+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:59.352697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029030+0000","last_change":"2023-08-27T11:27:44.011802+0000","last_active":"2023-08-27T11:27:45.029030+0000","last_peered":"2023-08-27T11:27:45.029030+0000","last_clean":"2023-08-27T11:27:45.029030+0000","last_became_active":"2023-08-27T11:27:44.011487+0000","last_became_peered":"2023-08-27T11:27:44.011487+0000","last_unstale":"2023-08-27T11:27:45.029030+0000","last_undegraded":"2023-08-27T11:27:45.029030+0000","last_fullsized":"2023-08-27T11:27:45.029030+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:39:58.033476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050120+0000","last_change":"2023-08-27T11:27:45.048635+0000","last_active":"2023-08-27T11:27:45.050120+0000","last_peered":"2023-08-27T11:27:45.050120+0000","last_clean":"2023-08-27T11:27:45.050120+0000","last_became_active":"2023-08-27T11:27:45.044063+0000","last_became_peered":"2023-08-27T11:27:45.044063+0000","last_unstale":"2023-08-27T11:27:45.050120+0000","last_undegraded":"2023-08-27T11:27:45.050120+0000","last_fullsized":"2023-08-27T11:27:45.050120+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:34:59.943383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016799+0000","last_change":"2023-08-27T11:27:44.006396+0000","last_active":"2023-08-27T11:27:45.016799+0000","last_peered":"2023-08-27T11:27:45.016799+0000","last_clean":"2023-08-27T11:27:45.016799+0000","last_became_active":"2023-08-27T11:27:44.006099+0000","last_became_peered":"2023-08-27T11:27:44.006099+0000","last_unstale":"2023-08-27T11:27:45.016799+0000","last_undegraded":"2023-08-27T11:27:45.016799+0000","last_fullsized":"2023-08-27T11:27:45.016799+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:10:28.705020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047251+0000","last_change":"2023-08-27T11:27:45.041054+0000","last_active":"2023-08-27T11:27:45.047251+0000","last_peered":"2023-08-27T11:27:45.047251+0000","last_clean":"2023-08-27T11:27:45.047251+0000","last_became_active":"2023-08-27T11:27:45.035587+0000","last_became_peered":"2023-08-27T11:27:45.035587+0000","last_unstale":"2023-08-27T11:27:45.047251+0000","last_undegraded":"2023-08-27T11:27:45.047251+0000","last_fullsized":"2023-08-27T11:27:45.047251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:18.733835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.023848+0000","last_change":"2023-08-27T11:27:44.007427+0000","last_active":"2023-08-27T11:27:45.023848+0000","last_peered":"2023-08-27T11:27:45.023848+0000","last_clean":"2023-08-27T11:27:45.023848+0000","last_became_active":"2023-08-27T11:27:44.007131+0000","last_became_peered":"2023-08-27T11:27:44.007131+0000","last_unstale":"2023-08-27T11:27:45.023848+0000","last_undegraded":"2023-08-27T11:27:45.023848+0000","last_fullsized":"2023-08-27T11:27:45.023848+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:27.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033407+0000","last_change":"2023-08-27T11:27:45.030283+0000","last_active":"2023-08-27T11:27:45.033407+0000","last_peered":"2023-08-27T11:27:45.033407+0000","last_clean":"2023-08-27T11:27:45.033407+0000","last_became_active":"2023-08-27T11:27:45.029967+0000","last_became_peered":"2023-08-27T11:27:45.029967+0000","last_unstale":"2023-08-27T11:27:45.033407+0000","last_undegraded":"2023-08-27T11:27:45.033407+0000","last_fullsized":"2023-08-27T11:27:45.033407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:02.760933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.015586+0000","last_change":"2023-08-27T11:27:44.007332+0000","last_active":"2023-08-27T11:27:45.015586+0000","last_peered":"2023-08-27T11:27:45.015586+0000","last_clean":"2023-08-27T11:27:45.015586+0000","last_became_active":"2023-08-27T11:27:44.006951+0000","last_became_peered":"2023-08-27T11:27:44.006951+0000","last_unstale":"2023-08-27T11:27:45.015586+0000","last_undegraded":"2023-08-27T11:27:45.015586+0000","last_fullsized":"2023-08-27T11:27:45.015586+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:13.862168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042557+0000","last_change":"2023-08-27T11:27:45.031306+0000","last_active":"2023-08-27T11:27:45.042557+0000","last_peered":"2023-08-27T11:27:45.042557+0000","last_clean":"2023-08-27T11:27:45.042557+0000","last_became_active":"2023-08-27T11:27:45.030726+0000","last_became_peered":"2023-08-27T11:27:45.030726+0000","last_unstale":"2023-08-27T11:27:45.042557+0000","last_undegraded":"2023-08-27T11:27:45.042557+0000","last_fullsized":"2023-08-27T11:27:45.042557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:08.068596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.028960+0000","last_change":"2023-08-27T11:27:44.005387+0000","last_active":"2023-08-27T11:27:45.028960+0000","last_peered":"2023-08-27T11:27:45.028960+0000","last_clean":"2023-08-27T11:27:45.028960+0000","last_became_active":"2023-08-27T11:27:44.005014+0000","last_became_peered":"2023-08-27T11:27:44.005014+0000","last_unstale":"2023-08-27T11:27:45.028960+0000","last_undegraded":"2023-08-27T11:27:45.028960+0000","last_fullsized":"2023-08-27T11:27:45.028960+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:58:40.980814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040051+0000","last_change":"2023-08-27T11:27:45.037380+0000","last_active":"2023-08-27T11:27:45.040051+0000","last_peered":"2023-08-27T11:27:45.040051+0000","last_clean":"2023-08-27T11:27:45.040051+0000","last_became_active":"2023-08-27T11:27:45.037180+0000","last_became_peered":"2023-08-27T11:27:45.037180+0000","last_unstale":"2023-08-27T11:27:45.040051+0000","last_undegraded":"2023-08-27T11:27:45.040051+0000","last_fullsized":"2023-08-27T11:27:45.040051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:35:34.814839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.009511+0000","last_change":"2023-08-27T11:27:44.009559+0000","last_active":"2023-08-27T11:27:45.009511+0000","last_peered":"2023-08-27T11:27:45.009511+0000","last_clean":"2023-08-27T11:27:45.009511+0000","last_became_active":"2023-08-27T11:27:44.009156+0000","last_became_peered":"2023-08-27T11:27:44.009156+0000","last_unstale":"2023-08-27T11:27:45.009511+0000","last_undegraded":"2023-08-27T11:27:45.009511+0000","last_fullsized":"2023-08-27T11:27:45.009511+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:40.552929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033417+0000","last_change":"2023-08-27T11:27:45.028918+0000","last_active":"2023-08-27T11:27:45.033417+0000","last_peered":"2023-08-27T11:27:45.033417+0000","last_clean":"2023-08-27T11:27:45.033417+0000","last_became_active":"2023-08-27T11:27:45.028613+0000","last_became_peered":"2023-08-27T11:27:45.028613+0000","last_unstale":"2023-08-27T11:27:45.033417+0000","last_undegraded":"2023-08-27T11:27:45.033417+0000","last_fullsized":"2023-08-27T11:27:45.033417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:52.619488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008848+0000","last_change":"2023-08-27T11:27:44.008852+0000","last_active":"2023-08-27T11:27:45.008848+0000","last_peered":"2023-08-27T11:27:45.008848+0000","last_clean":"2023-08-27T11:27:45.008848+0000","last_became_active":"2023-08-27T11:27:44.008414+0000","last_became_peered":"2023-08-27T11:27:44.008414+0000","last_unstale":"2023-08-27T11:27:45.008848+0000","last_undegraded":"2023-08-27T11:27:45.008848+0000","last_fullsized":"2023-08-27T11:27:45.008848+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:13.282050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033319+0000","last_change":"2023-08-27T11:27:45.026915+0000","last_active":"2023-08-27T11:27:45.033319+0000","last_peered":"2023-08-27T11:27:45.033319+0000","last_clean":"2023-08-27T11:27:45.033319+0000","last_became_active":"2023-08-27T11:27:45.024556+0000","last_became_peered":"2023-08-27T11:27:45.024556+0000","last_unstale":"2023-08-27T11:27:45.033319+0000","last_undegraded":"2023-08-27T11:27:45.033319+0000","last_fullsized":"2023-08-27T11:27:45.033319+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:50.788650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026274+0000","last_change":"2023-08-27T11:27:44.012518+0000","last_active":"2023-08-27T11:27:45.026274+0000","last_peered":"2023-08-27T11:27:45.026274+0000","last_clean":"2023-08-27T11:27:45.026274+0000","last_became_active":"2023-08-27T11:27:44.012206+0000","last_became_peered":"2023-08-27T11:27:44.012206+0000","last_unstale":"2023-08-27T11:27:45.026274+0000","last_undegraded":"2023-08-27T11:27:45.026274+0000","last_fullsized":"2023-08-27T11:27:45.026274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:51.142132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042641+0000","last_change":"2023-08-27T11:27:45.033110+0000","last_active":"2023-08-27T11:27:45.042641+0000","last_peered":"2023-08-27T11:27:45.042641+0000","last_clean":"2023-08-27T11:27:45.042641+0000","last_became_active":"2023-08-27T11:27:45.031993+0000","last_became_peered":"2023-08-27T11:27:45.031993+0000","last_unstale":"2023-08-27T11:27:45.042641+0000","last_undegraded":"2023-08-27T11:27:45.042641+0000","last_fullsized":"2023-08-27T11:27:45.042641+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:41.941751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012294+0000","last_change":"2023-08-27T11:27:44.007444+0000","last_active":"2023-08-27T11:27:45.012294+0000","last_peered":"2023-08-27T11:27:45.012294+0000","last_clean":"2023-08-27T11:27:45.012294+0000","last_became_active":"2023-08-27T11:27:44.007171+0000","last_became_peered":"2023-08-27T11:27:44.007171+0000","last_unstale":"2023-08-27T11:27:45.012294+0000","last_undegraded":"2023-08-27T11:27:45.012294+0000","last_fullsized":"2023-08-27T11:27:45.012294+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:27.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048744+0000","last_change":"2023-08-27T11:27:45.035608+0000","last_active":"2023-08-27T11:27:45.048744+0000","last_peered":"2023-08-27T11:27:45.048744+0000","last_clean":"2023-08-27T11:27:45.048744+0000","last_became_active":"2023-08-27T11:27:45.035310+0000","last_became_peered":"2023-08-27T11:27:45.035310+0000","last_unstale":"2023-08-27T11:27:45.048744+0000","last_undegraded":"2023-08-27T11:27:45.048744+0000","last_fullsized":"2023-08-27T11:27:45.048744+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:35.357053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013541+0000","last_change":"2023-08-27T11:27:44.003921+0000","last_active":"2023-08-27T11:27:45.013541+0000","last_peered":"2023-08-27T11:27:45.013541+0000","last_clean":"2023-08-27T11:27:45.013541+0000","last_became_active":"2023-08-27T11:27:44.003632+0000","last_became_peered":"2023-08-27T11:27:44.003632+0000","last_unstale":"2023-08-27T11:27:45.013541+0000","last_undegraded":"2023-08-27T11:27:45.013541+0000","last_fullsized":"2023-08-27T11:27:45.013541+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:40.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039548+0000","last_change":"2023-08-27T11:27:45.034320+0000","last_active":"2023-08-27T11:27:45.039548+0000","last_peered":"2023-08-27T11:27:45.039548+0000","last_clean":"2023-08-27T11:27:45.039548+0000","last_became_active":"2023-08-27T11:27:45.034071+0000","last_became_peered":"2023-08-27T11:27:45.034071+0000","last_unstale":"2023-08-27T11:27:45.039548+0000","last_undegraded":"2023-08-27T11:27:45.039548+0000","last_fullsized":"2023-08-27T11:27:45.039548+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:53.171394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016390+0000","last_change":"2023-08-27T11:27:44.008722+0000","last_active":"2023-08-27T11:27:45.016390+0000","last_peered":"2023-08-27T11:27:45.016390+0000","last_clean":"2023-08-27T11:27:45.016390+0000","last_became_active":"2023-08-27T11:27:44.008244+0000","last_became_peered":"2023-08-27T11:27:44.008244+0000","last_unstale":"2023-08-27T11:27:45.016390+0000","last_undegraded":"2023-08-27T11:27:45.016390+0000","last_fullsized":"2023-08-27T11:27:45.016390+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:29.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026275+0000","last_change":"2023-08-27T11:27:45.024803+0000","last_active":"2023-08-27T11:27:45.026275+0000","last_peered":"2023-08-27T11:27:45.026275+0000","last_clean":"2023-08-27T11:27:45.026275+0000","last_became_active":"2023-08-27T11:27:45.024507+0000","last_became_peered":"2023-08-27T11:27:45.024507+0000","last_unstale":"2023-08-27T11:27:45.026275+0000","last_undegraded":"2023-08-27T11:27:45.026275+0000","last_fullsized":"2023-08-27T11:27:45.026275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:53.409382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016723+0000","last_change":"2023-08-27T11:27:44.005243+0000","last_active":"2023-08-27T11:27:45.016723+0000","last_peered":"2023-08-27T11:27:45.016723+0000","last_clean":"2023-08-27T11:27:45.016723+0000","last_became_active":"2023-08-27T11:27:44.004877+0000","last_became_peered":"2023-08-27T11:27:44.004877+0000","last_unstale":"2023-08-27T11:27:45.016723+0000","last_undegraded":"2023-08-27T11:27:45.016723+0000","last_fullsized":"2023-08-27T11:27:45.016723+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:17:29.653398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033326+0000","last_change":"2023-08-27T11:27:45.027609+0000","last_active":"2023-08-27T11:27:45.033326+0000","last_peered":"2023-08-27T11:27:45.033326+0000","last_clean":"2023-08-27T11:27:45.033326+0000","last_became_active":"2023-08-27T11:27:45.027302+0000","last_became_peered":"2023-08-27T11:27:45.027302+0000","last_unstale":"2023-08-27T11:27:45.033326+0000","last_undegraded":"2023-08-27T11:27:45.033326+0000","last_fullsized":"2023-08-27T11:27:45.033326+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:08.810413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008414+0000","last_change":"2023-08-27T11:27:44.007720+0000","last_active":"2023-08-27T11:27:45.008414+0000","last_peered":"2023-08-27T11:27:45.008414+0000","last_clean":"2023-08-27T11:27:45.008414+0000","last_became_active":"2023-08-27T11:27:44.007098+0000","last_became_peered":"2023-08-27T11:27:44.007098+0000","last_unstale":"2023-08-27T11:27:45.008414+0000","last_undegraded":"2023-08-27T11:27:45.008414+0000","last_fullsized":"2023-08-27T11:27:45.008414+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:51.842321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008517+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:27:45.008517+0000","last_peered":"2023-08-27T11:27:45.008517+0000","last_clean":"2023-08-27T11:27:45.008517+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:27:45.008517+0000","last_undegraded":"2023-08-27T11:27:45.008517+0000","last_fullsized":"2023-08-27T11:27:45.008517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:52.699014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042931+0000","last_change":"2023-08-27T11:27:45.041883+0000","last_active":"2023-08-27T11:27:45.042931+0000","last_peered":"2023-08-27T11:27:45.042931+0000","last_clean":"2023-08-27T11:27:45.042931+0000","last_became_active":"2023-08-27T11:27:45.041462+0000","last_became_peered":"2023-08-27T11:27:45.041462+0000","last_unstale":"2023-08-27T11:27:45.042931+0000","last_undegraded":"2023-08-27T11:27:45.042931+0000","last_fullsized":"2023-08-27T11:27:45.042931+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:05.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012311+0000","last_change":"2023-08-27T11:27:44.009988+0000","last_active":"2023-08-27T11:27:45.012311+0000","last_peered":"2023-08-27T11:27:45.012311+0000","last_clean":"2023-08-27T11:27:45.012311+0000","last_became_active":"2023-08-27T11:27:44.009635+0000","last_became_peered":"2023-08-27T11:27:44.009635+0000","last_unstale":"2023-08-27T11:27:45.012311+0000","last_undegraded":"2023-08-27T11:27:45.012311+0000","last_fullsized":"2023-08-27T11:27:45.012311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:59.863156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008117+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:27:45.008117+0000","last_peered":"2023-08-27T11:27:45.008117+0000","last_clean":"2023-08-27T11:27:45.008117+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:27:45.008117+0000","last_undegraded":"2023-08-27T11:27:45.008117+0000","last_fullsized":"2023-08-27T11:27:45.008117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:37:53.396483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026557+0000","last_change":"2023-08-27T11:27:45.023280+0000","last_active":"2023-08-27T11:27:45.026557+0000","last_peered":"2023-08-27T11:27:45.026557+0000","last_clean":"2023-08-27T11:27:45.026557+0000","last_became_active":"2023-08-27T11:27:45.022950+0000","last_became_peered":"2023-08-27T11:27:45.022950+0000","last_unstale":"2023-08-27T11:27:45.026557+0000","last_undegraded":"2023-08-27T11:27:45.026557+0000","last_fullsized":"2023-08-27T11:27:45.026557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:57.287445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.023696+0000","last_change":"2023-08-27T11:27:44.008208+0000","last_active":"2023-08-27T11:27:45.023696+0000","last_peered":"2023-08-27T11:27:45.023696+0000","last_clean":"2023-08-27T11:27:45.023696+0000","last_became_active":"2023-08-27T11:27:44.007902+0000","last_became_peered":"2023-08-27T11:27:44.007902+0000","last_unstale":"2023-08-27T11:27:45.023696+0000","last_undegraded":"2023-08-27T11:27:45.023696+0000","last_fullsized":"2023-08-27T11:27:45.023696+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:15.722279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012210+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:27:45.012210+0000","last_peered":"2023-08-27T11:27:45.012210+0000","last_clean":"2023-08-27T11:27:45.012210+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:27:45.012210+0000","last_undegraded":"2023-08-27T11:27:45.012210+0000","last_fullsized":"2023-08-27T11:27:45.012210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:28.545718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038443+0000","last_change":"2023-08-27T11:27:45.030839+0000","last_active":"2023-08-27T11:27:45.038443+0000","last_peered":"2023-08-27T11:27:45.038443+0000","last_clean":"2023-08-27T11:27:45.038443+0000","last_became_active":"2023-08-27T11:27:45.029586+0000","last_became_peered":"2023-08-27T11:27:45.029586+0000","last_unstale":"2023-08-27T11:27:45.038443+0000","last_undegraded":"2023-08-27T11:27:45.038443+0000","last_fullsized":"2023-08-27T11:27:45.038443+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:14.622316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":19,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.049684+0000","last_change":"2023-08-27T11:27:44.005995+0000","last_active":"2023-08-27T11:27:45.049684+0000","last_peered":"2023-08-27T11:27:45.049684+0000","last_clean":"2023-08-27T11:27:45.049684+0000","last_became_active":"2023-08-27T11:27:44.005680+0000","last_became_peered":"2023-08-27T11:27:44.005680+0000","last_unstale":"2023-08-27T11:27:45.049684+0000","last_undegraded":"2023-08-27T11:27:45.049684+0000","last_fullsized":"2023-08-27T11:27:45.049684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:22.234358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.017611+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:27:45.017611+0000","last_peered":"2023-08-27T11:27:45.017611+0000","last_clean":"2023-08-27T11:27:45.017611+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:27:45.017611+0000","last_undegraded":"2023-08-27T11:27:45.017611+0000","last_fullsized":"2023-08-27T11:27:45.017611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:42:20.955972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033279+0000","last_change":"2023-08-27T11:27:45.032199+0000","last_active":"2023-08-27T11:27:45.033279+0000","last_peered":"2023-08-27T11:27:45.033279+0000","last_clean":"2023-08-27T11:27:45.033279+0000","last_became_active":"2023-08-27T11:27:45.031897+0000","last_became_peered":"2023-08-27T11:27:45.031897+0000","last_unstale":"2023-08-27T11:27:45.033279+0000","last_undegraded":"2023-08-27T11:27:45.033279+0000","last_fullsized":"2023-08-27T11:27:45.033279+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:09:42.219143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030165+0000","last_change":"2023-08-27T11:27:44.006594+0000","last_active":"2023-08-27T11:27:45.030165+0000","last_peered":"2023-08-27T11:27:45.030165+0000","last_clean":"2023-08-27T11:27:45.030165+0000","last_became_active":"2023-08-27T11:27:44.006156+0000","last_became_peered":"2023-08-27T11:27:44.006156+0000","last_unstale":"2023-08-27T11:27:45.030165+0000","last_undegraded":"2023-08-27T11:27:45.030165+0000","last_fullsized":"2023-08-27T11:27:45.030165+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:53.632157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.017355+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:27:45.017355+0000","last_peered":"2023-08-27T11:27:45.017355+0000","last_clean":"2023-08-27T11:27:45.017355+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:27:45.017355+0000","last_undegraded":"2023-08-27T11:27:45.017355+0000","last_fullsized":"2023-08-27T11:27:45.017355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:03:42.951769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051659+0000","last_change":"2023-08-27T11:27:45.050252+0000","last_active":"2023-08-27T11:27:45.051659+0000","last_peered":"2023-08-27T11:27:45.051659+0000","last_clean":"2023-08-27T11:27:45.051659+0000","last_became_active":"2023-08-27T11:27:45.049975+0000","last_became_peered":"2023-08-27T11:27:45.049975+0000","last_unstale":"2023-08-27T11:27:45.051659+0000","last_undegraded":"2023-08-27T11:27:45.051659+0000","last_fullsized":"2023-08-27T11:27:45.051659+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:10.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.044136+0000","last_change":"2023-08-27T11:27:44.007004+0000","last_active":"2023-08-27T11:27:45.044136+0000","last_peered":"2023-08-27T11:27:45.044136+0000","last_clean":"2023-08-27T11:27:45.044136+0000","last_became_active":"2023-08-27T11:27:44.006712+0000","last_became_peered":"2023-08-27T11:27:44.006712+0000","last_unstale":"2023-08-27T11:27:45.044136+0000","last_undegraded":"2023-08-27T11:27:45.044136+0000","last_fullsized":"2023-08-27T11:27:45.044136+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:24:26.730573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":319,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016843+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:27:45.016843+0000","last_peered":"2023-08-27T11:27:45.016843+0000","last_clean":"2023-08-27T11:27:45.016843+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:27:45.016843+0000","last_undegraded":"2023-08-27T11:27:45.016843+0000","last_fullsized":"2023-08-27T11:27:45.016843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:56:21.994448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.018437+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:27:45.018437+0000","last_peered":"2023-08-27T11:27:45.018437+0000","last_clean":"2023-08-27T11:27:45.018437+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:27:45.018437+0000","last_undegraded":"2023-08-27T11:27:45.018437+0000","last_fullsized":"2023-08-27T11:27:45.018437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:23.635363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.034353+0000","last_change":"2023-08-27T11:27:45.030844+0000","last_active":"2023-08-27T11:27:45.034353+0000","last_peered":"2023-08-27T11:27:45.034353+0000","last_clean":"2023-08-27T11:27:45.034353+0000","last_became_active":"2023-08-27T11:27:45.030332+0000","last_became_peered":"2023-08-27T11:27:45.030332+0000","last_unstale":"2023-08-27T11:27:45.034353+0000","last_undegraded":"2023-08-27T11:27:45.034353+0000","last_fullsized":"2023-08-27T11:27:45.034353+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:05.730153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"109'6","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050827+0000","last_change":"2023-08-27T11:27:44.008005+0000","last_active":"2023-08-27T11:27:45.050827+0000","last_peered":"2023-08-27T11:27:45.050827+0000","last_clean":"2023-08-27T11:27:45.050827+0000","last_became_active":"2023-08-27T11:27:44.007654+0000","last_became_peered":"2023-08-27T11:27:44.007654+0000","last_unstale":"2023-08-27T11:27:45.050827+0000","last_undegraded":"2023-08-27T11:27:45.050827+0000","last_fullsized":"2023-08-27T11:27:45.050827+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:26:00.841517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012728+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:27:45.012728+0000","last_peered":"2023-08-27T11:27:45.012728+0000","last_clean":"2023-08-27T11:27:45.012728+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:27:45.012728+0000","last_undegraded":"2023-08-27T11:27:45.012728+0000","last_fullsized":"2023-08-27T11:27:45.012728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:02:24.838670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047133+0000","last_change":"2023-08-27T11:27:45.043790+0000","last_active":"2023-08-27T11:27:45.047133+0000","last_peered":"2023-08-27T11:27:45.047133+0000","last_clean":"2023-08-27T11:27:45.047133+0000","last_became_active":"2023-08-27T11:27:45.040003+0000","last_became_peered":"2023-08-27T11:27:45.040003+0000","last_unstale":"2023-08-27T11:27:45.047133+0000","last_undegraded":"2023-08-27T11:27:45.047133+0000","last_fullsized":"2023-08-27T11:27:45.047133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:27:09.235918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"109'3","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035710+0000","last_change":"2023-08-27T11:27:44.009400+0000","last_active":"2023-08-27T11:27:45.035710+0000","last_peered":"2023-08-27T11:27:45.035710+0000","last_clean":"2023-08-27T11:27:45.035710+0000","last_became_active":"2023-08-27T11:27:44.009127+0000","last_became_peered":"2023-08-27T11:27:44.009127+0000","last_unstale":"2023-08-27T11:27:45.035710+0000","last_undegraded":"2023-08-27T11:27:45.035710+0000","last_fullsized":"2023-08-27T11:27:45.035710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:48.151916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013796+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:27:45.013796+0000","last_peered":"2023-08-27T11:27:45.013796+0000","last_clean":"2023-08-27T11:27:45.013796+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:27:45.013796+0000","last_undegraded":"2023-08-27T11:27:45.013796+0000","last_fullsized":"2023-08-27T11:27:45.013796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:20:02.077713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1937408,"data_stored":1217825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.81399999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.874},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":634181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.621},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.84699999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.71299999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":0.95199999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.79200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1224975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.30599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":633621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.373},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.872},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":634585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.81699999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.80800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":626471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.495}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.628},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.746}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":627457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.623},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":633759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.45900000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.503}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:49.503 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:27:49.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.733+0000 7efcedfff700 1 Processor -- start 2023-08-27T11:27:49.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.734+0000 7efcedfff700 1 -- start start 2023-08-27T11:27:49.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efcedfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efce8151a90 0x7efce80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efcedfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce806c4e0 con 0x7efce80c4a90 2023-08-27T11:27:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efcedfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce8155370 con 0x7efce80c4630 2023-08-27T11:27:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efcedfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce8151e70 con 0x7efce8151a90 2023-08-27T11:27:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efce8151a90 0x7efce80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efce8151a90 0x7efce80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47710/0 (socket says 172.21.15.43:47710) 2023-08-27T11:27:49.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 -- 172.21.15.43:0/667985891 learned_addr learned my addr 172.21.15.43:0/667985891 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:49.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce7fff700 1 --1- 172.21.15.43:0/667985891 >> v1:172.21.15.43:6789/0 conn(0x7efce80c4a90 0x7efce806b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59898/0 (socket says 172.21.15.43:59898) 2023-08-27T11:27:49.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 -- 172.21.15.43:0/667985891 >> v1:172.21.15.57:6789/0 conn(0x7efce80c4630 legacy=0x7efce806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 -- 172.21.15.43:0/667985891 >> v1:172.21.15.43:6789/0 conn(0x7efce80c4a90 legacy=0x7efce806b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.735+0000 7efce77fe700 1 -- 172.21.15.43:0/667985891 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8154480 con 0x7efce8151a90 2023-08-27T11:27:49.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.736+0000 7efce77fe700 1 --2- 172.21.15.43:0/667985891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce8151a90 0x7efce80c7bb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098f0 tx=0x7efcd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8659e2bed5086fc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.736+0000 7efce67fc700 1 -- 172.21.15.43:0/667985891 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800b8a0 con 0x7efce8151a90 2023-08-27T11:27:49.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.736+0000 7efce67fc700 1 -- 172.21.15.43:0/667985891 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd800ba00 con 0x7efce8151a90 2023-08-27T11:27:49.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.736+0000 7efce67fc700 1 -- 172.21.15.43:0/667985891 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd800bd90 con 0x7efce8151a90 2023-08-27T11:27:49.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 -- 172.21.15.43:0/667985891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce8151a90 msgr2=0x7efce80c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 --2- 172.21.15.43:0/667985891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce8151a90 0x7efce80c7bb0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098f0 tx=0x7efcd8009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:49.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 -- 172.21.15.43:0/667985891 shutdown_connections 2023-08-27T11:27:49.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 --2- 172.21.15.43:0/667985891 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce8151a90 0x7efce80c7bb0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 -- 172.21.15.43:0/667985891 >> 172.21.15.43:0/667985891 conn(0x7efce80ab820 msgr2=0x7efce80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:49.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 -- 172.21.15.43:0/667985891 shutdown_connections 2023-08-27T11:27:49.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.737+0000 7efcedfff700 1 -- 172.21.15.43:0/667985891 wait complete. 2023-08-27T11:27:49.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.738+0000 7efcedfff700 1 Processor -- start 2023-08-27T11:27:49.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.738+0000 7efcedfff700 1 -- start start 2023-08-27T11:27:49.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efce80c4630 0x7efce80aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce8151a90 0x7efce814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81e98b0 con 0x7efce80c4a90 2023-08-27T11:27:49.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce814db80 con 0x7efce8151a90 2023-08-27T11:27:49.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.739+0000 7efcedfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce81ed9d0 con 0x7efce80c4630 2023-08-27T11:27:49.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47726/0 (socket says 172.21.15.43:47726) 2023-08-27T11:27:49.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 -- 172.21.15.43:0/1744437126 learned_addr learned my addr 172.21.15.43:0/1744437126 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:49.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce7fff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce8151a90 0x7efce814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce77fe700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efce80c4630 0x7efce80aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 -- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efce80c4630 msgr2=0x7efce80aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efce80c4630 0x7efce80aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 -- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce8151a90 msgr2=0x7efce814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce8151a90 0x7efce814d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 -- 172.21.15.43:0/1744437126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8009550 con 0x7efce80c4a90 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.740+0000 7efce6ffd700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c450 tx=0x7efcdc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.741+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0050d0 con 0x7efce80c4a90 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.741+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc005230 con 0x7efce80c4a90 2023-08-27T11:27:49.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.741+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce80c2870 con 0x7efce80c4a90 2023-08-27T11:27:49.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.741+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc003680 con 0x7efce80c4a90 2023-08-27T11:27:49.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.741+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce80c0e20 con 0x7efce80c4a90 2023-08-27T11:27:49.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.742+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce81e9a00 con 0x7efce80c4a90 2023-08-27T11:27:49.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.743+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efcdc0037e0 con 0x7efce80c4a90 2023-08-27T11:27:49.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.744+0000 7efccffff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 0x7efcd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:49.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.744+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcdc087810 con 0x7efce80c4a90 2023-08-27T11:27:49.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.744+0000 7efce77fe700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 0x7efcd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:49.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.745+0000 7efce77fe700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 0x7efcd406c5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009c40 tx=0x7efcd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:49.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.748+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efce81e9a00 con 0x7efce80c4a90 2023-08-27T11:27:49.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.952+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efce8154a40 con 0x7efcd406a0e0 2023-08-27T11:27:49.963 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:27:49.961+0000 7f4ef9ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:49.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.963+0000 7efccffff700 1 -- 172.21.15.43:0/1744437126 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311811 (secure 0 0 0) 0x7efcd800bbf0 con 0x7efcd406a0e0 2023-08-27T11:27:49.969 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:49.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 msgr2=0x7efcd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 0x7efcd406c5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009c40 tx=0x7efcd8008030 comp rx=0 tx=0).stop 2023-08-27T11:27:49.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 msgr2=0x7efce814d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:49.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c450 tx=0x7efcdc00c760 comp rx=0 tx=0).stop 2023-08-27T11:27:49.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 shutdown_connections 2023-08-27T11:27:49.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcd406a0e0 0x7efcd406c5a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efce8151a90 0x7efce814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efce80c4630 0x7efce80aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 --2- 172.21.15.43:0/1744437126 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efce80c4a90 0x7efce814d100 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:49.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 >> 172.21.15.43:0/1744437126 conn(0x7efce80ab820 msgr2=0x7efce80c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:49.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 shutdown_connections 2023-08-27T11:27:49.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:49.968+0000 7efcedfff700 1 -- 172.21.15.43:0/1744437126 wait complete. 2023-08-27T11:27:49.974 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:27:49.988 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":260,"stamp":"2023-08-27T11:27:48.374254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232072,"kb_used_data":11720,"kb_used_omap":13,"kb_used_meta":220210,"kb_avail":754742648,"statfs":{"total":773094113280,"available":772856471552,"internally_reserved":0,"allocated":12001280,"data_stored":6232874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225495128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.394191"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031092+0000","last_change":"2023-08-27T11:27:45.026575+0000","last_active":"2023-08-27T11:27:45.031092+0000","last_peered":"2023-08-27T11:27:45.031092+0000","last_clean":"2023-08-27T11:27:45.031092+0000","last_became_active":"2023-08-27T11:27:45.026229+0000","last_became_peered":"2023-08-27T11:27:45.026229+0000","last_unstale":"2023-08-27T11:27:45.031092+0000","last_undegraded":"2023-08-27T11:27:45.031092+0000","last_fullsized":"2023-08-27T11:27:45.031092+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:34:41.976106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047111+0000","last_change":"2023-08-27T11:27:45.043682+0000","last_active":"2023-08-27T11:27:45.047111+0000","last_peered":"2023-08-27T11:27:45.047111+0000","last_clean":"2023-08-27T11:27:45.047111+0000","last_became_active":"2023-08-27T11:27:45.040495+0000","last_became_peered":"2023-08-27T11:27:45.040495+0000","last_unstale":"2023-08-27T11:27:45.047111+0000","last_undegraded":"2023-08-27T11:27:45.047111+0000","last_fullsized":"2023-08-27T11:27:45.047111+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:22.355760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046855+0000","last_change":"2023-08-27T11:27:45.040690+0000","last_active":"2023-08-27T11:27:45.046855+0000","last_peered":"2023-08-27T11:27:45.046855+0000","last_clean":"2023-08-27T11:27:45.046855+0000","last_became_active":"2023-08-27T11:27:45.040419+0000","last_became_peered":"2023-08-27T11:27:45.040419+0000","last_unstale":"2023-08-27T11:27:45.046855+0000","last_undegraded":"2023-08-27T11:27:45.046855+0000","last_fullsized":"2023-08-27T11:27:45.046855+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:24:25.195798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031463+0000","last_change":"2023-08-27T11:27:45.023720+0000","last_active":"2023-08-27T11:27:45.031463+0000","last_peered":"2023-08-27T11:27:45.031463+0000","last_clean":"2023-08-27T11:27:45.031463+0000","last_became_active":"2023-08-27T11:27:45.023373+0000","last_became_peered":"2023-08-27T11:27:45.023373+0000","last_unstale":"2023-08-27T11:27:45.031463+0000","last_undegraded":"2023-08-27T11:27:45.031463+0000","last_fullsized":"2023-08-27T11:27:45.031463+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:35:07.482657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040079+0000","last_change":"2023-08-27T11:27:45.035739+0000","last_active":"2023-08-27T11:27:45.040079+0000","last_peered":"2023-08-27T11:27:45.040079+0000","last_clean":"2023-08-27T11:27:45.040079+0000","last_became_active":"2023-08-27T11:27:45.035384+0000","last_became_peered":"2023-08-27T11:27:45.035384+0000","last_unstale":"2023-08-27T11:27:45.040079+0000","last_undegraded":"2023-08-27T11:27:45.040079+0000","last_fullsized":"2023-08-27T11:27:45.040079+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:57.494271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.049252+0000","last_change":"2023-08-27T11:27:45.048133+0000","last_active":"2023-08-27T11:27:45.049252+0000","last_peered":"2023-08-27T11:27:45.049252+0000","last_clean":"2023-08-27T11:27:45.049252+0000","last_became_active":"2023-08-27T11:27:45.047824+0000","last_became_peered":"2023-08-27T11:27:45.047824+0000","last_unstale":"2023-08-27T11:27:45.049252+0000","last_undegraded":"2023-08-27T11:27:45.049252+0000","last_fullsized":"2023-08-27T11:27:45.049252+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:39:15.652334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031920+0000","last_change":"2023-08-27T11:27:45.028552+0000","last_active":"2023-08-27T11:27:45.031920+0000","last_peered":"2023-08-27T11:27:45.031920+0000","last_clean":"2023-08-27T11:27:45.031920+0000","last_became_active":"2023-08-27T11:27:45.027383+0000","last_became_peered":"2023-08-27T11:27:45.027383+0000","last_unstale":"2023-08-27T11:27:45.031920+0000","last_undegraded":"2023-08-27T11:27:45.031920+0000","last_fullsized":"2023-08-27T11:27:45.031920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:57:06.086507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050811+0000","last_change":"2023-08-27T11:27:45.049508+0000","last_active":"2023-08-27T11:27:45.050811+0000","last_peered":"2023-08-27T11:27:45.050811+0000","last_clean":"2023-08-27T11:27:45.050811+0000","last_became_active":"2023-08-27T11:27:45.048935+0000","last_became_peered":"2023-08-27T11:27:45.048935+0000","last_unstale":"2023-08-27T11:27:45.050811+0000","last_undegraded":"2023-08-27T11:27:45.050811+0000","last_fullsized":"2023-08-27T11:27:45.050811+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:23.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.045649+0000","last_change":"2023-08-27T11:27:45.044233+0000","last_active":"2023-08-27T11:27:45.045649+0000","last_peered":"2023-08-27T11:27:45.045649+0000","last_clean":"2023-08-27T11:27:45.045649+0000","last_became_active":"2023-08-27T11:27:45.043927+0000","last_became_peered":"2023-08-27T11:27:45.043927+0000","last_unstale":"2023-08-27T11:27:45.045649+0000","last_undegraded":"2023-08-27T11:27:45.045649+0000","last_fullsized":"2023-08-27T11:27:45.045649+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:21:28.545403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038120+0000","last_change":"2023-08-27T11:27:45.036544+0000","last_active":"2023-08-27T11:27:45.038120+0000","last_peered":"2023-08-27T11:27:45.038120+0000","last_clean":"2023-08-27T11:27:45.038120+0000","last_became_active":"2023-08-27T11:27:45.036262+0000","last_became_peered":"2023-08-27T11:27:45.036262+0000","last_unstale":"2023-08-27T11:27:45.038120+0000","last_undegraded":"2023-08-27T11:27:45.038120+0000","last_fullsized":"2023-08-27T11:27:45.038120+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:10.495482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031764+0000","last_change":"2023-08-27T11:27:45.026675+0000","last_active":"2023-08-27T11:27:45.031764+0000","last_peered":"2023-08-27T11:27:45.031764+0000","last_clean":"2023-08-27T11:27:45.031764+0000","last_became_active":"2023-08-27T11:27:45.026278+0000","last_became_peered":"2023-08-27T11:27:45.026278+0000","last_unstale":"2023-08-27T11:27:45.031764+0000","last_undegraded":"2023-08-27T11:27:45.031764+0000","last_fullsized":"2023-08-27T11:27:45.031764+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:54:10.778317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042532+0000","last_change":"2023-08-27T11:27:45.031085+0000","last_active":"2023-08-27T11:27:45.042532+0000","last_peered":"2023-08-27T11:27:45.042532+0000","last_clean":"2023-08-27T11:27:45.042532+0000","last_became_active":"2023-08-27T11:27:45.030399+0000","last_became_peered":"2023-08-27T11:27:45.030399+0000","last_unstale":"2023-08-27T11:27:45.042532+0000","last_undegraded":"2023-08-27T11:27:45.042532+0000","last_fullsized":"2023-08-27T11:27:45.042532+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:51.120836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031482+0000","last_change":"2023-08-27T11:27:45.028898+0000","last_active":"2023-08-27T11:27:45.031482+0000","last_peered":"2023-08-27T11:27:45.031482+0000","last_clean":"2023-08-27T11:27:45.031482+0000","last_became_active":"2023-08-27T11:27:45.028616+0000","last_became_peered":"2023-08-27T11:27:45.028616+0000","last_unstale":"2023-08-27T11:27:45.031482+0000","last_undegraded":"2023-08-27T11:27:45.031482+0000","last_fullsized":"2023-08-27T11:27:45.031482+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:07:43.551331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048620+0000","last_change":"2023-08-27T11:27:45.047384+0000","last_active":"2023-08-27T11:27:45.048620+0000","last_peered":"2023-08-27T11:27:45.048620+0000","last_clean":"2023-08-27T11:27:45.048620+0000","last_became_active":"2023-08-27T11:27:45.046774+0000","last_became_peered":"2023-08-27T11:27:45.046774+0000","last_unstale":"2023-08-27T11:27:45.048620+0000","last_undegraded":"2023-08-27T11:27:45.048620+0000","last_fullsized":"2023-08-27T11:27:45.048620+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:57.494271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031034+0000","last_change":"2023-08-27T11:27:45.023377+0000","last_active":"2023-08-27T11:27:45.031034+0000","last_peered":"2023-08-27T11:27:45.031034+0000","last_clean":"2023-08-27T11:27:45.031034+0000","last_became_active":"2023-08-27T11:27:45.023092+0000","last_became_peered":"2023-08-27T11:27:45.023092+0000","last_unstale":"2023-08-27T11:27:45.031034+0000","last_undegraded":"2023-08-27T11:27:45.031034+0000","last_fullsized":"2023-08-27T11:27:45.031034+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:23.238831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042600+0000","last_change":"2023-08-27T11:27:45.032716+0000","last_active":"2023-08-27T11:27:45.042600+0000","last_peered":"2023-08-27T11:27:45.042600+0000","last_clean":"2023-08-27T11:27:45.042600+0000","last_became_active":"2023-08-27T11:27:45.032440+0000","last_became_peered":"2023-08-27T11:27:45.032440+0000","last_unstale":"2023-08-27T11:27:45.042600+0000","last_undegraded":"2023-08-27T11:27:45.042600+0000","last_fullsized":"2023-08-27T11:27:45.042600+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:04:52.395285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031605+0000","last_change":"2023-08-27T11:27:45.029100+0000","last_active":"2023-08-27T11:27:45.031605+0000","last_peered":"2023-08-27T11:27:45.031605+0000","last_clean":"2023-08-27T11:27:45.031605+0000","last_became_active":"2023-08-27T11:27:45.028830+0000","last_became_peered":"2023-08-27T11:27:45.028830+0000","last_unstale":"2023-08-27T11:27:45.031605+0000","last_undegraded":"2023-08-27T11:27:45.031605+0000","last_fullsized":"2023-08-27T11:27:45.031605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:24.814912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046003+0000","last_change":"2023-08-27T11:27:45.040805+0000","last_active":"2023-08-27T11:27:45.046003+0000","last_peered":"2023-08-27T11:27:45.046003+0000","last_clean":"2023-08-27T11:27:45.046003+0000","last_became_active":"2023-08-27T11:27:45.035484+0000","last_became_peered":"2023-08-27T11:27:45.035484+0000","last_unstale":"2023-08-27T11:27:45.046003+0000","last_undegraded":"2023-08-27T11:27:45.046003+0000","last_fullsized":"2023-08-27T11:27:45.046003+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:59:01.874912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035010+0000","last_change":"2023-08-27T11:27:45.028545+0000","last_active":"2023-08-27T11:27:45.035010+0000","last_peered":"2023-08-27T11:27:45.035010+0000","last_clean":"2023-08-27T11:27:45.035010+0000","last_became_active":"2023-08-27T11:27:45.027711+0000","last_became_peered":"2023-08-27T11:27:45.027711+0000","last_unstale":"2023-08-27T11:27:45.035010+0000","last_undegraded":"2023-08-27T11:27:45.035010+0000","last_fullsized":"2023-08-27T11:27:45.035010+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:00:51.595009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038690+0000","last_change":"2023-08-27T11:27:45.032816+0000","last_active":"2023-08-27T11:27:45.038690+0000","last_peered":"2023-08-27T11:27:45.038690+0000","last_clean":"2023-08-27T11:27:45.038690+0000","last_became_active":"2023-08-27T11:27:45.032511+0000","last_became_peered":"2023-08-27T11:27:45.032511+0000","last_unstale":"2023-08-27T11:27:45.038690+0000","last_undegraded":"2023-08-27T11:27:45.038690+0000","last_fullsized":"2023-08-27T11:27:45.038690+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:55:44.227379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038421+0000","last_change":"2023-08-27T11:27:45.029829+0000","last_active":"2023-08-27T11:27:45.038421+0000","last_peered":"2023-08-27T11:27:45.038421+0000","last_clean":"2023-08-27T11:27:45.038421+0000","last_became_active":"2023-08-27T11:27:45.029179+0000","last_became_peered":"2023-08-27T11:27:45.029179+0000","last_unstale":"2023-08-27T11:27:45.038421+0000","last_undegraded":"2023-08-27T11:27:45.038421+0000","last_fullsized":"2023-08-27T11:27:45.038421+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:53.671384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051200+0000","last_change":"2023-08-27T11:27:45.049985+0000","last_active":"2023-08-27T11:27:45.051200+0000","last_peered":"2023-08-27T11:27:45.051200+0000","last_clean":"2023-08-27T11:27:45.051200+0000","last_became_active":"2023-08-27T11:27:45.049341+0000","last_became_peered":"2023-08-27T11:27:45.049341+0000","last_unstale":"2023-08-27T11:27:45.051200+0000","last_undegraded":"2023-08-27T11:27:45.051200+0000","last_fullsized":"2023-08-27T11:27:45.051200+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:27:23.988483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051002+0000","last_change":"2023-08-27T11:27:45.050143+0000","last_active":"2023-08-27T11:27:45.051002+0000","last_peered":"2023-08-27T11:27:45.051002+0000","last_clean":"2023-08-27T11:27:45.051002+0000","last_became_active":"2023-08-27T11:27:45.049817+0000","last_became_peered":"2023-08-27T11:27:45.049817+0000","last_unstale":"2023-08-27T11:27:45.051002+0000","last_undegraded":"2023-08-27T11:27:45.051002+0000","last_fullsized":"2023-08-27T11:27:45.051002+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:34:35.674806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039855+0000","last_change":"2023-08-27T11:27:45.035123+0000","last_active":"2023-08-27T11:27:45.039855+0000","last_peered":"2023-08-27T11:27:45.039855+0000","last_clean":"2023-08-27T11:27:45.039855+0000","last_became_active":"2023-08-27T11:27:45.034451+0000","last_became_peered":"2023-08-27T11:27:45.034451+0000","last_unstale":"2023-08-27T11:27:45.039855+0000","last_undegraded":"2023-08-27T11:27:45.039855+0000","last_fullsized":"2023-08-27T11:27:45.039855+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:50:11.269333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030575+0000","last_change":"2023-08-27T11:27:45.022520+0000","last_active":"2023-08-27T11:27:45.030575+0000","last_peered":"2023-08-27T11:27:45.030575+0000","last_clean":"2023-08-27T11:27:45.030575+0000","last_became_active":"2023-08-27T11:27:45.022217+0000","last_became_peered":"2023-08-27T11:27:45.022217+0000","last_unstale":"2023-08-27T11:27:45.030575+0000","last_undegraded":"2023-08-27T11:27:45.030575+0000","last_fullsized":"2023-08-27T11:27:45.030575+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:03:31.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029605+0000","last_change":"2023-08-27T11:27:45.026399+0000","last_active":"2023-08-27T11:27:45.029605+0000","last_peered":"2023-08-27T11:27:45.029605+0000","last_clean":"2023-08-27T11:27:45.029605+0000","last_became_active":"2023-08-27T11:27:45.025844+0000","last_became_peered":"2023-08-27T11:27:45.025844+0000","last_unstale":"2023-08-27T11:27:45.029605+0000","last_undegraded":"2023-08-27T11:27:45.029605+0000","last_fullsized":"2023-08-27T11:27:45.029605+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:33:59.856885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035030+0000","last_change":"2023-08-27T11:27:45.028925+0000","last_active":"2023-08-27T11:27:45.035030+0000","last_peered":"2023-08-27T11:27:45.035030+0000","last_clean":"2023-08-27T11:27:45.035030+0000","last_became_active":"2023-08-27T11:27:45.028155+0000","last_became_peered":"2023-08-27T11:27:45.028155+0000","last_unstale":"2023-08-27T11:27:45.035030+0000","last_undegraded":"2023-08-27T11:27:45.035030+0000","last_fullsized":"2023-08-27T11:27:45.035030+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:46:31.152088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042720+0000","last_change":"2023-08-27T11:27:45.036792+0000","last_active":"2023-08-27T11:27:45.042720+0000","last_peered":"2023-08-27T11:27:45.042720+0000","last_clean":"2023-08-27T11:27:45.042720+0000","last_became_active":"2023-08-27T11:27:45.036412+0000","last_became_peered":"2023-08-27T11:27:45.036412+0000","last_unstale":"2023-08-27T11:27:45.042720+0000","last_undegraded":"2023-08-27T11:27:45.042720+0000","last_fullsized":"2023-08-27T11:27:45.042720+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:07:37.670573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029678+0000","last_change":"2023-08-27T11:27:45.027199+0000","last_active":"2023-08-27T11:27:45.029678+0000","last_peered":"2023-08-27T11:27:45.029678+0000","last_clean":"2023-08-27T11:27:45.029678+0000","last_became_active":"2023-08-27T11:27:45.024130+0000","last_became_peered":"2023-08-27T11:27:45.024130+0000","last_unstale":"2023-08-27T11:27:45.029678+0000","last_undegraded":"2023-08-27T11:27:45.029678+0000","last_fullsized":"2023-08-27T11:27:45.029678+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:36:44.566241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048599+0000","last_change":"2023-08-27T11:27:45.047152+0000","last_active":"2023-08-27T11:27:45.048599+0000","last_peered":"2023-08-27T11:27:45.048599+0000","last_clean":"2023-08-27T11:27:45.048599+0000","last_became_active":"2023-08-27T11:27:45.046746+0000","last_became_peered":"2023-08-27T11:27:45.046746+0000","last_unstale":"2023-08-27T11:27:45.048599+0000","last_undegraded":"2023-08-27T11:27:45.048599+0000","last_fullsized":"2023-08-27T11:27:45.048599+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:13:47.831341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033496+0000","last_change":"2023-08-27T11:27:45.029737+0000","last_active":"2023-08-27T11:27:45.033496+0000","last_peered":"2023-08-27T11:27:45.033496+0000","last_clean":"2023-08-27T11:27:45.033496+0000","last_became_active":"2023-08-27T11:27:45.029418+0000","last_became_peered":"2023-08-27T11:27:45.029418+0000","last_unstale":"2023-08-27T11:27:45.033496+0000","last_undegraded":"2023-08-27T11:27:45.033496+0000","last_fullsized":"2023-08-27T11:27:45.033496+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:31.708382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039381+0000","last_change":"2023-08-27T11:27:45.034816+0000","last_active":"2023-08-27T11:27:45.039381+0000","last_peered":"2023-08-27T11:27:45.039381+0000","last_clean":"2023-08-27T11:27:45.039381+0000","last_became_active":"2023-08-27T11:27:45.034043+0000","last_became_peered":"2023-08-27T11:27:45.034043+0000","last_unstale":"2023-08-27T11:27:45.039381+0000","last_undegraded":"2023-08-27T11:27:45.039381+0000","last_fullsized":"2023-08-27T11:27:45.039381+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:10.495482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040590+0000","last_change":"2023-08-27T11:27:45.038565+0000","last_active":"2023-08-27T11:27:45.040590+0000","last_peered":"2023-08-27T11:27:45.040590+0000","last_clean":"2023-08-27T11:27:45.040590+0000","last_became_active":"2023-08-27T11:27:45.038272+0000","last_became_peered":"2023-08-27T11:27:45.038272+0000","last_unstale":"2023-08-27T11:27:45.040590+0000","last_undegraded":"2023-08-27T11:27:45.040590+0000","last_fullsized":"2023-08-27T11:27:45.040590+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:05.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"109'4","reported_seq":15,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038713+0000","last_change":"2023-08-27T11:27:44.007422+0000","last_active":"2023-08-27T11:27:45.038713+0000","last_peered":"2023-08-27T11:27:45.038713+0000","last_clean":"2023-08-27T11:27:45.038713+0000","last_became_active":"2023-08-27T11:27:44.006689+0000","last_became_peered":"2023-08-27T11:27:44.006689+0000","last_unstale":"2023-08-27T11:27:45.038713+0000","last_undegraded":"2023-08-27T11:27:45.038713+0000","last_fullsized":"2023-08-27T11:27:45.038713+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:25:55.915984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046544+0000","last_change":"2023-08-27T11:27:45.045468+0000","last_active":"2023-08-27T11:27:45.046544+0000","last_peered":"2023-08-27T11:27:45.046544+0000","last_clean":"2023-08-27T11:27:45.046544+0000","last_became_active":"2023-08-27T11:27:45.045161+0000","last_became_peered":"2023-08-27T11:27:45.045161+0000","last_unstale":"2023-08-27T11:27:45.046544+0000","last_undegraded":"2023-08-27T11:27:45.046544+0000","last_fullsized":"2023-08-27T11:27:45.046544+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:50.803465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029438+0000","last_change":"2023-08-27T11:27:44.007038+0000","last_active":"2023-08-27T11:27:45.029438+0000","last_peered":"2023-08-27T11:27:45.029438+0000","last_clean":"2023-08-27T11:27:45.029438+0000","last_became_active":"2023-08-27T11:27:44.006712+0000","last_became_peered":"2023-08-27T11:27:44.006712+0000","last_unstale":"2023-08-27T11:27:45.029438+0000","last_undegraded":"2023-08-27T11:27:45.029438+0000","last_fullsized":"2023-08-27T11:27:45.029438+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:50:10.264861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039872+0000","last_change":"2023-08-27T11:27:45.035057+0000","last_active":"2023-08-27T11:27:45.039872+0000","last_peered":"2023-08-27T11:27:45.039872+0000","last_clean":"2023-08-27T11:27:45.039872+0000","last_became_active":"2023-08-27T11:27:45.034668+0000","last_became_peered":"2023-08-27T11:27:45.034668+0000","last_unstale":"2023-08-27T11:27:45.039872+0000","last_undegraded":"2023-08-27T11:27:45.039872+0000","last_fullsized":"2023-08-27T11:27:45.039872+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:24.075714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032708+0000","last_change":"2023-08-27T11:27:44.007848+0000","last_active":"2023-08-27T11:27:45.032708+0000","last_peered":"2023-08-27T11:27:45.032708+0000","last_clean":"2023-08-27T11:27:45.032708+0000","last_became_active":"2023-08-27T11:27:44.007529+0000","last_became_peered":"2023-08-27T11:27:44.007529+0000","last_unstale":"2023-08-27T11:27:45.032708+0000","last_undegraded":"2023-08-27T11:27:45.032708+0000","last_fullsized":"2023-08-27T11:27:45.032708+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:42.432850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038346+0000","last_change":"2023-08-27T11:27:45.030412+0000","last_active":"2023-08-27T11:27:45.038346+0000","last_peered":"2023-08-27T11:27:45.038346+0000","last_clean":"2023-08-27T11:27:45.038346+0000","last_became_active":"2023-08-27T11:27:45.030147+0000","last_became_peered":"2023-08-27T11:27:45.030147+0000","last_unstale":"2023-08-27T11:27:45.038346+0000","last_undegraded":"2023-08-27T11:27:45.038346+0000","last_fullsized":"2023-08-27T11:27:45.038346+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:07:11.182991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.044825+0000","last_change":"2023-08-27T11:27:44.011852+0000","last_active":"2023-08-27T11:27:45.044825+0000","last_peered":"2023-08-27T11:27:45.044825+0000","last_clean":"2023-08-27T11:27:45.044825+0000","last_became_active":"2023-08-27T11:27:44.011563+0000","last_became_peered":"2023-08-27T11:27:44.011563+0000","last_unstale":"2023-08-27T11:27:45.044825+0000","last_undegraded":"2023-08-27T11:27:45.044825+0000","last_fullsized":"2023-08-27T11:27:45.044825+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:47:36.826412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039982+0000","last_change":"2023-08-27T11:27:45.036889+0000","last_active":"2023-08-27T11:27:45.039982+0000","last_peered":"2023-08-27T11:27:45.039982+0000","last_clean":"2023-08-27T11:27:45.039982+0000","last_became_active":"2023-08-27T11:27:45.036620+0000","last_became_peered":"2023-08-27T11:27:45.036620+0000","last_unstale":"2023-08-27T11:27:45.039982+0000","last_undegraded":"2023-08-27T11:27:45.039982+0000","last_fullsized":"2023-08-27T11:27:45.039982+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:05.730153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031027+0000","last_change":"2023-08-27T11:27:44.005219+0000","last_active":"2023-08-27T11:27:45.031027+0000","last_peered":"2023-08-27T11:27:45.031027+0000","last_clean":"2023-08-27T11:27:45.031027+0000","last_became_active":"2023-08-27T11:27:44.004928+0000","last_became_peered":"2023-08-27T11:27:44.004928+0000","last_unstale":"2023-08-27T11:27:45.031027+0000","last_undegraded":"2023-08-27T11:27:45.031027+0000","last_fullsized":"2023-08-27T11:27:45.031027+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:15.722279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.031059+0000","last_change":"2023-08-27T11:27:45.023988+0000","last_active":"2023-08-27T11:27:45.031059+0000","last_peered":"2023-08-27T11:27:45.031059+0000","last_clean":"2023-08-27T11:27:45.031059+0000","last_became_active":"2023-08-27T11:27:45.023673+0000","last_became_peered":"2023-08-27T11:27:45.023673+0000","last_unstale":"2023-08-27T11:27:45.031059+0000","last_undegraded":"2023-08-27T11:27:45.031059+0000","last_fullsized":"2023-08-27T11:27:45.031059+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:54.636629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047568+0000","last_change":"2023-08-27T11:27:44.005378+0000","last_active":"2023-08-27T11:27:45.047568+0000","last_peered":"2023-08-27T11:27:45.047568+0000","last_clean":"2023-08-27T11:27:45.047568+0000","last_became_active":"2023-08-27T11:27:44.005103+0000","last_became_peered":"2023-08-27T11:27:44.005103+0000","last_unstale":"2023-08-27T11:27:45.047568+0000","last_undegraded":"2023-08-27T11:27:45.047568+0000","last_fullsized":"2023-08-27T11:27:45.047568+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:27.456736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047228+0000","last_change":"2023-08-27T11:27:45.041000+0000","last_active":"2023-08-27T11:27:45.047228+0000","last_peered":"2023-08-27T11:27:45.047228+0000","last_clean":"2023-08-27T11:27:45.047228+0000","last_became_active":"2023-08-27T11:27:45.035181+0000","last_became_peered":"2023-08-27T11:27:45.035181+0000","last_unstale":"2023-08-27T11:27:45.047228+0000","last_undegraded":"2023-08-27T11:27:45.047228+0000","last_fullsized":"2023-08-27T11:27:45.047228+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:54.041302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013850+0000","last_change":"2023-08-27T11:27:44.005290+0000","last_active":"2023-08-27T11:27:45.013850+0000","last_peered":"2023-08-27T11:27:45.013850+0000","last_clean":"2023-08-27T11:27:45.013850+0000","last_became_active":"2023-08-27T11:27:44.004856+0000","last_became_peered":"2023-08-27T11:27:44.004856+0000","last_unstale":"2023-08-27T11:27:45.013850+0000","last_undegraded":"2023-08-27T11:27:45.013850+0000","last_fullsized":"2023-08-27T11:27:45.013850+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:32.419381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.046297+0000","last_change":"2023-08-27T11:27:45.045166+0000","last_active":"2023-08-27T11:27:45.046297+0000","last_peered":"2023-08-27T11:27:45.046297+0000","last_clean":"2023-08-27T11:27:45.046297+0000","last_became_active":"2023-08-27T11:27:45.044842+0000","last_became_peered":"2023-08-27T11:27:45.044842+0000","last_unstale":"2023-08-27T11:27:45.046297+0000","last_undegraded":"2023-08-27T11:27:45.046297+0000","last_fullsized":"2023-08-27T11:27:45.046297+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:05.916888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026779+0000","last_change":"2023-08-27T11:27:44.012469+0000","last_active":"2023-08-27T11:27:45.026779+0000","last_peered":"2023-08-27T11:27:45.026779+0000","last_clean":"2023-08-27T11:27:45.026779+0000","last_became_active":"2023-08-27T11:27:44.012188+0000","last_became_peered":"2023-08-27T11:27:44.012188+0000","last_unstale":"2023-08-27T11:27:45.026779+0000","last_undegraded":"2023-08-27T11:27:45.026779+0000","last_fullsized":"2023-08-27T11:27:45.026779+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:26:04.968352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039892+0000","last_change":"2023-08-27T11:27:45.036431+0000","last_active":"2023-08-27T11:27:45.039892+0000","last_peered":"2023-08-27T11:27:45.039892+0000","last_clean":"2023-08-27T11:27:45.039892+0000","last_became_active":"2023-08-27T11:27:45.034565+0000","last_became_peered":"2023-08-27T11:27:45.034565+0000","last_unstale":"2023-08-27T11:27:45.039892+0000","last_undegraded":"2023-08-27T11:27:45.039892+0000","last_fullsized":"2023-08-27T11:27:45.039892+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:56.609127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029721+0000","last_change":"2023-08-27T11:27:44.010841+0000","last_active":"2023-08-27T11:27:45.029721+0000","last_peered":"2023-08-27T11:27:45.029721+0000","last_clean":"2023-08-27T11:27:45.029721+0000","last_became_active":"2023-08-27T11:27:44.010536+0000","last_became_peered":"2023-08-27T11:27:44.010536+0000","last_unstale":"2023-08-27T11:27:45.029721+0000","last_undegraded":"2023-08-27T11:27:45.029721+0000","last_fullsized":"2023-08-27T11:27:45.029721+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:01.756461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042920+0000","last_change":"2023-08-27T11:27:45.042008+0000","last_active":"2023-08-27T11:27:45.042920+0000","last_peered":"2023-08-27T11:27:45.042920+0000","last_clean":"2023-08-27T11:27:45.042920+0000","last_became_active":"2023-08-27T11:27:45.041614+0000","last_became_peered":"2023-08-27T11:27:45.041614+0000","last_unstale":"2023-08-27T11:27:45.042920+0000","last_undegraded":"2023-08-27T11:27:45.042920+0000","last_fullsized":"2023-08-27T11:27:45.042920+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:47.222790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032616+0000","last_change":"2023-08-27T11:27:44.011250+0000","last_active":"2023-08-27T11:27:45.032616+0000","last_peered":"2023-08-27T11:27:45.032616+0000","last_clean":"2023-08-27T11:27:45.032616+0000","last_became_active":"2023-08-27T11:27:44.010875+0000","last_became_peered":"2023-08-27T11:27:44.010875+0000","last_unstale":"2023-08-27T11:27:45.032616+0000","last_undegraded":"2023-08-27T11:27:45.032616+0000","last_fullsized":"2023-08-27T11:27:45.032616+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:49:59.614612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042614+0000","last_change":"2023-08-27T11:27:45.035654+0000","last_active":"2023-08-27T11:27:45.042614+0000","last_peered":"2023-08-27T11:27:45.042614+0000","last_clean":"2023-08-27T11:27:45.042614+0000","last_became_active":"2023-08-27T11:27:45.035381+0000","last_became_peered":"2023-08-27T11:27:45.035381+0000","last_unstale":"2023-08-27T11:27:45.042614+0000","last_undegraded":"2023-08-27T11:27:45.042614+0000","last_fullsized":"2023-08-27T11:27:45.042614+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:05.268776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"109'1","reported_seq":12,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.032853+0000","last_change":"2023-08-27T11:27:44.007463+0000","last_active":"2023-08-27T11:27:45.032853+0000","last_peered":"2023-08-27T11:27:45.032853+0000","last_clean":"2023-08-27T11:27:45.032853+0000","last_became_active":"2023-08-27T11:27:44.007075+0000","last_became_peered":"2023-08-27T11:27:44.007075+0000","last_unstale":"2023-08-27T11:27:45.032853+0000","last_undegraded":"2023-08-27T11:27:45.032853+0000","last_fullsized":"2023-08-27T11:27:45.032853+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:04:09.312895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030592+0000","last_change":"2023-08-27T11:27:45.025235+0000","last_active":"2023-08-27T11:27:45.030592+0000","last_peered":"2023-08-27T11:27:45.030592+0000","last_clean":"2023-08-27T11:27:45.030592+0000","last_became_active":"2023-08-27T11:27:45.024921+0000","last_became_peered":"2023-08-27T11:27:45.024921+0000","last_unstale":"2023-08-27T11:27:45.030592+0000","last_undegraded":"2023-08-27T11:27:45.030592+0000","last_fullsized":"2023-08-27T11:27:45.030592+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:47:37.830884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016481+0000","last_change":"2023-08-27T11:27:44.010804+0000","last_active":"2023-08-27T11:27:45.016481+0000","last_peered":"2023-08-27T11:27:45.016481+0000","last_clean":"2023-08-27T11:27:45.016481+0000","last_became_active":"2023-08-27T11:27:44.010517+0000","last_became_peered":"2023-08-27T11:27:44.010517+0000","last_unstale":"2023-08-27T11:27:45.016481+0000","last_undegraded":"2023-08-27T11:27:45.016481+0000","last_fullsized":"2023-08-27T11:27:45.016481+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:40:22.018004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042661+0000","last_change":"2023-08-27T11:27:45.035923+0000","last_active":"2023-08-27T11:27:45.042661+0000","last_peered":"2023-08-27T11:27:45.042661+0000","last_clean":"2023-08-27T11:27:45.042661+0000","last_became_active":"2023-08-27T11:27:45.035654+0000","last_became_peered":"2023-08-27T11:27:45.035654+0000","last_unstale":"2023-08-27T11:27:45.042661+0000","last_undegraded":"2023-08-27T11:27:45.042661+0000","last_fullsized":"2023-08-27T11:27:45.042661+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:39:59.352697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.029030+0000","last_change":"2023-08-27T11:27:44.011802+0000","last_active":"2023-08-27T11:27:45.029030+0000","last_peered":"2023-08-27T11:27:45.029030+0000","last_clean":"2023-08-27T11:27:45.029030+0000","last_became_active":"2023-08-27T11:27:44.011487+0000","last_became_peered":"2023-08-27T11:27:44.011487+0000","last_unstale":"2023-08-27T11:27:45.029030+0000","last_undegraded":"2023-08-27T11:27:45.029030+0000","last_fullsized":"2023-08-27T11:27:45.029030+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:39:58.033476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050120+0000","last_change":"2023-08-27T11:27:45.048635+0000","last_active":"2023-08-27T11:27:45.050120+0000","last_peered":"2023-08-27T11:27:45.050120+0000","last_clean":"2023-08-27T11:27:45.050120+0000","last_became_active":"2023-08-27T11:27:45.044063+0000","last_became_peered":"2023-08-27T11:27:45.044063+0000","last_unstale":"2023-08-27T11:27:45.050120+0000","last_undegraded":"2023-08-27T11:27:45.050120+0000","last_fullsized":"2023-08-27T11:27:45.050120+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:34:59.943383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016799+0000","last_change":"2023-08-27T11:27:44.006396+0000","last_active":"2023-08-27T11:27:45.016799+0000","last_peered":"2023-08-27T11:27:45.016799+0000","last_clean":"2023-08-27T11:27:45.016799+0000","last_became_active":"2023-08-27T11:27:44.006099+0000","last_became_peered":"2023-08-27T11:27:44.006099+0000","last_unstale":"2023-08-27T11:27:45.016799+0000","last_undegraded":"2023-08-27T11:27:45.016799+0000","last_fullsized":"2023-08-27T11:27:45.016799+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:10:28.705020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047251+0000","last_change":"2023-08-27T11:27:45.041054+0000","last_active":"2023-08-27T11:27:45.047251+0000","last_peered":"2023-08-27T11:27:45.047251+0000","last_clean":"2023-08-27T11:27:45.047251+0000","last_became_active":"2023-08-27T11:27:45.035587+0000","last_became_peered":"2023-08-27T11:27:45.035587+0000","last_unstale":"2023-08-27T11:27:45.047251+0000","last_undegraded":"2023-08-27T11:27:45.047251+0000","last_fullsized":"2023-08-27T11:27:45.047251+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:18.733835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.023848+0000","last_change":"2023-08-27T11:27:44.007427+0000","last_active":"2023-08-27T11:27:45.023848+0000","last_peered":"2023-08-27T11:27:45.023848+0000","last_clean":"2023-08-27T11:27:45.023848+0000","last_became_active":"2023-08-27T11:27:44.007131+0000","last_became_peered":"2023-08-27T11:27:44.007131+0000","last_unstale":"2023-08-27T11:27:45.023848+0000","last_undegraded":"2023-08-27T11:27:45.023848+0000","last_fullsized":"2023-08-27T11:27:45.023848+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:27.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033407+0000","last_change":"2023-08-27T11:27:45.030283+0000","last_active":"2023-08-27T11:27:45.033407+0000","last_peered":"2023-08-27T11:27:45.033407+0000","last_clean":"2023-08-27T11:27:45.033407+0000","last_became_active":"2023-08-27T11:27:45.029967+0000","last_became_peered":"2023-08-27T11:27:45.029967+0000","last_unstale":"2023-08-27T11:27:45.033407+0000","last_undegraded":"2023-08-27T11:27:45.033407+0000","last_fullsized":"2023-08-27T11:27:45.033407+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:00:02.760933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.015586+0000","last_change":"2023-08-27T11:27:44.007332+0000","last_active":"2023-08-27T11:27:45.015586+0000","last_peered":"2023-08-27T11:27:45.015586+0000","last_clean":"2023-08-27T11:27:45.015586+0000","last_became_active":"2023-08-27T11:27:44.006951+0000","last_became_peered":"2023-08-27T11:27:44.006951+0000","last_unstale":"2023-08-27T11:27:45.015586+0000","last_undegraded":"2023-08-27T11:27:45.015586+0000","last_fullsized":"2023-08-27T11:27:45.015586+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:13.862168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042557+0000","last_change":"2023-08-27T11:27:45.031306+0000","last_active":"2023-08-27T11:27:45.042557+0000","last_peered":"2023-08-27T11:27:45.042557+0000","last_clean":"2023-08-27T11:27:45.042557+0000","last_became_active":"2023-08-27T11:27:45.030726+0000","last_became_peered":"2023-08-27T11:27:45.030726+0000","last_unstale":"2023-08-27T11:27:45.042557+0000","last_undegraded":"2023-08-27T11:27:45.042557+0000","last_fullsized":"2023-08-27T11:27:45.042557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:08.068596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.028960+0000","last_change":"2023-08-27T11:27:44.005387+0000","last_active":"2023-08-27T11:27:45.028960+0000","last_peered":"2023-08-27T11:27:45.028960+0000","last_clean":"2023-08-27T11:27:45.028960+0000","last_became_active":"2023-08-27T11:27:44.005014+0000","last_became_peered":"2023-08-27T11:27:44.005014+0000","last_unstale":"2023-08-27T11:27:45.028960+0000","last_undegraded":"2023-08-27T11:27:45.028960+0000","last_fullsized":"2023-08-27T11:27:45.028960+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:58:40.980814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.040051+0000","last_change":"2023-08-27T11:27:45.037380+0000","last_active":"2023-08-27T11:27:45.040051+0000","last_peered":"2023-08-27T11:27:45.040051+0000","last_clean":"2023-08-27T11:27:45.040051+0000","last_became_active":"2023-08-27T11:27:45.037180+0000","last_became_peered":"2023-08-27T11:27:45.037180+0000","last_unstale":"2023-08-27T11:27:45.040051+0000","last_undegraded":"2023-08-27T11:27:45.040051+0000","last_fullsized":"2023-08-27T11:27:45.040051+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:35:34.814839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.009511+0000","last_change":"2023-08-27T11:27:44.009559+0000","last_active":"2023-08-27T11:27:45.009511+0000","last_peered":"2023-08-27T11:27:45.009511+0000","last_clean":"2023-08-27T11:27:45.009511+0000","last_became_active":"2023-08-27T11:27:44.009156+0000","last_became_peered":"2023-08-27T11:27:44.009156+0000","last_unstale":"2023-08-27T11:27:45.009511+0000","last_undegraded":"2023-08-27T11:27:45.009511+0000","last_fullsized":"2023-08-27T11:27:45.009511+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:40.552929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033417+0000","last_change":"2023-08-27T11:27:45.028918+0000","last_active":"2023-08-27T11:27:45.033417+0000","last_peered":"2023-08-27T11:27:45.033417+0000","last_clean":"2023-08-27T11:27:45.033417+0000","last_became_active":"2023-08-27T11:27:45.028613+0000","last_became_peered":"2023-08-27T11:27:45.028613+0000","last_unstale":"2023-08-27T11:27:45.033417+0000","last_undegraded":"2023-08-27T11:27:45.033417+0000","last_fullsized":"2023-08-27T11:27:45.033417+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:31:52.619488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008848+0000","last_change":"2023-08-27T11:27:44.008852+0000","last_active":"2023-08-27T11:27:45.008848+0000","last_peered":"2023-08-27T11:27:45.008848+0000","last_clean":"2023-08-27T11:27:45.008848+0000","last_became_active":"2023-08-27T11:27:44.008414+0000","last_became_peered":"2023-08-27T11:27:44.008414+0000","last_unstale":"2023-08-27T11:27:45.008848+0000","last_undegraded":"2023-08-27T11:27:45.008848+0000","last_fullsized":"2023-08-27T11:27:45.008848+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:18:13.282050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033319+0000","last_change":"2023-08-27T11:27:45.026915+0000","last_active":"2023-08-27T11:27:45.033319+0000","last_peered":"2023-08-27T11:27:45.033319+0000","last_clean":"2023-08-27T11:27:45.033319+0000","last_became_active":"2023-08-27T11:27:45.024556+0000","last_became_peered":"2023-08-27T11:27:45.024556+0000","last_unstale":"2023-08-27T11:27:45.033319+0000","last_undegraded":"2023-08-27T11:27:45.033319+0000","last_fullsized":"2023-08-27T11:27:45.033319+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:50.788650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026274+0000","last_change":"2023-08-27T11:27:44.012518+0000","last_active":"2023-08-27T11:27:45.026274+0000","last_peered":"2023-08-27T11:27:45.026274+0000","last_clean":"2023-08-27T11:27:45.026274+0000","last_became_active":"2023-08-27T11:27:44.012206+0000","last_became_peered":"2023-08-27T11:27:44.012206+0000","last_unstale":"2023-08-27T11:27:45.026274+0000","last_undegraded":"2023-08-27T11:27:45.026274+0000","last_fullsized":"2023-08-27T11:27:45.026274+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:51.142132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042641+0000","last_change":"2023-08-27T11:27:45.033110+0000","last_active":"2023-08-27T11:27:45.042641+0000","last_peered":"2023-08-27T11:27:45.042641+0000","last_clean":"2023-08-27T11:27:45.042641+0000","last_became_active":"2023-08-27T11:27:45.031993+0000","last_became_peered":"2023-08-27T11:27:45.031993+0000","last_unstale":"2023-08-27T11:27:45.042641+0000","last_undegraded":"2023-08-27T11:27:45.042641+0000","last_fullsized":"2023-08-27T11:27:45.042641+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:47:41.941751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012294+0000","last_change":"2023-08-27T11:27:44.007444+0000","last_active":"2023-08-27T11:27:45.012294+0000","last_peered":"2023-08-27T11:27:45.012294+0000","last_clean":"2023-08-27T11:27:45.012294+0000","last_became_active":"2023-08-27T11:27:44.007171+0000","last_became_peered":"2023-08-27T11:27:44.007171+0000","last_unstale":"2023-08-27T11:27:45.012294+0000","last_undegraded":"2023-08-27T11:27:45.012294+0000","last_fullsized":"2023-08-27T11:27:45.012294+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:27.340662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.048744+0000","last_change":"2023-08-27T11:27:45.035608+0000","last_active":"2023-08-27T11:27:45.048744+0000","last_peered":"2023-08-27T11:27:45.048744+0000","last_clean":"2023-08-27T11:27:45.048744+0000","last_became_active":"2023-08-27T11:27:45.035310+0000","last_became_peered":"2023-08-27T11:27:45.035310+0000","last_unstale":"2023-08-27T11:27:45.048744+0000","last_undegraded":"2023-08-27T11:27:45.048744+0000","last_fullsized":"2023-08-27T11:27:45.048744+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:35.357053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013541+0000","last_change":"2023-08-27T11:27:44.003921+0000","last_active":"2023-08-27T11:27:45.013541+0000","last_peered":"2023-08-27T11:27:45.013541+0000","last_clean":"2023-08-27T11:27:45.013541+0000","last_became_active":"2023-08-27T11:27:44.003632+0000","last_became_peered":"2023-08-27T11:27:44.003632+0000","last_unstale":"2023-08-27T11:27:45.013541+0000","last_undegraded":"2023-08-27T11:27:45.013541+0000","last_fullsized":"2023-08-27T11:27:45.013541+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:11:40.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.039548+0000","last_change":"2023-08-27T11:27:45.034320+0000","last_active":"2023-08-27T11:27:45.039548+0000","last_peered":"2023-08-27T11:27:45.039548+0000","last_clean":"2023-08-27T11:27:45.039548+0000","last_became_active":"2023-08-27T11:27:45.034071+0000","last_became_peered":"2023-08-27T11:27:45.034071+0000","last_unstale":"2023-08-27T11:27:45.039548+0000","last_undegraded":"2023-08-27T11:27:45.039548+0000","last_fullsized":"2023-08-27T11:27:45.039548+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:56:53.171394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016390+0000","last_change":"2023-08-27T11:27:44.008722+0000","last_active":"2023-08-27T11:27:45.016390+0000","last_peered":"2023-08-27T11:27:45.016390+0000","last_clean":"2023-08-27T11:27:45.016390+0000","last_became_active":"2023-08-27T11:27:44.008244+0000","last_became_peered":"2023-08-27T11:27:44.008244+0000","last_unstale":"2023-08-27T11:27:45.016390+0000","last_undegraded":"2023-08-27T11:27:45.016390+0000","last_fullsized":"2023-08-27T11:27:45.016390+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:29.434418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026275+0000","last_change":"2023-08-27T11:27:45.024803+0000","last_active":"2023-08-27T11:27:45.026275+0000","last_peered":"2023-08-27T11:27:45.026275+0000","last_clean":"2023-08-27T11:27:45.026275+0000","last_became_active":"2023-08-27T11:27:45.024507+0000","last_became_peered":"2023-08-27T11:27:45.024507+0000","last_unstale":"2023-08-27T11:27:45.026275+0000","last_undegraded":"2023-08-27T11:27:45.026275+0000","last_fullsized":"2023-08-27T11:27:45.026275+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:28:53.409382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016723+0000","last_change":"2023-08-27T11:27:44.005243+0000","last_active":"2023-08-27T11:27:45.016723+0000","last_peered":"2023-08-27T11:27:45.016723+0000","last_clean":"2023-08-27T11:27:45.016723+0000","last_became_active":"2023-08-27T11:27:44.004877+0000","last_became_peered":"2023-08-27T11:27:44.004877+0000","last_unstale":"2023-08-27T11:27:45.016723+0000","last_undegraded":"2023-08-27T11:27:45.016723+0000","last_fullsized":"2023-08-27T11:27:45.016723+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:17:29.653398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033326+0000","last_change":"2023-08-27T11:27:45.027609+0000","last_active":"2023-08-27T11:27:45.033326+0000","last_peered":"2023-08-27T11:27:45.033326+0000","last_clean":"2023-08-27T11:27:45.033326+0000","last_became_active":"2023-08-27T11:27:45.027302+0000","last_became_peered":"2023-08-27T11:27:45.027302+0000","last_unstale":"2023-08-27T11:27:45.033326+0000","last_undegraded":"2023-08-27T11:27:45.033326+0000","last_fullsized":"2023-08-27T11:27:45.033326+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:08.810413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008414+0000","last_change":"2023-08-27T11:27:44.007720+0000","last_active":"2023-08-27T11:27:45.008414+0000","last_peered":"2023-08-27T11:27:45.008414+0000","last_clean":"2023-08-27T11:27:45.008414+0000","last_became_active":"2023-08-27T11:27:44.007098+0000","last_became_peered":"2023-08-27T11:27:44.007098+0000","last_unstale":"2023-08-27T11:27:45.008414+0000","last_undegraded":"2023-08-27T11:27:45.008414+0000","last_fullsized":"2023-08-27T11:27:45.008414+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:51.842321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008517+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:27:45.008517+0000","last_peered":"2023-08-27T11:27:45.008517+0000","last_clean":"2023-08-27T11:27:45.008517+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:27:45.008517+0000","last_undegraded":"2023-08-27T11:27:45.008517+0000","last_fullsized":"2023-08-27T11:27:45.008517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:06:52.699014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.042931+0000","last_change":"2023-08-27T11:27:45.041883+0000","last_active":"2023-08-27T11:27:45.042931+0000","last_peered":"2023-08-27T11:27:45.042931+0000","last_clean":"2023-08-27T11:27:45.042931+0000","last_became_active":"2023-08-27T11:27:45.041462+0000","last_became_peered":"2023-08-27T11:27:45.041462+0000","last_unstale":"2023-08-27T11:27:45.042931+0000","last_undegraded":"2023-08-27T11:27:45.042931+0000","last_fullsized":"2023-08-27T11:27:45.042931+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:05.302417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012311+0000","last_change":"2023-08-27T11:27:44.009988+0000","last_active":"2023-08-27T11:27:45.012311+0000","last_peered":"2023-08-27T11:27:45.012311+0000","last_clean":"2023-08-27T11:27:45.012311+0000","last_became_active":"2023-08-27T11:27:44.009635+0000","last_became_peered":"2023-08-27T11:27:44.009635+0000","last_unstale":"2023-08-27T11:27:45.012311+0000","last_undegraded":"2023-08-27T11:27:45.012311+0000","last_fullsized":"2023-08-27T11:27:45.012311+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:59.863156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.008117+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:27:45.008117+0000","last_peered":"2023-08-27T11:27:45.008117+0000","last_clean":"2023-08-27T11:27:45.008117+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:27:45.008117+0000","last_undegraded":"2023-08-27T11:27:45.008117+0000","last_fullsized":"2023-08-27T11:27:45.008117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:37:53.396483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.026557+0000","last_change":"2023-08-27T11:27:45.023280+0000","last_active":"2023-08-27T11:27:45.026557+0000","last_peered":"2023-08-27T11:27:45.026557+0000","last_clean":"2023-08-27T11:27:45.026557+0000","last_became_active":"2023-08-27T11:27:45.022950+0000","last_became_peered":"2023-08-27T11:27:45.022950+0000","last_unstale":"2023-08-27T11:27:45.026557+0000","last_undegraded":"2023-08-27T11:27:45.026557+0000","last_fullsized":"2023-08-27T11:27:45.026557+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:57.287445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.023696+0000","last_change":"2023-08-27T11:27:44.008208+0000","last_active":"2023-08-27T11:27:45.023696+0000","last_peered":"2023-08-27T11:27:45.023696+0000","last_clean":"2023-08-27T11:27:45.023696+0000","last_became_active":"2023-08-27T11:27:44.007902+0000","last_became_peered":"2023-08-27T11:27:44.007902+0000","last_unstale":"2023-08-27T11:27:45.023696+0000","last_undegraded":"2023-08-27T11:27:45.023696+0000","last_fullsized":"2023-08-27T11:27:45.023696+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:15.722279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":193,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012210+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:27:45.012210+0000","last_peered":"2023-08-27T11:27:45.012210+0000","last_clean":"2023-08-27T11:27:45.012210+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:27:45.012210+0000","last_undegraded":"2023-08-27T11:27:45.012210+0000","last_fullsized":"2023-08-27T11:27:45.012210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:28.545718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.038443+0000","last_change":"2023-08-27T11:27:45.030839+0000","last_active":"2023-08-27T11:27:45.038443+0000","last_peered":"2023-08-27T11:27:45.038443+0000","last_clean":"2023-08-27T11:27:45.038443+0000","last_became_active":"2023-08-27T11:27:45.029586+0000","last_became_peered":"2023-08-27T11:27:45.029586+0000","last_unstale":"2023-08-27T11:27:45.038443+0000","last_undegraded":"2023-08-27T11:27:45.038443+0000","last_fullsized":"2023-08-27T11:27:45.038443+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:19:14.622316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"109'8","reported_seq":19,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.049684+0000","last_change":"2023-08-27T11:27:44.005995+0000","last_active":"2023-08-27T11:27:45.049684+0000","last_peered":"2023-08-27T11:27:45.049684+0000","last_clean":"2023-08-27T11:27:45.049684+0000","last_became_active":"2023-08-27T11:27:44.005680+0000","last_became_peered":"2023-08-27T11:27:44.005680+0000","last_unstale":"2023-08-27T11:27:45.049684+0000","last_undegraded":"2023-08-27T11:27:45.049684+0000","last_fullsized":"2023-08-27T11:27:45.049684+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:22.234358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.017611+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:27:45.017611+0000","last_peered":"2023-08-27T11:27:45.017611+0000","last_clean":"2023-08-27T11:27:45.017611+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:27:45.017611+0000","last_undegraded":"2023-08-27T11:27:45.017611+0000","last_fullsized":"2023-08-27T11:27:45.017611+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:42:20.955972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.033279+0000","last_change":"2023-08-27T11:27:45.032199+0000","last_active":"2023-08-27T11:27:45.033279+0000","last_peered":"2023-08-27T11:27:45.033279+0000","last_clean":"2023-08-27T11:27:45.033279+0000","last_became_active":"2023-08-27T11:27:45.031897+0000","last_became_peered":"2023-08-27T11:27:45.031897+0000","last_unstale":"2023-08-27T11:27:45.033279+0000","last_undegraded":"2023-08-27T11:27:45.033279+0000","last_fullsized":"2023-08-27T11:27:45.033279+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:09:42.219143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.030165+0000","last_change":"2023-08-27T11:27:44.006594+0000","last_active":"2023-08-27T11:27:45.030165+0000","last_peered":"2023-08-27T11:27:45.030165+0000","last_clean":"2023-08-27T11:27:45.030165+0000","last_became_active":"2023-08-27T11:27:44.006156+0000","last_became_peered":"2023-08-27T11:27:44.006156+0000","last_unstale":"2023-08-27T11:27:45.030165+0000","last_undegraded":"2023-08-27T11:27:45.030165+0000","last_fullsized":"2023-08-27T11:27:45.030165+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:16:53.632157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":171,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.017355+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:27:45.017355+0000","last_peered":"2023-08-27T11:27:45.017355+0000","last_clean":"2023-08-27T11:27:45.017355+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:27:45.017355+0000","last_undegraded":"2023-08-27T11:27:45.017355+0000","last_fullsized":"2023-08-27T11:27:45.017355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:03:42.951769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.051659+0000","last_change":"2023-08-27T11:27:45.050252+0000","last_active":"2023-08-27T11:27:45.051659+0000","last_peered":"2023-08-27T11:27:45.051659+0000","last_clean":"2023-08-27T11:27:45.051659+0000","last_became_active":"2023-08-27T11:27:45.049975+0000","last_became_peered":"2023-08-27T11:27:45.049975+0000","last_unstale":"2023-08-27T11:27:45.051659+0000","last_undegraded":"2023-08-27T11:27:45.051659+0000","last_fullsized":"2023-08-27T11:27:45.051659+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:10.378974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"109'2","reported_seq":13,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.044136+0000","last_change":"2023-08-27T11:27:44.007004+0000","last_active":"2023-08-27T11:27:45.044136+0000","last_peered":"2023-08-27T11:27:45.044136+0000","last_clean":"2023-08-27T11:27:45.044136+0000","last_became_active":"2023-08-27T11:27:44.006712+0000","last_became_peered":"2023-08-27T11:27:44.006712+0000","last_unstale":"2023-08-27T11:27:45.044136+0000","last_undegraded":"2023-08-27T11:27:45.044136+0000","last_fullsized":"2023-08-27T11:27:45.044136+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:24:26.730573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":319,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.016843+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:27:45.016843+0000","last_peered":"2023-08-27T11:27:45.016843+0000","last_clean":"2023-08-27T11:27:45.016843+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:27:45.016843+0000","last_undegraded":"2023-08-27T11:27:45.016843+0000","last_fullsized":"2023-08-27T11:27:45.016843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:56:21.994448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":173,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.018437+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:27:45.018437+0000","last_peered":"2023-08-27T11:27:45.018437+0000","last_clean":"2023-08-27T11:27:45.018437+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:27:45.018437+0000","last_undegraded":"2023-08-27T11:27:45.018437+0000","last_fullsized":"2023-08-27T11:27:45.018437+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:23.635363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.034353+0000","last_change":"2023-08-27T11:27:45.030844+0000","last_active":"2023-08-27T11:27:45.034353+0000","last_peered":"2023-08-27T11:27:45.034353+0000","last_clean":"2023-08-27T11:27:45.034353+0000","last_became_active":"2023-08-27T11:27:45.030332+0000","last_became_peered":"2023-08-27T11:27:45.030332+0000","last_unstale":"2023-08-27T11:27:45.034353+0000","last_undegraded":"2023-08-27T11:27:45.034353+0000","last_fullsized":"2023-08-27T11:27:45.034353+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:03:05.730153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"109'6","reported_seq":17,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.050827+0000","last_change":"2023-08-27T11:27:44.008005+0000","last_active":"2023-08-27T11:27:45.050827+0000","last_peered":"2023-08-27T11:27:45.050827+0000","last_clean":"2023-08-27T11:27:45.050827+0000","last_became_active":"2023-08-27T11:27:44.007654+0000","last_became_peered":"2023-08-27T11:27:44.007654+0000","last_unstale":"2023-08-27T11:27:45.050827+0000","last_undegraded":"2023-08-27T11:27:45.050827+0000","last_fullsized":"2023-08-27T11:27:45.050827+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:26:00.841517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":175,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.012728+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:27:45.012728+0000","last_peered":"2023-08-27T11:27:45.012728+0000","last_clean":"2023-08-27T11:27:45.012728+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:27:45.012728+0000","last_undegraded":"2023-08-27T11:27:45.012728+0000","last_fullsized":"2023-08-27T11:27:45.012728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:02:24.838670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.047133+0000","last_change":"2023-08-27T11:27:45.043790+0000","last_active":"2023-08-27T11:27:45.047133+0000","last_peered":"2023-08-27T11:27:45.047133+0000","last_clean":"2023-08-27T11:27:45.047133+0000","last_became_active":"2023-08-27T11:27:45.040003+0000","last_became_peered":"2023-08-27T11:27:45.040003+0000","last_unstale":"2023-08-27T11:27:45.047133+0000","last_undegraded":"2023-08-27T11:27:45.047133+0000","last_fullsized":"2023-08-27T11:27:45.047133+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":108,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:43.979763+0000","last_clean_scrub_stamp":"2023-08-27T11:27:43.979763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:27:09.235918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"109'3","reported_seq":14,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.035710+0000","last_change":"2023-08-27T11:27:44.009400+0000","last_active":"2023-08-27T11:27:45.035710+0000","last_peered":"2023-08-27T11:27:45.035710+0000","last_clean":"2023-08-27T11:27:45.035710+0000","last_became_active":"2023-08-27T11:27:44.009127+0000","last_became_peered":"2023-08-27T11:27:44.009127+0000","last_unstale":"2023-08-27T11:27:45.035710+0000","last_undegraded":"2023-08-27T11:27:45.035710+0000","last_fullsized":"2023-08-27T11:27:45.035710+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":107,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:27:42.975291+0000","last_clean_scrub_stamp":"2023-08-27T11:27:42.975291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:10:48.151916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":187,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-08-27T11:27:45.013796+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:27:45.013796+0000","last_peered":"2023-08-27T11:27:45.013796+0000","last_clean":"2023-08-27T11:27:45.013796+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:27:45.013796+0000","last_undegraded":"2023-08-27T11:27:45.013796+0000","last_fullsized":"2023-08-27T11:27:45.013796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:20:02.077713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28920,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342920,"statfs":{"total":96636764160,"available":96607150080,"internally_reserved":0,"allocated":1937408,"data_stored":1217825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.81399999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.69399999999999995}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.874},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":634181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.77200000000000002,"15min":0.89600000000000002},"min":{"1min":0.48799999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.82599999999999996,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.873,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72999999999999998,"15min":0.78000000000000003},"min":{"1min":0.435,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97999999999999998,"5min":3.472,"15min":3.472},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.82199999999999995,"15min":0.96599999999999997},"min":{"1min":0.56899999999999995,"5min":0.371,"15min":0.371},"max":{"1min":0.85699999999999998,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72099999999999997,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.621},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.77200000000000002,"15min":0.83799999999999997},"min":{"1min":0.47699999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.875,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.84699999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.84299999999999997,"15min":0.97299999999999998},"min":{"1min":0.48399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93700000000000006,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.85699999999999998},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96199999999999997,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.71299999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.55600000000000005,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.234,"15min":1.234},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.80500000000000005},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0189999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.748,"15min":0.76600000000000001},"min":{"1min":0.50900000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.0349999999999999,"5min":1.135,"15min":1.135},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.82899999999999996,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0609999999999999,"5min":1.127,"15min":1.127},"last":0.95199999999999996}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.84899999999999998,"15min":0.88700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0640000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.876},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83499999999999996,"15min":0.86699999999999999},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.073,"5min":1.27,"15min":1.27},"last":0.79200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1953792,"data_stored":1224975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.28699999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66500000000000004,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.49399999999999999,"15min":0.47799999999999998},"min":{"1min":0.373,"5min":0.253,"15min":0.253},"max":{"1min":0.69699999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.35299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59099999999999997,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.35099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76300000000000001,"5min":2.734,"15min":2.734},"last":0.30599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.69899999999999995,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.89700000000000002,"5min":3.101,"15min":3.101},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.54500000000000004,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0429999999999999,"5min":3.359,"15min":3.359},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.51500000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0349999999999999,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79700000000000004,"15min":0.81999999999999995},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.028,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.63400000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.96999999999999997,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0569999999999999,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84499999999999997,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.96199999999999997,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":633621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.32700000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.52100000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51500000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.41999999999999998,"15min":0.41599999999999998},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54900000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.373},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.503},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.62,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.373,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.62,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69699999999999995,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.51200000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89000000000000001,"5min":1.355,"15min":1.355},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88500000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.58899999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.90900000000000003,"5min":1.123,"15min":1.123},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.872,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.76100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.747,"15min":0.76000000000000001},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":1.329,"15min":1.329},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.755,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.88,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:26:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.90000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.872},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60399999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.91200000000000003,"5min":1.288,"15min":1.288},"last":0.71999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28348,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343492,"statfs":{"total":96636764160,"available":96607735808,"internally_reserved":0,"allocated":1355776,"data_stored":634585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.81699999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.80800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28332,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343508,"statfs":{"total":96636764160,"available":96607752192,"internally_reserved":0,"allocated":1339392,"data_stored":626471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51400000000000001,"15min":0.61699999999999999},"min":{"1min":0.26300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.67700000000000005,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27900000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.73699999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.495}]},{"osd":1,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":1.208},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.71099999999999997,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.58699999999999997,"15min":0.68899999999999995},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.626,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.53100000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76900000000000002,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.628,"15min":0.71599999999999997},"min":{"1min":0.40100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72499999999999998,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81999999999999995,"15min":0.91600000000000004},"min":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.83299999999999996,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.53400000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.95299999999999996,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.78000000000000003,"15min":0.82499999999999996},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0820000000000001,"5min":1.429,"15min":1.429},"last":0.628},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.871,"15min":0.98999999999999999},"min":{"1min":0.63200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.996,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.87,"15min":0.97299999999999998},"min":{"1min":0.58399999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.85899999999999999,"15min":0.96299999999999997},"min":{"1min":0.57499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.98899999999999999,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.746}]},{"osd":7,"last update":"Sun Aug 27 11:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.88100000000000001,"15min":0.97799999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96899999999999997,"5min":5,"15min":5},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.60599999999999998,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98699999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":627457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.623},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.46800000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.68400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1359872,"data_stored":633759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61499999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.45900000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.503}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:27:49.994 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:27:49.995 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:27:50.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.235+0000 7f5d771ff700 1 Processor -- start 2023-08-27T11:27:50.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.236+0000 7f5d771ff700 1 -- start start 2023-08-27T11:27:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.237+0000 7f5d771ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 0x7f5d7006a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.237+0000 7f5d771ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 0x7f5d700c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d771ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700ac7e0 con 0x7f5d700c92e0 2023-08-27T11:27:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d771ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700c86a0 con 0x7f5d70151d20 2023-08-27T11:27:50.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d771ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70155030 con 0x7f5d700c9750 2023-08-27T11:27:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d74f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 0x7f5d7006a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d7579c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 0x7f5d700c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d74f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 0x7f5d7006a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47728/0 (socket says 172.21.15.43:47728) 2023-08-27T11:27:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.238+0000 7f5d74f9b700 1 -- 172.21.15.43:0/1007312742 learned_addr learned my addr 172.21.15.43:0/1007312742 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.239+0000 7f5d7579c700 1 -- 172.21.15.43:0/1007312742 >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 msgr2=0x7f5d7006a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:50.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.239+0000 7f5d7579c700 1 --2- 172.21.15.43:0/1007312742 >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 0x7f5d7006a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.239+0000 7f5d7579c700 1 -- 172.21.15.43:0/1007312742 >> v1:172.21.15.43:6789/0 conn(0x7f5d700c92e0 legacy=0x7f5d700c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.239+0000 7f5d7579c700 1 -- 172.21.15.43:0/1007312742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d70155220 con 0x7f5d700c9750 2023-08-27T11:27:50.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.240+0000 7f5d7579c700 1 --2- 172.21.15.43:0/1007312742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 0x7f5d700c4e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c77f8c3fefb89b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.240+0000 7f5d6f7fe700 1 -- 172.21.15.43:0/1007312742 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800e070 con 0x7f5d700c9750 2023-08-27T11:27:50.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.240+0000 7f5d6f7fe700 1 -- 172.21.15.43:0/1007312742 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800bb20 con 0x7f5d700c9750 2023-08-27T11:27:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.240+0000 7f5d6f7fe700 1 -- 172.21.15.43:0/1007312742 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68012430 con 0x7f5d700c9750 2023-08-27T11:27:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 -- 172.21.15.43:0/1007312742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 msgr2=0x7f5d700c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 --2- 172.21.15.43:0/1007312742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 0x7f5d700c4e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009d90 tx=0x7f5d6800b330 comp rx=0 tx=0).stop 2023-08-27T11:27:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 -- 172.21.15.43:0/1007312742 shutdown_connections 2023-08-27T11:27:50.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 --2- 172.21.15.43:0/1007312742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c9750 0x7f5d700c4e20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 --2- 172.21.15.43:0/1007312742 >> v2:172.21.15.43:3300/0 conn(0x7f5d70151d20 0x7f5d7006a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 -- 172.21.15.43:0/1007312742 >> 172.21.15.43:0/1007312742 conn(0x7f5d700ab880 msgr2=0x7f5d700abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:50.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 -- 172.21.15.43:0/1007312742 shutdown_connections 2023-08-27T11:27:50.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.241+0000 7f5d771ff700 1 -- 172.21.15.43:0/1007312742 wait complete. 2023-08-27T11:27:50.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.243+0000 7f5d771ff700 1 Processor -- start 2023-08-27T11:27:50.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.243+0000 7f5d771ff700 1 -- start start 2023-08-27T11:27:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c92e0 0x7f5d700aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d70151d20 0x7f5d70147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70154740 con 0x7f5d700c9750 2023-08-27T11:27:50.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70152e80 con 0x7f5d70151d20 2023-08-27T11:27:50.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.244+0000 7f5d771ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d701542b0 con 0x7f5d700c92e0 2023-08-27T11:27:50.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d74f9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c92e0 0x7f5d700aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47740/0 (socket says 172.21.15.43:47740) 2023-08-27T11:27:50.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 -- 172.21.15.43:0/937248727 learned_addr learned my addr 172.21.15.43:0/937248727 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d7579c700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d70151d20 0x7f5d70147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 -- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c92e0 msgr2=0x7f5d700aaa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c92e0 0x7f5d700aaa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 -- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d70151d20 msgr2=0x7f5d70147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d70151d20 0x7f5d70147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 -- 172.21.15.43:0/937248727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009a70 con 0x7f5d700c9750 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.245+0000 7f5d6ffff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c510 tx=0x7f5d5c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.246+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0052d0 con 0x7f5d700c9750 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.246+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c005430 con 0x7f5d700c9750 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.246+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70153fa0 con 0x7f5d700c9750 2023-08-27T11:27:50.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.246+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0038c0 con 0x7f5d700c9750 2023-08-27T11:27:50.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.246+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701533b0 con 0x7f5d700c9750 2023-08-27T11:27:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.247+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70074680 con 0x7f5d700c9750 2023-08-27T11:27:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.248+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5d5c003a20 con 0x7f5d700c9750 2023-08-27T11:27:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.249+0000 7f5d6d7fa700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 0x7f5d5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.249+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d5c087780 con 0x7f5d700c9750 2023-08-27T11:27:50.253 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.249+0000 7f5d74f9b700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 0x7f5d5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.250+0000 7f5d74f9b700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 0x7f5d5406c5a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5d70158d10 tx=0x7f5d640092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.254+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5d5c052e60 con 0x7f5d700c9750 2023-08-27T11:27:50.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.554+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5d701543f0 con 0x7f5d700c9750 2023-08-27T11:27:50.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.558+0000 7f5d6d7fa700 1 -- 172.21.15.43:0/937248727 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5d5c056480 con 0x7f5d700c9750 2023-08-27T11:27:50.560 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:27:50.560 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:27:50.560 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:27:50.561 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:27:50.561 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:27:50.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 msgr2=0x7f5d5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 0x7f5d5406c5a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5d70158d10 tx=0x7f5d640092c0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 msgr2=0x7f5d701477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c510 tx=0x7f5d5c00c820 comp rx=0 tx=0).stop 2023-08-27T11:27:50.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 shutdown_connections 2023-08-27T11:27:50.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5d5406a0e0 0x7f5d5406c5a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d70151d20 0x7f5d70147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5d700c92e0 0x7f5d700aaa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 --2- 172.21.15.43:0/937248727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5d700c9750 0x7f5d701477f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 >> 172.21.15.43:0/937248727 conn(0x7f5d700ab880 msgr2=0x7f5d700c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:50.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 shutdown_connections 2023-08-27T11:27:50.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.561+0000 7f5d771ff700 1 -- 172.21.15.43:0/937248727 wait complete. 2023-08-27T11:27:50.565 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:27:50.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:50.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.780+0000 7fb7869ff700 1 Processor -- start 2023-08-27T11:27:50.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.780+0000 7fb7869ff700 1 -- start start 2023-08-27T11:27:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.781+0000 7fb7869ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb78006ca60 0x7fb78006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.781+0000 7fb7869ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb780155910 0x7fb780155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.781+0000 7fb7869ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78006d700 con 0x7fb7800c51a0 2023-08-27T11:27:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.781+0000 7fb7869ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7801530b0 con 0x7fb78006ca60 2023-08-27T11:27:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.781+0000 7fb7869ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78014c860 con 0x7fb780155910 2023-08-27T11:27:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb78006ca60 0x7fb78006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb78006ca60 0x7fb78006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47752/0 (socket says 172.21.15.43:47752) 2023-08-27T11:27:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 -- 172.21.15.43:0/1201011981 learned_addr learned my addr 172.21.15.43:0/1201011981 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb784f9c700 1 --2- 172.21.15.43:0/1201011981 >> v2:172.21.15.57:3300/0 conn(0x7fb780155910 0x7fb780155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 -- 172.21.15.43:0/1201011981 >> v2:172.21.15.57:3300/0 conn(0x7fb780155910 msgr2=0x7fb780155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 --2- 172.21.15.43:0/1201011981 >> v2:172.21.15.57:3300/0 conn(0x7fb780155910 0x7fb780155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 -- 172.21.15.43:0/1201011981 >> v1:172.21.15.57:6789/0 conn(0x7fb7800c51a0 legacy=0x7fb7800aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.782+0000 7fb77f7fe700 1 -- 172.21.15.43:0/1201011981 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780152430 con 0x7fb78006ca60 2023-08-27T11:27:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb77f7fe700 1 --2- 172.21.15.43:0/1201011981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb78006ca60 0x7fb78006d1c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb780153440 tx=0x7fb774009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8000522d2a26d54 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb77effd700 1 -- 172.21.15.43:0/1201011981 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011830 con 0x7fb78006ca60 2023-08-27T11:27:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb77effd700 1 -- 172.21.15.43:0/1201011981 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb774011990 con 0x7fb78006ca60 2023-08-27T11:27:50.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb77effd700 1 -- 172.21.15.43:0/1201011981 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774011d20 con 0x7fb78006ca60 2023-08-27T11:27:50.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 -- 172.21.15.43:0/1201011981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb78006ca60 msgr2=0x7fb78006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 --2- 172.21.15.43:0/1201011981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb78006ca60 0x7fb78006d1c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb780153440 tx=0x7fb774009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:50.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 -- 172.21.15.43:0/1201011981 shutdown_connections 2023-08-27T11:27:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 --2- 172.21.15.43:0/1201011981 >> v2:172.21.15.57:3300/0 conn(0x7fb780155910 0x7fb780155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 --2- 172.21.15.43:0/1201011981 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb78006ca60 0x7fb78006d1c0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 -- 172.21.15.43:0/1201011981 >> 172.21.15.43:0/1201011981 conn(0x7fb78006aa50 msgr2=0x7fb7800c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.783+0000 7fb7869ff700 1 -- 172.21.15.43:0/1201011981 shutdown_connections 2023-08-27T11:27:50.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.784+0000 7fb7869ff700 1 -- 172.21.15.43:0/1201011981 wait complete. 2023-08-27T11:27:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.785+0000 7fb7869ff700 1 Processor -- start 2023-08-27T11:27:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.785+0000 7fb7869ff700 1 -- start start 2023-08-27T11:27:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 0x7fb7800c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb780155910 0x7fb780148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800a4530 con 0x7fb7800c51a0 2023-08-27T11:27:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78006fff0 con 0x7fb78006ca60 2023-08-27T11:27:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.786+0000 7fb7869ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801ed600 con 0x7fb780155910 2023-08-27T11:27:50.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47760/0 (socket says 172.21.15.43:47760) 2023-08-27T11:27:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 -- 172.21.15.43:0/756750648 learned_addr learned my addr 172.21.15.43:0/756750648 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 -- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb780155910 msgr2=0x7fb780148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb780155910 0x7fb780148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 -- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 msgr2=0x7fb7800c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77ffff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 0x7fb7800c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 0x7fb7800c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 -- 172.21.15.43:0/756750648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009550 con 0x7fb7800c51a0 2023-08-27T11:27:50.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77ffff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 0x7fb7800c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77f7fe700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb774009c40 tx=0x7fb774004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.787+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774004400 con 0x7fb7800c51a0 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.788+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77401f070 con 0x7fb7800c51a0 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.788+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740038c0 con 0x7fb7800c51a0 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.788+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7800a4250 con 0x7fb7800c51a0 2023-08-27T11:27:50.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.788+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7801ed290 con 0x7fb7800c51a0 2023-08-27T11:27:50.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.789+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7800c4480 con 0x7fb7800c51a0 2023-08-27T11:27:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.790+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb774021030 con 0x7fb7800c51a0 2023-08-27T11:27:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.790+0000 7fb77cff9700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 0x7fb76c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.791+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7740898d0 con 0x7fb7800c51a0 2023-08-27T11:27:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.791+0000 7fb77ffff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 0x7fb76c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:50.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.791+0000 7fb77ffff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 0x7fb76c06c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb770000f60 tx=0x7fb770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:50.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:50.795+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb774055060 con 0x7fb7800c51a0 2023-08-27T11:27:51.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.046+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7801ed770 con 0x7fb7800c51a0 2023-08-27T11:27:51.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.046+0000 7fb77cff9700 1 -- 172.21.15.43:0/756750648 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4877 (secure 0 0 0) 0x7fb774058680 con 0x7fb7800c51a0 2023-08-27T11:27:51.049 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:51.049 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105},{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:48.059677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7575":{"gid":7575,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1939845776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1939845776},{"type":"v1","addr":"172.21.15.43:6837","nonce":1939845776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:27:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 msgr2=0x7fb76c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 0x7fb76c06c5a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb770000f60 tx=0x7fb770009040 comp rx=0 tx=0).stop 2023-08-27T11:27:51.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 msgr2=0x7fb7800a8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb774009c40 tx=0x7fb774004750 comp rx=0 tx=0).stop 2023-08-27T11:27:51.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 shutdown_connections 2023-08-27T11:27:51.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb76c06a0e0 0x7fb76c06c5a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb780155910 0x7fb780148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb78006ca60 0x7fb7800c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 --2- 172.21.15.43:0/756750648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb7800c51a0 0x7fb7800a8ff0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 >> 172.21.15.43:0/756750648 conn(0x7fb78006aa50 msgr2=0x7fb780154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 shutdown_connections 2023-08-27T11:27:51.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.049+0000 7fb7869ff700 1 -- 172.21.15.43:0/756750648 wait complete. 2023-08-27T11:27:51.054 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 111 2023-08-27T11:27:51.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:27:48.059677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7575}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7575': {'gid': 7575, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/1939845776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1939845776}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1939845776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:51.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:51.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:51.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.677+0000 7f51f6bff700 1 Processor -- start 2023-08-27T11:27:51.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.678+0000 7f51f6bff700 1 -- start start 2023-08-27T11:27:51.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f6bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51f0151a90 0x7f51f00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f6bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51f00c4630 0x7f51f00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f6bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f006c4e0 con 0x7f51f006ad70 2023-08-27T11:27:51.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f6bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0155370 con 0x7f51f0151a90 2023-08-27T11:27:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f6bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0151e70 con 0x7f51f00c4630 2023-08-27T11:27:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51f0151a90 0x7f51f00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f499b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f51f0151a90 0x7f51f00c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47766/0 (socket says 172.21.15.43:47766) 2023-08-27T11:27:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51f499b700 1 -- 172.21.15.43:0/3637002189 learned_addr learned my addr 172.21.15.43:0/3637002189 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.679+0000 7f51effff700 1 --2- 172.21.15.43:0/3637002189 >> v2:172.21.15.57:3300/0 conn(0x7f51f00c4630 0x7f51f00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51f499b700 1 -- 172.21.15.43:0/3637002189 >> v2:172.21.15.57:3300/0 conn(0x7f51f00c4630 msgr2=0x7f51f00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51f499b700 1 --2- 172.21.15.43:0/3637002189 >> v2:172.21.15.57:3300/0 conn(0x7f51f00c4630 0x7f51f00c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51f499b700 1 -- 172.21.15.43:0/3637002189 >> v1:172.21.15.57:6789/0 conn(0x7f51f006ad70 legacy=0x7f51f006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51f499b700 1 -- 172.21.15.43:0/3637002189 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0154480 con 0x7f51f0151a90 2023-08-27T11:27:51.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51f499b700 1 --2- 172.21.15.43:0/3637002189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f00c7bb0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f51f00c7740 tx=0x7f51e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0bed914a068e38 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51ef7fe700 1 -- 172.21.15.43:0/3637002189 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4011830 con 0x7f51f0151a90 2023-08-27T11:27:51.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51ef7fe700 1 -- 172.21.15.43:0/3637002189 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4011990 con 0x7f51f0151a90 2023-08-27T11:27:51.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.680+0000 7f51ef7fe700 1 -- 172.21.15.43:0/3637002189 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4011d20 con 0x7f51f0151a90 2023-08-27T11:27:51.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 -- 172.21.15.43:0/3637002189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 msgr2=0x7f51f00c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3637002189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f00c7bb0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f51f00c7740 tx=0x7f51e4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 -- 172.21.15.43:0/3637002189 shutdown_connections 2023-08-27T11:27:51.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3637002189 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f00c7bb0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3637002189 >> v2:172.21.15.57:3300/0 conn(0x7f51f00c4630 0x7f51f00c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 -- 172.21.15.43:0/3637002189 >> 172.21.15.43:0/3637002189 conn(0x7f51f00ab820 msgr2=0x7f51f00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 -- 172.21.15.43:0/3637002189 shutdown_connections 2023-08-27T11:27:51.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.681+0000 7f51f6bff700 1 -- 172.21.15.43:0/3637002189 wait complete. 2023-08-27T11:27:51.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.683+0000 7f51f6bff700 1 Processor -- start 2023-08-27T11:27:51.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.683+0000 7f51f6bff700 1 -- start start 2023-08-27T11:27:51.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51f006ad70 0x7f51f014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51f00c4630 0x7f51f00aa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f01ea060 con 0x7f51f0151a90 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f014dfe0 con 0x7f51f00c4630 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f01e9a50 con 0x7f51f006ad70 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f499b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51f006ad70 0x7f51f014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51effff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51f00c4630 0x7f51f00aa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47780/0 (socket says 172.21.15.43:47780) 2023-08-27T11:27:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 -- 172.21.15.43:0/3289359962 learned_addr learned my addr 172.21.15.43:0/3289359962 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 -- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51f006ad70 msgr2=0x7f51f014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51f006ad70 0x7f51f014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 -- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51f00c4630 msgr2=0x7f51f00aa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51f00c4630 0x7f51f00aa840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.684+0000 7f51f519c700 1 -- 172.21.15.43:0/3289359962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4009550 con 0x7f51f0151a90 2023-08-27T11:27:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51f519c700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cc50 tx=0x7f51e800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51ed7fa700 1 -- 172.21.15.43:0/3289359962 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003c00 con 0x7f51f0151a90 2023-08-27T11:27:51.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51ed7fa700 1 -- 172.21.15.43:0/3289359962 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8003d60 con 0x7f51f0151a90 2023-08-27T11:27:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51ed7fa700 1 -- 172.21.15.43:0/3289359962 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800aab0 con 0x7f51f0151a90 2023-08-27T11:27:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f014dd00 con 0x7f51f0151a90 2023-08-27T11:27:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.685+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00aad80 con 0x7f51f0151a90 2023-08-27T11:27:51.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.687+0000 7f51ed7fa700 1 -- 172.21.15.43:0/3289359962 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51e800ac10 con 0x7f51f0151a90 2023-08-27T11:27:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.688+0000 7f51ed7fa700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 0x7f51d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.688+0000 7f51ed7fa700 1 -- 172.21.15.43:0/3289359962 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51e8088590 con 0x7f51f0151a90 2023-08-27T11:27:51.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.688+0000 7f51f499b700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 0x7f51d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.689+0000 7f51f499b700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 0x7f51d406c5a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f51e4014040 tx=0x7f51e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.690+0000 7f520a5f7b80 1 Processor -- start 2023-08-27T11:27:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.690+0000 7f520a5f7b80 1 -- start start 2023-08-27T11:27:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c418dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41a3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c40c8730 con 0x5598c4170fe0 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c40c6050 con 0x5598c416b2e0 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c40c1940 con 0x5598c416af00 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f51effff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f51effff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47796/0 (socket says 172.21.15.43:47796) 2023-08-27T11:27:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.691+0000 7f51effff700 1 -- 172.21.15.43:0/2036444363 learned_addr learned my addr 172.21.15.43:0/2036444363 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51f519c700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51f499b700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c418dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 -- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 msgr2=0x5598c418dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c418dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 -- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 msgr2=0x5598c41a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41a3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 -- 172.21.15.43:0/2036444363 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c3f415e0 con 0x5598c4170fe0 2023-08-27T11:27:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51f519c700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:51.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51effff700 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009c30 tx=0x7f51dc009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dee74e64cc0708b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51da7fc700 1 -- 172.21.15.43:0/2036444363 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc011c50 con 0x5598c4170fe0 2023-08-27T11:27:51.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51da7fc700 1 -- 172.21.15.43:0/2036444363 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc011db0 con 0x5598c4170fe0 2023-08-27T11:27:51.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.692+0000 7f51da7fc700 1 -- 172.21.15.43:0/2036444363 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc004250 con 0x5598c4170fe0 2023-08-27T11:27:51.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2036444363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 msgr2=0x5598c418e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009c30 tx=0x7f51dc009f40 comp rx=0 tx=0).stop 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2036444363 shutdown_connections 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c418dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2036444363 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c4170fe0 0x5598c418e2b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2036444363 >> 172.21.15.43:0/2036444363 conn(0x5598c40cdc30 msgr2=0x5598c416d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2036444363 shutdown_connections 2023-08-27T11:27:51.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.693+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2036444363 wait complete. 2023-08-27T11:27:51.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.694+0000 7f520a5f7b80 1 -- start start 2023-08-27T11:27:51.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.694+0000 7f520a5f7b80 1 Processor -- start 2023-08-27T11:27:51.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4188ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c405fb60 con 0x5598c416af00 2023-08-27T11:27:51.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c405f860 con 0x5598c416b2e0 2023-08-27T11:27:51.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c3f438d0 con 0x5598c41ab4f0 2023-08-27T11:27:51.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f520a5f7b80 10 client.0 _ll_register_callbacks cb 0x5598c405d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:51.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f51f499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f51f499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47808/0 (socket says 172.21.15.43:47808) 2023-08-27T11:27:51.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f51f499b700 1 -- 172.21.15.43:0/3801171119 learned_addr learned my addr 172.21.15.43:0/3801171119 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f51f519c700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4188ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.696+0000 7f51effff700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 -- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 msgr2=0x5598c4188ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4188ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 -- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 msgr2=0x5598c41aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 -- 172.21.15.43:0/3801171119 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc009860 con 0x5598c416af00 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51f499b700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ac6e0 tx=0x7f51e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188fffe14990b688 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e401f070 con 0x5598c416af00 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598c41624f0 con 0x5598c416af00 2023-08-27T11:27:51.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51e40039b0 con 0x5598c416af00 2023-08-27T11:27:51.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e4003b70 con 0x5598c416af00 2023-08-27T11:27:51.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f520a5f7b80 10 client.7719 fetch_fsmap learned FSMap version 111 2023-08-27T11:27:51.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.697+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5598c40d9750 con 0x5598c416af00 2023-08-27T11:27:51.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5598c41624f0 con 0x5598c416af00 2023-08-27T11:27:51.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 111) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f51e4003cd0 con 0x5598c416af00 2023-08-27T11:27:51.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 10 client.7719 fetch_fsmap finished waiting for FSMap version 111 2023-08-27T11:27:51.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 10 client.7719 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:51.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 20 client.7719 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:51.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c4191e50 0x5598c4192230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 4 client.7719 mds_command: new command op to 7575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:51.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 --> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598c40ba920 con 0x5598c4191e50 2023-08-27T11:27:51.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.698+0000 7f51effff700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c4191e50 0x5598c4192230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.699+0000 7f51effff700 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c4191e50 0x5598c4192230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f649535a36dd366d server_cookie=d279b5611f02796c in_seq=0 out_seq=0 2023-08-27T11:27:51.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.699+0000 7f51cf7fe700 10 client.7719 ms_handle_connect on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:51.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.699+0000 7f51cf7fe700 1 -- 172.21.15.43:0/3801171119 <== mds.0 v2:172.21.15.43:6836/1939845776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5598c40ba920 con 0x5598c4191e50 2023-08-27T11:27:51.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.699+0000 7f51cf7fe700 10 client.7719 handle_command_reply: tid=0 2023-08-27T11:27:51.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 client.7719 shutdown 2023-08-27T11:27:51.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 msgr2=0x5598c41beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ac6e0 tx=0x7f51e40047c0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 shutdown_connections 2023-08-27T11:27:51.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4188ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c4191e50 0x5598c4192230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416af00 0x5598c41beec0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/3801171119 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c41aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 >> 172.21.15.43:0/3801171119 conn(0x5598c40cdc30 msgr2=0x5598c418d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f51cf7fe700 0 client.7719 ms_handle_reset on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:51.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 shutdown_connections 2023-08-27T11:27:51.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 1 -- 172.21.15.43:0/3801171119 wait complete. 2023-08-27T11:27:51.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.700+0000 7f520a5f7b80 20 client.7719 trim_cache size 0 max 16384 2023-08-27T11:27:51.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.718+0000 7f520a5f7b80 1 Processor -- start 2023-08-27T11:27:51.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 -- start start 2023-08-27T11:27:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c41697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c416d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c416eae0 con 0x5598c41ab4f0 2023-08-27T11:27:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c4164ad0 con 0x5598c416b2e0 2023-08-27T11:27:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.719+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c41a9400 con 0x5598c416af00 2023-08-27T11:27:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47810/0 (socket says 172.21.15.43:47810) 2023-08-27T11:27:51.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 -- 172.21.15.43:0/2293574173 learned_addr learned my addr 172.21.15.43:0/2293574173 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 -- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 msgr2=0x5598c41697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c41697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 -- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 msgr2=0x5598c416d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c416d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 -- 172.21.15.43:0/2293574173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598c416bb60 con 0x5598c41ab4f0 2023-08-27T11:27:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51f519c700 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f51e8086950 tx=0x7f51e8088040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55a6e52b29c2acd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51daffd700 1 -- 172.21.15.43:0/2293574173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e805f640 con 0x5598c41ab4f0 2023-08-27T11:27:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51daffd700 1 -- 172.21.15.43:0/2293574173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8055cd0 con 0x5598c41ab4f0 2023-08-27T11:27:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.720+0000 7f51daffd700 1 -- 172.21.15.43:0/2293574173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8054040 con 0x5598c41ab4f0 2023-08-27T11:27:51.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2293574173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 msgr2=0x5598c418d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f51e8086950 tx=0x7f51e8088040 comp rx=0 tx=0).stop 2023-08-27T11:27:51.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2293574173 shutdown_connections 2023-08-27T11:27:51.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c41ab4f0 0x5598c418d930 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c416af00 0x5598c41697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/2293574173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416b2e0 0x5598c416d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2293574173 >> 172.21.15.43:0/2293574173 conn(0x5598c40cdc30 msgr2=0x5598c4169090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2293574173 shutdown_connections 2023-08-27T11:27:51.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.721+0000 7f520a5f7b80 1 -- 172.21.15.43:0/2293574173 wait complete. 2023-08-27T11:27:51.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.722+0000 7f520a5f7b80 1 -- start start 2023-08-27T11:27:51.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.722+0000 7f520a5f7b80 1 Processor -- start 2023-08-27T11:27:51.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416af00 0x5598c418dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4190b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c41c01d0 con 0x5598c416b2e0 2023-08-27T11:27:51.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598c42175b0 con 0x5598c416af00 2023-08-27T11:27:51.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598c41ab1d0 con 0x5598c41ab4f0 2023-08-27T11:27:51.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f520a5f7b80 10 client.0 _ll_register_callbacks cb 0x5598c405d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:51.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f51effff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f51effff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47824/0 (socket says 172.21.15.43:47824) 2023-08-27T11:27:51.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f51f499b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416af00 0x5598c418dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f51effff700 1 -- 172.21.15.43:0/932523195 learned_addr learned my addr 172.21.15.43:0/932523195 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.723+0000 7f51f519c700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4190b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 -- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 msgr2=0x5598c4190b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4190b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 -- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416af00 msgr2=0x5598c418dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416af00 0x5598c418dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 -- 172.21.15.43:0/932523195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f00aad80 con 0x5598c416b2e0 2023-08-27T11:27:51.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51effff700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f51dc018000 tx=0x7f51dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc10fa7bad501e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51cf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:51.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc025070 con 0x5598c416b2e0 2023-08-27T11:27:51.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51dc006bd0 con 0x5598c416b2e0 2023-08-27T11:27:51.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51dc011db0 con 0x5598c416b2e0 2023-08-27T11:27:51.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51dc02de00 con 0x5598c416b2e0 2023-08-27T11:27:51.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f520a5f7b80 10 client.7725 fetch_fsmap learned FSMap version 111 2023-08-27T11:27:51.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.724+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x5598c3eedd90 con 0x5598c416b2e0 2023-08-27T11:27:51.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc011db0 con 0x5598c416b2e0 2023-08-27T11:27:51.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 111) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f51dc02d080 con 0x5598c416b2e0 2023-08-27T11:27:51.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 10 client.7725 fetch_fsmap finished waiting for FSMap version 111 2023-08-27T11:27:51.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 10 client.7725 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:51.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 20 client.7725 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:51.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c41912f0 0x5598c42102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 4 client.7725 mds_command: new command op to 7575 tid=0[{"prefix": "status"}] 2023-08-27T11:27:51.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 --> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5598c407b000 con 0x5598c41912f0 2023-08-27T11:27:51.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.725+0000 7f51f499b700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c41912f0 0x5598c42102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f51cf7fe700 10 client.7725 ms_handle_connect on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:51.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f51f499b700 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c41912f0 0x5598c42102b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b587ae38e9a246 server_cookie=79fe99ba0c446325 in_seq=0 out_seq=0 2023-08-27T11:27:51.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f51cf7fe700 1 -- 172.21.15.43:0/932523195 <== mds.0 v2:172.21.15.43:6836/1939845776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x5598c407b000 con 0x5598c41912f0 2023-08-27T11:27:51.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f51cf7fe700 10 client.7725 handle_command_reply: tid=0 2023-08-27T11:27:51.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 client.7725 shutdown 2023-08-27T11:27:51.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 msgr2=0x5598c4216ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f51dc018000 tx=0x7f51dc0047c0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 shutdown_connections 2023-08-27T11:27:51.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5598c41ab4f0 0x5598c4190b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5598c416af00 0x5598c418dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x5598c41912f0 0x5598c42102b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 --2- 172.21.15.43:0/932523195 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5598c416b2e0 0x5598c4216ba0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f51cf7fe700 0 client.7725 ms_handle_reset on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:51.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 >> 172.21.15.43:0/932523195 conn(0x5598c40cdc30 msgr2=0x5598c4188880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 shutdown_connections 2023-08-27T11:27:51.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 1 -- 172.21.15.43:0/932523195 wait complete. 2023-08-27T11:27:51.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.726+0000 7f520a5f7b80 20 client.7725 trim_cache size 0 max 16384 2023-08-27T11:27:51.747 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:51.748 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:51.748 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:51.749 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7575, 2023-08-27T11:27:51.749 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:51.749 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:51.750 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:51.750 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 6.7215594019999996, 2023-08-27T11:27:51.750 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 111, 2023-08-27T11:27:51.750 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 110, 2023-08-27T11:27:51.751 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 110, 2023-08-27T11:27:51.751 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 12.935898248000001 2023-08-27T11:27:51.751 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:51.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 msgr2=0x7f51d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 0x7f51d406c5a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f51e4014040 tx=0x7f51e4008030 comp rx=0 tx=0).stop 2023-08-27T11:27:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 msgr2=0x7f51f0152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cc50 tx=0x7f51e800cf60 comp rx=0 tx=0).stop 2023-08-27T11:27:51.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 shutdown_connections 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51d406a0e0 0x7f51d406c5a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f51f0151a90 0x7f51f0152240 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f51f006ad70 0x7f51f014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 --2- 172.21.15.43:0/3289359962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51f00c4630 0x7f51f00aa840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 >> 172.21.15.43:0/3289359962 conn(0x7f51f00ab820 msgr2=0x7f51f006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 shutdown_connections 2023-08-27T11:27:51.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.727+0000 7f51f6bff700 1 -- 172.21.15.43:0/3289359962 wait complete. 2023-08-27T11:27:51.755 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:51.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.954+0000 7f09f21ff700 1 Processor -- start 2023-08-27T11:27:51.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.954+0000 7f09f21ff700 1 -- start start 2023-08-27T11:27:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.955+0000 7f09f21ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09ec0c51a0 0x7f09ec06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.955+0000 7f09f21ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09ec155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.955+0000 7f09f21ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec06d700 con 0x7f09ec06ca60 2023-08-27T11:27:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.955+0000 7f09f21ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec1530b0 con 0x7f09ec0c51a0 2023-08-27T11:27:51.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.955+0000 7f09f21ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec14c860 con 0x7f09ec155910 2023-08-27T11:27:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09eaffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f09ec06ca60 0x7f09ec0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59912/0 (socket says 172.21.15.43:59912) 2023-08-27T11:27:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09eaffd700 1 -- 172.21.15.43:0/1632039175 learned_addr learned my addr 172.21.15.43:0/1632039175 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/1632039175 >> v2:172.21.15.57:3300/0 conn(0x7f09ec0c51a0 0x7f09ec06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ebfff700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09ec155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65287576 0 0) 0x7f09ec06d700 con 0x7f09ec06ca60 2023-08-27T11:27:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d40035b0 con 0x7f09ec06ca60 2023-08-27T11:27:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3739878530 0 0) 0x7f09d40035b0 con 0x7f09ec06ca60 2023-08-27T11:27:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 msgr2=0x7f09ec155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09ec155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 >> v2:172.21.15.57:3300/0 conn(0x7f09ec0c51a0 msgr2=0x7f09ec06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.956+0000 7f09ea7fc700 1 --2- 172.21.15.43:0/1632039175 >> v2:172.21.15.57:3300/0 conn(0x7f09ec0c51a0 0x7f09ec06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec152430 con 0x7f09ec06ca60 2023-08-27T11:27:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f09e0001670 con 0x7f09ec06ca60 2023-08-27T11:27:51.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 >> v1:172.21.15.43:6789/0 conn(0x7f09ec06ca60 legacy=0x7f09ec0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d4003a30 0x7f09d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4004d90 0x7f09d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1530b0 con 0x7f09d4004d90 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec14c860 con 0x7f09d4003a30 2023-08-27T11:27:51.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d400ba40 con 0x7f09ec155910 2023-08-27T11:27:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ebfff700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4004d90 0x7f09d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eaffd700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d4003a30 0x7f09d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 -- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 msgr2=0x7f09d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec155910 0x7f09d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 -- 172.21.15.43:0/1632039175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4004d90 msgr2=0x7f09d4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4004d90 0x7f09d4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09eb7fe700 1 -- 172.21.15.43:0/1632039175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d40035b0 con 0x7f09d4003a30 2023-08-27T11:27:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.957+0000 7f09ebfff700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4004d90 0x7f09d4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:51.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d4003a30 0x7f09d4003e50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009b60 tx=0x7f09d4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f826222941775f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00e6c0 con 0x7f09d4003a30 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc00e820 con 0x7f09d4003a30 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09ea7fc700 1 -- 172.21.15.43:0/1632039175 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00eb90 con 0x7f09d4003a30 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09f21ff700 1 -- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d4003a30 msgr2=0x7f09d4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09f21ff700 1 --2- 172.21.15.43:0/1632039175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d4003a30 0x7f09d4003e50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009b60 tx=0x7f09d4005880 comp rx=0 tx=0).stop 2023-08-27T11:27:51.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.958+0000 7f09ebfff700 1 -- 172.21.15.43:0/1632039175 reap_dead start 2023-08-27T11:27:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.959+0000 7f09f21ff700 1 -- 172.21.15.43:0/1632039175 shutdown_connections 2023-08-27T11:27:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.959+0000 7f09f21ff700 1 -- 172.21.15.43:0/1632039175 >> 172.21.15.43:0/1632039175 conn(0x7f09ec06aa50 msgr2=0x7f09ec0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.959+0000 7f09f21ff700 1 -- 172.21.15.43:0/1632039175 shutdown_connections 2023-08-27T11:27:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.959+0000 7f09f21ff700 1 -- 172.21.15.43:0/1632039175 wait complete. 2023-08-27T11:27:51.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.960+0000 7f09f21ff700 1 Processor -- start 2023-08-27T11:27:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.960+0000 7f09f21ff700 1 -- start start 2023-08-27T11:27:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec072600 0x7f09ec0bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0bc8e0 0x7f09ec0a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec070b60 con 0x7f09d4003a30 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1e8490 con 0x7f09ec0bc8e0 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.961+0000 7f09f21ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec14b850 con 0x7f09ec072600 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47842/0 (socket says 172.21.15.43:47842) 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 -- 172.21.15.43:0/2372406786 learned_addr learned my addr 172.21.15.43:0/2372406786 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:51.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eaffd700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec072600 0x7f09ec0bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09ebfff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0bc8e0 0x7f09ec0a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 -- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec072600 msgr2=0x7f09ec0bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec072600 0x7f09ec0bf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 -- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0bc8e0 msgr2=0x7f09ec0a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0bc8e0 0x7f09ec0a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:51.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 -- 172.21.15.43:0/2372406786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec06fe00 con 0x7f09d4003a30 2023-08-27T11:27:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.962+0000 7f09eb7fe700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f09d400ba10 tx=0x7f09dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.963+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc021070 con 0x7f09d4003a30 2023-08-27T11:27:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.963+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc004470 con 0x7f09d4003a30 2023-08-27T11:27:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.963+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc00e6c0 con 0x7f09d4003a30 2023-08-27T11:27:51.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.963+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec0700e0 con 0x7f09d4003a30 2023-08-27T11:27:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.963+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec071e00 con 0x7f09d4003a30 2023-08-27T11:27:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.964+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec071960 con 0x7f09d4003a30 2023-08-27T11:27:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.965+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f09dc025070 con 0x7f09d4003a30 2023-08-27T11:27:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.966+0000 7f09d3fff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:51.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.966+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f09dc089200 con 0x7f09d4003a30 2023-08-27T11:27:51.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.966+0000 7f09eaffd700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:51.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.967+0000 7f09eaffd700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 0x7f09d806c5a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ec1505f0 tx=0x7f09e0007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:51.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:51.970+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f09dc054a00 con 0x7f09d4003a30 2023-08-27T11:27:52.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.229+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09ec04ee70 con 0x7f09d4003a30 2023-08-27T11:27:52.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.229+0000 7f09d3fff700 1 -- 172.21.15.43:0/2372406786 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4877 (secure 0 0 0) 0x7f09dc058020 con 0x7f09d4003a30 2023-08-27T11:27:52.231 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:52.231 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105},{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:48.059677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7575":{"gid":7575,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1939845776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1939845776},{"type":"v1","addr":"172.21.15.43:6837","nonce":1939845776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:27:52.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.231+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 msgr2=0x7f09d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.231+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 0x7f09d806c5a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f09ec1505f0 tx=0x7f09e0007980 comp rx=0 tx=0).stop 2023-08-27T11:27:52.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.231+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 msgr2=0x7f09ec1e7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.231+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f09d400ba10 tx=0x7f09dc0047c0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 shutdown_connections 2023-08-27T11:27:52.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f09d806a0e0 0x7f09d806c5a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09ec0bc8e0 0x7f09ec0a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09d4003a30 0x7f09ec1e7f50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 --2- 172.21.15.43:0/2372406786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09ec072600 0x7f09ec0bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 >> 172.21.15.43:0/2372406786 conn(0x7f09ec06aa50 msgr2=0x7f09ec1551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:52.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 shutdown_connections 2023-08-27T11:27:52.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.232+0000 7f09f21ff700 1 -- 172.21.15.43:0/2372406786 wait complete. 2023-08-27T11:27:52.238 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 111 2023-08-27T11:27:52.252 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 8, "epoch": 111, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 8, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:27:44.512293+0000", "damaged": [], "data_pools": [ 18 ], "enabled": true, "epoch": 111, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7575": { "addr": "172.21.15.43:6837/1939845776", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1939845776, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1939845776, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7575, "incarnation": 107, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 17, "modified": "2023-08-27T11:27:48.059677+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7575 } } } ], "standbys": [ { "addr": "172.21.15.43:6835/3995831020", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3995831020, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 3995831020, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 105, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7180, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/30396136", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 30396136, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 30396136, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7195, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/2128138968", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2128138968, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2128138968, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7198, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:52.253 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:52.253 INFO:tasks.cephfs.test_failover:current = [{'gid': 7180, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 105}, {'gid': 7195, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}, {'gid': 7575, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/1939845776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1939845776}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1939845776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7198, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2128138968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2128138968}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2128138968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}] 2023-08-27T11:27:52.254 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.a mds_join_fs cephfs 2023-08-27T11:27:52.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.456+0000 7f60cedff700 1 Processor -- start 2023-08-27T11:27:52.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.456+0000 7f60cedff700 1 -- start start 2023-08-27T11:27:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.457+0000 7f60cedff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60c80c5150 0x7f60c81512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.457+0000 7f60cedff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c80c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.457+0000 7f60cedff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c80c03e0 con 0x7f60c814e780 2023-08-27T11:27:52.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.457+0000 7f60cedff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c8151900 con 0x7f60c80c5150 2023-08-27T11:27:52.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.457+0000 7f60cedff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8151be0 con 0x7f60c814eb60 2023-08-27T11:27:52.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.458+0000 7f60c7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60c80c5150 0x7f60c81512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.458+0000 7f60cd39c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c80c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.458+0000 7f60c7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60c80c5150 0x7f60c81512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:59584/0 (socket says 172.21.15.43:59584) 2023-08-27T11:27:52.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.458+0000 7f60c7fff700 1 -- 172.21.15.43:0/606457711 learned_addr learned my addr 172.21.15.43:0/606457711 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:52.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.458+0000 7f60cd39c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c80c0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:36066/0 (socket says 172.21.15.43:36066) 2023-08-27T11:27:52.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c7fff700 1 -- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 msgr2=0x7f60c80c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:52.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c7fff700 1 --2- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c80c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c7fff700 1 -- 172.21.15.43:0/606457711 >> v1:172.21.15.57:6789/0 conn(0x7f60c814e780 legacy=0x7f60c806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c7fff700 1 -- 172.21.15.43:0/606457711 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c8151ec0 con 0x7f60c80c5150 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c77fe700 1 -- 172.21.15.43:0/606457711 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414513331 0 0) 0x7f60c80c03e0 con 0x7f60c814e780 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c7fff700 1 --2- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c80c5150 0x7f60c81512b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f60b40098f0 tx=0x7f60b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a98a32e6bdd6ca server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c77fe700 1 -- 172.21.15.43:0/606457711 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4011830 con 0x7f60c80c5150 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c77fe700 1 -- 172.21.15.43:0/606457711 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b4011990 con 0x7f60c80c5150 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.459+0000 7f60c77fe700 1 -- 172.21.15.43:0/606457711 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4011d20 con 0x7f60c80c5150 2023-08-27T11:27:52.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 -- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c80c5150 msgr2=0x7f60c81512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 --2- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c80c5150 0x7f60c81512b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f60b40098f0 tx=0x7f60b4009c00 comp rx=0 tx=0).stop 2023-08-27T11:27:52.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 -- 172.21.15.43:0/606457711 shutdown_connections 2023-08-27T11:27:52.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 --2- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c80c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 --2- 172.21.15.43:0/606457711 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c80c5150 0x7f60c81512b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 -- 172.21.15.43:0/606457711 >> 172.21.15.43:0/606457711 conn(0x7f60c80c5b10 msgr2=0x7f60c80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:52.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 -- 172.21.15.43:0/606457711 shutdown_connections 2023-08-27T11:27:52.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.460+0000 7f60cedff700 1 -- 172.21.15.43:0/606457711 wait complete. 2023-08-27T11:27:52.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.462+0000 7f60cedff700 1 Processor -- start 2023-08-27T11:27:52.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.462+0000 7f60cedff700 1 -- start start 2023-08-27T11:27:52.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c814e780 0x7f60c814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c81e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c80702b0 con 0x7f60c80c5150 2023-08-27T11:27:52.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8150d70 con 0x7f60c814e780 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cedff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c81e8eb0 con 0x7f60c814eb60 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60ccb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60ccb9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47856/0 (socket says 172.21.15.43:47856) 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60ccb9b700 1 -- 172.21.15.43:0/3305713570 learned_addr learned my addr 172.21.15.43:0/3305713570 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60c7fff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c814e780 0x7f60c814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.463+0000 7f60cd39c700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c81e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 -- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 msgr2=0x7f60c81e4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c81e4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 -- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c814e780 msgr2=0x7f60c814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c814e780 0x7f60c814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 -- 172.21.15.43:0/3305713570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009550 con 0x7f60c80c5150 2023-08-27T11:27:52.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60ccb9b700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0011e0 tx=0x7f60bc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc0054e0 con 0x7f60c80c5150 2023-08-27T11:27:52.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60bc003680 con 0x7f60c80c5150 2023-08-27T11:27:52.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c8150f80 con 0x7f60c80c5150 2023-08-27T11:27:52.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60bc003a30 con 0x7f60c80c5150 2023-08-27T11:27:52.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.464+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c814e3e0 con 0x7f60c80c5150 2023-08-27T11:27:52.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.465+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c806f6b0 con 0x7f60c80c5150 2023-08-27T11:27:52.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.466+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60bc003b90 con 0x7f60c80c5150 2023-08-27T11:27:52.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.467+0000 7f60c57fa700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 0x7f60ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.468+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60bc0879c0 con 0x7f60c80c5150 2023-08-27T11:27:52.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.468+0000 7f60c7fff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 0x7f60ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.468+0000 7f60c7fff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 0x7f60ac06c5a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009c40 tx=0x7f60b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.472+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60bc0530a0 con 0x7f60c80c5150 2023-08-27T11:27:52.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.684+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f60c804ee70 con 0x7f60c80c5150 2023-08-27T11:27:52.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.689+0000 7f60c57fa700 1 -- 172.21.15.43:0/3305713570 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v38)=0 v38) v1 ==== 116+0+0 (secure 0 0 0) 0x7f60bc0170b0 con 0x7f60c80c5150 2023-08-27T11:27:52.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.691+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 msgr2=0x7f60ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.691+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 0x7f60ac06c5a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009c40 tx=0x7f60b4008030 comp rx=0 tx=0).stop 2023-08-27T11:27:52.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.691+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 msgr2=0x7f60c806fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.691+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0011e0 tx=0x7f60bc00ca30 comp rx=0 tx=0).stop 2023-08-27T11:27:52.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 shutdown_connections 2023-08-27T11:27:52.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60ac06a0e0 0x7f60ac06c5a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60c814eb60 0x7f60c81e4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60c80c5150 0x7f60c806fa70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 --2- 172.21.15.43:0/3305713570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60c814e780 0x7f60c814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 >> 172.21.15.43:0/3305713570 conn(0x7f60c80c5b10 msgr2=0x7f60c80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 shutdown_connections 2023-08-27T11:27:52.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.692+0000 7f60cedff700 1 -- 172.21.15.43:0/3305713570 wait complete. 2023-08-27T11:27:52.712 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.b mds_join_fs cephfs 2023-08-27T11:27:52.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.915+0000 7fd0247ff700 1 Processor -- start 2023-08-27T11:27:52.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.915+0000 7fd0247ff700 1 -- start start 2023-08-27T11:27:52.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c14e780 0x7fd01c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd01c0c5150 0x7fd01c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd01c06a310 0x7fd01c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c0c03e0 con 0x7fd01c0c5150 2023-08-27T11:27:52.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd01c151900 con 0x7fd01c06a310 2023-08-27T11:27:52.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd0247ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c151be0 con 0x7fd01c14e780 2023-08-27T11:27:52.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.916+0000 7fd021d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd01c0c5150 0x7fd01c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd01c0c5150 0x7fd01c14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47866/0 (socket says 172.21.15.43:47866) 2023-08-27T11:27:52.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 -- 172.21.15.43:0/2068389295 learned_addr learned my addr 172.21.15.43:0/2068389295 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:52.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd022d9c700 1 --2- 172.21.15.43:0/2068389295 >> v2:172.21.15.57:3300/0 conn(0x7fd01c06a310 0x7fd01c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd02259b700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c14e780 0x7fd01c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 -- 172.21.15.43:0/2068389295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c14e780 msgr2=0x7fd01c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:52.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c14e780 0x7fd01c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 -- 172.21.15.43:0/2068389295 >> v2:172.21.15.57:3300/0 conn(0x7fd01c06a310 msgr2=0x7fd01c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:52.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2068389295 >> v2:172.21.15.57:3300/0 conn(0x7fd01c06a310 0x7fd01c06a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 -- 172.21.15.43:0/2068389295 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c151ec0 con 0x7fd01c0c5150 2023-08-27T11:27:52.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c0c5150 0x7fd01c14eb60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0a4e90 tx=0x7fd00c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dfbc6a7a194c2d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.917+0000 7fd021599700 1 -- 172.21.15.43:0/2068389295 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00b870 con 0x7fd01c0c5150 2023-08-27T11:27:52.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd021599700 1 -- 172.21.15.43:0/2068389295 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c00b9d0 con 0x7fd01c0c5150 2023-08-27T11:27:52.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd021599700 1 -- 172.21.15.43:0/2068389295 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00bd60 con 0x7fd01c0c5150 2023-08-27T11:27:52.926 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 -- 172.21.15.43:0/2068389295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c0c5150 msgr2=0x7fd01c14eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c0c5150 0x7fd01c14eb60 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0a4e90 tx=0x7fd00c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 -- 172.21.15.43:0/2068389295 shutdown_connections 2023-08-27T11:27:52.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2068389295 >> v2:172.21.15.57:3300/0 conn(0x7fd01c06a310 0x7fd01c06a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c14e780 0x7fd01c1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2068389295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c0c5150 0x7fd01c14eb60 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 -- 172.21.15.43:0/2068389295 >> 172.21.15.43:0/2068389295 conn(0x7fd01c0c5b10 msgr2=0x7fd01c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:52.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 -- 172.21.15.43:0/2068389295 shutdown_connections 2023-08-27T11:27:52.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.918+0000 7fd0247ff700 1 -- 172.21.15.43:0/2068389295 wait complete. 2023-08-27T11:27:52.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.920+0000 7fd0247ff700 1 Processor -- start 2023-08-27T11:27:52.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.920+0000 7fd0247ff700 1 -- start start 2023-08-27T11:27:52.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c0c5150 0x7fd01c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd01c14e780 0x7fd01c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c14b710 con 0x7fd01c06a310 2023-08-27T11:27:52.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1ea7e0 con 0x7fd01c14e780 2023-08-27T11:27:52.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd0247ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01c1d8450 con 0x7fd01c0c5150 2023-08-27T11:27:52.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.921+0000 7fd02259b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47868/0 (socket says 172.21.15.43:47868) 2023-08-27T11:27:52.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 -- 172.21.15.43:0/2875808738 learned_addr learned my addr 172.21.15.43:0/2875808738 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:52.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c0c5150 0x7fd01c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd022d9c700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd01c14e780 0x7fd01c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 -- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c0c5150 msgr2=0x7fd01c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c0c5150 0x7fd01c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 -- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd01c14e780 msgr2=0x7fd01c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:52.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd01c14e780 0x7fd01c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:52.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 -- 172.21.15.43:0/2875808738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c009550 con 0x7fd01c06a310 2023-08-27T11:27:52.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd02259b700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd01800d800 tx=0x7fd01800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0180125f0 con 0x7fd01c06a310 2023-08-27T11:27:52.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018012750 con 0x7fd01c06a310 2023-08-27T11:27:52.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.922+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018012b00 con 0x7fd01c06a310 2023-08-27T11:27:52.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.923+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd01c1d8730 con 0x7fd01c06a310 2023-08-27T11:27:52.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.923+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01c1d8cf0 con 0x7fd01c06a310 2023-08-27T11:27:52.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.924+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01c0c0ed0 con 0x7fd01c06a310 2023-08-27T11:27:52.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.925+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd018012c60 con 0x7fd01c06a310 2023-08-27T11:27:52.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.925+0000 7fd012ffd700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 0x7fd00006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:52.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.926+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd018088470 con 0x7fd01c06a310 2023-08-27T11:27:52.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.926+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 0x7fd00006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:52.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.926+0000 7fd021d9a700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 0x7fd00006c5a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd00c000c00 tx=0x7fd00c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:52.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:52.930+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd018053bf0 con 0x7fd01c06a310 2023-08-27T11:27:53.145 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.144+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7fd01c0ab250 con 0x7fd01c06a310 2023-08-27T11:27:53.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.148+0000 7fd012ffd700 1 -- 172.21.15.43:0/2875808738 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v39)=0 v39) v1 ==== 116+0+0 (secure 0 0 0) 0x7fd018057210 con 0x7fd01c06a310 2023-08-27T11:27:53.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 msgr2=0x7fd00006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 0x7fd00006c5a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd00c000c00 tx=0x7fd00c008030 comp rx=0 tx=0).stop 2023-08-27T11:27:53.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 msgr2=0x7fd01c14c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.152 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd01800d800 tx=0x7fd01800db10 comp rx=0 tx=0).stop 2023-08-27T11:27:53.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 shutdown_connections 2023-08-27T11:27:53.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd00006a0e0 0x7fd00006c5a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd01c14e780 0x7fd01c14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd01c06a310 0x7fd01c14c200 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 --2- 172.21.15.43:0/2875808738 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd01c0c5150 0x7fd01c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 >> 172.21.15.43:0/2875808738 conn(0x7fd01c0c5b10 msgr2=0x7fd01c0aa560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:53.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 shutdown_connections 2023-08-27T11:27:53.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.150+0000 7fd0247ff700 1 -- 172.21.15.43:0/2875808738 wait complete. 2023-08-27T11:27:53.170 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:53.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.369+0000 7f65a0dff700 1 Processor -- start 2023-08-27T11:27:53.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.369+0000 7f65a0dff700 1 -- start start 2023-08-27T11:27:53.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f65a0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 0x7f659c156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:53.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f65a0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c152430 con 0x7f659c06ca60 2023-08-27T11:27:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f65a0dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c152710 con 0x7f659c0c51a0 2023-08-27T11:27:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f65a0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c1530b0 con 0x7f659c06d1c0 2023-08-27T11:27:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f6593fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f659c06ca60 0x7f659c155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59918/0 (socket says 172.21.15.43:59918) 2023-08-27T11:27:53.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f6593fff700 1 -- 172.21.15.43:0/3156395262 learned_addr learned my addr 172.21.15.43:0/3156395262 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:27:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.370+0000 7f659ad9d700 1 --2- 172.21.15.43:0/3156395262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 0x7f659c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231809760 0 0) 0x7f659c152430 con 0x7f659c06ca60 2023-08-27T11:27:53.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65880035b0 con 0x7f659c06ca60 2023-08-27T11:27:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163996415 0 0) 0x7f659c152710 con 0x7f659c0c51a0 2023-08-27T11:27:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f659c152430 con 0x7f659c0c51a0 2023-08-27T11:27:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f659ad9d700 1 -- 172.21.15.43:0/3156395262 >> v1:172.21.15.57:6789/0 conn(0x7f659c0c51a0 legacy=0x7f659c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f659ad9d700 1 -- 172.21.15.43:0/3156395262 >> v1:172.21.15.43:6789/0 conn(0x7f659c06ca60 legacy=0x7f659c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f659ad9d700 1 -- 172.21.15.43:0/3156395262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c1529f0 con 0x7f659c06d1c0 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.371+0000 7f659ad9d700 1 --2- 172.21.15.43:0/3156395262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 0x7f659c156020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6594009dc0 tx=0x7f659400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3cd35e27c1ea4b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659400e070 con 0x7f659c06d1c0 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659400bb20 con 0x7f659c06d1c0 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f6599d9b700 1 -- 172.21.15.43:0/3156395262 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594012430 con 0x7f659c06d1c0 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 -- 172.21.15.43:0/3156395262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 msgr2=0x7f659c156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 --2- 172.21.15.43:0/3156395262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 0x7f659c156020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6594009dc0 tx=0x7f659400b330 comp rx=0 tx=0).stop 2023-08-27T11:27:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 -- 172.21.15.43:0/3156395262 shutdown_connections 2023-08-27T11:27:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 --2- 172.21.15.43:0/3156395262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c06d1c0 0x7f659c156020 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 -- 172.21.15.43:0/3156395262 >> 172.21.15.43:0/3156395262 conn(0x7f659c06aa50 msgr2=0x7f659c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 -- 172.21.15.43:0/3156395262 shutdown_connections 2023-08-27T11:27:53.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.372+0000 7f65a0dff700 1 -- 172.21.15.43:0/3156395262 wait complete. 2023-08-27T11:27:53.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.374+0000 7f65a0dff700 1 Processor -- start 2023-08-27T11:27:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.374+0000 7f65a0dff700 1 -- start start 2023-08-27T11:27:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 0x7f659c1eb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:53.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 0x7f659c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0bcc50 con 0x7f659c06d1c0 2023-08-27T11:27:53.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0c5d70 con 0x7f659c06ca60 2023-08-27T11:27:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f65a0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0c6050 con 0x7f659c0c51a0 2023-08-27T11:27:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f6593fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:53.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f6593fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47880/0 (socket says 172.21.15.43:47880) 2023-08-27T11:27:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f6593fff700 1 -- 172.21.15.43:0/729955062 learned_addr learned my addr 172.21.15.43:0/729955062 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f659a59c700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 0x7f659c1eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:53.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.375+0000 7f659ad9d700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 0x7f659c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 -- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 msgr2=0x7f659c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 0x7f659c14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 -- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 msgr2=0x7f659c1eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 0x7f659c1eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 -- 172.21.15.43:0/729955062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594009a70 con 0x7f659c06d1c0 2023-08-27T11:27:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f659a59c700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 0x7f659c1eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f659ad9d700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 0x7f659c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6593fff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f658400c700 tx=0x7f658400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:53.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584005d70 con 0x7f659c06d1c0 2023-08-27T11:27:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840070d0 con 0x7f659c06d1c0 2023-08-27T11:27:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c0bc8e0 con 0x7f659c06d1c0 2023-08-27T11:27:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584007480 con 0x7f659c06d1c0 2023-08-27T11:27:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.376+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c0bb770 con 0x7f659c06d1c0 2023-08-27T11:27:53.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.377+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c04ee70 con 0x7f659c06d1c0 2023-08-27T11:27:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.378+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65840075e0 con 0x7f659c06d1c0 2023-08-27T11:27:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.379+0000 7f6592ffd700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 0x7f657c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.379+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6584087c20 con 0x7f659c06d1c0 2023-08-27T11:27:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.379+0000 7f659a59c700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 0x7f657c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:53.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.380+0000 7f659a59c700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 0x7f657c06c5a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f658c0011e0 tx=0x7f658c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:53.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.384+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6584053280 con 0x7f659c06d1c0 2023-08-27T11:27:53.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.640+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f659c06c840 con 0x7f659c06d1c0 2023-08-27T11:27:53.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.640+0000 7f6592ffd700 1 -- 172.21.15.43:0/729955062 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4877 (secure 0 0 0) 0x7f65840568a0 con 0x7f659c06d1c0 2023-08-27T11:27:53.643 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:53.643 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7180,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":105},{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:48.059677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7575},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7575":{"gid":7575,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6837/1939845776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1939845776},{"type":"v1","addr":"172.21.15.43:6837","nonce":1939845776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:27:53.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 msgr2=0x7f657c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 0x7f657c06c5a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f658c0011e0 tx=0x7f658c009040 comp rx=0 tx=0).stop 2023-08-27T11:27:53.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 msgr2=0x7f659c0a78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:53.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f658400c700 tx=0x7f658400cac0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 shutdown_connections 2023-08-27T11:27:53.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f657c06a0e0 0x7f657c06c5a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f659c0c51a0 0x7f659c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659c06ca60 0x7f659c1eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 --2- 172.21.15.43:0/729955062 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f659c06d1c0 0x7f659c0a78a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:53.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 >> 172.21.15.43:0/729955062 conn(0x7f659c06aa50 msgr2=0x7f659c0ba760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:53.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 shutdown_connections 2023-08-27T11:27:53.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:53.643+0000 7f65a0dff700 1 -- 172.21.15.43:0/729955062 wait complete. 2023-08-27T11:27:53.648 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 111 2023-08-27T11:27:54.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:27:48.059677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7575}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7575': {'gid': 7575, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/1939845776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1939845776}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1939845776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:27:54.066 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:27:54.066 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-27T11:27:54.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.273+0000 7f15cb5ff700 1 Processor -- start 2023-08-27T11:27:54.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.273+0000 7f15cb5ff700 1 -- start start 2023-08-27T11:27:54.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15cb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c4151a90 0x7f15c40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15cb5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15c40c4a90 0x7f15c406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15cb5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c406c4e0 con 0x7f15c40c4630 2023-08-27T11:27:54.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15cb5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c4155370 con 0x7f15c40c4a90 2023-08-27T11:27:54.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15cb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4151e70 con 0x7f15c4151a90 2023-08-27T11:27:54.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15c9b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15c40c4a90 0x7f15c406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15c9b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15c40c4a90 0x7f15c406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47884/0 (socket says 172.21.15.43:47884) 2023-08-27T11:27:54.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15c8b9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f15c40c4630 0x7f15c406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59930/0 (socket says 172.21.15.43:59930) 2023-08-27T11:27:54.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.274+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3154722766 learned_addr learned my addr 172.21.15.43:0/3154722766 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c939b700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c4151a90 0x7f15c40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3154722766 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c4151a90 msgr2=0x7f15c40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c4151a90 0x7f15c40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3154722766 >> v1:172.21.15.43:6789/0 conn(0x7f15c40c4630 legacy=0x7f15c406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3154722766 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4154480 con 0x7f15c40c4a90 2023-08-27T11:27:54.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15bbfff700 1 -- 172.21.15.43:0/3154722766 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368722437 0 0) 0x7f15c406c4e0 con 0x7f15c40c4630 2023-08-27T11:27:54.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c40c4a90 0x7f15c406b480 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009e50 tx=0x7f15bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4bb9b00bebcfef server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15bbfff700 1 -- 172.21.15.43:0/3154722766 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00e070 con 0x7f15c40c4a90 2023-08-27T11:27:54.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15bbfff700 1 -- 172.21.15.43:0/3154722766 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00b910 con 0x7f15c40c4a90 2023-08-27T11:27:54.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.275+0000 7f15bbfff700 1 -- 172.21.15.43:0/3154722766 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00bcc0 con 0x7f15c40c4a90 2023-08-27T11:27:54.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3154722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c40c4a90 msgr2=0x7f15c406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c40c4a90 0x7f15c406b480 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009e50 tx=0x7f15bc00b330 comp rx=0 tx=0).stop 2023-08-27T11:27:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3154722766 shutdown_connections 2023-08-27T11:27:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c40c4a90 0x7f15c406b480 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3154722766 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c4151a90 0x7f15c40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3154722766 >> 172.21.15.43:0/3154722766 conn(0x7f15c40ab820 msgr2=0x7f15c40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3154722766 shutdown_connections 2023-08-27T11:27:54.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.276+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3154722766 wait complete. 2023-08-27T11:27:54.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.278+0000 7f15cb5ff700 1 Processor -- start 2023-08-27T11:27:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.278+0000 7f15cb5ff700 1 -- start start 2023-08-27T11:27:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 0x7f15c40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 0x7f15c40c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4153b40 con 0x7f15c4151a90 2023-08-27T11:27:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40c7aa0 con 0x7f15c40c4a90 2023-08-27T11:27:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15cb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40c77c0 con 0x7f15c40c4630 2023-08-27T11:27:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47896/0 (socket says 172.21.15.43:47896) 2023-08-27T11:27:54.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3137391803 learned_addr learned my addr 172.21.15.43:0/3137391803 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 0x7f15c40c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c939b700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 0x7f15c40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 msgr2=0x7f15c40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 0x7f15c40aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 msgr2=0x7f15c40c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 0x7f15c40c9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c9b9c700 1 -- 172.21.15.43:0/3137391803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc009b30 con 0x7f15c4151a90 2023-08-27T11:27:54.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 0x7f15c40c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:54.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.279+0000 7f15c939b700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 0x7f15c40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:27:54.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00b680 tx=0x7f15bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15b9ffb700 1 -- 172.21.15.43:0/3137391803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0099b0 con 0x7f15c4151a90 2023-08-27T11:27:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15b9ffb700 1 -- 172.21.15.43:0/3137391803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc0092e0 con 0x7f15c4151a90 2023-08-27T11:27:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c41ea100 con 0x7f15c4151a90 2023-08-27T11:27:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15b9ffb700 1 -- 172.21.15.43:0/3137391803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc01c660 con 0x7f15c4151a90 2023-08-27T11:27:54.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.280+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40aae10 con 0x7f15c4151a90 2023-08-27T11:27:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.282+0000 7f15b9ffb700 1 -- 172.21.15.43:0/3137391803 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15bc01c7c0 con 0x7f15c4151a90 2023-08-27T11:27:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.283+0000 7f15b9ffb700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 0x7f15a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.283+0000 7f15b9ffb700 1 -- 172.21.15.43:0/3137391803 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15bc089f00 con 0x7f15c4151a90 2023-08-27T11:27:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.283+0000 7f15c939b700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 0x7f15a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.284+0000 7f15c939b700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 0x7f15a806c5a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ac0 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.285+0000 7f15df01bb80 1 Processor -- start 2023-08-27T11:27:54.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.285+0000 7f15df01bb80 1 -- start start 2023-08-27T11:27:54.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3dfbfe0 0x561ba3e192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3e2e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3d53730 con 0x561ba3df62e0 2023-08-27T11:27:54.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3d51050 con 0x561ba3df5f00 2023-08-27T11:27:54.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.286+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba3d4c940 con 0x561ba3dfbfe0 2023-08-27T11:27:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3e2e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:59630/0 (socket says 172.21.15.43:59630) 2023-08-27T11:27:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 -- 172.21.15.43:0/1467900906 learned_addr learned my addr 172.21.15.43:0/1467900906 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3dfbfe0 0x561ba3e192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 -- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3dfbfe0 msgr2=0x561ba3e192b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3dfbfe0 0x561ba3e192b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 -- 172.21.15.43:0/1467900906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 msgr2=0x561ba3e2e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3e2e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 -- 172.21.15.43:0/1467900906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ba3bcc5e0 con 0x561ba3df5f00 2023-08-27T11:27:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3e2e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:27:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.287+0000 7f15c939b700 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15c0010980 tx=0x7f15c0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fda4a75e94578f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15aeffd700 1 -- 172.21.15.43:0/1467900906 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0025070 con 0x561ba3df5f00 2023-08-27T11:27:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15aeffd700 1 -- 172.21.15.43:0/1467900906 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c001a070 con 0x561ba3df5f00 2023-08-27T11:27:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15aeffd700 1 -- 172.21.15.43:0/1467900906 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004220 con 0x561ba3df5f00 2023-08-27T11:27:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 -- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 msgr2=0x561ba3e18d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f15c0010980 tx=0x7f15c0013000 comp rx=0 tx=0).stop 2023-08-27T11:27:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 -- 172.21.15.43:0/1467900906 shutdown_connections 2023-08-27T11:27:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3e2e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e18d70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1467900906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3dfbfe0 0x561ba3e192b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 -- 172.21.15.43:0/1467900906 >> 172.21.15.43:0/1467900906 conn(0x561ba3d58c30 msgr2=0x561ba3df86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.288+0000 7f15df01bb80 1 -- 172.21.15.43:0/1467900906 shutdown_connections 2023-08-27T11:27:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.289+0000 7f15df01bb80 1 -- 172.21.15.43:0/1467900906 wait complete. 2023-08-27T11:27:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.289+0000 7f15df01bb80 1 -- start start 2023-08-27T11:27:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.289+0000 7f15df01bb80 1 Processor -- start 2023-08-27T11:27:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.290+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 0x561ba3e3a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.290+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e499e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.290+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15df01bb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3ceab60 con 0x561ba3e1b680 2023-08-27T11:27:54.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3cea860 con 0x561ba3df62e0 2023-08-27T11:27:54.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba3bce8d0 con 0x561ba3df5f00 2023-08-27T11:27:54.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15df01bb80 10 client.0 _ll_register_callbacks cb 0x561ba3ce8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:54.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47918/0 (socket says 172.21.15.43:47918) 2023-08-27T11:27:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 -- 172.21.15.43:0/1491279974 learned_addr learned my addr 172.21.15.43:0/1491279974 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c939b700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 0x561ba3e3a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 -- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 msgr2=0x561ba3e3a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 0x561ba3e3a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 -- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 msgr2=0x561ba3e499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c9b9c700 1 -- 172.21.15.43:0/1491279974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c000e050 con 0x561ba3e1b680 2023-08-27T11:27:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.291+0000 7f15c939b700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 0x561ba3e3a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:27:54.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0043d0 tx=0x7f15bc05d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197a692801323959 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc058990 con 0x561ba3e1b680 2023-08-27T11:27:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15bc057700 con 0x561ba3e1b680 2023-08-27T11:27:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ba3ded4f0 con 0x561ba3e1b680 2023-08-27T11:27:54.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15bc060b20 con 0x561ba3e1b680 2023-08-27T11:27:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 10 client.7761 fetch_fsmap learned FSMap version 111 2023-08-27T11:27:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x561ba3d64750 con 0x561ba3e1b680 2023-08-27T11:27:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ba3ded4f0 con 0x561ba3e1b680 2023-08-27T11:27:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 111) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f15bc05c070 con 0x561ba3e1b680 2023-08-27T11:27:54.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 10 client.7761 fetch_fsmap finished waiting for FSMap version 111 2023-08-27T11:27:54.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 10 client.7761 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:54.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 20 client.7761 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:54.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3e45ff0 0x561ba3e463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 4 client.7761 mds_command: new command op to 7575 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:27:54.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.292+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 --> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ba3d45920 con 0x561ba3e45ff0 2023-08-27T11:27:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.293+0000 7f15c939b700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3e45ff0 0x561ba3e463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.293+0000 7f15c939b700 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3e45ff0 0x561ba3e463d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614e0c7b10f4389c server_cookie=aa0878cdfc471126 in_seq=0 out_seq=0 2023-08-27T11:27:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.293+0000 7f15a3fff700 10 client.7761 ms_handle_connect on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15a3fff700 1 -- 172.21.15.43:0/1491279974 <== mds.0 v2:172.21.15.43:6836/1939845776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ba3d45920 con 0x561ba3e45ff0 2023-08-27T11:27:54.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15a3fff700 10 client.7761 handle_command_reply: tid=0 2023-08-27T11:27:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 client.7761 shutdown 2023-08-27T11:27:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 msgr2=0x561ba3e178f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0043d0 tx=0x7f15bc05d060 comp rx=0 tx=0).stop 2023-08-27T11:27:54.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 shutdown_connections 2023-08-27T11:27:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3e45ff0 0x561ba3e463d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3e1b680 0x561ba3e178f0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3df5f00 0x561ba3e3a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 --2- 172.21.15.43:0/1491279974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15a3fff700 0 client.7761 ms_handle_reset on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 >> 172.21.15.43:0/1491279974 conn(0x561ba3d58c30 msgr2=0x561ba3df3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 shutdown_connections 2023-08-27T11:27:54.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.294+0000 7f15df01bb80 1 -- 172.21.15.43:0/1491279974 wait complete. 2023-08-27T11:27:54.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.295+0000 7f15df01bb80 20 client.7761 trim_cache size 0 max 16384 2023-08-27T11:27:54.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.313+0000 7f15df01bb80 1 Processor -- start 2023-08-27T11:27:54.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.313+0000 7f15df01bb80 1 -- start start 2023-08-27T11:27:54.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3df8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3df7e20 con 0x561ba3df62e0 2023-08-27T11:27:54.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3ded4d0 con 0x561ba3df5f00 2023-08-27T11:27:54.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.314+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba3dfbe50 con 0x561ba3e1b680 2023-08-27T11:27:54.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47926/0 (socket says 172.21.15.43:47926) 2023-08-27T11:27:54.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 -- 172.21.15.43:0/3658536562 learned_addr learned my addr 172.21.15.43:0/3658536562 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c939b700 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3df8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 -- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 msgr2=0x561ba3df8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3df8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 -- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 msgr2=0x561ba3e38fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e38fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 -- 172.21.15.43:0/3658536562 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ba3b78d90 con 0x561ba3df62e0 2023-08-27T11:27:54.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.315+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f15b4004e70 tx=0x7f15b4004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ffd531c40eaf59 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15af7fe700 1 -- 172.21.15.43:0/3658536562 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b40013a0 con 0x561ba3df62e0 2023-08-27T11:27:54.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15af7fe700 1 -- 172.21.15.43:0/3658536562 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400d030 con 0x561ba3df62e0 2023-08-27T11:27:54.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15af7fe700 1 -- 172.21.15.43:0/3658536562 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4001720 con 0x561ba3df62e0 2023-08-27T11:27:54.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 -- 172.21.15.43:0/3658536562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 msgr2=0x561ba3df86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f15b4004e70 tx=0x7f15b4004ea0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 -- 172.21.15.43:0/3658536562 shutdown_connections 2023-08-27T11:27:54.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3df8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df5f00 0x561ba3e38fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 --2- 172.21.15.43:0/3658536562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df62e0 0x561ba3df86e0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 -- 172.21.15.43:0/3658536562 >> 172.21.15.43:0/3658536562 conn(0x561ba3d58c30 msgr2=0x561ba3e497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 -- 172.21.15.43:0/3658536562 shutdown_connections 2023-08-27T11:27:54.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.316+0000 7f15df01bb80 1 -- 172.21.15.43:0/3658536562 wait complete. 2023-08-27T11:27:54.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.317+0000 7f15df01bb80 1 -- start start 2023-08-27T11:27:54.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.317+0000 7f15df01bb80 1 Processor -- start 2023-08-27T11:27:54.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e1bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3ea1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3e3abb0 con 0x561ba3df5f00 2023-08-27T11:27:54.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba3e3a960 con 0x561ba3df62e0 2023-08-27T11:27:54.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba3e9e3d0 con 0x561ba3e1b680 2023-08-27T11:27:54.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15df01bb80 10 client.0 _ll_register_callbacks cb 0x561ba3ce8630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:27:54.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15c939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15c939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47928/0 (socket says 172.21.15.43:47928) 2023-08-27T11:27:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.318+0000 7f15c939b700 1 -- 172.21.15.43:0/817462445 learned_addr learned my addr 172.21.15.43:0/817462445 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c9b9c700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3ea1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e1bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 -- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 msgr2=0x561ba3ea1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3ea1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 -- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 msgr2=0x561ba3e1bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e1bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 -- 172.21.15.43:0/817462445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4004b50 con 0x561ba3df5f00 2023-08-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15c939b700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f15c0010980 tx=0x7f15c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f21dd2154175f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:54.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0025040 con 0x561ba3df5f00 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15c001a070 con 0x561ba3df5f00 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.319+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15c003bc50 con 0x561ba3df5f00 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15c003be10 con 0x561ba3df5f00 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 10 client.7767 fetch_fsmap learned FSMap version 111 2023-08-27T11:27:54.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x561ba3b61c10 con 0x561ba3df5f00 2023-08-27T11:27:54.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c001a070 con 0x561ba3df5f00 2023-08-27T11:27:54.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 111) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f15c0015980 con 0x561ba3df5f00 2023-08-27T11:27:54.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 10 client.7767 fetch_fsmap finished waiting for FSMap version 111 2023-08-27T11:27:54.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 10 client.7767 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-27T11:27:54.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 20 client.7767 populate_metadata read hostname 'smithi043' 2023-08-27T11:27:54.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3ea21b0 0x561ba3e9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:54.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 4 client.7767 mds_command: new command op to 7575 tid=0[{"prefix": "status"}] 2023-08-27T11:27:54.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 --> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ba3d06000 con 0x561ba3ea21b0 2023-08-27T11:27:54.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.320+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3ea21b0 0x561ba3e9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:54.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15a3fff700 10 client.7767 ms_handle_connect on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:54.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15c8b9a700 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3ea21b0 0x561ba3e9ae60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0ea36b3bdb552d1 server_cookie=697403d459804bb1 in_seq=0 out_seq=0 2023-08-27T11:27:54.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15a3fff700 1 -- 172.21.15.43:0/817462445 <== mds.0 v2:172.21.15.43:6836/1939845776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x561ba3d06000 con 0x561ba3ea21b0 2023-08-27T11:27:54.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15a3fff700 10 client.7767 handle_command_reply: tid=0 2023-08-27T11:27:54.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 client.7767 shutdown 2023-08-27T11:27:54.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 msgr2=0x561ba3e1a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f15c0010980 tx=0x7f15c00047c0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 shutdown_connections 2023-08-27T11:27:54.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561ba3e1b680 0x561ba3ea1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:6836/1939845776,v1:172.21.15.43:6837/1939845776] conn(0x561ba3ea21b0 0x561ba3e9ae60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561ba3df5f00 0x561ba3e1a710 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 --2- 172.21.15.43:0/817462445 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561ba3df62e0 0x561ba3e1bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15a3fff700 0 client.7767 ms_handle_reset on v2:172.21.15.43:6836/1939845776 2023-08-27T11:27:54.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.321+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 >> 172.21.15.43:0/817462445 conn(0x561ba3d58c30 msgr2=0x561ba3e434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 shutdown_connections 2023-08-27T11:27:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15df01bb80 1 -- 172.21.15.43:0/817462445 wait complete. 2023-08-27T11:27:54.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15df01bb80 20 client.7767 trim_cache size 0 max 16384 2023-08-27T11:27:54.340 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:27:54.341 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:27:54.341 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:27:54.341 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7575, 2023-08-27T11:27:54.341 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:27:54.341 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:27:54.342 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:27:54.342 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 9.3169274170000005, 2023-08-27T11:27:54.342 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 111, 2023-08-27T11:27:54.342 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 110, 2023-08-27T11:27:54.342 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 110, 2023-08-27T11:27:54.343 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 15.531265712 2023-08-27T11:27:54.343 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 msgr2=0x7f15a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 0x7f15a806c5a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ac0 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2023-08-27T11:27:54.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 msgr2=0x7f15c4152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:54.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00b680 tx=0x7f15bc004ad0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 shutdown_connections 2023-08-27T11:27:54.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15a806a0e0 0x7f15a806c5a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15c4151a90 0x7f15c4152210 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15c40c4630 0x7f15c40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 --2- 172.21.15.43:0/3137391803 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c40c4a90 0x7f15c40c9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.322+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 >> 172.21.15.43:0/3137391803 conn(0x7f15c40ab820 msgr2=0x7f15c414a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.323+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 shutdown_connections 2023-08-27T11:27:54.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:54.323+0000 7f15cb5ff700 1 -- 172.21.15.43:0/3137391803 wait complete. 2023-08-27T11:27:54.347 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 8, "epoch": 111, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 8, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:27:44.512293+0000", "damaged": [], "data_pools": [ 18 ], "enabled": true, "epoch": 111, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7575": { "addr": "172.21.15.43:6837/1939845776", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1939845776, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1939845776, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7575, "incarnation": 107, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 17, "modified": "2023-08-27T11:27:48.059677+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7575 } } } ], "standbys": [ { "addr": "172.21.15.43:6835/3995831020", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3995831020, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 3995831020, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 105, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7180, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/30396136", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 30396136, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 30396136, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7195, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6835/2128138968", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2128138968, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2128138968, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7198, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:27:54.348 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 8, 'name': 'a'}, {'join_fscid': 8, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:27:54.348 INFO:tasks.cephfs.test_failover:current = [{'gid': 7180, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 105}, {'gid': 7195, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}, {'gid': 7575, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6837/1939845776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1939845776}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1939845776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7198, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2128138968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2128138968}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2128138968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}] 2023-08-27T11:27:54.349 DEBUG:tasks.cephfs.test_failover:8 != -1 2023-08-27T11:27:54.349 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:27:55.117 INFO:tasks.ceph.mds.c.smithi043.stderr: -215> 2023-08-27T11:27:49.961+0000 7f4ef9ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:55.169 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:27:58.960 INFO:tasks.ceph.mds.a.smithi043.stderr:2023-08-27T11:27:58.959+0000 7f69d79f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:27:59.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:27:59.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.562+0000 7f6cb47ff700 1 Processor -- start 2023-08-27T11:27:59.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.562+0000 7f6cb47ff700 1 -- start start 2023-08-27T11:27:59.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.563+0000 7f6cb47ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6cac151a90 0x7f6cac0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.563+0000 7f6cb47ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6cac0c4630 0x7f6cac0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb47ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac06c4e0 con 0x7f6cac06ad70 2023-08-27T11:27:59.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb47ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac155370 con 0x7f6cac151a90 2023-08-27T11:27:59.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb47ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac151e70 con 0x7f6cac0c4630 2023-08-27T11:27:59.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6cac151a90 0x7f6cac0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:59.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6cac151a90 0x7f6cac0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44438/0 (socket says 172.21.15.43:44438) 2023-08-27T11:27:59.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 -- 172.21.15.43:0/451706275 learned_addr learned my addr 172.21.15.43:0/451706275 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:59.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 -- 172.21.15.43:0/451706275 >> v2:172.21.15.57:3300/0 conn(0x7f6cac0c4630 msgr2=0x7f6cac0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:59.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 --2- 172.21.15.43:0/451706275 >> v2:172.21.15.57:3300/0 conn(0x7f6cac0c4630 0x7f6cac0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 -- 172.21.15.43:0/451706275 >> v1:172.21.15.57:6789/0 conn(0x7f6cac06ad70 legacy=0x7f6cac06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:27:59.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.564+0000 7f6cb259b700 1 -- 172.21.15.43:0/451706275 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac154480 con 0x7f6cac151a90 2023-08-27T11:27:59.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb259b700 1 --2- 172.21.15.43:0/451706275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0c7bb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0c7740 tx=0x7f6ca8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e826b64aedaf20 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:59.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb1599700 1 -- 172.21.15.43:0/451706275 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004230 con 0x7f6cac151a90 2023-08-27T11:27:59.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb1599700 1 -- 172.21.15.43:0/451706275 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8004390 con 0x7f6cac151a90 2023-08-27T11:27:59.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb1599700 1 -- 172.21.15.43:0/451706275 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80036a0 con 0x7f6cac151a90 2023-08-27T11:27:59.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 -- 172.21.15.43:0/451706275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 msgr2=0x7f6cac0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:59.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/451706275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0c7bb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0c7740 tx=0x7f6ca8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 -- 172.21.15.43:0/451706275 shutdown_connections 2023-08-27T11:27:59.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/451706275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0c7bb0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/451706275 >> v2:172.21.15.57:3300/0 conn(0x7f6cac0c4630 0x7f6cac0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 -- 172.21.15.43:0/451706275 >> 172.21.15.43:0/451706275 conn(0x7f6cac0ab820 msgr2=0x7f6cac0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:59.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.565+0000 7f6cb47ff700 1 -- 172.21.15.43:0/451706275 shutdown_connections 2023-08-27T11:27:59.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.566+0000 7f6cb47ff700 1 -- 172.21.15.43:0/451706275 wait complete. 2023-08-27T11:27:59.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.567+0000 7f6cb47ff700 1 Processor -- start 2023-08-27T11:27:59.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.567+0000 7f6cb47ff700 1 -- start start 2023-08-27T11:27:59.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac06ad70 0x7f6cac0c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cac0c4630 0x7f6cac0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1ed7f0 con 0x7f6cac151a90 2023-08-27T11:27:59.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1edad0 con 0x7f6cac06ad70 2023-08-27T11:27:59.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac153b20 con 0x7f6cac0c4630 2023-08-27T11:27:59.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.568+0000 7f6cb2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:59.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44448/0 (socket says 172.21.15.43:44448) 2023-08-27T11:27:59.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 -- 172.21.15.43:0/1890684925 learned_addr learned my addr 172.21.15.43:0/1890684925 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:27:59.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb259b700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac06ad70 0x7f6cac0c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:59.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb1d9a700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cac0c4630 0x7f6cac0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:59.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 -- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cac0c4630 msgr2=0x7f6cac0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cac0c4630 0x7f6cac0aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 -- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac06ad70 msgr2=0x7f6cac0c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac06ad70 0x7f6cac0c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 -- 172.21.15.43:0/1890684925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009550 con 0x7f6cac151a90 2023-08-27T11:27:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb2d9c700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c7a0 tx=0x7f6ca400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:59.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4003e10 con 0x7f6cac151a90 2023-08-27T11:27:59.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca4005070 con 0x7f6cac151a90 2023-08-27T11:27:59.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4005420 con 0x7f6cac151a90 2023-08-27T11:27:59.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.569+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac153e00 con 0x7f6cac151a90 2023-08-27T11:27:59.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.570+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac0aae10 con 0x7f6cac151a90 2023-08-27T11:27:59.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.571+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac04ee70 con 0x7f6cac151a90 2023-08-27T11:27:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.572+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ca4005580 con 0x7f6cac151a90 2023-08-27T11:27:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.572+0000 7f6ca2ffd700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 0x7f6c9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:27:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.573+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6ca4087760 con 0x7f6cac151a90 2023-08-27T11:27:59.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.573+0000 7f6cb259b700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 0x7f6c9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:27:59.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.573+0000 7f6cb259b700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 0x7f6c9006c5a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009130 tx=0x7f6ca8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:27:59.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.577+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ca4052de0 con 0x7f6cac151a90 2023-08-27T11:27:59.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.830+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cac06c130 con 0x7f6cac151a90 2023-08-27T11:27:59.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.830+0000 7f6ca2ffd700 1 -- 172.21.15.43:0/1890684925 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4877 (secure 0 0 0) 0x7f6ca4056400 con 0x7f6cac151a90 2023-08-27T11:27:59.832 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:27:59.833 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":116,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":5,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:58.118818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7180":{"gid":7180,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:27:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 msgr2=0x7f6c9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 0x7f6c9006c5a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009130 tx=0x7f6ca8008030 comp rx=0 tx=0).stop 2023-08-27T11:27:59.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 msgr2=0x7f6cac0bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:27:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c7a0 tx=0x7f6ca400cab0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 shutdown_connections 2023-08-27T11:27:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c9006a0e0 0x7f6c9006c5a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6cac151a90 0x7f6cac0bbd50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6cac06ad70 0x7f6cac0c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 --2- 172.21.15.43:0/1890684925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6cac0c4630 0x7f6cac0aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:27:59.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.832+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 >> 172.21.15.43:0/1890684925 conn(0x7f6cac0ab820 msgr2=0x7f6cac14b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:27:59.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.833+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 shutdown_connections 2023-08-27T11:27:59.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:27:59.833+0000 7f6cb47ff700 1 -- 172.21.15.43:0/1890684925 wait complete. 2023-08-27T11:27:59.837 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 116 2023-08-27T11:28:00.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:27:58.118818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7180': {'gid': 7180, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:28:00.256 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:28:00.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-27T11:28:00.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.463+0000 7f87593ff700 1 Processor -- start 2023-08-27T11:28:00.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.463+0000 7f87593ff700 1 -- start start 2023-08-27T11:28:00.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.464+0000 7f87593ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.464+0000 7f87593ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.464+0000 7f87593ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875406c4e0 con 0x7f8754151a90 2023-08-27T11:28:00.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.464+0000 7f87593ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8754155370 con 0x7f875406ad70 2023-08-27T11:28:00.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.464+0000 7f87593ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540c82c0 con 0x7f87540c4630 2023-08-27T11:28:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87537fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:49838/0 (socket says 172.21.15.43:49838) 2023-08-27T11:28:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87537fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60644/0 (socket says 172.21.15.43:60644) 2023-08-27T11:28:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 -- 172.21.15.43:0/683117306 learned_addr learned my addr 172.21.15.43:0/683117306 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 -- 172.21.15.43:0/683117306 >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 msgr2=0x7f875406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 --2- 172.21.15.43:0/683117306 >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 -- 172.21.15.43:0/683117306 >> v1:172.21.15.57:6789/0 conn(0x7f8754151a90 legacy=0x7f87540c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 -- 172.21.15.43:0/683117306 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754151e70 con 0x7f87540c4630 2023-08-27T11:28:00.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87537fe700 1 --2- 172.21.15.43:0/683117306 >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:00.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.465+0000 7f87527fc700 1 --2- 172.21.15.43:0/683117306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87480098f0 tx=0x7f8748009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b031c5b46691040 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f8751ffb700 1 -- 172.21.15.43:0/683117306 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748011830 con 0x7f87540c4630 2023-08-27T11:28:00.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f8751ffb700 1 -- 172.21.15.43:0/683117306 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748011990 con 0x7f87540c4630 2023-08-27T11:28:00.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f8751ffb700 1 -- 172.21.15.43:0/683117306 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748011d20 con 0x7f87540c4630 2023-08-27T11:28:00.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 -- 172.21.15.43:0/683117306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 msgr2=0x7f87540c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 --2- 172.21.15.43:0/683117306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f87480098f0 tx=0x7f8748009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:00.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 -- 172.21.15.43:0/683117306 shutdown_connections 2023-08-27T11:28:00.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 --2- 172.21.15.43:0/683117306 >> v2:172.21.15.57:3300/0 conn(0x7f875406ad70 0x7f875406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 --2- 172.21.15.43:0/683117306 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f87540c4a90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 -- 172.21.15.43:0/683117306 >> 172.21.15.43:0/683117306 conn(0x7f87540ab820 msgr2=0x7f87540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.466+0000 7f87593ff700 1 -- 172.21.15.43:0/683117306 shutdown_connections 2023-08-27T11:28:00.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.467+0000 7f87593ff700 1 -- 172.21.15.43:0/683117306 wait complete. 2023-08-27T11:28:00.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.468+0000 7f87593ff700 1 Processor -- start 2023-08-27T11:28:00.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.468+0000 7f87593ff700 1 -- start start 2023-08-27T11:28:00.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f875406ad70 0x7f8754146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f8754150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754152290 con 0x7f8754151a90 2023-08-27T11:28:00.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8754152570 con 0x7f875406ad70 2023-08-27T11:28:00.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87593ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8754153f30 con 0x7f87540c4630 2023-08-27T11:28:00.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44458/0 (socket says 172.21.15.43:44458) 2023-08-27T11:28:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.469+0000 7f87537fe700 1 -- 172.21.15.43:0/850735200 learned_addr learned my addr 172.21.15.43:0/850735200 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87527fc700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f8754150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f8752ffd700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f875406ad70 0x7f8754146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 -- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 msgr2=0x7f8754150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f8754150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 -- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f875406ad70 msgr2=0x7f8754146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f875406ad70 0x7f8754146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 -- 172.21.15.43:0/850735200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c009a70 con 0x7f8754151a90 2023-08-27T11:28:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87537fe700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f874c00efc0 tx=0x7f874c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f873b7fe700 1 -- 172.21.15.43:0/850735200 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c009d70 con 0x7f8754151a90 2023-08-27T11:28:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f873b7fe700 1 -- 172.21.15.43:0/850735200 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c00f040 con 0x7f8754151a90 2023-08-27T11:28:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f873b7fe700 1 -- 172.21.15.43:0/850735200 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00ce00 con 0x7f8754151a90 2023-08-27T11:28:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.470+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8748009550 con 0x7f8754151a90 2023-08-27T11:28:00.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.471+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8754150b70 con 0x7f8754151a90 2023-08-27T11:28:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.473+0000 7f873b7fe700 1 -- 172.21.15.43:0/850735200 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f874c014480 con 0x7f8754151a90 2023-08-27T11:28:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.473+0000 7f873b7fe700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.474+0000 7f873b7fe700 1 -- 172.21.15.43:0/850735200 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f874c088e00 con 0x7f8754151a90 2023-08-27T11:28:00.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.474+0000 7f8752ffd700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.474+0000 7f8752ffd700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 0x7f874006c5a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f87540c4ec0 tx=0x7f8744009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.476+0000 7f876cc70b80 1 Processor -- start 2023-08-27T11:28:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.476+0000 7f876cc70b80 1 -- start start 2023-08-27T11:28:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9dafe0 0x55f5db9f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5dba0d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5db932730 con 0x55f5db9d4f00 2023-08-27T11:28:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5db930050 con 0x55f5db9d52e0 2023-08-27T11:28:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5db92b940 con 0x55f5db9dafe0 2023-08-27T11:28:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44468/0 (socket says 172.21.15.43:44468) 2023-08-27T11:28:00.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 -- 172.21.15.43:0/3187524511 learned_addr learned my addr 172.21.15.43:0/3187524511 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f87537fe700 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5dba0d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f87527fc700 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9dafe0 0x55f5db9f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 -- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9dafe0 msgr2=0x55f5db9f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9dafe0 0x55f5db9f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 -- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 msgr2=0x55f5dba0d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5dba0d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.477+0000 7f8752ffd700 1 -- 172.21.15.43:0/3187524511 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5db7ab5e0 con 0x55f5db9d4f00 2023-08-27T11:28:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.478+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8744005360 tx=0x7f8744011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a09068204f2c0b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.478+0000 7f87397fa700 1 -- 172.21.15.43:0/3187524511 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744003d20 con 0x55f5db9d4f00 2023-08-27T11:28:00.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.478+0000 7f87397fa700 1 -- 172.21.15.43:0/3187524511 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8744003e80 con 0x55f5db9d4f00 2023-08-27T11:28:00.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.478+0000 7f87397fa700 1 -- 172.21.15.43:0/3187524511 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744021650 con 0x55f5db9d4f00 2023-08-27T11:28:00.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 -- 172.21.15.43:0/3187524511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 msgr2=0x55f5db9f7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f8744005360 tx=0x7f8744011000 comp rx=0 tx=0).stop 2023-08-27T11:28:00.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 -- 172.21.15.43:0/3187524511 shutdown_connections 2023-08-27T11:28:00.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5dba0d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d4f00 0x55f5db9f7d70 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3187524511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9dafe0 0x55f5db9f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 -- 172.21.15.43:0/3187524511 >> 172.21.15.43:0/3187524511 conn(0x55f5db937c30 msgr2=0x55f5db9d76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 -- 172.21.15.43:0/3187524511 shutdown_connections 2023-08-27T11:28:00.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.479+0000 7f876cc70b80 1 -- 172.21.15.43:0/3187524511 wait complete. 2023-08-27T11:28:00.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.480+0000 7f876cc70b80 1 -- start start 2023-08-27T11:28:00.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.480+0000 7f876cc70b80 1 Processor -- start 2023-08-27T11:28:00.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba13c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5dba14e80 0x55f5dba157a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5db8c9b60 con 0x55f5db9d52e0 2023-08-27T11:28:00.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5db8c9860 con 0x55f5dba14e80 2023-08-27T11:28:00.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5db7ad8d0 con 0x55f5db9d4f00 2023-08-27T11:28:00.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f876cc70b80 10 client.0 _ll_register_callbacks cb 0x55f5db8c7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:00.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f87527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f87527fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44484/0 (socket says 172.21.15.43:44484) 2023-08-27T11:28:00.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f87527fc700 1 -- 172.21.15.43:0/3350603257 learned_addr learned my addr 172.21.15.43:0/3350603257 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.481+0000 7f87527fc700 1 -- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 msgr2=0x55f5dba13c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f87527fc700 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba13c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f87527fc700 1 -- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5dba14e80 msgr2=0x55f5dba157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f87527fc700 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5dba14e80 0x55f5dba157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f87527fc700 1 -- 172.21.15.43:0/3350603257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874400f040 con 0x55f5db9d52e0 2023-08-27T11:28:00.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f87527fc700 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f8748009130 tx=0x7f874800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35abb71a628fea7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f8731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:00.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748021040 con 0x55f5db9d52e0 2023-08-27T11:28:00.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f8748004510 con 0x55f5db9d52e0 2023-08-27T11:28:00.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5db924920 con 0x55f5db9d52e0 2023-08-27T11:28:00.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87480036a0 con 0x55f5db9d52e0 2023-08-27T11:28:00.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f876cc70b80 10 client.7791 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:00.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x55f5db943750 con 0x55f5db9d52e0 2023-08-27T11:28:00.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.482+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5db924920 con 0x55f5db9d52e0 2023-08-27T11:28:00.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8748003800 con 0x55f5db9d52e0 2023-08-27T11:28:00.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 10 client.7791 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:00.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 10 client.7791 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:00.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 20 client.7791 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:00.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba15f70 0x55f5db9f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 4 client.7791 mds_command: new command op to 7180 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:28:00.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5db8e5000 con 0x55f5dba15f70 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.483+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba15f70 0x55f5db9f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.484+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba15f70 0x55f5db9f5e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c3915689ea0c16 server_cookie=b877354252b93721 in_seq=0 out_seq=0 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.484+0000 7f8731ffb700 10 client.7791 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.484+0000 7f8731ffb700 1 -- 172.21.15.43:0/3350603257 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f5db8e5000 con 0x55f5dba15f70 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.484+0000 7f8731ffb700 10 client.7791 handle_command_reply: tid=0 2023-08-27T11:28:00.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.484+0000 7f876cc70b80 1 client.7791 shutdown 2023-08-27T11:28:00.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 msgr2=0x55f5dba18780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f8748009130 tx=0x7f874800e000 comp rx=0 tx=0).stop 2023-08-27T11:28:00.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 shutdown_connections 2023-08-27T11:28:00.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba15f70 0x55f5db9f5e30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5dba14e80 0x55f5dba157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba13c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f8731ffb700 0 client.7791 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:00.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3350603257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5db9d52e0 0x55f5dba18780 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 >> 172.21.15.43:0/3350603257 conn(0x55f5db937c30 msgr2=0x55f5db9d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 shutdown_connections 2023-08-27T11:28:00.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 1 -- 172.21.15.43:0/3350603257 wait complete. 2023-08-27T11:28:00.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.485+0000 7f876cc70b80 20 client.7791 trim_cache size 0 max 16384 2023-08-27T11:28:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.504+0000 7f876cc70b80 1 Processor -- start 2023-08-27T11:28:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.504+0000 7f876cc70b80 1 -- start start 2023-08-27T11:28:00.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba0c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9d4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dba14260 con 0x55f5dba14e80 2023-08-27T11:28:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dba163f0 con 0x55f5db9d52e0 2023-08-27T11:28:00.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5dba132f0 con 0x55f5db9d4f00 2023-08-27T11:28:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f87537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f87537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44500/0 (socket says 172.21.15.43:44500) 2023-08-27T11:28:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f87537fe700 1 -- 172.21.15.43:0/566882999 learned_addr learned my addr 172.21.15.43:0/566882999 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f8752ffd700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba0c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.505+0000 7f87527fc700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9d4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 -- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 msgr2=0x55f5dba0c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba0c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 -- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 msgr2=0x55f5db9d4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9d4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 -- 172.21.15.43:0/566882999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5db9d5b60 con 0x55f5dba14e80 2023-08-27T11:28:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f8752ffd700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba0c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f87537fe700 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f874c058040 tx=0x7f874c058840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d83e0e1643d7a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f8739ffb700 1 -- 172.21.15.43:0/566882999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c06f220 con 0x55f5dba14e80 2023-08-27T11:28:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f8739ffb700 1 -- 172.21.15.43:0/566882999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c056450 con 0x55f5dba14e80 2023-08-27T11:28:00.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f8739ffb700 1 -- 172.21.15.43:0/566882999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0577e0 con 0x55f5dba14e80 2023-08-27T11:28:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.506+0000 7f876cc70b80 1 -- 172.21.15.43:0/566882999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 msgr2=0x55f5db9f7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f874c058040 tx=0x7f874c058840 comp rx=0 tx=0).stop 2023-08-27T11:28:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 -- 172.21.15.43:0/566882999 shutdown_connections 2023-08-27T11:28:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5db9f7850 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5dba0c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 --2- 172.21.15.43:0/566882999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9d4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 -- 172.21.15.43:0/566882999 >> 172.21.15.43:0/566882999 conn(0x55f5db937c30 msgr2=0x55f5db9d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 -- 172.21.15.43:0/566882999 shutdown_connections 2023-08-27T11:28:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 -- 172.21.15.43:0/566882999 wait complete. 2023-08-27T11:28:00.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.507+0000 7f876cc70b80 1 -- start start 2023-08-27T11:28:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.508+0000 7f876cc70b80 1 Processor -- start 2023-08-27T11:28:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.508+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5db9d9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.508+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f876cc70b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5dba11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f876cc70b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5db9d3010 con 0x55f5dba14e80 2023-08-27T11:28:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dba12960 con 0x55f5db9d52e0 2023-08-27T11:28:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f876cc70b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5db9fba00 con 0x55f5db9d4f00 2023-08-27T11:28:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f876cc70b80 10 client.0 _ll_register_callbacks cb 0x55f5db8c7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5db9d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5dba11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f8752ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5db9d9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:49890/0 (socket says 172.21.15.43:49890) 2023-08-27T11:28:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f8752ffd700 1 -- 172.21.15.43:0/3541886227 learned_addr learned my addr 172.21.15.43:0/3541886227 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87527fc700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 -- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 msgr2=0x55f5db9d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5db9d9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 -- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 msgr2=0x55f5db9f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 -- 172.21.15.43:0/3541886227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8754150b70 con 0x55f5dba14e80 2023-08-27T11:28:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f87537fe700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5dba11a10 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f874c00c7a0 tx=0x7f874c057fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2959a902d5a2897 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:00.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.509+0000 7f8731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0543f0 con 0x55f5dba14e80 2023-08-27T11:28:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f874c06f220 con 0x55f5dba14e80 2023-08-27T11:28:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5db9cc4f0 con 0x55f5dba14e80 2023-08-27T11:28:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f874c076230 con 0x55f5dba14e80 2023-08-27T11:28:00.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 10 client.7797 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x55f5db757d90 con 0x55f5dba14e80 2023-08-27T11:28:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5db9cc4f0 con 0x55f5dba14e80 2023-08-27T11:28:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f874c07d020 con 0x55f5dba14e80 2023-08-27T11:28:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 10 client.7797 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:00.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 10 client.7797 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 20 client.7797 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba7a820 0x55f5db9f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 4 client.7797 mds_command: new command op to 7180 tid=0[{"prefix": "status"}] 2023-08-27T11:28:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f5db778f20 con 0x55f5dba7a820 2023-08-27T11:28:00.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.510+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba7a820 0x55f5db9f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f8752ffd700 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba7a820 0x55f5db9f5c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=700c07e98b88812c server_cookie=7263edb033858274 in_seq=0 out_seq=0 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f8731ffb700 10 client.7797 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f8731ffb700 1 -- 172.21.15.43:0/3541886227 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55f5db778f20 con 0x55f5dba7a820 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f8731ffb700 10 client.7797 handle_command_reply: tid=0 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 client.7797 shutdown 2023-08-27T11:28:00.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 msgr2=0x55f5dba11a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5dba11a10 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f874c00c7a0 tx=0x7f874c057fb0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 shutdown_connections 2023-08-27T11:28:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55f5dba7a820 0x55f5db9f5c90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f5dba14e80 0x55f5dba11a10 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55f5db9d4f00 0x55f5db9d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 --2- 172.21.15.43:0/3541886227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55f5db9d52e0 0x55f5db9f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f8731ffb700 0 client.7797 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.511+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 >> 172.21.15.43:0/3541886227 conn(0x55f5db937c30 msgr2=0x55f5db9d76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 shutdown_connections 2023-08-27T11:28:00.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f876cc70b80 1 -- 172.21.15.43:0/3541886227 wait complete. 2023-08-27T11:28:00.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f876cc70b80 20 client.7797 trim_cache size 0 max 16384 2023-08-27T11:28:00.530 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:00.530 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:28:00.530 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:28:00.531 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7180, 2023-08-27T11:28:00.531 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:28:00.531 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:28:00.531 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:28:00.531 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 5.3974166849999996, 2023-08-27T11:28:00.532 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 116, 2023-08-27T11:28:00.532 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 111, 2023-08-27T11:28:00.532 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 111, 2023-08-27T11:28:00.532 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 21.730876033000001 2023-08-27T11:28:00.532 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 msgr2=0x7f874006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 0x7f874006c5a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f87540c4ec0 tx=0x7f8744009040 comp rx=0 tx=0).stop 2023-08-27T11:28:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 msgr2=0x7f875414ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:00.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f874c00efc0 tx=0x7f874c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 shutdown_connections 2023-08-27T11:28:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8754151a90 0x7f875414ca40 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f875406ad70 0x7f8754146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 --2- 172.21.15.43:0/850735200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87540c4630 0x7f8754150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.512+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 >> 172.21.15.43:0/850735200 conn(0x7f87540ab820 msgr2=0x7f875414f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.513+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 shutdown_connections 2023-08-27T11:28:00.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:00.513+0000 7f87593ff700 1 -- 172.21.15.43:0/850735200 wait complete. 2023-08-27T11:28:00.536 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 8, "epoch": 116, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 8, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:27:44.512293+0000", "damaged": [], "data_pools": [ 18 ], "enabled": true, "epoch": 116, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7180": { "addr": "172.21.15.43:6835/3995831020", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3995831020, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 3995831020, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7180, "incarnation": 113, "join_fscid": 8, "name": "a", "rank": 0, "state": "up:active", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 111, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 17, "modified": "2023-08-27T11:27:58.118818+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7180 } } } ], "standbys": [ { "addr": "172.21.15.57:6834/30396136", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 30396136, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 30396136, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 112, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7195, "incarnation": 0, "join_fscid": 8, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 5 }, { "addr": "172.21.15.57:6835/2128138968", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2128138968, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2128138968, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7198, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1498551988", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1498551988, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1498551988, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 114, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7363, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:28:00.537 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 8, 'name': 'a'}, {'join_fscid': 8, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:28:00.538 INFO:tasks.cephfs.test_failover:current = [{'gid': 7180, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7195, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 5, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 112}, {'gid': 7363, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1498551988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1498551988}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1498551988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 114}, {'gid': 7198, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2128138968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2128138968}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2128138968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}] 2023-08-27T11:28:00.538 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:28:05.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:05.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.750+0000 7f6a1edff700 1 Processor -- start 2023-08-27T11:28:05.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.750+0000 7f6a1edff700 1 -- start start 2023-08-27T11:28:05.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.751+0000 7f6a1edff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a18151910 0x7f6a18157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.751+0000 7f6a1edff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180c5ae0 con 0x7f6a180c51a0 2023-08-27T11:28:05.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a1edff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a180c1190 con 0x7f6a180c15e0 2023-08-27T11:28:05.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a1edff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a18072900 con 0x7f6a18151910 2023-08-27T11:28:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a17fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6a180c51a0 0x7f6a180c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53962/0 (socket says 172.21.15.43:53962) 2023-08-27T11:28:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a17fff700 1 -- 172.21.15.43:0/4171644822 learned_addr learned my addr 172.21.15.43:0/4171644822 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a1cb9b700 1 --2- 172.21.15.43:0/4171644822 >> v2:172.21.15.57:3300/0 conn(0x7f6a18151910 0x7f6a18157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107009685 0 0) 0x7f6a180c5ae0 con 0x7f6a180c51a0 2023-08-27T11:28:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.752+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a080035b0 con 0x7f6a180c51a0 2023-08-27T11:28:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1165443559 0 0) 0x7f6a080035b0 con 0x7f6a180c51a0 2023-08-27T11:28:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 >> v2:172.21.15.57:3300/0 conn(0x7f6a18151910 msgr2=0x7f6a18157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 --2- 172.21.15.43:0/4171644822 >> v2:172.21.15.57:3300/0 conn(0x7f6a18151910 0x7f6a18157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 >> v1:172.21.15.57:6789/0 conn(0x7f6a180c15e0 legacy=0x7f6a1815ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180c6c00 con 0x7f6a180c51a0 2023-08-27T11:28:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f6a04001670 con 0x7f6a180c51a0 2023-08-27T11:28:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 >> v1:172.21.15.43:6789/0 conn(0x7f6a180c51a0 legacy=0x7f6a180c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a08003a00 0x7f6a08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08004850 0x7f6a08004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 0x7f6a0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18072900 con 0x7f6a08005210 2023-08-27T11:28:05.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0800c1b0 con 0x7f6a08004850 2023-08-27T11:28:05.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0800c370 con 0x7f6a08003a00 2023-08-27T11:28:05.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 0x7f6a0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a17fff700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08004850 0x7f6a08004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1cb9b700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a08003a00 0x7f6a08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 -- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a08003a00 msgr2=0x7f6a08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:05.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a08003a00 0x7f6a08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 -- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08004850 msgr2=0x7f6a08004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08004850 0x7f6a08004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.753+0000 7f6a1d39c700 1 -- 172.21.15.43:0/4171644822 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080035b0 con 0x7f6a08005210 2023-08-27T11:28:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a1d39c700 1 -- 172.21.15.43:0/4171644822 reap_dead start 2023-08-27T11:28:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a1d39c700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 0x7f6a0800ba10 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000c160 tx=0x7f6a08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee8d567d483b27c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10001db0 con 0x7f6a08005210 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000ccc0 con 0x7f6a08005210 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a177fe700 1 -- 172.21.15.43:0/4171644822 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10003c40 con 0x7f6a08005210 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a1edff700 1 -- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 msgr2=0x7f6a0800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a1edff700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 0x7f6a0800ba10 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000c160 tx=0x7f6a08005880 comp rx=0 tx=0).stop 2023-08-27T11:28:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.754+0000 7f6a1edff700 1 -- 172.21.15.43:0/4171644822 shutdown_connections 2023-08-27T11:28:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.755+0000 7f6a1edff700 1 --2- 172.21.15.43:0/4171644822 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a08005210 0x7f6a0800ba10 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.755+0000 7f6a1edff700 1 -- 172.21.15.43:0/4171644822 >> 172.21.15.43:0/4171644822 conn(0x7f6a180a9740 msgr2=0x7f6a180a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.755+0000 7f6a1edff700 1 -- 172.21.15.43:0/4171644822 shutdown_connections 2023-08-27T11:28:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.755+0000 7f6a1edff700 1 -- 172.21.15.43:0/4171644822 wait complete. 2023-08-27T11:28:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.756+0000 7f6a1edff700 1 Processor -- start 2023-08-27T11:28:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.756+0000 7f6a1edff700 1 -- start start 2023-08-27T11:28:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08005210 0x7f6a1814cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a18145d00 0x7f6a180ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18152540 con 0x7f6a18146480 2023-08-27T11:28:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a180aaee0 con 0x7f6a08005210 2023-08-27T11:28:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.757+0000 7f6a1edff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181eabb0 con 0x7f6a18145d00 2023-08-27T11:28:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44542/0 (socket says 172.21.15.43:44542) 2023-08-27T11:28:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 -- 172.21.15.43:0/3615114136 learned_addr learned my addr 172.21.15.43:0/3615114136 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a1cb9b700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08005210 0x7f6a1814cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a1d39c700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a18145d00 0x7f6a180ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 -- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a18145d00 msgr2=0x7f6a180ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a18145d00 0x7f6a180ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 -- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08005210 msgr2=0x7f6a1814cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08005210 0x7f6a1814cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 -- 172.21.15.43:0/3615114136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a181eae90 con 0x7f6a18146480 2023-08-27T11:28:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a17fff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6a040072c0 tx=0x7f6a040075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a040077b0 con 0x7f6a18146480 2023-08-27T11:28:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400f870 con 0x7f6a18146480 2023-08-27T11:28:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.758+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400fc20 con 0x7f6a18146480 2023-08-27T11:28:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.759+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a180aa890 con 0x7f6a18146480 2023-08-27T11:28:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.759+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1814d280 con 0x7f6a18146480 2023-08-27T11:28:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.760+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a180ac080 con 0x7f6a18146480 2023-08-27T11:28:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.761+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a0400fd80 con 0x7f6a18146480 2023-08-27T11:28:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.762+0000 7f6a157fa700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 0x7f69fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.762+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6a04087c00 con 0x7f6a18146480 2023-08-27T11:28:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.762+0000 7f6a1cb9b700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 0x7f69fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:05.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.762+0000 7f6a1cb9b700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 0x7f69fc06c5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6a180ac480 tx=0x7f6a0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:05.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:05.766+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a180ac080 con 0x7f6a18146480 2023-08-27T11:28:06.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.020+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a180ac080 con 0x7f6a18146480 2023-08-27T11:28:06.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.020+0000 7f6a157fa700 1 -- 172.21.15.43:0/3615114136 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4877 (secure 0 0 0) 0x7f6a180ac080 con 0x7f6a18146480 2023-08-27T11:28:06.022 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:06.022 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":116,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":5,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:58.118818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7180":{"gid":7180,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 msgr2=0x7f69fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 0x7f69fc06c5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6a180ac480 tx=0x7f6a0c008040 comp rx=0 tx=0).stop 2023-08-27T11:28:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 msgr2=0x7f6a181457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6a040072c0 tx=0x7f6a040075d0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 shutdown_connections 2023-08-27T11:28:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f69fc06a0e0 0x7f69fc06c5a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a18145d00 0x7f6a180ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a08005210 0x7f6a1814cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 --2- 172.21.15.43:0/3615114136 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6a18146480 0x7f6a181457c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 >> 172.21.15.43:0/3615114136 conn(0x7f6a180a9740 msgr2=0x7f6a180a76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 shutdown_connections 2023-08-27T11:28:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.023+0000 7f6a1edff700 1 -- 172.21.15.43:0/3615114136 wait complete. 2023-08-27T11:28:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 116 2023-08-27T11:28:06.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:27:58.118818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7180': {'gid': 7180, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:28:06.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:28:06.447 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-27T11:28:06.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.649+0000 7f82715ff700 1 Processor -- start 2023-08-27T11:28:06.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.649+0000 7f82715ff700 1 -- start start 2023-08-27T11:28:06.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 0x7f826c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c06ca60 0x7f826c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f826c0ab040 0x7f826c155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c1530b0 con 0x7f826c0ab040 2023-08-27T11:28:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c14c860 con 0x7f826c0c51a0 2023-08-27T11:28:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.650+0000 7f82715ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c06d700 con 0x7f826c06ca60 2023-08-27T11:28:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f826c0ab040 0x7f826c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.653 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f826c0ab040 0x7f826c155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44544/0 (socket says 172.21.15.43:44544) 2023-08-27T11:28:06.654 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 -- 172.21.15.43:0/242016312 learned_addr learned my addr 172.21.15.43:0/242016312 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 -- 172.21.15.43:0/242016312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c06ca60 msgr2=0x7f826c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.655 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 --2- 172.21.15.43:0/242016312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c06ca60 0x7f826c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 -- 172.21.15.43:0/242016312 >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 msgr2=0x7f826c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826affd700 1 --2- 172.21.15.43:0/242016312 >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 0x7f826c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 --2- 172.21.15.43:0/242016312 >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 0x7f826c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 -- 172.21.15.43:0/242016312 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c152430 con 0x7f826c0ab040 2023-08-27T11:28:06.656 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826affd700 1 --2- 172.21.15.43:0/242016312 >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 0x7f826c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.651+0000 7f826b7fe700 1 --2- 172.21.15.43:0/242016312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c0ab040 0x7f826c155910 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f826c06db90 tx=0x7f826400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde8127326893fe0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f8269ffb700 1 -- 172.21.15.43:0/242016312 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826400e070 con 0x7f826c0ab040 2023-08-27T11:28:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f8269ffb700 1 -- 172.21.15.43:0/242016312 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826400b980 con 0x7f826c0ab040 2023-08-27T11:28:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f8269ffb700 1 -- 172.21.15.43:0/242016312 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826400bd30 con 0x7f826c0ab040 2023-08-27T11:28:06.657 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 -- 172.21.15.43:0/242016312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c0ab040 msgr2=0x7f826c155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 --2- 172.21.15.43:0/242016312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c0ab040 0x7f826c155910 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f826c06db90 tx=0x7f826400b330 comp rx=0 tx=0).stop 2023-08-27T11:28:06.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 -- 172.21.15.43:0/242016312 shutdown_connections 2023-08-27T11:28:06.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 --2- 172.21.15.43:0/242016312 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c0ab040 0x7f826c155910 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 --2- 172.21.15.43:0/242016312 >> v2:172.21.15.57:3300/0 conn(0x7f826c0c51a0 0x7f826c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 --2- 172.21.15.43:0/242016312 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c06ca60 0x7f826c0aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 -- 172.21.15.43:0/242016312 >> 172.21.15.43:0/242016312 conn(0x7f826c06aa50 msgr2=0x7f826c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 -- 172.21.15.43:0/242016312 shutdown_connections 2023-08-27T11:28:06.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.652+0000 7f82715ff700 1 -- 172.21.15.43:0/242016312 wait complete. 2023-08-27T11:28:06.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.655+0000 7f82715ff700 1 Processor -- start 2023-08-27T11:28:06.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.655+0000 7f82715ff700 1 -- start start 2023-08-27T11:28:06.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c0ab040 0x7f826c0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c0c51a0 0x7f826c1e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0a8270 con 0x7f826c06ca60 2023-08-27T11:28:06.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0bc8e0 con 0x7f826c0ab040 2023-08-27T11:28:06.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f82715ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c0bfa90 con 0x7f826c0c51a0 2023-08-27T11:28:06.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44546/0 (socket says 172.21.15.43:44546) 2023-08-27T11:28:06.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.656+0000 7f826affd700 1 -- 172.21.15.43:0/1298724652 learned_addr learned my addr 172.21.15.43:0/1298724652 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826b7fe700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c0c51a0 0x7f826c1e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826a7fc700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c0ab040 0x7f826c0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 -- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c0c51a0 msgr2=0x7f826c1e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c0c51a0 0x7f826c1e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 -- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c0ab040 msgr2=0x7f826c0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c0ab040 0x7f826c0a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 -- 172.21.15.43:0/1298724652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264009b30 con 0x7f826c06ca60 2023-08-27T11:28:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f826affd700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c7f0 tx=0x7f825c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f82537fe700 1 -- 172.21.15.43:0/1298724652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c011800 con 0x7f826c06ca60 2023-08-27T11:28:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f82537fe700 1 -- 172.21.15.43:0/1298724652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c011960 con 0x7f826c06ca60 2023-08-27T11:28:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c0bcb30 con 0x7f826c06ca60 2023-08-27T11:28:06.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.657+0000 7f82537fe700 1 -- 172.21.15.43:0/1298724652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c011cf0 con 0x7f826c06ca60 2023-08-27T11:28:06.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.658+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c0bd0f0 con 0x7f826c06ca60 2023-08-27T11:28:06.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.660+0000 7f82537fe700 1 -- 172.21.15.43:0/1298724652 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f825c018360 con 0x7f826c06ca60 2023-08-27T11:28:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.661+0000 7f82537fe700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 0x7f825806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.661+0000 7f82537fe700 1 -- 172.21.15.43:0/1298724652 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f825c088450 con 0x7f826c06ca60 2023-08-27T11:28:06.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.662+0000 7f826a7fc700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 0x7f825806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.662+0000 7f826a7fc700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 0x7f825806c5a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8260009a10 tx=0x7f8260009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.663+0000 7f8284ec1b80 1 Processor -- start 2023-08-27T11:28:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.663+0000 7f8284ec1b80 1 -- start start 2023-08-27T11:28:06.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc14fe0 0x56300cc322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc47500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cb6c730 con 0x56300cc0ef00 2023-08-27T11:28:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cb6a050 con 0x56300cc14fe0 2023-08-27T11:28:06.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56300cb65940 con 0x56300cc0f2e0 2023-08-27T11:28:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44560/0 (socket says 172.21.15.43:44560) 2023-08-27T11:28:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.664+0000 7f826affd700 1 -- 172.21.15.43:0/1870961049 learned_addr learned my addr 172.21.15.43:0/1870961049 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 -- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 msgr2=0x56300cc47500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc47500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 -- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc14fe0 msgr2=0x56300cc322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc14fe0 0x56300cc322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 -- 172.21.15.43:0/1870961049 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56300c9e55e0 con 0x56300cc0ef00 2023-08-27T11:28:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f826affd700 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f825c053c90 tx=0x7f825c05b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35892e00ac6d016 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f8250ff9700 1 -- 172.21.15.43:0/1870961049 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c055b30 con 0x56300cc0ef00 2023-08-27T11:28:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f8250ff9700 1 -- 172.21.15.43:0/1870961049 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0880b0 con 0x56300cc0ef00 2023-08-27T11:28:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.665+0000 7f8250ff9700 1 -- 172.21.15.43:0/1870961049 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c088220 con 0x56300cc0ef00 2023-08-27T11:28:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 -- 172.21.15.43:0/1870961049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 msgr2=0x56300cc31d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f825c053c90 tx=0x7f825c05b550 comp rx=0 tx=0).stop 2023-08-27T11:28:06.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 -- 172.21.15.43:0/1870961049 shutdown_connections 2023-08-27T11:28:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc47500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc31d70 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/1870961049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc14fe0 0x56300cc322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 -- 172.21.15.43:0/1870961049 >> 172.21.15.43:0/1870961049 conn(0x56300cb71c30 msgr2=0x56300cc116e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 -- 172.21.15.43:0/1870961049 shutdown_connections 2023-08-27T11:28:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.666+0000 7f8284ec1b80 1 -- 172.21.15.43:0/1870961049 wait complete. 2023-08-27T11:28:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.667+0000 7f8284ec1b80 1 -- start start 2023-08-27T11:28:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.667+0000 7f8284ec1b80 1 Processor -- start 2023-08-27T11:28:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0ef00 0x56300cc488e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc52770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cb03b60 con 0x56300cc37e10 2023-08-27T11:28:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cb03860 con 0x56300cc0ef00 2023-08-27T11:28:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56300c9e78d0 con 0x56300cc0f2e0 2023-08-27T11:28:06.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f8284ec1b80 10 client.0 _ll_register_callbacks cb 0x56300cb01630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f826b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f826b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44576/0 (socket says 172.21.15.43:44576) 2023-08-27T11:28:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f826b7fe700 1 -- 172.21.15.43:0/2050342436 learned_addr learned my addr 172.21.15.43:0/2050342436 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.668+0000 7f826a7fc700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc52770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826affd700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0ef00 0x56300cc488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 -- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 msgr2=0x56300cc52770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc52770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 -- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0ef00 msgr2=0x56300cc488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0ef00 0x56300cc488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 -- 172.21.15.43:0/2050342436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c0bd0f0 con 0x56300cc37e10 2023-08-27T11:28:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f826c06de40 tx=0x7f8264004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5b484bfe631ddd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8249ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264004450 con 0x56300cc37e10 2023-08-27T11:28:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56300cc064f0 con 0x56300cc37e10 2023-08-27T11:28:06.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f82640045b0 con 0x56300cc37e10 2023-08-27T11:28:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8264009900 con 0x56300cc37e10 2023-08-27T11:28:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8284ec1b80 10 client.7815 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.669+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x56300cb7d750 con 0x56300cc37e10 2023-08-27T11:28:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56300cc064f0 con 0x56300cc37e10 2023-08-27T11:28:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8264019070 con 0x56300cc37e10 2023-08-27T11:28:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 10 client.7815 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 10 client.7815 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 20 client.7815 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc517e0 0x56300cc2e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 4 client.7815 mds_command: new command op to 7180 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:28:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56300cb5e920 con 0x56300cc517e0 2023-08-27T11:28:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.670+0000 7f826affd700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc517e0 0x56300cc2e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.671+0000 7f826affd700 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc517e0 0x56300cc2e580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=769de05613709cc6 server_cookie=ebc552a5205816ac in_seq=0 out_seq=0 2023-08-27T11:28:06.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.671+0000 7f8249ffb700 10 client.7815 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:06.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.671+0000 7f8249ffb700 1 -- 172.21.15.43:0/2050342436 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56300cb5e920 con 0x56300cc517e0 2023-08-27T11:28:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.671+0000 7f8249ffb700 10 client.7815 handle_command_reply: tid=0 2023-08-27T11:28:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.671+0000 7f8284ec1b80 1 client.7815 shutdown 2023-08-27T11:28:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 msgr2=0x56300cc50db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f826c06de40 tx=0x7f8264004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 shutdown_connections 2023-08-27T11:28:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc517e0 0x56300cc2e580 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300cc50db0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0ef00 0x56300cc488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2050342436 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc52770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8249ffb700 0 client.7815 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 >> 172.21.15.43:0/2050342436 conn(0x56300cb71c30 msgr2=0x56300cc13160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 shutdown_connections 2023-08-27T11:28:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2050342436 wait complete. 2023-08-27T11:28:06.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.672+0000 7f8284ec1b80 20 client.7815 trim_cache size 0 max 16384 2023-08-27T11:28:06.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.691+0000 7f8284ec1b80 1 Processor -- start 2023-08-27T11:28:06.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.691+0000 7f8284ec1b80 1 -- start start 2023-08-27T11:28:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc69070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc37e10 0x56300cc695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cc37ac0 con 0x56300cc0ef00 2023-08-27T11:28:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cc53330 con 0x56300cc37e10 2023-08-27T11:28:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56300cc346c0 con 0x56300cc0f2e0 2023-08-27T11:28:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44588/0 (socket says 172.21.15.43:44588) 2023-08-27T11:28:06.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 -- 172.21.15.43:0/875907205 learned_addr learned my addr 172.21.15.43:0/875907205 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826b7fe700 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc37e10 0x56300cc695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826a7fc700 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc69070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 -- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 msgr2=0x56300cc69070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc69070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 -- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc37e10 msgr2=0x56300cc695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc37e10 0x56300cc695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.692+0000 7f826affd700 1 -- 172.21.15.43:0/875907205 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56300cc0fb60 con 0x56300cc0ef00 2023-08-27T11:28:06.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f826affd700 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c7c0 tx=0x7f825c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266e855b2a30c806 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f82517fa700 1 -- 172.21.15.43:0/875907205 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0572d0 con 0x56300cc0ef00 2023-08-27T11:28:06.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f82517fa700 1 -- 172.21.15.43:0/875907205 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c055b30 con 0x56300cc0ef00 2023-08-27T11:28:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f82517fa700 1 -- 172.21.15.43:0/875907205 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c05b370 con 0x56300cc0ef00 2023-08-27T11:28:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 -- 172.21.15.43:0/875907205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 msgr2=0x56300cc465e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c7c0 tx=0x7f825c01f000 comp rx=0 tx=0).stop 2023-08-27T11:28:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 -- 172.21.15.43:0/875907205 shutdown_connections 2023-08-27T11:28:06.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc37e10 0x56300cc695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc0ef00 0x56300cc465e0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/875907205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0f2e0 0x56300cc69070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.693+0000 7f8284ec1b80 1 -- 172.21.15.43:0/875907205 >> 172.21.15.43:0/875907205 conn(0x56300cb71c30 msgr2=0x56300cc0a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.694+0000 7f8284ec1b80 1 -- 172.21.15.43:0/875907205 shutdown_connections 2023-08-27T11:28:06.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.694+0000 7f8284ec1b80 1 -- 172.21.15.43:0/875907205 wait complete. 2023-08-27T11:28:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.694+0000 7f8284ec1b80 1 -- start start 2023-08-27T11:28:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.694+0000 7f8284ec1b80 1 Processor -- start 2023-08-27T11:28:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0ef00 0x56300cc501c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0f2e0 0x56300ccbb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300cc533b0 con 0x56300cc37e10 2023-08-27T11:28:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56300ccbbd30 con 0x56300cc0f2e0 2023-08-27T11:28:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56300cc34ee0 con 0x56300cc0ef00 2023-08-27T11:28:06.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.695+0000 7f8284ec1b80 10 client.0 _ll_register_callbacks cb 0x7f82640093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44598/0 (socket says 172.21.15.43:44598) 2023-08-27T11:28:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 -- 172.21.15.43:0/2772235611 learned_addr learned my addr 172.21.15.43:0/2772235611 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826a7fc700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0f2e0 0x56300ccbb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826affd700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0ef00 0x56300cc501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 -- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0ef00 msgr2=0x56300cc501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0ef00 0x56300cc501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 -- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0f2e0 msgr2=0x56300ccbb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0f2e0 0x56300ccbb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 -- 172.21.15.43:0/2772235611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56300c9e55e0 con 0x56300cc37e10 2023-08-27T11:28:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f826b7fe700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f82640046f0 tx=0x7f8264009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fd642a9d816a5c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f8249ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.696+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264009900 con 0x56300cc37e10 2023-08-27T11:28:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f826400b730 con 0x56300cc37e10 2023-08-27T11:28:06.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f825c0880b0 con 0x56300cc37e10 2023-08-27T11:28:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f826401d4f0 con 0x56300cc37e10 2023-08-27T11:28:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 10 client.7821 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x56300c991d90 con 0x56300cc37e10 2023-08-27T11:28:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0880b0 con 0x56300cc37e10 2023-08-27T11:28:06.709 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f826400b450 con 0x56300cc37e10 2023-08-27T11:28:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 10 client.7821 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 10 client.7821 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 20 client.7821 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:06.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc52590 0x56300ccb89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 4 client.7821 mds_command: new command op to 7180 tid=0[{"prefix": "status"}] 2023-08-27T11:28:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56300cb1f000 con 0x56300cc52590 2023-08-27T11:28:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.697+0000 7f826affd700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc52590 0x56300ccb89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f826affd700 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc52590 0x56300ccb89b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e02f8b8622279ed4 server_cookie=27d57103bc8821ab in_seq=0 out_seq=0 2023-08-27T11:28:06.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8249ffb700 10 client.7821 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8249ffb700 1 -- 172.21.15.43:0/2772235611 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x56300cb1f000 con 0x56300cc52590 2023-08-27T11:28:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8249ffb700 10 client.7821 handle_command_reply: tid=0 2023-08-27T11:28:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 client.7821 shutdown 2023-08-27T11:28:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 msgr2=0x56300ccb8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f82640046f0 tx=0x7f8264009000 comp rx=0 tx=0).stop 2023-08-27T11:28:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 shutdown_connections 2023-08-27T11:28:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x56300cc52590 0x56300ccb89b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56300cc37e10 0x56300ccb8470 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x56300cc0ef00 0x56300cc501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 --2- 172.21.15.43:0/2772235611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56300cc0f2e0 0x56300ccbb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8249ffb700 0 client.7821 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 >> 172.21.15.43:0/2772235611 conn(0x56300cb71c30 msgr2=0x56300cc48290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.698+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 shutdown_connections 2023-08-27T11:28:06.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f8284ec1b80 1 -- 172.21.15.43:0/2772235611 wait complete. 2023-08-27T11:28:06.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f8284ec1b80 20 client.7821 trim_cache size 0 max 16384 2023-08-27T11:28:06.715 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:06.715 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:28:06.715 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:28:06.716 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7180, 2023-08-27T11:28:06.716 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:28:06.716 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:28:06.716 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:28:06.716 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 11.584310133000001, 2023-08-27T11:28:06.717 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 116, 2023-08-27T11:28:06.717 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 111, 2023-08-27T11:28:06.717 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 111, 2023-08-27T11:28:06.717 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 27.917773543999999 2023-08-27T11:28:06.717 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 msgr2=0x7f825806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 0x7f825806c5a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8260009a10 tx=0x7f8260009190 comp rx=0 tx=0).stop 2023-08-27T11:28:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 msgr2=0x7f826c14af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c7f0 tx=0x7f825c00cb00 comp rx=0 tx=0).stop 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 shutdown_connections 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f825806a0e0 0x7f825806c5a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f826c0c51a0 0x7f826c1e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f826c06ca60 0x7f826c14af30 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 --2- 172.21.15.43:0/1298724652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f826c0ab040 0x7f826c0a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 >> 172.21.15.43:0/1298724652 conn(0x7f826c06aa50 msgr2=0x7f826c0bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 shutdown_connections 2023-08-27T11:28:06.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.699+0000 7f82715ff700 1 -- 172.21.15.43:0/1298724652 wait complete. 2023-08-27T11:28:06.722 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.a mds_join_fs 2023-08-27T11:28:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.923+0000 7f5ea91ff700 1 Processor -- start 2023-08-27T11:28:06.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.923+0000 7f5ea91ff700 1 -- start start 2023-08-27T11:28:06.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.924+0000 7f5ea91ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ea40c51a0 0x7f5ea406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea91ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 0x7f5ea40aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea91ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea406d700 con 0x7f5ea40ab040 2023-08-27T11:28:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea91ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea41530b0 con 0x7f5ea40c51a0 2023-08-27T11:28:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea91ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea414c860 con 0x7f5ea406ca60 2023-08-27T11:28:06.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ea40c51a0 0x7f5ea406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ea40c51a0 0x7f5ea406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44602/0 (socket says 172.21.15.43:44602) 2023-08-27T11:28:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 -- 172.21.15.43:0/2203784583 learned_addr learned my addr 172.21.15.43:0/2203784583 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 -- 172.21.15.43:0/2203784583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 msgr2=0x7f5ea40aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea259c700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 0x7f5ea40aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 0x7f5ea40aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 -- 172.21.15.43:0/2203784583 >> v1:172.21.15.57:6789/0 conn(0x7f5ea40ab040 legacy=0x7f5ea4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea2d9d700 1 -- 172.21.15.43:0/2203784583 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4152430 con 0x7f5ea40c51a0 2023-08-27T11:28:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.925+0000 7f5ea259c700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 0x7f5ea40aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:06.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea2d9d700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea406d1c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009920 tx=0x7f5e94009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447f6b6480cac569 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea1d9b700 1 -- 172.21.15.43:0/2203784583 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94004230 con 0x7f5ea40c51a0 2023-08-27T11:28:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea1d9b700 1 -- 172.21.15.43:0/2203784583 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94004390 con 0x7f5ea40c51a0 2023-08-27T11:28:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea1d9b700 1 -- 172.21.15.43:0/2203784583 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94009e70 con 0x7f5ea40c51a0 2023-08-27T11:28:06.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea91ff700 1 -- 172.21.15.43:0/2203784583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 msgr2=0x7f5ea406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.926+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea406d1c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009920 tx=0x7f5e94009c30 comp rx=0 tx=0).stop 2023-08-27T11:28:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 -- 172.21.15.43:0/2203784583 shutdown_connections 2023-08-27T11:28:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea406d1c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/2203784583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea406ca60 0x7f5ea40aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 -- 172.21.15.43:0/2203784583 >> 172.21.15.43:0/2203784583 conn(0x7f5ea406aa50 msgr2=0x7f5ea40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 -- 172.21.15.43:0/2203784583 shutdown_connections 2023-08-27T11:28:06.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.927+0000 7f5ea91ff700 1 -- 172.21.15.43:0/2203784583 wait complete. 2023-08-27T11:28:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.928+0000 7f5ea91ff700 1 Processor -- start 2023-08-27T11:28:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.929+0000 7f5ea91ff700 1 -- start start 2023-08-27T11:28:06.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.929+0000 7f5ea91ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 0x7f5ea40a7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.929+0000 7f5ea91ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 0x7f5ea4070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.929+0000 7f5ea91ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.929+0000 7f5ea91ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40beb30 con 0x7f5ea40c51a0 2023-08-27T11:28:06.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea91ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea4072910 con 0x7f5ea406ca60 2023-08-27T11:28:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea91ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea40720c0 con 0x7f5ea40ab040 2023-08-27T11:28:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 0x7f5ea40a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44610/0 (socket says 172.21.15.43:44610) 2023-08-27T11:28:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 0x7f5ea40a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:60788/0 (socket says 172.21.15.43:60788) 2023-08-27T11:28:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 -- 172.21.15.43:0/311236490 learned_addr learned my addr 172.21.15.43:0/311236490 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea259c700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 0x7f5ea4070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 -- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 msgr2=0x7f5ea4070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 0x7f5ea4070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 -- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 msgr2=0x7f5ea40a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 0x7f5ea40a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 -- 172.21.15.43:0/311236490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94009550 con 0x7f5ea40c51a0 2023-08-27T11:28:06.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea259c700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 0x7f5ea4070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.930+0000 7f5ea359e700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cc10 tx=0x7f5e9c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.931+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00aab0 con 0x7f5ea40c51a0 2023-08-27T11:28:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.931+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00ac10 con 0x7f5ea40c51a0 2023-08-27T11:28:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.931+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c012420 con 0x7f5ea40c51a0 2023-08-27T11:28:06.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.931+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea41e84f0 con 0x7f5ea40c51a0 2023-08-27T11:28:06.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.931+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea40be330 con 0x7f5ea40c51a0 2023-08-27T11:28:06.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.932+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea404ee70 con 0x7f5ea40c51a0 2023-08-27T11:28:06.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.933+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e9c012580 con 0x7f5ea40c51a0 2023-08-27T11:28:06.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.934+0000 7f5e8b7fe700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:06.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.934+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5e9c0888d0 con 0x7f5ea40c51a0 2023-08-27T11:28:06.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.934+0000 7f5ea2d9d700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:06.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.935+0000 7f5ea2d9d700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009130 tx=0x7f5e94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:06.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:06.938+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e9c053f50 con 0x7f5ea40c51a0 2023-08-27T11:28:07.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.148+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"} v 0) v1 -- 0x7f5ea40bb5a0 con 0x7f5ea40c51a0 2023-08-27T11:28:07.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.152+0000 7f5e8b7fe700 1 -- 172.21.15.43:0/311236490 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"}]=0 v40) v1 ==== 96+0+0 (secure 0 0 0) 0x7f5e9c057570 con 0x7f5ea40c51a0 2023-08-27T11:28:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 msgr2=0x7f5e9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009130 tx=0x7f5e94008030 comp rx=0 tx=0).stop 2023-08-27T11:28:07.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 msgr2=0x7f5ea4070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cc10 tx=0x7f5e9c00cf20 comp rx=0 tx=0).stop 2023-08-27T11:28:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 shutdown_connections 2023-08-27T11:28:07.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9006a0e0 0x7f5e9006c5a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ea40c51a0 0x7f5ea4070ad0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea406ca60 0x7f5ea40a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 --2- 172.21.15.43:0/311236490 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ea40ab040 0x7f5ea4070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.154+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 >> 172.21.15.43:0/311236490 conn(0x7f5ea406aa50 msgr2=0x7f5ea40bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:07.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.155+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 shutdown_connections 2023-08-27T11:28:07.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.155+0000 7f5ea91ff700 1 -- 172.21.15.43:0/311236490 wait complete. 2023-08-27T11:28:07.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:07.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.375+0000 7fd428dff700 1 Processor -- start 2023-08-27T11:28:07.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.375+0000 7fd428dff700 1 -- start start 2023-08-27T11:28:07.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd428dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd42406ca60 0x7fd42406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd428dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd424155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd428dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42406d700 con 0x7fd4240c51a0 2023-08-27T11:28:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd428dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4241530b0 con 0x7fd42406ca60 2023-08-27T11:28:07.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd428dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42414c860 con 0x7fd424155910 2023-08-27T11:28:07.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd421d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd42406ca60 0x7fd42406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd421d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd42406ca60 0x7fd42406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44612/0 (socket says 172.21.15.43:44612) 2023-08-27T11:28:07.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd421d9b700 1 -- 172.21.15.43:0/4083489497 learned_addr learned my addr 172.21.15.43:0/4083489497 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:07.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.376+0000 7fd422d9d700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd424155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd421d9b700 1 -- 172.21.15.43:0/4083489497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 msgr2=0x7fd424155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:07.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd421d9b700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd424155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd421d9b700 1 -- 172.21.15.43:0/4083489497 >> v1:172.21.15.57:6789/0 conn(0x7fd4240c51a0 legacy=0x7fd4240aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd421d9b700 1 -- 172.21.15.43:0/4083489497 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424152430 con 0x7fd42406ca60 2023-08-27T11:28:07.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd421d9b700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42406ca60 0x7fd42406d1c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd418009920 tx=0x7fd418009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e900e810510705c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:07.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd42159a700 1 -- 172.21.15.43:0/4083489497 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418011830 con 0x7fd42406ca60 2023-08-27T11:28:07.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd42159a700 1 -- 172.21.15.43:0/4083489497 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418011990 con 0x7fd42406ca60 2023-08-27T11:28:07.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.377+0000 7fd42159a700 1 -- 172.21.15.43:0/4083489497 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418011d20 con 0x7fd42406ca60 2023-08-27T11:28:07.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 -- 172.21.15.43:0/4083489497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42406ca60 msgr2=0x7fd42406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42406ca60 0x7fd42406d1c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd418009920 tx=0x7fd418009c30 comp rx=0 tx=0).stop 2023-08-27T11:28:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 -- 172.21.15.43:0/4083489497 shutdown_connections 2023-08-27T11:28:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd424155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 --2- 172.21.15.43:0/4083489497 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd42406ca60 0x7fd42406d1c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 -- 172.21.15.43:0/4083489497 >> 172.21.15.43:0/4083489497 conn(0x7fd42406aa50 msgr2=0x7fd4240c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 -- 172.21.15.43:0/4083489497 shutdown_connections 2023-08-27T11:28:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.378+0000 7fd428dff700 1 -- 172.21.15.43:0/4083489497 wait complete. 2023-08-27T11:28:07.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.380+0000 7fd428dff700 1 Processor -- start 2023-08-27T11:28:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.380+0000 7fd428dff700 1 -- start start 2023-08-27T11:28:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42406ca60 0x7fd4240a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd4241ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4241ed6c0 con 0x7fd4240c51a0 2023-08-27T11:28:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240a5e70 con 0x7fd42406ca60 2023-08-27T11:28:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd428dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4240a7570 con 0x7fd424155910 2023-08-27T11:28:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44628/0 (socket says 172.21.15.43:44628) 2023-08-27T11:28:07.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 -- 172.21.15.43:0/3804228446 learned_addr learned my addr 172.21.15.43:0/3804228446 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd422d9d700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd4241ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd42259c700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42406ca60 0x7fd4240a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 -- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 msgr2=0x7fd4241ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd4241ed180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 -- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42406ca60 msgr2=0x7fd4240a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42406ca60 0x7fd4240a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.381+0000 7fd421d9b700 1 -- 172.21.15.43:0/3804228446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009550 con 0x7fd4240c51a0 2023-08-27T11:28:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd421d9b700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd418009870 tx=0x7fd418004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:07.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418004300 con 0x7fd4240c51a0 2023-08-27T11:28:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41801f070 con 0x7fd4240c51a0 2023-08-27T11:28:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180036a0 con 0x7fd4240c51a0 2023-08-27T11:28:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4240a7850 con 0x7fd4240c51a0 2023-08-27T11:28:07.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.382+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4240a60c0 con 0x7fd4240c51a0 2023-08-27T11:28:07.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.383+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4240a62b0 con 0x7fd4240c51a0 2023-08-27T11:28:07.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.384+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd418021030 con 0x7fd4240c51a0 2023-08-27T11:28:07.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.385+0000 7fd412ffd700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 0x7fd40406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:07.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.385+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fd418089750 con 0x7fd4240c51a0 2023-08-27T11:28:07.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.385+0000 7fd42259c700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 0x7fd40406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:07.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.386+0000 7fd42259c700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 0x7fd40406c5a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd414007fd0 tx=0x7fd414009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:07.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.389+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd418054dd0 con 0x7fd4240c51a0 2023-08-27T11:28:07.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.645+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd42404ee70 con 0x7fd4240c51a0 2023-08-27T11:28:07.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.646+0000 7fd412ffd700 1 -- 172.21.15.43:0/3804228446 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4877 (secure 0 0 0) 0x7fd4180583f0 con 0x7fd4240c51a0 2023-08-27T11:28:07.648 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:07.648 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":116,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7195,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":5,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112},{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:27:58.118818+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7180},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7180":{"gid":7180,"name":"a","rank":0,"incarnation":113,"state":"up:active","state_seq":8,"addr":"172.21.15.43:6835/3995831020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":3995831020},{"type":"v1","addr":"172.21.15.43:6835","nonce":3995831020}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 msgr2=0x7fd40406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 0x7fd40406c5a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd414007fd0 tx=0x7fd414009040 comp rx=0 tx=0).stop 2023-08-27T11:28:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 msgr2=0x7fd4241ecc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:07.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fd418009870 tx=0x7fd418004750 comp rx=0 tx=0).stop 2023-08-27T11:28:07.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 shutdown_connections 2023-08-27T11:28:07.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd40406a0e0 0x7fd40406c5a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd424155910 0x7fd4241ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd42406ca60 0x7fd4240a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.651 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 --2- 172.21.15.43:0/3804228446 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd4240c51a0 0x7fd4241ecc40 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 >> 172.21.15.43:0/3804228446 conn(0x7fd42406aa50 msgr2=0x7fd4240c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 shutdown_connections 2023-08-27T11:28:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:07.648+0000 7fd428dff700 1 -- 172.21.15.43:0/3804228446 wait complete. 2023-08-27T11:28:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 116 2023-08-27T11:28:08.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:27:58.118818+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 111, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7180}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7180': {'gid': 7180, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:28:08.071 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:28:08.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-27T11:28:08.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.278+0000 7fe85d1ff700 1 Processor -- start 2023-08-27T11:28:08.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.278+0000 7fe85d1ff700 1 -- start start 2023-08-27T11:28:08.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.279+0000 7fe85d1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 0x7fe858154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.279+0000 7fe85d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 0x7fe85814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.279+0000 7fe85d1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe858157c50 con 0x7fe8580c4880 2023-08-27T11:28:08.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.279+0000 7fe85d1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8580c70c0 con 0x7fe8580c7b90 2023-08-27T11:28:08.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.279+0000 7fe85d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581553f0 con 0x7fe85814aa60 2023-08-27T11:28:08.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe856d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe8580c4880 0x7fe8581580e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53964/0 (socket says 172.21.15.43:53964) 2023-08-27T11:28:08.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe856d9d700 1 -- 172.21.15.43:0/3373668060 learned_addr learned my addr 172.21.15.43:0/3373668060 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:08.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe85759e700 1 --2- 172.21.15.43:0/3373668060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 0x7fe85814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe84ffff700 1 --2- 172.21.15.43:0/3373668060 >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 0x7fe858154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940745844 0 0) 0x7fe858157c50 con 0x7fe8580c4880 2023-08-27T11:28:08.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8440035b0 con 0x7fe8580c4880 2023-08-27T11:28:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.280+0000 7fe85759e700 1 -- 172.21.15.43:0/3373668060 >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 msgr2=0x7fe858154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85759e700 1 --2- 172.21.15.43:0/3373668060 >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 0x7fe858154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85759e700 1 -- 172.21.15.43:0/3373668060 >> v1:172.21.15.43:6789/0 conn(0x7fe8580c4880 legacy=0x7fe8581580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154444510 0 0) 0x7fe8440035b0 con 0x7fe8580c4880 2023-08-27T11:28:08.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85759e700 1 -- 172.21.15.43:0/3373668060 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8580c6820 con 0x7fe85814aa60 2023-08-27T11:28:08.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe84ffff700 1 --2- 172.21.15.43:0/3373668060 >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 0x7fe858154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:08.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85759e700 1 --2- 172.21.15.43:0/3373668060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 0x7fe85814aed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe850009d90 tx=0x7fe85000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5952b08fa2421bd9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000e070 con 0x7fe85814aa60 2023-08-27T11:28:08.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850003a20 con 0x7fe85814aa60 2023-08-27T11:28:08.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.281+0000 7fe85659c700 1 -- 172.21.15.43:0/3373668060 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848001670 con 0x7fe85814aa60 2023-08-27T11:28:08.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 -- 172.21.15.43:0/3373668060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 msgr2=0x7fe85814aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/3373668060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 0x7fe85814aed0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe850009d90 tx=0x7fe85000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:08.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 -- 172.21.15.43:0/3373668060 shutdown_connections 2023-08-27T11:28:08.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/3373668060 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe85814aa60 0x7fe85814aed0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/3373668060 >> v2:172.21.15.57:3300/0 conn(0x7fe8580c7b90 0x7fe858154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 -- 172.21.15.43:0/3373668060 >> 172.21.15.43:0/3373668060 conn(0x7fe8580ab820 msgr2=0x7fe8580abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 -- 172.21.15.43:0/3373668060 shutdown_connections 2023-08-27T11:28:08.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.282+0000 7fe85d1ff700 1 -- 172.21.15.43:0/3373668060 wait complete. 2023-08-27T11:28:08.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.283+0000 7fe85d1ff700 1 Processor -- start 2023-08-27T11:28:08.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.284+0000 7fe85d1ff700 1 -- start start 2023-08-27T11:28:08.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.284+0000 7fe85d1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8580c4880 0x7fe858153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.284+0000 7fe85d1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8580c7b90 0x7fe8580ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.284+0000 7fe85d1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85d1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858153cd0 con 0x7fe85814aa60 2023-08-27T11:28:08.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85d1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858154870 con 0x7fe8580c4880 2023-08-27T11:28:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85d1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe858154b50 con 0x7fe8580c7b90 2023-08-27T11:28:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44640/0 (socket says 172.21.15.43:44640) 2023-08-27T11:28:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 -- 172.21.15.43:0/833500301 learned_addr learned my addr 172.21.15.43:0/833500301 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:08.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe84ffff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8580c7b90 0x7fe8580ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe856d9d700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8580c4880 0x7fe858153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 -- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8580c7b90 msgr2=0x7fe8580ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8580c7b90 0x7fe8580ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 -- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8580c4880 msgr2=0x7fe858153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8580c4880 0x7fe858153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 -- 172.21.15.43:0/833500301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8400094a0 con 0x7fe85814aa60 2023-08-27T11:28:08.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.285+0000 7fe85759e700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe858155530 tx=0x7fe850004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.286+0000 7fe84f7fe700 1 -- 172.21.15.43:0/833500301 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850009410 con 0x7fe85814aa60 2023-08-27T11:28:08.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.286+0000 7fe84f7fe700 1 -- 172.21.15.43:0/833500301 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850004460 con 0x7fe85814aa60 2023-08-27T11:28:08.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.286+0000 7fe84f7fe700 1 -- 172.21.15.43:0/833500301 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850004810 con 0x7fe85814aa60 2023-08-27T11:28:08.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.286+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe850009a70 con 0x7fe85814aa60 2023-08-27T11:28:08.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.286+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe858152f90 con 0x7fe85814aa60 2023-08-27T11:28:08.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.288+0000 7fe84f7fe700 1 -- 172.21.15.43:0/833500301 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe850012430 con 0x7fe85814aa60 2023-08-27T11:28:08.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.289+0000 7fe84f7fe700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 0x7fe83806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.289+0000 7fe84f7fe700 1 -- 172.21.15.43:0/833500301 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe85008a080 con 0x7fe85814aa60 2023-08-27T11:28:08.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.289+0000 7fe856d9d700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 0x7fe83806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.290+0000 7fe856d9d700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 0x7fe83806c5a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe848001eb0 tx=0x7fe848001730 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.291+0000 7fe870a7db80 1 Processor -- start 2023-08-27T11:28:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.291+0000 7fe870a7db80 1 -- start start 2023-08-27T11:28:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd706d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e9fe0 0x55c7fd7072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd641730 con 0x55c7fd6e42e0 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd63f050 con 0x55c7fd6e9fe0 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd63a940 con 0x55c7fd6e3f00 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe856d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd706d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44646/0 (socket says 172.21.15.43:44646) 2023-08-27T11:28:08.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe84ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e9fe0 0x55c7fd7072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.292+0000 7fe85759e700 1 -- 172.21.15.43:0/1654450135 learned_addr learned my addr 172.21.15.43:0/1654450135 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:08.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 -- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 msgr2=0x55c7fd706d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd706d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 -- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e9fe0 msgr2=0x55c7fd7072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e9fe0 0x55c7fd7072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 -- 172.21.15.43:0/1654450135 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fd4ba5e0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe85759e700 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe850060ba0 tx=0x7fe850059a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce641128ddda2eb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe84cff9700 1 -- 172.21.15.43:0/1654450135 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500610d0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe84cff9700 1 -- 172.21.15.43:0/1654450135 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850057760 con 0x55c7fd6e42e0 2023-08-27T11:28:08.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.293+0000 7fe84cff9700 1 -- 172.21.15.43:0/1654450135 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500588b0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 -- 172.21.15.43:0/1654450135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 msgr2=0x55c7fd71c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe850060ba0 tx=0x7fe850059a50 comp rx=0 tx=0).stop 2023-08-27T11:28:08.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 -- 172.21.15.43:0/1654450135 shutdown_connections 2023-08-27T11:28:08.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd71c500 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd706d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1654450135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e9fe0 0x55c7fd7072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 -- 172.21.15.43:0/1654450135 >> 172.21.15.43:0/1654450135 conn(0x55c7fd646c30 msgr2=0x55c7fd6e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 -- 172.21.15.43:0/1654450135 shutdown_connections 2023-08-27T11:28:08.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.294+0000 7fe870a7db80 1 -- 172.21.15.43:0/1654450135 wait complete. 2023-08-27T11:28:08.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.295+0000 7fe870a7db80 1 -- start start 2023-08-27T11:28:08.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.295+0000 7fe870a7db80 1 Processor -- start 2023-08-27T11:28:08.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd70acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd722d40 0x55c7fd702b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd5d8b60 con 0x55c7fd6e42e0 2023-08-27T11:28:08.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd5d8860 con 0x55c7fd6e3f00 2023-08-27T11:28:08.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd4bc8d0 con 0x55c7fd722d40 2023-08-27T11:28:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe870a7db80 10 client.0 _ll_register_callbacks cb 0x55c7fd5d6630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe84ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe84ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44656/0 (socket says 172.21.15.43:44656) 2023-08-27T11:28:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.296+0000 7fe84ffff700 1 -- 172.21.15.43:0/49508019 learned_addr learned my addr 172.21.15.43:0/49508019 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:08.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe856d9d700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd70acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe85759e700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd722d40 0x55c7fd702b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 -- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd722d40 msgr2=0x55c7fd702b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd722d40 0x55c7fd702b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 -- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 msgr2=0x55c7fd70acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd70acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 -- 172.21.15.43:0/49508019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe858152f90 con 0x55c7fd6e42e0 2023-08-27T11:28:08.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe856d9d700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd70acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:08.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe84ffff700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe840014980 tx=0x7fe840014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ec59353df9ea25 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe835ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:08.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8400157b0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe840015910 con 0x55c7fd6e42e0 2023-08-27T11:28:08.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.297+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7fd6db4f0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe840015ad0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 10 client.7845 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:08.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x55c7fd652750 con 0x55c7fd6e42e0 2023-08-27T11:28:08.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7fd6db4f0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe840015c30 con 0x55c7fd6e42e0 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 10 client.7845 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 10 client.7845 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 20 client.7845 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd703330 0x55c7fd70c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 4 client.7845 mds_command: new command op to 7180 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:28:08.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7fd633920 con 0x55c7fd703330 2023-08-27T11:28:08.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.298+0000 7fe856d9d700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd703330 0x55c7fd70c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.299+0000 7fe856d9d700 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd703330 0x55c7fd70c5e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcfbc71637ab832b server_cookie=842c908182d65d0e in_seq=0 out_seq=0 2023-08-27T11:28:08.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.299+0000 7fe835ffb700 10 client.7845 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.299+0000 7fe835ffb700 1 -- 172.21.15.43:0/49508019 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7fd633920 con 0x55c7fd703330 2023-08-27T11:28:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.299+0000 7fe835ffb700 10 client.7845 handle_command_reply: tid=0 2023-08-27T11:28:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.299+0000 7fe870a7db80 1 client.7845 shutdown 2023-08-27T11:28:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 msgr2=0x55c7fd737be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe840014980 tx=0x7fe840014a60 comp rx=0 tx=0).stop 2023-08-27T11:28:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 shutdown_connections 2023-08-27T11:28:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd703330 0x55c7fd70c5e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd722d40 0x55c7fd702b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe835ffb700 0 client.7845 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:08.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd70acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 --2- 172.21.15.43:0/49508019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd6e42e0 0x55c7fd737be0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 >> 172.21.15.43:0/49508019 conn(0x55c7fd646c30 msgr2=0x55c7fd706b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 shutdown_connections 2023-08-27T11:28:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 1 -- 172.21.15.43:0/49508019 wait complete. 2023-08-27T11:28:08.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.300+0000 7fe870a7db80 20 client.7845 trim_cache size 0 max 16384 2023-08-27T11:28:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.318+0000 7fe870a7db80 1 Processor -- start 2023-08-27T11:28:08.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.318+0000 7fe870a7db80 1 -- start start 2023-08-27T11:28:08.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd71ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 0x55c7fd6fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd709900 con 0x55c7fd722d40 2023-08-27T11:28:08.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd6fcf00 con 0x55c7fd6e3f00 2023-08-27T11:28:08.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.319+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd71b7d0 con 0x55c7fd6e42e0 2023-08-27T11:28:08.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44658/0 (socket says 172.21.15.43:44658) 2023-08-27T11:28:08.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 -- 172.21.15.43:0/3967014183 learned_addr learned my addr 172.21.15.43:0/3967014183 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:08.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe84ffff700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 0x55c7fd6fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe856d9d700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd71ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 -- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 msgr2=0x55c7fd6fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 0x55c7fd6fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 -- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 msgr2=0x55c7fd71ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd71ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 -- 172.21.15.43:0/3967014183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fd466d90 con 0x55c7fd722d40 2023-08-27T11:28:08.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe84ffff700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 0x55c7fd6fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:08.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe85759e700 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe8500590c0 tx=0x7fe850029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1132c78df503d56 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe84d7fa700 1 -- 172.21.15.43:0/3967014183 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500610d0 con 0x55c7fd722d40 2023-08-27T11:28:08.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe84d7fa700 1 -- 172.21.15.43:0/3967014183 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850057500 con 0x55c7fd722d40 2023-08-27T11:28:08.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.320+0000 7fe84d7fa700 1 -- 172.21.15.43:0/3967014183 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500588b0 con 0x55c7fd722d40 2023-08-27T11:28:08.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 -- 172.21.15.43:0/3967014183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 msgr2=0x55c7fd6fc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe8500590c0 tx=0x7fe850029000 comp rx=0 tx=0).stop 2023-08-27T11:28:08.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 -- 172.21.15.43:0/3967014183 shutdown_connections 2023-08-27T11:28:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6fc9c0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e3f00 0x55c7fd71ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 --2- 172.21.15.43:0/3967014183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e42e0 0x55c7fd6fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 -- 172.21.15.43:0/3967014183 >> 172.21.15.43:0/3967014183 conn(0x55c7fd646c30 msgr2=0x55c7fd721f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 -- 172.21.15.43:0/3967014183 shutdown_connections 2023-08-27T11:28:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.321+0000 7fe870a7db80 1 -- 172.21.15.43:0/3967014183 wait complete. 2023-08-27T11:28:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.322+0000 7fe870a7db80 1 -- start start 2023-08-27T11:28:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.322+0000 7fe870a7db80 1 Processor -- start 2023-08-27T11:28:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd789940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 0x55c7fd709b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd6e6ec0 con 0x55c7fd722d40 2023-08-27T11:28:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd70a550 con 0x55c7fd6e42e0 2023-08-27T11:28:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7fd6e7030 con 0x55c7fd6e3f00 2023-08-27T11:28:08.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe870a7db80 10 client.0 _ll_register_callbacks cb 0x55c7fd5d6630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe85759e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44664/0 (socket says 172.21.15.43:44664) 2023-08-27T11:28:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe85759e700 1 -- 172.21.15.43:0/1259118972 learned_addr learned my addr 172.21.15.43:0/1259118972 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe856d9d700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd789940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.324+0000 7fe84ffff700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 0x55c7fd709b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 -- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 msgr2=0x55c7fd789940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd789940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 -- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 msgr2=0x55c7fd709b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 0x55c7fd709b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 -- 172.21.15.43:0/1259118972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7fd4ba5e0 con 0x55c7fd722d40 2023-08-27T11:28:08.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe856d9d700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd789940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:08.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe84ffff700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 0x55c7fd709b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:08.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe85759e700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe85005d340 tx=0x7fe850004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71832c1cefbc1ac server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:08.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe835ffb700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:08.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8500610d0 con 0x55c7fd722d40 2023-08-27T11:28:08.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 6148+0+0 (secure 0 0 0) 0x7fe850060e50 con 0x55c7fd722d40 2023-08-27T11:28:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe850057760 con 0x55c7fd722d40 2023-08-27T11:28:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe850082080 con 0x55c7fd722d40 2023-08-27T11:28:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe870a7db80 10 client.7851 fetch_fsmap learned FSMap version 116 2023-08-27T11:28:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=2+}) v3 -- 0x55c7fd44fc10 con 0x55c7fd722d40 2023-08-27T11:28:08.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.325+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850057760 con 0x55c7fd722d40 2023-08-27T11:28:08.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 116) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe85000b050 con 0x55c7fd722d40 2023-08-27T11:28:08.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 10 client.7851 fetch_fsmap finished waiting for FSMap version 116 2023-08-27T11:28:08.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 10 client.7851 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-27T11:28:08.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 20 client.7851 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:08.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd6e3130 0x55c7fd71b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 4 client.7851 mds_command: new command op to 7180 tid=0[{"prefix": "status"}] 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 --> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7fd5f4000 con 0x55c7fd6e3130 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe856d9d700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd6e3130 0x55c7fd71b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe856d9d700 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd6e3130 0x55c7fd71b920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6948e18aba7cc5c6 server_cookie=7dd079da8ca0139b in_seq=0 out_seq=0 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.326+0000 7fe835ffb700 10 client.7851 ms_handle_connect on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:08.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe835ffb700 1 -- 172.21.15.43:0/1259118972 <== mds.0 v2:172.21.15.43:6834/3995831020 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55c7fd5f4000 con 0x55c7fd6e3130 2023-08-27T11:28:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe835ffb700 10 client.7851 handle_command_reply: tid=0 2023-08-27T11:28:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 client.7851 shutdown 2023-08-27T11:28:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 msgr2=0x55c7fd6e2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe85005d340 tx=0x7fe850004970 comp rx=0 tx=0).stop 2023-08-27T11:28:08.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 shutdown_connections 2023-08-27T11:28:08.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:6834/3995831020,v1:172.21.15.43:6835/3995831020] conn(0x55c7fd6e3130 0x55c7fd71b920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c7fd722d40 0x55c7fd6e2bf0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55c7fd6e3f00 0x55c7fd789940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 --2- 172.21.15.43:0/1259118972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c7fd6e42e0 0x55c7fd709b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe835ffb700 0 client.7851 ms_handle_reset on v2:172.21.15.43:6834/3995831020 2023-08-27T11:28:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 >> 172.21.15.43:0/1259118972 conn(0x55c7fd646c30 msgr2=0x55c7fd6e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 shutdown_connections 2023-08-27T11:28:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 1 -- 172.21.15.43:0/1259118972 wait complete. 2023-08-27T11:28:08.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.327+0000 7fe870a7db80 20 client.7851 trim_cache size 0 max 16384 2023-08-27T11:28:08.343 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:08.343 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:28:08.343 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:28:08.343 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7180, 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 13.212797768, 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 116, 2023-08-27T11:28:08.344 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 111, 2023-08-27T11:28:08.345 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 111, 2023-08-27T11:28:08.345 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 29.546257954000001 2023-08-27T11:28:08.345 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:08.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 msgr2=0x7fe83806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 0x7fe83806c5a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe848001eb0 tx=0x7fe848001730 comp rx=0 tx=0).stop 2023-08-27T11:28:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 msgr2=0x7fe858147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe858155530 tx=0x7fe850004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 shutdown_connections 2023-08-27T11:28:08.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe83806a0e0 0x7fe83806c5a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe85814aa60 0x7fe858147e10 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8580c4880 0x7fe858153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 --2- 172.21.15.43:0/833500301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8580c7b90 0x7fe8580ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 >> 172.21.15.43:0/833500301 conn(0x7fe8580ab820 msgr2=0x7fe8580ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:08.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 shutdown_connections 2023-08-27T11:28:08.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:08.328+0000 7fe85d1ff700 1 -- 172.21.15.43:0/833500301 wait complete. 2023-08-27T11:28:08.349 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 8, "epoch": 116, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 8, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:27:44.512293+0000", "damaged": [], "data_pools": [ 18 ], "enabled": true, "epoch": 116, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7180": { "addr": "172.21.15.43:6835/3995831020", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 3995831020, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 3995831020, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7180, "incarnation": 113, "join_fscid": 8, "name": "a", "rank": 0, "state": "up:active", "state_seq": 8 } }, "last_failure": 0, "last_failure_osd_epoch": 111, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 17, "modified": "2023-08-27T11:27:58.118818+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7180 } } } ], "standbys": [ { "addr": "172.21.15.57:6834/30396136", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 30396136, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 30396136, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 112, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7195, "incarnation": 0, "join_fscid": 8, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 5 }, { "addr": "172.21.15.57:6835/2128138968", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2128138968, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2128138968, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7198, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1498551988", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1498551988, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1498551988, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 114, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7363, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:28:08.350 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 8, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:28:08.351 INFO:tasks.cephfs.test_failover:current = [{'gid': 7180, 'name': 'a', 'rank': 0, 'incarnation': 113, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.43:6835/3995831020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 3995831020}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 3995831020}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7195, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 5, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 112}, {'gid': 7363, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1498551988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1498551988}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1498551988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 114}, {'gid': 7198, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2128138968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2128138968}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2128138968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}] 2023-08-27T11:28:08.351 DEBUG:tasks.cephfs.test_failover:-1 != 8 2023-08-27T11:28:08.351 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-08-27T11:28:09.183 INFO:tasks.ceph.mds.a.smithi043.stderr: -390> 2023-08-27T11:27:58.959+0000 7f69d79f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:28:09.232 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:28:11.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:28:11.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:28:13.353 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:13.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.564+0000 7f0d799ff700 1 Processor -- start 2023-08-27T11:28:13.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.564+0000 7f0d799ff700 1 -- start start 2023-08-27T11:28:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.565+0000 7f0d799ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d740c51a0 0x7f0d7406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.565+0000 7f0d799ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d7406ca60 0x7f0d740aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.565+0000 7f0d799ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7406d700 con 0x7f0d740ab040 2023-08-27T11:28:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.565+0000 7f0d799ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d741530b0 con 0x7f0d740c51a0 2023-08-27T11:28:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.565+0000 7f0d799ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7414c860 con 0x7f0d7406ca60 2023-08-27T11:28:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d737fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0d740ab040 0x7f0d74155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33598/0 (socket says 172.21.15.43:33598) 2023-08-27T11:28:13.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d737fe700 1 -- 172.21.15.43:0/1975592387 learned_addr learned my addr 172.21.15.43:0/1975592387 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/1975592387 >> v2:172.21.15.57:3300/0 conn(0x7f0d740c51a0 0x7f0d7406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d727fc700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d7406ca60 0x7f0d740aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d71ffb700 1 -- 172.21.15.43:0/1975592387 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861112332 0 0) 0x7f0d7406d700 con 0x7f0d740ab040 2023-08-27T11:28:13.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d71ffb700 1 -- 172.21.15.43:0/1975592387 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d5c0035b0 con 0x7f0d740ab040 2023-08-27T11:28:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d72ffd700 1 -- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d7406ca60 msgr2=0x7f0d740aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d7406ca60 0x7f0d740aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.566+0000 7f0d72ffd700 1 -- 172.21.15.43:0/1975592387 >> v1:172.21.15.43:6789/0 conn(0x7f0d740ab040 legacy=0x7f0d74155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.567+0000 7f0d72ffd700 1 -- 172.21.15.43:0/1975592387 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74152430 con 0x7f0d740c51a0 2023-08-27T11:28:13.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.567+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740c51a0 0x7f0d7406d1c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af102d3261d0a8dc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:13.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.567+0000 7f0d71ffb700 1 -- 172.21.15.43:0/1975592387 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011830 con 0x7f0d740c51a0 2023-08-27T11:28:13.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.567+0000 7f0d71ffb700 1 -- 172.21.15.43:0/1975592387 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64011990 con 0x7f0d740c51a0 2023-08-27T11:28:13.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.567+0000 7f0d71ffb700 1 -- 172.21.15.43:0/1975592387 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011d20 con 0x7f0d740c51a0 2023-08-27T11:28:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 -- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740c51a0 msgr2=0x7f0d7406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740c51a0 0x7f0d7406d1c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d64009b80 comp rx=0 tx=0).stop 2023-08-27T11:28:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 -- 172.21.15.43:0/1975592387 shutdown_connections 2023-08-27T11:28:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740c51a0 0x7f0d7406d1c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 --2- 172.21.15.43:0/1975592387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d7406ca60 0x7f0d740aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 -- 172.21.15.43:0/1975592387 >> 172.21.15.43:0/1975592387 conn(0x7f0d7406aa50 msgr2=0x7f0d740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 -- 172.21.15.43:0/1975592387 shutdown_connections 2023-08-27T11:28:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.568+0000 7f0d799ff700 1 -- 172.21.15.43:0/1975592387 wait complete. 2023-08-27T11:28:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.570+0000 7f0d799ff700 1 Processor -- start 2023-08-27T11:28:13.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.570+0000 7f0d799ff700 1 -- start start 2023-08-27T11:28:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 0x7f0d740a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d740c51a0 0x7f0d741e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740bc8e0 con 0x7f0d7406ca60 2023-08-27T11:28:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740bf880 con 0x7f0d740ab040 2023-08-27T11:28:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d799ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740a9b60 con 0x7f0d740c51a0 2023-08-27T11:28:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:13.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58216/0 (socket says 172.21.15.43:58216) 2023-08-27T11:28:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 -- 172.21.15.43:0/773969975 learned_addr learned my addr 172.21.15.43:0/773969975 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 -- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d740c51a0 msgr2=0x7f0d741e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d740c51a0 0x7f0d741e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d727fc700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 0x7f0d740a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:13.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 -- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 msgr2=0x7f0d740a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 0x7f0d740a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d72ffd700 1 -- 172.21.15.43:0/773969975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094a0 con 0x7f0d7406ca60 2023-08-27T11:28:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.571+0000 7f0d727fc700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 0x7f0d740a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:13.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d72ffd700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640036a0 con 0x7f0d7406ca60 2023-08-27T11:28:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6401f070 con 0x7f0d7406ca60 2023-08-27T11:28:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64003a20 con 0x7f0d7406ca60 2023-08-27T11:28:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d741ed0b0 con 0x7f0d7406ca60 2023-08-27T11:28:13.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.572+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740a9db0 con 0x7f0d7406ca60 2023-08-27T11:28:13.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.573+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7404ee70 con 0x7f0d7406ca60 2023-08-27T11:28:13.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.574+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d64003b80 con 0x7f0d7406ca60 2023-08-27T11:28:13.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.575+0000 7f0d5bfff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 0x7f0d6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:13.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.575+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f0d64021070 con 0x7f0d7406ca60 2023-08-27T11:28:13.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.575+0000 7f0d727fc700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 0x7f0d6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:13.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.576+0000 7f0d727fc700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 0x7f0d6006c5a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0d740a84d0 tx=0x7f0d68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:13.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.580+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d64055400 con 0x7f0d7406ca60 2023-08-27T11:28:13.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.836+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d741e9090 con 0x7f0d7406ca60 2023-08-27T11:28:13.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.837+0000 7f0d5bfff700 1 -- 172.21.15.43:0/773969975 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4879 (secure 0 0 0) 0x7f0d6402b020 con 0x7f0d7406ca60 2023-08-27T11:28:13.839 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:13.839 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":121,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:28:12.184654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7195":{"gid":7195,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:13.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 msgr2=0x7f0d6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 0x7f0d6006c5a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0d740a84d0 tx=0x7f0d68008040 comp rx=0 tx=0).stop 2023-08-27T11:28:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 msgr2=0x7f0d7414a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f0d64000c00 tx=0x7f0d64004750 comp rx=0 tx=0).stop 2023-08-27T11:28:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 shutdown_connections 2023-08-27T11:28:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d6006a0e0 0x7f0d6006c5a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d740c51a0 0x7f0d741e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d7406ca60 0x7f0d7414a6b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 --2- 172.21.15.43:0/773969975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d740ab040 0x7f0d740a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:13.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 >> 172.21.15.43:0/773969975 conn(0x7f0d7406aa50 msgr2=0x7f0d740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:13.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 shutdown_connections 2023-08-27T11:28:13.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:13.839+0000 7f0d799ff700 1 -- 172.21.15.43:0/773969975 wait complete. 2023-08-27T11:28:13.844 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 121 2023-08-27T11:28:14.262 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:27:44.512293+0000', 'modified': '2023-08-27T11:28:12.184654+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 112, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7195}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7195': {'gid': 7195, 'name': 'b', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:28:14.263 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:28:14.263 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-27T11:28:14.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.466+0000 7f09149ff700 1 Processor -- start 2023-08-27T11:28:14.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.466+0000 7f09149ff700 1 -- start start 2023-08-27T11:28:14.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f091014f920 0x7f09100aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091006d530 0x7f0910152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09100aaf80 0x7f0910152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100a7050 con 0x7f091014f920 2023-08-27T11:28:14.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091006ca00 con 0x7f09100aaf80 2023-08-27T11:28:14.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f09149ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09101568b0 con 0x7f091006d530 2023-08-27T11:28:14.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.467+0000 7f090e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f091014f920 0x7f09100aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f091014f920 0x7f09100aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58230/0 (socket says 172.21.15.43:58230) 2023-08-27T11:28:14.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 -- 172.21.15.43:0/1540360458 learned_addr learned my addr 172.21.15.43:0/1540360458 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f0907fff700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091006d530 0x7f0910152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1540360458 >> v2:172.21.15.57:3300/0 conn(0x7f09100aaf80 0x7f0910152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 -- 172.21.15.43:0/1540360458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091006d530 msgr2=0x7f0910152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091006d530 0x7f0910152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 -- 172.21.15.43:0/1540360458 >> v2:172.21.15.57:3300/0 conn(0x7f09100aaf80 msgr2=0x7f0910152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 --2- 172.21.15.43:0/1540360458 >> v2:172.21.15.57:3300/0 conn(0x7f09100aaf80 0x7f0910152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 -- 172.21.15.43:0/1540360458 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910156330 con 0x7f091014f920 2023-08-27T11:28:14.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090e59c700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091014f920 0x7f09100aaa40 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f09100b8e60 tx=0x7f0900009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464a9614fc5d6fc5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.468+0000 7f090dd9b700 1 -- 172.21.15.43:0/1540360458 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000b870 con 0x7f091014f920 2023-08-27T11:28:14.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f090dd9b700 1 -- 172.21.15.43:0/1540360458 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000b9d0 con 0x7f091014f920 2023-08-27T11:28:14.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f090dd9b700 1 -- 172.21.15.43:0/1540360458 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000bd60 con 0x7f091014f920 2023-08-27T11:28:14.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 -- 172.21.15.43:0/1540360458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091014f920 msgr2=0x7f09100aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091014f920 0x7f09100aaa40 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f09100b8e60 tx=0x7f0900009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 -- 172.21.15.43:0/1540360458 shutdown_connections 2023-08-27T11:28:14.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 --2- 172.21.15.43:0/1540360458 >> v2:172.21.15.57:3300/0 conn(0x7f09100aaf80 0x7f0910152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f091014f920 0x7f09100aaa40 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 --2- 172.21.15.43:0/1540360458 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091006d530 0x7f0910152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 -- 172.21.15.43:0/1540360458 >> 172.21.15.43:0/1540360458 conn(0x7f091006ab90 msgr2=0x7f09100a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 -- 172.21.15.43:0/1540360458 shutdown_connections 2023-08-27T11:28:14.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.469+0000 7f09149ff700 1 -- 172.21.15.43:0/1540360458 wait complete. 2023-08-27T11:28:14.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.472+0000 7f09149ff700 1 Processor -- start 2023-08-27T11:28:14.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.472+0000 7f09149ff700 1 -- start start 2023-08-27T11:28:14.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f091006d530 0x7f09100a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 0x7f09101e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100a8ec0 con 0x7f09100aaf80 2023-08-27T11:28:14.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100a9a20 con 0x7f091006d530 2023-08-27T11:28:14.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f09149ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100aa7b0 con 0x7f091014f920 2023-08-27T11:28:14.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58242/0 (socket says 172.21.15.43:58242) 2023-08-27T11:28:14.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f0907fff700 1 -- 172.21.15.43:0/232215819 learned_addr learned my addr 172.21.15.43:0/232215819 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.473+0000 7f090e59c700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f091006d530 0x7f09100a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f090ed9d700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 0x7f09101e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 -- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 msgr2=0x7f09101e9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 0x7f09101e9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 -- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f091006d530 msgr2=0x7f09100a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f091006d530 0x7f09100a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 -- 172.21.15.43:0/232215819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009550 con 0x7f09100aaf80 2023-08-27T11:28:14.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f090ed9d700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 0x7f09101e9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:14.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0907fff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f08f800d7d0 tx=0x7f08f800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0906ffd700 1 -- 172.21.15.43:0/232215819 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80125f0 con 0x7f09100aaf80 2023-08-27T11:28:14.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0906ffd700 1 -- 172.21.15.43:0/232215819 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8012750 con 0x7f09100aaf80 2023-08-27T11:28:14.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100ab6c0 con 0x7f09100aaf80 2023-08-27T11:28:14.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f0906ffd700 1 -- 172.21.15.43:0/232215819 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8012ae0 con 0x7f09100aaf80 2023-08-27T11:28:14.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.474+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09100a65c0 con 0x7f09100aaf80 2023-08-27T11:28:14.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.476+0000 7f0906ffd700 1 -- 172.21.15.43:0/232215819 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f08f8012c40 con 0x7f09100aaf80 2023-08-27T11:28:14.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.477+0000 7f0906ffd700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 0x7f08f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.477+0000 7f0906ffd700 1 -- 172.21.15.43:0/232215819 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f08f8088600 con 0x7f09100aaf80 2023-08-27T11:28:14.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.478+0000 7f090e59c700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 0x7f08f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.478+0000 7f090e59c700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 0x7f08f006c5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0900014040 tx=0x7f0900008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.480+0000 7f092829fb80 1 Processor -- start 2023-08-27T11:28:14.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.480+0000 7f092829fb80 1 -- start start 2023-08-27T11:28:14.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebffa8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 0x55bebffbe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebfee3730 con 0x55bebff8bfe0 2023-08-27T11:28:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebfee1050 con 0x55bebff862e0 2023-08-27T11:28:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bebfedc940 con 0x55bebff85f00 2023-08-27T11:28:14.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58256/0 (socket says 172.21.15.43:58256) 2023-08-27T11:28:14.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f0907fff700 1 -- 172.21.15.43:0/912283728 learned_addr learned my addr 172.21.15.43:0/912283728 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f090e59c700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebffa8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.481+0000 7f090ed9d700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 0x55bebffbe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 -- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 msgr2=0x55bebffa8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebffa8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 -- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 msgr2=0x55bebffbe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 0x55bebffbe500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 -- 172.21.15.43:0/912283728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bebfd5c5e0 con 0x55bebff8bfe0 2023-08-27T11:28:14.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f090ed9d700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 0x55bebffbe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:14.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f0907fff700 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f08f8053df0 tx=0x7f08f800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df68c730323adb2c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f08effff700 1 -- 172.21.15.43:0/912283728 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f805b6b0 con 0x55bebff8bfe0 2023-08-27T11:28:14.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f08effff700 1 -- 172.21.15.43:0/912283728 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f805f600 con 0x55bebff8bfe0 2023-08-27T11:28:14.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.482+0000 7f08effff700 1 -- 172.21.15.43:0/912283728 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f805f170 con 0x55bebff8bfe0 2023-08-27T11:28:14.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 -- 172.21.15.43:0/912283728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 msgr2=0x55bebffa92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f08f8053df0 tx=0x7f08f800bf90 comp rx=0 tx=0).stop 2023-08-27T11:28:14.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 -- 172.21.15.43:0/912283728 shutdown_connections 2023-08-27T11:28:14.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff862e0 0x55bebffbe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebffa8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 --2- 172.21.15.43:0/912283728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff8bfe0 0x55bebffa92b0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 -- 172.21.15.43:0/912283728 >> 172.21.15.43:0/912283728 conn(0x55bebfee8c30 msgr2=0x55bebff886e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 -- 172.21.15.43:0/912283728 shutdown_connections 2023-08-27T11:28:14.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.483+0000 7f092829fb80 1 -- 172.21.15.43:0/912283728 wait complete. 2023-08-27T11:28:14.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.484+0000 7f092829fb80 1 -- start start 2023-08-27T11:28:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.484+0000 7f092829fb80 1 Processor -- start 2023-08-27T11:28:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 0x55bebffa1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebfe7ab60 con 0x55bebff85f00 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebfe7a860 con 0x55bebffaa3c0 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bebfd5e8d0 con 0x55bebff862e0 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f092829fb80 10 client.0 _ll_register_callbacks cb 0x55bebfe78630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f090e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f090e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58268/0 (socket says 172.21.15.43:58268) 2023-08-27T11:28:14.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.485+0000 7f090e59c700 1 -- 172.21.15.43:0/1444553925 learned_addr learned my addr 172.21.15.43:0/1444553925 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 0x55bebffa1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f0907fff700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 -- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 msgr2=0x55bebffa9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 -- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 msgr2=0x55bebffa1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 0x55bebffa1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 -- 172.21.15.43:0/1444553925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09100a65c0 con 0x55bebff85f00 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 0x55bebffa1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f0907fff700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:14.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f090e59c700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0900013000 tx=0x7f090000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f954dbf87f21b8d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f08ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:14.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090002d040 con 0x55bebff85f00 2023-08-27T11:28:14.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f0900031420 con 0x55bebff85f00 2023-08-27T11:28:14.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.486+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bebff7d4f0 con 0x55bebff85f00 2023-08-27T11:28:14.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f090001f070 con 0x55bebff85f00 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 10 client.7875 fetch_fsmap learned FSMap version 121 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55bebfef4750 con 0x55bebff85f00 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bebff7d4f0 con 0x55bebff85f00 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 121) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f09000315e0 con 0x55bebff85f00 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 10 client.7875 fetch_fsmap finished waiting for FSMap version 121 2023-08-27T11:28:14.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 10 client.7875 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:28:14.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 20 client.7875 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:14.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bebffa2160 0x55bebffd09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 4 client.7875 mds_command: new command op to 7195 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:28:14.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 --> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bebfed5920 con 0x55bebffa2160 2023-08-27T11:28:14.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.487+0000 7f0907fff700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bebffa2160 0x55bebffd09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.488+0000 7f0907fff700 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bebffa2160 0x55bebffd09c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b6793e46ca6fe7 server_cookie=7951c5ba69d35c19 in_seq=0 out_seq=0 2023-08-27T11:28:14.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.488+0000 7f08ed7fa700 10 client.7875 ms_handle_connect on v2:172.21.15.57:6832/30396136 2023-08-27T11:28:14.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.489+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1444553925 <== mds.0 v2:172.21.15.57:6832/30396136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bebfed5920 con 0x55bebffa2160 2023-08-27T11:28:14.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.489+0000 7f08ed7fa700 10 client.7875 handle_command_reply: tid=0 2023-08-27T11:28:14.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.489+0000 7f092829fb80 1 client.7875 shutdown 2023-08-27T11:28:14.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.489+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 msgr2=0x55bebff9ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.489+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f0900013000 tx=0x7f090000e000 comp rx=0 tx=0).stop 2023-08-27T11:28:14.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 shutdown_connections 2023-08-27T11:28:14.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffaa3c0 0x55bebffa1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff85f00 0x55bebff9ecf0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bebffa2160 0x55bebffd09c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 --2- 172.21.15.43:0/1444553925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 >> 172.21.15.43:0/1444553925 conn(0x55bebfee8c30 msgr2=0x55bebffa8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f08ed7fa700 0 client.7875 ms_handle_reset on v2:172.21.15.57:6832/30396136 2023-08-27T11:28:14.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 shutdown_connections 2023-08-27T11:28:14.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 1 -- 172.21.15.43:0/1444553925 wait complete. 2023-08-27T11:28:14.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.490+0000 7f092829fb80 20 client.7875 trim_cache size 0 max 16384 2023-08-27T11:28:14.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.508+0000 7f092829fb80 1 Processor -- start 2023-08-27T11:28:14.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.508+0000 7f092829fb80 1 -- start start 2023-08-27T11:28:14.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebff851a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffd0f00 0x55bebffaa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebff846e0 con 0x55bebff862e0 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebffd4810 con 0x55bebffd0f00 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bebffc8170 con 0x55bebff85f00 2023-08-27T11:28:14.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f0907fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58282/0 (socket says 172.21.15.43:58282) 2023-08-27T11:28:14.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f0907fff700 1 -- 172.21.15.43:0/3422326651 learned_addr learned my addr 172.21.15.43:0/3422326651 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f090ed9d700 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffd0f00 0x55bebffaa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.509+0000 7f090e59c700 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebff851a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 -- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 msgr2=0x55bebff851a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebff851a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 -- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffd0f00 msgr2=0x55bebffaa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffd0f00 0x55bebffaa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 -- 172.21.15.43:0/3422326651 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bebfd08d90 con 0x55bebff862e0 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0907fff700 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f08f80575a0 tx=0x7f08f8015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8a4ebc5047a521 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0904ff9700 1 -- 172.21.15.43:0/3422326651 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f805f170 con 0x55bebff862e0 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0904ff9700 1 -- 172.21.15.43:0/3422326651 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f805f2d0 con 0x55bebff862e0 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.510+0000 7f0904ff9700 1 -- 172.21.15.43:0/3422326651 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f805f440 con 0x55bebff862e0 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- 172.21.15.43:0/3422326651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 msgr2=0x55bebffd09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f08f80575a0 tx=0x7f08f8015070 comp rx=0 tx=0).stop 2023-08-27T11:28:14.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- 172.21.15.43:0/3422326651 shutdown_connections 2023-08-27T11:28:14.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebffd0f00 0x55bebffaa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff85f00 0x55bebff851a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 --2- 172.21.15.43:0/3422326651 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebff862e0 0x55bebffd09c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- 172.21.15.43:0/3422326651 >> 172.21.15.43:0/3422326651 conn(0x55bebfee8c30 msgr2=0x55bebffa1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- 172.21.15.43:0/3422326651 shutdown_connections 2023-08-27T11:28:14.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- 172.21.15.43:0/3422326651 wait complete. 2023-08-27T11:28:14.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.511+0000 7f092829fb80 1 -- start start 2023-08-27T11:28:14.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.512+0000 7f092829fb80 1 Processor -- start 2023-08-27T11:28:14.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 0x55bebffa8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bec002caf0 con 0x55bebffd0f00 2023-08-27T11:28:14.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bebffaab40 con 0x55bebff85f00 2023-08-27T11:28:14.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bebffa8b00 con 0x55bebff862e0 2023-08-27T11:28:14.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f092829fb80 10 client.0 _ll_register_callbacks cb 0x55bebfe78630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:14.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 0x55bebffa8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090e59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:56560/0 (socket says 172.21.15.43:56560) 2023-08-27T11:28:14.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090e59c700 1 -- 172.21.15.43:0/1590558366 learned_addr learned my addr 172.21.15.43:0/1590558366 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:14.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f0907fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 -- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 msgr2=0x55bebffa8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 -- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 msgr2=0x55bebffa4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:14.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090ed9d700 1 -- 172.21.15.43:0/1590558366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bebfd5c5e0 con 0x55bebffd0f00 2023-08-27T11:28:14.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.513+0000 7f090e59c700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:14.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f090ed9d700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 0x55bebffa8570 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x55bebffa2780 tx=0x7f0908007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e30f1d925eca00 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:14.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:14.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908007b40 con 0x55bebffd0f00 2023-08-27T11:28:14.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f0908023cd0 con 0x55bebffd0f00 2023-08-27T11:28:14.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08f805f600 con 0x55bebffd0f00 2023-08-27T11:28:14.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0908023e90 con 0x55bebffd0f00 2023-08-27T11:28:14.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f092829fb80 10 client.7881 fetch_fsmap learned FSMap version 121 2023-08-27T11:28:14.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55bebfcf1c10 con 0x55bebffd0f00 2023-08-27T11:28:14.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f805f600 con 0x55bebffd0f00 2023-08-27T11:28:14.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.514+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 121) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0908007ca0 con 0x55bebffd0f00 2023-08-27T11:28:14.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 10 client.7881 fetch_fsmap finished waiting for FSMap version 121 2023-08-27T11:28:14.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 10 client.7881 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:28:14.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 20 client.7881 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:14.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bec0032880 0x55bec0032c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:14.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 4 client.7881 mds_command: new command op to 7195 tid=0[{"prefix": "status"}] 2023-08-27T11:28:14.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 --> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bebfe96000 con 0x55bec0032880 2023-08-27T11:28:14.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f090e59c700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bec0032880 0x55bec0032c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:14.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f090e59c700 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bec0032880 0x55bec0032c60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb8782348ccf4e39 server_cookie=dcf20438b621d69a in_seq=0 out_seq=0 2023-08-27T11:28:14.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.515+0000 7f08ed7fa700 10 client.7881 ms_handle_connect on v2:172.21.15.57:6832/30396136 2023-08-27T11:28:14.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f08ed7fa700 1 -- 172.21.15.43:0/1590558366 <== mds.0 v2:172.21.15.57:6832/30396136 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55bebfe96000 con 0x55bec0032880 2023-08-27T11:28:14.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f08ed7fa700 10 client.7881 handle_command_reply: tid=0 2023-08-27T11:28:14.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 client.7881 shutdown 2023-08-27T11:28:14.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 msgr2=0x55bebffa8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 0x55bebffa8570 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x55bebffa2780 tx=0x7f0908007610 comp rx=0 tx=0).stop 2023-08-27T11:28:14.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 shutdown_connections 2023-08-27T11:28:14.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bebffd0f00 0x55bebffa8570 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55bebff85f00 0x55bebffa4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:6832/30396136,v1:172.21.15.57:6834/30396136] conn(0x55bec0032880 0x55bec0032c60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 --2- 172.21.15.43:0/1590558366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55bebff862e0 0x55bebffa8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 >> 172.21.15.43:0/1590558366 conn(0x55bebfee8c30 msgr2=0x55bebff89330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f08ed7fa700 0 client.7881 ms_handle_reset on v2:172.21.15.57:6832/30396136 2023-08-27T11:28:14.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 shutdown_connections 2023-08-27T11:28:14.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 1 -- 172.21.15.43:0/1590558366 wait complete. 2023-08-27T11:28:14.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.516+0000 7f092829fb80 20 client.7881 trim_cache size 0 max 16384 2023-08-27T11:28:14.536 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:14.536 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:28:14.537 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:28:14.537 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 7195, 2023-08-27T11:28:14.537 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:28:14.537 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:28:14.537 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:28:14.538 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 5.3420664660000003, 2023-08-27T11:28:14.538 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 121, 2023-08-27T11:28:14.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 112, 2023-08-27T11:28:14.538 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 112, 2023-08-27T11:28:14.538 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 35.720011675999999 2023-08-27T11:28:14.539 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:14.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 msgr2=0x7f08f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 0x7f08f006c5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0900014040 tx=0x7f0900008030 comp rx=0 tx=0).stop 2023-08-27T11:28:14.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 msgr2=0x7f09100c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:14.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f08f800d7d0 tx=0x7f08f800dae0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 shutdown_connections 2023-08-27T11:28:14.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f08f006a0e0 0x7f08f006c5a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f091014f920 0x7f09101e9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f091006d530 0x7f09100a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 --2- 172.21.15.43:0/232215819 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09100aaf80 0x7f09100c6070 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:14.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 >> 172.21.15.43:0/232215819 conn(0x7f091006ab90 msgr2=0x7f091014d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:14.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 shutdown_connections 2023-08-27T11:28:14.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:14.517+0000 7f09149ff700 1 -- 172.21.15.43:0/232215819 wait complete. 2023-08-27T11:28:14.542 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 8, "epoch": 121, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 8, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:27:44.512293+0000", "damaged": [], "data_pools": [ 18 ], "enabled": true, "epoch": 121, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7195": { "addr": "172.21.15.57:6834/30396136", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 30396136, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 30396136, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7195, "incarnation": 118, "join_fscid": 8, "name": "b", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 112, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 17, "modified": "2023-08-27T11:28:12.184654+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7195 } } } ], "standbys": [ { "addr": "172.21.15.57:6835/2128138968", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2128138968, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2128138968, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 106, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7198, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6837/1498551988", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1498551988, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1498551988, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 114, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7363, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.43:6835/2173430717", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 2173430717, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 2173430717, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 119, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7857, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:28:14.544 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': 8, 'name': 'b', 'state': 'up:active'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:28:14.544 INFO:tasks.cephfs.test_failover:current = [{'gid': 7857, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6835/2173430717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 2173430717}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 2173430717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 119}, {'gid': 7195, 'name': 'b', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.57:6834/30396136', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 30396136}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 30396136}]}, 'join_fscid': 8, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7363, 'name': 'c', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6837/1498551988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1498551988}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1498551988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 114}, {'gid': 7198, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/2128138968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2128138968}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2128138968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 106}] 2023-08-27T11:28:14.545 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-08-27T11:28:14.545 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:28:14.545 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:28:14.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:28:14.760 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:28:14.761 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:28:14.761 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:28:14.805 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:28:14.806 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:28:14.806 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:28:14.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:28:14.853 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:14.966 INFO:tasks.ceph.mds.b.smithi057.stderr:2023-08-27T11:28:14.965+0000 7fce85bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:28:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.054+0000 7f42c97ff700 1 Processor -- start 2023-08-27T11:28:15.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.054+0000 7f42c97ff700 1 -- start start 2023-08-27T11:28:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.055+0000 7f42c97ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42c406e360 0x7f42c406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.055+0000 7f42c97ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 0x7f42c415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.055+0000 7f42c97ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c40c6820 con 0x7f42c406a310 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.055+0000 7f42c97ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40c23a0 con 0x7f42c406e360 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.055+0000 7f42c97ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41548c0 con 0x7f42c4158190 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c2ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f42c406a310 0x7f42c4157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33602/0 (socket says 172.21.15.43:33602) 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c2ffd700 1 -- 172.21.15.43:0/3759542598 learned_addr learned my addr 172.21.15.43:0/3759542598 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c27fc700 1 --2- 172.21.15.43:0/3759542598 >> v2:172.21.15.57:3300/0 conn(0x7f42c406e360 0x7f42c406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c37fe700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 0x7f42c415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c1ffb700 1 -- 172.21.15.43:0/3759542598 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060429313 0 0) 0x7f42c40c6820 con 0x7f42c406a310 2023-08-27T11:28:15.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c1ffb700 1 -- 172.21.15.43:0/3759542598 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ac0035b0 con 0x7f42c406a310 2023-08-27T11:28:15.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c27fc700 1 -- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 msgr2=0x7f42c415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:15.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c27fc700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 0x7f42c415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c27fc700 1 -- 172.21.15.43:0/3759542598 >> v1:172.21.15.43:6789/0 conn(0x7f42c406a310 legacy=0x7f42c4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c27fc700 1 -- 172.21.15.43:0/3759542598 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40c4a50 con 0x7f42c406e360 2023-08-27T11:28:15.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.056+0000 7f42c37fe700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 0x7f42c415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:15.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c27fc700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c406e360 0x7f42c406a6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009840 tx=0x7f42b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb29254e083928d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c1ffb700 1 -- 172.21.15.43:0/3759542598 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011830 con 0x7f42c406e360 2023-08-27T11:28:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c1ffb700 1 -- 172.21.15.43:0/3759542598 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8011990 con 0x7f42c406e360 2023-08-27T11:28:15.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c1ffb700 1 -- 172.21.15.43:0/3759542598 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8011d20 con 0x7f42c406e360 2023-08-27T11:28:15.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 -- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c406e360 msgr2=0x7f42c406a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c406e360 0x7f42c406a6f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009840 tx=0x7f42b8009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 -- 172.21.15.43:0/3759542598 shutdown_connections 2023-08-27T11:28:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c4158190 0x7f42c415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 --2- 172.21.15.43:0/3759542598 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c406e360 0x7f42c406a6f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 -- 172.21.15.43:0/3759542598 >> 172.21.15.43:0/3759542598 conn(0x7f42c40a85e0 msgr2=0x7f42c40a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.057+0000 7f42c97ff700 1 -- 172.21.15.43:0/3759542598 shutdown_connections 2023-08-27T11:28:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.058+0000 7f42c97ff700 1 -- 172.21.15.43:0/3759542598 wait complete. 2023-08-27T11:28:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.059+0000 7f42c97ff700 1 Processor -- start 2023-08-27T11:28:15.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.059+0000 7f42c97ff700 1 -- start start 2023-08-27T11:28:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c406a310 0x7f42c414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c4158190 0x7f42c40aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4072260 con 0x7f42c406e360 2023-08-27T11:28:15.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c414e8c0 con 0x7f42c4158190 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c97ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41ed2c0 con 0x7f42c406a310 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c27fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58294/0 (socket says 172.21.15.43:58294) 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.060+0000 7f42c27fc700 1 -- 172.21.15.43:0/2148511038 learned_addr learned my addr 172.21.15.43:0/2148511038 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c2ffd700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c406a310 0x7f42c414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c37fe700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c4158190 0x7f42c40aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 -- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c406a310 msgr2=0x7f42c414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c406a310 0x7f42c414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 -- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c4158190 msgr2=0x7f42c40aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c4158190 0x7f42c40aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 -- 172.21.15.43:0/2148511038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc009a70 con 0x7f42c406e360 2023-08-27T11:28:15.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c27fc700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80036a0 con 0x7f42c406e360 2023-08-27T11:28:15.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b801f070 con 0x7f42c406e360 2023-08-27T11:28:15.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b80094a0 con 0x7f42c406e360 2023-08-27T11:28:15.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.061+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8003a60 con 0x7f42c406e360 2023-08-27T11:28:15.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.062+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4071a00 con 0x7f42c406e360 2023-08-27T11:28:15.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.063+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c406d4f0 con 0x7f42c406e360 2023-08-27T11:28:15.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.063+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42b8003bc0 con 0x7f42c406e360 2023-08-27T11:28:15.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.064+0000 7f42ab7fe700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 0x7f42b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.064+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f42b8021070 con 0x7f42c406e360 2023-08-27T11:28:15.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.065+0000 7f42c2ffd700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 0x7f42b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.065+0000 7f42c2ffd700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 0x7f42b006c5a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f42b40011e0 tx=0x7f42b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.069+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f42b8055580 con 0x7f42c406e360 2023-08-27T11:28:15.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.327+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c404ee70 con 0x7f42c406e360 2023-08-27T11:28:15.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.328+0000 7f42ab7fe700 1 -- 172.21.15.43:0/2148511038 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4879 (secure 0 0 0) 0x7f42b802b090 con 0x7f42c406e360 2023-08-27T11:28:15.329 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:15.330 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":121,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:28:12.184654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7195":{"gid":7195,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:15.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 msgr2=0x7f42b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 0x7f42b006c5a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f42b40011e0 tx=0x7f42b4009040 comp rx=0 tx=0).stop 2023-08-27T11:28:15.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 msgr2=0x7f42c41ea240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8004750 comp rx=0 tx=0).stop 2023-08-27T11:28:15.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 shutdown_connections 2023-08-27T11:28:15.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42b006a0e0 0x7f42b006c5a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42c4158190 0x7f42c40aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42c406a310 0x7f42c414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 --2- 172.21.15.43:0/2148511038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42c406e360 0x7f42c41ea240 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 >> 172.21.15.43:0/2148511038 conn(0x7f42c40a85e0 msgr2=0x7f42c40a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:15.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 shutdown_connections 2023-08-27T11:28:15.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.330+0000 7f42c97ff700 1 -- 172.21.15.43:0/2148511038 wait complete. 2023-08-27T11:28:15.334 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 121 2023-08-27T11:28:15.350 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:15.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.550+0000 7f47a39ff700 1 Processor -- start 2023-08-27T11:28:15.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.551+0000 7f47a39ff700 1 -- start start 2023-08-27T11:28:15.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 0x7f479c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f479c06ca60 0x7f479c0aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 0x7f479c155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c1530b0 con 0x7f479c06ca60 2023-08-27T11:28:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c14c860 con 0x7f479c0c51a0 2023-08-27T11:28:15.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06d700 con 0x7f479c0ab040 2023-08-27T11:28:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a0f9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f479c06ca60 0x7f479c0aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a0f9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f479c06ca60 0x7f479c0aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58296/0 (socket says 172.21.15.43:58296) 2023-08-27T11:28:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a0f9a700 1 -- 172.21.15.43:0/1694066143 learned_addr learned my addr 172.21.15.43:0/1694066143 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a1f9c700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 0x7f479c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.552+0000 7f47a179b700 1 --2- 172.21.15.43:0/1694066143 >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 0x7f479c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 -- 172.21.15.43:0/1694066143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 msgr2=0x7f479c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:15.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 0x7f479c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 -- 172.21.15.43:0/1694066143 >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 msgr2=0x7f479c06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:15.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/1694066143 >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 0x7f479c06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 -- 172.21.15.43:0/1694066143 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c152430 con 0x7f479c06ca60 2023-08-27T11:28:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a1f9c700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 0x7f479c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a179b700 1 --2- 172.21.15.43:0/1694066143 >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 0x7f479c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c06ca60 0x7f479c0aab00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f479c06db90 tx=0x7f478c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ad65c1b5351ab9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f4793fff700 1 -- 172.21.15.43:0/1694066143 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c00b9e0 con 0x7f479c06ca60 2023-08-27T11:28:15.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f4793fff700 1 -- 172.21.15.43:0/1694066143 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c00bb40 con 0x7f479c06ca60 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.553+0000 7f4793fff700 1 -- 172.21.15.43:0/1694066143 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c009e70 con 0x7f479c06ca60 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 -- 172.21.15.43:0/1694066143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c06ca60 msgr2=0x7f479c0aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c06ca60 0x7f479c0aab00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f479c06db90 tx=0x7f478c009c30 comp rx=0 tx=0).stop 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 -- 172.21.15.43:0/1694066143 shutdown_connections 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c0ab040 0x7f479c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 --2- 172.21.15.43:0/1694066143 >> v2:172.21.15.57:3300/0 conn(0x7f479c0c51a0 0x7f479c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 --2- 172.21.15.43:0/1694066143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c06ca60 0x7f479c0aab00 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 -- 172.21.15.43:0/1694066143 >> 172.21.15.43:0/1694066143 conn(0x7f479c06aa50 msgr2=0x7f479c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 -- 172.21.15.43:0/1694066143 shutdown_connections 2023-08-27T11:28:15.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.554+0000 7f47a39ff700 1 -- 172.21.15.43:0/1694066143 wait complete. 2023-08-27T11:28:15.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.556+0000 7f47a39ff700 1 Processor -- start 2023-08-27T11:28:15.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.556+0000 7f47a39ff700 1 -- start start 2023-08-27T11:28:15.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c06ca60 0x7f479c1ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479c0c51a0 0x7f479c14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c06f820 con 0x7f479c0ab040 2023-08-27T11:28:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c1ea730 con 0x7f479c0c51a0 2023-08-27T11:28:15.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0aa5e0 con 0x7f479c06ca60 2023-08-27T11:28:15.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58306/0 (socket says 172.21.15.43:58306) 2023-08-27T11:28:15.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 -- 172.21.15.43:0/3871903128 learned_addr learned my addr 172.21.15.43:0/3871903128 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:15.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a179b700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c06ca60 0x7f479c1ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a1f9c700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479c0c51a0 0x7f479c14a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 -- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c06ca60 msgr2=0x7f479c1ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c06ca60 0x7f479c1ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 -- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479c0c51a0 msgr2=0x7f479c14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479c0c51a0 0x7f479c14a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.557+0000 7f47a0f9a700 1 -- 172.21.15.43:0/3871903128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009550 con 0x7f479c0ab040 2023-08-27T11:28:15.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f47a0f9a700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f478c009c70 tx=0x7f478c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c004400 con 0x7f479c0ab040 2023-08-27T11:28:15.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c01f070 con 0x7f479c0ab040 2023-08-27T11:28:15.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0038e0 con 0x7f479c0ab040 2023-08-27T11:28:15.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0bf6e0 con 0x7f479c0ab040 2023-08-27T11:28:15.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.558+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c14b370 con 0x7f479c0ab040 2023-08-27T11:28:15.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.559+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0bfc00 con 0x7f479c0ab040 2023-08-27T11:28:15.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.560+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f478c021030 con 0x7f479c0ab040 2023-08-27T11:28:15.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.561+0000 7f4791ffb700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 0x7f478006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:15.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.561+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f478c0899a0 con 0x7f479c0ab040 2023-08-27T11:28:15.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.562+0000 7f47a179b700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 0x7f478006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:15.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.562+0000 7f47a179b700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 0x7f478006c5a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f479800c900 tx=0x7f4798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:15.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.566+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f479c0bfc00 con 0x7f479c0ab040 2023-08-27T11:28:15.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.778+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c06f580 con 0x7f479c0ab040 2023-08-27T11:28:15.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.779+0000 7f4791ffb700 1 -- 172.21.15.43:0/3871903128 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f479c06f580 con 0x7f479c0ab040 2023-08-27T11:28:15.781 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:15.781 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":112,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:09.171014+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6835/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6834/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6837/1939845776":"2023-08-28T11:27:55.101994+0000","172.21.15.43:6836/1939845776":"2023-08-28T11:27:55.101994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 msgr2=0x7f478006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 0x7f478006c5a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f479800c900 tx=0x7f4798008040 comp rx=0 tx=0).stop 2023-08-27T11:28:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 msgr2=0x7f479c0a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f478c009c70 tx=0x7f478c004750 comp rx=0 tx=0).stop 2023-08-27T11:28:15.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 shutdown_connections 2023-08-27T11:28:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f478006a0e0 0x7f478006c5a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f479c0c51a0 0x7f479c14a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f479c06ca60 0x7f479c1ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 --2- 172.21.15.43:0/3871903128 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f479c0ab040 0x7f479c0a7630 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:15.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 >> 172.21.15.43:0/3871903128 conn(0x7f479c06aa50 msgr2=0x7f479c151b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:15.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 shutdown_connections 2023-08-27T11:28:15.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:15.782+0000 7f47a39ff700 1 -- 172.21.15.43:0/3871903128 wait complete. 2023-08-27T11:28:15.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:27:42.835660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:27:43.484816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:28:15.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:28:16.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.006+0000 7f903c1ff700 1 Processor -- start 2023-08-27T11:28:16.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.006+0000 7f903c1ff700 1 -- start start 2023-08-27T11:28:16.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903c1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9034151d20 0x7f90340c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903c1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90340c7c00 0x7f90340ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903c1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9034154660 con 0x7f90340abcc0 2023-08-27T11:28:16.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903c1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90340c5750 con 0x7f9034151d20 2023-08-27T11:28:16.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903c1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9034154940 con 0x7f90340c7c00 2023-08-27T11:28:16.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f9039f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9034151d20 0x7f90340c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f9039f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9034151d20 0x7f90340c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58310/0 (socket says 172.21.15.43:58310) 2023-08-27T11:28:16.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f903979a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90340c7c00 0x7f90340ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.008+0000 7f9039f9b700 1 -- 172.21.15.43:0/3197950328 learned_addr learned my addr 172.21.15.43:0/3197950328 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:16.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9039f9b700 1 -- 172.21.15.43:0/3197950328 >> v2:172.21.15.57:3300/0 conn(0x7f90340c7c00 msgr2=0x7f90340ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:16.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9039f9b700 1 --2- 172.21.15.43:0/3197950328 >> v2:172.21.15.57:3300/0 conn(0x7f90340c7c00 0x7f90340ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9039f9b700 1 -- 172.21.15.43:0/3197950328 >> v1:172.21.15.57:6789/0 conn(0x7f90340abcc0 legacy=0x7f903406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9039f9b700 1 -- 172.21.15.43:0/3197950328 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034154c20 con 0x7f9034151d20 2023-08-27T11:28:16.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9039f9b700 1 --2- 172.21.15.43:0/3197950328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9034151d20 0x7f90340c8110 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f90340cac40 tx=0x7f9030009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3bebea3d0ef6d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9038f99700 1 -- 172.21.15.43:0/3197950328 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030011830 con 0x7f9034151d20 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9038f99700 1 -- 172.21.15.43:0/3197950328 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030011990 con 0x7f9034151d20 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.009+0000 7f9038f99700 1 -- 172.21.15.43:0/3197950328 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030011d20 con 0x7f9034151d20 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 -- 172.21.15.43:0/3197950328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9034151d20 msgr2=0x7f90340c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 --2- 172.21.15.43:0/3197950328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9034151d20 0x7f90340c8110 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f90340cac40 tx=0x7f9030009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 -- 172.21.15.43:0/3197950328 shutdown_connections 2023-08-27T11:28:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 --2- 172.21.15.43:0/3197950328 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9034151d20 0x7f90340c8110 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 --2- 172.21.15.43:0/3197950328 >> v2:172.21.15.57:3300/0 conn(0x7f90340c7c00 0x7f90340ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 -- 172.21.15.43:0/3197950328 >> 172.21.15.43:0/3197950328 conn(0x7f90340c9d00 msgr2=0x7f90340ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 -- 172.21.15.43:0/3197950328 shutdown_connections 2023-08-27T11:28:16.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.010+0000 7f903c1ff700 1 -- 172.21.15.43:0/3197950328 wait complete. 2023-08-27T11:28:16.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.012+0000 7f903c1ff700 1 Processor -- start 2023-08-27T11:28:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.012+0000 7f903c1ff700 1 -- start start 2023-08-27T11:28:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90340abcc0 0x7f903414aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9034151d20 0x7f90340c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c1820 con 0x7f90340c7c00 2023-08-27T11:28:16.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c2410 con 0x7f90340abcc0 2023-08-27T11:28:16.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903c1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90340c0d40 con 0x7f9034151d20 2023-08-27T11:28:16.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903979a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903979a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58316/0 (socket says 172.21.15.43:58316) 2023-08-27T11:28:16.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.013+0000 7f903979a700 1 -- 172.21.15.43:0/1327300290 learned_addr learned my addr 172.21.15.43:0/1327300290 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:16.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f9039f9b700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90340abcc0 0x7f903414aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903a79c700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9034151d20 0x7f90340c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 -- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9034151d20 msgr2=0x7f90340c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9034151d20 0x7f90340c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 -- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90340abcc0 msgr2=0x7f903414aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90340abcc0 0x7f903414aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 -- 172.21.15.43:0/1327300290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009550 con 0x7f90340c7c00 2023-08-27T11:28:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903979a700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f902400e9e0 tx=0x7f902400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024009710 con 0x7f90340c7c00 2023-08-27T11:28:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400c850 con 0x7f90340c7c00 2023-08-27T11:28:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90341ea700 con 0x7f90340c7c00 2023-08-27T11:28:16.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400cbc0 con 0x7f90340c7c00 2023-08-27T11:28:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.014+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90340c1270 con 0x7f90340c7c00 2023-08-27T11:28:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.015+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903414a6b0 con 0x7f90340c7c00 2023-08-27T11:28:16.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.016+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f902400cd20 con 0x7f90340c7c00 2023-08-27T11:28:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.017+0000 7f902a7fc700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 0x7f901806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.017+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f9024088710 con 0x7f90340c7c00 2023-08-27T11:28:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.018+0000 7f9039f9b700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 0x7f901806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.018+0000 7f9039f9b700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 0x7f901806c5a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9030014040 tx=0x7f9030008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.022+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9024053cc0 con 0x7f90340c7c00 2023-08-27T11:28:16.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.229+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f903404ee70 con 0x7f90340c7c00 2023-08-27T11:28:16.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.230+0000 7f902a7fc700 1 -- 172.21.15.43:0/1327300290 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7f90240572e0 con 0x7f90340c7c00 2023-08-27T11:28:16.232 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:28:16.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 msgr2=0x7f901806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 0x7f901806c5a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9030014040 tx=0x7f9030008030 comp rx=0 tx=0).stop 2023-08-27T11:28:16.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 msgr2=0x7f90340aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f902400e9e0 tx=0x7f902400ecf0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 shutdown_connections 2023-08-27T11:28:16.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f901806a0e0 0x7f901806c5a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9034151d20 0x7f90340c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90340abcc0 0x7f903414aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 --2- 172.21.15.43:0/1327300290 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f90340c7c00 0x7f90340aa970 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 >> 172.21.15.43:0/1327300290 conn(0x7f90340c9d00 msgr2=0x7f903414b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:16.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 shutdown_connections 2023-08-27T11:28:16.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.232+0000 7f903c1ff700 1 -- 172.21.15.43:0/1327300290 wait complete. 2023-08-27T11:28:16.252 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:28:16.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.456+0000 7f7e875ff700 1 Processor -- start 2023-08-27T11:28:16.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.456+0000 7f7e875ff700 1 -- start start 2023-08-27T11:28:16.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e875ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e80136f50 0x7f7e800c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e875ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e80137330 con 0x7f7e80158340 2023-08-27T11:28:16.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e875ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e80154450 con 0x7f7e8006cc00 2023-08-27T11:28:16.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e875ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e80158840 con 0x7f7e80136f50 2023-08-27T11:28:16.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e84b9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7e80158340 0x7f7e8006ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33612/0 (socket says 172.21.15.43:33612) 2023-08-27T11:28:16.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.457+0000 7f7e84b9a700 1 -- 172.21.15.43:0/2652892843 learned_addr learned my addr 172.21.15.43:0/2652892843 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:16.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e8539b700 1 --2- 172.21.15.43:0/2652892843 >> v2:172.21.15.57:3300/0 conn(0x7f7e80136f50 0x7f7e800c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e77fff700 1 -- 172.21.15.43:0/2652892843 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985163846 0 0) 0x7f7e80137330 con 0x7f7e80158340 2023-08-27T11:28:16.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e77fff700 1 -- 172.21.15.43:0/2652892843 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e6c0035b0 con 0x7f7e80158340 2023-08-27T11:28:16.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e8539b700 1 -- 172.21.15.43:0/2652892843 >> v1:172.21.15.57:6789/0 conn(0x7f7e8006cc00 legacy=0x7f7e8006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e8539b700 1 -- 172.21.15.43:0/2652892843 >> v1:172.21.15.43:6789/0 conn(0x7f7e80158340 legacy=0x7f7e8006ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e8539b700 1 -- 172.21.15.43:0/2652892843 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e801546f0 con 0x7f7e80136f50 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.458+0000 7f7e8539b700 1 --2- 172.21.15.43:0/2652892843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e80136f50 0x7f7e800c03e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009840 tx=0x7f7e7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90da8f3a367a74e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e77fff700 1 -- 172.21.15.43:0/2652892843 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011830 con 0x7f7e80136f50 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e77fff700 1 -- 172.21.15.43:0/2652892843 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c011990 con 0x7f7e80136f50 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e77fff700 1 -- 172.21.15.43:0/2652892843 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011d00 con 0x7f7e80136f50 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 -- 172.21.15.43:0/2652892843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e80136f50 msgr2=0x7f7e800c03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 --2- 172.21.15.43:0/2652892843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e80136f50 0x7f7e800c03e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009840 tx=0x7f7e7c009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:16.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 -- 172.21.15.43:0/2652892843 shutdown_connections 2023-08-27T11:28:16.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 --2- 172.21.15.43:0/2652892843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e80136f50 0x7f7e800c03e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 -- 172.21.15.43:0/2652892843 >> 172.21.15.43:0/2652892843 conn(0x7f7e8006a310 msgr2=0x7f7e8006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:16.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 -- 172.21.15.43:0/2652892843 shutdown_connections 2023-08-27T11:28:16.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.459+0000 7f7e875ff700 1 -- 172.21.15.43:0/2652892843 wait complete. 2023-08-27T11:28:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.461+0000 7f7e875ff700 1 Processor -- start 2023-08-27T11:28:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.461+0000 7f7e875ff700 1 -- start start 2023-08-27T11:28:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8006cc00 0x7f7e80156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e80136f50 0x7f7e801e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800703c0 con 0x7f7e80158340 2023-08-27T11:28:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80071fe0 con 0x7f7e8006cc00 2023-08-27T11:28:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.462+0000 7f7e875ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80157510 con 0x7f7e80136f50 2023-08-27T11:28:16.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58320/0 (socket says 172.21.15.43:58320) 2023-08-27T11:28:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 -- 172.21.15.43:0/203313979 learned_addr learned my addr 172.21.15.43:0/203313979 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e8539b700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8006cc00 0x7f7e80156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e84b9a700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e80136f50 0x7f7e801e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 -- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e80136f50 msgr2=0x7f7e801e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e80136f50 0x7f7e801e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 -- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8006cc00 msgr2=0x7f7e80156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8006cc00 0x7f7e80156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 -- 172.21.15.43:0/203313979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0094a0 con 0x7f7e80158340 2023-08-27T11:28:16.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.463+0000 7f7e85b9c700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800cc50 tx=0x7f7e7800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.464+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78003c00 con 0x7f7e80158340 2023-08-27T11:28:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.464+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e78003d60 con 0x7f7e80158340 2023-08-27T11:28:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.464+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800aab0 con 0x7f7e80158340 2023-08-27T11:28:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.464+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e800c28c0 con 0x7f7e80158340 2023-08-27T11:28:16.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.464+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80071d00 con 0x7f7e80158340 2023-08-27T11:28:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.465+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8004ee70 con 0x7f7e80158340 2023-08-27T11:28:16.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.466+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e7800ac10 con 0x7f7e80158340 2023-08-27T11:28:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.467+0000 7f7e75ffb700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 0x7f7e6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.467+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f7e78088500 con 0x7f7e80158340 2023-08-27T11:28:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.467+0000 7f7e8539b700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 0x7f7e6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.467+0000 7f7e8539b700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 0x7f7e6406c5a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000c00 tx=0x7f7e7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.471+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e78053bd0 con 0x7f7e80158340 2023-08-27T11:28:16.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.681+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e800bfae0 con 0x7f7e80158340 2023-08-27T11:28:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.681+0000 7f7e75ffb700 1 -- 172.21.15.43:0/203313979 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e780571f0 con 0x7f7e80158340 2023-08-27T11:28:16.683 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:28:16.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 msgr2=0x7f7e6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 0x7f7e6406c5a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c000c00 tx=0x7f7e7c008030 comp rx=0 tx=0).stop 2023-08-27T11:28:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 msgr2=0x7f7e80130ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800cc50 tx=0x7f7e7800cf60 comp rx=0 tx=0).stop 2023-08-27T11:28:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 shutdown_connections 2023-08-27T11:28:16.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7e6406a0e0 0x7f7e6406c5a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7e80158340 0x7f7e80130ca0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e8006cc00 0x7f7e80156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 --2- 172.21.15.43:0/203313979 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e80136f50 0x7f7e801e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 >> 172.21.15.43:0/203313979 conn(0x7f7e8006a310 msgr2=0x7f7e80132810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:16.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 shutdown_connections 2023-08-27T11:28:16.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.684+0000 7f7e875ff700 1 -- 172.21.15.43:0/203313979 wait complete. 2023-08-27T11:28:16.704 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:28:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.906+0000 7f536b7ff700 1 Processor -- start 2023-08-27T11:28:16.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.907+0000 7f536b7ff700 1 -- start start 2023-08-27T11:28:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f536b7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f53640c7c00 0x7f53640c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f536b7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5364154660 con 0x7f5364151d20 2023-08-27T11:28:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f536b7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5364154940 con 0x7f536406a8e0 2023-08-27T11:28:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f536b7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640c5750 con 0x7f53640c7c00 2023-08-27T11:28:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f53640c7c00 0x7f53640c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f53640c7c00 0x7f53640c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58334/0 (socket says 172.21.15.43:58334) 2023-08-27T11:28:16.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 -- 172.21.15.43:0/2620013795 learned_addr learned my addr 172.21.15.43:0/2620013795 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:16.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f536959b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5364151d20 0x7f53640ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33618/0 (socket says 172.21.15.43:33618) 2023-08-27T11:28:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 -- 172.21.15.43:0/2620013795 >> v1:172.21.15.57:6789/0 conn(0x7f536406a8e0 legacy=0x7f536406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 -- 172.21.15.43:0/2620013795 >> v1:172.21.15.43:6789/0 conn(0x7f5364151d20 legacy=0x7f53640ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f5368d9a700 1 -- 172.21.15.43:0/2620013795 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364154c20 con 0x7f53640c7c00 2023-08-27T11:28:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.908+0000 7f535bfff700 1 -- 172.21.15.43:0/2620013795 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660604686 0 0) 0x7f5364154660 con 0x7f5364151d20 2023-08-27T11:28:16.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.909+0000 7f5368d9a700 1 --2- 172.21.15.43:0/2620013795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53640c7c00 0x7f53640c8110 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5364152140 tx=0x7f5354009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9ceca7a8777313 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.909+0000 7f535bfff700 1 -- 172.21.15.43:0/2620013795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011830 con 0x7f53640c7c00 2023-08-27T11:28:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.909+0000 7f535bfff700 1 -- 172.21.15.43:0/2620013795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354011990 con 0x7f53640c7c00 2023-08-27T11:28:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.909+0000 7f535bfff700 1 -- 172.21.15.43:0/2620013795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354011d20 con 0x7f53640c7c00 2023-08-27T11:28:16.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 -- 172.21.15.43:0/2620013795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53640c7c00 msgr2=0x7f53640c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 --2- 172.21.15.43:0/2620013795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53640c7c00 0x7f53640c8110 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5364152140 tx=0x7f5354009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 -- 172.21.15.43:0/2620013795 shutdown_connections 2023-08-27T11:28:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 --2- 172.21.15.43:0/2620013795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53640c7c00 0x7f53640c8110 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 -- 172.21.15.43:0/2620013795 >> 172.21.15.43:0/2620013795 conn(0x7f53640c9d00 msgr2=0x7f53640ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:16.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 -- 172.21.15.43:0/2620013795 shutdown_connections 2023-08-27T11:28:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.910+0000 7f536b7ff700 1 -- 172.21.15.43:0/2620013795 wait complete. 2023-08-27T11:28:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.911+0000 7f536b7ff700 1 Processor -- start 2023-08-27T11:28:16.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.912+0000 7f536b7ff700 1 -- start start 2023-08-27T11:28:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.912+0000 7f536b7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 0x7f536414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.912+0000 7f536b7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 0x7f53640aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.912+0000 7f536b7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 0x7f5364148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536b7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536414cf40 con 0x7f5364151d20 2023-08-27T11:28:16.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536b7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536414d220 con 0x7f536406a8e0 2023-08-27T11:28:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536b7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c0d40 con 0x7f53640c7c00 2023-08-27T11:28:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f5369d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 0x7f5364148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 0x7f536414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f5368d9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 0x7f53640aa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f5368d9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 0x7f53640aa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:48436/0 (socket says 172.21.15.43:48436) 2023-08-27T11:28:16.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f5368d9a700 1 -- 172.21.15.43:0/986963672 learned_addr learned my addr 172.21.15.43:0/986963672 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:16.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 -- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 msgr2=0x7f53640aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 0x7f53640aa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 -- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 msgr2=0x7f5364148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:16.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 0x7f5364148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f536959b700 1 -- 172.21.15.43:0/986963672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009550 con 0x7f536406a8e0 2023-08-27T11:28:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.913+0000 7f5369d9c700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 0x7f5364148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f536959b700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 0x7f536414e250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f536000c3c0 tx=0x7f536000c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5360004a70 con 0x7f536406a8e0 2023-08-27T11:28:16.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5360004bf0 con 0x7f536406a8e0 2023-08-27T11:28:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53640c1020 con 0x7f536406a8e0 2023-08-27T11:28:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53600070d0 con 0x7f536406a8e0 2023-08-27T11:28:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.914+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640aaf00 con 0x7f536406a8e0 2023-08-27T11:28:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.915+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53640c1540 con 0x7f536406a8e0 2023-08-27T11:28:16.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.916+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5360007230 con 0x7f536406a8e0 2023-08-27T11:28:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.917+0000 7f5359ffb700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 0x7f534806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:16.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.917+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f5360088130 con 0x7f536406a8e0 2023-08-27T11:28:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.917+0000 7f5368d9a700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 0x7f534806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.918+0000 7f5368d9a700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 0x7f534806c5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f536414c090 tx=0x7f5354008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:16.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:16.922+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f53600536d0 con 0x7f536406a8e0 2023-08-27T11:28:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.136+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f536414d360 con 0x7f536406a8e0 2023-08-27T11:28:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.137+0000 7f5359ffb700 1 -- 172.21.15.43:0/986963672 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f536414d360 con 0x7f536406a8e0 2023-08-27T11:28:17.139 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:28:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 msgr2=0x7f534806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 0x7f534806c5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f536414c090 tx=0x7f5354008030 comp rx=0 tx=0).stop 2023-08-27T11:28:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 msgr2=0x7f536414e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 0x7f536414e250 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f536000c3c0 tx=0x7f536000c6d0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 shutdown_connections 2023-08-27T11:28:17.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f534806a0e0 0x7f534806c5a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5364151d20 0x7f5364148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f536406a8e0 0x7f536414e250 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 --2- 172.21.15.43:0/986963672 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53640c7c00 0x7f53640aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 >> 172.21.15.43:0/986963672 conn(0x7f53640c9d00 msgr2=0x7f53640ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 shutdown_connections 2023-08-27T11:28:17.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.140+0000 7f536b7ff700 1 -- 172.21.15.43:0/986963672 wait complete. 2023-08-27T11:28:17.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:28:17.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.363+0000 7f4e44bff700 1 Processor -- start 2023-08-27T11:28:17.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.363+0000 7f4e44bff700 1 -- start start 2023-08-27T11:28:17.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e44bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e40151d20 0x7f4e400c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e44bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e4006a8e0 0x7f4e4006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e44bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e40154660 con 0x7f4e400c7c00 2023-08-27T11:28:17.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e44bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e400c5750 con 0x7f4e40151d20 2023-08-27T11:28:17.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e44bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e40154940 con 0x7f4e4006a8e0 2023-08-27T11:28:17.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e3e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4e40151d20 0x7f4e400c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e37fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4e400c7c00 0x7f4e400ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33622/0 (socket says 172.21.15.43:33622) 2023-08-27T11:28:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.364+0000 7f4e37fff700 1 -- 172.21.15.43:0/2076775138 learned_addr learned my addr 172.21.15.43:0/2076775138 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3ed9d700 1 --2- 172.21.15.43:0/2076775138 >> v2:172.21.15.57:3300/0 conn(0x7f4e4006a8e0 0x7f4e4006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3dd9b700 1 -- 172.21.15.43:0/2076775138 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169166752 0 0) 0x7f4e40154660 con 0x7f4e400c7c00 2023-08-27T11:28:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3e59c700 1 -- 172.21.15.43:0/2076775138 >> v2:172.21.15.57:3300/0 conn(0x7f4e4006a8e0 msgr2=0x7f4e4006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:17.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3e59c700 1 --2- 172.21.15.43:0/2076775138 >> v2:172.21.15.57:3300/0 conn(0x7f4e4006a8e0 0x7f4e4006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3e59c700 1 -- 172.21.15.43:0/2076775138 >> v1:172.21.15.43:6789/0 conn(0x7f4e400c7c00 legacy=0x7f4e400ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3e59c700 1 -- 172.21.15.43:0/2076775138 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e40154c20 con 0x7f4e40151d20 2023-08-27T11:28:17.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3e59c700 1 --2- 172.21.15.43:0/2076775138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e40151d20 0x7f4e400c8110 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4e400c4250 tx=0x7f4e30009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1629567c8f350ddf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3dd9b700 1 -- 172.21.15.43:0/2076775138 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30011830 con 0x7f4e40151d20 2023-08-27T11:28:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3dd9b700 1 -- 172.21.15.43:0/2076775138 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30011990 con 0x7f4e40151d20 2023-08-27T11:28:17.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.365+0000 7f4e3dd9b700 1 -- 172.21.15.43:0/2076775138 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30011d20 con 0x7f4e40151d20 2023-08-27T11:28:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 -- 172.21.15.43:0/2076775138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e40151d20 msgr2=0x7f4e400c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 --2- 172.21.15.43:0/2076775138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e40151d20 0x7f4e400c8110 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4e400c4250 tx=0x7f4e30009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 -- 172.21.15.43:0/2076775138 shutdown_connections 2023-08-27T11:28:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 --2- 172.21.15.43:0/2076775138 >> v2:172.21.15.57:3300/0 conn(0x7f4e4006a8e0 0x7f4e4006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 --2- 172.21.15.43:0/2076775138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e40151d20 0x7f4e400c8110 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 -- 172.21.15.43:0/2076775138 >> 172.21.15.43:0/2076775138 conn(0x7f4e400c9d00 msgr2=0x7f4e400ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 -- 172.21.15.43:0/2076775138 shutdown_connections 2023-08-27T11:28:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.366+0000 7f4e44bff700 1 -- 172.21.15.43:0/2076775138 wait complete. 2023-08-27T11:28:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.368+0000 7f4e44bff700 1 Processor -- start 2023-08-27T11:28:17.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.368+0000 7f4e44bff700 1 -- start start 2023-08-27T11:28:17.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4006a8e0 0x7f4e401eda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 0x7f4e40157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4014d8e0 con 0x7f4e400c7c00 2023-08-27T11:28:17.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401edfb0 con 0x7f4e4006a8e0 2023-08-27T11:28:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e44bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4014eae0 con 0x7f4e40151d20 2023-08-27T11:28:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58356/0 (socket says 172.21.15.43:58356) 2023-08-27T11:28:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e37fff700 1 -- 172.21.15.43:0/3691677665 learned_addr learned my addr 172.21.15.43:0/3691677665 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:17.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e3e59c700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4006a8e0 0x7f4e401eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.369+0000 7f4e3ed9d700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 0x7f4e40157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 -- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 msgr2=0x7f4e40157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 0x7f4e40157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 -- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4006a8e0 msgr2=0x7f4e401eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4006a8e0 0x7f4e401eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 -- 172.21.15.43:0/3691677665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300094a0 con 0x7f4e400c7c00 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e3ed9d700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 0x7f4e40157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e37fff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f4e280011e0 tx=0x7f4e2800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28004c80 con 0x7f4e400c7c00 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28004de0 con 0x7f4e400c7c00 2023-08-27T11:28:17.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4014db30 con 0x7f4e400c7c00 2023-08-27T11:28:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28007310 con 0x7f4e400c7c00 2023-08-27T11:28:17.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.370+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e400aaa50 con 0x7f4e400c7c00 2023-08-27T11:28:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.371+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4004ee70 con 0x7f4e400c7c00 2023-08-27T11:28:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.372+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e28007470 con 0x7f4e400c7c00 2023-08-27T11:28:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.373+0000 7f4e36ffd700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 0x7f4e2006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.373+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f4e280883c0 con 0x7f4e400c7c00 2023-08-27T11:28:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.373+0000 7f4e3e59c700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 0x7f4e2006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.374+0000 7f4e3e59c700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 0x7f4e2006c5d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4e300090b0 tx=0x7f4e3001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.378+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4e28053960 con 0x7f4e400c7c00 2023-08-27T11:28:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.584+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e40154ed0 con 0x7f4e400c7c00 2023-08-27T11:28:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.585+0000 7f4e36ffd700 1 -- 172.21.15.43:0/3691677665 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e28056f80 con 0x7f4e400c7c00 2023-08-27T11:28:17.587 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:28:17.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 msgr2=0x7f4e2006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 0x7f4e2006c5d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4e300090b0 tx=0x7f4e3001c040 comp rx=0 tx=0).stop 2023-08-27T11:28:17.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 msgr2=0x7f4e400aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f4e280011e0 tx=0x7f4e2800ca30 comp rx=0 tx=0).stop 2023-08-27T11:28:17.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 shutdown_connections 2023-08-27T11:28:17.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4e2006a110 0x7f4e2006c5d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4e40151d20 0x7f4e40157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e4006a8e0 0x7f4e401eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 --2- 172.21.15.43:0/3691677665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4e400c7c00 0x7f4e400aa510 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 >> 172.21.15.43:0/3691677665 conn(0x7f4e400c9d00 msgr2=0x7f4e401503d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:17.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 shutdown_connections 2023-08-27T11:28:17.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.587+0000 7f4e44bff700 1 -- 172.21.15.43:0/3691677665 wait complete. 2023-08-27T11:28:17.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:17.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.807+0000 7f8c3cfff700 1 Processor -- start 2023-08-27T11:28:17.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.807+0000 7f8c3cfff700 1 -- start start 2023-08-27T11:28:17.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c3cfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c3cfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c380c4a90 0x7f8c3806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c3cfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3806c4e0 con 0x7f8c380c4630 2023-08-27T11:28:17.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c3cfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c38155370 con 0x7f8c380c4a90 2023-08-27T11:28:17.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c3cfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38151e70 con 0x7f8c38151a90 2023-08-27T11:28:17.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c35d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8c380c4630 0x7f8c3806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33634/0 (socket says 172.21.15.43:33634) 2023-08-27T11:28:17.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.808+0000 7f8c35d9b700 1 -- 172.21.15.43:0/29653843 learned_addr learned my addr 172.21.15.43:0/29653843 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:17.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 --2- 172.21.15.43:0/29653843 >> v2:172.21.15.57:3300/0 conn(0x7f8c380c4a90 0x7f8c3806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c3659c700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c3559a700 1 -- 172.21.15.43:0/29653843 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104892253 0 0) 0x7f8c3806c4e0 con 0x7f8c380c4630 2023-08-27T11:28:17.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c3559a700 1 -- 172.21.15.43:0/29653843 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c200035b0 con 0x7f8c380c4630 2023-08-27T11:28:17.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 -- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 msgr2=0x7f8c380c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:17.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 -- 172.21.15.43:0/29653843 >> v1:172.21.15.43:6789/0 conn(0x7f8c380c4630 legacy=0x7f8c3806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 -- 172.21.15.43:0/29653843 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38154480 con 0x7f8c380c4a90 2023-08-27T11:28:17.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c3659c700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:17.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.809+0000 7f8c36d9d700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4a90 0x7f8c3806b480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009d90 tx=0x7f8c3000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec47ef921c66bab4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3559a700 1 -- 172.21.15.43:0/29653843 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000e070 con 0x7f8c380c4a90 2023-08-27T11:28:17.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3559a700 1 -- 172.21.15.43:0/29653843 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000bb20 con 0x7f8c380c4a90 2023-08-27T11:28:17.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3559a700 1 -- 172.21.15.43:0/29653843 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30012430 con 0x7f8c380c4a90 2023-08-27T11:28:17.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 -- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4a90 msgr2=0x7f8c3806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4a90 0x7f8c3806b480 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009d90 tx=0x7f8c3000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:17.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 -- 172.21.15.43:0/29653843 shutdown_connections 2023-08-27T11:28:17.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4a90 0x7f8c3806b480 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/29653843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 -- 172.21.15.43:0/29653843 >> 172.21.15.43:0/29653843 conn(0x7f8c380ab820 msgr2=0x7f8c380abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:17.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 -- 172.21.15.43:0/29653843 shutdown_connections 2023-08-27T11:28:17.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.810+0000 7f8c3cfff700 1 -- 172.21.15.43:0/29653843 wait complete. 2023-08-27T11:28:17.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.812+0000 7f8c3cfff700 1 Processor -- start 2023-08-27T11:28:17.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.812+0000 7f8c3cfff700 1 -- start start 2023-08-27T11:28:17.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4630 0x7f8c381ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381528b0 con 0x7f8c380c4a90 2023-08-27T11:28:17.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381e9bf0 con 0x7f8c380c4630 2023-08-27T11:28:17.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3cfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381447d0 con 0x7f8c38151a90 2023-08-27T11:28:17.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c35d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c35d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58368/0 (socket says 172.21.15.43:58368) 2023-08-27T11:28:17.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c35d9b700 1 -- 172.21.15.43:0/2181545789 learned_addr learned my addr 172.21.15.43:0/2181545789 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:17.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c3659c700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4630 0x7f8c381ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.813+0000 7f8c36d9d700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 -- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 msgr2=0x7f8c380a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 -- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4630 msgr2=0x7f8c381ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:17.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4630 0x7f8c381ea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:17.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 -- 172.21.15.43:0/2181545789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280094a0 con 0x7f8c380c4a90 2023-08-27T11:28:17.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c35d9b700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c730 tx=0x7f8c2c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c005d70 con 0x7f8c380c4a90 2023-08-27T11:28:17.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c0070d0 con 0x7f8c380c4a90 2023-08-27T11:28:17.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c30009a70 con 0x7f8c380c4a90 2023-08-27T11:28:17.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.814+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c007440 con 0x7f8c380c4a90 2023-08-27T11:28:17.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.815+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c380aaf10 con 0x7f8c380c4a90 2023-08-27T11:28:17.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.815+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3804ee70 con 0x7f8c380c4a90 2023-08-27T11:28:17.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.816+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8c2c0075a0 con 0x7f8c380c4a90 2023-08-27T11:28:17.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.817+0000 7f8c26ffd700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 0x7f8c1806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:17.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.817+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f8c2c087890 con 0x7f8c380c4a90 2023-08-27T11:28:17.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.817+0000 7f8c3659c700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 0x7f8c1806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:17.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.818+0000 7f8c3659c700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 0x7f8c1806c5d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009cd0 tx=0x7f8c28009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:17.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:17.822+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c2c053010 con 0x7f8c380c4a90 2023-08-27T11:28:18.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.074+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3806c130 con 0x7f8c380c4a90 2023-08-27T11:28:18.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.075+0000 7f8c26ffd700 1 -- 172.21.15.43:0/2181545789 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4879 (secure 0 0 0) 0x7f8c2c056630 con 0x7f8c380c4a90 2023-08-27T11:28:18.077 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:18.077 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":121,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:28:12.184654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7195":{"gid":7195,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 msgr2=0x7f8c1806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 0x7f8c1806c5d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009cd0 tx=0x7f8c28009210 comp rx=0 tx=0).stop 2023-08-27T11:28:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 msgr2=0x7f8c38148e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00c730 tx=0x7f8c2c00ca40 comp rx=0 tx=0).stop 2023-08-27T11:28:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 shutdown_connections 2023-08-27T11:28:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c1806a110 0x7f8c1806c5d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c38151a90 0x7f8c380a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c380c4630 0x7f8c381ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 --2- 172.21.15.43:0/2181545789 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c380c4a90 0x7f8c38148e90 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 >> 172.21.15.43:0/2181545789 conn(0x7f8c380ab820 msgr2=0x7f8c380c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 shutdown_connections 2023-08-27T11:28:18.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.077+0000 7f8c3cfff700 1 -- 172.21.15.43:0/2181545789 wait complete. 2023-08-27T11:28:18.082 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 121 2023-08-27T11:28:18.097 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:18.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.297+0000 7f64f4dff700 1 Processor -- start 2023-08-27T11:28:18.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.297+0000 7f64f4dff700 1 -- start start 2023-08-27T11:28:18.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.298+0000 7f64f4dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 0x7f64f00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.298+0000 7f64f4dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f64f00c4630 0x7f64f00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.298+0000 7f64f4dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 0x7f64f006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64f4dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f006c4e0 con 0x7f64f00c4630 2023-08-27T11:28:18.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64f4dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f0155370 con 0x7f64f006ad70 2023-08-27T11:28:18.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64f4dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0151e70 con 0x7f64f0151a90 2023-08-27T11:28:18.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f64f00c4630 0x7f64f00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f64f00c4630 0x7f64f00c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58372/0 (socket says 172.21.15.43:58372) 2023-08-27T11:28:18.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 -- 172.21.15.43:0/3824072321 learned_addr learned my addr 172.21.15.43:0/3824072321 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:18.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 -- 172.21.15.43:0/3824072321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 msgr2=0x7f64f00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:18.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64eed9d700 1 --2- 172.21.15.43:0/3824072321 >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 0x7f64f006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64ee59c700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 0x7f64f00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 0x7f64f00c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 -- 172.21.15.43:0/3824072321 >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 msgr2=0x7f64f006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:18.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 --2- 172.21.15.43:0/3824072321 >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 0x7f64f006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64e7fff700 1 -- 172.21.15.43:0/3824072321 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0154480 con 0x7f64f00c4630 2023-08-27T11:28:18.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64eed9d700 1 --2- 172.21.15.43:0/3824072321 >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 0x7f64f006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:18.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.299+0000 7f64ee59c700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 0x7f64f00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:18.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64e7fff700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f00c4630 0x7f64f00c4a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f64f00bd700 tx=0x7f64d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afebe6929136457 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64edd9b700 1 -- 172.21.15.43:0/3824072321 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800b870 con 0x7f64f00c4630 2023-08-27T11:28:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64edd9b700 1 -- 172.21.15.43:0/3824072321 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d800b9d0 con 0x7f64f00c4630 2023-08-27T11:28:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64edd9b700 1 -- 172.21.15.43:0/3824072321 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800bd60 con 0x7f64f00c4630 2023-08-27T11:28:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64f4dff700 1 -- 172.21.15.43:0/3824072321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f00c4630 msgr2=0x7f64f00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.300+0000 7f64f4dff700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f00c4630 0x7f64f00c4a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f64f00bd700 tx=0x7f64d8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 -- 172.21.15.43:0/3824072321 shutdown_connections 2023-08-27T11:28:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 --2- 172.21.15.43:0/3824072321 >> v2:172.21.15.57:3300/0 conn(0x7f64f006ad70 0x7f64f006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f0151a90 0x7f64f00c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 --2- 172.21.15.43:0/3824072321 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f00c4630 0x7f64f00c4a90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.310 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 -- 172.21.15.43:0/3824072321 >> 172.21.15.43:0/3824072321 conn(0x7f64f00ab820 msgr2=0x7f64f00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:18.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 -- 172.21.15.43:0/3824072321 shutdown_connections 2023-08-27T11:28:18.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.301+0000 7f64f4dff700 1 -- 172.21.15.43:0/3824072321 wait complete. 2023-08-27T11:28:18.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.302+0000 7f64f4dff700 1 Processor -- start 2023-08-27T11:28:18.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.303+0000 7f64f4dff700 1 -- start start 2023-08-27T11:28:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.303+0000 7f64f4dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.303+0000 7f64f4dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f00c4630 0x7f64f01e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.303+0000 7f64f4dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0151a90 0x7f64f01e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.303+0000 7f64f4dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00c0350 con 0x7f64f006ad70 2023-08-27T11:28:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64f4dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0154250 con 0x7f64f0151a90 2023-08-27T11:28:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64f4dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0153f70 con 0x7f64f00c4630 2023-08-27T11:28:18.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58388/0 (socket says 172.21.15.43:58388) 2023-08-27T11:28:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 -- 172.21.15.43:0/4278738843 learned_addr learned my addr 172.21.15.43:0/4278738843 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:18.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 -- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f00c4630 msgr2=0x7f64f01e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f00c4630 0x7f64f01e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 -- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0151a90 msgr2=0x7f64f01e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0151a90 0x7f64f01e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 -- 172.21.15.43:0/4278738843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009550 con 0x7f64f006ad70 2023-08-27T11:28:18.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.304+0000 7f64ee59c700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c7f0 tx=0x7f64e000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.305+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011800 con 0x7f64f006ad70 2023-08-27T11:28:18.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.305+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e0011960 con 0x7f64f006ad70 2023-08-27T11:28:18.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.305+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e0011d10 con 0x7f64f006ad70 2023-08-27T11:28:18.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.305+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f00bdfe0 con 0x7f64f006ad70 2023-08-27T11:28:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.305+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f00be2c0 con 0x7f64f006ad70 2023-08-27T11:28:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.306+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f01ea4a0 con 0x7f64f006ad70 2023-08-27T11:28:18.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.307+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f64e0018360 con 0x7f64f006ad70 2023-08-27T11:28:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.308+0000 7f64e6ffd700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 0x7f64d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.308+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f64e0088560 con 0x7f64f006ad70 2023-08-27T11:28:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.308+0000 7f64e7fff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 0x7f64d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.308+0000 7f64e7fff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 0x7f64d006c5a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64f01eddb0 tx=0x7f64d8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.312+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f64f01ea4a0 con 0x7f64f006ad70 2023-08-27T11:28:18.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.525+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64f00be4b0 con 0x7f64f006ad70 2023-08-27T11:28:18.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.526+0000 7f64e6ffd700 1 -- 172.21.15.43:0/4278738843 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f64e0057620 con 0x7f64f006ad70 2023-08-27T11:28:18.528 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:18.528 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":112,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:09.171014+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6835/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6834/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6837/1939845776":"2023-08-28T11:27:55.101994+0000","172.21.15.43:6836/1939845776":"2023-08-28T11:27:55.101994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:18.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 msgr2=0x7f64d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 0x7f64d006c5a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64f01eddb0 tx=0x7f64d8010000 comp rx=0 tx=0).stop 2023-08-27T11:28:18.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 msgr2=0x7f64f0148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f64e000c7f0 tx=0x7f64e000cbb0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 shutdown_connections 2023-08-27T11:28:18.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f64d006a0e0 0x7f64d006c5a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f0151a90 0x7f64f01e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f64f006ad70 0x7f64f0148a60 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 --2- 172.21.15.43:0/4278738843 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f64f00c4630 0x7f64f01e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 >> 172.21.15.43:0/4278738843 conn(0x7f64f00ab820 msgr2=0x7f64f014d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:18.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 shutdown_connections 2023-08-27T11:28:18.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.528+0000 7f64f4dff700 1 -- 172.21.15.43:0/4278738843 wait complete. 2023-08-27T11:28:18.548 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:28:18.548 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:18.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.748+0000 7ff69fbff700 1 Processor -- start 2023-08-27T11:28:18.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.748+0000 7ff69fbff700 1 -- start start 2023-08-27T11:28:18.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69fbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff698151a90 0x7ff6980c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69fbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69806c4e0 con 0x7ff6980c4a90 2023-08-27T11:28:18.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69fbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff698155370 con 0x7ff6980c4630 2023-08-27T11:28:18.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69fbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff698151e70 con 0x7ff698151a90 2023-08-27T11:28:18.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69d99b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff698151a90 0x7ff6980c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69e19c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff6980c4a90 0x7ff69806b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33642/0 (socket says 172.21.15.43:33642) 2023-08-27T11:28:18.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69e19c700 1 -- 172.21.15.43:0/3075074025 learned_addr learned my addr 172.21.15.43:0/3075074025 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:18.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69c999700 1 -- 172.21.15.43:0/3075074025 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126307259 0 0) 0x7ff69806c4e0 con 0x7ff6980c4a90 2023-08-27T11:28:18.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69d99b700 1 -- 172.21.15.43:0/3075074025 >> v1:172.21.15.57:6789/0 conn(0x7ff6980c4630 legacy=0x7ff69806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69d99b700 1 -- 172.21.15.43:0/3075074025 >> v1:172.21.15.43:6789/0 conn(0x7ff6980c4a90 legacy=0x7ff69806b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.750+0000 7ff69d99b700 1 -- 172.21.15.43:0/3075074025 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698154480 con 0x7ff698151a90 2023-08-27T11:28:18.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69d99b700 1 --2- 172.21.15.43:0/3075074025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff698151a90 0x7ff6980c7bb0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff694009840 tx=0x7ff694009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d809e92f85342452 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69c999700 1 -- 172.21.15.43:0/3075074025 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011830 con 0x7ff698151a90 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69c999700 1 -- 172.21.15.43:0/3075074025 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694011990 con 0x7ff698151a90 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69c999700 1 -- 172.21.15.43:0/3075074025 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011d20 con 0x7ff698151a90 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69fbff700 1 -- 172.21.15.43:0/3075074025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff698151a90 msgr2=0x7ff6980c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.751+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3075074025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff698151a90 0x7ff6980c7bb0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ff694009840 tx=0x7ff694009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.752+0000 7ff69fbff700 1 -- 172.21.15.43:0/3075074025 shutdown_connections 2023-08-27T11:28:18.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.752+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3075074025 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff698151a90 0x7ff6980c7bb0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.752+0000 7ff69fbff700 1 -- 172.21.15.43:0/3075074025 >> 172.21.15.43:0/3075074025 conn(0x7ff6980ab820 msgr2=0x7ff6980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:18.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.752+0000 7ff69fbff700 1 -- 172.21.15.43:0/3075074025 shutdown_connections 2023-08-27T11:28:18.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.752+0000 7ff69fbff700 1 -- 172.21.15.43:0/3075074025 wait complete. 2023-08-27T11:28:18.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.753+0000 7ff69fbff700 1 Processor -- start 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 -- start start 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980c4a90 0x7ff698153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff698151a90 0x7ff6980c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6981ed950 con 0x7ff6980c4630 2023-08-27T11:28:18.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff698153d70 con 0x7ff698151a90 2023-08-27T11:28:18.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.754+0000 7ff69fbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6981ede20 con 0x7ff6980c4a90 2023-08-27T11:28:18.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58392/0 (socket says 172.21.15.43:58392) 2023-08-27T11:28:18.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 -- 172.21.15.43:0/3885866112 learned_addr learned my addr 172.21.15.43:0/3885866112 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:18.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69e19c700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff698151a90 0x7ff6980c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d19a700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980c4a90 0x7ff698153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 -- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980c4a90 msgr2=0x7ff698153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980c4a90 0x7ff698153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 -- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff698151a90 msgr2=0x7ff6980c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:18.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff698151a90 0x7ff6980c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:18.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 -- 172.21.15.43:0/3885866112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940094a0 con 0x7ff6980c4630 2023-08-27T11:28:18.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.755+0000 7ff69d99b700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff694014040 tx=0x7ff694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.756+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69401a7e0 con 0x7ff6980c4630 2023-08-27T11:28:18.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.756+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69401a940 con 0x7ff6980c4630 2023-08-27T11:28:18.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.756+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69401acb0 con 0x7ff6980c4630 2023-08-27T11:28:18.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.756+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6981edb40 con 0x7ff6980c4630 2023-08-27T11:28:18.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.756+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6981e9df0 con 0x7ff6980c4630 2023-08-27T11:28:18.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.757+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69804ee70 con 0x7ff6980c4630 2023-08-27T11:28:18.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.758+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff694022070 con 0x7ff6980c4630 2023-08-27T11:28:18.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.758+0000 7ff68e7fc700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 0x7ff67c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:18.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.759+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7ff6940893b0 con 0x7ff6980c4630 2023-08-27T11:28:18.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.759+0000 7ff69d19a700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 0x7ff67c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:18.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.759+0000 7ff69d19a700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 0x7ff67c06c5a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6981eab30 tx=0x7ff688009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:18.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:18.763+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff694054bb0 con 0x7ff6980c4630 2023-08-27T11:28:19.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.017+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6980caa90 con 0x7ff6980c4630 2023-08-27T11:28:19.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.017+0000 7ff68e7fc700 1 -- 172.21.15.43:0/3885866112 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4879 (secure 0 0 0) 0x7ff6940581d0 con 0x7ff6980c4630 2023-08-27T11:28:19.019 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:19.019 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":121,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:28:12.184654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7195":{"gid":7195,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:19.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.019+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 msgr2=0x7ff67c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.019+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 0x7ff67c06c5a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff6981eab30 tx=0x7ff688009040 comp rx=0 tx=0).stop 2023-08-27T11:28:19.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.019+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 msgr2=0x7ff6981ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.019+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ff694014040 tx=0x7ff694004750 comp rx=0 tx=0).stop 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 shutdown_connections 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67c06a0e0 0x7ff67c06c5a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff698151a90 0x7ff6980c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6980c4630 0x7ff6981ea5f0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 --2- 172.21.15.43:0/3885866112 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6980c4a90 0x7ff698153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 >> 172.21.15.43:0/3885866112 conn(0x7ff6980ab820 msgr2=0x7ff6980c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:19.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 shutdown_connections 2023-08-27T11:28:19.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.020+0000 7ff69fbff700 1 -- 172.21.15.43:0/3885866112 wait complete. 2023-08-27T11:28:19.023 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 121 2023-08-27T11:28:19.040 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:19.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.242+0000 7f508c5ff700 1 Processor -- start 2023-08-27T11:28:19.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.242+0000 7f508c5ff700 1 -- start start 2023-08-27T11:28:19.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5084151a90 0x7f50840c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f50840c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508406c4e0 con 0x7f508406ad70 2023-08-27T11:28:19.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5084155370 con 0x7f5084151a90 2023-08-27T11:28:19.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5084151e70 con 0x7f50840c4630 2023-08-27T11:28:19.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5084151a90 0x7f50840c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5084151a90 0x7f50840c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49342/0 (socket says 172.21.15.43:49342) 2023-08-27T11:28:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 -- 172.21.15.43:0/1657944716 learned_addr learned my addr 172.21.15.43:0/1657944716 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f50840c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 -- 172.21.15.43:0/1657944716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 msgr2=0x7f50840c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:19.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f50840c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 -- 172.21.15.43:0/1657944716 >> v1:172.21.15.57:6789/0 conn(0x7f508406ad70 legacy=0x7f508406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:19.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f508a39b700 1 -- 172.21.15.43:0/1657944716 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084154480 con 0x7f5084151a90 2023-08-27T11:28:19.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.244+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f50840c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:19.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f508a39b700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5084151a90 0x7f50840c7bb0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f50800098f0 tx=0x7f5080009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b7fd9095f2a67d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f5089399700 1 -- 172.21.15.43:0/1657944716 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080004230 con 0x7f5084151a90 2023-08-27T11:28:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f5089399700 1 -- 172.21.15.43:0/1657944716 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080004390 con 0x7f5084151a90 2023-08-27T11:28:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f5089399700 1 -- 172.21.15.43:0/1657944716 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800036a0 con 0x7f5084151a90 2023-08-27T11:28:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f508c5ff700 1 -- 172.21.15.43:0/1657944716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5084151a90 msgr2=0x7f50840c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.245+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5084151a90 0x7f50840c7bb0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f50800098f0 tx=0x7f5080009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:19.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 -- 172.21.15.43:0/1657944716 shutdown_connections 2023-08-27T11:28:19.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5084151a90 0x7f50840c7bb0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1657944716 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f50840c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 -- 172.21.15.43:0/1657944716 >> 172.21.15.43:0/1657944716 conn(0x7f50840ab820 msgr2=0x7f50840abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:19.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 -- 172.21.15.43:0/1657944716 shutdown_connections 2023-08-27T11:28:19.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.246+0000 7f508c5ff700 1 -- 172.21.15.43:0/1657944716 wait complete. 2023-08-27T11:28:19.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.247+0000 7f508c5ff700 1 Processor -- start 2023-08-27T11:28:19.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.247+0000 7f508c5ff700 1 -- start start 2023-08-27T11:28:19.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f5084148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 0x7f50841ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084153da0 con 0x7f508406ad70 2023-08-27T11:28:19.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5084155b00 con 0x7f5084151a90 2023-08-27T11:28:19.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.248+0000 7f508c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50841edcd0 con 0x7f50840c4630 2023-08-27T11:28:19.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49346/0 (socket says 172.21.15.43:49346) 2023-08-27T11:28:19.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 -- 172.21.15.43:0/1677401477 learned_addr learned my addr 172.21.15.43:0/1677401477 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:19.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f5084148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508ab9c700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 0x7f50841ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 -- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 msgr2=0x7f5084148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f5084148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 -- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 msgr2=0x7f50841ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 0x7f50841ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 -- 172.21.15.43:0/1677401477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5080009550 con 0x7f508406ad70 2023-08-27T11:28:19.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f5084148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:19.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508ab9c700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 0x7f50841ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:19.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.249+0000 7f508a39b700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5080009130 tx=0x7f5080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.250+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000b860 con 0x7f508406ad70 2023-08-27T11:28:19.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.250+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508000b9c0 con 0x7f508406ad70 2023-08-27T11:28:19.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.250+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50841edfb0 con 0x7f508406ad70 2023-08-27T11:28:19.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.250+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000bd70 con 0x7f508406ad70 2023-08-27T11:28:19.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.250+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5084149330 con 0x7f508406ad70 2023-08-27T11:28:19.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.251+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50841ea0d0 con 0x7f508406ad70 2023-08-27T11:28:19.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.252+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f508001b440 con 0x7f508406ad70 2023-08-27T11:28:19.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.252+0000 7f507affd700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 0x7f506806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.253+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f5080089ff0 con 0x7f508406ad70 2023-08-27T11:28:19.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.253+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 0x7f506806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.253+0000 7f5089b9a700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 0x7f506806c5a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f508414bd00 tx=0x7f5074008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.257+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50800bc990 con 0x7f508406ad70 2023-08-27T11:28:19.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.513+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50841ea260 con 0x7f508406ad70 2023-08-27T11:28:19.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.513+0000 7f507affd700 1 -- 172.21.15.43:0/1677401477 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4879 (secure 0 0 0) 0x7f508001f090 con 0x7f508406ad70 2023-08-27T11:28:19.515 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:19.515 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":121,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:27:44.512293+0000","modified":"2023-08-27T11:28:12.184654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7195},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7195":{"gid":7195,"name":"b","rank":0,"incarnation":118,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/30396136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":30396136},{"type":"v1","addr":"172.21.15.57:6834","nonce":30396136}]},"join_fscid":8,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-27T11:28:19.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 msgr2=0x7f506806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 0x7f506806c5a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f508414bd00 tx=0x7f5074008040 comp rx=0 tx=0).stop 2023-08-27T11:28:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 msgr2=0x7f5084157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f5080009130 tx=0x7f5080004750 comp rx=0 tx=0).stop 2023-08-27T11:28:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 shutdown_connections 2023-08-27T11:28:19.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f506806a0e0 0x7f506806c5a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5084151a90 0x7f50841ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f508406ad70 0x7f5084157180 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 --2- 172.21.15.43:0/1677401477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50840c4630 0x7f5084148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 >> 172.21.15.43:0/1677401477 conn(0x7f50840ab820 msgr2=0x7f508414b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:19.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 shutdown_connections 2023-08-27T11:28:19.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.516+0000 7f508c5ff700 1 -- 172.21.15.43:0/1677401477 wait complete. 2023-08-27T11:28:19.521 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 121 2023-08-27T11:28:19.535 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:19.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.735+0000 7f94427ff700 1 Processor -- start 2023-08-27T11:28:19.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.735+0000 7f94427ff700 1 -- start start 2023-08-27T11:28:19.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f94427ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f943c0c4630 0x7f943c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f94427ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 0x7f943c06b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f94427ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06c4e0 con 0x7f943c151a90 2023-08-27T11:28:19.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f94427ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c155370 con 0x7f943c0c4630 2023-08-27T11:28:19.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f94427ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c82c0 con 0x7f943c06ad70 2023-08-27T11:28:19.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f943bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f943c151a90 0x7f943c0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42958/0 (socket says 172.21.15.43:42958) 2023-08-27T11:28:19.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f943bfff700 1 -- 172.21.15.43:0/2486579205 learned_addr learned my addr 172.21.15.43:0/2486579205 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f943b7fe700 1 --2- 172.21.15.43:0/2486579205 >> v2:172.21.15.57:3300/0 conn(0x7f943c0c4630 0x7f943c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.736+0000 7f9440d9c700 1 --2- 172.21.15.43:0/2486579205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 0x7f943c06b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f943affd700 1 -- 172.21.15.43:0/2486579205 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842564544 0 0) 0x7f943c06c4e0 con 0x7f943c151a90 2023-08-27T11:28:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f943affd700 1 -- 172.21.15.43:0/2486579205 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94240035b0 con 0x7f943c151a90 2023-08-27T11:28:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f9440d9c700 1 -- 172.21.15.43:0/2486579205 >> v2:172.21.15.57:3300/0 conn(0x7f943c0c4630 msgr2=0x7f943c0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f9440d9c700 1 --2- 172.21.15.43:0/2486579205 >> v2:172.21.15.57:3300/0 conn(0x7f943c0c4630 0x7f943c0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f9440d9c700 1 -- 172.21.15.43:0/2486579205 >> v1:172.21.15.43:6789/0 conn(0x7f943c151a90 legacy=0x7f943c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f9440d9c700 1 -- 172.21.15.43:0/2486579205 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c151e70 con 0x7f943c06ad70 2023-08-27T11:28:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.737+0000 7f9440d9c700 1 --2- 172.21.15.43:0/2486579205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 0x7f943c06b200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9434009d90 tx=0x7f943400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f29a6ae72922f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f943affd700 1 -- 172.21.15.43:0/2486579205 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943400e070 con 0x7f943c06ad70 2023-08-27T11:28:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f943affd700 1 -- 172.21.15.43:0/2486579205 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943400bb20 con 0x7f943c06ad70 2023-08-27T11:28:19.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f943affd700 1 -- 172.21.15.43:0/2486579205 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434012430 con 0x7f943c06ad70 2023-08-27T11:28:19.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 -- 172.21.15.43:0/2486579205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 msgr2=0x7f943c06b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 --2- 172.21.15.43:0/2486579205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 0x7f943c06b200 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9434009d90 tx=0x7f943400b330 comp rx=0 tx=0).stop 2023-08-27T11:28:19.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 -- 172.21.15.43:0/2486579205 shutdown_connections 2023-08-27T11:28:19.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 --2- 172.21.15.43:0/2486579205 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c06ad70 0x7f943c06b200 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 --2- 172.21.15.43:0/2486579205 >> v2:172.21.15.57:3300/0 conn(0x7f943c0c4630 0x7f943c0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 -- 172.21.15.43:0/2486579205 >> 172.21.15.43:0/2486579205 conn(0x7f943c0ab820 msgr2=0x7f943c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:19.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 -- 172.21.15.43:0/2486579205 shutdown_connections 2023-08-27T11:28:19.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.738+0000 7f94427ff700 1 -- 172.21.15.43:0/2486579205 wait complete. 2023-08-27T11:28:19.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.740+0000 7f94427ff700 1 Processor -- start 2023-08-27T11:28:19.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.740+0000 7f94427ff700 1 -- start start 2023-08-27T11:28:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ad70 0x7f943c0c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c151a90 0x7f943c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c156f50 con 0x7f943c0c4630 2023-08-27T11:28:19.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c158030 con 0x7f943c06ad70 2023-08-27T11:28:19.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f94427ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c1eac70 con 0x7f943c151a90 2023-08-27T11:28:19.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f943b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f943b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49356/0 (socket says 172.21.15.43:49356) 2023-08-27T11:28:19.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.741+0000 7f943b7fe700 1 -- 172.21.15.43:0/3820416512 learned_addr learned my addr 172.21.15.43:0/3820416512 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:19.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943bfff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ad70 0x7f943c0c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f9440d9c700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c151a90 0x7f943c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 -- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c151a90 msgr2=0x7f943c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c151a90 0x7f943c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 -- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ad70 msgr2=0x7f943c0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ad70 0x7f943c0c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 -- 172.21.15.43:0/3820416512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009a70 con 0x7f943c0c4630 2023-08-27T11:28:19.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f943b7fe700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9b0 tx=0x7f943000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430009710 con 0x7f943c0c4630 2023-08-27T11:28:19.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000c850 con 0x7f943c0c4630 2023-08-27T11:28:19.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c158820 con 0x7f943c0c4630 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000cbc0 con 0x7f943c0c4630 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.742+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0c0fb0 con 0x7f943c0c4630 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.743+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0c1140 con 0x7f943c0c4630 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.744+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f943000cd20 con 0x7f943c0c4630 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.745+0000 7f9438ff9700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 0x7f942806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:19.751 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.745+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f9430088590 con 0x7f943c0c4630 2023-08-27T11:28:19.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.745+0000 7f943bfff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 0x7f942806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:19.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.746+0000 7f943bfff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 0x7f942806c5a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f942c0011e0 tx=0x7f942c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:19.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.750+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f94300576f0 con 0x7f943c0c4630 2023-08-27T11:28:19.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.963+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f943c04ee70 con 0x7f943c0c4630 2023-08-27T11:28:19.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.964+0000 7f9438ff9700 1 -- 172.21.15.43:0/3820416512 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f9430057280 con 0x7f943c0c4630 2023-08-27T11:28:19.966 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:19.966 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":112,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:09.171014+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:27:42.835660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-27T11:27:43.484816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6835/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6834/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6837/1939845776":"2023-08-28T11:27:55.101994+0000","172.21.15.43:6836/1939845776":"2023-08-28T11:27:55.101994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:19.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 msgr2=0x7f942806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 0x7f942806c5a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f942c0011e0 tx=0x7f942c009040 comp rx=0 tx=0).stop 2023-08-27T11:28:19.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 msgr2=0x7f943c1534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:19.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9b0 tx=0x7f943000ed70 comp rx=0 tx=0).stop 2023-08-27T11:28:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 shutdown_connections 2023-08-27T11:28:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942806a0e0 0x7f942806c5a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c151a90 0x7f943c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ad70 0x7f943c0c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 --2- 172.21.15.43:0/3820416512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c4630 0x7f943c1534b0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:19.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 >> 172.21.15.43:0/3820416512 conn(0x7f943c0ab820 msgr2=0x7f943c150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:19.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.966+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 shutdown_connections 2023-08-27T11:28:19.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:19.967+0000 7f94427ff700 1 -- 172.21.15.43:0/3820416512 wait complete. 2023-08-27T11:28:19.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:28:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.186+0000 7f76e81ff700 1 Processor -- start 2023-08-27T11:28:20.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.186+0000 7f76e81ff700 1 -- start start 2023-08-27T11:28:20.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e81ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f76e0154740 0x7f76e00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e81ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0154d00 con 0x7f76e00c50d0 2023-08-27T11:28:20.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e81ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e0154fe0 con 0x7f76e014e960 2023-08-27T11:28:20.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e81ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e00baf30 con 0x7f76e0154740 2023-08-27T11:28:20.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e579a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f76e00c50d0 0x7f76e00c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42972/0 (socket says 172.21.15.43:42972) 2023-08-27T11:28:20.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e579a700 1 -- 172.21.15.43:0/2857110536 learned_addr learned my addr 172.21.15.43:0/2857110536 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:20.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e679c700 1 --2- 172.21.15.43:0/2857110536 >> v2:172.21.15.43:3300/0 conn(0x7f76e0154740 0x7f76e00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601151715 0 0) 0x7f76e0154d00 con 0x7f76e00c50d0 2023-08-27T11:28:20.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc0057c0 con 0x7f76e00c50d0 2023-08-27T11:28:20.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764843749 0 0) 0x7f76e0154fe0 con 0x7f76e014e960 2023-08-27T11:28:20.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e679c700 1 -- 172.21.15.43:0/2857110536 >> v1:172.21.15.57:6789/0 conn(0x7f76e014e960 legacy=0x7f76e00a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e679c700 1 -- 172.21.15.43:0/2857110536 >> v1:172.21.15.43:6789/0 conn(0x7f76e00c50d0 legacy=0x7f76e00c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.188+0000 7f76e679c700 1 -- 172.21.15.43:0/2857110536 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e01552c0 con 0x7f76e0154740 2023-08-27T11:28:20.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e679c700 1 --2- 172.21.15.43:0/2857110536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e0154740 0x7f76e00c43d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009d90 tx=0x7f76d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb95e8668f4e7f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800e070 con 0x7f76e0154740 2023-08-27T11:28:20.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d800bb20 con 0x7f76e0154740 2023-08-27T11:28:20.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e4f99700 1 -- 172.21.15.43:0/2857110536 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d800bed0 con 0x7f76e0154740 2023-08-27T11:28:20.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e81ff700 1 -- 172.21.15.43:0/2857110536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e0154740 msgr2=0x7f76e00c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.189+0000 7f76e81ff700 1 --2- 172.21.15.43:0/2857110536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e0154740 0x7f76e00c43d0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009d90 tx=0x7f76d800b330 comp rx=0 tx=0).stop 2023-08-27T11:28:20.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.190+0000 7f76e81ff700 1 -- 172.21.15.43:0/2857110536 shutdown_connections 2023-08-27T11:28:20.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.190+0000 7f76e81ff700 1 --2- 172.21.15.43:0/2857110536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e0154740 0x7f76e00c43d0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.190+0000 7f76e81ff700 1 -- 172.21.15.43:0/2857110536 >> 172.21.15.43:0/2857110536 conn(0x7f76e006aa50 msgr2=0x7f76e00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:20.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.190+0000 7f76e81ff700 1 -- 172.21.15.43:0/2857110536 shutdown_connections 2023-08-27T11:28:20.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.190+0000 7f76e81ff700 1 -- 172.21.15.43:0/2857110536 wait complete. 2023-08-27T11:28:20.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.191+0000 7f76e81ff700 1 Processor -- start 2023-08-27T11:28:20.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.192+0000 7f76e81ff700 1 -- start start 2023-08-27T11:28:20.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.192+0000 7f76e81ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.192+0000 7f76e81ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76e014e960 0x7f76e014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.192+0000 7f76e81ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e0154740 0x7f76e01e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e81ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00ab330 con 0x7f76e00c50d0 2023-08-27T11:28:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e81ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e01e9430 con 0x7f76e0154740 2023-08-27T11:28:20.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e81ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00a9a10 con 0x7f76e014e960 2023-08-27T11:28:20.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49370/0 (socket says 172.21.15.43:49370) 2023-08-27T11:28:20.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 -- 172.21.15.43:0/1743470732 learned_addr learned my addr 172.21.15.43:0/1743470732 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:20.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e579a700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76e014e960 0x7f76e014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e679c700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e0154740 0x7f76e01e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 -- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76e014e960 msgr2=0x7f76e014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76e014e960 0x7f76e014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 -- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e0154740 msgr2=0x7f76e01e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e0154740 0x7f76e01e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 -- 172.21.15.43:0/1743470732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d8009a70 con 0x7f76e00c50d0 2023-08-27T11:28:20.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.193+0000 7f76e5f9b700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0011e0 tx=0x7f76dc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.194+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0054e0 con 0x7f76e00c50d0 2023-08-27T11:28:20.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.194+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc003680 con 0x7f76e00c50d0 2023-08-27T11:28:20.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.194+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc003a30 con 0x7f76e00c50d0 2023-08-27T11:28:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.194+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e00a9cf0 con 0x7f76e00c50d0 2023-08-27T11:28:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.194+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e00aa2b0 con 0x7f76e00c50d0 2023-08-27T11:28:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.195+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e00c4890 con 0x7f76e00c50d0 2023-08-27T11:28:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.196+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76dc003b90 con 0x7f76e00c50d0 2023-08-27T11:28:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.197+0000 7f76d67fc700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 0x7f76c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.197+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6234+0+0 (secure 0 0 0) 0x7f76dc087a70 con 0x7f76e00c50d0 2023-08-27T11:28:20.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.197+0000 7f76e579a700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 0x7f76c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.198+0000 7f76e579a700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 0x7f76c406c5a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f76e006d270 tx=0x7f76d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.201+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f76dc0530a0 con 0x7f76e00c50d0 2023-08-27T11:28:20.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.460+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f76e004ee70 con 0x7f76e00c50d0 2023-08-27T11:28:20.462 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:28:20.461+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:28:20.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.465+0000 7f76d67fc700 1 -- 172.21.15.43:0/1743470732 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v122) v1 ==== 161+0+0 (secure 0 0 0) 0x7f76dc017090 con 0x7f76e00c50d0 2023-08-27T11:28:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 msgr2=0x7f76c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 0x7f76c406c5a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f76e006d270 tx=0x7f76d0009040 comp rx=0 tx=0).stop 2023-08-27T11:28:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 msgr2=0x7f76e006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0011e0 tx=0x7f76dc00ca30 comp rx=0 tx=0).stop 2023-08-27T11:28:20.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 shutdown_connections 2023-08-27T11:28:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f76c406a0e0 0x7f76c406c5a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76e0154740 0x7f76e01e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f76e00c50d0 0x7f76e006c970 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 --2- 172.21.15.43:0/1743470732 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76e014e960 0x7f76e014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 >> 172.21.15.43:0/1743470732 conn(0x7f76e006aa50 msgr2=0x7f76e014dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.468+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 shutdown_connections 2023-08-27T11:28:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.469+0000 7f76e81ff700 1 -- 172.21.15.43:0/1743470732 wait complete. 2023-08-27T11:28:20.472 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:28:20.474 INFO:tasks.ceph.mds.b.smithi057.stderr: -147> 2023-08-27T11:28:14.965+0000 7fce85bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:28:20.489 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:28:20.519 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:28:20.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.690+0000 7fc803dff700 1 Processor -- start 2023-08-27T11:28:20.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.690+0000 7fc803dff700 1 -- start start 2023-08-27T11:28:20.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc803dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 0x7fc7fc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc803dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc7fc0c4630 0x7fc7fc0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc803dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc06c450 con 0x7fc7fc06ad70 2023-08-27T11:28:20.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc803dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc151f00 con 0x7fc7fc0c4630 2023-08-27T11:28:20.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc803dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc154760 con 0x7fc7fc151b20 2023-08-27T11:28:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc80239c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc7fc06ad70 0x7fc7fc06b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42978/0 (socket says 172.21.15.43:42978) 2023-08-27T11:28:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.691+0000 7fc80239c700 1 -- 172.21.15.43:0/1656983014 learned_addr learned my addr 172.21.15.43:0/1656983014 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc80139a700 1 --2- 172.21.15.43:0/1656983014 >> v2:172.21.15.57:3300/0 conn(0x7fc7fc0c4630 0x7fc7fc0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 --2- 172.21.15.43:0/1656983014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 0x7fc7fc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc800b99700 1 -- 172.21.15.43:0/1656983014 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496017475 0 0) 0x7fc7fc06c450 con 0x7fc7fc06ad70 2023-08-27T11:28:20.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc800b99700 1 -- 172.21.15.43:0/1656983014 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e80035b0 con 0x7fc7fc06ad70 2023-08-27T11:28:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 -- 172.21.15.43:0/1656983014 >> v2:172.21.15.57:3300/0 conn(0x7fc7fc0c4630 msgr2=0x7fc7fc0c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 --2- 172.21.15.43:0/1656983014 >> v2:172.21.15.57:3300/0 conn(0x7fc7fc0c4630 0x7fc7fc0c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 -- 172.21.15.43:0/1656983014 >> v1:172.21.15.43:6789/0 conn(0x7fc7fc06ad70 legacy=0x7fc7fc06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 -- 172.21.15.43:0/1656983014 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc154a40 con 0x7fc7fc151b20 2023-08-27T11:28:20.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.692+0000 7fc801b9b700 1 --2- 172.21.15.43:0/1656983014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 0x7fc7fc0c7bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009840 tx=0x7fc7f8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1e1f24d4a655cf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc800b99700 1 -- 172.21.15.43:0/1656983014 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011830 con 0x7fc7fc151b20 2023-08-27T11:28:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc800b99700 1 -- 172.21.15.43:0/1656983014 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8011990 con 0x7fc7fc151b20 2023-08-27T11:28:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc800b99700 1 -- 172.21.15.43:0/1656983014 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011d20 con 0x7fc7fc151b20 2023-08-27T11:28:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 -- 172.21.15.43:0/1656983014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 msgr2=0x7fc7fc0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 --2- 172.21.15.43:0/1656983014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 0x7fc7fc0c7bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009840 tx=0x7fc7f8009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 -- 172.21.15.43:0/1656983014 shutdown_connections 2023-08-27T11:28:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 --2- 172.21.15.43:0/1656983014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc151b20 0x7fc7fc0c7bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 --2- 172.21.15.43:0/1656983014 >> v2:172.21.15.57:3300/0 conn(0x7fc7fc0c4630 0x7fc7fc0c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 -- 172.21.15.43:0/1656983014 >> 172.21.15.43:0/1656983014 conn(0x7fc7fc0ab820 msgr2=0x7fc7fc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:20.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 -- 172.21.15.43:0/1656983014 shutdown_connections 2023-08-27T11:28:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.693+0000 7fc803dff700 1 -- 172.21.15.43:0/1656983014 wait complete. 2023-08-27T11:28:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.695+0000 7fc803dff700 1 Processor -- start 2023-08-27T11:28:20.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.695+0000 7fc803dff700 1 -- start start 2023-08-27T11:28:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc06ad70 0x7fc7fc14c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7fc0c4630 0x7fc7fc0aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc1e7650 con 0x7fc7fc151b20 2023-08-27T11:28:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0c14c0 con 0x7fc7fc0c4630 2023-08-27T11:28:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc803dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0c3c30 con 0x7fc7fc06ad70 2023-08-27T11:28:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc80239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc80239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49376/0 (socket says 172.21.15.43:49376) 2023-08-27T11:28:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.696+0000 7fc80239c700 1 -- 172.21.15.43:0/3551844773 learned_addr learned my addr 172.21.15.43:0/3551844773 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc801b9b700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc06ad70 0x7fc7fc14c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80139a700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7fc0c4630 0x7fc7fc0aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 -- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc06ad70 msgr2=0x7fc7fc14c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.704 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc06ad70 0x7fc7fc14c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 -- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7fc0c4630 msgr2=0x7fc7fc0aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:20.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7fc0c4630 0x7fc7fc0aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:20.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 -- 172.21.15.43:0/3551844773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80094a0 con 0x7fc7fc151b20 2023-08-27T11:28:20.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc80239c700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400caa0 tx=0x7fc7f400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f400a980 con 0x7fc7fc151b20 2023-08-27T11:28:20.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f400aae0 con 0x7fc7fc151b20 2023-08-27T11:28:20.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc0c0f00 con 0x7fc7fc151b20 2023-08-27T11:28:20.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.697+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f400ae70 con 0x7fc7fc151b20 2023-08-27T11:28:20.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.698+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc14f4c0 con 0x7fc7fc151b20 2023-08-27T11:28:20.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.699+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc04ee70 con 0x7fc7fc151b20 2023-08-27T11:28:20.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.699+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc7f401b3b0 con 0x7fc7fc151b20 2023-08-27T11:28:20.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.701+0000 7fc7f27fc700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 0x7fc7e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:20.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.701+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fc7f4088390 con 0x7fc7fc151b20 2023-08-27T11:28:20.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.701+0000 7fc801b9b700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 0x7fc7e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:20.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.702+0000 7fc801b9b700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 0x7fc7e006c5a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000c00 tx=0x7fc7f801d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:20.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.705+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc7f4053900 con 0x7fc7fc151b20 2023-08-27T11:28:20.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:20.967+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc7fc0c8b10 con 0x7fc7fc151b20 2023-08-27T11:28:21.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.466+0000 7fc7f27fc700 1 -- 172.21.15.43:0/3551844773 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v123) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc7f4056f20 con 0x7fc7fc151b20 2023-08-27T11:28:21.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 msgr2=0x7fc7e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 0x7fc7e006c5a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000c00 tx=0x7fc7f801d040 comp rx=0 tx=0).stop 2023-08-27T11:28:21.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 msgr2=0x7fc7fc14fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400caa0 tx=0x7fc7f400cdb0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 shutdown_connections 2023-08-27T11:28:21.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc7e006a0e0 0x7fc7e006c5a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc7fc151b20 0x7fc7fc14fcc0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7fc06ad70 0x7fc7fc14c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 --2- 172.21.15.43:0/3551844773 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7fc0c4630 0x7fc7fc0aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.469+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 >> 172.21.15.43:0/3551844773 conn(0x7fc7fc0ab820 msgr2=0x7fc7fc06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:21.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.470+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 shutdown_connections 2023-08-27T11:28:21.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.470+0000 7fc803dff700 1 -- 172.21.15.43:0/3551844773 wait complete. 2023-08-27T11:28:21.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:28:21.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.698+0000 7feec0dff700 1 Processor -- start 2023-08-27T11:28:21.700 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.698+0000 7feec0dff700 1 -- start start 2023-08-27T11:28:21.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.699+0000 7feec0dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7feebc151a40 0x7feebc0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.701 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.699+0000 7feec0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc06bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.699+0000 7feec0dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc154730 con 0x7feebc0c81c0 2023-08-27T11:28:21.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.699+0000 7feec0dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc154520 con 0x7feebc151a40 2023-08-27T11:28:21.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.699+0000 7feec0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc154a10 con 0x7feebc06b780 2023-08-27T11:28:21.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeb9d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feebc0c81c0 0x7feebc0c4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42992/0 (socket says 172.21.15.43:42992) 2023-08-27T11:28:21.702 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeb9d9b700 1 -- 172.21.15.43:0/2262461846 learned_addr learned my addr 172.21.15.43:0/2262461846 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:21.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeba59c700 1 --2- 172.21.15.43:0/2262461846 >> v2:172.21.15.57:3300/0 conn(0x7feebc151a40 0x7feebc0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feebad9d700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc06bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeb959a700 1 -- 172.21.15.43:0/2262461846 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376757647 0 0) 0x7feebc154730 con 0x7feebc0c81c0 2023-08-27T11:28:21.703 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeb959a700 1 -- 172.21.15.43:0/2262461846 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea40035b0 con 0x7feebc0c81c0 2023-08-27T11:28:21.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeba59c700 1 -- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 msgr2=0x7feebc06bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:21.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeba59c700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc06bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeba59c700 1 -- 172.21.15.43:0/2262461846 >> v1:172.21.15.43:6789/0 conn(0x7feebc0c81c0 legacy=0x7feebc0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.705 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feeba59c700 1 -- 172.21.15.43:0/2262461846 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc154cf0 con 0x7feebc151a40 2023-08-27T11:28:21.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.700+0000 7feebad9d700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:21.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.701+0000 7feeba59c700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c7c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7feebc154660 tx=0x7feeac009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139c46cca3677261 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:21.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.701+0000 7feeb959a700 1 -- 172.21.15.43:0/2262461846 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac004020 con 0x7feebc151a40 2023-08-27T11:28:21.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.701+0000 7feeb959a700 1 -- 172.21.15.43:0/2262461846 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac004180 con 0x7feebc151a40 2023-08-27T11:28:21.706 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.701+0000 7feeb959a700 1 -- 172.21.15.43:0/2262461846 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac004530 con 0x7feebc151a40 2023-08-27T11:28:21.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 -- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 msgr2=0x7feebc0c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c7c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7feebc154660 tx=0x7feeac009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:21.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 -- 172.21.15.43:0/2262461846 shutdown_connections 2023-08-27T11:28:21.707 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc06bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 --2- 172.21.15.43:0/2262461846 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c7c80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 -- 172.21.15.43:0/2262461846 >> 172.21.15.43:0/2262461846 conn(0x7feebc0ab890 msgr2=0x7feebc0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 -- 172.21.15.43:0/2262461846 shutdown_connections 2023-08-27T11:28:21.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.702+0000 7feec0dff700 1 -- 172.21.15.43:0/2262461846 wait complete. 2023-08-27T11:28:21.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.704+0000 7feec0dff700 1 Processor -- start 2023-08-27T11:28:21.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.704+0000 7feec0dff700 1 -- start start 2023-08-27T11:28:21.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc1ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.711 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1edb50 con 0x7feebc0c81c0 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc153c60 con 0x7feebc151a40 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feec0dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1e7500 con 0x7feebc06b780 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49382/0 (socket says 172.21.15.43:49382) 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 -- 172.21.15.43:0/3794001922 learned_addr learned my addr 172.21.15.43:0/3794001922 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:21.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeba59c700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc1ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feebad9d700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 -- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 msgr2=0x7feebc1ecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc1ecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 -- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 msgr2=0x7feebc0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:21.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:21.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feeb9d9b700 1 -- 172.21.15.43:0/3794001922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009a70 con 0x7feebc0c81c0 2023-08-27T11:28:21.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.706+0000 7feebad9d700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:21.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feeb9d9b700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c700 tx=0x7feeb000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:21.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0005d70 con 0x7feebc0c81c0 2023-08-27T11:28:21.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00070d0 con 0x7feebc0c81c0 2023-08-27T11:28:21.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0007440 con 0x7feebc0c81c0 2023-08-27T11:28:21.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac0094a0 con 0x7feebc0c81c0 2023-08-27T11:28:21.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.707+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1ed870 con 0x7feebc0c81c0 2023-08-27T11:28:21.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.708+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc0ae490 con 0x7feebc0c81c0 2023-08-27T11:28:21.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.709+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feeb00075a0 con 0x7feebc0c81c0 2023-08-27T11:28:21.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.710+0000 7feeaaffd700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 0x7fee9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:21.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.710+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6320+0+0 (secure 0 0 0) 0x7feeb00879f0 con 0x7feebc0c81c0 2023-08-27T11:28:21.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.710+0000 7feeba59c700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 0x7fee9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:21.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.711+0000 7feeba59c700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 0x7fee9c06c5a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7feeac000c00 tx=0x7feeac01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:21.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.714+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feeb00530a0 con 0x7feebc0c81c0 2023-08-27T11:28:21.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:21.923+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feebc0abef0 con 0x7feebc0c81c0 2023-08-27T11:28:22.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.469+0000 7feeaaffd700 1 -- 172.21.15.43:0/3794001922 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) v1 ==== 181+0+0 (secure 0 0 0) 0x7feeb00566c0 con 0x7feebc0c81c0 2023-08-27T11:28:22.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 msgr2=0x7fee9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 0x7fee9c06c5a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7feeac000c00 tx=0x7feeac01c040 comp rx=0 tx=0).stop 2023-08-27T11:28:22.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 msgr2=0x7feebc0c3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c700 tx=0x7feeb000ca10 comp rx=0 tx=0).stop 2023-08-27T11:28:22.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 shutdown_connections 2023-08-27T11:28:22.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fee9c06a0e0 0x7fee9c06c5a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feebc151a40 0x7feebc0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feebc06b780 0x7feebc1ecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 --2- 172.21.15.43:0/3794001922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feebc0c81c0 0x7feebc0c3450 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.473+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 >> 172.21.15.43:0/3794001922 conn(0x7feebc0ab890 msgr2=0x7feebc06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:22.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.474+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 shutdown_connections 2023-08-27T11:28:22.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.474+0000 7feec0dff700 1 -- 172.21.15.43:0/3794001922 wait complete. 2023-08-27T11:28:22.478 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:28:22.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:28:22.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.710+0000 7f6250bff700 1 Processor -- start 2023-08-27T11:28:22.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.710+0000 7f6250bff700 1 -- start start 2023-08-27T11:28:22.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.711+0000 7f6250bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f624c151a40 0x7f624c0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.711+0000 7f6250bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f6250bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c154730 con 0x7f624c0c4c40 2023-08-27T11:28:22.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f6250bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c154520 con 0x7f624c151a40 2023-08-27T11:28:22.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f6250bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c154a10 con 0x7f624c0c81c0 2023-08-27T11:28:22.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f624c151a40 0x7f624c0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f624c0c4c40 0x7f624c06b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43006/0 (socket says 172.21.15.43:43006) 2023-08-27T11:28:22.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f624c151a40 0x7f624c0c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49396/0 (socket says 172.21.15.43:49396) 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624ad9d700 1 -- 172.21.15.43:0/1167084667 learned_addr learned my addr 172.21.15.43:0/1167084667 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f6243fff700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 -- 172.21.15.43:0/1167084667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 msgr2=0x7f624c0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 -- 172.21.15.43:0/1167084667 >> v1:172.21.15.43:6789/0 conn(0x7f624c0c4c40 legacy=0x7f624c06b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f624a59c700 1 -- 172.21.15.43:0/1167084667 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c154cf0 con 0x7f624c151a40 2023-08-27T11:28:22.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.712+0000 7f6249d9b700 1 -- 172.21.15.43:0/1167084667 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531293991 0 0) 0x7f624c154730 con 0x7f624c0c4c40 2023-08-27T11:28:22.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f624a59c700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c151a40 0x7f624c0c7c80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f623c009840 tx=0x7f623c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9facf2bda837d441 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:22.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f6249d9b700 1 -- 172.21.15.43:0/1167084667 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011830 con 0x7f624c151a40 2023-08-27T11:28:22.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f6249d9b700 1 -- 172.21.15.43:0/1167084667 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c011990 con 0x7f624c151a40 2023-08-27T11:28:22.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f6249d9b700 1 -- 172.21.15.43:0/1167084667 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c011d20 con 0x7f624c151a40 2023-08-27T11:28:22.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f6250bff700 1 -- 172.21.15.43:0/1167084667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c151a40 msgr2=0x7f624c0c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.713+0000 7f6250bff700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c151a40 0x7f624c0c7c80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f623c009840 tx=0x7f623c009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:22.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 -- 172.21.15.43:0/1167084667 shutdown_connections 2023-08-27T11:28:22.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c151a40 0x7f624c0c7c80 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 --2- 172.21.15.43:0/1167084667 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 -- 172.21.15.43:0/1167084667 >> 172.21.15.43:0/1167084667 conn(0x7f624c0ab890 msgr2=0x7f624c0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:22.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 -- 172.21.15.43:0/1167084667 shutdown_connections 2023-08-27T11:28:22.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.714+0000 7f6250bff700 1 -- 172.21.15.43:0/1167084667 wait complete. 2023-08-27T11:28:22.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.715+0000 7f6250bff700 1 Processor -- start 2023-08-27T11:28:22.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.715+0000 7f6250bff700 1 -- start start 2023-08-27T11:28:22.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f624c151a40 0x7f624c1ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0c3bf0 con 0x7f624c0c4c40 2023-08-27T11:28:22.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14d1a0 con 0x7f624c151a40 2023-08-27T11:28:22.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.716+0000 7f6250bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c14dde0 con 0x7f624c0c81c0 2023-08-27T11:28:22.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49404/0 (socket says 172.21.15.43:49404) 2023-08-27T11:28:22.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 -- 172.21.15.43:0/3324692978 learned_addr learned my addr 172.21.15.43:0/3324692978 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:22.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f6243fff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624ad9d700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f624c151a40 0x7f624c1ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 -- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 msgr2=0x7f624c0c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 -- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f624c151a40 msgr2=0x7f624c1ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f624c151a40 0x7f624c1ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 -- 172.21.15.43:0/3324692978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c0094a0 con 0x7f624c0c4c40 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.717+0000 7f624a59c700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f623c014040 tx=0x7f623c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.718+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0038a0 con 0x7f624c0c4c40 2023-08-27T11:28:22.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.718+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c01e070 con 0x7f624c0c4c40 2023-08-27T11:28:22.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.718+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c003c20 con 0x7f624c0c4c40 2023-08-27T11:28:22.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.718+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c14e0c0 con 0x7f624c0c4c40 2023-08-27T11:28:22.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.718+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c14e680 con 0x7f624c0c4c40 2023-08-27T11:28:22.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.719+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c04ee70 con 0x7f624c0c4c40 2023-08-27T11:28:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.720+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f623c02d450 con 0x7f624c0c4c40 2023-08-27T11:28:22.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.720+0000 7f6242ffd700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 0x7f622c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.720+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5882+0+0 (secure 0 0 0) 0x7f623c0895e0 con 0x7f624c0c4c40 2023-08-27T11:28:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.721+0000 7f6243fff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 0x7f622c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.721+0000 7f6243fff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 0x7f622c06c5a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f624c1527f0 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:22.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.725+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f623c054d70 con 0x7f624c0c4c40 2023-08-27T11:28:22.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:22.938+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f624c0c0b60 con 0x7f624c0c4c40 2023-08-27T11:28:23.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.930+0000 7f6242ffd700 1 -- 172.21.15.43:0/3324692978 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) v1 ==== 169+0+0 (secure 0 0 0) 0x7f623c058390 con 0x7f624c0c4c40 2023-08-27T11:28:23.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 msgr2=0x7f622c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:23.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 0x7f622c06c5a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f624c1527f0 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-08-27T11:28:23.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 msgr2=0x7f624c0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:23.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f623c014040 tx=0x7f623c004750 comp rx=0 tx=0).stop 2023-08-27T11:28:23.937 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 shutdown_connections 2023-08-27T11:28:23.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f622c06a0e0 0x7f622c06c5a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:23.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f624c151a40 0x7f624c1ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:23.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f624c0c4c40 0x7f624c0c3170 secure :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f623c014040 tx=0x7f623c004750 comp rx=0 tx=0).stop 2023-08-27T11:28:23.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 --2- 172.21.15.43:0/3324692978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f624c0c81c0 0x7f624c0c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:23.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.935+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 >> 172.21.15.43:0/3324692978 conn(0x7f624c0ab890 msgr2=0x7f624c0c90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:23.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.936+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 shutdown_connections 2023-08-27T11:28:23.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:23.936+0000 7f6250bff700 1 -- 172.21.15.43:0/3324692978 wait complete. 2023-08-27T11:28:23.940 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:28:23.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:28:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.166+0000 7fc035dff700 1 Processor -- start 2023-08-27T11:28:24.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.166+0000 7fc035dff700 1 -- start start 2023-08-27T11:28:24.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.167+0000 7fc035dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0300c4630 0x7fc0300c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.167+0000 7fc035dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03006c4e0 con 0x7fc03006ad70 2023-08-27T11:28:24.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.167+0000 7fc035dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc030155370 con 0x7fc030151a90 2023-08-27T11:28:24.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.167+0000 7fc035dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0300c82c0 con 0x7fc0300c4630 2023-08-27T11:28:24.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0300c4630 0x7fc0300c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc03006ad70 0x7fc03006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43008/0 (socket says 172.21.15.43:43008) 2023-08-27T11:28:24.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02ffff700 1 -- 172.21.15.43:0/1962747573 learned_addr learned my addr 172.21.15.43:0/1962747573 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:24.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc0300c4630 0x7fc0300c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49416/0 (socket says 172.21.15.43:49416) 2023-08-27T11:28:24.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 -- 172.21.15.43:0/1962747573 >> v1:172.21.15.57:6789/0 conn(0x7fc030151a90 legacy=0x7fc0300c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 -- 172.21.15.43:0/1962747573 >> v1:172.21.15.43:6789/0 conn(0x7fc03006ad70 legacy=0x7fc03006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 -- 172.21.15.43:0/1962747573 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc030151e70 con 0x7fc0300c4630 2023-08-27T11:28:24.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02e7fc700 1 -- 172.21.15.43:0/1962747573 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966949662 0 0) 0x7fc03006c4e0 con 0x7fc03006ad70 2023-08-27T11:28:24.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.168+0000 7fc02effd700 1 --2- 172.21.15.43:0/1962747573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0300c4630 0x7fc0300c4a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc024009840 tx=0x7fc024009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f0938d6b0f87a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc02e7fc700 1 -- 172.21.15.43:0/1962747573 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011830 con 0x7fc0300c4630 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc02e7fc700 1 -- 172.21.15.43:0/1962747573 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc024011990 con 0x7fc0300c4630 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc02e7fc700 1 -- 172.21.15.43:0/1962747573 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc024011d20 con 0x7fc0300c4630 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 -- 172.21.15.43:0/1962747573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0300c4630 msgr2=0x7fc0300c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 --2- 172.21.15.43:0/1962747573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0300c4630 0x7fc0300c4a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc024009840 tx=0x7fc024009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:24.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 -- 172.21.15.43:0/1962747573 shutdown_connections 2023-08-27T11:28:24.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 --2- 172.21.15.43:0/1962747573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0300c4630 0x7fc0300c4a90 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 -- 172.21.15.43:0/1962747573 >> 172.21.15.43:0/1962747573 conn(0x7fc0300ab820 msgr2=0x7fc0300abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:24.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 -- 172.21.15.43:0/1962747573 shutdown_connections 2023-08-27T11:28:24.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.169+0000 7fc035dff700 1 -- 172.21.15.43:0/1962747573 wait complete. 2023-08-27T11:28:24.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.171+0000 7fc035dff700 1 Processor -- start 2023-08-27T11:28:24.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.171+0000 7fc035dff700 1 -- start start 2023-08-27T11:28:24.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0300c4630 0x7fc0301ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030151a90 0x7fc030153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03014fe40 con 0x7fc03006ad70 2023-08-27T11:28:24.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0300ab140 con 0x7fc030151a90 2023-08-27T11:28:24.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc035dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03014e3a0 con 0x7fc0300c4630 2023-08-27T11:28:24.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc02f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49428/0 (socket says 172.21.15.43:49428) 2023-08-27T11:28:24.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.172+0000 7fc02f7fe700 1 -- 172.21.15.43:0/1659948720 learned_addr learned my addr 172.21.15.43:0/1659948720 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:24.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 -- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0300c4630 msgr2=0x7fc0301ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0300c4630 0x7fc0301ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 -- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030151a90 msgr2=0x7fc030153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030151a90 0x7fc030153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 -- 172.21.15.43:0/1659948720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240094a0 con 0x7fc03006ad70 2023-08-27T11:28:24.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc02f7fe700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c480 tx=0x7fc02000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200052d0 con 0x7fc03006ad70 2023-08-27T11:28:24.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc020005430 con 0x7fc03006ad70 2023-08-27T11:28:24.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0200038c0 con 0x7fc03006ad70 2023-08-27T11:28:24.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0301542d0 con 0x7fc03006ad70 2023-08-27T11:28:24.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.173+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0301e9640 con 0x7fc03006ad70 2023-08-27T11:28:24.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.174+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc030154460 con 0x7fc03006ad70 2023-08-27T11:28:24.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.175+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc020003a20 con 0x7fc03006ad70 2023-08-27T11:28:24.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.176+0000 7fc017fff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 0x7fc01c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.176+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc0200877a0 con 0x7fc03006ad70 2023-08-27T11:28:24.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.176+0000 7fc02effd700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 0x7fc01c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.177+0000 7fc02effd700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 0x7fc01c06c5d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc030146b20 tx=0x7fc024010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.181+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc030154460 con 0x7fc03006ad70 2023-08-27T11:28:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.397+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc030154460 con 0x7fc03006ad70 2023-08-27T11:28:24.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.401+0000 7fc017fff700 1 -- 172.21.15.43:0/1659948720 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc030154460 con 0x7fc03006ad70 2023-08-27T11:28:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.403+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 msgr2=0x7fc01c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.403+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 0x7fc01c06c5d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc030146b20 tx=0x7fc024010000 comp rx=0 tx=0).stop 2023-08-27T11:28:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 msgr2=0x7fc03014bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c480 tx=0x7fc02000c840 comp rx=0 tx=0).stop 2023-08-27T11:28:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 shutdown_connections 2023-08-27T11:28:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc01c06a110 0x7fc01c06c5d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc030151a90 0x7fc030153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc03006ad70 0x7fc03014bd30 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 --2- 172.21.15.43:0/1659948720 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0300c4630 0x7fc0301ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 >> 172.21.15.43:0/1659948720 conn(0x7fc0300ab820 msgr2=0x7fc0300c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 shutdown_connections 2023-08-27T11:28:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.404+0000 7fc035dff700 1 -- 172.21.15.43:0/1659948720 wait complete. 2023-08-27T11:28:24.424 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.b mds_join_fs 2023-08-27T11:28:24.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.625+0000 7fc0e29ff700 1 Processor -- start 2023-08-27T11:28:24.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.625+0000 7fc0e29ff700 1 -- start start 2023-08-27T11:28:24.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.626+0000 7fc0e29ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0dc151b20 0x7fc0dc0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0e29ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc06c450 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0e29ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc154760 con 0x7fc0dc0c4630 2023-08-27T11:28:24.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0e29ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc151f00 con 0x7fc0dc151b20 2023-08-27T11:28:24.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0e0f9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc0dc0c4ae0 0x7fc0dc06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43010/0 (socket says 172.21.15.43:43010) 2023-08-27T11:28:24.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0e0f9c700 1 -- 172.21.15.43:0/3433619390 learned_addr learned my addr 172.21.15.43:0/3433619390 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:24.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/3433619390 >> v2:172.21.15.57:3300/0 conn(0x7fc0dc151b20 0x7fc0dc0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372035930 0 0) 0x7fc0dc06c450 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.627+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c40035b0 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1946398856 0 0) 0x7fc0c40035b0 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 >> v2:172.21.15.57:3300/0 conn(0x7fc0dc151b20 msgr2=0x7fc0dc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 --2- 172.21.15.43:0/3433619390 >> v2:172.21.15.57:3300/0 conn(0x7fc0dc151b20 0x7fc0dc0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 >> v1:172.21.15.57:6789/0 conn(0x7fc0dc0c4630 legacy=0x7fc0dc06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc154a40 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fc0d40019f0 con 0x7fc0dc0c4ae0 2023-08-27T11:28:24.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 >> v1:172.21.15.43:6789/0 conn(0x7fc0dc0c4ae0 legacy=0x7fc0dc06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0c4004850 0x7fc0c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0c4005330 0x7fc0c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c400c200 con 0x7fc0c4003a50 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c400c370 con 0x7fc0c4005330 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c400c530 con 0x7fc0c4004850 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0e0f9c700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0c4005330 0x7fc0c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.628+0000 7fc0db7fe700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0c4004850 0x7fc0c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 -- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0c4004850 msgr2=0x7fc0c4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:24.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0c4004850 0x7fc0c4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 -- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0c4005330 msgr2=0x7fc0c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:24.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0c4005330 0x7fc0c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 -- 172.21.15.43:0/3433619390 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c40035b0 con 0x7fc0c4003a50 2023-08-27T11:28:24.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0e0f9c700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0c4005330 0x7fc0c400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:24.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0e0f9c700 1 -- 172.21.15.43:0/3433619390 reap_dead start 2023-08-27T11:28:24.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009b60 tx=0x7fc0c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7aaa770ab44330 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00e6c0 con 0x7fc0c4003a50 2023-08-27T11:28:24.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00e820 con 0x7fc0c4003a50 2023-08-27T11:28:24.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.629+0000 7fc0daffd700 1 -- 172.21.15.43:0/3433619390 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00eb90 con 0x7fc0c4003a50 2023-08-27T11:28:24.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 -- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 msgr2=0x7fc0c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009b60 tx=0x7fc0c4005880 comp rx=0 tx=0).stop 2023-08-27T11:28:24.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 -- 172.21.15.43:0/3433619390 shutdown_connections 2023-08-27T11:28:24.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/3433619390 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 -- 172.21.15.43:0/3433619390 >> 172.21.15.43:0/3433619390 conn(0x7fc0dc0ab820 msgr2=0x7fc0dc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:24.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 -- 172.21.15.43:0/3433619390 shutdown_connections 2023-08-27T11:28:24.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.630+0000 7fc0e29ff700 1 -- 172.21.15.43:0/3433619390 wait complete. 2023-08-27T11:28:24.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.632+0000 7fc0e29ff700 1 Processor -- start 2023-08-27T11:28:24.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.632+0000 7fc0e29ff700 1 -- start start 2023-08-27T11:28:24.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0dc1561c0 0x7fc0dc1e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0dc14d6a0 0x7fc0dc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc14c280 con 0x7fc0c4003a50 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc14c560 con 0x7fc0dc14d6a0 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0e29ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc14c840 con 0x7fc0dc1561c0 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49452/0 (socket says 172.21.15.43:49452) 2023-08-27T11:28:24.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 -- 172.21.15.43:0/1878442714 learned_addr learned my addr 172.21.15.43:0/1878442714 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:24.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 -- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0dc1561c0 msgr2=0x7fc0dc1e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0dc1561c0 0x7fc0dc1e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 -- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0dc14d6a0 msgr2=0x7fc0dc158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0dc14d6a0 0x7fc0dc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.633+0000 7fc0dbfff700 1 -- 172.21.15.43:0/1878442714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc157a80 con 0x7fc0c4003a50 2023-08-27T11:28:24.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0dbfff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c340 tx=0x7fc0cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00e6c0 con 0x7fc0c4003a50 2023-08-27T11:28:24.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc003ad0 con 0x7fc0c4003a50 2023-08-27T11:28:24.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc003e80 con 0x7fc0c4003a50 2023-08-27T11:28:24.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc157d60 con 0x7fc0c4003a50 2023-08-27T11:28:24.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.634+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc1587c0 con 0x7fc0c4003a50 2023-08-27T11:28:24.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.635+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc1580d0 con 0x7fc0c4003a50 2023-08-27T11:28:24.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.636+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc0cc013470 con 0x7fc0c4003a50 2023-08-27T11:28:24.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.637+0000 7fc0d8ff9700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 0x7fc0c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:24.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.637+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc0cc089c60 con 0x7fc0c4003a50 2023-08-27T11:28:24.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.637+0000 7fc0db7fe700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 0x7fc0c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:24.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.637+0000 7fc0db7fe700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 0x7fc0c806c5a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000ef0 tx=0x7fc0d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:24.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.641+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc0cc0556b0 con 0x7fc0c4003a50 2023-08-27T11:28:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.857+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"} v 0) v1 -- 0x7fc0dc04ee70 con 0x7fc0c4003a50 2023-08-27T11:28:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.861+0000 7fc0d8ff9700 1 -- 172.21.15.43:0/1878442714 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.b", "name": "mds_join_fs"}]=0 v42) v1 ==== 96+0+0 (secure 0 0 0) 0x7fc0cc017020 con 0x7fc0c4003a50 2023-08-27T11:28:24.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 msgr2=0x7fc0c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 0x7fc0c806c5a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0000ef0 tx=0x7fc0d0009040 comp rx=0 tx=0).stop 2023-08-27T11:28:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 msgr2=0x7fc0dc14cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c340 tx=0x7fc0cc0047c0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 shutdown_connections 2023-08-27T11:28:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc0c806a0e0 0x7fc0c806c5a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0dc14d6a0 0x7fc0dc158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0c4003a50 0x7fc0dc14cb20 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 --2- 172.21.15.43:0/1878442714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc0dc1561c0 0x7fc0dc1e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 >> 172.21.15.43:0/1878442714 conn(0x7fc0dc0ab820 msgr2=0x7fc0dc14eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 shutdown_connections 2023-08-27T11:28:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:24.864+0000 7fc0e29ff700 1 -- 172.21.15.43:0/1878442714 wait complete. 2023-08-27T11:28:24.883 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.a mds_join_fs 2023-08-27T11:28:25.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.087+0000 7f3c63fff700 1 Processor -- start 2023-08-27T11:28:25.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.087+0000 7f3c63fff700 1 -- start start 2023-08-27T11:28:25.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.088+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c5c156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c63fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c152430 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c63fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c152710 con 0x7f3c5c06ca60 2023-08-27T11:28:25.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c63fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1530b0 con 0x7f3c5c06d1c0 2023-08-27T11:28:25.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c61d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3c5c0c51a0 0x7f3c5c0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43026/0 (socket says 172.21.15.43:43026) 2023-08-27T11:28:25.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c61d9b700 1 -- 172.21.15.43:0/1288222383 learned_addr learned my addr 172.21.15.43:0/1288222383 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:25.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c6259c700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c5c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944908529 0 0) 0x7f3c5c152430 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c480035b0 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.089+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2500940831 0 0) 0x7f3c480035b0 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 msgr2=0x7f3c5c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c5c156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 >> v1:172.21.15.57:6789/0 conn(0x7f3c5c06ca60 legacy=0x7f3c5c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c1529f0 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f3c58001670 con 0x7f3c5c0c51a0 2023-08-27T11:28:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 >> v1:172.21.15.43:6789/0 conn(0x7f3c5c0c51a0 legacy=0x7f3c5c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48003a30 0x7f3c48003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c48004850 0x7f3c48004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c48005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1530b0 con 0x7f3c48004850 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800bb10 con 0x7f3c48003a30 2023-08-27T11:28:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4800bcd0 con 0x7f3c5c06d1c0 2023-08-27T11:28:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c6159a700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c48004850 0x7f3c48004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c61d9b700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48003a30 0x7f3c48003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c6259c700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c48005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c6159a700 1 -- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 msgr2=0x7f3c48005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:25.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.090+0000 7f3c6159a700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c06d1c0 0x7f3c48005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c6159a700 1 -- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48003a30 msgr2=0x7f3c48003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:25.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c6159a700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48003a30 0x7f3c48003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c6159a700 1 -- 172.21.15.43:0/1288222383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480035b0 con 0x7f3c48004850 2023-08-27T11:28:25.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c6159a700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c48004850 0x7f3c48004cd0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0018d0 tx=0x7f3c48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427220bc1bbef519 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00c690 con 0x7f3c48004850 2023-08-27T11:28:25.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00c7f0 con 0x7f3c48004850 2023-08-27T11:28:25.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c60d99700 1 -- 172.21.15.43:0/1288222383 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00cba0 con 0x7f3c48004850 2023-08-27T11:28:25.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c63fff700 1 -- 172.21.15.43:0/1288222383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c48004850 msgr2=0x7f3c48004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c63fff700 1 --2- 172.21.15.43:0/1288222383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c48004850 0x7f3c48004cd0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0018d0 tx=0x7f3c48005880 comp rx=0 tx=0).stop 2023-08-27T11:28:25.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.091+0000 7f3c6259c700 1 -- 172.21.15.43:0/1288222383 reap_dead start 2023-08-27T11:28:25.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.092+0000 7f3c63fff700 1 -- 172.21.15.43:0/1288222383 shutdown_connections 2023-08-27T11:28:25.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.092+0000 7f3c63fff700 1 -- 172.21.15.43:0/1288222383 >> 172.21.15.43:0/1288222383 conn(0x7f3c5c06aa50 msgr2=0x7f3c5c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:25.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.092+0000 7f3c63fff700 1 -- 172.21.15.43:0/1288222383 shutdown_connections 2023-08-27T11:28:25.100 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.092+0000 7f3c63fff700 1 -- 172.21.15.43:0/1288222383 wait complete. 2023-08-27T11:28:25.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.094+0000 7f3c63fff700 1 Processor -- start 2023-08-27T11:28:25.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.094+0000 7f3c63fff700 1 -- start start 2023-08-27T11:28:25.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.095+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48004850 0x7f3c5c14fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.095+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.095+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c0be6d0 0x7f3c5c0beb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c63fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0bd2f0 con 0x7f3c5c148900 2023-08-27T11:28:25.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c63fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1492c0 con 0x7f3c48004850 2023-08-27T11:28:25.104 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c63fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c1e5f90 con 0x7f3c5c0be6d0 2023-08-27T11:28:25.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49468/0 (socket says 172.21.15.43:49468) 2023-08-27T11:28:25.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 -- 172.21.15.43:0/2693712974 learned_addr learned my addr 172.21.15.43:0/2693712974 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:25.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c61d9b700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48004850 0x7f3c5c14fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.105 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6259c700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c0be6d0 0x7f3c5c0beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 -- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c0be6d0 msgr2=0x7f3c5c0beb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c0be6d0 0x7f3c5c0beb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 -- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48004850 msgr2=0x7f3c5c14fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48004850 0x7f3c5c14fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.106 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 -- 172.21.15.43:0/2693712974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c0bcd80 con 0x7f3c5c148900 2023-08-27T11:28:25.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.096+0000 7f3c6159a700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c0e0 tx=0x7f3c4c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.097+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00cb60 con 0x7f3c5c148900 2023-08-27T11:28:25.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.097+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c021070 con 0x7f3c5c148900 2023-08-27T11:28:25.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.097+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c1e5a30 con 0x7f3c5c148900 2023-08-27T11:28:25.107 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.097+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00cee0 con 0x7f3c5c148900 2023-08-27T11:28:25.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.097+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c0bca10 con 0x7f3c5c148900 2023-08-27T11:28:25.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.098+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c04ee70 con 0x7f3c5c148900 2023-08-27T11:28:25.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.099+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c4c023030 con 0x7f3c5c148900 2023-08-27T11:28:25.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.100+0000 7f3c527fc700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 0x7f3c4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.100+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3c4c0894c0 con 0x7f3c5c148900 2023-08-27T11:28:25.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.100+0000 7f3c61d9b700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 0x7f3c4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.100+0000 7f3c61d9b700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 0x7f3c4006c5a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0a5510 tx=0x7f3c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.109 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.104+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c4c054df0 con 0x7f3c5c148900 2023-08-27T11:28:25.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.315+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"} v 0) v1 -- 0x7f3c5c06c840 con 0x7f3c5c148900 2023-08-27T11:28:25.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.316+0000 7f3c527fc700 1 -- 172.21.15.43:0/2693712974 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"}]=0 v42) v1 ==== 96+0+0 (secure 0 0 0) 0x7f3c4c087e60 con 0x7f3c5c148900 2023-08-27T11:28:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 msgr2=0x7f3c4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 0x7f3c4006c5a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0a5510 tx=0x7f3c58009040 comp rx=0 tx=0).stop 2023-08-27T11:28:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 msgr2=0x7f3c5c148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c0e0 tx=0x7f3c4c001230 comp rx=0 tx=0).stop 2023-08-27T11:28:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 shutdown_connections 2023-08-27T11:28:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3c4006a0e0 0x7f3c4006c5a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c5c0be6d0 0x7f3c5c0beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c48004850 0x7f3c5c14fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 --2- 172.21.15.43:0/2693712974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3c5c148900 0x7f3c5c148d80 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 >> 172.21.15.43:0/2693712974 conn(0x7f3c5c06aa50 msgr2=0x7f3c5c0bb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:25.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 shutdown_connections 2023-08-27T11:28:25.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.318+0000 7f3c63fff700 1 -- 172.21.15.43:0/2693712974 wait complete. 2023-08-27T11:28:25.338 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset' 2023-08-27T11:28:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.541+0000 7fe7e69ff700 1 Processor -- start 2023-08-27T11:28:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.541+0000 7fe7e69ff700 1 -- start start 2023-08-27T11:28:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e69ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e00c4630 0x7fe7e00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e69ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe7e006ad70 0x7fe7e006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e69ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e006c4e0 con 0x7fe7e0151a90 2023-08-27T11:28:25.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e69ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e0155370 con 0x7fe7e006ad70 2023-08-27T11:28:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e69ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00c82c0 con 0x7fe7e00c4630 2023-08-27T11:28:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7dffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe7e0151a90 0x7fe7e00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43034/0 (socket says 172.21.15.43:43034) 2023-08-27T11:28:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7dffff700 1 -- 172.21.15.43:0/2097663580 learned_addr learned my addr 172.21.15.43:0/2097663580 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7e4f9c700 1 --2- 172.21.15.43:0/2097663580 >> v2:172.21.15.43:3300/0 conn(0x7fe7e006ad70 0x7fe7e006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.542+0000 7fe7df7fe700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e00c4630 0x7fe7e00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7deffd700 1 -- 172.21.15.43:0/2097663580 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594813956 0 0) 0x7fe7e006c4e0 con 0x7fe7e0151a90 2023-08-27T11:28:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7deffd700 1 -- 172.21.15.43:0/2097663580 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c80035b0 con 0x7fe7e0151a90 2023-08-27T11:28:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7e4f9c700 1 -- 172.21.15.43:0/2097663580 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e00c4630 msgr2=0x7fe7e00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7e4f9c700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e00c4630 0x7fe7e00c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7e4f9c700 1 -- 172.21.15.43:0/2097663580 >> v1:172.21.15.43:6789/0 conn(0x7fe7e0151a90 legacy=0x7fe7e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7e4f9c700 1 -- 172.21.15.43:0/2097663580 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0151e70 con 0x7fe7e006ad70 2023-08-27T11:28:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7e4f9c700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e006b200 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009d90 tx=0x7fe7d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cba0d5bc29eb22f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7deffd700 1 -- 172.21.15.43:0/2097663580 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e070 con 0x7fe7e006ad70 2023-08-27T11:28:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7deffd700 1 -- 172.21.15.43:0/2097663580 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800bb20 con 0x7fe7e006ad70 2023-08-27T11:28:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.543+0000 7fe7deffd700 1 -- 172.21.15.43:0/2097663580 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8012430 con 0x7fe7e006ad70 2023-08-27T11:28:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 -- 172.21.15.43:0/2097663580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 msgr2=0x7fe7e006b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e006b200 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009d90 tx=0x7fe7d800b330 comp rx=0 tx=0).stop 2023-08-27T11:28:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 -- 172.21.15.43:0/2097663580 shutdown_connections 2023-08-27T11:28:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e006b200 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/2097663580 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e00c4630 0x7fe7e00c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 -- 172.21.15.43:0/2097663580 >> 172.21.15.43:0/2097663580 conn(0x7fe7e00ab820 msgr2=0x7fe7e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 -- 172.21.15.43:0/2097663580 shutdown_connections 2023-08-27T11:28:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.544+0000 7fe7e69ff700 1 -- 172.21.15.43:0/2097663580 wait complete. 2023-08-27T11:28:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.546+0000 7fe7e69ff700 1 Processor -- start 2023-08-27T11:28:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.546+0000 7fe7e69ff700 1 -- start start 2023-08-27T11:28:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 0x7fe7e00c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e0151a90 0x7fe7e014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0156e50 con 0x7fe7e006ad70 2023-08-27T11:28:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e01ed6e0 con 0x7fe7e00c4630 2023-08-27T11:28:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e69ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00c0d80 con 0x7fe7e0151a90 2023-08-27T11:28:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49488/0 (socket says 172.21.15.43:49488) 2023-08-27T11:28:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 -- 172.21.15.43:0/3530919143 learned_addr learned my addr 172.21.15.43:0/3530919143 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7e4f9c700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e0151a90 0x7fe7e014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7df7fe700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 0x7fe7e00c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 -- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e0151a90 msgr2=0x7fe7e014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e0151a90 0x7fe7e014ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.547+0000 7fe7dffff700 1 -- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 msgr2=0x7fe7e00c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dffff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 0x7fe7e00c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dffff700 1 -- 172.21.15.43:0/3530919143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009a70 con 0x7fe7e006ad70 2023-08-27T11:28:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7df7fe700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 0x7fe7e00c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:25.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dffff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0001eb0 tx=0x7fe7d000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0005d70 con 0x7fe7e006ad70 2023-08-27T11:28:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d00070d0 con 0x7fe7e006ad70 2023-08-27T11:28:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0007460 con 0x7fe7e006ad70 2023-08-27T11:28:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e0156b70 con 0x7fe7e006ad70 2023-08-27T11:28:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.548+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00c1280 con 0x7fe7e006ad70 2023-08-27T11:28:25.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.549+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e01ed540 con 0x7fe7e006ad70 2023-08-27T11:28:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.550+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe7d00075c0 con 0x7fe7e006ad70 2023-08-27T11:28:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.551+0000 7fe7dcff9700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 0x7fe7cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.551+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe7d00878a0 con 0x7fe7e006ad70 2023-08-27T11:28:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.551+0000 7fe7df7fe700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 0x7fe7cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:25.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.552+0000 7fe7df7fe700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 0x7fe7cc06c5a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe7e01e7400 tx=0x7fe7d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:25.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.556+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe7e01ed540 con 0x7fe7e006ad70 2023-08-27T11:28:25.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.846+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset"]} v 0) v1 -- 0x7fe7e01ed540 con 0x7fe7e006ad70 2023-08-27T11:28:25.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.937+0000 7fe7dcff9700 1 -- 172.21.15.43:0/3530919143 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_unset"]}]=0 v333) v1 ==== 144+0+0 (secure 0 0 0) 0x7fe7e01ed540 con 0x7fe7e006ad70 2023-08-27T11:28:25.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 msgr2=0x7fe7cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 0x7fe7cc06c5a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe7e01e7400 tx=0x7fe7d4008040 comp rx=0 tx=0).stop 2023-08-27T11:28:25.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 msgr2=0x7fe7e00c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0001eb0 tx=0x7fe7d000c860 comp rx=0 tx=0).stop 2023-08-27T11:28:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 shutdown_connections 2023-08-27T11:28:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe7cc06a0e0 0x7fe7cc06c5a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7e0151a90 0x7fe7e014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe7e006ad70 0x7fe7e00c33d0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 --2- 172.21.15.43:0/3530919143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7e00c4630 0x7fe7e00c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 >> 172.21.15.43:0/3530919143 conn(0x7fe7e00ab820 msgr2=0x7fe7e014b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 shutdown_connections 2023-08-27T11:28:25.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:25.940+0000 7fe7e69ff700 1 -- 172.21.15.43:0/3530919143 wait complete. 2023-08-27T11:28:25.960 INFO:tasks.cephfs_test_runner:That unsetting mds_join_fs will cause failover if another high-affinity standby exists. ... ok 2023-08-27T11:28:25.960 INFO:tasks.cephfs_test_runner:Starting test: test_join_fs_vanilla (tasks.cephfs.test_failover.TestClusterAffinity) That a vanilla standby is preferred over others with mds_join_fs set to another fs. 2023-08-27T11:28:25.961 INFO:tasks.cephfs_test_runner:test_join_fs_vanilla (tasks.cephfs.test_failover.TestClusterAffinity) 2023-08-27T11:28:25.961 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla' 2023-08-27T11:28:26.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.162+0000 7f43111ff700 1 Processor -- start 2023-08-27T11:28:26.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.162+0000 7f43111ff700 1 -- start start 2023-08-27T11:28:26.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c14e960 0x7f430c0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f430c0a79c0 0x7f430c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f430c0c50d0 0x7f430c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0baf30 con 0x7f430c0a79c0 2023-08-27T11:28:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c154d00 con 0x7f430c0c50d0 2023-08-27T11:28:26.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f43111ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c154fe0 con 0x7f430c14e960 2023-08-27T11:28:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.163+0000 7f430a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f430c0a79c0 0x7f430c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f430c0a79c0 0x7f430c0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49504/0 (socket says 172.21.15.43:49504) 2023-08-27T11:28:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 -- 172.21.15.43:0/2859917530 learned_addr learned my addr 172.21.15.43:0/2859917530 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430b59e700 1 --2- 172.21.15.43:0/2859917530 >> v2:172.21.15.57:3300/0 conn(0x7f430c0c50d0 0x7f430c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430ad9d700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c14e960 0x7f430c0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 -- 172.21.15.43:0/2859917530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c14e960 msgr2=0x7f430c0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c14e960 0x7f430c0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 -- 172.21.15.43:0/2859917530 >> v2:172.21.15.57:3300/0 conn(0x7f430c0c50d0 msgr2=0x7f430c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 --2- 172.21.15.43:0/2859917530 >> v2:172.21.15.57:3300/0 conn(0x7f430c0c50d0 0x7f430c0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 -- 172.21.15.43:0/2859917530 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c1552c0 con 0x7f430c0a79c0 2023-08-27T11:28:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f430a59c700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0a79c0 0x7f430c0c3cc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f430c072b00 tx=0x7f4300009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a740c0c27b5df879 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.164+0000 7f4309d9b700 1 -- 172.21.15.43:0/2859917530 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000b870 con 0x7f430c0a79c0 2023-08-27T11:28:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f4309d9b700 1 -- 172.21.15.43:0/2859917530 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000b9d0 con 0x7f430c0a79c0 2023-08-27T11:28:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f4309d9b700 1 -- 172.21.15.43:0/2859917530 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000bd60 con 0x7f430c0a79c0 2023-08-27T11:28:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 -- 172.21.15.43:0/2859917530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0a79c0 msgr2=0x7f430c0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0a79c0 0x7f430c0c3cc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f430c072b00 tx=0x7f4300009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 -- 172.21.15.43:0/2859917530 shutdown_connections 2023-08-27T11:28:26.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 --2- 172.21.15.43:0/2859917530 >> v2:172.21.15.57:3300/0 conn(0x7f430c0c50d0 0x7f430c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c14e960 0x7f430c0a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 --2- 172.21.15.43:0/2859917530 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0a79c0 0x7f430c0c3cc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 -- 172.21.15.43:0/2859917530 >> 172.21.15.43:0/2859917530 conn(0x7f430c06aa50 msgr2=0x7f430c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 -- 172.21.15.43:0/2859917530 shutdown_connections 2023-08-27T11:28:26.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.165+0000 7f43111ff700 1 -- 172.21.15.43:0/2859917530 wait complete. 2023-08-27T11:28:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.167+0000 7f43111ff700 1 Processor -- start 2023-08-27T11:28:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.167+0000 7f43111ff700 1 -- start start 2023-08-27T11:28:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 0x7f430c1de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430c14e960 0x7f430c1eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c152dd0 con 0x7f430c0c50d0 2023-08-27T11:28:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c14f000 con 0x7f430c14e960 2023-08-27T11:28:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f43111ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c14f8a0 con 0x7f430c0a79c0 2023-08-27T11:28:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f430a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f430a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49506/0 (socket says 172.21.15.43:49506) 2023-08-27T11:28:26.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.168+0000 7f430a59c700 1 -- 172.21.15.43:0/2423218618 learned_addr learned my addr 172.21.15.43:0/2423218618 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430ad9d700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 0x7f430c1de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 -- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 msgr2=0x7f430c1de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 0x7f430c1de9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 -- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430c14e960 msgr2=0x7f430c1eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:26.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430c14e960 0x7f430c1eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 -- 172.21.15.43:0/2423218618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009550 con 0x7f430c0c50d0 2023-08-27T11:28:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430ad9d700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 0x7f430c1de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f430a59c700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c00 tx=0x7f4300004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300004540 con 0x7f430c0c50d0 2023-08-27T11:28:26.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43000036a0 con 0x7f430c0c50d0 2023-08-27T11:28:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c1e9ff0 con 0x7f430c0c50d0 2023-08-27T11:28:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.169+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300003a50 con 0x7f430c0c50d0 2023-08-27T11:28:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.170+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c14f250 con 0x7f430c0c50d0 2023-08-27T11:28:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.170+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c0bb390 con 0x7f430c0c50d0 2023-08-27T11:28:26.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.171+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4300021070 con 0x7f430c0c50d0 2023-08-27T11:28:26.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.172+0000 7f42f37fe700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 0x7f42f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:26.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.172+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f43000899a0 con 0x7f430c0c50d0 2023-08-27T11:28:26.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.173+0000 7f430ad9d700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 0x7f42f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:26.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.173+0000 7f430ad9d700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 0x7f42f806c5a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009820 tx=0x7f42fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:26.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.177+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f43000553f0 con 0x7f430c0c50d0 2023-08-27T11:28:26.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.466+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla"]} v 0) v1 -- 0x7f430c1ed5f0 con 0x7f430c0c50d0 2023-08-27T11:28:26.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.940+0000 7f42f37fe700 1 -- 172.21.15.43:0/2423218618 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla"]}]=0 v334) v1 ==== 149+0+0 (secure 0 0 0) 0x7f430c1ed5f0 con 0x7f430c0c50d0 2023-08-27T11:28:26.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.942+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 msgr2=0x7f42f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:26.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.942+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 0x7f42f806c5a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009820 tx=0x7f42fc008040 comp rx=0 tx=0).stop 2023-08-27T11:28:26.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.942+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 msgr2=0x7f430c1ea640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:26.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.942+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f4300000c00 tx=0x7f4300004750 comp rx=0 tx=0).stop 2023-08-27T11:28:26.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 shutdown_connections 2023-08-27T11:28:26.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42f806a0e0 0x7f42f806c5a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f430c14e960 0x7f430c1eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f430c0a79c0 0x7f430c1de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 --2- 172.21.15.43:0/2423218618 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f430c0c50d0 0x7f430c1ea640 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 >> 172.21.15.43:0/2423218618 conn(0x7f430c06aa50 msgr2=0x7f430c06c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:26.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 shutdown_connections 2023-08-27T11:28:26.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:26.943+0000 7f43111ff700 1 -- 172.21.15.43:0/2423218618 wait complete. 2023-08-27T11:28:26.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:27.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.170+0000 7fc42ebff700 1 Processor -- start 2023-08-27T11:28:27.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.170+0000 7fc42ebff700 1 -- start start 2023-08-27T11:28:27.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc42ebff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4280c4630 0x7fc4280c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc42ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc42806c4e0 con 0x7fc42806ad70 2023-08-27T11:28:27.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc42ebff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc428155370 con 0x7fc428151a90 2023-08-27T11:28:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc42ebff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280c82c0 con 0x7fc4280c4630 2023-08-27T11:28:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc427fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4280c4630 0x7fc4280c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.171+0000 7fc42d19c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc42806ad70 0x7fc42806b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43038/0 (socket says 172.21.15.43:43038) 2023-08-27T11:28:27.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc427fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc4280c4630 0x7fc4280c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49516/0 (socket says 172.21.15.43:49516) 2023-08-27T11:28:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc42d19c700 1 -- 172.21.15.43:0/689729937 learned_addr learned my addr 172.21.15.43:0/689729937 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc427fff700 1 -- 172.21.15.43:0/689729937 >> v1:172.21.15.57:6789/0 conn(0x7fc428151a90 legacy=0x7fc4280c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc427fff700 1 -- 172.21.15.43:0/689729937 >> v1:172.21.15.43:6789/0 conn(0x7fc42806ad70 legacy=0x7fc42806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc427fff700 1 -- 172.21.15.43:0/689729937 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428151e70 con 0x7fc4280c4630 2023-08-27T11:28:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc427fff700 1 --2- 172.21.15.43:0/689729937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4280c4630 0x7fc4280c4a90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc414009840 tx=0x7fc414009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d2581453e0aadb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc4277fe700 1 -- 172.21.15.43:0/689729937 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414011830 con 0x7fc4280c4630 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.172+0000 7fc4277fe700 1 -- 172.21.15.43:0/689729937 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414011990 con 0x7fc4280c4630 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc4277fe700 1 -- 172.21.15.43:0/689729937 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414011d20 con 0x7fc4280c4630 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 -- 172.21.15.43:0/689729937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4280c4630 msgr2=0x7fc4280c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 --2- 172.21.15.43:0/689729937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4280c4630 0x7fc4280c4a90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fc414009840 tx=0x7fc414009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 -- 172.21.15.43:0/689729937 shutdown_connections 2023-08-27T11:28:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 --2- 172.21.15.43:0/689729937 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc4280c4630 0x7fc4280c4a90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 -- 172.21.15.43:0/689729937 >> 172.21.15.43:0/689729937 conn(0x7fc4280ab820 msgr2=0x7fc4280abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 -- 172.21.15.43:0/689729937 shutdown_connections 2023-08-27T11:28:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.173+0000 7fc42ebff700 1 -- 172.21.15.43:0/689729937 wait complete. 2023-08-27T11:28:27.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.176+0000 7fc42ebff700 1 Processor -- start 2023-08-27T11:28:27.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.176+0000 7fc42ebff700 1 -- start start 2023-08-27T11:28:27.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc42806ad70 0x7fc4281ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4280c4630 0x7fc4281539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4281eaa30 con 0x7fc428151a90 2023-08-27T11:28:27.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428149090 con 0x7fc4280c4630 2023-08-27T11:28:27.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280bcf90 con 0x7fc42806ad70 2023-08-27T11:28:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42d19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42d19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49528/0 (socket says 172.21.15.43:49528) 2023-08-27T11:28:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42d19c700 1 -- 172.21.15.43:0/2163866812 learned_addr learned my addr 172.21.15.43:0/2163866812 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc427fff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4280c4630 0x7fc4281539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.177+0000 7fc42c99b700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc42806ad70 0x7fc4281ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 -- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc42806ad70 msgr2=0x7fc4281ec2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc42806ad70 0x7fc4281ec2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 -- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4280c4630 msgr2=0x7fc4281539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4280c4630 0x7fc4281539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 -- 172.21.15.43:0/2163866812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140094a0 con 0x7fc428151a90 2023-08-27T11:28:27.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42d19c700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c500 tx=0x7fc42000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420005d70 con 0x7fc428151a90 2023-08-27T11:28:27.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200070d0 con 0x7fc428151a90 2023-08-27T11:28:27.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420007440 con 0x7fc428151a90 2023-08-27T11:28:27.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.178+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4280c0d80 con 0x7fc428151a90 2023-08-27T11:28:27.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.179+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4281ea040 con 0x7fc428151a90 2023-08-27T11:28:27.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.180+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42804ee70 con 0x7fc428151a90 2023-08-27T11:28:27.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.181+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4200075a0 con 0x7fc428151a90 2023-08-27T11:28:27.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.182+0000 7fc4257fa700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 0x7fc40c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.182+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fc420087560 con 0x7fc428151a90 2023-08-27T11:28:27.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.182+0000 7fc42c99b700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 0x7fc40c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.182+0000 7fc42c99b700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 0x7fc40c06c5a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0012e0 tx=0x7fc41c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.186+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc420052f40 con 0x7fc428151a90 2023-08-27T11:28:27.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.399+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc42806c130 con 0x7fc428151a90 2023-08-27T11:28:27.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.400+0000 7fc4257fa700 1 -- 172.21.15.43:0/2163866812 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+14916 (secure 0 0 0) 0x7fc420056560 con 0x7fc428151a90 2023-08-27T11:28:27.401 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:27.402 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":115,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:23.927141+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6832/30396136":"2023-08-28T11:28:20.461769+0000","172.21.15.43:6835/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6834/3995831020":"2023-08-28T11:28:09.170974+0000","172.21.15.43:6837/1939845776":"2023-08-28T11:27:55.101994+0000","172.21.15.57:6834/30396136":"2023-08-28T11:28:20.461769+0000","172.21.15.43:6836/1939845776":"2023-08-28T11:27:55.101994+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:27.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 msgr2=0x7fc40c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 0x7fc40c06c5a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0012e0 tx=0x7fc41c009040 comp rx=0 tx=0).stop 2023-08-27T11:28:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 msgr2=0x7fc4281ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c500 tx=0x7fc42000c810 comp rx=0 tx=0).stop 2023-08-27T11:28:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 shutdown_connections 2023-08-27T11:28:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc40c06a0e0 0x7fc40c06c5a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc428151a90 0x7fc4281ecef0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc42806ad70 0x7fc4281ec2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 --2- 172.21.15.43:0/2163866812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4280c4630 0x7fc4281539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 >> 172.21.15.43:0/2163866812 conn(0x7fc4280ab820 msgr2=0x7fc42806b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 shutdown_connections 2023-08-27T11:28:27.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.402+0000 7fc42ebff700 1 -- 172.21.15.43:0/2163866812 wait complete. 2023-08-27T11:28:27.422 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:28:27.423 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:28:27.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.625+0000 7f18367ff700 1 Processor -- start 2023-08-27T11:28:27.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.625+0000 7f18367ff700 1 -- start start 2023-08-27T11:28:27.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.626+0000 7f18367ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1830157a30 0x7f18300c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.626+0000 7f18367ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f18300c72e0 0x7f1830154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.626+0000 7f18367ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1830154600 con 0x7f18300c3b30 2023-08-27T11:28:27.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f18367ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300c66c0 con 0x7f18300c72e0 2023-08-27T11:28:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f18367ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300700a0 con 0x7f1830157a30 2023-08-27T11:28:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f18300c72e0 0x7f1830154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f18300c72e0 0x7f1830154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49536/0 (socket says 172.21.15.43:49536) 2023-08-27T11:28:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 -- 172.21.15.43:0/3689090943 learned_addr learned my addr 172.21.15.43:0/3689090943 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:27.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f182f7fe700 1 --2- 172.21.15.43:0/3689090943 >> v2:172.21.15.57:3300/0 conn(0x7f1830157a30 0x7f18300c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 -- 172.21.15.43:0/3689090943 >> v2:172.21.15.57:3300/0 conn(0x7f1830157a30 msgr2=0x7f18300c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 --2- 172.21.15.43:0/3689090943 >> v2:172.21.15.57:3300/0 conn(0x7f1830157a30 0x7f18300c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 -- 172.21.15.43:0/3689090943 >> v1:172.21.15.57:6789/0 conn(0x7f18300c3b30 legacy=0x7f18300a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.627+0000 7f1834d9c700 1 -- 172.21.15.43:0/3689090943 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183006f800 con 0x7f18300c72e0 2023-08-27T11:28:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f1834d9c700 1 --2- 172.21.15.43:0/3689090943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c72e0 0x7f1830154a90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f18300c4530 tx=0x7f182800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583f04f541c27095 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f182effd700 1 -- 172.21.15.43:0/3689090943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800e070 con 0x7f18300c72e0 2023-08-27T11:28:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f182effd700 1 -- 172.21.15.43:0/3689090943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182800b9c0 con 0x7f18300c72e0 2023-08-27T11:28:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f182effd700 1 -- 172.21.15.43:0/3689090943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182800bd70 con 0x7f18300c72e0 2023-08-27T11:28:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f18367ff700 1 -- 172.21.15.43:0/3689090943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c72e0 msgr2=0x7f1830154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.628+0000 7f18367ff700 1 --2- 172.21.15.43:0/3689090943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c72e0 0x7f1830154a90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f18300c4530 tx=0x7f182800b330 comp rx=0 tx=0).stop 2023-08-27T11:28:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 -- 172.21.15.43:0/3689090943 shutdown_connections 2023-08-27T11:28:27.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 --2- 172.21.15.43:0/3689090943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c72e0 0x7f1830154a90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 --2- 172.21.15.43:0/3689090943 >> v2:172.21.15.57:3300/0 conn(0x7f1830157a30 0x7f18300c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 -- 172.21.15.43:0/3689090943 >> 172.21.15.43:0/3689090943 conn(0x7f18300a97d0 msgr2=0x7f18300a9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:27.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 -- 172.21.15.43:0/3689090943 shutdown_connections 2023-08-27T11:28:27.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.629+0000 7f18367ff700 1 -- 172.21.15.43:0/3689090943 wait complete. 2023-08-27T11:28:27.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.630+0000 7f18367ff700 1 Processor -- start 2023-08-27T11:28:27.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.630+0000 7f18367ff700 1 -- start start 2023-08-27T11:28:27.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18300c72e0 0x7f18301ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1830157a30 0x7f18301e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c0fe0 con 0x7f18300c3b30 2023-08-27T11:28:27.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300c04d0 con 0x7f18300c72e0 2023-08-27T11:28:27.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.631+0000 7f18367ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18301526b0 con 0x7f1830157a30 2023-08-27T11:28:27.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49542/0 (socket says 172.21.15.43:49542) 2023-08-27T11:28:27.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 -- 172.21.15.43:0/1175642888 learned_addr learned my addr 172.21.15.43:0/1175642888 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:27.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182f7fe700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18300c72e0 0x7f18301ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f1834d9c700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1830157a30 0x7f18301e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 -- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1830157a30 msgr2=0x7f18301e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1830157a30 0x7f18301e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 -- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18300c72e0 msgr2=0x7f18301ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18300c72e0 0x7f18301ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 -- 172.21.15.43:0/1175642888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828009b30 con 0x7f18300c3b30 2023-08-27T11:28:27.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.632+0000 7f182ffff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f182000c510 tx=0x7f182000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.633+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200052d0 con 0x7f18300c3b30 2023-08-27T11:28:27.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.633+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820005430 con 0x7f18300c3b30 2023-08-27T11:28:27.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.633+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200038c0 con 0x7f18300c3b30 2023-08-27T11:28:27.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.633+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18301ed890 con 0x7f18300c3b30 2023-08-27T11:28:27.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.633+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300c18c0 con 0x7f18300c3b30 2023-08-27T11:28:27.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.634+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830156a20 con 0x7f18300c3b30 2023-08-27T11:28:27.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.635+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1820003a20 con 0x7f18300c3b30 2023-08-27T11:28:27.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.636+0000 7f182cff9700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:27.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.636+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f18200876d0 con 0x7f18300c3b30 2023-08-27T11:28:27.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.636+0000 7f182f7fe700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:27.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.637+0000 7f182f7fe700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 0x7f181c06c5a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f18301ea9a0 tx=0x7f1824008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:27.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.640+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1820053000 con 0x7f18300c3b30 2023-08-27T11:28:27.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.851+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f183004ee70 con 0x7f18300c3b30 2023-08-27T11:28:27.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.852+0000 7f182cff9700 1 -- 172.21.15.43:0/1175642888 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v115) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1820056620 con 0x7f18300c3b30 2023-08-27T11:28:27.853 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:28:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 msgr2=0x7f181c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 0x7f181c06c5a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f18301ea9a0 tx=0x7f1824008040 comp rx=0 tx=0).stop 2023-08-27T11:28:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 msgr2=0x7f1830156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f182000c510 tx=0x7f182000c820 comp rx=0 tx=0).stop 2023-08-27T11:28:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 shutdown_connections 2023-08-27T11:28:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f181c06a0e0 0x7f181c06c5a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1830157a30 0x7f18301e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f18300c3b30 0x7f1830156d00 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 --2- 172.21.15.43:0/1175642888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18300c72e0 0x7f18301ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 >> 172.21.15.43:0/1175642888 conn(0x7f18300a97d0 msgr2=0x7f18300a8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:27.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 shutdown_connections 2023-08-27T11:28:27.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:27.854+0000 7f18367ff700 1 -- 172.21.15.43:0/1175642888 wait complete. 2023-08-27T11:28:27.873 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:28:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.077+0000 7f74737ff700 1 Processor -- start 2023-08-27T11:28:28.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.077+0000 7f74737ff700 1 -- start start 2023-08-27T11:28:28.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.078+0000 7f74737ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f746c0ac410 0x7f746c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.078+0000 7f74737ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c0c94c0 0x7f746c15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f74737ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c0c80c0 con 0x7f746c0c49f0 2023-08-27T11:28:28.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f74737ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c1555a0 con 0x7f746c0c94c0 2023-08-27T11:28:28.081 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f74737ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c1552c0 con 0x7f746c0ac410 2023-08-27T11:28:28.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c0c94c0 0x7f746c15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f746c0c94c0 0x7f746c15eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49558/0 (socket says 172.21.15.43:49558) 2023-08-27T11:28:28.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 -- 172.21.15.43:0/2044655123 learned_addr learned my addr 172.21.15.43:0/2044655123 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:28.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7470d9a700 1 --2- 172.21.15.43:0/2044655123 >> v2:172.21.15.57:3300/0 conn(0x7f746c0ac410 0x7f746c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 -- 172.21.15.43:0/2044655123 >> v2:172.21.15.57:3300/0 conn(0x7f746c0ac410 msgr2=0x7f746c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:28.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 --2- 172.21.15.43:0/2044655123 >> v2:172.21.15.57:3300/0 conn(0x7f746c0ac410 0x7f746c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 -- 172.21.15.43:0/2044655123 >> v1:172.21.15.57:6789/0 conn(0x7f746c0c49f0 legacy=0x7f746c151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.079+0000 7f7471d9c700 1 -- 172.21.15.43:0/2044655123 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0c8360 con 0x7f746c0c94c0 2023-08-27T11:28:28.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f7471d9c700 1 --2- 172.21.15.43:0/2044655123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0c94c0 0x7f746c15eee0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f746c072830 tx=0x7f746400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a787e904fad680 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f7463fff700 1 -- 172.21.15.43:0/2044655123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400e070 con 0x7f746c0c94c0 2023-08-27T11:28:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f7463fff700 1 -- 172.21.15.43:0/2044655123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400b910 con 0x7f746c0c94c0 2023-08-27T11:28:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f7463fff700 1 -- 172.21.15.43:0/2044655123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400bcc0 con 0x7f746c0c94c0 2023-08-27T11:28:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f74737ff700 1 -- 172.21.15.43:0/2044655123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0c94c0 msgr2=0x7f746c15eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.080+0000 7f74737ff700 1 --2- 172.21.15.43:0/2044655123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0c94c0 0x7f746c15eee0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f746c072830 tx=0x7f746400b330 comp rx=0 tx=0).stop 2023-08-27T11:28:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 -- 172.21.15.43:0/2044655123 shutdown_connections 2023-08-27T11:28:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 --2- 172.21.15.43:0/2044655123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0c94c0 0x7f746c15eee0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 --2- 172.21.15.43:0/2044655123 >> v2:172.21.15.57:3300/0 conn(0x7f746c0ac410 0x7f746c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 -- 172.21.15.43:0/2044655123 >> 172.21.15.43:0/2044655123 conn(0x7f746c0ab8f0 msgr2=0x7f746c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 -- 172.21.15.43:0/2044655123 shutdown_connections 2023-08-27T11:28:28.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.081+0000 7f74737ff700 1 -- 172.21.15.43:0/2044655123 wait complete. 2023-08-27T11:28:28.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.082+0000 7f74737ff700 1 Processor -- start 2023-08-27T11:28:28.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.083+0000 7f74737ff700 1 -- start start 2023-08-27T11:28:28.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.083+0000 7f74737ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.083+0000 7f74737ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f746c0c49f0 0x7f746c1e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f74737ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f746c0c94c0 0x7f746c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f74737ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c157900 con 0x7f746c0ac410 2023-08-27T11:28:28.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f74737ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0ada10 con 0x7f746c0c49f0 2023-08-27T11:28:28.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f74737ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c1573d0 con 0x7f746c0c94c0 2023-08-27T11:28:28.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49566/0 (socket says 172.21.15.43:49566) 2023-08-27T11:28:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 -- 172.21.15.43:0/3560657735 learned_addr learned my addr 172.21.15.43:0/3560657735 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f7470d9a700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f746c0c49f0 0x7f746c1e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f7471d9c700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f746c0c94c0 0x7f746c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 -- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f746c0c94c0 msgr2=0x7f746c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f746c0c94c0 0x7f746c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 -- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f746c0c49f0 msgr2=0x7f746c1e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f746c0c49f0 0x7f746c1e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.084+0000 7f747159b700 1 -- 172.21.15.43:0/3560657735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464009b30 con 0x7f746c0ac410 2023-08-27T11:28:28.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f747159b700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f746800c4e0 tx=0x7f746800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74680052d0 con 0x7f746c0ac410 2023-08-27T11:28:28.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746800ce90 con 0x7f746c0ac410 2023-08-27T11:28:28.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c1e77e0 con 0x7f746c0ac410 2023-08-27T11:28:28.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468003680 con 0x7f746c0ac410 2023-08-27T11:28:28.093 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.085+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c157620 con 0x7f746c0ac410 2023-08-27T11:28:28.094 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.086+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c0ad320 con 0x7f746c0ac410 2023-08-27T11:28:28.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.087+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74680037e0 con 0x7f746c0ac410 2023-08-27T11:28:28.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.088+0000 7f7461ffb700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 0x7f745006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.088+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7468087670 con 0x7f746c0ac410 2023-08-27T11:28:28.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.088+0000 7f7470d9a700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 0x7f745006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.089+0000 7f7470d9a700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 0x7f745006c5a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f746c14cfb0 tx=0x7f745c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.093+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7468052fa0 con 0x7f746c0ac410 2023-08-27T11:28:28.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.301+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f746c151e60 con 0x7f746c0ac410 2023-08-27T11:28:28.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.302+0000 7f7461ffb700 1 -- 172.21.15.43:0/3560657735 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74680565c0 con 0x7f746c0ac410 2023-08-27T11:28:28.303 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:28:28.305 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 msgr2=0x7f745006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 0x7f745006c5a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f746c14cfb0 tx=0x7f745c009210 comp rx=0 tx=0).stop 2023-08-27T11:28:28.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 msgr2=0x7f746c0ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f746800c4e0 tx=0x7f746800c7f0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.306 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 shutdown_connections 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f745006a0e0 0x7f745006c5a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f746c0c94c0 0x7f746c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f746c0ac410 0x7f746c0ad4d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 --2- 172.21.15.43:0/3560657735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f746c0c49f0 0x7f746c1e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 >> 172.21.15.43:0/3560657735 conn(0x7f746c0ab8f0 msgr2=0x7f746c0aa660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:28.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 shutdown_connections 2023-08-27T11:28:28.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.304+0000 7f74737ff700 1 -- 172.21.15.43:0/3560657735 wait complete. 2023-08-27T11:28:28.323 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:28:28.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.526+0000 7f0fa59ff700 1 Processor -- start 2023-08-27T11:28:28.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.526+0000 7f0fa59ff700 1 -- start start 2023-08-27T11:28:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.527+0000 7f0fa59ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa00c7c00 0x7f0fa00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.527+0000 7f0fa59ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa006a8e0 0x7f0fa006ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.527+0000 7f0fa59ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa0154660 con 0x7f0fa0151d20 2023-08-27T11:28:28.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.527+0000 7f0fa59ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa00c5750 con 0x7f0fa00c7c00 2023-08-27T11:28:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.527+0000 7f0fa59ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0154940 con 0x7f0fa006a8e0 2023-08-27T11:28:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa00c7c00 0x7f0fa00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9effd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0fa0151d20 0x7f0fa00ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43052/0 (socket says 172.21.15.43:43052) 2023-08-27T11:28:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa00c7c00 0x7f0fa00c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49574/0 (socket says 172.21.15.43:49574) 2023-08-27T11:28:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9effd700 1 -- 172.21.15.43:0/3038161795 learned_addr learned my addr 172.21.15.43:0/3038161795 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9f7fe700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa006a8e0 0x7f0fa006ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 -- 172.21.15.43:0/3038161795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa006a8e0 msgr2=0x7f0fa006ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa006a8e0 0x7f0fa006ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 -- 172.21.15.43:0/3038161795 >> v1:172.21.15.43:6789/0 conn(0x7f0fa0151d20 legacy=0x7f0fa00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 -- 172.21.15.43:0/3038161795 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0154c20 con 0x7f0fa00c7c00 2023-08-27T11:28:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9dffb700 1 -- 172.21.15.43:0/3038161795 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893180450 0 0) 0x7f0fa0154660 con 0x7f0fa0151d20 2023-08-27T11:28:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.528+0000 7f0f9e7fc700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa00c7c00 0x7f0fa00c8110 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009840 tx=0x7f0f94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88467c33f5f0da5c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0f9dffb700 1 -- 172.21.15.43:0/3038161795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011830 con 0x7f0fa00c7c00 2023-08-27T11:28:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0f9dffb700 1 -- 172.21.15.43:0/3038161795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94011990 con 0x7f0fa00c7c00 2023-08-27T11:28:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0f9dffb700 1 -- 172.21.15.43:0/3038161795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94011d20 con 0x7f0fa00c7c00 2023-08-27T11:28:28.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 -- 172.21.15.43:0/3038161795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa00c7c00 msgr2=0x7f0fa00c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa00c7c00 0x7f0fa00c8110 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009840 tx=0x7f0f94009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:28.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 -- 172.21.15.43:0/3038161795 shutdown_connections 2023-08-27T11:28:28.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa006a8e0 0x7f0fa006ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/3038161795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa00c7c00 0x7f0fa00c8110 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 -- 172.21.15.43:0/3038161795 >> 172.21.15.43:0/3038161795 conn(0x7f0fa00c9d00 msgr2=0x7f0fa00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:28.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 -- 172.21.15.43:0/3038161795 shutdown_connections 2023-08-27T11:28:28.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.529+0000 7f0fa59ff700 1 -- 172.21.15.43:0/3038161795 wait complete. 2023-08-27T11:28:28.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.532+0000 7f0fa59ff700 1 Processor -- start 2023-08-27T11:28:28.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.532+0000 7f0fa59ff700 1 -- start start 2023-08-27T11:28:28.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa00c7c00 0x7f0fa00c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa0151d20 0x7f0fa0150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.539 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01e9790 con 0x7f0fa006a8e0 2023-08-27T11:28:28.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c1280 con 0x7f0fa0151d20 2023-08-27T11:28:28.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0fa59ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c16f0 con 0x7f0fa00c7c00 2023-08-27T11:28:28.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0f9effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0f9effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:49578/0 (socket says 172.21.15.43:49578) 2023-08-27T11:28:28.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.533+0000 7f0f9effd700 1 -- 172.21.15.43:0/1508345775 learned_addr learned my addr 172.21.15.43:0/1508345775 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9e7fc700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa00c7c00 0x7f0fa00c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9f7fe700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa0151d20 0x7f0fa0150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 -- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa00c7c00 msgr2=0x7f0fa00c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa00c7c00 0x7f0fa00c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 -- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa0151d20 msgr2=0x7f0fa0150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa0151d20 0x7f0fa0150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 -- 172.21.15.43:0/1508345775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940094a0 con 0x7f0fa006a8e0 2023-08-27T11:28:28.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f9effd700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000c550 tx=0x7f0f9000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90004c80 con 0x7f0fa006a8e0 2023-08-27T11:28:28.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f90004e00 con 0x7f0fa006a8e0 2023-08-27T11:28:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa00c19d0 con 0x7f0fa006a8e0 2023-08-27T11:28:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.534+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90007310 con 0x7f0fa006a8e0 2023-08-27T11:28:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.535+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa0150680 con 0x7f0fa006a8e0 2023-08-27T11:28:28.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.536+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa004ee70 con 0x7f0fa006a8e0 2023-08-27T11:28:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.536+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f90007470 con 0x7f0fa006a8e0 2023-08-27T11:28:28.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.538+0000 7f0f87fff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:28.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.538+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0f90087f40 con 0x7f0fa006a8e0 2023-08-27T11:28:28.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.538+0000 7f0f9e7fc700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:28.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.539+0000 7f0f9e7fc700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0f940090b0 tx=0x7f0f94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:28.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.542+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0f90053870 con 0x7f0fa006a8e0 2023-08-27T11:28:28.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.755+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0fa00ac650 con 0x7f0fa006a8e0 2023-08-27T11:28:28.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.759+0000 7f0f87fff700 1 -- 172.21.15.43:0/1508345775 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f90056e90 con 0x7f0fa006a8e0 2023-08-27T11:28:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 msgr2=0x7f0f8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0f940090b0 tx=0x7f0f94008030 comp rx=0 tx=0).stop 2023-08-27T11:28:28.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 msgr2=0x7f0fa01ea820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:28.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000c550 tx=0x7f0f9000c860 comp rx=0 tx=0).stop 2023-08-27T11:28:28.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 shutdown_connections 2023-08-27T11:28:28.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa0151d20 0x7f0fa0150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa006a8e0 0x7f0fa01ea820 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 --2- 172.21.15.43:0/1508345775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa00c7c00 0x7f0fa00c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.761+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 >> 172.21.15.43:0/1508345775 conn(0x7f0fa00c9d00 msgr2=0x7f0fa0150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.762+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 shutdown_connections 2023-08-27T11:28:28.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:28.762+0000 7f0fa59ff700 1 -- 172.21.15.43:0/1508345775 wait complete. 2023-08-27T11:28:28.781 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:28:28.781 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:28:28.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:28:28.986 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:28:28.987 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:28:28.987 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:28:29.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:28:29.032 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:28:29.032 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:28:29.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:28:29.078 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:28:29.078 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:29.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.277+0000 7ff5b27ff700 1 Processor -- start 2023-08-27T11:28:29.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.277+0000 7ff5b27ff700 1 -- start start 2023-08-27T11:28:29.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5b27ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff5ac151a90 0x7ff5ac0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5b27ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 0x7ff5ac0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5b27ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac06c4e0 con 0x7ff5ac06ad70 2023-08-27T11:28:29.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5b27ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac155370 con 0x7ff5ac151a90 2023-08-27T11:28:29.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5b27ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac151e70 con 0x7ff5ac0c4630 2023-08-27T11:28:29.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.278+0000 7ff5abfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff5ac151a90 0x7ff5ac0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5b0d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff5ac06ad70 0x7ff5ac06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59086/0 (socket says 172.21.15.43:59086) 2023-08-27T11:28:29.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5b0d9c700 1 -- 172.21.15.43:0/618299297 learned_addr learned my addr 172.21.15.43:0/618299297 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:29.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5ab7fe700 1 --2- 172.21.15.43:0/618299297 >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 0x7ff5ac0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5abfff700 1 -- 172.21.15.43:0/618299297 >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 msgr2=0x7ff5ac0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:29.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5abfff700 1 --2- 172.21.15.43:0/618299297 >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 0x7ff5ac0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5abfff700 1 -- 172.21.15.43:0/618299297 >> v1:172.21.15.43:6789/0 conn(0x7ff5ac06ad70 legacy=0x7ff5ac06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5abfff700 1 -- 172.21.15.43:0/618299297 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac154480 con 0x7ff5ac151a90 2023-08-27T11:28:29.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5aaffd700 1 -- 172.21.15.43:0/618299297 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705154001 0 0) 0x7ff5ac06c4e0 con 0x7ff5ac06ad70 2023-08-27T11:28:29.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5ab7fe700 1 --2- 172.21.15.43:0/618299297 >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 0x7ff5ac0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:29.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.279+0000 7ff5abfff700 1 --2- 172.21.15.43:0/618299297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac151a90 0x7ff5ac0c7bb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c7740 tx=0x7ff59c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847d6800787aa517 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5aaffd700 1 -- 172.21.15.43:0/618299297 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c011830 con 0x7ff5ac151a90 2023-08-27T11:28:29.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5aaffd700 1 -- 172.21.15.43:0/618299297 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c011990 con 0x7ff5ac151a90 2023-08-27T11:28:29.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5aaffd700 1 -- 172.21.15.43:0/618299297 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c011d20 con 0x7ff5ac151a90 2023-08-27T11:28:29.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 -- 172.21.15.43:0/618299297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac151a90 msgr2=0x7ff5ac0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/618299297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac151a90 0x7ff5ac0c7bb0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0c7740 tx=0x7ff59c009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:29.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 -- 172.21.15.43:0/618299297 shutdown_connections 2023-08-27T11:28:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/618299297 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac151a90 0x7ff5ac0c7bb0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/618299297 >> v2:172.21.15.57:3300/0 conn(0x7ff5ac0c4630 0x7ff5ac0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 -- 172.21.15.43:0/618299297 >> 172.21.15.43:0/618299297 conn(0x7ff5ac0ab820 msgr2=0x7ff5ac0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 -- 172.21.15.43:0/618299297 shutdown_connections 2023-08-27T11:28:29.287 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.280+0000 7ff5b27ff700 1 -- 172.21.15.43:0/618299297 wait complete. 2023-08-27T11:28:29.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.282+0000 7ff5b27ff700 1 Processor -- start 2023-08-27T11:28:29.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.282+0000 7ff5b27ff700 1 -- start start 2023-08-27T11:28:29.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5ac06ad70 0x7ff5ac0a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5ac151a90 0x7ff5ac1e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0aa930 con 0x7ff5ac0c4630 2023-08-27T11:28:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0aa600 con 0x7ff5ac151a90 2023-08-27T11:28:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5b27ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0ab0d0 con 0x7ff5ac06ad70 2023-08-27T11:28:29.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38696/0 (socket says 172.21.15.43:38696) 2023-08-27T11:28:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.283+0000 7ff5ab7fe700 1 -- 172.21.15.43:0/4271378503 learned_addr learned my addr 172.21.15.43:0/4271378503 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5b0d9c700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5ac151a90 0x7ff5ac1e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5abfff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5ac06ad70 0x7ff5ac0a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 -- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5ac06ad70 msgr2=0x7ff5ac0a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5ac06ad70 0x7ff5ac0a9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 -- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5ac151a90 msgr2=0x7ff5ac1e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5ac151a90 0x7ff5ac1e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 -- 172.21.15.43:0/4271378503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0094a0 con 0x7ff5ac0c4630 2023-08-27T11:28:29.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5ab7fe700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c750 tx=0x7ff5a000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011800 con 0x7ff5ac0c4630 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.284+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0011960 con 0x7ff5ac0c4630 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.285+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011cd0 con 0x7ff5ac0c4630 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.285+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac0aab70 con 0x7ff5ac0c4630 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.285+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0c3bf0 con 0x7ff5ac0c4630 2023-08-27T11:28:29.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.286+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac1e9910 con 0x7ff5ac0c4630 2023-08-27T11:28:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.287+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5a0021350 con 0x7ff5ac0c4630 2023-08-27T11:28:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.288+0000 7ff5a8ff9700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 0x7ff59806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.288+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff5a0088100 con 0x7ff5ac0c4630 2023-08-27T11:28:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.288+0000 7ff5abfff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 0x7ff59806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.289+0000 7ff5abfff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 0x7ff59806c5a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.296 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.292+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff5ac1e9910 con 0x7ff5ac0c4630 2023-08-27T11:28:29.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.548+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5ac1e9910 con 0x7ff5ac0c4630 2023-08-27T11:28:29.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.549+0000 7ff5a8ff9700 1 -- 172.21.15.43:0/4271378503 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+3701 (secure 0 0 0) 0x7ff5a001ee90 con 0x7ff5ac0c4630 2023-08-27T11:28:29.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:29.550 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":123,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7198,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/2128138968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2128138968},{"type":"v1","addr":"172.21.15.57:6835","nonce":2128138968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":7363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1498551988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1498551988},{"type":"v1","addr":"172.21.15.43:6837","nonce":1498551988}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":114},{"gid":7525,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/754657577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":754657577},{"type":"v1","addr":"172.21.15.57:6834","nonce":754657577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":123},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/2173430717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":2173430717},{"type":"v1","addr":"172.21.15.43:6835","nonce":2173430717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[]} 2023-08-27T11:28:29.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 msgr2=0x7ff59806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 0x7ff59806c5a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c01c040 comp rx=0 tx=0).stop 2023-08-27T11:28:29.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 msgr2=0x7ff5ac1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c750 tx=0x7ff5a000ca60 comp rx=0 tx=0).stop 2023-08-27T11:28:29.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 shutdown_connections 2023-08-27T11:28:29.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff59806a0e0 0x7ff59806c5a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5ac151a90 0x7ff5ac1e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5ac06ad70 0x7ff5ac0a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 --2- 172.21.15.43:0/4271378503 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5ac0c4630 0x7ff5ac1532d0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 >> 172.21.15.43:0/4271378503 conn(0x7ff5ac0ab820 msgr2=0x7ff5ac149ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:29.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 shutdown_connections 2023-08-27T11:28:29.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.551+0000 7ff5b27ff700 1 -- 172.21.15.43:0/4271378503 wait complete. 2023-08-27T11:28:29.555 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 123 2023-08-27T11:28:29.572 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:28:29.573 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:28:29.573 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:28:29.573 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:28:29.573 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:28:29.574 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:28:29.574 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:28:29.574 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:28:29.575 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:28:29.575 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:28:29.575 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:28:29.575 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:28:29.576 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:28:29.576 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:28:29.576 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:28:29.576 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:28:29.587 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:28:29.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:28:29.588 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:28:29.589 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:28:29.595 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:28:29.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:28:29.596 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:28:29.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:28:29.634 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:28:29.635 DEBUG:teuthology.parallel:result is None 2023-08-27T11:28:29.638 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:28:29.638 DEBUG:teuthology.parallel:result is None 2023-08-27T11:28:29.640 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:28:29.640 DEBUG:teuthology.parallel:result is None 2023-08-27T11:28:29.643 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:28:29.643 DEBUG:teuthology.parallel:result is None 2023-08-27T11:28:29.643 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:28:29.786 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:28:29.788 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:28:29.798 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:28:29.798 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:28:29.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.857+0000 7f80759ff700 1 Processor -- start 2023-08-27T11:28:29.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.858+0000 7f80759ff700 1 -- start start 2023-08-27T11:28:29.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80700c51a0 0x7f807006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f807006ca60 0x7f80700aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80700ab040 0x7f8070155910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80701530b0 con 0x7f80700c51a0 2023-08-27T11:28:29.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807014c860 con 0x7f80700ab040 2023-08-27T11:28:29.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f80759ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807006d700 con 0x7f807006ca60 2023-08-27T11:28:29.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80700c51a0 0x7f807006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f80700c51a0 0x7f807006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38770/0 (socket says 172.21.15.43:38770) 2023-08-27T11:28:29.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 -- 172.21.15.43:0/1761263699 learned_addr learned my addr 172.21.15.43:0/1761263699 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:29.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806f7fe700 1 --2- 172.21.15.43:0/1761263699 >> v2:172.21.15.57:3300/0 conn(0x7f80700ab040 0x7f8070155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806e7fc700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f807006ca60 0x7f80700aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 -- 172.21.15.43:0/1761263699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f807006ca60 msgr2=0x7f80700aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:29.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f807006ca60 0x7f80700aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 -- 172.21.15.43:0/1761263699 >> v2:172.21.15.57:3300/0 conn(0x7f80700ab040 msgr2=0x7f8070155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:29.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 --2- 172.21.15.43:0/1761263699 >> v2:172.21.15.57:3300/0 conn(0x7f80700ab040 0x7f8070155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.859+0000 7f806effd700 1 -- 172.21.15.43:0/1761263699 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070152430 con 0x7f80700c51a0 2023-08-27T11:28:29.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.860+0000 7f806effd700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f807006d1c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8070152320 tx=0x7f8060009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639c12b728b2bc51 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.860+0000 7f806dffb700 1 -- 172.21.15.43:0/1761263699 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011830 con 0x7f80700c51a0 2023-08-27T11:28:29.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.860+0000 7f806dffb700 1 -- 172.21.15.43:0/1761263699 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8060011990 con 0x7f80700c51a0 2023-08-27T11:28:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.860+0000 7f806dffb700 1 -- 172.21.15.43:0/1761263699 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060011d20 con 0x7f80700c51a0 2023-08-27T11:28:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 -- 172.21.15.43:0/1761263699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 msgr2=0x7f807006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f807006d1c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8070152320 tx=0x7f8060009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:29.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 -- 172.21.15.43:0/1761263699 shutdown_connections 2023-08-27T11:28:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 --2- 172.21.15.43:0/1761263699 >> v2:172.21.15.57:3300/0 conn(0x7f80700ab040 0x7f8070155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f807006d1c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 --2- 172.21.15.43:0/1761263699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f807006ca60 0x7f80700aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 -- 172.21.15.43:0/1761263699 >> 172.21.15.43:0/1761263699 conn(0x7f807006aa50 msgr2=0x7f80700c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:29.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 -- 172.21.15.43:0/1761263699 shutdown_connections 2023-08-27T11:28:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.861+0000 7f80759ff700 1 -- 172.21.15.43:0/1761263699 wait complete. 2023-08-27T11:28:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.862+0000 7f80759ff700 1 Processor -- start 2023-08-27T11:28:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.863+0000 7f80759ff700 1 -- start start 2023-08-27T11:28:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.863+0000 7f80759ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f80759ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80700ab040 0x7f80701ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f80759ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f8070149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f80759ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700a6ec0 con 0x7f80700c51a0 2023-08-27T11:28:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f80759ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80700a70a0 con 0x7f807006ca60 2023-08-27T11:28:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f80759ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80700a7380 con 0x7f80700ab040 2023-08-27T11:28:29.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49238/0 (socket says 172.21.15.43:49238) 2023-08-27T11:28:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 -- 172.21.15.43:0/3192223832 learned_addr learned my addr 172.21.15.43:0/3192223832 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806f7fe700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f8070149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806e7fc700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80700ab040 0x7f80701ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 -- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80700ab040 msgr2=0x7f80701ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80700ab040 0x7f80701ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 -- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 msgr2=0x7f8070149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f8070149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.864+0000 7f806effd700 1 -- 172.21.15.43:0/3192223832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009550 con 0x7f807006ca60 2023-08-27T11:28:29.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f806effd700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f8060004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060004510 con 0x7f807006ca60 2023-08-27T11:28:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806001e070 con 0x7f807006ca60 2023-08-27T11:28:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80600038e0 con 0x7f807006ca60 2023-08-27T11:28:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80700a7660 con 0x7f807006ca60 2023-08-27T11:28:29.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.865+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807014a790 con 0x7f807006ca60 2023-08-27T11:28:29.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.866+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80700a7b80 con 0x7f807006ca60 2023-08-27T11:28:29.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.867+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8060003a40 con 0x7f807006ca60 2023-08-27T11:28:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.868+0000 7f8057fff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 0x7f805c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.868+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f8060089100 con 0x7f807006ca60 2023-08-27T11:28:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.868+0000 7f806e7fc700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 0x7f805c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.869+0000 7f806e7fc700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 0x7f805c06c5a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f80700bfe10 tx=0x7f8064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:29.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:29.873+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80700a7b80 con 0x7f807006ca60 2023-08-27T11:28:30.108 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.107+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f80700a7b80 con 0x7f807006ca60 2023-08-27T11:28:30.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.985+0000 7f8057fff700 1 -- 172.21.15.43:0/3192223832 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7f80700a7b80 con 0x7f807006ca60 2023-08-27T11:28:30.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 msgr2=0x7f805c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 0x7f805c06c5a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f80700bfe10 tx=0x7f8064008040 comp rx=0 tx=0).stop 2023-08-27T11:28:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 msgr2=0x7f80701ea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f8060004750 comp rx=0 tx=0).stop 2023-08-27T11:28:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 shutdown_connections 2023-08-27T11:28:30.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f805c06a0e0 0x7f805c06c5a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80700c51a0 0x7f8070149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f807006ca60 0x7f80701ea850 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 --2- 172.21.15.43:0/3192223832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80700ab040 0x7f80701ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 >> 172.21.15.43:0/3192223832 conn(0x7f807006aa50 msgr2=0x7f80700ba760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:30.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 shutdown_connections 2023-08-27T11:28:30.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:30.988+0000 7f80759ff700 1 -- 172.21.15.43:0/3192223832 wait complete. 2023-08-27T11:28:30.992 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:28:31.011 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:28:31.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.215+0000 7fa4465ff700 1 Processor -- start 2023-08-27T11:28:31.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.215+0000 7fa4465ff700 1 -- start start 2023-08-27T11:28:31.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.216+0000 7fa4465ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4400c4630 0x7fa4400c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.216+0000 7fa4465ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 0x7fa44006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.216+0000 7fa4465ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44006c4e0 con 0x7fa440151a90 2023-08-27T11:28:31.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.216+0000 7fa4465ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa440155370 con 0x7fa4400c4630 2023-08-27T11:28:31.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.216+0000 7fa4465ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4400c82c0 con 0x7fa44006ad70 2023-08-27T11:28:31.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa440151a90 0x7fa4400c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59106/0 (socket says 172.21.15.43:59106) 2023-08-27T11:28:31.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43ffff700 1 -- 172.21.15.43:0/1313948032 learned_addr learned my addr 172.21.15.43:0/1313948032 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:31.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1313948032 >> v2:172.21.15.43:3300/0 conn(0x7fa4400c4630 0x7fa4400c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa444b9c700 1 --2- 172.21.15.43:0/1313948032 >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 0x7fa44006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1313948032 >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 msgr2=0x7fa44006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:31.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43effd700 1 -- 172.21.15.43:0/1313948032 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429068100 0 0) 0x7fa44006c4e0 con 0x7fa440151a90 2023-08-27T11:28:31.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1313948032 >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 0x7fa44006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1313948032 >> v1:172.21.15.43:6789/0 conn(0x7fa440151a90 legacy=0x7fa4400c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1313948032 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440151e70 con 0x7fa4400c4630 2023-08-27T11:28:31.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa444b9c700 1 --2- 172.21.15.43:0/1313948032 >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 0x7fa44006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:31.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.217+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1313948032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4400c4a90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa4400c4270 tx=0x7fa434009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28793465b901823 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa43effd700 1 -- 172.21.15.43:0/1313948032 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011830 con 0x7fa4400c4630 2023-08-27T11:28:31.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa43effd700 1 -- 172.21.15.43:0/1313948032 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434011990 con 0x7fa4400c4630 2023-08-27T11:28:31.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa43effd700 1 -- 172.21.15.43:0/1313948032 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011d20 con 0x7fa4400c4630 2023-08-27T11:28:31.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 -- 172.21.15.43:0/1313948032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 msgr2=0x7fa4400c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1313948032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4400c4a90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa4400c4270 tx=0x7fa434009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:31.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 -- 172.21.15.43:0/1313948032 shutdown_connections 2023-08-27T11:28:31.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1313948032 >> v2:172.21.15.57:3300/0 conn(0x7fa44006ad70 0x7fa44006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1313948032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4400c4a90 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 -- 172.21.15.43:0/1313948032 >> 172.21.15.43:0/1313948032 conn(0x7fa4400ab820 msgr2=0x7fa4400abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:31.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 -- 172.21.15.43:0/1313948032 shutdown_connections 2023-08-27T11:28:31.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.218+0000 7fa4465ff700 1 -- 172.21.15.43:0/1313948032 wait complete. 2023-08-27T11:28:31.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.220+0000 7fa4465ff700 1 Processor -- start 2023-08-27T11:28:31.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.220+0000 7fa4465ff700 1 -- start start 2023-08-27T11:28:31.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44006ad70 0x7fa44014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa440151a90 0x7fa440147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa440147b40 con 0x7fa4400c4630 2023-08-27T11:28:31.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa440157340 con 0x7fa440151a90 2023-08-27T11:28:31.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa4465ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa440157850 con 0x7fa44006ad70 2023-08-27T11:28:31.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38794/0 (socket says 172.21.15.43:38794) 2023-08-27T11:28:31.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1097013265 learned_addr learned my addr 172.21.15.43:0/1097013265 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:31.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43ffff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44006ad70 0x7fa44014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa444b9c700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa440151a90 0x7fa440147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44006ad70 msgr2=0x7fa44014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44006ad70 0x7fa44014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa440151a90 msgr2=0x7fa440147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa440151a90 0x7fa440147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.222+0000 7fa43f7fe700 1 -- 172.21.15.43:0/1097013265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4340094a0 con 0x7fa4400c4630 2023-08-27T11:28:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa43f7fe700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa434009b60 tx=0x7fa434004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340045d0 con 0x7fa4400c4630 2023-08-27T11:28:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43401f070 con 0x7fa4400c4630 2023-08-27T11:28:31.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4401562d0 con 0x7fa4400c4630 2023-08-27T11:28:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4340038e0 con 0x7fa4400c4630 2023-08-27T11:28:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.223+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4400a9ab0 con 0x7fa4400c4630 2023-08-27T11:28:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.224+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4400a9e00 con 0x7fa4400c4630 2023-08-27T11:28:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.225+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa434003a40 con 0x7fa4400c4630 2023-08-27T11:28:31.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.226+0000 7fa43cff9700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.226+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa434021070 con 0x7fa4400c4630 2023-08-27T11:28:31.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.227+0000 7fa43ffff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.227+0000 7fa43ffff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa430000f60 tx=0x7fa430007e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.231+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4340555d0 con 0x7fa4400c4630 2023-08-27T11:28:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.522+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa440154720 con 0x7fa4400c4630 2023-08-27T11:28:31.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.522+0000 7fa43cff9700 1 -- 172.21.15.43:0/1097013265 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4724 (secure 0 0 0) 0x7fa434015020 con 0x7fa4400c4630 2023-08-27T11:28:31.524 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:31.524 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:31.524 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:28:31.525 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.525 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:28:31.525 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:28:31.525 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.525 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.526 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:28:31.526 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:28:31.526 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.526 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.526 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.527 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.527 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:28:31.527 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:28:31.527 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.527 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.528 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:28:31.528 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:28:31.528 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.528 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.528 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.529 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.529 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:28:31.529 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:28:31.529 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.529 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.530 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.531 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:28:31.531 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:28:31.531 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.531 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.532 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:28:31.532 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:28:31.532 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.532 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.532 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.533 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.533 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:28:31.533 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:28:31.533 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.533 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.534 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.534 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.534 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.534 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.534 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.535 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:28:31.535 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:28:31.535 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.535 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.535 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:28:31.536 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:28:31.537 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.537 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.537 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.537 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.537 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.538 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.538 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.538 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:28:31.538 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:28:31.539 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.539 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.539 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.539 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.539 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.540 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.540 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.540 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:28:31.540 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:28:31.541 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.541 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.541 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.541 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.541 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.542 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.543 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.543 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.543 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.543 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.543 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.544 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:28:31.544 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:28:31.544 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.544 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.544 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:28:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:28:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:28:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:28:31.546 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:28:31.547 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.548 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.548 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:28:31.548 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:28:31.548 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.548 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.549 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.549 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:28:31.549 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:28:31.549 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.549 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:28:31.550 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:28:31.550 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:28:31.550 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:28:31.550 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.550 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:28:31.551 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:28:31.552 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:28:31.552 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.552 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.552 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.552 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.553 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:28:31.553 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:28:31.553 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.553 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:28:31.553 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:28:31.554 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:28:31.555 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:28:31.555 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:28:31.555 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:28:31.555 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:28:31.555 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.556 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:31.556 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:28:31.556 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:31.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.524+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 msgr2=0x7fa42c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.524+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa430000f60 tx=0x7fa430007e70 comp rx=0 tx=0).stop 2023-08-27T11:28:31.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.524+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 msgr2=0x7fa4401470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.524+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa434009b60 tx=0x7fa434004750 comp rx=0 tx=0).stop 2023-08-27T11:28:31.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 shutdown_connections 2023-08-27T11:28:31.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa440151a90 0x7fa440147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44006ad70 0x7fa44014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 --2- 172.21.15.43:0/1097013265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4400c4630 0x7fa4401470c0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 >> 172.21.15.43:0/1097013265 conn(0x7fa4400ab820 msgr2=0x7fa44006b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:31.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 shutdown_connections 2023-08-27T11:28:31.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.525+0000 7fa4465ff700 1 -- 172.21.15.43:0/1097013265 wait complete. 2023-08-27T11:28:31.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:31.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.760+0000 7f42f93ff700 1 Processor -- start 2023-08-27T11:28:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.760+0000 7f42f93ff700 1 -- start start 2023-08-27T11:28:31.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.761+0000 7f42f93ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42f40c4630 0x7f42f40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.761+0000 7f42f93ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f42f406ad70 0x7f42f406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.761+0000 7f42f93ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f406c4e0 con 0x7f42f4151a90 2023-08-27T11:28:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.761+0000 7f42f93ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f4155370 con 0x7f42f40c4630 2023-08-27T11:28:31.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.761+0000 7f42f93ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40c82c0 con 0x7f42f406ad70 2023-08-27T11:28:31.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42f40c4630 0x7f42f40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f42f40c4630 0x7f42f40c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38796/0 (socket says 172.21.15.43:38796) 2023-08-27T11:28:31.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 -- 172.21.15.43:0/1236031406 learned_addr learned my addr 172.21.15.43:0/1236031406 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:31.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f37fe700 1 --2- 172.21.15.43:0/1236031406 >> v2:172.21.15.57:3300/0 conn(0x7f42f406ad70 0x7f42f406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 -- 172.21.15.43:0/1236031406 >> v2:172.21.15.57:3300/0 conn(0x7f42f406ad70 msgr2=0x7f42f406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 --2- 172.21.15.43:0/1236031406 >> v2:172.21.15.57:3300/0 conn(0x7f42f406ad70 0x7f42f406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 -- 172.21.15.43:0/1236031406 >> v1:172.21.15.57:6789/0 conn(0x7f42f4151a90 legacy=0x7f42f40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 -- 172.21.15.43:0/1236031406 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f4151e70 con 0x7f42f40c4630 2023-08-27T11:28:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.762+0000 7f42f27fc700 1 --2- 172.21.15.43:0/1236031406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f40c4630 0x7f42f40c4a90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f42f40c4270 tx=0x7f42e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272f92692bacb8d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f1ffb700 1 -- 172.21.15.43:0/1236031406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8011830 con 0x7f42f40c4630 2023-08-27T11:28:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f1ffb700 1 -- 172.21.15.43:0/1236031406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e8011990 con 0x7f42f40c4630 2023-08-27T11:28:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f1ffb700 1 -- 172.21.15.43:0/1236031406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8011d20 con 0x7f42f40c4630 2023-08-27T11:28:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 -- 172.21.15.43:0/1236031406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f40c4630 msgr2=0x7f42f40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 --2- 172.21.15.43:0/1236031406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f40c4630 0x7f42f40c4a90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f42f40c4270 tx=0x7f42e8009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 -- 172.21.15.43:0/1236031406 shutdown_connections 2023-08-27T11:28:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 --2- 172.21.15.43:0/1236031406 >> v2:172.21.15.57:3300/0 conn(0x7f42f406ad70 0x7f42f406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 --2- 172.21.15.43:0/1236031406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f40c4630 0x7f42f40c4a90 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 -- 172.21.15.43:0/1236031406 >> 172.21.15.43:0/1236031406 conn(0x7f42f40ab820 msgr2=0x7f42f40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 -- 172.21.15.43:0/1236031406 shutdown_connections 2023-08-27T11:28:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.763+0000 7f42f93ff700 1 -- 172.21.15.43:0/1236031406 wait complete. 2023-08-27T11:28:31.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.765+0000 7f42f93ff700 1 Processor -- start 2023-08-27T11:28:31.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.765+0000 7f42f93ff700 1 -- start start 2023-08-27T11:28:31.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42f40c4630 0x7f42f414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 0x7f42f414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f414cb40 con 0x7f42f406ad70 2023-08-27T11:28:31.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4146bf0 con 0x7f42f40c4630 2023-08-27T11:28:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f93ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f414c830 con 0x7f42f4151a90 2023-08-27T11:28:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f2ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38812/0 (socket says 172.21.15.43:38812) 2023-08-27T11:28:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.766+0000 7f42f2ffd700 1 -- 172.21.15.43:0/992462549 learned_addr learned my addr 172.21.15.43:0/992462549 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:31.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f37fe700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 0x7f42f414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f27fc700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42f40c4630 0x7f42f414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 -- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 msgr2=0x7f42f414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 0x7f42f414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 -- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42f40c4630 msgr2=0x7f42f414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42f40c4630 0x7f42f414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 -- 172.21.15.43:0/992462549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009550 con 0x7f42f406ad70 2023-08-27T11:28:31.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f37fe700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 0x7f42f414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:31.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f2ffd700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c480 tx=0x7f42e400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40052d0 con 0x7f42f406ad70 2023-08-27T11:28:31.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4005430 con 0x7f42f406ad70 2023-08-27T11:28:31.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40c3390 con 0x7f42f406ad70 2023-08-27T11:28:31.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e40038c0 con 0x7f42f406ad70 2023-08-27T11:28:31.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.767+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f4146e70 con 0x7f42f406ad70 2023-08-27T11:28:31.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.768+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f414ce20 con 0x7f42f406ad70 2023-08-27T11:28:31.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.769+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42e4003a20 con 0x7f42f406ad70 2023-08-27T11:28:31.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.770+0000 7f42db7fe700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 0x7f42e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:31.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.770+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f42e4087680 con 0x7f42f406ad70 2023-08-27T11:28:31.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.771+0000 7f42f27fc700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 0x7f42e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:31.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.771+0000 7f42f27fc700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 0x7f42e006c5a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009c10 tx=0x7f42e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:31.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.775+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f42e40530b0 con 0x7f42f406ad70 2023-08-27T11:28:31.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.985+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f404ee70 con 0x7f42f406ad70 2023-08-27T11:28:31.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.986+0000 7f42db7fe700 1 -- 172.21.15.43:0/992462549 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f42e40566d0 con 0x7f42f406ad70 2023-08-27T11:28:31.987 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:31.988 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":120,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:30.973703+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 msgr2=0x7f42e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 0x7f42e006c5a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009c10 tx=0x7f42e8008030 comp rx=0 tx=0).stop 2023-08-27T11:28:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 msgr2=0x7f42f40c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:31.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c480 tx=0x7f42e400c840 comp rx=0 tx=0).stop 2023-08-27T11:28:31.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 shutdown_connections 2023-08-27T11:28:31.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f42e006a0e0 0x7f42e006c5a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f42f4151a90 0x7f42f414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42f406ad70 0x7f42f40c2e50 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 --2- 172.21.15.43:0/992462549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f42f40c4630 0x7f42f414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:31.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 >> 172.21.15.43:0/992462549 conn(0x7f42f40ab820 msgr2=0x7f42f414ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:31.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.988+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 shutdown_connections 2023-08-27T11:28:31.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:31.989+0000 7f42f93ff700 1 -- 172.21.15.43:0/992462549 wait complete. 2023-08-27T11:28:32.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:28:32.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:28:32.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.213+0000 7fc06e7ff700 1 Processor -- start 2023-08-27T11:28:32.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.213+0000 7fc06e7ff700 1 -- start start 2023-08-27T11:28:32.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.214+0000 7fc06e7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc068151e40 0x7fc06806bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.214+0000 7fc06e7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0681588f0 con 0x7fc0680c6d60 2023-08-27T11:28:32.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.214+0000 7fc06e7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc068157ce0 con 0x7fc06806c230 2023-08-27T11:28:32.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.214+0000 7fc06e7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0680c4e90 con 0x7fc068151e40 2023-08-27T11:28:32.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc0677fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc0680c6d60 0x7fc068154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59122/0 (socket says 172.21.15.43:59122) 2023-08-27T11:28:32.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc0677fe700 1 -- 172.21.15.43:0/3147951535 learned_addr learned my addr 172.21.15.43:0/3147951535 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:32.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc067fff700 1 --2- 172.21.15.43:0/3147951535 >> v2:172.21.15.57:3300/0 conn(0x7fc068151e40 0x7fc06806bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445779082 0 0) 0x7fc0681588f0 con 0x7fc0680c6d60 2023-08-27T11:28:32.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0500035b0 con 0x7fc0680c6d60 2023-08-27T11:28:32.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664872503 0 0) 0x7fc068157ce0 con 0x7fc06806c230 2023-08-27T11:28:32.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0681588f0 con 0x7fc06806c230 2023-08-27T11:28:32.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc067fff700 1 -- 172.21.15.43:0/3147951535 >> v1:172.21.15.57:6789/0 conn(0x7fc06806c230 legacy=0x7fc068154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc067fff700 1 -- 172.21.15.43:0/3147951535 >> v1:172.21.15.43:6789/0 conn(0x7fc0680c6d60 legacy=0x7fc068154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.215+0000 7fc067fff700 1 -- 172.21.15.43:0/3147951535 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068157fc0 con 0x7fc068151e40 2023-08-27T11:28:32.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc067fff700 1 --2- 172.21.15.43:0/3147951535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc068151e40 0x7fc06806bcf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc058009820 tx=0x7fc058009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d236034c676b6ed server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058005e30 con 0x7fc068151e40 2023-08-27T11:28:32.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058006030 con 0x7fc068151e40 2023-08-27T11:28:32.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc066ffd700 1 -- 172.21.15.43:0/3147951535 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580063c0 con 0x7fc068151e40 2023-08-27T11:28:32.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3147951535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc068151e40 msgr2=0x7fc06806bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.216+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3147951535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc068151e40 0x7fc06806bcf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc058009820 tx=0x7fc058009b30 comp rx=0 tx=0).stop 2023-08-27T11:28:32.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.217+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3147951535 shutdown_connections 2023-08-27T11:28:32.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.217+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3147951535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc068151e40 0x7fc06806bcf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.217+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3147951535 >> 172.21.15.43:0/3147951535 conn(0x7fc068065fe0 msgr2=0x7fc0680663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:32.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.217+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3147951535 shutdown_connections 2023-08-27T11:28:32.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.217+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3147951535 wait complete. 2023-08-27T11:28:32.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.218+0000 7fc06e7ff700 1 Processor -- start 2023-08-27T11:28:32.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.219+0000 7fc06e7ff700 1 -- start start 2023-08-27T11:28:32.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 0x7fc068153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc068151e40 0x7fc06814e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680aaaf0 con 0x7fc0680c6d60 2023-08-27T11:28:32.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0681e9850 con 0x7fc06806c230 2023-08-27T11:28:32.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06e7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0681e9b30 con 0x7fc068151e40 2023-08-27T11:28:32.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc0677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc0677fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38816/0 (socket says 172.21.15.43:38816) 2023-08-27T11:28:32.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc0677fe700 1 -- 172.21.15.43:0/3417094141 learned_addr learned my addr 172.21.15.43:0/3417094141 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:32.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc067fff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 0x7fc068153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.220+0000 7fc06cd9c700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc068151e40 0x7fc06814e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 -- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc068151e40 msgr2=0x7fc06814e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc068151e40 0x7fc06814e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 -- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 msgr2=0x7fc068153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 0x7fc068153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 -- 172.21.15.43:0/3417094141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc058009430 con 0x7fc0680c6d60 2023-08-27T11:28:32.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc067fff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 0x7fc068153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc0677fe700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00c700 tx=0x7fc05c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c005d70 con 0x7fc0680c6d60 2023-08-27T11:28:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0070d0 con 0x7fc0680c6d60 2023-08-27T11:28:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c007460 con 0x7fc0680c6d60 2023-08-27T11:28:32.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0681e9e10 con 0x7fc0680c6d60 2023-08-27T11:28:32.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.221+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0681ea3d0 con 0x7fc0680c6d60 2023-08-27T11:28:32.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.222+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06804ee70 con 0x7fc0680c6d60 2023-08-27T11:28:32.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.223+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc05c0075c0 con 0x7fc0680c6d60 2023-08-27T11:28:32.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.224+0000 7fc064ff9700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 0x7fc05406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.224+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc05c087870 con 0x7fc0680c6d60 2023-08-27T11:28:32.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.224+0000 7fc067fff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 0x7fc05406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.225+0000 7fc067fff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 0x7fc05406c5a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc058013040 tx=0x7fc058008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.228+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc05c053220 con 0x7fc0680c6d60 2023-08-27T11:28:32.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.438+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0681ecb30 con 0x7fc0680c6d60 2023-08-27T11:28:32.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.439+0000 7fc064ff9700 1 -- 172.21.15.43:0/3417094141 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc05c056840 con 0x7fc0680c6d60 2023-08-27T11:28:32.440 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:28:32.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 msgr2=0x7fc05406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 0x7fc05406c5a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc058013040 tx=0x7fc058008070 comp rx=0 tx=0).stop 2023-08-27T11:28:32.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 msgr2=0x7fc0680c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00c700 tx=0x7fc05c00cac0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 shutdown_connections 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc05406a0e0 0x7fc05406c5a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc068151e40 0x7fc06814e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc06806c230 0x7fc068153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 --2- 172.21.15.43:0/3417094141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc0680c6d60 0x7fc0680c0420 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 >> 172.21.15.43:0/3417094141 conn(0x7fc068065fe0 msgr2=0x7fc068073280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:32.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 shutdown_connections 2023-08-27T11:28:32.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.441+0000 7fc06e7ff700 1 -- 172.21.15.43:0/3417094141 wait complete. 2023-08-27T11:28:32.461 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:28:32.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.663+0000 7fd470dff700 1 Processor -- start 2023-08-27T11:28:32.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.664+0000 7fd470dff700 1 -- start start 2023-08-27T11:28:32.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd470dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd46c151b70 0x7fd46c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd470dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd46c0c4780 0x7fd46c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd470dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0c6040 con 0x7fd46c0c9010 2023-08-27T11:28:32.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd470dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0c7d00 con 0x7fd46c151b70 2023-08-27T11:28:32.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd470dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0c8510 con 0x7fd46c0c4780 2023-08-27T11:28:32.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd46a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd46c151b70 0x7fd46c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd46ad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd46c0c9010 0x7fd46c0c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59138/0 (socket says 172.21.15.43:59138) 2023-08-27T11:28:32.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd46ad9d700 1 -- 172.21.15.43:0/2138061591 learned_addr learned my addr 172.21.15.43:0/2138061591 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:32.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.665+0000 7fd463fff700 1 --2- 172.21.15.43:0/2138061591 >> v2:172.21.15.57:3300/0 conn(0x7fd46c0c4780 0x7fd46c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd46a59c700 1 -- 172.21.15.43:0/2138061591 >> v2:172.21.15.57:3300/0 conn(0x7fd46c0c4780 msgr2=0x7fd46c0c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:32.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd46a59c700 1 --2- 172.21.15.43:0/2138061591 >> v2:172.21.15.57:3300/0 conn(0x7fd46c0c4780 0x7fd46c0c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd46a59c700 1 -- 172.21.15.43:0/2138061591 >> v1:172.21.15.43:6789/0 conn(0x7fd46c0c9010 legacy=0x7fd46c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd46a59c700 1 -- 172.21.15.43:0/2138061591 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0c8b80 con 0x7fd46c151b70 2023-08-27T11:28:32.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd469d9b700 1 -- 172.21.15.43:0/2138061591 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463754976 0 0) 0x7fd46c0c6040 con 0x7fd46c0c9010 2023-08-27T11:28:32.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd46a59c700 1 --2- 172.21.15.43:0/2138061591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c151b70 0x7fd46c1550a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0c6760 tx=0x7fd45c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bfab03a5ecf4e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd469d9b700 1 -- 172.21.15.43:0/2138061591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c011830 con 0x7fd46c151b70 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd469d9b700 1 -- 172.21.15.43:0/2138061591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c011990 con 0x7fd46c151b70 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.666+0000 7fd469d9b700 1 -- 172.21.15.43:0/2138061591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c011d20 con 0x7fd46c151b70 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 -- 172.21.15.43:0/2138061591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c151b70 msgr2=0x7fd46c1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 --2- 172.21.15.43:0/2138061591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c151b70 0x7fd46c1550a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0c6760 tx=0x7fd45c009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 -- 172.21.15.43:0/2138061591 shutdown_connections 2023-08-27T11:28:32.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 --2- 172.21.15.43:0/2138061591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c151b70 0x7fd46c1550a0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 --2- 172.21.15.43:0/2138061591 >> v2:172.21.15.57:3300/0 conn(0x7fd46c0c4780 0x7fd46c0c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 -- 172.21.15.43:0/2138061591 >> 172.21.15.43:0/2138061591 conn(0x7fd46c0ab8f0 msgr2=0x7fd46c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:32.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 -- 172.21.15.43:0/2138061591 shutdown_connections 2023-08-27T11:28:32.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.667+0000 7fd470dff700 1 -- 172.21.15.43:0/2138061591 wait complete. 2023-08-27T11:28:32.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.669+0000 7fd470dff700 1 Processor -- start 2023-08-27T11:28:32.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.669+0000 7fd470dff700 1 -- start start 2023-08-27T11:28:32.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.669+0000 7fd470dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd46c0c4780 0x7fd46c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd470dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd470dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd46c151b70 0x7fd46c1eb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd470dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0c2050 con 0x7fd46c0c9010 2023-08-27T11:28:32.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd470dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1ea8f0 con 0x7fd46c151b70 2023-08-27T11:28:32.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd470dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1eaeb0 con 0x7fd46c0c4780 2023-08-27T11:28:32.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38824/0 (socket says 172.21.15.43:38824) 2023-08-27T11:28:32.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 -- 172.21.15.43:0/2271036591 learned_addr learned my addr 172.21.15.43:0/2271036591 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:32.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd46a59c700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd46c0c4780 0x7fd46c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd46ad9d700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd46c151b70 0x7fd46c1eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 -- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd46c0c4780 msgr2=0x7fd46c0c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd46c0c4780 0x7fd46c0c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 -- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd46c151b70 msgr2=0x7fd46c1eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd46c151b70 0x7fd46c1eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.670+0000 7fd463fff700 1 -- 172.21.15.43:0/2271036591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c0094a0 con 0x7fd46c0c9010 2023-08-27T11:28:32.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd463fff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd45400e810 tx=0x7fd45400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400c070 con 0x7fd46c0c9010 2023-08-27T11:28:32.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454013610 con 0x7fd46c0c9010 2023-08-27T11:28:32.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c157f00 con 0x7fd46c0c9010 2023-08-27T11:28:32.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540139c0 con 0x7fd46c0c9010 2023-08-27T11:28:32.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.671+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c1eab40 con 0x7fd46c0c9010 2023-08-27T11:28:32.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.672+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c04ee70 con 0x7fd46c0c9010 2023-08-27T11:28:32.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.673+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd454013b20 con 0x7fd46c0c9010 2023-08-27T11:28:32.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.674+0000 7fd462ffd700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 0x7fd44c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:32.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.674+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd454087f60 con 0x7fd46c0c9010 2023-08-27T11:28:32.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.674+0000 7fd46a59c700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 0x7fd44c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:32.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.675+0000 7fd46a59c700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 0x7fd44c06c5d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0090b0 tx=0x7fd45c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:32.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.678+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd4540573a0 con 0x7fd46c0c9010 2023-08-27T11:28:32.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.887+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd46c1eaff0 con 0x7fd46c0c9010 2023-08-27T11:28:32.889 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.887+0000 7fd462ffd700 1 -- 172.21.15.43:0/2271036591 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd454056f30 con 0x7fd46c0c9010 2023-08-27T11:28:32.889 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:28:32.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 msgr2=0x7fd44c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 0x7fd44c06c5d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd45c0090b0 tx=0x7fd45c01c040 comp rx=0 tx=0).stop 2023-08-27T11:28:32.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 msgr2=0x7fd46c1546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:32.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd45400e810 tx=0x7fd45400eb20 comp rx=0 tx=0).stop 2023-08-27T11:28:32.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 shutdown_connections 2023-08-27T11:28:32.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd44c06a110 0x7fd44c06c5d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd46c151b70 0x7fd46c1eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd46c0c4780 0x7fd46c0c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 --2- 172.21.15.43:0/2271036591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd46c0c9010 0x7fd46c1546e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:32.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 >> 172.21.15.43:0/2271036591 conn(0x7fd46c0ab8f0 msgr2=0x7fd46c0a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:32.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 shutdown_connections 2023-08-27T11:28:32.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:32.890+0000 7fd470dff700 1 -- 172.21.15.43:0/2271036591 wait complete. 2023-08-27T11:28:32.911 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:28:33.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.112+0000 7f6c56fff700 1 Processor -- start 2023-08-27T11:28:33.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.112+0000 7f6c56fff700 1 -- start start 2023-08-27T11:28:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c56fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6c500c50d0 0x7f6c500c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c56fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c50154d00 con 0x7f6c5014e960 2023-08-27T11:28:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c56fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c50154fe0 con 0x7f6c50154740 2023-08-27T11:28:33.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c56fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c500baf30 con 0x7f6c500c50d0 2023-08-27T11:28:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c54d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6c5014e960 0x7f6c500a7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59144/0 (socket says 172.21.15.43:59144) 2023-08-27T11:28:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.113+0000 7f6c54d9b700 1 -- 172.21.15.43:0/941609171 learned_addr learned my addr 172.21.15.43:0/941609171 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4ffff700 1 --2- 172.21.15.43:0/941609171 >> v2:172.21.15.57:3300/0 conn(0x7f6c500c50d0 0x7f6c500c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476010689 0 0) 0x7f6c50154d00 con 0x7f6c5014e960 2023-08-27T11:28:33.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c400035b0 con 0x7f6c5014e960 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969250270 0 0) 0x7f6c400035b0 con 0x7f6c5014e960 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 >> v2:172.21.15.57:3300/0 conn(0x7f6c500c50d0 msgr2=0x7f6c500c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 --2- 172.21.15.43:0/941609171 >> v2:172.21.15.57:3300/0 conn(0x7f6c500c50d0 0x7f6c500c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 >> v1:172.21.15.57:6789/0 conn(0x7f6c50154740 legacy=0x7f6c500c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c501552c0 con 0x7f6c5014e960 2023-08-27T11:28:33.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f6c44001670 con 0x7f6c5014e960 2023-08-27T11:28:33.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 >> v1:172.21.15.43:6789/0 conn(0x7f6c5014e960 legacy=0x7f6c500a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c40004850 0x7f6c40004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40005210 0x7f6c4000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.120 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500baf30 con 0x7f6c40003a00 2023-08-27T11:28:33.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000e3c0 con 0x7f6c40005210 2023-08-27T11:28:33.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.114+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4000e580 con 0x7f6c40004850 2023-08-27T11:28:33.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c4ffff700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c40004850 0x7f6c40004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c5559c700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40005210 0x7f6c4000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 -- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c40004850 msgr2=0x7f6c40004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c40004850 0x7f6c40004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 -- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40005210 msgr2=0x7f6c4000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40005210 0x7f6c4000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 -- 172.21.15.43:0/941609171 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c400035b0 con 0x7f6c40003a00 2023-08-27T11:28:33.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c5559c700 1 -- 172.21.15.43:0/941609171 reap_dead start 2023-08-27T11:28:33.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c240 tx=0x7f6c40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4c7c40f1b2e51f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44007c10 con 0x7f6c40003a00 2023-08-27T11:28:33.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4400ce00 con 0x7f6c40003a00 2023-08-27T11:28:33.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.115+0000 7f6c4f7fe700 1 -- 172.21.15.43:0/941609171 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44005ba0 con 0x7f6c40003a00 2023-08-27T11:28:33.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 -- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 msgr2=0x7f6c40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c240 tx=0x7f6c40005880 comp rx=0 tx=0).stop 2023-08-27T11:28:33.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 -- 172.21.15.43:0/941609171 shutdown_connections 2023-08-27T11:28:33.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 --2- 172.21.15.43:0/941609171 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c40003a00 0x7f6c40003e20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 -- 172.21.15.43:0/941609171 >> 172.21.15.43:0/941609171 conn(0x7f6c5006aa50 msgr2=0x7f6c500c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:33.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 -- 172.21.15.43:0/941609171 shutdown_connections 2023-08-27T11:28:33.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.116+0000 7f6c56fff700 1 -- 172.21.15.43:0/941609171 wait complete. 2023-08-27T11:28:33.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.118+0000 7f6c56fff700 1 Processor -- start 2023-08-27T11:28:33.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.118+0000 7f6c56fff700 1 -- start start 2023-08-27T11:28:33.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 0x7f6c500ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c50151d00 0x7f6c500a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500aa6f0 con 0x7f6c5014f000 2023-08-27T11:28:33.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500aa9d0 con 0x7f6c40003a00 2023-08-27T11:28:33.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c56fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5014f680 con 0x7f6c50151d00 2023-08-27T11:28:33.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c4ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c4ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38852/0 (socket says 172.21.15.43:38852) 2023-08-27T11:28:33.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c4ffff700 1 -- 172.21.15.43:0/2699873416 learned_addr learned my addr 172.21.15.43:0/2699873416 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:33.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 0x7f6c500ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.119+0000 7f6c5559c700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c50151d00 0x7f6c500a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 -- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c50151d00 msgr2=0x7f6c500a63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c50151d00 0x7f6c500a63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 -- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 msgr2=0x7f6c500ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 0x7f6c500ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 -- 172.21.15.43:0/2699873416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500ab5e0 con 0x7f6c5014f000 2023-08-27T11:28:33.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 0x7f6c500ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:33.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4ffff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0118f0 tx=0x7f6c3c011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c004240 con 0x7f6c5014f000 2023-08-27T11:28:33.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0043a0 con 0x7f6c5014f000 2023-08-27T11:28:33.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c500a8880 con 0x7f6c5014f000 2023-08-27T11:28:33.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00f730 con 0x7f6c5014f000 2023-08-27T11:28:33.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.120+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5014fd80 con 0x7f6c5014f000 2023-08-27T11:28:33.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.121+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c500aa830 con 0x7f6c5014f000 2023-08-27T11:28:33.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.122+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c3c00f890 con 0x7f6c5014f000 2023-08-27T11:28:33.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.124+0000 7f6c4d7fa700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 0x7f6c3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.124+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c3c0886a0 con 0x7f6c5014f000 2023-08-27T11:28:33.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.124+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 0x7f6c3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.125+0000 7f6c54d9b700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 0x7f6c3406c5a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c44007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.128+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6c500aa830 con 0x7f6c5014f000 2023-08-27T11:28:33.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.339+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6c5014f4e0 con 0x7f6c5014f000 2023-08-27T11:28:33.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.339+0000 7f6c4d7fa700 1 -- 172.21.15.43:0/2699873416 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6c5014f4e0 con 0x7f6c5014f000 2023-08-27T11:28:33.341 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:33.341 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:28:33.341 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:33.342 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:28:33.342 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:28:33.342 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:33.342 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:33.342 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:28:33.343 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:28:33.343 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:33.343 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:28:33.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 msgr2=0x7f6c3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 0x7f6c3406c5a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6c44000c00 tx=0x7f6c44007000 comp rx=0 tx=0).stop 2023-08-27T11:28:33.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 msgr2=0x7f6c500a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0118f0 tx=0x7f6c3c011cb0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 shutdown_connections 2023-08-27T11:28:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6c3406a0e0 0x7f6c3406c5a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6c50151d00 0x7f6c500a63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6c40003a00 0x7f6c500ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 --2- 172.21.15.43:0/2699873416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6c5014f000 0x7f6c500a5e70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 >> 172.21.15.43:0/2699873416 conn(0x7f6c5006aa50 msgr2=0x7f6c50152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 shutdown_connections 2023-08-27T11:28:33.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.341+0000 7f6c56fff700 1 -- 172.21.15.43:0/2699873416 wait complete. 2023-08-27T11:28:33.361 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:28:33.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:28:33.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.566+0000 7fecc07ff700 1 Processor -- start 2023-08-27T11:28:33.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.566+0000 7fecc07ff700 1 -- start start 2023-08-27T11:28:33.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.567+0000 7fecc07ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fecb80c4b80 0x7fecb806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.567+0000 7fecc07ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80c4f80 con 0x7fecb80c4700 2023-08-27T11:28:33.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.567+0000 7fecc07ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb8154730 con 0x7fecb8151a40 2023-08-27T11:28:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.567+0000 7fecc07ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb8154520 con 0x7fecb80c4b80 2023-08-27T11:28:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbdd9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fecb80c4700 0x7fecb806b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59154/0 (socket says 172.21.15.43:59154) 2023-08-27T11:28:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbdd9a700 1 -- 172.21.15.43:0/2608390309 learned_addr learned my addr 172.21.15.43:0/2608390309 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:33.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbed9c700 1 --2- 172.21.15.43:0/2608390309 >> v2:172.21.15.57:3300/0 conn(0x7fecb80c4b80 0x7fecb806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722640265 0 0) 0x7fecb80c4f80 con 0x7fecb80c4700 2023-08-27T11:28:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca40035b0 con 0x7fecb80c4700 2023-08-27T11:28:33.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326465059 0 0) 0x7fecb8154730 con 0x7fecb8151a40 2023-08-27T11:28:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb80c4f80 con 0x7fecb8151a40 2023-08-27T11:28:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbed9c700 1 -- 172.21.15.43:0/2608390309 >> v1:172.21.15.57:6789/0 conn(0x7fecb8151a40 legacy=0x7fecb80c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbed9c700 1 -- 172.21.15.43:0/2608390309 >> v1:172.21.15.43:6789/0 conn(0x7fecb80c4700 legacy=0x7fecb806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.568+0000 7fecbed9c700 1 -- 172.21.15.43:0/2608390309 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8154a10 con 0x7fecb80c4b80 2023-08-27T11:28:33.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecbed9c700 1 --2- 172.21.15.43:0/2608390309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb806be90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aaedc9cb1728698 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000e070 con 0x7fecb80c4b80 2023-08-27T11:28:33.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000bb20 con 0x7fecb80c4b80 2023-08-27T11:28:33.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecbd599700 1 -- 172.21.15.43:0/2608390309 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0012430 con 0x7fecb80c4b80 2023-08-27T11:28:33.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecc07ff700 1 -- 172.21.15.43:0/2608390309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 msgr2=0x7fecb806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.569+0000 7fecc07ff700 1 --2- 172.21.15.43:0/2608390309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb806be90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009d90 tx=0x7fecb000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:33.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.570+0000 7fecc07ff700 1 -- 172.21.15.43:0/2608390309 shutdown_connections 2023-08-27T11:28:33.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.570+0000 7fecc07ff700 1 --2- 172.21.15.43:0/2608390309 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb806be90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.570+0000 7fecc07ff700 1 -- 172.21.15.43:0/2608390309 >> 172.21.15.43:0/2608390309 conn(0x7fecb80ab890 msgr2=0x7fecb80abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:33.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.570+0000 7fecc07ff700 1 -- 172.21.15.43:0/2608390309 shutdown_connections 2023-08-27T11:28:33.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.570+0000 7fecc07ff700 1 -- 172.21.15.43:0/2608390309 wait complete. 2023-08-27T11:28:33.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.571+0000 7fecc07ff700 1 Processor -- start 2023-08-27T11:28:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.571+0000 7fecc07ff700 1 -- start start 2023-08-27T11:28:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 0x7fecb814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb81ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb814dcb0 con 0x7fecb8151a40 2023-08-27T11:28:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8155b60 con 0x7fecb80c4b80 2023-08-27T11:28:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.572+0000 7fecc07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c1b80 con 0x7fecb80c4700 2023-08-27T11:28:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38854/0 (socket says 172.21.15.43:38854) 2023-08-27T11:28:33.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 -- 172.21.15.43:0/3238979688 learned_addr learned my addr 172.21.15.43:0/3238979688 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbdd9a700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb81ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbe59b700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 0x7fecb814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 -- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 msgr2=0x7fecb814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 0x7fecb814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 -- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 msgr2=0x7fecb81ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb81ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 -- 172.21.15.43:0/3238979688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb0009a70 con 0x7fecb8151a40 2023-08-27T11:28:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbdd9a700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb81ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbe59b700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 0x7fecb814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:33.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.573+0000 7fecbed9c700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fecb0014040 tx=0x7fecb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.574+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb001b810 con 0x7fecb8151a40 2023-08-27T11:28:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.574+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0020070 con 0x7fecb8151a40 2023-08-27T11:28:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.574+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb81ed8e0 con 0x7fecb8151a40 2023-08-27T11:28:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.574+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb001bb90 con 0x7fecb8151a40 2023-08-27T11:28:33.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.574+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80c1220 con 0x7fecb8151a40 2023-08-27T11:28:33.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.575+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb804ee70 con 0x7fecb8151a40 2023-08-27T11:28:33.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.576+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fecb001bcf0 con 0x7fecb8151a40 2023-08-27T11:28:33.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.577+0000 7fecaeffd700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 0x7fec9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:33.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.577+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fecb0022070 con 0x7fecb8151a40 2023-08-27T11:28:33.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.577+0000 7fecbe59b700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 0x7fec9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:33.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.578+0000 7fecbe59b700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 0x7fec9c06c5a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:33.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.581+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fecb00bc990 con 0x7fecb8151a40 2023-08-27T11:28:33.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.790+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fecb80c13b0 con 0x7fecb8151a40 2023-08-27T11:28:33.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.984+0000 7fecaeffd700 1 -- 172.21.15.43:0/3238979688 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v121) v1 ==== 138+0+0 (secure 0 0 0) 0x7fecb0055c60 con 0x7fecb8151a40 2023-08-27T11:28:33.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 msgr2=0x7fec9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 0x7fec9c06c5a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fecb4007fd0 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2023-08-27T11:28:33.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 msgr2=0x7fecb814cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:33.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fecb0014040 tx=0x7fecb0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 shutdown_connections 2023-08-27T11:28:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fec9c06a0e0 0x7fec9c06c5a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fecb8151a40 0x7fecb814cad0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecb80c4700 0x7fecb814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 --2- 172.21.15.43:0/3238979688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecb80c4b80 0x7fecb81ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 >> 172.21.15.43:0/3238979688 conn(0x7fecb80ab890 msgr2=0x7fecb8152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 shutdown_connections 2023-08-27T11:28:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:33.988+0000 7fecc07ff700 1 -- 172.21.15.43:0/3238979688 wait complete. 2023-08-27T11:28:33.994 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:28:34.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:28:34.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.217+0000 7f86251ff700 1 Processor -- start 2023-08-27T11:28:34.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.217+0000 7f86251ff700 1 -- start start 2023-08-27T11:28:34.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f862014e860 0x7f86200c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 0x7f86201551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 0x7f86200c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86200a8c00 con 0x7f862014e860 2023-08-27T11:28:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8620154d30 con 0x7f86200c2120 2023-08-27T11:28:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.218+0000 7f86251ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86200c5430 con 0x7f8620151e10 2023-08-27T11:28:34.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f862014e860 0x7f86200c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f862014e860 0x7f86200c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38862/0 (socket says 172.21.15.43:38862) 2023-08-27T11:28:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 -- 172.21.15.43:0/1869696883 learned_addr learned my addr 172.21.15.43:0/1869696883 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:34.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861e59c700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 0x7f86201551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861f59e700 1 --2- 172.21.15.43:0/1869696883 >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 0x7f86200c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 -- 172.21.15.43:0/1869696883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 msgr2=0x7f86201551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 0x7f86201551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 -- 172.21.15.43:0/1869696883 >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 msgr2=0x7f86200c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:34.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 --2- 172.21.15.43:0/1869696883 >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 0x7f86200c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 -- 172.21.15.43:0/1869696883 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200c4e70 con 0x7f862014e860 2023-08-27T11:28:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861f59e700 1 --2- 172.21.15.43:0/1869696883 >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 0x7f86200c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861e59c700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 0x7f86201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.219+0000 7f861ed9d700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862014e860 0x7f86200c02c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f86200a8e70 tx=0x7f8610009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea1588a4af5dbfa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:34.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f861dd9b700 1 -- 172.21.15.43:0/1869696883 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000f8a0 con 0x7f862014e860 2023-08-27T11:28:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f861dd9b700 1 -- 172.21.15.43:0/1869696883 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000fa00 con 0x7f862014e860 2023-08-27T11:28:34.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f861dd9b700 1 -- 172.21.15.43:0/1869696883 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000fd90 con 0x7f862014e860 2023-08-27T11:28:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 -- 172.21.15.43:0/1869696883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862014e860 msgr2=0x7f86200c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862014e860 0x7f86200c02c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f86200a8e70 tx=0x7f8610009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 -- 172.21.15.43:0/1869696883 shutdown_connections 2023-08-27T11:28:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 --2- 172.21.15.43:0/1869696883 >> v2:172.21.15.57:3300/0 conn(0x7f86200c2120 0x7f86200c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862014e860 0x7f86200c02c0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 --2- 172.21.15.43:0/1869696883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8620151e10 0x7f86201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 -- 172.21.15.43:0/1869696883 >> 172.21.15.43:0/1869696883 conn(0x7f862006a310 msgr2=0x7f862006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 -- 172.21.15.43:0/1869696883 shutdown_connections 2023-08-27T11:28:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.220+0000 7f86251ff700 1 -- 172.21.15.43:0/1869696883 wait complete. 2023-08-27T11:28:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.222+0000 7f86251ff700 1 Processor -- start 2023-08-27T11:28:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.222+0000 7f86251ff700 1 -- start start 2023-08-27T11:28:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86200c2120 0x7f8620152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862014e860 0x7f86200b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86201e96a0 con 0x7f8620151e10 2023-08-27T11:28:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86200b8330 con 0x7f86200c2120 2023-08-27T11:28:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f86251ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86201e93c0 con 0x7f862014e860 2023-08-27T11:28:34.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f861f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f861f59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38876/0 (socket says 172.21.15.43:38876) 2023-08-27T11:28:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f861f59e700 1 -- 172.21.15.43:0/2951943477 learned_addr learned my addr 172.21.15.43:0/2951943477 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f861ed9d700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86200c2120 0x7f8620152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.223+0000 7f861e59c700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862014e860 0x7f86200b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 -- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862014e860 msgr2=0x7f86200b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862014e860 0x7f86200b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 -- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86200c2120 msgr2=0x7f8620152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86200c2120 0x7f8620152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 -- 172.21.15.43:0/2951943477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8610009550 con 0x7f8620151e10 2023-08-27T11:28:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f861f59e700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f861800cef0 tx=0x7f861800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861800ac80 con 0x7f8620151e10 2023-08-27T11:28:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861800ade0 con 0x7f8620151e10 2023-08-27T11:28:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618015680 con 0x7f8620151e10 2023-08-27T11:28:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.224+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86201542d0 con 0x7f8620151e10 2023-08-27T11:28:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.225+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8620153fc0 con 0x7f8620151e10 2023-08-27T11:28:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.226+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86201547f0 con 0x7f8620151e10 2023-08-27T11:28:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.227+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f861800d430 con 0x7f8620151e10 2023-08-27T11:28:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.227+0000 7f86077fe700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 0x7f860c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.228+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8618088760 con 0x7f8620151e10 2023-08-27T11:28:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.228+0000 7f861ed9d700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 0x7f860c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.228+0000 7f861ed9d700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 0x7f860c06c5d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8610000c00 tx=0x7f8610008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:34.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.232+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f86201547f0 con 0x7f8620151e10 2023-08-27T11:28:34.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.440+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f86201547f0 con 0x7f8620151e10 2023-08-27T11:28:34.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.992+0000 7f86077fe700 1 -- 172.21.15.43:0/2951943477 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v122) v1 ==== 170+0+0 (secure 0 0 0) 0x7f86201547f0 con 0x7f8620151e10 2023-08-27T11:28:35.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 msgr2=0x7f860c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:35.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 0x7f860c06c5d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8610000c00 tx=0x7f8610008030 comp rx=0 tx=0).stop 2023-08-27T11:28:35.000 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 msgr2=0x7f8620150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f861800cef0 tx=0x7f861800cf20 comp rx=0 tx=0).stop 2023-08-27T11:28:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 shutdown_connections 2023-08-27T11:28:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f860c06a110 0x7f860c06c5d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8620151e10 0x7f8620150b30 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86200c2120 0x7f8620152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 --2- 172.21.15.43:0/2951943477 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862014e860 0x7f86200b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.998+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 >> 172.21.15.43:0/2951943477 conn(0x7f862006a310 msgr2=0x7f862014cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.999+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 shutdown_connections 2023-08-27T11:28:35.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:34.999+0000 7f86251ff700 1 -- 172.21.15.43:0/2951943477 wait complete. 2023-08-27T11:28:35.005 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:28:35.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:28:35.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.238+0000 7fc28dfff700 1 Processor -- start 2023-08-27T11:28:35.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.239+0000 7fc28dfff700 1 -- start start 2023-08-27T11:28:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc288151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc288151cd0 0x7fc2880c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc2880ac410 0x7fc2880c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2881555a0 con 0x7fc288151cd0 2023-08-27T11:28:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880c80c0 con 0x7fc2880ac410 2023-08-27T11:28:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc28dfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881552c0 con 0x7fc2880c49f0 2023-08-27T11:28:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc286ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc288151cd0 0x7fc2880c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc286ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc288151cd0 0x7fc2880c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38882/0 (socket says 172.21.15.43:38882) 2023-08-27T11:28:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc286ffd700 1 -- 172.21.15.43:0/2667387299 learned_addr learned my addr 172.21.15.43:0/2667387299 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc2877fe700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc288151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.240+0000 7fc287fff700 1 --2- 172.21.15.43:0/2667387299 >> v2:172.21.15.57:3300/0 conn(0x7fc2880ac410 0x7fc2880c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 -- 172.21.15.43:0/2667387299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 msgr2=0x7fc288151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc288151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 -- 172.21.15.43:0/2667387299 >> v2:172.21.15.57:3300/0 conn(0x7fc2880ac410 msgr2=0x7fc2880c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 --2- 172.21.15.43:0/2667387299 >> v2:172.21.15.57:3300/0 conn(0x7fc2880ac410 0x7fc2880c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.249 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 -- 172.21.15.43:0/2667387299 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880c8360 con 0x7fc288151cd0 2023-08-27T11:28:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc2877fe700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc288151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc286ffd700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc2880c8f80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fc288072830 tx=0x7fc27c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1603cb654e2e1413 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc2867fc700 1 -- 172.21.15.43:0/2667387299 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c011830 con 0x7fc288151cd0 2023-08-27T11:28:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc2867fc700 1 -- 172.21.15.43:0/2667387299 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c011990 con 0x7fc288151cd0 2023-08-27T11:28:35.250 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.241+0000 7fc2867fc700 1 -- 172.21.15.43:0/2667387299 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c011d20 con 0x7fc288151cd0 2023-08-27T11:28:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 -- 172.21.15.43:0/2667387299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 msgr2=0x7fc2880c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc2880c8f80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fc288072830 tx=0x7fc27c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 -- 172.21.15.43:0/2667387299 shutdown_connections 2023-08-27T11:28:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 --2- 172.21.15.43:0/2667387299 >> v2:172.21.15.57:3300/0 conn(0x7fc2880ac410 0x7fc2880c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc288151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 --2- 172.21.15.43:0/2667387299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc2880c8f80 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 -- 172.21.15.43:0/2667387299 >> 172.21.15.43:0/2667387299 conn(0x7fc2880ab8f0 msgr2=0x7fc2880abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 -- 172.21.15.43:0/2667387299 shutdown_connections 2023-08-27T11:28:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.242+0000 7fc28dfff700 1 -- 172.21.15.43:0/2667387299 wait complete. 2023-08-27T11:28:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.244+0000 7fc28dfff700 1 Processor -- start 2023-08-27T11:28:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.244+0000 7fc28dfff700 1 -- start start 2023-08-27T11:28:35.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 0x7fc288158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc2881ec820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc28814ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881576b0 con 0x7fc288151cd0 2023-08-27T11:28:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881ed2d0 con 0x7fc2880ac410 2023-08-27T11:28:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc28dfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881ed570 con 0x7fc2880c49f0 2023-08-27T11:28:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc28814ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 0x7fc288158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc2877fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 0x7fc288158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49388/0 (socket says 172.21.15.43:49388) 2023-08-27T11:28:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc2877fe700 1 -- 172.21.15.43:0/3033472192 learned_addr learned my addr 172.21.15.43:0/3033472192 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc286ffd700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc2881ec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 -- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 msgr2=0x7fc2881ec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:35.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc2881ec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 -- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 msgr2=0x7fc288158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 0x7fc288158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.245+0000 7fc287fff700 1 -- 172.21.15.43:0/3033472192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c009550 con 0x7fc288151cd0 2023-08-27T11:28:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc287fff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc28814ae00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc28000eab0 tx=0x7fc28000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:35.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280010040 con 0x7fc288151cd0 2023-08-27T11:28:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28000b970 con 0x7fc288151cd0 2023-08-27T11:28:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc288157900 con 0x7fc288151cd0 2023-08-27T11:28:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280009a80 con 0x7fc288151cd0 2023-08-27T11:28:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.246+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28814ba40 con 0x7fc288151cd0 2023-08-27T11:28:35.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.247+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc288157e20 con 0x7fc288151cd0 2023-08-27T11:28:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.248+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc28000bd20 con 0x7fc288151cd0 2023-08-27T11:28:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.249+0000 7fc26ffff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 0x7fc27406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.249+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc280088780 con 0x7fc288151cd0 2023-08-27T11:28:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.249+0000 7fc2877fe700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 0x7fc27406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:35.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.250+0000 7fc2877fe700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 0x7fc27406c5a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc278009a90 tx=0x7fc278008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:35.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.254+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc288157e20 con 0x7fc288151cd0 2023-08-27T11:28:35.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:35.518+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc288157e20 con 0x7fc288151cd0 2023-08-27T11:28:36.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.018+0000 7fc26ffff700 1 -- 172.21.15.43:0/3033472192 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v126) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc288157e20 con 0x7fc288151cd0 2023-08-27T11:28:36.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.027+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 msgr2=0x7fc27406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.027+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 0x7fc27406c5a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc278009a90 tx=0x7fc278008040 comp rx=0 tx=0).stop 2023-08-27T11:28:36.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.027+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 msgr2=0x7fc28814ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.027+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc28814ae00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc28000eab0 tx=0x7fc28000edc0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 shutdown_connections 2023-08-27T11:28:36.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc27406a0e0 0x7fc27406c5a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc288151cd0 0x7fc28814ae00 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2880ac410 0x7fc288158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 --2- 172.21.15.43:0/3033472192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2880c49f0 0x7fc2881ec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.030+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 >> 172.21.15.43:0/3033472192 conn(0x7fc2880ab8f0 msgr2=0x7fc288150d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:36.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.032+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 shutdown_connections 2023-08-27T11:28:36.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.034+0000 7fc28dfff700 1 -- 172.21.15.43:0/3033472192 wait complete. 2023-08-27T11:28:36.039 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 19 and data pool 20 2023-08-27T11:28:36.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.263+0000 7fc97afff700 1 Processor -- start 2023-08-27T11:28:36.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.263+0000 7fc97afff700 1 -- start start 2023-08-27T11:28:36.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97afff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc974154740 0x7fc9740c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97afff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc974154d00 con 0x7fc97414e960 2023-08-27T11:28:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97afff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740baf30 con 0x7fc974154740 2023-08-27T11:28:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc974154fe0 con 0x7fc9740c50d0 2023-08-27T11:28:36.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97959c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc974154740 0x7fc9740c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc973fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc973fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:45262/0 (socket says 172.21.15.43:45262) 2023-08-27T11:28:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc97959c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc974154740 0x7fc9740c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:49400/0 (socket says 172.21.15.43:49400) 2023-08-27T11:28:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.264+0000 7fc973fff700 1 -- 172.21.15.43:0/1168505786 learned_addr learned my addr 172.21.15.43:0/1168505786 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc9737fe700 1 -- 172.21.15.43:0/1168505786 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027617184 0 0) 0x7fc974154d00 con 0x7fc97414e960 2023-08-27T11:28:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc9737fe700 1 -- 172.21.15.43:0/1168505786 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9640035b0 con 0x7fc97414e960 2023-08-27T11:28:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc97959c700 1 -- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 msgr2=0x7fc9740c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc97959c700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc97959c700 1 -- 172.21.15.43:0/1168505786 >> v1:172.21.15.57:6789/0 conn(0x7fc97414e960 legacy=0x7fc9740a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc97959c700 1 -- 172.21.15.43:0/1168505786 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9741552c0 con 0x7fc974154740 2023-08-27T11:28:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc973fff700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.265+0000 7fc97959c700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc974154740 0x7fc9740c4200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed05217623c1f54 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc9737fe700 1 -- 172.21.15.43:0/1168505786 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00e070 con 0x7fc974154740 2023-08-27T11:28:36.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc9737fe700 1 -- 172.21.15.43:0/1168505786 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00bb20 con 0x7fc974154740 2023-08-27T11:28:36.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc9737fe700 1 -- 172.21.15.43:0/1168505786 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c012430 con 0x7fc974154740 2023-08-27T11:28:36.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 -- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc974154740 msgr2=0x7fc9740c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc974154740 0x7fc9740c4200 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009d90 tx=0x7fc96c00b330 comp rx=0 tx=0).stop 2023-08-27T11:28:36.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 -- 172.21.15.43:0/1168505786 shutdown_connections 2023-08-27T11:28:36.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc974154740 0x7fc9740c4200 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 --2- 172.21.15.43:0/1168505786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9740c50d0 0x7fc9740c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 -- 172.21.15.43:0/1168505786 >> 172.21.15.43:0/1168505786 conn(0x7fc97406aa50 msgr2=0x7fc9740c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:36.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 -- 172.21.15.43:0/1168505786 shutdown_connections 2023-08-27T11:28:36.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.266+0000 7fc97afff700 1 -- 172.21.15.43:0/1168505786 wait complete. 2023-08-27T11:28:36.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.268+0000 7fc97afff700 1 Processor -- start 2023-08-27T11:28:36.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.268+0000 7fc97afff700 1 -- start start 2023-08-27T11:28:36.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9740c50d0 0x7fc9740a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc974154740 0x7fc974151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740bd4e0 con 0x7fc97414e960 2023-08-27T11:28:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740bcf20 con 0x7fc9740c50d0 2023-08-27T11:28:36.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc97afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741ed9c0 con 0x7fc974154740 2023-08-27T11:28:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc973fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc973fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38900/0 (socket says 172.21.15.43:38900) 2023-08-27T11:28:36.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.269+0000 7fc973fff700 1 -- 172.21.15.43:0/202768332 learned_addr learned my addr 172.21.15.43:0/202768332 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc97959c700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc974154740 0x7fc974151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc978d9b700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9740c50d0 0x7fc9740a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 -- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc974154740 msgr2=0x7fc974151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc974154740 0x7fc974151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 -- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9740c50d0 msgr2=0x7fc9740a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9740c50d0 0x7fc9740a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 -- 172.21.15.43:0/202768332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009550 con 0x7fc97414e960 2023-08-27T11:28:36.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc973fff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc96000ebe0 tx=0x7fc96000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000c850 con 0x7fc97414e960 2023-08-27T11:28:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000c9b0 con 0x7fc97414e960 2023-08-27T11:28:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c009a70 con 0x7fc97414e960 2023-08-27T11:28:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.270+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000cd60 con 0x7fc97414e960 2023-08-27T11:28:36.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.271+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740bd170 con 0x7fc97414e960 2023-08-27T11:28:36.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.271+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740bb390 con 0x7fc97414e960 2023-08-27T11:28:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.273+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc960013470 con 0x7fc97414e960 2023-08-27T11:28:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.274+0000 7fc9717fa700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 0x7fc95806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.274+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc960088990 con 0x7fc97414e960 2023-08-27T11:28:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.274+0000 7fc978d9b700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 0x7fc95806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.275+0000 7fc978d9b700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 0x7fc95806c5a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9680011e0 tx=0x7fc968009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.278+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc960053fe0 con 0x7fc97414e960 2023-08-27T11:28:36.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.489+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9740bd690 con 0x7fc97414e960 2023-08-27T11:28:36.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.490+0000 7fc9717fa700 1 -- 172.21.15.43:0/202768332 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fc9740bd690 con 0x7fc97414e960 2023-08-27T11:28:36.493 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:36.493 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":123,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:35.519414+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:36.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 msgr2=0x7fc95806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 0x7fc95806c5a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9680011e0 tx=0x7fc968009040 comp rx=0 tx=0).stop 2023-08-27T11:28:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 msgr2=0x7fc9741ed180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc96000ebe0 tx=0x7fc96000eef0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 shutdown_connections 2023-08-27T11:28:36.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc95806a0e0 0x7fc95806c5a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc974154740 0x7fc974151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9740c50d0 0x7fc9740a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 --2- 172.21.15.43:0/202768332 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc97414e960 0x7fc9741ed180 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 >> 172.21.15.43:0/202768332 conn(0x7fc97406aa50 msgr2=0x7fc97406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 shutdown_connections 2023-08-27T11:28:36.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.493+0000 7fc97afff700 1 -- 172.21.15.43:0/202768332 wait complete. 2023-08-27T11:28:36.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:36.714 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.712+0000 7fa6231ff700 1 Processor -- start 2023-08-27T11:28:36.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.712+0000 7fa6231ff700 1 -- start start 2023-08-27T11:28:36.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa6231ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa61c06a310 0x7fa61c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa6231ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c06a6f0 0x7fa61c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa6231ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61c157950 con 0x7fa61c158320 2023-08-27T11:28:36.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa6231ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61c0715e0 con 0x7fa61c06a310 2023-08-27T11:28:36.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa6231ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c06ab70 con 0x7fa61c06a6f0 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.713+0000 7fa620f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa61c06a310 0x7fa61c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa61c06a310 0x7fa61c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38906/0 (socket says 172.21.15.43:38906) 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 -- 172.21.15.43:0/397334326 learned_addr learned my addr 172.21.15.43:0/397334326 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa61bfff700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c06a6f0 0x7fa61c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 -- 172.21.15.43:0/397334326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c06a6f0 msgr2=0x7fa61c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:36.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c06a6f0 0x7fa61c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 -- 172.21.15.43:0/397334326 >> v1:172.21.15.57:6789/0 conn(0x7fa61c158320 legacy=0x7fa61c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 -- 172.21.15.43:0/397334326 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c158770 con 0x7fa61c06a310 2023-08-27T11:28:36.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa620f9b700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c154d70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa6100098f0 tx=0x7fa610009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755ed7f575eece1a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa61b7fe700 1 -- 172.21.15.43:0/397334326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610011830 con 0x7fa61c06a310 2023-08-27T11:28:36.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa61b7fe700 1 -- 172.21.15.43:0/397334326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610011990 con 0x7fa61c06a310 2023-08-27T11:28:36.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.714+0000 7fa61b7fe700 1 -- 172.21.15.43:0/397334326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610011d20 con 0x7fa61c06a310 2023-08-27T11:28:36.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 -- 172.21.15.43:0/397334326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 msgr2=0x7fa61c154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c154d70 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa6100098f0 tx=0x7fa610009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:36.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 -- 172.21.15.43:0/397334326 shutdown_connections 2023-08-27T11:28:36.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c154d70 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 --2- 172.21.15.43:0/397334326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c06a6f0 0x7fa61c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 -- 172.21.15.43:0/397334326 >> 172.21.15.43:0/397334326 conn(0x7fa61c06bdf0 msgr2=0x7fa61c0c6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:36.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 -- 172.21.15.43:0/397334326 shutdown_connections 2023-08-27T11:28:36.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.715+0000 7fa6231ff700 1 -- 172.21.15.43:0/397334326 wait complete. 2023-08-27T11:28:36.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.717+0000 7fa6231ff700 1 Processor -- start 2023-08-27T11:28:36.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.717+0000 7fa6231ff700 1 -- start start 2023-08-27T11:28:36.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa61c06a6f0 0x7fa61c0bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 0x7fa61c0bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c155170 con 0x7fa61c06a310 2023-08-27T11:28:36.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c153eb0 con 0x7fa61c06a6f0 2023-08-27T11:28:36.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa6231ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c0abfd0 con 0x7fa61c158320 2023-08-27T11:28:36.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa620f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa620f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38914/0 (socket says 172.21.15.43:38914) 2023-08-27T11:28:36.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa620f9b700 1 -- 172.21.15.43:0/430651398 learned_addr learned my addr 172.21.15.43:0/430651398 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:36.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa61bfff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa61c06a6f0 0x7fa61c0bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.718+0000 7fa62179c700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 0x7fa61c0bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 -- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 msgr2=0x7fa61c0bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 0x7fa61c0bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 -- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa61c06a6f0 msgr2=0x7fa61c0bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa61c06a6f0 0x7fa61c0bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 -- 172.21.15.43:0/430651398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610009550 con 0x7fa61c06a310 2023-08-27T11:28:36.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa62179c700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 0x7fa61c0bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:36.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa620f9b700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa610000c00 tx=0x7fa610004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610004480 con 0x7fa61c06a310 2023-08-27T11:28:36.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61001f070 con 0x7fa61c06a310 2023-08-27T11:28:36.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100038c0 con 0x7fa61c06a310 2023-08-27T11:28:36.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61c0c0440 con 0x7fa61c06a310 2023-08-27T11:28:36.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.719+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61c0ab6a0 con 0x7fa61c06a310 2023-08-27T11:28:36.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.720+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61c06ed30 con 0x7fa61c06a310 2023-08-27T11:28:36.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.721+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa610021030 con 0x7fa61c06a310 2023-08-27T11:28:36.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.722+0000 7fa6197fa700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 0x7fa60006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:36.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.722+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6100899e0 con 0x7fa61c06a310 2023-08-27T11:28:36.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.723+0000 7fa61bfff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 0x7fa60006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:36.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.723+0000 7fa61bfff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 0x7fa60006c5a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa61c071220 tx=0x7fa608009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:36.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.726+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6100550c0 con 0x7fa61c06a310 2023-08-27T11:28:36.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.940+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa61c04ee70 con 0x7fa61c06a310 2023-08-27T11:28:36.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.941+0000 7fa6197fa700 1 -- 172.21.15.43:0/430651398 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fa610015090 con 0x7fa61c06a310 2023-08-27T11:28:36.946 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:36.946 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":123,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:35.519414+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:36.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 msgr2=0x7fa60006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 0x7fa60006c5a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa61c071220 tx=0x7fa608009210 comp rx=0 tx=0).stop 2023-08-27T11:28:36.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 msgr2=0x7fa61c0c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa610000c00 tx=0x7fa610004750 comp rx=0 tx=0).stop 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 shutdown_connections 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa60006a0e0 0x7fa60006c5a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa61c158320 0x7fa61c0bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa61c06a310 0x7fa61c0c5a00 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 --2- 172.21.15.43:0/430651398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa61c06a6f0 0x7fa61c0bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:36.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 >> 172.21.15.43:0/430651398 conn(0x7fa61c06bdf0 msgr2=0x7fa61c1566b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:36.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 shutdown_connections 2023-08-27T11:28:36.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:36.944+0000 7fa6231ff700 1 -- 172.21.15.43:0/430651398 wait complete. 2023-08-27T11:28:36.966 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:28:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.171+0000 7f4cb95ff700 1 Processor -- start 2023-08-27T11:28:37.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.171+0000 7f4cb95ff700 1 -- start start 2023-08-27T11:28:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb95ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4cb40c4780 0x7f4cb40c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb95ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40c6040 con 0x7f4cb40c9010 2023-08-27T11:28:37.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb95ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb40c7d00 con 0x7f4cb4151b70 2023-08-27T11:28:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb95ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb40c8510 con 0x7f4cb40c4780 2023-08-27T11:28:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb37fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4cb40c9010 0x7f4cb40c94a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59162/0 (socket says 172.21.15.43:59162) 2023-08-27T11:28:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb37fe700 1 -- 172.21.15.43:0/3998900622 learned_addr learned my addr 172.21.15.43:0/3998900622 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:37.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cabfff700 1 --2- 172.21.15.43:0/3998900622 >> v2:172.21.15.57:3300/0 conn(0x7f4cb40c4780 0x7f4cb40c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798530395 0 0) 0x7f4cb40c6040 con 0x7f4cb40c9010 2023-08-27T11:28:37.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.173+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca00035b0 con 0x7f4cb40c9010 2023-08-27T11:28:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242150537 0 0) 0x7f4cb40c7d00 con 0x7f4cb4151b70 2023-08-27T11:28:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cb40c6040 con 0x7f4cb4151b70 2023-08-27T11:28:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cabfff700 1 -- 172.21.15.43:0/3998900622 >> v1:172.21.15.57:6789/0 conn(0x7f4cb4151b70 legacy=0x7f4cb41550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cabfff700 1 -- 172.21.15.43:0/3998900622 >> v1:172.21.15.43:6789/0 conn(0x7f4cb40c9010 legacy=0x7f4cb40c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:37.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013678070 0 0) 0x7f4ca00035b0 con 0x7f4cb40c9010 2023-08-27T11:28:37.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cabfff700 1 -- 172.21.15.43:0/3998900622 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40c8b80 con 0x7f4cb40c4780 2023-08-27T11:28:37.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cabfff700 1 --2- 172.21.15.43:0/3998900622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40c4c00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aceea54f9b96360e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:37.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0019f0 con 0x7f4cb40c4780 2023-08-27T11:28:37.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c004030 con 0x7f4cb40c4780 2023-08-27T11:28:37.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.174+0000 7f4cb27fc700 1 -- 172.21.15.43:0/3998900622 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0043a0 con 0x7f4cb40c4780 2023-08-27T11:28:37.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 -- 172.21.15.43:0/3998900622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 msgr2=0x7f4cb40c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:37.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 --2- 172.21.15.43:0/3998900622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40c4c00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009840 tx=0x7f4c9c009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:37.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 -- 172.21.15.43:0/3998900622 shutdown_connections 2023-08-27T11:28:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 --2- 172.21.15.43:0/3998900622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40c4c00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 -- 172.21.15.43:0/3998900622 >> 172.21.15.43:0/3998900622 conn(0x7f4cb40ab8f0 msgr2=0x7f4cb40abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 -- 172.21.15.43:0/3998900622 shutdown_connections 2023-08-27T11:28:37.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.175+0000 7f4cb95ff700 1 -- 172.21.15.43:0/3998900622 wait complete. 2023-08-27T11:28:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.177+0000 7f4cb95ff700 1 Processor -- start 2023-08-27T11:28:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.177+0000 7f4cb95ff700 1 -- start start 2023-08-27T11:28:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:37.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 0x7f4cb40af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40ad610 con 0x7f4cb40c9010 2023-08-27T11:28:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40c3450 con 0x7f4cb40c4780 2023-08-27T11:28:37.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb95ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb40aeaf0 con 0x7f4cb4151b70 2023-08-27T11:28:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cabfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cabfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38924/0 (socket says 172.21.15.43:38924) 2023-08-27T11:28:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cabfff700 1 -- 172.21.15.43:0/1766398992 learned_addr learned my addr 172.21.15.43:0/1766398992 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb2ffd700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:37.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.178+0000 7f4cb37fe700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 0x7f4cb40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 -- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 msgr2=0x7f4cb40af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 0x7f4cb40af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 -- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 msgr2=0x7f4cb40ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:37.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 -- 172.21.15.43:0/1766398992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c0094a0 con 0x7f4cb40c9010 2023-08-27T11:28:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cb2ffd700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cb37fe700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 0x7f4cb40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cabfff700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009b90 tx=0x7f4c9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:37.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c004590 con 0x7f4cb40c9010 2023-08-27T11:28:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c01f070 con 0x7f4cb40c9010 2023-08-27T11:28:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cb95ff700 1 -- 172.21.15.43:0/1766398992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb40aef20 con 0x7f4cb40c9010 2023-08-27T11:28:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.179+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c011870 con 0x7f4cb40c9010 2023-08-27T11:28:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.180+0000 7f4cb95ff700 1 -- 172.21.15.43:0/1766398992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb40c36c0 con 0x7f4cb40c9010 2023-08-27T11:28:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.181+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb40ada60 con 0x7f4cb40c9010 2023-08-27T11:28:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.181+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4c9c0119d0 con 0x7f4cb40c9010 2023-08-27T11:28:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.182+0000 7f4cab7fe700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 0x7f4c9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.182+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c9c021070 con 0x7f4cb40c9010 2023-08-27T11:28:37.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.183+0000 7f4cb2ffd700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 0x7f4c9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.183+0000 7f4cb2ffd700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 0x7f4c9406c5a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40c1f50 tx=0x7f4ca4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.187+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4c9c059070 con 0x7f4cb40c9010 2023-08-27T11:28:37.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:37.445+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4cb404ee70 con 0x7f4cb40c9010 2023-08-27T11:28:38.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.024+0000 7f4cab7fe700 1 -- 172.21.15.43:0/1766398992 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v129) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c9c058c00 con 0x7f4cb40c9010 2023-08-27T11:28:38.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 msgr2=0x7f4c9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 0x7f4c9406c5a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40c1f50 tx=0x7f4ca4009040 comp rx=0 tx=0).stop 2023-08-27T11:28:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 msgr2=0x7f4cb40c2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009b90 tx=0x7f4c9c004750 comp rx=0 tx=0).stop 2023-08-27T11:28:38.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 shutdown_connections 2023-08-27T11:28:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4c9406a0e0 0x7f4c9406c5a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4cb4151b70 0x7f4cb40af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb40c4780 0x7f4cb40ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 --2- 172.21.15.43:0/1766398992 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4cb40c9010 0x7f4cb40c2540 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 >> 172.21.15.43:0/1766398992 conn(0x7f4cb40ab8f0 msgr2=0x7f4cb414b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 shutdown_connections 2023-08-27T11:28:38.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.027+0000 7f4ca97fa700 1 -- 172.21.15.43:0/1766398992 wait complete. 2023-08-27T11:28:38.051 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:28:38.051 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:28:38.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.259+0000 7fdcf8fff700 1 Processor -- start 2023-08-27T11:28:38.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.259+0000 7fdcf8fff700 1 -- start start 2023-08-27T11:28:38.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf8fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdcf414e780 0x7fdcf41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf8fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 0x7fdcf40c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf8fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40c03e0 con 0x7fdcf40c5150 2023-08-27T11:28:38.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf8fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf4151900 con 0x7fdcf414e780 2023-08-27T11:28:38.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf8fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4151be0 con 0x7fdcf414eb60 2023-08-27T11:28:38.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf1d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fdcf40c5150 0x7fdcf406a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:59164/0 (socket says 172.21.15.43:59164) 2023-08-27T11:28:38.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.260+0000 7fdcf1d9b700 1 -- 172.21.15.43:0/2030229059 learned_addr learned my addr 172.21.15.43:0/2030229059 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:38.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 0x7fdcf40c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf259c700 1 --2- 172.21.15.43:0/2030229059 >> v2:172.21.15.57:3300/0 conn(0x7fdcf414e780 0x7fdcf41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423090982 0 0) 0x7fdcf40c03e0 con 0x7fdcf40c5150 2023-08-27T11:28:38.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc0035b0 con 0x7fdcf40c5150 2023-08-27T11:28:38.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490098530 0 0) 0x7fdcdc0035b0 con 0x7fdcf40c5150 2023-08-27T11:28:38.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 msgr2=0x7fdcf40c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:38.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 0x7fdcf40c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 >> v2:172.21.15.57:3300/0 conn(0x7fdcf414e780 msgr2=0x7fdcf41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:38.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 --2- 172.21.15.43:0/2030229059 >> v2:172.21.15.57:3300/0 conn(0x7fdcf414e780 0x7fdcf41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4151ec0 con 0x7fdcf40c5150 2023-08-27T11:28:38.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fdce8001670 con 0x7fdcf40c5150 2023-08-27T11:28:38.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 >> v1:172.21.15.43:6789/0 conn(0x7fdcf40c5150 legacy=0x7fdcf406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc003a70 0x7fdcdc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.261+0000 7fdcf159a700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcdc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf159a700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 0x7fdcdc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4151900 con 0x7fdcdc004850 2023-08-27T11:28:38.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4151be0 con 0x7fdcdc003a70 2023-08-27T11:28:38.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00ba60 con 0x7fdcf414eb60 2023-08-27T11:28:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcdc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf259c700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc003a70 0x7fdcdc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 -- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 msgr2=0x7fdcdc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf414eb60 0x7fdcdc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 -- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc003a70 msgr2=0x7fdcdc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcdc003a70 0x7fdcdc003e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 -- 172.21.15.43:0/2030229059 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0035b0 con 0x7fdcdc004850 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.262+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcdc004cd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c240 tx=0x7fdcdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c54770c4957e8f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8007b70 con 0x7fdcdc004850 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce800cda0 con 0x7fdcdc004850 2023-08-27T11:28:38.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf159a700 1 -- 172.21.15.43:0/2030229059 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8005ba0 con 0x7fdcdc004850 2023-08-27T11:28:38.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 -- 172.21.15.43:0/2030229059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 msgr2=0x7fdcdc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/2030229059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcdc004cd0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fdce800c240 tx=0x7fdcdc005880 comp rx=0 tx=0).stop 2023-08-27T11:28:38.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf2d9d700 1 -- 172.21.15.43:0/2030229059 reap_dead start 2023-08-27T11:28:38.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 -- 172.21.15.43:0/2030229059 shutdown_connections 2023-08-27T11:28:38.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 -- 172.21.15.43:0/2030229059 >> 172.21.15.43:0/2030229059 conn(0x7fdcf40c5b10 msgr2=0x7fdcf40c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:38.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 -- 172.21.15.43:0/2030229059 shutdown_connections 2023-08-27T11:28:38.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.263+0000 7fdcf8fff700 1 -- 172.21.15.43:0/2030229059 wait complete. 2023-08-27T11:28:38.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.265+0000 7fdcf8fff700 1 Processor -- start 2023-08-27T11:28:38.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.265+0000 7fdcf8fff700 1 -- start start 2023-08-27T11:28:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf40723e0 0x7fdcf41e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 0x7fdcf41e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf4151200 con 0x7fdcdc004850 2023-08-27T11:28:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40700a0 con 0x7fdcf414c280 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf8fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf406fb60 con 0x7fdcf40723e0 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:38944/0 (socket says 172.21.15.43:38944) 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.266+0000 7fdcf259c700 1 -- 172.21.15.43:0/1550015459 learned_addr learned my addr 172.21.15.43:0/1550015459 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 0x7fdcf41e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf40723e0 0x7fdcf41e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 -- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf40723e0 msgr2=0x7fdcf41e89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf40723e0 0x7fdcf41e89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 -- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 msgr2=0x7fdcf41e8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 0x7fdcf41e8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:38.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 -- 172.21.15.43:0/1550015459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf406fe40 con 0x7fdcdc004850 2023-08-27T11:28:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf2d9d700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 0x7fdcf41e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf259c700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fdce4010900 tx=0x7fdce4010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce40096b0 con 0x7fdcdc004850 2023-08-27T11:28:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400ea70 con 0x7fdcdc004850 2023-08-27T11:28:38.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400ee20 con 0x7fdcdc004850 2023-08-27T11:28:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.267+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf4150e90 con 0x7fdcdc004850 2023-08-27T11:28:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.268+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf40c4eb0 con 0x7fdcdc004850 2023-08-27T11:28:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.268+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf404ee70 con 0x7fdcdc004850 2023-08-27T11:28:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.270+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdce401c400 con 0x7fdcdc004850 2023-08-27T11:28:38.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.270+0000 7fdce2ffd700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 0x7fdcd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.270+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdce4088a10 con 0x7fdcdc004850 2023-08-27T11:28:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.271+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 0x7fdcd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.271+0000 7fdcf1d9b700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 0x7fdcd406c5a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdce8015040 tx=0x7fdce800a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:38.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.275+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdce40541a0 con 0x7fdcdc004850 2023-08-27T11:28:38.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:38.533+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdcf40aad00 con 0x7fdcdc004850 2023-08-27T11:28:39.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.033+0000 7fdce2ffd700 1 -- 172.21.15.43:0/1550015459 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v130) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdce40577c0 con 0x7fdcdc004850 2023-08-27T11:28:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 msgr2=0x7fdcd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 0x7fdcd406c5a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdce8015040 tx=0x7fdce800a000 comp rx=0 tx=0).stop 2023-08-27T11:28:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 msgr2=0x7fdcf414cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fdce4010900 tx=0x7fdce4010cc0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.039 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 shutdown_connections 2023-08-27T11:28:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdcd406a0e0 0x7fdcd406c5a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcf414c280 0x7fdcf41e8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdcdc004850 0x7fdcf414cbe0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 --2- 172.21.15.43:0/1550015459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdcf40723e0 0x7fdcf41e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 >> 172.21.15.43:0/1550015459 conn(0x7fdcf40c5b10 msgr2=0x7fdcf414dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 shutdown_connections 2023-08-27T11:28:39.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.036+0000 7fdcf8fff700 1 -- 172.21.15.43:0/1550015459 wait complete. 2023-08-27T11:28:39.059 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:28:39.060 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:39.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.262+0000 7f15db7ff700 1 Processor -- start 2023-08-27T11:28:39.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.262+0000 7f15db7ff700 1 -- start start 2023-08-27T11:28:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.263+0000 7f15db7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15d414e960 0x7f15d40a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.263+0000 7f15db7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.263+0000 7f15db7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d4154d00 con 0x7f15d40c50d0 2023-08-27T11:28:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.263+0000 7f15db7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40baf30 con 0x7f15d414e960 2023-08-27T11:28:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.263+0000 7f15db7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4154fe0 con 0x7f15d40a79c0 2023-08-27T11:28:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f15d414e960 0x7f15d40a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d9d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f15d40c50d0 0x7f15d40c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47356/0 (socket says 172.21.15.43:47356) 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d9d9c700 1 -- 172.21.15.43:0/3078077897 learned_addr learned my addr 172.21.15.43:0/3078077897 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d8d9a700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 -- 172.21.15.43:0/3078077897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 msgr2=0x7f15d40c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 -- 172.21.15.43:0/3078077897 >> v1:172.21.15.43:6789/0 conn(0x7f15d40c50d0 legacy=0x7f15d40c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15cbfff700 1 -- 172.21.15.43:0/3078077897 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501191743 0 0) 0x7f15d4154d00 con 0x7f15d40c50d0 2023-08-27T11:28:39.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 -- 172.21.15.43:0/3078077897 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d41552c0 con 0x7f15d414e960 2023-08-27T11:28:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.264+0000 7f15d959b700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d40a7480 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009840 tx=0x7f15d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a2ef7f2da7df90 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15cbfff700 1 -- 172.21.15.43:0/3078077897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0011830 con 0x7f15d414e960 2023-08-27T11:28:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15cbfff700 1 -- 172.21.15.43:0/3078077897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d0011990 con 0x7f15d414e960 2023-08-27T11:28:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15cbfff700 1 -- 172.21.15.43:0/3078077897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0011d20 con 0x7f15d414e960 2023-08-27T11:28:39.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 -- 172.21.15.43:0/3078077897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 msgr2=0x7f15d40a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d40a7480 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009840 tx=0x7f15d0009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 -- 172.21.15.43:0/3078077897 shutdown_connections 2023-08-27T11:28:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d40a7480 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3078077897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 -- 172.21.15.43:0/3078077897 >> 172.21.15.43:0/3078077897 conn(0x7f15d406aa50 msgr2=0x7f15d40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 -- 172.21.15.43:0/3078077897 shutdown_connections 2023-08-27T11:28:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.265+0000 7f15db7ff700 1 -- 172.21.15.43:0/3078077897 wait complete. 2023-08-27T11:28:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.267+0000 7f15db7ff700 1 Processor -- start 2023-08-27T11:28:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.267+0000 7f15db7ff700 1 -- start start 2023-08-27T11:28:39.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 0x7f15d414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d414bf90 con 0x7f15d414e960 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4151fa0 con 0x7f15d40c50d0 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15db7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41511e0 con 0x7f15d40a79c0 2023-08-27T11:28:39.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15d9d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15d9d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36522/0 (socket says 172.21.15.43:36522) 2023-08-27T11:28:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.268+0000 7f15d9d9c700 1 -- 172.21.15.43:0/3849228628 learned_addr learned my addr 172.21.15.43:0/3849228628 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d959b700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d8d9a700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 0x7f15d414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 -- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 msgr2=0x7f15d40aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40aa560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 -- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 msgr2=0x7f15d414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 0x7f15d414b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 -- 172.21.15.43:0/3849228628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00094a0 con 0x7f15d414e960 2023-08-27T11:28:39.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d8d9a700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 0x7f15d414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15d9d9c700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cca0 tx=0x7f15cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00cea0 con 0x7f15d414e960 2023-08-27T11:28:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc00ade0 con 0x7f15d414e960 2023-08-27T11:28:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007310 con 0x7f15d414e960 2023-08-27T11:28:39.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d41514c0 con 0x7f15d414e960 2023-08-27T11:28:39.279 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.269+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d4151a80 con 0x7f15d414e960 2023-08-27T11:28:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.270+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d40bb390 con 0x7f15d414e960 2023-08-27T11:28:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.271+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15cc007470 con 0x7f15d414e960 2023-08-27T11:28:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.272+0000 7f15c9ffb700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 0x7f15b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.272+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15cc088230 con 0x7f15d414e960 2023-08-27T11:28:39.280 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.272+0000 7f15d959b700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 0x7f15b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.273+0000 7f15d959b700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 0x7f15b806c5a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f15d00090b0 tx=0x7f15d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.277+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f15cc053910 con 0x7f15d414e960 2023-08-27T11:28:39.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.535+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15d4151c90 con 0x7f15d414e960 2023-08-27T11:28:39.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.535+0000 7f15c9ffb700 1 -- 172.21.15.43:0/3849228628 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4883 (secure 0 0 0) 0x7f15cc056f30 con 0x7f15d414e960 2023-08-27T11:28:39.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:39.538 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":130,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124},{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125},{"gid":8091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:28:39.024709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8097":{"gid":8097,"name":"d","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2179580288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2179580288},{"type":"v1","addr":"172.21.15.57:6835","nonce":2179580288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-27T11:28:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.537+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 msgr2=0x7f15b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.537+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 0x7f15b806c5a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f15d00090b0 tx=0x7f15d0008030 comp rx=0 tx=0).stop 2023-08-27T11:28:39.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 msgr2=0x7f15d414ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cca0 tx=0x7f15cc00a340 comp rx=0 tx=0).stop 2023-08-27T11:28:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 shutdown_connections 2023-08-27T11:28:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f15b806a0e0 0x7f15b806c5a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f15d414e960 0x7f15d414ba50 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.541 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f15d40a79c0 0x7f15d40aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 --2- 172.21.15.43:0/3849228628 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15d40c50d0 0x7f15d414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 >> 172.21.15.43:0/3849228628 conn(0x7f15d406aa50 msgr2=0x7f15d4154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 shutdown_connections 2023-08-27T11:28:39.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.538+0000 7f15db7ff700 1 -- 172.21.15.43:0/3849228628 wait complete. 2023-08-27T11:28:39.543 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 130 2023-08-27T11:28:39.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.758+0000 7f73797ff700 1 Processor -- start 2023-08-27T11:28:39.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.758+0000 7f73797ff700 1 -- start start 2023-08-27T11:28:39.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73797ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f73740c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73797ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f737406ad70 0x7f737406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73797ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737406c4e0 con 0x7f7374151a90 2023-08-27T11:28:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73797ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7374155370 con 0x7f737406ad70 2023-08-27T11:28:39.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73797ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c82c0 con 0x7f73740c4630 2023-08-27T11:28:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73737fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f737406ad70 0x7f737406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f736bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f73740c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73737fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f737406ad70 0x7f737406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:35588/0 (socket says 172.21.15.43:35588) 2023-08-27T11:28:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f73737fe700 1 -- 172.21.15.43:0/881840223 learned_addr learned my addr 172.21.15.43:0/881840223 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:39.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.759+0000 7f7372ffd700 1 --1- 172.21.15.43:0/881840223 >> v1:172.21.15.57:6789/0 conn(0x7f7374151a90 0x7f73740c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:54762/0 (socket says 172.21.15.43:54762) 2023-08-27T11:28:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73737fe700 1 -- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 msgr2=0x7f73740c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73737fe700 1 --2- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f73740c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73737fe700 1 -- 172.21.15.43:0/881840223 >> v1:172.21.15.57:6789/0 conn(0x7f7374151a90 legacy=0x7f73740c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73737fe700 1 -- 172.21.15.43:0/881840223 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374151e70 con 0x7f737406ad70 2023-08-27T11:28:39.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73727fc700 1 -- 172.21.15.43:0/881840223 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656735986 0 0) 0x7f737406c4e0 con 0x7f7374151a90 2023-08-27T11:28:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73737fe700 1 --2- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f737406ad70 0x7f737406b200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f736c009e50 tx=0x7f736c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3237b4d405a37817 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73727fc700 1 -- 172.21.15.43:0/881840223 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00e070 con 0x7f737406ad70 2023-08-27T11:28:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73727fc700 1 -- 172.21.15.43:0/881840223 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c00b910 con 0x7f737406ad70 2023-08-27T11:28:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.760+0000 7f73727fc700 1 -- 172.21.15.43:0/881840223 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00bcc0 con 0x7f737406ad70 2023-08-27T11:28:39.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 -- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f737406ad70 msgr2=0x7f737406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 --2- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f737406ad70 0x7f737406b200 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f736c009e50 tx=0x7f736c00b330 comp rx=0 tx=0).stop 2023-08-27T11:28:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 -- 172.21.15.43:0/881840223 shutdown_connections 2023-08-27T11:28:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 --2- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f737406ad70 0x7f737406b200 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 --2- 172.21.15.43:0/881840223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f73740c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 -- 172.21.15.43:0/881840223 >> 172.21.15.43:0/881840223 conn(0x7f73740ab820 msgr2=0x7f73740abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 -- 172.21.15.43:0/881840223 shutdown_connections 2023-08-27T11:28:39.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.761+0000 7f73797ff700 1 -- 172.21.15.43:0/881840223 wait complete. 2023-08-27T11:28:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.763+0000 7f73797ff700 1 Processor -- start 2023-08-27T11:28:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.763+0000 7f73797ff700 1 -- start start 2023-08-27T11:28:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f737414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7374151a90 0x7f73740c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740c3d10 con 0x7f737406ad70 2023-08-27T11:28:39.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73740ab3b0 con 0x7f7374151a90 2023-08-27T11:28:39.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73797ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73741ece70 con 0x7f73740c4630 2023-08-27T11:28:39.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36530/0 (socket says 172.21.15.43:36530) 2023-08-27T11:28:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 -- 172.21.15.43:0/99704110 learned_addr learned my addr 172.21.15.43:0/99704110 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f736bfff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f737414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f73737fe700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7374151a90 0x7f73740c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 -- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 msgr2=0x7f737414ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f737414ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 -- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7374151a90 msgr2=0x7f73740c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7374151a90 0x7f73740c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f7372ffd700 1 -- 172.21.15.43:0/99704110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c009b30 con 0x7f737406ad70 2023-08-27T11:28:39.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.764+0000 7f736bfff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f737414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f7372ffd700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f736400c550 tx=0x7f736400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364004c80 con 0x7f737406ad70 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364004e00 con 0x7f737406ad70 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73741ed150 con 0x7f737406ad70 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364007310 con 0x7f737406ad70 2023-08-27T11:28:39.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.765+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73741ed710 con 0x7f737406ad70 2023-08-27T11:28:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.766+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73741ed930 con 0x7f737406ad70 2023-08-27T11:28:39.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.767+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7364007470 con 0x7f737406ad70 2023-08-27T11:28:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.768+0000 7f736b7fe700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 0x7f735406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.768+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7364088240 con 0x7f737406ad70 2023-08-27T11:28:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.768+0000 7f736bfff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 0x7f735406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.769+0000 7f736bfff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 0x7f735406c5a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f73740ab7f0 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.773+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73640538a0 con 0x7f737406ad70 2023-08-27T11:28:39.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.984+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f737404ee70 con 0x7f737406ad70 2023-08-27T11:28:39.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.985+0000 7f736b7fe700 1 -- 172.21.15.43:0/99704110 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18191 (secure 0 0 0) 0x7f7364056ec0 con 0x7f737406ad70 2023-08-27T11:28:39.988 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:39.988 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":124,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:36.993232+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.987+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 msgr2=0x7f735406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.987+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 0x7f735406c5a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f73740ab7f0 tx=0x7f735c008040 comp rx=0 tx=0).stop 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.987+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 msgr2=0x7f73740c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.987+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f736400c550 tx=0x7f736400c860 comp rx=0 tx=0).stop 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 shutdown_connections 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f735406a0e0 0x7f735406c5a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7374151a90 0x7f73740c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f737406ad70 0x7f73740c37d0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 --2- 172.21.15.43:0/99704110 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f73740c4630 0x7f737414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 >> 172.21.15.43:0/99704110 conn(0x7f73740ab820 msgr2=0x7f7374150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 shutdown_connections 2023-08-27T11:28:39.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:39.988+0000 7f73797ff700 1 -- 172.21.15.43:0/99704110 wait complete. 2023-08-27T11:28:40.008 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:28:40.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.211+0000 7f56839ff700 1 Processor -- start 2023-08-27T11:28:40.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.211+0000 7f56839ff700 1 -- start start 2023-08-27T11:28:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f56839ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f56839ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f567c0c4630 0x7f567c0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f56839ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567c06c4e0 con 0x7f567c06ad70 2023-08-27T11:28:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f56839ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567c155370 con 0x7f567c0c4630 2023-08-27T11:28:40.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f56839ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c151e70 con 0x7f567c151a90 2023-08-27T11:28:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f567c0c4630 0x7f567c0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f567c0c4630 0x7f567c0c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36536/0 (socket says 172.21.15.43:36536) 2023-08-27T11:28:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 -- 172.21.15.43:0/3370917277 learned_addr learned my addr 172.21.15.43:0/3370917277 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f568179b700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 -- 172.21.15.43:0/3370917277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 msgr2=0x7f567c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 -- 172.21.15.43:0/3370917277 >> v1:172.21.15.57:6789/0 conn(0x7f567c06ad70 legacy=0x7f567c06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.213+0000 7f5680f9a700 1 -- 172.21.15.43:0/3370917277 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c154480 con 0x7f567c0c4630 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.214+0000 7f5680f9a700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c0c4630 0x7f567c0c4a90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f566c0098f0 tx=0x7f566c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d6bb8fd00da53a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.214+0000 7f5673fff700 1 -- 172.21.15.43:0/3370917277 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011830 con 0x7f567c0c4630 2023-08-27T11:28:40.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.214+0000 7f5673fff700 1 -- 172.21.15.43:0/3370917277 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c011990 con 0x7f567c0c4630 2023-08-27T11:28:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.214+0000 7f5673fff700 1 -- 172.21.15.43:0/3370917277 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011d20 con 0x7f567c0c4630 2023-08-27T11:28:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 -- 172.21.15.43:0/3370917277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c0c4630 msgr2=0x7f567c0c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c0c4630 0x7f567c0c4a90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f566c0098f0 tx=0x7f566c009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 -- 172.21.15.43:0/3370917277 shutdown_connections 2023-08-27T11:28:40.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 --2- 172.21.15.43:0/3370917277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c0c4630 0x7f567c0c4a90 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 -- 172.21.15.43:0/3370917277 >> 172.21.15.43:0/3370917277 conn(0x7f567c0ab820 msgr2=0x7f567c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 -- 172.21.15.43:0/3370917277 shutdown_connections 2023-08-27T11:28:40.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.215+0000 7f56839ff700 1 -- 172.21.15.43:0/3370917277 wait complete. 2023-08-27T11:28:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.217+0000 7f56839ff700 1 Processor -- start 2023-08-27T11:28:40.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.217+0000 7f56839ff700 1 -- start start 2023-08-27T11:28:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f567c0c4630 0x7f567c149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c149990 con 0x7f567c06ad70 2023-08-27T11:28:40.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1557b0 con 0x7f567c0c4630 2023-08-27T11:28:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f56839ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c0aa390 con 0x7f567c151a90 2023-08-27T11:28:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36550/0 (socket says 172.21.15.43:36550) 2023-08-27T11:28:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 -- 172.21.15.43:0/1036958295 learned_addr learned my addr 172.21.15.43:0/1036958295 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 -- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 msgr2=0x7f567c0c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 -- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f567c0c4630 msgr2=0x7f567c149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f567c0c4630 0x7f567c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 -- 172.21.15.43:0/1036958295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c009550 con 0x7f567c06ad70 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.219+0000 7f568179b700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f567800e870 tx=0x7f567800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.220+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678009590 con 0x7f567c06ad70 2023-08-27T11:28:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.220+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567800ee70 con 0x7f567c06ad70 2023-08-27T11:28:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.220+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c0c1b20 con 0x7f567c06ad70 2023-08-27T11:28:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.220+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567800ca50 con 0x7f567c06ad70 2023-08-27T11:28:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.220+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c155ce0 con 0x7f567c06ad70 2023-08-27T11:28:40.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.221+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c04ee70 con 0x7f567c06ad70 2023-08-27T11:28:40.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.222+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f567800cbb0 con 0x7f567c06ad70 2023-08-27T11:28:40.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.223+0000 7f5671ffb700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 0x7f566006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.223+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5678088500 con 0x7f567c06ad70 2023-08-27T11:28:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.223+0000 7f5680f9a700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 0x7f566006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.224+0000 7f5680f9a700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 0x7f566006c5a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f567c151120 tx=0x7f566c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.228+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5678057710 con 0x7f567c06ad70 2023-08-27T11:28:40.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.433+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f567c154a40 con 0x7f566006a0e0 2023-08-27T11:28:40.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.444+0000 7f5671ffb700 1 -- 172.21.15.43:0/1036958295 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306350 (secure 0 0 0) 0x7f566c01f070 con 0x7f566006a0e0 2023-08-27T11:28:40.451 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:40.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.448+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 msgr2=0x7f566006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.448+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 0x7f566006c5a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f567c151120 tx=0x7f566c010000 comp rx=0 tx=0).stop 2023-08-27T11:28:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.448+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 msgr2=0x7f567c1eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.448+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f567800e870 tx=0x7f567800ec30 comp rx=0 tx=0).stop 2023-08-27T11:28:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 shutdown_connections 2023-08-27T11:28:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f566006a0e0 0x7f566006c5a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f567c151a90 0x7f567c0c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f567c06ad70 0x7f567c1eac80 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 --2- 172.21.15.43:0/1036958295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f567c0c4630 0x7f567c149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 >> 172.21.15.43:0/1036958295 conn(0x7f567c0ab820 msgr2=0x7f567c06b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 shutdown_connections 2023-08-27T11:28:40.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.449+0000 7f56839ff700 1 -- 172.21.15.43:0/1036958295 wait complete. 2023-08-27T11:28:40.456 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:40.469 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-08-27T11:28:40.385720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233300,"kb_used_data":12976,"kb_used_omap":13,"kb_used_meta":220210,"kb_avail":754741420,"statfs":{"total":773094113280,"available":772855214080,"internally_reserved":0,"allocated":13287424,"data_stored":6853056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225495128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001051"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998893+0000","last_change":"2023-08-27T11:28:34.998893+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998893+0000","last_undegraded":"2023-08-27T11:28:34.998893+0000","last_fullsized":"2023-08-27T11:28:34.998893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995765+0000","last_change":"2023-08-27T11:28:34.995765+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995765+0000","last_undegraded":"2023-08-27T11:28:34.995765+0000","last_fullsized":"2023-08-27T11:28:34.995765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998666+0000","last_change":"2023-08-27T11:28:34.998666+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998666+0000","last_undegraded":"2023-08-27T11:28:34.998666+0000","last_fullsized":"2023-08-27T11:28:34.998666+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994872+0000","last_change":"2023-08-27T11:28:34.994872+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994872+0000","last_undegraded":"2023-08-27T11:28:34.994872+0000","last_fullsized":"2023-08-27T11:28:34.994872+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996260+0000","last_change":"2023-08-27T11:28:34.996260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996260+0000","last_undegraded":"2023-08-27T11:28:34.996260+0000","last_fullsized":"2023-08-27T11:28:34.996260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005148+0000","last_change":"2023-08-27T11:28:35.005148+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005148+0000","last_undegraded":"2023-08-27T11:28:35.005148+0000","last_fullsized":"2023-08-27T11:28:35.005148+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002060+0000","last_change":"2023-08-27T11:28:35.002060+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002060+0000","last_undegraded":"2023-08-27T11:28:35.002060+0000","last_fullsized":"2023-08-27T11:28:35.002060+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996585+0000","last_change":"2023-08-27T11:28:34.996585+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996585+0000","last_undegraded":"2023-08-27T11:28:34.996585+0000","last_fullsized":"2023-08-27T11:28:34.996585+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.008210+0000","last_change":"2023-08-27T11:28:35.008210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.008210+0000","last_undegraded":"2023-08-27T11:28:35.008210+0000","last_fullsized":"2023-08-27T11:28:35.008210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005825+0000","last_change":"2023-08-27T11:28:35.005825+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005825+0000","last_undegraded":"2023-08-27T11:28:35.005825+0000","last_fullsized":"2023-08-27T11:28:35.005825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994798+0000","last_change":"2023-08-27T11:28:34.994798+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994798+0000","last_undegraded":"2023-08-27T11:28:34.994798+0000","last_fullsized":"2023-08-27T11:28:34.994798+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997687+0000","last_change":"2023-08-27T11:28:34.997687+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997687+0000","last_undegraded":"2023-08-27T11:28:34.997687+0000","last_fullsized":"2023-08-27T11:28:34.997687+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004548+0000","last_change":"2023-08-27T11:28:35.004548+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004548+0000","last_undegraded":"2023-08-27T11:28:35.004548+0000","last_fullsized":"2023-08-27T11:28:35.004548+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999341+0000","last_change":"2023-08-27T11:28:34.999341+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999341+0000","last_undegraded":"2023-08-27T11:28:34.999341+0000","last_fullsized":"2023-08-27T11:28:34.999341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998562+0000","last_change":"2023-08-27T11:28:34.998562+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998562+0000","last_undegraded":"2023-08-27T11:28:34.998562+0000","last_fullsized":"2023-08-27T11:28:34.998562+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002126+0000","last_change":"2023-08-27T11:28:35.002126+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002126+0000","last_undegraded":"2023-08-27T11:28:35.002126+0000","last_fullsized":"2023-08-27T11:28:35.002126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004361+0000","last_change":"2023-08-27T11:28:35.004361+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004361+0000","last_undegraded":"2023-08-27T11:28:35.004361+0000","last_fullsized":"2023-08-27T11:28:35.004361+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001770+0000","last_change":"2023-08-27T11:28:35.001770+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001770+0000","last_undegraded":"2023-08-27T11:28:35.001770+0000","last_fullsized":"2023-08-27T11:28:35.001770+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002510+0000","last_change":"2023-08-27T11:28:35.002510+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002510+0000","last_undegraded":"2023-08-27T11:28:35.002510+0000","last_fullsized":"2023-08-27T11:28:35.002510+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996286+0000","last_change":"2023-08-27T11:28:34.996286+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996286+0000","last_undegraded":"2023-08-27T11:28:34.996286+0000","last_fullsized":"2023-08-27T11:28:34.996286+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995246+0000","last_change":"2023-08-27T11:28:34.995246+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995246+0000","last_undegraded":"2023-08-27T11:28:34.995246+0000","last_fullsized":"2023-08-27T11:28:34.995246+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998003+0000","last_change":"2023-08-27T11:28:34.998003+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998003+0000","last_undegraded":"2023-08-27T11:28:34.998003+0000","last_fullsized":"2023-08-27T11:28:34.998003+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995512+0000","last_change":"2023-08-27T11:28:34.995512+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995512+0000","last_undegraded":"2023-08-27T11:28:34.995512+0000","last_fullsized":"2023-08-27T11:28:34.995512+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003500+0000","last_change":"2023-08-27T11:28:35.003500+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003500+0000","last_undegraded":"2023-08-27T11:28:35.003500+0000","last_fullsized":"2023-08-27T11:28:35.003500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998398+0000","last_change":"2023-08-27T11:28:34.998398+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998398+0000","last_undegraded":"2023-08-27T11:28:34.998398+0000","last_fullsized":"2023-08-27T11:28:34.998398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998311+0000","last_change":"2023-08-27T11:28:34.998311+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998311+0000","last_undegraded":"2023-08-27T11:28:34.998311+0000","last_fullsized":"2023-08-27T11:28:34.998311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002965+0000","last_change":"2023-08-27T11:28:35.002965+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002965+0000","last_undegraded":"2023-08-27T11:28:35.002965+0000","last_fullsized":"2023-08-27T11:28:35.002965+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004607+0000","last_change":"2023-08-27T11:28:35.004607+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004607+0000","last_undegraded":"2023-08-27T11:28:35.004607+0000","last_fullsized":"2023-08-27T11:28:35.004607+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999210+0000","last_change":"2023-08-27T11:28:34.999210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999210+0000","last_undegraded":"2023-08-27T11:28:34.999210+0000","last_fullsized":"2023-08-27T11:28:34.999210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998437+0000","last_change":"2023-08-27T11:28:34.998437+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998437+0000","last_undegraded":"2023-08-27T11:28:34.998437+0000","last_fullsized":"2023-08-27T11:28:34.998437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997101+0000","last_change":"2023-08-27T11:28:34.997101+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997101+0000","last_undegraded":"2023-08-27T11:28:34.997101+0000","last_fullsized":"2023-08-27T11:28:34.997101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003565+0000","last_change":"2023-08-27T11:28:35.003565+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003565+0000","last_undegraded":"2023-08-27T11:28:35.003565+0000","last_fullsized":"2023-08-27T11:28:35.003565+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996024+0000","last_change":"2023-08-27T11:28:34.996024+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996024+0000","last_undegraded":"2023-08-27T11:28:34.996024+0000","last_fullsized":"2023-08-27T11:28:34.996024+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012797+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:35.012797+0000","last_peered":"2023-08-27T11:28:35.012797+0000","last_clean":"2023-08-27T11:28:35.012797+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:35.012797+0000","last_undegraded":"2023-08-27T11:28:35.012797+0000","last_fullsized":"2023-08-27T11:28:35.012797+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996599+0000","last_change":"2023-08-27T11:28:34.996599+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996599+0000","last_undegraded":"2023-08-27T11:28:34.996599+0000","last_fullsized":"2023-08-27T11:28:34.996599+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013644+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:35.013644+0000","last_peered":"2023-08-27T11:28:35.013644+0000","last_clean":"2023-08-27T11:28:35.013644+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:35.013644+0000","last_undegraded":"2023-08-27T11:28:35.013644+0000","last_fullsized":"2023-08-27T11:28:35.013644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994787+0000","last_change":"2023-08-27T11:28:34.994787+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994787+0000","last_undegraded":"2023-08-27T11:28:34.994787+0000","last_fullsized":"2023-08-27T11:28:34.994787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020581+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:35.020581+0000","last_peered":"2023-08-27T11:28:35.020581+0000","last_clean":"2023-08-27T11:28:35.020581+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:35.020581+0000","last_undegraded":"2023-08-27T11:28:35.020581+0000","last_fullsized":"2023-08-27T11:28:35.020581+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:37.820343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998325+0000","last_change":"2023-08-27T11:28:34.998325+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998325+0000","last_undegraded":"2023-08-27T11:28:34.998325+0000","last_fullsized":"2023-08-27T11:28:34.998325+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013103+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:35.013103+0000","last_peered":"2023-08-27T11:28:35.013103+0000","last_clean":"2023-08-27T11:28:35.013103+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:35.013103+0000","last_undegraded":"2023-08-27T11:28:35.013103+0000","last_fullsized":"2023-08-27T11:28:35.013103+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:28.488734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998726+0000","last_change":"2023-08-27T11:28:34.998726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998726+0000","last_undegraded":"2023-08-27T11:28:34.998726+0000","last_fullsized":"2023-08-27T11:28:34.998726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015098+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:35.015098+0000","last_peered":"2023-08-27T11:28:35.015098+0000","last_clean":"2023-08-27T11:28:35.015098+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:35.015098+0000","last_undegraded":"2023-08-27T11:28:35.015098+0000","last_fullsized":"2023-08-27T11:28:35.015098+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:20.653735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998913+0000","last_change":"2023-08-27T11:28:34.998913+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998913+0000","last_undegraded":"2023-08-27T11:28:34.998913+0000","last_fullsized":"2023-08-27T11:28:34.998913+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015302+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:35.015302+0000","last_peered":"2023-08-27T11:28:35.015302+0000","last_clean":"2023-08-27T11:28:35.015302+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:35.015302+0000","last_undegraded":"2023-08-27T11:28:35.015302+0000","last_fullsized":"2023-08-27T11:28:35.015302+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001260+0000","last_change":"2023-08-27T11:28:35.001260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001260+0000","last_undegraded":"2023-08-27T11:28:35.001260+0000","last_fullsized":"2023-08-27T11:28:35.001260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018572+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:35.018572+0000","last_peered":"2023-08-27T11:28:35.018572+0000","last_clean":"2023-08-27T11:28:35.018572+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:35.018572+0000","last_undegraded":"2023-08-27T11:28:35.018572+0000","last_fullsized":"2023-08-27T11:28:35.018572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:42.683860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002434+0000","last_change":"2023-08-27T11:28:35.002434+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002434+0000","last_undegraded":"2023-08-27T11:28:35.002434+0000","last_fullsized":"2023-08-27T11:28:35.002434+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012732+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:35.012732+0000","last_peered":"2023-08-27T11:28:35.012732+0000","last_clean":"2023-08-27T11:28:35.012732+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:35.012732+0000","last_undegraded":"2023-08-27T11:28:35.012732+0000","last_fullsized":"2023-08-27T11:28:35.012732+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:30.207482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997296+0000","last_change":"2023-08-27T11:28:34.997296+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997296+0000","last_undegraded":"2023-08-27T11:28:34.997296+0000","last_fullsized":"2023-08-27T11:28:34.997296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014037+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:35.014037+0000","last_peered":"2023-08-27T11:28:35.014037+0000","last_clean":"2023-08-27T11:28:35.014037+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:35.014037+0000","last_undegraded":"2023-08-27T11:28:35.014037+0000","last_fullsized":"2023-08-27T11:28:35.014037+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:49.824933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001555+0000","last_change":"2023-08-27T11:28:35.001555+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001555+0000","last_undegraded":"2023-08-27T11:28:35.001555+0000","last_fullsized":"2023-08-27T11:28:35.001555+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015544+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:35.015544+0000","last_peered":"2023-08-27T11:28:35.015544+0000","last_clean":"2023-08-27T11:28:35.015544+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:35.015544+0000","last_undegraded":"2023-08-27T11:28:35.015544+0000","last_fullsized":"2023-08-27T11:28:35.015544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002570+0000","last_change":"2023-08-27T11:28:35.002570+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002570+0000","last_undegraded":"2023-08-27T11:28:35.002570+0000","last_fullsized":"2023-08-27T11:28:35.002570+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018469+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:35.018469+0000","last_peered":"2023-08-27T11:28:35.018469+0000","last_clean":"2023-08-27T11:28:35.018469+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:35.018469+0000","last_undegraded":"2023-08-27T11:28:35.018469+0000","last_fullsized":"2023-08-27T11:28:35.018469+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:26.864578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006662+0000","last_change":"2023-08-27T11:28:35.006662+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006662+0000","last_undegraded":"2023-08-27T11:28:35.006662+0000","last_fullsized":"2023-08-27T11:28:35.006662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013597+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:35.013597+0000","last_peered":"2023-08-27T11:28:35.013597+0000","last_clean":"2023-08-27T11:28:35.013597+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:35.013597+0000","last_undegraded":"2023-08-27T11:28:35.013597+0000","last_fullsized":"2023-08-27T11:28:35.013597+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:01.094339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999726+0000","last_change":"2023-08-27T11:28:34.999726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999726+0000","last_undegraded":"2023-08-27T11:28:34.999726+0000","last_fullsized":"2023-08-27T11:28:34.999726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013821+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:35.013821+0000","last_peered":"2023-08-27T11:28:35.013821+0000","last_clean":"2023-08-27T11:28:35.013821+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:35.013821+0000","last_undegraded":"2023-08-27T11:28:35.013821+0000","last_fullsized":"2023-08-27T11:28:35.013821+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:13.018341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997114+0000","last_change":"2023-08-27T11:28:34.997114+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997114+0000","last_undegraded":"2023-08-27T11:28:34.997114+0000","last_fullsized":"2023-08-27T11:28:34.997114+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.016113+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:35.016113+0000","last_peered":"2023-08-27T11:28:35.016113+0000","last_clean":"2023-08-27T11:28:35.016113+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:35.016113+0000","last_undegraded":"2023-08-27T11:28:35.016113+0000","last_fullsized":"2023-08-27T11:28:35.016113+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:57.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997099+0000","last_change":"2023-08-27T11:28:34.997099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997099+0000","last_undegraded":"2023-08-27T11:28:34.997099+0000","last_fullsized":"2023-08-27T11:28:34.997099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018075+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:35.018075+0000","last_peered":"2023-08-27T11:28:35.018075+0000","last_clean":"2023-08-27T11:28:35.018075+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:35.018075+0000","last_undegraded":"2023-08-27T11:28:35.018075+0000","last_fullsized":"2023-08-27T11:28:35.018075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:56:55.724660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997186+0000","last_change":"2023-08-27T11:28:34.997186+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997186+0000","last_undegraded":"2023-08-27T11:28:34.997186+0000","last_fullsized":"2023-08-27T11:28:34.997186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018708+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:35.018708+0000","last_peered":"2023-08-27T11:28:35.018708+0000","last_clean":"2023-08-27T11:28:35.018708+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:35.018708+0000","last_undegraded":"2023-08-27T11:28:35.018708+0000","last_fullsized":"2023-08-27T11:28:35.018708+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:11.806392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996963+0000","last_change":"2023-08-27T11:28:34.996963+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996963+0000","last_undegraded":"2023-08-27T11:28:34.996963+0000","last_fullsized":"2023-08-27T11:28:34.996963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017206+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:35.017206+0000","last_peered":"2023-08-27T11:28:35.017206+0000","last_clean":"2023-08-27T11:28:35.017206+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:35.017206+0000","last_undegraded":"2023-08-27T11:28:35.017206+0000","last_fullsized":"2023-08-27T11:28:35.017206+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:22:07.385319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997210+0000","last_change":"2023-08-27T11:28:34.997210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997210+0000","last_undegraded":"2023-08-27T11:28:34.997210+0000","last_fullsized":"2023-08-27T11:28:34.997210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012101+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:35.012101+0000","last_peered":"2023-08-27T11:28:35.012101+0000","last_clean":"2023-08-27T11:28:35.012101+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:35.012101+0000","last_undegraded":"2023-08-27T11:28:35.012101+0000","last_fullsized":"2023-08-27T11:28:35.012101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:02:19.059991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001884+0000","last_change":"2023-08-27T11:28:35.001884+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001884+0000","last_undegraded":"2023-08-27T11:28:35.001884+0000","last_fullsized":"2023-08-27T11:28:35.001884+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012084+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:35.012084+0000","last_peered":"2023-08-27T11:28:35.012084+0000","last_clean":"2023-08-27T11:28:35.012084+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:35.012084+0000","last_undegraded":"2023-08-27T11:28:35.012084+0000","last_fullsized":"2023-08-27T11:28:35.012084+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:11:19.705357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004673+0000","last_change":"2023-08-27T11:28:35.004673+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004673+0000","last_undegraded":"2023-08-27T11:28:35.004673+0000","last_fullsized":"2023-08-27T11:28:35.004673+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019674+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:35.019674+0000","last_peered":"2023-08-27T11:28:35.019674+0000","last_clean":"2023-08-27T11:28:35.019674+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:35.019674+0000","last_undegraded":"2023-08-27T11:28:35.019674+0000","last_fullsized":"2023-08-27T11:28:35.019674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:41:18.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004099+0000","last_change":"2023-08-27T11:28:35.004099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004099+0000","last_undegraded":"2023-08-27T11:28:35.004099+0000","last_fullsized":"2023-08-27T11:28:35.004099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012108+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:35.012108+0000","last_peered":"2023-08-27T11:28:35.012108+0000","last_clean":"2023-08-27T11:28:35.012108+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:35.012108+0000","last_undegraded":"2023-08-27T11:28:35.012108+0000","last_fullsized":"2023-08-27T11:28:35.012108+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:48.153571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004718+0000","last_change":"2023-08-27T11:28:35.004718+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004718+0000","last_undegraded":"2023-08-27T11:28:35.004718+0000","last_fullsized":"2023-08-27T11:28:35.004718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013124+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:35.013124+0000","last_peered":"2023-08-27T11:28:35.013124+0000","last_clean":"2023-08-27T11:28:35.013124+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:35.013124+0000","last_undegraded":"2023-08-27T11:28:35.013124+0000","last_fullsized":"2023-08-27T11:28:35.013124+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:40:45.508564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003873+0000","last_change":"2023-08-27T11:28:35.003873+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003873+0000","last_undegraded":"2023-08-27T11:28:35.003873+0000","last_fullsized":"2023-08-27T11:28:35.003873+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019706+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:35.019706+0000","last_peered":"2023-08-27T11:28:35.019706+0000","last_clean":"2023-08-27T11:28:35.019706+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:35.019706+0000","last_undegraded":"2023-08-27T11:28:35.019706+0000","last_fullsized":"2023-08-27T11:28:35.019706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:54:02.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001853+0000","last_change":"2023-08-27T11:28:35.001853+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001853+0000","last_undegraded":"2023-08-27T11:28:35.001853+0000","last_fullsized":"2023-08-27T11:28:35.001853+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017121+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:35.017121+0000","last_peered":"2023-08-27T11:28:35.017121+0000","last_clean":"2023-08-27T11:28:35.017121+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:35.017121+0000","last_undegraded":"2023-08-27T11:28:35.017121+0000","last_fullsized":"2023-08-27T11:28:35.017121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:21.005653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995868+0000","last_change":"2023-08-27T11:28:34.995868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995868+0000","last_undegraded":"2023-08-27T11:28:34.995868+0000","last_fullsized":"2023-08-27T11:28:34.995868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015811+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:35.015811+0000","last_peered":"2023-08-27T11:28:35.015811+0000","last_clean":"2023-08-27T11:28:35.015811+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:35.015811+0000","last_undegraded":"2023-08-27T11:28:35.015811+0000","last_fullsized":"2023-08-27T11:28:35.015811+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:43:18.868103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:26.705541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995888+0000","last_change":"2023-08-27T11:28:34.995888+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995888+0000","last_undegraded":"2023-08-27T11:28:34.995888+0000","last_fullsized":"2023-08-27T11:28:34.995888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017472+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:35.017472+0000","last_peered":"2023-08-27T11:28:35.017472+0000","last_clean":"2023-08-27T11:28:35.017472+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:35.017472+0000","last_undegraded":"2023-08-27T11:28:35.017472+0000","last_fullsized":"2023-08-27T11:28:35.017472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:06.183796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:29.520414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004143+0000","last_change":"2023-08-27T11:28:35.004143+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004143+0000","last_undegraded":"2023-08-27T11:28:35.004143+0000","last_fullsized":"2023-08-27T11:28:35.004143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020153+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:35.020153+0000","last_peered":"2023-08-27T11:28:35.020153+0000","last_clean":"2023-08-27T11:28:35.020153+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:35.020153+0000","last_undegraded":"2023-08-27T11:28:35.020153+0000","last_fullsized":"2023-08-27T11:28:35.020153+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:15.211750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":215,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.996443+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:34.996443+0000","last_peered":"2023-08-27T11:28:34.996443+0000","last_clean":"2023-08-27T11:28:34.996443+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:34.996443+0000","last_undegraded":"2023-08-27T11:28:34.996443+0000","last_fullsized":"2023-08-27T11:28:34.996443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:28:28.689665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996258+0000","last_change":"2023-08-27T11:28:34.996258+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996258+0000","last_undegraded":"2023-08-27T11:28:34.996258+0000","last_fullsized":"2023-08-27T11:28:34.996258+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018068+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:35.018068+0000","last_peered":"2023-08-27T11:28:35.018068+0000","last_clean":"2023-08-27T11:28:35.018068+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:35.018068+0000","last_undegraded":"2023-08-27T11:28:35.018068+0000","last_fullsized":"2023-08-27T11:28:35.018068+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:30.665301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004952+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:35.004952+0000","last_peered":"2023-08-27T11:28:35.004952+0000","last_clean":"2023-08-27T11:28:35.004952+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:35.004952+0000","last_undegraded":"2023-08-27T11:28:35.004952+0000","last_fullsized":"2023-08-27T11:28:35.004952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:29:36.012817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998709+0000","last_change":"2023-08-27T11:28:34.998709+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998709+0000","last_undegraded":"2023-08-27T11:28:34.998709+0000","last_fullsized":"2023-08-27T11:28:34.998709+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017161+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:35.017161+0000","last_peered":"2023-08-27T11:28:35.017161+0000","last_clean":"2023-08-27T11:28:35.017161+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:35.017161+0000","last_undegraded":"2023-08-27T11:28:35.017161+0000","last_fullsized":"2023-08-27T11:28:35.017161+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:44.678356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004477+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:35.004477+0000","last_peered":"2023-08-27T11:28:35.004477+0000","last_clean":"2023-08-27T11:28:35.004477+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:35.004477+0000","last_undegraded":"2023-08-27T11:28:35.004477+0000","last_fullsized":"2023-08-27T11:28:35.004477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:25.039099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001814+0000","last_change":"2023-08-27T11:28:35.001814+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001814+0000","last_undegraded":"2023-08-27T11:28:35.001814+0000","last_fullsized":"2023-08-27T11:28:35.001814+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012867+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:35.012867+0000","last_peered":"2023-08-27T11:28:35.012867+0000","last_clean":"2023-08-27T11:28:35.012867+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:35.012867+0000","last_undegraded":"2023-08-27T11:28:35.012867+0000","last_fullsized":"2023-08-27T11:28:35.012867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:52.103487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":339,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004793+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:35.004793+0000","last_peered":"2023-08-27T11:28:35.004793+0000","last_clean":"2023-08-27T11:28:35.004793+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:35.004793+0000","last_undegraded":"2023-08-27T11:28:35.004793+0000","last_fullsized":"2023-08-27T11:28:35.004793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:33.273771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014342+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:35.014342+0000","last_peered":"2023-08-27T11:28:35.014342+0000","last_clean":"2023-08-27T11:28:35.014342+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:35.014342+0000","last_undegraded":"2023-08-27T11:28:35.014342+0000","last_fullsized":"2023-08-27T11:28:35.014342+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:50.084686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006201+0000","last_change":"2023-08-27T11:28:35.006201+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006201+0000","last_undegraded":"2023-08-27T11:28:35.006201+0000","last_fullsized":"2023-08-27T11:28:35.006201+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019744+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:35.019744+0000","last_peered":"2023-08-27T11:28:35.019744+0000","last_clean":"2023-08-27T11:28:35.019744+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:35.019744+0000","last_undegraded":"2023-08-27T11:28:35.019744+0000","last_fullsized":"2023-08-27T11:28:35.019744+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:59:23.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.006432+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:35.006432+0000","last_peered":"2023-08-27T11:28:35.006432+0000","last_clean":"2023-08-27T11:28:35.006432+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:35.006432+0000","last_undegraded":"2023-08-27T11:28:35.006432+0000","last_fullsized":"2023-08-27T11:28:35.006432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:11:59.900036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996868+0000","last_change":"2023-08-27T11:28:34.996868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996868+0000","last_undegraded":"2023-08-27T11:28:34.996868+0000","last_fullsized":"2023-08-27T11:28:34.996868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014057+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:35.014057+0000","last_peered":"2023-08-27T11:28:35.014057+0000","last_clean":"2023-08-27T11:28:35.014057+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:35.014057+0000","last_undegraded":"2023-08-27T11:28:35.014057+0000","last_fullsized":"2023-08-27T11:28:35.014057+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:48:41.844380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":213,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.999190+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:34.999190+0000","last_peered":"2023-08-27T11:28:34.999190+0000","last_clean":"2023-08-27T11:28:34.999190+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:34.999190+0000","last_undegraded":"2023-08-27T11:28:34.999190+0000","last_fullsized":"2023-08-27T11:28:34.999190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:45.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29076,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342764,"statfs":{"total":96636764160,"available":96606990336,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.505}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.745}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.52500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28504,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343336,"statfs":{"total":96636764160,"available":96607576064,"internally_reserved":0,"allocated":1519616,"data_stored":713512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71299999999999997,"15min":0.877},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.01,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":3.472,"15min":3.472},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.94599999999999995},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.98799999999999999,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.753,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.95299999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74199999999999999,"15min":0.84599999999999997},"min":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.101,"5min":1.234,"15min":1.234},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76300000000000001,"15min":0.80200000000000005},"min":{"1min":0.50900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.071,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":1.135,"15min":1.135},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82499999999999996,"15min":0.84699999999999998},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.88100000000000001},"min":{"1min":0.62,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.111,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0309999999999999,"5min":1.27,"15min":1.27},"last":0.71899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":2.734,"15min":2.734},"last":0.64600000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68700000000000006,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61599999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.93100000000000005,"5min":3.101,"15min":3.101},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1240000000000001,"5min":3.359,"15min":3.359},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.96999999999999997,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.036,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.754}]},{"osd":7,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.038,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60499999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.88900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":1.135}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.355,"15min":1.355},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94299999999999995,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.74299999999999999},"min":{"1min":0.621,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":1.123,"15min":1.123},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.032,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.173}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90100000000000002,"5min":1.329,"15min":1.329},"last":1.081},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94799999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.111}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96899999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.254},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":1.2789999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1523712,"data_stored":714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.375}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.90000000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.93799999999999994}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46000000000000002,"15min":0.59899999999999998},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.52000000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.443},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83799999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":1.1459999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70299999999999996,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.628,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74099999999999999,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77300000000000002,"15min":0.90000000000000002},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.022,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96399999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.429,"15min":1.429},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.96999999999999997},"min":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.62}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.95399999999999996},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80200000000000005,"15min":0.94399999999999995},"min":{"1min":0.622,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90700000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.96099999999999997},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":5,"15min":5},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1511424,"data_stored":707878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.498},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.628}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.749}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.034}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:40.476 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:40.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 Processor -- start 2023-08-27T11:28:40.710 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 -- start start 2023-08-27T11:28:40.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26600c4630 0x7f26600c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 0x7f266006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266006c4e0 con 0x7f2660151a90 2023-08-27T11:28:40.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2660155370 con 0x7f266006ad70 2023-08-27T11:28:40.712 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f26661ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26600c82c0 con 0x7f26600c4630 2023-08-27T11:28:40.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f265f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2660151a90 0x7f26600c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47358/0 (socket says 172.21.15.43:47358) 2023-08-27T11:28:40.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f265f7fe700 1 -- 172.21.15.43:0/2858527764 learned_addr learned my addr 172.21.15.43:0/2858527764 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:40.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.709+0000 7f265effd700 1 --2- 172.21.15.43:0/2858527764 >> v2:172.21.15.57:3300/0 conn(0x7f26600c4630 0x7f26600c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.713 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265ffff700 1 --2- 172.21.15.43:0/2858527764 >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 0x7f266006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265e7fc700 1 -- 172.21.15.43:0/2858527764 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856507897 0 0) 0x7f266006c4e0 con 0x7f2660151a90 2023-08-27T11:28:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265e7fc700 1 -- 172.21.15.43:0/2858527764 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26480035b0 con 0x7f2660151a90 2023-08-27T11:28:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265effd700 1 -- 172.21.15.43:0/2858527764 >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 msgr2=0x7f266006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:40.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265effd700 1 --2- 172.21.15.43:0/2858527764 >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 0x7f266006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265effd700 1 -- 172.21.15.43:0/2858527764 >> v1:172.21.15.43:6789/0 conn(0x7f2660151a90 legacy=0x7f26600c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265effd700 1 -- 172.21.15.43:0/2858527764 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660151e70 con 0x7f26600c4630 2023-08-27T11:28:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265ffff700 1 --2- 172.21.15.43:0/2858527764 >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 0x7f266006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.710+0000 7f265effd700 1 --2- 172.21.15.43:0/2858527764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26600c4630 0x7f26600c4a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f26600c7740 tx=0x7f2654009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3625ba947562a744 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f265e7fc700 1 -- 172.21.15.43:0/2858527764 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654011830 con 0x7f26600c4630 2023-08-27T11:28:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f265e7fc700 1 -- 172.21.15.43:0/2858527764 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2654011990 con 0x7f26600c4630 2023-08-27T11:28:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f265e7fc700 1 -- 172.21.15.43:0/2858527764 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654011d00 con 0x7f26600c4630 2023-08-27T11:28:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 -- 172.21.15.43:0/2858527764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26600c4630 msgr2=0x7f26600c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 --2- 172.21.15.43:0/2858527764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26600c4630 0x7f26600c4a90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f26600c7740 tx=0x7f2654009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:40.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 -- 172.21.15.43:0/2858527764 shutdown_connections 2023-08-27T11:28:40.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 --2- 172.21.15.43:0/2858527764 >> v2:172.21.15.43:3300/0 conn(0x7f266006ad70 0x7f266006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 --2- 172.21.15.43:0/2858527764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26600c4630 0x7f26600c4a90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 -- 172.21.15.43:0/2858527764 >> 172.21.15.43:0/2858527764 conn(0x7f26600ab820 msgr2=0x7f26600abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:40.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 -- 172.21.15.43:0/2858527764 shutdown_connections 2023-08-27T11:28:40.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.711+0000 7f26661ff700 1 -- 172.21.15.43:0/2858527764 wait complete. 2023-08-27T11:28:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.713+0000 7f26661ff700 1 Processor -- start 2023-08-27T11:28:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.713+0000 7f26661ff700 1 -- start start 2023-08-27T11:28:40.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 0x7f2660149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2660151a90 0x7f2660148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26601e9200 con 0x7f26600c4630 2023-08-27T11:28:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266014bdd0 con 0x7f2660151a90 2023-08-27T11:28:40.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.714+0000 7f26661ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266014c0b0 con 0x7f266006ad70 2023-08-27T11:28:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36574/0 (socket says 172.21.15.43:36574) 2023-08-27T11:28:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 -- 172.21.15.43:0/3922874431 learned_addr learned my addr 172.21.15.43:0/3922874431 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265ffff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2660151a90 0x7f2660148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.723 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265f7fe700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 0x7f2660149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 -- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 msgr2=0x7f2660149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 0x7f2660149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 -- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2660151a90 msgr2=0x7f2660148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2660151a90 0x7f2660148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 -- 172.21.15.43:0/3922874431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658009a70 con 0x7f26600c4630 2023-08-27T11:28:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265f7fe700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 0x7f2660149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f265effd700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2654009b60 tx=0x7f2654004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.715+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26540036a0 con 0x7f26600c4630 2023-08-27T11:28:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.716+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265401f070 con 0x7f26600c4630 2023-08-27T11:28:40.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.716+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654003a40 con 0x7f26600c4630 2023-08-27T11:28:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.716+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26540094a0 con 0x7f26600c4630 2023-08-27T11:28:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.716+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266014c670 con 0x7f26600c4630 2023-08-27T11:28:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.717+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266004ee70 con 0x7f26600c4630 2023-08-27T11:28:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.718+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2654003ba0 con 0x7f26600c4630 2023-08-27T11:28:40.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.718+0000 7f2647fff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:40.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.719+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2654021070 con 0x7f26600c4630 2023-08-27T11:28:40.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.719+0000 7f265f7fe700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:40.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.719+0000 7f265f7fe700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2650005910 tx=0x7f2650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:40.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.723+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2654055450 con 0x7f26600c4630 2023-08-27T11:28:40.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.928+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f266014bf40 con 0x7f264c06a0e0 2023-08-27T11:28:40.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.938+0000 7f2647fff700 1 -- 172.21.15.43:0/3922874431 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306350 (secure 0 0 0) 0x7f266014bf40 con 0x7f264c06a0e0 2023-08-27T11:28:40.947 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:40.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 msgr2=0x7f264c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2650005910 tx=0x7f2650009040 comp rx=0 tx=0).stop 2023-08-27T11:28:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 msgr2=0x7f26600c1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2654009b60 tx=0x7f2654004750 comp rx=0 tx=0).stop 2023-08-27T11:28:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 shutdown_connections 2023-08-27T11:28:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2660151a90 0x7f2660148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266006ad70 0x7f2660149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 --2- 172.21.15.43:0/3922874431 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26600c4630 0x7f26600c1220 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 >> 172.21.15.43:0/3922874431 conn(0x7f26600ab820 msgr2=0x7f266006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 shutdown_connections 2023-08-27T11:28:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:40.943+0000 7f26661ff700 1 -- 172.21.15.43:0/3922874431 wait complete. 2023-08-27T11:28:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:40.964 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-08-27T11:28:40.385720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233300,"kb_used_data":12976,"kb_used_omap":13,"kb_used_meta":220210,"kb_avail":754741420,"statfs":{"total":773094113280,"available":772855214080,"internally_reserved":0,"allocated":13287424,"data_stored":6853056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225495128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001051"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998893+0000","last_change":"2023-08-27T11:28:34.998893+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998893+0000","last_undegraded":"2023-08-27T11:28:34.998893+0000","last_fullsized":"2023-08-27T11:28:34.998893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995765+0000","last_change":"2023-08-27T11:28:34.995765+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995765+0000","last_undegraded":"2023-08-27T11:28:34.995765+0000","last_fullsized":"2023-08-27T11:28:34.995765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998666+0000","last_change":"2023-08-27T11:28:34.998666+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998666+0000","last_undegraded":"2023-08-27T11:28:34.998666+0000","last_fullsized":"2023-08-27T11:28:34.998666+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994872+0000","last_change":"2023-08-27T11:28:34.994872+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994872+0000","last_undegraded":"2023-08-27T11:28:34.994872+0000","last_fullsized":"2023-08-27T11:28:34.994872+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996260+0000","last_change":"2023-08-27T11:28:34.996260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996260+0000","last_undegraded":"2023-08-27T11:28:34.996260+0000","last_fullsized":"2023-08-27T11:28:34.996260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005148+0000","last_change":"2023-08-27T11:28:35.005148+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005148+0000","last_undegraded":"2023-08-27T11:28:35.005148+0000","last_fullsized":"2023-08-27T11:28:35.005148+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002060+0000","last_change":"2023-08-27T11:28:35.002060+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002060+0000","last_undegraded":"2023-08-27T11:28:35.002060+0000","last_fullsized":"2023-08-27T11:28:35.002060+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996585+0000","last_change":"2023-08-27T11:28:34.996585+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996585+0000","last_undegraded":"2023-08-27T11:28:34.996585+0000","last_fullsized":"2023-08-27T11:28:34.996585+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.008210+0000","last_change":"2023-08-27T11:28:35.008210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.008210+0000","last_undegraded":"2023-08-27T11:28:35.008210+0000","last_fullsized":"2023-08-27T11:28:35.008210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005825+0000","last_change":"2023-08-27T11:28:35.005825+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005825+0000","last_undegraded":"2023-08-27T11:28:35.005825+0000","last_fullsized":"2023-08-27T11:28:35.005825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994798+0000","last_change":"2023-08-27T11:28:34.994798+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994798+0000","last_undegraded":"2023-08-27T11:28:34.994798+0000","last_fullsized":"2023-08-27T11:28:34.994798+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997687+0000","last_change":"2023-08-27T11:28:34.997687+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997687+0000","last_undegraded":"2023-08-27T11:28:34.997687+0000","last_fullsized":"2023-08-27T11:28:34.997687+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004548+0000","last_change":"2023-08-27T11:28:35.004548+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004548+0000","last_undegraded":"2023-08-27T11:28:35.004548+0000","last_fullsized":"2023-08-27T11:28:35.004548+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999341+0000","last_change":"2023-08-27T11:28:34.999341+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999341+0000","last_undegraded":"2023-08-27T11:28:34.999341+0000","last_fullsized":"2023-08-27T11:28:34.999341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998562+0000","last_change":"2023-08-27T11:28:34.998562+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998562+0000","last_undegraded":"2023-08-27T11:28:34.998562+0000","last_fullsized":"2023-08-27T11:28:34.998562+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002126+0000","last_change":"2023-08-27T11:28:35.002126+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002126+0000","last_undegraded":"2023-08-27T11:28:35.002126+0000","last_fullsized":"2023-08-27T11:28:35.002126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004361+0000","last_change":"2023-08-27T11:28:35.004361+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004361+0000","last_undegraded":"2023-08-27T11:28:35.004361+0000","last_fullsized":"2023-08-27T11:28:35.004361+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001770+0000","last_change":"2023-08-27T11:28:35.001770+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001770+0000","last_undegraded":"2023-08-27T11:28:35.001770+0000","last_fullsized":"2023-08-27T11:28:35.001770+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002510+0000","last_change":"2023-08-27T11:28:35.002510+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002510+0000","last_undegraded":"2023-08-27T11:28:35.002510+0000","last_fullsized":"2023-08-27T11:28:35.002510+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996286+0000","last_change":"2023-08-27T11:28:34.996286+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996286+0000","last_undegraded":"2023-08-27T11:28:34.996286+0000","last_fullsized":"2023-08-27T11:28:34.996286+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995246+0000","last_change":"2023-08-27T11:28:34.995246+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995246+0000","last_undegraded":"2023-08-27T11:28:34.995246+0000","last_fullsized":"2023-08-27T11:28:34.995246+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998003+0000","last_change":"2023-08-27T11:28:34.998003+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998003+0000","last_undegraded":"2023-08-27T11:28:34.998003+0000","last_fullsized":"2023-08-27T11:28:34.998003+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995512+0000","last_change":"2023-08-27T11:28:34.995512+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995512+0000","last_undegraded":"2023-08-27T11:28:34.995512+0000","last_fullsized":"2023-08-27T11:28:34.995512+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003500+0000","last_change":"2023-08-27T11:28:35.003500+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003500+0000","last_undegraded":"2023-08-27T11:28:35.003500+0000","last_fullsized":"2023-08-27T11:28:35.003500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998398+0000","last_change":"2023-08-27T11:28:34.998398+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998398+0000","last_undegraded":"2023-08-27T11:28:34.998398+0000","last_fullsized":"2023-08-27T11:28:34.998398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998311+0000","last_change":"2023-08-27T11:28:34.998311+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998311+0000","last_undegraded":"2023-08-27T11:28:34.998311+0000","last_fullsized":"2023-08-27T11:28:34.998311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002965+0000","last_change":"2023-08-27T11:28:35.002965+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002965+0000","last_undegraded":"2023-08-27T11:28:35.002965+0000","last_fullsized":"2023-08-27T11:28:35.002965+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004607+0000","last_change":"2023-08-27T11:28:35.004607+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004607+0000","last_undegraded":"2023-08-27T11:28:35.004607+0000","last_fullsized":"2023-08-27T11:28:35.004607+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999210+0000","last_change":"2023-08-27T11:28:34.999210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999210+0000","last_undegraded":"2023-08-27T11:28:34.999210+0000","last_fullsized":"2023-08-27T11:28:34.999210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998437+0000","last_change":"2023-08-27T11:28:34.998437+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998437+0000","last_undegraded":"2023-08-27T11:28:34.998437+0000","last_fullsized":"2023-08-27T11:28:34.998437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997101+0000","last_change":"2023-08-27T11:28:34.997101+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997101+0000","last_undegraded":"2023-08-27T11:28:34.997101+0000","last_fullsized":"2023-08-27T11:28:34.997101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003565+0000","last_change":"2023-08-27T11:28:35.003565+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003565+0000","last_undegraded":"2023-08-27T11:28:35.003565+0000","last_fullsized":"2023-08-27T11:28:35.003565+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996024+0000","last_change":"2023-08-27T11:28:34.996024+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996024+0000","last_undegraded":"2023-08-27T11:28:34.996024+0000","last_fullsized":"2023-08-27T11:28:34.996024+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012797+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:35.012797+0000","last_peered":"2023-08-27T11:28:35.012797+0000","last_clean":"2023-08-27T11:28:35.012797+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:35.012797+0000","last_undegraded":"2023-08-27T11:28:35.012797+0000","last_fullsized":"2023-08-27T11:28:35.012797+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996599+0000","last_change":"2023-08-27T11:28:34.996599+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996599+0000","last_undegraded":"2023-08-27T11:28:34.996599+0000","last_fullsized":"2023-08-27T11:28:34.996599+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013644+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:35.013644+0000","last_peered":"2023-08-27T11:28:35.013644+0000","last_clean":"2023-08-27T11:28:35.013644+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:35.013644+0000","last_undegraded":"2023-08-27T11:28:35.013644+0000","last_fullsized":"2023-08-27T11:28:35.013644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994787+0000","last_change":"2023-08-27T11:28:34.994787+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994787+0000","last_undegraded":"2023-08-27T11:28:34.994787+0000","last_fullsized":"2023-08-27T11:28:34.994787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020581+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:35.020581+0000","last_peered":"2023-08-27T11:28:35.020581+0000","last_clean":"2023-08-27T11:28:35.020581+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:35.020581+0000","last_undegraded":"2023-08-27T11:28:35.020581+0000","last_fullsized":"2023-08-27T11:28:35.020581+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:37.820343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998325+0000","last_change":"2023-08-27T11:28:34.998325+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998325+0000","last_undegraded":"2023-08-27T11:28:34.998325+0000","last_fullsized":"2023-08-27T11:28:34.998325+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013103+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:35.013103+0000","last_peered":"2023-08-27T11:28:35.013103+0000","last_clean":"2023-08-27T11:28:35.013103+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:35.013103+0000","last_undegraded":"2023-08-27T11:28:35.013103+0000","last_fullsized":"2023-08-27T11:28:35.013103+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:28.488734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998726+0000","last_change":"2023-08-27T11:28:34.998726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998726+0000","last_undegraded":"2023-08-27T11:28:34.998726+0000","last_fullsized":"2023-08-27T11:28:34.998726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015098+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:35.015098+0000","last_peered":"2023-08-27T11:28:35.015098+0000","last_clean":"2023-08-27T11:28:35.015098+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:35.015098+0000","last_undegraded":"2023-08-27T11:28:35.015098+0000","last_fullsized":"2023-08-27T11:28:35.015098+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:20.653735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998913+0000","last_change":"2023-08-27T11:28:34.998913+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998913+0000","last_undegraded":"2023-08-27T11:28:34.998913+0000","last_fullsized":"2023-08-27T11:28:34.998913+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015302+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:35.015302+0000","last_peered":"2023-08-27T11:28:35.015302+0000","last_clean":"2023-08-27T11:28:35.015302+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:35.015302+0000","last_undegraded":"2023-08-27T11:28:35.015302+0000","last_fullsized":"2023-08-27T11:28:35.015302+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001260+0000","last_change":"2023-08-27T11:28:35.001260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001260+0000","last_undegraded":"2023-08-27T11:28:35.001260+0000","last_fullsized":"2023-08-27T11:28:35.001260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018572+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:35.018572+0000","last_peered":"2023-08-27T11:28:35.018572+0000","last_clean":"2023-08-27T11:28:35.018572+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:35.018572+0000","last_undegraded":"2023-08-27T11:28:35.018572+0000","last_fullsized":"2023-08-27T11:28:35.018572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:42.683860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002434+0000","last_change":"2023-08-27T11:28:35.002434+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002434+0000","last_undegraded":"2023-08-27T11:28:35.002434+0000","last_fullsized":"2023-08-27T11:28:35.002434+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012732+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:35.012732+0000","last_peered":"2023-08-27T11:28:35.012732+0000","last_clean":"2023-08-27T11:28:35.012732+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:35.012732+0000","last_undegraded":"2023-08-27T11:28:35.012732+0000","last_fullsized":"2023-08-27T11:28:35.012732+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:30.207482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997296+0000","last_change":"2023-08-27T11:28:34.997296+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997296+0000","last_undegraded":"2023-08-27T11:28:34.997296+0000","last_fullsized":"2023-08-27T11:28:34.997296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014037+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:35.014037+0000","last_peered":"2023-08-27T11:28:35.014037+0000","last_clean":"2023-08-27T11:28:35.014037+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:35.014037+0000","last_undegraded":"2023-08-27T11:28:35.014037+0000","last_fullsized":"2023-08-27T11:28:35.014037+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:49.824933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001555+0000","last_change":"2023-08-27T11:28:35.001555+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001555+0000","last_undegraded":"2023-08-27T11:28:35.001555+0000","last_fullsized":"2023-08-27T11:28:35.001555+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015544+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:35.015544+0000","last_peered":"2023-08-27T11:28:35.015544+0000","last_clean":"2023-08-27T11:28:35.015544+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:35.015544+0000","last_undegraded":"2023-08-27T11:28:35.015544+0000","last_fullsized":"2023-08-27T11:28:35.015544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002570+0000","last_change":"2023-08-27T11:28:35.002570+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002570+0000","last_undegraded":"2023-08-27T11:28:35.002570+0000","last_fullsized":"2023-08-27T11:28:35.002570+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018469+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:35.018469+0000","last_peered":"2023-08-27T11:28:35.018469+0000","last_clean":"2023-08-27T11:28:35.018469+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:35.018469+0000","last_undegraded":"2023-08-27T11:28:35.018469+0000","last_fullsized":"2023-08-27T11:28:35.018469+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:26.864578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006662+0000","last_change":"2023-08-27T11:28:35.006662+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006662+0000","last_undegraded":"2023-08-27T11:28:35.006662+0000","last_fullsized":"2023-08-27T11:28:35.006662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013597+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:35.013597+0000","last_peered":"2023-08-27T11:28:35.013597+0000","last_clean":"2023-08-27T11:28:35.013597+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:35.013597+0000","last_undegraded":"2023-08-27T11:28:35.013597+0000","last_fullsized":"2023-08-27T11:28:35.013597+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:01.094339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999726+0000","last_change":"2023-08-27T11:28:34.999726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999726+0000","last_undegraded":"2023-08-27T11:28:34.999726+0000","last_fullsized":"2023-08-27T11:28:34.999726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013821+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:35.013821+0000","last_peered":"2023-08-27T11:28:35.013821+0000","last_clean":"2023-08-27T11:28:35.013821+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:35.013821+0000","last_undegraded":"2023-08-27T11:28:35.013821+0000","last_fullsized":"2023-08-27T11:28:35.013821+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:13.018341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997114+0000","last_change":"2023-08-27T11:28:34.997114+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997114+0000","last_undegraded":"2023-08-27T11:28:34.997114+0000","last_fullsized":"2023-08-27T11:28:34.997114+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.016113+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:35.016113+0000","last_peered":"2023-08-27T11:28:35.016113+0000","last_clean":"2023-08-27T11:28:35.016113+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:35.016113+0000","last_undegraded":"2023-08-27T11:28:35.016113+0000","last_fullsized":"2023-08-27T11:28:35.016113+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:57.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997099+0000","last_change":"2023-08-27T11:28:34.997099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997099+0000","last_undegraded":"2023-08-27T11:28:34.997099+0000","last_fullsized":"2023-08-27T11:28:34.997099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018075+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:35.018075+0000","last_peered":"2023-08-27T11:28:35.018075+0000","last_clean":"2023-08-27T11:28:35.018075+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:35.018075+0000","last_undegraded":"2023-08-27T11:28:35.018075+0000","last_fullsized":"2023-08-27T11:28:35.018075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:56:55.724660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997186+0000","last_change":"2023-08-27T11:28:34.997186+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997186+0000","last_undegraded":"2023-08-27T11:28:34.997186+0000","last_fullsized":"2023-08-27T11:28:34.997186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018708+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:35.018708+0000","last_peered":"2023-08-27T11:28:35.018708+0000","last_clean":"2023-08-27T11:28:35.018708+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:35.018708+0000","last_undegraded":"2023-08-27T11:28:35.018708+0000","last_fullsized":"2023-08-27T11:28:35.018708+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:11.806392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996963+0000","last_change":"2023-08-27T11:28:34.996963+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996963+0000","last_undegraded":"2023-08-27T11:28:34.996963+0000","last_fullsized":"2023-08-27T11:28:34.996963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017206+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:35.017206+0000","last_peered":"2023-08-27T11:28:35.017206+0000","last_clean":"2023-08-27T11:28:35.017206+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:35.017206+0000","last_undegraded":"2023-08-27T11:28:35.017206+0000","last_fullsized":"2023-08-27T11:28:35.017206+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:22:07.385319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997210+0000","last_change":"2023-08-27T11:28:34.997210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997210+0000","last_undegraded":"2023-08-27T11:28:34.997210+0000","last_fullsized":"2023-08-27T11:28:34.997210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012101+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:35.012101+0000","last_peered":"2023-08-27T11:28:35.012101+0000","last_clean":"2023-08-27T11:28:35.012101+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:35.012101+0000","last_undegraded":"2023-08-27T11:28:35.012101+0000","last_fullsized":"2023-08-27T11:28:35.012101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:02:19.059991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001884+0000","last_change":"2023-08-27T11:28:35.001884+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001884+0000","last_undegraded":"2023-08-27T11:28:35.001884+0000","last_fullsized":"2023-08-27T11:28:35.001884+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012084+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:35.012084+0000","last_peered":"2023-08-27T11:28:35.012084+0000","last_clean":"2023-08-27T11:28:35.012084+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:35.012084+0000","last_undegraded":"2023-08-27T11:28:35.012084+0000","last_fullsized":"2023-08-27T11:28:35.012084+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:11:19.705357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004673+0000","last_change":"2023-08-27T11:28:35.004673+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004673+0000","last_undegraded":"2023-08-27T11:28:35.004673+0000","last_fullsized":"2023-08-27T11:28:35.004673+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019674+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:35.019674+0000","last_peered":"2023-08-27T11:28:35.019674+0000","last_clean":"2023-08-27T11:28:35.019674+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:35.019674+0000","last_undegraded":"2023-08-27T11:28:35.019674+0000","last_fullsized":"2023-08-27T11:28:35.019674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:41:18.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004099+0000","last_change":"2023-08-27T11:28:35.004099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004099+0000","last_undegraded":"2023-08-27T11:28:35.004099+0000","last_fullsized":"2023-08-27T11:28:35.004099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012108+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:35.012108+0000","last_peered":"2023-08-27T11:28:35.012108+0000","last_clean":"2023-08-27T11:28:35.012108+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:35.012108+0000","last_undegraded":"2023-08-27T11:28:35.012108+0000","last_fullsized":"2023-08-27T11:28:35.012108+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:48.153571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004718+0000","last_change":"2023-08-27T11:28:35.004718+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004718+0000","last_undegraded":"2023-08-27T11:28:35.004718+0000","last_fullsized":"2023-08-27T11:28:35.004718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013124+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:35.013124+0000","last_peered":"2023-08-27T11:28:35.013124+0000","last_clean":"2023-08-27T11:28:35.013124+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:35.013124+0000","last_undegraded":"2023-08-27T11:28:35.013124+0000","last_fullsized":"2023-08-27T11:28:35.013124+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:40:45.508564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003873+0000","last_change":"2023-08-27T11:28:35.003873+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003873+0000","last_undegraded":"2023-08-27T11:28:35.003873+0000","last_fullsized":"2023-08-27T11:28:35.003873+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019706+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:35.019706+0000","last_peered":"2023-08-27T11:28:35.019706+0000","last_clean":"2023-08-27T11:28:35.019706+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:35.019706+0000","last_undegraded":"2023-08-27T11:28:35.019706+0000","last_fullsized":"2023-08-27T11:28:35.019706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:54:02.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001853+0000","last_change":"2023-08-27T11:28:35.001853+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001853+0000","last_undegraded":"2023-08-27T11:28:35.001853+0000","last_fullsized":"2023-08-27T11:28:35.001853+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017121+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:35.017121+0000","last_peered":"2023-08-27T11:28:35.017121+0000","last_clean":"2023-08-27T11:28:35.017121+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:35.017121+0000","last_undegraded":"2023-08-27T11:28:35.017121+0000","last_fullsized":"2023-08-27T11:28:35.017121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:21.005653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995868+0000","last_change":"2023-08-27T11:28:34.995868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995868+0000","last_undegraded":"2023-08-27T11:28:34.995868+0000","last_fullsized":"2023-08-27T11:28:34.995868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015811+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:35.015811+0000","last_peered":"2023-08-27T11:28:35.015811+0000","last_clean":"2023-08-27T11:28:35.015811+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:35.015811+0000","last_undegraded":"2023-08-27T11:28:35.015811+0000","last_fullsized":"2023-08-27T11:28:35.015811+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:43:18.868103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:26.705541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995888+0000","last_change":"2023-08-27T11:28:34.995888+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995888+0000","last_undegraded":"2023-08-27T11:28:34.995888+0000","last_fullsized":"2023-08-27T11:28:34.995888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017472+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:35.017472+0000","last_peered":"2023-08-27T11:28:35.017472+0000","last_clean":"2023-08-27T11:28:35.017472+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:35.017472+0000","last_undegraded":"2023-08-27T11:28:35.017472+0000","last_fullsized":"2023-08-27T11:28:35.017472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:06.183796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:29.520414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004143+0000","last_change":"2023-08-27T11:28:35.004143+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004143+0000","last_undegraded":"2023-08-27T11:28:35.004143+0000","last_fullsized":"2023-08-27T11:28:35.004143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020153+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:35.020153+0000","last_peered":"2023-08-27T11:28:35.020153+0000","last_clean":"2023-08-27T11:28:35.020153+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:35.020153+0000","last_undegraded":"2023-08-27T11:28:35.020153+0000","last_fullsized":"2023-08-27T11:28:35.020153+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:15.211750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":215,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.996443+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:34.996443+0000","last_peered":"2023-08-27T11:28:34.996443+0000","last_clean":"2023-08-27T11:28:34.996443+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:34.996443+0000","last_undegraded":"2023-08-27T11:28:34.996443+0000","last_fullsized":"2023-08-27T11:28:34.996443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:28:28.689665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996258+0000","last_change":"2023-08-27T11:28:34.996258+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996258+0000","last_undegraded":"2023-08-27T11:28:34.996258+0000","last_fullsized":"2023-08-27T11:28:34.996258+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018068+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:35.018068+0000","last_peered":"2023-08-27T11:28:35.018068+0000","last_clean":"2023-08-27T11:28:35.018068+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:35.018068+0000","last_undegraded":"2023-08-27T11:28:35.018068+0000","last_fullsized":"2023-08-27T11:28:35.018068+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:30.665301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004952+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:35.004952+0000","last_peered":"2023-08-27T11:28:35.004952+0000","last_clean":"2023-08-27T11:28:35.004952+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:35.004952+0000","last_undegraded":"2023-08-27T11:28:35.004952+0000","last_fullsized":"2023-08-27T11:28:35.004952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:29:36.012817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998709+0000","last_change":"2023-08-27T11:28:34.998709+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998709+0000","last_undegraded":"2023-08-27T11:28:34.998709+0000","last_fullsized":"2023-08-27T11:28:34.998709+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017161+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:35.017161+0000","last_peered":"2023-08-27T11:28:35.017161+0000","last_clean":"2023-08-27T11:28:35.017161+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:35.017161+0000","last_undegraded":"2023-08-27T11:28:35.017161+0000","last_fullsized":"2023-08-27T11:28:35.017161+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:44.678356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004477+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:35.004477+0000","last_peered":"2023-08-27T11:28:35.004477+0000","last_clean":"2023-08-27T11:28:35.004477+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:35.004477+0000","last_undegraded":"2023-08-27T11:28:35.004477+0000","last_fullsized":"2023-08-27T11:28:35.004477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:25.039099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001814+0000","last_change":"2023-08-27T11:28:35.001814+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001814+0000","last_undegraded":"2023-08-27T11:28:35.001814+0000","last_fullsized":"2023-08-27T11:28:35.001814+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012867+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:35.012867+0000","last_peered":"2023-08-27T11:28:35.012867+0000","last_clean":"2023-08-27T11:28:35.012867+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:35.012867+0000","last_undegraded":"2023-08-27T11:28:35.012867+0000","last_fullsized":"2023-08-27T11:28:35.012867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:52.103487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":339,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004793+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:35.004793+0000","last_peered":"2023-08-27T11:28:35.004793+0000","last_clean":"2023-08-27T11:28:35.004793+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:35.004793+0000","last_undegraded":"2023-08-27T11:28:35.004793+0000","last_fullsized":"2023-08-27T11:28:35.004793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:33.273771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014342+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:35.014342+0000","last_peered":"2023-08-27T11:28:35.014342+0000","last_clean":"2023-08-27T11:28:35.014342+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:35.014342+0000","last_undegraded":"2023-08-27T11:28:35.014342+0000","last_fullsized":"2023-08-27T11:28:35.014342+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:50.084686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006201+0000","last_change":"2023-08-27T11:28:35.006201+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006201+0000","last_undegraded":"2023-08-27T11:28:35.006201+0000","last_fullsized":"2023-08-27T11:28:35.006201+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019744+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:35.019744+0000","last_peered":"2023-08-27T11:28:35.019744+0000","last_clean":"2023-08-27T11:28:35.019744+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:35.019744+0000","last_undegraded":"2023-08-27T11:28:35.019744+0000","last_fullsized":"2023-08-27T11:28:35.019744+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:59:23.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.006432+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:35.006432+0000","last_peered":"2023-08-27T11:28:35.006432+0000","last_clean":"2023-08-27T11:28:35.006432+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:35.006432+0000","last_undegraded":"2023-08-27T11:28:35.006432+0000","last_fullsized":"2023-08-27T11:28:35.006432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:11:59.900036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996868+0000","last_change":"2023-08-27T11:28:34.996868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996868+0000","last_undegraded":"2023-08-27T11:28:34.996868+0000","last_fullsized":"2023-08-27T11:28:34.996868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014057+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:35.014057+0000","last_peered":"2023-08-27T11:28:35.014057+0000","last_clean":"2023-08-27T11:28:35.014057+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:35.014057+0000","last_undegraded":"2023-08-27T11:28:35.014057+0000","last_fullsized":"2023-08-27T11:28:35.014057+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:48:41.844380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":213,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.999190+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:34.999190+0000","last_peered":"2023-08-27T11:28:34.999190+0000","last_clean":"2023-08-27T11:28:34.999190+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:34.999190+0000","last_undegraded":"2023-08-27T11:28:34.999190+0000","last_fullsized":"2023-08-27T11:28:34.999190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:45.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29076,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342764,"statfs":{"total":96636764160,"available":96606990336,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.505}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.745}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.52500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28504,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343336,"statfs":{"total":96636764160,"available":96607576064,"internally_reserved":0,"allocated":1519616,"data_stored":713512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71299999999999997,"15min":0.877},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.01,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":3.472,"15min":3.472},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.94599999999999995},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.98799999999999999,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.753,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.95299999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74199999999999999,"15min":0.84599999999999997},"min":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.101,"5min":1.234,"15min":1.234},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76300000000000001,"15min":0.80200000000000005},"min":{"1min":0.50900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.071,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":1.135,"15min":1.135},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82499999999999996,"15min":0.84699999999999998},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.88100000000000001},"min":{"1min":0.62,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.111,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0309999999999999,"5min":1.27,"15min":1.27},"last":0.71899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":2.734,"15min":2.734},"last":0.64600000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68700000000000006,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61599999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.93100000000000005,"5min":3.101,"15min":3.101},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1240000000000001,"5min":3.359,"15min":3.359},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.96999999999999997,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.036,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.754}]},{"osd":7,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.038,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60499999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.88900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":1.135}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.355,"15min":1.355},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94299999999999995,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.74299999999999999},"min":{"1min":0.621,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":1.123,"15min":1.123},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.032,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.173}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90100000000000002,"5min":1.329,"15min":1.329},"last":1.081},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94799999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.111}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96899999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.254},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":1.2789999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1523712,"data_stored":714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.375}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.90000000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.93799999999999994}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46000000000000002,"15min":0.59899999999999998},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.52000000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.443},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83799999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":1.1459999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70299999999999996,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.628,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74099999999999999,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77300000000000002,"15min":0.90000000000000002},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.022,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96399999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.429,"15min":1.429},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.96999999999999997},"min":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.62}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.95399999999999996},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80200000000000005,"15min":0.94399999999999995},"min":{"1min":0.622,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90700000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.96099999999999997},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":5,"15min":5},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1511424,"data_stored":707878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.498},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.628}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.749}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.034}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:40.970 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:40.973 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:28:40.973+0000 7f2275df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:28:41.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.204+0000 7f5eb5dff700 1 Processor -- start 2023-08-27T11:28:41.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.204+0000 7f5eb5dff700 1 -- start start 2023-08-27T11:28:41.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.205+0000 7f5eb5dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5eb00c51a0 0x7f5eb006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.205+0000 7f5eb5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb006ca60 0x7f5eb00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.205+0000 7f5eb5dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb006d700 con 0x7f5eb00ab040 2023-08-27T11:28:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.205+0000 7f5eb5dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb01530b0 con 0x7f5eb00c51a0 2023-08-27T11:28:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.205+0000 7f5eb5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb014c860 con 0x7f5eb006ca60 2023-08-27T11:28:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5eb00c51a0 0x7f5eb006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5eb00c51a0 0x7f5eb006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36588/0 (socket says 172.21.15.43:36588) 2023-08-27T11:28:41.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/733351265 learned_addr learned my addr 172.21.15.43:0/733351265 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaeffd700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb006ca60 0x7f5eb00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/733351265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb006ca60 msgr2=0x7f5eb00aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb006ca60 0x7f5eb00aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/733351265 >> v1:172.21.15.57:6789/0 conn(0x7f5eb00ab040 legacy=0x7f5eb0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:41.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/733351265 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0152430 con 0x7f5eb00c51a0 2023-08-27T11:28:41.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.206+0000 7f5eaf7fe700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb00c51a0 0x7f5eb006d1c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009920 tx=0x7f5ea0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af846ff581dfdc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eae7fc700 1 -- 172.21.15.43:0/733351265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000ba20 con 0x7f5eb00c51a0 2023-08-27T11:28:41.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eae7fc700 1 -- 172.21.15.43:0/733351265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000bb80 con 0x7f5eb00c51a0 2023-08-27T11:28:41.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eae7fc700 1 -- 172.21.15.43:0/733351265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0009e70 con 0x7f5eb00c51a0 2023-08-27T11:28:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 -- 172.21.15.43:0/733351265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb00c51a0 msgr2=0x7f5eb006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb00c51a0 0x7f5eb006d1c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009920 tx=0x7f5ea0009c30 comp rx=0 tx=0).stop 2023-08-27T11:28:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 -- 172.21.15.43:0/733351265 shutdown_connections 2023-08-27T11:28:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb00c51a0 0x7f5eb006d1c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/733351265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb006ca60 0x7f5eb00aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 -- 172.21.15.43:0/733351265 >> 172.21.15.43:0/733351265 conn(0x7f5eb006aa50 msgr2=0x7f5eb00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 -- 172.21.15.43:0/733351265 shutdown_connections 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.207+0000 7f5eb5dff700 1 -- 172.21.15.43:0/733351265 wait complete. 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.209+0000 7f5eb5dff700 1 Processor -- start 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.209+0000 7f5eb5dff700 1 -- start start 2023-08-27T11:28:41.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 0x7f5eb006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 0x7f5eb00a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01eace0 con 0x7f5eb006ca60 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00bc980 con 0x7f5eb00c51a0 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eb5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00bcf00 con 0x7f5eb00ab040 2023-08-27T11:28:41.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eaf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eaf7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36598/0 (socket says 172.21.15.43:36598) 2023-08-27T11:28:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.210+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/154645233 learned_addr learned my addr 172.21.15.43:0/154645233 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaffff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 0x7f5eb00a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaeffd700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 0x7f5eb006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 msgr2=0x7f5eb006f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 0x7f5eb006f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 msgr2=0x7f5eb00a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 0x7f5eb00a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 -- 172.21.15.43:0/154645233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0009550 con 0x7f5eb006ca60 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaffff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 0x7f5eb00a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:41.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaeffd700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 0x7f5eb006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:41.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eaf7fe700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009130 tx=0x7f5ea0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0004550 con 0x7f5eb006ca60 2023-08-27T11:28:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea001e070 con 0x7f5eb006ca60 2023-08-27T11:28:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00038e0 con 0x7f5eb006ca60 2023-08-27T11:28:41.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb00bcc20 con 0x7f5eb006ca60 2023-08-27T11:28:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.211+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb00a7de0 con 0x7f5eb006ca60 2023-08-27T11:28:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.213+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb004ee70 con 0x7f5eb006ca60 2023-08-27T11:28:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.213+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ea0003a40 con 0x7f5eb006ca60 2023-08-27T11:28:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.215+0000 7f5e97fff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 0x7f5e9c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.215+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ea0020070 con 0x7f5eb006ca60 2023-08-27T11:28:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.215+0000 7f5eaeffd700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 0x7f5e9c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.216+0000 7f5eaeffd700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 0x7f5e9c06c570 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5eb01512d0 tx=0x7f5ea4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.219+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ea0055170 con 0x7f5eb006ca60 2023-08-27T11:28:41.405 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:28:41.410 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:28:41.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.430+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5eb01529f0 con 0x7f5e9c06a0b0 2023-08-27T11:28:41.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.441+0000 7f5e97fff700 1 -- 172.21.15.43:0/154645233 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306350 (secure 0 0 0) 0x7f5ea4009610 con 0x7f5e9c06a0b0 2023-08-27T11:28:41.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:41.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 msgr2=0x7f5e9c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 0x7f5e9c06c570 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5eb01512d0 tx=0x7f5ea4008040 comp rx=0 tx=0).stop 2023-08-27T11:28:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 msgr2=0x7f5eb00bf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009130 tx=0x7f5ea0004750 comp rx=0 tx=0).stop 2023-08-27T11:28:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 shutdown_connections 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e9c06a0b0 0x7f5e9c06c570 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5eb00c51a0 0x7f5eb00a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5eb006ca60 0x7f5eb00bf3d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 --2- 172.21.15.43:0/154645233 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5eb00ab040 0x7f5eb006f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.445+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 >> 172.21.15.43:0/154645233 conn(0x7f5eb006aa50 msgr2=0x7f5eb01556f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.446+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 shutdown_connections 2023-08-27T11:28:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.446+0000 7f5eb5dff700 1 -- 172.21.15.43:0/154645233 wait complete. 2023-08-27T11:28:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:41.473 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-08-27T11:28:40.385720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233300,"kb_used_data":12976,"kb_used_omap":13,"kb_used_meta":220210,"kb_avail":754741420,"statfs":{"total":773094113280,"available":772855214080,"internally_reserved":0,"allocated":13287424,"data_stored":6853056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":225495128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001051"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998893+0000","last_change":"2023-08-27T11:28:34.998893+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998893+0000","last_undegraded":"2023-08-27T11:28:34.998893+0000","last_fullsized":"2023-08-27T11:28:34.998893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995765+0000","last_change":"2023-08-27T11:28:34.995765+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995765+0000","last_undegraded":"2023-08-27T11:28:34.995765+0000","last_fullsized":"2023-08-27T11:28:34.995765+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998666+0000","last_change":"2023-08-27T11:28:34.998666+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998666+0000","last_undegraded":"2023-08-27T11:28:34.998666+0000","last_fullsized":"2023-08-27T11:28:34.998666+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994872+0000","last_change":"2023-08-27T11:28:34.994872+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994872+0000","last_undegraded":"2023-08-27T11:28:34.994872+0000","last_fullsized":"2023-08-27T11:28:34.994872+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996260+0000","last_change":"2023-08-27T11:28:34.996260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996260+0000","last_undegraded":"2023-08-27T11:28:34.996260+0000","last_fullsized":"2023-08-27T11:28:34.996260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005148+0000","last_change":"2023-08-27T11:28:35.005148+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005148+0000","last_undegraded":"2023-08-27T11:28:35.005148+0000","last_fullsized":"2023-08-27T11:28:35.005148+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002060+0000","last_change":"2023-08-27T11:28:35.002060+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002060+0000","last_undegraded":"2023-08-27T11:28:35.002060+0000","last_fullsized":"2023-08-27T11:28:35.002060+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996585+0000","last_change":"2023-08-27T11:28:34.996585+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996585+0000","last_undegraded":"2023-08-27T11:28:34.996585+0000","last_fullsized":"2023-08-27T11:28:34.996585+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.008210+0000","last_change":"2023-08-27T11:28:35.008210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.008210+0000","last_undegraded":"2023-08-27T11:28:35.008210+0000","last_fullsized":"2023-08-27T11:28:35.008210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.005825+0000","last_change":"2023-08-27T11:28:35.005825+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.005825+0000","last_undegraded":"2023-08-27T11:28:35.005825+0000","last_fullsized":"2023-08-27T11:28:35.005825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994798+0000","last_change":"2023-08-27T11:28:34.994798+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994798+0000","last_undegraded":"2023-08-27T11:28:34.994798+0000","last_fullsized":"2023-08-27T11:28:34.994798+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997687+0000","last_change":"2023-08-27T11:28:34.997687+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997687+0000","last_undegraded":"2023-08-27T11:28:34.997687+0000","last_fullsized":"2023-08-27T11:28:34.997687+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004548+0000","last_change":"2023-08-27T11:28:35.004548+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004548+0000","last_undegraded":"2023-08-27T11:28:35.004548+0000","last_fullsized":"2023-08-27T11:28:35.004548+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999341+0000","last_change":"2023-08-27T11:28:34.999341+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999341+0000","last_undegraded":"2023-08-27T11:28:34.999341+0000","last_fullsized":"2023-08-27T11:28:34.999341+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998562+0000","last_change":"2023-08-27T11:28:34.998562+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998562+0000","last_undegraded":"2023-08-27T11:28:34.998562+0000","last_fullsized":"2023-08-27T11:28:34.998562+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002126+0000","last_change":"2023-08-27T11:28:35.002126+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002126+0000","last_undegraded":"2023-08-27T11:28:35.002126+0000","last_fullsized":"2023-08-27T11:28:35.002126+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004361+0000","last_change":"2023-08-27T11:28:35.004361+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004361+0000","last_undegraded":"2023-08-27T11:28:35.004361+0000","last_fullsized":"2023-08-27T11:28:35.004361+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001770+0000","last_change":"2023-08-27T11:28:35.001770+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001770+0000","last_undegraded":"2023-08-27T11:28:35.001770+0000","last_fullsized":"2023-08-27T11:28:35.001770+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002510+0000","last_change":"2023-08-27T11:28:35.002510+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002510+0000","last_undegraded":"2023-08-27T11:28:35.002510+0000","last_fullsized":"2023-08-27T11:28:35.002510+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996286+0000","last_change":"2023-08-27T11:28:34.996286+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996286+0000","last_undegraded":"2023-08-27T11:28:34.996286+0000","last_fullsized":"2023-08-27T11:28:34.996286+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995246+0000","last_change":"2023-08-27T11:28:34.995246+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995246+0000","last_undegraded":"2023-08-27T11:28:34.995246+0000","last_fullsized":"2023-08-27T11:28:34.995246+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998003+0000","last_change":"2023-08-27T11:28:34.998003+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998003+0000","last_undegraded":"2023-08-27T11:28:34.998003+0000","last_fullsized":"2023-08-27T11:28:34.998003+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995512+0000","last_change":"2023-08-27T11:28:34.995512+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995512+0000","last_undegraded":"2023-08-27T11:28:34.995512+0000","last_fullsized":"2023-08-27T11:28:34.995512+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003500+0000","last_change":"2023-08-27T11:28:35.003500+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003500+0000","last_undegraded":"2023-08-27T11:28:35.003500+0000","last_fullsized":"2023-08-27T11:28:35.003500+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998398+0000","last_change":"2023-08-27T11:28:34.998398+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998398+0000","last_undegraded":"2023-08-27T11:28:34.998398+0000","last_fullsized":"2023-08-27T11:28:34.998398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998311+0000","last_change":"2023-08-27T11:28:34.998311+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998311+0000","last_undegraded":"2023-08-27T11:28:34.998311+0000","last_fullsized":"2023-08-27T11:28:34.998311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002965+0000","last_change":"2023-08-27T11:28:35.002965+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002965+0000","last_undegraded":"2023-08-27T11:28:35.002965+0000","last_fullsized":"2023-08-27T11:28:35.002965+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004607+0000","last_change":"2023-08-27T11:28:35.004607+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004607+0000","last_undegraded":"2023-08-27T11:28:35.004607+0000","last_fullsized":"2023-08-27T11:28:35.004607+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999210+0000","last_change":"2023-08-27T11:28:34.999210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999210+0000","last_undegraded":"2023-08-27T11:28:34.999210+0000","last_fullsized":"2023-08-27T11:28:34.999210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998437+0000","last_change":"2023-08-27T11:28:34.998437+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998437+0000","last_undegraded":"2023-08-27T11:28:34.998437+0000","last_fullsized":"2023-08-27T11:28:34.998437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997101+0000","last_change":"2023-08-27T11:28:34.997101+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997101+0000","last_undegraded":"2023-08-27T11:28:34.997101+0000","last_fullsized":"2023-08-27T11:28:34.997101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003565+0000","last_change":"2023-08-27T11:28:35.003565+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003565+0000","last_undegraded":"2023-08-27T11:28:35.003565+0000","last_fullsized":"2023-08-27T11:28:35.003565+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996024+0000","last_change":"2023-08-27T11:28:34.996024+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996024+0000","last_undegraded":"2023-08-27T11:28:34.996024+0000","last_fullsized":"2023-08-27T11:28:34.996024+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012797+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:35.012797+0000","last_peered":"2023-08-27T11:28:35.012797+0000","last_clean":"2023-08-27T11:28:35.012797+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:35.012797+0000","last_undegraded":"2023-08-27T11:28:35.012797+0000","last_fullsized":"2023-08-27T11:28:35.012797+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996599+0000","last_change":"2023-08-27T11:28:34.996599+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996599+0000","last_undegraded":"2023-08-27T11:28:34.996599+0000","last_fullsized":"2023-08-27T11:28:34.996599+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013644+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:35.013644+0000","last_peered":"2023-08-27T11:28:35.013644+0000","last_clean":"2023-08-27T11:28:35.013644+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:35.013644+0000","last_undegraded":"2023-08-27T11:28:35.013644+0000","last_fullsized":"2023-08-27T11:28:35.013644+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:34.466026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.994787+0000","last_change":"2023-08-27T11:28:34.994787+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.994787+0000","last_undegraded":"2023-08-27T11:28:34.994787+0000","last_fullsized":"2023-08-27T11:28:34.994787+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020581+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:35.020581+0000","last_peered":"2023-08-27T11:28:35.020581+0000","last_clean":"2023-08-27T11:28:35.020581+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:35.020581+0000","last_undegraded":"2023-08-27T11:28:35.020581+0000","last_fullsized":"2023-08-27T11:28:35.020581+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:37.820343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998325+0000","last_change":"2023-08-27T11:28:34.998325+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998325+0000","last_undegraded":"2023-08-27T11:28:34.998325+0000","last_fullsized":"2023-08-27T11:28:34.998325+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013103+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:35.013103+0000","last_peered":"2023-08-27T11:28:35.013103+0000","last_clean":"2023-08-27T11:28:35.013103+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:35.013103+0000","last_undegraded":"2023-08-27T11:28:35.013103+0000","last_fullsized":"2023-08-27T11:28:35.013103+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:28.488734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998726+0000","last_change":"2023-08-27T11:28:34.998726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998726+0000","last_undegraded":"2023-08-27T11:28:34.998726+0000","last_fullsized":"2023-08-27T11:28:34.998726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015098+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:35.015098+0000","last_peered":"2023-08-27T11:28:35.015098+0000","last_clean":"2023-08-27T11:28:35.015098+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:35.015098+0000","last_undegraded":"2023-08-27T11:28:35.015098+0000","last_fullsized":"2023-08-27T11:28:35.015098+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:20.653735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998913+0000","last_change":"2023-08-27T11:28:34.998913+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998913+0000","last_undegraded":"2023-08-27T11:28:34.998913+0000","last_fullsized":"2023-08-27T11:28:34.998913+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015302+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:35.015302+0000","last_peered":"2023-08-27T11:28:35.015302+0000","last_clean":"2023-08-27T11:28:35.015302+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:35.015302+0000","last_undegraded":"2023-08-27T11:28:35.015302+0000","last_fullsized":"2023-08-27T11:28:35.015302+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001260+0000","last_change":"2023-08-27T11:28:35.001260+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001260+0000","last_undegraded":"2023-08-27T11:28:35.001260+0000","last_fullsized":"2023-08-27T11:28:35.001260+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018572+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:35.018572+0000","last_peered":"2023-08-27T11:28:35.018572+0000","last_clean":"2023-08-27T11:28:35.018572+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:35.018572+0000","last_undegraded":"2023-08-27T11:28:35.018572+0000","last_fullsized":"2023-08-27T11:28:35.018572+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:42.683860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002434+0000","last_change":"2023-08-27T11:28:35.002434+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002434+0000","last_undegraded":"2023-08-27T11:28:35.002434+0000","last_fullsized":"2023-08-27T11:28:35.002434+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012732+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:35.012732+0000","last_peered":"2023-08-27T11:28:35.012732+0000","last_clean":"2023-08-27T11:28:35.012732+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:35.012732+0000","last_undegraded":"2023-08-27T11:28:35.012732+0000","last_fullsized":"2023-08-27T11:28:35.012732+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:30.207482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997296+0000","last_change":"2023-08-27T11:28:34.997296+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997296+0000","last_undegraded":"2023-08-27T11:28:34.997296+0000","last_fullsized":"2023-08-27T11:28:34.997296+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014037+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:35.014037+0000","last_peered":"2023-08-27T11:28:35.014037+0000","last_clean":"2023-08-27T11:28:35.014037+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:35.014037+0000","last_undegraded":"2023-08-27T11:28:35.014037+0000","last_fullsized":"2023-08-27T11:28:35.014037+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:49.824933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001555+0000","last_change":"2023-08-27T11:28:35.001555+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001555+0000","last_undegraded":"2023-08-27T11:28:35.001555+0000","last_fullsized":"2023-08-27T11:28:35.001555+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015544+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:35.015544+0000","last_peered":"2023-08-27T11:28:35.015544+0000","last_clean":"2023-08-27T11:28:35.015544+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:35.015544+0000","last_undegraded":"2023-08-27T11:28:35.015544+0000","last_fullsized":"2023-08-27T11:28:35.015544+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.002570+0000","last_change":"2023-08-27T11:28:35.002570+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.002570+0000","last_undegraded":"2023-08-27T11:28:35.002570+0000","last_fullsized":"2023-08-27T11:28:35.002570+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018469+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:35.018469+0000","last_peered":"2023-08-27T11:28:35.018469+0000","last_clean":"2023-08-27T11:28:35.018469+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:35.018469+0000","last_undegraded":"2023-08-27T11:28:35.018469+0000","last_fullsized":"2023-08-27T11:28:35.018469+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:41:26.864578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006662+0000","last_change":"2023-08-27T11:28:35.006662+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006662+0000","last_undegraded":"2023-08-27T11:28:35.006662+0000","last_fullsized":"2023-08-27T11:28:35.006662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013597+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:35.013597+0000","last_peered":"2023-08-27T11:28:35.013597+0000","last_clean":"2023-08-27T11:28:35.013597+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:35.013597+0000","last_undegraded":"2023-08-27T11:28:35.013597+0000","last_fullsized":"2023-08-27T11:28:35.013597+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:01.094339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.999726+0000","last_change":"2023-08-27T11:28:34.999726+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.999726+0000","last_undegraded":"2023-08-27T11:28:34.999726+0000","last_fullsized":"2023-08-27T11:28:34.999726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013821+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:35.013821+0000","last_peered":"2023-08-27T11:28:35.013821+0000","last_clean":"2023-08-27T11:28:35.013821+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:35.013821+0000","last_undegraded":"2023-08-27T11:28:35.013821+0000","last_fullsized":"2023-08-27T11:28:35.013821+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:13.018341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997114+0000","last_change":"2023-08-27T11:28:34.997114+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997114+0000","last_undegraded":"2023-08-27T11:28:34.997114+0000","last_fullsized":"2023-08-27T11:28:34.997114+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.016113+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:35.016113+0000","last_peered":"2023-08-27T11:28:35.016113+0000","last_clean":"2023-08-27T11:28:35.016113+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:35.016113+0000","last_undegraded":"2023-08-27T11:28:35.016113+0000","last_fullsized":"2023-08-27T11:28:35.016113+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:57.994566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997099+0000","last_change":"2023-08-27T11:28:34.997099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997099+0000","last_undegraded":"2023-08-27T11:28:34.997099+0000","last_fullsized":"2023-08-27T11:28:34.997099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018075+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:35.018075+0000","last_peered":"2023-08-27T11:28:35.018075+0000","last_clean":"2023-08-27T11:28:35.018075+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:35.018075+0000","last_undegraded":"2023-08-27T11:28:35.018075+0000","last_fullsized":"2023-08-27T11:28:35.018075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:56:55.724660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997186+0000","last_change":"2023-08-27T11:28:34.997186+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997186+0000","last_undegraded":"2023-08-27T11:28:34.997186+0000","last_fullsized":"2023-08-27T11:28:34.997186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018708+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:35.018708+0000","last_peered":"2023-08-27T11:28:35.018708+0000","last_clean":"2023-08-27T11:28:35.018708+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:35.018708+0000","last_undegraded":"2023-08-27T11:28:35.018708+0000","last_fullsized":"2023-08-27T11:28:35.018708+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:29:11.806392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996963+0000","last_change":"2023-08-27T11:28:34.996963+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996963+0000","last_undegraded":"2023-08-27T11:28:34.996963+0000","last_fullsized":"2023-08-27T11:28:34.996963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017206+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:35.017206+0000","last_peered":"2023-08-27T11:28:35.017206+0000","last_clean":"2023-08-27T11:28:35.017206+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:35.017206+0000","last_undegraded":"2023-08-27T11:28:35.017206+0000","last_fullsized":"2023-08-27T11:28:35.017206+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:22:07.385319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.997210+0000","last_change":"2023-08-27T11:28:34.997210+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.997210+0000","last_undegraded":"2023-08-27T11:28:34.997210+0000","last_fullsized":"2023-08-27T11:28:34.997210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012101+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:35.012101+0000","last_peered":"2023-08-27T11:28:35.012101+0000","last_clean":"2023-08-27T11:28:35.012101+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:35.012101+0000","last_undegraded":"2023-08-27T11:28:35.012101+0000","last_fullsized":"2023-08-27T11:28:35.012101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:02:19.059991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001884+0000","last_change":"2023-08-27T11:28:35.001884+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001884+0000","last_undegraded":"2023-08-27T11:28:35.001884+0000","last_fullsized":"2023-08-27T11:28:35.001884+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012084+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:35.012084+0000","last_peered":"2023-08-27T11:28:35.012084+0000","last_clean":"2023-08-27T11:28:35.012084+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:35.012084+0000","last_undegraded":"2023-08-27T11:28:35.012084+0000","last_fullsized":"2023-08-27T11:28:35.012084+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:11:19.705357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004673+0000","last_change":"2023-08-27T11:28:35.004673+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004673+0000","last_undegraded":"2023-08-27T11:28:35.004673+0000","last_fullsized":"2023-08-27T11:28:35.004673+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019674+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:35.019674+0000","last_peered":"2023-08-27T11:28:35.019674+0000","last_clean":"2023-08-27T11:28:35.019674+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:35.019674+0000","last_undegraded":"2023-08-27T11:28:35.019674+0000","last_fullsized":"2023-08-27T11:28:35.019674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:41:18.188292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004099+0000","last_change":"2023-08-27T11:28:35.004099+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004099+0000","last_undegraded":"2023-08-27T11:28:35.004099+0000","last_fullsized":"2023-08-27T11:28:35.004099+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012108+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:35.012108+0000","last_peered":"2023-08-27T11:28:35.012108+0000","last_clean":"2023-08-27T11:28:35.012108+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:35.012108+0000","last_undegraded":"2023-08-27T11:28:35.012108+0000","last_fullsized":"2023-08-27T11:28:35.012108+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:48.153571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004718+0000","last_change":"2023-08-27T11:28:35.004718+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004718+0000","last_undegraded":"2023-08-27T11:28:35.004718+0000","last_fullsized":"2023-08-27T11:28:35.004718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.013124+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:35.013124+0000","last_peered":"2023-08-27T11:28:35.013124+0000","last_clean":"2023-08-27T11:28:35.013124+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:35.013124+0000","last_undegraded":"2023-08-27T11:28:35.013124+0000","last_fullsized":"2023-08-27T11:28:35.013124+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:40:45.508564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.003873+0000","last_change":"2023-08-27T11:28:35.003873+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.003873+0000","last_undegraded":"2023-08-27T11:28:35.003873+0000","last_fullsized":"2023-08-27T11:28:35.003873+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019706+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:35.019706+0000","last_peered":"2023-08-27T11:28:35.019706+0000","last_clean":"2023-08-27T11:28:35.019706+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:35.019706+0000","last_undegraded":"2023-08-27T11:28:35.019706+0000","last_fullsized":"2023-08-27T11:28:35.019706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:54:02.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001853+0000","last_change":"2023-08-27T11:28:35.001853+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001853+0000","last_undegraded":"2023-08-27T11:28:35.001853+0000","last_fullsized":"2023-08-27T11:28:35.001853+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017121+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:35.017121+0000","last_peered":"2023-08-27T11:28:35.017121+0000","last_clean":"2023-08-27T11:28:35.017121+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:35.017121+0000","last_undegraded":"2023-08-27T11:28:35.017121+0000","last_fullsized":"2023-08-27T11:28:35.017121+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:33:21.005653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995868+0000","last_change":"2023-08-27T11:28:34.995868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995868+0000","last_undegraded":"2023-08-27T11:28:34.995868+0000","last_fullsized":"2023-08-27T11:28:34.995868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.015811+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:35.015811+0000","last_peered":"2023-08-27T11:28:35.015811+0000","last_clean":"2023-08-27T11:28:35.015811+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:35.015811+0000","last_undegraded":"2023-08-27T11:28:35.015811+0000","last_fullsized":"2023-08-27T11:28:35.015811+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:43:18.868103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:55:26.705541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.995888+0000","last_change":"2023-08-27T11:28:34.995888+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.995888+0000","last_undegraded":"2023-08-27T11:28:34.995888+0000","last_fullsized":"2023-08-27T11:28:34.995888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017472+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:35.017472+0000","last_peered":"2023-08-27T11:28:35.017472+0000","last_clean":"2023-08-27T11:28:35.017472+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:35.017472+0000","last_undegraded":"2023-08-27T11:28:35.017472+0000","last_fullsized":"2023-08-27T11:28:35.017472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:06.183796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":205,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.994474+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:34.994474+0000","last_peered":"2023-08-27T11:28:34.994474+0000","last_clean":"2023-08-27T11:28:34.994474+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:34.994474+0000","last_undegraded":"2023-08-27T11:28:34.994474+0000","last_fullsized":"2023-08-27T11:28:34.994474+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:29.520414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.004143+0000","last_change":"2023-08-27T11:28:35.004143+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.004143+0000","last_undegraded":"2023-08-27T11:28:35.004143+0000","last_fullsized":"2023-08-27T11:28:35.004143+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.020153+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:35.020153+0000","last_peered":"2023-08-27T11:28:35.020153+0000","last_clean":"2023-08-27T11:28:35.020153+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:35.020153+0000","last_undegraded":"2023-08-27T11:28:35.020153+0000","last_fullsized":"2023-08-27T11:28:35.020153+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:04:15.211750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":215,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.996443+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:34.996443+0000","last_peered":"2023-08-27T11:28:34.996443+0000","last_clean":"2023-08-27T11:28:34.996443+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:34.996443+0000","last_undegraded":"2023-08-27T11:28:34.996443+0000","last_fullsized":"2023-08-27T11:28:34.996443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:28:28.689665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996258+0000","last_change":"2023-08-27T11:28:34.996258+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996258+0000","last_undegraded":"2023-08-27T11:28:34.996258+0000","last_fullsized":"2023-08-27T11:28:34.996258+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.018068+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:35.018068+0000","last_peered":"2023-08-27T11:28:35.018068+0000","last_clean":"2023-08-27T11:28:35.018068+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:35.018068+0000","last_undegraded":"2023-08-27T11:28:35.018068+0000","last_fullsized":"2023-08-27T11:28:35.018068+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:30.665301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004952+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:35.004952+0000","last_peered":"2023-08-27T11:28:35.004952+0000","last_clean":"2023-08-27T11:28:35.004952+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:35.004952+0000","last_undegraded":"2023-08-27T11:28:35.004952+0000","last_fullsized":"2023-08-27T11:28:35.004952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:29:36.012817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.998709+0000","last_change":"2023-08-27T11:28:34.998709+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.998709+0000","last_undegraded":"2023-08-27T11:28:34.998709+0000","last_fullsized":"2023-08-27T11:28:34.998709+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.017161+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:35.017161+0000","last_peered":"2023-08-27T11:28:35.017161+0000","last_clean":"2023-08-27T11:28:35.017161+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:35.017161+0000","last_undegraded":"2023-08-27T11:28:35.017161+0000","last_fullsized":"2023-08-27T11:28:35.017161+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:43:44.678356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":191,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004477+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:35.004477+0000","last_peered":"2023-08-27T11:28:35.004477+0000","last_clean":"2023-08-27T11:28:35.004477+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:35.004477+0000","last_undegraded":"2023-08-27T11:28:35.004477+0000","last_fullsized":"2023-08-27T11:28:35.004477+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:25.039099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.001814+0000","last_change":"2023-08-27T11:28:35.001814+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.001814+0000","last_undegraded":"2023-08-27T11:28:35.001814+0000","last_fullsized":"2023-08-27T11:28:35.001814+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.012867+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:35.012867+0000","last_peered":"2023-08-27T11:28:35.012867+0000","last_clean":"2023-08-27T11:28:35.012867+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:35.012867+0000","last_undegraded":"2023-08-27T11:28:35.012867+0000","last_fullsized":"2023-08-27T11:28:35.012867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:52.103487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":339,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.004793+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:35.004793+0000","last_peered":"2023-08-27T11:28:35.004793+0000","last_clean":"2023-08-27T11:28:35.004793+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:35.004793+0000","last_undegraded":"2023-08-27T11:28:35.004793+0000","last_fullsized":"2023-08-27T11:28:35.004793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:20:33.273771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014342+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:35.014342+0000","last_peered":"2023-08-27T11:28:35.014342+0000","last_clean":"2023-08-27T11:28:35.014342+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:35.014342+0000","last_undegraded":"2023-08-27T11:28:35.014342+0000","last_fullsized":"2023-08-27T11:28:35.014342+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:02:50.084686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:35.006201+0000","last_change":"2023-08-27T11:28:35.006201+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:35.006201+0000","last_undegraded":"2023-08-27T11:28:35.006201+0000","last_fullsized":"2023-08-27T11:28:35.006201+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.019744+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:35.019744+0000","last_peered":"2023-08-27T11:28:35.019744+0000","last_clean":"2023-08-27T11:28:35.019744+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:35.019744+0000","last_undegraded":"2023-08-27T11:28:35.019744+0000","last_fullsized":"2023-08-27T11:28:35.019744+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:59:23.026278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":197,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.006432+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:35.006432+0000","last_peered":"2023-08-27T11:28:35.006432+0000","last_clean":"2023-08-27T11:28:35.006432+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:35.006432+0000","last_undegraded":"2023-08-27T11:28:35.006432+0000","last_fullsized":"2023-08-27T11:28:35.006432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:11:59.900036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":122,"state":"creating+peering","last_fresh":"2023-08-27T11:28:34.996868+0000","last_change":"2023-08-27T11:28:34.996868+0000","last_active":"2023-08-27T11:28:34.984084+0000","last_peered":"2023-08-27T11:28:34.984084+0000","last_clean":"2023-08-27T11:28:34.984084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:28:34.996868+0000","last_undegraded":"2023-08-27T11:28:34.996868+0000","last_fullsized":"2023-08-27T11:28:34.996868+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:35.014057+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:35.014057+0000","last_peered":"2023-08-27T11:28:35.014057+0000","last_clean":"2023-08-27T11:28:35.014057+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:35.014057+0000","last_undegraded":"2023-08-27T11:28:35.014057+0000","last_fullsized":"2023-08-27T11:28:35.014057+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:48:41.844380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":213,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-27T11:28:34.999190+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:34.999190+0000","last_peered":"2023-08-27T11:28:34.999190+0000","last_clean":"2023-08-27T11:28:34.999190+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:34.999190+0000","last_undegraded":"2023-08-27T11:28:34.999190+0000","last_fullsized":"2023-08-27T11:28:34.999190+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:51:45.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29076,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342764,"statfs":{"total":96636764160,"available":96606990336,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.63},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.57599999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.505}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.745}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.52500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28504,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343336,"statfs":{"total":96636764160,"available":96607576064,"internally_reserved":0,"allocated":1519616,"data_stored":713512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71299999999999997,"15min":0.877},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.01,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":3.472,"15min":3.472},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.94599999999999995},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.98799999999999999,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.753,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.95299999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74199999999999999,"15min":0.84599999999999997},"min":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.101,"5min":1.234,"15min":1.234},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76300000000000001,"15min":0.80200000000000005},"min":{"1min":0.50900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.071,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":1.135,"15min":1.135},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82499999999999996,"15min":0.84699999999999998},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.88100000000000001},"min":{"1min":0.62,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.111,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0309999999999999,"5min":1.27,"15min":1.27},"last":0.71899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2105344,"data_stored":1298246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":2.734,"15min":2.734},"last":0.64600000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68700000000000006,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61599999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.93100000000000005,"5min":3.101,"15min":3.101},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1240000000000001,"5min":3.359,"15min":3.359},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.96999999999999997,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.036,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.754}]},{"osd":7,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.038,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60499999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.88900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":1.135}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.355,"15min":1.355},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94299999999999995,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.74299999999999999},"min":{"1min":0.621,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":1.123,"15min":1.123},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.032,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.173}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90100000000000002,"5min":1.329,"15min":1.329},"last":1.081},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94799999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.111}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96899999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.254},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":1.2789999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1523712,"data_stored":714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.375}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.90000000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.93799999999999994}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46000000000000002,"15min":0.59899999999999998},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.52000000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.443},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83799999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":1.1459999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70299999999999996,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.628,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74099999999999999,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77300000000000002,"15min":0.90000000000000002},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.022,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96399999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.429,"15min":1.429},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.96999999999999997},"min":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.62}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.95399999999999996},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80200000000000005,"15min":0.94399999999999995},"min":{"1min":0.622,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90700000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.96099999999999997},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":5,"15min":5},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28496,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343344,"statfs":{"total":96636764160,"available":96607584256,"internally_reserved":0,"allocated":1511424,"data_stored":707878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.498},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.628}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.70999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28492,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343348,"statfs":{"total":96636764160,"available":96607588352,"internally_reserved":0,"allocated":1507328,"data_stored":706892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.627},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.749}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.034}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:41.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-08-27T11:28:41.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998893+0000', 'last_change': '2023-08-27T11:28:34.998893+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998893+0000', 'last_undegraded': '2023-08-27T11:28:34.998893+0000', 'last_fullsized': '2023-08-27T11:28:34.998893+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-08-27T11:28:41.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.995765+0000', 'last_change': '2023-08-27T11:28:34.995765+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.995765+0000', 'last_undegraded': '2023-08-27T11:28:34.995765+0000', 'last_fullsized': '2023-08-27T11:28:34.995765+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-08-27T11:28:41.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998666+0000', 'last_change': '2023-08-27T11:28:34.998666+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998666+0000', 'last_undegraded': '2023-08-27T11:28:34.998666+0000', 'last_fullsized': '2023-08-27T11:28:34.998666+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-08-27T11:28:41.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.994872+0000', 'last_change': '2023-08-27T11:28:34.994872+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.994872+0000', 'last_undegraded': '2023-08-27T11:28:34.994872+0000', 'last_fullsized': '2023-08-27T11:28:34.994872+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-08-27T11:28:41.517 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996260+0000', 'last_change': '2023-08-27T11:28:34.996260+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996260+0000', 'last_undegraded': '2023-08-27T11:28:34.996260+0000', 'last_fullsized': '2023-08-27T11:28:34.996260+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.517 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-08-27T11:28:41.518 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.005148+0000', 'last_change': '2023-08-27T11:28:35.005148+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.005148+0000', 'last_undegraded': '2023-08-27T11:28:35.005148+0000', 'last_fullsized': '2023-08-27T11:28:35.005148+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.518 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-08-27T11:28:41.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002060+0000', 'last_change': '2023-08-27T11:28:35.002060+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002060+0000', 'last_undegraded': '2023-08-27T11:28:35.002060+0000', 'last_fullsized': '2023-08-27T11:28:35.002060+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.519 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-08-27T11:28:41.519 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996585+0000', 'last_change': '2023-08-27T11:28:34.996585+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996585+0000', 'last_undegraded': '2023-08-27T11:28:34.996585+0000', 'last_fullsized': '2023-08-27T11:28:34.996585+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:28:41.520 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-08-27T11:28:41.520 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.008210+0000', 'last_change': '2023-08-27T11:28:35.008210+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.008210+0000', 'last_undegraded': '2023-08-27T11:28:35.008210+0000', 'last_fullsized': '2023-08-27T11:28:35.008210+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-08-27T11:28:41.521 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.005825+0000', 'last_change': '2023-08-27T11:28:35.005825+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.005825+0000', 'last_undegraded': '2023-08-27T11:28:35.005825+0000', 'last_fullsized': '2023-08-27T11:28:35.005825+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.521 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-08-27T11:28:41.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.994798+0000', 'last_change': '2023-08-27T11:28:34.994798+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.994798+0000', 'last_undegraded': '2023-08-27T11:28:34.994798+0000', 'last_fullsized': '2023-08-27T11:28:34.994798+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.522 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-08-27T11:28:41.522 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997687+0000', 'last_change': '2023-08-27T11:28:34.997687+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997687+0000', 'last_undegraded': '2023-08-27T11:28:34.997687+0000', 'last_fullsized': '2023-08-27T11:28:34.997687+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.523 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-08-27T11:28:41.523 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004548+0000', 'last_change': '2023-08-27T11:28:35.004548+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004548+0000', 'last_undegraded': '2023-08-27T11:28:35.004548+0000', 'last_fullsized': '2023-08-27T11:28:35.004548+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-08-27T11:28:41.524 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.999341+0000', 'last_change': '2023-08-27T11:28:34.999341+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.999341+0000', 'last_undegraded': '2023-08-27T11:28:34.999341+0000', 'last_fullsized': '2023-08-27T11:28:34.999341+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.524 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-08-27T11:28:41.525 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998562+0000', 'last_change': '2023-08-27T11:28:34.998562+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998562+0000', 'last_undegraded': '2023-08-27T11:28:34.998562+0000', 'last_fullsized': '2023-08-27T11:28:34.998562+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-08-27T11:28:41.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002126+0000', 'last_change': '2023-08-27T11:28:35.002126+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002126+0000', 'last_undegraded': '2023-08-27T11:28:35.002126+0000', 'last_fullsized': '2023-08-27T11:28:35.002126+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-08-27T11:28:41.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004361+0000', 'last_change': '2023-08-27T11:28:35.004361+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004361+0000', 'last_undegraded': '2023-08-27T11:28:35.004361+0000', 'last_fullsized': '2023-08-27T11:28:35.004361+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-08-27T11:28:41.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001770+0000', 'last_change': '2023-08-27T11:28:35.001770+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001770+0000', 'last_undegraded': '2023-08-27T11:28:35.001770+0000', 'last_fullsized': '2023-08-27T11:28:35.001770+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-08-27T11:28:41.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002510+0000', 'last_change': '2023-08-27T11:28:35.002510+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002510+0000', 'last_undegraded': '2023-08-27T11:28:35.002510+0000', 'last_fullsized': '2023-08-27T11:28:35.002510+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-08-27T11:28:41.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996286+0000', 'last_change': '2023-08-27T11:28:34.996286+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996286+0000', 'last_undegraded': '2023-08-27T11:28:34.996286+0000', 'last_fullsized': '2023-08-27T11:28:34.996286+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-08-27T11:28:41.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.995246+0000', 'last_change': '2023-08-27T11:28:34.995246+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.995246+0000', 'last_undegraded': '2023-08-27T11:28:34.995246+0000', 'last_fullsized': '2023-08-27T11:28:34.995246+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-08-27T11:28:41.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998003+0000', 'last_change': '2023-08-27T11:28:34.998003+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998003+0000', 'last_undegraded': '2023-08-27T11:28:34.998003+0000', 'last_fullsized': '2023-08-27T11:28:34.998003+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-08-27T11:28:41.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.995512+0000', 'last_change': '2023-08-27T11:28:34.995512+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.995512+0000', 'last_undegraded': '2023-08-27T11:28:34.995512+0000', 'last_fullsized': '2023-08-27T11:28:34.995512+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-08-27T11:28:41.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.003500+0000', 'last_change': '2023-08-27T11:28:35.003500+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.003500+0000', 'last_undegraded': '2023-08-27T11:28:35.003500+0000', 'last_fullsized': '2023-08-27T11:28:35.003500+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-08-27T11:28:41.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998398+0000', 'last_change': '2023-08-27T11:28:34.998398+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998398+0000', 'last_undegraded': '2023-08-27T11:28:34.998398+0000', 'last_fullsized': '2023-08-27T11:28:34.998398+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-08-27T11:28:41.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998311+0000', 'last_change': '2023-08-27T11:28:34.998311+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998311+0000', 'last_undegraded': '2023-08-27T11:28:34.998311+0000', 'last_fullsized': '2023-08-27T11:28:34.998311+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-08-27T11:28:41.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002965+0000', 'last_change': '2023-08-27T11:28:35.002965+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002965+0000', 'last_undegraded': '2023-08-27T11:28:35.002965+0000', 'last_fullsized': '2023-08-27T11:28:35.002965+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-08-27T11:28:41.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004607+0000', 'last_change': '2023-08-27T11:28:35.004607+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004607+0000', 'last_undegraded': '2023-08-27T11:28:35.004607+0000', 'last_fullsized': '2023-08-27T11:28:35.004607+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-08-27T11:28:41.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.999210+0000', 'last_change': '2023-08-27T11:28:34.999210+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.999210+0000', 'last_undegraded': '2023-08-27T11:28:34.999210+0000', 'last_fullsized': '2023-08-27T11:28:34.999210+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-08-27T11:28:41.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998437+0000', 'last_change': '2023-08-27T11:28:34.998437+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998437+0000', 'last_undegraded': '2023-08-27T11:28:34.998437+0000', 'last_fullsized': '2023-08-27T11:28:34.998437+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-08-27T11:28:41.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997101+0000', 'last_change': '2023-08-27T11:28:34.997101+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997101+0000', 'last_undegraded': '2023-08-27T11:28:34.997101+0000', 'last_fullsized': '2023-08-27T11:28:34.997101+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:28:41.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-08-27T11:28:41.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.003565+0000', 'last_change': '2023-08-27T11:28:35.003565+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.003565+0000', 'last_undegraded': '2023-08-27T11:28:35.003565+0000', 'last_fullsized': '2023-08-27T11:28:35.003565+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-08-27T11:28:41.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996024+0000', 'last_change': '2023-08-27T11:28:34.996024+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996024+0000', 'last_undegraded': '2023-08-27T11:28:34.996024+0000', 'last_fullsized': '2023-08-27T11:28:34.996024+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:28:41.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-08-27T11:28:41.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996599+0000', 'last_change': '2023-08-27T11:28:34.996599+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996599+0000', 'last_undegraded': '2023-08-27T11:28:34.996599+0000', 'last_fullsized': '2023-08-27T11:28:34.996599+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-08-27T11:28:41.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.994787+0000', 'last_change': '2023-08-27T11:28:34.994787+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.994787+0000', 'last_undegraded': '2023-08-27T11:28:34.994787+0000', 'last_fullsized': '2023-08-27T11:28:34.994787+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-08-27T11:28:41.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998325+0000', 'last_change': '2023-08-27T11:28:34.998325+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998325+0000', 'last_undegraded': '2023-08-27T11:28:34.998325+0000', 'last_fullsized': '2023-08-27T11:28:34.998325+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-08-27T11:28:41.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998726+0000', 'last_change': '2023-08-27T11:28:34.998726+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998726+0000', 'last_undegraded': '2023-08-27T11:28:34.998726+0000', 'last_fullsized': '2023-08-27T11:28:34.998726+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:28:41.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-08-27T11:28:41.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998913+0000', 'last_change': '2023-08-27T11:28:34.998913+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998913+0000', 'last_undegraded': '2023-08-27T11:28:34.998913+0000', 'last_fullsized': '2023-08-27T11:28:34.998913+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:28:41.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-08-27T11:28:41.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001260+0000', 'last_change': '2023-08-27T11:28:35.001260+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001260+0000', 'last_undegraded': '2023-08-27T11:28:35.001260+0000', 'last_fullsized': '2023-08-27T11:28:35.001260+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-08-27T11:28:41.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002434+0000', 'last_change': '2023-08-27T11:28:35.002434+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002434+0000', 'last_undegraded': '2023-08-27T11:28:35.002434+0000', 'last_fullsized': '2023-08-27T11:28:35.002434+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-08-27T11:28:41.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997296+0000', 'last_change': '2023-08-27T11:28:34.997296+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997296+0000', 'last_undegraded': '2023-08-27T11:28:34.997296+0000', 'last_fullsized': '2023-08-27T11:28:34.997296+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-08-27T11:28:41.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001555+0000', 'last_change': '2023-08-27T11:28:35.001555+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001555+0000', 'last_undegraded': '2023-08-27T11:28:35.001555+0000', 'last_fullsized': '2023-08-27T11:28:35.001555+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-08-27T11:28:41.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.002570+0000', 'last_change': '2023-08-27T11:28:35.002570+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.002570+0000', 'last_undegraded': '2023-08-27T11:28:35.002570+0000', 'last_fullsized': '2023-08-27T11:28:35.002570+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-08-27T11:28:41.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.006662+0000', 'last_change': '2023-08-27T11:28:35.006662+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.006662+0000', 'last_undegraded': '2023-08-27T11:28:35.006662+0000', 'last_fullsized': '2023-08-27T11:28:35.006662+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-08-27T11:28:41.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.999726+0000', 'last_change': '2023-08-27T11:28:34.999726+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.999726+0000', 'last_undegraded': '2023-08-27T11:28:34.999726+0000', 'last_fullsized': '2023-08-27T11:28:34.999726+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-08-27T11:28:41.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997114+0000', 'last_change': '2023-08-27T11:28:34.997114+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997114+0000', 'last_undegraded': '2023-08-27T11:28:34.997114+0000', 'last_fullsized': '2023-08-27T11:28:34.997114+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-08-27T11:28:41.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997099+0000', 'last_change': '2023-08-27T11:28:34.997099+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997099+0000', 'last_undegraded': '2023-08-27T11:28:34.997099+0000', 'last_fullsized': '2023-08-27T11:28:34.997099+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-08-27T11:28:41.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997186+0000', 'last_change': '2023-08-27T11:28:34.997186+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997186+0000', 'last_undegraded': '2023-08-27T11:28:34.997186+0000', 'last_fullsized': '2023-08-27T11:28:34.997186+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:28:41.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-08-27T11:28:41.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996963+0000', 'last_change': '2023-08-27T11:28:34.996963+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996963+0000', 'last_undegraded': '2023-08-27T11:28:34.996963+0000', 'last_fullsized': '2023-08-27T11:28:34.996963+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-08-27T11:28:41.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.997210+0000', 'last_change': '2023-08-27T11:28:34.997210+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.997210+0000', 'last_undegraded': '2023-08-27T11:28:34.997210+0000', 'last_fullsized': '2023-08-27T11:28:34.997210+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-08-27T11:28:41.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001884+0000', 'last_change': '2023-08-27T11:28:35.001884+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001884+0000', 'last_undegraded': '2023-08-27T11:28:35.001884+0000', 'last_fullsized': '2023-08-27T11:28:35.001884+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-08-27T11:28:41.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004673+0000', 'last_change': '2023-08-27T11:28:35.004673+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004673+0000', 'last_undegraded': '2023-08-27T11:28:35.004673+0000', 'last_fullsized': '2023-08-27T11:28:35.004673+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-08-27T11:28:41.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004099+0000', 'last_change': '2023-08-27T11:28:35.004099+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004099+0000', 'last_undegraded': '2023-08-27T11:28:35.004099+0000', 'last_fullsized': '2023-08-27T11:28:35.004099+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-08-27T11:28:41.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004718+0000', 'last_change': '2023-08-27T11:28:35.004718+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004718+0000', 'last_undegraded': '2023-08-27T11:28:35.004718+0000', 'last_fullsized': '2023-08-27T11:28:35.004718+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-08-27T11:28:41.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.003873+0000', 'last_change': '2023-08-27T11:28:35.003873+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.003873+0000', 'last_undegraded': '2023-08-27T11:28:35.003873+0000', 'last_fullsized': '2023-08-27T11:28:35.003873+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-08-27T11:28:41.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001853+0000', 'last_change': '2023-08-27T11:28:35.001853+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001853+0000', 'last_undegraded': '2023-08-27T11:28:35.001853+0000', 'last_fullsized': '2023-08-27T11:28:35.001853+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-08-27T11:28:41.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.995868+0000', 'last_change': '2023-08-27T11:28:34.995868+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.995868+0000', 'last_undegraded': '2023-08-27T11:28:34.995868+0000', 'last_fullsized': '2023-08-27T11:28:34.995868+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-08-27T11:28:41.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.995888+0000', 'last_change': '2023-08-27T11:28:34.995888+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.995888+0000', 'last_undegraded': '2023-08-27T11:28:34.995888+0000', 'last_fullsized': '2023-08-27T11:28:34.995888+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-08-27T11:28:41.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.004143+0000', 'last_change': '2023-08-27T11:28:35.004143+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.004143+0000', 'last_undegraded': '2023-08-27T11:28:35.004143+0000', 'last_fullsized': '2023-08-27T11:28:35.004143+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:28:41.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-08-27T11:28:41.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996258+0000', 'last_change': '2023-08-27T11:28:34.996258+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996258+0000', 'last_undegraded': '2023-08-27T11:28:34.996258+0000', 'last_fullsized': '2023-08-27T11:28:34.996258+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:28:41.559 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-08-27T11:28:41.559 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.998709+0000', 'last_change': '2023-08-27T11:28:34.998709+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.998709+0000', 'last_undegraded': '2023-08-27T11:28:34.998709+0000', 'last_fullsized': '2023-08-27T11:28:34.998709+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:28:41.560 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-08-27T11:28:41.560 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.001814+0000', 'last_change': '2023-08-27T11:28:35.001814+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.001814+0000', 'last_undegraded': '2023-08-27T11:28:35.001814+0000', 'last_fullsized': '2023-08-27T11:28:35.001814+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:28:41.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-08-27T11:28:41.561 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:35.006201+0000', 'last_change': '2023-08-27T11:28:35.006201+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:35.006201+0000', 'last_undegraded': '2023-08-27T11:28:35.006201+0000', 'last_fullsized': '2023-08-27T11:28:35.006201+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:28:41.561 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-08-27T11:28:41.562 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 122, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:28:34.996868+0000', 'last_change': '2023-08-27T11:28:34.996868+0000', 'last_active': '2023-08-27T11:28:34.984084+0000', 'last_peered': '2023-08-27T11:28:34.984084+0000', 'last_clean': '2023-08-27T11:28:34.984084+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:28:34.996868+0000', 'last_undegraded': '2023-08-27T11:28:34.996868+0000', 'last_fullsized': '2023-08-27T11:28:34.996868+0000', 'mapping_epoch': 122, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 122, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'last_clean_scrub_stamp': '2023-08-27T11:28:34.984084+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:28:41.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-27T11:28:41.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.802+0000 7fd724dff700 1 Processor -- start 2023-08-27T11:28:41.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.803+0000 7fd724dff700 1 -- start start 2023-08-27T11:28:41.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 0x7fd7200c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 0x7fd7200c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7200c4be0 0x7fd72006b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7200c6730 con 0x7fd7200c4be0 2023-08-27T11:28:41.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7200c7240 con 0x7fd720151c40 2023-08-27T11:28:41.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd724dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200c76d0 con 0x7fd720155160 2023-08-27T11:28:41.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd71ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7200c4be0 0x7fd72006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd71ed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd7200c4be0 0x7fd72006b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36606/0 (socket says 172.21.15.43:36606) 2023-08-27T11:28:41.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.804+0000 7fd71ed9d700 1 -- 172.21.15.43:0/1752694897 learned_addr learned my addr 172.21.15.43:0/1752694897 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd717fff700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 0x7fd7200c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 -- 172.21.15.43:0/1752694897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 msgr2=0x7fd7200c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:41.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71e59c700 1 --2- 172.21.15.43:0/1752694897 >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 0x7fd7200c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 0x7fd7200c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 -- 172.21.15.43:0/1752694897 >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 msgr2=0x7fd7200c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/1752694897 >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 0x7fd7200c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 -- 172.21.15.43:0/1752694897 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200c8380 con 0x7fd7200c4be0 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd717fff700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 0x7fd7200c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:41.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71e59c700 1 --2- 172.21.15.43:0/1752694897 >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 0x7fd7200c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:41.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7200c4be0 0x7fd72006b620 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd72008b3a0 tx=0x7fd71800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c241f59be7c2e932 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71dd9b700 1 -- 172.21.15.43:0/1752694897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800e070 con 0x7fd7200c4be0 2023-08-27T11:28:41.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71dd9b700 1 -- 172.21.15.43:0/1752694897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800b9c0 con 0x7fd7200c4be0 2023-08-27T11:28:41.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.805+0000 7fd71dd9b700 1 -- 172.21.15.43:0/1752694897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800bd70 con 0x7fd7200c4be0 2023-08-27T11:28:41.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 -- 172.21.15.43:0/1752694897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7200c4be0 msgr2=0x7fd72006b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7200c4be0 0x7fd72006b620 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd72008b3a0 tx=0x7fd71800b330 comp rx=0 tx=0).stop 2023-08-27T11:28:41.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 -- 172.21.15.43:0/1752694897 shutdown_connections 2023-08-27T11:28:41.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd7200c4be0 0x7fd72006b620 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 --2- 172.21.15.43:0/1752694897 >> v2:172.21.15.57:3300/0 conn(0x7fd720151c40 0x7fd7200c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 --2- 172.21.15.43:0/1752694897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd720155160 0x7fd7200c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 -- 172.21.15.43:0/1752694897 >> 172.21.15.43:0/1752694897 conn(0x7fd7200ab910 msgr2=0x7fd7200abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 -- 172.21.15.43:0/1752694897 shutdown_connections 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.806+0000 7fd724dff700 1 -- 172.21.15.43:0/1752694897 wait complete. 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.808+0000 7fd724dff700 1 Processor -- start 2023-08-27T11:28:41.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.808+0000 7fd724dff700 1 -- start start 2023-08-27T11:28:41.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7200c4be0 0x7fd7200bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd720151c40 0x7fd7201eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7201eb090 con 0x7fd720155160 2023-08-27T11:28:41.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7201eda50 con 0x7fd720151c40 2023-08-27T11:28:41.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd724dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd720154110 con 0x7fd7200c4be0 2023-08-27T11:28:41.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36608/0 (socket says 172.21.15.43:36608) 2023-08-27T11:28:41.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 -- 172.21.15.43:0/49812492 learned_addr learned my addr 172.21.15.43:0/49812492 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:41.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd717fff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd720151c40 0x7fd7201eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71e59c700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7200c4be0 0x7fd7200bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 -- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7200c4be0 msgr2=0x7fd7200bdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7200c4be0 0x7fd7200bdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 -- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd720151c40 msgr2=0x7fd7201eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:41.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd720151c40 0x7fd7201eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:41.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.809+0000 7fd71ed9d700 1 -- 172.21.15.43:0/49812492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd718009b30 con 0x7fd720155160 2023-08-27T11:28:41.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd71ed9d700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b370 tx=0x7fd718004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718004310 con 0x7fd720155160 2023-08-27T11:28:41.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718004470 con 0x7fd720155160 2023-08-27T11:28:41.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7201543f0 con 0x7fd720155160 2023-08-27T11:28:41.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718004820 con 0x7fd720155160 2023-08-27T11:28:41.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.810+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72014dbe0 con 0x7fd720155160 2023-08-27T11:28:41.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.811+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7200c5080 con 0x7fd720155160 2023-08-27T11:28:41.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.812+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd71801b430 con 0x7fd720155160 2023-08-27T11:28:41.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.813+0000 7fd716ffd700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 0x7fd70006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:41.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.813+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd718089860 con 0x7fd720155160 2023-08-27T11:28:41.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.813+0000 7fd71e59c700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 0x7fd70006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:41.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.814+0000 7fd71e59c700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 0x7fd70006c5a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd710006ba0 tx=0x7fd710008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:41.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:41.817+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd718054f40 con 0x7fd720155160 2023-08-27T11:28:42.114 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.113+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd72004ee70 con 0x7fd720155160 2023-08-27T11:28:42.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.113+0000 7fd716ffd700 1 -- 172.21.15.43:0/49812492 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1456 (secure 0 0 0) 0x7fd718058560 con 0x7fd720155160 2023-08-27T11:28:42.115 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:42.115 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":379,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1693135354,"num_in_osds":8,"osd_in_since":1693135346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":238899200,"bytes_avail":772855214080,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":130,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8097}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-08-27T11:27:30.371471+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-27T11:28:42.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 msgr2=0x7fd70006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 0x7fd70006c5a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd710006ba0 tx=0x7fd710008040 comp rx=0 tx=0).stop 2023-08-27T11:28:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 msgr2=0x7fd72014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd71800b370 tx=0x7fd718004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 shutdown_connections 2023-08-27T11:28:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd70006a0e0 0x7fd70006c5a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd720155160 0x7fd72014d6a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7200c4be0 0x7fd7200bdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 --2- 172.21.15.43:0/49812492 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd720151c40 0x7fd7201eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 >> 172.21.15.43:0/49812492 conn(0x7fd7200ab910 msgr2=0x7fd7200bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 shutdown_connections 2023-08-27T11:28:42.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.116+0000 7fd724dff700 1 -- 172.21.15.43:0/49812492 wait complete. 2023-08-27T11:28:42.136 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-27T11:28:42.136 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:42.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.339+0000 7f33e0fff700 1 Processor -- start 2023-08-27T11:28:42.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.339+0000 7f33e0fff700 1 -- start start 2023-08-27T11:28:42.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33e0fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33dc0c4630 0x7f33dc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33e0fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc06c4e0 con 0x7f33dc06ad70 2023-08-27T11:28:42.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33e0fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc155370 con 0x7f33dc151a90 2023-08-27T11:28:42.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33e0fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc0c82c0 con 0x7f33dc0c4630 2023-08-27T11:28:42.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33dad9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f33dc06ad70 0x7f33dc06b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47364/0 (socket says 172.21.15.43:47364) 2023-08-27T11:28:42.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.340+0000 7f33dad9d700 1 -- 172.21.15.43:0/3868621185 learned_addr learned my addr 172.21.15.43:0/3868621185 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:42.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3868621185 >> v2:172.21.15.57:3300/0 conn(0x7f33dc0c4630 0x7f33dc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277745841 0 0) 0x7f33dc06c4e0 con 0x7f33dc06ad70 2023-08-27T11:28:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c80035b0 con 0x7f33dc06ad70 2023-08-27T11:28:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902827347 0 0) 0x7f33dc155370 con 0x7f33dc151a90 2023-08-27T11:28:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33dc06c4e0 con 0x7f33dc151a90 2023-08-27T11:28:42.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346573062 0 0) 0x7f33c80035b0 con 0x7f33dc06ad70 2023-08-27T11:28:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 >> v2:172.21.15.57:3300/0 conn(0x7f33dc0c4630 msgr2=0x7f33dc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 --2- 172.21.15.43:0/3868621185 >> v2:172.21.15.57:3300/0 conn(0x7f33dc0c4630 0x7f33dc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 >> v1:172.21.15.57:6789/0 conn(0x7f33dc151a90 legacy=0x7f33dc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc151e70 con 0x7f33dc06ad70 2023-08-27T11:28:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f33d40019f0 con 0x7f33dc06ad70 2023-08-27T11:28:42.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 >> v1:172.21.15.43:6789/0 conn(0x7f33dc06ad70 legacy=0x7f33dc06b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33c8003be0 0x7f33c8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 0x7f33c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8005260 0x7f33c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0c82c0 con 0x7f33c8004850 2023-08-27T11:28:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c800c190 con 0x7f33c8005260 2023-08-27T11:28:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.341+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c800c350 con 0x7f33c8003be0 2023-08-27T11:28:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 0x7f33c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33dad9d700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8005260 0x7f33c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33da59c700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33c8003be0 0x7f33c8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 -- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33c8003be0 msgr2=0x7f33c8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:42.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33c8003be0 0x7f33c8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 -- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8005260 msgr2=0x7f33c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:42.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8005260 0x7f33c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 -- 172.21.15.43:0/3868621185 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80035b0 con 0x7f33c8004850 2023-08-27T11:28:42.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33dad9d700 1 -- 172.21.15.43:0/3868621185 reap_dead start 2023-08-27T11:28:42.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 0x7f33c8004cd0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009b60 tx=0x7f33c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab771ba583966b69 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:42.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.342+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400e6c0 con 0x7f33c8004850 2023-08-27T11:28:42.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400e820 con 0x7f33c8004850 2023-08-27T11:28:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33d9d9b700 1 -- 172.21.15.43:0/3868621185 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400eb90 con 0x7f33c8004850 2023-08-27T11:28:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 -- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 msgr2=0x7f33c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 0x7f33c8004cd0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009b60 tx=0x7f33c8005880 comp rx=0 tx=0).stop 2023-08-27T11:28:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 -- 172.21.15.43:0/3868621185 shutdown_connections 2023-08-27T11:28:42.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3868621185 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33c8004850 0x7f33c8004cd0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 -- 172.21.15.43:0/3868621185 >> 172.21.15.43:0/3868621185 conn(0x7f33dc0ab820 msgr2=0x7f33dc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:42.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 -- 172.21.15.43:0/3868621185 shutdown_connections 2023-08-27T11:28:42.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.343+0000 7f33e0fff700 1 -- 172.21.15.43:0/3868621185 wait complete. 2023-08-27T11:28:42.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.346+0000 7f33e0fff700 1 Processor -- start 2023-08-27T11:28:42.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.346+0000 7f33e0fff700 1 -- start start 2023-08-27T11:28:42.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8004850 0x7f33dc06b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33dc14bee0 0x7f33dc145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc1eac90 con 0x7f33dc14ce00 2023-08-27T11:28:42.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc146900 con 0x7f33c8004850 2023-08-27T11:28:42.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33e0fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc1ea960 con 0x7f33dc14bee0 2023-08-27T11:28:42.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33dad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33dad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36624/0 (socket says 172.21.15.43:36624) 2023-08-27T11:28:42.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33dad9d700 1 -- 172.21.15.43:0/3453962054 learned_addr learned my addr 172.21.15.43:0/3453962054 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:42.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33da59c700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8004850 0x7f33dc06b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.347+0000 7f33d3fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33dc14bee0 0x7f33dc145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 -- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33dc14bee0 msgr2=0x7f33dc145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33dc14bee0 0x7f33dc145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 -- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8004850 msgr2=0x7f33dc06b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8004850 0x7f33dc06b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 -- 172.21.15.43:0/3453962054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc14d3a0 con 0x7f33dc14ce00 2023-08-27T11:28:42.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33dad9d700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0ac390 tx=0x7f33d400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:42.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400ab70 con 0x7f33dc14ce00 2023-08-27T11:28:42.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400acf0 con 0x7f33dc14ce00 2023-08-27T11:28:42.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc14d680 con 0x7f33dc14ce00 2023-08-27T11:28:42.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4013630 con 0x7f33dc14ce00 2023-08-27T11:28:42.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.348+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc1482a0 con 0x7f33dc14ce00 2023-08-27T11:28:42.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.349+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc04ee70 con 0x7f33dc14ce00 2023-08-27T11:28:42.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.350+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33d4013790 con 0x7f33dc14ce00 2023-08-27T11:28:42.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.351+0000 7f33d2ffd700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 0x7f33bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:42.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.351+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33d4088f10 con 0x7f33dc14ce00 2023-08-27T11:28:42.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.352+0000 7f33da59c700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 0x7f33bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:42.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.352+0000 7f33da59c700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 0x7f33bc06c5a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f33dc063f10 tx=0x7f33cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:42.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.356+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33d40545f0 con 0x7f33dc14ce00 2023-08-27T11:28:42.566 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.564+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33dc154760 con 0x7f33bc06a0e0 2023-08-27T11:28:42.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.575+0000 7f33d2ffd700 1 -- 172.21.15.43:0/3453962054 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311861 (secure 0 0 0) 0x7f33cc001700 con 0x7f33bc06a0e0 2023-08-27T11:28:42.581 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:42.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.579+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 msgr2=0x7f33bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.579+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 0x7f33bc06c5a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f33dc063f10 tx=0x7f33cc009040 comp rx=0 tx=0).stop 2023-08-27T11:28:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.579+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 msgr2=0x7f33dc1463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.579+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0ac390 tx=0x7f33d400a510 comp rx=0 tx=0).stop 2023-08-27T11:28:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 shutdown_connections 2023-08-27T11:28:42.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33bc06a0e0 0x7f33bc06c5a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33dc14ce00 0x7f33dc1463c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33c8004850 0x7f33dc06b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 --2- 172.21.15.43:0/3453962054 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33dc14bee0 0x7f33dc145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 >> 172.21.15.43:0/3453962054 conn(0x7f33dc0ab820 msgr2=0x7f33dc0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:42.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 shutdown_connections 2023-08-27T11:28:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:42.580+0000 7f33e0fff700 1 -- 172.21.15.43:0/3453962054 wait complete. 2023-08-27T11:28:42.586 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:42.599 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-08-27T11:28:42.386017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241976,"kb_used_data":13304,"kb_used_omap":13,"kb_used_meta":228530,"kb_avail":754732744,"statfs":{"total":773094113280,"available":772846329856,"internally_reserved":0,"allocated":13623296,"data_stored":7007844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":234014808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.395146"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356594+0000","last_change":"2023-08-27T11:28:36.025295+0000","last_active":"2023-08-27T11:28:37.356594+0000","last_peered":"2023-08-27T11:28:37.356594+0000","last_clean":"2023-08-27T11:28:37.356594+0000","last_became_active":"2023-08-27T11:28:36.024913+0000","last_became_peered":"2023-08-27T11:28:36.024913+0000","last_unstale":"2023-08-27T11:28:37.356594+0000","last_undegraded":"2023-08-27T11:28:37.356594+0000","last_fullsized":"2023-08-27T11:28:37.356594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:50.868614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004981+0000","last_change":"2023-08-27T11:28:36.028793+0000","last_active":"2023-08-27T11:28:37.004981+0000","last_peered":"2023-08-27T11:28:37.004981+0000","last_clean":"2023-08-27T11:28:37.004981+0000","last_became_active":"2023-08-27T11:28:36.028457+0000","last_became_peered":"2023-08-27T11:28:36.028457+0000","last_unstale":"2023-08-27T11:28:37.004981+0000","last_undegraded":"2023-08-27T11:28:37.004981+0000","last_fullsized":"2023-08-27T11:28:37.004981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:00.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004265+0000","last_change":"2023-08-27T11:28:36.014516+0000","last_active":"2023-08-27T11:28:37.004265+0000","last_peered":"2023-08-27T11:28:37.004265+0000","last_clean":"2023-08-27T11:28:37.004265+0000","last_became_active":"2023-08-27T11:28:36.013518+0000","last_became_peered":"2023-08-27T11:28:36.013518+0000","last_unstale":"2023-08-27T11:28:37.004265+0000","last_undegraded":"2023-08-27T11:28:37.004265+0000","last_fullsized":"2023-08-27T11:28:37.004265+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:19.802416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004512+0000","last_change":"2023-08-27T11:28:36.026307+0000","last_active":"2023-08-27T11:28:37.004512+0000","last_peered":"2023-08-27T11:28:37.004512+0000","last_clean":"2023-08-27T11:28:37.004512+0000","last_became_active":"2023-08-27T11:28:36.026010+0000","last_became_peered":"2023-08-27T11:28:36.026010+0000","last_unstale":"2023-08-27T11:28:37.004512+0000","last_undegraded":"2023-08-27T11:28:37.004512+0000","last_fullsized":"2023-08-27T11:28:37.004512+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:57.207944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356357+0000","last_change":"2023-08-27T11:28:36.018518+0000","last_active":"2023-08-27T11:28:37.356357+0000","last_peered":"2023-08-27T11:28:37.356357+0000","last_clean":"2023-08-27T11:28:37.356357+0000","last_became_active":"2023-08-27T11:28:36.016928+0000","last_became_peered":"2023-08-27T11:28:36.016928+0000","last_unstale":"2023-08-27T11:28:37.356357+0000","last_undegraded":"2023-08-27T11:28:37.356357+0000","last_fullsized":"2023-08-27T11:28:37.356357+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:26.188725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356483+0000","last_change":"2023-08-27T11:28:36.032093+0000","last_active":"2023-08-27T11:28:37.356483+0000","last_peered":"2023-08-27T11:28:37.356483+0000","last_clean":"2023-08-27T11:28:37.356483+0000","last_became_active":"2023-08-27T11:28:36.031709+0000","last_became_peered":"2023-08-27T11:28:36.031709+0000","last_unstale":"2023-08-27T11:28:37.356483+0000","last_undegraded":"2023-08-27T11:28:37.356483+0000","last_fullsized":"2023-08-27T11:28:37.356483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:05.870961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356186+0000","last_change":"2023-08-27T11:28:36.037935+0000","last_active":"2023-08-27T11:28:37.356186+0000","last_peered":"2023-08-27T11:28:37.356186+0000","last_clean":"2023-08-27T11:28:37.356186+0000","last_became_active":"2023-08-27T11:28:36.034667+0000","last_became_peered":"2023-08-27T11:28:36.034667+0000","last_unstale":"2023-08-27T11:28:37.356186+0000","last_undegraded":"2023-08-27T11:28:37.356186+0000","last_fullsized":"2023-08-27T11:28:37.356186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:30.365109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005334+0000","last_change":"2023-08-27T11:28:36.025699+0000","last_active":"2023-08-27T11:28:37.005334+0000","last_peered":"2023-08-27T11:28:37.005334+0000","last_clean":"2023-08-27T11:28:37.005334+0000","last_became_active":"2023-08-27T11:28:36.025101+0000","last_became_peered":"2023-08-27T11:28:36.025101+0000","last_unstale":"2023-08-27T11:28:37.005334+0000","last_undegraded":"2023-08-27T11:28:37.005334+0000","last_fullsized":"2023-08-27T11:28:37.005334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:45:46.806482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356543+0000","last_change":"2023-08-27T11:28:36.032044+0000","last_active":"2023-08-27T11:28:37.356543+0000","last_peered":"2023-08-27T11:28:37.356543+0000","last_clean":"2023-08-27T11:28:37.356543+0000","last_became_active":"2023-08-27T11:28:36.031578+0000","last_became_peered":"2023-08-27T11:28:36.031578+0000","last_unstale":"2023-08-27T11:28:37.356543+0000","last_undegraded":"2023-08-27T11:28:37.356543+0000","last_fullsized":"2023-08-27T11:28:37.356543+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.626638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227832+0000","last_change":"2023-08-27T11:28:36.025467+0000","last_active":"2023-08-27T11:28:37.227832+0000","last_peered":"2023-08-27T11:28:37.227832+0000","last_clean":"2023-08-27T11:28:37.227832+0000","last_became_active":"2023-08-27T11:28:36.025183+0000","last_became_peered":"2023-08-27T11:28:36.025183+0000","last_unstale":"2023-08-27T11:28:37.227832+0000","last_undegraded":"2023-08-27T11:28:37.227832+0000","last_fullsized":"2023-08-27T11:28:37.227832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:41.778525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004486+0000","last_change":"2023-08-27T11:28:36.028552+0000","last_active":"2023-08-27T11:28:37.004486+0000","last_peered":"2023-08-27T11:28:37.004486+0000","last_clean":"2023-08-27T11:28:37.004486+0000","last_became_active":"2023-08-27T11:28:36.028230+0000","last_became_peered":"2023-08-27T11:28:36.028230+0000","last_unstale":"2023-08-27T11:28:37.004486+0000","last_undegraded":"2023-08-27T11:28:37.004486+0000","last_fullsized":"2023-08-27T11:28:37.004486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:35.849708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357175+0000","last_change":"2023-08-27T11:28:36.003637+0000","last_active":"2023-08-27T11:28:37.357175+0000","last_peered":"2023-08-27T11:28:37.357175+0000","last_clean":"2023-08-27T11:28:37.357175+0000","last_became_active":"2023-08-27T11:28:36.003238+0000","last_became_peered":"2023-08-27T11:28:36.003238+0000","last_unstale":"2023-08-27T11:28:37.357175+0000","last_undegraded":"2023-08-27T11:28:37.357175+0000","last_fullsized":"2023-08-27T11:28:37.357175+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:12.209607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355955+0000","last_change":"2023-08-27T11:28:36.029468+0000","last_active":"2023-08-27T11:28:37.355955+0000","last_peered":"2023-08-27T11:28:37.355955+0000","last_clean":"2023-08-27T11:28:37.355955+0000","last_became_active":"2023-08-27T11:28:36.028083+0000","last_became_peered":"2023-08-27T11:28:36.028083+0000","last_unstale":"2023-08-27T11:28:37.355955+0000","last_undegraded":"2023-08-27T11:28:37.355955+0000","last_fullsized":"2023-08-27T11:28:37.355955+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:44.393970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356709+0000","last_change":"2023-08-27T11:28:36.031513+0000","last_active":"2023-08-27T11:28:37.356709+0000","last_peered":"2023-08-27T11:28:37.356709+0000","last_clean":"2023-08-27T11:28:37.356709+0000","last_became_active":"2023-08-27T11:28:36.031228+0000","last_became_peered":"2023-08-27T11:28:36.031228+0000","last_unstale":"2023-08-27T11:28:37.356709+0000","last_undegraded":"2023-08-27T11:28:37.356709+0000","last_fullsized":"2023-08-27T11:28:37.356709+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:08.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356170+0000","last_change":"2023-08-27T11:28:36.031969+0000","last_active":"2023-08-27T11:28:37.356170+0000","last_peered":"2023-08-27T11:28:37.356170+0000","last_clean":"2023-08-27T11:28:37.356170+0000","last_became_active":"2023-08-27T11:28:36.030385+0000","last_became_peered":"2023-08-27T11:28:36.030385+0000","last_unstale":"2023-08-27T11:28:37.356170+0000","last_undegraded":"2023-08-27T11:28:37.356170+0000","last_fullsized":"2023-08-27T11:28:37.356170+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:11.176589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355763+0000","last_change":"2023-08-27T11:28:36.035072+0000","last_active":"2023-08-27T11:28:37.355763+0000","last_peered":"2023-08-27T11:28:37.355763+0000","last_clean":"2023-08-27T11:28:37.355763+0000","last_became_active":"2023-08-27T11:28:36.031725+0000","last_became_peered":"2023-08-27T11:28:36.031725+0000","last_unstale":"2023-08-27T11:28:37.355763+0000","last_undegraded":"2023-08-27T11:28:37.355763+0000","last_fullsized":"2023-08-27T11:28:37.355763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:00.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356676+0000","last_change":"2023-08-27T11:28:36.026210+0000","last_active":"2023-08-27T11:28:37.356676+0000","last_peered":"2023-08-27T11:28:37.356676+0000","last_clean":"2023-08-27T11:28:37.356676+0000","last_became_active":"2023-08-27T11:28:36.025658+0000","last_became_peered":"2023-08-27T11:28:36.025658+0000","last_unstale":"2023-08-27T11:28:37.356676+0000","last_undegraded":"2023-08-27T11:28:37.356676+0000","last_fullsized":"2023-08-27T11:28:37.356676+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:35:58.486978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356228+0000","last_change":"2023-08-27T11:28:36.018073+0000","last_active":"2023-08-27T11:28:37.356228+0000","last_peered":"2023-08-27T11:28:37.356228+0000","last_clean":"2023-08-27T11:28:37.356228+0000","last_became_active":"2023-08-27T11:28:36.017781+0000","last_became_peered":"2023-08-27T11:28:36.017781+0000","last_unstale":"2023-08-27T11:28:37.356228+0000","last_undegraded":"2023-08-27T11:28:37.356228+0000","last_fullsized":"2023-08-27T11:28:37.356228+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:40.136336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356688+0000","last_change":"2023-08-27T11:28:36.038441+0000","last_active":"2023-08-27T11:28:37.356688+0000","last_peered":"2023-08-27T11:28:37.356688+0000","last_clean":"2023-08-27T11:28:37.356688+0000","last_became_active":"2023-08-27T11:28:36.036212+0000","last_became_peered":"2023-08-27T11:28:36.036212+0000","last_unstale":"2023-08-27T11:28:37.356688+0000","last_undegraded":"2023-08-27T11:28:37.356688+0000","last_fullsized":"2023-08-27T11:28:37.356688+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:51.362462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356966+0000","last_change":"2023-08-27T11:28:36.034189+0000","last_active":"2023-08-27T11:28:37.356966+0000","last_peered":"2023-08-27T11:28:37.356966+0000","last_clean":"2023-08-27T11:28:37.356966+0000","last_became_active":"2023-08-27T11:28:36.033669+0000","last_became_peered":"2023-08-27T11:28:36.033669+0000","last_unstale":"2023-08-27T11:28:37.356966+0000","last_undegraded":"2023-08-27T11:28:37.356966+0000","last_fullsized":"2023-08-27T11:28:37.356966+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:24.927456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004914+0000","last_change":"2023-08-27T11:28:36.028057+0000","last_active":"2023-08-27T11:28:37.004914+0000","last_peered":"2023-08-27T11:28:37.004914+0000","last_clean":"2023-08-27T11:28:37.004914+0000","last_became_active":"2023-08-27T11:28:36.027646+0000","last_became_peered":"2023-08-27T11:28:36.027646+0000","last_unstale":"2023-08-27T11:28:37.004914+0000","last_undegraded":"2023-08-27T11:28:37.004914+0000","last_fullsized":"2023-08-27T11:28:37.004914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:12.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356859+0000","last_change":"2023-08-27T11:28:36.019510+0000","last_active":"2023-08-27T11:28:37.356859+0000","last_peered":"2023-08-27T11:28:37.356859+0000","last_clean":"2023-08-27T11:28:37.356859+0000","last_became_active":"2023-08-27T11:28:36.019179+0000","last_became_peered":"2023-08-27T11:28:36.019179+0000","last_unstale":"2023-08-27T11:28:37.356859+0000","last_undegraded":"2023-08-27T11:28:37.356859+0000","last_fullsized":"2023-08-27T11:28:37.356859+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:30.973505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005108+0000","last_change":"2023-08-27T11:28:36.033383+0000","last_active":"2023-08-27T11:28:37.005108+0000","last_peered":"2023-08-27T11:28:37.005108+0000","last_clean":"2023-08-27T11:28:37.005108+0000","last_became_active":"2023-08-27T11:28:36.033079+0000","last_became_peered":"2023-08-27T11:28:36.033079+0000","last_unstale":"2023-08-27T11:28:37.005108+0000","last_undegraded":"2023-08-27T11:28:37.005108+0000","last_fullsized":"2023-08-27T11:28:37.005108+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:20.118168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355539+0000","last_change":"2023-08-27T11:28:36.026817+0000","last_active":"2023-08-27T11:28:37.355539+0000","last_peered":"2023-08-27T11:28:37.355539+0000","last_clean":"2023-08-27T11:28:37.355539+0000","last_became_active":"2023-08-27T11:28:36.026404+0000","last_became_peered":"2023-08-27T11:28:36.026404+0000","last_unstale":"2023-08-27T11:28:37.355539+0000","last_undegraded":"2023-08-27T11:28:37.355539+0000","last_fullsized":"2023-08-27T11:28:37.355539+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:36:45.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004836+0000","last_change":"2023-08-27T11:28:36.018195+0000","last_active":"2023-08-27T11:28:37.004836+0000","last_peered":"2023-08-27T11:28:37.004836+0000","last_clean":"2023-08-27T11:28:37.004836+0000","last_became_active":"2023-08-27T11:28:36.017891+0000","last_became_peered":"2023-08-27T11:28:36.017891+0000","last_unstale":"2023-08-27T11:28:37.004836+0000","last_undegraded":"2023-08-27T11:28:37.004836+0000","last_fullsized":"2023-08-27T11:28:37.004836+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:52.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004475+0000","last_change":"2023-08-27T11:28:36.033043+0000","last_active":"2023-08-27T11:28:37.004475+0000","last_peered":"2023-08-27T11:28:37.004475+0000","last_clean":"2023-08-27T11:28:37.004475+0000","last_became_active":"2023-08-27T11:28:36.032749+0000","last_became_peered":"2023-08-27T11:28:36.032749+0000","last_unstale":"2023-08-27T11:28:37.004475+0000","last_undegraded":"2023-08-27T11:28:37.004475+0000","last_fullsized":"2023-08-27T11:28:37.004475+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:24.927456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356465+0000","last_change":"2023-08-27T11:28:36.036171+0000","last_active":"2023-08-27T11:28:37.356465+0000","last_peered":"2023-08-27T11:28:37.356465+0000","last_clean":"2023-08-27T11:28:37.356465+0000","last_became_active":"2023-08-27T11:28:36.035804+0000","last_became_peered":"2023-08-27T11:28:36.035804+0000","last_unstale":"2023-08-27T11:28:37.356465+0000","last_undegraded":"2023-08-27T11:28:37.356465+0000","last_fullsized":"2023-08-27T11:28:37.356465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:08.180371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227993+0000","last_change":"2023-08-27T11:28:36.028752+0000","last_active":"2023-08-27T11:28:37.227993+0000","last_peered":"2023-08-27T11:28:37.227993+0000","last_clean":"2023-08-27T11:28:37.227993+0000","last_became_active":"2023-08-27T11:28:36.028448+0000","last_became_peered":"2023-08-27T11:28:36.028448+0000","last_unstale":"2023-08-27T11:28:37.227993+0000","last_undegraded":"2023-08-27T11:28:37.227993+0000","last_fullsized":"2023-08-27T11:28:37.227993+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:12.034872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004031+0000","last_change":"2023-08-27T11:28:36.027534+0000","last_active":"2023-08-27T11:28:37.004031+0000","last_peered":"2023-08-27T11:28:37.004031+0000","last_clean":"2023-08-27T11:28:37.004031+0000","last_became_active":"2023-08-27T11:28:36.027208+0000","last_became_peered":"2023-08-27T11:28:36.027208+0000","last_unstale":"2023-08-27T11:28:37.004031+0000","last_undegraded":"2023-08-27T11:28:37.004031+0000","last_fullsized":"2023-08-27T11:28:37.004031+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.092818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003822+0000","last_change":"2023-08-27T11:28:36.029470+0000","last_active":"2023-08-27T11:28:37.003822+0000","last_peered":"2023-08-27T11:28:37.003822+0000","last_clean":"2023-08-27T11:28:37.003822+0000","last_became_active":"2023-08-27T11:28:36.028657+0000","last_became_peered":"2023-08-27T11:28:36.028657+0000","last_unstale":"2023-08-27T11:28:37.003822+0000","last_undegraded":"2023-08-27T11:28:37.003822+0000","last_fullsized":"2023-08-27T11:28:37.003822+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:10.567763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005355+0000","last_change":"2023-08-27T11:28:36.032791+0000","last_active":"2023-08-27T11:28:37.005355+0000","last_peered":"2023-08-27T11:28:37.005355+0000","last_clean":"2023-08-27T11:28:37.005355+0000","last_became_active":"2023-08-27T11:28:36.032496+0000","last_became_peered":"2023-08-27T11:28:36.032496+0000","last_unstale":"2023-08-27T11:28:37.005355+0000","last_undegraded":"2023-08-27T11:28:37.005355+0000","last_fullsized":"2023-08-27T11:28:37.005355+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:43.702058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227649+0000","last_change":"2023-08-27T11:28:36.036286+0000","last_active":"2023-08-27T11:28:37.227649+0000","last_peered":"2023-08-27T11:28:37.227649+0000","last_clean":"2023-08-27T11:28:37.227649+0000","last_became_active":"2023-08-27T11:28:36.036000+0000","last_became_peered":"2023-08-27T11:28:36.036000+0000","last_unstale":"2023-08-27T11:28:37.227649+0000","last_undegraded":"2023-08-27T11:28:37.227649+0000","last_fullsized":"2023-08-27T11:28:37.227649+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:18.555018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005530+0000","last_change":"2023-08-27T11:28:36.034952+0000","last_active":"2023-08-27T11:28:37.005530+0000","last_peered":"2023-08-27T11:28:37.005530+0000","last_clean":"2023-08-27T11:28:37.005530+0000","last_became_active":"2023-08-27T11:28:36.034648+0000","last_became_peered":"2023-08-27T11:28:36.034648+0000","last_unstale":"2023-08-27T11:28:37.005530+0000","last_undegraded":"2023-08-27T11:28:37.005530+0000","last_fullsized":"2023-08-27T11:28:37.005530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:20.001897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"123'4","reported_seq":17,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004996+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:37.004996+0000","last_peered":"2023-08-27T11:28:37.004996+0000","last_clean":"2023-08-27T11:28:37.004996+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:37.004996+0000","last_undegraded":"2023-08-27T11:28:37.004996+0000","last_fullsized":"2023-08-27T11:28:37.004996+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:22.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356311+0000","last_change":"2023-08-27T11:28:36.021627+0000","last_active":"2023-08-27T11:28:37.356311+0000","last_peered":"2023-08-27T11:28:37.356311+0000","last_clean":"2023-08-27T11:28:37.356311+0000","last_became_active":"2023-08-27T11:28:36.021354+0000","last_became_peered":"2023-08-27T11:28:36.021354+0000","last_unstale":"2023-08-27T11:28:37.356311+0000","last_undegraded":"2023-08-27T11:28:37.356311+0000","last_fullsized":"2023-08-27T11:28:37.356311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:38.018967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356650+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:37.356650+0000","last_peered":"2023-08-27T11:28:37.356650+0000","last_clean":"2023-08-27T11:28:37.356650+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:37.356650+0000","last_undegraded":"2023-08-27T11:28:37.356650+0000","last_fullsized":"2023-08-27T11:28:37.356650+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:18.793959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004538+0000","last_change":"2023-08-27T11:28:36.031467+0000","last_active":"2023-08-27T11:28:37.004538+0000","last_peered":"2023-08-27T11:28:37.004538+0000","last_clean":"2023-08-27T11:28:37.004538+0000","last_became_active":"2023-08-27T11:28:36.031196+0000","last_became_peered":"2023-08-27T11:28:36.031196+0000","last_unstale":"2023-08-27T11:28:37.004538+0000","last_undegraded":"2023-08-27T11:28:37.004538+0000","last_fullsized":"2023-08-27T11:28:37.004538+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:09:41.853185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356840+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:37.356840+0000","last_peered":"2023-08-27T11:28:37.356840+0000","last_clean":"2023-08-27T11:28:37.356840+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:37.356840+0000","last_undegraded":"2023-08-27T11:28:37.356840+0000","last_fullsized":"2023-08-27T11:28:37.356840+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:47:02.535920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356429+0000","last_change":"2023-08-27T11:28:36.032795+0000","last_active":"2023-08-27T11:28:37.356429+0000","last_peered":"2023-08-27T11:28:37.356429+0000","last_clean":"2023-08-27T11:28:37.356429+0000","last_became_active":"2023-08-27T11:28:36.032518+0000","last_became_peered":"2023-08-27T11:28:36.032518+0000","last_unstale":"2023-08-27T11:28:37.356429+0000","last_undegraded":"2023-08-27T11:28:37.356429+0000","last_fullsized":"2023-08-27T11:28:37.356429+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:39.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356793+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:37.356793+0000","last_peered":"2023-08-27T11:28:37.356793+0000","last_clean":"2023-08-27T11:28:37.356793+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:37.356793+0000","last_undegraded":"2023-08-27T11:28:37.356793+0000","last_fullsized":"2023-08-27T11:28:37.356793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:45.648964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005636+0000","last_change":"2023-08-27T11:28:36.032681+0000","last_active":"2023-08-27T11:28:37.005636+0000","last_peered":"2023-08-27T11:28:37.005636+0000","last_clean":"2023-08-27T11:28:37.005636+0000","last_became_active":"2023-08-27T11:28:36.032386+0000","last_became_peered":"2023-08-27T11:28:36.032386+0000","last_unstale":"2023-08-27T11:28:37.005636+0000","last_undegraded":"2023-08-27T11:28:37.005636+0000","last_fullsized":"2023-08-27T11:28:37.005636+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:53.111944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005574+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:37.005574+0000","last_peered":"2023-08-27T11:28:37.005574+0000","last_clean":"2023-08-27T11:28:37.005574+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:37.005574+0000","last_undegraded":"2023-08-27T11:28:37.005574+0000","last_fullsized":"2023-08-27T11:28:37.005574+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:30:30.932090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005867+0000","last_change":"2023-08-27T11:28:36.025498+0000","last_active":"2023-08-27T11:28:37.005867+0000","last_peered":"2023-08-27T11:28:37.005867+0000","last_clean":"2023-08-27T11:28:37.005867+0000","last_became_active":"2023-08-27T11:28:36.024956+0000","last_became_peered":"2023-08-27T11:28:36.024956+0000","last_unstale":"2023-08-27T11:28:37.005867+0000","last_undegraded":"2023-08-27T11:28:37.005867+0000","last_fullsized":"2023-08-27T11:28:37.005867+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:01:25.782882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356256+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:37.356256+0000","last_peered":"2023-08-27T11:28:37.356256+0000","last_clean":"2023-08-27T11:28:37.356256+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:37.356256+0000","last_undegraded":"2023-08-27T11:28:37.356256+0000","last_fullsized":"2023-08-27T11:28:37.356256+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:09.559307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356383+0000","last_change":"2023-08-27T11:28:36.034683+0000","last_active":"2023-08-27T11:28:37.356383+0000","last_peered":"2023-08-27T11:28:37.356383+0000","last_clean":"2023-08-27T11:28:37.356383+0000","last_became_active":"2023-08-27T11:28:36.034353+0000","last_became_peered":"2023-08-27T11:28:36.034353+0000","last_unstale":"2023-08-27T11:28:37.356383+0000","last_undegraded":"2023-08-27T11:28:37.356383+0000","last_fullsized":"2023-08-27T11:28:37.356383+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.092818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356047+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:37.356047+0000","last_peered":"2023-08-27T11:28:37.356047+0000","last_clean":"2023-08-27T11:28:37.356047+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:37.356047+0000","last_undegraded":"2023-08-27T11:28:37.356047+0000","last_fullsized":"2023-08-27T11:28:37.356047+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:42.571486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356591+0000","last_change":"2023-08-27T11:28:36.035634+0000","last_active":"2023-08-27T11:28:37.356591+0000","last_peered":"2023-08-27T11:28:37.356591+0000","last_clean":"2023-08-27T11:28:37.356591+0000","last_became_active":"2023-08-27T11:28:36.035256+0000","last_became_peered":"2023-08-27T11:28:36.035256+0000","last_unstale":"2023-08-27T11:28:37.356591+0000","last_undegraded":"2023-08-27T11:28:37.356591+0000","last_fullsized":"2023-08-27T11:28:37.356591+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:51:53.072825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003557+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:37.003557+0000","last_peered":"2023-08-27T11:28:37.003557+0000","last_clean":"2023-08-27T11:28:37.003557+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:37.003557+0000","last_undegraded":"2023-08-27T11:28:37.003557+0000","last_fullsized":"2023-08-27T11:28:37.003557+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:00.841333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003735+0000","last_change":"2023-08-27T11:28:36.013300+0000","last_active":"2023-08-27T11:28:37.003735+0000","last_peered":"2023-08-27T11:28:37.003735+0000","last_clean":"2023-08-27T11:28:37.003735+0000","last_became_active":"2023-08-27T11:28:36.012993+0000","last_became_peered":"2023-08-27T11:28:36.012993+0000","last_unstale":"2023-08-27T11:28:37.003735+0000","last_undegraded":"2023-08-27T11:28:37.003735+0000","last_fullsized":"2023-08-27T11:28:37.003735+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:40.136336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005217+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:37.005217+0000","last_peered":"2023-08-27T11:28:37.005217+0000","last_clean":"2023-08-27T11:28:37.005217+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:37.005217+0000","last_undegraded":"2023-08-27T11:28:37.005217+0000","last_fullsized":"2023-08-27T11:28:37.005217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:43.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356401+0000","last_change":"2023-08-27T11:28:36.037732+0000","last_active":"2023-08-27T11:28:37.356401+0000","last_peered":"2023-08-27T11:28:37.356401+0000","last_clean":"2023-08-27T11:28:37.356401+0000","last_became_active":"2023-08-27T11:28:36.031618+0000","last_became_peered":"2023-08-27T11:28:36.031618+0000","last_unstale":"2023-08-27T11:28:37.356401+0000","last_undegraded":"2023-08-27T11:28:37.356401+0000","last_fullsized":"2023-08-27T11:28:37.356401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:51.453087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004608+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:37.004608+0000","last_peered":"2023-08-27T11:28:37.004608+0000","last_clean":"2023-08-27T11:28:37.004608+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:37.004608+0000","last_undegraded":"2023-08-27T11:28:37.004608+0000","last_fullsized":"2023-08-27T11:28:37.004608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:35.181431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356337+0000","last_change":"2023-08-27T11:28:36.035453+0000","last_active":"2023-08-27T11:28:37.356337+0000","last_peered":"2023-08-27T11:28:37.356337+0000","last_clean":"2023-08-27T11:28:37.356337+0000","last_became_active":"2023-08-27T11:28:36.035166+0000","last_became_peered":"2023-08-27T11:28:36.035166+0000","last_unstale":"2023-08-27T11:28:37.356337+0000","last_undegraded":"2023-08-27T11:28:37.356337+0000","last_fullsized":"2023-08-27T11:28:37.356337+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:08:41.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356211+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:37.356211+0000","last_peered":"2023-08-27T11:28:37.356211+0000","last_clean":"2023-08-27T11:28:37.356211+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:37.356211+0000","last_undegraded":"2023-08-27T11:28:37.356211+0000","last_fullsized":"2023-08-27T11:28:37.356211+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:56.749429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227779+0000","last_change":"2023-08-27T11:28:36.031284+0000","last_active":"2023-08-27T11:28:37.227779+0000","last_peered":"2023-08-27T11:28:37.227779+0000","last_clean":"2023-08-27T11:28:37.227779+0000","last_became_active":"2023-08-27T11:28:36.031015+0000","last_became_peered":"2023-08-27T11:28:36.031015+0000","last_unstale":"2023-08-27T11:28:37.227779+0000","last_undegraded":"2023-08-27T11:28:37.227779+0000","last_fullsized":"2023-08-27T11:28:37.227779+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:58.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356809+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:37.356809+0000","last_peered":"2023-08-27T11:28:37.356809+0000","last_clean":"2023-08-27T11:28:37.356809+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:37.356809+0000","last_undegraded":"2023-08-27T11:28:37.356809+0000","last_fullsized":"2023-08-27T11:28:37.356809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:26.883140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356984+0000","last_change":"2023-08-27T11:28:36.003840+0000","last_active":"2023-08-27T11:28:37.356984+0000","last_peered":"2023-08-27T11:28:37.356984+0000","last_clean":"2023-08-27T11:28:37.356984+0000","last_became_active":"2023-08-27T11:28:36.003484+0000","last_became_peered":"2023-08-27T11:28:36.003484+0000","last_unstale":"2023-08-27T11:28:37.356984+0000","last_undegraded":"2023-08-27T11:28:37.356984+0000","last_fullsized":"2023-08-27T11:28:37.356984+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:36.189887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005670+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:37.005670+0000","last_peered":"2023-08-27T11:28:37.005670+0000","last_clean":"2023-08-27T11:28:37.005670+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:37.005670+0000","last_undegraded":"2023-08-27T11:28:37.005670+0000","last_fullsized":"2023-08-27T11:28:37.005670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:27.589298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356830+0000","last_change":"2023-08-27T11:28:36.029240+0000","last_active":"2023-08-27T11:28:37.356830+0000","last_peered":"2023-08-27T11:28:37.356830+0000","last_clean":"2023-08-27T11:28:37.356830+0000","last_became_active":"2023-08-27T11:28:36.028966+0000","last_became_peered":"2023-08-27T11:28:36.028966+0000","last_unstale":"2023-08-27T11:28:37.356830+0000","last_undegraded":"2023-08-27T11:28:37.356830+0000","last_fullsized":"2023-08-27T11:28:37.356830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:39.524586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357060+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:37.357060+0000","last_peered":"2023-08-27T11:28:37.357060+0000","last_clean":"2023-08-27T11:28:37.357060+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:37.357060+0000","last_undegraded":"2023-08-27T11:28:37.357060+0000","last_fullsized":"2023-08-27T11:28:37.357060+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:47.308263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356528+0000","last_change":"2023-08-27T11:28:36.013853+0000","last_active":"2023-08-27T11:28:37.356528+0000","last_peered":"2023-08-27T11:28:37.356528+0000","last_clean":"2023-08-27T11:28:37.356528+0000","last_became_active":"2023-08-27T11:28:36.013326+0000","last_became_peered":"2023-08-27T11:28:36.013326+0000","last_unstale":"2023-08-27T11:28:37.356528+0000","last_undegraded":"2023-08-27T11:28:37.356528+0000","last_fullsized":"2023-08-27T11:28:37.356528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:28.695622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356513+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:37.356513+0000","last_peered":"2023-08-27T11:28:37.356513+0000","last_clean":"2023-08-27T11:28:37.356513+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:37.356513+0000","last_undegraded":"2023-08-27T11:28:37.356513+0000","last_fullsized":"2023-08-27T11:28:37.356513+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:52:44.734304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004860+0000","last_change":"2023-08-27T11:28:36.028818+0000","last_active":"2023-08-27T11:28:37.004860+0000","last_peered":"2023-08-27T11:28:37.004860+0000","last_clean":"2023-08-27T11:28:37.004860+0000","last_became_active":"2023-08-27T11:28:36.028244+0000","last_became_peered":"2023-08-27T11:28:36.028244+0000","last_unstale":"2023-08-27T11:28:37.004860+0000","last_undegraded":"2023-08-27T11:28:37.004860+0000","last_fullsized":"2023-08-27T11:28:37.004860+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:50.691012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355675+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:37.355675+0000","last_peered":"2023-08-27T11:28:37.355675+0000","last_clean":"2023-08-27T11:28:37.355675+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:37.355675+0000","last_undegraded":"2023-08-27T11:28:37.355675+0000","last_fullsized":"2023-08-27T11:28:37.355675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:11.851792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355734+0000","last_change":"2023-08-27T11:28:36.032846+0000","last_active":"2023-08-27T11:28:37.355734+0000","last_peered":"2023-08-27T11:28:37.355734+0000","last_clean":"2023-08-27T11:28:37.355734+0000","last_became_active":"2023-08-27T11:28:36.032564+0000","last_became_peered":"2023-08-27T11:28:36.032564+0000","last_unstale":"2023-08-27T11:28:37.355734+0000","last_undegraded":"2023-08-27T11:28:37.355734+0000","last_fullsized":"2023-08-27T11:28:37.355734+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:28.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356816+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:37.356816+0000","last_peered":"2023-08-27T11:28:37.356816+0000","last_clean":"2023-08-27T11:28:37.356816+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:37.356816+0000","last_undegraded":"2023-08-27T11:28:37.356816+0000","last_fullsized":"2023-08-27T11:28:37.356816+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:43:42.664864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003491+0000","last_change":"2023-08-27T11:28:36.025457+0000","last_active":"2023-08-27T11:28:37.003491+0000","last_peered":"2023-08-27T11:28:37.003491+0000","last_clean":"2023-08-27T11:28:37.003491+0000","last_became_active":"2023-08-27T11:28:36.025184+0000","last_became_peered":"2023-08-27T11:28:36.025184+0000","last_unstale":"2023-08-27T11:28:37.003491+0000","last_undegraded":"2023-08-27T11:28:37.003491+0000","last_fullsized":"2023-08-27T11:28:37.003491+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:28.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"124'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005924+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:37.005924+0000","last_peered":"2023-08-27T11:28:37.005924+0000","last_clean":"2023-08-27T11:28:37.005924+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:37.005924+0000","last_undegraded":"2023-08-27T11:28:37.005924+0000","last_fullsized":"2023-08-27T11:28:37.005924+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:30.207482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356700+0000","last_change":"2023-08-27T11:28:36.031143+0000","last_active":"2023-08-27T11:28:37.356700+0000","last_peered":"2023-08-27T11:28:37.356700+0000","last_clean":"2023-08-27T11:28:37.356700+0000","last_became_active":"2023-08-27T11:28:36.030840+0000","last_became_peered":"2023-08-27T11:28:36.030840+0000","last_unstale":"2023-08-27T11:28:37.356700+0000","last_undegraded":"2023-08-27T11:28:37.356700+0000","last_fullsized":"2023-08-27T11:28:37.356700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:24.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005914+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:37.005914+0000","last_peered":"2023-08-27T11:28:37.005914+0000","last_clean":"2023-08-27T11:28:37.005914+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:37.005914+0000","last_undegraded":"2023-08-27T11:28:37.005914+0000","last_fullsized":"2023-08-27T11:28:37.005914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227811+0000","last_change":"2023-08-27T11:28:36.027765+0000","last_active":"2023-08-27T11:28:37.227811+0000","last_peered":"2023-08-27T11:28:37.227811+0000","last_clean":"2023-08-27T11:28:37.227811+0000","last_became_active":"2023-08-27T11:28:36.027374+0000","last_became_peered":"2023-08-27T11:28:36.027374+0000","last_unstale":"2023-08-27T11:28:37.227811+0000","last_undegraded":"2023-08-27T11:28:37.227811+0000","last_fullsized":"2023-08-27T11:28:37.227811+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:44.920689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355800+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:37.355800+0000","last_peered":"2023-08-27T11:28:37.355800+0000","last_clean":"2023-08-27T11:28:37.355800+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:37.355800+0000","last_undegraded":"2023-08-27T11:28:37.355800+0000","last_fullsized":"2023-08-27T11:28:37.355800+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:49.682556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355670+0000","last_change":"2023-08-27T11:28:36.027113+0000","last_active":"2023-08-27T11:28:37.355670+0000","last_peered":"2023-08-27T11:28:37.355670+0000","last_clean":"2023-08-27T11:28:37.355670+0000","last_became_active":"2023-08-27T11:28:36.026825+0000","last_became_peered":"2023-08-27T11:28:36.026825+0000","last_unstale":"2023-08-27T11:28:37.355670+0000","last_undegraded":"2023-08-27T11:28:37.355670+0000","last_fullsized":"2023-08-27T11:28:37.355670+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:09.415460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004794+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:37.004794+0000","last_peered":"2023-08-27T11:28:37.004794+0000","last_clean":"2023-08-27T11:28:37.004794+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:37.004794+0000","last_undegraded":"2023-08-27T11:28:37.004794+0000","last_fullsized":"2023-08-27T11:28:37.004794+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:46.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356077+0000","last_change":"2023-08-27T11:28:36.026876+0000","last_active":"2023-08-27T11:28:37.356077+0000","last_peered":"2023-08-27T11:28:37.356077+0000","last_clean":"2023-08-27T11:28:37.356077+0000","last_became_active":"2023-08-27T11:28:36.026348+0000","last_became_peered":"2023-08-27T11:28:36.026348+0000","last_unstale":"2023-08-27T11:28:37.356077+0000","last_undegraded":"2023-08-27T11:28:37.356077+0000","last_fullsized":"2023-08-27T11:28:37.356077+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:13.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356781+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:37.356781+0000","last_peered":"2023-08-27T11:28:37.356781+0000","last_clean":"2023-08-27T11:28:37.356781+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:37.356781+0000","last_undegraded":"2023-08-27T11:28:37.356781+0000","last_fullsized":"2023-08-27T11:28:37.356781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:33.703657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356806+0000","last_change":"2023-08-27T11:28:36.035026+0000","last_active":"2023-08-27T11:28:37.356806+0000","last_peered":"2023-08-27T11:28:37.356806+0000","last_clean":"2023-08-27T11:28:37.356806+0000","last_became_active":"2023-08-27T11:28:36.034706+0000","last_became_peered":"2023-08-27T11:28:36.034706+0000","last_unstale":"2023-08-27T11:28:37.356806+0000","last_undegraded":"2023-08-27T11:28:37.356806+0000","last_fullsized":"2023-08-27T11:28:37.356806+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:14.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356248+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:37.356248+0000","last_peered":"2023-08-27T11:28:37.356248+0000","last_clean":"2023-08-27T11:28:37.356248+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:37.356248+0000","last_undegraded":"2023-08-27T11:28:37.356248+0000","last_fullsized":"2023-08-27T11:28:37.356248+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:37:43.667249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356662+0000","last_change":"2023-08-27T11:28:36.032354+0000","last_active":"2023-08-27T11:28:37.356662+0000","last_peered":"2023-08-27T11:28:37.356662+0000","last_clean":"2023-08-27T11:28:37.356662+0000","last_became_active":"2023-08-27T11:28:36.031936+0000","last_became_peered":"2023-08-27T11:28:36.031936+0000","last_unstale":"2023-08-27T11:28:37.356662+0000","last_undegraded":"2023-08-27T11:28:37.356662+0000","last_fullsized":"2023-08-27T11:28:37.356662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:06:02.311365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356090+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:37.356090+0000","last_peered":"2023-08-27T11:28:37.356090+0000","last_clean":"2023-08-27T11:28:37.356090+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:37.356090+0000","last_undegraded":"2023-08-27T11:28:37.356090+0000","last_fullsized":"2023-08-27T11:28:37.356090+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:00.841333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003888+0000","last_change":"2023-08-27T11:28:36.019620+0000","last_active":"2023-08-27T11:28:37.003888+0000","last_peered":"2023-08-27T11:28:37.003888+0000","last_clean":"2023-08-27T11:28:37.003888+0000","last_became_active":"2023-08-27T11:28:36.019344+0000","last_became_peered":"2023-08-27T11:28:36.019344+0000","last_unstale":"2023-08-27T11:28:37.003888+0000","last_undegraded":"2023-08-27T11:28:37.003888+0000","last_fullsized":"2023-08-27T11:28:37.003888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:26.188725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"123'3","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356866+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:37.356866+0000","last_peered":"2023-08-27T11:28:37.356866+0000","last_clean":"2023-08-27T11:28:37.356866+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:37.356866+0000","last_undegraded":"2023-08-27T11:28:37.356866+0000","last_fullsized":"2023-08-27T11:28:37.356866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:37.700816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":209,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005295+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:37.005295+0000","last_peered":"2023-08-27T11:28:37.005295+0000","last_clean":"2023-08-27T11:28:37.005295+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:37.005295+0000","last_undegraded":"2023-08-27T11:28:37.005295+0000","last_fullsized":"2023-08-27T11:28:37.005295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:53.297926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004200+0000","last_change":"2023-08-27T11:28:36.027190+0000","last_active":"2023-08-27T11:28:37.004200+0000","last_peered":"2023-08-27T11:28:37.004200+0000","last_clean":"2023-08-27T11:28:37.004200+0000","last_became_active":"2023-08-27T11:28:36.026781+0000","last_became_peered":"2023-08-27T11:28:36.026781+0000","last_unstale":"2023-08-27T11:28:37.004200+0000","last_undegraded":"2023-08-27T11:28:37.004200+0000","last_fullsized":"2023-08-27T11:28:37.004200+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:28.695622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"123'6","reported_seq":19,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356518+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:37.356518+0000","last_peered":"2023-08-27T11:28:37.356518+0000","last_clean":"2023-08-27T11:28:37.356518+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:37.356518+0000","last_undegraded":"2023-08-27T11:28:37.356518+0000","last_fullsized":"2023-08-27T11:28:37.356518+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:13:50.550704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":209,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004616+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:37.004616+0000","last_peered":"2023-08-27T11:28:37.004616+0000","last_clean":"2023-08-27T11:28:37.004616+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:37.004616+0000","last_undegraded":"2023-08-27T11:28:37.004616+0000","last_fullsized":"2023-08-27T11:28:37.004616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:30:29.304654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227887+0000","last_change":"2023-08-27T11:28:36.023266+0000","last_active":"2023-08-27T11:28:37.227887+0000","last_peered":"2023-08-27T11:28:37.227887+0000","last_clean":"2023-08-27T11:28:37.227887+0000","last_became_active":"2023-08-27T11:28:36.022928+0000","last_became_peered":"2023-08-27T11:28:36.022928+0000","last_unstale":"2023-08-27T11:28:37.227887+0000","last_undegraded":"2023-08-27T11:28:37.227887+0000","last_fullsized":"2023-08-27T11:28:37.227887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:18:20.304393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357204+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:37.357204+0000","last_peered":"2023-08-27T11:28:37.357204+0000","last_clean":"2023-08-27T11:28:37.357204+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:37.357204+0000","last_undegraded":"2023-08-27T11:28:37.357204+0000","last_fullsized":"2023-08-27T11:28:37.357204+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:49:57.704411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":219,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004720+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:37.004720+0000","last_peered":"2023-08-27T11:28:37.004720+0000","last_clean":"2023-08-27T11:28:37.004720+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:37.004720+0000","last_undegraded":"2023-08-27T11:28:37.004720+0000","last_fullsized":"2023-08-27T11:28:37.004720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:30:46.094518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004418+0000","last_change":"2023-08-27T11:28:36.010061+0000","last_active":"2023-08-27T11:28:37.004418+0000","last_peered":"2023-08-27T11:28:37.004418+0000","last_clean":"2023-08-27T11:28:37.004418+0000","last_became_active":"2023-08-27T11:28:36.009747+0000","last_became_peered":"2023-08-27T11:28:36.009747+0000","last_unstale":"2023-08-27T11:28:37.004418+0000","last_undegraded":"2023-08-27T11:28:37.004418+0000","last_fullsized":"2023-08-27T11:28:37.004418+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:27.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356682+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:37.356682+0000","last_peered":"2023-08-27T11:28:37.356682+0000","last_clean":"2023-08-27T11:28:37.356682+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:37.356682+0000","last_undegraded":"2023-08-27T11:28:37.356682+0000","last_fullsized":"2023-08-27T11:28:37.356682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:18.559193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":196,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356633+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:37.356633+0000","last_peered":"2023-08-27T11:28:37.356633+0000","last_clean":"2023-08-27T11:28:37.356633+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:37.356633+0000","last_undegraded":"2023-08-27T11:28:37.356633+0000","last_fullsized":"2023-08-27T11:28:37.356633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:20.167598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356131+0000","last_change":"2023-08-27T11:28:36.027147+0000","last_active":"2023-08-27T11:28:37.356131+0000","last_peered":"2023-08-27T11:28:37.356131+0000","last_clean":"2023-08-27T11:28:37.356131+0000","last_became_active":"2023-08-27T11:28:36.026783+0000","last_became_peered":"2023-08-27T11:28:36.026783+0000","last_unstale":"2023-08-27T11:28:37.356131+0000","last_undegraded":"2023-08-27T11:28:37.356131+0000","last_fullsized":"2023-08-27T11:28:37.356131+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:12:41.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"123'8","reported_seq":21,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355604+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:37.355604+0000","last_peered":"2023-08-27T11:28:37.355604+0000","last_clean":"2023-08-27T11:28:37.355604+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:37.355604+0000","last_undegraded":"2023-08-27T11:28:37.355604+0000","last_fullsized":"2023-08-27T11:28:37.355604+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:46.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":195,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356862+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:37.356862+0000","last_peered":"2023-08-27T11:28:37.356862+0000","last_clean":"2023-08-27T11:28:37.356862+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:37.356862+0000","last_undegraded":"2023-08-27T11:28:37.356862+0000","last_fullsized":"2023-08-27T11:28:37.356862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:00:21.078296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356734+0000","last_change":"2023-08-27T11:28:36.038226+0000","last_active":"2023-08-27T11:28:37.356734+0000","last_peered":"2023-08-27T11:28:37.356734+0000","last_clean":"2023-08-27T11:28:37.356734+0000","last_became_active":"2023-08-27T11:28:36.037748+0000","last_became_peered":"2023-08-27T11:28:36.037748+0000","last_unstale":"2023-08-27T11:28:37.356734+0000","last_undegraded":"2023-08-27T11:28:37.356734+0000","last_fullsized":"2023-08-27T11:28:37.356734+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:16.394591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003625+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:37.003625+0000","last_peered":"2023-08-27T11:28:37.003625+0000","last_clean":"2023-08-27T11:28:37.003625+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:37.003625+0000","last_undegraded":"2023-08-27T11:28:37.003625+0000","last_fullsized":"2023-08-27T11:28:37.003625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:12:40.162456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":344,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356332+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:37.356332+0000","last_peered":"2023-08-27T11:28:37.356332+0000","last_clean":"2023-08-27T11:28:37.356332+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:37.356332+0000","last_undegraded":"2023-08-27T11:28:37.356332+0000","last_fullsized":"2023-08-27T11:28:37.356332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:13.742685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":201,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356069+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:37.356069+0000","last_peered":"2023-08-27T11:28:37.356069+0000","last_clean":"2023-08-27T11:28:37.356069+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:37.356069+0000","last_undegraded":"2023-08-27T11:28:37.356069+0000","last_fullsized":"2023-08-27T11:28:37.356069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:29.749059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355911+0000","last_change":"2023-08-27T11:28:36.031797+0000","last_active":"2023-08-27T11:28:37.355911+0000","last_peered":"2023-08-27T11:28:37.355911+0000","last_clean":"2023-08-27T11:28:37.355911+0000","last_became_active":"2023-08-27T11:28:36.031421+0000","last_became_peered":"2023-08-27T11:28:36.031421+0000","last_unstale":"2023-08-27T11:28:37.355911+0000","last_undegraded":"2023-08-27T11:28:37.355911+0000","last_fullsized":"2023-08-27T11:28:37.355911+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:20.118168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356876+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:37.356876+0000","last_peered":"2023-08-27T11:28:37.356876+0000","last_clean":"2023-08-27T11:28:37.356876+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:37.356876+0000","last_undegraded":"2023-08-27T11:28:37.356876+0000","last_fullsized":"2023-08-27T11:28:37.356876+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:08.653781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":201,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357110+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:37.357110+0000","last_peered":"2023-08-27T11:28:37.357110+0000","last_clean":"2023-08-27T11:28:37.357110+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:37.357110+0000","last_undegraded":"2023-08-27T11:28:37.357110+0000","last_fullsized":"2023-08-27T11:28:37.357110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:30:29.304654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356535+0000","last_change":"2023-08-27T11:28:36.013449+0000","last_active":"2023-08-27T11:28:37.356535+0000","last_peered":"2023-08-27T11:28:37.356535+0000","last_clean":"2023-08-27T11:28:37.356535+0000","last_became_active":"2023-08-27T11:28:36.013153+0000","last_became_peered":"2023-08-27T11:28:36.013153+0000","last_unstale":"2023-08-27T11:28:37.356535+0000","last_undegraded":"2023-08-27T11:28:37.356535+0000","last_fullsized":"2023-08-27T11:28:37.356535+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:58.239625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004973+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:37.004973+0000","last_peered":"2023-08-27T11:28:37.004973+0000","last_clean":"2023-08-27T11:28:37.004973+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:37.004973+0000","last_undegraded":"2023-08-27T11:28:37.004973+0000","last_fullsized":"2023-08-27T11:28:37.004973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:08.407004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":217,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.006016+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:37.006016+0000","last_peered":"2023-08-27T11:28:37.006016+0000","last_clean":"2023-08-27T11:28:37.006016+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:37.006016+0000","last_undegraded":"2023-08-27T11:28:37.006016+0000","last_fullsized":"2023-08-27T11:28:37.006016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:36.397142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2158592,"data_stored":1320349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47899999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28544,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343296,"statfs":{"total":96636764160,"available":96607535104,"internally_reserved":0,"allocated":1552384,"data_stored":727965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71299999999999997,"15min":0.877},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.01,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":3.472,"15min":3.472},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.94599999999999995},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.98799999999999999,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.753,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.95299999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74199999999999999,"15min":0.84599999999999997},"min":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.76000000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.101,"5min":1.234,"15min":1.234},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76300000000000001,"15min":0.80200000000000005},"min":{"1min":0.50900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.071,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":1.135,"15min":1.135},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82499999999999996,"15min":0.84699999999999998},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.88100000000000001},"min":{"1min":0.62,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.111,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0309999999999999,"5min":1.27,"15min":1.27},"last":0.82399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1318717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":2.734,"15min":2.734},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68700000000000006,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61599999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.93100000000000005,"5min":3.101,"15min":3.101},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1240000000000001,"5min":3.359,"15min":3.359},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.96999999999999997,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.036,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.038,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28536,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343304,"statfs":{"total":96636764160,"available":96607543296,"internally_reserved":0,"allocated":1552384,"data_stored":727349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60499999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.371}]},{"osd":3,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.355,"15min":1.355},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94299999999999995,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.96599999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.74299999999999999},"min":{"1min":0.621,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":1.123,"15min":1.123},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.032,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90100000000000002,"5min":1.329,"15min":1.329},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94799999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0469999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96899999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":1.022}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1556480,"data_stored":728895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.374},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.80400000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":728975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46000000000000002,"15min":0.59899999999999998},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.52000000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83799999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":1.1459999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70299999999999996,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.628,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74099999999999999,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.56699999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77300000000000002,"15min":0.90000000000000002},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.022,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96399999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.429,"15min":1.429},"last":0.753},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.96999999999999997},"min":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.95399999999999996},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80200000000000005,"15min":0.94399999999999995},"min":{"1min":0.622,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90700000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.96099999999999997},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":5,"15min":5},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1548288,"data_stored":728279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1548288,"data_stored":727315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.876},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.755}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:45.607 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.817+0000 7ff654bff700 1 Processor -- start 2023-08-27T11:28:45.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.818+0000 7ff654bff700 1 -- start start 2023-08-27T11:28:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff654bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff650151a90 0x7ff6500c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff654bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65006c4e0 con 0x7ff6500c4a90 2023-08-27T11:28:45.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff654bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff650155370 con 0x7ff6500c4630 2023-08-27T11:28:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff654bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff650151e70 con 0x7ff650151a90 2023-08-27T11:28:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64e59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff650151a90 0x7ff6500c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64ed9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff6500c4a90 0x7ff65006b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47378/0 (socket says 172.21.15.43:47378) 2023-08-27T11:28:45.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64ed9d700 1 -- 172.21.15.43:0/2905474028 learned_addr learned my addr 172.21.15.43:0/2905474028 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:45.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64e59c700 1 -- 172.21.15.43:0/2905474028 >> v1:172.21.15.57:6789/0 conn(0x7ff6500c4630 legacy=0x7ff65006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:45.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64e59c700 1 -- 172.21.15.43:0/2905474028 >> v1:172.21.15.43:6789/0 conn(0x7ff6500c4a90 legacy=0x7ff65006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:45.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.819+0000 7ff64e59c700 1 -- 172.21.15.43:0/2905474028 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650154480 con 0x7ff650151a90 2023-08-27T11:28:45.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff64e59c700 1 --2- 172.21.15.43:0/2905474028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff650151a90 0x7ff6500c7bb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff640009840 tx=0x7ff640009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829673b63cb5e61a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:45.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff64dd9b700 1 -- 172.21.15.43:0/2905474028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640004230 con 0x7ff650151a90 2023-08-27T11:28:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff64dd9b700 1 -- 172.21.15.43:0/2905474028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640004390 con 0x7ff650151a90 2023-08-27T11:28:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff64dd9b700 1 -- 172.21.15.43:0/2905474028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400036a0 con 0x7ff650151a90 2023-08-27T11:28:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff654bff700 1 -- 172.21.15.43:0/2905474028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff650151a90 msgr2=0x7ff6500c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.820+0000 7ff654bff700 1 --2- 172.21.15.43:0/2905474028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff650151a90 0x7ff6500c7bb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ff640009840 tx=0x7ff640009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:45.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.821+0000 7ff654bff700 1 -- 172.21.15.43:0/2905474028 shutdown_connections 2023-08-27T11:28:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.821+0000 7ff654bff700 1 --2- 172.21.15.43:0/2905474028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff650151a90 0x7ff6500c7bb0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.821+0000 7ff654bff700 1 -- 172.21.15.43:0/2905474028 >> 172.21.15.43:0/2905474028 conn(0x7ff6500ab820 msgr2=0x7ff6500abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.821+0000 7ff654bff700 1 -- 172.21.15.43:0/2905474028 shutdown_connections 2023-08-27T11:28:45.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.821+0000 7ff654bff700 1 -- 172.21.15.43:0/2905474028 wait complete. 2023-08-27T11:28:45.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.822+0000 7ff654bff700 1 Processor -- start 2023-08-27T11:28:45.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.822+0000 7ff654bff700 1 -- start start 2023-08-27T11:28:45.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:45.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6500c4a90 0x7ff650152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:45.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff650151a90 0x7ff6500bbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501ea800 con 0x7ff6500c4630 2023-08-27T11:28:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501ecee0 con 0x7ff6500c4a90 2023-08-27T11:28:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff654bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65014fb70 con 0x7ff650151a90 2023-08-27T11:28:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:45.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36640/0 (socket says 172.21.15.43:36640) 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.823+0000 7ff64e59c700 1 -- 172.21.15.43:0/2220110921 learned_addr learned my addr 172.21.15.43:0/2220110921 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64ed9d700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff650151a90 0x7ff6500bbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff647fff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6500c4a90 0x7ff650152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 -- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff650151a90 msgr2=0x7ff6500bbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff650151a90 0x7ff6500bbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:45.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 -- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6500c4a90 msgr2=0x7ff650152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6500c4a90 0x7ff650152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 -- 172.21.15.43:0/2220110921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400094a0 con 0x7ff6500c4630 2023-08-27T11:28:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff64e59c700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ff6400090b0 tx=0x7ff6400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640011630 con 0x7ff6500c4630 2023-08-27T11:28:45.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640011790 con 0x7ff6500c4630 2023-08-27T11:28:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640011b40 con 0x7ff6500c4630 2023-08-27T11:28:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.824+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65014fe50 con 0x7ff6500c4630 2023-08-27T11:28:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.825+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff650150410 con 0x7ff6500c4630 2023-08-27T11:28:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.826+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65004ee70 con 0x7ff6500c4630 2023-08-27T11:28:45.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.826+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff640011ca0 con 0x7ff6500c4630 2023-08-27T11:28:45.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.827+0000 7ff646ffd700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 0x7ff63006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.827+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff640089ee0 con 0x7ff6500c4630 2023-08-27T11:28:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.827+0000 7ff647fff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 0x7ff63006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.828+0000 7ff647fff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 0x7ff63006c5a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff638004f30 tx=0x7ff638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:45.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:45.832+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff6400555c0 con 0x7ff6500c4630 2023-08-27T11:28:46.038 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.037+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff650154a40 con 0x7ff63006a0e0 2023-08-27T11:28:46.049 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.048+0000 7ff646ffd700 1 -- 172.21.15.43:0/2220110921 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311861 (secure 0 0 0) 0x7ff638015430 con 0x7ff63006a0e0 2023-08-27T11:28:46.056 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.052+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 msgr2=0x7ff63006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 0x7ff63006c5a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff638004f30 tx=0x7ff638009040 comp rx=0 tx=0).stop 2023-08-27T11:28:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 msgr2=0x7ff6501ea2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ff6400090b0 tx=0x7ff6400047c0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 shutdown_connections 2023-08-27T11:28:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff63006a0e0 0x7ff63006c5a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff650151a90 0x7ff6500bbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6500c4630 0x7ff6501ea2c0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 --2- 172.21.15.43:0/2220110921 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6500c4a90 0x7ff650152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 >> 172.21.15.43:0/2220110921 conn(0x7ff6500ab820 msgr2=0x7ff6500c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 shutdown_connections 2023-08-27T11:28:46.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.053+0000 7ff654bff700 1 -- 172.21.15.43:0/2220110921 wait complete. 2023-08-27T11:28:46.061 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:46.073 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2023-08-27T11:28:44.386635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":201,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241976,"kb_used_data":13304,"kb_used_omap":13,"kb_used_meta":228530,"kb_avail":754732744,"statfs":{"total":773094113280,"available":772846329856,"internally_reserved":0,"allocated":13623296,"data_stored":7007844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":234014808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.393102"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356594+0000","last_change":"2023-08-27T11:28:36.025295+0000","last_active":"2023-08-27T11:28:37.356594+0000","last_peered":"2023-08-27T11:28:37.356594+0000","last_clean":"2023-08-27T11:28:37.356594+0000","last_became_active":"2023-08-27T11:28:36.024913+0000","last_became_peered":"2023-08-27T11:28:36.024913+0000","last_unstale":"2023-08-27T11:28:37.356594+0000","last_undegraded":"2023-08-27T11:28:37.356594+0000","last_fullsized":"2023-08-27T11:28:37.356594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:50.868614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004981+0000","last_change":"2023-08-27T11:28:36.028793+0000","last_active":"2023-08-27T11:28:37.004981+0000","last_peered":"2023-08-27T11:28:37.004981+0000","last_clean":"2023-08-27T11:28:37.004981+0000","last_became_active":"2023-08-27T11:28:36.028457+0000","last_became_peered":"2023-08-27T11:28:36.028457+0000","last_unstale":"2023-08-27T11:28:37.004981+0000","last_undegraded":"2023-08-27T11:28:37.004981+0000","last_fullsized":"2023-08-27T11:28:37.004981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:00.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004265+0000","last_change":"2023-08-27T11:28:36.014516+0000","last_active":"2023-08-27T11:28:37.004265+0000","last_peered":"2023-08-27T11:28:37.004265+0000","last_clean":"2023-08-27T11:28:37.004265+0000","last_became_active":"2023-08-27T11:28:36.013518+0000","last_became_peered":"2023-08-27T11:28:36.013518+0000","last_unstale":"2023-08-27T11:28:37.004265+0000","last_undegraded":"2023-08-27T11:28:37.004265+0000","last_fullsized":"2023-08-27T11:28:37.004265+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:19.802416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004512+0000","last_change":"2023-08-27T11:28:36.026307+0000","last_active":"2023-08-27T11:28:37.004512+0000","last_peered":"2023-08-27T11:28:37.004512+0000","last_clean":"2023-08-27T11:28:37.004512+0000","last_became_active":"2023-08-27T11:28:36.026010+0000","last_became_peered":"2023-08-27T11:28:36.026010+0000","last_unstale":"2023-08-27T11:28:37.004512+0000","last_undegraded":"2023-08-27T11:28:37.004512+0000","last_fullsized":"2023-08-27T11:28:37.004512+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:05:57.207944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356357+0000","last_change":"2023-08-27T11:28:36.018518+0000","last_active":"2023-08-27T11:28:37.356357+0000","last_peered":"2023-08-27T11:28:37.356357+0000","last_clean":"2023-08-27T11:28:37.356357+0000","last_became_active":"2023-08-27T11:28:36.016928+0000","last_became_peered":"2023-08-27T11:28:36.016928+0000","last_unstale":"2023-08-27T11:28:37.356357+0000","last_undegraded":"2023-08-27T11:28:37.356357+0000","last_fullsized":"2023-08-27T11:28:37.356357+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:26.188725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356483+0000","last_change":"2023-08-27T11:28:36.032093+0000","last_active":"2023-08-27T11:28:37.356483+0000","last_peered":"2023-08-27T11:28:37.356483+0000","last_clean":"2023-08-27T11:28:37.356483+0000","last_became_active":"2023-08-27T11:28:36.031709+0000","last_became_peered":"2023-08-27T11:28:36.031709+0000","last_unstale":"2023-08-27T11:28:37.356483+0000","last_undegraded":"2023-08-27T11:28:37.356483+0000","last_fullsized":"2023-08-27T11:28:37.356483+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:23:05.870961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356186+0000","last_change":"2023-08-27T11:28:36.037935+0000","last_active":"2023-08-27T11:28:37.356186+0000","last_peered":"2023-08-27T11:28:37.356186+0000","last_clean":"2023-08-27T11:28:37.356186+0000","last_became_active":"2023-08-27T11:28:36.034667+0000","last_became_peered":"2023-08-27T11:28:36.034667+0000","last_unstale":"2023-08-27T11:28:37.356186+0000","last_undegraded":"2023-08-27T11:28:37.356186+0000","last_fullsized":"2023-08-27T11:28:37.356186+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:30.365109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005334+0000","last_change":"2023-08-27T11:28:36.025699+0000","last_active":"2023-08-27T11:28:37.005334+0000","last_peered":"2023-08-27T11:28:37.005334+0000","last_clean":"2023-08-27T11:28:37.005334+0000","last_became_active":"2023-08-27T11:28:36.025101+0000","last_became_peered":"2023-08-27T11:28:36.025101+0000","last_unstale":"2023-08-27T11:28:37.005334+0000","last_undegraded":"2023-08-27T11:28:37.005334+0000","last_fullsized":"2023-08-27T11:28:37.005334+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:45:46.806482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356543+0000","last_change":"2023-08-27T11:28:36.032044+0000","last_active":"2023-08-27T11:28:37.356543+0000","last_peered":"2023-08-27T11:28:37.356543+0000","last_clean":"2023-08-27T11:28:37.356543+0000","last_became_active":"2023-08-27T11:28:36.031578+0000","last_became_peered":"2023-08-27T11:28:36.031578+0000","last_unstale":"2023-08-27T11:28:37.356543+0000","last_undegraded":"2023-08-27T11:28:37.356543+0000","last_fullsized":"2023-08-27T11:28:37.356543+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:20:05.626638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227832+0000","last_change":"2023-08-27T11:28:36.025467+0000","last_active":"2023-08-27T11:28:37.227832+0000","last_peered":"2023-08-27T11:28:37.227832+0000","last_clean":"2023-08-27T11:28:37.227832+0000","last_became_active":"2023-08-27T11:28:36.025183+0000","last_became_peered":"2023-08-27T11:28:36.025183+0000","last_unstale":"2023-08-27T11:28:37.227832+0000","last_undegraded":"2023-08-27T11:28:37.227832+0000","last_fullsized":"2023-08-27T11:28:37.227832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:41.778525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004486+0000","last_change":"2023-08-27T11:28:36.028552+0000","last_active":"2023-08-27T11:28:37.004486+0000","last_peered":"2023-08-27T11:28:37.004486+0000","last_clean":"2023-08-27T11:28:37.004486+0000","last_became_active":"2023-08-27T11:28:36.028230+0000","last_became_peered":"2023-08-27T11:28:36.028230+0000","last_unstale":"2023-08-27T11:28:37.004486+0000","last_undegraded":"2023-08-27T11:28:37.004486+0000","last_fullsized":"2023-08-27T11:28:37.004486+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:35.849708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357175+0000","last_change":"2023-08-27T11:28:36.003637+0000","last_active":"2023-08-27T11:28:37.357175+0000","last_peered":"2023-08-27T11:28:37.357175+0000","last_clean":"2023-08-27T11:28:37.357175+0000","last_became_active":"2023-08-27T11:28:36.003238+0000","last_became_peered":"2023-08-27T11:28:36.003238+0000","last_unstale":"2023-08-27T11:28:37.357175+0000","last_undegraded":"2023-08-27T11:28:37.357175+0000","last_fullsized":"2023-08-27T11:28:37.357175+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:12.209607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355955+0000","last_change":"2023-08-27T11:28:36.029468+0000","last_active":"2023-08-27T11:28:37.355955+0000","last_peered":"2023-08-27T11:28:37.355955+0000","last_clean":"2023-08-27T11:28:37.355955+0000","last_became_active":"2023-08-27T11:28:36.028083+0000","last_became_peered":"2023-08-27T11:28:36.028083+0000","last_unstale":"2023-08-27T11:28:37.355955+0000","last_undegraded":"2023-08-27T11:28:37.355955+0000","last_fullsized":"2023-08-27T11:28:37.355955+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:44.393970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356709+0000","last_change":"2023-08-27T11:28:36.031513+0000","last_active":"2023-08-27T11:28:37.356709+0000","last_peered":"2023-08-27T11:28:37.356709+0000","last_clean":"2023-08-27T11:28:37.356709+0000","last_became_active":"2023-08-27T11:28:36.031228+0000","last_became_peered":"2023-08-27T11:28:36.031228+0000","last_unstale":"2023-08-27T11:28:37.356709+0000","last_undegraded":"2023-08-27T11:28:37.356709+0000","last_fullsized":"2023-08-27T11:28:37.356709+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:05:08.790588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356170+0000","last_change":"2023-08-27T11:28:36.031969+0000","last_active":"2023-08-27T11:28:37.356170+0000","last_peered":"2023-08-27T11:28:37.356170+0000","last_clean":"2023-08-27T11:28:37.356170+0000","last_became_active":"2023-08-27T11:28:36.030385+0000","last_became_peered":"2023-08-27T11:28:36.030385+0000","last_unstale":"2023-08-27T11:28:37.356170+0000","last_undegraded":"2023-08-27T11:28:37.356170+0000","last_fullsized":"2023-08-27T11:28:37.356170+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:22:11.176589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355763+0000","last_change":"2023-08-27T11:28:36.035072+0000","last_active":"2023-08-27T11:28:37.355763+0000","last_peered":"2023-08-27T11:28:37.355763+0000","last_clean":"2023-08-27T11:28:37.355763+0000","last_became_active":"2023-08-27T11:28:36.031725+0000","last_became_peered":"2023-08-27T11:28:36.031725+0000","last_unstale":"2023-08-27T11:28:37.355763+0000","last_undegraded":"2023-08-27T11:28:37.355763+0000","last_fullsized":"2023-08-27T11:28:37.355763+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:00.181326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356676+0000","last_change":"2023-08-27T11:28:36.026210+0000","last_active":"2023-08-27T11:28:37.356676+0000","last_peered":"2023-08-27T11:28:37.356676+0000","last_clean":"2023-08-27T11:28:37.356676+0000","last_became_active":"2023-08-27T11:28:36.025658+0000","last_became_peered":"2023-08-27T11:28:36.025658+0000","last_unstale":"2023-08-27T11:28:37.356676+0000","last_undegraded":"2023-08-27T11:28:37.356676+0000","last_fullsized":"2023-08-27T11:28:37.356676+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:35:58.486978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356228+0000","last_change":"2023-08-27T11:28:36.018073+0000","last_active":"2023-08-27T11:28:37.356228+0000","last_peered":"2023-08-27T11:28:37.356228+0000","last_clean":"2023-08-27T11:28:37.356228+0000","last_became_active":"2023-08-27T11:28:36.017781+0000","last_became_peered":"2023-08-27T11:28:36.017781+0000","last_unstale":"2023-08-27T11:28:37.356228+0000","last_undegraded":"2023-08-27T11:28:37.356228+0000","last_fullsized":"2023-08-27T11:28:37.356228+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:40.136336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356688+0000","last_change":"2023-08-27T11:28:36.038441+0000","last_active":"2023-08-27T11:28:37.356688+0000","last_peered":"2023-08-27T11:28:37.356688+0000","last_clean":"2023-08-27T11:28:37.356688+0000","last_became_active":"2023-08-27T11:28:36.036212+0000","last_became_peered":"2023-08-27T11:28:36.036212+0000","last_unstale":"2023-08-27T11:28:37.356688+0000","last_undegraded":"2023-08-27T11:28:37.356688+0000","last_fullsized":"2023-08-27T11:28:37.356688+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:51.362462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356966+0000","last_change":"2023-08-27T11:28:36.034189+0000","last_active":"2023-08-27T11:28:37.356966+0000","last_peered":"2023-08-27T11:28:37.356966+0000","last_clean":"2023-08-27T11:28:37.356966+0000","last_became_active":"2023-08-27T11:28:36.033669+0000","last_became_peered":"2023-08-27T11:28:36.033669+0000","last_unstale":"2023-08-27T11:28:37.356966+0000","last_undegraded":"2023-08-27T11:28:37.356966+0000","last_fullsized":"2023-08-27T11:28:37.356966+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:24.927456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004914+0000","last_change":"2023-08-27T11:28:36.028057+0000","last_active":"2023-08-27T11:28:37.004914+0000","last_peered":"2023-08-27T11:28:37.004914+0000","last_clean":"2023-08-27T11:28:37.004914+0000","last_became_active":"2023-08-27T11:28:36.027646+0000","last_became_peered":"2023-08-27T11:28:36.027646+0000","last_unstale":"2023-08-27T11:28:37.004914+0000","last_undegraded":"2023-08-27T11:28:37.004914+0000","last_fullsized":"2023-08-27T11:28:37.004914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:12.860248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356859+0000","last_change":"2023-08-27T11:28:36.019510+0000","last_active":"2023-08-27T11:28:37.356859+0000","last_peered":"2023-08-27T11:28:37.356859+0000","last_clean":"2023-08-27T11:28:37.356859+0000","last_became_active":"2023-08-27T11:28:36.019179+0000","last_became_peered":"2023-08-27T11:28:36.019179+0000","last_unstale":"2023-08-27T11:28:37.356859+0000","last_undegraded":"2023-08-27T11:28:37.356859+0000","last_fullsized":"2023-08-27T11:28:37.356859+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:50:30.973505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005108+0000","last_change":"2023-08-27T11:28:36.033383+0000","last_active":"2023-08-27T11:28:37.005108+0000","last_peered":"2023-08-27T11:28:37.005108+0000","last_clean":"2023-08-27T11:28:37.005108+0000","last_became_active":"2023-08-27T11:28:36.033079+0000","last_became_peered":"2023-08-27T11:28:36.033079+0000","last_unstale":"2023-08-27T11:28:37.005108+0000","last_undegraded":"2023-08-27T11:28:37.005108+0000","last_fullsized":"2023-08-27T11:28:37.005108+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:20.118168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355539+0000","last_change":"2023-08-27T11:28:36.026817+0000","last_active":"2023-08-27T11:28:37.355539+0000","last_peered":"2023-08-27T11:28:37.355539+0000","last_clean":"2023-08-27T11:28:37.355539+0000","last_became_active":"2023-08-27T11:28:36.026404+0000","last_became_peered":"2023-08-27T11:28:36.026404+0000","last_unstale":"2023-08-27T11:28:37.355539+0000","last_undegraded":"2023-08-27T11:28:37.355539+0000","last_fullsized":"2023-08-27T11:28:37.355539+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:36:45.171859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004836+0000","last_change":"2023-08-27T11:28:36.018195+0000","last_active":"2023-08-27T11:28:37.004836+0000","last_peered":"2023-08-27T11:28:37.004836+0000","last_clean":"2023-08-27T11:28:37.004836+0000","last_became_active":"2023-08-27T11:28:36.017891+0000","last_became_peered":"2023-08-27T11:28:36.017891+0000","last_unstale":"2023-08-27T11:28:37.004836+0000","last_undegraded":"2023-08-27T11:28:37.004836+0000","last_fullsized":"2023-08-27T11:28:37.004836+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:38:52.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004475+0000","last_change":"2023-08-27T11:28:36.033043+0000","last_active":"2023-08-27T11:28:37.004475+0000","last_peered":"2023-08-27T11:28:37.004475+0000","last_clean":"2023-08-27T11:28:37.004475+0000","last_became_active":"2023-08-27T11:28:36.032749+0000","last_became_peered":"2023-08-27T11:28:36.032749+0000","last_unstale":"2023-08-27T11:28:37.004475+0000","last_undegraded":"2023-08-27T11:28:37.004475+0000","last_fullsized":"2023-08-27T11:28:37.004475+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:31:24.927456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356465+0000","last_change":"2023-08-27T11:28:36.036171+0000","last_active":"2023-08-27T11:28:37.356465+0000","last_peered":"2023-08-27T11:28:37.356465+0000","last_clean":"2023-08-27T11:28:37.356465+0000","last_became_active":"2023-08-27T11:28:36.035804+0000","last_became_peered":"2023-08-27T11:28:36.035804+0000","last_unstale":"2023-08-27T11:28:37.356465+0000","last_undegraded":"2023-08-27T11:28:37.356465+0000","last_fullsized":"2023-08-27T11:28:37.356465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:37:08.180371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227993+0000","last_change":"2023-08-27T11:28:36.028752+0000","last_active":"2023-08-27T11:28:37.227993+0000","last_peered":"2023-08-27T11:28:37.227993+0000","last_clean":"2023-08-27T11:28:37.227993+0000","last_became_active":"2023-08-27T11:28:36.028448+0000","last_became_peered":"2023-08-27T11:28:36.028448+0000","last_unstale":"2023-08-27T11:28:37.227993+0000","last_undegraded":"2023-08-27T11:28:37.227993+0000","last_fullsized":"2023-08-27T11:28:37.227993+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:12.034872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004031+0000","last_change":"2023-08-27T11:28:36.027534+0000","last_active":"2023-08-27T11:28:37.004031+0000","last_peered":"2023-08-27T11:28:37.004031+0000","last_clean":"2023-08-27T11:28:37.004031+0000","last_became_active":"2023-08-27T11:28:36.027208+0000","last_became_peered":"2023-08-27T11:28:36.027208+0000","last_unstale":"2023-08-27T11:28:37.004031+0000","last_undegraded":"2023-08-27T11:28:37.004031+0000","last_fullsized":"2023-08-27T11:28:37.004031+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.092818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003822+0000","last_change":"2023-08-27T11:28:36.029470+0000","last_active":"2023-08-27T11:28:37.003822+0000","last_peered":"2023-08-27T11:28:37.003822+0000","last_clean":"2023-08-27T11:28:37.003822+0000","last_became_active":"2023-08-27T11:28:36.028657+0000","last_became_peered":"2023-08-27T11:28:36.028657+0000","last_unstale":"2023-08-27T11:28:37.003822+0000","last_undegraded":"2023-08-27T11:28:37.003822+0000","last_fullsized":"2023-08-27T11:28:37.003822+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:10.567763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005355+0000","last_change":"2023-08-27T11:28:36.032791+0000","last_active":"2023-08-27T11:28:37.005355+0000","last_peered":"2023-08-27T11:28:37.005355+0000","last_clean":"2023-08-27T11:28:37.005355+0000","last_became_active":"2023-08-27T11:28:36.032496+0000","last_became_peered":"2023-08-27T11:28:36.032496+0000","last_unstale":"2023-08-27T11:28:37.005355+0000","last_undegraded":"2023-08-27T11:28:37.005355+0000","last_fullsized":"2023-08-27T11:28:37.005355+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:43.702058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227649+0000","last_change":"2023-08-27T11:28:36.036286+0000","last_active":"2023-08-27T11:28:37.227649+0000","last_peered":"2023-08-27T11:28:37.227649+0000","last_clean":"2023-08-27T11:28:37.227649+0000","last_became_active":"2023-08-27T11:28:36.036000+0000","last_became_peered":"2023-08-27T11:28:36.036000+0000","last_unstale":"2023-08-27T11:28:37.227649+0000","last_undegraded":"2023-08-27T11:28:37.227649+0000","last_fullsized":"2023-08-27T11:28:37.227649+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:18.555018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005530+0000","last_change":"2023-08-27T11:28:36.034952+0000","last_active":"2023-08-27T11:28:37.005530+0000","last_peered":"2023-08-27T11:28:37.005530+0000","last_clean":"2023-08-27T11:28:37.005530+0000","last_became_active":"2023-08-27T11:28:36.034648+0000","last_became_peered":"2023-08-27T11:28:36.034648+0000","last_unstale":"2023-08-27T11:28:37.005530+0000","last_undegraded":"2023-08-27T11:28:37.005530+0000","last_fullsized":"2023-08-27T11:28:37.005530+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:20.001897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"123'4","reported_seq":17,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004996+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:37.004996+0000","last_peered":"2023-08-27T11:28:37.004996+0000","last_clean":"2023-08-27T11:28:37.004996+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:37.004996+0000","last_undegraded":"2023-08-27T11:28:37.004996+0000","last_fullsized":"2023-08-27T11:28:37.004996+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:22.211436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356311+0000","last_change":"2023-08-27T11:28:36.021627+0000","last_active":"2023-08-27T11:28:37.356311+0000","last_peered":"2023-08-27T11:28:37.356311+0000","last_clean":"2023-08-27T11:28:37.356311+0000","last_became_active":"2023-08-27T11:28:36.021354+0000","last_became_peered":"2023-08-27T11:28:36.021354+0000","last_unstale":"2023-08-27T11:28:37.356311+0000","last_undegraded":"2023-08-27T11:28:37.356311+0000","last_fullsized":"2023-08-27T11:28:37.356311+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:38.018967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356650+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:37.356650+0000","last_peered":"2023-08-27T11:28:37.356650+0000","last_clean":"2023-08-27T11:28:37.356650+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:37.356650+0000","last_undegraded":"2023-08-27T11:28:37.356650+0000","last_fullsized":"2023-08-27T11:28:37.356650+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:18.793959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004538+0000","last_change":"2023-08-27T11:28:36.031467+0000","last_active":"2023-08-27T11:28:37.004538+0000","last_peered":"2023-08-27T11:28:37.004538+0000","last_clean":"2023-08-27T11:28:37.004538+0000","last_became_active":"2023-08-27T11:28:36.031196+0000","last_became_peered":"2023-08-27T11:28:36.031196+0000","last_unstale":"2023-08-27T11:28:37.004538+0000","last_undegraded":"2023-08-27T11:28:37.004538+0000","last_fullsized":"2023-08-27T11:28:37.004538+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:09:41.853185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356840+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:37.356840+0000","last_peered":"2023-08-27T11:28:37.356840+0000","last_clean":"2023-08-27T11:28:37.356840+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:37.356840+0000","last_undegraded":"2023-08-27T11:28:37.356840+0000","last_fullsized":"2023-08-27T11:28:37.356840+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:47:02.535920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356429+0000","last_change":"2023-08-27T11:28:36.032795+0000","last_active":"2023-08-27T11:28:37.356429+0000","last_peered":"2023-08-27T11:28:37.356429+0000","last_clean":"2023-08-27T11:28:37.356429+0000","last_became_active":"2023-08-27T11:28:36.032518+0000","last_became_peered":"2023-08-27T11:28:36.032518+0000","last_unstale":"2023-08-27T11:28:37.356429+0000","last_undegraded":"2023-08-27T11:28:37.356429+0000","last_fullsized":"2023-08-27T11:28:37.356429+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:39.531922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356793+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:37.356793+0000","last_peered":"2023-08-27T11:28:37.356793+0000","last_clean":"2023-08-27T11:28:37.356793+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:37.356793+0000","last_undegraded":"2023-08-27T11:28:37.356793+0000","last_fullsized":"2023-08-27T11:28:37.356793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:03:45.648964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005636+0000","last_change":"2023-08-27T11:28:36.032681+0000","last_active":"2023-08-27T11:28:37.005636+0000","last_peered":"2023-08-27T11:28:37.005636+0000","last_clean":"2023-08-27T11:28:37.005636+0000","last_became_active":"2023-08-27T11:28:36.032386+0000","last_became_peered":"2023-08-27T11:28:36.032386+0000","last_unstale":"2023-08-27T11:28:37.005636+0000","last_undegraded":"2023-08-27T11:28:37.005636+0000","last_fullsized":"2023-08-27T11:28:37.005636+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:53.111944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005574+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:37.005574+0000","last_peered":"2023-08-27T11:28:37.005574+0000","last_clean":"2023-08-27T11:28:37.005574+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:37.005574+0000","last_undegraded":"2023-08-27T11:28:37.005574+0000","last_fullsized":"2023-08-27T11:28:37.005574+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:30:30.932090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005867+0000","last_change":"2023-08-27T11:28:36.025498+0000","last_active":"2023-08-27T11:28:37.005867+0000","last_peered":"2023-08-27T11:28:37.005867+0000","last_clean":"2023-08-27T11:28:37.005867+0000","last_became_active":"2023-08-27T11:28:36.024956+0000","last_became_peered":"2023-08-27T11:28:36.024956+0000","last_unstale":"2023-08-27T11:28:37.005867+0000","last_undegraded":"2023-08-27T11:28:37.005867+0000","last_fullsized":"2023-08-27T11:28:37.005867+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:01:25.782882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356256+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:37.356256+0000","last_peered":"2023-08-27T11:28:37.356256+0000","last_clean":"2023-08-27T11:28:37.356256+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:37.356256+0000","last_undegraded":"2023-08-27T11:28:37.356256+0000","last_fullsized":"2023-08-27T11:28:37.356256+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:09.559307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356383+0000","last_change":"2023-08-27T11:28:36.034683+0000","last_active":"2023-08-27T11:28:37.356383+0000","last_peered":"2023-08-27T11:28:37.356383+0000","last_clean":"2023-08-27T11:28:37.356383+0000","last_became_active":"2023-08-27T11:28:36.034353+0000","last_became_peered":"2023-08-27T11:28:36.034353+0000","last_unstale":"2023-08-27T11:28:37.356383+0000","last_undegraded":"2023-08-27T11:28:37.356383+0000","last_fullsized":"2023-08-27T11:28:37.356383+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:21:37.092818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356047+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:37.356047+0000","last_peered":"2023-08-27T11:28:37.356047+0000","last_clean":"2023-08-27T11:28:37.356047+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:37.356047+0000","last_undegraded":"2023-08-27T11:28:37.356047+0000","last_fullsized":"2023-08-27T11:28:37.356047+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:42.571486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356591+0000","last_change":"2023-08-27T11:28:36.035634+0000","last_active":"2023-08-27T11:28:37.356591+0000","last_peered":"2023-08-27T11:28:37.356591+0000","last_clean":"2023-08-27T11:28:37.356591+0000","last_became_active":"2023-08-27T11:28:36.035256+0000","last_became_peered":"2023-08-27T11:28:36.035256+0000","last_unstale":"2023-08-27T11:28:37.356591+0000","last_undegraded":"2023-08-27T11:28:37.356591+0000","last_fullsized":"2023-08-27T11:28:37.356591+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:51:53.072825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003557+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:37.003557+0000","last_peered":"2023-08-27T11:28:37.003557+0000","last_clean":"2023-08-27T11:28:37.003557+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:37.003557+0000","last_undegraded":"2023-08-27T11:28:37.003557+0000","last_fullsized":"2023-08-27T11:28:37.003557+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:00.841333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003735+0000","last_change":"2023-08-27T11:28:36.013300+0000","last_active":"2023-08-27T11:28:37.003735+0000","last_peered":"2023-08-27T11:28:37.003735+0000","last_clean":"2023-08-27T11:28:37.003735+0000","last_became_active":"2023-08-27T11:28:36.012993+0000","last_became_peered":"2023-08-27T11:28:36.012993+0000","last_unstale":"2023-08-27T11:28:37.003735+0000","last_undegraded":"2023-08-27T11:28:37.003735+0000","last_fullsized":"2023-08-27T11:28:37.003735+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:19:40.136336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005217+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:37.005217+0000","last_peered":"2023-08-27T11:28:37.005217+0000","last_clean":"2023-08-27T11:28:37.005217+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:37.005217+0000","last_undegraded":"2023-08-27T11:28:37.005217+0000","last_fullsized":"2023-08-27T11:28:37.005217+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:51:43.385513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356401+0000","last_change":"2023-08-27T11:28:36.037732+0000","last_active":"2023-08-27T11:28:37.356401+0000","last_peered":"2023-08-27T11:28:37.356401+0000","last_clean":"2023-08-27T11:28:37.356401+0000","last_became_active":"2023-08-27T11:28:36.031618+0000","last_became_peered":"2023-08-27T11:28:36.031618+0000","last_unstale":"2023-08-27T11:28:37.356401+0000","last_undegraded":"2023-08-27T11:28:37.356401+0000","last_fullsized":"2023-08-27T11:28:37.356401+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:51.453087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004608+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:37.004608+0000","last_peered":"2023-08-27T11:28:37.004608+0000","last_clean":"2023-08-27T11:28:37.004608+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:37.004608+0000","last_undegraded":"2023-08-27T11:28:37.004608+0000","last_fullsized":"2023-08-27T11:28:37.004608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:35.181431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356337+0000","last_change":"2023-08-27T11:28:36.035453+0000","last_active":"2023-08-27T11:28:37.356337+0000","last_peered":"2023-08-27T11:28:37.356337+0000","last_clean":"2023-08-27T11:28:37.356337+0000","last_became_active":"2023-08-27T11:28:36.035166+0000","last_became_peered":"2023-08-27T11:28:36.035166+0000","last_unstale":"2023-08-27T11:28:37.356337+0000","last_undegraded":"2023-08-27T11:28:37.356337+0000","last_fullsized":"2023-08-27T11:28:37.356337+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:08:41.898065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"123'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356211+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:37.356211+0000","last_peered":"2023-08-27T11:28:37.356211+0000","last_clean":"2023-08-27T11:28:37.356211+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:37.356211+0000","last_undegraded":"2023-08-27T11:28:37.356211+0000","last_fullsized":"2023-08-27T11:28:37.356211+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:56.749429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227779+0000","last_change":"2023-08-27T11:28:36.031284+0000","last_active":"2023-08-27T11:28:37.227779+0000","last_peered":"2023-08-27T11:28:37.227779+0000","last_clean":"2023-08-27T11:28:37.227779+0000","last_became_active":"2023-08-27T11:28:36.031015+0000","last_became_peered":"2023-08-27T11:28:36.031015+0000","last_unstale":"2023-08-27T11:28:37.227779+0000","last_undegraded":"2023-08-27T11:28:37.227779+0000","last_fullsized":"2023-08-27T11:28:37.227779+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:58.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356809+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:37.356809+0000","last_peered":"2023-08-27T11:28:37.356809+0000","last_clean":"2023-08-27T11:28:37.356809+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:37.356809+0000","last_undegraded":"2023-08-27T11:28:37.356809+0000","last_fullsized":"2023-08-27T11:28:37.356809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:26.883140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356984+0000","last_change":"2023-08-27T11:28:36.003840+0000","last_active":"2023-08-27T11:28:37.356984+0000","last_peered":"2023-08-27T11:28:37.356984+0000","last_clean":"2023-08-27T11:28:37.356984+0000","last_became_active":"2023-08-27T11:28:36.003484+0000","last_became_peered":"2023-08-27T11:28:36.003484+0000","last_unstale":"2023-08-27T11:28:37.356984+0000","last_undegraded":"2023-08-27T11:28:37.356984+0000","last_fullsized":"2023-08-27T11:28:37.356984+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:36.189887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005670+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:37.005670+0000","last_peered":"2023-08-27T11:28:37.005670+0000","last_clean":"2023-08-27T11:28:37.005670+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:37.005670+0000","last_undegraded":"2023-08-27T11:28:37.005670+0000","last_fullsized":"2023-08-27T11:28:37.005670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:10:27.589298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356830+0000","last_change":"2023-08-27T11:28:36.029240+0000","last_active":"2023-08-27T11:28:37.356830+0000","last_peered":"2023-08-27T11:28:37.356830+0000","last_clean":"2023-08-27T11:28:37.356830+0000","last_became_active":"2023-08-27T11:28:36.028966+0000","last_became_peered":"2023-08-27T11:28:36.028966+0000","last_unstale":"2023-08-27T11:28:37.356830+0000","last_undegraded":"2023-08-27T11:28:37.356830+0000","last_fullsized":"2023-08-27T11:28:37.356830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:12:39.524586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357060+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:37.357060+0000","last_peered":"2023-08-27T11:28:37.357060+0000","last_clean":"2023-08-27T11:28:37.357060+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:37.357060+0000","last_undegraded":"2023-08-27T11:28:37.357060+0000","last_fullsized":"2023-08-27T11:28:37.357060+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:47.308263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356528+0000","last_change":"2023-08-27T11:28:36.013853+0000","last_active":"2023-08-27T11:28:37.356528+0000","last_peered":"2023-08-27T11:28:37.356528+0000","last_clean":"2023-08-27T11:28:37.356528+0000","last_became_active":"2023-08-27T11:28:36.013326+0000","last_became_peered":"2023-08-27T11:28:36.013326+0000","last_unstale":"2023-08-27T11:28:37.356528+0000","last_undegraded":"2023-08-27T11:28:37.356528+0000","last_fullsized":"2023-08-27T11:28:37.356528+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:28.695622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356513+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:37.356513+0000","last_peered":"2023-08-27T11:28:37.356513+0000","last_clean":"2023-08-27T11:28:37.356513+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:37.356513+0000","last_undegraded":"2023-08-27T11:28:37.356513+0000","last_fullsized":"2023-08-27T11:28:37.356513+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:52:44.734304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004860+0000","last_change":"2023-08-27T11:28:36.028818+0000","last_active":"2023-08-27T11:28:37.004860+0000","last_peered":"2023-08-27T11:28:37.004860+0000","last_clean":"2023-08-27T11:28:37.004860+0000","last_became_active":"2023-08-27T11:28:36.028244+0000","last_became_peered":"2023-08-27T11:28:36.028244+0000","last_unstale":"2023-08-27T11:28:37.004860+0000","last_undegraded":"2023-08-27T11:28:37.004860+0000","last_fullsized":"2023-08-27T11:28:37.004860+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:50.691012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355675+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:37.355675+0000","last_peered":"2023-08-27T11:28:37.355675+0000","last_clean":"2023-08-27T11:28:37.355675+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:37.355675+0000","last_undegraded":"2023-08-27T11:28:37.355675+0000","last_fullsized":"2023-08-27T11:28:37.355675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:06:11.851792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355734+0000","last_change":"2023-08-27T11:28:36.032846+0000","last_active":"2023-08-27T11:28:37.355734+0000","last_peered":"2023-08-27T11:28:37.355734+0000","last_clean":"2023-08-27T11:28:37.355734+0000","last_became_active":"2023-08-27T11:28:36.032564+0000","last_became_peered":"2023-08-27T11:28:36.032564+0000","last_unstale":"2023-08-27T11:28:37.355734+0000","last_undegraded":"2023-08-27T11:28:37.355734+0000","last_fullsized":"2023-08-27T11:28:37.355734+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:28.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356816+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:37.356816+0000","last_peered":"2023-08-27T11:28:37.356816+0000","last_clean":"2023-08-27T11:28:37.356816+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:37.356816+0000","last_undegraded":"2023-08-27T11:28:37.356816+0000","last_fullsized":"2023-08-27T11:28:37.356816+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:43:42.664864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003491+0000","last_change":"2023-08-27T11:28:36.025457+0000","last_active":"2023-08-27T11:28:37.003491+0000","last_peered":"2023-08-27T11:28:37.003491+0000","last_clean":"2023-08-27T11:28:37.003491+0000","last_became_active":"2023-08-27T11:28:36.025184+0000","last_became_peered":"2023-08-27T11:28:36.025184+0000","last_unstale":"2023-08-27T11:28:37.003491+0000","last_undegraded":"2023-08-27T11:28:37.003491+0000","last_fullsized":"2023-08-27T11:28:37.003491+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:28.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"124'1","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005924+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:37.005924+0000","last_peered":"2023-08-27T11:28:37.005924+0000","last_clean":"2023-08-27T11:28:37.005924+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:37.005924+0000","last_undegraded":"2023-08-27T11:28:37.005924+0000","last_fullsized":"2023-08-27T11:28:37.005924+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:30.207482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356700+0000","last_change":"2023-08-27T11:28:36.031143+0000","last_active":"2023-08-27T11:28:37.356700+0000","last_peered":"2023-08-27T11:28:37.356700+0000","last_clean":"2023-08-27T11:28:37.356700+0000","last_became_active":"2023-08-27T11:28:36.030840+0000","last_became_peered":"2023-08-27T11:28:36.030840+0000","last_unstale":"2023-08-27T11:28:37.356700+0000","last_undegraded":"2023-08-27T11:28:37.356700+0000","last_fullsized":"2023-08-27T11:28:37.356700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:24.417498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005914+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:37.005914+0000","last_peered":"2023-08-27T11:28:37.005914+0000","last_clean":"2023-08-27T11:28:37.005914+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:37.005914+0000","last_undegraded":"2023-08-27T11:28:37.005914+0000","last_fullsized":"2023-08-27T11:28:37.005914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:50.363119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227811+0000","last_change":"2023-08-27T11:28:36.027765+0000","last_active":"2023-08-27T11:28:37.227811+0000","last_peered":"2023-08-27T11:28:37.227811+0000","last_clean":"2023-08-27T11:28:37.227811+0000","last_became_active":"2023-08-27T11:28:36.027374+0000","last_became_peered":"2023-08-27T11:28:36.027374+0000","last_unstale":"2023-08-27T11:28:37.227811+0000","last_undegraded":"2023-08-27T11:28:37.227811+0000","last_fullsized":"2023-08-27T11:28:37.227811+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:44.920689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355800+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:37.355800+0000","last_peered":"2023-08-27T11:28:37.355800+0000","last_clean":"2023-08-27T11:28:37.355800+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:37.355800+0000","last_undegraded":"2023-08-27T11:28:37.355800+0000","last_fullsized":"2023-08-27T11:28:37.355800+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:49.682556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355670+0000","last_change":"2023-08-27T11:28:36.027113+0000","last_active":"2023-08-27T11:28:37.355670+0000","last_peered":"2023-08-27T11:28:37.355670+0000","last_clean":"2023-08-27T11:28:37.355670+0000","last_became_active":"2023-08-27T11:28:36.026825+0000","last_became_peered":"2023-08-27T11:28:36.026825+0000","last_unstale":"2023-08-27T11:28:37.355670+0000","last_undegraded":"2023-08-27T11:28:37.355670+0000","last_fullsized":"2023-08-27T11:28:37.355670+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:09.415460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004794+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:37.004794+0000","last_peered":"2023-08-27T11:28:37.004794+0000","last_clean":"2023-08-27T11:28:37.004794+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:37.004794+0000","last_undegraded":"2023-08-27T11:28:37.004794+0000","last_fullsized":"2023-08-27T11:28:37.004794+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:46.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356077+0000","last_change":"2023-08-27T11:28:36.026876+0000","last_active":"2023-08-27T11:28:37.356077+0000","last_peered":"2023-08-27T11:28:37.356077+0000","last_clean":"2023-08-27T11:28:37.356077+0000","last_became_active":"2023-08-27T11:28:36.026348+0000","last_became_peered":"2023-08-27T11:28:36.026348+0000","last_unstale":"2023-08-27T11:28:37.356077+0000","last_undegraded":"2023-08-27T11:28:37.356077+0000","last_fullsized":"2023-08-27T11:28:37.356077+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:17:13.088059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356781+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:37.356781+0000","last_peered":"2023-08-27T11:28:37.356781+0000","last_clean":"2023-08-27T11:28:37.356781+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:37.356781+0000","last_undegraded":"2023-08-27T11:28:37.356781+0000","last_fullsized":"2023-08-27T11:28:37.356781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:12:33.703657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356806+0000","last_change":"2023-08-27T11:28:36.035026+0000","last_active":"2023-08-27T11:28:37.356806+0000","last_peered":"2023-08-27T11:28:37.356806+0000","last_clean":"2023-08-27T11:28:37.356806+0000","last_became_active":"2023-08-27T11:28:36.034706+0000","last_became_peered":"2023-08-27T11:28:36.034706+0000","last_unstale":"2023-08-27T11:28:37.356806+0000","last_undegraded":"2023-08-27T11:28:37.356806+0000","last_fullsized":"2023-08-27T11:28:37.356806+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:41:14.026798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356248+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:37.356248+0000","last_peered":"2023-08-27T11:28:37.356248+0000","last_clean":"2023-08-27T11:28:37.356248+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:37.356248+0000","last_undegraded":"2023-08-27T11:28:37.356248+0000","last_fullsized":"2023-08-27T11:28:37.356248+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:37:43.667249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356662+0000","last_change":"2023-08-27T11:28:36.032354+0000","last_active":"2023-08-27T11:28:37.356662+0000","last_peered":"2023-08-27T11:28:37.356662+0000","last_clean":"2023-08-27T11:28:37.356662+0000","last_became_active":"2023-08-27T11:28:36.031936+0000","last_became_peered":"2023-08-27T11:28:36.031936+0000","last_unstale":"2023-08-27T11:28:37.356662+0000","last_undegraded":"2023-08-27T11:28:37.356662+0000","last_fullsized":"2023-08-27T11:28:37.356662+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:06:02.311365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356090+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:37.356090+0000","last_peered":"2023-08-27T11:28:37.356090+0000","last_clean":"2023-08-27T11:28:37.356090+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:37.356090+0000","last_undegraded":"2023-08-27T11:28:37.356090+0000","last_fullsized":"2023-08-27T11:28:37.356090+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:00.841333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003888+0000","last_change":"2023-08-27T11:28:36.019620+0000","last_active":"2023-08-27T11:28:37.003888+0000","last_peered":"2023-08-27T11:28:37.003888+0000","last_clean":"2023-08-27T11:28:37.003888+0000","last_became_active":"2023-08-27T11:28:36.019344+0000","last_became_peered":"2023-08-27T11:28:36.019344+0000","last_unstale":"2023-08-27T11:28:37.003888+0000","last_undegraded":"2023-08-27T11:28:37.003888+0000","last_fullsized":"2023-08-27T11:28:37.003888+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:26.188725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"123'3","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356866+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:37.356866+0000","last_peered":"2023-08-27T11:28:37.356866+0000","last_clean":"2023-08-27T11:28:37.356866+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:37.356866+0000","last_undegraded":"2023-08-27T11:28:37.356866+0000","last_fullsized":"2023-08-27T11:28:37.356866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:50:37.700816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":209,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.005295+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:37.005295+0000","last_peered":"2023-08-27T11:28:37.005295+0000","last_clean":"2023-08-27T11:28:37.005295+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:37.005295+0000","last_undegraded":"2023-08-27T11:28:37.005295+0000","last_fullsized":"2023-08-27T11:28:37.005295+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:19:53.297926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004200+0000","last_change":"2023-08-27T11:28:36.027190+0000","last_active":"2023-08-27T11:28:37.004200+0000","last_peered":"2023-08-27T11:28:37.004200+0000","last_clean":"2023-08-27T11:28:37.004200+0000","last_became_active":"2023-08-27T11:28:36.026781+0000","last_became_peered":"2023-08-27T11:28:36.026781+0000","last_unstale":"2023-08-27T11:28:37.004200+0000","last_undegraded":"2023-08-27T11:28:37.004200+0000","last_fullsized":"2023-08-27T11:28:37.004200+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:18:28.695622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"123'6","reported_seq":19,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356518+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:37.356518+0000","last_peered":"2023-08-27T11:28:37.356518+0000","last_clean":"2023-08-27T11:28:37.356518+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:37.356518+0000","last_undegraded":"2023-08-27T11:28:37.356518+0000","last_fullsized":"2023-08-27T11:28:37.356518+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:13:50.550704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":209,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004616+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:37.004616+0000","last_peered":"2023-08-27T11:28:37.004616+0000","last_clean":"2023-08-27T11:28:37.004616+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:37.004616+0000","last_undegraded":"2023-08-27T11:28:37.004616+0000","last_fullsized":"2023-08-27T11:28:37.004616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:30:29.304654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.227887+0000","last_change":"2023-08-27T11:28:36.023266+0000","last_active":"2023-08-27T11:28:37.227887+0000","last_peered":"2023-08-27T11:28:37.227887+0000","last_clean":"2023-08-27T11:28:37.227887+0000","last_became_active":"2023-08-27T11:28:36.022928+0000","last_became_peered":"2023-08-27T11:28:36.022928+0000","last_unstale":"2023-08-27T11:28:37.227887+0000","last_undegraded":"2023-08-27T11:28:37.227887+0000","last_fullsized":"2023-08-27T11:28:37.227887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:18:20.304393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"123'2","reported_seq":15,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357204+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:37.357204+0000","last_peered":"2023-08-27T11:28:37.357204+0000","last_clean":"2023-08-27T11:28:37.357204+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:37.357204+0000","last_undegraded":"2023-08-27T11:28:37.357204+0000","last_fullsized":"2023-08-27T11:28:37.357204+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:49:57.704411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":219,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004720+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:37.004720+0000","last_peered":"2023-08-27T11:28:37.004720+0000","last_clean":"2023-08-27T11:28:37.004720+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:37.004720+0000","last_undegraded":"2023-08-27T11:28:37.004720+0000","last_fullsized":"2023-08-27T11:28:37.004720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:30:46.094518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004418+0000","last_change":"2023-08-27T11:28:36.010061+0000","last_active":"2023-08-27T11:28:37.004418+0000","last_peered":"2023-08-27T11:28:37.004418+0000","last_clean":"2023-08-27T11:28:37.004418+0000","last_became_active":"2023-08-27T11:28:36.009747+0000","last_became_peered":"2023-08-27T11:28:36.009747+0000","last_unstale":"2023-08-27T11:28:37.004418+0000","last_undegraded":"2023-08-27T11:28:37.004418+0000","last_fullsized":"2023-08-27T11:28:37.004418+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:54:27.891596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356682+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:37.356682+0000","last_peered":"2023-08-27T11:28:37.356682+0000","last_clean":"2023-08-27T11:28:37.356682+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:37.356682+0000","last_undegraded":"2023-08-27T11:28:37.356682+0000","last_fullsized":"2023-08-27T11:28:37.356682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:42:18.559193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":196,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356633+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:37.356633+0000","last_peered":"2023-08-27T11:28:37.356633+0000","last_clean":"2023-08-27T11:28:37.356633+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:37.356633+0000","last_undegraded":"2023-08-27T11:28:37.356633+0000","last_fullsized":"2023-08-27T11:28:37.356633+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:46:20.167598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356131+0000","last_change":"2023-08-27T11:28:36.027147+0000","last_active":"2023-08-27T11:28:37.356131+0000","last_peered":"2023-08-27T11:28:37.356131+0000","last_clean":"2023-08-27T11:28:37.356131+0000","last_became_active":"2023-08-27T11:28:36.026783+0000","last_became_peered":"2023-08-27T11:28:36.026783+0000","last_unstale":"2023-08-27T11:28:37.356131+0000","last_undegraded":"2023-08-27T11:28:37.356131+0000","last_fullsized":"2023-08-27T11:28:37.356131+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:12:41.170913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"123'8","reported_seq":21,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355604+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:37.355604+0000","last_peered":"2023-08-27T11:28:37.355604+0000","last_clean":"2023-08-27T11:28:37.355604+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:37.355604+0000","last_undegraded":"2023-08-27T11:28:37.355604+0000","last_fullsized":"2023-08-27T11:28:37.355604+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:37:46.632796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":195,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356862+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:37.356862+0000","last_peered":"2023-08-27T11:28:37.356862+0000","last_clean":"2023-08-27T11:28:37.356862+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:37.356862+0000","last_undegraded":"2023-08-27T11:28:37.356862+0000","last_fullsized":"2023-08-27T11:28:37.356862+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:00:21.078296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356734+0000","last_change":"2023-08-27T11:28:36.038226+0000","last_active":"2023-08-27T11:28:37.356734+0000","last_peered":"2023-08-27T11:28:37.356734+0000","last_clean":"2023-08-27T11:28:37.356734+0000","last_became_active":"2023-08-27T11:28:36.037748+0000","last_became_peered":"2023-08-27T11:28:36.037748+0000","last_unstale":"2023-08-27T11:28:37.356734+0000","last_undegraded":"2023-08-27T11:28:37.356734+0000","last_fullsized":"2023-08-27T11:28:37.356734+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:16.394591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.003625+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:37.003625+0000","last_peered":"2023-08-27T11:28:37.003625+0000","last_clean":"2023-08-27T11:28:37.003625+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:37.003625+0000","last_undegraded":"2023-08-27T11:28:37.003625+0000","last_fullsized":"2023-08-27T11:28:37.003625+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:12:40.162456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":344,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356332+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:37.356332+0000","last_peered":"2023-08-27T11:28:37.356332+0000","last_clean":"2023-08-27T11:28:37.356332+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:37.356332+0000","last_undegraded":"2023-08-27T11:28:37.356332+0000","last_fullsized":"2023-08-27T11:28:37.356332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:13.742685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":201,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356069+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:37.356069+0000","last_peered":"2023-08-27T11:28:37.356069+0000","last_clean":"2023-08-27T11:28:37.356069+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:37.356069+0000","last_undegraded":"2023-08-27T11:28:37.356069+0000","last_fullsized":"2023-08-27T11:28:37.356069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:53:29.749059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.355911+0000","last_change":"2023-08-27T11:28:36.031797+0000","last_active":"2023-08-27T11:28:37.355911+0000","last_peered":"2023-08-27T11:28:37.355911+0000","last_clean":"2023-08-27T11:28:37.355911+0000","last_became_active":"2023-08-27T11:28:36.031421+0000","last_became_peered":"2023-08-27T11:28:36.031421+0000","last_unstale":"2023-08-27T11:28:37.355911+0000","last_undegraded":"2023-08-27T11:28:37.355911+0000","last_fullsized":"2023-08-27T11:28:37.355911+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:13:20.118168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356876+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:37.356876+0000","last_peered":"2023-08-27T11:28:37.356876+0000","last_clean":"2023-08-27T11:28:37.356876+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:37.356876+0000","last_undegraded":"2023-08-27T11:28:37.356876+0000","last_fullsized":"2023-08-27T11:28:37.356876+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:08.653781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":201,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.357110+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:37.357110+0000","last_peered":"2023-08-27T11:28:37.357110+0000","last_clean":"2023-08-27T11:28:37.357110+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:37.357110+0000","last_undegraded":"2023-08-27T11:28:37.357110+0000","last_fullsized":"2023-08-27T11:28:37.357110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:30:29.304654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.356535+0000","last_change":"2023-08-27T11:28:36.013449+0000","last_active":"2023-08-27T11:28:37.356535+0000","last_peered":"2023-08-27T11:28:37.356535+0000","last_clean":"2023-08-27T11:28:37.356535+0000","last_became_active":"2023-08-27T11:28:36.013153+0000","last_became_peered":"2023-08-27T11:28:36.013153+0000","last_unstale":"2023-08-27T11:28:37.356535+0000","last_undegraded":"2023-08-27T11:28:37.356535+0000","last_fullsized":"2023-08-27T11:28:37.356535+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:23:58.239625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.004973+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:37.004973+0000","last_peered":"2023-08-27T11:28:37.004973+0000","last_clean":"2023-08-27T11:28:37.004973+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:37.004973+0000","last_undegraded":"2023-08-27T11:28:37.004973+0000","last_fullsized":"2023-08-27T11:28:37.004973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:08.407004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":217,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-08-27T11:28:37.006016+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:37.006016+0000","last_peered":"2023-08-27T11:28:37.006016+0000","last_clean":"2023-08-27T11:28:37.006016+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:37.006016+0000","last_undegraded":"2023-08-27T11:28:37.006016+0000","last_fullsized":"2023-08-27T11:28:37.006016+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:04:36.397142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33292,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338548,"statfs":{"total":96636764160,"available":96602673152,"internally_reserved":0,"allocated":2158592,"data_stored":1320349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61599999999999999,"15min":0.58699999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.872,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68200000000000005},"min":{"1min":0.39900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47899999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.67600000000000005,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93500000000000005,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.504,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86399999999999999,"5min":0.878,"15min":0.878},"last":0.78900000000000003}]},{"osd":2,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.70799999999999996},"min":{"1min":0.44600000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.95599999999999996,"5min":1.173,"15min":1.173},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.65800000000000003},"min":{"1min":0.501,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.71299999999999997,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.53800000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.496,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2649999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93100000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.51200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.52300000000000002,"5min":0.498,"15min":0.498},"max":{"1min":1.0740000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.86899999999999999},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0569999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.80300000000000005},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.048,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.84999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574925,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28544,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343296,"statfs":{"total":96636764160,"available":96607535104,"internally_reserved":0,"allocated":1552384,"data_stored":727965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71299999999999997,"15min":0.877},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.01,"5min":8.5419999999999998,"15min":8.5419999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70999999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":3.472,"15min":3.472},"last":0.752},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.94599999999999995},"min":{"1min":0.47499999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.98799999999999999,"5min":8.5920000000000005,"15min":8.5920000000000005},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.69299999999999995,"15min":0.78100000000000003},"min":{"1min":0.47299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93500000000000005,"5min":4.5039999999999996,"15min":4.5039999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.753,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.038,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":0.95299999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.044,"5min":7.4850000000000003,"15min":7.4850000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74199999999999999,"15min":0.84599999999999997},"min":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.76000000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.101,"5min":1.234,"15min":1.234},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76300000000000001,"15min":0.80200000000000005},"min":{"1min":0.50900000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.071,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.98699999999999999,"5min":1.135,"15min":1.135},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82499999999999996,"15min":0.84699999999999998},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83099999999999996,"15min":0.88100000000000001},"min":{"1min":0.62,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.111,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.87},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0309999999999999,"5min":1.27,"15min":1.27},"last":0.82399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2146304,"data_stored":1318717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.41899999999999998,"15min":0.40500000000000003},"min":{"1min":0.26200000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55600000000000005,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48899999999999999,"15min":0.47599999999999998},"min":{"1min":0.314,"5min":0.253,"15min":0.253},"max":{"1min":0.56599999999999995,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58399999999999996,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.505,"15min":0.499},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":2.734,"15min":2.734},"last":0.53700000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68700000000000006,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61599999999999999,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.57499999999999996,"5min":0.435,"15min":0.435},"max":{"1min":0.93100000000000005,"5min":3.101,"15min":3.101},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1240000000000001,"5min":3.359,"15min":3.359},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.54700000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0669999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.78700000000000003,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.96999999999999997,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.81499999999999995},"min":{"1min":0.57499999999999996,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.036,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78500000000000003,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.038,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83599999999999997,"15min":0.82899999999999996},"min":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.145,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28536,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343304,"statfs":{"total":96636764160,"available":96607543296,"internally_reserved":0,"allocated":1552384,"data_stored":727349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.30199999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60499999999999998,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.45100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42399999999999999,"15min":0.41699999999999998},"min":{"1min":0.34999999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.501},"min":{"1min":0.38500000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.63800000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.371}]},{"osd":3,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.496,"15min":0.51200000000000001},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.58099999999999996},"min":{"1min":0.44400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70299999999999996,"15min":0.70899999999999996},"min":{"1min":0.495,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.355,"15min":1.355},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94299999999999995,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.96599999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76700000000000002,"15min":0.74299999999999999},"min":{"1min":0.621,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0609999999999999,"5min":1.123,"15min":1.123},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.032,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.1859999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":0.75600000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.90100000000000002,"5min":1.329,"15min":1.329},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.94799999999999995,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.0469999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.79400000000000004},"min":{"1min":0.59399999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.96899999999999997,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.94699999999999995,"5min":1.288,"15min":1.288},"last":1.022}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1556480,"data_stored":728895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.437,"15min":0.50600000000000001},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56699999999999995,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48599999999999999,"15min":0.55000000000000004},"min":{"1min":0.34100000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.64700000000000002,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51300000000000001,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80900000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.35199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.621,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":0.76200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.56699999999999995},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.66300000000000003,"5min":1.8480000000000001,"15min":1.8480000000000001},"last":0.374},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57899999999999996,"15min":0.67100000000000004},"min":{"1min":0.439,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70599999999999996,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.81200000000000006},"min":{"1min":0.55600000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":1.669,"15min":1.669},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76300000000000001,"15min":0.78900000000000003},"min":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":1.994,"15min":1.994},"last":0.80400000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55300000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.95599999999999996,"5min":2.036,"15min":2.036},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80300000000000005},"min":{"1min":0.502,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94099999999999995,"5min":1.26,"15min":1.26},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.82199999999999995},"min":{"1min":0.54500000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96599999999999997,"5min":1.321,"15min":1.321},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78100000000000003,"15min":0.83999999999999997},"min":{"1min":0.623,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89600000000000002,"5min":1.627,"15min":1.627},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:27:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.84999999999999998},"min":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93799999999999994,"5min":2.073,"15min":2.073},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.80000000000000004,"15min":0.85799999999999998},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.98699999999999999,"5min":1.323,"15min":1.323},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574924,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":728975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46000000000000002,"15min":0.59899999999999998},"min":{"1min":0.30499999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.52000000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.28899999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83799999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.54400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.64400000000000002,"15min":1.1459999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70299999999999996,"5min":18.928000000000001,"15min":18.928000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.628,"5min":5.5380000000000003,"15min":5.5380000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.54200000000000004,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.70099999999999996},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.74099999999999999,"5min":5.5700000000000003,"15min":5.5700000000000003},"last":0.56699999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77300000000000002,"15min":0.90000000000000002},"min":{"1min":0.55300000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.022,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.75800000000000001,"15min":0.80300000000000005},"min":{"1min":0.48899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96399999999999997,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.81699999999999995},"min":{"1min":0.55000000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.429,"15min":1.429},"last":0.753},{"interface":"front","average":{"1min":0.747,"5min":0.81000000000000005,"15min":0.96999999999999997},"min":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93300000000000005,"5min":5.5039999999999996,"15min":5.5039999999999996},"last":0.67400000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.81200000000000006,"15min":0.95399999999999996},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99399999999999999,"5min":5.4699999999999998,"15min":5.4699999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80200000000000005,"15min":0.94399999999999995},"min":{"1min":0.622,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.90700000000000003,"5min":5.0389999999999997,"15min":5.0389999999999997},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:27:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.82899999999999996,"15min":0.96099999999999997},"min":{"1min":0.53600000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96399999999999997,"5min":5,"15min":5},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.81999999999999995},"min":{"1min":0.56999999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97699999999999998,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1548288,"data_stored":728279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65300000000000002,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.317,"15min":0.317},"max":{"1min":0.92100000000000004,"5min":1.161,"15min":1.161},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.66100000000000003},"min":{"1min":0.38800000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.91400000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.71099999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.028},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83299999999999996,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95199999999999996,"5min":1.173,"15min":1.173},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.53900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.69199999999999995},"min":{"1min":0.48599999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93400000000000005,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.54000000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.96699999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.73299999999999998},"min":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0600000000000001,"5min":1.25,"15min":1.25},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73999999999999999,"15min":0.70299999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.006,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.499,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0049999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.625},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.59799999999999998,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1080000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:27:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79100000000000004,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.044,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.82199999999999995,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1240000000000001,"5min":1.232,"15min":1.232},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28540,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343300,"statfs":{"total":96636764160,"available":96607539200,"internally_reserved":0,"allocated":1548288,"data_stored":727315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65900000000000003,"15min":0.629},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94499999999999995,"5min":1.105,"15min":1.105},"last":0.876},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0549999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69599999999999995,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0369999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80900000000000005}]},{"osd":2,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71999999999999997,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97799999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75700000000000001,"15min":0.73599999999999999},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1259999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.71199999999999997},"min":{"1min":0.53300000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.755}]},{"osd":4,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70699999999999996,"15min":0.72599999999999998},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0109999999999999,"5min":1.744,"15min":1.744},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.747,"15min":0.76800000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77900000000000003,"15min":0.78700000000000003},"min":{"1min":0.503,"5min":0.443,"15min":0.443},"max":{"1min":1.2230000000000001,"5min":1.663,"15min":1.663},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58299999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.83599999999999997,"15min":0.81899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:46.079 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:28:46.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:28:46.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.320+0000 7f671a1ff700 1 Processor -- start 2023-08-27T11:28:46.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.320+0000 7f671a1ff700 1 -- start start 2023-08-27T11:28:46.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f671a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c02c0 0x7f6714151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f671a1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67140c2120 0x7f67140c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f671a1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6714152350 con 0x7f671414e860 2023-08-27T11:28:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f671a1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67141558d0 con 0x7f67140c2120 2023-08-27T11:28:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f671a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140a8c00 con 0x7f67140c02c0 2023-08-27T11:28:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f6713fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67140c2120 0x7f67140c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.321+0000 7f6713fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67140c2120 0x7f67140c25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36644/0 (socket says 172.21.15.43:36644) 2023-08-27T11:28:46.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 -- 172.21.15.43:0/734356039 learned_addr learned my addr 172.21.15.43:0/734356039 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:46.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6712ffd700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c02c0 0x7f6714151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 -- 172.21.15.43:0/734356039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c02c0 msgr2=0x7f6714151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:46.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c02c0 0x7f6714151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 -- 172.21.15.43:0/734356039 >> v1:172.21.15.57:6789/0 conn(0x7f671414e860 legacy=0x7f67141551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:46.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 -- 172.21.15.43:0/734356039 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6714154d30 con 0x7f67140c2120 2023-08-27T11:28:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f6713fff700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c2120 0x7f67140c25b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f670c00d150 tx=0x7f670c00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1120ebf6cd9bd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f67127fc700 1 -- 172.21.15.43:0/734356039 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c010070 con 0x7f67140c2120 2023-08-27T11:28:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f67127fc700 1 -- 172.21.15.43:0/734356039 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00dd80 con 0x7f67140c2120 2023-08-27T11:28:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.322+0000 7f67127fc700 1 -- 172.21.15.43:0/734356039 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00b310 con 0x7f67140c2120 2023-08-27T11:28:46.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 -- 172.21.15.43:0/734356039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c2120 msgr2=0x7f67140c25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c2120 0x7f67140c25b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f670c00d150 tx=0x7f670c00d460 comp rx=0 tx=0).stop 2023-08-27T11:28:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 -- 172.21.15.43:0/734356039 shutdown_connections 2023-08-27T11:28:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c2120 0x7f67140c25b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 --2- 172.21.15.43:0/734356039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c02c0 0x7f6714151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 -- 172.21.15.43:0/734356039 >> 172.21.15.43:0/734356039 conn(0x7f671406a310 msgr2=0x7f671406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:46.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 -- 172.21.15.43:0/734356039 shutdown_connections 2023-08-27T11:28:46.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.323+0000 7f671a1ff700 1 -- 172.21.15.43:0/734356039 wait complete. 2023-08-27T11:28:46.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.325+0000 7f671a1ff700 1 Processor -- start 2023-08-27T11:28:46.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.325+0000 7f671a1ff700 1 -- start start 2023-08-27T11:28:46.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 0x7f67140bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 0x7f67141ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67140bd810 con 0x7f67140c02c0 2023-08-27T11:28:46.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671414c280 con 0x7f671414e860 2023-08-27T11:28:46.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f671a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714070260 con 0x7f67140c2120 2023-08-27T11:28:46.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f67137fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f67137fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36652/0 (socket says 172.21.15.43:36652) 2023-08-27T11:28:46.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f67137fe700 1 -- 172.21.15.43:0/1404487571 learned_addr learned my addr 172.21.15.43:0/1404487571 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:46.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f6712ffd700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 0x7f67140bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.326+0000 7f6713fff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 0x7f67141ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 -- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 msgr2=0x7f67140bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 0x7f67140bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 -- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 msgr2=0x7f67141ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 0x7f67141ecff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 -- 172.21.15.43:0/1404487571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c00bd40 con 0x7f67140c02c0 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f6712ffd700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 0x7f67140bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f6713fff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 0x7f67141ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f67137fe700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f670400b4d0 tx=0x7f670400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011830 con 0x7f67140c02c0 2023-08-27T11:28:46.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6704011990 con 0x7f67140c02c0 2023-08-27T11:28:46.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67140726e0 con 0x7f67140c02c0 2023-08-27T11:28:46.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704011d40 con 0x7f67140c02c0 2023-08-27T11:28:46.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.327+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714071290 con 0x7f67140c02c0 2023-08-27T11:28:46.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.328+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6714071480 con 0x7f67140c02c0 2023-08-27T11:28:46.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.329+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f670401a400 con 0x7f67140c02c0 2023-08-27T11:28:46.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.330+0000 7f66fbfff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 0x7f670006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.330+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6704088270 con 0x7f67140c02c0 2023-08-27T11:28:46.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.331+0000 7f6712ffd700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 0x7f670006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.331+0000 7f6712ffd700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 0x7f670006c5a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6714151900 tx=0x7f6708008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.334+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f67040539f0 con 0x7f67140c02c0 2023-08-27T11:28:46.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.631+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6714074680 con 0x7f67140c02c0 2023-08-27T11:28:46.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.636+0000 7f66fbfff700 1 -- 172.21.15.43:0/1404487571 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6704057010 con 0x7f67140c02c0 2023-08-27T11:28:46.637 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:28:46.638 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:28:46.638 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:28:46.638 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:28:46.638 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:28:46.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 msgr2=0x7f670006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 0x7f670006c5a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f6714151900 tx=0x7f6708008040 comp rx=0 tx=0).stop 2023-08-27T11:28:46.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 msgr2=0x7f67140721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f670400b4d0 tx=0x7f670400b890 comp rx=0 tx=0).stop 2023-08-27T11:28:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 shutdown_connections 2023-08-27T11:28:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f670006a0e0 0x7f670006c5a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671414e860 0x7f67141ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67140c02c0 0x7f67140721a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 --2- 172.21.15.43:0/1404487571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67140c2120 0x7f67140bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 >> 172.21.15.43:0/1404487571 conn(0x7f671406a310 msgr2=0x7f67140c1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 shutdown_connections 2023-08-27T11:28:46.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.638+0000 7f671a1ff700 1 -- 172.21.15.43:0/1404487571 wait complete. 2023-08-27T11:28:46.643 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:28:46.657 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.858+0000 7fb4ab9ff700 1 Processor -- start 2023-08-27T11:28:46.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.858+0000 7fb4ab9ff700 1 -- start start 2023-08-27T11:28:46.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4ab9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a4151a90 0x7fb4a40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4ab9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb4a40c4a90 0x7fb4a406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4ab9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a406c4e0 con 0x7fb4a40c4630 2023-08-27T11:28:46.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4ab9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a4155370 con 0x7fb4a40c4a90 2023-08-27T11:28:46.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4ab9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a4151e70 con 0x7fb4a4151a90 2023-08-27T11:28:46.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4a9f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb4a40c4a90 0x7fb4a406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4a9f9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb4a40c4a90 0x7fb4a406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36668/0 (socket says 172.21.15.43:36668) 2023-08-27T11:28:46.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4a9f9c700 1 -- 172.21.15.43:0/612552172 learned_addr learned my addr 172.21.15.43:0/612552172 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:46.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.859+0000 7fb4a979b700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a4151a90 0x7fb4a40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb4a9f9c700 1 -- 172.21.15.43:0/612552172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a4151a90 msgr2=0x7fb4a40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb4a9f9c700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a4151a90 0x7fb4a40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb4a9f9c700 1 -- 172.21.15.43:0/612552172 >> v1:172.21.15.57:6789/0 conn(0x7fb4a40c4630 legacy=0x7fb4a406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb4a9f9c700 1 -- 172.21.15.43:0/612552172 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4154480 con 0x7fb4a40c4a90 2023-08-27T11:28:46.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb4a9f9c700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a406b480 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e50 tx=0x7fb49c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adc262bcb2da50d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb49bfff700 1 -- 172.21.15.43:0/612552172 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00e070 con 0x7fb4a40c4a90 2023-08-27T11:28:46.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb49bfff700 1 -- 172.21.15.43:0/612552172 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00b910 con 0x7fb4a40c4a90 2023-08-27T11:28:46.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.860+0000 7fb49bfff700 1 -- 172.21.15.43:0/612552172 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00bcc0 con 0x7fb4a40c4a90 2023-08-27T11:28:46.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/612552172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 msgr2=0x7fb4a406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a406b480 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009e50 tx=0x7fb49c00b330 comp rx=0 tx=0).stop 2023-08-27T11:28:46.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/612552172 shutdown_connections 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a406b480 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/612552172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a4151a90 0x7fb4a40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/612552172 >> 172.21.15.43:0/612552172 conn(0x7fb4a40ab820 msgr2=0x7fb4a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/612552172 shutdown_connections 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.861+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/612552172 wait complete. 2023-08-27T11:28:46.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.863+0000 7fb4ab9ff700 1 Processor -- start 2023-08-27T11:28:46.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.863+0000 7fb4ab9ff700 1 -- start start 2023-08-27T11:28:46.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a40c4630 0x7fb4a414bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a4151a90 0x7fb4a41ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40c9520 con 0x7fb4a40c4a90 2023-08-27T11:28:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a41566d0 con 0x7fb4a4151a90 2023-08-27T11:28:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4ab9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a41ecc40 con 0x7fb4a40c4630 2023-08-27T11:28:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36678/0 (socket says 172.21.15.43:36678) 2023-08-27T11:28:46.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 -- 172.21.15.43:0/3829881897 learned_addr learned my addr 172.21.15.43:0/3829881897 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:46.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 -- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a40c4630 msgr2=0x7fb4a414bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a40c4630 0x7fb4a414bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 -- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a4151a90 msgr2=0x7fb4a41ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:46.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a4151a90 0x7fb4a41ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:46.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.864+0000 7fb4a8f9a700 1 -- 172.21.15.43:0/3829881897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009b30 con 0x7fb4a40c4a90 2023-08-27T11:28:46.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb4a8f9a700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c510 tx=0x7fb49400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940052d0 con 0x7fb4a40c4a90 2023-08-27T11:28:46.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494005450 con 0x7fb4a40c4a90 2023-08-27T11:28:46.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940038c0 con 0x7fb4a40c4a90 2023-08-27T11:28:46.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a4155980 con 0x7fb4a40c4a90 2023-08-27T11:28:46.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.865+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a414c4e0 con 0x7fb4a40c4a90 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.866+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a41ece40 con 0x7fb4a40c4a90 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.867+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb494003a20 con 0x7fb4a40c4a90 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.868+0000 7fb499ffb700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.868+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb4940879c0 con 0x7fb4a40c4a90 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.868+0000 7fb4a979b700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:46.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.869+0000 7fb4a979b700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0006b20 tx=0x7fb4a0006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:46.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:46.872+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb4a41ece40 con 0x7fb4a40c4a90 2023-08-27T11:28:47.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.131+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4a41ece00 con 0x7fb4a40c4a90 2023-08-27T11:28:47.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.131+0000 7fb499ffb700 1 -- 172.21.15.43:0/3829881897 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4883 (secure 0 0 0) 0x7fb4940530a0 con 0x7fb4a40c4a90 2023-08-27T11:28:47.133 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:47.133 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":130,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124},{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125},{"gid":8091,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:28:39.024709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8097":{"gid":8097,"name":"d","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2179580288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2179580288},{"type":"v1","addr":"172.21.15.57:6835","nonce":2179580288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-27T11:28:47.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.133+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 msgr2=0x7fb48806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.133+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0006b20 tx=0x7fb4a0006ab0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.133+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 msgr2=0x7fb4a41ed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.133+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c510 tx=0x7fb49400c8d0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.133+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 shutdown_connections 2023-08-27T11:28:47.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb48806a0e0 0x7fb48806c5a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a4151a90 0x7fb4a41ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb4a40c4630 0x7fb4a414bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 --2- 172.21.15.43:0/3829881897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb4a40c4a90 0x7fb4a41ed120 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 >> 172.21.15.43:0/3829881897 conn(0x7fb4a40ab820 msgr2=0x7fb4a4150b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 shutdown_connections 2023-08-27T11:28:47.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.134+0000 7fb4ab9ff700 1 -- 172.21.15.43:0/3829881897 wait complete. 2023-08-27T11:28:47.138 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 130 2023-08-27T11:28:47.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 130, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:28:35.519882+0000', 'modified': '2023-08-27T11:28:39.024709+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8097}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8097': {'gid': 8097, 'name': 'd', 'rank': 0, 'incarnation': 126, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2179580288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2179580288}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2179580288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:28:47.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:28:47.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:28:47.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.761+0000 7fd0083ff700 1 Processor -- start 2023-08-27T11:28:47.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.762+0000 7fd0083ff700 1 -- start start 2023-08-27T11:28:47.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd0083ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd00006ca60 0x7fd00006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd0083ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00006d700 con 0x7fd0000c51a0 2023-08-27T11:28:47.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd0083ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd000152430 con 0x7fd000155910 2023-08-27T11:28:47.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd0083ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0001530b0 con 0x7fd00006ca60 2023-08-27T11:28:47.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd00619b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd0000c51a0 0x7fd0000aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47388/0 (socket says 172.21.15.43:47388) 2023-08-27T11:28:47.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd00619b700 1 -- 172.21.15.43:0/2298503920 learned_addr learned my addr 172.21.15.43:0/2298503920 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:47.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd00599a700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd00006ca60 0x7fd00006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010253445 0 0) 0x7fd00006d700 con 0x7fd0000c51a0 2023-08-27T11:28:47.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.763+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec0035b0 con 0x7fd0000c51a0 2023-08-27T11:28:47.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328407315 0 0) 0x7fd000152430 con 0x7fd000155910 2023-08-27T11:28:47.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd00006d700 con 0x7fd000155910 2023-08-27T11:28:47.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739829432 0 0) 0x7fcfec0035b0 con 0x7fd0000c51a0 2023-08-27T11:28:47.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd00006ca60 msgr2=0x7fd00006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd00006ca60 0x7fd00006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 >> v1:172.21.15.57:6789/0 conn(0x7fd000155910 legacy=0x7fd000155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000152710 con 0x7fd0000c51a0 2023-08-27T11:28:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fcffc001670 con 0x7fd0000c51a0 2023-08-27T11:28:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 >> v1:172.21.15.43:6789/0 conn(0x7fd0000c51a0 legacy=0x7fd0000aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec003bc0 0x7fcfec003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfec004850 0x7fcfec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfec005210 0x7fcfec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0001530b0 con 0x7fcfec005210 2023-08-27T11:28:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00c080 con 0x7fcfec003bc0 2023-08-27T11:28:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec00c240 con 0x7fcfec004850 2023-08-27T11:28:47.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd00599a700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd00006ca60 0x7fd00006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd00699c700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfec005210 0x7fcfec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.764+0000 7fd00619b700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec003bc0 0x7fcfec003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00599a700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfec004850 0x7fcfec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 -- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfec004850 msgr2=0x7fcfec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfec004850 0x7fcfec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 -- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec003bc0 msgr2=0x7fcfec003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec003bc0 0x7fcfec003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 -- 172.21.15.43:0/2298503920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0035b0 con 0x7fcfec005210 2023-08-27T11:28:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd00699c700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfec005210 0x7fcfec00ba10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c2f0 tx=0x7fcfec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd8fca17e017691 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8001f30 con 0x7fcfec005210 2023-08-27T11:28:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff800ce90 con 0x7fcfec005210 2023-08-27T11:28:47.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.765+0000 7fd005199700 1 -- 172.21.15.43:0/2298503920 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8003c40 con 0x7fcfec005210 2023-08-27T11:28:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 -- 172.21.15.43:0/2298503920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfec005210 msgr2=0x7fcfec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 --2- 172.21.15.43:0/2298503920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfec005210 0x7fcfec00ba10 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c2f0 tx=0x7fcfec005880 comp rx=0 tx=0).stop 2023-08-27T11:28:47.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd00699c700 1 -- 172.21.15.43:0/2298503920 reap_dead start 2023-08-27T11:28:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 -- 172.21.15.43:0/2298503920 shutdown_connections 2023-08-27T11:28:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 -- 172.21.15.43:0/2298503920 >> 172.21.15.43:0/2298503920 conn(0x7fd00006aa50 msgr2=0x7fd0000c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 -- 172.21.15.43:0/2298503920 shutdown_connections 2023-08-27T11:28:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.766+0000 7fd0083ff700 1 -- 172.21.15.43:0/2298503920 wait complete. 2023-08-27T11:28:47.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.768+0000 7fd0083ff700 1 Processor -- start 2023-08-27T11:28:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.768+0000 7fd0083ff700 1 -- start start 2023-08-27T11:28:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 0x7fd0000bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 0x7fd0000c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00006f580 con 0x7fd0000c5ca0 2023-08-27T11:28:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00006fab0 con 0x7fcfec005210 2023-08-27T11:28:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd0083ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00006f7d0 con 0x7fd0001ed520 2023-08-27T11:28:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36710/0 (socket says 172.21.15.43:36710) 2023-08-27T11:28:47.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 -- 172.21.15.43:0/987138903 learned_addr learned my addr 172.21.15.43:0/987138903 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00619b700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 0x7fd0000bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00599a700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 0x7fd0000c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 -- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 msgr2=0x7fd0000c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 0x7fd0000c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 -- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 msgr2=0x7fd0000bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 0x7fd0000bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00699c700 1 -- 172.21.15.43:0/987138903 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0001eca40 con 0x7fd0000c5ca0 2023-08-27T11:28:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.769+0000 7fd00619b700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 0x7fd0000bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fd00599a700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 0x7fd0000c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:47.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fd00699c700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c050 tx=0x7fcff8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fcff6ffd700 1 -- 172.21.15.43:0/987138903 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800cc90 con 0x7fd0000c5ca0 2023-08-27T11:28:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fcff6ffd700 1 -- 172.21.15.43:0/987138903 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80050d0 con 0x7fd0000c5ca0 2023-08-27T11:28:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fcff6ffd700 1 -- 172.21.15.43:0/987138903 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8005480 con 0x7fd0000c5ca0 2023-08-27T11:28:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0001ecd20 con 0x7fd0000c5ca0 2023-08-27T11:28:47.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.770+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000bfa90 con 0x7fd0000c5ca0 2023-08-27T11:28:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.772+0000 7fcff6ffd700 1 -- 172.21.15.43:0/987138903 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcff8019070 con 0x7fd0000c5ca0 2023-08-27T11:28:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.774+0000 7fcff6ffd700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 0x7fcfe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.774+0000 7fcff6ffd700 1 -- 172.21.15.43:0/987138903 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcff8089380 con 0x7fd0000c5ca0 2023-08-27T11:28:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.774+0000 7fd00619b700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 0x7fcfe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.775+0000 7fd00619b700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 0x7fcfe406c5a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd0000bdda0 tx=0x7fcffc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.776+0000 7fd01bd01b80 1 Processor -- start 2023-08-27T11:28:47.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.776+0000 7fd01bd01b80 1 -- start start 2023-08-27T11:28:47.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd0cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd22500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cc47730 con 0x556a0cceffe0 2023-08-27T11:28:47.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cc45050 con 0x556a0ccea2e0 2023-08-27T11:28:47.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a0cc40940 con 0x556a0cce9f00 2023-08-27T11:28:47.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd00599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd00599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36712/0 (socket says 172.21.15.43:36712) 2023-08-27T11:28:47.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd00599a700 1 -- 172.21.15.43:0/137931954 learned_addr learned my addr 172.21.15.43:0/137931954 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:47.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd00619b700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd0cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.777+0000 7fd00699c700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd22500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 -- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 msgr2=0x556a0cd0cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd0cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 -- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 msgr2=0x556a0cd22500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd22500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 -- 172.21.15.43:0/137931954 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0cac05e0 con 0x556a0cceffe0 2023-08-27T11:28:47.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00699c700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd22500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:47.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fd00599a700 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009a60 tx=0x7fcff0009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab2c58d52c4f0da server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fcfe3fff700 1 -- 172.21.15.43:0/137931954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0012bd0 con 0x556a0cceffe0 2023-08-27T11:28:47.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fcfe3fff700 1 -- 172.21.15.43:0/137931954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0012d30 con 0x556a0cceffe0 2023-08-27T11:28:47.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.778+0000 7fcfe3fff700 1 -- 172.21.15.43:0/137931954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0015650 con 0x556a0cceffe0 2023-08-27T11:28:47.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 -- 172.21.15.43:0/137931954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 msgr2=0x556a0cd0d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009a60 tx=0x7fcff0009210 comp rx=0 tx=0).stop 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 -- 172.21.15.43:0/137931954 shutdown_connections 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd22500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd0cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/137931954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0cceffe0 0x556a0cd0d2b0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 -- 172.21.15.43:0/137931954 >> 172.21.15.43:0/137931954 conn(0x556a0cc4cc30 msgr2=0x556a0ccec6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 -- 172.21.15.43:0/137931954 shutdown_connections 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.779+0000 7fd01bd01b80 1 -- 172.21.15.43:0/137931954 wait complete. 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.780+0000 7fd01bd01b80 1 -- start start 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.780+0000 7fd01bd01b80 1 Processor -- start 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 0x556a0cd12e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cd133c0 0x556a0cd3a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cbdeb60 con 0x556a0ccea2e0 2023-08-27T11:28:47.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cbde860 con 0x556a0cce9f00 2023-08-27T11:28:47.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a0cac28d0 con 0x556a0cd133c0 2023-08-27T11:28:47.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd01bd01b80 10 client.0 _ll_register_callbacks cb 0x556a0cbdc630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:47.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36718/0 (socket says 172.21.15.43:36718) 2023-08-27T11:28:47.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 -- 172.21.15.43:0/3742446823 learned_addr learned my addr 172.21.15.43:0/3742446823 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:47.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00619b700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 0x556a0cd12e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00699c700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cd133c0 0x556a0cd3a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 -- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cd133c0 msgr2=0x556a0cd3a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cd133c0 0x556a0cd3a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 -- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 msgr2=0x556a0cd12e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 0x556a0cd12e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00599a700 1 -- 172.21.15.43:0/3742446823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff00094a0 con 0x556a0ccea2e0 2023-08-27T11:28:47.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.782+0000 7fd00619b700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 0x556a0cd12e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:47.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fd00599a700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcff0019000 tx=0x7fcff0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5484c4ee61f0fb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fcfe17fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0024070 con 0x556a0ccea2e0 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a0cce14f0 con 0x556a0ccea2e0 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcff0004550 con 0x556a0ccea2e0 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcff0012ea0 con 0x556a0ccea2e0 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fd01bd01b80 10 client.8256 fetch_fsmap learned FSMap version 130 2023-08-27T11:28:47.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.783+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x556a0cc58750 con 0x556a0ccea2e0 2023-08-27T11:28:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a0cce14f0 con 0x556a0ccea2e0 2023-08-27T11:28:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 130) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcff00036a0 con 0x556a0ccea2e0 2023-08-27T11:28:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 10 client.8256 fetch_fsmap finished waiting for FSMap version 130 2023-08-27T11:28:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 10 client.8256 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:28:47.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 20 client.8256 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd3d510 0x556a0cd3d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 4 client.8256 mds_command: new command op to 8097 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 --> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a0cc39920 con 0x556a0cd3d510 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.784+0000 7fd00619b700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd3d510 0x556a0cd3d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.785+0000 7fd00619b700 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd3d510 0x556a0cd3d8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f7989706a78069c server_cookie=9a82d2261b5cdcaa in_seq=0 out_seq=0 2023-08-27T11:28:47.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.785+0000 7fcfe17fa700 10 client.8256 ms_handle_connect on v2:172.21.15.57:6833/2179580288 2023-08-27T11:28:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3742446823 <== mds.0 v2:172.21.15.57:6833/2179580288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556a0cc39920 con 0x556a0cd3d510 2023-08-27T11:28:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fcfe17fa700 10 client.8256 handle_command_reply: tid=0 2023-08-27T11:28:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 client.8256 shutdown 2023-08-27T11:28:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 msgr2=0x556a0cd3a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fcff0019000 tx=0x7fcff0004750 comp rx=0 tx=0).stop 2023-08-27T11:28:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 shutdown_connections 2023-08-27T11:28:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd3d510 0x556a0cd3d8f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cd133c0 0x556a0cd3a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0cce9f00 0x556a0cd12e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fcfe17fa700 0 client.8256 ms_handle_reset on v2:172.21.15.57:6833/2179580288 2023-08-27T11:28:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3742446823 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccea2e0 0x556a0cd3a3f0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 >> 172.21.15.43:0/3742446823 conn(0x556a0cc4cc30 msgr2=0x556a0cd28100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 shutdown_connections 2023-08-27T11:28:47.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3742446823 wait complete. 2023-08-27T11:28:47.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.786+0000 7fd01bd01b80 20 client.8256 trim_cache size 0 max 16384 2023-08-27T11:28:47.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 Processor -- start 2023-08-27T11:28:47.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 -- start start 2023-08-27T11:28:47.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd3a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0ccec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.805+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cd12c40 con 0x556a0ccece30 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cced2b0 con 0x556a0ccea2e0 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a0cd3b240 con 0x556a0cce9f00 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36722/0 (socket says 172.21.15.43:36722) 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 -- 172.21.15.43:0/2394016832 learned_addr learned my addr 172.21.15.43:0/2394016832 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:47.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00599a700 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0ccec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00619b700 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd3a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 -- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 msgr2=0x556a0cd3a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd3a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 -- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 msgr2=0x556a0ccec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0ccec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 -- 172.21.15.43:0/2394016832 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a0cd0b960 con 0x556a0ccece30 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.806+0000 7fd00699c700 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fcff80587d0 tx=0x7fcff80581a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f703c7c858873a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fcff4bff700 1 -- 172.21.15.43:0/2394016832 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80011c0 con 0x556a0ccece30 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fcff4bff700 1 -- 172.21.15.43:0/2394016832 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8058ed0 con 0x556a0ccece30 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fcff4bff700 1 -- 172.21.15.43:0/2394016832 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff805c600 con 0x556a0ccece30 2023-08-27T11:28:47.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 -- 172.21.15.43:0/2394016832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 msgr2=0x556a0cd43920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fcff80587d0 tx=0x7fcff80581a0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 -- 172.21.15.43:0/2394016832 shutdown_connections 2023-08-27T11:28:47.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd43920 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd3a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/2394016832 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0ccec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 -- 172.21.15.43:0/2394016832 >> 172.21.15.43:0/2394016832 conn(0x556a0cc4cc30 msgr2=0x556a0cce5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 -- 172.21.15.43:0/2394016832 shutdown_connections 2023-08-27T11:28:47.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.807+0000 7fd01bd01b80 1 -- 172.21.15.43:0/2394016832 wait complete. 2023-08-27T11:28:47.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.808+0000 7fd01bd01b80 1 -- start start 2023-08-27T11:28:47.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.808+0000 7fd01bd01b80 1 Processor -- start 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd20750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd44230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cd0bfe0 con 0x556a0ccece30 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a0cd95c70 con 0x556a0ccea2e0 2023-08-27T11:28:47.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a0cd95a60 con 0x556a0cce9f00 2023-08-27T11:28:47.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd01bd01b80 10 client.0 _ll_register_callbacks cb 0x556a0cbdc630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:28:47.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd00699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36732/0 (socket says 172.21.15.43:36732) 2023-08-27T11:28:47.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.809+0000 7fd00699c700 1 -- 172.21.15.43:0/3042719688 learned_addr learned my addr 172.21.15.43:0/3042719688 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:47.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00599a700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd44230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00619b700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd20750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 -- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 msgr2=0x556a0cd20750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd20750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 -- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 msgr2=0x556a0cd44230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:47.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd44230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 -- 172.21.15.43:0/3042719688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000bfa90 con 0x556a0ccece30 2023-08-27T11:28:47.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd00699c700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c960 tx=0x7fcff800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d40ce633fbae7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:47.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fcfe17fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:28:47.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8086070 con 0x556a0ccece30 2023-08-27T11:28:47.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcff8060550 con 0x556a0ccece30 2023-08-27T11:28:47.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a0cd127f0 con 0x556a0ccece30 2023-08-27T11:28:47.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcff805c600 con 0x556a0ccece30 2023-08-27T11:28:47.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd01bd01b80 10 client.8262 fetch_fsmap learned FSMap version 130 2023-08-27T11:28:47.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.810+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x556a0ca6cd90 con 0x556a0ccece30 2023-08-27T11:28:47.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8066020 con 0x556a0ccece30 2023-08-27T11:28:47.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 130) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcff8087260 con 0x556a0ccece30 2023-08-27T11:28:47.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 10 client.8262 fetch_fsmap finished waiting for FSMap version 130 2023-08-27T11:28:47.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 10 client.8262 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:28:47.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 20 client.8262 populate_metadata read hostname 'smithi043' 2023-08-27T11:28:47.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd8f620 0x556a0ccee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:47.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 4 client.8262 mds_command: new command op to 8097 tid=0[{"prefix": "status"}] 2023-08-27T11:28:47.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 --> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fcff0012d30 con 0x556a0cd8f620 2023-08-27T11:28:47.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.811+0000 7fd00619b700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd8f620 0x556a0ccee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:47.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fcfe17fa700 10 client.8262 ms_handle_connect on v2:172.21.15.57:6833/2179580288 2023-08-27T11:28:47.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd00619b700 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd8f620 0x556a0ccee0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b19de21522720b3 server_cookie=af06428dcbe0a7c5 in_seq=0 out_seq=0 2023-08-27T11:28:47.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fcfe17fa700 1 -- 172.21.15.43:0/3042719688 <== mds.0 v2:172.21.15.57:6833/2179580288 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x7fcff0012d30 con 0x556a0cd8f620 2023-08-27T11:28:47.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fcfe17fa700 10 client.8262 handle_command_reply: tid=0 2023-08-27T11:28:47.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 client.8262 shutdown 2023-08-27T11:28:47.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 msgr2=0x556a0cd95520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c960 tx=0x7fcff800cdf0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 shutdown_connections 2023-08-27T11:28:47.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:6833/2179580288,v1:172.21.15.57:6835/2179580288] conn(0x556a0cd8f620 0x556a0ccee0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556a0ccece30 0x556a0cd95520 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x556a0cce9f00 0x556a0cd20750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 --2- 172.21.15.43:0/3042719688 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x556a0ccea2e0 0x556a0cd44230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fcfe17fa700 0 client.8262 ms_handle_reset on v2:172.21.15.57:6833/2179580288 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 >> 172.21.15.43:0/3042719688 conn(0x556a0cc4cc30 msgr2=0x556a0ccec6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 shutdown_connections 2023-08-27T11:28:47.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.812+0000 7fd01bd01b80 1 -- 172.21.15.43:0/3042719688 wait complete. 2023-08-27T11:28:47.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd01bd01b80 20 client.8262 trim_cache size 0 max 16384 2023-08-27T11:28:47.830 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:28:47.830 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 8097, 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:28:47.831 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 11.793740998000001, 2023-08-27T11:28:47.832 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 130, 2023-08-27T11:28:47.832 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 124, 2023-08-27T11:28:47.832 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 124, 2023-08-27T11:28:47.832 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 18.011267665999998 2023-08-27T11:28:47.832 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:28:47.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 msgr2=0x7fcfe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 0x7fcfe406c5a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd0000bdda0 tx=0x7fcffc009040 comp rx=0 tx=0).stop 2023-08-27T11:28:47.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 msgr2=0x7fd0001e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:47.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c050 tx=0x7fcff8001650 comp rx=0 tx=0).stop 2023-08-27T11:28:47.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 shutdown_connections 2023-08-27T11:28:47.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfe406a0e0 0x7fcfe406c5a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd0000c5ca0 0x7fd0001e9330 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfec005210 0x7fd0000bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 --2- 172.21.15.43:0/987138903 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0001ed520 0x7fd0000c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:47.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 >> 172.21.15.43:0/987138903 conn(0x7fd00006aa50 msgr2=0x7fd0000c3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:47.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 shutdown_connections 2023-08-27T11:28:47.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:47.813+0000 7fd0083ff700 1 -- 172.21.15.43:0/987138903 wait complete. 2023-08-27T11:28:47.836 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:48.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.039+0000 7f1fc0bff700 1 Processor -- start 2023-08-27T11:28:48.041 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.040+0000 7f1fc0bff700 1 -- start start 2023-08-27T11:28:48.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fc0bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1fbc0c15e0 0x7f1fbc15fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fc0bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0c5ae0 con 0x7f1fbc0c51a0 2023-08-27T11:28:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fc0bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0c1190 con 0x7f1fbc151910 2023-08-27T11:28:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fc0bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fbc072900 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fb3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1fbc0c51a0 0x7f1fbc0c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47400/0 (socket says 172.21.15.43:47400) 2023-08-27T11:28:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fbad9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1fbc0c15e0 0x7f1fbc15fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fb3fff700 1 -- 172.21.15.43:0/3074317495 learned_addr learned my addr 172.21.15.43:0/3074317495 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fbad9d700 1 -- 172.21.15.43:0/3074317495 >> v1:172.21.15.57:6789/0 conn(0x7f1fbc151910 legacy=0x7f1fbc157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.041+0000 7f1fb9d9b700 1 -- 172.21.15.43:0/3074317495 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030671742 0 0) 0x7f1fbc0c5ae0 con 0x7f1fbc0c51a0 2023-08-27T11:28:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fbad9d700 1 -- 172.21.15.43:0/3074317495 >> v1:172.21.15.43:6789/0 conn(0x7f1fbc0c51a0 legacy=0x7f1fbc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fbad9d700 1 -- 172.21.15.43:0/3074317495 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0c6c00 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fbad9d700 1 --2- 172.21.15.43:0/3074317495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc0c15e0 0x7f1fbc15fda0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009d90 tx=0x7f1fb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7512d1ec7c5a5a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fb9d9b700 1 -- 172.21.15.43:0/3074317495 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb400e070 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fb9d9b700 1 -- 172.21.15.43:0/3074317495 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb400bbd0 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.042+0000 7f1fb9d9b700 1 -- 172.21.15.43:0/3074317495 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4012430 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 -- 172.21.15.43:0/3074317495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc0c15e0 msgr2=0x7f1fbc15fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/3074317495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc0c15e0 0x7f1fbc15fda0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009d90 tx=0x7f1fb400b330 comp rx=0 tx=0).stop 2023-08-27T11:28:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 -- 172.21.15.43:0/3074317495 shutdown_connections 2023-08-27T11:28:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/3074317495 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc0c15e0 0x7f1fbc15fda0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 -- 172.21.15.43:0/3074317495 >> 172.21.15.43:0/3074317495 conn(0x7f1fbc0a9740 msgr2=0x7f1fbc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 -- 172.21.15.43:0/3074317495 shutdown_connections 2023-08-27T11:28:48.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.043+0000 7f1fc0bff700 1 -- 172.21.15.43:0/3074317495 wait complete. 2023-08-27T11:28:48.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.044+0000 7f1fc0bff700 1 Processor -- start 2023-08-27T11:28:48.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.045+0000 7f1fc0bff700 1 -- start start 2023-08-27T11:28:48.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.045+0000 7f1fc0bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 0x7f1fbc1e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.045+0000 7f1fc0bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 0x7f1fbc14c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fc0bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fc0bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc1ea280 con 0x7f1fbc151910 2023-08-27T11:28:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fc0bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc14aa30 con 0x7f1fbc0c51a0 2023-08-27T11:28:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fc0bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc14cca0 con 0x7f1fbc0c15e0 2023-08-27T11:28:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.051 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36742/0 (socket says 172.21.15.43:36742) 2023-08-27T11:28:48.052 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 -- 172.21.15.43:0/59364847 learned_addr learned my addr 172.21.15.43:0/59364847 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fba59c700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 0x7f1fbc1e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fb3fff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 0x7f1fbc14c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 -- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 msgr2=0x7f1fbc1e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 0x7f1fbc1e7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.053 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 -- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 msgr2=0x7f1fbc14c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 0x7f1fbc14c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fbad9d700 1 -- 172.21.15.43:0/59364847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb4009a70 con 0x7f1fbc151910 2023-08-27T11:28:48.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fba59c700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 0x7f1fbc1e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:48.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.046+0000 7f1fb3fff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 0x7f1fbc14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:48.054 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fbad9d700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4014040 tx=0x7f1fb4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb401b810 con 0x7f1fbc151910 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4020070 con 0x7f1fbc151910 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc1eded0 con 0x7f1fbc151910 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb401bbb0 con 0x7f1fbc151910 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.047+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc1e7670 con 0x7f1fbc151910 2023-08-27T11:28:48.055 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.048+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fbc072320 con 0x7f1fbc151910 2023-08-27T11:28:48.056 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.049+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1fb401bd10 con 0x7f1fbc151910 2023-08-27T11:28:48.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.050+0000 7f1fb2ffd700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 0x7f1f9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.050+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fb4022070 con 0x7f1fbc151910 2023-08-27T11:28:48.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.050+0000 7f1fba59c700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 0x7f1f9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.051+0000 7f1fba59c700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 0x7f1f9c06c5a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1fac000f60 tx=0x7f1fac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.055+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1fbc072320 con 0x7f1fbc151910 2023-08-27T11:28:48.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.268+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fbc1ea3c0 con 0x7f1fbc151910 2023-08-27T11:28:48.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.269+0000 7f1fb2ffd700 1 -- 172.21.15.43:0/59364847 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18191 (secure 0 0 0) 0x7f1fbc1ea3c0 con 0x7f1fbc151910 2023-08-27T11:28:48.272 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:48.272 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":124,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:36.993232+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:48.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 msgr2=0x7f1f9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 0x7f1f9c06c5a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1fac000f60 tx=0x7f1fac009040 comp rx=0 tx=0).stop 2023-08-27T11:28:48.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 msgr2=0x7f1fbc157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4014040 tx=0x7f1fb4004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 shutdown_connections 2023-08-27T11:28:48.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1f9c06a0e0 0x7f1f9c06c5a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.271+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1fbc151910 0x7f1fbc157010 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.272+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fbc0c15e0 0x7f1fbc1e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.272+0000 7f1fc0bff700 1 --2- 172.21.15.43:0/59364847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fbc0c51a0 0x7f1fbc14c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.272+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 >> 172.21.15.43:0/59364847 conn(0x7f1fbc0a9740 msgr2=0x7f1fbc0c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:48.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.272+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 shutdown_connections 2023-08-27T11:28:48.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.272+0000 7f1fc0bff700 1 -- 172.21.15.43:0/59364847 wait complete. 2023-08-27T11:28:48.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:28:33.832606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:28:34.482137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:28:48.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:28:48.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.494+0000 7fc6a3fff700 1 Processor -- start 2023-08-27T11:28:48.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.494+0000 7fc6a3fff700 1 -- start start 2023-08-27T11:28:48.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.495+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 0x7fc69c151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.495+0000 7fc6a3fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c0c80c0 con 0x7fc69c0ac410 2023-08-27T11:28:48.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.495+0000 7fc6a3fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c1552c0 con 0x7fc69c151cd0 2023-08-27T11:28:48.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.495+0000 7fc6a3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c1555a0 con 0x7fc69c0c49f0 2023-08-27T11:28:48.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a259c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc69c0ac410 0x7fc69c15eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:47416/0 (socket says 172.21.15.43:47416) 2023-08-27T11:28:48.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a259c700 1 -- 172.21.15.43:0/1650316416 learned_addr learned my addr 172.21.15.43:0/1650316416 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:48.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a1d9b700 1 --2- 172.21.15.43:0/1650316416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 0x7fc69c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611706557 0 0) 0x7fc69c0c80c0 con 0x7fc69c0ac410 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6880035b0 con 0x7fc69c0ac410 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1650316416 >> v1:172.21.15.57:6789/0 conn(0x7fc69c151cd0 legacy=0x7fc69c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073001198 0 0) 0x7fc69c1552c0 con 0x7fc69c151cd0 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1650316416 >> v1:172.21.15.43:6789/0 conn(0x7fc69c0ac410 legacy=0x7fc69c15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.496+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1650316416 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c0c8360 con 0x7fc69c0c49f0 2023-08-27T11:28:48.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a1d9b700 1 --2- 172.21.15.43:0/1650316416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 0x7fc69c151790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc698009870 tx=0x7fc698009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f48f1bf1ef8c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698011830 con 0x7fc69c0c49f0 2023-08-27T11:28:48.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698011990 con 0x7fc69c0c49f0 2023-08-27T11:28:48.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a0d99700 1 -- 172.21.15.43:0/1650316416 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698011d20 con 0x7fc69c0c49f0 2023-08-27T11:28:48.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1650316416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 msgr2=0x7fc69c151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1650316416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 0x7fc69c151790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc698009870 tx=0x7fc698009b80 comp rx=0 tx=0).stop 2023-08-27T11:28:48.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1650316416 shutdown_connections 2023-08-27T11:28:48.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1650316416 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c0c49f0 0x7fc69c151790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.497+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1650316416 >> 172.21.15.43:0/1650316416 conn(0x7fc69c0ab8f0 msgr2=0x7fc69c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:48.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.498+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1650316416 shutdown_connections 2023-08-27T11:28:48.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.498+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1650316416 wait complete. 2023-08-27T11:28:48.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.499+0000 7fc6a3fff700 1 Processor -- start 2023-08-27T11:28:48.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.499+0000 7fc6a3fff700 1 -- start start 2023-08-27T11:28:48.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 0x7fc69c1ecbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 0x7fc69c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0af660 con 0x7fc69c0ac410 2023-08-27T11:28:48.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c1e9c70 con 0x7fc69c0c49f0 2023-08-27T11:28:48.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a3fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c1e9680 con 0x7fc69c151cd0 2023-08-27T11:28:48.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a1d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36746/0 (socket says 172.21.15.43:36746) 2023-08-27T11:28:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.500+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1944966180 learned_addr learned my addr 172.21.15.43:0/1944966180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a259c700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 0x7fc69c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a159a700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 0x7fc69c1ecbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 msgr2=0x7fc69c0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 0x7fc69c0c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 msgr2=0x7fc69c1ecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 0x7fc69c1ecbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 -- 172.21.15.43:0/1944966180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980094a0 con 0x7fc69c0ac410 2023-08-27T11:28:48.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a159a700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 0x7fc69c1ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a259c700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 0x7fc69c0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a1d9b700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc6980090b0 tx=0x7fc698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69801ab20 con 0x7fc69c0ac410 2023-08-27T11:28:48.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69801ac80 con 0x7fc69c0ac410 2023-08-27T11:28:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69c0af130 con 0x7fc69c0ac410 2023-08-27T11:28:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.501+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6980243f0 con 0x7fc69c0ac410 2023-08-27T11:28:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.502+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c1ed130 con 0x7fc69c0ac410 2023-08-27T11:28:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.502+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c04ee70 con 0x7fc69c0ac410 2023-08-27T11:28:48.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.503+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc69802d450 con 0x7fc69c0ac410 2023-08-27T11:28:48.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.504+0000 7fc6927fc700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 0x7fc68006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.504+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6980899b0 con 0x7fc69c0ac410 2023-08-27T11:28:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.505+0000 7fc6a159a700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 0x7fc68006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.505+0000 7fc6a159a700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 0x7fc68006c5a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc69c151050 tx=0x7fc68c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.509+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc698055090 con 0x7fc69c0ac410 2023-08-27T11:28:48.716 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.715+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc69c0c7d00 con 0x7fc69c0ac410 2023-08-27T11:28:48.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.715+0000 7fc6927fc700 1 -- 172.21.15.43:0/1944966180 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6980150a0 con 0x7fc69c0ac410 2023-08-27T11:28:48.717 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:28:48.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 msgr2=0x7fc68006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 0x7fc68006c5a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc69c151050 tx=0x7fc68c009040 comp rx=0 tx=0).stop 2023-08-27T11:28:48.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 msgr2=0x7fc69c1ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc6980090b0 tx=0x7fc698004750 comp rx=0 tx=0).stop 2023-08-27T11:28:48.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 shutdown_connections 2023-08-27T11:28:48.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68006a0e0 0x7fc68006c5a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.717+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc69c151cd0 0x7fc69c0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.718+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc69c0ac410 0x7fc69c1ea090 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.718+0000 7fc6a3fff700 1 --2- 172.21.15.43:0/1944966180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc69c0c49f0 0x7fc69c1ecbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.718+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 >> 172.21.15.43:0/1944966180 conn(0x7fc69c0ab8f0 msgr2=0x7fc69c0abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.718+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 shutdown_connections 2023-08-27T11:28:48.722 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.718+0000 7fc6a3fff700 1 -- 172.21.15.43:0/1944966180 wait complete. 2023-08-27T11:28:48.737 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:28:48.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.939+0000 7fc6a89ff700 1 Processor -- start 2023-08-27T11:28:48.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.939+0000 7fc6a89ff700 1 -- start start 2023-08-27T11:28:48.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.940+0000 7fc6a89ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc6a40c2cd0 0x7fc6a40c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.940+0000 7fc6a89ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40c6080 con 0x7fc6a40a6150 2023-08-27T11:28:48.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.940+0000 7fc6a89ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40c6890 con 0x7fc6a40a5cf0 2023-08-27T11:28:48.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.940+0000 7fc6a89ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40c62d0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a2d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc6a40a6150 0x7fc6a4154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60260/0 (socket says 172.21.15.43:60260) 2023-08-27T11:28:48.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a2d9d700 1 -- 172.21.15.43:0/1131659941 learned_addr learned my addr 172.21.15.43:0/1131659941 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:48.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a259c700 1 --2- 172.21.15.43:0/1131659941 >> v2:172.21.15.57:3300/0 conn(0x7fc6a40c2cd0 0x7fc6a40c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a159a700 1 -- 172.21.15.43:0/1131659941 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396614048 0 0) 0x7fc6a40c6080 con 0x7fc6a40a6150 2023-08-27T11:28:48.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a159a700 1 -- 172.21.15.43:0/1131659941 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc68c0035b0 con 0x7fc6a40a6150 2023-08-27T11:28:48.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a259c700 1 -- 172.21.15.43:0/1131659941 >> v1:172.21.15.57:6789/0 conn(0x7fc6a40a5cf0 legacy=0x7fc6a41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a259c700 1 -- 172.21.15.43:0/1131659941 >> v1:172.21.15.43:6789/0 conn(0x7fc6a40a6150 legacy=0x7fc6a4154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.941+0000 7fc6a259c700 1 -- 172.21.15.43:0/1131659941 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40c65b0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a259c700 1 --2- 172.21.15.43:0/1131659941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a40c4940 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc694009840 tx=0x7fc694009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83495fb1ff3011aa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a159a700 1 -- 172.21.15.43:0/1131659941 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011830 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a159a700 1 -- 172.21.15.43:0/1131659941 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694011990 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a159a700 1 -- 172.21.15.43:0/1131659941 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694011d20 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a89ff700 1 -- 172.21.15.43:0/1131659941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40c2cd0 msgr2=0x7fc6a40c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/1131659941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a40c4940 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc694009840 tx=0x7fc694009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a89ff700 1 -- 172.21.15.43:0/1131659941 shutdown_connections 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.942+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/1131659941 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a40c4940 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.943+0000 7fc6a89ff700 1 -- 172.21.15.43:0/1131659941 >> 172.21.15.43:0/1131659941 conn(0x7fc6a40c6a40 msgr2=0x7fc6a40c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.943+0000 7fc6a89ff700 1 -- 172.21.15.43:0/1131659941 shutdown_connections 2023-08-27T11:28:48.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.943+0000 7fc6a89ff700 1 -- 172.21.15.43:0/1131659941 wait complete. 2023-08-27T11:28:48.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.944+0000 7fc6a89ff700 1 Processor -- start 2023-08-27T11:28:48.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.945+0000 7fc6a89ff700 1 -- start start 2023-08-27T11:28:48.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.945+0000 7fc6a89ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40a5cf0 0x7fc6a4071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.945+0000 7fc6a89ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6a40a6150 0x7fc6a40ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a89ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a89ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41e9160 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a89ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a41502f0 con 0x7fc6a40a5cf0 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a89ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4072930 con 0x7fc6a40a6150 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a259c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40a5cf0 0x7fc6a4071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6a40a6150 0x7fc6a40ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58218/0 (socket says 172.21.15.43:58218) 2023-08-27T11:28:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 -- 172.21.15.43:0/3867371871 learned_addr learned my addr 172.21.15.43:0/3867371871 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 -- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6a40a6150 msgr2=0x7fc6a40ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6a40a6150 0x7fc6a40ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 -- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40a5cf0 msgr2=0x7fc6a4071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:48.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40a5cf0 0x7fc6a4071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:48.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.946+0000 7fc6a2d9d700 1 -- 172.21.15.43:0/3867371871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940094a0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc6a2d9d700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00cbb0 tx=0x7fc69c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00a9e0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00ab40 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c012400 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4150540 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.947+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a4150b00 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.948+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a41e96e0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.949+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc69c01b3b0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.950+0000 7fc692ffd700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 0x7fc68406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:48.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.950+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc69c0881d0 con 0x7fc6a40c2cd0 2023-08-27T11:28:48.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.950+0000 7fc6a259c700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 0x7fc68406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:48.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.951+0000 7fc6a259c700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 0x7fc68406c5a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc6940090b0 tx=0x7fc69401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:48.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:48.954+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc69c053960 con 0x7fc6a40c2cd0 2023-08-27T11:28:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.165+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6a4151f90 con 0x7fc6a40c2cd0 2023-08-27T11:28:49.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.166+0000 7fc692ffd700 1 -- 172.21.15.43:0/3867371871 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc69c056f80 con 0x7fc6a40c2cd0 2023-08-27T11:28:49.167 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:28:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 msgr2=0x7fc68406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 0x7fc68406c5a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc6940090b0 tx=0x7fc69401c040 comp rx=0 tx=0).stop 2023-08-27T11:28:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 msgr2=0x7fc6a41e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00cbb0 tx=0x7fc69c00cec0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 shutdown_connections 2023-08-27T11:28:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc68406a0e0 0x7fc68406c5a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6a40c2cd0 0x7fc6a41e9870 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6a40a5cf0 0x7fc6a4071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 --2- 172.21.15.43:0/3867371871 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6a40a6150 0x7fc6a40ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.168+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 >> 172.21.15.43:0/3867371871 conn(0x7fc6a40c6a40 msgr2=0x7fc6a4152e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.169+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 shutdown_connections 2023-08-27T11:28:49.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.169+0000 7fc6a89ff700 1 -- 172.21.15.43:0/3867371871 wait complete. 2023-08-27T11:28:49.188 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:28:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.391+0000 7f0faf1ff700 1 Processor -- start 2023-08-27T11:28:49.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.391+0000 7f0faf1ff700 1 -- start start 2023-08-27T11:28:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.392+0000 7f0faf1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0fa80c5230 0x7f0fa806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0faf1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa80aac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0faf1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa80ab190 0x7f0fa8155880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0faf1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa8152290 con 0x7f0fa80ab190 2023-08-27T11:28:49.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0faf1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa806d7a0 con 0x7f0fa80c5230 2023-08-27T11:28:49.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0faf1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8152550 con 0x7f0fa806c5e0 2023-08-27T11:28:49.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa80ab190 0x7f0fa8155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0fa80ab190 0x7f0fa8155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58232/0 (socket says 172.21.15.43:58232) 2023-08-27T11:28:49.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 -- 172.21.15.43:0/2120256905 learned_addr learned my addr 172.21.15.43:0/2120256905 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:49.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0facf9b700 1 --2- 172.21.15.43:0/2120256905 >> v2:172.21.15.57:3300/0 conn(0x7f0fa80c5230 0x7f0fa806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fa7fff700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa80aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 -- 172.21.15.43:0/2120256905 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 msgr2=0x7f0fa80aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:49.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa80aac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 -- 172.21.15.43:0/2120256905 >> v2:172.21.15.57:3300/0 conn(0x7f0fa80c5230 msgr2=0x7f0fa806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:49.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 --2- 172.21.15.43:0/2120256905 >> v2:172.21.15.57:3300/0 conn(0x7f0fa80c5230 0x7f0fa806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.393+0000 7f0fad79c700 1 -- 172.21.15.43:0/2120256905 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8152830 con 0x7f0fa80ab190 2023-08-27T11:28:49.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.394+0000 7f0fad79c700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa8155880 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa806ced0 tx=0x7f0fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ef8556a67b2d1a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.394+0000 7f0fa77fe700 1 -- 172.21.15.43:0/2120256905 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000e070 con 0x7f0fa80ab190 2023-08-27T11:28:49.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.394+0000 7f0fa77fe700 1 -- 172.21.15.43:0/2120256905 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000b9c0 con 0x7f0fa80ab190 2023-08-27T11:28:49.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.394+0000 7f0fa77fe700 1 -- 172.21.15.43:0/2120256905 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000bd70 con 0x7f0fa80ab190 2023-08-27T11:28:49.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 -- 172.21.15.43:0/2120256905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 msgr2=0x7f0fa8155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa8155880 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0fa806ced0 tx=0x7f0fa000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:49.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 -- 172.21.15.43:0/2120256905 shutdown_connections 2023-08-27T11:28:49.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa8155880 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/2120256905 >> v2:172.21.15.57:3300/0 conn(0x7f0fa80c5230 0x7f0fa806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/2120256905 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa80aac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 -- 172.21.15.43:0/2120256905 >> 172.21.15.43:0/2120256905 conn(0x7f0fa80c5b10 msgr2=0x7f0fa80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:49.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 -- 172.21.15.43:0/2120256905 shutdown_connections 2023-08-27T11:28:49.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.395+0000 7f0faf1ff700 1 -- 172.21.15.43:0/2120256905 wait complete. 2023-08-27T11:28:49.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.396+0000 7f0faf1ff700 1 Processor -- start 2023-08-27T11:28:49.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 -- start start 2023-08-27T11:28:49.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa80c5230 0x7f0fa80709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81ede90 con 0x7f0fa80ab190 2023-08-27T11:28:49.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa806f6b0 con 0x7f0fa80c5230 2023-08-27T11:28:49.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.397+0000 7f0faf1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa806f900 con 0x7f0fa806c5e0 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58246/0 (socket says 172.21.15.43:58246) 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 -- 172.21.15.43:0/558978071 learned_addr learned my addr 172.21.15.43:0/558978071 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fad79c700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa80c5230 0x7f0fa80709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0facf9b700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 -- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 msgr2=0x7f0fa814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 -- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa80c5230 msgr2=0x7f0fa80709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa80c5230 0x7f0fa80709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 -- 172.21.15.43:0/558978071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009b30 con 0x7f0fa80ab190 2023-08-27T11:28:49.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.398+0000 7f0fa7fff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e810 tx=0x7f0f9400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.399+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400c070 con 0x7f0fa80ab190 2023-08-27T11:28:49.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.399+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94013610 con 0x7f0fa80ab190 2023-08-27T11:28:49.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.399+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940139a0 con 0x7f0fa80ab190 2023-08-27T11:28:49.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.399+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa81edab0 con 0x7f0fa80ab190 2023-08-27T11:28:49.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.399+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa80aac40 con 0x7f0fa80ab190 2023-08-27T11:28:49.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.400+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa80716e0 con 0x7f0fa80ab190 2023-08-27T11:28:49.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.401+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f94013b00 con 0x7f0fa80ab190 2023-08-27T11:28:49.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.402+0000 7f0fa57fa700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.402+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f940881e0 con 0x7f0fa80ab190 2023-08-27T11:28:49.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.402+0000 7f0facf9b700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.403+0000 7f0facf9b700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80a6d20 tx=0x7f0f9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.406+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0fa80716e0 con 0x7f0fa80ab190 2023-08-27T11:28:49.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.615+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0fa80716e0 con 0x7f0fa80ab190 2023-08-27T11:28:49.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.616+0000 7f0fa57fa700 1 -- 172.21.15.43:0/558978071 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0fa80716e0 con 0x7f0fa80ab190 2023-08-27T11:28:49.618 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:28:49.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 msgr2=0x7f0f8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80a6d20 tx=0x7f0f9c008040 comp rx=0 tx=0).stop 2023-08-27T11:28:49.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 msgr2=0x7f0fa81ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400e810 tx=0x7f0f9400eb20 comp rx=0 tx=0).stop 2023-08-27T11:28:49.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 shutdown_connections 2023-08-27T11:28:49.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0f8c06a0e0 0x7f0f8c06c5a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fa80c5230 0x7f0fa80709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0fa806c5e0 0x7f0fa814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 --2- 172.21.15.43:0/558978071 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0fa80ab190 0x7f0fa81ed170 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 >> 172.21.15.43:0/558978071 conn(0x7f0fa80c5b10 msgr2=0x7f0fa80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:49.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.618+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 shutdown_connections 2023-08-27T11:28:49.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.619+0000 7f0faf1ff700 1 -- 172.21.15.43:0/558978071 wait complete. 2023-08-27T11:28:49.638 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:28:49.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.841+0000 7ff16f3ff700 1 Processor -- start 2023-08-27T11:28:49.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.841+0000 7ff16f3ff700 1 -- start start 2023-08-27T11:28:49.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.842+0000 7ff16f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1680c7c00 0x7ff1680c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.842+0000 7ff16f3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff16806a8e0 0x7ff16806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16f3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff168154660 con 0x7ff168151d20 2023-08-27T11:28:49.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16f3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680c5750 con 0x7ff16806a8e0 2023-08-27T11:28:49.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff168154940 con 0x7ff1680c7c00 2023-08-27T11:28:49.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d19b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff168151d20 0x7ff1680ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60266/0 (socket says 172.21.15.43:60266) 2023-08-27T11:28:49.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d19b700 1 -- 172.21.15.43:0/3356527940 learned_addr learned my addr 172.21.15.43:0/3356527940 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:49.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d99c700 1 --2- 172.21.15.43:0/3356527940 >> v2:172.21.15.43:3300/0 conn(0x7ff16806a8e0 0x7ff16806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16c99a700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1680c7c00 0x7ff1680c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff15ffff700 1 -- 172.21.15.43:0/3356527940 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739213585 0 0) 0x7ff168154660 con 0x7ff168151d20 2023-08-27T11:28:49.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff15ffff700 1 -- 172.21.15.43:0/3356527940 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1540035b0 con 0x7ff168151d20 2023-08-27T11:28:49.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d99c700 1 -- 172.21.15.43:0/3356527940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1680c7c00 msgr2=0x7ff1680c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:49.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d99c700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1680c7c00 0x7ff1680c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d99c700 1 -- 172.21.15.43:0/3356527940 >> v1:172.21.15.43:6789/0 conn(0x7ff168151d20 legacy=0x7ff1680ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.843+0000 7ff16d99c700 1 -- 172.21.15.43:0/3356527940 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168154c20 con 0x7ff16806a8e0 2023-08-27T11:28:49.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff16d99c700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff16806a8e0 0x7ff16806ad50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff160009d90 tx=0x7ff16000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaa573687debc02 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff15ffff700 1 -- 172.21.15.43:0/3356527940 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16000e070 con 0x7ff16806a8e0 2023-08-27T11:28:49.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff15ffff700 1 -- 172.21.15.43:0/3356527940 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16000bb20 con 0x7ff16806a8e0 2023-08-27T11:28:49.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff15ffff700 1 -- 172.21.15.43:0/3356527940 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160012430 con 0x7ff16806a8e0 2023-08-27T11:28:49.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff16f3ff700 1 -- 172.21.15.43:0/3356527940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff16806a8e0 msgr2=0x7ff16806ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.844+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff16806a8e0 0x7ff16806ad50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff160009d90 tx=0x7ff16000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:49.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 -- 172.21.15.43:0/3356527940 shutdown_connections 2023-08-27T11:28:49.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff16806a8e0 0x7ff16806ad50 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/3356527940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff1680c7c00 0x7ff1680c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 -- 172.21.15.43:0/3356527940 >> 172.21.15.43:0/3356527940 conn(0x7ff1680c9d00 msgr2=0x7ff1680ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:49.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 -- 172.21.15.43:0/3356527940 shutdown_connections 2023-08-27T11:28:49.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.845+0000 7ff16f3ff700 1 -- 172.21.15.43:0/3356527940 wait complete. 2023-08-27T11:28:49.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.846+0000 7ff16f3ff700 1 Processor -- start 2023-08-27T11:28:49.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 -- start start 2023-08-27T11:28:49.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff16806a8e0 0x7ff1681ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff168151d20 0x7ff168156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680c36c0 con 0x7ff1680c7c00 2023-08-27T11:28:49.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681ed1b0 con 0x7ff16806a8e0 2023-08-27T11:28:49.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.847+0000 7ff16f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681589d0 con 0x7ff168151d20 2023-08-27T11:28:49.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58272/0 (socket says 172.21.15.43:58272) 2023-08-27T11:28:49.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16d19b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff16806a8e0 0x7ff1681ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 -- 172.21.15.43:0/2777802719 learned_addr learned my addr 172.21.15.43:0/2777802719 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:49.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16d99c700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff168151d20 0x7ff168156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 -- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff168151d20 msgr2=0x7ff168156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff168151d20 0x7ff168156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 -- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff16806a8e0 msgr2=0x7ff1681ecc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:49.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff16806a8e0 0x7ff1681ecc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:49.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 -- 172.21.15.43:0/2777802719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160009a70 con 0x7ff1680c7c00 2023-08-27T11:28:49.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.848+0000 7ff16c99a700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e9b0 tx=0x7ff15800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.849+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158009710 con 0x7ff1680c7c00 2023-08-27T11:28:49.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.849+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800ee50 con 0x7ff1680c7c00 2023-08-27T11:28:49.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.849+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680c38a0 con 0x7ff1680c7c00 2023-08-27T11:28:49.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.849+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800ca50 con 0x7ff1680c7c00 2023-08-27T11:28:49.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.849+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff168158310 con 0x7ff1680c7c00 2023-08-27T11:28:49.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.850+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16804ee70 con 0x7ff1680c7c00 2023-08-27T11:28:49.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.851+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff15800cbb0 con 0x7ff1680c7c00 2023-08-27T11:28:49.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.852+0000 7ff15dffb700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 0x7ff14c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:49.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.852+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff158088580 con 0x7ff1680c7c00 2023-08-27T11:28:49.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.852+0000 7ff16d19b700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 0x7ff14c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:49.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.853+0000 7ff16d19b700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 0x7ff14c06c5a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff164007fd0 tx=0x7ff164007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:49.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:49.856+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff158057660 con 0x7ff1680c7c00 2023-08-27T11:28:50.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.064+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1680ac650 con 0x7ff1680c7c00 2023-08-27T11:28:50.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.064+0000 7ff15dffb700 1 -- 172.21.15.43:0/2777802719 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff15800ce60 con 0x7ff1680c7c00 2023-08-27T11:28:50.068 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:28:50.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 msgr2=0x7ff14c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 0x7ff14c06c5a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff164007fd0 tx=0x7ff164007dc0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 msgr2=0x7ff168150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e9b0 tx=0x7ff15800ecc0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 shutdown_connections 2023-08-27T11:28:50.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.066+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff14c06a0e0 0x7ff14c06c5a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff168151d20 0x7ff168156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff16806a8e0 0x7ff1681ecc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 --2- 172.21.15.43:0/2777802719 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff1680c7c00 0x7ff168150140 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 >> 172.21.15.43:0/2777802719 conn(0x7ff1680c9d00 msgr2=0x7ff168151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:50.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 shutdown_connections 2023-08-27T11:28:50.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.067+0000 7ff16f3ff700 1 -- 172.21.15.43:0/2777802719 wait complete. 2023-08-27T11:28:50.087 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:28:50.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.286+0000 7f09467ff700 1 Processor -- start 2023-08-27T11:28:50.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.287+0000 7f09467ff700 1 -- start start 2023-08-27T11:28:50.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f09467ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0940151a90 0x7f09400c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f09467ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094006c4e0 con 0x7f09400c4a90 2023-08-27T11:28:50.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f09467ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0940155370 con 0x7f09400c4630 2023-08-27T11:28:50.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f09467ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0940151e70 con 0x7f0940151a90 2023-08-27T11:28:50.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f0944d9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f09400c4a90 0x7f094006b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60280/0 (socket says 172.21.15.43:60280) 2023-08-27T11:28:50.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f0944d9c700 1 -- 172.21.15.43:0/668749487 learned_addr learned my addr 172.21.15.43:0/668749487 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:50.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f093ffff700 1 --2- 172.21.15.43:0/668749487 >> v2:172.21.15.43:3300/0 conn(0x7f0940151a90 0x7f09400c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.288+0000 7f093effd700 1 -- 172.21.15.43:0/668749487 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362592621 0 0) 0x7f094006c4e0 con 0x7f09400c4a90 2023-08-27T11:28:50.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093effd700 1 -- 172.21.15.43:0/668749487 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09280035b0 con 0x7f09400c4a90 2023-08-27T11:28:50.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093ffff700 1 -- 172.21.15.43:0/668749487 >> v1:172.21.15.57:6789/0 conn(0x7f09400c4630 legacy=0x7f094006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093ffff700 1 -- 172.21.15.43:0/668749487 >> v1:172.21.15.43:6789/0 conn(0x7f09400c4a90 legacy=0x7f094006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093ffff700 1 -- 172.21.15.43:0/668749487 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0940154480 con 0x7f0940151a90 2023-08-27T11:28:50.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093ffff700 1 --2- 172.21.15.43:0/668749487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400c7bb0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0930009840 tx=0x7f0930009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bc632f27365e7d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093effd700 1 -- 172.21.15.43:0/668749487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930011830 con 0x7f0940151a90 2023-08-27T11:28:50.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093effd700 1 -- 172.21.15.43:0/668749487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0930011990 con 0x7f0940151a90 2023-08-27T11:28:50.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.289+0000 7f093effd700 1 -- 172.21.15.43:0/668749487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930011d20 con 0x7f0940151a90 2023-08-27T11:28:50.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 -- 172.21.15.43:0/668749487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 msgr2=0x7f09400c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 --2- 172.21.15.43:0/668749487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400c7bb0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0930009840 tx=0x7f0930009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:50.294 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 -- 172.21.15.43:0/668749487 shutdown_connections 2023-08-27T11:28:50.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 --2- 172.21.15.43:0/668749487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400c7bb0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 -- 172.21.15.43:0/668749487 >> 172.21.15.43:0/668749487 conn(0x7f09400ab820 msgr2=0x7f09400abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:50.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 -- 172.21.15.43:0/668749487 shutdown_connections 2023-08-27T11:28:50.295 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.290+0000 7f09467ff700 1 -- 172.21.15.43:0/668749487 wait complete. 2023-08-27T11:28:50.297 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.291+0000 7f09467ff700 1 Processor -- start 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.292+0000 7f09467ff700 1 -- start start 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.292+0000 7f09467ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09400c4630 0x7f0940148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f09467ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 0x7f0940152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f09467ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f09467ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940155b30 con 0x7f0940151a90 2023-08-27T11:28:50.298 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f09467ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0940156ff0 con 0x7f09400c4a90 2023-08-27T11:28:50.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f09467ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0940156ca0 con 0x7f09400c4630 2023-08-27T11:28:50.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58292/0 (socket says 172.21.15.43:58292) 2023-08-27T11:28:50.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 -- 172.21.15.43:0/3800034586 learned_addr learned my addr 172.21.15.43:0/3800034586 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:50.299 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f093ffff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09400c4630 0x7f0940148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f093f7fe700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 0x7f0940152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 -- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09400c4630 msgr2=0x7f0940148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09400c4630 0x7f0940148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 -- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 msgr2=0x7f0940152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 0x7f0940152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.300 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f0944d9c700 1 -- 172.21.15.43:0/3800034586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300094a0 con 0x7f0940151a90 2023-08-27T11:28:50.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.293+0000 7f093f7fe700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 0x7f0940152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:50.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f0944d9c700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f093800cb70 tx=0x7f093800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800aa60 con 0x7f0940151a90 2023-08-27T11:28:50.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800abc0 con 0x7f0940151a90 2023-08-27T11:28:50.301 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940153b00 con 0x7f0940151a90 2023-08-27T11:28:50.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938012400 con 0x7f0940151a90 2023-08-27T11:28:50.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.294+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09401540c0 con 0x7f0940151a90 2023-08-27T11:28:50.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.295+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094004ee70 con 0x7f0940151a90 2023-08-27T11:28:50.302 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.296+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f093801b3b0 con 0x7f0940151a90 2023-08-27T11:28:50.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.297+0000 7f093cff9700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 0x7f092c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.297+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0938088340 con 0x7f0940151a90 2023-08-27T11:28:50.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.297+0000 7f093ffff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 0x7f092c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.303 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.298+0000 7f093ffff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 0x7f092c06c5a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09300090b0 tx=0x7f093001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.304 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.301+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0938053990 con 0x7f0940151a90 2023-08-27T11:28:50.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.520+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0940157130 con 0x7f0940151a90 2023-08-27T11:28:50.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.520+0000 7f093cff9700 1 -- 172.21.15.43:0/3800034586 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) v1 ==== 84+0+270 (secure 0 0 0) 0x7f0938056fb0 con 0x7f0940151a90 2023-08-27T11:28:50.522 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:50.522 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:28:50.522 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:50.522 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:28:50.523 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:28:50.523 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:50.523 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:50.523 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:28:50.523 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 19, 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "cephfs_metadata" 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:28:50.524 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:28:50.525 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 20, 2023-08-27T11:28:50.525 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "cephfs_data" 2023-08-27T11:28:50.525 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:28:50.525 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:28:50.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 msgr2=0x7f092c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 0x7f092c06c5a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f09300090b0 tx=0x7f093001c040 comp rx=0 tx=0).stop 2023-08-27T11:28:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 msgr2=0x7f09400bbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f093800cb70 tx=0x7f093800ce80 comp rx=0 tx=0).stop 2023-08-27T11:28:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 shutdown_connections 2023-08-27T11:28:50.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f092c06a0e0 0x7f092c06c5a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0940151a90 0x7f09400bbcc0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09400c4630 0x7f0940148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 --2- 172.21.15.43:0/3800034586 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09400c4a90 0x7f0940152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.522+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 >> 172.21.15.43:0/3800034586 conn(0x7f09400ab820 msgr2=0x7f094006ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.523+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 shutdown_connections 2023-08-27T11:28:50.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.523+0000 7f09467ff700 1 -- 172.21.15.43:0/3800034586 wait complete. 2023-08-27T11:28:50.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-08-27T11:28:50.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-08-27T11:28:50.747 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.746+0000 7fac131ff700 1 Processor -- start 2023-08-27T11:28:50.748 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.746+0000 7fac131ff700 1 -- start start 2023-08-27T11:28:50.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.747+0000 7fac131ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fac0c0aae50 0x7fac0c06c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.747+0000 7fac131ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c06cde0 con 0x7fac0c152380 2023-08-27T11:28:50.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.747+0000 7fac131ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c155b00 con 0x7fac0c06d360 2023-08-27T11:28:50.749 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.747+0000 7fac131ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c1558f0 con 0x7fac0c0aae50 2023-08-27T11:28:50.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac1179c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fac0c152380 0x7fac0c1527d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60288/0 (socket says 172.21.15.43:60288) 2023-08-27T11:28:50.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac1179c700 1 -- 172.21.15.43:0/4291856312 learned_addr learned my addr 172.21.15.43:0/4291856312 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:50.750 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac10f9b700 1 --2- 172.21.15.43:0/4291856312 >> v2:172.21.15.57:3300/0 conn(0x7fac0c0aae50 0x7fac0c06c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac0b7fe700 1 -- 172.21.15.43:0/4291856312 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812790148 0 0) 0x7fac0c06cde0 con 0x7fac0c152380 2023-08-27T11:28:50.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac0b7fe700 1 -- 172.21.15.43:0/4291856312 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabfc0035b0 con 0x7fac0c152380 2023-08-27T11:28:50.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac10f9b700 1 -- 172.21.15.43:0/4291856312 >> v1:172.21.15.57:6789/0 conn(0x7fac0c06d360 legacy=0x7fac0c14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac10f9b700 1 -- 172.21.15.43:0/4291856312 >> v1:172.21.15.43:6789/0 conn(0x7fac0c152380 legacy=0x7fac0c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.752 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.748+0000 7fac10f9b700 1 -- 172.21.15.43:0/4291856312 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c155de0 con 0x7fac0c0aae50 2023-08-27T11:28:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac10f9b700 1 --2- 172.21.15.43:0/4291856312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0aae50 0x7fac0c06c8a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0c14d0 tx=0x7fac00009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a8b0631f0974c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac0b7fe700 1 -- 172.21.15.43:0/4291856312 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00004020 con 0x7fac0c0aae50 2023-08-27T11:28:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac0b7fe700 1 -- 172.21.15.43:0/4291856312 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00004180 con 0x7fac0c0aae50 2023-08-27T11:28:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac0b7fe700 1 -- 172.21.15.43:0/4291856312 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00004530 con 0x7fac0c0aae50 2023-08-27T11:28:50.753 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac131ff700 1 -- 172.21.15.43:0/4291856312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0aae50 msgr2=0x7fac0c06c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac131ff700 1 --2- 172.21.15.43:0/4291856312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0aae50 0x7fac0c06c8a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fac0c0c14d0 tx=0x7fac00009b20 comp rx=0 tx=0).stop 2023-08-27T11:28:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac131ff700 1 -- 172.21.15.43:0/4291856312 shutdown_connections 2023-08-27T11:28:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac131ff700 1 --2- 172.21.15.43:0/4291856312 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c0aae50 0x7fac0c06c8a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.749+0000 7fac131ff700 1 -- 172.21.15.43:0/4291856312 >> 172.21.15.43:0/4291856312 conn(0x7fac0c0c2400 msgr2=0x7fac0c0c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:50.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.750+0000 7fac131ff700 1 -- 172.21.15.43:0/4291856312 shutdown_connections 2023-08-27T11:28:50.755 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.750+0000 7fac131ff700 1 -- 172.21.15.43:0/4291856312 wait complete. 2023-08-27T11:28:50.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.751+0000 7fac131ff700 1 Processor -- start 2023-08-27T11:28:50.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.751+0000 7fac131ff700 1 -- start start 2023-08-27T11:28:50.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c06d360 0x7fac0c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0c152380 0x7fac0c1eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0a5bf0 con 0x7fac0c0aae50 2023-08-27T11:28:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1e6d10 con 0x7fac0c06d360 2023-08-27T11:28:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac131ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0bc590 con 0x7fac0c152380 2023-08-27T11:28:50.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.752+0000 7fac0bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58298/0 (socket says 172.21.15.43:58298) 2023-08-27T11:28:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 -- 172.21.15.43:0/3003694987 learned_addr learned my addr 172.21.15.43:0/3003694987 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac1179c700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0c152380 0x7fac0c1eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac10f9b700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c06d360 0x7fac0c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 -- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0c152380 msgr2=0x7fac0c1eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0c152380 0x7fac0c1eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 -- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c06d360 msgr2=0x7fac0c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c06d360 0x7fac0c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 -- 172.21.15.43:0/3003694987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000094a0 con 0x7fac0c0aae50 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac0bfff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c4e0 tx=0x7fabf800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80052d0 con 0x7fac0c0aae50 2023-08-27T11:28:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8005430 con 0x7fac0c0aae50 2023-08-27T11:28:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0a5e40 con 0x7fac0c0aae50 2023-08-27T11:28:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.753+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80038c0 con 0x7fac0c0aae50 2023-08-27T11:28:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.754+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c1528b0 con 0x7fac0c0aae50 2023-08-27T11:28:50.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.755+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c1ea310 con 0x7fac0c0aae50 2023-08-27T11:28:50.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.756+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fabf8003a20 con 0x7fac0c0aae50 2023-08-27T11:28:50.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.758+0000 7fac097fa700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 0x7fabf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.758+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabf8087880 con 0x7fac0c0aae50 2023-08-27T11:28:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.758+0000 7fac10f9b700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 0x7fabf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.758+0000 7fac10f9b700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 0x7fabf006c5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac000090b0 tx=0x7fac00008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:50.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.762+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fac0c1ea310 con 0x7fac0c0aae50 2023-08-27T11:28:50.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:50.970+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fac0c1ea310 con 0x7fac0c0aae50 2023-08-27T11:28:51.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.083+0000 7fac097fa700 1 -- 172.21.15.43:0/3003694987 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v125) v1 ==== 140+0+0 (secure 0 0 0) 0x7fac0c1ea310 con 0x7fac0c0aae50 2023-08-27T11:28:51.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 msgr2=0x7fabf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 0x7fabf006c5a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac000090b0 tx=0x7fac00008030 comp rx=0 tx=0).stop 2023-08-27T11:28:51.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 msgr2=0x7fac0c1ea5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c4e0 tx=0x7fabf800c7f0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 shutdown_connections 2023-08-27T11:28:51.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fabf006a0e0 0x7fabf006c5a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac0c152380 0x7fac0c1eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac0c06d360 0x7fac0c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 --2- 172.21.15.43:0/3003694987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac0c0aae50 0x7fac0c1ea5f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.087+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 >> 172.21.15.43:0/3003694987 conn(0x7fac0c0c2400 msgr2=0x7fac0c1dd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:51.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.088+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 shutdown_connections 2023-08-27T11:28:51.091 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.088+0000 7fac131ff700 1 -- 172.21.15.43:0/3003694987 wait complete. 2023-08-27T11:28:51.091 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_metadata' created 2023-08-27T11:28:51.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:28:51.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.318+0000 7f575ddff700 1 Processor -- start 2023-08-27T11:28:51.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.319+0000 7f575ddff700 1 -- start start 2023-08-27T11:28:51.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f575ddff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5758151a70 0x7f5758154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f575ddff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758157ee0 0x7f5758158390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f575ddff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57580c5250 con 0x7f57580c7c90 2023-08-27T11:28:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f575ddff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580c4710 con 0x7f5758151a70 2023-08-27T11:28:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f575ddff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580c4920 con 0x7f5758157ee0 2023-08-27T11:28:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f57577fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5758151a70 0x7f5758154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f57577fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5758151a70 0x7f5758154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58312/0 (socket says 172.21.15.43:58312) 2023-08-27T11:28:51.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f57577fe700 1 -- 172.21.15.43:0/2755762218 learned_addr learned my addr 172.21.15.43:0/2755762218 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:51.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.320+0000 7f5757fff700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758157ee0 0x7f5758158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f57577fe700 1 -- 172.21.15.43:0/2755762218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758157ee0 msgr2=0x7f5758158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:51.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f57577fe700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758157ee0 0x7f5758158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f57577fe700 1 -- 172.21.15.43:0/2755762218 >> v1:172.21.15.57:6789/0 conn(0x7f57580c7c90 legacy=0x7f57580c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f57577fe700 1 -- 172.21.15.43:0/2755762218 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580c4c00 con 0x7f5758151a70 2023-08-27T11:28:51.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f57577fe700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5758151a70 0x7f5758154ff0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5748006fd0 tx=0x7f5748009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19cef56e5da1ba6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f5756ffd700 1 -- 172.21.15.43:0/2755762218 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748005e30 con 0x7f5758151a70 2023-08-27T11:28:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f5756ffd700 1 -- 172.21.15.43:0/2755762218 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748004030 con 0x7f5758151a70 2023-08-27T11:28:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.321+0000 7f5756ffd700 1 -- 172.21.15.43:0/2755762218 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57480043e0 con 0x7f5758151a70 2023-08-27T11:28:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 -- 172.21.15.43:0/2755762218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5758151a70 msgr2=0x7f5758154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5758151a70 0x7f5758154ff0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f5748006fd0 tx=0x7f5748009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 -- 172.21.15.43:0/2755762218 shutdown_connections 2023-08-27T11:28:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758157ee0 0x7f5758158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 --2- 172.21.15.43:0/2755762218 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5758151a70 0x7f5758154ff0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 -- 172.21.15.43:0/2755762218 >> 172.21.15.43:0/2755762218 conn(0x7f57580c9d90 msgr2=0x7f57580ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:51.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 -- 172.21.15.43:0/2755762218 shutdown_connections 2023-08-27T11:28:51.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.322+0000 7f575ddff700 1 -- 172.21.15.43:0/2755762218 wait complete. 2023-08-27T11:28:51.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.324+0000 7f575ddff700 1 Processor -- start 2023-08-27T11:28:51.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.324+0000 7f575ddff700 1 -- start start 2023-08-27T11:28:51.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758151a70 0x7f5758146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5758157ee0 0x7f5758146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758146ca0 con 0x7f57580c7c90 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580c2130 con 0x7f5758157ee0 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f575ddff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758156fe0 con 0x7f5758151a70 2023-08-27T11:28:51.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58314/0 (socket says 172.21.15.43:58314) 2023-08-27T11:28:51.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 -- 172.21.15.43:0/720592746 learned_addr learned my addr 172.21.15.43:0/720592746 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:51.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f5757fff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5758157ee0 0x7f5758146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f574ffff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758151a70 0x7f5758146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 -- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758151a70 msgr2=0x7f5758146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758151a70 0x7f5758146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 -- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5758157ee0 msgr2=0x7f5758146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:51.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5758157ee0 0x7f5758146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:51.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.325+0000 7f57577fe700 1 -- 172.21.15.43:0/720592746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009500 con 0x7f57580c7c90 2023-08-27T11:28:51.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f57577fe700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f575808b930 tx=0x7f5748004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:51.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748011420 con 0x7f57580c7c90 2023-08-27T11:28:51.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748011580 con 0x7f57580c7c90 2023-08-27T11:28:51.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748011930 con 0x7f57580c7c90 2023-08-27T11:28:51.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57581572c0 con 0x7f57580c7c90 2023-08-27T11:28:51.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.326+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5758157880 con 0x7f57580c7c90 2023-08-27T11:28:51.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.327+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758074680 con 0x7f57580c7c90 2023-08-27T11:28:51.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.328+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f574802f480 con 0x7f57580c7c90 2023-08-27T11:28:51.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.330+0000 7f5754ff9700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 0x7f573806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:51.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.330+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f5748089d00 con 0x7f57580c7c90 2023-08-27T11:28:51.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.330+0000 7f574ffff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 0x7f573806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:51.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.331+0000 7f574ffff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 0x7f573806c5a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f575814ad00 tx=0x7f5740009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:51.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.334+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f57480552e0 con 0x7f57580c7c90 2023-08-27T11:28:51.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:51.543+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f57580c7530 con 0x7f57580c7c90 2023-08-27T11:28:52.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.088+0000 7f5754ff9700 1 -- 172.21.15.43:0/720592746 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v126) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5748058900 con 0x7f57580c7c90 2023-08-27T11:28:52.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.094+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 msgr2=0x7f573806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.094+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 0x7f573806c5a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f575814ad00 tx=0x7f5740009040 comp rx=0 tx=0).stop 2023-08-27T11:28:52.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.094+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 msgr2=0x7f57580c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.094+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f575808b930 tx=0x7f5748004750 comp rx=0 tx=0).stop 2023-08-27T11:28:52.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 shutdown_connections 2023-08-27T11:28:52.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f573806a0e0 0x7f573806c5a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5758157ee0 0x7f5758146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57580c7c90 0x7f57580c6ba0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 --2- 172.21.15.43:0/720592746 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5758151a70 0x7f5758146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.099 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.095+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 >> 172.21.15.43:0/720592746 conn(0x7f57580c9d90 msgr2=0x7f575814c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.100+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 shutdown_connections 2023-08-27T11:28:52.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.101+0000 7f575ddff700 1 -- 172.21.15.43:0/720592746 wait complete. 2023-08-27T11:28:52.112 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_data' created 2023-08-27T11:28:52.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-08-27T11:28:52.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.337+0000 7f25cb5ff700 1 Processor -- start 2023-08-27T11:28:52.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.337+0000 7f25cb5ff700 1 -- start start 2023-08-27T11:28:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.338+0000 7f25cb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c40c7c00 0x7f25c40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.338+0000 7f25cb5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c406a8e0 0x7f25c406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.338+0000 7f25cb5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c4154660 con 0x7f25c4151d20 2023-08-27T11:28:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.338+0000 7f25cb5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c40c5750 con 0x7f25c406a8e0 2023-08-27T11:28:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.338+0000 7f25cb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c4154940 con 0x7f25c40c7c00 2023-08-27T11:28:52.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c406a8e0 0x7f25c406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f25c406a8e0 0x7f25c406ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58318/0 (socket says 172.21.15.43:58318) 2023-08-27T11:28:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 -- 172.21.15.43:0/3232147378 learned_addr learned my addr 172.21.15.43:0/3232147378 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c8b9a700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c40c7c00 0x7f25c40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 -- 172.21.15.43:0/3232147378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c40c7c00 msgr2=0x7f25c40c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:52.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c40c7c00 0x7f25c40c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 -- 172.21.15.43:0/3232147378 >> v1:172.21.15.57:6789/0 conn(0x7f25c4151d20 legacy=0x7f25c40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 -- 172.21.15.43:0/3232147378 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4154c20 con 0x7f25c406a8e0 2023-08-27T11:28:52.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.339+0000 7f25c9b9c700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c406ad50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009e50 tx=0x7f25bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafa1c0fc8abbdbb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25bbfff700 1 -- 172.21.15.43:0/3232147378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00e070 con 0x7f25c406a8e0 2023-08-27T11:28:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25bbfff700 1 -- 172.21.15.43:0/3232147378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc00b910 con 0x7f25c406a8e0 2023-08-27T11:28:52.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25bbfff700 1 -- 172.21.15.43:0/3232147378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00bcc0 con 0x7f25c406a8e0 2023-08-27T11:28:52.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 -- 172.21.15.43:0/3232147378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 msgr2=0x7f25c406ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c406ad50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009e50 tx=0x7f25bc00b330 comp rx=0 tx=0).stop 2023-08-27T11:28:52.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 -- 172.21.15.43:0/3232147378 shutdown_connections 2023-08-27T11:28:52.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c406ad50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/3232147378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c40c7c00 0x7f25c40c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 -- 172.21.15.43:0/3232147378 >> 172.21.15.43:0/3232147378 conn(0x7f25c40c9d00 msgr2=0x7f25c40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:52.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 -- 172.21.15.43:0/3232147378 shutdown_connections 2023-08-27T11:28:52.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.340+0000 7f25cb5ff700 1 -- 172.21.15.43:0/3232147378 wait complete. 2023-08-27T11:28:52.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.342+0000 7f25cb5ff700 1 Processor -- start 2023-08-27T11:28:52.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.342+0000 7f25cb5ff700 1 -- start start 2023-08-27T11:28:52.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 0x7f25c40c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c4151d20 0x7f25c40c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c3d70 con 0x7f25c406a8e0 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41ea3c0 con 0x7f25c40c7c00 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25cb5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c0e70 con 0x7f25c4151d20 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25c939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25c939b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58336/0 (socket says 172.21.15.43:58336) 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.343+0000 7f25c939b700 1 -- 172.21.15.43:0/2914236972 learned_addr learned my addr 172.21.15.43:0/2914236972 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:52.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c8b9a700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 0x7f25c40c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:52.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 -- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c4151d20 msgr2=0x7f25c40c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c4151d20 0x7f25c40c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 -- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 msgr2=0x7f25c40c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:52.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 0x7f25c40c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:52.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 -- 172.21.15.43:0/2914236972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009b30 con 0x7f25c406a8e0 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c8b9a700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 0x7f25c40c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25c939b700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c450 tx=0x7f25c000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00052d0 con 0x7f25c406a8e0 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c0005430 con 0x7f25c406a8e0 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c41ea930 con 0x7f25c406a8e0 2023-08-27T11:28:52.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00038c0 con 0x7f25c406a8e0 2023-08-27T11:28:52.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.344+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c41ea650 con 0x7f25c406a8e0 2023-08-27T11:28:52.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.345+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c404ee70 con 0x7f25c406a8e0 2023-08-27T11:28:52.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.347+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25c0003a20 con 0x7f25c406a8e0 2023-08-27T11:28:52.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.348+0000 7f25b9ffb700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 0x7f25a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:52.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.348+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6816+0+0 (secure 0 0 0) 0x7f25c0087d20 con 0x7f25c406a8e0 2023-08-27T11:28:52.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.348+0000 7f25c8b9a700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 0x7f25a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:52.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.349+0000 7f25c8b9a700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 0x7f25a806c5a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009b60 tx=0x7f25b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:52.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.352+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f25c00531b0 con 0x7f25c406a8e0 2023-08-27T11:28:52.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:52.604+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f25c40c8430 con 0x7f25c406a8e0 2023-08-27T11:28:53.112 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.110+0000 7f25b9ffb700 1 -- 172.21.15.43:0/2914236972 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 21 and data pool 22 v131) v1 ==== 177+0+0 (secure 0 0 0) 0x7f25c00567d0 con 0x7f25c406a8e0 2023-08-27T11:28:53.115 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 msgr2=0x7f25a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 0x7f25a806c5a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009b60 tx=0x7f25b4008040 comp rx=0 tx=0).stop 2023-08-27T11:28:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 msgr2=0x7f25c40bf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c450 tx=0x7f25c000c810 comp rx=0 tx=0).stop 2023-08-27T11:28:53.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 shutdown_connections 2023-08-27T11:28:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f25a806a0e0 0x7f25a806c5a0 secure :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009b60 tx=0x7f25b4008040 comp rx=0 tx=0).stop 2023-08-27T11:28:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f25c4151d20 0x7f25c40c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f25c406a8e0 0x7f25c40bf9d0 secure :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c450 tx=0x7f25c000c810 comp rx=0 tx=0).stop 2023-08-27T11:28:53.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 --2- 172.21.15.43:0/2914236972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25c40c7c00 0x7f25c40c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.114+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 >> 172.21.15.43:0/2914236972 conn(0x7f25c40c9d00 msgr2=0x7f25c40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:53.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.117+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 shutdown_connections 2023-08-27T11:28:53.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.117+0000 7f25cb5ff700 1 -- 172.21.15.43:0/2914236972 wait complete. 2023-08-27T11:28:53.121 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 21 and data pool 22 2023-08-27T11:28:53.140 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:53.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.342+0000 7f03dd5ff700 1 Processor -- start 2023-08-27T11:28:53.343 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.342+0000 7f03dd5ff700 1 -- start start 2023-08-27T11:28:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.343+0000 7f03dd5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.343+0000 7f03dd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 0x7f03d806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.343+0000 7f03dd5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d806c4e0 con 0x7f03d80c4630 2023-08-27T11:28:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.343+0000 7f03dd5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d8155370 con 0x7f03d8151a90 2023-08-27T11:28:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.343+0000 7f03dd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8151e70 con 0x7f03d80c4a90 2023-08-27T11:28:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 0x7f03d806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:35356/0 (socket says 172.21.15.43:35356) 2023-08-27T11:28:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d6ffd700 1 -- 172.21.15.43:0/1468164951 learned_addr learned my addr 172.21.15.43:0/1468164951 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d67fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f03d80c4630 0x7f03d806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:45054/0 (socket says 172.21.15.43:45054) 2023-08-27T11:28:53.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d5ffb700 1 -- 172.21.15.43:0/1468164951 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70203051 0 0) 0x7f03d806c4e0 con 0x7f03d80c4630 2023-08-27T11:28:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d5ffb700 1 -- 172.21.15.43:0/1468164951 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c00035b0 con 0x7f03d80c4630 2023-08-27T11:28:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d77fe700 1 -- 172.21.15.43:0/1468164951 >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 msgr2=0x7f03d80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d77fe700 1 --2- 172.21.15.43:0/1468164951 >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d77fe700 1 -- 172.21.15.43:0/1468164951 >> v1:172.21.15.57:6789/0 conn(0x7f03d80c4630 legacy=0x7f03d806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d77fe700 1 -- 172.21.15.43:0/1468164951 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8154480 con 0x7f03d80c4a90 2023-08-27T11:28:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.344+0000 7f03d6ffd700 1 --2- 172.21.15.43:0/1468164951 >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03d77fe700 1 --2- 172.21.15.43:0/1468164951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 0x7f03d806b480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009d90 tx=0x7f03d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce4d78274707fb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03d5ffb700 1 -- 172.21.15.43:0/1468164951 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000e070 con 0x7f03d80c4a90 2023-08-27T11:28:53.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03d5ffb700 1 -- 172.21.15.43:0/1468164951 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000bb20 con 0x7f03d80c4a90 2023-08-27T11:28:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03d5ffb700 1 -- 172.21.15.43:0/1468164951 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0012430 con 0x7f03d80c4a90 2023-08-27T11:28:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03dd5ff700 1 -- 172.21.15.43:0/1468164951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 msgr2=0x7f03d806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.345+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/1468164951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 0x7f03d806b480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009d90 tx=0x7f03d000b330 comp rx=0 tx=0).stop 2023-08-27T11:28:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 -- 172.21.15.43:0/1468164951 shutdown_connections 2023-08-27T11:28:53.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/1468164951 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4a90 0x7f03d806b480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/1468164951 >> v2:172.21.15.57:3300/0 conn(0x7f03d8151a90 0x7f03d80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 -- 172.21.15.43:0/1468164951 >> 172.21.15.43:0/1468164951 conn(0x7f03d80ab820 msgr2=0x7f03d80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 -- 172.21.15.43:0/1468164951 shutdown_connections 2023-08-27T11:28:53.352 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.346+0000 7f03dd5ff700 1 -- 172.21.15.43:0/1468164951 wait complete. 2023-08-27T11:28:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.347+0000 7f03dd5ff700 1 Processor -- start 2023-08-27T11:28:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.347+0000 7f03dd5ff700 1 -- start start 2023-08-27T11:28:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4630 0x7f03d814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03d80c4a90 0x7f03d80aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8156970 con 0x7f03d8151a90 2023-08-27T11:28:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81ece50 con 0x7f03d80c4a90 2023-08-27T11:28:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.348+0000 7f03dd5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81ed130 con 0x7f03d80c4630 2023-08-27T11:28:53.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58352/0 (socket says 172.21.15.43:58352) 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 -- 172.21.15.43:0/2796406485 learned_addr learned my addr 172.21.15.43:0/2796406485 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d6ffd700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4630 0x7f03d814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d67fc700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03d80c4a90 0x7f03d80aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 -- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4630 msgr2=0x7f03d814bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4630 0x7f03d814bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 -- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03d80c4a90 msgr2=0x7f03d80aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03d80c4a90 0x7f03d80aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 -- 172.21.15.43:0/2796406485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009550 con 0x7f03d8151a90 2023-08-27T11:28:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.349+0000 7f03d77fe700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f03d0014040 tx=0x7f03d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.350+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00129f0 con 0x7f03d8151a90 2023-08-27T11:28:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.350+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0020070 con 0x7f03d8151a90 2023-08-27T11:28:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.350+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0012db0 con 0x7f03d8151a90 2023-08-27T11:28:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.350+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d0009a70 con 0x7f03d8151a90 2023-08-27T11:28:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.350+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d81ed6f0 con 0x7f03d8151a90 2023-08-27T11:28:53.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.351+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d804ee70 con 0x7f03d8151a90 2023-08-27T11:28:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.352+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f03d0004040 con 0x7f03d8151a90 2023-08-27T11:28:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.353+0000 7f03bf7fe700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 0x7f03c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.353+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f03d0022070 con 0x7f03d8151a90 2023-08-27T11:28:53.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.353+0000 7f03d6ffd700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 0x7f03c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.354+0000 7f03d6ffd700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 0x7f03c406c5a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f03c8006d30 tx=0x7f03c80092c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.358+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f03d00557f0 con 0x7f03d8151a90 2023-08-27T11:28:53.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.567+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03d806c130 con 0x7f03d8151a90 2023-08-27T11:28:53.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.569+0000 7f03bf7fe700 1 -- 172.21.15.43:0/2796406485 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+21860 (secure 0 0 0) 0x7f03d0058e10 con 0x7f03d8151a90 2023-08-27T11:28:53.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:53.571 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":127,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:52.606084+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 msgr2=0x7f03c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 0x7f03c406c5a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f03c8006d30 tx=0x7f03c80092c0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 msgr2=0x7f03d81536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f03d0014040 tx=0x7f03d0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 shutdown_connections 2023-08-27T11:28:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f03c406a0e0 0x7f03c406c5a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f03d8151a90 0x7f03d81536f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03d80c4630 0x7f03d814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 --2- 172.21.15.43:0/2796406485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03d80c4a90 0x7f03d80aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 >> 172.21.15.43:0/2796406485 conn(0x7f03d80ab820 msgr2=0x7f03d8149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:53.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 shutdown_connections 2023-08-27T11:28:53.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.571+0000 7f03dd5ff700 1 -- 172.21.15.43:0/2796406485 wait complete. 2023-08-27T11:28:53.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:53.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.791+0000 7f1e0f7ff700 1 Processor -- start 2023-08-27T11:28:53.792 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.791+0000 7f1e0f7ff700 1 -- start start 2023-08-27T11:28:53.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e080c51a0 0x7f1e0806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0f7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1e0806ca60 0x7f1e080aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0f7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0806d700 con 0x7f1e080ab040 2023-08-27T11:28:53.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0f7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e081530b0 con 0x7f1e0806ca60 2023-08-27T11:28:53.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0814c860 con 0x7f1e080c51a0 2023-08-27T11:28:53.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0cd9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1e0806ca60 0x7f1e080aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0dd9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1e080ab040 0x7f1e08155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60298/0 (socket says 172.21.15.43:60298) 2023-08-27T11:28:53.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.792+0000 7f1e0dd9c700 1 -- 172.21.15.43:0/2951703783 learned_addr learned my addr 172.21.15.43:0/2951703783 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:53.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0d59b700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e080c51a0 0x7f1e0806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0cd9a700 1 -- 172.21.15.43:0/2951703783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e080c51a0 msgr2=0x7f1e0806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0cd9a700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e080c51a0 0x7f1e0806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1dfffff700 1 -- 172.21.15.43:0/2951703783 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398351737 0 0) 0x7f1e0806d700 con 0x7f1e080ab040 2023-08-27T11:28:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0cd9a700 1 -- 172.21.15.43:0/2951703783 >> v1:172.21.15.43:6789/0 conn(0x7f1e080ab040 legacy=0x7f1e08155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0cd9a700 1 -- 172.21.15.43:0/2951703783 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08152430 con 0x7f1e0806ca60 2023-08-27T11:28:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1e0cd9a700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e0806ca60 0x7f1e080aab00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009870 tx=0x7f1df8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34b4c4ddbd2bda6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1dfffff700 1 -- 172.21.15.43:0/2951703783 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011830 con 0x7f1e0806ca60 2023-08-27T11:28:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1dfffff700 1 -- 172.21.15.43:0/2951703783 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df8011990 con 0x7f1e0806ca60 2023-08-27T11:28:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.793+0000 7f1dfffff700 1 -- 172.21.15.43:0/2951703783 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df8011d20 con 0x7f1e0806ca60 2023-08-27T11:28:53.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/2951703783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e0806ca60 msgr2=0x7f1e080aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e0806ca60 0x7f1e080aab00 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009870 tx=0x7f1df8009b80 comp rx=0 tx=0).stop 2023-08-27T11:28:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/2951703783 shutdown_connections 2023-08-27T11:28:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e080c51a0 0x7f1e0806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/2951703783 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e0806ca60 0x7f1e080aab00 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/2951703783 >> 172.21.15.43:0/2951703783 conn(0x7f1e0806aa50 msgr2=0x7f1e080c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/2951703783 shutdown_connections 2023-08-27T11:28:53.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.794+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/2951703783 wait complete. 2023-08-27T11:28:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.796+0000 7f1e0f7ff700 1 Processor -- start 2023-08-27T11:28:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.796+0000 7f1e0f7ff700 1 -- start start 2023-08-27T11:28:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e0806ca60 0x7f1e080bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e080ab040 0x7f1e080a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081ea5e0 con 0x7f1e080c51a0 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e081ea8c0 con 0x7f1e080ab040 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0f7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e080be1f0 con 0x7f1e0806ca60 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58374/0 (socket says 172.21.15.43:58374) 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 -- 172.21.15.43:0/954302021 learned_addr learned my addr 172.21.15.43:0/954302021 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0cd9a700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e080ab040 0x7f1e080a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0d59b700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e0806ca60 0x7f1e080bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 -- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e0806ca60 msgr2=0x7f1e080bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e0806ca60 0x7f1e080bd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 -- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e080ab040 msgr2=0x7f1e080a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e080ab040 0x7f1e080a7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.797+0000 7f1e0dd9c700 1 -- 172.21.15.43:0/954302021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df80094a0 con 0x7f1e080c51a0 2023-08-27T11:28:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1e0dd9c700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f1e00002230 tx=0x7f1e0000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000aac0 con 0x7f1e080c51a0 2023-08-27T11:28:53.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000ac40 con 0x7f1e080c51a0 2023-08-27T11:28:53.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000070d0 con 0x7f1e080c51a0 2023-08-27T11:28:53.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e080bf4b0 con 0x7f1e080c51a0 2023-08-27T11:28:53.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.798+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e080bfa70 con 0x7f1e080c51a0 2023-08-27T11:28:53.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.799+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e080bfc60 con 0x7f1e080c51a0 2023-08-27T11:28:53.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.800+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1e00007250 con 0x7f1e080c51a0 2023-08-27T11:28:53.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.801+0000 7f1dfdffb700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 0x7f1dec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:53.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.801+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f1e00088240 con 0x7f1e080c51a0 2023-08-27T11:28:53.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.801+0000 7f1e0d59b700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 0x7f1dec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:53.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.802+0000 7f1e0d59b700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 0x7f1dec06c5a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1e04006b20 tx=0x7f1e04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:53.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:53.806+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1e00053660 con 0x7f1e080c51a0 2023-08-27T11:28:54.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.022+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e0804ee70 con 0x7f1e080c51a0 2023-08-27T11:28:54.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.023+0000 7f1dfdffb700 1 -- 172.21.15.43:0/954302021 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+21847 (secure 0 0 0) 0x7f1e00056c80 con 0x7f1e080c51a0 2023-08-27T11:28:54.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:54.026 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":128,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:53.933498+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:54.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 msgr2=0x7f1dec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:54.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 0x7f1dec06c5a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1e04006b20 tx=0x7f1e04008040 comp rx=0 tx=0).stop 2023-08-27T11:28:54.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 msgr2=0x7f1e081eace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:54.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f1e00002230 tx=0x7f1e0000cf50 comp rx=0 tx=0).stop 2023-08-27T11:28:54.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 shutdown_connections 2023-08-27T11:28:54.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1dec06a0e0 0x7f1dec06c5a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1e080c51a0 0x7f1e081eace0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1e0806ca60 0x7f1e080bd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 --2- 172.21.15.43:0/954302021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e080ab040 0x7f1e080a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 >> 172.21.15.43:0/954302021 conn(0x7f1e0806aa50 msgr2=0x7f1e0806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:54.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 shutdown_connections 2023-08-27T11:28:54.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.026+0000 7f1e0f7ff700 1 -- 172.21.15.43:0/954302021 wait complete. 2023-08-27T11:28:54.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-08-27T11:28:54.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.253+0000 7f9d9afff700 1 Processor -- start 2023-08-27T11:28:54.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.253+0000 7f9d9afff700 1 -- start start 2023-08-27T11:28:54.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d9afff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d940c5230 0x7f9d9406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d9afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d94155880 0x7f9d94155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d9afff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d941561f0 con 0x7f9d9406c5e0 2023-08-27T11:28:54.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d9afff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d94152290 con 0x7f9d940c5230 2023-08-27T11:28:54.257 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d9afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9406d7a0 con 0x7f9d94155880 2023-08-27T11:28:54.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d98d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d940c5230 0x7f9d9406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d98d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f9d940c5230 0x7f9d9406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58380/0 (socket says 172.21.15.43:58380) 2023-08-27T11:28:54.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.254+0000 7f9d98d9b700 1 -- 172.21.15.43:0/3161144190 learned_addr learned my addr 172.21.15.43:0/3161144190 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:54.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d9959c700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d94155880 0x7f9d94155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d98d9b700 1 -- 172.21.15.43:0/3161144190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d94155880 msgr2=0x7f9d94155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:54.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d98d9b700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d94155880 0x7f9d94155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d98d9b700 1 -- 172.21.15.43:0/3161144190 >> v1:172.21.15.57:6789/0 conn(0x7f9d9406c5e0 legacy=0x7f9d940aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:54.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d98d9b700 1 -- 172.21.15.43:0/3161144190 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94152550 con 0x7f9d940c5230 2023-08-27T11:28:54.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d98d9b700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d940c5230 0x7f9d9406d1c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9d880098f0 tx=0x7f9d88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccefcf13f471eb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:54.259 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d937fe700 1 -- 172.21.15.43:0/3161144190 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88004230 con 0x7f9d940c5230 2023-08-27T11:28:54.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d937fe700 1 -- 172.21.15.43:0/3161144190 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88004390 con 0x7f9d940c5230 2023-08-27T11:28:54.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.255+0000 7f9d937fe700 1 -- 172.21.15.43:0/3161144190 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880036a0 con 0x7f9d940c5230 2023-08-27T11:28:54.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 -- 172.21.15.43:0/3161144190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d940c5230 msgr2=0x7f9d9406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:54.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d940c5230 0x7f9d9406d1c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9d880098f0 tx=0x7f9d88009c00 comp rx=0 tx=0).stop 2023-08-27T11:28:54.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 -- 172.21.15.43:0/3161144190 shutdown_connections 2023-08-27T11:28:54.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d94155880 0x7f9d94155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 --2- 172.21.15.43:0/3161144190 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d940c5230 0x7f9d9406d1c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 -- 172.21.15.43:0/3161144190 >> 172.21.15.43:0/3161144190 conn(0x7f9d940c5b10 msgr2=0x7f9d940c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 -- 172.21.15.43:0/3161144190 shutdown_connections 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.256+0000 7f9d9afff700 1 -- 172.21.15.43:0/3161144190 wait complete. 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.258+0000 7f9d9afff700 1 Processor -- start 2023-08-27T11:28:54.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.258+0000 7f9d9afff700 1 -- start start 2023-08-27T11:28:54.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9406c5e0 0x7f9d94070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d940c5230 0x7f9d941ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94071e70 con 0x7f9d94155880 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940a8c50 con 0x7f9d9406c5e0 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940a9460 con 0x7f9d940c5230 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58386/0 (socket says 172.21.15.43:58386) 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d9959c700 1 -- 172.21.15.43:0/4081657914 learned_addr learned my addr 172.21.15.43:0/4081657914 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:54.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d93fff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d940c5230 0x7f9d941ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.259+0000 7f9d98d9b700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9406c5e0 0x7f9d94070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 -- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d940c5230 msgr2=0x7f9d941ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d940c5230 0x7f9d941ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 -- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9406c5e0 msgr2=0x7f9d94070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9406c5e0 0x7f9d94070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:54.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 -- 172.21.15.43:0/4081657914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009550 con 0x7f9d94155880 2023-08-27T11:28:54.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9959c700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c007e60 tx=0x7f9d8c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:54.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00ed30 con 0x7f9d94155880 2023-08-27T11:28:54.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c014420 con 0x7f9d94155880 2023-08-27T11:28:54.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d941ed920 con 0x7f9d94155880 2023-08-27T11:28:54.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0147d0 con 0x7f9d94155880 2023-08-27T11:28:54.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.260+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d940a8ea0 con 0x7f9d94155880 2023-08-27T11:28:54.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.261+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d940a98c0 con 0x7f9d94155880 2023-08-27T11:28:54.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.262+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d8c014930 con 0x7f9d94155880 2023-08-27T11:28:54.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.263+0000 7f9d917fa700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 0x7f9d7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:54.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.264+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9d8c088e50 con 0x7f9d94155880 2023-08-27T11:28:54.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.264+0000 7f9d98d9b700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 0x7f9d7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:54.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.264+0000 7f9d98d9b700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 0x7f9d7806c5a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009130 tx=0x7f9d88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:54.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.267+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9d940a98c0 con 0x7f9d94155880 2023-08-27T11:28:54.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:54.526+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9d940a98c0 con 0x7f9d94155880 2023-08-27T11:28:55.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.130+0000 7f9d917fa700 1 -- 172.21.15.43:0/4081657914 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v134) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9d940a98c0 con 0x7f9d94155880 2023-08-27T11:28:55.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 msgr2=0x7f9d7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 0x7f9d7806c5a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009130 tx=0x7f9d88008030 comp rx=0 tx=0).stop 2023-08-27T11:28:55.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 msgr2=0x7f9d9414a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c007e60 tx=0x7f9d8c00e3c0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 shutdown_connections 2023-08-27T11:28:55.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9d7806a0e0 0x7f9d7806c5a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9d94155880 0x7f9d9414a220 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9d9406c5e0 0x7f9d94070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 --2- 172.21.15.43:0/4081657914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9d940c5230 0x7f9d941ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 >> 172.21.15.43:0/4081657914 conn(0x7f9d940c5b10 msgr2=0x7f9d940a6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:55.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 shutdown_connections 2023-08-27T11:28:55.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.133+0000 7f9d9afff700 1 -- 172.21.15.43:0/4081657914 wait complete. 2023-08-27T11:28:55.156 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:28:55.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-08-27T11:28:55.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.364+0000 7ffa4cdff700 1 Processor -- start 2023-08-27T11:28:55.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.365+0000 7ffa4cdff700 1 -- start start 2023-08-27T11:28:55.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa4cdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa480c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa4cdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa48154660 con 0x7ffa4806a8e0 2023-08-27T11:28:55.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa4cdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa48154940 con 0x7ffa48151d20 2023-08-27T11:28:55.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa4cdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480c5750 con 0x7ffa480c7c00 2023-08-27T11:28:55.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa46d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ffa4806a8e0 0x7ffa4806ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60306/0 (socket says 172.21.15.43:60306) 2023-08-27T11:28:55.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa46d9d700 1 -- 172.21.15.43:0/3660477481 learned_addr learned my addr 172.21.15.43:0/3660477481 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:55.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112823830 0 0) 0x7ffa48154660 con 0x7ffa4806a8e0 2023-08-27T11:28:55.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa480c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.366+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa340035b0 con 0x7ffa4806a8e0 2023-08-27T11:28:55.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899002303 0 0) 0x7ffa340035b0 con 0x7ffa4806a8e0 2023-08-27T11:28:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 msgr2=0x7ffa480c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa480c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 >> v1:172.21.15.57:6789/0 conn(0x7ffa48151d20 legacy=0x7ffa480ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa48154c20 con 0x7ffa4806a8e0 2023-08-27T11:28:55.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7ffa40001a40 con 0x7ffa4806a8e0 2023-08-27T11:28:55.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 >> v1:172.21.15.43:6789/0 conn(0x7ffa4806a8e0 legacy=0x7ffa4806ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa34003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa34004de0 0x7ffa34005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3400bcc0 con 0x7ffa34004070 2023-08-27T11:28:55.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3400be30 con 0x7ffa34004de0 2023-08-27T11:28:55.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3400bff0 con 0x7ffa480c7c00 2023-08-27T11:28:55.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa4659c700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa34003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.367+0000 7ffa46d9d700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa34004de0 0x7ffa34005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 -- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 msgr2=0x7ffa34003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:55.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480c7c00 0x7ffa34003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 -- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa34004de0 msgr2=0x7ffa34005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:55.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa34004de0 0x7ffa34005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 -- 172.21.15.43:0/3660477481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340035b0 con 0x7ffa34004070 2023-08-27T11:28:55.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa34004850 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009b60 tx=0x7ffa34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc65bfee86a6271 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:55.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000e6c0 con 0x7ffa34004070 2023-08-27T11:28:55.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000e820 con 0x7ffa34004070 2023-08-27T11:28:55.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.368+0000 7ffa45d9b700 1 -- 172.21.15.43:0/3660477481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000eb90 con 0x7ffa34004070 2023-08-27T11:28:55.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 -- 172.21.15.43:0/3660477481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 msgr2=0x7ffa34004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/3660477481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa34004850 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009b60 tx=0x7ffa34005880 comp rx=0 tx=0).stop 2023-08-27T11:28:55.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa46d9d700 1 -- 172.21.15.43:0/3660477481 reap_dead start 2023-08-27T11:28:55.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 -- 172.21.15.43:0/3660477481 shutdown_connections 2023-08-27T11:28:55.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 -- 172.21.15.43:0/3660477481 >> 172.21.15.43:0/3660477481 conn(0x7ffa480c9d00 msgr2=0x7ffa480ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:55.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 -- 172.21.15.43:0/3660477481 shutdown_connections 2023-08-27T11:28:55.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.369+0000 7ffa4cdff700 1 -- 172.21.15.43:0/3660477481 wait complete. 2023-08-27T11:28:55.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.371+0000 7ffa4cdff700 1 Processor -- start 2023-08-27T11:28:55.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.371+0000 7ffa4cdff700 1 -- start start 2023-08-27T11:28:55.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 0x7ffa4814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa48149b60 0x7ffa48149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481e9520 con 0x7ffa34004070 2023-08-27T11:28:55.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480c18e0 con 0x7ffa48149b60 2023-08-27T11:28:55.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4cdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa480bfdc0 con 0x7ffa480bd780 2023-08-27T11:28:55.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4659c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58400/0 (socket says 172.21.15.43:58400) 2023-08-27T11:28:55.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa4659c700 1 -- 172.21.15.43:0/277951737 learned_addr learned my addr 172.21.15.43:0/277951737 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 0x7ffa4814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.372+0000 7ffa46d9d700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa48149b60 0x7ffa48149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 -- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 msgr2=0x7ffa4814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 0x7ffa4814f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 -- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa48149b60 msgr2=0x7ffa48149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:55.387 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa48149b60 0x7ffa48149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:55.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 -- 172.21.15.43:0/277951737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480c1320 con 0x7ffa34004070 2023-08-27T11:28:55.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 0x7ffa4814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:55.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4659c700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800f7f0 tx=0x7ffa3800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:55.388 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa380013a0 con 0x7ffa34004070 2023-08-27T11:28:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa380052e0 con 0x7ffa34004070 2023-08-27T11:28:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa480c1600 con 0x7ffa34004070 2023-08-27T11:28:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38003680 con 0x7ffa34004070 2023-08-27T11:28:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.373+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa480bfab0 con 0x7ffa34004070 2023-08-27T11:28:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.374+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa480c1180 con 0x7ffa34004070 2023-08-27T11:28:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.375+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa380037e0 con 0x7ffa34004070 2023-08-27T11:28:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.376+0000 7ffa3effd700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.376+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7ffa380886a0 con 0x7ffa34004070 2023-08-27T11:28:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.376+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.377+0000 7ffa3ffff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffa300090b0 tx=0x7ffa30008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:55.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.380+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffa480c1180 con 0x7ffa34004070 2023-08-27T11:28:55.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:55.637+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffa480c1180 con 0x7ffa34004070 2023-08-27T11:28:55.973 INFO:tasks.ceph.mds.c.smithi043.stderr:2023-08-27T11:28:55.972+0000 7fb3977f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:28:56.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.131+0000 7ffa3effd700 1 -- 172.21.15.43:0/277951737 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v135) v1 ==== 123+0+0 (secure 0 0 0) 0x7ffa480c1180 con 0x7ffa34004070 2023-08-27T11:28:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.134+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 msgr2=0x7ffa2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.134+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ffa300090b0 tx=0x7ffa30008030 comp rx=0 tx=0).stop 2023-08-27T11:28:56.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.134+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 msgr2=0x7ffa4814a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.134+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800f7f0 tx=0x7ffa3800fbb0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 shutdown_connections 2023-08-27T11:28:56.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffa2806a0e0 0x7ffa2806c5a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffa48149b60 0x7ffa48149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffa34004070 0x7ffa4814a880 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 --2- 172.21.15.43:0/277951737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffa480bd780 0x7ffa4814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 >> 172.21.15.43:0/277951737 conn(0x7ffa480c9d00 msgr2=0x7ffa48150480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 shutdown_connections 2023-08-27T11:28:56.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.135+0000 7ffa4cdff700 1 -- 172.21.15.43:0/277951737 wait complete. 2023-08-27T11:28:56.157 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-08-27T11:28:56.158 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:56.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.361+0000 7f8557dff700 1 Processor -- start 2023-08-27T11:28:56.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.362+0000 7f8557dff700 1 -- start start 2023-08-27T11:28:56.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.363+0000 7f8557dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f85500bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.363+0000 7f8557dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500c17f0 con 0x7f85500c4c40 2023-08-27T11:28:56.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.363+0000 7f8557dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500c0900 con 0x7f855014e0d0 2023-08-27T11:28:56.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8557dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c21a0 con 0x7f85500c0390 2023-08-27T11:28:56.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f855539a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f85500c4c40 0x7f85500bb5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60316/0 (socket says 172.21.15.43:60316) 2023-08-27T11:28:56.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f855539a700 1 -- 172.21.15.43:0/759134124 learned_addr learned my addr 172.21.15.43:0/759134124 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:56.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f855639c700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f85500bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951400832 0 0) 0x7f85500c17f0 con 0x7f85500c4c40 2023-08-27T11:28:56.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853c0034d0 con 0x7f85500c4c40 2023-08-27T11:28:56.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500238028 0 0) 0x7f853c0034d0 con 0x7f85500c4c40 2023-08-27T11:28:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 msgr2=0x7f85500bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f85500bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 >> v1:172.21.15.57:6789/0 conn(0x7f855014e0d0 legacy=0x7f85500c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500c0be0 con 0x7f85500c4c40 2023-08-27T11:28:56.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.364+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f8540001670 con 0x7f85500c4c40 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 >> v1:172.21.15.43:6789/0 conn(0x7f85500c4c40 legacy=0x7f85500bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c003b20 0x7f853c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853c0088e0 0x7f853c00acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f853c00d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500c21a0 con 0x7f853c0088e0 2023-08-27T11:28:56.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c00dd00 con 0x7f853c003b20 2023-08-27T11:28:56.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c00dec0 con 0x7f85500c0390 2023-08-27T11:28:56.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853c0088e0 0x7f853c00acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f8555b9b700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c003b20 0x7f853c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855639c700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f853c00d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 -- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 msgr2=0x7f853c00d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:56.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500c0390 0x7f853c00d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 -- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c003b20 msgr2=0x7f853c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:56.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c003b20 0x7f853c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.365+0000 7f855539a700 1 -- 172.21.15.43:0/759134124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0034d0 con 0x7f853c0088e0 2023-08-27T11:28:56.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f855539a700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853c0088e0 0x7f853c00acd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f854000c1e0 tx=0x7f853c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4146d4921d74bb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540007b70 con 0x7f853c0088e0 2023-08-27T11:28:56.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854000cd80 con 0x7f853c0088e0 2023-08-27T11:28:56.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f8554b99700 1 -- 172.21.15.43:0/759134124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540005ba0 con 0x7f853c0088e0 2023-08-27T11:28:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f8557dff700 1 -- 172.21.15.43:0/759134124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853c0088e0 msgr2=0x7f853c00acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f8557dff700 1 --2- 172.21.15.43:0/759134124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f853c0088e0 0x7f853c00acd0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f854000c1e0 tx=0x7f853c003780 comp rx=0 tx=0).stop 2023-08-27T11:28:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.366+0000 7f855639c700 1 -- 172.21.15.43:0/759134124 reap_dead start 2023-08-27T11:28:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.367+0000 7f8557dff700 1 -- 172.21.15.43:0/759134124 shutdown_connections 2023-08-27T11:28:56.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.367+0000 7f8557dff700 1 -- 172.21.15.43:0/759134124 >> 172.21.15.43:0/759134124 conn(0x7f855006aa50 msgr2=0x7f85500c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.367+0000 7f8557dff700 1 -- 172.21.15.43:0/759134124 shutdown_connections 2023-08-27T11:28:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.367+0000 7f8557dff700 1 -- 172.21.15.43:0/759134124 wait complete. 2023-08-27T11:28:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.369+0000 7f8557dff700 1 Processor -- start 2023-08-27T11:28:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.369+0000 7f8557dff700 1 -- start start 2023-08-27T11:28:56.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.370+0000 7f8557dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c0088e0 0x7f8550148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.370+0000 7f8557dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.370+0000 7f8557dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 0x7f85500bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.370+0000 7f8557dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85501e9640 con 0x7f85501ea030 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f8557dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85501493e0 con 0x7f853c0088e0 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f8557dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8550143f30 con 0x7f85500be900 2023-08-27T11:28:56.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58418/0 (socket says 172.21.15.43:58418) 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 -- 172.21.15.43:0/139644538 learned_addr learned my addr 172.21.15.43:0/139644538 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855639c700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 0x7f85500bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f8555b9b700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c0088e0 0x7f8550148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 -- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 msgr2=0x7f85500bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 0x7f85500bed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 -- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c0088e0 msgr2=0x7f8550148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c0088e0 0x7f8550148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 -- 172.21.15.43:0/139644538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550144180 con 0x7f85501ea030 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855639c700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 0x7f85500bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.371+0000 7f855539a700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f854000c7d0 tx=0x7f8540001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.372+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540004c80 con 0x7f85501ea030 2023-08-27T11:28:56.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.372+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8540004de0 con 0x7f85501ea030 2023-08-27T11:28:56.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.372+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85500bf2c0 con 0x7f85501ea030 2023-08-27T11:28:56.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.372+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8540007310 con 0x7f85501ea030 2023-08-27T11:28:56.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.372+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85501444e0 con 0x7f85501ea030 2023-08-27T11:28:56.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.373+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85501446d0 con 0x7f85501ea030 2023-08-27T11:28:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.374+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8540019070 con 0x7f85501ea030 2023-08-27T11:28:56.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.375+0000 7f85467fc700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 0x7f853406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.375+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f85400898b0 con 0x7f85501ea030 2023-08-27T11:28:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.375+0000 7f8555b9b700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 0x7f853406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.376+0000 7f8555b9b700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 0x7f853406c5a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f854c0011a0 tx=0x7f854c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.379+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8540054bb0 con 0x7f85501ea030 2023-08-27T11:28:56.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.632+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f855004ee70 con 0x7f85501ea030 2023-08-27T11:28:56.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.633+0000 7f85467fc700 1 -- 172.21.15.43:0/139644538 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+6066 (secure 0 0 0) 0x7f85400581d0 con 0x7f85501ea030 2023-08-27T11:28:56.635 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:56.635 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":135,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124},{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:28:39.024709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8097":{"gid":8097,"name":"d","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2179580288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2179580288},{"type":"v1","addr":"172.21.15.57:6835","nonce":2179580288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":135,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:28:56.129072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:28:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 msgr2=0x7f853406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 0x7f853406c5a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f854c0011a0 tx=0x7f854c009040 comp rx=0 tx=0).stop 2023-08-27T11:28:56.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 msgr2=0x7f85501dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f854000c7d0 tx=0x7f8540001930 comp rx=0 tx=0).stop 2023-08-27T11:28:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 shutdown_connections 2023-08-27T11:28:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f853406a0e0 0x7f853406c5a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85500be900 0x7f85500bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f853c0088e0 0x7f8550148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 --2- 172.21.15.43:0/139644538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f85501ea030 0x7f85501dc850 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.635+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 >> 172.21.15.43:0/139644538 conn(0x7f855006aa50 msgr2=0x7f855014d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.636+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 shutdown_connections 2023-08-27T11:28:56.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.636+0000 7f8557dff700 1 -- 172.21.15.43:0/139644538 wait complete. 2023-08-27T11:28:56.640 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 135 2023-08-27T11:28:56.655 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:28:56.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.854+0000 7fa4509ff700 1 Processor -- start 2023-08-27T11:28:56.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.854+0000 7fa4509ff700 1 -- start start 2023-08-27T11:28:56.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa4509ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa44c14e0d0 0x7fa44c0c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa4509ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c0c45c0 0x7fa44c0bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa4509ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44c0c17f0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa4509ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44c0c21a0 con 0x7fa44c14e0d0 2023-08-27T11:28:56.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa4509ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0bc210 con 0x7fa44c0c45c0 2023-08-27T11:28:56.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa443fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa44c0c4c40 0x7fa44c0bb5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60332/0 (socket says 172.21.15.43:60332) 2023-08-27T11:28:56.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa443fff700 1 -- 172.21.15.43:0/3646153664 learned_addr learned my addr 172.21.15.43:0/3646153664 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:56.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.856+0000 7fa44a59c700 1 --2- 172.21.15.43:0/3646153664 >> v2:172.21.15.57:3300/0 conn(0x7fa44c14e0d0 0x7fa44c0c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44ad9d700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c0c45c0 0x7fa44c0bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa449d9b700 1 -- 172.21.15.43:0/3646153664 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482290959 0 0) 0x7fa44c0c17f0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa449d9b700 1 -- 172.21.15.43:0/3646153664 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4380035b0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44a59c700 1 -- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c0c45c0 msgr2=0x7fa44c0bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:56.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44a59c700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c0c45c0 0x7fa44c0bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44a59c700 1 -- 172.21.15.43:0/3646153664 >> v1:172.21.15.43:6789/0 conn(0x7fa44c0c4c40 legacy=0x7fa44c0bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44a59c700 1 -- 172.21.15.43:0/3646153664 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c0c0900 con 0x7fa44c14e0d0 2023-08-27T11:28:56.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.857+0000 7fa44a59c700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c14e0d0 0x7fa44c0c4080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009870 tx=0x7fa43c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d270c9f28bf4dff2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa449d9b700 1 -- 172.21.15.43:0/3646153664 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c011830 con 0x7fa44c14e0d0 2023-08-27T11:28:56.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa449d9b700 1 -- 172.21.15.43:0/3646153664 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c011990 con 0x7fa44c14e0d0 2023-08-27T11:28:56.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa449d9b700 1 -- 172.21.15.43:0/3646153664 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c011d20 con 0x7fa44c14e0d0 2023-08-27T11:28:56.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 -- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c14e0d0 msgr2=0x7fa44c0c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c14e0d0 0x7fa44c0c4080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009870 tx=0x7fa43c009b80 comp rx=0 tx=0).stop 2023-08-27T11:28:56.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 -- 172.21.15.43:0/3646153664 shutdown_connections 2023-08-27T11:28:56.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c0c45c0 0x7fa44c0bbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 --2- 172.21.15.43:0/3646153664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c14e0d0 0x7fa44c0c4080 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 -- 172.21.15.43:0/3646153664 >> 172.21.15.43:0/3646153664 conn(0x7fa44c06aa50 msgr2=0x7fa44c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:56.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 -- 172.21.15.43:0/3646153664 shutdown_connections 2023-08-27T11:28:56.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.858+0000 7fa4509ff700 1 -- 172.21.15.43:0/3646153664 wait complete. 2023-08-27T11:28:56.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.860+0000 7fa4509ff700 1 Processor -- start 2023-08-27T11:28:56.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.860+0000 7fa4509ff700 1 -- start start 2023-08-27T11:28:56.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c0c45c0 0x7fa44c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c14e0d0 0x7fa44c1ec220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c1ec760 con 0x7fa44c0c4c40 2023-08-27T11:28:56.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0a8840 con 0x7fa44c0c45c0 2023-08-27T11:28:56.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa4509ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44c0a8e00 con 0x7fa44c14e0d0 2023-08-27T11:28:56.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa443fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa443fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58422/0 (socket says 172.21.15.43:58422) 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.861+0000 7fa443fff700 1 -- 172.21.15.43:0/4277909959 learned_addr learned my addr 172.21.15.43:0/4277909959 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa44a59c700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c0c45c0 0x7fa44c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa44ad9d700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c14e0d0 0x7fa44c1ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 -- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c14e0d0 msgr2=0x7fa44c1ec220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c14e0d0 0x7fa44c1ec220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 -- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c0c45c0 msgr2=0x7fa44c0aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:56.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c0c45c0 0x7fa44c0aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:56.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 -- 172.21.15.43:0/4277909959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0094a0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa443fff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa434005910 tx=0x7fa43400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434005d70 con 0x7fa44c0c4c40 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4340070d0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44c1e9f10 con 0x7fa44c0c4c40 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434007440 con 0x7fa44c0c4c40 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.862+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c0a8a90 con 0x7fa44c0c4c40 2023-08-27T11:28:56.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.863+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44c04ee70 con 0x7fa44c0c4c40 2023-08-27T11:28:56.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.865+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa4340075a0 con 0x7fa44c0c4c40 2023-08-27T11:28:56.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.865+0000 7fa442ffd700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:56.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.866+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fa434087c70 con 0x7fa44c0c4c40 2023-08-27T11:28:56.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.866+0000 7fa44a59c700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:56.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.866+0000 7fa44a59c700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0090b0 tx=0x7fa43c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:56.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:56.870+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa4340530a0 con 0x7fa44c0c4c40 2023-08-27T11:28:57.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.081+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa44c0c3e60 con 0x7fa44c0c4c40 2023-08-27T11:28:57.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.082+0000 7fa442ffd700 1 -- 172.21.15.43:0/4277909959 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+21847 (secure 0 0 0) 0x7fa434017090 con 0x7fa44c0c4c40 2023-08-27T11:28:57.084 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:57.084 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":128,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:28:53.933498+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:28:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 msgr2=0x7fa42c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0090b0 tx=0x7fa43c01c040 comp rx=0 tx=0).stop 2023-08-27T11:28:57.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 msgr2=0x7fa44c1ebce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa434005910 tx=0x7fa43400c9e0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 shutdown_connections 2023-08-27T11:28:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa42c06a0e0 0x7fa42c06c5a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa44c14e0d0 0x7fa44c1ec220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa44c0c45c0 0x7fa44c0aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 --2- 172.21.15.43:0/4277909959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa44c0c4c40 0x7fa44c1ebce0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 >> 172.21.15.43:0/4277909959 conn(0x7fa44c06aa50 msgr2=0x7fa44c0c0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 shutdown_connections 2023-08-27T11:28:57.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.085+0000 7fa4509ff700 1 -- 172.21.15.43:0/4277909959 wait complete. 2023-08-27T11:28:57.104 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:28:57.105 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.305+0000 7fa0031ff700 1 Processor -- start 2023-08-27T11:28:57.307 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.306+0000 7fa0031ff700 1 -- start start 2023-08-27T11:28:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa0031ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ffc151910 0x7f9ffc157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa0031ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa0031ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ffc0c5ae0 con 0x7f9ffc0c15e0 2023-08-27T11:28:57.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa0031ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ffc158480 con 0x7f9ffc151910 2023-08-27T11:28:57.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa0031ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc0c1190 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa000f9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ffc151910 0x7f9ffc157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7f9ffbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa00179c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ffc0c15e0 0x7f9ffc0c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:45096/0 (socket says 172.21.15.43:45096) 2023-08-27T11:28:57.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa000f9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ffc151910 0x7f9ffc157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:35432/0 (socket says 172.21.15.43:35432) 2023-08-27T11:28:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7f9ffbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:50950/0 (socket says 172.21.15.43:50950) 2023-08-27T11:28:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.307+0000 7fa00179c700 1 -- 172.21.15.43:0/759127653 learned_addr learned my addr 172.21.15.43:0/759127653 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7f9ffb7fe700 1 -- 172.21.15.43:0/759127653 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200022011 0 0) 0x7f9ffc0c5ae0 con 0x7f9ffc0c15e0 2023-08-27T11:28:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7f9ffb7fe700 1 -- 172.21.15.43:0/759127653 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec0035b0 con 0x7f9ffc0c15e0 2023-08-27T11:28:57.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7fa000f9b700 1 -- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 msgr2=0x7f9ffc157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:57.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7fa000f9b700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7fa000f9b700 1 -- 172.21.15.43:0/759127653 >> v1:172.21.15.57:6789/0 conn(0x7f9ffc0c15e0 legacy=0x7f9ffc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7fa000f9b700 1 -- 172.21.15.43:0/759127653 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc072900 con 0x7f9ffc151910 2023-08-27T11:28:57.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7f9ffbfff700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:28:57.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.308+0000 7fa000f9b700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc157a00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009840 tx=0x7f9ff0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3943e000c9400154 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7f9ffb7fe700 1 -- 172.21.15.43:0/759127653 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011830 con 0x7f9ffc151910 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7f9ffb7fe700 1 -- 172.21.15.43:0/759127653 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0011990 con 0x7f9ffc151910 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7f9ffb7fe700 1 -- 172.21.15.43:0/759127653 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0011d20 con 0x7f9ffc151910 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 -- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 msgr2=0x7f9ffc157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc157a00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009840 tx=0x7f9ff0009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:57.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 -- 172.21.15.43:0/759127653 shutdown_connections 2023-08-27T11:28:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc157a00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 --2- 172.21.15.43:0/759127653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c51a0 0x7f9ffc157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 -- 172.21.15.43:0/759127653 >> 172.21.15.43:0/759127653 conn(0x7f9ffc0a9740 msgr2=0x7f9ffc0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 -- 172.21.15.43:0/759127653 shutdown_connections 2023-08-27T11:28:57.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.309+0000 7fa0031ff700 1 -- 172.21.15.43:0/759127653 wait complete. 2023-08-27T11:28:57.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.311+0000 7fa0031ff700 1 Processor -- start 2023-08-27T11:28:57.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.311+0000 7fa0031ff700 1 -- start start 2023-08-27T11:28:57.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 0x7f9ffc1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc1ee1f0 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc1edf10 con 0x7f9ffc151910 2023-08-27T11:28:57.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa0031ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc1524c0 con 0x7f9ffc0c15e0 2023-08-27T11:28:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7f9ffbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7f9ffbfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58430/0 (socket says 172.21.15.43:58430) 2023-08-27T11:28:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7f9ffbfff700 1 -- 172.21.15.43:0/1166055985 learned_addr learned my addr 172.21.15.43:0/1166055985 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa00179c700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.312+0000 7fa000f9b700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 0x7f9ffc1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 -- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 msgr2=0x7f9ffc1ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 0x7f9ffc1ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 -- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 msgr2=0x7f9ffc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 -- 172.21.15.43:0/1166055985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80094a0 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7fa000f9b700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 0x7f9ffc1ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7fa00179c700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ffbfff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e9b0 tx=0x7f9fe800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800c850 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe800c9b0 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff00094a0 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800cd60 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.313+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc152090 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.314+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc153630 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.315+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9fe8013470 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.316+0000 7f9ff97fa700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 0x7f9fe006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.317+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f9fe80886d0 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.317+0000 7fa000f9b700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 0x7f9fe006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.317+0000 7fa000f9b700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 0x7f9fe006c5a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00090b0 tx=0x7f9ff0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.321+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ffc153630 con 0x7f9ffc0c51a0 2023-08-27T11:28:57.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.527+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ffc152630 con 0x7f9fe006a0e0 2023-08-27T11:28:57.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.546+0000 7f9ff97fa700 1 -- 172.21.15.43:0/1166055985 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+551039 (secure 0 0 0) 0x7f9ffc152630 con 0x7f9fe006a0e0 2023-08-27T11:28:57.554 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:57.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 msgr2=0x7f9fe006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 0x7f9fe006c5a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9ff00090b0 tx=0x7f9ff0008030 comp rx=0 tx=0).stop 2023-08-27T11:28:57.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 msgr2=0x7f9ffc153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e9b0 tx=0x7f9fe800ed70 comp rx=0 tx=0).stop 2023-08-27T11:28:57.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 shutdown_connections 2023-08-27T11:28:57.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9fe006a0e0 0x7f9fe006c5a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ffc151910 0x7f9ffc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ffc0c15e0 0x7f9ffc1ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 --2- 172.21.15.43:0/1166055985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9ffc0c51a0 0x7f9ffc153910 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 >> 172.21.15.43:0/1166055985 conn(0x7f9ffc0a9740 msgr2=0x7f9ffc071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:57.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 shutdown_connections 2023-08-27T11:28:57.561 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.552+0000 7fa0031ff700 1 -- 172.21.15.43:0/1166055985 wait complete. 2023-08-27T11:28:57.561 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:57.572 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-08-27T11:28:56.388955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":373,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250740,"kb_used_data":13752,"kb_used_omap":13,"kb_used_meta":236850,"kb_avail":754723980,"statfs":{"total":773094113280,"available":772837355520,"internally_reserved":0,"allocated":14082048,"data_stored":7252688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":242534488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.307433"},"pg_stats":[{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944835+0000","last_change":"2023-08-27T11:28:52.970905+0000","last_active":"2023-08-27T11:28:53.944835+0000","last_peered":"2023-08-27T11:28:53.944835+0000","last_clean":"2023-08-27T11:28:53.944835+0000","last_became_active":"2023-08-27T11:28:52.970532+0000","last_became_peered":"2023-08-27T11:28:52.970532+0000","last_unstale":"2023-08-27T11:28:53.944835+0000","last_undegraded":"2023-08-27T11:28:53.944835+0000","last_fullsized":"2023-08-27T11:28:53.944835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:16:54.608924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938621+0000","last_change":"2023-08-27T11:28:36.025295+0000","last_active":"2023-08-27T11:28:53.938621+0000","last_peered":"2023-08-27T11:28:53.938621+0000","last_clean":"2023-08-27T11:28:53.938621+0000","last_became_active":"2023-08-27T11:28:36.024913+0000","last_became_peered":"2023-08-27T11:28:36.024913+0000","last_unstale":"2023-08-27T11:28:53.938621+0000","last_undegraded":"2023-08-27T11:28:53.938621+0000","last_fullsized":"2023-08-27T11:28:53.938621+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:19:56.110594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544232+0000","last_change":"2023-08-27T11:28:52.955220+0000","last_active":"2023-08-27T11:28:54.544232+0000","last_peered":"2023-08-27T11:28:54.544232+0000","last_clean":"2023-08-27T11:28:54.544232+0000","last_became_active":"2023-08-27T11:28:52.951920+0000","last_became_peered":"2023-08-27T11:28:52.951920+0000","last_unstale":"2023-08-27T11:28:54.544232+0000","last_undegraded":"2023-08-27T11:28:54.544232+0000","last_fullsized":"2023-08-27T11:28:54.544232+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:10.925089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127804+0000","last_change":"2023-08-27T11:28:36.028793+0000","last_active":"2023-08-27T11:28:54.127804+0000","last_peered":"2023-08-27T11:28:54.127804+0000","last_clean":"2023-08-27T11:28:54.127804+0000","last_became_active":"2023-08-27T11:28:36.028457+0000","last_became_peered":"2023-08-27T11:28:36.028457+0000","last_unstale":"2023-08-27T11:28:54.127804+0000","last_undegraded":"2023-08-27T11:28:54.127804+0000","last_fullsized":"2023-08-27T11:28:54.127804+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:58.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127294+0000","last_change":"2023-08-27T11:28:52.959765+0000","last_active":"2023-08-27T11:28:54.127294+0000","last_peered":"2023-08-27T11:28:54.127294+0000","last_clean":"2023-08-27T11:28:54.127294+0000","last_became_active":"2023-08-27T11:28:52.959481+0000","last_became_peered":"2023-08-27T11:28:52.959481+0000","last_unstale":"2023-08-27T11:28:54.127294+0000","last_undegraded":"2023-08-27T11:28:54.127294+0000","last_fullsized":"2023-08-27T11:28:54.127294+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:49.992877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543339+0000","last_change":"2023-08-27T11:28:36.014516+0000","last_active":"2023-08-27T11:28:54.543339+0000","last_peered":"2023-08-27T11:28:54.543339+0000","last_clean":"2023-08-27T11:28:54.543339+0000","last_became_active":"2023-08-27T11:28:36.013518+0000","last_became_peered":"2023-08-27T11:28:36.013518+0000","last_unstale":"2023-08-27T11:28:54.543339+0000","last_undegraded":"2023-08-27T11:28:54.543339+0000","last_fullsized":"2023-08-27T11:28:54.543339+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:27.852773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943524+0000","last_change":"2023-08-27T11:28:52.965423+0000","last_active":"2023-08-27T11:28:53.943524+0000","last_peered":"2023-08-27T11:28:53.943524+0000","last_clean":"2023-08-27T11:28:53.943524+0000","last_became_active":"2023-08-27T11:28:52.965137+0000","last_became_peered":"2023-08-27T11:28:52.965137+0000","last_unstale":"2023-08-27T11:28:53.943524+0000","last_undegraded":"2023-08-27T11:28:53.943524+0000","last_fullsized":"2023-08-27T11:28:53.943524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:13:38.426677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127018+0000","last_change":"2023-08-27T11:28:36.026307+0000","last_active":"2023-08-27T11:28:54.127018+0000","last_peered":"2023-08-27T11:28:54.127018+0000","last_clean":"2023-08-27T11:28:54.127018+0000","last_became_active":"2023-08-27T11:28:36.026010+0000","last_became_peered":"2023-08-27T11:28:36.026010+0000","last_unstale":"2023-08-27T11:28:54.127018+0000","last_undegraded":"2023-08-27T11:28:54.127018+0000","last_fullsized":"2023-08-27T11:28:54.127018+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:40:15.388622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127402+0000","last_change":"2023-08-27T11:28:52.968368+0000","last_active":"2023-08-27T11:28:54.127402+0000","last_peered":"2023-08-27T11:28:54.127402+0000","last_clean":"2023-08-27T11:28:54.127402+0000","last_became_active":"2023-08-27T11:28:52.968022+0000","last_became_peered":"2023-08-27T11:28:52.968022+0000","last_unstale":"2023-08-27T11:28:54.127402+0000","last_undegraded":"2023-08-27T11:28:54.127402+0000","last_fullsized":"2023-08-27T11:28:54.127402+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:36:56.212337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167700+0000","last_change":"2023-08-27T11:28:36.018518+0000","last_active":"2023-08-27T11:28:54.167700+0000","last_peered":"2023-08-27T11:28:54.167700+0000","last_clean":"2023-08-27T11:28:54.167700+0000","last_became_active":"2023-08-27T11:28:36.016928+0000","last_became_peered":"2023-08-27T11:28:36.016928+0000","last_unstale":"2023-08-27T11:28:54.167700+0000","last_undegraded":"2023-08-27T11:28:54.167700+0000","last_fullsized":"2023-08-27T11:28:54.167700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:45.630236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543076+0000","last_change":"2023-08-27T11:28:52.955295+0000","last_active":"2023-08-27T11:28:54.543076+0000","last_peered":"2023-08-27T11:28:54.543076+0000","last_clean":"2023-08-27T11:28:54.543076+0000","last_became_active":"2023-08-27T11:28:52.954568+0000","last_became_peered":"2023-08-27T11:28:52.954568+0000","last_unstale":"2023-08-27T11:28:54.543076+0000","last_undegraded":"2023-08-27T11:28:54.543076+0000","last_fullsized":"2023-08-27T11:28:54.543076+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:02.715971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943806+0000","last_change":"2023-08-27T11:28:36.032093+0000","last_active":"2023-08-27T11:28:53.943806+0000","last_peered":"2023-08-27T11:28:53.943806+0000","last_clean":"2023-08-27T11:28:53.943806+0000","last_became_active":"2023-08-27T11:28:36.031709+0000","last_became_peered":"2023-08-27T11:28:36.031709+0000","last_unstale":"2023-08-27T11:28:53.943806+0000","last_undegraded":"2023-08-27T11:28:53.943806+0000","last_fullsized":"2023-08-27T11:28:53.943806+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:23.083108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168377+0000","last_change":"2023-08-27T11:28:52.959725+0000","last_active":"2023-08-27T11:28:54.168377+0000","last_peered":"2023-08-27T11:28:54.168377+0000","last_clean":"2023-08-27T11:28:54.168377+0000","last_became_active":"2023-08-27T11:28:52.959522+0000","last_became_peered":"2023-08-27T11:28:52.959522+0000","last_unstale":"2023-08-27T11:28:54.168377+0000","last_undegraded":"2023-08-27T11:28:54.168377+0000","last_fullsized":"2023-08-27T11:28:54.168377+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:57.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542593+0000","last_change":"2023-08-27T11:28:36.037935+0000","last_active":"2023-08-27T11:28:54.542593+0000","last_peered":"2023-08-27T11:28:54.542593+0000","last_clean":"2023-08-27T11:28:54.542593+0000","last_became_active":"2023-08-27T11:28:36.034667+0000","last_became_peered":"2023-08-27T11:28:36.034667+0000","last_unstale":"2023-08-27T11:28:54.542593+0000","last_undegraded":"2023-08-27T11:28:54.542593+0000","last_fullsized":"2023-08-27T11:28:54.542593+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:33.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167481+0000","last_change":"2023-08-27T11:28:52.960430+0000","last_active":"2023-08-27T11:28:54.167481+0000","last_peered":"2023-08-27T11:28:54.167481+0000","last_clean":"2023-08-27T11:28:54.167481+0000","last_became_active":"2023-08-27T11:28:52.960074+0000","last_became_peered":"2023-08-27T11:28:52.960074+0000","last_unstale":"2023-08-27T11:28:54.167481+0000","last_undegraded":"2023-08-27T11:28:54.167481+0000","last_fullsized":"2023-08-27T11:28:54.167481+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:59.312381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542914+0000","last_change":"2023-08-27T11:28:36.025699+0000","last_active":"2023-08-27T11:28:54.542914+0000","last_peered":"2023-08-27T11:28:54.542914+0000","last_clean":"2023-08-27T11:28:54.542914+0000","last_became_active":"2023-08-27T11:28:36.025101+0000","last_became_peered":"2023-08-27T11:28:36.025101+0000","last_unstale":"2023-08-27T11:28:54.542914+0000","last_undegraded":"2023-08-27T11:28:54.542914+0000","last_fullsized":"2023-08-27T11:28:54.542914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:13:21.329711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.939019+0000","last_change":"2023-08-27T11:28:52.969507+0000","last_active":"2023-08-27T11:28:53.939019+0000","last_peered":"2023-08-27T11:28:53.939019+0000","last_clean":"2023-08-27T11:28:53.939019+0000","last_became_active":"2023-08-27T11:28:52.969094+0000","last_became_peered":"2023-08-27T11:28:52.969094+0000","last_unstale":"2023-08-27T11:28:53.939019+0000","last_undegraded":"2023-08-27T11:28:53.939019+0000","last_fullsized":"2023-08-27T11:28:53.939019+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:26:39.809670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944150+0000","last_change":"2023-08-27T11:28:36.032044+0000","last_active":"2023-08-27T11:28:53.944150+0000","last_peered":"2023-08-27T11:28:53.944150+0000","last_clean":"2023-08-27T11:28:53.944150+0000","last_became_active":"2023-08-27T11:28:36.031578+0000","last_became_peered":"2023-08-27T11:28:36.031578+0000","last_unstale":"2023-08-27T11:28:53.944150+0000","last_undegraded":"2023-08-27T11:28:53.944150+0000","last_fullsized":"2023-08-27T11:28:53.944150+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:30.353351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544088+0000","last_change":"2023-08-27T11:28:52.957697+0000","last_active":"2023-08-27T11:28:54.544088+0000","last_peered":"2023-08-27T11:28:54.544088+0000","last_clean":"2023-08-27T11:28:54.544088+0000","last_became_active":"2023-08-27T11:28:52.957376+0000","last_became_peered":"2023-08-27T11:28:52.957376+0000","last_unstale":"2023-08-27T11:28:54.544088+0000","last_undegraded":"2023-08-27T11:28:54.544088+0000","last_fullsized":"2023-08-27T11:28:54.544088+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:03:15.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944347+0000","last_change":"2023-08-27T11:28:36.025467+0000","last_active":"2023-08-27T11:28:53.944347+0000","last_peered":"2023-08-27T11:28:53.944347+0000","last_clean":"2023-08-27T11:28:53.944347+0000","last_became_active":"2023-08-27T11:28:36.025183+0000","last_became_peered":"2023-08-27T11:28:36.025183+0000","last_unstale":"2023-08-27T11:28:53.944347+0000","last_undegraded":"2023-08-27T11:28:53.944347+0000","last_fullsized":"2023-08-27T11:28:53.944347+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:02.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168367+0000","last_change":"2023-08-27T11:28:52.967391+0000","last_active":"2023-08-27T11:28:54.168367+0000","last_peered":"2023-08-27T11:28:54.168367+0000","last_clean":"2023-08-27T11:28:54.168367+0000","last_became_active":"2023-08-27T11:28:52.967102+0000","last_became_peered":"2023-08-27T11:28:52.967102+0000","last_unstale":"2023-08-27T11:28:54.168367+0000","last_undegraded":"2023-08-27T11:28:54.168367+0000","last_fullsized":"2023-08-27T11:28:54.168367+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:00.466304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127396+0000","last_change":"2023-08-27T11:28:36.028552+0000","last_active":"2023-08-27T11:28:54.127396+0000","last_peered":"2023-08-27T11:28:54.127396+0000","last_clean":"2023-08-27T11:28:54.127396+0000","last_became_active":"2023-08-27T11:28:36.028230+0000","last_became_peered":"2023-08-27T11:28:36.028230+0000","last_unstale":"2023-08-27T11:28:54.127396+0000","last_undegraded":"2023-08-27T11:28:54.127396+0000","last_fullsized":"2023-08-27T11:28:54.127396+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:24.100532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167748+0000","last_change":"2023-08-27T11:28:52.953021+0000","last_active":"2023-08-27T11:28:54.167748+0000","last_peered":"2023-08-27T11:28:54.167748+0000","last_clean":"2023-08-27T11:28:54.167748+0000","last_became_active":"2023-08-27T11:28:52.952723+0000","last_became_peered":"2023-08-27T11:28:52.952723+0000","last_unstale":"2023-08-27T11:28:54.167748+0000","last_undegraded":"2023-08-27T11:28:54.167748+0000","last_fullsized":"2023-08-27T11:28:54.167748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.478232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938106+0000","last_change":"2023-08-27T11:28:36.003637+0000","last_active":"2023-08-27T11:28:53.938106+0000","last_peered":"2023-08-27T11:28:53.938106+0000","last_clean":"2023-08-27T11:28:53.938106+0000","last_became_active":"2023-08-27T11:28:36.003238+0000","last_became_peered":"2023-08-27T11:28:36.003238+0000","last_unstale":"2023-08-27T11:28:53.938106+0000","last_undegraded":"2023-08-27T11:28:53.938106+0000","last_fullsized":"2023-08-27T11:28:53.938106+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:36.607713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943754+0000","last_change":"2023-08-27T11:28:52.961781+0000","last_active":"2023-08-27T11:28:53.943754+0000","last_peered":"2023-08-27T11:28:53.943754+0000","last_clean":"2023-08-27T11:28:53.943754+0000","last_became_active":"2023-08-27T11:28:52.961474+0000","last_became_peered":"2023-08-27T11:28:52.961474+0000","last_unstale":"2023-08-27T11:28:53.943754+0000","last_undegraded":"2023-08-27T11:28:53.943754+0000","last_fullsized":"2023-08-27T11:28:53.943754+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:41.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943729+0000","last_change":"2023-08-27T11:28:36.029468+0000","last_active":"2023-08-27T11:28:53.943729+0000","last_peered":"2023-08-27T11:28:53.943729+0000","last_clean":"2023-08-27T11:28:53.943729+0000","last_became_active":"2023-08-27T11:28:36.028083+0000","last_became_peered":"2023-08-27T11:28:36.028083+0000","last_unstale":"2023-08-27T11:28:53.943729+0000","last_undegraded":"2023-08-27T11:28:53.943729+0000","last_fullsized":"2023-08-27T11:28:53.943729+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:16.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167230+0000","last_change":"2023-08-27T11:28:52.957558+0000","last_active":"2023-08-27T11:28:54.167230+0000","last_peered":"2023-08-27T11:28:54.167230+0000","last_clean":"2023-08-27T11:28:54.167230+0000","last_became_active":"2023-08-27T11:28:52.957209+0000","last_became_peered":"2023-08-27T11:28:52.957209+0000","last_unstale":"2023-08-27T11:28:54.167230+0000","last_undegraded":"2023-08-27T11:28:54.167230+0000","last_fullsized":"2023-08-27T11:28:54.167230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:44.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938324+0000","last_change":"2023-08-27T11:28:36.031513+0000","last_active":"2023-08-27T11:28:53.938324+0000","last_peered":"2023-08-27T11:28:53.938324+0000","last_clean":"2023-08-27T11:28:53.938324+0000","last_became_active":"2023-08-27T11:28:36.031228+0000","last_became_peered":"2023-08-27T11:28:36.031228+0000","last_unstale":"2023-08-27T11:28:53.938324+0000","last_undegraded":"2023-08-27T11:28:53.938324+0000","last_fullsized":"2023-08-27T11:28:53.938324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:30.485111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167957+0000","last_change":"2023-08-27T11:28:52.953161+0000","last_active":"2023-08-27T11:28:54.167957+0000","last_peered":"2023-08-27T11:28:54.167957+0000","last_clean":"2023-08-27T11:28:54.167957+0000","last_became_active":"2023-08-27T11:28:52.952874+0000","last_became_peered":"2023-08-27T11:28:52.952874+0000","last_unstale":"2023-08-27T11:28:54.167957+0000","last_undegraded":"2023-08-27T11:28:54.167957+0000","last_fullsized":"2023-08-27T11:28:54.167957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:24:54.174903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.937934+0000","last_change":"2023-08-27T11:28:36.031969+0000","last_active":"2023-08-27T11:28:53.937934+0000","last_peered":"2023-08-27T11:28:53.937934+0000","last_clean":"2023-08-27T11:28:53.937934+0000","last_became_active":"2023-08-27T11:28:36.030385+0000","last_became_peered":"2023-08-27T11:28:36.030385+0000","last_unstale":"2023-08-27T11:28:53.937934+0000","last_undegraded":"2023-08-27T11:28:53.937934+0000","last_fullsized":"2023-08-27T11:28:53.937934+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:19.251549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542532+0000","last_change":"2023-08-27T11:28:52.959856+0000","last_active":"2023-08-27T11:28:54.542532+0000","last_peered":"2023-08-27T11:28:54.542532+0000","last_clean":"2023-08-27T11:28:54.542532+0000","last_became_active":"2023-08-27T11:28:52.959579+0000","last_became_peered":"2023-08-27T11:28:52.959579+0000","last_unstale":"2023-08-27T11:28:54.542532+0000","last_undegraded":"2023-08-27T11:28:54.542532+0000","last_fullsized":"2023-08-27T11:28:54.542532+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:38:55.412052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943161+0000","last_change":"2023-08-27T11:28:36.035072+0000","last_active":"2023-08-27T11:28:53.943161+0000","last_peered":"2023-08-27T11:28:53.943161+0000","last_clean":"2023-08-27T11:28:53.943161+0000","last_became_active":"2023-08-27T11:28:36.031725+0000","last_became_peered":"2023-08-27T11:28:36.031725+0000","last_unstale":"2023-08-27T11:28:53.943161+0000","last_undegraded":"2023-08-27T11:28:53.943161+0000","last_fullsized":"2023-08-27T11:28:53.943161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:18:20.304393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543484+0000","last_change":"2023-08-27T11:28:52.971482+0000","last_active":"2023-08-27T11:28:54.543484+0000","last_peered":"2023-08-27T11:28:54.543484+0000","last_clean":"2023-08-27T11:28:54.543484+0000","last_became_active":"2023-08-27T11:28:52.970997+0000","last_became_peered":"2023-08-27T11:28:52.970997+0000","last_unstale":"2023-08-27T11:28:54.543484+0000","last_undegraded":"2023-08-27T11:28:54.543484+0000","last_fullsized":"2023-08-27T11:28:54.543484+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:13.194705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944270+0000","last_change":"2023-08-27T11:28:36.026210+0000","last_active":"2023-08-27T11:28:53.944270+0000","last_peered":"2023-08-27T11:28:53.944270+0000","last_clean":"2023-08-27T11:28:53.944270+0000","last_became_active":"2023-08-27T11:28:36.025658+0000","last_became_peered":"2023-08-27T11:28:36.025658+0000","last_unstale":"2023-08-27T11:28:53.944270+0000","last_undegraded":"2023-08-27T11:28:53.944270+0000","last_fullsized":"2023-08-27T11:28:53.944270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:14.460751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944291+0000","last_change":"2023-08-27T11:28:52.955731+0000","last_active":"2023-08-27T11:28:53.944291+0000","last_peered":"2023-08-27T11:28:53.944291+0000","last_clean":"2023-08-27T11:28:53.944291+0000","last_became_active":"2023-08-27T11:28:52.955461+0000","last_became_peered":"2023-08-27T11:28:52.955461+0000","last_unstale":"2023-08-27T11:28:53.944291+0000","last_undegraded":"2023-08-27T11:28:53.944291+0000","last_fullsized":"2023-08-27T11:28:53.944291+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:44.392829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167843+0000","last_change":"2023-08-27T11:28:36.018073+0000","last_active":"2023-08-27T11:28:54.167843+0000","last_peered":"2023-08-27T11:28:54.167843+0000","last_clean":"2023-08-27T11:28:54.167843+0000","last_became_active":"2023-08-27T11:28:36.017781+0000","last_became_peered":"2023-08-27T11:28:36.017781+0000","last_unstale":"2023-08-27T11:28:54.167843+0000","last_undegraded":"2023-08-27T11:28:54.167843+0000","last_fullsized":"2023-08-27T11:28:54.167843+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:20.044100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545105+0000","last_change":"2023-08-27T11:28:52.961616+0000","last_active":"2023-08-27T11:28:54.545105+0000","last_peered":"2023-08-27T11:28:54.545105+0000","last_clean":"2023-08-27T11:28:54.545105+0000","last_became_active":"2023-08-27T11:28:52.961275+0000","last_became_peered":"2023-08-27T11:28:52.961275+0000","last_unstale":"2023-08-27T11:28:54.545105+0000","last_undegraded":"2023-08-27T11:28:54.545105+0000","last_fullsized":"2023-08-27T11:28:54.545105+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:57:13.830082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544159+0000","last_change":"2023-08-27T11:28:36.038441+0000","last_active":"2023-08-27T11:28:54.544159+0000","last_peered":"2023-08-27T11:28:54.544159+0000","last_clean":"2023-08-27T11:28:54.544159+0000","last_became_active":"2023-08-27T11:28:36.036212+0000","last_became_peered":"2023-08-27T11:28:36.036212+0000","last_unstale":"2023-08-27T11:28:54.544159+0000","last_undegraded":"2023-08-27T11:28:54.544159+0000","last_fullsized":"2023-08-27T11:28:54.544159+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:03.531752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938765+0000","last_change":"2023-08-27T11:28:52.964385+0000","last_active":"2023-08-27T11:28:53.938765+0000","last_peered":"2023-08-27T11:28:53.938765+0000","last_clean":"2023-08-27T11:28:53.938765+0000","last_became_active":"2023-08-27T11:28:52.964020+0000","last_became_peered":"2023-08-27T11:28:52.964020+0000","last_unstale":"2023-08-27T11:28:53.938765+0000","last_undegraded":"2023-08-27T11:28:53.938765+0000","last_fullsized":"2023-08-27T11:28:53.938765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:51.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168591+0000","last_change":"2023-08-27T11:28:36.034189+0000","last_active":"2023-08-27T11:28:54.168591+0000","last_peered":"2023-08-27T11:28:54.168591+0000","last_clean":"2023-08-27T11:28:54.168591+0000","last_became_active":"2023-08-27T11:28:36.033669+0000","last_became_peered":"2023-08-27T11:28:36.033669+0000","last_unstale":"2023-08-27T11:28:54.168591+0000","last_undegraded":"2023-08-27T11:28:54.168591+0000","last_fullsized":"2023-08-27T11:28:54.168591+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:35.542306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542530+0000","last_change":"2023-08-27T11:28:52.965411+0000","last_active":"2023-08-27T11:28:54.542530+0000","last_peered":"2023-08-27T11:28:54.542530+0000","last_clean":"2023-08-27T11:28:54.542530+0000","last_became_active":"2023-08-27T11:28:52.965122+0000","last_became_peered":"2023-08-27T11:28:52.965122+0000","last_unstale":"2023-08-27T11:28:54.542530+0000","last_undegraded":"2023-08-27T11:28:54.542530+0000","last_fullsized":"2023-08-27T11:28:54.542530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:37.452054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127182+0000","last_change":"2023-08-27T11:28:36.028057+0000","last_active":"2023-08-27T11:28:54.127182+0000","last_peered":"2023-08-27T11:28:54.127182+0000","last_clean":"2023-08-27T11:28:54.127182+0000","last_became_active":"2023-08-27T11:28:36.027646+0000","last_became_peered":"2023-08-27T11:28:36.027646+0000","last_unstale":"2023-08-27T11:28:54.127182+0000","last_undegraded":"2023-08-27T11:28:54.127182+0000","last_fullsized":"2023-08-27T11:28:54.127182+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:26.709063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938308+0000","last_change":"2023-08-27T11:28:52.942898+0000","last_active":"2023-08-27T11:28:53.938308+0000","last_peered":"2023-08-27T11:28:53.938308+0000","last_clean":"2023-08-27T11:28:53.938308+0000","last_became_active":"2023-08-27T11:28:52.942592+0000","last_became_peered":"2023-08-27T11:28:52.942592+0000","last_unstale":"2023-08-27T11:28:53.938308+0000","last_undegraded":"2023-08-27T11:28:53.938308+0000","last_fullsized":"2023-08-27T11:28:53.938308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:56.339532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938196+0000","last_change":"2023-08-27T11:28:36.019510+0000","last_active":"2023-08-27T11:28:53.938196+0000","last_peered":"2023-08-27T11:28:53.938196+0000","last_clean":"2023-08-27T11:28:53.938196+0000","last_became_active":"2023-08-27T11:28:36.019179+0000","last_became_peered":"2023-08-27T11:28:36.019179+0000","last_unstale":"2023-08-27T11:28:53.938196+0000","last_undegraded":"2023-08-27T11:28:53.938196+0000","last_fullsized":"2023-08-27T11:28:53.938196+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:42.947156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167802+0000","last_change":"2023-08-27T11:28:52.967202+0000","last_active":"2023-08-27T11:28:54.167802+0000","last_peered":"2023-08-27T11:28:54.167802+0000","last_clean":"2023-08-27T11:28:54.167802+0000","last_became_active":"2023-08-27T11:28:52.966903+0000","last_became_peered":"2023-08-27T11:28:52.966903+0000","last_unstale":"2023-08-27T11:28:54.167802+0000","last_undegraded":"2023-08-27T11:28:54.167802+0000","last_fullsized":"2023-08-27T11:28:54.167802+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:38:55.412052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126660+0000","last_change":"2023-08-27T11:28:36.033383+0000","last_active":"2023-08-27T11:28:54.126660+0000","last_peered":"2023-08-27T11:28:54.126660+0000","last_clean":"2023-08-27T11:28:54.126660+0000","last_became_active":"2023-08-27T11:28:36.033079+0000","last_became_peered":"2023-08-27T11:28:36.033079+0000","last_unstale":"2023-08-27T11:28:54.126660+0000","last_undegraded":"2023-08-27T11:28:54.126660+0000","last_fullsized":"2023-08-27T11:28:54.126660+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:14:19.562242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126820+0000","last_change":"2023-08-27T11:28:52.967971+0000","last_active":"2023-08-27T11:28:54.126820+0000","last_peered":"2023-08-27T11:28:54.126820+0000","last_clean":"2023-08-27T11:28:54.126820+0000","last_became_active":"2023-08-27T11:28:52.967668+0000","last_became_peered":"2023-08-27T11:28:52.967668+0000","last_unstale":"2023-08-27T11:28:54.126820+0000","last_undegraded":"2023-08-27T11:28:54.126820+0000","last_fullsized":"2023-08-27T11:28:54.126820+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:40:21.488882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.942925+0000","last_change":"2023-08-27T11:28:36.026817+0000","last_active":"2023-08-27T11:28:53.942925+0000","last_peered":"2023-08-27T11:28:53.942925+0000","last_clean":"2023-08-27T11:28:53.942925+0000","last_became_active":"2023-08-27T11:28:36.026404+0000","last_became_peered":"2023-08-27T11:28:36.026404+0000","last_unstale":"2023-08-27T11:28:53.942925+0000","last_undegraded":"2023-08-27T11:28:53.942925+0000","last_fullsized":"2023-08-27T11:28:53.942925+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:18.555018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167920+0000","last_change":"2023-08-27T11:28:52.969344+0000","last_active":"2023-08-27T11:28:54.167920+0000","last_peered":"2023-08-27T11:28:54.167920+0000","last_clean":"2023-08-27T11:28:54.167920+0000","last_became_active":"2023-08-27T11:28:52.969023+0000","last_became_peered":"2023-08-27T11:28:52.969023+0000","last_unstale":"2023-08-27T11:28:54.167920+0000","last_undegraded":"2023-08-27T11:28:54.167920+0000","last_fullsized":"2023-08-27T11:28:54.167920+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:25.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545672+0000","last_change":"2023-08-27T11:28:36.018195+0000","last_active":"2023-08-27T11:28:54.545672+0000","last_peered":"2023-08-27T11:28:54.545672+0000","last_clean":"2023-08-27T11:28:54.545672+0000","last_became_active":"2023-08-27T11:28:36.017891+0000","last_became_peered":"2023-08-27T11:28:36.017891+0000","last_unstale":"2023-08-27T11:28:54.545672+0000","last_undegraded":"2023-08-27T11:28:54.545672+0000","last_fullsized":"2023-08-27T11:28:54.545672+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:40:46.517021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938680+0000","last_change":"2023-08-27T11:28:52.954128+0000","last_active":"2023-08-27T11:28:53.938680+0000","last_peered":"2023-08-27T11:28:53.938680+0000","last_clean":"2023-08-27T11:28:53.938680+0000","last_became_active":"2023-08-27T11:28:52.953855+0000","last_became_peered":"2023-08-27T11:28:52.953855+0000","last_unstale":"2023-08-27T11:28:53.938680+0000","last_undegraded":"2023-08-27T11:28:53.938680+0000","last_fullsized":"2023-08-27T11:28:53.938680+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:10:50.320430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544581+0000","last_change":"2023-08-27T11:28:36.033043+0000","last_active":"2023-08-27T11:28:54.544581+0000","last_peered":"2023-08-27T11:28:54.544581+0000","last_clean":"2023-08-27T11:28:54.544581+0000","last_became_active":"2023-08-27T11:28:36.032749+0000","last_became_peered":"2023-08-27T11:28:36.032749+0000","last_unstale":"2023-08-27T11:28:54.544581+0000","last_undegraded":"2023-08-27T11:28:54.544581+0000","last_fullsized":"2023-08-27T11:28:54.544581+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:17.454243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127527+0000","last_change":"2023-08-27T11:28:52.959156+0000","last_active":"2023-08-27T11:28:54.127527+0000","last_peered":"2023-08-27T11:28:54.127527+0000","last_clean":"2023-08-27T11:28:54.127527+0000","last_became_active":"2023-08-27T11:28:52.958808+0000","last_became_peered":"2023-08-27T11:28:52.958808+0000","last_unstale":"2023-08-27T11:28:54.127527+0000","last_undegraded":"2023-08-27T11:28:54.127527+0000","last_fullsized":"2023-08-27T11:28:54.127527+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:28.646510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543832+0000","last_change":"2023-08-27T11:28:36.036171+0000","last_active":"2023-08-27T11:28:54.543832+0000","last_peered":"2023-08-27T11:28:54.543832+0000","last_clean":"2023-08-27T11:28:54.543832+0000","last_became_active":"2023-08-27T11:28:36.035804+0000","last_became_peered":"2023-08-27T11:28:36.035804+0000","last_unstale":"2023-08-27T11:28:54.543832+0000","last_undegraded":"2023-08-27T11:28:54.543832+0000","last_fullsized":"2023-08-27T11:28:54.543832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:54:18.370265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127267+0000","last_change":"2023-08-27T11:28:52.962341+0000","last_active":"2023-08-27T11:28:54.127267+0000","last_peered":"2023-08-27T11:28:54.127267+0000","last_clean":"2023-08-27T11:28:54.127267+0000","last_became_active":"2023-08-27T11:28:52.960517+0000","last_became_peered":"2023-08-27T11:28:52.960517+0000","last_unstale":"2023-08-27T11:28:54.127267+0000","last_undegraded":"2023-08-27T11:28:54.127267+0000","last_fullsized":"2023-08-27T11:28:54.127267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:45:51.060085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944592+0000","last_change":"2023-08-27T11:28:36.028752+0000","last_active":"2023-08-27T11:28:53.944592+0000","last_peered":"2023-08-27T11:28:53.944592+0000","last_clean":"2023-08-27T11:28:53.944592+0000","last_became_active":"2023-08-27T11:28:36.028448+0000","last_became_peered":"2023-08-27T11:28:36.028448+0000","last_unstale":"2023-08-27T11:28:53.944592+0000","last_undegraded":"2023-08-27T11:28:53.944592+0000","last_fullsized":"2023-08-27T11:28:53.944592+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:48.381266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167303+0000","last_change":"2023-08-27T11:28:52.954147+0000","last_active":"2023-08-27T11:28:54.167303+0000","last_peered":"2023-08-27T11:28:54.167303+0000","last_clean":"2023-08-27T11:28:54.167303+0000","last_became_active":"2023-08-27T11:28:52.953813+0000","last_became_peered":"2023-08-27T11:28:52.953813+0000","last_unstale":"2023-08-27T11:28:54.167303+0000","last_undegraded":"2023-08-27T11:28:54.167303+0000","last_fullsized":"2023-08-27T11:28:54.167303+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:41.864976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543579+0000","last_change":"2023-08-27T11:28:36.027534+0000","last_active":"2023-08-27T11:28:54.543579+0000","last_peered":"2023-08-27T11:28:54.543579+0000","last_clean":"2023-08-27T11:28:54.543579+0000","last_became_active":"2023-08-27T11:28:36.027208+0000","last_became_peered":"2023-08-27T11:28:36.027208+0000","last_unstale":"2023-08-27T11:28:54.543579+0000","last_undegraded":"2023-08-27T11:28:54.543579+0000","last_fullsized":"2023-08-27T11:28:54.543579+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:53.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542817+0000","last_change":"2023-08-27T11:28:52.954320+0000","last_active":"2023-08-27T11:28:54.542817+0000","last_peered":"2023-08-27T11:28:54.542817+0000","last_clean":"2023-08-27T11:28:54.542817+0000","last_became_active":"2023-08-27T11:28:52.953989+0000","last_became_peered":"2023-08-27T11:28:52.953989+0000","last_unstale":"2023-08-27T11:28:54.542817+0000","last_undegraded":"2023-08-27T11:28:54.542817+0000","last_fullsized":"2023-08-27T11:28:54.542817+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:57.664067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542933+0000","last_change":"2023-08-27T11:28:36.029470+0000","last_active":"2023-08-27T11:28:54.542933+0000","last_peered":"2023-08-27T11:28:54.542933+0000","last_clean":"2023-08-27T11:28:54.542933+0000","last_became_active":"2023-08-27T11:28:36.028657+0000","last_became_peered":"2023-08-27T11:28:36.028657+0000","last_unstale":"2023-08-27T11:28:54.542933+0000","last_undegraded":"2023-08-27T11:28:54.542933+0000","last_fullsized":"2023-08-27T11:28:54.542933+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:04.796015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543579+0000","last_change":"2023-08-27T11:28:52.953855+0000","last_active":"2023-08-27T11:28:54.543579+0000","last_peered":"2023-08-27T11:28:54.543579+0000","last_clean":"2023-08-27T11:28:54.543579+0000","last_became_active":"2023-08-27T11:28:52.953186+0000","last_became_peered":"2023-08-27T11:28:52.953186+0000","last_unstale":"2023-08-27T11:28:54.543579+0000","last_undegraded":"2023-08-27T11:28:54.543579+0000","last_fullsized":"2023-08-27T11:28:54.543579+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:40.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542638+0000","last_change":"2023-08-27T11:28:36.032791+0000","last_active":"2023-08-27T11:28:54.542638+0000","last_peered":"2023-08-27T11:28:54.542638+0000","last_clean":"2023-08-27T11:28:54.542638+0000","last_became_active":"2023-08-27T11:28:36.032496+0000","last_became_peered":"2023-08-27T11:28:36.032496+0000","last_unstale":"2023-08-27T11:28:54.542638+0000","last_undegraded":"2023-08-27T11:28:54.542638+0000","last_fullsized":"2023-08-27T11:28:54.542638+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:01.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938511+0000","last_change":"2023-08-27T11:28:52.956303+0000","last_active":"2023-08-27T11:28:53.938511+0000","last_peered":"2023-08-27T11:28:53.938511+0000","last_clean":"2023-08-27T11:28:53.938511+0000","last_became_active":"2023-08-27T11:28:52.955766+0000","last_became_peered":"2023-08-27T11:28:52.955766+0000","last_unstale":"2023-08-27T11:28:53.938511+0000","last_undegraded":"2023-08-27T11:28:53.938511+0000","last_fullsized":"2023-08-27T11:28:53.938511+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:08.162719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943858+0000","last_change":"2023-08-27T11:28:36.036286+0000","last_active":"2023-08-27T11:28:53.943858+0000","last_peered":"2023-08-27T11:28:53.943858+0000","last_clean":"2023-08-27T11:28:53.943858+0000","last_became_active":"2023-08-27T11:28:36.036000+0000","last_became_peered":"2023-08-27T11:28:36.036000+0000","last_unstale":"2023-08-27T11:28:53.943858+0000","last_undegraded":"2023-08-27T11:28:53.943858+0000","last_fullsized":"2023-08-27T11:28:53.943858+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:24.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943719+0000","last_change":"2023-08-27T11:28:52.953416+0000","last_active":"2023-08-27T11:28:53.943719+0000","last_peered":"2023-08-27T11:28:53.943719+0000","last_clean":"2023-08-27T11:28:53.943719+0000","last_became_active":"2023-08-27T11:28:52.953155+0000","last_became_peered":"2023-08-27T11:28:52.953155+0000","last_unstale":"2023-08-27T11:28:53.943719+0000","last_undegraded":"2023-08-27T11:28:53.943719+0000","last_fullsized":"2023-08-27T11:28:53.943719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:59.775537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126881+0000","last_change":"2023-08-27T11:28:52.113283+0000","last_active":"2023-08-27T11:28:54.126881+0000","last_peered":"2023-08-27T11:28:54.126881+0000","last_clean":"2023-08-27T11:28:54.126881+0000","last_became_active":"2023-08-27T11:28:52.111763+0000","last_became_peered":"2023-08-27T11:28:52.111763+0000","last_unstale":"2023-08-27T11:28:54.126881+0000","last_undegraded":"2023-08-27T11:28:54.126881+0000","last_fullsized":"2023-08-27T11:28:54.126881+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:40.784729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543078+0000","last_change":"2023-08-27T11:28:36.034952+0000","last_active":"2023-08-27T11:28:54.543078+0000","last_peered":"2023-08-27T11:28:54.543078+0000","last_clean":"2023-08-27T11:28:54.543078+0000","last_became_active":"2023-08-27T11:28:36.034648+0000","last_became_peered":"2023-08-27T11:28:36.034648+0000","last_unstale":"2023-08-27T11:28:54.543078+0000","last_undegraded":"2023-08-27T11:28:54.543078+0000","last_fullsized":"2023-08-27T11:28:54.543078+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:09.974932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"123'4","reported_seq":25,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545530+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:54.545530+0000","last_peered":"2023-08-27T11:28:54.545530+0000","last_clean":"2023-08-27T11:28:54.545530+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:54.545530+0000","last_undegraded":"2023-08-27T11:28:54.545530+0000","last_fullsized":"2023-08-27T11:28:54.545530+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:23.107984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127038+0000","last_change":"2023-08-27T11:28:52.959436+0000","last_active":"2023-08-27T11:28:54.127038+0000","last_peered":"2023-08-27T11:28:54.127038+0000","last_clean":"2023-08-27T11:28:54.127038+0000","last_became_active":"2023-08-27T11:28:52.959095+0000","last_became_peered":"2023-08-27T11:28:52.959095+0000","last_unstale":"2023-08-27T11:28:54.127038+0000","last_undegraded":"2023-08-27T11:28:54.127038+0000","last_fullsized":"2023-08-27T11:28:54.127038+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:49.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167226+0000","last_change":"2023-08-27T11:28:52.105198+0000","last_active":"2023-08-27T11:28:54.167226+0000","last_peered":"2023-08-27T11:28:54.167226+0000","last_clean":"2023-08-27T11:28:54.167226+0000","last_became_active":"2023-08-27T11:28:52.104869+0000","last_became_peered":"2023-08-27T11:28:52.104869+0000","last_unstale":"2023-08-27T11:28:54.167226+0000","last_undegraded":"2023-08-27T11:28:54.167226+0000","last_fullsized":"2023-08-27T11:28:54.167226+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:37.714190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938036+0000","last_change":"2023-08-27T11:28:36.021627+0000","last_active":"2023-08-27T11:28:53.938036+0000","last_peered":"2023-08-27T11:28:53.938036+0000","last_clean":"2023-08-27T11:28:53.938036+0000","last_became_active":"2023-08-27T11:28:36.021354+0000","last_became_peered":"2023-08-27T11:28:36.021354+0000","last_unstale":"2023-08-27T11:28:53.938036+0000","last_undegraded":"2023-08-27T11:28:53.938036+0000","last_fullsized":"2023-08-27T11:28:53.938036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:05:34.719477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168488+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:54.168488+0000","last_peered":"2023-08-27T11:28:54.168488+0000","last_clean":"2023-08-27T11:28:54.168488+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:54.168488+0000","last_undegraded":"2023-08-27T11:28:54.168488+0000","last_fullsized":"2023-08-27T11:28:54.168488+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:40.024589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943576+0000","last_change":"2023-08-27T11:28:52.953635+0000","last_active":"2023-08-27T11:28:53.943576+0000","last_peered":"2023-08-27T11:28:53.943576+0000","last_clean":"2023-08-27T11:28:53.943576+0000","last_became_active":"2023-08-27T11:28:52.953341+0000","last_became_peered":"2023-08-27T11:28:52.953341+0000","last_unstale":"2023-08-27T11:28:53.943576+0000","last_undegraded":"2023-08-27T11:28:53.943576+0000","last_fullsized":"2023-08-27T11:28:53.943576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:44.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543954+0000","last_change":"2023-08-27T11:28:52.109813+0000","last_active":"2023-08-27T11:28:54.543954+0000","last_peered":"2023-08-27T11:28:54.543954+0000","last_clean":"2023-08-27T11:28:54.543954+0000","last_became_active":"2023-08-27T11:28:52.108877+0000","last_became_peered":"2023-08-27T11:28:52.108877+0000","last_unstale":"2023-08-27T11:28:54.543954+0000","last_undegraded":"2023-08-27T11:28:54.543954+0000","last_fullsized":"2023-08-27T11:28:54.543954+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:30.551128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126981+0000","last_change":"2023-08-27T11:28:36.031467+0000","last_active":"2023-08-27T11:28:54.126981+0000","last_peered":"2023-08-27T11:28:54.126981+0000","last_clean":"2023-08-27T11:28:54.126981+0000","last_became_active":"2023-08-27T11:28:36.031196+0000","last_became_peered":"2023-08-27T11:28:36.031196+0000","last_unstale":"2023-08-27T11:28:54.126981+0000","last_undegraded":"2023-08-27T11:28:54.126981+0000","last_fullsized":"2023-08-27T11:28:54.126981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:40.633224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544001+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:54.544001+0000","last_peered":"2023-08-27T11:28:54.544001+0000","last_clean":"2023-08-27T11:28:54.544001+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:54.544001+0000","last_undegraded":"2023-08-27T11:28:54.544001+0000","last_fullsized":"2023-08-27T11:28:54.544001+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:31.949031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542764+0000","last_change":"2023-08-27T11:28:52.959630+0000","last_active":"2023-08-27T11:28:54.542764+0000","last_peered":"2023-08-27T11:28:54.542764+0000","last_clean":"2023-08-27T11:28:54.542764+0000","last_became_active":"2023-08-27T11:28:52.959190+0000","last_became_peered":"2023-08-27T11:28:52.959190+0000","last_unstale":"2023-08-27T11:28:54.542764+0000","last_undegraded":"2023-08-27T11:28:54.542764+0000","last_fullsized":"2023-08-27T11:28:54.542764+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:25.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167638+0000","last_change":"2023-08-27T11:28:52.107641+0000","last_active":"2023-08-27T11:28:54.167638+0000","last_peered":"2023-08-27T11:28:54.167638+0000","last_clean":"2023-08-27T11:28:54.167638+0000","last_became_active":"2023-08-27T11:28:52.107345+0000","last_became_peered":"2023-08-27T11:28:52.107345+0000","last_unstale":"2023-08-27T11:28:54.167638+0000","last_undegraded":"2023-08-27T11:28:54.167638+0000","last_fullsized":"2023-08-27T11:28:54.167638+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:39.603250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938380+0000","last_change":"2023-08-27T11:28:36.032795+0000","last_active":"2023-08-27T11:28:53.938380+0000","last_peered":"2023-08-27T11:28:53.938380+0000","last_clean":"2023-08-27T11:28:53.938380+0000","last_became_active":"2023-08-27T11:28:36.032518+0000","last_became_peered":"2023-08-27T11:28:36.032518+0000","last_unstale":"2023-08-27T11:28:53.938380+0000","last_undegraded":"2023-08-27T11:28:53.938380+0000","last_fullsized":"2023-08-27T11:28:53.938380+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:50.856976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543055+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:54.543055+0000","last_peered":"2023-08-27T11:28:54.543055+0000","last_clean":"2023-08-27T11:28:54.543055+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:54.543055+0000","last_undegraded":"2023-08-27T11:28:54.543055+0000","last_fullsized":"2023-08-27T11:28:54.543055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:46.537540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543937+0000","last_change":"2023-08-27T11:28:52.969287+0000","last_active":"2023-08-27T11:28:54.543937+0000","last_peered":"2023-08-27T11:28:54.543937+0000","last_clean":"2023-08-27T11:28:54.543937+0000","last_became_active":"2023-08-27T11:28:52.969003+0000","last_became_peered":"2023-08-27T11:28:52.969003+0000","last_unstale":"2023-08-27T11:28:54.543937+0000","last_undegraded":"2023-08-27T11:28:54.543937+0000","last_fullsized":"2023-08-27T11:28:54.543937+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:47.450318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543621+0000","last_change":"2023-08-27T11:28:52.118520+0000","last_active":"2023-08-27T11:28:54.543621+0000","last_peered":"2023-08-27T11:28:54.543621+0000","last_clean":"2023-08-27T11:28:54.543621+0000","last_became_active":"2023-08-27T11:28:52.118225+0000","last_became_peered":"2023-08-27T11:28:52.118225+0000","last_unstale":"2023-08-27T11:28:54.543621+0000","last_undegraded":"2023-08-27T11:28:54.543621+0000","last_fullsized":"2023-08-27T11:28:54.543621+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:13:57.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544239+0000","last_change":"2023-08-27T11:28:36.032681+0000","last_active":"2023-08-27T11:28:54.544239+0000","last_peered":"2023-08-27T11:28:54.544239+0000","last_clean":"2023-08-27T11:28:54.544239+0000","last_became_active":"2023-08-27T11:28:36.032386+0000","last_became_peered":"2023-08-27T11:28:36.032386+0000","last_unstale":"2023-08-27T11:28:54.544239+0000","last_undegraded":"2023-08-27T11:28:54.544239+0000","last_fullsized":"2023-08-27T11:28:54.544239+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:19.799417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544428+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:54.544428+0000","last_peered":"2023-08-27T11:28:54.544428+0000","last_clean":"2023-08-27T11:28:54.544428+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:54.544428+0000","last_undegraded":"2023-08-27T11:28:54.544428+0000","last_fullsized":"2023-08-27T11:28:54.544428+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:02.568722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543470+0000","last_change":"2023-08-27T11:28:52.969271+0000","last_active":"2023-08-27T11:28:54.543470+0000","last_peered":"2023-08-27T11:28:54.543470+0000","last_clean":"2023-08-27T11:28:54.543470+0000","last_became_active":"2023-08-27T11:28:52.968884+0000","last_became_peered":"2023-08-27T11:28:52.968884+0000","last_unstale":"2023-08-27T11:28:54.543470+0000","last_undegraded":"2023-08-27T11:28:54.543470+0000","last_fullsized":"2023-08-27T11:28:54.543470+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:25.044979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944656+0000","last_change":"2023-08-27T11:28:52.111044+0000","last_active":"2023-08-27T11:28:53.944656+0000","last_peered":"2023-08-27T11:28:53.944656+0000","last_clean":"2023-08-27T11:28:53.944656+0000","last_became_active":"2023-08-27T11:28:52.110543+0000","last_became_peered":"2023-08-27T11:28:52.110543+0000","last_unstale":"2023-08-27T11:28:53.944656+0000","last_undegraded":"2023-08-27T11:28:53.944656+0000","last_fullsized":"2023-08-27T11:28:53.944656+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:19.667556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544740+0000","last_change":"2023-08-27T11:28:36.025498+0000","last_active":"2023-08-27T11:28:54.544740+0000","last_peered":"2023-08-27T11:28:54.544740+0000","last_clean":"2023-08-27T11:28:54.544740+0000","last_became_active":"2023-08-27T11:28:36.024956+0000","last_became_peered":"2023-08-27T11:28:36.024956+0000","last_unstale":"2023-08-27T11:28:54.544740+0000","last_undegraded":"2023-08-27T11:28:54.544740+0000","last_fullsized":"2023-08-27T11:28:54.544740+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:49.772712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168380+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:54.168380+0000","last_peered":"2023-08-27T11:28:54.168380+0000","last_clean":"2023-08-27T11:28:54.168380+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:54.168380+0000","last_undegraded":"2023-08-27T11:28:54.168380+0000","last_fullsized":"2023-08-27T11:28:54.168380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:52.670343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944368+0000","last_change":"2023-08-27T11:28:52.970908+0000","last_active":"2023-08-27T11:28:53.944368+0000","last_peered":"2023-08-27T11:28:53.944368+0000","last_clean":"2023-08-27T11:28:53.944368+0000","last_became_active":"2023-08-27T11:28:52.970604+0000","last_became_peered":"2023-08-27T11:28:52.970604+0000","last_unstale":"2023-08-27T11:28:53.944368+0000","last_undegraded":"2023-08-27T11:28:53.944368+0000","last_fullsized":"2023-08-27T11:28:53.944368+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:36.896383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"127'4","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168517+0000","last_change":"2023-08-27T11:28:52.108195+0000","last_active":"2023-08-27T11:28:54.168517+0000","last_peered":"2023-08-27T11:28:54.168517+0000","last_clean":"2023-08-27T11:28:54.168517+0000","last_became_active":"2023-08-27T11:28:52.107884+0000","last_became_peered":"2023-08-27T11:28:52.107884+0000","last_unstale":"2023-08-27T11:28:54.168517+0000","last_undegraded":"2023-08-27T11:28:54.168517+0000","last_fullsized":"2023-08-27T11:28:54.168517+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:03:14.694373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168002+0000","last_change":"2023-08-27T11:28:36.034683+0000","last_active":"2023-08-27T11:28:54.168002+0000","last_peered":"2023-08-27T11:28:54.168002+0000","last_clean":"2023-08-27T11:28:54.168002+0000","last_became_active":"2023-08-27T11:28:36.034353+0000","last_became_peered":"2023-08-27T11:28:36.034353+0000","last_unstale":"2023-08-27T11:28:54.168002+0000","last_undegraded":"2023-08-27T11:28:54.168002+0000","last_fullsized":"2023-08-27T11:28:54.168002+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:04.796015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943448+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:53.943448+0000","last_peered":"2023-08-27T11:28:53.943448+0000","last_clean":"2023-08-27T11:28:53.943448+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:53.943448+0000","last_undegraded":"2023-08-27T11:28:53.943448+0000","last_fullsized":"2023-08-27T11:28:53.943448+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944823+0000","last_change":"2023-08-27T11:28:52.961569+0000","last_active":"2023-08-27T11:28:53.944823+0000","last_peered":"2023-08-27T11:28:53.944823+0000","last_clean":"2023-08-27T11:28:53.944823+0000","last_became_active":"2023-08-27T11:28:52.961282+0000","last_became_peered":"2023-08-27T11:28:52.961282+0000","last_unstale":"2023-08-27T11:28:53.944823+0000","last_undegraded":"2023-08-27T11:28:53.944823+0000","last_fullsized":"2023-08-27T11:28:53.944823+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:06.869678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544661+0000","last_change":"2023-08-27T11:28:52.117536+0000","last_active":"2023-08-27T11:28:54.544661+0000","last_peered":"2023-08-27T11:28:54.544661+0000","last_clean":"2023-08-27T11:28:54.544661+0000","last_became_active":"2023-08-27T11:28:52.117216+0000","last_became_peered":"2023-08-27T11:28:52.117216+0000","last_unstale":"2023-08-27T11:28:54.544661+0000","last_undegraded":"2023-08-27T11:28:54.544661+0000","last_fullsized":"2023-08-27T11:28:54.544661+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:14.628060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543661+0000","last_change":"2023-08-27T11:28:36.035634+0000","last_active":"2023-08-27T11:28:54.543661+0000","last_peered":"2023-08-27T11:28:54.543661+0000","last_clean":"2023-08-27T11:28:54.543661+0000","last_became_active":"2023-08-27T11:28:36.035256+0000","last_became_peered":"2023-08-27T11:28:36.035256+0000","last_unstale":"2023-08-27T11:28:54.543661+0000","last_undegraded":"2023-08-27T11:28:54.543661+0000","last_fullsized":"2023-08-27T11:28:54.543661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:53:15.473061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542084+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:54.542084+0000","last_peered":"2023-08-27T11:28:54.542084+0000","last_clean":"2023-08-27T11:28:54.542084+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:54.542084+0000","last_undegraded":"2023-08-27T11:28:54.542084+0000","last_fullsized":"2023-08-27T11:28:54.542084+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:44.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543264+0000","last_change":"2023-08-27T11:28:52.968302+0000","last_active":"2023-08-27T11:28:54.543264+0000","last_peered":"2023-08-27T11:28:54.543264+0000","last_clean":"2023-08-27T11:28:54.543264+0000","last_became_active":"2023-08-27T11:28:52.968028+0000","last_became_peered":"2023-08-27T11:28:52.968028+0000","last_unstale":"2023-08-27T11:28:54.543264+0000","last_undegraded":"2023-08-27T11:28:54.543264+0000","last_fullsized":"2023-08-27T11:28:54.543264+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:11:56.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944017+0000","last_change":"2023-08-27T11:28:52.115386+0000","last_active":"2023-08-27T11:28:53.944017+0000","last_peered":"2023-08-27T11:28:53.944017+0000","last_clean":"2023-08-27T11:28:53.944017+0000","last_became_active":"2023-08-27T11:28:52.115108+0000","last_became_peered":"2023-08-27T11:28:52.115108+0000","last_unstale":"2023-08-27T11:28:53.944017+0000","last_undegraded":"2023-08-27T11:28:53.944017+0000","last_fullsized":"2023-08-27T11:28:53.944017+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:28.769523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.541897+0000","last_change":"2023-08-27T11:28:36.013300+0000","last_active":"2023-08-27T11:28:54.541897+0000","last_peered":"2023-08-27T11:28:54.541897+0000","last_clean":"2023-08-27T11:28:54.541897+0000","last_became_active":"2023-08-27T11:28:36.012993+0000","last_became_peered":"2023-08-27T11:28:36.012993+0000","last_unstale":"2023-08-27T11:28:54.541897+0000","last_undegraded":"2023-08-27T11:28:54.541897+0000","last_fullsized":"2023-08-27T11:28:54.541897+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:23.512873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127888+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:54.127888+0000","last_peered":"2023-08-27T11:28:54.127888+0000","last_clean":"2023-08-27T11:28:54.127888+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:54.127888+0000","last_undegraded":"2023-08-27T11:28:54.127888+0000","last_fullsized":"2023-08-27T11:28:54.127888+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:43.912232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943423+0000","last_change":"2023-08-27T11:28:52.961598+0000","last_active":"2023-08-27T11:28:53.943423+0000","last_peered":"2023-08-27T11:28:53.943423+0000","last_clean":"2023-08-27T11:28:53.943423+0000","last_became_active":"2023-08-27T11:28:52.961290+0000","last_became_peered":"2023-08-27T11:28:52.961290+0000","last_unstale":"2023-08-27T11:28:53.943423+0000","last_undegraded":"2023-08-27T11:28:53.943423+0000","last_fullsized":"2023-08-27T11:28:53.943423+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:37.452054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543213+0000","last_change":"2023-08-27T11:28:52.109586+0000","last_active":"2023-08-27T11:28:54.543213+0000","last_peered":"2023-08-27T11:28:54.543213+0000","last_clean":"2023-08-27T11:28:54.543213+0000","last_became_active":"2023-08-27T11:28:52.108535+0000","last_became_peered":"2023-08-27T11:28:52.108535+0000","last_unstale":"2023-08-27T11:28:54.543213+0000","last_undegraded":"2023-08-27T11:28:54.543213+0000","last_fullsized":"2023-08-27T11:28:54.543213+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:27.130335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542769+0000","last_change":"2023-08-27T11:28:36.037732+0000","last_active":"2023-08-27T11:28:54.542769+0000","last_peered":"2023-08-27T11:28:54.542769+0000","last_clean":"2023-08-27T11:28:54.542769+0000","last_became_active":"2023-08-27T11:28:36.031618+0000","last_became_peered":"2023-08-27T11:28:36.031618+0000","last_unstale":"2023-08-27T11:28:54.542769+0000","last_undegraded":"2023-08-27T11:28:54.542769+0000","last_fullsized":"2023-08-27T11:28:54.542769+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:47:27.683116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544637+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:54.544637+0000","last_peered":"2023-08-27T11:28:54.544637+0000","last_clean":"2023-08-27T11:28:54.544637+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:54.544637+0000","last_undegraded":"2023-08-27T11:28:54.544637+0000","last_fullsized":"2023-08-27T11:28:54.544637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:34.533849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543769+0000","last_change":"2023-08-27T11:28:52.973023+0000","last_active":"2023-08-27T11:28:54.543769+0000","last_peered":"2023-08-27T11:28:54.543769+0000","last_clean":"2023-08-27T11:28:54.543769+0000","last_became_active":"2023-08-27T11:28:52.972708+0000","last_became_peered":"2023-08-27T11:28:52.972708+0000","last_unstale":"2023-08-27T11:28:54.543769+0000","last_undegraded":"2023-08-27T11:28:54.543769+0000","last_fullsized":"2023-08-27T11:28:54.543769+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:12.899801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944416+0000","last_change":"2023-08-27T11:28:52.113775+0000","last_active":"2023-08-27T11:28:53.944416+0000","last_peered":"2023-08-27T11:28:53.944416+0000","last_clean":"2023-08-27T11:28:53.944416+0000","last_became_active":"2023-08-27T11:28:52.113503+0000","last_became_peered":"2023-08-27T11:28:52.113503+0000","last_unstale":"2023-08-27T11:28:53.944416+0000","last_undegraded":"2023-08-27T11:28:53.944416+0000","last_fullsized":"2023-08-27T11:28:53.944416+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:39.603250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543537+0000","last_change":"2023-08-27T11:28:36.035453+0000","last_active":"2023-08-27T11:28:54.543537+0000","last_peered":"2023-08-27T11:28:54.543537+0000","last_clean":"2023-08-27T11:28:54.543537+0000","last_became_active":"2023-08-27T11:28:36.035166+0000","last_became_peered":"2023-08-27T11:28:36.035166+0000","last_unstale":"2023-08-27T11:28:54.543537+0000","last_undegraded":"2023-08-27T11:28:54.543537+0000","last_fullsized":"2023-08-27T11:28:54.543537+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:42:32.278155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.945156+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:53.945156+0000","last_peered":"2023-08-27T11:28:53.945156+0000","last_clean":"2023-08-27T11:28:53.945156+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:53.945156+0000","last_undegraded":"2023-08-27T11:28:53.945156+0000","last_fullsized":"2023-08-27T11:28:53.945156+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:16.723874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943616+0000","last_change":"2023-08-27T11:28:52.964656+0000","last_active":"2023-08-27T11:28:53.943616+0000","last_peered":"2023-08-27T11:28:53.943616+0000","last_clean":"2023-08-27T11:28:53.943616+0000","last_became_active":"2023-08-27T11:28:52.964358+0000","last_became_peered":"2023-08-27T11:28:52.964358+0000","last_unstale":"2023-08-27T11:28:53.943616+0000","last_undegraded":"2023-08-27T11:28:53.943616+0000","last_fullsized":"2023-08-27T11:28:53.943616+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:02.715971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543526+0000","last_change":"2023-08-27T11:28:52.111349+0000","last_active":"2023-08-27T11:28:54.543526+0000","last_peered":"2023-08-27T11:28:54.543526+0000","last_clean":"2023-08-27T11:28:54.543526+0000","last_became_active":"2023-08-27T11:28:52.111065+0000","last_became_peered":"2023-08-27T11:28:52.111065+0000","last_unstale":"2023-08-27T11:28:54.543526+0000","last_undegraded":"2023-08-27T11:28:54.543526+0000","last_fullsized":"2023-08-27T11:28:54.543526+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:32.779494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944513+0000","last_change":"2023-08-27T11:28:36.031284+0000","last_active":"2023-08-27T11:28:53.944513+0000","last_peered":"2023-08-27T11:28:53.944513+0000","last_clean":"2023-08-27T11:28:53.944513+0000","last_became_active":"2023-08-27T11:28:36.031015+0000","last_became_peered":"2023-08-27T11:28:36.031015+0000","last_unstale":"2023-08-27T11:28:53.944513+0000","last_undegraded":"2023-08-27T11:28:53.944513+0000","last_fullsized":"2023-08-27T11:28:53.944513+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:45.630236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168519+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:54.168519+0000","last_peered":"2023-08-27T11:28:54.168519+0000","last_clean":"2023-08-27T11:28:54.168519+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:54.168519+0000","last_undegraded":"2023-08-27T11:28:54.168519+0000","last_fullsized":"2023-08-27T11:28:54.168519+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:16.445787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127423+0000","last_change":"2023-08-27T11:28:52.962152+0000","last_active":"2023-08-27T11:28:54.127423+0000","last_peered":"2023-08-27T11:28:54.127423+0000","last_clean":"2023-08-27T11:28:54.127423+0000","last_became_active":"2023-08-27T11:28:52.960175+0000","last_became_peered":"2023-08-27T11:28:52.960175+0000","last_unstale":"2023-08-27T11:28:54.127423+0000","last_undegraded":"2023-08-27T11:28:54.127423+0000","last_fullsized":"2023-08-27T11:28:54.127423+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:30:34.934972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944976+0000","last_change":"2023-08-27T11:28:52.107495+0000","last_active":"2023-08-27T11:28:53.944976+0000","last_peered":"2023-08-27T11:28:53.944976+0000","last_clean":"2023-08-27T11:28:53.944976+0000","last_became_active":"2023-08-27T11:28:52.107015+0000","last_became_peered":"2023-08-27T11:28:52.107015+0000","last_unstale":"2023-08-27T11:28:53.944976+0000","last_undegraded":"2023-08-27T11:28:53.944976+0000","last_fullsized":"2023-08-27T11:28:53.944976+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:46:41.277306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168474+0000","last_change":"2023-08-27T11:28:36.003840+0000","last_active":"2023-08-27T11:28:54.168474+0000","last_peered":"2023-08-27T11:28:54.168474+0000","last_clean":"2023-08-27T11:28:54.168474+0000","last_became_active":"2023-08-27T11:28:36.003484+0000","last_became_peered":"2023-08-27T11:28:36.003484+0000","last_unstale":"2023-08-27T11:28:54.168474+0000","last_undegraded":"2023-08-27T11:28:54.168474+0000","last_fullsized":"2023-08-27T11:28:54.168474+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:07:53.828122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544472+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:54.544472+0000","last_peered":"2023-08-27T11:28:54.544472+0000","last_clean":"2023-08-27T11:28:54.544472+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:54.544472+0000","last_undegraded":"2023-08-27T11:28:54.544472+0000","last_fullsized":"2023-08-27T11:28:54.544472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:25.030981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127588+0000","last_change":"2023-08-27T11:28:52.966674+0000","last_active":"2023-08-27T11:28:54.127588+0000","last_peered":"2023-08-27T11:28:54.127588+0000","last_clean":"2023-08-27T11:28:54.127588+0000","last_became_active":"2023-08-27T11:28:52.965751+0000","last_became_peered":"2023-08-27T11:28:52.965751+0000","last_unstale":"2023-08-27T11:28:54.127588+0000","last_undegraded":"2023-08-27T11:28:54.127588+0000","last_fullsized":"2023-08-27T11:28:54.127588+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:44:26.015810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544367+0000","last_change":"2023-08-27T11:28:52.110521+0000","last_active":"2023-08-27T11:28:54.544367+0000","last_peered":"2023-08-27T11:28:54.544367+0000","last_clean":"2023-08-27T11:28:54.544367+0000","last_became_active":"2023-08-27T11:28:52.110145+0000","last_became_peered":"2023-08-27T11:28:52.110145+0000","last_unstale":"2023-08-27T11:28:54.544367+0000","last_undegraded":"2023-08-27T11:28:54.544367+0000","last_fullsized":"2023-08-27T11:28:54.544367+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:57.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.939109+0000","last_change":"2023-08-27T11:28:36.029240+0000","last_active":"2023-08-27T11:28:53.939109+0000","last_peered":"2023-08-27T11:28:53.939109+0000","last_clean":"2023-08-27T11:28:53.939109+0000","last_became_active":"2023-08-27T11:28:36.028966+0000","last_became_peered":"2023-08-27T11:28:36.028966+0000","last_unstale":"2023-08-27T11:28:53.939109+0000","last_undegraded":"2023-08-27T11:28:53.939109+0000","last_fullsized":"2023-08-27T11:28:53.939109+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:48:28.835205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938044+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:53.938044+0000","last_peered":"2023-08-27T11:28:53.938044+0000","last_clean":"2023-08-27T11:28:53.938044+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:53.938044+0000","last_undegraded":"2023-08-27T11:28:53.938044+0000","last_fullsized":"2023-08-27T11:28:53.938044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:33:47.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543419+0000","last_change":"2023-08-27T11:28:52.970090+0000","last_active":"2023-08-27T11:28:54.543419+0000","last_peered":"2023-08-27T11:28:54.543419+0000","last_clean":"2023-08-27T11:28:54.543419+0000","last_became_active":"2023-08-27T11:28:52.969791+0000","last_became_peered":"2023-08-27T11:28:52.969791+0000","last_unstale":"2023-08-27T11:28:54.543419+0000","last_undegraded":"2023-08-27T11:28:54.543419+0000","last_fullsized":"2023-08-27T11:28:54.543419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:21.931456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938709+0000","last_change":"2023-08-27T11:28:52.112133+0000","last_active":"2023-08-27T11:28:53.938709+0000","last_peered":"2023-08-27T11:28:53.938709+0000","last_clean":"2023-08-27T11:28:53.938709+0000","last_became_active":"2023-08-27T11:28:52.111829+0000","last_became_peered":"2023-08-27T11:28:52.111829+0000","last_unstale":"2023-08-27T11:28:53.938709+0000","last_undegraded":"2023-08-27T11:28:53.938709+0000","last_fullsized":"2023-08-27T11:28:53.938709+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:13.011586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168368+0000","last_change":"2023-08-27T11:28:36.013853+0000","last_active":"2023-08-27T11:28:54.168368+0000","last_peered":"2023-08-27T11:28:54.168368+0000","last_clean":"2023-08-27T11:28:54.168368+0000","last_became_active":"2023-08-27T11:28:36.013326+0000","last_became_peered":"2023-08-27T11:28:36.013326+0000","last_unstale":"2023-08-27T11:28:54.168368+0000","last_undegraded":"2023-08-27T11:28:54.168368+0000","last_fullsized":"2023-08-27T11:28:54.168368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:27.852773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542914+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:54.542914+0000","last_peered":"2023-08-27T11:28:54.542914+0000","last_clean":"2023-08-27T11:28:54.542914+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:54.542914+0000","last_undegraded":"2023-08-27T11:28:54.542914+0000","last_fullsized":"2023-08-27T11:28:54.542914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:01:40.116261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543337+0000","last_change":"2023-08-27T11:28:52.971264+0000","last_active":"2023-08-27T11:28:54.543337+0000","last_peered":"2023-08-27T11:28:54.543337+0000","last_clean":"2023-08-27T11:28:54.543337+0000","last_became_active":"2023-08-27T11:28:52.970571+0000","last_became_peered":"2023-08-27T11:28:52.970571+0000","last_unstale":"2023-08-27T11:28:54.543337+0000","last_undegraded":"2023-08-27T11:28:54.543337+0000","last_fullsized":"2023-08-27T11:28:54.543337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:36.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544829+0000","last_change":"2023-08-27T11:28:52.118194+0000","last_active":"2023-08-27T11:28:54.544829+0000","last_peered":"2023-08-27T11:28:54.544829+0000","last_clean":"2023-08-27T11:28:54.544829+0000","last_became_active":"2023-08-27T11:28:52.117803+0000","last_became_peered":"2023-08-27T11:28:52.117803+0000","last_unstale":"2023-08-27T11:28:54.544829+0000","last_undegraded":"2023-08-27T11:28:54.544829+0000","last_fullsized":"2023-08-27T11:28:54.544829+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:26:54.960443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127723+0000","last_change":"2023-08-27T11:28:36.028818+0000","last_active":"2023-08-27T11:28:54.127723+0000","last_peered":"2023-08-27T11:28:54.127723+0000","last_clean":"2023-08-27T11:28:54.127723+0000","last_became_active":"2023-08-27T11:28:36.028244+0000","last_became_peered":"2023-08-27T11:28:36.028244+0000","last_unstale":"2023-08-27T11:28:54.127723+0000","last_undegraded":"2023-08-27T11:28:54.127723+0000","last_fullsized":"2023-08-27T11:28:54.127723+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:27.529486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943075+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:53.943075+0000","last_peered":"2023-08-27T11:28:53.943075+0000","last_clean":"2023-08-27T11:28:53.943075+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:53.943075+0000","last_undegraded":"2023-08-27T11:28:53.943075+0000","last_fullsized":"2023-08-27T11:28:53.943075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:43.912232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943440+0000","last_change":"2023-08-27T11:28:52.955019+0000","last_active":"2023-08-27T11:28:53.943440+0000","last_peered":"2023-08-27T11:28:53.943440+0000","last_clean":"2023-08-27T11:28:53.943440+0000","last_became_active":"2023-08-27T11:28:52.954735+0000","last_became_peered":"2023-08-27T11:28:52.954735+0000","last_unstale":"2023-08-27T11:28:53.943440+0000","last_undegraded":"2023-08-27T11:28:53.943440+0000","last_fullsized":"2023-08-27T11:28:53.943440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:18.137793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127568+0000","last_change":"2023-08-27T11:28:52.113480+0000","last_active":"2023-08-27T11:28:54.127568+0000","last_peered":"2023-08-27T11:28:54.127568+0000","last_clean":"2023-08-27T11:28:54.127568+0000","last_became_active":"2023-08-27T11:28:52.112964+0000","last_became_peered":"2023-08-27T11:28:52.112964+0000","last_unstale":"2023-08-27T11:28:54.127568+0000","last_undegraded":"2023-08-27T11:28:54.127568+0000","last_fullsized":"2023-08-27T11:28:54.127568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:50.221973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167327+0000","last_change":"2023-08-27T11:28:36.032846+0000","last_active":"2023-08-27T11:28:54.167327+0000","last_peered":"2023-08-27T11:28:54.167327+0000","last_clean":"2023-08-27T11:28:54.167327+0000","last_became_active":"2023-08-27T11:28:36.032564+0000","last_became_peered":"2023-08-27T11:28:36.032564+0000","last_unstale":"2023-08-27T11:28:54.167327+0000","last_undegraded":"2023-08-27T11:28:54.167327+0000","last_fullsized":"2023-08-27T11:28:54.167327+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:12.679146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938936+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:53.938936+0000","last_peered":"2023-08-27T11:28:53.938936+0000","last_clean":"2023-08-27T11:28:53.938936+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:53.938936+0000","last_undegraded":"2023-08-27T11:28:53.938936+0000","last_fullsized":"2023-08-27T11:28:53.938936+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:55.298282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543753+0000","last_change":"2023-08-27T11:28:52.953472+0000","last_active":"2023-08-27T11:28:54.543753+0000","last_peered":"2023-08-27T11:28:54.543753+0000","last_clean":"2023-08-27T11:28:54.543753+0000","last_became_active":"2023-08-27T11:28:52.952835+0000","last_became_peered":"2023-08-27T11:28:52.952835+0000","last_unstale":"2023-08-27T11:28:54.543753+0000","last_undegraded":"2023-08-27T11:28:54.543753+0000","last_fullsized":"2023-08-27T11:28:54.543753+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:33.645891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543911+0000","last_change":"2023-08-27T11:28:52.110429+0000","last_active":"2023-08-27T11:28:54.543911+0000","last_peered":"2023-08-27T11:28:54.543911+0000","last_clean":"2023-08-27T11:28:54.543911+0000","last_became_active":"2023-08-27T11:28:52.110151+0000","last_became_peered":"2023-08-27T11:28:52.110151+0000","last_unstale":"2023-08-27T11:28:54.543911+0000","last_undegraded":"2023-08-27T11:28:54.543911+0000","last_fullsized":"2023-08-27T11:28:54.543911+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:18:35.513430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542407+0000","last_change":"2023-08-27T11:28:36.025457+0000","last_active":"2023-08-27T11:28:54.542407+0000","last_peered":"2023-08-27T11:28:54.542407+0000","last_clean":"2023-08-27T11:28:54.542407+0000","last_became_active":"2023-08-27T11:28:36.025184+0000","last_became_peered":"2023-08-27T11:28:36.025184+0000","last_unstale":"2023-08-27T11:28:54.542407+0000","last_undegraded":"2023-08-27T11:28:54.542407+0000","last_fullsized":"2023-08-27T11:28:54.542407+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:06.009064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"124'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544345+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:54.544345+0000","last_peered":"2023-08-27T11:28:54.544345+0000","last_clean":"2023-08-27T11:28:54.544345+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:54.544345+0000","last_undegraded":"2023-08-27T11:28:54.544345+0000","last_fullsized":"2023-08-27T11:28:54.544345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:12.198796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543278+0000","last_change":"2023-08-27T11:28:52.955531+0000","last_active":"2023-08-27T11:28:54.543278+0000","last_peered":"2023-08-27T11:28:54.543278+0000","last_clean":"2023-08-27T11:28:54.543278+0000","last_became_active":"2023-08-27T11:28:52.955017+0000","last_became_peered":"2023-08-27T11:28:52.955017+0000","last_unstale":"2023-08-27T11:28:54.543278+0000","last_undegraded":"2023-08-27T11:28:54.543278+0000","last_fullsized":"2023-08-27T11:28:54.543278+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:59.775537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127099+0000","last_change":"2023-08-27T11:28:52.113270+0000","last_active":"2023-08-27T11:28:54.127099+0000","last_peered":"2023-08-27T11:28:54.127099+0000","last_clean":"2023-08-27T11:28:54.127099+0000","last_became_active":"2023-08-27T11:28:52.112926+0000","last_became_peered":"2023-08-27T11:28:52.112926+0000","last_unstale":"2023-08-27T11:28:54.127099+0000","last_undegraded":"2023-08-27T11:28:54.127099+0000","last_fullsized":"2023-08-27T11:28:54.127099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.923496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543691+0000","last_change":"2023-08-27T11:28:36.031143+0000","last_active":"2023-08-27T11:28:54.543691+0000","last_peered":"2023-08-27T11:28:54.543691+0000","last_clean":"2023-08-27T11:28:54.543691+0000","last_became_active":"2023-08-27T11:28:36.030840+0000","last_became_peered":"2023-08-27T11:28:36.030840+0000","last_unstale":"2023-08-27T11:28:54.543691+0000","last_undegraded":"2023-08-27T11:28:54.543691+0000","last_fullsized":"2023-08-27T11:28:54.543691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:07:08.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544887+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:54.544887+0000","last_peered":"2023-08-27T11:28:54.544887+0000","last_clean":"2023-08-27T11:28:54.544887+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:54.544887+0000","last_undegraded":"2023-08-27T11:28:54.544887+0000","last_fullsized":"2023-08-27T11:28:54.544887+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:46:24.178472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542241+0000","last_change":"2023-08-27T11:28:52.953234+0000","last_active":"2023-08-27T11:28:54.542241+0000","last_peered":"2023-08-27T11:28:54.542241+0000","last_clean":"2023-08-27T11:28:54.542241+0000","last_became_active":"2023-08-27T11:28:52.952924+0000","last_became_peered":"2023-08-27T11:28:52.952924+0000","last_unstale":"2023-08-27T11:28:54.542241+0000","last_undegraded":"2023-08-27T11:28:54.542241+0000","last_fullsized":"2023-08-27T11:28:54.542241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.478232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938923+0000","last_change":"2023-08-27T11:28:52.109488+0000","last_active":"2023-08-27T11:28:53.938923+0000","last_peered":"2023-08-27T11:28:53.938923+0000","last_clean":"2023-08-27T11:28:53.938923+0000","last_became_active":"2023-08-27T11:28:52.109178+0000","last_became_peered":"2023-08-27T11:28:52.109178+0000","last_unstale":"2023-08-27T11:28:53.938923+0000","last_undegraded":"2023-08-27T11:28:53.938923+0000","last_fullsized":"2023-08-27T11:28:53.938923+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:01:31.909610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944212+0000","last_change":"2023-08-27T11:28:36.027765+0000","last_active":"2023-08-27T11:28:53.944212+0000","last_peered":"2023-08-27T11:28:53.944212+0000","last_clean":"2023-08-27T11:28:53.944212+0000","last_became_active":"2023-08-27T11:28:36.027374+0000","last_became_peered":"2023-08-27T11:28:36.027374+0000","last_unstale":"2023-08-27T11:28:53.944212+0000","last_undegraded":"2023-08-27T11:28:53.944212+0000","last_fullsized":"2023-08-27T11:28:53.944212+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:42.215415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944757+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:53.944757+0000","last_peered":"2023-08-27T11:28:53.944757+0000","last_clean":"2023-08-27T11:28:53.944757+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:53.944757+0000","last_undegraded":"2023-08-27T11:28:53.944757+0000","last_fullsized":"2023-08-27T11:28:53.944757+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:25.030981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127523+0000","last_change":"2023-08-27T11:28:52.963639+0000","last_active":"2023-08-27T11:28:54.127523+0000","last_peered":"2023-08-27T11:28:54.127523+0000","last_clean":"2023-08-27T11:28:54.127523+0000","last_became_active":"2023-08-27T11:28:52.963113+0000","last_became_peered":"2023-08-27T11:28:52.963113+0000","last_unstale":"2023-08-27T11:28:54.127523+0000","last_undegraded":"2023-08-27T11:28:54.127523+0000","last_fullsized":"2023-08-27T11:28:54.127523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:58.321050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944988+0000","last_change":"2023-08-27T11:28:52.110695+0000","last_active":"2023-08-27T11:28:53.944988+0000","last_peered":"2023-08-27T11:28:53.944988+0000","last_clean":"2023-08-27T11:28:53.944988+0000","last_became_active":"2023-08-27T11:28:52.110410+0000","last_became_peered":"2023-08-27T11:28:52.110410+0000","last_unstale":"2023-08-27T11:28:53.944988+0000","last_undegraded":"2023-08-27T11:28:53.944988+0000","last_fullsized":"2023-08-27T11:28:53.944988+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:15:32.371940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944596+0000","last_change":"2023-08-27T11:28:36.027113+0000","last_active":"2023-08-27T11:28:53.944596+0000","last_peered":"2023-08-27T11:28:53.944596+0000","last_clean":"2023-08-27T11:28:53.944596+0000","last_became_active":"2023-08-27T11:28:36.026825+0000","last_became_peered":"2023-08-27T11:28:36.026825+0000","last_unstale":"2023-08-27T11:28:53.944596+0000","last_undegraded":"2023-08-27T11:28:53.944596+0000","last_fullsized":"2023-08-27T11:28:53.944596+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:13.207253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127236+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:54.127236+0000","last_peered":"2023-08-27T11:28:54.127236+0000","last_clean":"2023-08-27T11:28:54.127236+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:54.127236+0000","last_undegraded":"2023-08-27T11:28:54.127236+0000","last_fullsized":"2023-08-27T11:28:54.127236+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:04:41.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168496+0000","last_change":"2023-08-27T11:28:52.963525+0000","last_active":"2023-08-27T11:28:54.168496+0000","last_peered":"2023-08-27T11:28:54.168496+0000","last_clean":"2023-08-27T11:28:54.168496+0000","last_became_active":"2023-08-27T11:28:52.963326+0000","last_became_peered":"2023-08-27T11:28:52.963326+0000","last_unstale":"2023-08-27T11:28:54.168496+0000","last_undegraded":"2023-08-27T11:28:54.168496+0000","last_fullsized":"2023-08-27T11:28:54.168496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:36.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167786+0000","last_change":"2023-08-27T11:28:52.110101+0000","last_active":"2023-08-27T11:28:54.167786+0000","last_peered":"2023-08-27T11:28:54.167786+0000","last_clean":"2023-08-27T11:28:54.167786+0000","last_became_active":"2023-08-27T11:28:52.109772+0000","last_became_peered":"2023-08-27T11:28:52.109772+0000","last_unstale":"2023-08-27T11:28:54.167786+0000","last_undegraded":"2023-08-27T11:28:54.167786+0000","last_fullsized":"2023-08-27T11:28:54.167786+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:22.099441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.945084+0000","last_change":"2023-08-27T11:28:36.026876+0000","last_active":"2023-08-27T11:28:53.945084+0000","last_peered":"2023-08-27T11:28:53.945084+0000","last_clean":"2023-08-27T11:28:53.945084+0000","last_became_active":"2023-08-27T11:28:36.026348+0000","last_became_peered":"2023-08-27T11:28:36.026348+0000","last_unstale":"2023-08-27T11:28:53.945084+0000","last_undegraded":"2023-08-27T11:28:53.945084+0000","last_fullsized":"2023-08-27T11:28:53.945084+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:12.652500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545065+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:54.545065+0000","last_peered":"2023-08-27T11:28:54.545065+0000","last_clean":"2023-08-27T11:28:54.545065+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:54.545065+0000","last_undegraded":"2023-08-27T11:28:54.545065+0000","last_fullsized":"2023-08-27T11:28:54.545065+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:15.764582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167652+0000","last_change":"2023-08-27T11:28:52.959730+0000","last_active":"2023-08-27T11:28:54.167652+0000","last_peered":"2023-08-27T11:28:54.167652+0000","last_clean":"2023-08-27T11:28:54.167652+0000","last_became_active":"2023-08-27T11:28:52.959420+0000","last_became_peered":"2023-08-27T11:28:52.959420+0000","last_unstale":"2023-08-27T11:28:54.167652+0000","last_undegraded":"2023-08-27T11:28:54.167652+0000","last_fullsized":"2023-08-27T11:28:54.167652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:22.061225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544934+0000","last_change":"2023-08-27T11:28:52.108972+0000","last_active":"2023-08-27T11:28:54.544934+0000","last_peered":"2023-08-27T11:28:54.544934+0000","last_clean":"2023-08-27T11:28:54.544934+0000","last_became_active":"2023-08-27T11:28:52.108614+0000","last_became_peered":"2023-08-27T11:28:52.108614+0000","last_unstale":"2023-08-27T11:28:54.544934+0000","last_undegraded":"2023-08-27T11:28:54.544934+0000","last_fullsized":"2023-08-27T11:28:54.544934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:47.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943622+0000","last_change":"2023-08-27T11:28:36.035026+0000","last_active":"2023-08-27T11:28:53.943622+0000","last_peered":"2023-08-27T11:28:53.943622+0000","last_clean":"2023-08-27T11:28:53.943622+0000","last_became_active":"2023-08-27T11:28:36.034706+0000","last_became_peered":"2023-08-27T11:28:36.034706+0000","last_unstale":"2023-08-27T11:28:53.943622+0000","last_undegraded":"2023-08-27T11:28:53.943622+0000","last_fullsized":"2023-08-27T11:28:53.943622+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:11.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943238+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:53.943238+0000","last_peered":"2023-08-27T11:28:53.943238+0000","last_clean":"2023-08-27T11:28:53.943238+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:53.943238+0000","last_undegraded":"2023-08-27T11:28:53.943238+0000","last_fullsized":"2023-08-27T11:28:53.943238+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:11.026416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543250+0000","last_change":"2023-08-27T11:28:52.957361+0000","last_active":"2023-08-27T11:28:54.543250+0000","last_peered":"2023-08-27T11:28:54.543250+0000","last_clean":"2023-08-27T11:28:54.543250+0000","last_became_active":"2023-08-27T11:28:52.956848+0000","last_became_peered":"2023-08-27T11:28:52.956848+0000","last_unstale":"2023-08-27T11:28:54.543250+0000","last_undegraded":"2023-08-27T11:28:54.543250+0000","last_fullsized":"2023-08-27T11:28:54.543250+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:57.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"128'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.801051+0000","last_change":"2023-08-27T11:28:52.112549+0000","last_active":"2023-08-27T11:28:54.801051+0000","last_peered":"2023-08-27T11:28:54.801051+0000","last_clean":"2023-08-27T11:28:54.801051+0000","last_became_active":"2023-08-27T11:28:52.112223+0000","last_became_peered":"2023-08-27T11:28:52.112223+0000","last_unstale":"2023-08-27T11:28:54.801051+0000","last_undegraded":"2023-08-27T11:28:54.801051+0000","last_fullsized":"2023-08-27T11:28:54.801051+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:14:26.215023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543970+0000","last_change":"2023-08-27T11:28:36.032354+0000","last_active":"2023-08-27T11:28:54.543970+0000","last_peered":"2023-08-27T11:28:54.543970+0000","last_clean":"2023-08-27T11:28:54.543970+0000","last_became_active":"2023-08-27T11:28:36.031936+0000","last_became_peered":"2023-08-27T11:28:36.031936+0000","last_unstale":"2023-08-27T11:28:54.543970+0000","last_undegraded":"2023-08-27T11:28:54.543970+0000","last_fullsized":"2023-08-27T11:28:54.543970+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:38.881764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167559+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:54.167559+0000","last_peered":"2023-08-27T11:28:54.167559+0000","last_clean":"2023-08-27T11:28:54.167559+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:54.167559+0000","last_undegraded":"2023-08-27T11:28:54.167559+0000","last_fullsized":"2023-08-27T11:28:54.167559+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:01.873554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543352+0000","last_change":"2023-08-27T11:28:52.964224+0000","last_active":"2023-08-27T11:28:54.543352+0000","last_peered":"2023-08-27T11:28:54.543352+0000","last_clean":"2023-08-27T11:28:54.543352+0000","last_became_active":"2023-08-27T11:28:52.963863+0000","last_became_peered":"2023-08-27T11:28:52.963863+0000","last_unstale":"2023-08-27T11:28:54.543352+0000","last_undegraded":"2023-08-27T11:28:54.543352+0000","last_fullsized":"2023-08-27T11:28:54.543352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:41.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167895+0000","last_change":"2023-08-27T11:28:52.107711+0000","last_active":"2023-08-27T11:28:54.167895+0000","last_peered":"2023-08-27T11:28:54.167895+0000","last_clean":"2023-08-27T11:28:54.167895+0000","last_became_active":"2023-08-27T11:28:52.107323+0000","last_became_peered":"2023-08-27T11:28:52.107323+0000","last_unstale":"2023-08-27T11:28:54.167895+0000","last_undegraded":"2023-08-27T11:28:54.167895+0000","last_fullsized":"2023-08-27T11:28:54.167895+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:08.464535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543070+0000","last_change":"2023-08-27T11:28:36.019620+0000","last_active":"2023-08-27T11:28:54.543070+0000","last_peered":"2023-08-27T11:28:54.543070+0000","last_clean":"2023-08-27T11:28:54.543070+0000","last_became_active":"2023-08-27T11:28:36.019344+0000","last_became_peered":"2023-08-27T11:28:36.019344+0000","last_unstale":"2023-08-27T11:28:54.543070+0000","last_undegraded":"2023-08-27T11:28:54.543070+0000","last_fullsized":"2023-08-27T11:28:54.543070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:43.369338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"123'3","reported_seq":24,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544570+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:54.544570+0000","last_peered":"2023-08-27T11:28:54.544570+0000","last_clean":"2023-08-27T11:28:54.544570+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:54.544570+0000","last_undegraded":"2023-08-27T11:28:54.544570+0000","last_fullsized":"2023-08-27T11:28:54.544570+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:27.241465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545198+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:54.545198+0000","last_peered":"2023-08-27T11:28:54.545198+0000","last_clean":"2023-08-27T11:28:54.545198+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:54.545198+0000","last_undegraded":"2023-08-27T11:28:54.545198+0000","last_fullsized":"2023-08-27T11:28:54.545198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:30.419850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943146+0000","last_change":"2023-08-27T11:28:52.965454+0000","last_active":"2023-08-27T11:28:53.943146+0000","last_peered":"2023-08-27T11:28:53.943146+0000","last_clean":"2023-08-27T11:28:53.943146+0000","last_became_active":"2023-08-27T11:28:52.965148+0000","last_became_peered":"2023-08-27T11:28:52.965148+0000","last_unstale":"2023-08-27T11:28:53.943146+0000","last_undegraded":"2023-08-27T11:28:53.943146+0000","last_fullsized":"2023-08-27T11:28:53.943146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:58.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542684+0000","last_change":"2023-08-27T11:28:52.109636+0000","last_active":"2023-08-27T11:28:54.542684+0000","last_peered":"2023-08-27T11:28:54.542684+0000","last_clean":"2023-08-27T11:28:54.542684+0000","last_became_active":"2023-08-27T11:28:52.109296+0000","last_became_peered":"2023-08-27T11:28:52.109296+0000","last_unstale":"2023-08-27T11:28:54.542684+0000","last_undegraded":"2023-08-27T11:28:54.542684+0000","last_fullsized":"2023-08-27T11:28:54.542684+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:08.464535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543784+0000","last_change":"2023-08-27T11:28:36.027190+0000","last_active":"2023-08-27T11:28:54.543784+0000","last_peered":"2023-08-27T11:28:54.543784+0000","last_clean":"2023-08-27T11:28:54.543784+0000","last_became_active":"2023-08-27T11:28:36.026781+0000","last_became_peered":"2023-08-27T11:28:36.026781+0000","last_unstale":"2023-08-27T11:28:54.543784+0000","last_undegraded":"2023-08-27T11:28:54.543784+0000","last_fullsized":"2023-08-27T11:28:54.543784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:19.892696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"123'6","reported_seq":27,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542791+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:54.542791+0000","last_peered":"2023-08-27T11:28:54.542791+0000","last_clean":"2023-08-27T11:28:54.542791+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:54.542791+0000","last_undegraded":"2023-08-27T11:28:54.542791+0000","last_fullsized":"2023-08-27T11:28:54.542791+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:32:27.241226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544726+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:54.544726+0000","last_peered":"2023-08-27T11:28:54.544726+0000","last_clean":"2023-08-27T11:28:54.544726+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:54.544726+0000","last_undegraded":"2023-08-27T11:28:54.544726+0000","last_fullsized":"2023-08-27T11:28:54.544726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:43.780121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938686+0000","last_change":"2023-08-27T11:28:52.964629+0000","last_active":"2023-08-27T11:28:53.938686+0000","last_peered":"2023-08-27T11:28:53.938686+0000","last_clean":"2023-08-27T11:28:53.938686+0000","last_became_active":"2023-08-27T11:28:52.964057+0000","last_became_peered":"2023-08-27T11:28:52.964057+0000","last_unstale":"2023-08-27T11:28:53.938686+0000","last_undegraded":"2023-08-27T11:28:53.938686+0000","last_fullsized":"2023-08-27T11:28:53.938686+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:01.510670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"127'3","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938890+0000","last_change":"2023-08-27T11:28:52.108757+0000","last_active":"2023-08-27T11:28:53.938890+0000","last_peered":"2023-08-27T11:28:53.938890+0000","last_clean":"2023-08-27T11:28:53.938890+0000","last_became_active":"2023-08-27T11:28:52.108482+0000","last_became_peered":"2023-08-27T11:28:52.108482+0000","last_unstale":"2023-08-27T11:28:53.938890+0000","last_undegraded":"2023-08-27T11:28:53.938890+0000","last_fullsized":"2023-08-27T11:28:53.938890+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:36:41.909538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944648+0000","last_change":"2023-08-27T11:28:36.023266+0000","last_active":"2023-08-27T11:28:53.944648+0000","last_peered":"2023-08-27T11:28:53.944648+0000","last_clean":"2023-08-27T11:28:53.944648+0000","last_became_active":"2023-08-27T11:28:36.022928+0000","last_became_peered":"2023-08-27T11:28:36.022928+0000","last_unstale":"2023-08-27T11:28:53.944648+0000","last_undegraded":"2023-08-27T11:28:53.944648+0000","last_fullsized":"2023-08-27T11:28:53.944648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:06.009064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938434+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:53.938434+0000","last_peered":"2023-08-27T11:28:53.938434+0000","last_clean":"2023-08-27T11:28:53.938434+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:53.938434+0000","last_undegraded":"2023-08-27T11:28:53.938434+0000","last_fullsized":"2023-08-27T11:28:53.938434+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:26.172666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126651+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:54.126651+0000","last_peered":"2023-08-27T11:28:54.126651+0000","last_clean":"2023-08-27T11:28:54.126651+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:54.126651+0000","last_undegraded":"2023-08-27T11:28:54.126651+0000","last_fullsized":"2023-08-27T11:28:54.126651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:36.881366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544913+0000","last_change":"2023-08-27T11:28:52.953919+0000","last_active":"2023-08-27T11:28:54.544913+0000","last_peered":"2023-08-27T11:28:54.544913+0000","last_clean":"2023-08-27T11:28:54.544913+0000","last_became_active":"2023-08-27T11:28:52.953523+0000","last_became_peered":"2023-08-27T11:28:52.953523+0000","last_unstale":"2023-08-27T11:28:54.544913+0000","last_undegraded":"2023-08-27T11:28:54.544913+0000","last_fullsized":"2023-08-27T11:28:54.544913+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:16:54.608924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"127'6","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944441+0000","last_change":"2023-08-27T11:28:52.115409+0000","last_active":"2023-08-27T11:28:53.944441+0000","last_peered":"2023-08-27T11:28:53.944441+0000","last_clean":"2023-08-27T11:28:53.944441+0000","last_became_active":"2023-08-27T11:28:52.115101+0000","last_became_peered":"2023-08-27T11:28:52.115101+0000","last_unstale":"2023-08-27T11:28:53.944441+0000","last_undegraded":"2023-08-27T11:28:53.944441+0000","last_fullsized":"2023-08-27T11:28:53.944441+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:21.054635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542877+0000","last_change":"2023-08-27T11:28:36.010061+0000","last_active":"2023-08-27T11:28:54.542877+0000","last_peered":"2023-08-27T11:28:54.542877+0000","last_clean":"2023-08-27T11:28:54.542877+0000","last_became_active":"2023-08-27T11:28:36.009747+0000","last_became_peered":"2023-08-27T11:28:36.009747+0000","last_unstale":"2023-08-27T11:28:54.542877+0000","last_undegraded":"2023-08-27T11:28:54.542877+0000","last_fullsized":"2023-08-27T11:28:54.542877+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:24:37.077937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545050+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:54.545050+0000","last_peered":"2023-08-27T11:28:54.545050+0000","last_clean":"2023-08-27T11:28:54.545050+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:54.545050+0000","last_undegraded":"2023-08-27T11:28:54.545050+0000","last_fullsized":"2023-08-27T11:28:54.545050+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:19.973281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544306+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:54.544306+0000","last_peered":"2023-08-27T11:28:54.544306+0000","last_clean":"2023-08-27T11:28:54.544306+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:54.544306+0000","last_undegraded":"2023-08-27T11:28:54.544306+0000","last_fullsized":"2023-08-27T11:28:54.544306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:44.999303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938500+0000","last_change":"2023-08-27T11:28:52.969419+0000","last_active":"2023-08-27T11:28:53.938500+0000","last_peered":"2023-08-27T11:28:53.938500+0000","last_clean":"2023-08-27T11:28:53.938500+0000","last_became_active":"2023-08-27T11:28:52.969068+0000","last_became_peered":"2023-08-27T11:28:52.969068+0000","last_unstale":"2023-08-27T11:28:53.938500+0000","last_undegraded":"2023-08-27T11:28:53.938500+0000","last_fullsized":"2023-08-27T11:28:53.938500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:12:58.548279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127584+0000","last_change":"2023-08-27T11:28:52.109801+0000","last_active":"2023-08-27T11:28:54.127584+0000","last_peered":"2023-08-27T11:28:54.127584+0000","last_clean":"2023-08-27T11:28:54.127584+0000","last_became_active":"2023-08-27T11:28:52.109522+0000","last_became_peered":"2023-08-27T11:28:52.109522+0000","last_unstale":"2023-08-27T11:28:54.127584+0000","last_undegraded":"2023-08-27T11:28:54.127584+0000","last_fullsized":"2023-08-27T11:28:54.127584+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:23:17.583292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168614+0000","last_change":"2023-08-27T11:28:36.027147+0000","last_active":"2023-08-27T11:28:54.168614+0000","last_peered":"2023-08-27T11:28:54.168614+0000","last_clean":"2023-08-27T11:28:54.168614+0000","last_became_active":"2023-08-27T11:28:36.026783+0000","last_became_peered":"2023-08-27T11:28:36.026783+0000","last_unstale":"2023-08-27T11:28:54.168614+0000","last_undegraded":"2023-08-27T11:28:54.168614+0000","last_fullsized":"2023-08-27T11:28:54.168614+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:24:42.857462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"123'8","reported_seq":29,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943019+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:53.943019+0000","last_peered":"2023-08-27T11:28:53.943019+0000","last_clean":"2023-08-27T11:28:53.943019+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:53.943019+0000","last_undegraded":"2023-08-27T11:28:53.943019+0000","last_fullsized":"2023-08-27T11:28:53.943019+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:57.352018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545244+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:54.545244+0000","last_peered":"2023-08-27T11:28:54.545244+0000","last_clean":"2023-08-27T11:28:54.545244+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:54.545244+0000","last_undegraded":"2023-08-27T11:28:54.545244+0000","last_fullsized":"2023-08-27T11:28:54.545244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:23.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543892+0000","last_change":"2023-08-27T11:28:52.964215+0000","last_active":"2023-08-27T11:28:54.543892+0000","last_peered":"2023-08-27T11:28:54.543892+0000","last_clean":"2023-08-27T11:28:54.543892+0000","last_became_active":"2023-08-27T11:28:52.963891+0000","last_became_peered":"2023-08-27T11:28:52.963891+0000","last_unstale":"2023-08-27T11:28:54.543892+0000","last_undegraded":"2023-08-27T11:28:54.543892+0000","last_fullsized":"2023-08-27T11:28:54.543892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:32.765118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543857+0000","last_change":"2023-08-27T11:28:52.117757+0000","last_active":"2023-08-27T11:28:54.543857+0000","last_peered":"2023-08-27T11:28:54.543857+0000","last_clean":"2023-08-27T11:28:54.543857+0000","last_became_active":"2023-08-27T11:28:52.117338+0000","last_became_peered":"2023-08-27T11:28:52.117338+0000","last_unstale":"2023-08-27T11:28:54.543857+0000","last_undegraded":"2023-08-27T11:28:54.543857+0000","last_fullsized":"2023-08-27T11:28:54.543857+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:33.403772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544972+0000","last_change":"2023-08-27T11:28:36.038226+0000","last_active":"2023-08-27T11:28:54.544972+0000","last_peered":"2023-08-27T11:28:54.544972+0000","last_clean":"2023-08-27T11:28:54.544972+0000","last_became_active":"2023-08-27T11:28:36.037748+0000","last_became_peered":"2023-08-27T11:28:36.037748+0000","last_unstale":"2023-08-27T11:28:54.544972+0000","last_undegraded":"2023-08-27T11:28:54.544972+0000","last_fullsized":"2023-08-27T11:28:54.544972+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:02:27.900251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542019+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:54.542019+0000","last_peered":"2023-08-27T11:28:54.542019+0000","last_clean":"2023-08-27T11:28:54.542019+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:54.542019+0000","last_undegraded":"2023-08-27T11:28:54.542019+0000","last_fullsized":"2023-08-27T11:28:54.542019+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:03.955802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":352,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544168+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:54.544168+0000","last_peered":"2023-08-27T11:28:54.544168+0000","last_clean":"2023-08-27T11:28:54.544168+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:54.544168+0000","last_undegraded":"2023-08-27T11:28:54.544168+0000","last_fullsized":"2023-08-27T11:28:54.544168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:19.957551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943898+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:53.943898+0000","last_peered":"2023-08-27T11:28:53.943898+0000","last_clean":"2023-08-27T11:28:53.943898+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:53.943898+0000","last_undegraded":"2023-08-27T11:28:53.943898+0000","last_fullsized":"2023-08-27T11:28:53.943898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:04:16.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943644+0000","last_change":"2023-08-27T11:28:52.949204+0000","last_active":"2023-08-27T11:28:53.943644+0000","last_peered":"2023-08-27T11:28:53.943644+0000","last_clean":"2023-08-27T11:28:53.943644+0000","last_became_active":"2023-08-27T11:28:52.948339+0000","last_became_peered":"2023-08-27T11:28:52.948339+0000","last_unstale":"2023-08-27T11:28:53.943644+0000","last_undegraded":"2023-08-27T11:28:53.943644+0000","last_fullsized":"2023-08-27T11:28:53.943644+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:27.071898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"127'8","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126615+0000","last_change":"2023-08-27T11:28:52.111865+0000","last_active":"2023-08-27T11:28:54.126615+0000","last_peered":"2023-08-27T11:28:54.126615+0000","last_clean":"2023-08-27T11:28:54.126615+0000","last_became_active":"2023-08-27T11:28:52.111518+0000","last_became_peered":"2023-08-27T11:28:52.111518+0000","last_unstale":"2023-08-27T11:28:54.126615+0000","last_undegraded":"2023-08-27T11:28:54.126615+0000","last_fullsized":"2023-08-27T11:28:54.126615+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:37:19.606710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943842+0000","last_change":"2023-08-27T11:28:36.031797+0000","last_active":"2023-08-27T11:28:53.943842+0000","last_peered":"2023-08-27T11:28:53.943842+0000","last_clean":"2023-08-27T11:28:53.943842+0000","last_became_active":"2023-08-27T11:28:36.031421+0000","last_became_peered":"2023-08-27T11:28:36.031421+0000","last_unstale":"2023-08-27T11:28:53.943842+0000","last_undegraded":"2023-08-27T11:28:53.943842+0000","last_fullsized":"2023-08-27T11:28:53.943842+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:16.548925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938924+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:53.938924+0000","last_peered":"2023-08-27T11:28:53.938924+0000","last_clean":"2023-08-27T11:28:53.938924+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:53.938924+0000","last_undegraded":"2023-08-27T11:28:53.938924+0000","last_fullsized":"2023-08-27T11:28:53.938924+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:07:00.491347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168685+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:54.168685+0000","last_peered":"2023-08-27T11:28:54.168685+0000","last_clean":"2023-08-27T11:28:54.168685+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:54.168685+0000","last_undegraded":"2023-08-27T11:28:54.168685+0000","last_fullsized":"2023-08-27T11:28:54.168685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:32.596417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167548+0000","last_change":"2023-08-27T11:28:52.942737+0000","last_active":"2023-08-27T11:28:54.167548+0000","last_peered":"2023-08-27T11:28:54.167548+0000","last_clean":"2023-08-27T11:28:54.167548+0000","last_became_active":"2023-08-27T11:28:52.942411+0000","last_became_peered":"2023-08-27T11:28:52.942411+0000","last_unstale":"2023-08-27T11:28:54.167548+0000","last_undegraded":"2023-08-27T11:28:54.167548+0000","last_fullsized":"2023-08-27T11:28:54.167548+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:44.392829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542602+0000","last_change":"2023-08-27T11:28:52.104695+0000","last_active":"2023-08-27T11:28:54.542602+0000","last_peered":"2023-08-27T11:28:54.542602+0000","last_clean":"2023-08-27T11:28:54.542602+0000","last_became_active":"2023-08-27T11:28:52.104419+0000","last_became_peered":"2023-08-27T11:28:52.104419+0000","last_unstale":"2023-08-27T11:28:54.542602+0000","last_undegraded":"2023-08-27T11:28:54.542602+0000","last_fullsized":"2023-08-27T11:28:54.542602+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:36.134477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938034+0000","last_change":"2023-08-27T11:28:36.013449+0000","last_active":"2023-08-27T11:28:53.938034+0000","last_peered":"2023-08-27T11:28:53.938034+0000","last_clean":"2023-08-27T11:28:53.938034+0000","last_became_active":"2023-08-27T11:28:36.013153+0000","last_became_peered":"2023-08-27T11:28:36.013153+0000","last_unstale":"2023-08-27T11:28:53.938034+0000","last_undegraded":"2023-08-27T11:28:53.938034+0000","last_fullsized":"2023-08-27T11:28:53.938034+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:43:34.511520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127735+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:54.127735+0000","last_peered":"2023-08-27T11:28:54.127735+0000","last_clean":"2023-08-27T11:28:54.127735+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:54.127735+0000","last_undegraded":"2023-08-27T11:28:54.127735+0000","last_fullsized":"2023-08-27T11:28:54.127735+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:17.546562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545034+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:54.545034+0000","last_peered":"2023-08-27T11:28:54.545034+0000","last_clean":"2023-08-27T11:28:54.545034+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:54.545034+0000","last_undegraded":"2023-08-27T11:28:54.545034+0000","last_fullsized":"2023-08-27T11:28:54.545034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:17.204222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33340,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338500,"statfs":{"total":96636764160,"available":96602624000,"internally_reserved":0,"allocated":2211840,"data_stored":1350374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.64100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.748}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.88900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28592,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343248,"statfs":{"total":96636764160,"available":96607485952,"internally_reserved":0,"allocated":1605632,"data_stored":758038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.77700000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33328,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338512,"statfs":{"total":96636764160,"available":96602636288,"internally_reserved":0,"allocated":2199552,"data_stored":1348790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.375}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":0.626}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.70399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1626112,"data_stored":759670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.373},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.437}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35599999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1613824,"data_stored":759010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":0.71399999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":759594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.63},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":0.81299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343244,"statfs":{"total":96636764160,"available":96607481856,"internally_reserved":0,"allocated":1609728,"data_stored":759894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.745},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":1.2},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.125}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343256,"statfs":{"total":96636764160,"available":96607494144,"internally_reserved":0,"allocated":1597440,"data_stored":757318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:57.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:28:57.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.811+0000 7f0d4f3ff700 1 Processor -- start 2023-08-27T11:28:57.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.811+0000 7f0d4f3ff700 1 -- start start 2023-08-27T11:28:57.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.812+0000 7f0d4f3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d480c4630 0x7f0d480c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.812+0000 7f0d4f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d4806ad70 0x7f0d4806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.812+0000 7f0d4f3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4806c4e0 con 0x7f0d48151a90 2023-08-27T11:28:57.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4f3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d48155370 con 0x7f0d480c4630 2023-08-27T11:28:57.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480c82c0 con 0x7f0d4806ad70 2023-08-27T11:28:57.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4d19b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0d48151a90 0x7f0d480c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60336/0 (socket says 172.21.15.43:60336) 2023-08-27T11:28:57.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4d19b700 1 -- 172.21.15.43:0/1593083545 learned_addr learned my addr 172.21.15.43:0/1593083545 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:57.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/1593083545 >> v2:172.21.15.57:3300/0 conn(0x7f0d480c4630 0x7f0d480c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4d99c700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d4806ad70 0x7f0d4806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d3ffff700 1 -- 172.21.15.43:0/1593083545 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243160579 0 0) 0x7f0d4806c4e0 con 0x7f0d48151a90 2023-08-27T11:28:57.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d3ffff700 1 -- 172.21.15.43:0/1593083545 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d340035b0 con 0x7f0d48151a90 2023-08-27T11:28:57.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4c99a700 1 -- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d4806ad70 msgr2=0x7f0d4806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:57.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d4806ad70 0x7f0d4806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4c99a700 1 -- 172.21.15.43:0/1593083545 >> v1:172.21.15.43:6789/0 conn(0x7f0d48151a90 legacy=0x7f0d480c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.813+0000 7f0d4c99a700 1 -- 172.21.15.43:0/1593083545 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48151e70 con 0x7f0d480c4630 2023-08-27T11:28:57.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d480c4630 0x7f0d480c4a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009840 tx=0x7f0d38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555bb78d1b7193e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d3ffff700 1 -- 172.21.15.43:0/1593083545 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38011830 con 0x7f0d480c4630 2023-08-27T11:28:57.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d3ffff700 1 -- 172.21.15.43:0/1593083545 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d38011990 con 0x7f0d480c4630 2023-08-27T11:28:57.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d3ffff700 1 -- 172.21.15.43:0/1593083545 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38011d00 con 0x7f0d480c4630 2023-08-27T11:28:57.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d480c4630 msgr2=0x7f0d480c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.814+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d480c4630 0x7f0d480c4a90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009840 tx=0x7f0d38009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:57.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/1593083545 shutdown_connections 2023-08-27T11:28:57.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d4806ad70 0x7f0d4806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/1593083545 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d480c4630 0x7f0d480c4a90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/1593083545 >> 172.21.15.43:0/1593083545 conn(0x7f0d480ab820 msgr2=0x7f0d480abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:57.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/1593083545 shutdown_connections 2023-08-27T11:28:57.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.815+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/1593083545 wait complete. 2023-08-27T11:28:57.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.816+0000 7f0d4f3ff700 1 Processor -- start 2023-08-27T11:28:57.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.816+0000 7f0d4f3ff700 1 -- start start 2023-08-27T11:28:57.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.817+0000 7f0d4f3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.817+0000 7f0d4f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d480c4630 0x7f0d480be510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4f3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d48151a90 0x7f0d480aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4f3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481e9b80 con 0x7f0d4806ad70 2023-08-27T11:28:57.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4f3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48149900 con 0x7f0d48151a90 2023-08-27T11:28:57.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d481ed570 con 0x7f0d480c4630 2023-08-27T11:28:57.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58442/0 (socket says 172.21.15.43:58442) 2023-08-27T11:28:57.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 -- 172.21.15.43:0/4277083425 learned_addr learned my addr 172.21.15.43:0/4277083425 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:57.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d99c700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d48151a90 0x7f0d480aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d480c4630 0x7f0d480be510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 -- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d480c4630 msgr2=0x7f0d480be510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d480c4630 0x7f0d480be510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 -- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d48151a90 msgr2=0x7f0d480aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:57.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d48151a90 0x7f0d480aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:57.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.818+0000 7f0d4d19b700 1 -- 172.21.15.43:0/4277083425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380094a0 con 0x7f0d4806ad70 2023-08-27T11:28:57.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d4d19b700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c420 tx=0x7f0d4400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44005d70 con 0x7f0d4806ad70 2023-08-27T11:28:57.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4400ce30 con 0x7f0d4806ad70 2023-08-27T11:28:57.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d440072d0 con 0x7f0d4806ad70 2023-08-27T11:28:57.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48150b50 con 0x7f0d4806ad70 2023-08-27T11:28:57.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.819+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481ecf20 con 0x7f0d4806ad70 2023-08-27T11:28:57.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.820+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48072450 con 0x7f0d4806ad70 2023-08-27T11:28:57.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.821+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d44007430 con 0x7f0d4806ad70 2023-08-27T11:28:57.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.822+0000 7f0d3dffb700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 0x7f0d2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:57.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.822+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f0d44087b90 con 0x7f0d4806ad70 2023-08-27T11:28:57.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.823+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 0x7f0d2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:57.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.823+0000 7f0d4c99a700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 0x7f0d2c06c5a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000c00 tx=0x7f0d38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:57.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:57.827+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d44052f30 con 0x7f0d4806ad70 2023-08-27T11:28:58.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.031+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d48154760 con 0x7f0d2c06a0e0 2023-08-27T11:28:58.050 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.049+0000 7f0d3dffb700 1 -- 172.21.15.43:0/4277083425 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+551039 (secure 0 0 0) 0x7f0d38011630 con 0x7f0d2c06a0e0 2023-08-27T11:28:58.058 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:58.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 msgr2=0x7f0d2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 0x7f0d2c06c5a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0d38000c00 tx=0x7f0d38008030 comp rx=0 tx=0).stop 2023-08-27T11:28:58.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 msgr2=0x7f0d481493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400c420 tx=0x7f0d4400c730 comp rx=0 tx=0).stop 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 shutdown_connections 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d2c06a0e0 0x7f0d2c06c5a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d48151a90 0x7f0d480aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d4806ad70 0x7f0d481493c0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 --2- 172.21.15.43:0/4277083425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d480c4630 0x7f0d480be510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 >> 172.21.15.43:0/4277083425 conn(0x7f0d480ab820 msgr2=0x7f0d4814b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:58.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 shutdown_connections 2023-08-27T11:28:58.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.055+0000 7f0d4f3ff700 1 -- 172.21.15.43:0/4277083425 wait complete. 2023-08-27T11:28:58.065 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:28:58.075 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2023-08-27T11:28:56.388955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":373,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250740,"kb_used_data":13752,"kb_used_omap":13,"kb_used_meta":236850,"kb_avail":754723980,"statfs":{"total":773094113280,"available":772837355520,"internally_reserved":0,"allocated":14082048,"data_stored":7252688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":242534488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.307433"},"pg_stats":[{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944835+0000","last_change":"2023-08-27T11:28:52.970905+0000","last_active":"2023-08-27T11:28:53.944835+0000","last_peered":"2023-08-27T11:28:53.944835+0000","last_clean":"2023-08-27T11:28:53.944835+0000","last_became_active":"2023-08-27T11:28:52.970532+0000","last_became_peered":"2023-08-27T11:28:52.970532+0000","last_unstale":"2023-08-27T11:28:53.944835+0000","last_undegraded":"2023-08-27T11:28:53.944835+0000","last_fullsized":"2023-08-27T11:28:53.944835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:16:54.608924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938621+0000","last_change":"2023-08-27T11:28:36.025295+0000","last_active":"2023-08-27T11:28:53.938621+0000","last_peered":"2023-08-27T11:28:53.938621+0000","last_clean":"2023-08-27T11:28:53.938621+0000","last_became_active":"2023-08-27T11:28:36.024913+0000","last_became_peered":"2023-08-27T11:28:36.024913+0000","last_unstale":"2023-08-27T11:28:53.938621+0000","last_undegraded":"2023-08-27T11:28:53.938621+0000","last_fullsized":"2023-08-27T11:28:53.938621+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:19:56.110594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544232+0000","last_change":"2023-08-27T11:28:52.955220+0000","last_active":"2023-08-27T11:28:54.544232+0000","last_peered":"2023-08-27T11:28:54.544232+0000","last_clean":"2023-08-27T11:28:54.544232+0000","last_became_active":"2023-08-27T11:28:52.951920+0000","last_became_peered":"2023-08-27T11:28:52.951920+0000","last_unstale":"2023-08-27T11:28:54.544232+0000","last_undegraded":"2023-08-27T11:28:54.544232+0000","last_fullsized":"2023-08-27T11:28:54.544232+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:08:10.925089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127804+0000","last_change":"2023-08-27T11:28:36.028793+0000","last_active":"2023-08-27T11:28:54.127804+0000","last_peered":"2023-08-27T11:28:54.127804+0000","last_clean":"2023-08-27T11:28:54.127804+0000","last_became_active":"2023-08-27T11:28:36.028457+0000","last_became_peered":"2023-08-27T11:28:36.028457+0000","last_unstale":"2023-08-27T11:28:54.127804+0000","last_undegraded":"2023-08-27T11:28:54.127804+0000","last_fullsized":"2023-08-27T11:28:54.127804+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:58.360474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127294+0000","last_change":"2023-08-27T11:28:52.959765+0000","last_active":"2023-08-27T11:28:54.127294+0000","last_peered":"2023-08-27T11:28:54.127294+0000","last_clean":"2023-08-27T11:28:54.127294+0000","last_became_active":"2023-08-27T11:28:52.959481+0000","last_became_peered":"2023-08-27T11:28:52.959481+0000","last_unstale":"2023-08-27T11:28:54.127294+0000","last_undegraded":"2023-08-27T11:28:54.127294+0000","last_fullsized":"2023-08-27T11:28:54.127294+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:52:49.992877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543339+0000","last_change":"2023-08-27T11:28:36.014516+0000","last_active":"2023-08-27T11:28:54.543339+0000","last_peered":"2023-08-27T11:28:54.543339+0000","last_clean":"2023-08-27T11:28:54.543339+0000","last_became_active":"2023-08-27T11:28:36.013518+0000","last_became_peered":"2023-08-27T11:28:36.013518+0000","last_unstale":"2023-08-27T11:28:54.543339+0000","last_undegraded":"2023-08-27T11:28:54.543339+0000","last_fullsized":"2023-08-27T11:28:54.543339+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:27.852773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943524+0000","last_change":"2023-08-27T11:28:52.965423+0000","last_active":"2023-08-27T11:28:53.943524+0000","last_peered":"2023-08-27T11:28:53.943524+0000","last_clean":"2023-08-27T11:28:53.943524+0000","last_became_active":"2023-08-27T11:28:52.965137+0000","last_became_peered":"2023-08-27T11:28:52.965137+0000","last_unstale":"2023-08-27T11:28:53.943524+0000","last_undegraded":"2023-08-27T11:28:53.943524+0000","last_fullsized":"2023-08-27T11:28:53.943524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:13:38.426677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127018+0000","last_change":"2023-08-27T11:28:36.026307+0000","last_active":"2023-08-27T11:28:54.127018+0000","last_peered":"2023-08-27T11:28:54.127018+0000","last_clean":"2023-08-27T11:28:54.127018+0000","last_became_active":"2023-08-27T11:28:36.026010+0000","last_became_peered":"2023-08-27T11:28:36.026010+0000","last_unstale":"2023-08-27T11:28:54.127018+0000","last_undegraded":"2023-08-27T11:28:54.127018+0000","last_fullsized":"2023-08-27T11:28:54.127018+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:40:15.388622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127402+0000","last_change":"2023-08-27T11:28:52.968368+0000","last_active":"2023-08-27T11:28:54.127402+0000","last_peered":"2023-08-27T11:28:54.127402+0000","last_clean":"2023-08-27T11:28:54.127402+0000","last_became_active":"2023-08-27T11:28:52.968022+0000","last_became_peered":"2023-08-27T11:28:52.968022+0000","last_unstale":"2023-08-27T11:28:54.127402+0000","last_undegraded":"2023-08-27T11:28:54.127402+0000","last_fullsized":"2023-08-27T11:28:54.127402+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:36:56.212337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167700+0000","last_change":"2023-08-27T11:28:36.018518+0000","last_active":"2023-08-27T11:28:54.167700+0000","last_peered":"2023-08-27T11:28:54.167700+0000","last_clean":"2023-08-27T11:28:54.167700+0000","last_became_active":"2023-08-27T11:28:36.016928+0000","last_became_peered":"2023-08-27T11:28:36.016928+0000","last_unstale":"2023-08-27T11:28:54.167700+0000","last_undegraded":"2023-08-27T11:28:54.167700+0000","last_fullsized":"2023-08-27T11:28:54.167700+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:45.630236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543076+0000","last_change":"2023-08-27T11:28:52.955295+0000","last_active":"2023-08-27T11:28:54.543076+0000","last_peered":"2023-08-27T11:28:54.543076+0000","last_clean":"2023-08-27T11:28:54.543076+0000","last_became_active":"2023-08-27T11:28:52.954568+0000","last_became_peered":"2023-08-27T11:28:52.954568+0000","last_unstale":"2023-08-27T11:28:54.543076+0000","last_undegraded":"2023-08-27T11:28:54.543076+0000","last_fullsized":"2023-08-27T11:28:54.543076+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:02.715971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943806+0000","last_change":"2023-08-27T11:28:36.032093+0000","last_active":"2023-08-27T11:28:53.943806+0000","last_peered":"2023-08-27T11:28:53.943806+0000","last_clean":"2023-08-27T11:28:53.943806+0000","last_became_active":"2023-08-27T11:28:36.031709+0000","last_became_peered":"2023-08-27T11:28:36.031709+0000","last_unstale":"2023-08-27T11:28:53.943806+0000","last_undegraded":"2023-08-27T11:28:53.943806+0000","last_fullsized":"2023-08-27T11:28:53.943806+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:23.083108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168377+0000","last_change":"2023-08-27T11:28:52.959725+0000","last_active":"2023-08-27T11:28:54.168377+0000","last_peered":"2023-08-27T11:28:54.168377+0000","last_clean":"2023-08-27T11:28:54.168377+0000","last_became_active":"2023-08-27T11:28:52.959522+0000","last_became_peered":"2023-08-27T11:28:52.959522+0000","last_unstale":"2023-08-27T11:28:54.168377+0000","last_undegraded":"2023-08-27T11:28:54.168377+0000","last_fullsized":"2023-08-27T11:28:54.168377+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:57.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542593+0000","last_change":"2023-08-27T11:28:36.037935+0000","last_active":"2023-08-27T11:28:54.542593+0000","last_peered":"2023-08-27T11:28:54.542593+0000","last_clean":"2023-08-27T11:28:54.542593+0000","last_became_active":"2023-08-27T11:28:36.034667+0000","last_became_peered":"2023-08-27T11:28:36.034667+0000","last_unstale":"2023-08-27T11:28:54.542593+0000","last_undegraded":"2023-08-27T11:28:54.542593+0000","last_fullsized":"2023-08-27T11:28:54.542593+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:33.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167481+0000","last_change":"2023-08-27T11:28:52.960430+0000","last_active":"2023-08-27T11:28:54.167481+0000","last_peered":"2023-08-27T11:28:54.167481+0000","last_clean":"2023-08-27T11:28:54.167481+0000","last_became_active":"2023-08-27T11:28:52.960074+0000","last_became_peered":"2023-08-27T11:28:52.960074+0000","last_unstale":"2023-08-27T11:28:54.167481+0000","last_undegraded":"2023-08-27T11:28:54.167481+0000","last_fullsized":"2023-08-27T11:28:54.167481+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:59.312381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542914+0000","last_change":"2023-08-27T11:28:36.025699+0000","last_active":"2023-08-27T11:28:54.542914+0000","last_peered":"2023-08-27T11:28:54.542914+0000","last_clean":"2023-08-27T11:28:54.542914+0000","last_became_active":"2023-08-27T11:28:36.025101+0000","last_became_peered":"2023-08-27T11:28:36.025101+0000","last_unstale":"2023-08-27T11:28:54.542914+0000","last_undegraded":"2023-08-27T11:28:54.542914+0000","last_fullsized":"2023-08-27T11:28:54.542914+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:13:21.329711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.939019+0000","last_change":"2023-08-27T11:28:52.969507+0000","last_active":"2023-08-27T11:28:53.939019+0000","last_peered":"2023-08-27T11:28:53.939019+0000","last_clean":"2023-08-27T11:28:53.939019+0000","last_became_active":"2023-08-27T11:28:52.969094+0000","last_became_peered":"2023-08-27T11:28:52.969094+0000","last_unstale":"2023-08-27T11:28:53.939019+0000","last_undegraded":"2023-08-27T11:28:53.939019+0000","last_fullsized":"2023-08-27T11:28:53.939019+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:26:39.809670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944150+0000","last_change":"2023-08-27T11:28:36.032044+0000","last_active":"2023-08-27T11:28:53.944150+0000","last_peered":"2023-08-27T11:28:53.944150+0000","last_clean":"2023-08-27T11:28:53.944150+0000","last_became_active":"2023-08-27T11:28:36.031578+0000","last_became_peered":"2023-08-27T11:28:36.031578+0000","last_unstale":"2023-08-27T11:28:53.944150+0000","last_undegraded":"2023-08-27T11:28:53.944150+0000","last_fullsized":"2023-08-27T11:28:53.944150+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:30.353351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544088+0000","last_change":"2023-08-27T11:28:52.957697+0000","last_active":"2023-08-27T11:28:54.544088+0000","last_peered":"2023-08-27T11:28:54.544088+0000","last_clean":"2023-08-27T11:28:54.544088+0000","last_became_active":"2023-08-27T11:28:52.957376+0000","last_became_peered":"2023-08-27T11:28:52.957376+0000","last_unstale":"2023-08-27T11:28:54.544088+0000","last_undegraded":"2023-08-27T11:28:54.544088+0000","last_fullsized":"2023-08-27T11:28:54.544088+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:03:15.700962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944347+0000","last_change":"2023-08-27T11:28:36.025467+0000","last_active":"2023-08-27T11:28:53.944347+0000","last_peered":"2023-08-27T11:28:53.944347+0000","last_clean":"2023-08-27T11:28:53.944347+0000","last_became_active":"2023-08-27T11:28:36.025183+0000","last_became_peered":"2023-08-27T11:28:36.025183+0000","last_unstale":"2023-08-27T11:28:53.944347+0000","last_undegraded":"2023-08-27T11:28:53.944347+0000","last_fullsized":"2023-08-27T11:28:53.944347+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:02.882010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168367+0000","last_change":"2023-08-27T11:28:52.967391+0000","last_active":"2023-08-27T11:28:54.168367+0000","last_peered":"2023-08-27T11:28:54.168367+0000","last_clean":"2023-08-27T11:28:54.168367+0000","last_became_active":"2023-08-27T11:28:52.967102+0000","last_became_peered":"2023-08-27T11:28:52.967102+0000","last_unstale":"2023-08-27T11:28:54.168367+0000","last_undegraded":"2023-08-27T11:28:54.168367+0000","last_fullsized":"2023-08-27T11:28:54.168367+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:42:00.466304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127396+0000","last_change":"2023-08-27T11:28:36.028552+0000","last_active":"2023-08-27T11:28:54.127396+0000","last_peered":"2023-08-27T11:28:54.127396+0000","last_clean":"2023-08-27T11:28:54.127396+0000","last_became_active":"2023-08-27T11:28:36.028230+0000","last_became_peered":"2023-08-27T11:28:36.028230+0000","last_unstale":"2023-08-27T11:28:54.127396+0000","last_undegraded":"2023-08-27T11:28:54.127396+0000","last_fullsized":"2023-08-27T11:28:54.127396+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:27:24.100532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167748+0000","last_change":"2023-08-27T11:28:52.953021+0000","last_active":"2023-08-27T11:28:54.167748+0000","last_peered":"2023-08-27T11:28:54.167748+0000","last_clean":"2023-08-27T11:28:54.167748+0000","last_became_active":"2023-08-27T11:28:52.952723+0000","last_became_peered":"2023-08-27T11:28:52.952723+0000","last_unstale":"2023-08-27T11:28:54.167748+0000","last_undegraded":"2023-08-27T11:28:54.167748+0000","last_fullsized":"2023-08-27T11:28:54.167748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.478232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938106+0000","last_change":"2023-08-27T11:28:36.003637+0000","last_active":"2023-08-27T11:28:53.938106+0000","last_peered":"2023-08-27T11:28:53.938106+0000","last_clean":"2023-08-27T11:28:53.938106+0000","last_became_active":"2023-08-27T11:28:36.003238+0000","last_became_peered":"2023-08-27T11:28:36.003238+0000","last_unstale":"2023-08-27T11:28:53.938106+0000","last_undegraded":"2023-08-27T11:28:53.938106+0000","last_fullsized":"2023-08-27T11:28:53.938106+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:09:36.607713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943754+0000","last_change":"2023-08-27T11:28:52.961781+0000","last_active":"2023-08-27T11:28:53.943754+0000","last_peered":"2023-08-27T11:28:53.943754+0000","last_clean":"2023-08-27T11:28:53.943754+0000","last_became_active":"2023-08-27T11:28:52.961474+0000","last_became_peered":"2023-08-27T11:28:52.961474+0000","last_unstale":"2023-08-27T11:28:53.943754+0000","last_undegraded":"2023-08-27T11:28:53.943754+0000","last_fullsized":"2023-08-27T11:28:53.943754+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:41.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943729+0000","last_change":"2023-08-27T11:28:36.029468+0000","last_active":"2023-08-27T11:28:53.943729+0000","last_peered":"2023-08-27T11:28:53.943729+0000","last_clean":"2023-08-27T11:28:53.943729+0000","last_became_active":"2023-08-27T11:28:36.028083+0000","last_became_peered":"2023-08-27T11:28:36.028083+0000","last_unstale":"2023-08-27T11:28:53.943729+0000","last_undegraded":"2023-08-27T11:28:53.943729+0000","last_fullsized":"2023-08-27T11:28:53.943729+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:16.689117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167230+0000","last_change":"2023-08-27T11:28:52.957558+0000","last_active":"2023-08-27T11:28:54.167230+0000","last_peered":"2023-08-27T11:28:54.167230+0000","last_clean":"2023-08-27T11:28:54.167230+0000","last_became_active":"2023-08-27T11:28:52.957209+0000","last_became_peered":"2023-08-27T11:28:52.957209+0000","last_unstale":"2023-08-27T11:28:54.167230+0000","last_undegraded":"2023-08-27T11:28:54.167230+0000","last_fullsized":"2023-08-27T11:28:54.167230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:44.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938324+0000","last_change":"2023-08-27T11:28:36.031513+0000","last_active":"2023-08-27T11:28:53.938324+0000","last_peered":"2023-08-27T11:28:53.938324+0000","last_clean":"2023-08-27T11:28:53.938324+0000","last_became_active":"2023-08-27T11:28:36.031228+0000","last_became_peered":"2023-08-27T11:28:36.031228+0000","last_unstale":"2023-08-27T11:28:53.938324+0000","last_undegraded":"2023-08-27T11:28:53.938324+0000","last_fullsized":"2023-08-27T11:28:53.938324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:06:30.485111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167957+0000","last_change":"2023-08-27T11:28:52.953161+0000","last_active":"2023-08-27T11:28:54.167957+0000","last_peered":"2023-08-27T11:28:54.167957+0000","last_clean":"2023-08-27T11:28:54.167957+0000","last_became_active":"2023-08-27T11:28:52.952874+0000","last_became_peered":"2023-08-27T11:28:52.952874+0000","last_unstale":"2023-08-27T11:28:54.167957+0000","last_undegraded":"2023-08-27T11:28:54.167957+0000","last_fullsized":"2023-08-27T11:28:54.167957+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:24:54.174903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.937934+0000","last_change":"2023-08-27T11:28:36.031969+0000","last_active":"2023-08-27T11:28:53.937934+0000","last_peered":"2023-08-27T11:28:53.937934+0000","last_clean":"2023-08-27T11:28:53.937934+0000","last_became_active":"2023-08-27T11:28:36.030385+0000","last_became_peered":"2023-08-27T11:28:36.030385+0000","last_unstale":"2023-08-27T11:28:53.937934+0000","last_undegraded":"2023-08-27T11:28:53.937934+0000","last_fullsized":"2023-08-27T11:28:53.937934+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:51:19.251549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542532+0000","last_change":"2023-08-27T11:28:52.959856+0000","last_active":"2023-08-27T11:28:54.542532+0000","last_peered":"2023-08-27T11:28:54.542532+0000","last_clean":"2023-08-27T11:28:54.542532+0000","last_became_active":"2023-08-27T11:28:52.959579+0000","last_became_peered":"2023-08-27T11:28:52.959579+0000","last_unstale":"2023-08-27T11:28:54.542532+0000","last_undegraded":"2023-08-27T11:28:54.542532+0000","last_fullsized":"2023-08-27T11:28:54.542532+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:38:55.412052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943161+0000","last_change":"2023-08-27T11:28:36.035072+0000","last_active":"2023-08-27T11:28:53.943161+0000","last_peered":"2023-08-27T11:28:53.943161+0000","last_clean":"2023-08-27T11:28:53.943161+0000","last_became_active":"2023-08-27T11:28:36.031725+0000","last_became_peered":"2023-08-27T11:28:36.031725+0000","last_unstale":"2023-08-27T11:28:53.943161+0000","last_undegraded":"2023-08-27T11:28:53.943161+0000","last_fullsized":"2023-08-27T11:28:53.943161+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:18:20.304393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543484+0000","last_change":"2023-08-27T11:28:52.971482+0000","last_active":"2023-08-27T11:28:54.543484+0000","last_peered":"2023-08-27T11:28:54.543484+0000","last_clean":"2023-08-27T11:28:54.543484+0000","last_became_active":"2023-08-27T11:28:52.970997+0000","last_became_peered":"2023-08-27T11:28:52.970997+0000","last_unstale":"2023-08-27T11:28:54.543484+0000","last_undegraded":"2023-08-27T11:28:54.543484+0000","last_fullsized":"2023-08-27T11:28:54.543484+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:02:13.194705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944270+0000","last_change":"2023-08-27T11:28:36.026210+0000","last_active":"2023-08-27T11:28:53.944270+0000","last_peered":"2023-08-27T11:28:53.944270+0000","last_clean":"2023-08-27T11:28:53.944270+0000","last_became_active":"2023-08-27T11:28:36.025658+0000","last_became_peered":"2023-08-27T11:28:36.025658+0000","last_unstale":"2023-08-27T11:28:53.944270+0000","last_undegraded":"2023-08-27T11:28:53.944270+0000","last_fullsized":"2023-08-27T11:28:53.944270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:14.460751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944291+0000","last_change":"2023-08-27T11:28:52.955731+0000","last_active":"2023-08-27T11:28:53.944291+0000","last_peered":"2023-08-27T11:28:53.944291+0000","last_clean":"2023-08-27T11:28:53.944291+0000","last_became_active":"2023-08-27T11:28:52.955461+0000","last_became_peered":"2023-08-27T11:28:52.955461+0000","last_unstale":"2023-08-27T11:28:53.944291+0000","last_undegraded":"2023-08-27T11:28:53.944291+0000","last_fullsized":"2023-08-27T11:28:53.944291+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:44.392829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167843+0000","last_change":"2023-08-27T11:28:36.018073+0000","last_active":"2023-08-27T11:28:54.167843+0000","last_peered":"2023-08-27T11:28:54.167843+0000","last_clean":"2023-08-27T11:28:54.167843+0000","last_became_active":"2023-08-27T11:28:36.017781+0000","last_became_peered":"2023-08-27T11:28:36.017781+0000","last_unstale":"2023-08-27T11:28:54.167843+0000","last_undegraded":"2023-08-27T11:28:54.167843+0000","last_fullsized":"2023-08-27T11:28:54.167843+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:20.044100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545105+0000","last_change":"2023-08-27T11:28:52.961616+0000","last_active":"2023-08-27T11:28:54.545105+0000","last_peered":"2023-08-27T11:28:54.545105+0000","last_clean":"2023-08-27T11:28:54.545105+0000","last_became_active":"2023-08-27T11:28:52.961275+0000","last_became_peered":"2023-08-27T11:28:52.961275+0000","last_unstale":"2023-08-27T11:28:54.545105+0000","last_undegraded":"2023-08-27T11:28:54.545105+0000","last_fullsized":"2023-08-27T11:28:54.545105+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:57:13.830082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544159+0000","last_change":"2023-08-27T11:28:36.038441+0000","last_active":"2023-08-27T11:28:54.544159+0000","last_peered":"2023-08-27T11:28:54.544159+0000","last_clean":"2023-08-27T11:28:54.544159+0000","last_became_active":"2023-08-27T11:28:36.036212+0000","last_became_peered":"2023-08-27T11:28:36.036212+0000","last_unstale":"2023-08-27T11:28:54.544159+0000","last_undegraded":"2023-08-27T11:28:54.544159+0000","last_fullsized":"2023-08-27T11:28:54.544159+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:03.531752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938765+0000","last_change":"2023-08-27T11:28:52.964385+0000","last_active":"2023-08-27T11:28:53.938765+0000","last_peered":"2023-08-27T11:28:53.938765+0000","last_clean":"2023-08-27T11:28:53.938765+0000","last_became_active":"2023-08-27T11:28:52.964020+0000","last_became_peered":"2023-08-27T11:28:52.964020+0000","last_unstale":"2023-08-27T11:28:53.938765+0000","last_undegraded":"2023-08-27T11:28:53.938765+0000","last_fullsized":"2023-08-27T11:28:53.938765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:51.652619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168591+0000","last_change":"2023-08-27T11:28:36.034189+0000","last_active":"2023-08-27T11:28:54.168591+0000","last_peered":"2023-08-27T11:28:54.168591+0000","last_clean":"2023-08-27T11:28:54.168591+0000","last_became_active":"2023-08-27T11:28:36.033669+0000","last_became_peered":"2023-08-27T11:28:36.033669+0000","last_unstale":"2023-08-27T11:28:54.168591+0000","last_undegraded":"2023-08-27T11:28:54.168591+0000","last_fullsized":"2023-08-27T11:28:54.168591+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:35.542306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542530+0000","last_change":"2023-08-27T11:28:52.965411+0000","last_active":"2023-08-27T11:28:54.542530+0000","last_peered":"2023-08-27T11:28:54.542530+0000","last_clean":"2023-08-27T11:28:54.542530+0000","last_became_active":"2023-08-27T11:28:52.965122+0000","last_became_peered":"2023-08-27T11:28:52.965122+0000","last_unstale":"2023-08-27T11:28:54.542530+0000","last_undegraded":"2023-08-27T11:28:54.542530+0000","last_fullsized":"2023-08-27T11:28:54.542530+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:37.452054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127182+0000","last_change":"2023-08-27T11:28:36.028057+0000","last_active":"2023-08-27T11:28:54.127182+0000","last_peered":"2023-08-27T11:28:54.127182+0000","last_clean":"2023-08-27T11:28:54.127182+0000","last_became_active":"2023-08-27T11:28:36.027646+0000","last_became_peered":"2023-08-27T11:28:36.027646+0000","last_unstale":"2023-08-27T11:28:54.127182+0000","last_undegraded":"2023-08-27T11:28:54.127182+0000","last_fullsized":"2023-08-27T11:28:54.127182+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:08:26.709063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938308+0000","last_change":"2023-08-27T11:28:52.942898+0000","last_active":"2023-08-27T11:28:53.938308+0000","last_peered":"2023-08-27T11:28:53.938308+0000","last_clean":"2023-08-27T11:28:53.938308+0000","last_became_active":"2023-08-27T11:28:52.942592+0000","last_became_peered":"2023-08-27T11:28:52.942592+0000","last_unstale":"2023-08-27T11:28:53.938308+0000","last_undegraded":"2023-08-27T11:28:53.938308+0000","last_fullsized":"2023-08-27T11:28:53.938308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:59:56.339532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938196+0000","last_change":"2023-08-27T11:28:36.019510+0000","last_active":"2023-08-27T11:28:53.938196+0000","last_peered":"2023-08-27T11:28:53.938196+0000","last_clean":"2023-08-27T11:28:53.938196+0000","last_became_active":"2023-08-27T11:28:36.019179+0000","last_became_peered":"2023-08-27T11:28:36.019179+0000","last_unstale":"2023-08-27T11:28:53.938196+0000","last_undegraded":"2023-08-27T11:28:53.938196+0000","last_fullsized":"2023-08-27T11:28:53.938196+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:42.947156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167802+0000","last_change":"2023-08-27T11:28:52.967202+0000","last_active":"2023-08-27T11:28:54.167802+0000","last_peered":"2023-08-27T11:28:54.167802+0000","last_clean":"2023-08-27T11:28:54.167802+0000","last_became_active":"2023-08-27T11:28:52.966903+0000","last_became_peered":"2023-08-27T11:28:52.966903+0000","last_unstale":"2023-08-27T11:28:54.167802+0000","last_undegraded":"2023-08-27T11:28:54.167802+0000","last_fullsized":"2023-08-27T11:28:54.167802+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:38:55.412052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126660+0000","last_change":"2023-08-27T11:28:36.033383+0000","last_active":"2023-08-27T11:28:54.126660+0000","last_peered":"2023-08-27T11:28:54.126660+0000","last_clean":"2023-08-27T11:28:54.126660+0000","last_became_active":"2023-08-27T11:28:36.033079+0000","last_became_peered":"2023-08-27T11:28:36.033079+0000","last_unstale":"2023-08-27T11:28:54.126660+0000","last_undegraded":"2023-08-27T11:28:54.126660+0000","last_fullsized":"2023-08-27T11:28:54.126660+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:14:19.562242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126820+0000","last_change":"2023-08-27T11:28:52.967971+0000","last_active":"2023-08-27T11:28:54.126820+0000","last_peered":"2023-08-27T11:28:54.126820+0000","last_clean":"2023-08-27T11:28:54.126820+0000","last_became_active":"2023-08-27T11:28:52.967668+0000","last_became_peered":"2023-08-27T11:28:52.967668+0000","last_unstale":"2023-08-27T11:28:54.126820+0000","last_undegraded":"2023-08-27T11:28:54.126820+0000","last_fullsized":"2023-08-27T11:28:54.126820+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:40:21.488882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.942925+0000","last_change":"2023-08-27T11:28:36.026817+0000","last_active":"2023-08-27T11:28:53.942925+0000","last_peered":"2023-08-27T11:28:53.942925+0000","last_clean":"2023-08-27T11:28:53.942925+0000","last_became_active":"2023-08-27T11:28:36.026404+0000","last_became_peered":"2023-08-27T11:28:36.026404+0000","last_unstale":"2023-08-27T11:28:53.942925+0000","last_undegraded":"2023-08-27T11:28:53.942925+0000","last_fullsized":"2023-08-27T11:28:53.942925+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:18.555018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167920+0000","last_change":"2023-08-27T11:28:52.969344+0000","last_active":"2023-08-27T11:28:54.167920+0000","last_peered":"2023-08-27T11:28:54.167920+0000","last_clean":"2023-08-27T11:28:54.167920+0000","last_became_active":"2023-08-27T11:28:52.969023+0000","last_became_peered":"2023-08-27T11:28:52.969023+0000","last_unstale":"2023-08-27T11:28:54.167920+0000","last_undegraded":"2023-08-27T11:28:54.167920+0000","last_fullsized":"2023-08-27T11:28:54.167920+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:25.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545672+0000","last_change":"2023-08-27T11:28:36.018195+0000","last_active":"2023-08-27T11:28:54.545672+0000","last_peered":"2023-08-27T11:28:54.545672+0000","last_clean":"2023-08-27T11:28:54.545672+0000","last_became_active":"2023-08-27T11:28:36.017891+0000","last_became_peered":"2023-08-27T11:28:36.017891+0000","last_unstale":"2023-08-27T11:28:54.545672+0000","last_undegraded":"2023-08-27T11:28:54.545672+0000","last_fullsized":"2023-08-27T11:28:54.545672+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:40:46.517021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938680+0000","last_change":"2023-08-27T11:28:52.954128+0000","last_active":"2023-08-27T11:28:53.938680+0000","last_peered":"2023-08-27T11:28:53.938680+0000","last_clean":"2023-08-27T11:28:53.938680+0000","last_became_active":"2023-08-27T11:28:52.953855+0000","last_became_peered":"2023-08-27T11:28:52.953855+0000","last_unstale":"2023-08-27T11:28:53.938680+0000","last_undegraded":"2023-08-27T11:28:53.938680+0000","last_fullsized":"2023-08-27T11:28:53.938680+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:10:50.320430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544581+0000","last_change":"2023-08-27T11:28:36.033043+0000","last_active":"2023-08-27T11:28:54.544581+0000","last_peered":"2023-08-27T11:28:54.544581+0000","last_clean":"2023-08-27T11:28:54.544581+0000","last_became_active":"2023-08-27T11:28:36.032749+0000","last_became_peered":"2023-08-27T11:28:36.032749+0000","last_unstale":"2023-08-27T11:28:54.544581+0000","last_undegraded":"2023-08-27T11:28:54.544581+0000","last_fullsized":"2023-08-27T11:28:54.544581+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:17.454243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127527+0000","last_change":"2023-08-27T11:28:52.959156+0000","last_active":"2023-08-27T11:28:54.127527+0000","last_peered":"2023-08-27T11:28:54.127527+0000","last_clean":"2023-08-27T11:28:54.127527+0000","last_became_active":"2023-08-27T11:28:52.958808+0000","last_became_peered":"2023-08-27T11:28:52.958808+0000","last_unstale":"2023-08-27T11:28:54.127527+0000","last_undegraded":"2023-08-27T11:28:54.127527+0000","last_fullsized":"2023-08-27T11:28:54.127527+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:28.646510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543832+0000","last_change":"2023-08-27T11:28:36.036171+0000","last_active":"2023-08-27T11:28:54.543832+0000","last_peered":"2023-08-27T11:28:54.543832+0000","last_clean":"2023-08-27T11:28:54.543832+0000","last_became_active":"2023-08-27T11:28:36.035804+0000","last_became_peered":"2023-08-27T11:28:36.035804+0000","last_unstale":"2023-08-27T11:28:54.543832+0000","last_undegraded":"2023-08-27T11:28:54.543832+0000","last_fullsized":"2023-08-27T11:28:54.543832+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:54:18.370265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127267+0000","last_change":"2023-08-27T11:28:52.962341+0000","last_active":"2023-08-27T11:28:54.127267+0000","last_peered":"2023-08-27T11:28:54.127267+0000","last_clean":"2023-08-27T11:28:54.127267+0000","last_became_active":"2023-08-27T11:28:52.960517+0000","last_became_peered":"2023-08-27T11:28:52.960517+0000","last_unstale":"2023-08-27T11:28:54.127267+0000","last_undegraded":"2023-08-27T11:28:54.127267+0000","last_fullsized":"2023-08-27T11:28:54.127267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:45:51.060085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944592+0000","last_change":"2023-08-27T11:28:36.028752+0000","last_active":"2023-08-27T11:28:53.944592+0000","last_peered":"2023-08-27T11:28:53.944592+0000","last_clean":"2023-08-27T11:28:53.944592+0000","last_became_active":"2023-08-27T11:28:36.028448+0000","last_became_peered":"2023-08-27T11:28:36.028448+0000","last_unstale":"2023-08-27T11:28:53.944592+0000","last_undegraded":"2023-08-27T11:28:53.944592+0000","last_fullsized":"2023-08-27T11:28:53.944592+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:36:48.381266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167303+0000","last_change":"2023-08-27T11:28:52.954147+0000","last_active":"2023-08-27T11:28:54.167303+0000","last_peered":"2023-08-27T11:28:54.167303+0000","last_clean":"2023-08-27T11:28:54.167303+0000","last_became_active":"2023-08-27T11:28:52.953813+0000","last_became_peered":"2023-08-27T11:28:52.953813+0000","last_unstale":"2023-08-27T11:28:54.167303+0000","last_undegraded":"2023-08-27T11:28:54.167303+0000","last_fullsized":"2023-08-27T11:28:54.167303+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:41.864976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543579+0000","last_change":"2023-08-27T11:28:36.027534+0000","last_active":"2023-08-27T11:28:54.543579+0000","last_peered":"2023-08-27T11:28:54.543579+0000","last_clean":"2023-08-27T11:28:54.543579+0000","last_became_active":"2023-08-27T11:28:36.027208+0000","last_became_peered":"2023-08-27T11:28:36.027208+0000","last_unstale":"2023-08-27T11:28:54.543579+0000","last_undegraded":"2023-08-27T11:28:54.543579+0000","last_fullsized":"2023-08-27T11:28:54.543579+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:53.678799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542817+0000","last_change":"2023-08-27T11:28:52.954320+0000","last_active":"2023-08-27T11:28:54.542817+0000","last_peered":"2023-08-27T11:28:54.542817+0000","last_clean":"2023-08-27T11:28:54.542817+0000","last_became_active":"2023-08-27T11:28:52.953989+0000","last_became_peered":"2023-08-27T11:28:52.953989+0000","last_unstale":"2023-08-27T11:28:54.542817+0000","last_undegraded":"2023-08-27T11:28:54.542817+0000","last_fullsized":"2023-08-27T11:28:54.542817+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:57.664067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542933+0000","last_change":"2023-08-27T11:28:36.029470+0000","last_active":"2023-08-27T11:28:54.542933+0000","last_peered":"2023-08-27T11:28:54.542933+0000","last_clean":"2023-08-27T11:28:54.542933+0000","last_became_active":"2023-08-27T11:28:36.028657+0000","last_became_peered":"2023-08-27T11:28:36.028657+0000","last_unstale":"2023-08-27T11:28:54.542933+0000","last_undegraded":"2023-08-27T11:28:54.542933+0000","last_fullsized":"2023-08-27T11:28:54.542933+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:04.796015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543579+0000","last_change":"2023-08-27T11:28:52.953855+0000","last_active":"2023-08-27T11:28:54.543579+0000","last_peered":"2023-08-27T11:28:54.543579+0000","last_clean":"2023-08-27T11:28:54.543579+0000","last_became_active":"2023-08-27T11:28:52.953186+0000","last_became_peered":"2023-08-27T11:28:52.953186+0000","last_unstale":"2023-08-27T11:28:54.543579+0000","last_undegraded":"2023-08-27T11:28:54.543579+0000","last_fullsized":"2023-08-27T11:28:54.543579+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:51:40.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542638+0000","last_change":"2023-08-27T11:28:36.032791+0000","last_active":"2023-08-27T11:28:54.542638+0000","last_peered":"2023-08-27T11:28:54.542638+0000","last_clean":"2023-08-27T11:28:54.542638+0000","last_became_active":"2023-08-27T11:28:36.032496+0000","last_became_peered":"2023-08-27T11:28:36.032496+0000","last_unstale":"2023-08-27T11:28:54.542638+0000","last_undegraded":"2023-08-27T11:28:54.542638+0000","last_fullsized":"2023-08-27T11:28:54.542638+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:01.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938511+0000","last_change":"2023-08-27T11:28:52.956303+0000","last_active":"2023-08-27T11:28:53.938511+0000","last_peered":"2023-08-27T11:28:53.938511+0000","last_clean":"2023-08-27T11:28:53.938511+0000","last_became_active":"2023-08-27T11:28:52.955766+0000","last_became_peered":"2023-08-27T11:28:52.955766+0000","last_unstale":"2023-08-27T11:28:53.938511+0000","last_undegraded":"2023-08-27T11:28:53.938511+0000","last_fullsized":"2023-08-27T11:28:53.938511+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:08.162719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943858+0000","last_change":"2023-08-27T11:28:36.036286+0000","last_active":"2023-08-27T11:28:53.943858+0000","last_peered":"2023-08-27T11:28:53.943858+0000","last_clean":"2023-08-27T11:28:53.943858+0000","last_became_active":"2023-08-27T11:28:36.036000+0000","last_became_peered":"2023-08-27T11:28:36.036000+0000","last_unstale":"2023-08-27T11:28:53.943858+0000","last_undegraded":"2023-08-27T11:28:53.943858+0000","last_fullsized":"2023-08-27T11:28:53.943858+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:12:24.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943719+0000","last_change":"2023-08-27T11:28:52.953416+0000","last_active":"2023-08-27T11:28:53.943719+0000","last_peered":"2023-08-27T11:28:53.943719+0000","last_clean":"2023-08-27T11:28:53.943719+0000","last_became_active":"2023-08-27T11:28:52.953155+0000","last_became_peered":"2023-08-27T11:28:52.953155+0000","last_unstale":"2023-08-27T11:28:53.943719+0000","last_undegraded":"2023-08-27T11:28:53.943719+0000","last_fullsized":"2023-08-27T11:28:53.943719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:59.775537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126881+0000","last_change":"2023-08-27T11:28:52.113283+0000","last_active":"2023-08-27T11:28:54.126881+0000","last_peered":"2023-08-27T11:28:54.126881+0000","last_clean":"2023-08-27T11:28:54.126881+0000","last_became_active":"2023-08-27T11:28:52.111763+0000","last_became_peered":"2023-08-27T11:28:52.111763+0000","last_unstale":"2023-08-27T11:28:54.126881+0000","last_undegraded":"2023-08-27T11:28:54.126881+0000","last_fullsized":"2023-08-27T11:28:54.126881+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:40.784729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543078+0000","last_change":"2023-08-27T11:28:36.034952+0000","last_active":"2023-08-27T11:28:54.543078+0000","last_peered":"2023-08-27T11:28:54.543078+0000","last_clean":"2023-08-27T11:28:54.543078+0000","last_became_active":"2023-08-27T11:28:36.034648+0000","last_became_peered":"2023-08-27T11:28:36.034648+0000","last_unstale":"2023-08-27T11:28:54.543078+0000","last_undegraded":"2023-08-27T11:28:54.543078+0000","last_fullsized":"2023-08-27T11:28:54.543078+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:09.974932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"123'4","reported_seq":25,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545530+0000","last_change":"2023-08-27T11:28:35.006568+0000","last_active":"2023-08-27T11:28:54.545530+0000","last_peered":"2023-08-27T11:28:54.545530+0000","last_clean":"2023-08-27T11:28:54.545530+0000","last_became_active":"2023-08-27T11:28:35.006280+0000","last_became_peered":"2023-08-27T11:28:35.006280+0000","last_unstale":"2023-08-27T11:28:54.545530+0000","last_undegraded":"2023-08-27T11:28:54.545530+0000","last_fullsized":"2023-08-27T11:28:54.545530+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:56:23.107984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127038+0000","last_change":"2023-08-27T11:28:52.959436+0000","last_active":"2023-08-27T11:28:54.127038+0000","last_peered":"2023-08-27T11:28:54.127038+0000","last_clean":"2023-08-27T11:28:54.127038+0000","last_became_active":"2023-08-27T11:28:52.959095+0000","last_became_peered":"2023-08-27T11:28:52.959095+0000","last_unstale":"2023-08-27T11:28:54.127038+0000","last_undegraded":"2023-08-27T11:28:54.127038+0000","last_fullsized":"2023-08-27T11:28:54.127038+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:06:49.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167226+0000","last_change":"2023-08-27T11:28:52.105198+0000","last_active":"2023-08-27T11:28:54.167226+0000","last_peered":"2023-08-27T11:28:54.167226+0000","last_clean":"2023-08-27T11:28:54.167226+0000","last_became_active":"2023-08-27T11:28:52.104869+0000","last_became_peered":"2023-08-27T11:28:52.104869+0000","last_unstale":"2023-08-27T11:28:54.167226+0000","last_undegraded":"2023-08-27T11:28:54.167226+0000","last_fullsized":"2023-08-27T11:28:54.167226+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:12:37.714190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938036+0000","last_change":"2023-08-27T11:28:36.021627+0000","last_active":"2023-08-27T11:28:53.938036+0000","last_peered":"2023-08-27T11:28:53.938036+0000","last_clean":"2023-08-27T11:28:53.938036+0000","last_became_active":"2023-08-27T11:28:36.021354+0000","last_became_peered":"2023-08-27T11:28:36.021354+0000","last_unstale":"2023-08-27T11:28:53.938036+0000","last_undegraded":"2023-08-27T11:28:53.938036+0000","last_fullsized":"2023-08-27T11:28:53.938036+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:05:34.719477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168488+0000","last_change":"2023-08-27T11:28:35.011425+0000","last_active":"2023-08-27T11:28:54.168488+0000","last_peered":"2023-08-27T11:28:54.168488+0000","last_clean":"2023-08-27T11:28:54.168488+0000","last_became_active":"2023-08-27T11:28:35.011116+0000","last_became_peered":"2023-08-27T11:28:35.011116+0000","last_unstale":"2023-08-27T11:28:54.168488+0000","last_undegraded":"2023-08-27T11:28:54.168488+0000","last_fullsized":"2023-08-27T11:28:54.168488+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:40.024589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943576+0000","last_change":"2023-08-27T11:28:52.953635+0000","last_active":"2023-08-27T11:28:53.943576+0000","last_peered":"2023-08-27T11:28:53.943576+0000","last_clean":"2023-08-27T11:28:53.943576+0000","last_became_active":"2023-08-27T11:28:52.953341+0000","last_became_peered":"2023-08-27T11:28:52.953341+0000","last_unstale":"2023-08-27T11:28:53.943576+0000","last_undegraded":"2023-08-27T11:28:53.943576+0000","last_fullsized":"2023-08-27T11:28:53.943576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:44.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543954+0000","last_change":"2023-08-27T11:28:52.109813+0000","last_active":"2023-08-27T11:28:54.543954+0000","last_peered":"2023-08-27T11:28:54.543954+0000","last_clean":"2023-08-27T11:28:54.543954+0000","last_became_active":"2023-08-27T11:28:52.108877+0000","last_became_peered":"2023-08-27T11:28:52.108877+0000","last_unstale":"2023-08-27T11:28:54.543954+0000","last_undegraded":"2023-08-27T11:28:54.543954+0000","last_fullsized":"2023-08-27T11:28:54.543954+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:30.551128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126981+0000","last_change":"2023-08-27T11:28:36.031467+0000","last_active":"2023-08-27T11:28:54.126981+0000","last_peered":"2023-08-27T11:28:54.126981+0000","last_clean":"2023-08-27T11:28:54.126981+0000","last_became_active":"2023-08-27T11:28:36.031196+0000","last_became_peered":"2023-08-27T11:28:36.031196+0000","last_unstale":"2023-08-27T11:28:54.126981+0000","last_undegraded":"2023-08-27T11:28:54.126981+0000","last_fullsized":"2023-08-27T11:28:54.126981+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:11:40.633224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544001+0000","last_change":"2023-08-27T11:28:35.019493+0000","last_active":"2023-08-27T11:28:54.544001+0000","last_peered":"2023-08-27T11:28:54.544001+0000","last_clean":"2023-08-27T11:28:54.544001+0000","last_became_active":"2023-08-27T11:28:35.019259+0000","last_became_peered":"2023-08-27T11:28:35.019259+0000","last_unstale":"2023-08-27T11:28:54.544001+0000","last_undegraded":"2023-08-27T11:28:54.544001+0000","last_fullsized":"2023-08-27T11:28:54.544001+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:31.949031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542764+0000","last_change":"2023-08-27T11:28:52.959630+0000","last_active":"2023-08-27T11:28:54.542764+0000","last_peered":"2023-08-27T11:28:54.542764+0000","last_clean":"2023-08-27T11:28:54.542764+0000","last_became_active":"2023-08-27T11:28:52.959190+0000","last_became_peered":"2023-08-27T11:28:52.959190+0000","last_unstale":"2023-08-27T11:28:54.542764+0000","last_undegraded":"2023-08-27T11:28:54.542764+0000","last_fullsized":"2023-08-27T11:28:54.542764+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:05:25.147670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167638+0000","last_change":"2023-08-27T11:28:52.107641+0000","last_active":"2023-08-27T11:28:54.167638+0000","last_peered":"2023-08-27T11:28:54.167638+0000","last_clean":"2023-08-27T11:28:54.167638+0000","last_became_active":"2023-08-27T11:28:52.107345+0000","last_became_peered":"2023-08-27T11:28:52.107345+0000","last_unstale":"2023-08-27T11:28:54.167638+0000","last_undegraded":"2023-08-27T11:28:54.167638+0000","last_fullsized":"2023-08-27T11:28:54.167638+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:39.603250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938380+0000","last_change":"2023-08-27T11:28:36.032795+0000","last_active":"2023-08-27T11:28:53.938380+0000","last_peered":"2023-08-27T11:28:53.938380+0000","last_clean":"2023-08-27T11:28:53.938380+0000","last_became_active":"2023-08-27T11:28:36.032518+0000","last_became_peered":"2023-08-27T11:28:36.032518+0000","last_unstale":"2023-08-27T11:28:53.938380+0000","last_undegraded":"2023-08-27T11:28:53.938380+0000","last_fullsized":"2023-08-27T11:28:53.938380+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:20:50.856976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543055+0000","last_change":"2023-08-27T11:28:35.010966+0000","last_active":"2023-08-27T11:28:54.543055+0000","last_peered":"2023-08-27T11:28:54.543055+0000","last_clean":"2023-08-27T11:28:54.543055+0000","last_became_active":"2023-08-27T11:28:35.010653+0000","last_became_peered":"2023-08-27T11:28:35.010653+0000","last_unstale":"2023-08-27T11:28:54.543055+0000","last_undegraded":"2023-08-27T11:28:54.543055+0000","last_fullsized":"2023-08-27T11:28:54.543055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:25:46.537540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543937+0000","last_change":"2023-08-27T11:28:52.969287+0000","last_active":"2023-08-27T11:28:54.543937+0000","last_peered":"2023-08-27T11:28:54.543937+0000","last_clean":"2023-08-27T11:28:54.543937+0000","last_became_active":"2023-08-27T11:28:52.969003+0000","last_became_peered":"2023-08-27T11:28:52.969003+0000","last_unstale":"2023-08-27T11:28:54.543937+0000","last_undegraded":"2023-08-27T11:28:54.543937+0000","last_fullsized":"2023-08-27T11:28:54.543937+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:47.450318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543621+0000","last_change":"2023-08-27T11:28:52.118520+0000","last_active":"2023-08-27T11:28:54.543621+0000","last_peered":"2023-08-27T11:28:54.543621+0000","last_clean":"2023-08-27T11:28:54.543621+0000","last_became_active":"2023-08-27T11:28:52.118225+0000","last_became_peered":"2023-08-27T11:28:52.118225+0000","last_unstale":"2023-08-27T11:28:54.543621+0000","last_undegraded":"2023-08-27T11:28:54.543621+0000","last_fullsized":"2023-08-27T11:28:54.543621+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:13:57.315234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544239+0000","last_change":"2023-08-27T11:28:36.032681+0000","last_active":"2023-08-27T11:28:54.544239+0000","last_peered":"2023-08-27T11:28:54.544239+0000","last_clean":"2023-08-27T11:28:54.544239+0000","last_became_active":"2023-08-27T11:28:36.032386+0000","last_became_peered":"2023-08-27T11:28:36.032386+0000","last_unstale":"2023-08-27T11:28:54.544239+0000","last_undegraded":"2023-08-27T11:28:54.544239+0000","last_fullsized":"2023-08-27T11:28:54.544239+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:19.799417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544428+0000","last_change":"2023-08-27T11:28:35.013728+0000","last_active":"2023-08-27T11:28:54.544428+0000","last_peered":"2023-08-27T11:28:54.544428+0000","last_clean":"2023-08-27T11:28:54.544428+0000","last_became_active":"2023-08-27T11:28:35.013321+0000","last_became_peered":"2023-08-27T11:28:35.013321+0000","last_unstale":"2023-08-27T11:28:54.544428+0000","last_undegraded":"2023-08-27T11:28:54.544428+0000","last_fullsized":"2023-08-27T11:28:54.544428+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:02.568722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543470+0000","last_change":"2023-08-27T11:28:52.969271+0000","last_active":"2023-08-27T11:28:54.543470+0000","last_peered":"2023-08-27T11:28:54.543470+0000","last_clean":"2023-08-27T11:28:54.543470+0000","last_became_active":"2023-08-27T11:28:52.968884+0000","last_became_peered":"2023-08-27T11:28:52.968884+0000","last_unstale":"2023-08-27T11:28:54.543470+0000","last_undegraded":"2023-08-27T11:28:54.543470+0000","last_fullsized":"2023-08-27T11:28:54.543470+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:44:25.044979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944656+0000","last_change":"2023-08-27T11:28:52.111044+0000","last_active":"2023-08-27T11:28:53.944656+0000","last_peered":"2023-08-27T11:28:53.944656+0000","last_clean":"2023-08-27T11:28:53.944656+0000","last_became_active":"2023-08-27T11:28:52.110543+0000","last_became_peered":"2023-08-27T11:28:52.110543+0000","last_unstale":"2023-08-27T11:28:53.944656+0000","last_undegraded":"2023-08-27T11:28:53.944656+0000","last_fullsized":"2023-08-27T11:28:53.944656+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:01:19.667556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544740+0000","last_change":"2023-08-27T11:28:36.025498+0000","last_active":"2023-08-27T11:28:54.544740+0000","last_peered":"2023-08-27T11:28:54.544740+0000","last_clean":"2023-08-27T11:28:54.544740+0000","last_became_active":"2023-08-27T11:28:36.024956+0000","last_became_peered":"2023-08-27T11:28:36.024956+0000","last_unstale":"2023-08-27T11:28:54.544740+0000","last_undegraded":"2023-08-27T11:28:54.544740+0000","last_fullsized":"2023-08-27T11:28:54.544740+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:20:49.772712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168380+0000","last_change":"2023-08-27T11:28:35.011910+0000","last_active":"2023-08-27T11:28:54.168380+0000","last_peered":"2023-08-27T11:28:54.168380+0000","last_clean":"2023-08-27T11:28:54.168380+0000","last_became_active":"2023-08-27T11:28:35.011496+0000","last_became_peered":"2023-08-27T11:28:35.011496+0000","last_unstale":"2023-08-27T11:28:54.168380+0000","last_undegraded":"2023-08-27T11:28:54.168380+0000","last_fullsized":"2023-08-27T11:28:54.168380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:39:52.670343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944368+0000","last_change":"2023-08-27T11:28:52.970908+0000","last_active":"2023-08-27T11:28:53.944368+0000","last_peered":"2023-08-27T11:28:53.944368+0000","last_clean":"2023-08-27T11:28:53.944368+0000","last_became_active":"2023-08-27T11:28:52.970604+0000","last_became_peered":"2023-08-27T11:28:52.970604+0000","last_unstale":"2023-08-27T11:28:53.944368+0000","last_undegraded":"2023-08-27T11:28:53.944368+0000","last_fullsized":"2023-08-27T11:28:53.944368+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:18:36.896383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"127'4","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168517+0000","last_change":"2023-08-27T11:28:52.108195+0000","last_active":"2023-08-27T11:28:54.168517+0000","last_peered":"2023-08-27T11:28:54.168517+0000","last_clean":"2023-08-27T11:28:54.168517+0000","last_became_active":"2023-08-27T11:28:52.107884+0000","last_became_peered":"2023-08-27T11:28:52.107884+0000","last_unstale":"2023-08-27T11:28:54.168517+0000","last_undegraded":"2023-08-27T11:28:54.168517+0000","last_fullsized":"2023-08-27T11:28:54.168517+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:03:14.694373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168002+0000","last_change":"2023-08-27T11:28:36.034683+0000","last_active":"2023-08-27T11:28:54.168002+0000","last_peered":"2023-08-27T11:28:54.168002+0000","last_clean":"2023-08-27T11:28:54.168002+0000","last_became_active":"2023-08-27T11:28:36.034353+0000","last_became_peered":"2023-08-27T11:28:36.034353+0000","last_unstale":"2023-08-27T11:28:54.168002+0000","last_undegraded":"2023-08-27T11:28:54.168002+0000","last_fullsized":"2023-08-27T11:28:54.168002+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:43:04.796015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943448+0000","last_change":"2023-08-27T11:28:35.016692+0000","last_active":"2023-08-27T11:28:53.943448+0000","last_peered":"2023-08-27T11:28:53.943448+0000","last_clean":"2023-08-27T11:28:53.943448+0000","last_became_active":"2023-08-27T11:28:35.016279+0000","last_became_peered":"2023-08-27T11:28:35.016279+0000","last_unstale":"2023-08-27T11:28:53.943448+0000","last_undegraded":"2023-08-27T11:28:53.943448+0000","last_fullsized":"2023-08-27T11:28:53.943448+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944823+0000","last_change":"2023-08-27T11:28:52.961569+0000","last_active":"2023-08-27T11:28:53.944823+0000","last_peered":"2023-08-27T11:28:53.944823+0000","last_clean":"2023-08-27T11:28:53.944823+0000","last_became_active":"2023-08-27T11:28:52.961282+0000","last_became_peered":"2023-08-27T11:28:52.961282+0000","last_unstale":"2023-08-27T11:28:53.944823+0000","last_undegraded":"2023-08-27T11:28:53.944823+0000","last_fullsized":"2023-08-27T11:28:53.944823+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:21:06.869678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544661+0000","last_change":"2023-08-27T11:28:52.117536+0000","last_active":"2023-08-27T11:28:54.544661+0000","last_peered":"2023-08-27T11:28:54.544661+0000","last_clean":"2023-08-27T11:28:54.544661+0000","last_became_active":"2023-08-27T11:28:52.117216+0000","last_became_peered":"2023-08-27T11:28:52.117216+0000","last_unstale":"2023-08-27T11:28:54.544661+0000","last_undegraded":"2023-08-27T11:28:54.544661+0000","last_fullsized":"2023-08-27T11:28:54.544661+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:14.628060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543661+0000","last_change":"2023-08-27T11:28:36.035634+0000","last_active":"2023-08-27T11:28:54.543661+0000","last_peered":"2023-08-27T11:28:54.543661+0000","last_clean":"2023-08-27T11:28:54.543661+0000","last_became_active":"2023-08-27T11:28:36.035256+0000","last_became_peered":"2023-08-27T11:28:36.035256+0000","last_unstale":"2023-08-27T11:28:54.543661+0000","last_undegraded":"2023-08-27T11:28:54.543661+0000","last_fullsized":"2023-08-27T11:28:54.543661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:53:15.473061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542084+0000","last_change":"2023-08-27T11:28:35.005894+0000","last_active":"2023-08-27T11:28:54.542084+0000","last_peered":"2023-08-27T11:28:54.542084+0000","last_clean":"2023-08-27T11:28:54.542084+0000","last_became_active":"2023-08-27T11:28:35.005541+0000","last_became_peered":"2023-08-27T11:28:35.005541+0000","last_unstale":"2023-08-27T11:28:54.542084+0000","last_undegraded":"2023-08-27T11:28:54.542084+0000","last_fullsized":"2023-08-27T11:28:54.542084+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:44.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543264+0000","last_change":"2023-08-27T11:28:52.968302+0000","last_active":"2023-08-27T11:28:54.543264+0000","last_peered":"2023-08-27T11:28:54.543264+0000","last_clean":"2023-08-27T11:28:54.543264+0000","last_became_active":"2023-08-27T11:28:52.968028+0000","last_became_peered":"2023-08-27T11:28:52.968028+0000","last_unstale":"2023-08-27T11:28:54.543264+0000","last_undegraded":"2023-08-27T11:28:54.543264+0000","last_fullsized":"2023-08-27T11:28:54.543264+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:11:56.495239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944017+0000","last_change":"2023-08-27T11:28:52.115386+0000","last_active":"2023-08-27T11:28:53.944017+0000","last_peered":"2023-08-27T11:28:53.944017+0000","last_clean":"2023-08-27T11:28:53.944017+0000","last_became_active":"2023-08-27T11:28:52.115108+0000","last_became_peered":"2023-08-27T11:28:52.115108+0000","last_unstale":"2023-08-27T11:28:53.944017+0000","last_undegraded":"2023-08-27T11:28:53.944017+0000","last_fullsized":"2023-08-27T11:28:53.944017+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:28.769523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.541897+0000","last_change":"2023-08-27T11:28:36.013300+0000","last_active":"2023-08-27T11:28:54.541897+0000","last_peered":"2023-08-27T11:28:54.541897+0000","last_clean":"2023-08-27T11:28:54.541897+0000","last_became_active":"2023-08-27T11:28:36.012993+0000","last_became_peered":"2023-08-27T11:28:36.012993+0000","last_unstale":"2023-08-27T11:28:54.541897+0000","last_undegraded":"2023-08-27T11:28:54.541897+0000","last_fullsized":"2023-08-27T11:28:54.541897+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:23.512873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127888+0000","last_change":"2023-08-27T11:28:35.010824+0000","last_active":"2023-08-27T11:28:54.127888+0000","last_peered":"2023-08-27T11:28:54.127888+0000","last_clean":"2023-08-27T11:28:54.127888+0000","last_became_active":"2023-08-27T11:28:35.010499+0000","last_became_peered":"2023-08-27T11:28:35.010499+0000","last_unstale":"2023-08-27T11:28:54.127888+0000","last_undegraded":"2023-08-27T11:28:54.127888+0000","last_fullsized":"2023-08-27T11:28:54.127888+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:43.912232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943423+0000","last_change":"2023-08-27T11:28:52.961598+0000","last_active":"2023-08-27T11:28:53.943423+0000","last_peered":"2023-08-27T11:28:53.943423+0000","last_clean":"2023-08-27T11:28:53.943423+0000","last_became_active":"2023-08-27T11:28:52.961290+0000","last_became_peered":"2023-08-27T11:28:52.961290+0000","last_unstale":"2023-08-27T11:28:53.943423+0000","last_undegraded":"2023-08-27T11:28:53.943423+0000","last_fullsized":"2023-08-27T11:28:53.943423+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:37.452054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543213+0000","last_change":"2023-08-27T11:28:52.109586+0000","last_active":"2023-08-27T11:28:54.543213+0000","last_peered":"2023-08-27T11:28:54.543213+0000","last_clean":"2023-08-27T11:28:54.543213+0000","last_became_active":"2023-08-27T11:28:52.108535+0000","last_became_peered":"2023-08-27T11:28:52.108535+0000","last_unstale":"2023-08-27T11:28:54.543213+0000","last_undegraded":"2023-08-27T11:28:54.543213+0000","last_fullsized":"2023-08-27T11:28:54.543213+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:27.130335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542769+0000","last_change":"2023-08-27T11:28:36.037732+0000","last_active":"2023-08-27T11:28:54.542769+0000","last_peered":"2023-08-27T11:28:54.542769+0000","last_clean":"2023-08-27T11:28:54.542769+0000","last_became_active":"2023-08-27T11:28:36.031618+0000","last_became_peered":"2023-08-27T11:28:36.031618+0000","last_unstale":"2023-08-27T11:28:54.542769+0000","last_undegraded":"2023-08-27T11:28:54.542769+0000","last_fullsized":"2023-08-27T11:28:54.542769+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:47:27.683116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544637+0000","last_change":"2023-08-27T11:28:35.011526+0000","last_active":"2023-08-27T11:28:54.544637+0000","last_peered":"2023-08-27T11:28:54.544637+0000","last_clean":"2023-08-27T11:28:54.544637+0000","last_became_active":"2023-08-27T11:28:35.011255+0000","last_became_peered":"2023-08-27T11:28:35.011255+0000","last_unstale":"2023-08-27T11:28:54.544637+0000","last_undegraded":"2023-08-27T11:28:54.544637+0000","last_fullsized":"2023-08-27T11:28:54.544637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:45:34.533849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543769+0000","last_change":"2023-08-27T11:28:52.973023+0000","last_active":"2023-08-27T11:28:54.543769+0000","last_peered":"2023-08-27T11:28:54.543769+0000","last_clean":"2023-08-27T11:28:54.543769+0000","last_became_active":"2023-08-27T11:28:52.972708+0000","last_became_peered":"2023-08-27T11:28:52.972708+0000","last_unstale":"2023-08-27T11:28:54.543769+0000","last_undegraded":"2023-08-27T11:28:54.543769+0000","last_fullsized":"2023-08-27T11:28:54.543769+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:12.899801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944416+0000","last_change":"2023-08-27T11:28:52.113775+0000","last_active":"2023-08-27T11:28:53.944416+0000","last_peered":"2023-08-27T11:28:53.944416+0000","last_clean":"2023-08-27T11:28:53.944416+0000","last_became_active":"2023-08-27T11:28:52.113503+0000","last_became_peered":"2023-08-27T11:28:52.113503+0000","last_unstale":"2023-08-27T11:28:53.944416+0000","last_undegraded":"2023-08-27T11:28:53.944416+0000","last_fullsized":"2023-08-27T11:28:53.944416+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:45:39.603250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543537+0000","last_change":"2023-08-27T11:28:36.035453+0000","last_active":"2023-08-27T11:28:54.543537+0000","last_peered":"2023-08-27T11:28:54.543537+0000","last_clean":"2023-08-27T11:28:54.543537+0000","last_became_active":"2023-08-27T11:28:36.035166+0000","last_became_peered":"2023-08-27T11:28:36.035166+0000","last_unstale":"2023-08-27T11:28:54.543537+0000","last_undegraded":"2023-08-27T11:28:54.543537+0000","last_fullsized":"2023-08-27T11:28:54.543537+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:42:32.278155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"123'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.945156+0000","last_change":"2023-08-27T11:28:35.016501+0000","last_active":"2023-08-27T11:28:53.945156+0000","last_peered":"2023-08-27T11:28:53.945156+0000","last_clean":"2023-08-27T11:28:53.945156+0000","last_became_active":"2023-08-27T11:28:35.014453+0000","last_became_peered":"2023-08-27T11:28:35.014453+0000","last_unstale":"2023-08-27T11:28:53.945156+0000","last_undegraded":"2023-08-27T11:28:53.945156+0000","last_fullsized":"2023-08-27T11:28:53.945156+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:16.723874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943616+0000","last_change":"2023-08-27T11:28:52.964656+0000","last_active":"2023-08-27T11:28:53.943616+0000","last_peered":"2023-08-27T11:28:53.943616+0000","last_clean":"2023-08-27T11:28:53.943616+0000","last_became_active":"2023-08-27T11:28:52.964358+0000","last_became_peered":"2023-08-27T11:28:52.964358+0000","last_unstale":"2023-08-27T11:28:53.943616+0000","last_undegraded":"2023-08-27T11:28:53.943616+0000","last_fullsized":"2023-08-27T11:28:53.943616+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:02:02.715971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543526+0000","last_change":"2023-08-27T11:28:52.111349+0000","last_active":"2023-08-27T11:28:54.543526+0000","last_peered":"2023-08-27T11:28:54.543526+0000","last_clean":"2023-08-27T11:28:54.543526+0000","last_became_active":"2023-08-27T11:28:52.111065+0000","last_became_peered":"2023-08-27T11:28:52.111065+0000","last_unstale":"2023-08-27T11:28:54.543526+0000","last_undegraded":"2023-08-27T11:28:54.543526+0000","last_fullsized":"2023-08-27T11:28:54.543526+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:53:32.779494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944513+0000","last_change":"2023-08-27T11:28:36.031284+0000","last_active":"2023-08-27T11:28:53.944513+0000","last_peered":"2023-08-27T11:28:53.944513+0000","last_clean":"2023-08-27T11:28:53.944513+0000","last_became_active":"2023-08-27T11:28:36.031015+0000","last_became_peered":"2023-08-27T11:28:36.031015+0000","last_unstale":"2023-08-27T11:28:53.944513+0000","last_undegraded":"2023-08-27T11:28:53.944513+0000","last_fullsized":"2023-08-27T11:28:53.944513+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:13:45.630236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168519+0000","last_change":"2023-08-27T11:28:35.011409+0000","last_active":"2023-08-27T11:28:54.168519+0000","last_peered":"2023-08-27T11:28:54.168519+0000","last_clean":"2023-08-27T11:28:54.168519+0000","last_became_active":"2023-08-27T11:28:35.011089+0000","last_became_peered":"2023-08-27T11:28:35.011089+0000","last_unstale":"2023-08-27T11:28:54.168519+0000","last_undegraded":"2023-08-27T11:28:54.168519+0000","last_fullsized":"2023-08-27T11:28:54.168519+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:41:16.445787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127423+0000","last_change":"2023-08-27T11:28:52.962152+0000","last_active":"2023-08-27T11:28:54.127423+0000","last_peered":"2023-08-27T11:28:54.127423+0000","last_clean":"2023-08-27T11:28:54.127423+0000","last_became_active":"2023-08-27T11:28:52.960175+0000","last_became_peered":"2023-08-27T11:28:52.960175+0000","last_unstale":"2023-08-27T11:28:54.127423+0000","last_undegraded":"2023-08-27T11:28:54.127423+0000","last_fullsized":"2023-08-27T11:28:54.127423+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:30:34.934972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944976+0000","last_change":"2023-08-27T11:28:52.107495+0000","last_active":"2023-08-27T11:28:53.944976+0000","last_peered":"2023-08-27T11:28:53.944976+0000","last_clean":"2023-08-27T11:28:53.944976+0000","last_became_active":"2023-08-27T11:28:52.107015+0000","last_became_peered":"2023-08-27T11:28:52.107015+0000","last_unstale":"2023-08-27T11:28:53.944976+0000","last_undegraded":"2023-08-27T11:28:53.944976+0000","last_fullsized":"2023-08-27T11:28:53.944976+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:46:41.277306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168474+0000","last_change":"2023-08-27T11:28:36.003840+0000","last_active":"2023-08-27T11:28:54.168474+0000","last_peered":"2023-08-27T11:28:54.168474+0000","last_clean":"2023-08-27T11:28:54.168474+0000","last_became_active":"2023-08-27T11:28:36.003484+0000","last_became_peered":"2023-08-27T11:28:36.003484+0000","last_unstale":"2023-08-27T11:28:54.168474+0000","last_undegraded":"2023-08-27T11:28:54.168474+0000","last_fullsized":"2023-08-27T11:28:54.168474+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:07:53.828122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544472+0000","last_change":"2023-08-27T11:28:35.010794+0000","last_active":"2023-08-27T11:28:54.544472+0000","last_peered":"2023-08-27T11:28:54.544472+0000","last_clean":"2023-08-27T11:28:54.544472+0000","last_became_active":"2023-08-27T11:28:35.010467+0000","last_became_peered":"2023-08-27T11:28:35.010467+0000","last_unstale":"2023-08-27T11:28:54.544472+0000","last_undegraded":"2023-08-27T11:28:54.544472+0000","last_fullsized":"2023-08-27T11:28:54.544472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:25.030981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127588+0000","last_change":"2023-08-27T11:28:52.966674+0000","last_active":"2023-08-27T11:28:54.127588+0000","last_peered":"2023-08-27T11:28:54.127588+0000","last_clean":"2023-08-27T11:28:54.127588+0000","last_became_active":"2023-08-27T11:28:52.965751+0000","last_became_peered":"2023-08-27T11:28:52.965751+0000","last_unstale":"2023-08-27T11:28:54.127588+0000","last_undegraded":"2023-08-27T11:28:54.127588+0000","last_fullsized":"2023-08-27T11:28:54.127588+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:44:26.015810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544367+0000","last_change":"2023-08-27T11:28:52.110521+0000","last_active":"2023-08-27T11:28:54.544367+0000","last_peered":"2023-08-27T11:28:54.544367+0000","last_clean":"2023-08-27T11:28:54.544367+0000","last_became_active":"2023-08-27T11:28:52.110145+0000","last_became_peered":"2023-08-27T11:28:52.110145+0000","last_unstale":"2023-08-27T11:28:54.544367+0000","last_undegraded":"2023-08-27T11:28:54.544367+0000","last_fullsized":"2023-08-27T11:28:54.544367+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:57.123422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.939109+0000","last_change":"2023-08-27T11:28:36.029240+0000","last_active":"2023-08-27T11:28:53.939109+0000","last_peered":"2023-08-27T11:28:53.939109+0000","last_clean":"2023-08-27T11:28:53.939109+0000","last_became_active":"2023-08-27T11:28:36.028966+0000","last_became_peered":"2023-08-27T11:28:36.028966+0000","last_unstale":"2023-08-27T11:28:53.939109+0000","last_undegraded":"2023-08-27T11:28:53.939109+0000","last_fullsized":"2023-08-27T11:28:53.939109+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:48:28.835205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938044+0000","last_change":"2023-08-27T11:28:35.009808+0000","last_active":"2023-08-27T11:28:53.938044+0000","last_peered":"2023-08-27T11:28:53.938044+0000","last_clean":"2023-08-27T11:28:53.938044+0000","last_became_active":"2023-08-27T11:28:35.009519+0000","last_became_peered":"2023-08-27T11:28:35.009519+0000","last_unstale":"2023-08-27T11:28:53.938044+0000","last_undegraded":"2023-08-27T11:28:53.938044+0000","last_fullsized":"2023-08-27T11:28:53.938044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:33:47.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543419+0000","last_change":"2023-08-27T11:28:52.970090+0000","last_active":"2023-08-27T11:28:54.543419+0000","last_peered":"2023-08-27T11:28:54.543419+0000","last_clean":"2023-08-27T11:28:54.543419+0000","last_became_active":"2023-08-27T11:28:52.969791+0000","last_became_peered":"2023-08-27T11:28:52.969791+0000","last_unstale":"2023-08-27T11:28:54.543419+0000","last_undegraded":"2023-08-27T11:28:54.543419+0000","last_fullsized":"2023-08-27T11:28:54.543419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:21.931456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938709+0000","last_change":"2023-08-27T11:28:52.112133+0000","last_active":"2023-08-27T11:28:53.938709+0000","last_peered":"2023-08-27T11:28:53.938709+0000","last_clean":"2023-08-27T11:28:53.938709+0000","last_became_active":"2023-08-27T11:28:52.111829+0000","last_became_peered":"2023-08-27T11:28:52.111829+0000","last_unstale":"2023-08-27T11:28:53.938709+0000","last_undegraded":"2023-08-27T11:28:53.938709+0000","last_fullsized":"2023-08-27T11:28:53.938709+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:32:13.011586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168368+0000","last_change":"2023-08-27T11:28:36.013853+0000","last_active":"2023-08-27T11:28:54.168368+0000","last_peered":"2023-08-27T11:28:54.168368+0000","last_clean":"2023-08-27T11:28:54.168368+0000","last_became_active":"2023-08-27T11:28:36.013326+0000","last_became_peered":"2023-08-27T11:28:36.013326+0000","last_unstale":"2023-08-27T11:28:54.168368+0000","last_undegraded":"2023-08-27T11:28:54.168368+0000","last_fullsized":"2023-08-27T11:28:54.168368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:47:27.852773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542914+0000","last_change":"2023-08-27T11:28:35.017152+0000","last_active":"2023-08-27T11:28:54.542914+0000","last_peered":"2023-08-27T11:28:54.542914+0000","last_clean":"2023-08-27T11:28:54.542914+0000","last_became_active":"2023-08-27T11:28:35.016826+0000","last_became_peered":"2023-08-27T11:28:35.016826+0000","last_unstale":"2023-08-27T11:28:54.542914+0000","last_undegraded":"2023-08-27T11:28:54.542914+0000","last_fullsized":"2023-08-27T11:28:54.542914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:01:40.116261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543337+0000","last_change":"2023-08-27T11:28:52.971264+0000","last_active":"2023-08-27T11:28:54.543337+0000","last_peered":"2023-08-27T11:28:54.543337+0000","last_clean":"2023-08-27T11:28:54.543337+0000","last_became_active":"2023-08-27T11:28:52.970571+0000","last_became_peered":"2023-08-27T11:28:52.970571+0000","last_unstale":"2023-08-27T11:28:54.543337+0000","last_undegraded":"2023-08-27T11:28:54.543337+0000","last_fullsized":"2023-08-27T11:28:54.543337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:42:36.500530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544829+0000","last_change":"2023-08-27T11:28:52.118194+0000","last_active":"2023-08-27T11:28:54.544829+0000","last_peered":"2023-08-27T11:28:54.544829+0000","last_clean":"2023-08-27T11:28:54.544829+0000","last_became_active":"2023-08-27T11:28:52.117803+0000","last_became_peered":"2023-08-27T11:28:52.117803+0000","last_unstale":"2023-08-27T11:28:54.544829+0000","last_undegraded":"2023-08-27T11:28:54.544829+0000","last_fullsized":"2023-08-27T11:28:54.544829+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:26:54.960443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127723+0000","last_change":"2023-08-27T11:28:36.028818+0000","last_active":"2023-08-27T11:28:54.127723+0000","last_peered":"2023-08-27T11:28:54.127723+0000","last_clean":"2023-08-27T11:28:54.127723+0000","last_became_active":"2023-08-27T11:28:36.028244+0000","last_became_peered":"2023-08-27T11:28:36.028244+0000","last_unstale":"2023-08-27T11:28:54.127723+0000","last_undegraded":"2023-08-27T11:28:54.127723+0000","last_fullsized":"2023-08-27T11:28:54.127723+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:03:27.529486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943075+0000","last_change":"2023-08-27T11:28:35.015618+0000","last_active":"2023-08-27T11:28:53.943075+0000","last_peered":"2023-08-27T11:28:53.943075+0000","last_clean":"2023-08-27T11:28:53.943075+0000","last_became_active":"2023-08-27T11:28:35.014705+0000","last_became_peered":"2023-08-27T11:28:35.014705+0000","last_unstale":"2023-08-27T11:28:53.943075+0000","last_undegraded":"2023-08-27T11:28:53.943075+0000","last_fullsized":"2023-08-27T11:28:53.943075+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:43.912232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943440+0000","last_change":"2023-08-27T11:28:52.955019+0000","last_active":"2023-08-27T11:28:53.943440+0000","last_peered":"2023-08-27T11:28:53.943440+0000","last_clean":"2023-08-27T11:28:53.943440+0000","last_became_active":"2023-08-27T11:28:52.954735+0000","last_became_peered":"2023-08-27T11:28:52.954735+0000","last_unstale":"2023-08-27T11:28:53.943440+0000","last_undegraded":"2023-08-27T11:28:53.943440+0000","last_fullsized":"2023-08-27T11:28:53.943440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:18.137793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127568+0000","last_change":"2023-08-27T11:28:52.113480+0000","last_active":"2023-08-27T11:28:54.127568+0000","last_peered":"2023-08-27T11:28:54.127568+0000","last_clean":"2023-08-27T11:28:54.127568+0000","last_became_active":"2023-08-27T11:28:52.112964+0000","last_became_peered":"2023-08-27T11:28:52.112964+0000","last_unstale":"2023-08-27T11:28:54.127568+0000","last_undegraded":"2023-08-27T11:28:54.127568+0000","last_fullsized":"2023-08-27T11:28:54.127568+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:50.221973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167327+0000","last_change":"2023-08-27T11:28:36.032846+0000","last_active":"2023-08-27T11:28:54.167327+0000","last_peered":"2023-08-27T11:28:54.167327+0000","last_clean":"2023-08-27T11:28:54.167327+0000","last_became_active":"2023-08-27T11:28:36.032564+0000","last_became_peered":"2023-08-27T11:28:36.032564+0000","last_unstale":"2023-08-27T11:28:54.167327+0000","last_undegraded":"2023-08-27T11:28:54.167327+0000","last_fullsized":"2023-08-27T11:28:54.167327+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:12.679146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938936+0000","last_change":"2023-08-27T11:28:35.011169+0000","last_active":"2023-08-27T11:28:53.938936+0000","last_peered":"2023-08-27T11:28:53.938936+0000","last_clean":"2023-08-27T11:28:53.938936+0000","last_became_active":"2023-08-27T11:28:35.010895+0000","last_became_peered":"2023-08-27T11:28:35.010895+0000","last_unstale":"2023-08-27T11:28:53.938936+0000","last_undegraded":"2023-08-27T11:28:53.938936+0000","last_fullsized":"2023-08-27T11:28:53.938936+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:58:55.298282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543753+0000","last_change":"2023-08-27T11:28:52.953472+0000","last_active":"2023-08-27T11:28:54.543753+0000","last_peered":"2023-08-27T11:28:54.543753+0000","last_clean":"2023-08-27T11:28:54.543753+0000","last_became_active":"2023-08-27T11:28:52.952835+0000","last_became_peered":"2023-08-27T11:28:52.952835+0000","last_unstale":"2023-08-27T11:28:54.543753+0000","last_undegraded":"2023-08-27T11:28:54.543753+0000","last_fullsized":"2023-08-27T11:28:54.543753+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:33.645891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543911+0000","last_change":"2023-08-27T11:28:52.110429+0000","last_active":"2023-08-27T11:28:54.543911+0000","last_peered":"2023-08-27T11:28:54.543911+0000","last_clean":"2023-08-27T11:28:54.543911+0000","last_became_active":"2023-08-27T11:28:52.110151+0000","last_became_peered":"2023-08-27T11:28:52.110151+0000","last_unstale":"2023-08-27T11:28:54.543911+0000","last_undegraded":"2023-08-27T11:28:54.543911+0000","last_fullsized":"2023-08-27T11:28:54.543911+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:18:35.513430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542407+0000","last_change":"2023-08-27T11:28:36.025457+0000","last_active":"2023-08-27T11:28:54.542407+0000","last_peered":"2023-08-27T11:28:54.542407+0000","last_clean":"2023-08-27T11:28:54.542407+0000","last_became_active":"2023-08-27T11:28:36.025184+0000","last_became_peered":"2023-08-27T11:28:36.025184+0000","last_unstale":"2023-08-27T11:28:54.542407+0000","last_undegraded":"2023-08-27T11:28:54.542407+0000","last_fullsized":"2023-08-27T11:28:54.542407+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:06.009064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"124'1","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544345+0000","last_change":"2023-08-27T11:28:35.009263+0000","last_active":"2023-08-27T11:28:54.544345+0000","last_peered":"2023-08-27T11:28:54.544345+0000","last_clean":"2023-08-27T11:28:54.544345+0000","last_became_active":"2023-08-27T11:28:35.008954+0000","last_became_peered":"2023-08-27T11:28:35.008954+0000","last_unstale":"2023-08-27T11:28:54.544345+0000","last_undegraded":"2023-08-27T11:28:54.544345+0000","last_fullsized":"2023-08-27T11:28:54.544345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:12.198796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543278+0000","last_change":"2023-08-27T11:28:52.955531+0000","last_active":"2023-08-27T11:28:54.543278+0000","last_peered":"2023-08-27T11:28:54.543278+0000","last_clean":"2023-08-27T11:28:54.543278+0000","last_became_active":"2023-08-27T11:28:52.955017+0000","last_became_peered":"2023-08-27T11:28:52.955017+0000","last_unstale":"2023-08-27T11:28:54.543278+0000","last_undegraded":"2023-08-27T11:28:54.543278+0000","last_fullsized":"2023-08-27T11:28:54.543278+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:39:59.775537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127099+0000","last_change":"2023-08-27T11:28:52.113270+0000","last_active":"2023-08-27T11:28:54.127099+0000","last_peered":"2023-08-27T11:28:54.127099+0000","last_clean":"2023-08-27T11:28:54.127099+0000","last_became_active":"2023-08-27T11:28:52.112926+0000","last_became_peered":"2023-08-27T11:28:52.112926+0000","last_unstale":"2023-08-27T11:28:54.127099+0000","last_undegraded":"2023-08-27T11:28:54.127099+0000","last_fullsized":"2023-08-27T11:28:54.127099+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.923496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543691+0000","last_change":"2023-08-27T11:28:36.031143+0000","last_active":"2023-08-27T11:28:54.543691+0000","last_peered":"2023-08-27T11:28:54.543691+0000","last_clean":"2023-08-27T11:28:54.543691+0000","last_became_active":"2023-08-27T11:28:36.030840+0000","last_became_peered":"2023-08-27T11:28:36.030840+0000","last_unstale":"2023-08-27T11:28:54.543691+0000","last_undegraded":"2023-08-27T11:28:54.543691+0000","last_fullsized":"2023-08-27T11:28:54.543691+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:07:08.813329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544887+0000","last_change":"2023-08-27T11:28:35.009258+0000","last_active":"2023-08-27T11:28:54.544887+0000","last_peered":"2023-08-27T11:28:54.544887+0000","last_clean":"2023-08-27T11:28:54.544887+0000","last_became_active":"2023-08-27T11:28:35.008865+0000","last_became_peered":"2023-08-27T11:28:35.008865+0000","last_unstale":"2023-08-27T11:28:54.544887+0000","last_undegraded":"2023-08-27T11:28:54.544887+0000","last_fullsized":"2023-08-27T11:28:54.544887+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:46:24.178472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542241+0000","last_change":"2023-08-27T11:28:52.953234+0000","last_active":"2023-08-27T11:28:54.542241+0000","last_peered":"2023-08-27T11:28:54.542241+0000","last_clean":"2023-08-27T11:28:54.542241+0000","last_became_active":"2023-08-27T11:28:52.952924+0000","last_became_peered":"2023-08-27T11:28:52.952924+0000","last_unstale":"2023-08-27T11:28:54.542241+0000","last_undegraded":"2023-08-27T11:28:54.542241+0000","last_fullsized":"2023-08-27T11:28:54.542241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:37:05.478232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938923+0000","last_change":"2023-08-27T11:28:52.109488+0000","last_active":"2023-08-27T11:28:53.938923+0000","last_peered":"2023-08-27T11:28:53.938923+0000","last_clean":"2023-08-27T11:28:53.938923+0000","last_became_active":"2023-08-27T11:28:52.109178+0000","last_became_peered":"2023-08-27T11:28:52.109178+0000","last_unstale":"2023-08-27T11:28:53.938923+0000","last_undegraded":"2023-08-27T11:28:53.938923+0000","last_fullsized":"2023-08-27T11:28:53.938923+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:01:31.909610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944212+0000","last_change":"2023-08-27T11:28:36.027765+0000","last_active":"2023-08-27T11:28:53.944212+0000","last_peered":"2023-08-27T11:28:53.944212+0000","last_clean":"2023-08-27T11:28:53.944212+0000","last_became_active":"2023-08-27T11:28:36.027374+0000","last_became_peered":"2023-08-27T11:28:36.027374+0000","last_unstale":"2023-08-27T11:28:53.944212+0000","last_undegraded":"2023-08-27T11:28:53.944212+0000","last_fullsized":"2023-08-27T11:28:53.944212+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:42.215415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944757+0000","last_change":"2023-08-27T11:28:35.018197+0000","last_active":"2023-08-27T11:28:53.944757+0000","last_peered":"2023-08-27T11:28:53.944757+0000","last_clean":"2023-08-27T11:28:53.944757+0000","last_became_active":"2023-08-27T11:28:35.017901+0000","last_became_peered":"2023-08-27T11:28:35.017901+0000","last_unstale":"2023-08-27T11:28:53.944757+0000","last_undegraded":"2023-08-27T11:28:53.944757+0000","last_fullsized":"2023-08-27T11:28:53.944757+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:19:25.030981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127523+0000","last_change":"2023-08-27T11:28:52.963639+0000","last_active":"2023-08-27T11:28:54.127523+0000","last_peered":"2023-08-27T11:28:54.127523+0000","last_clean":"2023-08-27T11:28:54.127523+0000","last_became_active":"2023-08-27T11:28:52.963113+0000","last_became_peered":"2023-08-27T11:28:52.963113+0000","last_unstale":"2023-08-27T11:28:54.127523+0000","last_undegraded":"2023-08-27T11:28:54.127523+0000","last_fullsized":"2023-08-27T11:28:54.127523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:29:58.321050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944988+0000","last_change":"2023-08-27T11:28:52.110695+0000","last_active":"2023-08-27T11:28:53.944988+0000","last_peered":"2023-08-27T11:28:53.944988+0000","last_clean":"2023-08-27T11:28:53.944988+0000","last_became_active":"2023-08-27T11:28:52.110410+0000","last_became_peered":"2023-08-27T11:28:52.110410+0000","last_unstale":"2023-08-27T11:28:53.944988+0000","last_undegraded":"2023-08-27T11:28:53.944988+0000","last_fullsized":"2023-08-27T11:28:53.944988+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:15:32.371940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944596+0000","last_change":"2023-08-27T11:28:36.027113+0000","last_active":"2023-08-27T11:28:53.944596+0000","last_peered":"2023-08-27T11:28:53.944596+0000","last_clean":"2023-08-27T11:28:53.944596+0000","last_became_active":"2023-08-27T11:28:36.026825+0000","last_became_peered":"2023-08-27T11:28:36.026825+0000","last_unstale":"2023-08-27T11:28:53.944596+0000","last_undegraded":"2023-08-27T11:28:53.944596+0000","last_fullsized":"2023-08-27T11:28:53.944596+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:29:13.207253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127236+0000","last_change":"2023-08-27T11:28:35.007965+0000","last_active":"2023-08-27T11:28:54.127236+0000","last_peered":"2023-08-27T11:28:54.127236+0000","last_clean":"2023-08-27T11:28:54.127236+0000","last_became_active":"2023-08-27T11:28:35.007619+0000","last_became_peered":"2023-08-27T11:28:35.007619+0000","last_unstale":"2023-08-27T11:28:54.127236+0000","last_undegraded":"2023-08-27T11:28:54.127236+0000","last_fullsized":"2023-08-27T11:28:54.127236+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:04:41.245871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168496+0000","last_change":"2023-08-27T11:28:52.963525+0000","last_active":"2023-08-27T11:28:54.168496+0000","last_peered":"2023-08-27T11:28:54.168496+0000","last_clean":"2023-08-27T11:28:54.168496+0000","last_became_active":"2023-08-27T11:28:52.963326+0000","last_became_peered":"2023-08-27T11:28:52.963326+0000","last_unstale":"2023-08-27T11:28:54.168496+0000","last_undegraded":"2023-08-27T11:28:54.168496+0000","last_fullsized":"2023-08-27T11:28:54.168496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:36.989662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167786+0000","last_change":"2023-08-27T11:28:52.110101+0000","last_active":"2023-08-27T11:28:54.167786+0000","last_peered":"2023-08-27T11:28:54.167786+0000","last_clean":"2023-08-27T11:28:54.167786+0000","last_became_active":"2023-08-27T11:28:52.109772+0000","last_became_peered":"2023-08-27T11:28:52.109772+0000","last_unstale":"2023-08-27T11:28:54.167786+0000","last_undegraded":"2023-08-27T11:28:54.167786+0000","last_fullsized":"2023-08-27T11:28:54.167786+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:22.099441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.945084+0000","last_change":"2023-08-27T11:28:36.026876+0000","last_active":"2023-08-27T11:28:53.945084+0000","last_peered":"2023-08-27T11:28:53.945084+0000","last_clean":"2023-08-27T11:28:53.945084+0000","last_became_active":"2023-08-27T11:28:36.026348+0000","last_became_peered":"2023-08-27T11:28:36.026348+0000","last_unstale":"2023-08-27T11:28:53.945084+0000","last_undegraded":"2023-08-27T11:28:53.945084+0000","last_fullsized":"2023-08-27T11:28:53.945084+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:12.652500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545065+0000","last_change":"2023-08-27T11:28:35.011049+0000","last_active":"2023-08-27T11:28:54.545065+0000","last_peered":"2023-08-27T11:28:54.545065+0000","last_clean":"2023-08-27T11:28:54.545065+0000","last_became_active":"2023-08-27T11:28:35.010700+0000","last_became_peered":"2023-08-27T11:28:35.010700+0000","last_unstale":"2023-08-27T11:28:54.545065+0000","last_undegraded":"2023-08-27T11:28:54.545065+0000","last_fullsized":"2023-08-27T11:28:54.545065+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:15.764582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167652+0000","last_change":"2023-08-27T11:28:52.959730+0000","last_active":"2023-08-27T11:28:54.167652+0000","last_peered":"2023-08-27T11:28:54.167652+0000","last_clean":"2023-08-27T11:28:54.167652+0000","last_became_active":"2023-08-27T11:28:52.959420+0000","last_became_peered":"2023-08-27T11:28:52.959420+0000","last_unstale":"2023-08-27T11:28:54.167652+0000","last_undegraded":"2023-08-27T11:28:54.167652+0000","last_fullsized":"2023-08-27T11:28:54.167652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:22.061225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544934+0000","last_change":"2023-08-27T11:28:52.108972+0000","last_active":"2023-08-27T11:28:54.544934+0000","last_peered":"2023-08-27T11:28:54.544934+0000","last_clean":"2023-08-27T11:28:54.544934+0000","last_became_active":"2023-08-27T11:28:52.108614+0000","last_became_peered":"2023-08-27T11:28:52.108614+0000","last_unstale":"2023-08-27T11:28:54.544934+0000","last_undegraded":"2023-08-27T11:28:54.544934+0000","last_fullsized":"2023-08-27T11:28:54.544934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:47.764135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943622+0000","last_change":"2023-08-27T11:28:36.035026+0000","last_active":"2023-08-27T11:28:53.943622+0000","last_peered":"2023-08-27T11:28:53.943622+0000","last_clean":"2023-08-27T11:28:53.943622+0000","last_became_active":"2023-08-27T11:28:36.034706+0000","last_became_peered":"2023-08-27T11:28:36.034706+0000","last_unstale":"2023-08-27T11:28:53.943622+0000","last_undegraded":"2023-08-27T11:28:53.943622+0000","last_fullsized":"2023-08-27T11:28:53.943622+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:11.039958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943238+0000","last_change":"2023-08-27T11:28:35.018449+0000","last_active":"2023-08-27T11:28:53.943238+0000","last_peered":"2023-08-27T11:28:53.943238+0000","last_clean":"2023-08-27T11:28:53.943238+0000","last_became_active":"2023-08-27T11:28:35.018182+0000","last_became_peered":"2023-08-27T11:28:35.018182+0000","last_unstale":"2023-08-27T11:28:53.943238+0000","last_undegraded":"2023-08-27T11:28:53.943238+0000","last_fullsized":"2023-08-27T11:28:53.943238+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:30:11.026416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543250+0000","last_change":"2023-08-27T11:28:52.957361+0000","last_active":"2023-08-27T11:28:54.543250+0000","last_peered":"2023-08-27T11:28:54.543250+0000","last_clean":"2023-08-27T11:28:54.543250+0000","last_became_active":"2023-08-27T11:28:52.956848+0000","last_became_peered":"2023-08-27T11:28:52.956848+0000","last_unstale":"2023-08-27T11:28:54.543250+0000","last_undegraded":"2023-08-27T11:28:54.543250+0000","last_fullsized":"2023-08-27T11:28:54.543250+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:30:57.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"128'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.801051+0000","last_change":"2023-08-27T11:28:52.112549+0000","last_active":"2023-08-27T11:28:54.801051+0000","last_peered":"2023-08-27T11:28:54.801051+0000","last_clean":"2023-08-27T11:28:54.801051+0000","last_became_active":"2023-08-27T11:28:52.112223+0000","last_became_peered":"2023-08-27T11:28:52.112223+0000","last_unstale":"2023-08-27T11:28:54.801051+0000","last_undegraded":"2023-08-27T11:28:54.801051+0000","last_fullsized":"2023-08-27T11:28:54.801051+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:14:26.215023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543970+0000","last_change":"2023-08-27T11:28:36.032354+0000","last_active":"2023-08-27T11:28:54.543970+0000","last_peered":"2023-08-27T11:28:54.543970+0000","last_clean":"2023-08-27T11:28:54.543970+0000","last_became_active":"2023-08-27T11:28:36.031936+0000","last_became_peered":"2023-08-27T11:28:36.031936+0000","last_unstale":"2023-08-27T11:28:54.543970+0000","last_undegraded":"2023-08-27T11:28:54.543970+0000","last_fullsized":"2023-08-27T11:28:54.543970+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:38.881764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167559+0000","last_change":"2023-08-27T11:28:35.013499+0000","last_active":"2023-08-27T11:28:54.167559+0000","last_peered":"2023-08-27T11:28:54.167559+0000","last_clean":"2023-08-27T11:28:54.167559+0000","last_became_active":"2023-08-27T11:28:35.013176+0000","last_became_peered":"2023-08-27T11:28:35.013176+0000","last_unstale":"2023-08-27T11:28:54.167559+0000","last_undegraded":"2023-08-27T11:28:54.167559+0000","last_fullsized":"2023-08-27T11:28:54.167559+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:21:01.873554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543352+0000","last_change":"2023-08-27T11:28:52.964224+0000","last_active":"2023-08-27T11:28:54.543352+0000","last_peered":"2023-08-27T11:28:54.543352+0000","last_clean":"2023-08-27T11:28:54.543352+0000","last_became_active":"2023-08-27T11:28:52.963863+0000","last_became_peered":"2023-08-27T11:28:52.963863+0000","last_unstale":"2023-08-27T11:28:54.543352+0000","last_undegraded":"2023-08-27T11:28:54.543352+0000","last_fullsized":"2023-08-27T11:28:54.543352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:58:41.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167895+0000","last_change":"2023-08-27T11:28:52.107711+0000","last_active":"2023-08-27T11:28:54.167895+0000","last_peered":"2023-08-27T11:28:54.167895+0000","last_clean":"2023-08-27T11:28:54.167895+0000","last_became_active":"2023-08-27T11:28:52.107323+0000","last_became_peered":"2023-08-27T11:28:52.107323+0000","last_unstale":"2023-08-27T11:28:54.167895+0000","last_undegraded":"2023-08-27T11:28:54.167895+0000","last_fullsized":"2023-08-27T11:28:54.167895+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:08.464535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543070+0000","last_change":"2023-08-27T11:28:36.019620+0000","last_active":"2023-08-27T11:28:54.543070+0000","last_peered":"2023-08-27T11:28:54.543070+0000","last_clean":"2023-08-27T11:28:54.543070+0000","last_became_active":"2023-08-27T11:28:36.019344+0000","last_became_peered":"2023-08-27T11:28:36.019344+0000","last_unstale":"2023-08-27T11:28:54.543070+0000","last_undegraded":"2023-08-27T11:28:54.543070+0000","last_fullsized":"2023-08-27T11:28:54.543070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:41:43.369338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"123'3","reported_seq":24,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544570+0000","last_change":"2023-08-27T11:28:35.013652+0000","last_active":"2023-08-27T11:28:54.544570+0000","last_peered":"2023-08-27T11:28:54.544570+0000","last_clean":"2023-08-27T11:28:54.544570+0000","last_became_active":"2023-08-27T11:28:35.013324+0000","last_became_peered":"2023-08-27T11:28:35.013324+0000","last_unstale":"2023-08-27T11:28:54.544570+0000","last_undegraded":"2023-08-27T11:28:54.544570+0000","last_fullsized":"2023-08-27T11:28:54.544570+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:27.241465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545198+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:28:54.545198+0000","last_peered":"2023-08-27T11:28:54.545198+0000","last_clean":"2023-08-27T11:28:54.545198+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:28:54.545198+0000","last_undegraded":"2023-08-27T11:28:54.545198+0000","last_fullsized":"2023-08-27T11:28:54.545198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:02:30.419850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943146+0000","last_change":"2023-08-27T11:28:52.965454+0000","last_active":"2023-08-27T11:28:53.943146+0000","last_peered":"2023-08-27T11:28:53.943146+0000","last_clean":"2023-08-27T11:28:53.943146+0000","last_became_active":"2023-08-27T11:28:52.965148+0000","last_became_peered":"2023-08-27T11:28:52.965148+0000","last_unstale":"2023-08-27T11:28:53.943146+0000","last_undegraded":"2023-08-27T11:28:53.943146+0000","last_fullsized":"2023-08-27T11:28:53.943146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:03:58.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542684+0000","last_change":"2023-08-27T11:28:52.109636+0000","last_active":"2023-08-27T11:28:54.542684+0000","last_peered":"2023-08-27T11:28:54.542684+0000","last_clean":"2023-08-27T11:28:54.542684+0000","last_became_active":"2023-08-27T11:28:52.109296+0000","last_became_peered":"2023-08-27T11:28:52.109296+0000","last_unstale":"2023-08-27T11:28:54.542684+0000","last_undegraded":"2023-08-27T11:28:54.542684+0000","last_fullsized":"2023-08-27T11:28:54.542684+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:12:08.464535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543784+0000","last_change":"2023-08-27T11:28:36.027190+0000","last_active":"2023-08-27T11:28:54.543784+0000","last_peered":"2023-08-27T11:28:54.543784+0000","last_clean":"2023-08-27T11:28:54.543784+0000","last_became_active":"2023-08-27T11:28:36.026781+0000","last_became_peered":"2023-08-27T11:28:36.026781+0000","last_unstale":"2023-08-27T11:28:54.543784+0000","last_undegraded":"2023-08-27T11:28:54.543784+0000","last_fullsized":"2023-08-27T11:28:54.543784+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:18:19.892696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"123'6","reported_seq":27,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542791+0000","last_change":"2023-08-27T11:28:35.015092+0000","last_active":"2023-08-27T11:28:54.542791+0000","last_peered":"2023-08-27T11:28:54.542791+0000","last_clean":"2023-08-27T11:28:54.542791+0000","last_became_active":"2023-08-27T11:28:35.014378+0000","last_became_peered":"2023-08-27T11:28:35.014378+0000","last_unstale":"2023-08-27T11:28:54.542791+0000","last_undegraded":"2023-08-27T11:28:54.542791+0000","last_fullsized":"2023-08-27T11:28:54.542791+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:32:27.241226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":217,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544726+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:28:54.544726+0000","last_peered":"2023-08-27T11:28:54.544726+0000","last_clean":"2023-08-27T11:28:54.544726+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:28:54.544726+0000","last_undegraded":"2023-08-27T11:28:54.544726+0000","last_fullsized":"2023-08-27T11:28:54.544726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:18:43.780121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938686+0000","last_change":"2023-08-27T11:28:52.964629+0000","last_active":"2023-08-27T11:28:53.938686+0000","last_peered":"2023-08-27T11:28:53.938686+0000","last_clean":"2023-08-27T11:28:53.938686+0000","last_became_active":"2023-08-27T11:28:52.964057+0000","last_became_peered":"2023-08-27T11:28:52.964057+0000","last_unstale":"2023-08-27T11:28:53.938686+0000","last_undegraded":"2023-08-27T11:28:53.938686+0000","last_fullsized":"2023-08-27T11:28:53.938686+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:30:01.510670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"127'3","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938890+0000","last_change":"2023-08-27T11:28:52.108757+0000","last_active":"2023-08-27T11:28:53.938890+0000","last_peered":"2023-08-27T11:28:53.938890+0000","last_clean":"2023-08-27T11:28:53.938890+0000","last_became_active":"2023-08-27T11:28:52.108482+0000","last_became_peered":"2023-08-27T11:28:52.108482+0000","last_unstale":"2023-08-27T11:28:53.938890+0000","last_undegraded":"2023-08-27T11:28:53.938890+0000","last_fullsized":"2023-08-27T11:28:53.938890+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:36:41.909538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944648+0000","last_change":"2023-08-27T11:28:36.023266+0000","last_active":"2023-08-27T11:28:53.944648+0000","last_peered":"2023-08-27T11:28:53.944648+0000","last_clean":"2023-08-27T11:28:53.944648+0000","last_became_active":"2023-08-27T11:28:36.022928+0000","last_became_peered":"2023-08-27T11:28:36.022928+0000","last_unstale":"2023-08-27T11:28:53.944648+0000","last_undegraded":"2023-08-27T11:28:53.944648+0000","last_fullsized":"2023-08-27T11:28:53.944648+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:28:06.009064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"123'2","reported_seq":23,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938434+0000","last_change":"2023-08-27T11:28:35.018191+0000","last_active":"2023-08-27T11:28:53.938434+0000","last_peered":"2023-08-27T11:28:53.938434+0000","last_clean":"2023-08-27T11:28:53.938434+0000","last_became_active":"2023-08-27T11:28:35.017875+0000","last_became_peered":"2023-08-27T11:28:35.017875+0000","last_unstale":"2023-08-27T11:28:53.938434+0000","last_undegraded":"2023-08-27T11:28:53.938434+0000","last_fullsized":"2023-08-27T11:28:53.938434+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:26.172666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":228,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126651+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:28:54.126651+0000","last_peered":"2023-08-27T11:28:54.126651+0000","last_clean":"2023-08-27T11:28:54.126651+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:28:54.126651+0000","last_undegraded":"2023-08-27T11:28:54.126651+0000","last_fullsized":"2023-08-27T11:28:54.126651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:36.881366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544913+0000","last_change":"2023-08-27T11:28:52.953919+0000","last_active":"2023-08-27T11:28:54.544913+0000","last_peered":"2023-08-27T11:28:54.544913+0000","last_clean":"2023-08-27T11:28:54.544913+0000","last_became_active":"2023-08-27T11:28:52.953523+0000","last_became_peered":"2023-08-27T11:28:52.953523+0000","last_unstale":"2023-08-27T11:28:54.544913+0000","last_undegraded":"2023-08-27T11:28:54.544913+0000","last_fullsized":"2023-08-27T11:28:54.544913+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:16:54.608924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"127'6","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.944441+0000","last_change":"2023-08-27T11:28:52.115409+0000","last_active":"2023-08-27T11:28:53.944441+0000","last_peered":"2023-08-27T11:28:53.944441+0000","last_clean":"2023-08-27T11:28:53.944441+0000","last_became_active":"2023-08-27T11:28:52.115101+0000","last_became_peered":"2023-08-27T11:28:52.115101+0000","last_unstale":"2023-08-27T11:28:53.944441+0000","last_undegraded":"2023-08-27T11:28:53.944441+0000","last_fullsized":"2023-08-27T11:28:53.944441+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:21.054635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542877+0000","last_change":"2023-08-27T11:28:36.010061+0000","last_active":"2023-08-27T11:28:54.542877+0000","last_peered":"2023-08-27T11:28:54.542877+0000","last_clean":"2023-08-27T11:28:54.542877+0000","last_became_active":"2023-08-27T11:28:36.009747+0000","last_became_peered":"2023-08-27T11:28:36.009747+0000","last_unstale":"2023-08-27T11:28:54.542877+0000","last_undegraded":"2023-08-27T11:28:54.542877+0000","last_fullsized":"2023-08-27T11:28:54.542877+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:24:37.077937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545050+0000","last_change":"2023-08-27T11:28:35.017167+0000","last_active":"2023-08-27T11:28:54.545050+0000","last_peered":"2023-08-27T11:28:54.545050+0000","last_clean":"2023-08-27T11:28:54.545050+0000","last_became_active":"2023-08-27T11:28:35.016834+0000","last_became_peered":"2023-08-27T11:28:35.016834+0000","last_unstale":"2023-08-27T11:28:54.545050+0000","last_undegraded":"2023-08-27T11:28:54.545050+0000","last_fullsized":"2023-08-27T11:28:54.545050+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:46:19.973281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544306+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:28:54.544306+0000","last_peered":"2023-08-27T11:28:54.544306+0000","last_clean":"2023-08-27T11:28:54.544306+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:28:54.544306+0000","last_undegraded":"2023-08-27T11:28:54.544306+0000","last_fullsized":"2023-08-27T11:28:54.544306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:21:44.999303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938500+0000","last_change":"2023-08-27T11:28:52.969419+0000","last_active":"2023-08-27T11:28:53.938500+0000","last_peered":"2023-08-27T11:28:53.938500+0000","last_clean":"2023-08-27T11:28:53.938500+0000","last_became_active":"2023-08-27T11:28:52.969068+0000","last_became_peered":"2023-08-27T11:28:52.969068+0000","last_unstale":"2023-08-27T11:28:53.938500+0000","last_undegraded":"2023-08-27T11:28:53.938500+0000","last_fullsized":"2023-08-27T11:28:53.938500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:12:58.548279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127584+0000","last_change":"2023-08-27T11:28:52.109801+0000","last_active":"2023-08-27T11:28:54.127584+0000","last_peered":"2023-08-27T11:28:54.127584+0000","last_clean":"2023-08-27T11:28:54.127584+0000","last_became_active":"2023-08-27T11:28:52.109522+0000","last_became_peered":"2023-08-27T11:28:52.109522+0000","last_unstale":"2023-08-27T11:28:54.127584+0000","last_undegraded":"2023-08-27T11:28:54.127584+0000","last_fullsized":"2023-08-27T11:28:54.127584+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:23:17.583292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168614+0000","last_change":"2023-08-27T11:28:36.027147+0000","last_active":"2023-08-27T11:28:54.168614+0000","last_peered":"2023-08-27T11:28:54.168614+0000","last_clean":"2023-08-27T11:28:54.168614+0000","last_became_active":"2023-08-27T11:28:36.026783+0000","last_became_peered":"2023-08-27T11:28:36.026783+0000","last_unstale":"2023-08-27T11:28:54.168614+0000","last_undegraded":"2023-08-27T11:28:54.168614+0000","last_fullsized":"2023-08-27T11:28:54.168614+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:24:42.857462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"123'8","reported_seq":29,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943019+0000","last_change":"2023-08-27T11:28:35.014741+0000","last_active":"2023-08-27T11:28:53.943019+0000","last_peered":"2023-08-27T11:28:53.943019+0000","last_clean":"2023-08-27T11:28:53.943019+0000","last_became_active":"2023-08-27T11:28:35.014112+0000","last_became_peered":"2023-08-27T11:28:35.014112+0000","last_unstale":"2023-08-27T11:28:53.943019+0000","last_undegraded":"2023-08-27T11:28:53.943019+0000","last_fullsized":"2023-08-27T11:28:53.943019+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:48:57.352018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545244+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:28:54.545244+0000","last_peered":"2023-08-27T11:28:54.545244+0000","last_clean":"2023-08-27T11:28:54.545244+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:28:54.545244+0000","last_undegraded":"2023-08-27T11:28:54.545244+0000","last_fullsized":"2023-08-27T11:28:54.545244+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:23.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543892+0000","last_change":"2023-08-27T11:28:52.964215+0000","last_active":"2023-08-27T11:28:54.543892+0000","last_peered":"2023-08-27T11:28:54.543892+0000","last_clean":"2023-08-27T11:28:54.543892+0000","last_became_active":"2023-08-27T11:28:52.963891+0000","last_became_peered":"2023-08-27T11:28:52.963891+0000","last_unstale":"2023-08-27T11:28:54.543892+0000","last_undegraded":"2023-08-27T11:28:54.543892+0000","last_fullsized":"2023-08-27T11:28:54.543892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:10:32.765118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.543857+0000","last_change":"2023-08-27T11:28:52.117757+0000","last_active":"2023-08-27T11:28:54.543857+0000","last_peered":"2023-08-27T11:28:54.543857+0000","last_clean":"2023-08-27T11:28:54.543857+0000","last_became_active":"2023-08-27T11:28:52.117338+0000","last_became_peered":"2023-08-27T11:28:52.117338+0000","last_unstale":"2023-08-27T11:28:54.543857+0000","last_undegraded":"2023-08-27T11:28:54.543857+0000","last_fullsized":"2023-08-27T11:28:54.543857+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:33.403772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544972+0000","last_change":"2023-08-27T11:28:36.038226+0000","last_active":"2023-08-27T11:28:54.544972+0000","last_peered":"2023-08-27T11:28:54.544972+0000","last_clean":"2023-08-27T11:28:54.544972+0000","last_became_active":"2023-08-27T11:28:36.037748+0000","last_became_peered":"2023-08-27T11:28:36.037748+0000","last_unstale":"2023-08-27T11:28:54.544972+0000","last_undegraded":"2023-08-27T11:28:54.544972+0000","last_fullsized":"2023-08-27T11:28:54.544972+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:02:27.900251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542019+0000","last_change":"2023-08-27T11:28:35.005991+0000","last_active":"2023-08-27T11:28:54.542019+0000","last_peered":"2023-08-27T11:28:54.542019+0000","last_clean":"2023-08-27T11:28:54.542019+0000","last_became_active":"2023-08-27T11:28:35.005687+0000","last_became_peered":"2023-08-27T11:28:35.005687+0000","last_unstale":"2023-08-27T11:28:54.542019+0000","last_undegraded":"2023-08-27T11:28:54.542019+0000","last_fullsized":"2023-08-27T11:28:54.542019+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:34:03.955802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":352,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.544168+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:28:54.544168+0000","last_peered":"2023-08-27T11:28:54.544168+0000","last_clean":"2023-08-27T11:28:54.544168+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:28:54.544168+0000","last_undegraded":"2023-08-27T11:28:54.544168+0000","last_fullsized":"2023-08-27T11:28:54.544168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:56:19.957551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943898+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:28:53.943898+0000","last_peered":"2023-08-27T11:28:53.943898+0000","last_clean":"2023-08-27T11:28:53.943898+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:28:53.943898+0000","last_undegraded":"2023-08-27T11:28:53.943898+0000","last_fullsized":"2023-08-27T11:28:53.943898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:04:16.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943644+0000","last_change":"2023-08-27T11:28:52.949204+0000","last_active":"2023-08-27T11:28:53.943644+0000","last_peered":"2023-08-27T11:28:53.943644+0000","last_clean":"2023-08-27T11:28:53.943644+0000","last_became_active":"2023-08-27T11:28:52.948339+0000","last_became_peered":"2023-08-27T11:28:52.948339+0000","last_unstale":"2023-08-27T11:28:53.943644+0000","last_undegraded":"2023-08-27T11:28:53.943644+0000","last_fullsized":"2023-08-27T11:28:53.943644+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:50:27.071898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"127'8","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.126615+0000","last_change":"2023-08-27T11:28:52.111865+0000","last_active":"2023-08-27T11:28:54.126615+0000","last_peered":"2023-08-27T11:28:54.126615+0000","last_clean":"2023-08-27T11:28:54.126615+0000","last_became_active":"2023-08-27T11:28:52.111518+0000","last_became_peered":"2023-08-27T11:28:52.111518+0000","last_unstale":"2023-08-27T11:28:54.126615+0000","last_undegraded":"2023-08-27T11:28:54.126615+0000","last_fullsized":"2023-08-27T11:28:54.126615+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:37:19.606710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.943842+0000","last_change":"2023-08-27T11:28:36.031797+0000","last_active":"2023-08-27T11:28:53.943842+0000","last_peered":"2023-08-27T11:28:53.943842+0000","last_clean":"2023-08-27T11:28:53.943842+0000","last_became_active":"2023-08-27T11:28:36.031421+0000","last_became_peered":"2023-08-27T11:28:36.031421+0000","last_unstale":"2023-08-27T11:28:53.943842+0000","last_undegraded":"2023-08-27T11:28:53.943842+0000","last_fullsized":"2023-08-27T11:28:53.943842+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:38:16.548925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938924+0000","last_change":"2023-08-27T11:28:35.018314+0000","last_active":"2023-08-27T11:28:53.938924+0000","last_peered":"2023-08-27T11:28:53.938924+0000","last_clean":"2023-08-27T11:28:53.938924+0000","last_became_active":"2023-08-27T11:28:35.018018+0000","last_became_peered":"2023-08-27T11:28:35.018018+0000","last_unstale":"2023-08-27T11:28:53.938924+0000","last_undegraded":"2023-08-27T11:28:53.938924+0000","last_fullsized":"2023-08-27T11:28:53.938924+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:07:00.491347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":210,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.168685+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:28:54.168685+0000","last_peered":"2023-08-27T11:28:54.168685+0000","last_clean":"2023-08-27T11:28:54.168685+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:28:54.168685+0000","last_undegraded":"2023-08-27T11:28:54.168685+0000","last_fullsized":"2023-08-27T11:28:54.168685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:12:32.596417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.167548+0000","last_change":"2023-08-27T11:28:52.942737+0000","last_active":"2023-08-27T11:28:54.167548+0000","last_peered":"2023-08-27T11:28:54.167548+0000","last_clean":"2023-08-27T11:28:54.167548+0000","last_became_active":"2023-08-27T11:28:52.942411+0000","last_became_peered":"2023-08-27T11:28:52.942411+0000","last_unstale":"2023-08-27T11:28:54.167548+0000","last_undegraded":"2023-08-27T11:28:54.167548+0000","last_fullsized":"2023-08-27T11:28:54.167548+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:52.081051+0000","last_clean_scrub_stamp":"2023-08-27T11:28:52.081051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:00:44.392829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.542602+0000","last_change":"2023-08-27T11:28:52.104695+0000","last_active":"2023-08-27T11:28:54.542602+0000","last_peered":"2023-08-27T11:28:54.542602+0000","last_clean":"2023-08-27T11:28:54.542602+0000","last_became_active":"2023-08-27T11:28:52.104419+0000","last_became_peered":"2023-08-27T11:28:52.104419+0000","last_unstale":"2023-08-27T11:28:54.542602+0000","last_undegraded":"2023-08-27T11:28:54.542602+0000","last_fullsized":"2023-08-27T11:28:54.542602+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:51.074461+0000","last_clean_scrub_stamp":"2023-08-27T11:28:51.074461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:03:36.134477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:53.938034+0000","last_change":"2023-08-27T11:28:36.013449+0000","last_active":"2023-08-27T11:28:53.938034+0000","last_peered":"2023-08-27T11:28:53.938034+0000","last_clean":"2023-08-27T11:28:53.938034+0000","last_became_active":"2023-08-27T11:28:36.013153+0000","last_became_peered":"2023-08-27T11:28:36.013153+0000","last_unstale":"2023-08-27T11:28:53.938034+0000","last_undegraded":"2023-08-27T11:28:53.938034+0000","last_fullsized":"2023-08-27T11:28:53.938034+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:34.984084+0000","last_clean_scrub_stamp":"2023-08-27T11:28:34.984084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:43:34.511520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.127735+0000","last_change":"2023-08-27T11:28:35.011771+0000","last_active":"2023-08-27T11:28:54.127735+0000","last_peered":"2023-08-27T11:28:54.127735+0000","last_clean":"2023-08-27T11:28:54.127735+0000","last_became_active":"2023-08-27T11:28:35.011472+0000","last_became_peered":"2023-08-27T11:28:35.011472+0000","last_unstale":"2023-08-27T11:28:54.127735+0000","last_undegraded":"2023-08-27T11:28:54.127735+0000","last_fullsized":"2023-08-27T11:28:54.127735+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:28:33.975628+0000","last_clean_scrub_stamp":"2023-08-27T11:28:33.975628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:33:17.546562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":226,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-08-27T11:28:54.545034+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:28:54.545034+0000","last_peered":"2023-08-27T11:28:54.545034+0000","last_clean":"2023-08-27T11:28:54.545034+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:28:54.545034+0000","last_undegraded":"2023-08-27T11:28:54.545034+0000","last_fullsized":"2023-08-27T11:28:54.545034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:09:17.204222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33340,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338500,"statfs":{"total":96636764160,"available":96602624000,"internally_reserved":0,"allocated":2211840,"data_stored":1350374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.64100000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.748}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.88900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28592,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343248,"statfs":{"total":96636764160,"available":96607485952,"internally_reserved":0,"allocated":1605632,"data_stored":758038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.77700000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33328,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338512,"statfs":{"total":96636764160,"available":96602636288,"internally_reserved":0,"allocated":2199552,"data_stored":1348790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.375}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":0.626}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.54000000000000004}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.70399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1626112,"data_stored":759670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.373},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.437}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.35599999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.81200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1613824,"data_stored":759010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":0.71399999999999997}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":0.76900000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":0.68700000000000006}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":759594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.434},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.63},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":0.81299999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28596,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343244,"statfs":{"total":96636764160,"available":96607481856,"internally_reserved":0,"allocated":1609728,"data_stored":759894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.745},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":1.2},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":1.125}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343256,"statfs":{"total":96636764160,"available":96607494144,"internally_reserved":0,"allocated":1597440,"data_stored":757318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.0189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:28:58.086 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:28:58.086 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:58.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.315+0000 7fb386bff700 1 Processor -- start 2023-08-27T11:28:58.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.315+0000 7fb386bff700 1 -- start start 2023-08-27T11:28:58.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.316+0000 7fb386bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb380151a90 0x7fb3800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb386bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38006c4e0 con 0x7fb3800c4630 2023-08-27T11:28:58.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb386bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb380155370 con 0x7fb3800c4a90 2023-08-27T11:28:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb386bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb380151e70 con 0x7fb380151a90 2023-08-27T11:28:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb37ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb3800c4630 0x7fb38006ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60348/0 (socket says 172.21.15.43:60348) 2023-08-27T11:28:58.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb37ffff700 1 -- 172.21.15.43:0/1623365801 learned_addr learned my addr 172.21.15.43:0/1623365801 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb38499b700 1 --2- 172.21.15.43:0/1623365801 >> v2:172.21.15.57:3300/0 conn(0x7fb380151a90 0x7fb3800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934486748 0 0) 0x7fb38006c4e0 con 0x7fb3800c4630 2023-08-27T11:28:58.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.317+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3700035b0 con 0x7fb3800c4630 2023-08-27T11:28:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 452294024 0 0) 0x7fb3700035b0 con 0x7fb3800c4630 2023-08-27T11:28:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 >> v2:172.21.15.57:3300/0 conn(0x7fb380151a90 msgr2=0x7fb3800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:58.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 --2- 172.21.15.43:0/1623365801 >> v2:172.21.15.57:3300/0 conn(0x7fb380151a90 0x7fb3800c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 >> v1:172.21.15.57:6789/0 conn(0x7fb3800c4a90 legacy=0x7fb38006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380154480 con 0x7fb3800c4630 2023-08-27T11:28:58.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fb36c001670 con 0x7fb3800c4630 2023-08-27T11:28:58.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 >> v1:172.21.15.43:6789/0 conn(0x7fb3800c4630 legacy=0x7fb38006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 0x7fb370003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb370004850 0x7fb370004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370005210 0x7fb37000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380151e70 con 0x7fb370003a00 2023-08-27T11:28:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37000c1b0 con 0x7fb370005210 2023-08-27T11:28:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37000c370 con 0x7fb370004850 2023-08-27T11:28:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 0x7fb370003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb37ffff700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb370004850 0x7fb370004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38519c700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370005210 0x7fb37000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 -- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb370004850 msgr2=0x7fb370004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb370004850 0x7fb370004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 -- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370005210 msgr2=0x7fb37000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:58.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370005210 0x7fb37000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38499b700 1 -- 172.21.15.43:0/1623365801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700035b0 con 0x7fb370003a00 2023-08-27T11:28:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.318+0000 7fb38519c700 1 -- 172.21.15.43:0/1623365801 reap_dead start 2023-08-27T11:28:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb38499b700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 0x7fb370003e20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fb374009b60 tx=0x7fb370005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e1347092f10bd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400e6c0 con 0x7fb370003a00 2023-08-27T11:28:58.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400e820 con 0x7fb370003a00 2023-08-27T11:28:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb37f7fe700 1 -- 172.21.15.43:0/1623365801 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400eb90 con 0x7fb370003a00 2023-08-27T11:28:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb386bff700 1 -- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 msgr2=0x7fb370003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb386bff700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 0x7fb370003e20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fb374009b60 tx=0x7fb370005880 comp rx=0 tx=0).stop 2023-08-27T11:28:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb386bff700 1 -- 172.21.15.43:0/1623365801 shutdown_connections 2023-08-27T11:28:58.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb386bff700 1 --2- 172.21.15.43:0/1623365801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb370003a00 0x7fb370003e20 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.319+0000 7fb386bff700 1 -- 172.21.15.43:0/1623365801 >> 172.21.15.43:0/1623365801 conn(0x7fb3800ab820 msgr2=0x7fb3800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.320+0000 7fb386bff700 1 -- 172.21.15.43:0/1623365801 shutdown_connections 2023-08-27T11:28:58.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.320+0000 7fb386bff700 1 -- 172.21.15.43:0/1623365801 wait complete. 2023-08-27T11:28:58.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.321+0000 7fb386bff700 1 Processor -- start 2023-08-27T11:28:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.321+0000 7fb386bff700 1 -- start start 2023-08-27T11:28:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370003a00 0x7fb3801eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 0x7fb38014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3801eafc0 con 0x7fb3800aa660 2023-08-27T11:28:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380150990 con 0x7fb370003a00 2023-08-27T11:28:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.322+0000 7fb386bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38014ef40 con 0x7fb38014f3d0 2023-08-27T11:28:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58474/0 (socket says 172.21.15.43:58474) 2023-08-27T11:28:58.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 -- 172.21.15.43:0/1275159791 learned_addr learned my addr 172.21.15.43:0/1275159791 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:58.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb38499b700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370003a00 0x7fb3801eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb38519c700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 0x7fb38014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 -- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 msgr2=0x7fb38014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 0x7fb38014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 -- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370003a00 msgr2=0x7fb3801eaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370003a00 0x7fb3801eaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 -- 172.21.15.43:0/1275159791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38014fd90 con 0x7fb3800aa660 2023-08-27T11:28:58.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb38519c700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 0x7fb38014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:28:58.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37ffff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00eb20 tx=0x7fb36c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.323+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c005e00 con 0x7fb3800aa660 2023-08-27T11:28:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.324+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c00c7e0 con 0x7fb3800aa660 2023-08-27T11:28:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.324+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c00cb90 con 0x7fb3800aa660 2023-08-27T11:28:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.324+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3800c1140 con 0x7fb3800aa660 2023-08-27T11:28:58.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.324+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb380150ec0 con 0x7fb3800aa660 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.325+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38004ee70 con 0x7fb3800aa660 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.326+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb36c00ccf0 con 0x7fb3800aa660 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.328+0000 7fb37d7fa700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 0x7fb36406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.328+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7fb36c0885e0 con 0x7fb3800aa660 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.328+0000 7fb38499b700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 0x7fb36406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.328+0000 7fb38499b700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 0x7fb36406c5a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb3740090b0 tx=0x7fb37401e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.332+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb36c053960 con 0x7fb3800aa660 2023-08-27T11:28:58.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.586+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb38006c130 con 0x7fb3800aa660 2023-08-27T11:28:58.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.587+0000 7fb37d7fa700 1 -- 172.21.15.43:0/1275159791 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+6066 (secure 0 0 0) 0x7fb36c056f80 con 0x7fb3800aa660 2023-08-27T11:28:58.588 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:58.589 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":135,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124},{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:28:39.024709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8097":{"gid":8097,"name":"d","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2179580288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2179580288},{"type":"v1","addr":"172.21.15.57:6835","nonce":2179580288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":135,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:28:56.129072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:28:58.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.589+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 msgr2=0x7fb36406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.589+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 0x7fb36406c5a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb3740090b0 tx=0x7fb37401e040 comp rx=0 tx=0).stop 2023-08-27T11:28:58.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.589+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 msgr2=0x7fb3800aaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.589+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00eb20 tx=0x7fb36c00ee30 comp rx=0 tx=0).stop 2023-08-27T11:28:58.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 shutdown_connections 2023-08-27T11:28:58.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb36406a0e0 0x7fb36406c5a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb38014f3d0 0x7fb38014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb370003a00 0x7fb3801eaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 --2- 172.21.15.43:0/1275159791 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3800aa660 0x7fb3800aaae0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 >> 172.21.15.43:0/1275159791 conn(0x7fb3800ab820 msgr2=0x7fb38014d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:58.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 shutdown_connections 2023-08-27T11:28:58.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.590+0000 7fb386bff700 1 -- 172.21.15.43:0/1275159791 wait complete. 2023-08-27T11:28:58.594 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 135 2023-08-27T11:28:58.610 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 9, "epoch": 135, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 9, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:35.519882+0000", "damaged": [], "data_pools": [ 20 ], "enabled": true, "epoch": 130, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_8097": { "addr": "172.21.15.57:6835/2179580288", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2179580288, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2179580288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8097, "incarnation": 126, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 19, "modified": "2023-08-27T11:28:39.024709+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 8097 } } }, { "id": 10, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:52.606401+0000", "damaged": [], "data_pools": [ 22 ], "enabled": true, "epoch": 135, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs2", "in": [ 0 ], "info": { "gid_8091": { "addr": "172.21.15.43:6837/1923359880", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1923359880, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1923359880, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8091, "incarnation": 131, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 21, "modified": "2023-08-27T11:28:56.129072+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 8091 } } } ], "standbys": [ { "addr": "172.21.15.43:6835/1663361937", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1663361937, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 1663361937, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 124, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6770, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/3257371578", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 3257371578, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 3257371578, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 125, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6776, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:28:58.611 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:28:58.611 INFO:tasks.cephfs.test_failover:current = [{'gid': 6770, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6835/1663361937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1663361937}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 1663361937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 124}, {'gid': 6776, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 125}, {'gid': 8091, 'name': 'c', 'rank': 0, 'incarnation': 131, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6837/1923359880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1923359880}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1923359880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 8097, 'name': 'd', 'rank': 0, 'incarnation': 126, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2179580288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2179580288}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2179580288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:28:58.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:28:58.813 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.812+0000 7f7051dff700 1 Processor -- start 2023-08-27T11:28:58.814 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.812+0000 7f7051dff700 1 -- start start 2023-08-27T11:28:58.815 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f704c154da0 0x7f704c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f704c06dff0 0x7f704c06e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c0c2820 con 0x7f704c154da0 2023-08-27T11:28:58.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c0c1750 con 0x7f704c06dff0 2023-08-27T11:28:58.816 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.813+0000 7f7051dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c0c1a30 con 0x7f704c14e380 2023-08-27T11:28:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f704c154da0 0x7f704c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f704c154da0 0x7f704c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58482/0 (socket says 172.21.15.43:58482) 2023-08-27T11:28:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 -- 172.21.15.43:0/3382496590 learned_addr learned my addr 172.21.15.43:0/3382496590 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704bfff700 1 --2- 172.21.15.43:0/3382496590 >> v2:172.21.15.57:3300/0 conn(0x7f704c06dff0 0x7f704c06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.817 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704b7fe700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 -- 172.21.15.43:0/3382496590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 msgr2=0x7f704c06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:58.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 -- 172.21.15.43:0/3382496590 >> v2:172.21.15.57:3300/0 conn(0x7f704c06dff0 msgr2=0x7f704c06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:58.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 --2- 172.21.15.43:0/3382496590 >> v2:172.21.15.57:3300/0 conn(0x7f704c06dff0 0x7f704c06e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 -- 172.21.15.43:0/3382496590 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c0c1d10 con 0x7f704c154da0 2023-08-27T11:28:58.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.814+0000 7f704affd700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c154da0 0x7f704c158200 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f704c0c2c00 tx=0x7f7040009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd17c4b9d28cdaeb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f704a7fc700 1 -- 172.21.15.43:0/3382496590 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000b870 con 0x7f704c154da0 2023-08-27T11:28:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f704a7fc700 1 -- 172.21.15.43:0/3382496590 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704000b9d0 con 0x7f704c154da0 2023-08-27T11:28:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f704a7fc700 1 -- 172.21.15.43:0/3382496590 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704000bd60 con 0x7f704c154da0 2023-08-27T11:28:58.820 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 -- 172.21.15.43:0/3382496590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c154da0 msgr2=0x7f704c158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c154da0 0x7f704c158200 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f704c0c2c00 tx=0x7f7040009bd0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 -- 172.21.15.43:0/3382496590 shutdown_connections 2023-08-27T11:28:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 --2- 172.21.15.43:0/3382496590 >> v2:172.21.15.57:3300/0 conn(0x7f704c06dff0 0x7f704c06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 --2- 172.21.15.43:0/3382496590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c154da0 0x7f704c158200 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 -- 172.21.15.43:0/3382496590 >> 172.21.15.43:0/3382496590 conn(0x7f704c0c2c30 msgr2=0x7f704c0c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:58.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.815+0000 7f7051dff700 1 -- 172.21.15.43:0/3382496590 shutdown_connections 2023-08-27T11:28:58.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.816+0000 7f7051dff700 1 -- 172.21.15.43:0/3382496590 wait complete. 2023-08-27T11:28:58.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.818+0000 7f7051dff700 1 Processor -- start 2023-08-27T11:28:58.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.818+0000 7f7051dff700 1 -- start start 2023-08-27T11:28:58.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c1e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c154da0 0x7f704c14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c148ad0 con 0x7f704c06dff0 2023-08-27T11:28:58.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c1e99b0 con 0x7f704c154da0 2023-08-27T11:28:58.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.819+0000 7f7051dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c1edb50 con 0x7f704c14e380 2023-08-27T11:28:58.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58492/0 (socket says 172.21.15.43:58492) 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 -- 172.21.15.43:0/1477747747 learned_addr learned my addr 172.21.15.43:0/1477747747 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704bfff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c154da0 0x7f704c14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704affd700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c1e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 -- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 msgr2=0x7f704c1e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c1e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.827 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 -- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c154da0 msgr2=0x7f704c14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c154da0 0x7f704c14ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 -- 172.21.15.43:0/1477747747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040009550 con 0x7f704c06dff0 2023-08-27T11:28:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f704b7fe700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f703c00e810 tx=0x7f703c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c013610 con 0x7f704c06dff0 2023-08-27T11:28:58.828 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.820+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c013770 con 0x7f704c06dff0 2023-08-27T11:28:58.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.821+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c013b20 con 0x7f704c06dff0 2023-08-27T11:28:58.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.821+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c1ed620 con 0x7f704c06dff0 2023-08-27T11:28:58.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.821+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c1ed870 con 0x7f704c06dff0 2023-08-27T11:28:58.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.822+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704c1e96a0 con 0x7f704c06dff0 2023-08-27T11:28:58.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.823+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f703c013c80 con 0x7f704c06dff0 2023-08-27T11:28:58.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.823+0000 7f7033fff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 0x7f703806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:58.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.824+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f703c0885a0 con 0x7f704c06dff0 2023-08-27T11:28:58.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.824+0000 7f704affd700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 0x7f703806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:58.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.824+0000 7f704affd700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 0x7f703806c5a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7040014040 tx=0x7f7040008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:58.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:58.828+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f703c0538a0 con 0x7f704c06dff0 2023-08-27T11:28:59.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.083+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f704c1e9c20 con 0x7f704c06dff0 2023-08-27T11:28:59.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.083+0000 7f7033fff700 1 -- 172.21.15.43:0/1477747747 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+6066 (secure 0 0 0) 0x7f703c056ec0 con 0x7f704c06dff0 2023-08-27T11:28:59.085 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:28:59.085 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":135,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124},{"gid":6776,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:28:39.024709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8097},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8097":{"gid":8097,"name":"d","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/2179580288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":2179580288},{"type":"v1","addr":"172.21.15.57:6835","nonce":2179580288}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":135,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:28:56.129072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:28:59.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 msgr2=0x7f703806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 0x7f703806c5a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7040014040 tx=0x7f7040008030 comp rx=0 tx=0).stop 2023-08-27T11:28:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 msgr2=0x7f704c14ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f703c00e810 tx=0x7f703c00ebd0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 shutdown_connections 2023-08-27T11:28:59.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f703806a0e0 0x7f703806c5a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c154da0 0x7f704c14ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f704c06dff0 0x7f704c14ce60 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 --2- 172.21.15.43:0/1477747747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f704c14e380 0x7f704c1e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 >> 172.21.15.43:0/1477747747 conn(0x7f704c0c2c30 msgr2=0x7f704c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:59.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 shutdown_connections 2023-08-27T11:28:59.090 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.086+0000 7f7051dff700 1 -- 172.21.15.43:0/1477747747 wait complete. 2023-08-27T11:28:59.090 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 135 2023-08-27T11:28:59.106 INFO:tasks.cephfs.test_failover:status = { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 9, "epoch": 135, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 9, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:35.519882+0000", "damaged": [], "data_pools": [ 20 ], "enabled": true, "epoch": 130, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_8097": { "addr": "172.21.15.57:6835/2179580288", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 2179580288, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 2179580288, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8097, "incarnation": 126, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 19, "modified": "2023-08-27T11:28:39.024709+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 8097 } } }, { "id": 10, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:52.606401+0000", "damaged": [], "data_pools": [ 22 ], "enabled": true, "epoch": 135, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs2", "in": [ 0 ], "info": { "gid_8091": { "addr": "172.21.15.43:6837/1923359880", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1923359880, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1923359880, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8091, "incarnation": 131, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 7 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 21, "modified": "2023-08-27T11:28:56.129072+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 8091 } } } ], "standbys": [ { "addr": "172.21.15.43:6835/1663361937", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1663361937, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 1663361937, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 124, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6770, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.57:6834/3257371578", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 3257371578, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 3257371578, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 125, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6776, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:28:59.106 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': -1, 'name': 'a'}, {'join_fscid': -1, 'name': 'b'}, {'join_fscid': -1, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:28:59.107 INFO:tasks.cephfs.test_failover:current = [{'gid': 6770, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.43:6835/1663361937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1663361937}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 1663361937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 124}, {'gid': 6776, 'name': 'b', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 125}, {'gid': 8091, 'name': 'c', 'rank': 0, 'incarnation': 131, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.43:6837/1923359880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1923359880}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1923359880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 8097, 'name': 'd', 'rank': 0, 'incarnation': 126, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/2179580288', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 2179580288}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 2179580288}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}] 2023-08-27T11:28:59.107 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.a mds_join_fs cephfs2 2023-08-27T11:28:59.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.311+0000 7f7f247ff700 1 Processor -- start 2023-08-27T11:28:59.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.311+0000 7f7f247ff700 1 -- start start 2023-08-27T11:28:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f247ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7f1c0c9690 0x7f7f1c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f247ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c0c80c0 con 0x7f7f1c0ac410 2023-08-27T11:28:59.314 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f247ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c1552c0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f247ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c1555a0 con 0x7f7f1c0c9690 2023-08-27T11:28:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f21d9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7f1c0ac410 0x7f7f1c0c8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36980/0 (socket says 172.21.15.43:36980) 2023-08-27T11:28:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f21d9a700 1 -- 172.21.15.43:0/2517813999 learned_addr learned my addr 172.21.15.43:0/2517813999 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:59.315 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f22d9c700 1 --2- 172.21.15.43:0/2517813999 >> v2:172.21.15.43:3300/0 conn(0x7f7f1c0c9690 0x7f7f1c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f21599700 1 -- 172.21.15.43:0/2517813999 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947450870 0 0) 0x7f7f1c0c80c0 con 0x7f7f1c0ac410 2023-08-27T11:28:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f22d9c700 1 -- 172.21.15.43:0/2517813999 >> v1:172.21.15.57:6789/0 conn(0x7f7f1c0c49f0 legacy=0x7f7f1c151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f22d9c700 1 -- 172.21.15.43:0/2517813999 >> v1:172.21.15.43:6789/0 conn(0x7f7f1c0ac410 legacy=0x7f7f1c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.313+0000 7f7f22d9c700 1 -- 172.21.15.43:0/2517813999 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0c8360 con 0x7f7f1c0c9690 2023-08-27T11:28:59.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f22d9c700 1 --2- 172.21.15.43:0/2517813999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c15fef0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009d90 tx=0x7f7f1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00837f897081fae server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f21599700 1 -- 172.21.15.43:0/2517813999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400e070 con 0x7f7f1c0c9690 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f21599700 1 -- 172.21.15.43:0/2517813999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1400bbd0 con 0x7f7f1c0c9690 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f21599700 1 -- 172.21.15.43:0/2517813999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14012430 con 0x7f7f1c0c9690 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f247ff700 1 -- 172.21.15.43:0/2517813999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c9690 msgr2=0x7f7f1c15fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f247ff700 1 --2- 172.21.15.43:0/2517813999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c15fef0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009d90 tx=0x7f7f1400b330 comp rx=0 tx=0).stop 2023-08-27T11:28:59.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.314+0000 7f7f247ff700 1 -- 172.21.15.43:0/2517813999 shutdown_connections 2023-08-27T11:28:59.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.315+0000 7f7f247ff700 1 --2- 172.21.15.43:0/2517813999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c15fef0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.315+0000 7f7f247ff700 1 -- 172.21.15.43:0/2517813999 >> 172.21.15.43:0/2517813999 conn(0x7f7f1c0ab8f0 msgr2=0x7f7f1c0abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:59.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.315+0000 7f7f247ff700 1 -- 172.21.15.43:0/2517813999 shutdown_connections 2023-08-27T11:28:59.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.315+0000 7f7f247ff700 1 -- 172.21.15.43:0/2517813999 wait complete. 2023-08-27T11:28:59.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.316+0000 7f7f247ff700 1 Processor -- start 2023-08-27T11:28:59.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.316+0000 7f7f247ff700 1 -- start start 2023-08-27T11:28:59.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 0x7f7f1c0c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c0c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1e9a90 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0aa9b0 con 0x7f7f1c0c9690 2023-08-27T11:28:59.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f247ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c153cc0 con 0x7f7f1c0ac410 2023-08-27T11:28:59.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.317+0000 7f7f21d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36106/0 (socket says 172.21.15.43:36106) 2023-08-27T11:28:59.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 -- 172.21.15.43:0/1449001932 learned_addr learned my addr 172.21.15.43:0/1449001932 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f22d9c700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c0c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f2259b700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 0x7f7f1c0c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 -- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 msgr2=0x7f7f1c0c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 0x7f7f1c0c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 -- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f1c0c9690 msgr2=0x7f7f1c0c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c0c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 -- 172.21.15.43:0/1449001932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f14009a70 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f2259b700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 0x7f7f1c0c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:28:59.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f21d9a700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001eb0 tx=0x7f7f0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004c80 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c004de0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c007310 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.318+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c153420 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.319+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1539e0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.320+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0afe10 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.320+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f0c007470 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.321+0000 7f7f12ffd700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 0x7f7f0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.321+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f7f0c088590 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.322+0000 7f7f2259b700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 0x7f7f0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.322+0000 7f7f2259b700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 0x7f7f0006c5a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c151f20 tx=0x7f7f18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.326+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7f0c0539b0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.534+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f7f1c1e9bd0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.538+0000 7f7f12ffd700 1 -- 172.21.15.43:0/1449001932 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v44)=0 v44) v1 ==== 117+0+0 (secure 0 0 0) 0x7f7f1c1e9bd0 con 0x7f7f1c0c49f0 2023-08-27T11:28:59.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 msgr2=0x7f7f0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 0x7f7f0006c5a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c151f20 tx=0x7f7f18009040 comp rx=0 tx=0).stop 2023-08-27T11:28:59.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 msgr2=0x7f7f1c155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001eb0 tx=0x7f7f0c00c8b0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 shutdown_connections 2023-08-27T11:28:59.543 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f0006a0e0 0x7f7f0006c5a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7f1c0c9690 0x7f7f1c0c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7f1c0ac410 0x7f7f1c0c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 --2- 172.21.15.43:0/1449001932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7f1c0c49f0 0x7f7f1c155950 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 >> 172.21.15.43:0/1449001932 conn(0x7f7f1c0ab8f0 msgr2=0x7f7f1c06a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 shutdown_connections 2023-08-27T11:28:59.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.541+0000 7f7f247ff700 1 -- 172.21.15.43:0/1449001932 wait complete. 2023-08-27T11:28:59.561 INFO:tasks.cephfs.test_failover:assigning affinity to cephfs2 for active mds (mds.c) 2023-08-27T11:28:59.561 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds.c mds_join_fs cephfs2 2023-08-27T11:28:59.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.764+0000 7f2382dff700 1 Processor -- start 2023-08-27T11:28:59.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.764+0000 7f2382dff700 1 -- start start 2023-08-27T11:28:59.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2382dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f237c0c5230 0x7f237c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2382dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2382dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c1561f0 con 0x7f237c06c5e0 2023-08-27T11:28:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2382dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c152290 con 0x7f237c0c5230 2023-08-27T11:28:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2382dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c06d7a0 con 0x7f237c155880 2023-08-27T11:28:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f237bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f237c06c5e0 0x7f237c0aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36988/0 (socket says 172.21.15.43:36988) 2023-08-27T11:28:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2380b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f237c0c5230 0x7f237c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f237bfff700 1 -- 172.21.15.43:0/146336461 learned_addr learned my addr 172.21.15.43:0/146336461 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:28:59.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f238139c700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2380b9b700 1 -- 172.21.15.43:0/146336461 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 msgr2=0x7f237c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:28:59.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2380b9b700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f2380b9b700 1 -- 172.21.15.43:0/146336461 >> v1:172.21.15.43:6789/0 conn(0x7f237c06c5e0 legacy=0x7f237c0aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.767+0000 7f2380b9b700 1 -- 172.21.15.43:0/146336461 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c152550 con 0x7f237c0c5230 2023-08-27T11:28:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.766+0000 7f237b7fe700 1 -- 172.21.15.43:0/146336461 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646045303 0 0) 0x7f237c1561f0 con 0x7f237c06c5e0 2023-08-27T11:28:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.767+0000 7f2380b9b700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c0c5230 0x7f237c06d1c0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2370009840 tx=0x7f2370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa7316cb4a17fd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.767+0000 7f237b7fe700 1 -- 172.21.15.43:0/146336461 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011830 con 0x7f237c0c5230 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.767+0000 7f237b7fe700 1 -- 172.21.15.43:0/146336461 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370011990 con 0x7f237c0c5230 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.767+0000 7f237b7fe700 1 -- 172.21.15.43:0/146336461 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370011d20 con 0x7f237c0c5230 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 -- 172.21.15.43:0/146336461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c0c5230 msgr2=0x7f237c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c0c5230 0x7f237c06d1c0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f2370009840 tx=0x7f2370009b50 comp rx=0 tx=0).stop 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 -- 172.21.15.43:0/146336461 shutdown_connections 2023-08-27T11:28:59.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 --2- 172.21.15.43:0/146336461 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c0c5230 0x7f237c06d1c0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 -- 172.21.15.43:0/146336461 >> 172.21.15.43:0/146336461 conn(0x7f237c0c5b10 msgr2=0x7f237c0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:28:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 -- 172.21.15.43:0/146336461 shutdown_connections 2023-08-27T11:28:59.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.768+0000 7f2382dff700 1 -- 172.21.15.43:0/146336461 wait complete. 2023-08-27T11:28:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.770+0000 7f2382dff700 1 Processor -- start 2023-08-27T11:28:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.770+0000 7f2382dff700 1 -- start start 2023-08-27T11:28:59.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.771+0000 7f2382dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2382dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f237c0c5230 0x7f237c0a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2382dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2382dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c070640 con 0x7f237c06c5e0 2023-08-27T11:28:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2382dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c14d3a0 con 0x7f237c0c5230 2023-08-27T11:28:59.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2382dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c070010 con 0x7f237c155880 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36116/0 (socket says 172.21.15.43:36116) 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 -- 172.21.15.43:0/2543289378 learned_addr learned my addr 172.21.15.43:0/2543289378 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 -- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 msgr2=0x7f237c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 -- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f237c0c5230 msgr2=0x7f237c0a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:28:59.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f237c0c5230 0x7f237c0a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:28:59.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 -- 172.21.15.43:0/2543289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700094a0 con 0x7f237c06c5e0 2023-08-27T11:28:59.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.772+0000 7f2380b9b700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2370009fd0 tx=0x7f2370004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.773+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700036a0 con 0x7f237c06c5e0 2023-08-27T11:28:59.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.773+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237001f070 con 0x7f237c06c5e0 2023-08-27T11:28:59.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.773+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370003a40 con 0x7f237c06c5e0 2023-08-27T11:28:59.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.773+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c1e5430 con 0x7f237c06c5e0 2023-08-27T11:28:59.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.773+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c1e85a0 con 0x7f237c06c5e0 2023-08-27T11:28:59.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.774+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c04ee70 con 0x7f237c06c5e0 2023-08-27T11:28:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.775+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2370003ba0 con 0x7f237c06c5e0 2023-08-27T11:28:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.776+0000 7f23797fa700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 0x7f236006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:28:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.776+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f2370021070 con 0x7f237c06c5e0 2023-08-27T11:28:59.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.776+0000 7f237bfff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 0x7f236006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:28:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.777+0000 7f237bfff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 0x7f236006c570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f23680011e0 tx=0x7f23680079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:28:59.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.780+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f23700554d0 con 0x7f237c06c5e0 2023-08-27T11:28:59.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.992+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mds_join_fs}] v 0) v1 -- 0x7f237c06ca80 con 0x7f237c06c5e0 2023-08-27T11:28:59.998 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.997+0000 7f23797fa700 1 -- 172.21.15.43:0/2543289378 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_join_fs}]=0 v45)=0 v45) v1 ==== 117+0+0 (secure 0 0 0) 0x7f23700150b0 con 0x7f237c06c5e0 2023-08-27T11:29:00.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 msgr2=0x7f236006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 0x7f236006c570 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f23680011e0 tx=0x7f23680079b0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 msgr2=0x7f237c1e4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2370009fd0 tx=0x7f2370004750 comp rx=0 tx=0).stop 2023-08-27T11:29:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 shutdown_connections 2023-08-27T11:29:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f236006a0b0 0x7f236006c570 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f237c155880 0x7f237c154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f237c06c5e0 0x7f237c1e4ef0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 --2- 172.21.15.43:0/2543289378 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f237c0c5230 0x7f237c0a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 >> 172.21.15.43:0/2543289378 conn(0x7f237c0c5b10 msgr2=0x7f237c0c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:00.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:28:59.999+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 shutdown_connections 2023-08-27T11:29:00.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.000+0000 7f2382dff700 1 -- 172.21.15.43:0/2543289378 wait complete. 2023-08-27T11:29:00.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 9:0 2023-08-27T11:29:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.226+0000 7f8cb11ff700 1 Processor -- start 2023-08-27T11:29:00.228 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.226+0000 7f8cb11ff700 1 -- start start 2023-08-27T11:29:00.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cb11ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cac0c51a0 0x7f8cac0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cb11ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8cac0c15e0 0x7f8cac0c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cb11ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0c5ae0 con 0x7f8cac151910 2023-08-27T11:29:00.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cb11ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0c69f0 con 0x7f8cac0c15e0 2023-08-27T11:29:00.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cb11ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0c1190 con 0x7f8cac0c51a0 2023-08-27T11:29:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.227+0000 7f8cab59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8cac0c15e0 0x7f8cac0c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8cac0c15e0 0x7f8cac0c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36120/0 (socket says 172.21.15.43:36120) 2023-08-27T11:29:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8caa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8cac0c51a0 0x7f8cac0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 -- 172.21.15.43:0/1350868557 learned_addr learned my addr 172.21.15.43:0/1350868557 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:00.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 -- 172.21.15.43:0/1350868557 >> v2:172.21.15.57:3300/0 conn(0x7f8cac0c51a0 msgr2=0x7f8cac0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 --2- 172.21.15.43:0/1350868557 >> v2:172.21.15.57:3300/0 conn(0x7f8cac0c51a0 0x7f8cac0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 -- 172.21.15.43:0/1350868557 >> v1:172.21.15.57:6789/0 conn(0x7f8cac151910 legacy=0x7f8cac157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 -- 172.21.15.43:0/1350868557 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac072900 con 0x7f8cac0c15e0 2023-08-27T11:29:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.228+0000 7f8cab59e700 1 --2- 172.21.15.43:0/1350868557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c15e0 0x7f8cac0c64b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0c8ac0 tx=0x7f8ca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fb516a75516dac server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8ca9d9b700 1 -- 172.21.15.43:0/1350868557 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400e070 con 0x7f8cac0c15e0 2023-08-27T11:29:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8ca9d9b700 1 -- 172.21.15.43:0/1350868557 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca400b910 con 0x7f8cac0c15e0 2023-08-27T11:29:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8ca9d9b700 1 -- 172.21.15.43:0/1350868557 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400bcc0 con 0x7f8cac0c15e0 2023-08-27T11:29:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 -- 172.21.15.43:0/1350868557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c15e0 msgr2=0x7f8cac0c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/1350868557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c15e0 0x7f8cac0c64b0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8cac0c8ac0 tx=0x7f8ca400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:00.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 -- 172.21.15.43:0/1350868557 shutdown_connections 2023-08-27T11:29:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/1350868557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c15e0 0x7f8cac0c64b0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/1350868557 >> v2:172.21.15.57:3300/0 conn(0x7f8cac0c51a0 0x7f8cac0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 -- 172.21.15.43:0/1350868557 >> 172.21.15.43:0/1350868557 conn(0x7f8cac0a9740 msgr2=0x7f8cac0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 -- 172.21.15.43:0/1350868557 shutdown_connections 2023-08-27T11:29:00.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.229+0000 7f8cb11ff700 1 -- 172.21.15.43:0/1350868557 wait complete. 2023-08-27T11:29:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.231+0000 7f8cb11ff700 1 Processor -- start 2023-08-27T11:29:00.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.231+0000 7f8cb11ff700 1 -- start start 2023-08-27T11:29:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 0x7f8cac14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8cac151910 0x7f8cac152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac152280 con 0x7f8cac0c51a0 2023-08-27T11:29:00.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac1ea860 con 0x7f8cac0c15e0 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8cb11ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac1eab40 con 0x7f8cac151910 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8caa59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.232+0000 7f8caa59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36126/0 (socket says 172.21.15.43:36126) 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 -- 172.21.15.43:0/3622990067 learned_addr learned my addr 172.21.15.43:0/3622990067 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caad9d700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 0x7f8cac14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8cab59e700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8cac151910 0x7f8cac152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 -- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8cac151910 msgr2=0x7f8cac152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8cac151910 0x7f8cac152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 -- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 msgr2=0x7f8cac14b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 0x7f8cac14b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 -- 172.21.15.43:0/3622990067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4009b30 con 0x7f8cac0c51a0 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caad9d700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 0x7f8cac14b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8caa59c700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e870 tx=0x7f8ca000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0009590 con 0x7f8cac0c51a0 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca000ee70 con 0x7f8cac0c51a0 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac1524d0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.233+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000ca50 con 0x7f8cac0c51a0 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.234+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac14bdf0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.234+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac1529f0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.235+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ca000cbb0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.236+0000 7f8c937fe700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.236+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6918+0+0 (secure 0 0 0) 0x7f8ca0088950 con 0x7f8cac0c51a0 2023-08-27T11:29:00.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.237+0000 7f8caad9d700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.237+0000 7f8caad9d700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c000f60 tx=0x7f8c9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.241+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8cac1529f0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.534+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "9:0"} v 0) v1 -- 0x7f8cac1529f0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.536 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:29:00.535+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:29:00.540 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.539+0000 7f8c937fe700 1 -- 172.21.15.43:0/3622990067 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "9:0"}]=0 failed mds gid 8097 v136) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8cac1529f0 con 0x7f8cac0c51a0 2023-08-27T11:29:00.544 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.542+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 msgr2=0x7f8c9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.542+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c000f60 tx=0x7f8c9c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.542+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 msgr2=0x7f8cac1548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.542+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e870 tx=0x7f8ca000ec30 comp rx=0 tx=0).stop 2023-08-27T11:29:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 shutdown_connections 2023-08-27T11:29:00.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8c9806a0e0 0x7f8c9806c5a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8cac151910 0x7f8cac152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8cac0c15e0 0x7f8cac14b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 --2- 172.21.15.43:0/3622990067 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cac0c51a0 0x7f8cac1548a0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 >> 172.21.15.43:0/3622990067 conn(0x7f8cac0a9740 msgr2=0x7f8cac1511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:00.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 shutdown_connections 2023-08-27T11:29:00.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.543+0000 7f8cb11ff700 1 -- 172.21.15.43:0/3622990067 wait complete. 2023-08-27T11:29:00.547 INFO:teuthology.orchestra.run.smithi043.stderr:failed mds gid 8097 2023-08-27T11:29:00.547 INFO:tasks.ceph.mds.d.smithi057.stderr: -541> 2023-08-27T11:28:40.973+0000 7f2275df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:29:00.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:00.598 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:29:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.768+0000 7efec81ff700 1 Processor -- start 2023-08-27T11:29:00.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.768+0000 7efec81ff700 1 -- start start 2023-08-27T11:29:00.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec81ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efec00c4630 0x7efec00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec81ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec006c4e0 con 0x7efec006ad70 2023-08-27T11:29:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec81ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec0155370 con 0x7efec0151a90 2023-08-27T11:29:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec81ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec00c82c0 con 0x7efec00c4630 2023-08-27T11:29:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec679c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7efec006ad70 0x7efec006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36994/0 (socket says 172.21.15.43:36994) 2023-08-27T11:29:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec679c700 1 -- 172.21.15.43:0/1040718486 learned_addr learned my addr 172.21.15.43:0/1040718486 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:00.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.769+0000 7efec579a700 1 --2- 172.21.15.43:0/1040718486 >> v2:172.21.15.57:3300/0 conn(0x7efec00c4630 0x7efec00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170903087 0 0) 0x7efec006c4e0 con 0x7efec006ad70 2023-08-27T11:29:00.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeac0035b0 con 0x7efec006ad70 2023-08-27T11:29:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091583919 0 0) 0x7efec0155370 con 0x7efec0151a90 2023-08-27T11:29:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec006c4e0 con 0x7efec0151a90 2023-08-27T11:29:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec579a700 1 -- 172.21.15.43:0/1040718486 >> v1:172.21.15.57:6789/0 conn(0x7efec0151a90 legacy=0x7efec00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec579a700 1 -- 172.21.15.43:0/1040718486 >> v1:172.21.15.43:6789/0 conn(0x7efec006ad70 legacy=0x7efec006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec579a700 1 -- 172.21.15.43:0/1040718486 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0151e70 con 0x7efec00c4630 2023-08-27T11:29:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec579a700 1 --2- 172.21.15.43:0/1040718486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec00c4a90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009840 tx=0x7efeb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d91749e5aba277b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011830 con 0x7efec00c4630 2023-08-27T11:29:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0011990 con 0x7efec00c4630 2023-08-27T11:29:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.770+0000 7efec4f99700 1 -- 172.21.15.43:0/1040718486 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011d20 con 0x7efec00c4630 2023-08-27T11:29:00.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 -- 172.21.15.43:0/1040718486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 msgr2=0x7efec00c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 --2- 172.21.15.43:0/1040718486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec00c4a90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009840 tx=0x7efeb0009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 -- 172.21.15.43:0/1040718486 shutdown_connections 2023-08-27T11:29:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 --2- 172.21.15.43:0/1040718486 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec00c4a90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 -- 172.21.15.43:0/1040718486 >> 172.21.15.43:0/1040718486 conn(0x7efec00ab820 msgr2=0x7efec00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:00.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 -- 172.21.15.43:0/1040718486 shutdown_connections 2023-08-27T11:29:00.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.771+0000 7efec81ff700 1 -- 172.21.15.43:0/1040718486 wait complete. 2023-08-27T11:29:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.773+0000 7efec81ff700 1 Processor -- start 2023-08-27T11:29:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.773+0000 7efec81ff700 1 -- start start 2023-08-27T11:29:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 0x7efec014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec014cb90 con 0x7efec006ad70 2023-08-27T11:29:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec014bef0 con 0x7efec00c4630 2023-08-27T11:29:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec81ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec01542c0 con 0x7efec0151a90 2023-08-27T11:29:00.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36132/0 (socket says 172.21.15.43:36132) 2023-08-27T11:29:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 -- 172.21.15.43:0/3568132589 learned_addr learned my addr 172.21.15.43:0/3568132589 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec579a700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec679c700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 0x7efec014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 -- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 msgr2=0x7efec014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 0x7efec014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 -- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 msgr2=0x7efec0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:00.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:00.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec5f9b700 1 -- 172.21.15.43:0/3568132589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00094a0 con 0x7efec006ad70 2023-08-27T11:29:00.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.774+0000 7efec679c700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 0x7efec014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:00.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efec5f9b700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c500 tx=0x7efebc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0052d0 con 0x7efec006ad70 2023-08-27T11:29:00.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc005450 con 0x7efec006ad70 2023-08-27T11:29:00.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec01edcc0 con 0x7efec006ad70 2023-08-27T11:29:00.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0038c0 con 0x7efec006ad70 2023-08-27T11:29:00.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.775+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec0153d00 con 0x7efec006ad70 2023-08-27T11:29:00.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.776+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec004ee70 con 0x7efec006ad70 2023-08-27T11:29:00.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.777+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efebc003a20 con 0x7efec006ad70 2023-08-27T11:29:00.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.778+0000 7efeb67fc700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 0x7efea406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:00.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.778+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7efebc087d50 con 0x7efec006ad70 2023-08-27T11:29:00.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.778+0000 7efec579a700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 0x7efea406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:00.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.779+0000 7efec579a700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 0x7efea406c5a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fd0 tx=0x7efeb001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:00.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:00.782+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efebc053080 con 0x7efec006ad70 2023-08-27T11:29:01.042 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.041+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efec006c130 con 0x7efec006ad70 2023-08-27T11:29:01.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.042+0000 7efeb67fc700 1 -- 172.21.15.43:0/3568132589 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+5276 (secure 0 0 0) 0x7efebc0566a0 con 0x7efec006ad70 2023-08-27T11:29:01.043 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:01.044 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":137,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:00.540746+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:replay","state_seq":1,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":135,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:28:56.129072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":7,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:01.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 msgr2=0x7efea406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:01.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 0x7efea406c5a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009fd0 tx=0x7efeb001c040 comp rx=0 tx=0).stop 2023-08-27T11:29:01.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 msgr2=0x7efec00a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:01.046 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c500 tx=0x7efebc00c810 comp rx=0 tx=0).stop 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 shutdown_connections 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efea406a0e0 0x7efea406c5a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efec0151a90 0x7efec014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efec006ad70 0x7efec00a9610 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 --2- 172.21.15.43:0/3568132589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efec00c4630 0x7efec0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:01.047 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 >> 172.21.15.43:0/3568132589 conn(0x7efec00ab820 msgr2=0x7efec014eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:01.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 shutdown_connections 2023-08-27T11:29:01.048 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:01.044+0000 7efec81ff700 1 -- 172.21.15.43:0/3568132589 wait complete. 2023-08-27T11:29:01.048 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 137 2023-08-27T11:29:01.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 137, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:28:35.519882+0000', 'modified': '2023-08-27T11:29:00.540746+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 129, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6776': {'gid': 6776, 'name': 'b', 'rank': 0, 'incarnation': 137, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:01.466 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6776:up:replay 2023-08-27T11:29:02.468 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:02.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.680+0000 7f5bedfff700 1 Processor -- start 2023-08-27T11:29:02.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.680+0000 7f5bedfff700 1 -- start start 2023-08-27T11:29:02.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.681+0000 7f5bedfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5be814e960 0x7f5be80a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:02.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5bedfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be8154d00 con 0x7f5be80a79c0 2023-08-27T11:29:02.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5bedfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be8154fe0 con 0x7f5be80c50d0 2023-08-27T11:29:02.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5bedfff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be80baf30 con 0x7f5be814e960 2023-08-27T11:29:02.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5be814e960 0x7f5be80a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:02.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5be814e960 0x7f5be80a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36142/0 (socket says 172.21.15.43:36142) 2023-08-27T11:29:02.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 -- 172.21.15.43:0/3420211956 learned_addr learned my addr 172.21.15.43:0/3420211956 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:02.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 -- 172.21.15.43:0/3420211956 >> v1:172.21.15.57:6789/0 conn(0x7f5be80c50d0 legacy=0x7f5be80c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 -- 172.21.15.43:0/3420211956 >> v1:172.21.15.43:6789/0 conn(0x7f5be80a79c0 legacy=0x7f5be80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.682+0000 7f5be77fe700 1 -- 172.21.15.43:0/3420211956 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be81552c0 con 0x7f5be814e960 2023-08-27T11:29:02.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5be77fe700 1 --2- 172.21.15.43:0/3420211956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be80a7480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80098f0 tx=0x7f5bd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c0eef0bc0e3f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:02.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5be6ffd700 1 -- 172.21.15.43:0/3420211956 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800b8a0 con 0x7f5be814e960 2023-08-27T11:29:02.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5be6ffd700 1 -- 172.21.15.43:0/3420211956 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800ba00 con 0x7f5be814e960 2023-08-27T11:29:02.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5be6ffd700 1 -- 172.21.15.43:0/3420211956 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800bd90 con 0x7f5be814e960 2023-08-27T11:29:02.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5bedfff700 1 -- 172.21.15.43:0/3420211956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 msgr2=0x7f5be80a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.683+0000 7f5bedfff700 1 --2- 172.21.15.43:0/3420211956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be80a7480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80098f0 tx=0x7f5bd8009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:02.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.684+0000 7f5bedfff700 1 -- 172.21.15.43:0/3420211956 shutdown_connections 2023-08-27T11:29:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.684+0000 7f5bedfff700 1 --2- 172.21.15.43:0/3420211956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be80a7480 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.684+0000 7f5bedfff700 1 -- 172.21.15.43:0/3420211956 >> 172.21.15.43:0/3420211956 conn(0x7f5be806aa50 msgr2=0x7f5be80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.684+0000 7f5bedfff700 1 -- 172.21.15.43:0/3420211956 shutdown_connections 2023-08-27T11:29:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.684+0000 7f5bedfff700 1 -- 172.21.15.43:0/3420211956 wait complete. 2023-08-27T11:29:02.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.685+0000 7f5bedfff700 1 Processor -- start 2023-08-27T11:29:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.685+0000 7f5bedfff700 1 -- start start 2023-08-27T11:29:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 0x7f5be80bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 0x7f5be8151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:02.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80aaae0 con 0x7f5be814e960 2023-08-27T11:29:02.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80bd4e0 con 0x7f5be80a79c0 2023-08-27T11:29:02.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.686+0000 7f5bedfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80bcb10 con 0x7f5be80c50d0 2023-08-27T11:29:02.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36148/0 (socket says 172.21.15.43:36148) 2023-08-27T11:29:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 -- 172.21.15.43:0/929069257 learned_addr learned my addr 172.21.15.43:0/929069257 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5bdffff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 0x7f5be8151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be77fe700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 0x7f5be80bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:02.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 -- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 msgr2=0x7f5be8151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 0x7f5be8151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 -- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 msgr2=0x7f5be80bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 0x7f5be80bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 -- 172.21.15.43:0/929069257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009550 con 0x7f5be814e960 2023-08-27T11:29:02.695 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5bdffff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 0x7f5be8151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:02.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be77fe700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 0x7f5be80bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:02.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.687+0000 7f5be7fff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5be000ccb0 tx=0x7f5be000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:02.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.688+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000ad00 con 0x7f5be814e960 2023-08-27T11:29:02.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.688+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000ae60 con 0x7f5be814e960 2023-08-27T11:29:02.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.688+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be80aa560 con 0x7f5be814e960 2023-08-27T11:29:02.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.688+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0003c40 con 0x7f5be814e960 2023-08-27T11:29:02.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.688+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8151f80 con 0x7f5be814e960 2023-08-27T11:29:02.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.689+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be804ee70 con 0x7f5be814e960 2023-08-27T11:29:02.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.690+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5be00050d0 con 0x7f5be814e960 2023-08-27T11:29:02.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.691+0000 7f5be4ff9700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 0x7f5bc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:02.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.691+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f5be0088ad0 con 0x7f5be814e960 2023-08-27T11:29:02.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.691+0000 7f5be77fe700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 0x7f5bc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:02.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.692+0000 7f5be77fe700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 0x7f5bc806c5a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014040 tx=0x7f5bd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:02.699 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.695+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5be0053d70 con 0x7f5be814e960 2023-08-27T11:29:02.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.949+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be80bc8e0 con 0x7f5be814e960 2023-08-27T11:29:02.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.949+0000 7f5be4ff9700 1 -- 172.21.15.43:0/929069257 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) v1 ==== 95+0+6069 (secure 0 0 0) 0x7f5be0057390 con 0x7f5be814e960 2023-08-27T11:29:02.952 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:02.953 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":139,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":139,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:02.547163+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 msgr2=0x7f5bc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 0x7f5bc806c5a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8014040 tx=0x7f5bd8008030 comp rx=0 tx=0).stop 2023-08-27T11:29:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 msgr2=0x7f5be81ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:02.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f5be000ccb0 tx=0x7f5be000a340 comp rx=0 tx=0).stop 2023-08-27T11:29:02.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 shutdown_connections 2023-08-27T11:29:02.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5bc806a0e0 0x7f5bc806c5a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5be814e960 0x7f5be81ed530 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5be80a79c0 0x7f5be80bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 --2- 172.21.15.43:0/929069257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5be80c50d0 0x7f5be8151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 >> 172.21.15.43:0/929069257 conn(0x7f5be806aa50 msgr2=0x7f5be81542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 shutdown_connections 2023-08-27T11:29:02.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:02.952+0000 7f5bedfff700 1 -- 172.21.15.43:0/929069257 wait complete. 2023-08-27T11:29:02.957 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 139 2023-08-27T11:29:03.374 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 139, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:28:35.519882+0000', 'modified': '2023-08-27T11:29:02.547163+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 129, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6776': {'gid': 6776, 'name': 'b', 'rank': 0, 'incarnation': 137, 'state': 'up:rejoin', 'state_seq': 10, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:03.375 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6776:up:rejoin 2023-08-27T11:29:04.376 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:04.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.590+0000 7fbdfc7ff700 1 Processor -- start 2023-08-27T11:29:04.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.590+0000 7fbdfc7ff700 1 -- start start 2023-08-27T11:29:04.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdf4151a90 0x7fbdf40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbdf40c4630 0x7fbdf40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf406ad70 0x7fbdf406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf406c4e0 con 0x7fbdf4151a90 2023-08-27T11:29:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf4155370 con 0x7fbdf40c4630 2023-08-27T11:29:04.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.591+0000 7fbdfc7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4151e70 con 0x7fbdf406ad70 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdf4151a90 0x7fbdf40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbdf4151a90 0x7fbdf40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36164/0 (socket says 172.21.15.43:36164) 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3457199759 learned_addr learned my addr 172.21.15.43:0/3457199759 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfad9c700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf406ad70 0x7fbdf406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdf9d9a700 1 --2- 172.21.15.43:0/3457199759 >> v2:172.21.15.57:3300/0 conn(0x7fbdf40c4630 0x7fbdf40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:04.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3457199759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf406ad70 msgr2=0x7fbdf406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:04.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf406ad70 0x7fbdf406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3457199759 >> v2:172.21.15.57:3300/0 conn(0x7fbdf40c4630 msgr2=0x7fbdf40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:04.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3457199759 >> v2:172.21.15.57:3300/0 conn(0x7fbdf40c4630 0x7fbdf40c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3457199759 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4154480 con 0x7fbdf4151a90 2023-08-27T11:29:04.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.592+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf4151a90 0x7fbdf40c7bb0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c7740 tx=0x7fbdf0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca86fd059ec2b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:04.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdf9599700 1 -- 172.21.15.43:0/3457199759 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011830 con 0x7fbdf4151a90 2023-08-27T11:29:04.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdf9599700 1 -- 172.21.15.43:0/3457199759 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0011990 con 0x7fbdf4151a90 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdf9599700 1 -- 172.21.15.43:0/3457199759 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0011d20 con 0x7fbdf4151a90 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3457199759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf4151a90 msgr2=0x7fbdf40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf4151a90 0x7fbdf40c7bb0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c7740 tx=0x7fbdf0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3457199759 shutdown_connections 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf406ad70 0x7fbdf406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3457199759 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf4151a90 0x7fbdf40c7bb0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3457199759 >> v2:172.21.15.57:3300/0 conn(0x7fbdf40c4630 0x7fbdf40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3457199759 >> 172.21.15.43:0/3457199759 conn(0x7fbdf40ab820 msgr2=0x7fbdf40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:04.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.593+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3457199759 shutdown_connections 2023-08-27T11:29:04.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.594+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3457199759 wait complete. 2023-08-27T11:29:04.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.595+0000 7fbdfc7ff700 1 Processor -- start 2023-08-27T11:29:04.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.595+0000 7fbdfc7ff700 1 -- start start 2023-08-27T11:29:04.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf40c4630 0x7fbdf41e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4151a90 0x7fbdf41e9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf41ece20 con 0x7fbdf406ad70 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf41ed680 con 0x7fbdf4151a90 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.596+0000 7fbdfc7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf4143f60 con 0x7fbdf40c4630 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36174/0 (socket says 172.21.15.43:36174) 2023-08-27T11:29:04.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3703383572 learned_addr learned my addr 172.21.15.43:0/3703383572 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf40c4630 msgr2=0x7fbdf41e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf40c4630 0x7fbdf41e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4151a90 msgr2=0x7fbdf41e9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4151a90 0x7fbdf41e9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.604 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 -- 172.21.15.43:0/3703383572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009550 con 0x7fbdf406ad70 2023-08-27T11:29:04.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfa59b700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0014040 tx=0x7fbdf0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:04.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0004450 con 0x7fbdf406ad70 2023-08-27T11:29:04.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf001e070 con 0x7fbdf406ad70 2023-08-27T11:29:04.605 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf4153a80 con 0x7fbdf406ad70 2023-08-27T11:29:04.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.597+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00038e0 con 0x7fbdf406ad70 2023-08-27T11:29:04.606 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.598+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf41ed310 con 0x7fbdf406ad70 2023-08-27T11:29:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.599+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf41ed4a0 con 0x7fbdf406ad70 2023-08-27T11:29:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.599+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbdf0003a40 con 0x7fbdf406ad70 2023-08-27T11:29:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.600+0000 7fbdeaffd700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 0x7fbdd806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:04.607 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.600+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fbdf0089790 con 0x7fbdf406ad70 2023-08-27T11:29:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.601+0000 7fbdf9d9a700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 0x7fbdd806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.601+0000 7fbdf9d9a700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 0x7fbdd806c5a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbdf414d9f0 tx=0x7fbde40095a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:04.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.605+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbdf0054ac0 con 0x7fbdf406ad70 2023-08-27T11:29:04.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.858+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdf404ee70 con 0x7fbdf406ad70 2023-08-27T11:29:04.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.858+0000 7fbdeaffd700 1 -- 172.21.15.43:0/3703383572 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7fbdf00580e0 con 0x7fbdf406ad70 2023-08-27T11:29:04.860 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:04.860 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:04.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 msgr2=0x7fbdd806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 0x7fbdd806c5a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbdf414d9f0 tx=0x7fbde40095a0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 msgr2=0x7fbdf40aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0014040 tx=0x7fbdf0004750 comp rx=0 tx=0).stop 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 shutdown_connections 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fbdd806a0e0 0x7fbdd806c5a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdf4151a90 0x7fbdf41e9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbdf406ad70 0x7fbdf40aa8d0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 --2- 172.21.15.43:0/3703383572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdf40c4630 0x7fbdf41e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:04.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 >> 172.21.15.43:0/3703383572 conn(0x7fbdf40ab820 msgr2=0x7fbdf406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:04.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 shutdown_connections 2023-08-27T11:29:04.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:04.861+0000 7fbdfc7ff700 1 -- 172.21.15.43:0/3703383572 wait complete. 2023-08-27T11:29:04.865 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:05.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 140, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:28:35.519882+0000', 'modified': '2023-08-27T11:29:03.549817+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 129, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6776': {'gid': 6776, 'name': 'b', 'rank': 0, 'incarnation': 137, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:05.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:29:05.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-27T11:29:05.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.491+0000 7f57787ff700 1 Processor -- start 2023-08-27T11:29:05.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.492+0000 7f57787ff700 1 -- start start 2023-08-27T11:29:05.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f57787ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f57700c4a90 0x7f577006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f57787ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577006c4e0 con 0x7f5770151a90 2023-08-27T11:29:05.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f57787ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5770155370 con 0x7f57700c4630 2023-08-27T11:29:05.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f57787ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700c82c0 con 0x7f57700c4a90 2023-08-27T11:29:05.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f577659b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5770151a90 0x7f57700c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37010/0 (socket says 172.21.15.43:37010) 2023-08-27T11:29:05.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f577659b700 1 -- 172.21.15.43:0/1740257838 learned_addr learned my addr 172.21.15.43:0/1740257838 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:05.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.493+0000 7f5776d9c700 1 --2- 172.21.15.43:0/1740257838 >> v2:172.21.15.43:3300/0 conn(0x7f57700c4a90 0x7f577006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5776d9c700 1 -- 172.21.15.43:0/1740257838 >> v1:172.21.15.57:6789/0 conn(0x7f57700c4630 legacy=0x7f577006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5776d9c700 1 -- 172.21.15.43:0/1740257838 >> v1:172.21.15.43:6789/0 conn(0x7f5770151a90 legacy=0x7f57700c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5776d9c700 1 -- 172.21.15.43:0/1740257838 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770151e70 con 0x7f57700c4a90 2023-08-27T11:29:05.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5776d9c700 1 --2- 172.21.15.43:0/1740257838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4a90 0x7f577006b480 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9701cf2a138ac694 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5775599700 1 -- 172.21.15.43:0/1740257838 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800e070 con 0x7f57700c4a90 2023-08-27T11:29:05.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5775599700 1 -- 172.21.15.43:0/1740257838 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800bbd0 con 0x7f57700c4a90 2023-08-27T11:29:05.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.494+0000 7f5775599700 1 -- 172.21.15.43:0/1740257838 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768012430 con 0x7f57700c4a90 2023-08-27T11:29:05.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 -- 172.21.15.43:0/1740257838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4a90 msgr2=0x7f577006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 --2- 172.21.15.43:0/1740257838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4a90 0x7f577006b480 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 -- 172.21.15.43:0/1740257838 shutdown_connections 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 --2- 172.21.15.43:0/1740257838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4a90 0x7f577006b480 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 -- 172.21.15.43:0/1740257838 >> 172.21.15.43:0/1740257838 conn(0x7f57700ab820 msgr2=0x7f57700abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 -- 172.21.15.43:0/1740257838 shutdown_connections 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.495+0000 7f57787ff700 1 -- 172.21.15.43:0/1740257838 wait complete. 2023-08-27T11:29:05.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.496+0000 7f57787ff700 1 Processor -- start 2023-08-27T11:29:05.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.497+0000 7f57787ff700 1 -- start start 2023-08-27T11:29:05.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.497+0000 7f57787ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.497+0000 7f57787ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57700c4a90 0x7f57701ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f57787ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5770151a90 0x7f57701ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f57787ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014bd30 con 0x7f57700c4630 2023-08-27T11:29:05.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f57787ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57701ecc40 con 0x7f57700c4a90 2023-08-27T11:29:05.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f57787ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5770152400 con 0x7f5770151a90 2023-08-27T11:29:05.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36190/0 (socket says 172.21.15.43:36190) 2023-08-27T11:29:05.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 -- 172.21.15.43:0/1827057625 learned_addr learned my addr 172.21.15.43:0/1827057625 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57700c4a90 0x7f57701ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f5776d9c700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5770151a90 0x7f57701ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 -- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5770151a90 msgr2=0x7f57701ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5770151a90 0x7f57701ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 -- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57700c4a90 msgr2=0x7f57701ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57700c4a90 0x7f57701ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.498+0000 7f577659b700 1 -- 172.21.15.43:0/1827057625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009a70 con 0x7f57700c4630 2023-08-27T11:29:05.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f577659b700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c480 tx=0x7f576c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f5766ffd700 1 -- 172.21.15.43:0/1827057625 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c005d70 con 0x7f57700c4630 2023-08-27T11:29:05.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f5766ffd700 1 -- 172.21.15.43:0/1827057625 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c0070d0 con 0x7f57700c4630 2023-08-27T11:29:05.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f5766ffd700 1 -- 172.21.15.43:0/1827057625 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c007440 con 0x7f57700c4630 2023-08-27T11:29:05.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577014bf40 con 0x7f57700c4630 2023-08-27T11:29:05.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.499+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770149480 con 0x7f57700c4630 2023-08-27T11:29:05.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.501+0000 7f5766ffd700 1 -- 172.21.15.43:0/1827057625 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f576c0075a0 con 0x7f57700c4630 2023-08-27T11:29:05.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.502+0000 7f5766ffd700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 0x7f575406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.502+0000 7f5766ffd700 1 -- 172.21.15.43:0/1827057625 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f576c087bc0 con 0x7f57700c4630 2023-08-27T11:29:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.502+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 0x7f575406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.503+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 0x7f575406c5a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f57700ab700 tx=0x7f5760009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.504+0000 7f578c21fb80 1 Processor -- start 2023-08-27T11:29:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.504+0000 7f578c21fb80 1 -- start start 2023-08-27T11:29:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562508456f00 0x562508479d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x56250848f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625083b4730 con 0x56250845cfe0 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625083b2050 con 0x562508456f00 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625083ad940 con 0x5625084572e0 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f5775d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f5775d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36196/0 (socket says 172.21.15.43:36196) 2023-08-27T11:29:05.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f5775d9a700 1 -- 172.21.15.43:0/375610928 learned_addr learned my addr 172.21.15.43:0/375610928 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f577659b700 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562508456f00 0x562508479d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.505+0000 7f5776d9c700 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x56250848f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 -- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 msgr2=0x56250848f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x56250848f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 -- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562508456f00 msgr2=0x562508479d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562508456f00 0x562508479d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 -- 172.21.15.43:0/375610928 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56250822d5e0 con 0x56250845cfe0 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5775d9a700 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f576000f6c0 tx=0x7f5760012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b851f1a536ec3f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5753fff700 1 -- 172.21.15.43:0/375610928 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000fe40 con 0x56250845cfe0 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5753fff700 1 -- 172.21.15.43:0/375610928 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760014450 con 0x56250845cfe0 2023-08-27T11:29:05.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.506+0000 7f5753fff700 1 -- 172.21.15.43:0/375610928 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600147c0 con 0x56250845cfe0 2023-08-27T11:29:05.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 -- 172.21.15.43:0/375610928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 msgr2=0x56250847a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f576000f6c0 tx=0x7f5760012000 comp rx=0 tx=0).stop 2023-08-27T11:29:05.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 -- 172.21.15.43:0/375610928 shutdown_connections 2023-08-27T11:29:05.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x56250848f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562508456f00 0x562508479d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 --2- 172.21.15.43:0/375610928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56250845cfe0 0x56250847a2b0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 -- 172.21.15.43:0/375610928 >> 172.21.15.43:0/375610928 conn(0x5625083b9c30 msgr2=0x5625084596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 -- 172.21.15.43:0/375610928 shutdown_connections 2023-08-27T11:29:05.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.507+0000 7f578c21fb80 1 -- 172.21.15.43:0/375610928 wait complete. 2023-08-27T11:29:05.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.508+0000 7f578c21fb80 1 -- start start 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.508+0000 7f578c21fb80 1 Processor -- start 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562508456f00 0x56250847fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084785a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250834bb60 con 0x5625084572e0 2023-08-27T11:29:05.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250834b860 con 0x56250848e600 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56250822f8d0 con 0x562508456f00 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f578c21fb80 10 client.0 _ll_register_callbacks cb 0x562508349630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f5775d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f5775d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36198/0 (socket says 172.21.15.43:36198) 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f5775d9a700 1 -- 172.21.15.43:0/1536228645 learned_addr learned my addr 172.21.15.43:0/1536228645 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f577659b700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562508456f00 0x56250847fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.509+0000 7f5776d9c700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 -- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562508456f00 msgr2=0x56250847fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562508456f00 0x56250847fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 -- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 msgr2=0x5625084785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084785a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 -- 172.21.15.43:0/1536228645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770155370 con 0x5625084572e0 2023-08-27T11:29:05.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f5775d9a700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f5760020000 tx=0x7f5760001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5749c20ff9a1a8c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f57517fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:29:05.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760006a60 con 0x5625084572e0 2023-08-27T11:29:05.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f576000fe40 con 0x5625084572e0 2023-08-27T11:29:05.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56250844e4f0 con 0x5625084572e0 2023-08-27T11:29:05.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=140) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5760006bc0 con 0x5625084572e0 2023-08-27T11:29:05.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f578c21fb80 10 client.8445 fetch_fsmap learned FSMap version 140 2023-08-27T11:29:05.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.510+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=140,monmap=2+}) v3 -- 0x5625083c5750 con 0x5625084572e0 2023-08-27T11:29:05.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56250844e4f0 con 0x5625084572e0 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 140) v1 ==== 3889+0+0 (secure 0 0 0) 0x7f5760006d20 con 0x5625084572e0 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 10 client.8445 fetch_fsmap finished waiting for FSMap version 140 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 10 client.8445 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 20 client.8445 populate_metadata read hostname 'smithi043' 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x5625084aacb0 0x5625084ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 4 client.8445 mds_command: new command op to 6776 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:29:05.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 --> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625083a6920 con 0x5625084aacb0 2023-08-27T11:29:05.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.511+0000 7f577659b700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x5625084aacb0 0x5625084ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.512+0000 7f577659b700 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x5625084aacb0 0x5625084ab090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc3ecd268d3e322 server_cookie=5fa012768db9a416 in_seq=0 out_seq=0 2023-08-27T11:29:05.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.512+0000 7f57517fa700 10 client.8445 ms_handle_connect on v2:172.21.15.57:6832/3257371578 2023-08-27T11:29:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f57517fa700 1 -- 172.21.15.43:0/1536228645 <== mds.0 v2:172.21.15.57:6832/3257371578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625083a6920 con 0x5625084aacb0 2023-08-27T11:29:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f57517fa700 10 client.8445 handle_command_reply: tid=0 2023-08-27T11:29:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 client.8445 shutdown 2023-08-27T11:29:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 msgr2=0x562508492b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f5760020000 tx=0x7f5760001120 comp rx=0 tx=0).stop 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 shutdown_connections 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x5625084aacb0 0x5625084ab090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084785a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x562508456f00 0x56250847fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f57517fa700 0 client.8445 ms_handle_reset on v2:172.21.15.57:6832/3257371578 2023-08-27T11:29:05.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 --2- 172.21.15.43:0/1536228645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5625084572e0 0x562508492b50 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 >> 172.21.15.43:0/1536228645 conn(0x5625083b9c30 msgr2=0x562508454b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 shutdown_connections 2023-08-27T11:29:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 1 -- 172.21.15.43:0/1536228645 wait complete. 2023-08-27T11:29:05.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.513+0000 7f578c21fb80 20 client.8445 trim_cache size 0 max 16384 2023-08-27T11:29:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.531+0000 7f578c21fb80 1 Processor -- start 2023-08-27T11:29:05.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 -- start start 2023-08-27T11:29:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084552d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x562508495220 con 0x562508456f00 2023-08-27T11:29:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250847f3e0 con 0x56250848e600 2023-08-27T11:29:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.532+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56250845a540 con 0x5625084572e0 2023-08-27T11:29:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36202/0 (socket says 172.21.15.43:36202) 2023-08-27T11:29:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 -- 172.21.15.43:0/3222770301 learned_addr learned my addr 172.21.15.43:0/3222770301 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 -- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 msgr2=0x5625084563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 -- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 msgr2=0x5625084552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 -- 172.21.15.43:0/3222770301 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562508457b60 con 0x562508456f00 2023-08-27T11:29:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f577659b700 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f576c000f60 tx=0x7f576c085aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9550990967d8728 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f5764ff9700 1 -- 172.21.15.43:0/3222770301 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c054e60 con 0x562508456f00 2023-08-27T11:29:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f5764ff9700 1 -- 172.21.15.43:0/3222770301 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c085c50 con 0x562508456f00 2023-08-27T11:29:05.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.533+0000 7f5764ff9700 1 -- 172.21.15.43:0/3222770301 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c05e4f0 con 0x562508456f00 2023-08-27T11:29:05.545 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 -- 172.21.15.43:0/3222770301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 msgr2=0x562508492b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f576c000f60 tx=0x7f576c085aa0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 -- 172.21.15.43:0/3222770301 shutdown_connections 2023-08-27T11:29:05.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625084552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508492b30 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 --2- 172.21.15.43:0/3222770301 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 -- 172.21.15.43:0/3222770301 >> 172.21.15.43:0/3222770301 conn(0x5625083b9c30 msgr2=0x562508479030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 -- 172.21.15.43:0/3222770301 shutdown_connections 2023-08-27T11:29:05.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.534+0000 7f578c21fb80 1 -- 172.21.15.43:0/3222770301 wait complete. 2023-08-27T11:29:05.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.535+0000 7f578c21fb80 1 -- start start 2023-08-27T11:29:05.547 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.535+0000 7f578c21fb80 1 Processor -- start 2023-08-27T11:29:05.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625085025a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625084a73d0 con 0x562508456f00 2023-08-27T11:29:05.548 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56250847fcf0 con 0x56250848e600 2023-08-27T11:29:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x56250845a1c0 con 0x5625084572e0 2023-08-27T11:29:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f578c21fb80 10 client.0 _ll_register_callbacks cb 0x562508349630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:29:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36210/0 (socket says 172.21.15.43:36210) 2023-08-27T11:29:05.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 -- 172.21.15.43:0/817919073 learned_addr learned my addr 172.21.15.43:0/817919073 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f5775d9a700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f5776d9c700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625085025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 -- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 msgr2=0x5625084a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 -- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 msgr2=0x5625085025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625085025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 -- 172.21.15.43:0/817919073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770149480 con 0x562508456f00 2023-08-27T11:29:05.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f577659b700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f576c056a20 tx=0x7f576c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb52d6d629f7f6f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.537+0000 7f57517fa700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:29:05.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c05e700 con 0x562508456f00 2023-08-27T11:29:05.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f576c052b10 con 0x562508456f00 2023-08-27T11:29:05.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5760014450 con 0x562508456f00 2023-08-27T11:29:05.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=140) v2 ==== 24+0+0 (secure 0 0 0) 0x7f576c052cd0 con 0x562508456f00 2023-08-27T11:29:05.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 10 client.8451 fetch_fsmap learned FSMap version 140 2023-08-27T11:29:05.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=140,monmap=2+}) v3 -- 0x5625081d9d90 con 0x562508456f00 2023-08-27T11:29:05.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760014450 con 0x562508456f00 2023-08-27T11:29:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 140) v1 ==== 3889+0+0 (secure 0 0 0) 0x7f576c05ebd0 con 0x562508456f00 2023-08-27T11:29:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 10 client.8451 fetch_fsmap finished waiting for FSMap version 140 2023-08-27T11:29:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 10 client.8451 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:29:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 20 client.8451 populate_metadata read hostname 'smithi043' 2023-08-27T11:29:05.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x562508502ae0 0x562508502ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 4 client.8451 mds_command: new command op to 6776 tid=0[{"prefix": "status"}] 2023-08-27T11:29:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.538+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 --> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562508367000 con 0x562508502ae0 2023-08-27T11:29:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f5775d9a700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x562508502ae0 0x562508502ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f5775d9a700 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x562508502ae0 0x562508502ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc2c2250fa7270 server_cookie=77d93a644dae11bb in_seq=0 out_seq=0 2023-08-27T11:29:05.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f57517fa700 10 client.8451 ms_handle_connect on v2:172.21.15.57:6832/3257371578 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f57517fa700 1 -- 172.21.15.43:0/817919073 <== mds.0 v2:172.21.15.57:6832/3257371578 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x562508367000 con 0x562508502ae0 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f57517fa700 10 client.8451 handle_command_reply: tid=0 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.539+0000 7f578c21fb80 1 client.8451 shutdown 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 msgr2=0x562508456560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f576c056a20 tx=0x7f576c014040 comp rx=0 tx=0).stop 2023-08-27T11:29:05.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 shutdown_connections 2023-08-27T11:29:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:6832/3257371578,v1:172.21.15.57:6834/3257371578] conn(0x562508502ae0 0x562508502ec0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x56250848e600 0x5625085025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562508456f00 0x562508456560 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 --2- 172.21.15.43:0/817919073 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5625084572e0 0x5625084a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f57517fa700 0 client.8451 ms_handle_reset on v2:172.21.15.57:6832/3257371578 2023-08-27T11:29:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 >> 172.21.15.43:0/817919073 conn(0x5625083b9c30 msgr2=0x5625084552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 shutdown_connections 2023-08-27T11:29:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 1 -- 172.21.15.43:0/817919073 wait complete. 2023-08-27T11:29:05.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.540+0000 7f578c21fb80 20 client.8451 trim_cache size 0 max 16384 2023-08-27T11:29:05.558 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:29:05.558 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 6776, 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:29:05.559 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 4.99053813, 2023-08-27T11:29:05.560 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 140, 2023-08-27T11:29:05.560 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 129, 2023-08-27T11:29:05.560 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 129, 2023-08-27T11:29:05.560 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 35.739238876999998 2023-08-27T11:29:05.560 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:29:05.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 msgr2=0x7f575406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 0x7f575406c5a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f57700ab700 tx=0x7f5760009040 comp rx=0 tx=0).stop 2023-08-27T11:29:05.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 msgr2=0x7f5770148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c480 tx=0x7f576c00c790 comp rx=0 tx=0).stop 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 shutdown_connections 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f575406a0e0 0x7f575406c5a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5770151a90 0x7f57701ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57700c4630 0x7f5770148f40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 --2- 172.21.15.43:0/1827057625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57700c4a90 0x7f57701ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 >> 172.21.15.43:0/1827057625 conn(0x7f57700ab820 msgr2=0x7f57700c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 shutdown_connections 2023-08-27T11:29:05.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.541+0000 7f57787ff700 1 -- 172.21.15.43:0/1827057625 wait complete. 2023-08-27T11:29:05.564 DEBUG:tasks.cephfs.test_failover:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 9, "epoch": 140, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 9, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:35.519882+0000", "damaged": [], "data_pools": [ 20 ], "enabled": true, "epoch": 140, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_6776": { "addr": "172.21.15.57:6834/3257371578", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6832", "nonce": 3257371578, "type": "v2" }, { "addr": "172.21.15.57:6834", "nonce": 3257371578, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6776, "incarnation": 137, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 129, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 19, "modified": "2023-08-27T11:29:03.549817+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 6776 } } }, { "id": 10, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-08-27T11:28:52.606401+0000", "damaged": [], "data_pools": [ 22 ], "enabled": true, "epoch": 138, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs2", "in": [ 0 ], "info": { "gid_8091": { "addr": "172.21.15.43:6837/1923359880", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6836", "nonce": 1923359880, "type": "v2" }, { "addr": "172.21.15.43:6837", "nonce": 1923359880, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8091, "incarnation": 131, "join_fscid": 10, "name": "c", "rank": 0, "state": "up:active", "state_seq": 9 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 21, "modified": "2023-08-27T11:29:01.545245+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 8091 } } } ], "standbys": [ { "addr": "172.21.15.43:6835/1663361937", "addrs": { "addrvec": [ { "addr": "172.21.15.43:6834", "nonce": 1663361937, "type": "v2" }, { "addr": "172.21.15.43:6835", "nonce": 1663361937, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 139, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6770, "incarnation": 0, "join_fscid": 10, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 9 }, { "addr": "172.21.15.57:6835/3253544091", "addrs": { "addrvec": [ { "addr": "172.21.15.57:6833", "nonce": 3253544091, "type": "v2" }, { "addr": "172.21.15.57:6835", "nonce": 3253544091, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 138, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7888, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-08-27T11:29:05.565 INFO:tasks.cephfs.test_failover:target = [{'join_fscid': 10, 'name': 'a'}, {'join_fscid': -1, 'name': 'b', 'state': 'up:active'}, {'join_fscid': 10, 'name': 'c'}, {'join_fscid': -1, 'name': 'd'}] 2023-08-27T11:29:05.566 INFO:tasks.cephfs.test_failover:current = [{'gid': 6770, 'name': 'a', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 9, 'addr': '172.21.15.43:6835/1663361937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6834', 'nonce': 1663361937}, {'type': 'v1', 'addr': '172.21.15.43:6835', 'nonce': 1663361937}]}, 'join_fscid': 10, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 139}, {'gid': 6776, 'name': 'b', 'rank': 0, 'incarnation': 137, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.57:6834/3257371578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 3257371578}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 3257371578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 8091, 'name': 'c', 'rank': 0, 'incarnation': 131, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.43:6837/1923359880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6836', 'nonce': 1923359880}, {'type': 'v1', 'addr': '172.21.15.43:6837', 'nonce': 1923359880}]}, 'join_fscid': 10, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, {'gid': 7888, 'name': 'd', 'rank': -1, 'incarnation': 0, 'state': 'up:standby', 'state_seq': 1, 'addr': '172.21.15.57:6835/3253544091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3253544091}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3253544091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'epoch': 138}] 2023-08-27T11:29:05.566 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-08-27T11:29:05.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.767+0000 7f266ebff700 1 Processor -- start 2023-08-27T11:29:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.768+0000 7f266ebff700 1 -- start start 2023-08-27T11:29:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266ebff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26680c4630 0x7f26680c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f266806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266806c4e0 con 0x7f2668151a90 2023-08-27T11:29:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266ebff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2668155370 con 0x7f26680c4630 2023-08-27T11:29:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26680c82c0 con 0x7f266806ad70 2023-08-27T11:29:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266c99b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f2668151a90 0x7f26680c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37016/0 (socket says 172.21.15.43:37016) 2023-08-27T11:29:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266c99b700 1 -- 172.21.15.43:0/254486456 learned_addr learned my addr 172.21.15.43:0/254486456 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278344993 0 0) 0x7f266806c4e0 con 0x7f2668151a90 2023-08-27T11:29:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26580035b0 con 0x7f2668151a90 2023-08-27T11:29:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f2667fff700 1 --2- 172.21.15.43:0/254486456 >> v2:172.21.15.57:3300/0 conn(0x7f26680c4630 0x7f26680c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.769+0000 7f266d19c700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f266806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366528742 0 0) 0x7f26580035b0 con 0x7f2668151a90 2023-08-27T11:29:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 msgr2=0x7f266806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f266806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 >> v2:172.21.15.57:3300/0 conn(0x7f26680c4630 msgr2=0x7f26680c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 --2- 172.21.15.43:0/254486456 >> v2:172.21.15.57:3300/0 conn(0x7f26680c4630 0x7f26680c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668151e70 con 0x7f2668151a90 2023-08-27T11:29:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f265c001670 con 0x7f2668151a90 2023-08-27T11:29:05.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 >> v1:172.21.15.43:6789/0 conn(0x7f2668151a90 legacy=0x7f26680c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2658003a00 0x7f2658003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f2658004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f2658005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2668155370 con 0x7f2658004850 2023-08-27T11:29:05.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26680c82c0 con 0x7f2658003a00 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f265800ba90 con 0x7f266806ad70 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f2667fff700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f2658004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f266c99b700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2658003a00 0x7f2658003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.770+0000 7f266d19c700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f2658005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 -- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 msgr2=0x7f2658005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f266806ad70 0x7f2658005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 -- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2658003a00 msgr2=0x7f2658003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2658003a00 0x7f2658003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 -- 172.21.15.43:0/254486456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580035b0 con 0x7f2658004850 2023-08-27T11:29:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f266c99b700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2658003a00 0x7f2658003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:05.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f2667fff700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f2658004cd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f2654009b60 tx=0x7f2658005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3e892bb647a4e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400e6c0 con 0x7f2658004850 2023-08-27T11:29:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265400e820 con 0x7f2658004850 2023-08-27T11:29:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.771+0000 7f26677fe700 1 -- 172.21.15.43:0/254486456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265400eb90 con 0x7f2658004850 2023-08-27T11:29:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 -- 172.21.15.43:0/254486456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 msgr2=0x7f2658004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 --2- 172.21.15.43:0/254486456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f2658004cd0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f2654009b60 tx=0x7f2658005880 comp rx=0 tx=0).stop 2023-08-27T11:29:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266d19c700 1 -- 172.21.15.43:0/254486456 reap_dead start 2023-08-27T11:29:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 -- 172.21.15.43:0/254486456 shutdown_connections 2023-08-27T11:29:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 -- 172.21.15.43:0/254486456 >> 172.21.15.43:0/254486456 conn(0x7f26680ab820 msgr2=0x7f26680abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 -- 172.21.15.43:0/254486456 shutdown_connections 2023-08-27T11:29:05.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.772+0000 7f266ebff700 1 -- 172.21.15.43:0/254486456 wait complete. 2023-08-27T11:29:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.774+0000 7f266ebff700 1 Processor -- start 2023-08-27T11:29:05.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.774+0000 7f266ebff700 1 -- start start 2023-08-27T11:29:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 0x7f26681462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 0x7f2668152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266814bdd0 con 0x7f2658004850 2023-08-27T11:29:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266814c070 con 0x7f26681539d0 2023-08-27T11:29:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26681e9a20 con 0x7f2668153e20 2023-08-27T11:29:05.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36242/0 (socket says 172.21.15.43:36242) 2023-08-27T11:29:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 -- 172.21.15.43:0/1770700837 learned_addr learned my addr 172.21.15.43:0/1770700837 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f2667fff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 0x7f26681462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266d19c700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 0x7f2668152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 -- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 msgr2=0x7f2668152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 0x7f2668152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 -- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 msgr2=0x7f26681462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:05.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 0x7f26681462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:05.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 -- 172.21.15.43:0/1770700837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26681e9d00 con 0x7f2658004850 2023-08-27T11:29:05.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f2667fff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 0x7f26681462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266d19c700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 0x7f2668152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.775+0000 7f266c99b700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f265c001200 tx=0x7f265c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.776+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c012590 con 0x7f2658004850 2023-08-27T11:29:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.776+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0126f0 con 0x7f2658004850 2023-08-27T11:29:05.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.776+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2668146800 con 0x7f2658004850 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.776+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c012a60 con 0x7f2658004850 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.776+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266814e190 con 0x7f2658004850 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.777+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266804ee70 con 0x7f2658004850 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.778+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f265c012bc0 con 0x7f2658004850 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.780+0000 7f26657fa700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:05.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.780+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f265c088710 con 0x7f2658004850 2023-08-27T11:29:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.780+0000 7f2667fff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.781+0000 7f2667fff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f266814a7d0 tx=0x7f2654008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:05.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:05.784+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f265c0574d0 con 0x7f2658004850 2023-08-27T11:29:05.975 INFO:tasks.ceph.mds.b.smithi057.stderr:2023-08-27T11:29:05.974+0000 7f9a759f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:29:06.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.039+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26680c4df0 con 0x7f2658004850 2023-08-27T11:29:06.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.039+0000 7f26657fa700 1 -- 172.21.15.43:0/1770700837 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7f265c0014d0 con 0x7f2658004850 2023-08-27T11:29:06.041 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:06.041 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:06.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 msgr2=0x7f264c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f266814a7d0 tx=0x7f2654008030 comp rx=0 tx=0).stop 2023-08-27T11:29:06.043 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 msgr2=0x7f26681ea220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f265c001200 tx=0x7f265c00eb10 comp rx=0 tx=0).stop 2023-08-27T11:29:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 shutdown_connections 2023-08-27T11:29:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f264c06a0e0 0x7f264c06c5a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2668153e20 0x7f2668152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.044 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2658004850 0x7f26681ea220 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 --2- 172.21.15.43:0/1770700837 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26681539d0 0x7f26681462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 >> 172.21.15.43:0/1770700837 conn(0x7f26680ab820 msgr2=0x7f266806b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:06.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 shutdown_connections 2023-08-27T11:29:06.045 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.042+0000 7f266ebff700 1 -- 172.21.15.43:0/1770700837 wait complete. 2023-08-27T11:29:06.046 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:06.061 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:29:06.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:29:06.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:29:06.263 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:29:06.264 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:29:06.264 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:29:06.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:29:06.308 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:29:06.309 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:29:06.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:29:06.354 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:06.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.555+0000 7f2716fff700 1 Processor -- start 2023-08-27T11:29:06.557 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.555+0000 7f2716fff700 1 -- start start 2023-08-27T11:29:06.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.556+0000 7f2716fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f271006b320 0x7f271014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.558 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.556+0000 7f2716fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 0x7f271014e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2716fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27101546f0 con 0x7f271006c690 2023-08-27T11:29:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2716fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100c4bb0 con 0x7f27100c4600 2023-08-27T11:29:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2716fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100c4e90 con 0x7f271006b320 2023-08-27T11:29:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f270ffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f271006c690 0x7f27100c5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37030/0 (socket says 172.21.15.43:37030) 2023-08-27T11:29:06.559 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f270ffff700 1 -- 172.21.15.43:0/1046911761 learned_addr learned my addr 172.21.15.43:0/1046911761 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:06.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2714d9b700 1 --2- 172.21.15.43:0/1046911761 >> v2:172.21.15.57:3300/0 conn(0x7f271006b320 0x7f271014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.560 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f271559c700 1 --2- 172.21.15.43:0/1046911761 >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 0x7f271014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2714d9b700 1 -- 172.21.15.43:0/1046911761 >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 msgr2=0x7f271014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2714d9b700 1 --2- 172.21.15.43:0/1046911761 >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 0x7f271014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2714d9b700 1 -- 172.21.15.43:0/1046911761 >> v1:172.21.15.43:6789/0 conn(0x7f271006c690 legacy=0x7f27100c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f2714d9b700 1 -- 172.21.15.43:0/1046911761 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100c5170 con 0x7f271006b320 2023-08-27T11:29:06.562 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.557+0000 7f271559c700 1 --2- 172.21.15.43:0/1046911761 >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 0x7f271014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f2714d9b700 1 --2- 172.21.15.43:0/1046911761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f271006b320 0x7f271014dfd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970a347061cb207e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f270f7fe700 1 -- 172.21.15.43:0/1046911761 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011830 con 0x7f271006b320 2023-08-27T11:29:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f270f7fe700 1 -- 172.21.15.43:0/1046911761 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704011990 con 0x7f271006b320 2023-08-27T11:29:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f270f7fe700 1 -- 172.21.15.43:0/1046911761 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011d20 con 0x7f271006b320 2023-08-27T11:29:06.563 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f2716fff700 1 -- 172.21.15.43:0/1046911761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f271006b320 msgr2=0x7f271014dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.558+0000 7f2716fff700 1 --2- 172.21.15.43:0/1046911761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f271006b320 0x7f271014dfd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2704009840 tx=0x7f2704009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:06.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 -- 172.21.15.43:0/1046911761 shutdown_connections 2023-08-27T11:29:06.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 --2- 172.21.15.43:0/1046911761 >> v2:172.21.15.43:3300/0 conn(0x7f27100c4600 0x7f271014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 --2- 172.21.15.43:0/1046911761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f271006b320 0x7f271014dfd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.564 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 -- 172.21.15.43:0/1046911761 >> 172.21.15.43:0/1046911761 conn(0x7f27100c9c80 msgr2=0x7f27100ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:06.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 -- 172.21.15.43:0/1046911761 shutdown_connections 2023-08-27T11:29:06.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.559+0000 7f2716fff700 1 -- 172.21.15.43:0/1046911761 wait complete. 2023-08-27T11:29:06.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.560+0000 7f2716fff700 1 Processor -- start 2023-08-27T11:29:06.565 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.560+0000 7f2716fff700 1 -- start start 2023-08-27T11:29:06.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006b320 0x7f271014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4600 0x7f27100ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27100aea60 con 0x7f271006c690 2023-08-27T11:29:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101eae50 con 0x7f27100c4600 2023-08-27T11:29:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.561+0000 7f2716fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27101eb9d0 con 0x7f271006b320 2023-08-27T11:29:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.568 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36272/0 (socket says 172.21.15.43:36272) 2023-08-27T11:29:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f271559c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4600 0x7f27100ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 -- 172.21.15.43:0/3655335031 learned_addr learned my addr 172.21.15.43:0/3655335031 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f2714d9b700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006b320 0x7f271014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 -- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006b320 msgr2=0x7f271014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006b320 0x7f271014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 -- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4600 msgr2=0x7f27100ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4600 0x7f27100ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 -- 172.21.15.43:0/3655335031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009a70 con 0x7f271006c690 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.562+0000 7f270ffff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00c500 tx=0x7f26fc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.563+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc005d70 con 0x7f271006c690 2023-08-27T11:29:06.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.563+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0070d0 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.563+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc007440 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.563+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040094a0 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.563+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27101eb380 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.564+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271004ee70 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.565+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26fc0075a0 con 0x7f271006c690 2023-08-27T11:29:06.571 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.566+0000 7f270d7fa700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:06.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.566+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f26fc087d00 con 0x7f271006c690 2023-08-27T11:29:06.572 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.566+0000 7f2714d9b700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:06.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.567+0000 7f2714d9b700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f27040090b0 tx=0x7f270401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:06.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.571+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f26fc052fc0 con 0x7f271006c690 2023-08-27T11:29:06.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.830+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2710154370 con 0x7f271006c690 2023-08-27T11:29:06.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.831+0000 7f270d7fa700 1 -- 172.21.15.43:0/3655335031 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7f26fc017020 con 0x7f271006c690 2023-08-27T11:29:06.833 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:06.833 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:06.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 msgr2=0x7f26f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f27040090b0 tx=0x7f270401c040 comp rx=0 tx=0).stop 2023-08-27T11:29:06.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 msgr2=0x7f27100adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:06.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00c500 tx=0x7f26fc00c810 comp rx=0 tx=0).stop 2023-08-27T11:29:06.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 shutdown_connections 2023-08-27T11:29:06.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.833+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4600 0x7f27100ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.834+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006b320 0x7f271014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.834+0000 7f2716fff700 1 --2- 172.21.15.43:0/3655335031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f271006c690 0x7f27100adfe0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:06.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.834+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 >> 172.21.15.43:0/3655335031 conn(0x7f27100c9c80 msgr2=0x7f27101530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:06.837 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.834+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 shutdown_connections 2023-08-27T11:29:06.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:06.834+0000 7f2716fff700 1 -- 172.21.15.43:0/3655335031 wait complete. 2023-08-27T11:29:06.838 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:06.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:07.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.055+0000 7fb07d7ff700 1 Processor -- start 2023-08-27T11:29:07.057 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.056+0000 7fb07d7ff700 1 -- start start 2023-08-27T11:29:07.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb07d7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0780c4c40 0x7fb0780bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.058 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb07d7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb0780c0390 0x7fb0780bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb07d7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0780c17f0 con 0x7fb07814e0d0 2023-08-27T11:29:07.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb07d7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780c21a0 con 0x7fb0780c0390 2023-08-27T11:29:07.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb07d7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780c0900 con 0x7fb0780c4c40 2023-08-27T11:29:07.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb076ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb07814e0d0 0x7fb0780c4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37038/0 (socket says 172.21.15.43:37038) 2023-08-27T11:29:07.059 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb076ffd700 1 -- 172.21.15.43:0/2685392690 learned_addr learned my addr 172.21.15.43:0/2685392690 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:07.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb0777fe700 1 --2- 172.21.15.43:0/2685392690 >> v2:172.21.15.43:3300/0 conn(0x7fb0780c0390 0x7fb0780bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.060 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.057+0000 7fb06ffff700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0780c4c40 0x7fb0780bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.061 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0777fe700 1 -- 172.21.15.43:0/2685392690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0780c4c40 msgr2=0x7fb0780bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:07.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0777fe700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0780c4c40 0x7fb0780bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0777fe700 1 -- 172.21.15.43:0/2685392690 >> v1:172.21.15.43:6789/0 conn(0x7fb07814e0d0 legacy=0x7fb0780c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0777fe700 1 -- 172.21.15.43:0/2685392690 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780c0be0 con 0x7fb0780c0390 2023-08-27T11:29:07.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0777fe700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c0390 0x7fb0780bbb00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb070009d90 tx=0x7fb07000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4de6898b8c803 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0767fc700 1 -- 172.21.15.43:0/2685392690 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000e070 con 0x7fb0780c0390 2023-08-27T11:29:07.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0767fc700 1 -- 172.21.15.43:0/2685392690 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000bb20 con 0x7fb0780c0390 2023-08-27T11:29:07.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.058+0000 7fb0767fc700 1 -- 172.21.15.43:0/2685392690 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070012430 con 0x7fb0780c0390 2023-08-27T11:29:07.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 -- 172.21.15.43:0/2685392690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c0390 msgr2=0x7fb0780bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c0390 0x7fb0780bbb00 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb070009d90 tx=0x7fb07000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 -- 172.21.15.43:0/2685392690 shutdown_connections 2023-08-27T11:29:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c0390 0x7fb0780bbb00 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/2685392690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0780c4c40 0x7fb0780bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 -- 172.21.15.43:0/2685392690 >> 172.21.15.43:0/2685392690 conn(0x7fb07806aa50 msgr2=0x7fb0780c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:07.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 -- 172.21.15.43:0/2685392690 shutdown_connections 2023-08-27T11:29:07.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.059+0000 7fb07d7ff700 1 -- 172.21.15.43:0/2685392690 wait complete. 2023-08-27T11:29:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.061+0000 7fb07d7ff700 1 Processor -- start 2023-08-27T11:29:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.061+0000 7fb07d7ff700 1 -- start start 2023-08-27T11:29:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0780c0390 0x7fb078142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 0x7fb078148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0781e58a0 con 0x7fb0780c4c40 2023-08-27T11:29:07.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0781e5b80 con 0x7fb0780c0390 2023-08-27T11:29:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb07d7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0781e5e60 con 0x7fb07814e0d0 2023-08-27T11:29:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36278/0 (socket says 172.21.15.43:36278) 2023-08-27T11:29:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 -- 172.21.15.43:0/3083740229 learned_addr learned my addr 172.21.15.43:0/3083740229 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb076ffd700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0780c0390 0x7fb078142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb0777fe700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 0x7fb078148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 -- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 msgr2=0x7fb078148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 0x7fb078148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 -- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0780c0390 msgr2=0x7fb078142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0780c0390 0x7fb078142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb06ffff700 1 -- 172.21.15.43:0/3083740229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070009a70 con 0x7fb0780c4c40 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.063+0000 7fb0777fe700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 0x7fb078148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb06ffff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e8e0 tx=0x7fb06000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000eee0 con 0x7fb0780c4c40 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06000caf0 con 0x7fb0780c4c40 2023-08-27T11:29:07.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06000cea0 con 0x7fb0780c4c40 2023-08-27T11:29:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0781e6140 con 0x7fb0780c4c40 2023-08-27T11:29:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.064+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0781dca00 con 0x7fb0780c4c40 2023-08-27T11:29:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.065+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0781484a0 con 0x7fb0780c4c40 2023-08-27T11:29:07.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.066+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb0600113f0 con 0x7fb0780c4c40 2023-08-27T11:29:07.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.067+0000 7fb06f7fe700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.067+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fb060088610 con 0x7fb0780c4c40 2023-08-27T11:29:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.067+0000 7fb076ffd700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.068+0000 7fb076ffd700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb068005910 tx=0x7fb068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.071+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb0600573d0 con 0x7fb0780c4c40 2023-08-27T11:29:07.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.283+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb078149360 con 0x7fb0780c4c40 2023-08-27T11:29:07.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.285+0000 7fb06f7fe700 1 -- 172.21.15.43:0/3083740229 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+21976 (secure 0 0 0) 0x7fb078149360 con 0x7fb0780c4c40 2023-08-27T11:29:07.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:07.287 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":129,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:00.535670+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:07.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 msgr2=0x7fb05806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb068005910 tx=0x7fb068009040 comp rx=0 tx=0).stop 2023-08-27T11:29:07.289 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 msgr2=0x7fb0781dc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fb06000e8e0 tx=0x7fb06000eca0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 shutdown_connections 2023-08-27T11:29:07.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb05806a0e0 0x7fb05806c5a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb07814e0d0 0x7fb078148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.290 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0780c0390 0x7fb078142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 --2- 172.21.15.43:0/3083740229 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb0780c4c40 0x7fb0781dc4c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 >> 172.21.15.43:0/3083740229 conn(0x7fb07806aa50 msgr2=0x7fb07814c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 shutdown_connections 2023-08-27T11:29:07.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.287+0000 7fb07d7ff700 1 -- 172.21.15.43:0/3083740229 wait complete. 2023-08-27T11:29:07.307 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:28:33.832606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:28:34.482137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-27T11:28:51.013075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-27T11:28:51.585124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:29:07.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:29:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.511+0000 7f680c9ff700 1 Processor -- start 2023-08-27T11:29:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.512+0000 7f680c9ff700 1 -- start start 2023-08-27T11:29:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080ac410 0x7f68080c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680c9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f68080c94c0 0x7f680815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680c9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68080c80c0 con 0x7f68080c49f0 2023-08-27T11:29:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680c9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68081555a0 con 0x7f68080c94c0 2023-08-27T11:29:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68081552c0 con 0x7f68080ac410 2023-08-27T11:29:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f68080c49f0 0x7f6808151790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37050/0 (socket says 172.21.15.43:37050) 2023-08-27T11:29:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f680659c700 1 -- 172.21.15.43:0/693819291 learned_addr learned my addr 172.21.15.43:0/693819291 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f6806d9d700 1 --2- 172.21.15.43:0/693819291 >> v2:172.21.15.43:3300/0 conn(0x7f68080c94c0 0x7f680815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.513+0000 7f67fffff700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080ac410 0x7f68080c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6806d9d700 1 -- 172.21.15.43:0/693819291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080ac410 msgr2=0x7f68080c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6806d9d700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080ac410 0x7f68080c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6806d9d700 1 -- 172.21.15.43:0/693819291 >> v1:172.21.15.43:6789/0 conn(0x7f68080c49f0 legacy=0x7f6808151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6805d9b700 1 -- 172.21.15.43:0/693819291 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441010078 0 0) 0x7f68080c80c0 con 0x7f68080c49f0 2023-08-27T11:29:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6806d9d700 1 -- 172.21.15.43:0/693819291 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080c8360 con 0x7f68080c94c0 2023-08-27T11:29:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6806d9d700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f680815eee0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6800009d90 tx=0x7f680000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bddd1125034c92 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6805d9b700 1 -- 172.21.15.43:0/693819291 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680000e070 con 0x7f68080c94c0 2023-08-27T11:29:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6805d9b700 1 -- 172.21.15.43:0/693819291 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680000bb20 con 0x7f68080c94c0 2023-08-27T11:29:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.514+0000 7f6805d9b700 1 -- 172.21.15.43:0/693819291 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800012430 con 0x7f68080c94c0 2023-08-27T11:29:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 -- 172.21.15.43:0/693819291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 msgr2=0x7f680815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f680815eee0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6800009d90 tx=0x7f680000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 -- 172.21.15.43:0/693819291 shutdown_connections 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f680815eee0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 --2- 172.21.15.43:0/693819291 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080ac410 0x7f68080c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 -- 172.21.15.43:0/693819291 >> 172.21.15.43:0/693819291 conn(0x7f68080ab8f0 msgr2=0x7f68080abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 -- 172.21.15.43:0/693819291 shutdown_connections 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.515+0000 7f680c9ff700 1 -- 172.21.15.43:0/693819291 wait complete. 2023-08-27T11:29:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.517+0000 7f680c9ff700 1 Processor -- start 2023-08-27T11:29:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.517+0000 7f680c9ff700 1 -- start start 2023-08-27T11:29:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080ac410 0x7f6808157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080c49f0 0x7f68081ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081ed300 con 0x7f68080c94c0 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68080c1720 con 0x7f68080ac410 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68080c1440 con 0x7f68080c49f0 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36298/0 (socket says 172.21.15.43:36298) 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 -- 172.21.15.43:0/1573539660 learned_addr learned my addr 172.21.15.43:0/1573539660 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f680659c700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080ac410 0x7f6808157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f67fffff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080c49f0 0x7f68081ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 -- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080c49f0 msgr2=0x7f68081ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080c49f0 0x7f68081ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 -- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080ac410 msgr2=0x7f6808157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080ac410 0x7f6808157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.518+0000 7f6806d9d700 1 -- 172.21.15.43:0/1573539660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009a70 con 0x7f68080c94c0 2023-08-27T11:29:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f6806d9d700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6808066f40 tx=0x7f6800004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800012430 con 0x7f68080c94c0 2023-08-27T11:29:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800020070 con 0x7f68080c94c0 2023-08-27T11:29:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68081ecc40 con 0x7f68080c94c0 2023-08-27T11:29:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800004280 con 0x7f68080c94c0 2023-08-27T11:29:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.519+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6808158230 con 0x7f68080c94c0 2023-08-27T11:29:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.520+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68081ecaa0 con 0x7f68080c94c0 2023-08-27T11:29:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.521+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f68000043e0 con 0x7f68080c94c0 2023-08-27T11:29:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.522+0000 7f67feffd700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 0x7f67e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.522+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f6800022070 con 0x7f68080c94c0 2023-08-27T11:29:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.522+0000 7f680659c700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 0x7f67e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.523+0000 7f680659c700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 0x7f67e806c5a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67f8007fd0 tx=0x7f67f8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.526+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f68081ecaa0 con 0x7f68080c94c0 2023-08-27T11:29:07.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.735+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f68081ed440 con 0x7f68080c94c0 2023-08-27T11:29:07.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.736+0000 7f67feffd700 1 -- 172.21.15.43:0/1573539660 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7f68081ed440 con 0x7f68080c94c0 2023-08-27T11:29:07.738 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:29:07.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.738+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 msgr2=0x7f67e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.738+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 0x7f67e806c5a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f67f8007fd0 tx=0x7f67f8007de0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.738+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 msgr2=0x7f68081eaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.738+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6808066f40 tx=0x7f6800004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 shutdown_connections 2023-08-27T11:29:07.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f67e806a0e0 0x7f67e806c5a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f68080c94c0 0x7f68081eaee0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f68080ac410 0x7f6808157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 --2- 172.21.15.43:0/1573539660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f68080c49f0 0x7f68081ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 >> 172.21.15.43:0/1573539660 conn(0x7f68080ab8f0 msgr2=0x7f68080abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:07.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 shutdown_connections 2023-08-27T11:29:07.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.739+0000 7f680c9ff700 1 -- 172.21.15.43:0/1573539660 wait complete. 2023-08-27T11:29:07.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:29:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.963+0000 7f6daa9ff700 1 Processor -- start 2023-08-27T11:29:07.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.963+0000 7f6daa9ff700 1 -- start start 2023-08-27T11:29:07.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6daa9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6daa9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 0x7f6da40ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6daa9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da4154660 con 0x7f6da40abcc0 2023-08-27T11:29:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6daa9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da40c5750 con 0x7f6da40c7c00 2023-08-27T11:29:07.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6daa9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4154940 con 0x7f6da4151d20 2023-08-27T11:29:07.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6da8f9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6da40abcc0 0x7f6da406a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37052/0 (socket says 172.21.15.43:37052) 2023-08-27T11:29:07.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6da8f9c700 1 -- 172.21.15.43:0/1773188693 learned_addr learned my addr 172.21.15.43:0/1773188693 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:07.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6d9bfff700 1 --2- 172.21.15.43:0/1773188693 >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 0x7f6da40ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.964+0000 7f6da3fff700 1 --2- 172.21.15.43:0/1773188693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da37fe700 1 -- 172.21.15.43:0/1773188693 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606234847 0 0) 0x7f6da4154660 con 0x7f6da40abcc0 2023-08-27T11:29:07.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da37fe700 1 -- 172.21.15.43:0/1773188693 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d900035b0 con 0x7f6da40abcc0 2023-08-27T11:29:07.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da3fff700 1 -- 172.21.15.43:0/1773188693 >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 msgr2=0x7f6da40ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:07.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da3fff700 1 --2- 172.21.15.43:0/1773188693 >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 0x7f6da40ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da3fff700 1 -- 172.21.15.43:0/1773188693 >> v1:172.21.15.43:6789/0 conn(0x7f6da40abcc0 legacy=0x7f6da406a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da3fff700 1 -- 172.21.15.43:0/1773188693 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4154c20 con 0x7f6da4151d20 2023-08-27T11:29:07.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6d9bfff700 1 --2- 172.21.15.43:0/1773188693 >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 0x7f6da40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:07.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.965+0000 7f6da3fff700 1 --2- 172.21.15.43:0/1773188693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c8110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009840 tx=0x7f6d94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d919dc54ffb270 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6da37fe700 1 -- 172.21.15.43:0/1773188693 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94011830 con 0x7f6da4151d20 2023-08-27T11:29:07.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6da37fe700 1 -- 172.21.15.43:0/1773188693 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94011990 con 0x7f6da4151d20 2023-08-27T11:29:07.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6da37fe700 1 -- 172.21.15.43:0/1773188693 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94011d20 con 0x7f6da4151d20 2023-08-27T11:29:07.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 -- 172.21.15.43:0/1773188693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 msgr2=0x7f6da40c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/1773188693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c8110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009840 tx=0x7f6d94009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:07.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 -- 172.21.15.43:0/1773188693 shutdown_connections 2023-08-27T11:29:07.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/1773188693 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c8110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/1773188693 >> v2:172.21.15.57:3300/0 conn(0x7f6da40c7c00 0x7f6da40ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 -- 172.21.15.43:0/1773188693 >> 172.21.15.43:0/1773188693 conn(0x7f6da40c9d00 msgr2=0x7f6da40ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:07.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 -- 172.21.15.43:0/1773188693 shutdown_connections 2023-08-27T11:29:07.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.966+0000 7f6daa9ff700 1 -- 172.21.15.43:0/1773188693 wait complete. 2023-08-27T11:29:07.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.968+0000 7f6daa9ff700 1 Processor -- start 2023-08-27T11:29:07.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.968+0000 7f6daa9ff700 1 -- start start 2023-08-27T11:29:07.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 0x7f6da41ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da41eded0 con 0x7f6da40c7c00 2023-08-27T11:29:07.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da4155a70 con 0x7f6da40abcc0 2023-08-27T11:29:07.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6daa9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40aaa20 con 0x7f6da4151d20 2023-08-27T11:29:07.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36306/0 (socket says 172.21.15.43:36306) 2023-08-27T11:29:07.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.969+0000 7f6d9bfff700 1 -- 172.21.15.43:0/4099177459 learned_addr learned my addr 172.21.15.43:0/4099177459 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:07.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da3fff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 0x7f6da41ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da8f9c700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 -- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 msgr2=0x7f6da40c3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 -- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 msgr2=0x7f6da41ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 0x7f6da41ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:07.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 -- 172.21.15.43:0/4099177459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0094a0 con 0x7f6da40c7c00 2023-08-27T11:29:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da3fff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 0x7f6da41ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da8f9c700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6d9bfff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00ec10 tx=0x7f6d8c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00c940 con 0x7f6da40c7c00 2023-08-27T11:29:07.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00caa0 con 0x7f6da40c7c00 2023-08-27T11:29:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940094a0 con 0x7f6da40c7c00 2023-08-27T11:29:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.970+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00ce10 con 0x7f6da40c7c00 2023-08-27T11:29:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.971+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da40aafe0 con 0x7f6da40c7c00 2023-08-27T11:29:07.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.972+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da4155c00 con 0x7f6da40c7c00 2023-08-27T11:29:07.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.973+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6d8c013470 con 0x7f6da40c7c00 2023-08-27T11:29:07.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.973+0000 7f6da17fa700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 0x7f6d8406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:07.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.974+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f6d8c088bf0 con 0x7f6da40c7c00 2023-08-27T11:29:07.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.974+0000 7f6da3fff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 0x7f6d8406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:07.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.974+0000 7f6da3fff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 0x7f6d8406c5d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000c00 tx=0x7f6d94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:07.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:07.978+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6d8c053e00 con 0x7f6da40c7c00 2023-08-27T11:29:08.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.193+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6da404ee70 con 0x7f6da40c7c00 2023-08-27T11:29:08.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.193+0000 7f6da17fa700 1 -- 172.21.15.43:0/4099177459 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d8c0170a0 con 0x7f6da40c7c00 2023-08-27T11:29:08.195 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:29:08.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 msgr2=0x7f6d8406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 0x7f6d8406c5d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000c00 tx=0x7f6d94008030 comp rx=0 tx=0).stop 2023-08-27T11:29:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 msgr2=0x7f6da4153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00ec10 tx=0x7f6d8c009ec0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 shutdown_connections 2023-08-27T11:29:08.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6d8406a110 0x7f6d8406c5d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6da4151d20 0x7f6da40c3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6da40abcc0 0x7f6da41ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 --2- 172.21.15.43:0/4099177459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6da40c7c00 0x7f6da4153680 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 >> 172.21.15.43:0/4099177459 conn(0x7f6da40c9d00 msgr2=0x7f6da40c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:08.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 shutdown_connections 2023-08-27T11:29:08.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.196+0000 7f6daa9ff700 1 -- 172.21.15.43:0/4099177459 wait complete. 2023-08-27T11:29:08.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:29:08.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.419+0000 7f12415ff700 1 Processor -- start 2023-08-27T11:29:08.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.419+0000 7f12415ff700 1 -- start start 2023-08-27T11:29:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.420+0000 7f12415ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c0c7c00 0x7f123c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.420+0000 7f12415ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f123c06a8e0 0x7f123c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f12415ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c154660 con 0x7f123c151d20 2023-08-27T11:29:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f12415ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0c5750 con 0x7f123c06a8e0 2023-08-27T11:29:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f12415ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c154940 con 0x7f123c0c7c00 2023-08-27T11:29:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f123c06a8e0 0x7f123c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f1233fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c0c7c00 0x7f123c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f123c06a8e0 0x7f123c06ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:38922/0 (socket says 172.21.15.43:38922) 2023-08-27T11:29:08.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 -- 172.21.15.43:0/1680299655 learned_addr learned my addr 172.21.15.43:0/1680299655 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:08.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 -- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c0c7c00 msgr2=0x7f123c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:08.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 --2- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c0c7c00 0x7f123c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 -- 172.21.15.43:0/1680299655 >> v1:172.21.15.57:6789/0 conn(0x7f123c151d20 legacy=0x7f123c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.421+0000 7f123b7fe700 1 -- 172.21.15.43:0/1680299655 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c154c20 con 0x7f123c06a8e0 2023-08-27T11:29:08.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f123b7fe700 1 --2- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c06a8e0 0x7f123c06ad50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1234009e50 tx=0x7f123400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74db4783fd29d8c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f123a7fc700 1 -- 172.21.15.43:0/1680299655 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400e070 con 0x7f123c06a8e0 2023-08-27T11:29:08.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f123a7fc700 1 -- 172.21.15.43:0/1680299655 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400b910 con 0x7f123c06a8e0 2023-08-27T11:29:08.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f123a7fc700 1 -- 172.21.15.43:0/1680299655 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400bcc0 con 0x7f123c06a8e0 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f12415ff700 1 -- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c06a8e0 msgr2=0x7f123c06ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.422+0000 7f12415ff700 1 --2- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c06a8e0 0x7f123c06ad50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1234009e50 tx=0x7f123400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 -- 172.21.15.43:0/1680299655 shutdown_connections 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 --2- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c06a8e0 0x7f123c06ad50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 --2- 172.21.15.43:0/1680299655 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c0c7c00 0x7f123c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 -- 172.21.15.43:0/1680299655 >> 172.21.15.43:0/1680299655 conn(0x7f123c0c9d00 msgr2=0x7f123c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 -- 172.21.15.43:0/1680299655 shutdown_connections 2023-08-27T11:29:08.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.423+0000 7f12415ff700 1 -- 172.21.15.43:0/1680299655 wait complete. 2023-08-27T11:29:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.424+0000 7f12415ff700 1 Processor -- start 2023-08-27T11:29:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.425+0000 7f12415ff700 1 -- start start 2023-08-27T11:29:08.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.425+0000 7f12415ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c06a8e0 0x7f123c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f12415ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c0c7c00 0x7f123c1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f12415ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f12415ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1ead80 con 0x7f123c151d20 2023-08-27T11:29:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f12415ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1edd80 con 0x7f123c0c7c00 2023-08-27T11:29:08.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f12415ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c14e5a0 con 0x7f123c06a8e0 2023-08-27T11:29:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36314/0 (socket says 172.21.15.43:36314) 2023-08-27T11:29:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 -- 172.21.15.43:0/3627674403 learned_addr learned my addr 172.21.15.43:0/3627674403 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123affd700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c06a8e0 0x7f123c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f1233fff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c0c7c00 0x7f123c1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 -- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c06a8e0 msgr2=0x7f123c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c06a8e0 0x7f123c14dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 -- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c0c7c00 msgr2=0x7f123c1ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c0c7c00 0x7f123c1ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.426+0000 7f123b7fe700 1 -- 172.21.15.43:0/3627674403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009b30 con 0x7f123c151d20 2023-08-27T11:29:08.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f123b7fe700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f123400b370 tx=0x7f1234004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234004840 con 0x7f123c151d20 2023-08-27T11:29:08.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12340092e0 con 0x7f123c151d20 2023-08-27T11:29:08.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340049c0 con 0x7f123c151d20 2023-08-27T11:29:08.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c14e880 con 0x7f123c151d20 2023-08-27T11:29:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.427+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c1eb2b0 con 0x7f123c151d20 2023-08-27T11:29:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.428+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c14ea70 con 0x7f123c151d20 2023-08-27T11:29:08.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.429+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f123401c680 con 0x7f123c151d20 2023-08-27T11:29:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.430+0000 7f12337fe700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 0x7f121c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.430+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f123408a250 con 0x7f123c151d20 2023-08-27T11:29:08.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.430+0000 7f123affd700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 0x7f121c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.431+0000 7f123affd700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 0x7f121c06c5a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f122c007fd0 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.434+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12340555b0 con 0x7f123c151d20 2023-08-27T11:29:08.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.643+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f123c04ee70 con 0x7f123c151d20 2023-08-27T11:29:08.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.644+0000 7f12337fe700 1 -- 172.21.15.43:0/3627674403 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1234058bd0 con 0x7f123c151d20 2023-08-27T11:29:08.646 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:29:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 msgr2=0x7f121c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 0x7f121c06c5a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f122c007fd0 tx=0x7f122c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 msgr2=0x7f123c0aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f123400b370 tx=0x7f1234004b20 comp rx=0 tx=0).stop 2023-08-27T11:29:08.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 shutdown_connections 2023-08-27T11:29:08.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f121c06a0e0 0x7f121c06c5a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f123c151d20 0x7f123c0aa920 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.649 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f123c06a8e0 0x7f123c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 --2- 172.21.15.43:0/3627674403 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f123c0c7c00 0x7f123c1ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 >> 172.21.15.43:0/3627674403 conn(0x7f123c0c9d00 msgr2=0x7f123c0c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:08.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 shutdown_connections 2023-08-27T11:29:08.650 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.646+0000 7f12415ff700 1 -- 172.21.15.43:0/3627674403 wait complete. 2023-08-27T11:29:08.666 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:29:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.868+0000 7ffbd11ff700 1 Processor -- start 2023-08-27T11:29:08.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.868+0000 7ffbd11ff700 1 -- start start 2023-08-27T11:29:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbd11ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc151d20 0x7ffbcc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbd11ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbd11ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc154660 con 0x7ffbcc0c7c00 2023-08-27T11:29:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbd11ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0c5750 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbd11ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc154940 con 0x7ffbcc151d20 2023-08-27T11:29:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbcb59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbcb59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40818/0 (socket says 172.21.15.43:40818) 2023-08-27T11:29:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2261019698 learned_addr learned my addr 172.21.15.43:0/2261019698 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.869+0000 7ffbcad9d700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc151d20 0x7ffbcc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2261019698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc151d20 msgr2=0x7ffbcc0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbcb59e700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc151d20 0x7ffbcc0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2261019698 >> v1:172.21.15.57:6789/0 conn(0x7ffbcc0c7c00 legacy=0x7ffbcc0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2261019698 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc154c20 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbcb59e700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009e50 tx=0x7ffbc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c70763044fe60f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbc9d9b700 1 -- 172.21.15.43:0/2261019698 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400e070 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbc9d9b700 1 -- 172.21.15.43:0/2261019698 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400b910 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.870+0000 7ffbc9d9b700 1 -- 172.21.15.43:0/2261019698 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400bcc0 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2261019698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc06a8e0 msgr2=0x7ffbcc06ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009e50 tx=0x7ffbc400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2261019698 shutdown_connections 2023-08-27T11:29:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc06a8e0 0x7ffbcc06ad70 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2261019698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc151d20 0x7ffbcc0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2261019698 >> 172.21.15.43:0/2261019698 conn(0x7ffbcc0c9d00 msgr2=0x7ffbcc0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2261019698 shutdown_connections 2023-08-27T11:29:08.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.871+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2261019698 wait complete. 2023-08-27T11:29:08.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.873+0000 7ffbd11ff700 1 Processor -- start 2023-08-27T11:29:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.873+0000 7ffbd11ff700 1 -- start start 2023-08-27T11:29:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc06a8e0 0x7ffbcc0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbcc0c7c00 0x7ffbcc0c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1ea4e0 con 0x7ffbcc151d20 2023-08-27T11:29:08.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1eaa10 con 0x7ffbcc0c7c00 2023-08-27T11:29:08.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbd11ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1ea730 con 0x7ffbcc06a8e0 2023-08-27T11:29:08.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40828/0 (socket says 172.21.15.43:40828) 2023-08-27T11:29:08.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2517758531 learned_addr learned my addr 172.21.15.43:0/2517758531 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:08.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcad9d700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc06a8e0 0x7ffbcc0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbca59c700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbcc0c7c00 0x7ffbcc0c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc06a8e0 msgr2=0x7ffbcc0c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc06a8e0 0x7ffbcc0c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbcc0c7c00 msgr2=0x7ffbcc0c1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:08.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbcc0c7c00 0x7ffbcc0c1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:08.882 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.874+0000 7ffbcb59e700 1 -- 172.21.15.43:0/2517758531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4009b30 con 0x7ffbcc151d20 2023-08-27T11:29:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbcb59e700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0ac340 tx=0x7ffbc4004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4004960 con 0x7ffbcc151d20 2023-08-27T11:29:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc40092e0 con 0x7ffbcc151d20 2023-08-27T11:29:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0c0e70 con 0x7ffbcc151d20 2023-08-27T11:29:08.883 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc401c680 con 0x7ffbcc151d20 2023-08-27T11:29:08.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.875+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0c2a00 con 0x7ffbcc151d20 2023-08-27T11:29:08.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.876+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc0c1390 con 0x7ffbcc151d20 2023-08-27T11:29:08.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.877+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffbc401c7e0 con 0x7ffbcc151d20 2023-08-27T11:29:08.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.878+0000 7ffbb37fe700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 0x7ffbb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:08.884 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.878+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7ffbc408a5e0 con 0x7ffbcc151d20 2023-08-27T11:29:08.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.878+0000 7ffbcad9d700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 0x7ffbb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:08.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.879+0000 7ffbcad9d700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 0x7ffbb806c5a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009ad0 tx=0x7ffbbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:08.885 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:08.882+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffbcc0c1390 con 0x7ffbcc151d20 2023-08-27T11:29:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.096+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbcc0c1390 con 0x7ffbcc151d20 2023-08-27T11:29:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.097+0000 7ffbb37fe700 1 -- 172.21.15.43:0/2517758531 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbcc0c1390 con 0x7ffbcc151d20 2023-08-27T11:29:09.099 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:29:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.099+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 msgr2=0x7ffbb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.099+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 0x7ffbb806c5a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009ad0 tx=0x7ffbbc008040 comp rx=0 tx=0).stop 2023-08-27T11:29:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.099+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 msgr2=0x7ffbcc1482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.099+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0ac340 tx=0x7ffbc4004b20 comp rx=0 tx=0).stop 2023-08-27T11:29:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 shutdown_connections 2023-08-27T11:29:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffbb806a0e0 0x7ffbb806c5a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffbcc151d20 0x7ffbcc1482b0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffbcc06a8e0 0x7ffbcc0c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 --2- 172.21.15.43:0/2517758531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbcc0c7c00 0x7ffbcc0c1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 >> 172.21.15.43:0/2517758531 conn(0x7ffbcc0c9d00 msgr2=0x7ffbcc0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 shutdown_connections 2023-08-27T11:29:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.100+0000 7ffbd11ff700 1 -- 172.21.15.43:0/2517758531 wait complete. 2023-08-27T11:29:09.119 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-27T11:29:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.324+0000 7f1ff53ff700 1 Processor -- start 2023-08-27T11:29:09.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.324+0000 7f1ff53ff700 1 -- start start 2023-08-27T11:29:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1ff53ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff00c0020 0x7f1ff0158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1ff53ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff0151fc0 0x7f1ff00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1ff53ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff0157af0 con 0x7f1ff0071f70 2023-08-27T11:29:09.327 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1ff53ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff0071e10 con 0x7f1ff0151fc0 2023-08-27T11:29:09.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1ff53ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff0158a80 con 0x7f1ff00c0020 2023-08-27T11:29:09.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1fef7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff0151fc0 0x7f1ff00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1fef7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1ff0151fc0 0x7f1ff00708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40836/0 (socket says 172.21.15.43:40836) 2023-08-27T11:29:09.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1feeffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff00c0020 0x7f1ff0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.328 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.325+0000 7f1fef7fe700 1 -- 172.21.15.43:0/2064552899 learned_addr learned my addr 172.21.15.43:0/2064552899 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:09.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fef7fe700 1 -- 172.21.15.43:0/2064552899 >> v2:172.21.15.57:3300/0 conn(0x7f1ff00c0020 msgr2=0x7f1ff0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:09.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fef7fe700 1 --2- 172.21.15.43:0/2064552899 >> v2:172.21.15.57:3300/0 conn(0x7f1ff00c0020 0x7f1ff0158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fef7fe700 1 -- 172.21.15.43:0/2064552899 >> v1:172.21.15.57:6789/0 conn(0x7f1ff0071f70 legacy=0x7f1ff01518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.329 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fef7fe700 1 -- 172.21.15.43:0/2064552899 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00a6040 con 0x7f1ff0151fc0 2023-08-27T11:29:09.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fef7fe700 1 --2- 172.21.15.43:0/2064552899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff00708c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00c1060 tx=0x7f1fe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3598937c91955a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fedffb700 1 -- 172.21.15.43:0/2064552899 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800e070 con 0x7f1ff0151fc0 2023-08-27T11:29:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fedffb700 1 -- 172.21.15.43:0/2064552899 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe800b910 con 0x7f1ff0151fc0 2023-08-27T11:29:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.326+0000 7f1fedffb700 1 -- 172.21.15.43:0/2064552899 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800bcc0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 -- 172.21.15.43:0/2064552899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 msgr2=0x7f1ff00708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/2064552899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff00708c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00c1060 tx=0x7f1fe800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 -- 172.21.15.43:0/2064552899 shutdown_connections 2023-08-27T11:29:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/2064552899 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff00708c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/2064552899 >> v2:172.21.15.57:3300/0 conn(0x7f1ff00c0020 0x7f1ff0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 -- 172.21.15.43:0/2064552899 >> 172.21.15.43:0/2064552899 conn(0x7f1ff00c6a40 msgr2=0x7f1ff00c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:09.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 -- 172.21.15.43:0/2064552899 shutdown_connections 2023-08-27T11:29:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.327+0000 7f1ff53ff700 1 -- 172.21.15.43:0/2064552899 wait complete. 2023-08-27T11:29:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.329+0000 7f1ff53ff700 1 Processor -- start 2023-08-27T11:29:09.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.329+0000 7f1ff53ff700 1 -- start start 2023-08-27T11:29:09.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff0071f70 0x7f1ff0157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 0x7f1ff0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00a78e0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00a7bc0 con 0x7f1ff0071f70 2023-08-27T11:29:09.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1ff53ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff01ed710 con 0x7f1ff00c0020 2023-08-27T11:29:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1fef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1fef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40846/0 (socket says 172.21.15.43:40846) 2023-08-27T11:29:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1fef7fe700 1 -- 172.21.15.43:0/270424776 learned_addr learned my addr 172.21.15.43:0/270424776 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.330+0000 7f1feeffd700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff0071f70 0x7f1ff0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 -- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 msgr2=0x7f1ff0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fee7fc700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 0x7f1ff0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 0x7f1ff0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 -- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff0071f70 msgr2=0x7f1ff0157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff0071f70 0x7f1ff0157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 -- 172.21.15.43:0/270424776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009b30 con 0x7f1ff0151fc0 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fee7fc700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 0x7f1ff0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fef7fe700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800b370 tx=0x7f1fe8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80099b0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80092e0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe801c660 con 0x7f1ff0151fc0 2023-08-27T11:29:09.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff00aa5e0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.331+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff0157560 con 0x7f1ff0151fc0 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.333+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff00c4af0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.333+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1fe801c7c0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.334+0000 7f1fd77fe700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 0x7f1fdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.334+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f1fe808a300 con 0x7f1ff0151fc0 2023-08-27T11:29:09.340 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.335+0000 7f1feeffd700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 0x7f1fdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.335+0000 7f1feeffd700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 0x7f1fdc06c5a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009b70 tx=0x7f1fe0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.339+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1fe80556d0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.550+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ff0157d10 con 0x7f1ff0151fc0 2023-08-27T11:29:09.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.551+0000 7f1fd77fe700 1 -- 172.21.15.43:0/270424776 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v129) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1fe8058cf0 con 0x7f1ff0151fc0 2023-08-27T11:29:09.552 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:29:09.554 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 msgr2=0x7f1fdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 0x7f1fdc06c5a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009b70 tx=0x7f1fe0008040 comp rx=0 tx=0).stop 2023-08-27T11:29:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 msgr2=0x7f1ff0155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800b370 tx=0x7f1fe8004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 shutdown_connections 2023-08-27T11:29:09.555 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1fdc06a0e0 0x7f1fdc06c5a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1ff0151fc0 0x7f1ff0155050 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff0071f70 0x7f1ff0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 --2- 172.21.15.43:0/270424776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff00c0020 0x7f1ff0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 >> 172.21.15.43:0/270424776 conn(0x7f1ff00c6a40 msgr2=0x7f1ff006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 shutdown_connections 2023-08-27T11:29:09.556 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.553+0000 7f1ff53ff700 1 -- 172.21.15.43:0/270424776 wait complete. 2023-08-27T11:29:09.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-27T11:29:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.777+0000 7f836ebff700 1 Processor -- start 2023-08-27T11:29:09.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.777+0000 7f836ebff700 1 -- start start 2023-08-27T11:29:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f836806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836ebff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8368155880 0x7f8368155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836ebff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83681561f0 con 0x7f83680c5230 2023-08-27T11:29:09.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836ebff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8368152290 con 0x7f8368155880 2023-08-27T11:29:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836806d7a0 con 0x7f836806c5e0 2023-08-27T11:29:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.778+0000 7f836c99b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f83680c5230 0x7f83680aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43084/0 (socket says 172.21.15.43:43084) 2023-08-27T11:29:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f836c99b700 1 -- 172.21.15.43:0/1168617742 learned_addr learned my addr 172.21.15.43:0/1168617742 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f8367fff700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f836806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f836d19c700 1 --2- 172.21.15.43:0/1168617742 >> v2:172.21.15.57:3300/0 conn(0x7f8368155880 0x7f8368155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908067227 0 0) 0x7f83681561f0 con 0x7f83680c5230 2023-08-27T11:29:09.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83580035b0 con 0x7f83680c5230 2023-08-27T11:29:09.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1720779025 0 0) 0x7f83580035b0 con 0x7f83680c5230 2023-08-27T11:29:09.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 msgr2=0x7f836806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:09.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f836806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 >> v2:172.21.15.57:3300/0 conn(0x7f8368155880 msgr2=0x7f8368155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 --2- 172.21.15.43:0/1168617742 >> v2:172.21.15.57:3300/0 conn(0x7f8368155880 0x7f8368155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368152550 con 0x7f83680c5230 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f835c001670 con 0x7f83680c5230 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 >> v1:172.21.15.43:6789/0 conn(0x7f83680c5230 legacy=0x7f83680aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8358003a70 0x7f8358003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f8358004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.779+0000 7f83677fe700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8358004d90 0x7f8358005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368152290 con 0x7f8358004d90 2023-08-27T11:29:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836806d7a0 con 0x7f8358003a70 2023-08-27T11:29:09.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835800baf0 con 0x7f836806c5e0 2023-08-27T11:29:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8358004d90 0x7f8358005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836c99b700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8358003a70 0x7f8358003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f8367fff700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f8358004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 -- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 msgr2=0x7f8358004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:09.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f836806c5e0 0x7f8358004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 -- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8358003a70 msgr2=0x7f8358003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:09.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8358003a70 0x7f8358003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 -- 172.21.15.43:0/1168617742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580035b0 con 0x7f8358004d90 2023-08-27T11:29:09.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.780+0000 7f836d19c700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8358004d90 0x7f8358005210 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8360009f90 tx=0x7f8358005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1e147e31327ac3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836000ec30 con 0x7f8358004d90 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000f040 con 0x7f8358004d90 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f83677fe700 1 -- 172.21.15.43:0/1168617742 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360014480 con 0x7f8358004d90 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 -- 172.21.15.43:0/1168617742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8358004d90 msgr2=0x7f8358005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 --2- 172.21.15.43:0/1168617742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8358004d90 0x7f8358005210 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f8360009f90 tx=0x7f8358005880 comp rx=0 tx=0).stop 2023-08-27T11:29:09.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836d19c700 1 -- 172.21.15.43:0/1168617742 reap_dead start 2023-08-27T11:29:09.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 -- 172.21.15.43:0/1168617742 shutdown_connections 2023-08-27T11:29:09.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 -- 172.21.15.43:0/1168617742 >> 172.21.15.43:0/1168617742 conn(0x7f83680c5b10 msgr2=0x7f83680c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:09.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 -- 172.21.15.43:0/1168617742 shutdown_connections 2023-08-27T11:29:09.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.781+0000 7f836ebff700 1 -- 172.21.15.43:0/1168617742 wait complete. 2023-08-27T11:29:09.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.783+0000 7f836ebff700 1 Processor -- start 2023-08-27T11:29:09.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.783+0000 7f836ebff700 1 -- start start 2023-08-27T11:29:09.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8358004d90 0x7f83680a6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f836814a610 0x7f836814ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83680aa580 con 0x7f8368149ef0 2023-08-27T11:29:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8368148ae0 con 0x7f836814a610 2023-08-27T11:29:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836ebff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836814aaa0 con 0x7f8358004d90 2023-08-27T11:29:09.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836d19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836d19c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40860/0 (socket says 172.21.15.43:40860) 2023-08-27T11:29:09.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836d19c700 1 -- 172.21.15.43:0/3674638504 learned_addr learned my addr 172.21.15.43:0/3674638504 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:09.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f836c99b700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8358004d90 0x7f83680a6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.784+0000 7f8367fff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f836814a610 0x7f836814ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 -- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8358004d90 msgr2=0x7f83680a6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8358004d90 0x7f83680a6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 -- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f836814a610 msgr2=0x7f836814ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:09.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f836814a610 0x7f836814ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:09.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 -- 172.21.15.43:0/3674638504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83680bf550 con 0x7f8368149ef0 2023-08-27T11:29:09.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836d19c700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f835800ba40 tx=0x7f8360009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360014bf0 con 0x7f8368149ef0 2023-08-27T11:29:09.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360014d70 con 0x7f8368149ef0 2023-08-27T11:29:09.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83681ed230 con 0x7f8368149ef0 2023-08-27T11:29:09.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.785+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83600276b0 con 0x7f8368149ef0 2023-08-27T11:29:09.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.786+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83680a6a70 con 0x7f8368149ef0 2023-08-27T11:29:09.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.787+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836804ee70 con 0x7f8368149ef0 2023-08-27T11:29:09.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.788+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8360024070 con 0x7f8368149ef0 2023-08-27T11:29:09.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.789+0000 7f83657fa700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 0x7f834c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:09.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.789+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f836008a300 con 0x7f8368149ef0 2023-08-27T11:29:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.789+0000 7f836c99b700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 0x7f834c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.790+0000 7f836c99b700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 0x7f834c06c5a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f835c001bf0 tx=0x7f835c001dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:09.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:09.793+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f83600556d0 con 0x7f8368149ef0 2023-08-27T11:29:10.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.005+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f836806ca80 con 0x7f8368149ef0 2023-08-27T11:29:10.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.006+0000 7f83657fa700 1 -- 172.21.15.43:0/3674638504 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v129) v1 ==== 101+0+11 (secure 0 0 0) 0x7f8360058cf0 con 0x7f8368149ef0 2023-08-27T11:29:10.008 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:29:10.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 msgr2=0x7f834c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 0x7f834c06c5a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f835c001bf0 tx=0x7f835c001dd0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 msgr2=0x7f836814ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f835800ba40 tx=0x7f8360009750 comp rx=0 tx=0).stop 2023-08-27T11:29:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 shutdown_connections 2023-08-27T11:29:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f834c06a0e0 0x7f834c06c5a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8368149ef0 0x7f836814ef70 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8358004d90 0x7f83680a6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 --2- 172.21.15.43:0/3674638504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f836814a610 0x7f836814ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 >> 172.21.15.43:0/3674638504 conn(0x7f83680c5b10 msgr2=0x7f83680aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:10.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.008+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 shutdown_connections 2023-08-27T11:29:10.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.009+0000 7f836ebff700 1 -- 172.21.15.43:0/3674638504 wait complete. 2023-08-27T11:29:10.028 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:10.229 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.228+0000 7fa21afff700 1 Processor -- start 2023-08-27T11:29:10.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.228+0000 7fa21afff700 1 -- start start 2023-08-27T11:29:10.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa21afff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa21414e960 0x7fa2140a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa21afff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 0x7fa2140c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa21afff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa214154d00 con 0x7fa2140a79c0 2023-08-27T11:29:10.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa21afff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140baf30 con 0x7fa21414e960 2023-08-27T11:29:10.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa21afff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa214154fe0 con 0x7fa2140c50d0 2023-08-27T11:29:10.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.229+0000 7fa218d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa21414e960 0x7fa2140a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa21414e960 0x7fa2140a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40874/0 (socket says 172.21.15.43:40874) 2023-08-27T11:29:10.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 -- 172.21.15.43:0/2886620709 learned_addr learned my addr 172.21.15.43:0/2886620709 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:10.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa213fff700 1 --1- 172.21.15.43:0/2886620709 >> v1:172.21.15.43:6789/0 conn(0x7fa2140a79c0 0x7fa2140c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43098/0 (socket says 172.21.15.43:43098) 2023-08-27T11:29:10.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa21959c700 1 --2- 172.21.15.43:0/2886620709 >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 0x7fa2140c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 -- 172.21.15.43:0/2886620709 >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 msgr2=0x7fa2140c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2886620709 >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 0x7fa2140c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 -- 172.21.15.43:0/2886620709 >> v1:172.21.15.43:6789/0 conn(0x7fa2140a79c0 legacy=0x7fa2140c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 -- 172.21.15.43:0/2886620709 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2141552c0 con 0x7fa21414e960 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa21959c700 1 --2- 172.21.15.43:0/2886620709 >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 0x7fa2140c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:10.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.230+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2886620709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2140a7480 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa2141521a0 tx=0x7fa208009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b866e3a3f48031 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa2137fe700 1 -- 172.21.15.43:0/2886620709 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20800b870 con 0x7fa21414e960 2023-08-27T11:29:10.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa2137fe700 1 -- 172.21.15.43:0/2886620709 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20800b9d0 con 0x7fa21414e960 2023-08-27T11:29:10.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa2137fe700 1 -- 172.21.15.43:0/2886620709 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20800bd60 con 0x7fa21414e960 2023-08-27T11:29:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 -- 172.21.15.43:0/2886620709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 msgr2=0x7fa2140a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 --2- 172.21.15.43:0/2886620709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2140a7480 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fa2141521a0 tx=0x7fa208009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 -- 172.21.15.43:0/2886620709 shutdown_connections 2023-08-27T11:29:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 --2- 172.21.15.43:0/2886620709 >> v2:172.21.15.57:3300/0 conn(0x7fa2140c50d0 0x7fa2140c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 --2- 172.21.15.43:0/2886620709 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2140a7480 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 -- 172.21.15.43:0/2886620709 >> 172.21.15.43:0/2886620709 conn(0x7fa21406aa50 msgr2=0x7fa2140c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:10.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 -- 172.21.15.43:0/2886620709 shutdown_connections 2023-08-27T11:29:10.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.231+0000 7fa21afff700 1 -- 172.21.15.43:0/2886620709 wait complete. 2023-08-27T11:29:10.239 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.233+0000 7fa21afff700 1 Processor -- start 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.233+0000 7fa21afff700 1 -- start start 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 0x7fa2140bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2140c50d0 0x7fa2140a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140bd080 con 0x7fa21414e960 2023-08-27T11:29:10.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140a4a90 con 0x7fa2140c50d0 2023-08-27T11:29:10.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21afff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21414ba80 con 0x7fa2140a79c0 2023-08-27T11:29:10.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21959c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40886/0 (socket says 172.21.15.43:40886) 2023-08-27T11:29:10.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.234+0000 7fa21959c700 1 -- 172.21.15.43:0/2430835360 learned_addr learned my addr 172.21.15.43:0/2430835360 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 0x7fa2140bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa213fff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2140c50d0 0x7fa2140a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 -- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 msgr2=0x7fa2140bc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 0x7fa2140bc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 -- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2140c50d0 msgr2=0x7fa2140a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2140c50d0 0x7fa2140a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 -- 172.21.15.43:0/2430835360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009550 con 0x7fa21414e960 2023-08-27T11:29:10.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 0x7fa2140bc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:10.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21959c700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007f20 tx=0x7fa20c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00de90 con 0x7fa21414e960 2023-08-27T11:29:10.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00f040 con 0x7fa21414e960 2023-08-27T11:29:10.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c003c60 con 0x7fa21414e960 2023-08-27T11:29:10.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.235+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2141ee080 con 0x7fa21414e960 2023-08-27T11:29:10.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.236+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2140a92f0 con 0x7fa21414e960 2023-08-27T11:29:10.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.236+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2140bb390 con 0x7fa21414e960 2023-08-27T11:29:10.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.237+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa20c004030 con 0x7fa21414e960 2023-08-27T11:29:10.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.239+0000 7fa2117fa700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 0x7fa1f806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.239+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fa20c088a80 con 0x7fa21414e960 2023-08-27T11:29:10.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.239+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 0x7fa1f806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.240+0000 7fa218d9b700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 0x7fa1f806c5d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa208014040 tx=0x7fa208008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.243+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa20c053db0 con 0x7fa21414e960 2023-08-27T11:29:10.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.499+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2140a9680 con 0x7fa21414e960 2023-08-27T11:29:10.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.500+0000 7fa2117fa700 1 -- 172.21.15.43:0/2430835360 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7fa2140a9680 con 0x7fa21414e960 2023-08-27T11:29:10.501 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:10.502 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:10.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 msgr2=0x7fa1f806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 0x7fa1f806c5d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa208014040 tx=0x7fa208008030 comp rx=0 tx=0).stop 2023-08-27T11:29:10.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 msgr2=0x7fa2141ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa20c007f20 tx=0x7fa20c00d3b0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 shutdown_connections 2023-08-27T11:29:10.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa1f806a110 0x7fa1f806c5d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa21414e960 0x7fa2141ed140 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2140a79c0 0x7fa2140bc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 --2- 172.21.15.43:0/2430835360 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2140c50d0 0x7fa2140a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.502+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 >> 172.21.15.43:0/2430835360 conn(0x7fa21406aa50 msgr2=0x7fa214152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:10.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.503+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 shutdown_connections 2023-08-27T11:29:10.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.503+0000 7fa21afff700 1 -- 172.21.15.43:0/2430835360 wait complete. 2023-08-27T11:29:10.507 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:10.522 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:10.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.723+0000 7fd9877ff700 1 Processor -- start 2023-08-27T11:29:10.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.723+0000 7fd9877ff700 1 -- start start 2023-08-27T11:29:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.724+0000 7fd9877ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd9800c4630 0x7fd9800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.724+0000 7fd9877ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd98006ad70 0x7fd98006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.724+0000 7fd9877ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98006c4e0 con 0x7fd980151a90 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.724+0000 7fd9877ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd980155370 con 0x7fd9800c4630 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.724+0000 7fd9877ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800c82c0 con 0x7fd98006ad70 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd9800c4630 0x7fd9800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd9800c4630 0x7fd9800c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40894/0 (socket says 172.21.15.43:40894) 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 -- 172.21.15.43:0/3318246083 learned_addr learned my addr 172.21.15.43:0/3318246083 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:10.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd985d9c700 1 --2- 172.21.15.43:0/3318246083 >> v2:172.21.15.57:3300/0 conn(0x7fd98006ad70 0x7fd98006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 -- 172.21.15.43:0/3318246083 >> v2:172.21.15.57:3300/0 conn(0x7fd98006ad70 msgr2=0x7fd98006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 --2- 172.21.15.43:0/3318246083 >> v2:172.21.15.57:3300/0 conn(0x7fd98006ad70 0x7fd98006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 -- 172.21.15.43:0/3318246083 >> v1:172.21.15.57:6789/0 conn(0x7fd980151a90 legacy=0x7fd9800c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.725+0000 7fd984d9a700 1 -- 172.21.15.43:0/3318246083 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980151e70 con 0x7fd9800c4630 2023-08-27T11:29:10.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd984d9a700 1 --2- 172.21.15.43:0/3318246083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9800c4630 0x7fd9800c4a90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c4270 tx=0x7fd970009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60061063dc255200 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd977fff700 1 -- 172.21.15.43:0/3318246083 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970011830 con 0x7fd9800c4630 2023-08-27T11:29:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd977fff700 1 -- 172.21.15.43:0/3318246083 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970011990 con 0x7fd9800c4630 2023-08-27T11:29:10.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd977fff700 1 -- 172.21.15.43:0/3318246083 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970011d20 con 0x7fd9800c4630 2023-08-27T11:29:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 -- 172.21.15.43:0/3318246083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9800c4630 msgr2=0x7fd9800c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 --2- 172.21.15.43:0/3318246083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9800c4630 0x7fd9800c4a90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fd9800c4270 tx=0x7fd970009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 -- 172.21.15.43:0/3318246083 shutdown_connections 2023-08-27T11:29:10.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 --2- 172.21.15.43:0/3318246083 >> v2:172.21.15.57:3300/0 conn(0x7fd98006ad70 0x7fd98006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 --2- 172.21.15.43:0/3318246083 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd9800c4630 0x7fd9800c4a90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.726+0000 7fd9877ff700 1 -- 172.21.15.43:0/3318246083 >> 172.21.15.43:0/3318246083 conn(0x7fd9800ab820 msgr2=0x7fd9800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:10.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.727+0000 7fd9877ff700 1 -- 172.21.15.43:0/3318246083 shutdown_connections 2023-08-27T11:29:10.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.727+0000 7fd9877ff700 1 -- 172.21.15.43:0/3318246083 wait complete. 2023-08-27T11:29:10.734 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.728+0000 7fd9877ff700 1 Processor -- start 2023-08-27T11:29:10.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.728+0000 7fd9877ff700 1 -- start start 2023-08-27T11:29:10.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd9800c4630 0x7fd9800c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd980151a90 0x7fd9800bc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.735 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98014d940 con 0x7fd98006ad70 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800c3c00 con 0x7fd980151a90 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd9877ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9801ea420 con 0x7fd9800c4630 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd98559b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd98559b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40906/0 (socket says 172.21.15.43:40906) 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.729+0000 7fd98559b700 1 -- 172.21.15.43:0/764425637 learned_addr learned my addr 172.21.15.43:0/764425637 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:10.736 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd984d9a700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd9800c4630 0x7fd9800c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd985d9c700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd980151a90 0x7fd9800bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 -- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd9800c4630 msgr2=0x7fd9800c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd9800c4630 0x7fd9800c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 -- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd980151a90 msgr2=0x7fd9800bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.737 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd980151a90 0x7fd9800bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 -- 172.21.15.43:0/764425637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009550 con 0x7fd98006ad70 2023-08-27T11:29:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd98559b700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c450 tx=0x7fd97c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0052d0 con 0x7fd98006ad70 2023-08-27T11:29:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c005430 con 0x7fd98006ad70 2023-08-27T11:29:10.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98014db90 con 0x7fd98006ad70 2023-08-27T11:29:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.730+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0038c0 con 0x7fd98006ad70 2023-08-27T11:29:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.731+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9800c1410 con 0x7fd98006ad70 2023-08-27T11:29:10.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.731+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98004ee70 con 0x7fd98006ad70 2023-08-27T11:29:10.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.733+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd97c003a20 con 0x7fd98006ad70 2023-08-27T11:29:10.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.733+0000 7fd975ffb700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 0x7fd96406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:10.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.733+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fd97c087be0 con 0x7fd98006ad70 2023-08-27T11:29:10.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.734+0000 7fd984d9a700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 0x7fd96406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.734+0000 7fd984d9a700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 0x7fd96406c5a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd970009c10 tx=0x7fd970008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:10.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.738+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd97c052f10 con 0x7fd98006ad70 2023-08-27T11:29:10.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.950+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd98006c130 con 0x7fd98006ad70 2023-08-27T11:29:10.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.952+0000 7fd975ffb700 1 -- 172.21.15.43:0/764425637 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+21976 (secure 0 0 0) 0x7fd97c00ce60 con 0x7fd98006ad70 2023-08-27T11:29:10.954 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:10.954 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":129,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:00.535670+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.954+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 msgr2=0x7fd96406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.954+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 0x7fd96406c5a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd970009c10 tx=0x7fd970008030 comp rx=0 tx=0).stop 2023-08-27T11:29:10.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 msgr2=0x7fd9800c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00c450 tx=0x7fd97c00c760 comp rx=0 tx=0).stop 2023-08-27T11:29:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 shutdown_connections 2023-08-27T11:29:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd96406a0e0 0x7fd96406c5a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd980151a90 0x7fd9800bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd98006ad70 0x7fd9800c3080 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 --2- 172.21.15.43:0/764425637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd9800c4630 0x7fd9800c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 >> 172.21.15.43:0/764425637 conn(0x7fd9800ab820 msgr2=0x7fd980149c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 shutdown_connections 2023-08-27T11:29:10.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:10.955+0000 7fd9877ff700 1 -- 172.21.15.43:0/764425637 wait complete. 2023-08-27T11:29:10.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:29:10.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:11.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.175+0000 7fe4ddfff700 1 Processor -- start 2023-08-27T11:29:11.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.175+0000 7fe4ddfff700 1 -- start start 2023-08-27T11:29:11.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4ddfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4ddfff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d806d700 con 0x7fe4d80c51a0 2023-08-27T11:29:11.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4ddfff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d8152430 con 0x7fe4d8155910 2023-08-27T11:29:11.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4ddfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d81530b0 con 0x7fe4d806ca60 2023-08-27T11:29:11.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4d77fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe4d80c51a0 0x7fe4d80aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43104/0 (socket says 172.21.15.43:43104) 2023-08-27T11:29:11.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4d77fe700 1 -- 172.21.15.43:0/4075105152 learned_addr learned my addr 172.21.15.43:0/4075105152 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:11.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.176+0000 7fe4d6ffd700 1 --2- 172.21.15.43:0/4075105152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214241169 0 0) 0x7fe4d806d700 con 0x7fe4d80c51a0 2023-08-27T11:29:11.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c00035b0 con 0x7fe4d80c51a0 2023-08-27T11:29:11.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47892865 0 0) 0x7fe4d8152430 con 0x7fe4d8155910 2023-08-27T11:29:11.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d806d700 con 0x7fe4d8155910 2023-08-27T11:29:11.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/4075105152 >> v1:172.21.15.57:6789/0 conn(0x7fe4d8155910 legacy=0x7fe4d8155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.181 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/4075105152 >> v1:172.21.15.43:6789/0 conn(0x7fe4d80c51a0 legacy=0x7fe4d80aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/4075105152 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8152710 con 0x7fe4d806ca60 2023-08-27T11:29:11.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d6ffd700 1 --2- 172.21.15.43:0/4075105152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d806d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a99d5c4e9099c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.177+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc011830 con 0x7fe4d806ca60 2023-08-27T11:29:11.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc011990 con 0x7fe4d806ca60 2023-08-27T11:29:11.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4d67fc700 1 -- 172.21.15.43:0/4075105152 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc011d20 con 0x7fe4d806ca60 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 -- 172.21.15.43:0/4075105152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 msgr2=0x7fe4d806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/4075105152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d806d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc009b80 comp rx=0 tx=0).stop 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 -- 172.21.15.43:0/4075105152 shutdown_connections 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/4075105152 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d806d1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 -- 172.21.15.43:0/4075105152 >> 172.21.15.43:0/4075105152 conn(0x7fe4d806aa50 msgr2=0x7fe4d80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:11.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 -- 172.21.15.43:0/4075105152 shutdown_connections 2023-08-27T11:29:11.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.178+0000 7fe4ddfff700 1 -- 172.21.15.43:0/4075105152 wait complete. 2023-08-27T11:29:11.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.180+0000 7fe4ddfff700 1 Processor -- start 2023-08-27T11:29:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.180+0000 7fe4ddfff700 1 -- start start 2023-08-27T11:29:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d81e9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4d8155910 0x7fe4d8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d81edb50 con 0x7fe4d80c51a0 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80a81b0 con 0x7fe4d8155910 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4ddfff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d81ecf40 con 0x7fe4d806ca60 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4d6ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40918/0 (socket says 172.21.15.43:40918) 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/3864496965 learned_addr learned my addr 172.21.15.43:0/3864496965 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:11.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4d77fe700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d81e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.181+0000 7fe4d7fff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4d8155910 0x7fe4d8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 msgr2=0x7fe4d81e9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d81e9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4d8155910 msgr2=0x7fe4d8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4d8155910 0x7fe4d8071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 -- 172.21.15.43:0/3864496965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0094a0 con 0x7fe4d80c51a0 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4d6ffd700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0090b0 tx=0x7fe4cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01a6e0 con 0x7fe4d80c51a0 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc01a840 con 0x7fe4d80c51a0 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d81ed220 con 0x7fe4d80c51a0 2023-08-27T11:29:11.189 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc01abb0 con 0x7fe4d80c51a0 2023-08-27T11:29:11.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.182+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d81ed7e0 con 0x7fe4d80c51a0 2023-08-27T11:29:11.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.183+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d814c840 con 0x7fe4d80c51a0 2023-08-27T11:29:11.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.184+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4cc022070 con 0x7fe4d80c51a0 2023-08-27T11:29:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.185+0000 7fe4bffff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 0x7fe4c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.185+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fe4cc089990 con 0x7fe4d80c51a0 2023-08-27T11:29:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.186+0000 7fe4d77fe700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 0x7fe4c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.186+0000 7fe4d77fe700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 0x7fe4c406c5a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8007fd0 tx=0x7fe4c8007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.190+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe4d814c840 con 0x7fe4d80c51a0 2023-08-27T11:29:11.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.444+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4d814c840 con 0x7fe4d80c51a0 2023-08-27T11:29:11.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.444+0000 7fe4bffff700 1 -- 172.21.15.43:0/3864496965 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7fe4d814c840 con 0x7fe4d80c51a0 2023-08-27T11:29:11.446 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:11.446 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:11.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.446+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 msgr2=0x7fe4c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.446+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 0x7fe4c406c5a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8007fd0 tx=0x7fe4c8007e00 comp rx=0 tx=0).stop 2023-08-27T11:29:11.448 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.446+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 msgr2=0x7fe4d80a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.446+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0090b0 tx=0x7fe4cc004750 comp rx=0 tx=0).stop 2023-08-27T11:29:11.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 shutdown_connections 2023-08-27T11:29:11.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe4c406a0e0 0x7fe4c406c5a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4d8155910 0x7fe4d8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4d806ca60 0x7fe4d81e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 --2- 172.21.15.43:0/3864496965 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe4d80c51a0 0x7fe4d80a9df0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 >> 172.21.15.43:0/3864496965 conn(0x7fe4d806aa50 msgr2=0x7fe4d8153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:11.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 shutdown_connections 2023-08-27T11:29:11.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.447+0000 7fe4ddfff700 1 -- 172.21.15.43:0/3864496965 wait complete. 2023-08-27T11:29:11.451 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:11.466 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:11.566 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:29:11.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:29:11.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.675+0000 7fc2da5ff700 1 Processor -- start 2023-08-27T11:29:11.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.675+0000 7fc2da5ff700 1 -- start start 2023-08-27T11:29:11.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2da5ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc2d40c4a90 0x7fc2d406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2da5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d406c4e0 con 0x7fc2d4151a90 2023-08-27T11:29:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2da5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d4155370 con 0x7fc2d40c4630 2023-08-27T11:29:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2da5ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40c82c0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2d3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc2d4151a90 0x7fc2d40c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43106/0 (socket says 172.21.15.43:43106) 2023-08-27T11:29:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.676+0000 7fc2d3fff700 1 -- 172.21.15.43:0/3790442056 learned_addr learned my addr 172.21.15.43:0/3790442056 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:11.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d8b9c700 1 --2- 172.21.15.43:0/3790442056 >> v2:172.21.15.57:3300/0 conn(0x7fc2d40c4a90 0x7fc2d406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306087841 0 0) 0x7fc2d406c4e0 con 0x7fc2d4151a90 2023-08-27T11:29:11.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2bc0035b0 con 0x7fc2d4151a90 2023-08-27T11:29:11.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936249502 0 0) 0x7fc2d4155370 con 0x7fc2d40c4630 2023-08-27T11:29:11.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d406c4e0 con 0x7fc2d40c4630 2023-08-27T11:29:11.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d8b9c700 1 -- 172.21.15.43:0/3790442056 >> v1:172.21.15.57:6789/0 conn(0x7fc2d40c4630 legacy=0x7fc2d406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d8b9c700 1 -- 172.21.15.43:0/3790442056 >> v1:172.21.15.43:6789/0 conn(0x7fc2d4151a90 legacy=0x7fc2d40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.677+0000 7fc2d8b9c700 1 -- 172.21.15.43:0/3790442056 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4151e70 con 0x7fc2d40c4a90 2023-08-27T11:29:11.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2d8b9c700 1 --2- 172.21.15.43:0/3790442056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d40c4a90 0x7fc2d406b480 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009d90 tx=0x7fc2cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31a329dcd7c92a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00e070 con 0x7fc2d40c4a90 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc00bb20 con 0x7fc2d40c4a90 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2d2ffd700 1 -- 172.21.15.43:0/3790442056 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc012430 con 0x7fc2d40c4a90 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 -- 172.21.15.43:0/3790442056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d40c4a90 msgr2=0x7fc2d406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/3790442056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d40c4a90 0x7fc2d406b480 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009d90 tx=0x7fc2cc00b330 comp rx=0 tx=0).stop 2023-08-27T11:29:11.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 -- 172.21.15.43:0/3790442056 shutdown_connections 2023-08-27T11:29:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/3790442056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d40c4a90 0x7fc2d406b480 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 -- 172.21.15.43:0/3790442056 >> 172.21.15.43:0/3790442056 conn(0x7fc2d40ab820 msgr2=0x7fc2d40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 -- 172.21.15.43:0/3790442056 shutdown_connections 2023-08-27T11:29:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.678+0000 7fc2da5ff700 1 -- 172.21.15.43:0/3790442056 wait complete. 2023-08-27T11:29:11.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.681+0000 7fc2da5ff700 1 Processor -- start 2023-08-27T11:29:11.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.681+0000 7fc2da5ff700 1 -- start start 2023-08-27T11:29:11.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2d40c4630 0x7fc2d414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d4151a90 0x7fc2d41e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4155ff0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41ea500 con 0x7fc2d4151a90 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.682+0000 7fc2da5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41557e0 con 0x7fc2d40c4630 2023-08-27T11:29:11.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d8b9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d4151a90 0x7fc2d41e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40932/0 (socket says 172.21.15.43:40932) 2023-08-27T11:29:11.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2d40c4630 0x7fc2d414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 -- 172.21.15.43:0/1330557817 learned_addr learned my addr 172.21.15.43:0/1330557817 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:11.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 -- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2d40c4630 msgr2=0x7fc2d414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2d40c4630 0x7fc2d414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 -- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d4151a90 msgr2=0x7fc2d41e9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d4151a90 0x7fc2d41e9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 -- 172.21.15.43:0/1330557817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc009a70 con 0x7fc2d40c4a90 2023-08-27T11:29:11.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.683+0000 7fc2d37fe700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c520 tx=0x7fc2c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.684+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80052d0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.684+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005430 con 0x7fc2d40c4a90 2023-08-27T11:29:11.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.684+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d41e95c0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.684+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80038c0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.684+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d41eaa90 con 0x7fc2d40c4a90 2023-08-27T11:29:11.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.685+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d41e97a0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.686+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2c8003a20 con 0x7fc2d40c4a90 2023-08-27T11:29:11.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.687+0000 7fc2d0ff9700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 0x7fc2c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:11.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.687+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fc2c8087d30 con 0x7fc2d40c4a90 2023-08-27T11:29:11.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.687+0000 7fc2d3fff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 0x7fc2c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:11.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.688+0000 7fc2d3fff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 0x7fc2c006c5a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4007fd0 tx=0x7fc2c4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:11.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.691+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2d41e97a0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.946+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d41e97a0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.947+0000 7fc2d0ff9700 1 -- 172.21.15.43:0/1330557817 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+6069 (secure 0 0 0) 0x7fc2d41e97a0 con 0x7fc2d40c4a90 2023-08-27T11:29:11.948 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:11.949 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138}],"filesystems":[{"mdsmap":{"epoch":140,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:35.519882+0000","modified":"2023-08-27T11:29:03.549817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":129,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6776":{"gid":6776,"name":"b","rank":0,"incarnation":137,"state":"up:active","state_seq":11,"addr":"172.21.15.57:6834/3257371578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":3257371578},{"type":"v1","addr":"172.21.15.57:6834","nonce":3257371578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9},{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:11.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 msgr2=0x7fc2c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 0x7fc2c006c5a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4007fd0 tx=0x7fc2c4007de0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 msgr2=0x7fc2d41e9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:11.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c520 tx=0x7fc2c800c830 comp rx=0 tx=0).stop 2023-08-27T11:29:11.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 shutdown_connections 2023-08-27T11:29:11.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc2c006a0e0 0x7fc2c006c5a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc2d4151a90 0x7fc2d41e9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc2d40c4630 0x7fc2d414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 --2- 172.21.15.43:0/1330557817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc2d40c4a90 0x7fc2d41e9a80 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:11.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 >> 172.21.15.43:0/1330557817 conn(0x7fc2d40ab820 msgr2=0x7fc2d40c9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:11.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 shutdown_connections 2023-08-27T11:29:11.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:11.949+0000 7fc2da5ff700 1 -- 172.21.15.43:0/1330557817 wait complete. 2023-08-27T11:29:11.953 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 140 2023-08-27T11:29:11.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:12.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.210+0000 7f145c1ff700 1 Processor -- start 2023-08-27T11:29:12.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.210+0000 7f145c1ff700 1 -- start start 2023-08-27T11:29:12.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145c1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f145406d1c0 0x7f1454156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145c1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1454152430 con 0x7f145406ca60 2023-08-27T11:29:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145c1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1454152710 con 0x7f14540c51a0 2023-08-27T11:29:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145c1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14541530b0 con 0x7f145406d1c0 2023-08-27T11:29:12.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145a79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f145406d1c0 0x7f1454156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145a79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f145406d1c0 0x7f1454156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40948/0 (socket says 172.21.15.43:40948) 2023-08-27T11:29:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.211+0000 7f145a79c700 1 -- 172.21.15.43:0/667148078 learned_addr learned my addr 172.21.15.43:0/667148078 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f145a79c700 1 -- 172.21.15.43:0/667148078 >> v1:172.21.15.57:6789/0 conn(0x7f14540c51a0 legacy=0x7f14540aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f145a79c700 1 -- 172.21.15.43:0/667148078 >> v1:172.21.15.43:6789/0 conn(0x7f145406ca60 legacy=0x7f1454155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f145a79c700 1 -- 172.21.15.43:0/667148078 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14541529f0 con 0x7f145406d1c0 2023-08-27T11:29:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f145a79c700 1 --2- 172.21.15.43:0/667148078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406d1c0 0x7f1454156020 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e50 tx=0x7f144c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f1e1447431d47f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f1458f99700 1 -- 172.21.15.43:0/667148078 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00e070 con 0x7f145406d1c0 2023-08-27T11:29:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f1458f99700 1 -- 172.21.15.43:0/667148078 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c00b9c0 con 0x7f145406d1c0 2023-08-27T11:29:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.212+0000 7f1458f99700 1 -- 172.21.15.43:0/667148078 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c00bd70 con 0x7f145406d1c0 2023-08-27T11:29:12.216 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 -- 172.21.15.43:0/667148078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406d1c0 msgr2=0x7f1454156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 --2- 172.21.15.43:0/667148078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406d1c0 0x7f1454156020 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f144c009e50 tx=0x7f144c00b330 comp rx=0 tx=0).stop 2023-08-27T11:29:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 -- 172.21.15.43:0/667148078 shutdown_connections 2023-08-27T11:29:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 --2- 172.21.15.43:0/667148078 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406d1c0 0x7f1454156020 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.217 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 -- 172.21.15.43:0/667148078 >> 172.21.15.43:0/667148078 conn(0x7f145406aa50 msgr2=0x7f14540c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 -- 172.21.15.43:0/667148078 shutdown_connections 2023-08-27T11:29:12.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.213+0000 7f145c1ff700 1 -- 172.21.15.43:0/667148078 wait complete. 2023-08-27T11:29:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.215+0000 7f145c1ff700 1 Processor -- start 2023-08-27T11:29:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.215+0000 7f145c1ff700 1 -- start start 2023-08-27T11:29:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 0x7f1454071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 0x7f14540a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540a9920 con 0x7f145406ca60 2023-08-27T11:29:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540bd740 con 0x7f14540c51a0 2023-08-27T11:29:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145c1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14541ea3c0 con 0x7f145406d1c0 2023-08-27T11:29:12.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40952/0 (socket says 172.21.15.43:40952) 2023-08-27T11:29:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 -- 172.21.15.43:0/1970910058 learned_addr learned my addr 172.21.15.43:0/1970910058 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145979a700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 0x7f1454071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145a79c700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 0x7f14540a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 -- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 msgr2=0x7f1454071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 0x7f1454071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 -- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 msgr2=0x7f14540a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 0x7f14540a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f1459f9b700 1 -- 172.21.15.43:0/1970910058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009b30 con 0x7f145406ca60 2023-08-27T11:29:12.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145979a700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 0x7f1454071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.217+0000 7f145a79c700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 0x7f14540a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f1459f9b700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f145000c450 tx=0x7f145000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500052d0 con 0x7f145406ca60 2023-08-27T11:29:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1450005430 con 0x7f145406ca60 2023-08-27T11:29:12.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500038c0 con 0x7f145406ca60 2023-08-27T11:29:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14540bf470 con 0x7f145406ca60 2023-08-27T11:29:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.218+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14540aa7c0 con 0x7f145406ca60 2023-08-27T11:29:12.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.219+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145404ee70 con 0x7f145406ca60 2023-08-27T11:29:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.220+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1450003a20 con 0x7f145406ca60 2023-08-27T11:29:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.221+0000 7f144a7fc700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 0x7f143806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.221+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7f1450087d30 con 0x7f145406ca60 2023-08-27T11:29:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.221+0000 7f145979a700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 0x7f143806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.222+0000 7f145979a700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 0x7f143806c5a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1454151070 tx=0x7f1444009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.225+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1450052f50 con 0x7f145406ca60 2023-08-27T11:29:12.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.436+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14540a5000 con 0x7f145406ca60 2023-08-27T11:29:12.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.437+0000 7f144a7fc700 1 -- 172.21.15.43:0/1970910058 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+21976 (secure 0 0 0) 0x7f1450056570 con 0x7f145406ca60 2023-08-27T11:29:12.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:12.439 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":129,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:00.535670+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:28:33.832606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-27T11:28:34.482137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:12.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 msgr2=0x7f143806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 0x7f143806c5a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1454151070 tx=0x7f1444009040 comp rx=0 tx=0).stop 2023-08-27T11:29:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 msgr2=0x7f14540bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f145000c450 tx=0x7f145000c810 comp rx=0 tx=0).stop 2023-08-27T11:29:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 shutdown_connections 2023-08-27T11:29:12.442 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f143806a0e0 0x7f143806c5a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14540c51a0 0x7f14540a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f145406ca60 0x7f14540bef30 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 --2- 172.21.15.43:0/1970910058 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145406d1c0 0x7f1454071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 >> 172.21.15.43:0/1970910058 conn(0x7f145406aa50 msgr2=0x7f14540baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:12.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 shutdown_connections 2023-08-27T11:29:12.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.440+0000 7f145c1ff700 1 -- 172.21.15.43:0/1970910058 wait complete. 2023-08-27T11:29:12.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:29:12.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.662+0000 7fd59c9ff700 1 Processor -- start 2023-08-27T11:29:12.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.662+0000 7fd59c9ff700 1 -- start start 2023-08-27T11:29:12.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd59c9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5980c4630 0x7fd5980c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd59c9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59806c4e0 con 0x7fd59806ad70 2023-08-27T11:29:12.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd59c9ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd598155370 con 0x7fd598151a90 2023-08-27T11:29:12.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd59c9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5980c82c0 con 0x7fd5980c4630 2023-08-27T11:29:12.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd595d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5980c4630 0x7fd5980c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd595d9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd5980c4630 0x7fd5980c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40960/0 (socket says 172.21.15.43:40960) 2023-08-27T11:29:12.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd595d9b700 1 -- 172.21.15.43:0/4073171005 learned_addr learned my addr 172.21.15.43:0/4073171005 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:12.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.663+0000 7fd596d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd59806ad70 0x7fd59806b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43116/0 (socket says 172.21.15.43:43116) 2023-08-27T11:29:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd595d9b700 1 -- 172.21.15.43:0/4073171005 >> v1:172.21.15.57:6789/0 conn(0x7fd598151a90 legacy=0x7fd5980c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd595d9b700 1 -- 172.21.15.43:0/4073171005 >> v1:172.21.15.43:6789/0 conn(0x7fd59806ad70 legacy=0x7fd59806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd595d9b700 1 -- 172.21.15.43:0/4073171005 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598151e70 con 0x7fd5980c4630 2023-08-27T11:29:12.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd595d9b700 1 --2- 172.21.15.43:0/4073171005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5980c4a90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0098f0 tx=0x7fd58c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceea4176af39f47c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd59559a700 1 -- 172.21.15.43:0/4073171005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00b8a0 con 0x7fd5980c4630 2023-08-27T11:29:12.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd59559a700 1 -- 172.21.15.43:0/4073171005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00ba00 con 0x7fd5980c4630 2023-08-27T11:29:12.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.664+0000 7fd59559a700 1 -- 172.21.15.43:0/4073171005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00bd90 con 0x7fd5980c4630 2023-08-27T11:29:12.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 -- 172.21.15.43:0/4073171005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 msgr2=0x7fd5980c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/4073171005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5980c4a90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0098f0 tx=0x7fd58c009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 -- 172.21.15.43:0/4073171005 shutdown_connections 2023-08-27T11:29:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/4073171005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5980c4a90 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 -- 172.21.15.43:0/4073171005 >> 172.21.15.43:0/4073171005 conn(0x7fd5980ab820 msgr2=0x7fd5980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 -- 172.21.15.43:0/4073171005 shutdown_connections 2023-08-27T11:29:12.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.665+0000 7fd59c9ff700 1 -- 172.21.15.43:0/4073171005 wait complete. 2023-08-27T11:29:12.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.666+0000 7fd59c9ff700 1 Processor -- start 2023-08-27T11:29:12.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.667+0000 7fd59c9ff700 1 -- start start 2023-08-27T11:29:12.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59806ad70 0x7fd5981ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 0x7fd598146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981edc00 con 0x7fd5980c4630 2023-08-27T11:29:12.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598146ac0 con 0x7fd598151a90 2023-08-27T11:29:12.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598146790 con 0x7fd59806ad70 2023-08-27T11:29:12.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd595d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd595d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40974/0 (socket says 172.21.15.43:40974) 2023-08-27T11:29:12.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd59659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59806ad70 0x7fd5981ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd595d9b700 1 -- 172.21.15.43:0/690794666 learned_addr learned my addr 172.21.15.43:0/690794666 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:12.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.668+0000 7fd596d9d700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 0x7fd598146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 -- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59806ad70 msgr2=0x7fd5981ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59806ad70 0x7fd5981ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 -- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 msgr2=0x7fd598146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 0x7fd598146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 -- 172.21.15.43:0/690794666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c009550 con 0x7fd5980c4630 2023-08-27T11:29:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd596d9d700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 0x7fd598146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd595d9b700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009c40 tx=0x7fd58c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c004400 con 0x7fd5980c4630 2023-08-27T11:29:12.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c01f070 con 0x7fd5980c4630 2023-08-27T11:29:12.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0038c0 con 0x7fd5980c4630 2023-08-27T11:29:12.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59814be60 con 0x7fd5980c4630 2023-08-27T11:29:12.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.669+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd598150cf0 con 0x7fd5980c4630 2023-08-27T11:29:12.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.670+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59814bb50 con 0x7fd5980c4630 2023-08-27T11:29:12.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.671+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd58c021030 con 0x7fd5980c4630 2023-08-27T11:29:12.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.672+0000 7fd586ffd700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 0x7fd57806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:12.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.672+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 7004+0+0 (secure 0 0 0) 0x7fd58c089cf0 con 0x7fd5980c4630 2023-08-27T11:29:12.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.672+0000 7fd59659c700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 0x7fd57806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:12.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.673+0000 7fd59659c700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 0x7fd57806c5a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd588007fd0 tx=0x7fd588009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:12.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.677+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd58c055020 con 0x7fd5980c4630 2023-08-27T11:29:12.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.932+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd59804ee70 con 0x7fd5980c4630 2023-08-27T11:29:12.933 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:29:12.932+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:29:12.938 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.937+0000 7fd586ffd700 1 -- 172.21.15.43:0/690794666 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v141) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd58c058640 con 0x7fd5980c4630 2023-08-27T11:29:12.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.939+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 msgr2=0x7fd57806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.939+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 0x7fd57806c5a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd588007fd0 tx=0x7fd588009040 comp rx=0 tx=0).stop 2023-08-27T11:29:12.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.939+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 msgr2=0x7fd5981507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.939+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009c40 tx=0x7fd58c004750 comp rx=0 tx=0).stop 2023-08-27T11:29:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 shutdown_connections 2023-08-27T11:29:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd57806a0e0 0x7fd57806c5a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd598151a90 0x7fd598146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd59806ad70 0x7fd5981ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 --2- 172.21.15.43:0/690794666 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd5980c4630 0x7fd5981507b0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 >> 172.21.15.43:0/690794666 conn(0x7fd5980ab820 msgr2=0x7fd59814e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 shutdown_connections 2023-08-27T11:29:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:12.940+0000 7fd59c9ff700 1 -- 172.21.15.43:0/690794666 wait complete. 2023-08-27T11:29:12.943 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:29:12.947 INFO:tasks.ceph.mds.b.smithi057.stderr: -164> 2023-08-27T11:29:05.974+0000 7f9a759f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:29:12.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:29:12.993 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:29:13.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.162+0000 7f175dbff700 1 Processor -- start 2023-08-27T11:29:13.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.162+0000 7f175dbff700 1 -- start start 2023-08-27T11:29:13.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.163+0000 7f175dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f175806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.163+0000 7f175dbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1758155910 0x7f1758155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.163+0000 7f175dbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175806d700 con 0x7f175806ca60 2023-08-27T11:29:13.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.163+0000 7f175dbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17581530b0 con 0x7f1758155910 2023-08-27T11:29:13.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.163+0000 7f175dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175814c860 con 0x7f17580c51a0 2023-08-27T11:29:13.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f17577fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f175806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1757fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1758155910 0x7f1758155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1756ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f175806ca60 0x7f17580aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:34460/0 (socket says 172.21.15.43:34460) 2023-08-27T11:29:13.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1756ffd700 1 -- 172.21.15.43:0/3559118816 learned_addr learned my addr 172.21.15.43:0/3559118816 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:13.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1757fff700 1 -- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 msgr2=0x7f175806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:13.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1757fff700 1 --2- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f175806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1757fff700 1 -- 172.21.15.43:0/3559118816 >> v1:172.21.15.57:6789/0 conn(0x7f175806ca60 legacy=0x7f17580aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.164+0000 7f1757fff700 1 -- 172.21.15.43:0/3559118816 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758152430 con 0x7f1758155910 2023-08-27T11:29:13.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f1757fff700 1 --2- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f1758155da0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1750009dc0 tx=0x7f175000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=766de185f62c8475 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:13.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f17567fc700 1 -- 172.21.15.43:0/3559118816 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000e070 con 0x7f1758155910 2023-08-27T11:29:13.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f17567fc700 1 -- 172.21.15.43:0/3559118816 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175000bae0 con 0x7f1758155910 2023-08-27T11:29:13.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f17567fc700 1 -- 172.21.15.43:0/3559118816 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000be90 con 0x7f1758155910 2023-08-27T11:29:13.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 -- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 msgr2=0x7f1758155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 --2- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f1758155da0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1750009dc0 tx=0x7f175000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:13.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 -- 172.21.15.43:0/3559118816 shutdown_connections 2023-08-27T11:29:13.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 --2- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f1758155da0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 --2- 172.21.15.43:0/3559118816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f175806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.165+0000 7f175dbff700 1 -- 172.21.15.43:0/3559118816 >> 172.21.15.43:0/3559118816 conn(0x7f175806aa50 msgr2=0x7f17580c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:13.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.166+0000 7f175dbff700 1 -- 172.21.15.43:0/3559118816 shutdown_connections 2023-08-27T11:29:13.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.166+0000 7f175dbff700 1 -- 172.21.15.43:0/3559118816 wait complete. 2023-08-27T11:29:13.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.167+0000 7f175dbff700 1 Processor -- start 2023-08-27T11:29:13.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.167+0000 7f175dbff700 1 -- start start 2023-08-27T11:29:13.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f17581ed7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f17581514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580a99b0 con 0x7f175806ca60 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580a59f0 con 0x7f1758155910 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.168+0000 7f175dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580aa1c0 con 0x7f17580c51a0 2023-08-27T11:29:13.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40988/0 (socket says 172.21.15.43:40988) 2023-08-27T11:29:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 -- 172.21.15.43:0/335987028 learned_addr learned my addr 172.21.15.43:0/335987028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f1756ffd700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f17581ed7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f1757fff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f17581514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 -- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 msgr2=0x7f17581ed7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f17581ed7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 -- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 msgr2=0x7f17581514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f17581514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 -- 172.21.15.43:0/335987028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750009a70 con 0x7f175806ca60 2023-08-27T11:29:13.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f1757fff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f17581514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.169+0000 7f17577fe700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f174800e9e0 tx=0x7f174800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.170+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1748009710 con 0x7f175806ca60 2023-08-27T11:29:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.170+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174800c850 con 0x7f175806ca60 2023-08-27T11:29:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.170+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17580a9c00 con 0x7f175806ca60 2023-08-27T11:29:13.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.170+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174800cbc0 con 0x7f175806ca60 2023-08-27T11:29:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.170+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17580a8cd0 con 0x7f175806ca60 2023-08-27T11:29:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.171+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17580a5cd0 con 0x7f175806ca60 2023-08-27T11:29:13.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.172+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f174800cd20 con 0x7f175806ca60 2023-08-27T11:29:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.173+0000 7f173ffff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 0x7f174406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.173+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f1748088a70 con 0x7f175806ca60 2023-08-27T11:29:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.173+0000 7f1756ffd700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 0x7f174406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.173+0000 7f1756ffd700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 0x7f174406c5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f174c005910 tx=0x7f174c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.177+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1748053cc0 con 0x7f175806ca60 2023-08-27T11:29:13.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.432+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f175804ee70 con 0x7f175806ca60 2023-08-27T11:29:13.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.949+0000 7f173ffff700 1 -- 172.21.15.43:0/335987028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v142) v1 ==== 104+0+0 (secure 0 0 0) 0x7f17480572e0 con 0x7f175806ca60 2023-08-27T11:29:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 msgr2=0x7f174406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 0x7f174406c5a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f174c005910 tx=0x7f174c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:13.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 msgr2=0x7f17580a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:13.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f174800e9e0 tx=0x7f174800ecf0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 shutdown_connections 2023-08-27T11:29:13.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f174406a0e0 0x7f174406c5a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1758155910 0x7f17581514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f175806ca60 0x7f17580a4680 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 --2- 172.21.15.43:0/335987028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f17580c51a0 0x7f17581ed7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:13.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.952+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 >> 172.21.15.43:0/335987028 conn(0x7f175806aa50 msgr2=0x7f1758155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:13.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.953+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 shutdown_connections 2023-08-27T11:29:13.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:13.953+0000 7f175dbff700 1 -- 172.21.15.43:0/335987028 wait complete. 2023-08-27T11:29:13.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:29:14.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.184+0000 7f35721ff700 1 Processor -- start 2023-08-27T11:29:14.186 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.184+0000 7f35721ff700 1 -- start start 2023-08-27T11:29:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.185+0000 7f35721ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f356c151900 0x7f356c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.185+0000 7f35721ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c06e080 con 0x7f356c06a580 2023-08-27T11:29:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.185+0000 7f35721ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c06e360 con 0x7f356c0c4f10 2023-08-27T11:29:14.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.185+0000 7f35721ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356c152280 con 0x7f356c151900 2023-08-27T11:29:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f356c151900 0x7f356c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f356c151900 0x7f356c151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40992/0 (socket says 172.21.15.43:40992) 2023-08-27T11:29:14.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 -- 172.21.15.43:0/2571312003 learned_addr learned my addr 172.21.15.43:0/2571312003 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 -- 172.21.15.43:0/2571312003 >> v1:172.21.15.57:6789/0 conn(0x7f356c0c4f10 legacy=0x7f356c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 -- 172.21.15.43:0/2571312003 >> v1:172.21.15.43:6789/0 conn(0x7f356c06a580 legacy=0x7f356c154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356a7fc700 1 -- 172.21.15.43:0/2571312003 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813839337 0 0) 0x7f356c06e080 con 0x7f356c06a580 2023-08-27T11:29:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.186+0000 7f356affd700 1 -- 172.21.15.43:0/2571312003 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c06e640 con 0x7f356c151900 2023-08-27T11:29:14.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f356affd700 1 --2- 172.21.15.43:0/2571312003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c151900 0x7f356c151d40 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f35600098f0 tx=0x7f3560009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af93c4f35e828be server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:14.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f356a7fc700 1 -- 172.21.15.43:0/2571312003 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000b8a0 con 0x7f356c151900 2023-08-27T11:29:14.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f356a7fc700 1 -- 172.21.15.43:0/2571312003 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356000ba00 con 0x7f356c151900 2023-08-27T11:29:14.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f356a7fc700 1 -- 172.21.15.43:0/2571312003 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356000bd90 con 0x7f356c151900 2023-08-27T11:29:14.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 -- 172.21.15.43:0/2571312003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c151900 msgr2=0x7f356c151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 --2- 172.21.15.43:0/2571312003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c151900 0x7f356c151d40 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f35600098f0 tx=0x7f3560009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:14.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 -- 172.21.15.43:0/2571312003 shutdown_connections 2023-08-27T11:29:14.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 --2- 172.21.15.43:0/2571312003 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c151900 0x7f356c151d40 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 -- 172.21.15.43:0/2571312003 >> 172.21.15.43:0/2571312003 conn(0x7f356c0c6a90 msgr2=0x7f356c0c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:14.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.187+0000 7f35721ff700 1 -- 172.21.15.43:0/2571312003 shutdown_connections 2023-08-27T11:29:14.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.188+0000 7f35721ff700 1 -- 172.21.15.43:0/2571312003 wait complete. 2023-08-27T11:29:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.189+0000 7f35721ff700 1 Processor -- start 2023-08-27T11:29:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.189+0000 7f35721ff700 1 -- start start 2023-08-27T11:29:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:14.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0c4f10 0x7f356c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f356c151900 0x7f356c1ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c158930 con 0x7f356c06a580 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c14dc80 con 0x7f356c0c4f10 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f35721ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c156760 con 0x7f356c151900 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f356b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:14.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f356b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:40996/0 (socket says 172.21.15.43:40996) 2023-08-27T11:29:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.190+0000 7f356b7fe700 1 -- 172.21.15.43:0/3105108169 learned_addr learned my addr 172.21.15.43:0/3105108169 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356affd700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0c4f10 0x7f356c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356bfff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f356c151900 0x7f356c1ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 -- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f356c151900 msgr2=0x7f356c1ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f356c151900 0x7f356c1ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 -- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0c4f10 msgr2=0x7f356c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0c4f10 0x7f356c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 -- 172.21.15.43:0/3105108169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560009550 con 0x7f356c06a580 2023-08-27T11:29:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f356b7fe700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c520 tx=0x7f355c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:14.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0054e0 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c003680 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c0aabd0 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0039f0 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.191+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c1edb00 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.193+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c156a40 con 0x7f356c06a580 2023-08-27T11:29:14.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.193+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f355c003b50 con 0x7f356c06a580 2023-08-27T11:29:14.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.194+0000 7f3553fff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 0x7f355806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.194+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 7090+0+0 (secure 0 0 0) 0x7f355c087cd0 con 0x7f356c06a580 2023-08-27T11:29:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.194+0000 7f356affd700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 0x7f355806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.195+0000 7f356affd700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 0x7f355806c5a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3560014040 tx=0x7f3560008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:14.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.199+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f355c0530f0 con 0x7f356c06a580 2023-08-27T11:29:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.409+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f356c04ee70 con 0x7f356c06a580 2023-08-27T11:29:14.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.956+0000 7f3553fff700 1 -- 172.21.15.43:0/3105108169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7f355c056710 con 0x7f356c06a580 2023-08-27T11:29:14.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 msgr2=0x7f355806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 0x7f355806c5a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3560014040 tx=0x7f3560008030 comp rx=0 tx=0).stop 2023-08-27T11:29:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 msgr2=0x7f356c0aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f355c00c520 tx=0x7f355c00c8e0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 shutdown_connections 2023-08-27T11:29:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f355806a0e0 0x7f355806c5a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f356c151900 0x7f356c1ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f356c06a580 0x7f356c0aa690 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 --2- 172.21.15.43:0/3105108169 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f356c0c4f10 0x7f356c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:14.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.960+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 >> 172.21.15.43:0/3105108169 conn(0x7f356c0c6a90 msgr2=0x7f356c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.961+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 shutdown_connections 2023-08-27T11:29:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:14.961+0000 7f35721ff700 1 -- 172.21.15.43:0/3105108169 wait complete. 2023-08-27T11:29:14.964 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2023-08-27T11:29:14.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-27T11:29:15.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.196+0000 7f87f93ff700 1 Processor -- start 2023-08-27T11:29:15.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.196+0000 7f87f93ff700 1 -- start start 2023-08-27T11:29:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f93ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f40c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f93ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87f406b780 0x7f87f406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f93ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f4154730 con 0x7f87f4151a40 2023-08-27T11:29:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f93ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f4154520 con 0x7f87f406b780 2023-08-27T11:29:15.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f93ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4154a10 con 0x7f87f40c4700 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87f406b780 0x7f87f406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f37fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f87f406b780 0x7f87f406bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41010/0 (socket says 172.21.15.43:41010) 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f37fe700 1 -- 172.21.15.43:0/1274218591 learned_addr learned my addr 172.21.15.43:0/1274218591 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.197+0000 7f87f27fc700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f40c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f37fe700 1 -- 172.21.15.43:0/1274218591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 msgr2=0x7f87f40c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:15.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f37fe700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f40c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f37fe700 1 -- 172.21.15.43:0/1274218591 >> v1:172.21.15.57:6789/0 conn(0x7f87f4151a40 legacy=0x7f87f40c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f37fe700 1 -- 172.21.15.43:0/1274218591 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4154cf0 con 0x7f87f406b780 2023-08-27T11:29:15.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f37fe700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f406b780 0x7f87f406bbf0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009e50 tx=0x7f87ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d3b8727e9ffb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f1ffb700 1 -- 172.21.15.43:0/1274218591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00e070 con 0x7f87f406b780 2023-08-27T11:29:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f1ffb700 1 -- 172.21.15.43:0/1274218591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00b9c0 con 0x7f87f406b780 2023-08-27T11:29:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.198+0000 7f87f1ffb700 1 -- 172.21.15.43:0/1274218591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00bd70 con 0x7f87f406b780 2023-08-27T11:29:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 -- 172.21.15.43:0/1274218591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f406b780 msgr2=0x7f87f406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f406b780 0x7f87f406bbf0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009e50 tx=0x7f87ec00b330 comp rx=0 tx=0).stop 2023-08-27T11:29:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 -- 172.21.15.43:0/1274218591 shutdown_connections 2023-08-27T11:29:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f406b780 0x7f87f406bbf0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 --2- 172.21.15.43:0/1274218591 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f40c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 -- 172.21.15.43:0/1274218591 >> 172.21.15.43:0/1274218591 conn(0x7f87f40ab890 msgr2=0x7f87f40abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:15.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 -- 172.21.15.43:0/1274218591 shutdown_connections 2023-08-27T11:29:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.199+0000 7f87f93ff700 1 -- 172.21.15.43:0/1274218591 wait complete. 2023-08-27T11:29:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.200+0000 7f87f93ff700 1 Processor -- start 2023-08-27T11:29:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.201+0000 7f87f93ff700 1 -- start start 2023-08-27T11:29:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.201+0000 7f87f93ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 0x7f87f40c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.201+0000 7f87f93ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f4142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.201+0000 7f87f93ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f93ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40c0e50 con 0x7f87f4151a40 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f93ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40c3b10 con 0x7f87f406b780 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f93ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40c10a0 con 0x7f87f40c4700 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41016/0 (socket says 172.21.15.43:41016) 2023-08-27T11:29:15.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 -- 172.21.15.43:0/2421406855 learned_addr learned my addr 172.21.15.43:0/2421406855 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f27fc700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f2ffd700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 0x7f87f40c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 -- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 msgr2=0x7f87f4142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f4142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 -- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 msgr2=0x7f87f40c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 0x7f87f40c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f37fe700 1 -- 172.21.15.43:0/2421406855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009b30 con 0x7f87f4151a40 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.202+0000 7f87f2ffd700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 0x7f87f40c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87f37fe700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f87f4067780 tx=0x7f87ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec004960 con 0x7f87f4151a40 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec0099b0 con 0x7f87f4151a40 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec01c680 con 0x7f87f4151a40 2023-08-27T11:29:15.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40c1380 con 0x7f87f4151a40 2023-08-27T11:29:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.203+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f40c30b0 con 0x7f87f4151a40 2023-08-27T11:29:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.204+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f404ee70 con 0x7f87f4151a40 2023-08-27T11:29:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.205+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f87ec01c7e0 con 0x7f87f4151a40 2023-08-27T11:29:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.206+0000 7f87db7fe700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 0x7f87e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:15.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.206+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6652+0+0 (secure 0 0 0) 0x7f87ec08a520 con 0x7f87f4151a40 2023-08-27T11:29:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.206+0000 7f87f2ffd700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 0x7f87e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.207+0000 7f87f2ffd700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 0x7f87e006c5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f87e4000f60 tx=0x7f87e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:15.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.210+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f87ec0559b0 con 0x7f87f4151a40 2023-08-27T11:29:15.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.419+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87f406c800 con 0x7f87f4151a40 2023-08-27T11:29:15.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.958+0000 7f87db7fe700 1 -- 172.21.15.43:0/2421406855 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) v1 ==== 169+0+0 (secure 0 0 0) 0x7f87ec058fd0 con 0x7f87f4151a40 2023-08-27T11:29:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 msgr2=0x7f87e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 0x7f87e006c5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f87e4000f60 tx=0x7f87e4009040 comp rx=0 tx=0).stop 2023-08-27T11:29:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 msgr2=0x7f87f41502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:15.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f87f4067780 tx=0x7f87ec004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 shutdown_connections 2023-08-27T11:29:15.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f87e006a0e0 0x7f87e006c5a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f87f4151a40 0x7f87f41502b0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f406b780 0x7f87f40c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 --2- 172.21.15.43:0/2421406855 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f40c4700 0x7f87f4142450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 >> 172.21.15.43:0/2421406855 conn(0x7f87f40ab890 msgr2=0x7f87f40c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 shutdown_connections 2023-08-27T11:29:15.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:15.961+0000 7f87f93ff700 1 -- 172.21.15.43:0/2421406855 wait complete. 2023-08-27T11:29:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2023-08-27T11:29:15.990 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:16.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.197+0000 7f8edcdff700 1 Processor -- start 2023-08-27T11:29:16.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.197+0000 7f8edcdff700 1 -- start start 2023-08-27T11:29:16.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8edcdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 0x7f8ed806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8edcdff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed806c4e0 con 0x7f8ed80c4630 2023-08-27T11:29:16.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8edcdff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed8155370 con 0x7f8ed8151a90 2023-08-27T11:29:16.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8edcdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80c82c0 con 0x7f8ed80c4a90 2023-08-27T11:29:16.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8ecffff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8ed80c4630 0x7f8ed806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43128/0 (socket says 172.21.15.43:43128) 2023-08-27T11:29:16.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8ecffff700 1 -- 172.21.15.43:0/3149078546 learned_addr learned my addr 172.21.15.43:0/3149078546 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:16.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.198+0000 7f8ed6d9d700 1 --2- 172.21.15.43:0/3149078546 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 0x7f8ed806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937166211 0 0) 0x7f8ed806c4e0 con 0x7f8ed80c4630 2023-08-27T11:29:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec40035b0 con 0x7f8ed80c4630 2023-08-27T11:29:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376697335 0 0) 0x7f8ed8155370 con 0x7f8ed8151a90 2023-08-27T11:29:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed806c4e0 con 0x7f8ed8151a90 2023-08-27T11:29:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed6d9d700 1 -- 172.21.15.43:0/3149078546 >> v1:172.21.15.57:6789/0 conn(0x7f8ed8151a90 legacy=0x7f8ed80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed6d9d700 1 -- 172.21.15.43:0/3149078546 >> v1:172.21.15.43:6789/0 conn(0x7f8ed80c4630 legacy=0x7f8ed806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed6d9d700 1 -- 172.21.15.43:0/3149078546 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8151e70 con 0x7f8ed80c4a90 2023-08-27T11:29:16.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.199+0000 7f8ed6d9d700 1 --2- 172.21.15.43:0/3149078546 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 0x7f8ed806b480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009dc0 tx=0x7f8ed000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06c4210851ce023 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000e070 con 0x7f8ed80c4a90 2023-08-27T11:29:16.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000bb20 con 0x7f8ed80c4a90 2023-08-27T11:29:16.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8ed5d9b700 1 -- 172.21.15.43:0/3149078546 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0012430 con 0x7f8ed80c4a90 2023-08-27T11:29:16.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 -- 172.21.15.43:0/3149078546 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 msgr2=0x7f8ed806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 --2- 172.21.15.43:0/3149078546 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 0x7f8ed806b480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009dc0 tx=0x7f8ed000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:16.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 -- 172.21.15.43:0/3149078546 shutdown_connections 2023-08-27T11:29:16.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 --2- 172.21.15.43:0/3149078546 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4a90 0x7f8ed806b480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 -- 172.21.15.43:0/3149078546 >> 172.21.15.43:0/3149078546 conn(0x7f8ed80ab820 msgr2=0x7f8ed80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:16.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 -- 172.21.15.43:0/3149078546 shutdown_connections 2023-08-27T11:29:16.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.200+0000 7f8edcdff700 1 -- 172.21.15.43:0/3149078546 wait complete. 2023-08-27T11:29:16.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.202+0000 7f8edcdff700 1 Processor -- start 2023-08-27T11:29:16.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.202+0000 7f8edcdff700 1 -- start start 2023-08-27T11:29:16.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4630 0x7f8ed814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ed8151a90 0x7f8ed81edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed814f990 con 0x7f8ed80c4a90 2023-08-27T11:29:16.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed80ab3f0 con 0x7f8ed8151a90 2023-08-27T11:29:16.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8edcdff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8153cf0 con 0x7f8ed80c4630 2023-08-27T11:29:16.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8ecffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41018/0 (socket says 172.21.15.43:41018) 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8ecffff700 1 -- 172.21.15.43:0/2268039557 learned_addr learned my addr 172.21.15.43:0/2268039557 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8ed659c700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4630 0x7f8ed814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.203+0000 7f8ed6d9d700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ed8151a90 0x7f8ed81edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 -- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4630 msgr2=0x7f8ed814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4630 0x7f8ed814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 -- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ed8151a90 msgr2=0x7f8ed81edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ed8151a90 0x7f8ed81edb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 -- 172.21.15.43:0/2268039557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0009a70 con 0x7f8ed80c4a90 2023-08-27T11:29:16.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8ecffff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c4d0 tx=0x7f8ec000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000cea0 con 0x7f8ed80c4a90 2023-08-27T11:29:16.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0005d70 con 0x7f8ed80c4a90 2023-08-27T11:29:16.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed80aae30 con 0x7f8ed80c4a90 2023-08-27T11:29:16.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00072d0 con 0x7f8ed80c4a90 2023-08-27T11:29:16.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.204+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed81ed0a0 con 0x7f8ed80c4a90 2023-08-27T11:29:16.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.205+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed804ee70 con 0x7f8ed80c4a90 2023-08-27T11:29:16.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.206+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ec0007430 con 0x7f8ed80c4a90 2023-08-27T11:29:16.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.207+0000 7f8eceffd700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 0x7f8eb806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.207+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f8ec0087800 con 0x7f8ed80c4a90 2023-08-27T11:29:16.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.208+0000 7f8ed659c700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 0x7f8eb806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.208+0000 7f8ed659c700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 0x7f8eb806c5d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80011e0 tx=0x7f8ec8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.212+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8ec0052f80 con 0x7f8ed80c4a90 2023-08-27T11:29:16.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.430+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ed806c130 con 0x7f8ed80c4a90 2023-08-27T11:29:16.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.431+0000 7f8eceffd700 1 -- 172.21.15.43:0/2268039557 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f8ec00565a0 con 0x7f8ed80c4a90 2023-08-27T11:29:16.433 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:16.434 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":132,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:15.954349+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6834/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6832/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:16.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 msgr2=0x7f8eb806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 0x7f8eb806c5d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80011e0 tx=0x7f8ec8009040 comp rx=0 tx=0).stop 2023-08-27T11:29:16.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 msgr2=0x7f8ed81ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c4d0 tx=0x7f8ec000c7e0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 shutdown_connections 2023-08-27T11:29:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8eb806a110 0x7f8eb806c5d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ed8151a90 0x7f8ed81edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ed80c4630 0x7f8ed814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 --2- 172.21.15.43:0/2268039557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ed80c4a90 0x7f8ed81ed5c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 >> 172.21.15.43:0/2268039557 conn(0x7f8ed80ab820 msgr2=0x7f8ed81503c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:16.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 shutdown_connections 2023-08-27T11:29:16.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.435+0000 7f8edcdff700 1 -- 172.21.15.43:0/2268039557 wait complete. 2023-08-27T11:29:16.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-08-27T11:28:51.013075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs2_data', 'create_time': '2023-08-27T11:28:51.585124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:29:16.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:29:16.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.661+0000 7f9e6adff700 1 Processor -- start 2023-08-27T11:29:16.662 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.661+0000 7f9e6adff700 1 -- start start 2023-08-27T11:29:16.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6adff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9e640ac410 0x7f9e640c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e6415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6adff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e640c80c0 con 0x7f9e640c49f0 2023-08-27T11:29:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6adff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e641555a0 con 0x7f9e640ac410 2023-08-27T11:29:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641552c0 con 0x7f9e640c94c0 2023-08-27T11:29:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e68b9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9e640c49f0 0x7f9e64151790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43138/0 (socket says 172.21.15.43:43138) 2023-08-27T11:29:16.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e68b9b700 1 -- 172.21.15.43:0/2761187350 learned_addr learned my addr 172.21.15.43:0/2761187350 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:16.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e63fff700 1 --2- 172.21.15.43:0/2761187350 >> v2:172.21.15.57:3300/0 conn(0x7f9e640ac410 0x7f9e640c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e6415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88805924 0 0) 0x7f9e640c80c0 con 0x7f9e640c49f0 2023-08-27T11:29:16.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.663+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e540035b0 con 0x7f9e640c49f0 2023-08-27T11:29:16.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238709430 0 0) 0x7f9e540035b0 con 0x7f9e640c49f0 2023-08-27T11:29:16.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 msgr2=0x7f9e6415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:16.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e6415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 >> v2:172.21.15.57:3300/0 conn(0x7f9e640ac410 msgr2=0x7f9e640c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:16.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 --2- 172.21.15.43:0/2761187350 >> v2:172.21.15.57:3300/0 conn(0x7f9e640ac410 0x7f9e640c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640c8360 con 0x7f9e640c49f0 2023-08-27T11:29:16.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f9e58001670 con 0x7f9e640c49f0 2023-08-27T11:29:16.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e63fff700 1 --2- 172.21.15.43:0/2761187350 >> v2:172.21.15.57:3300/0 conn(0x7f9e640ac410 0x7f9e640c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:16.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 >> v1:172.21.15.43:6789/0 conn(0x7f9e640c49f0 legacy=0x7f9e64151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e54003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004040 0x7f9e54004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e54004d90 0x7f9e54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641555a0 con 0x7f9e54004d90 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641552c0 con 0x7f9e54004040 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5400bbd0 con 0x7f9e640c94c0 2023-08-27T11:29:16.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e54004d90 0x7f9e54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e68b9b700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e54003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.664+0000 7f9e63fff700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004040 0x7f9e54004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 -- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 msgr2=0x7f9e54003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:16.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e640c94c0 0x7f9e54003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 -- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004040 msgr2=0x7f9e54004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004040 0x7f9e54004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 -- 172.21.15.43:0/2761187350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540035b0 con 0x7f9e54004d90 2023-08-27T11:29:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e54004d90 0x7f9e54005210 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009fc0 tx=0x7f9e54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d080f644434fa3aa server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c00ec30 con 0x7f9e54004d90 2023-08-27T11:29:16.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c00f040 con 0x7f9e54004d90 2023-08-27T11:29:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.665+0000 7f9e637fe700 1 -- 172.21.15.43:0/2761187350 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c014480 con 0x7f9e54004d90 2023-08-27T11:29:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 -- 172.21.15.43:0/2761187350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e54004d90 msgr2=0x7f9e54005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2761187350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e54004d90 0x7f9e54005210 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009fc0 tx=0x7f9e54005880 comp rx=0 tx=0).stop 2023-08-27T11:29:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6939c700 1 -- 172.21.15.43:0/2761187350 reap_dead start 2023-08-27T11:29:16.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 -- 172.21.15.43:0/2761187350 shutdown_connections 2023-08-27T11:29:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 -- 172.21.15.43:0/2761187350 >> 172.21.15.43:0/2761187350 conn(0x7f9e640ab8f0 msgr2=0x7f9e640abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 -- 172.21.15.43:0/2761187350 shutdown_connections 2023-08-27T11:29:16.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.666+0000 7f9e6adff700 1 -- 172.21.15.43:0/2761187350 wait complete. 2023-08-27T11:29:16.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.668+0000 7f9e6adff700 1 Processor -- start 2023-08-27T11:29:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.669+0000 7f9e6adff700 1 -- start start 2023-08-27T11:29:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004d90 0x7f9e640aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e641ec930 0x7f9e640ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641ea150 con 0x7f9e64157f90 2023-08-27T11:29:16.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e64155a40 con 0x7f9e54004d90 2023-08-27T11:29:16.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e641e94d0 con 0x7f9e641ec930 2023-08-27T11:29:16.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41040/0 (socket says 172.21.15.43:41040) 2023-08-27T11:29:16.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e68b9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004d90 0x7f9e640aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e6939c700 1 -- 172.21.15.43:0/2084742796 learned_addr learned my addr 172.21.15.43:0/2084742796 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.670+0000 7f9e63fff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e641ec930 0x7f9e640ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 -- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e641ec930 msgr2=0x7f9e640ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e641ec930 0x7f9e640ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 -- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004d90 msgr2=0x7f9e640aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004d90 0x7f9e640aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 -- 172.21.15.43:0/2084742796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e641e97b0 con 0x7f9e64157f90 2023-08-27T11:29:16.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6939c700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bb20 tx=0x7f9e5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c007000 con 0x7f9e64157f90 2023-08-27T11:29:16.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c014890 con 0x7f9e64157f90 2023-08-27T11:29:16.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e641e9a90 con 0x7f9e64157f90 2023-08-27T11:29:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c014c40 con 0x7f9e64157f90 2023-08-27T11:29:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.671+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e64158980 con 0x7f9e64157f90 2023-08-27T11:29:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.672+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640afe10 con 0x7f9e64157f90 2023-08-27T11:29:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.673+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e5c024070 con 0x7f9e64157f90 2023-08-27T11:29:16.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.674+0000 7f9e617fa700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 0x7f9e4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:16.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.675+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f9e5c089c90 con 0x7f9e64157f90 2023-08-27T11:29:16.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.675+0000 7f9e68b9b700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 0x7f9e4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:16.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.675+0000 7f9e68b9b700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 0x7f9e4806c5a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007fd0 tx=0x7f9e58001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:16.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.679+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9e5c0552c0 con 0x7f9e64157f90 2023-08-27T11:29:16.887 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.886+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e64158b10 con 0x7f9e64157f90 2023-08-27T11:29:16.888 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.887+0000 7f9e617fa700 1 -- 172.21.15.43:0/2084742796 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e5c0180a0 con 0x7f9e64157f90 2023-08-27T11:29:16.888 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:29:16.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 msgr2=0x7f9e4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 0x7f9e4806c5a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9e58007fd0 tx=0x7f9e58001e00 comp rx=0 tx=0).stop 2023-08-27T11:29:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 msgr2=0x7f9e64158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400bb20 tx=0x7f9e5c009750 comp rx=0 tx=0).stop 2023-08-27T11:29:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 shutdown_connections 2023-08-27T11:29:16.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f9e4806a0e0 0x7f9e4806c5a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9e64157f90 0x7f9e64158440 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e54004d90 0x7f9e640aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 --2- 172.21.15.43:0/2084742796 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e641ec930 0x7f9e640ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 >> 172.21.15.43:0/2084742796 conn(0x7f9e640ab8f0 msgr2=0x7f9e6414f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:16.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 shutdown_connections 2023-08-27T11:29:16.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:16.889+0000 7f9e6adff700 1 -- 172.21.15.43:0/2084742796 wait complete. 2023-08-27T11:29:16.908 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:29:17.116 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.115+0000 7f60e6bff700 1 Processor -- start 2023-08-27T11:29:17.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.115+0000 7f60e6bff700 1 -- start start 2023-08-27T11:29:17.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.116+0000 7f60e6bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f60e00c49f0 0x7f60e0151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60e00c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e6bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00c80c0 con 0x7f60e00ac410 2023-08-27T11:29:17.118 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e6bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e00c9bd0 con 0x7f60e00c49f0 2023-08-27T11:29:17.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01555a0 con 0x7f60e0151cd0 2023-08-27T11:29:17.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e519c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f60e00ac410 0x7f60e00c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43140/0 (socket says 172.21.15.43:43140) 2023-08-27T11:29:17.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e519c700 1 -- 172.21.15.43:0/2133436869 learned_addr learned my addr 172.21.15.43:0/2133436869 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:17.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60e499b700 1 --2- 172.21.15.43:0/2133436869 >> v2:172.21.15.57:3300/0 conn(0x7f60e00c49f0 0x7f60e0151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60dffff700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60e00c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331436477 0 0) 0x7f60e00c80c0 con 0x7f60e00ac410 2023-08-27T11:29:17.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.117+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d00035b0 con 0x7f60e00ac410 2023-08-27T11:29:17.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320948891 0 0) 0x7f60d00035b0 con 0x7f60e00ac410 2023-08-27T11:29:17.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 msgr2=0x7f60e00c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60e00c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 >> v2:172.21.15.57:3300/0 conn(0x7f60e00c49f0 msgr2=0x7f60e0151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 --2- 172.21.15.43:0/2133436869 >> v2:172.21.15.57:3300/0 conn(0x7f60e00c49f0 0x7f60e0151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e01552c0 con 0x7f60e00ac410 2023-08-27T11:29:17.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f60d80019f0 con 0x7f60e00ac410 2023-08-27T11:29:17.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 >> v1:172.21.15.43:6789/0 conn(0x7f60e00ac410 legacy=0x7f60e00c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60d0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d0004020 0x7f60d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00c9bd0 con 0x7f60d0004d90 2023-08-27T11:29:17.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01555a0 con 0x7f60d0004020 2023-08-27T11:29:17.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d000bba0 con 0x7f60e0151cd0 2023-08-27T11:29:17.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60e499b700 1 --2- 172.21.15.43:0/2133436869 >> v2:172.21.15.57:3300/0 conn(0x7f60e00c49f0 0x7f60e0151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:17.126 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60e519c700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60dffff700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d0004020 0x7f60d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.118+0000 7f60e499b700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60d0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 -- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 msgr2=0x7f60d0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60d0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.127 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 -- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d0004020 msgr2=0x7f60d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60d0004020 0x7f60d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 -- 172.21.15.43:0/2133436869 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d00035b0 con 0x7f60d0004d90 2023-08-27T11:29:17.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e499b700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0151cd0 0x7f60d0003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:17.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60e519c700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60d0005210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a830 tx=0x7f60d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e6de593a8477d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.128 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800a2f0 con 0x7f60d0004d90 2023-08-27T11:29:17.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8012620 con 0x7f60d0004d90 2023-08-27T11:29:17.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.119+0000 7f60df7fe700 1 -- 172.21.15.43:0/2133436869 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d80129d0 con 0x7f60d0004d90 2023-08-27T11:29:17.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 -- 172.21.15.43:0/2133436869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 msgr2=0x7f60d0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 --2- 172.21.15.43:0/2133436869 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60d0005210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f60d800a830 tx=0x7f60d0005880 comp rx=0 tx=0).stop 2023-08-27T11:29:17.129 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e519c700 1 -- 172.21.15.43:0/2133436869 reap_dead start 2023-08-27T11:29:17.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 -- 172.21.15.43:0/2133436869 shutdown_connections 2023-08-27T11:29:17.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 -- 172.21.15.43:0/2133436869 >> 172.21.15.43:0/2133436869 conn(0x7f60e00ab8f0 msgr2=0x7f60e00abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:17.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 -- 172.21.15.43:0/2133436869 shutdown_connections 2023-08-27T11:29:17.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.120+0000 7f60e6bff700 1 -- 172.21.15.43:0/2133436869 wait complete. 2023-08-27T11:29:17.130 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.121+0000 7f60e6bff700 1 Processor -- start 2023-08-27T11:29:17.131 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.122+0000 7f60e6bff700 1 -- start start 2023-08-27T11:29:17.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.133 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e00af310 0x7f60e01ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0157010 0x7f60e01531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01540d0 con 0x7f60d0004d90 2023-08-27T11:29:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e01568c0 con 0x7f60e00af310 2023-08-27T11:29:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e6bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0155930 con 0x7f60e0157010 2023-08-27T11:29:17.134 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41054/0 (socket says 172.21.15.43:41054) 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 -- 172.21.15.43:0/584753904 learned_addr learned my addr 172.21.15.43:0/584753904 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60dffff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e00af310 0x7f60e01ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e519c700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0157010 0x7f60e01531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 -- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0157010 msgr2=0x7f60e01531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.135 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0157010 0x7f60e01531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 -- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e00af310 msgr2=0x7f60e01ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e00af310 0x7f60e01ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.123+0000 7f60e499b700 1 -- 172.21.15.43:0/584753904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e01edb60 con 0x7f60d0004d90 2023-08-27T11:29:17.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60e499b700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f60d4011970 tx=0x7f60d4011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.136 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d400fae0 con 0x7f60d0004d90 2023-08-27T11:29:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d400fc40 con 0x7f60d0004d90 2023-08-27T11:29:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4011eb0 con 0x7f60d0004d90 2023-08-27T11:29:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e00af8a0 con 0x7f60d0004d90 2023-08-27T11:29:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.124+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e0155b80 con 0x7f60d0004d90 2023-08-27T11:29:17.137 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.125+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e004ee70 con 0x7f60d0004d90 2023-08-27T11:29:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.126+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f60d4015460 con 0x7f60d0004d90 2023-08-27T11:29:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.127+0000 7f60dd7fa700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 0x7f60c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.127+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f60d4088ea0 con 0x7f60d0004d90 2023-08-27T11:29:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.127+0000 7f60dffff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 0x7f60c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.128+0000 7f60dffff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 0x7f60c406c5a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f60e01e74c0 tx=0x7f60cc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.131+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f60d4058000 con 0x7f60d0004d90 2023-08-27T11:29:17.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.340+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60e0154c20 con 0x7f60d0004d90 2023-08-27T11:29:17.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.340+0000 7f60dd7fa700 1 -- 172.21.15.43:0/584753904 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60d40220a0 con 0x7f60d0004d90 2023-08-27T11:29:17.342 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:29:17.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 msgr2=0x7f60c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 0x7f60c406c5a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f60e01e74c0 tx=0x7f60cc009210 comp rx=0 tx=0).stop 2023-08-27T11:29:17.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 msgr2=0x7f60e0156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f60d4011970 tx=0x7f60d4011d30 comp rx=0 tx=0).stop 2023-08-27T11:29:17.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 shutdown_connections 2023-08-27T11:29:17.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f60c406a0e0 0x7f60c406c5a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f60e0157010 0x7f60e01531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f60d0004d90 0x7f60e0156380 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 --2- 172.21.15.43:0/584753904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f60e00af310 0x7f60e01ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 >> 172.21.15.43:0/584753904 conn(0x7f60e00ab8f0 msgr2=0x7f60e00c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:17.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 shutdown_connections 2023-08-27T11:29:17.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.343+0000 7f60e6bff700 1 -- 172.21.15.43:0/584753904 wait complete. 2023-08-27T11:29:17.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-08-27T11:29:17.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.566+0000 7f96f5dff700 1 Processor -- start 2023-08-27T11:29:17.567 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.566+0000 7f96f5dff700 1 -- start start 2023-08-27T11:29:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96f5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96f00c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96f5dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f0154660 con 0x7f96f0151d20 2023-08-27T11:29:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96f5dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f0154940 con 0x7f96f006a8e0 2023-08-27T11:29:17.569 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96f5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c5750 con 0x7f96f00c7c00 2023-08-27T11:29:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96ef7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f96f0151d20 0x7f96f00ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43144/0 (socket says 172.21.15.43:43144) 2023-08-27T11:29:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.567+0000 7f96ef7fe700 1 -- 172.21.15.43:0/2294136406 learned_addr learned my addr 172.21.15.43:0/2294136406 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96eeffd700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96f00c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119498330 0 0) 0x7f96f0154660 con 0x7f96f0151d20 2023-08-27T11:29:17.570 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d80035b0 con 0x7f96f0151d20 2023-08-27T11:29:17.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517730961 0 0) 0x7f96f0154940 con 0x7f96f006a8e0 2023-08-27T11:29:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f0154660 con 0x7f96f006a8e0 2023-08-27T11:29:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467051154 0 0) 0x7f96d80035b0 con 0x7f96f0151d20 2023-08-27T11:29:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 msgr2=0x7f96f00c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96f00c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 >> v1:172.21.15.57:6789/0 conn(0x7f96f006a8e0 legacy=0x7f96f006ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f0154c20 con 0x7f96f0151d20 2023-08-27T11:29:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f96e0001670 con 0x7f96f0151d20 2023-08-27T11:29:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 >> v1:172.21.15.43:6789/0 conn(0x7f96f0151d20 legacy=0x7f96f00ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d8003c30 0x7f96d8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96d8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8005500 con 0x7f96d8004850 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8005670 con 0x7f96d8003c30 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d800bf50 con 0x7f96f00c7c00 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.568+0000 7f96eeffd700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96d8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.576 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96ef7fe700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d8003c30 0x7f96d8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96effff700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 -- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 msgr2=0x7f96d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c7c00 0x7f96d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.577 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 -- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d8003c30 msgr2=0x7f96d8004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:17.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96d8003c30 0x7f96d8004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 -- 172.21.15.43:0/2294136406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80035b0 con 0x7f96d8004850 2023-08-27T11:29:17.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96eeffd700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96d8004cd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009b60 tx=0x7f96d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8391033d3ccc9b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e6c0 con 0x7f96d8004850 2023-08-27T11:29:17.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400e820 con 0x7f96d8004850 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.569+0000 7f96ee7fc700 1 -- 172.21.15.43:0/2294136406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400eb90 con 0x7f96d8004850 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 -- 172.21.15.43:0/2294136406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 msgr2=0x7f96d8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 --2- 172.21.15.43:0/2294136406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96d8004cd0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009b60 tx=0x7f96d8005880 comp rx=0 tx=0).stop 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96effff700 1 -- 172.21.15.43:0/2294136406 reap_dead start 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 -- 172.21.15.43:0/2294136406 shutdown_connections 2023-08-27T11:29:17.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 -- 172.21.15.43:0/2294136406 >> 172.21.15.43:0/2294136406 conn(0x7f96f00c9d00 msgr2=0x7f96f00ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:17.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 -- 172.21.15.43:0/2294136406 shutdown_connections 2023-08-27T11:29:17.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.570+0000 7f96f5dff700 1 -- 172.21.15.43:0/2294136406 wait complete. 2023-08-27T11:29:17.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.572+0000 7f96f5dff700 1 Processor -- start 2023-08-27T11:29:17.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.572+0000 7f96f5dff700 1 -- start start 2023-08-27T11:29:17.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 0x7f96f014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 0x7f96f014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f00c3ad0 con 0x7f96d8004850 2023-08-27T11:29:17.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0157ee0 con 0x7f96f00c2360 2023-08-27T11:29:17.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96f5dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f0158410 con 0x7f96f00c0880 2023-08-27T11:29:17.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41082/0 (socket says 172.21.15.43:41082) 2023-08-27T11:29:17.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 -- 172.21.15.43:0/226185652 learned_addr learned my addr 172.21.15.43:0/226185652 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:17.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96eeffd700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 0x7f96f014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96effff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 0x7f96f014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 -- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 msgr2=0x7f96f014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 0x7f96f014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 -- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 msgr2=0x7f96f014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.573+0000 7f96ef7fe700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 0x7f96f014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96ef7fe700 1 -- 172.21.15.43:0/226185652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f01ea350 con 0x7f96d8004850 2023-08-27T11:29:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96eeffd700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 0x7f96f014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96effff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 0x7f96f014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:17.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96ef7fe700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007fb0 tx=0x7f96e00073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0011580 con 0x7f96d8004850 2023-08-27T11:29:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00116e0 con 0x7f96d8004850 2023-08-27T11:29:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f01586b0 con 0x7f96d8004850 2023-08-27T11:29:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0011a90 con 0x7f96d8004850 2023-08-27T11:29:17.587 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.574+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f014fcf0 con 0x7f96d8004850 2023-08-27T11:29:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.575+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f01588f0 con 0x7f96d8004850 2023-08-27T11:29:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.576+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96e0011bf0 con 0x7f96d8004850 2023-08-27T11:29:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.577+0000 7f96d7fff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 0x7f96dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.577+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f96e00884d0 con 0x7f96d8004850 2023-08-27T11:29:17.588 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.577+0000 7f96eeffd700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 0x7f96dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:17.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.578+0000 7f96eeffd700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 0x7f96dc06c5a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96f0153440 tx=0x7f96e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:17.589 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.581+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96f01588f0 con 0x7f96d8004850 2023-08-27T11:29:17.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.789+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96f01588f0 con 0x7f96d8004850 2023-08-27T11:29:17.791 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.790+0000 7f96d7fff700 1 -- 172.21.15.43:0/226185652 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v132) v1 ==== 105+0+11 (secure 0 0 0) 0x7f96f01588f0 con 0x7f96d8004850 2023-08-27T11:29:17.791 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:29:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 msgr2=0x7f96dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 0x7f96dc06c5a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f96f0153440 tx=0x7f96e4008030 comp rx=0 tx=0).stop 2023-08-27T11:29:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 msgr2=0x7f96f01eccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:17.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007fb0 tx=0x7f96e00073f0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 shutdown_connections 2023-08-27T11:29:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f96dc06a0e0 0x7f96dc06c5a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96f00c2360 0x7f96f014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f96d8004850 0x7f96f01eccc0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 --2- 172.21.15.43:0/226185652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96f00c0880 0x7f96f014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 >> 172.21.15.43:0/226185652 conn(0x7f96f00c9d00 msgr2=0x7f96f00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 shutdown_connections 2023-08-27T11:29:17.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:17.792+0000 7f96f5dff700 1 -- 172.21.15.43:0/226185652 wait complete. 2023-08-27T11:29:17.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-08-27T11:29:18.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.017+0000 7fb780fff700 1 Processor -- start 2023-08-27T11:29:18.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.017+0000 7fb780fff700 1 -- start start 2023-08-27T11:29:18.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.018+0000 7fb780fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb77c151d20 0x7fb77c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.018+0000 7fb780fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c0c7c00 0x7fb77c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.018+0000 7fb780fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c154660 con 0x7fb77c0abcc0 2023-08-27T11:29:18.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.018+0000 7fb780fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c0c5750 con 0x7fb77c151d20 2023-08-27T11:29:18.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.018+0000 7fb780fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c154940 con 0x7fb77c0c7c00 2023-08-27T11:29:18.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb77c151d20 0x7fb77c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb77c151d20 0x7fb77c0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41084/0 (socket says 172.21.15.43:41084) 2023-08-27T11:29:18.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 -- 172.21.15.43:0/2461103316 learned_addr learned my addr 172.21.15.43:0/2461103316 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb773fff700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c0c7c00 0x7fb77c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 -- 172.21.15.43:0/2461103316 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c0c7c00 msgr2=0x7fb77c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:18.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c0c7c00 0x7fb77c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 -- 172.21.15.43:0/2461103316 >> v1:172.21.15.43:6789/0 conn(0x7fb77c0abcc0 legacy=0x7fb77c06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 -- 172.21.15.43:0/2461103316 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c154c20 con 0x7fb77c151d20 2023-08-27T11:29:18.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.019+0000 7fb77a59c700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c151d20 0x7fb77c0c8110 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0098f0 tx=0x7fb76c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f9948059235d00 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb779d9b700 1 -- 172.21.15.43:0/2461103316 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00b8a0 con 0x7fb77c151d20 2023-08-27T11:29:18.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb779d9b700 1 -- 172.21.15.43:0/2461103316 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00ba00 con 0x7fb77c151d20 2023-08-27T11:29:18.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb779d9b700 1 -- 172.21.15.43:0/2461103316 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00bd90 con 0x7fb77c151d20 2023-08-27T11:29:18.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 -- 172.21.15.43:0/2461103316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c151d20 msgr2=0x7fb77c0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c151d20 0x7fb77c0c8110 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0098f0 tx=0x7fb76c009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:18.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 -- 172.21.15.43:0/2461103316 shutdown_connections 2023-08-27T11:29:18.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c151d20 0x7fb77c0c8110 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 --2- 172.21.15.43:0/2461103316 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c0c7c00 0x7fb77c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 -- 172.21.15.43:0/2461103316 >> 172.21.15.43:0/2461103316 conn(0x7fb77c0c9d00 msgr2=0x7fb77c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:18.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 -- 172.21.15.43:0/2461103316 shutdown_connections 2023-08-27T11:29:18.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.020+0000 7fb780fff700 1 -- 172.21.15.43:0/2461103316 wait complete. 2023-08-27T11:29:18.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.022+0000 7fb780fff700 1 Processor -- start 2023-08-27T11:29:18.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.022+0000 7fb780fff700 1 -- start start 2023-08-27T11:29:18.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 0x7fb77c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 0x7fb77c0c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0aa3a0 con 0x7fb77c0c7c00 2023-08-27T11:29:18.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0a9790 con 0x7fb77c0abcc0 2023-08-27T11:29:18.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb780fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0a9a70 con 0x7fb77c151d20 2023-08-27T11:29:18.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb773fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb773fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41086/0 (socket says 172.21.15.43:41086) 2023-08-27T11:29:18.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.023+0000 7fb773fff700 1 -- 172.21.15.43:0/3714687442 learned_addr learned my addr 172.21.15.43:0/3714687442 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb77a59c700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 0x7fb77c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb77ad9d700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 0x7fb77c0c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 -- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 msgr2=0x7fb77c0c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 0x7fb77c0c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 -- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 msgr2=0x7fb77c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 0x7fb77c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 -- 172.21.15.43:0/3714687442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c009550 con 0x7fb77c0c7c00 2023-08-27T11:29:18.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb77a59c700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 0x7fb77c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:18.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb77ad9d700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 0x7fb77c0c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:18.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb773fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e810 tx=0x7fb76400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764013610 con 0x7fb77c0c7c00 2023-08-27T11:29:18.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764013770 con 0x7fb77c0c7c00 2023-08-27T11:29:18.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c0a9d50 con 0x7fb77c0c7c00 2023-08-27T11:29:18.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764013b20 con 0x7fb77c0c7c00 2023-08-27T11:29:18.034 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.024+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c153b90 con 0x7fb77c0c7c00 2023-08-27T11:29:18.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.026+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c0aa550 con 0x7fb77c0c7c00 2023-08-27T11:29:18.035 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.026+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb764013c80 con 0x7fb77c0c7c00 2023-08-27T11:29:18.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.027+0000 7fb772ffd700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.027+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7fb7640882c0 con 0x7fb77c0c7c00 2023-08-27T11:29:18.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.027+0000 7fb77a59c700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.028+0000 7fb77a59c700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb76c014040 tx=0x7fb76c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.036 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.032+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb77c0aa550 con 0x7fb77c0c7c00 2023-08-27T11:29:18.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.242+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb77c0aa550 con 0x7fb77c0c7c00 2023-08-27T11:29:18.244 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.242+0000 7fb772ffd700 1 -- 172.21.15.43:0/3714687442 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v132) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb77c0aa550 con 0x7fb77c0c7c00 2023-08-27T11:29:18.244 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:29:18.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 msgr2=0x7fb75c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb76c014040 tx=0x7fb76c008030 comp rx=0 tx=0).stop 2023-08-27T11:29:18.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 msgr2=0x7fb77c158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e810 tx=0x7fb76400ebd0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 shutdown_connections 2023-08-27T11:29:18.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb77c151d20 0x7fb77c0c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb77c0abcc0 0x7fb77c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 --2- 172.21.15.43:0/3714687442 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb77c0c7c00 0x7fb77c158250 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 >> 172.21.15.43:0/3714687442 conn(0x7fb77c0c9d00 msgr2=0x7fb77c14eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:18.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 shutdown_connections 2023-08-27T11:29:18.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.245+0000 7fb780fff700 1 -- 172.21.15.43:0/3714687442 wait complete. 2023-08-27T11:29:18.264 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.466+0000 7f326c5ff700 1 Processor -- start 2023-08-27T11:29:18.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.466+0000 7f326c5ff700 1 -- start start 2023-08-27T11:29:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326c5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3264151a90 0x7f32640c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326c5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326406c4e0 con 0x7f32640c4a90 2023-08-27T11:29:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326c5ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3264155370 con 0x7f32640c4630 2023-08-27T11:29:18.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326c5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3264151e70 con 0x7f3264151a90 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3264151a90 0x7f32640c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326a39b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3264151a90 0x7f32640c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41094/0 (socket says 172.21.15.43:41094) 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326a39b700 1 -- 172.21.15.43:0/1620949088 learned_addr learned my addr 172.21.15.43:0/1620949088 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.467+0000 7f326ab9c700 1 --1- 172.21.15.43:0/1620949088 >> v1:172.21.15.43:6789/0 conn(0x7f32640c4a90 0x7f326406b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:43164/0 (socket says 172.21.15.43:43164) 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f326a39b700 1 -- 172.21.15.43:0/1620949088 >> v1:172.21.15.57:6789/0 conn(0x7f32640c4630 legacy=0x7f326406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f326a39b700 1 -- 172.21.15.43:0/1620949088 >> v1:172.21.15.43:6789/0 conn(0x7f32640c4a90 legacy=0x7f326406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f326a39b700 1 -- 172.21.15.43:0/1620949088 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264154480 con 0x7f3264151a90 2023-08-27T11:29:18.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f326a39b700 1 --2- 172.21.15.43:0/1620949088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3264151a90 0x7f32640c7bb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f32600098f0 tx=0x7f3260009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94818db2b8f7f29e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f3269399700 1 -- 172.21.15.43:0/1620949088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326000b8a0 con 0x7f3264151a90 2023-08-27T11:29:18.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f3269399700 1 -- 172.21.15.43:0/1620949088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326000ba00 con 0x7f3264151a90 2023-08-27T11:29:18.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.468+0000 7f3269399700 1 -- 172.21.15.43:0/1620949088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326000bd90 con 0x7f3264151a90 2023-08-27T11:29:18.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 -- 172.21.15.43:0/1620949088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3264151a90 msgr2=0x7f32640c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 --2- 172.21.15.43:0/1620949088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3264151a90 0x7f32640c7bb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f32600098f0 tx=0x7f3260009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:18.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 -- 172.21.15.43:0/1620949088 shutdown_connections 2023-08-27T11:29:18.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 --2- 172.21.15.43:0/1620949088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3264151a90 0x7f32640c7bb0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 -- 172.21.15.43:0/1620949088 >> 172.21.15.43:0/1620949088 conn(0x7f32640ab820 msgr2=0x7f32640abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:18.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 -- 172.21.15.43:0/1620949088 shutdown_connections 2023-08-27T11:29:18.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.469+0000 7f326c5ff700 1 -- 172.21.15.43:0/1620949088 wait complete. 2023-08-27T11:29:18.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.471+0000 7f326c5ff700 1 Processor -- start 2023-08-27T11:29:18.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.471+0000 7f326c5ff700 1 -- start start 2023-08-27T11:29:18.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32640c4a90 0x7f32641e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3264151a90 0x7f32641e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264154180 con 0x7f32640c4630 2023-08-27T11:29:18.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32641ea4a0 con 0x7f3264151a90 2023-08-27T11:29:18.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326c5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264153e10 con 0x7f32640c4a90 2023-08-27T11:29:18.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41096/0 (socket says 172.21.15.43:41096) 2023-08-27T11:29:18.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 -- 172.21.15.43:0/3362756318 learned_addr learned my addr 172.21.15.43:0/3362756318 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f3269b9a700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32640c4a90 0x7f32641e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326ab9c700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3264151a90 0x7f32641e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 -- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32640c4a90 msgr2=0x7f32641e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32640c4a90 0x7f32641e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 -- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3264151a90 msgr2=0x7f32641e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3264151a90 0x7f32641e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.472+0000 7f326a39b700 1 -- 172.21.15.43:0/3362756318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260009550 con 0x7f32640c4630 2023-08-27T11:29:18.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f326a39b700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3260000c00 tx=0x7f3260004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260004480 con 0x7f32640c4630 2023-08-27T11:29:18.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326001f070 con 0x7f32640c4630 2023-08-27T11:29:18.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32600038e0 con 0x7f32640c4630 2023-08-27T11:29:18.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326414d630 con 0x7f32640c4630 2023-08-27T11:29:18.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.473+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640c9290 con 0x7f32640c4630 2023-08-27T11:29:18.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.474+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640c9480 con 0x7f32640c4630 2023-08-27T11:29:18.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.475+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3260021030 con 0x7f32640c4630 2023-08-27T11:29:18.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.476+0000 7f325affd700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 0x7f324806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.476+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f3260089a90 con 0x7f32640c4630 2023-08-27T11:29:18.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.476+0000 7f3269b9a700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 0x7f324806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.477+0000 7f3269b9a700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 0x7f324806c5a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3264149e60 tx=0x7f3254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.480+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f32640c9480 con 0x7f32640c4630 2023-08-27T11:29:18.738 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.737+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32640c9480 con 0x7f32640c4630 2023-08-27T11:29:18.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.737+0000 7f325affd700 1 -- 172.21.15.43:0/3362756318 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f32640c9480 con 0x7f32640c4630 2023-08-27T11:29:18.739 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:18.739 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":142,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138},{"gid":8014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2299425020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2299425020},{"type":"v1","addr":"172.21.15.57:6834","nonce":2299425020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:18.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 msgr2=0x7f324806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 0x7f324806c5a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3264149e60 tx=0x7f3254009040 comp rx=0 tx=0).stop 2023-08-27T11:29:18.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 msgr2=0x7f326414d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.742 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3260000c00 tx=0x7f3260004750 comp rx=0 tx=0).stop 2023-08-27T11:29:18.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 shutdown_connections 2023-08-27T11:29:18.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f324806a0e0 0x7f324806c5a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3264151a90 0x7f32641e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f32640c4630 0x7f326414d0f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 --2- 172.21.15.43:0/3362756318 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f32640c4a90 0x7f32641e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 >> 172.21.15.43:0/3362756318 conn(0x7f32640ab820 msgr2=0x7f32640bceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 shutdown_connections 2023-08-27T11:29:18.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.740+0000 7f326c5ff700 1 -- 172.21.15.43:0/3362756318 wait complete. 2023-08-27T11:29:18.745 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 142 2023-08-27T11:29:18.760 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:18.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.960+0000 7f57837ff700 1 Processor -- start 2023-08-27T11:29:18.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.960+0000 7f57837ff700 1 -- start start 2023-08-27T11:29:18.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.961+0000 7f57837ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f577c151910 0x7f577c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.961+0000 7f57837ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.961+0000 7f57837ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 0x7f577c0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f57837ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c158480 con 0x7f577c151910 2023-08-27T11:29:18.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f57837ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0c5ae0 con 0x7f577c0c15e0 2023-08-27T11:29:18.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f57837ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0c1190 con 0x7f577c0c51a0 2023-08-27T11:29:18.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f577c151910 0x7f577c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f577c151910 0x7f577c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42562/0 (socket says 172.21.15.43:42562) 2023-08-27T11:29:18.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 -- 172.21.15.43:0/3385521638 learned_addr learned my addr 172.21.15.43:0/3385521638 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f5780d9a700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f5781d9c700 1 --2- 172.21.15.43:0/3385521638 >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 0x7f577c0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 -- 172.21.15.43:0/3385521638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 msgr2=0x7f577c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:18.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 -- 172.21.15.43:0/3385521638 >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 msgr2=0x7f577c0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:18.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 --2- 172.21.15.43:0/3385521638 >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 0x7f577c0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f578159b700 1 -- 172.21.15.43:0/3385521638 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c072900 con 0x7f577c151910 2023-08-27T11:29:18.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.962+0000 7f5781d9c700 1 --2- 172.21.15.43:0/3385521638 >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 0x7f577c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:18.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f578159b700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c151910 0x7f577c157a00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f577c067650 tx=0x7f5778009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ea7550adceb7a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f5773fff700 1 -- 172.21.15.43:0/3385521638 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778011830 con 0x7f577c151910 2023-08-27T11:29:18.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f5773fff700 1 -- 172.21.15.43:0/3385521638 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5778011990 con 0x7f577c151910 2023-08-27T11:29:18.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f5773fff700 1 -- 172.21.15.43:0/3385521638 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778011d20 con 0x7f577c151910 2023-08-27T11:29:18.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 -- 172.21.15.43:0/3385521638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c151910 msgr2=0x7f577c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c151910 0x7f577c157a00 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f577c067650 tx=0x7f5778009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 -- 172.21.15.43:0/3385521638 shutdown_connections 2023-08-27T11:29:18.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 --2- 172.21.15.43:0/3385521638 >> v2:172.21.15.57:3300/0 conn(0x7f577c0c15e0 0x7f577c0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c151910 0x7f577c157a00 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 --2- 172.21.15.43:0/3385521638 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.963+0000 7f57837ff700 1 -- 172.21.15.43:0/3385521638 >> 172.21.15.43:0/3385521638 conn(0x7f577c0a9740 msgr2=0x7f577c0a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:18.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.964+0000 7f57837ff700 1 -- 172.21.15.43:0/3385521638 shutdown_connections 2023-08-27T11:29:18.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.964+0000 7f57837ff700 1 -- 172.21.15.43:0/3385521638 wait complete. 2023-08-27T11:29:18.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.965+0000 7f57837ff700 1 Processor -- start 2023-08-27T11:29:18.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.965+0000 7f57837ff700 1 -- start start 2023-08-27T11:29:18.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c1ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f577c151910 0x7f577c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c152280 con 0x7f577c0c15e0 2023-08-27T11:29:18.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c06d230 con 0x7f577c151910 2023-08-27T11:29:18.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f57837ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c1edb10 con 0x7f577c0c51a0 2023-08-27T11:29:18.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.966+0000 7f578159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42574/0 (socket says 172.21.15.43:42574) 2023-08-27T11:29:18.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 -- 172.21.15.43:0/3747717201 learned_addr learned my addr 172.21.15.43:0/3747717201 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:18.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 -- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 msgr2=0x7f577c1ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c1ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 -- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f577c151910 msgr2=0x7f577c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:18.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f577c151910 0x7f577c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:18.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 -- 172.21.15.43:0/3747717201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5778009550 con 0x7f577c0c15e0 2023-08-27T11:29:18.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f578159b700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5778000c00 tx=0x7f5778004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778004380 con 0x7f577c0c15e0 2023-08-27T11:29:18.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577801f070 con 0x7f577c0c15e0 2023-08-27T11:29:18.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c1eddf0 con 0x7f577c0c15e0 2023-08-27T11:29:18.989 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.967+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780036a0 con 0x7f577c0c15e0 2023-08-27T11:29:18.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.968+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c1ed810 con 0x7f577c0c15e0 2023-08-27T11:29:18.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.969+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c1edfc0 con 0x7f577c0c15e0 2023-08-27T11:29:18.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.969+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5778021030 con 0x7f577c0c15e0 2023-08-27T11:29:18.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.971+0000 7f5771ffb700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 0x7f576006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:18.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.971+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f5778089bc0 con 0x7f577c0c15e0 2023-08-27T11:29:18.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.971+0000 7f5780d9a700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 0x7f576006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:18.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.972+0000 7f5780d9a700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 0x7f576006c5a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f577c0a9290 tx=0x7f576c009500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:18.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:18.975+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5778055310 con 0x7f577c0c15e0 2023-08-27T11:29:19.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.189+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f577c04ee70 con 0x7f577c0c15e0 2023-08-27T11:29:19.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.190+0000 7f5771ffb700 1 -- 172.21.15.43:0/3747717201 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f5778015090 con 0x7f577c0c15e0 2023-08-27T11:29:19.192 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:19.192 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":132,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:15.954349+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6834/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6832/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:19.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 msgr2=0x7f576006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 0x7f576006c5a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f577c0a9290 tx=0x7f576c009500 comp rx=0 tx=0).stop 2023-08-27T11:29:19.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 msgr2=0x7f577c0a6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5778000c00 tx=0x7f5778004750 comp rx=0 tx=0).stop 2023-08-27T11:29:19.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 shutdown_connections 2023-08-27T11:29:19.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f576006a0e0 0x7f576006c5a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f577c151910 0x7f577c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f577c0c15e0 0x7f577c0a6e90 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 --2- 172.21.15.43:0/3747717201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f577c0c51a0 0x7f577c1ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 >> 172.21.15.43:0/3747717201 conn(0x7f577c0a9740 msgr2=0x7f577c0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:19.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 shutdown_connections 2023-08-27T11:29:19.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.193+0000 7f57837ff700 1 -- 172.21.15.43:0/3747717201 wait complete. 2023-08-27T11:29:19.213 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-08-27T11:29:19.213 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:19.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.412+0000 7f2e393ff700 1 Processor -- start 2023-08-27T11:29:19.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.413+0000 7f2e393ff700 1 -- start start 2023-08-27T11:29:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e393ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e393ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2e340c4630 0x7f2e340c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e393ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3406c4e0 con 0x7f2e3406ad70 2023-08-27T11:29:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e393ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e34155370 con 0x7f2e340c4630 2023-08-27T11:29:19.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e393ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34151e70 con 0x7f2e34151a90 2023-08-27T11:29:19.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:55306/0 (socket says 172.21.15.43:55306) 2023-08-27T11:29:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1145044690 learned_addr learned my addr 172.21.15.43:0/1145044690 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e337fe700 1 --1- 172.21.15.43:0/1145044690 >> v1:172.21.15.57:6789/0 conn(0x7f2e3406ad70 0x7f2e3406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53134/0 (socket says 172.21.15.43:53134) 2023-08-27T11:29:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.414+0000 7f2e2bfff700 1 --2- 172.21.15.43:0/1145044690 >> v2:172.21.15.57:3300/0 conn(0x7f2e340c4630 0x7f2e340c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1145044690 >> v2:172.21.15.57:3300/0 conn(0x7f2e340c4630 msgr2=0x7f2e340c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:19.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e32ffd700 1 --2- 172.21.15.43:0/1145044690 >> v2:172.21.15.57:3300/0 conn(0x7f2e340c4630 0x7f2e340c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1145044690 >> v1:172.21.15.57:6789/0 conn(0x7f2e3406ad70 legacy=0x7f2e3406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1145044690 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34154480 con 0x7f2e34151a90 2023-08-27T11:29:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e32ffd700 1 --2- 172.21.15.43:0/1145044690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eacf7d428d16ffb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e327fc700 1 -- 172.21.15.43:0/1145044690 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011830 con 0x7f2e34151a90 2023-08-27T11:29:19.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e327fc700 1 -- 172.21.15.43:0/1145044690 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011990 con 0x7f2e34151a90 2023-08-27T11:29:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.415+0000 7f2e327fc700 1 -- 172.21.15.43:0/1145044690 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011d20 con 0x7f2e34151a90 2023-08-27T11:29:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 -- 172.21.15.43:0/1145044690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 msgr2=0x7f2e340c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1145044690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e240098f0 tx=0x7f2e24009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:19.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 -- 172.21.15.43:0/1145044690 shutdown_connections 2023-08-27T11:29:19.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1145044690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e34151a90 0x7f2e340c7bb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1145044690 >> v2:172.21.15.57:3300/0 conn(0x7f2e340c4630 0x7f2e340c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 -- 172.21.15.43:0/1145044690 >> 172.21.15.43:0/1145044690 conn(0x7f2e340ab820 msgr2=0x7f2e340abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:19.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 -- 172.21.15.43:0/1145044690 shutdown_connections 2023-08-27T11:29:19.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.416+0000 7f2e393ff700 1 -- 172.21.15.43:0/1145044690 wait complete. 2023-08-27T11:29:19.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.418+0000 7f2e393ff700 1 Processor -- start 2023-08-27T11:29:19.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.418+0000 7f2e393ff700 1 -- start start 2023-08-27T11:29:19.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e340c4630 0x7f2e341495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e34151a90 0x7f2e341ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3414c380 con 0x7f2e3406ad70 2023-08-27T11:29:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3414f7d0 con 0x7f2e34151a90 2023-08-27T11:29:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e393ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e341500e0 con 0x7f2e340c4630 2023-08-27T11:29:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e2bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e340c4630 0x7f2e341495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42584/0 (socket says 172.21.15.43:42584) 2023-08-27T11:29:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1215655481 learned_addr learned my addr 172.21.15.43:0/1215655481 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.419+0000 7f2e337fe700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e34151a90 0x7f2e341ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e340c4630 msgr2=0x7f2e341495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e340c4630 0x7f2e341495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e34151a90 msgr2=0x7f2e341ed000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e34151a90 0x7f2e341ed000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 -- 172.21.15.43:0/1215655481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009550 con 0x7f2e3406ad70 2023-08-27T11:29:19.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e32ffd700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009c40 tx=0x7f2e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240045d0 con 0x7f2e3406ad70 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2401f070 con 0x7f2e3406ad70 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e240038c0 con 0x7f2e3406ad70 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e341ea640 con 0x7f2e3406ad70 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.420+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e34146ab0 con 0x7f2e3406ad70 2023-08-27T11:29:19.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.421+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3404ee70 con 0x7f2e3406ad70 2023-08-27T11:29:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.422+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e24003a20 con 0x7f2e3406ad70 2023-08-27T11:29:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.423+0000 7f2e2b7fe700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 0x7f2e1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.424+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f2e24021070 con 0x7f2e3406ad70 2023-08-27T11:29:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.424+0000 7f2e2bfff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 0x7f2e1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.431 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.424+0000 7f2e2bfff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 0x7f2e1406c5a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2e3414c9a0 tx=0x7f2e1c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.428+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e24055480 con 0x7f2e3406ad70 2023-08-27T11:29:19.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.679+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e340c3eb0 con 0x7f2e3406ad70 2023-08-27T11:29:19.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.679+0000 7f2e2b7fe700 1 -- 172.21.15.43:0/1215655481 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f2e2402b090 con 0x7f2e3406ad70 2023-08-27T11:29:19.681 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:19.681 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":142,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138},{"gid":8014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2299425020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2299425020},{"type":"v1","addr":"172.21.15.57:6834","nonce":2299425020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.681+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 msgr2=0x7f2e1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.681+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 0x7f2e1406c5a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2e3414c9a0 tx=0x7f2e1c009210 comp rx=0 tx=0).stop 2023-08-27T11:29:19.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.681+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 msgr2=0x7f2e34152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.681+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009c40 tx=0x7f2e24004750 comp rx=0 tx=0).stop 2023-08-27T11:29:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 shutdown_connections 2023-08-27T11:29:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f2e1406a0e0 0x7f2e1406c5a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2e34151a90 0x7f2e341ed000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f2e3406ad70 0x7f2e34152280 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 --2- 172.21.15.43:0/1215655481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2e340c4630 0x7f2e341495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 >> 172.21.15.43:0/1215655481 conn(0x7f2e340ab820 msgr2=0x7f2e3414a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 shutdown_connections 2023-08-27T11:29:19.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.682+0000 7f2e393ff700 1 -- 172.21.15.43:0/1215655481 wait complete. 2023-08-27T11:29:19.686 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 142 2023-08-27T11:29:19.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:19.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.901+0000 7f4983bff700 1 Processor -- start 2023-08-27T11:29:19.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.902+0000 7f4983bff700 1 -- start start 2023-08-27T11:29:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f4983bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c151a90 0x7f497c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f4983bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f497c0c4a90 0x7f497c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f4983bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c06c4e0 con 0x7f497c0c4630 2023-08-27T11:29:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f4983bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c155370 con 0x7f497c0c4a90 2023-08-27T11:29:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f4983bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c151e70 con 0x7f497c151a90 2023-08-27T11:29:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f498219c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f497c0c4a90 0x7f497c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f498119a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f497c0c4630 0x7f497c06ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53138/0 (socket says 172.21.15.43:53138) 2023-08-27T11:29:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f498219c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f497c0c4a90 0x7f497c06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42594/0 (socket says 172.21.15.43:42594) 2023-08-27T11:29:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f498119a700 1 -- 172.21.15.43:0/41631438 learned_addr learned my addr 172.21.15.43:0/41631438 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:19.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.903+0000 7f498199b700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c151a90 0x7f497c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f498219c700 1 -- 172.21.15.43:0/41631438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c151a90 msgr2=0x7f497c0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f498219c700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c151a90 0x7f497c0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f498219c700 1 -- 172.21.15.43:0/41631438 >> v1:172.21.15.57:6789/0 conn(0x7f497c0c4630 legacy=0x7f497c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f498219c700 1 -- 172.21.15.43:0/41631438 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c154480 con 0x7f497c0c4a90 2023-08-27T11:29:19.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f4980999700 1 -- 172.21.15.43:0/41631438 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771818508 0 0) 0x7f497c06c4e0 con 0x7f497c0c4630 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f498219c700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c0c4a90 0x7f497c06b480 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1580aab50e8c4f07 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f4980999700 1 -- 172.21.15.43:0/41631438 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400e070 con 0x7f497c0c4a90 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f4980999700 1 -- 172.21.15.43:0/41631438 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400bb20 con 0x7f497c0c4a90 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.904+0000 7f4980999700 1 -- 172.21.15.43:0/41631438 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012430 con 0x7f497c0c4a90 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 -- 172.21.15.43:0/41631438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c0c4a90 msgr2=0x7f497c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.909 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c0c4a90 0x7f497c06b480 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:19.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 -- 172.21.15.43:0/41631438 shutdown_connections 2023-08-27T11:29:19.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c0c4a90 0x7f497c06b480 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 --2- 172.21.15.43:0/41631438 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c151a90 0x7f497c0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 -- 172.21.15.43:0/41631438 >> 172.21.15.43:0/41631438 conn(0x7f497c0ab820 msgr2=0x7f497c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:19.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 -- 172.21.15.43:0/41631438 shutdown_connections 2023-08-27T11:29:19.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.905+0000 7f4983bff700 1 -- 172.21.15.43:0/41631438 wait complete. 2023-08-27T11:29:19.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.907+0000 7f4983bff700 1 Processor -- start 2023-08-27T11:29:19.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.907+0000 7f4983bff700 1 -- start start 2023-08-27T11:29:19.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c0c4630 0x7f497c0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c0c4a90 0x7f497c0aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0bda70 con 0x7f497c151a90 2023-08-27T11:29:19.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0bf2b0 con 0x7f497c0c4630 2023-08-27T11:29:19.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f4983bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c0bea10 con 0x7f497c0c4a90 2023-08-27T11:29:19.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498199b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c0c4630 0x7f497c0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42598/0 (socket says 172.21.15.43:42598) 2023-08-27T11:29:19.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 -- 172.21.15.43:0/3462220180 learned_addr learned my addr 172.21.15.43:0/3462220180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:19.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498119a700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c0c4a90 0x7f497c0aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 -- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c0c4a90 msgr2=0x7f497c0aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c0c4a90 0x7f497c0aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 -- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c0c4630 msgr2=0x7f497c0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:19.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c0c4630 0x7f497c0aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:19.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.908+0000 7f498219c700 1 -- 172.21.15.43:0/3462220180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009a70 con 0x7f497c151a90 2023-08-27T11:29:19.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f498219c700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f497400b680 tx=0x7f4974004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012430 con 0x7f497c151a90 2023-08-27T11:29:19.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4974020070 con 0x7f497c151a90 2023-08-27T11:29:19.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974004280 con 0x7f497c151a90 2023-08-27T11:29:19.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c156670 con 0x7f497c151a90 2023-08-27T11:29:19.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.909+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c156bf0 con 0x7f497c151a90 2023-08-27T11:29:19.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.910+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c0ca240 con 0x7f497c151a90 2023-08-27T11:29:19.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.911+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49740043e0 con 0x7f497c151a90 2023-08-27T11:29:19.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.912+0000 7f49727fc700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 0x7f496006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:19.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.912+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f4974022070 con 0x7f497c151a90 2023-08-27T11:29:19.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.912+0000 7f498199b700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 0x7f496006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:19.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.913+0000 7f498199b700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 0x7f496006c5a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4978009b40 tx=0x7f4978009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:19.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:19.916+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f49740557d0 con 0x7f497c151a90 2023-08-27T11:29:20.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.170+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f497c04ee70 con 0x7f497c151a90 2023-08-27T11:29:20.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.171+0000 7f49727fc700 1 -- 172.21.15.43:0/3462220180 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 142 v142) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f4974058df0 con 0x7f497c151a90 2023-08-27T11:29:20.208 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:20.208 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":142,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":139},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138},{"gid":8014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2299425020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2299425020},{"type":"v1","addr":"172.21.15.57:6834","nonce":2299425020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":142}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:28:52.606401+0000","modified":"2023-08-27T11:29:01.545245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8091},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8091":{"gid":8091,"name":"c","rank":0,"incarnation":131,"state":"up:active","state_seq":9,"addr":"172.21.15.43:6837/1923359880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":1923359880},{"type":"v1","addr":"172.21.15.43:6837","nonce":1923359880}]},"join_fscid":10,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-27T11:29:20.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 msgr2=0x7f496006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 0x7f496006c5a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4978009b40 tx=0x7f4978009210 comp rx=0 tx=0).stop 2023-08-27T11:29:20.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 msgr2=0x7f497c1ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f497400b680 tx=0x7f4974004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 shutdown_connections 2023-08-27T11:29:20.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f496006a0e0 0x7f496006c5a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f497c151a90 0x7f497c1ecef0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f497c0c4630 0x7f497c0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 --2- 172.21.15.43:0/3462220180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f497c0c4a90 0x7f497c0aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 >> 172.21.15.43:0/3462220180 conn(0x7f497c0ab820 msgr2=0x7f497c149fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:20.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 shutdown_connections 2023-08-27T11:29:20.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.173+0000 7f4983bff700 1 -- 172.21.15.43:0/3462220180 wait complete. 2023-08-27T11:29:20.212 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 142 2023-08-27T11:29:20.212 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:20.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.413+0000 7f4f27dff700 1 Processor -- start 2023-08-27T11:29:20.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.413+0000 7f4f27dff700 1 -- start start 2023-08-27T11:29:20.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f27dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f200c4630 0x7f4f200c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f27dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2006c4e0 con 0x7f4f2006ad70 2023-08-27T11:29:20.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f27dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f20155370 con 0x7f4f20151a90 2023-08-27T11:29:20.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f27dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f200c82c0 con 0x7f4f200c4630 2023-08-27T11:29:20.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f2639c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4f2006ad70 0x7f4f2006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42044/0 (socket says 172.21.15.43:42044) 2023-08-27T11:29:20.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.414+0000 7f4f2639c700 1 -- 172.21.15.43:0/548107962 learned_addr learned my addr 172.21.15.43:0/548107962 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:20.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> v2:172.21.15.57:3300/0 conn(0x7f4f200c4630 0x7f4f200c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194223588 0 0) 0x7f4f2006c4e0 con 0x7f4f2006ad70 2023-08-27T11:29:20.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f0c0035b0 con 0x7f4f2006ad70 2023-08-27T11:29:20.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356705438 0 0) 0x7f4f0c0035b0 con 0x7f4f2006ad70 2023-08-27T11:29:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 >> v2:172.21.15.57:3300/0 conn(0x7f4f200c4630 msgr2=0x7f4f200c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 --2- 172.21.15.43:0/548107962 >> v2:172.21.15.57:3300/0 conn(0x7f4f200c4630 0x7f4f200c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 >> v1:172.21.15.57:6789/0 conn(0x7f4f20151a90 legacy=0x7f4f200c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20151e70 con 0x7f4f2006ad70 2023-08-27T11:29:20.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f4f180019f0 con 0x7f4f2006ad70 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> v2:172.21.15.57:3300/0 conn(0x7f4f200c4630 0x7f4f200c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 >> v1:172.21.15.43:6789/0 conn(0x7f4f2006ad70 legacy=0x7f4f2006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c003a00 0x7f4f0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f0c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c005210 0x7f4f0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200c82c0 con 0x7f4f0c004850 2023-08-27T11:29:20.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00c1b0 con 0x7f4f0c003a00 2023-08-27T11:29:20.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.415+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c00c370 con 0x7f4f0c005210 2023-08-27T11:29:20.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f0c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f25b9b700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c003a00 0x7f4f0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2639c700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c005210 0x7f4f0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 -- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c005210 msgr2=0x7f4f0c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:20.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c005210 0x7f4f0c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 -- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c003a00 msgr2=0x7f4f0c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:20.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c003a00 0x7f4f0c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 -- 172.21.15.43:0/548107962 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0035b0 con 0x7f4f0c004850 2023-08-27T11:29:20.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2639c700 1 -- 172.21.15.43:0/548107962 reap_dead start 2023-08-27T11:29:20.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.416+0000 7f4f2539a700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f0c004cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009d30 tx=0x7f4f0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2e3c8882591238 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10009e80 con 0x7f4f0c004850 2023-08-27T11:29:20.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000e920 con 0x7f4f0c004850 2023-08-27T11:29:20.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f24b99700 1 -- 172.21.15.43:0/548107962 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000ec90 con 0x7f4f0c004850 2023-08-27T11:29:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 -- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 msgr2=0x7f4f0c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f0c004cd0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009d30 tx=0x7f4f0c005880 comp rx=0 tx=0).stop 2023-08-27T11:29:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 -- 172.21.15.43:0/548107962 shutdown_connections 2023-08-27T11:29:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 --2- 172.21.15.43:0/548107962 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f0c004cd0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 -- 172.21.15.43:0/548107962 >> 172.21.15.43:0/548107962 conn(0x7f4f200ab820 msgr2=0x7f4f200abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 -- 172.21.15.43:0/548107962 shutdown_connections 2023-08-27T11:29:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.417+0000 7f4f27dff700 1 -- 172.21.15.43:0/548107962 wait complete. 2023-08-27T11:29:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.420+0000 7f4f27dff700 1 Processor -- start 2023-08-27T11:29:20.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.420+0000 7f4f27dff700 1 -- start start 2023-08-27T11:29:20.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 0x7f4f201ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f2014dca0 0x7f4f20146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201e9ff0 con 0x7f4f0c004850 2023-08-27T11:29:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f201e9a20 con 0x7f4f200a9830 2023-08-27T11:29:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f27dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f200aa150 con 0x7f4f2014dca0 2023-08-27T11:29:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f25b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.421+0000 7f4f25b9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42626/0 (socket says 172.21.15.43:42626) 2023-08-27T11:29:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 -- 172.21.15.43:0/4108167326 learned_addr learned my addr 172.21.15.43:0/4108167326 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f2539a700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 0x7f4f201ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f2639c700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f2014dca0 0x7f4f20146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 -- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f2014dca0 msgr2=0x7f4f20146260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f2014dca0 0x7f4f20146260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 -- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 msgr2=0x7f4f201ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 0x7f4f201ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 -- 172.21.15.43:0/4108167326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f201527c0 con 0x7f4f0c004850 2023-08-27T11:29:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f2539a700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 0x7f4f201ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f25b9b700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00f770 tx=0x7f4f1c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0052e0 con 0x7f4f0c004850 2023-08-27T11:29:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c005440 con 0x7f4f0c004850 2023-08-27T11:29:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0038c0 con 0x7f4f0c004850 2023-08-27T11:29:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.422+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f201ea950 con 0x7f4f0c004850 2023-08-27T11:29:20.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.423+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f20153fe0 con 0x7f4f0c004850 2023-08-27T11:29:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.424+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2004ee70 con 0x7f4f0c004850 2023-08-27T11:29:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.425+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4f1c003a20 con 0x7f4f0c004850 2023-08-27T11:29:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.425+0000 7f4f167fc700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.425+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f4f1c088350 con 0x7f4f0c004850 2023-08-27T11:29:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.426+0000 7f4f2539a700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.426+0000 7f4f2539a700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f100090b0 tx=0x7f4f10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.430+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4f1c053980 con 0x7f4f0c004850 2023-08-27T11:29:20.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.637+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f2006c130 con 0x7f4f0c004850 2023-08-27T11:29:20.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.639+0000 7f4f167fc700 1 -- 172.21.15.43:0/4108167326 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+18446 (secure 0 0 0) 0x7f4f1c056fa0 con 0x7f4f0c004850 2023-08-27T11:29:20.641 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:20.641 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":132,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:15.954349+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs2_metadata","create_time":"2023-08-27T11:28:51.013075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs2_data","create_time":"2023-08-27T11:28:51.585124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6834/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6832/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:20.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 msgr2=0x7f4f0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4f100090b0 tx=0x7f4f10008030 comp rx=0 tx=0).stop 2023-08-27T11:29:20.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 msgr2=0x7f4f20152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.643 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00f770 tx=0x7f4f1c00fb30 comp rx=0 tx=0).stop 2023-08-27T11:29:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 shutdown_connections 2023-08-27T11:29:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f4f0406a0e0 0x7f4f0406c5a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f2014dca0 0x7f4f20146260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4f0c004850 0x7f4f20152280 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.644 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 --2- 172.21.15.43:0/4108167326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f200a9830 0x7f4f201ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.641+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 >> 172.21.15.43:0/4108167326 conn(0x7f4f200ab820 msgr2=0x7f4f2006b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:20.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.642+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 shutdown_connections 2023-08-27T11:29:20.645 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.642+0000 7f4f27dff700 1 -- 172.21.15.43:0/4108167326 wait complete. 2023-08-27T11:29:20.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-08-27T11:29:20.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.863+0000 7f26c07ff700 1 Processor -- start 2023-08-27T11:29:20.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.863+0000 7f26c07ff700 1 -- start start 2023-08-27T11:29:20.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26c07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e5b0 0x7f26b80c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26c07ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26b8072150 0x7f26b80c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26c07ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b80c4160 con 0x7f26b814e990 2023-08-27T11:29:20.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26c07ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b80c1520 con 0x7f26b8072150 2023-08-27T11:29:20.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26c07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b806c780 con 0x7f26b814e5b0 2023-08-27T11:29:20.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26bed9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f26b8072150 0x7f26b80c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26bdd9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f26b814e990 0x7f26b8071a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42054/0 (socket says 172.21.15.43:42054) 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26bdd9a700 1 -- 172.21.15.43:0/1947976398 learned_addr learned my addr 172.21.15.43:0/1947976398 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.864+0000 7f26be59b700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e5b0 0x7f26b80c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bed9c700 1 -- 172.21.15.43:0/1947976398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e5b0 msgr2=0x7f26b80c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bed9c700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e5b0 0x7f26b80c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bed9c700 1 -- 172.21.15.43:0/1947976398 >> v1:172.21.15.43:6789/0 conn(0x7f26b814e990 legacy=0x7f26b8071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bed9c700 1 -- 172.21.15.43:0/1947976398 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80c2180 con 0x7f26b8072150 2023-08-27T11:29:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bd599700 1 -- 172.21.15.43:0/1947976398 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537093680 0 0) 0x7f26b80c4160 con 0x7f26b814e990 2023-08-27T11:29:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bed9c700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b8072150 0x7f26b80c5080 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6935a01ada9d30c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bd599700 1 -- 172.21.15.43:0/1947976398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b000e070 con 0x7f26b8072150 2023-08-27T11:29:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bd599700 1 -- 172.21.15.43:0/1947976398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b000bb20 con 0x7f26b8072150 2023-08-27T11:29:20.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.865+0000 7f26bd599700 1 -- 172.21.15.43:0/1947976398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0012430 con 0x7f26b8072150 2023-08-27T11:29:20.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 -- 172.21.15.43:0/1947976398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b8072150 msgr2=0x7f26b80c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b8072150 0x7f26b80c5080 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009d90 tx=0x7f26b000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:20.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 -- 172.21.15.43:0/1947976398 shutdown_connections 2023-08-27T11:29:20.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b8072150 0x7f26b80c5080 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 --2- 172.21.15.43:0/1947976398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e5b0 0x7f26b80c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 -- 172.21.15.43:0/1947976398 >> 172.21.15.43:0/1947976398 conn(0x7f26b80c2860 msgr2=0x7f26b80c2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:20.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 -- 172.21.15.43:0/1947976398 shutdown_connections 2023-08-27T11:29:20.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.866+0000 7f26c07ff700 1 -- 172.21.15.43:0/1947976398 wait complete. 2023-08-27T11:29:20.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.868+0000 7f26c07ff700 1 Processor -- start 2023-08-27T11:29:20.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.868+0000 7f26c07ff700 1 -- start start 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 0x7f26b814edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e990 0x7f26b81ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b81ed920 con 0x7f26b814ff90 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8152ae0 con 0x7f26b814e5b0 2023-08-27T11:29:20.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26c07ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b8152dc0 con 0x7f26b814e990 2023-08-27T11:29:20.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26be59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 0x7f26b814edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42652/0 (socket says 172.21.15.43:42652) 2023-08-27T11:29:20.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bdd9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e990 0x7f26b81ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 -- 172.21.15.43:0/2803493402 learned_addr learned my addr 172.21.15.43:0/2803493402 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:20.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26be59b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 0x7f26b814edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:47172/0 (socket says 172.21.15.43:47172) 2023-08-27T11:29:20.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 -- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e990 msgr2=0x7f26b81ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e990 0x7f26b81ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 -- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 msgr2=0x7f26b814edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:20.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 0x7f26b814edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:20.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.869+0000 7f26bed9c700 1 -- 172.21.15.43:0/2803493402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b0009a70 con 0x7f26b814ff90 2023-08-27T11:29:20.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26bed9c700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f26b0013000 tx=0x7f26b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0012430 con 0x7f26b814ff90 2023-08-27T11:29:20.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b0020070 con 0x7f26b814ff90 2023-08-27T11:29:20.878 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b81530a0 con 0x7f26b814ff90 2023-08-27T11:29:20.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0004280 con 0x7f26b814ff90 2023-08-27T11:29:20.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.870+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b8071650 con 0x7f26b814ff90 2023-08-27T11:29:20.879 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.871+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b81532e0 con 0x7f26b814ff90 2023-08-27T11:29:20.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.872+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26b00043e0 con 0x7f26b814ff90 2023-08-27T11:29:20.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.873+0000 7f26aeffd700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 0x7f269c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:20.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.873+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6238+0+0 (secure 0 0 0) 0x7f26b0022070 con 0x7f26b814ff90 2023-08-27T11:29:20.880 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.873+0000 7f26be59b700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 0x7f269c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:20.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.874+0000 7f26be59b700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 0x7f269c06c5a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009be0 tx=0x7f26b4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:20.881 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:20.878+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f26b81532e0 con 0x7f26b814ff90 2023-08-27T11:29:21.132 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.131+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f26b8153290 con 0x7f26b814ff90 2023-08-27T11:29:21.133 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:29:21.132+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:29:21.138 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.137+0000 7f26aeffd700 1 -- 172.21.15.43:0/2803493402 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v143) v1 ==== 163+0+0 (secure 0 0 0) 0x7f26b00558c0 con 0x7f26b814ff90 2023-08-27T11:29:21.141 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 msgr2=0x7f269c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 0x7f269c06c5a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009be0 tx=0x7f26b4009210 comp rx=0 tx=0).stop 2023-08-27T11:29:21.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 msgr2=0x7f26b814cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f26b0013000 tx=0x7f26b0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 shutdown_connections 2023-08-27T11:29:21.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f269c06a0e0 0x7f269c06c5a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f26b814ff90 0x7f26b814cae0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26b814e5b0 0x7f26b814edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 --2- 172.21.15.43:0/2803493402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f26b814e990 0x7f26b81ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 >> 172.21.15.43:0/2803493402 conn(0x7f26b80c2860 msgr2=0x7f26b80704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:21.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 shutdown_connections 2023-08-27T11:29:21.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.140+0000 7f26c07ff700 1 -- 172.21.15.43:0/2803493402 wait complete. 2023-08-27T11:29:21.144 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:29:21.145 INFO:tasks.ceph.mds.c.smithi043.stderr: -677> 2023-08-27T11:28:55.972+0000 7fb3977f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:29:21.160 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-08-27T11:29:21.190 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:29:21.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.368+0000 7f01fcbff700 1 Processor -- start 2023-08-27T11:29:21.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.368+0000 7f01fcbff700 1 -- start start 2023-08-27T11:29:21.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.369+0000 7f01fcbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f01f8154740 0x7f01f80c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:21.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01fcbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f8154d00 con 0x7f01f80c50d0 2023-08-27T11:29:21.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01fcbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f8154fe0 con 0x7f01f814e960 2023-08-27T11:29:21.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01fcbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f80baf30 con 0x7f01f8154740 2023-08-27T11:29:21.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01effff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f01f80c50d0 0x7f01f80c3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42080/0 (socket says 172.21.15.43:42080) 2023-08-27T11:29:21.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01effff700 1 -- 172.21.15.43:0/1058695548 learned_addr learned my addr 172.21.15.43:0/1058695548 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:21.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f6d9d700 1 --2- 172.21.15.43:0/1058695548 >> v2:172.21.15.43:3300/0 conn(0x7f01f8154740 0x7f01f80c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:21.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f5d9b700 1 -- 172.21.15.43:0/1058695548 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721728796 0 0) 0x7f01f8154d00 con 0x7f01f80c50d0 2023-08-27T11:29:21.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f5d9b700 1 -- 172.21.15.43:0/1058695548 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e40057c0 con 0x7f01f80c50d0 2023-08-27T11:29:21.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f6d9d700 1 -- 172.21.15.43:0/1058695548 >> v1:172.21.15.57:6789/0 conn(0x7f01f814e960 legacy=0x7f01f80a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f6d9d700 1 -- 172.21.15.43:0/1058695548 >> v1:172.21.15.43:6789/0 conn(0x7f01f80c50d0 legacy=0x7f01f80c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.370+0000 7f01f6d9d700 1 -- 172.21.15.43:0/1058695548 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f81552c0 con 0x7f01f8154740 2023-08-27T11:29:21.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01f6d9d700 1 --2- 172.21.15.43:0/1058695548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f80c43d0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e543b8cdf0ae79 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:21.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01f5d9b700 1 -- 172.21.15.43:0/1058695548 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000e070 con 0x7f01f8154740 2023-08-27T11:29:21.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01f5d9b700 1 -- 172.21.15.43:0/1058695548 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f000bb20 con 0x7f01f8154740 2023-08-27T11:29:21.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01f5d9b700 1 -- 172.21.15.43:0/1058695548 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0012430 con 0x7f01f8154740 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01fcbff700 1 -- 172.21.15.43:0/1058695548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 msgr2=0x7f01f80c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.371+0000 7f01fcbff700 1 --2- 172.21.15.43:0/1058695548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f80c43d0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009d90 tx=0x7f01f000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.372+0000 7f01fcbff700 1 -- 172.21.15.43:0/1058695548 shutdown_connections 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.372+0000 7f01fcbff700 1 --2- 172.21.15.43:0/1058695548 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f80c43d0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.372+0000 7f01fcbff700 1 -- 172.21.15.43:0/1058695548 >> 172.21.15.43:0/1058695548 conn(0x7f01f806aa50 msgr2=0x7f01f80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:21.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.372+0000 7f01fcbff700 1 -- 172.21.15.43:0/1058695548 shutdown_connections 2023-08-27T11:29:21.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.372+0000 7f01fcbff700 1 -- 172.21.15.43:0/1058695548 wait complete. 2023-08-27T11:29:21.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.373+0000 7f01fcbff700 1 Processor -- start 2023-08-27T11:29:21.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.373+0000 7f01fcbff700 1 -- start start 2023-08-27T11:29:21.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f80c50d0 0x7f01f814a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:21.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01f814e960 0x7f01f8148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:21.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:21.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8150ad0 con 0x7f01f8154740 2023-08-27T11:29:21.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f814fb50 con 0x7f01f80c50d0 2023-08-27T11:29:21.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.374+0000 7f01fcbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f80bf370 con 0x7f01f814e960 2023-08-27T11:29:21.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:21.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42708/0 (socket says 172.21.15.43:42708) 2023-08-27T11:29:21.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 -- 172.21.15.43:0/2235208830 learned_addr learned my addr 172.21.15.43:0/2235208830 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:21.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f659c700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f80c50d0 0x7f01f814a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:21.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01effff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01f814e960 0x7f01f8148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:21.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 -- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01f814e960 msgr2=0x7f01f8148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01f814e960 0x7f01f8148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 -- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f80c50d0 msgr2=0x7f01f814a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:21.382 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f80c50d0 0x7f01f814a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 -- 172.21.15.43:0/2235208830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f0009a70 con 0x7f01f8154740 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.375+0000 7f01f6d9d700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b680 tx=0x7f01f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.376+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0012430 con 0x7f01f8154740 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.376+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0020070 con 0x7f01f8154740 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.376+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004280 con 0x7f01f8154740 2023-08-27T11:29:21.383 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.376+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f814f6c0 con 0x7f01f8154740 2023-08-27T11:29:21.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.376+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f81e9870 con 0x7f01f8154740 2023-08-27T11:29:21.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.377+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f814f490 con 0x7f01f8154740 2023-08-27T11:29:21.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.378+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01f00043e0 con 0x7f01f8154740 2023-08-27T11:29:21.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.379+0000 7f01eeffd700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 0x7f01d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:21.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.379+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f01f0022070 con 0x7f01f8154740 2023-08-27T11:29:21.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.379+0000 7f01f659c700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 0x7f01d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.380+0000 7f01f659c700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 0x7f01d806c5a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007fd0 tx=0x7f01e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:21.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.383+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f01f814f490 con 0x7f01f8154740 2023-08-27T11:29:21.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:21.637+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01f814f490 con 0x7f01f8154740 2023-08-27T11:29:22.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.138+0000 7f01eeffd700 1 -- 172.21.15.43:0/2235208830 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v144) v1 ==== 105+0+0 (secure 0 0 0) 0x7f01f814f490 con 0x7f01f8154740 2023-08-27T11:29:22.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.140+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 msgr2=0x7f01d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.140+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 0x7f01d806c5a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007fd0 tx=0x7f01e8009040 comp rx=0 tx=0).stop 2023-08-27T11:29:22.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.140+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 msgr2=0x7f01f8148d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.140+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b680 tx=0x7f01f0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 shutdown_connections 2023-08-27T11:29:22.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f01d806a0e0 0x7f01d806c5a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01f8154740 0x7f01f8148d70 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01f80c50d0 0x7f01f814a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 --2- 172.21.15.43:0/2235208830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01f814e960 0x7f01f8148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 >> 172.21.15.43:0/2235208830 conn(0x7f01f806aa50 msgr2=0x7f01f814c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:22.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 shutdown_connections 2023-08-27T11:29:22.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.141+0000 7f01fcbff700 1 -- 172.21.15.43:0/2235208830 wait complete. 2023-08-27T11:29:22.163 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-08-27T11:29:22.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.410+0000 7efcdb7ff700 1 Processor -- start 2023-08-27T11:29:22.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.411+0000 7efcdb7ff700 1 -- start start 2023-08-27T11:29:22.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcdb7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efcd4151a40 0x7efcd40c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcdb7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcd40c81c0 0x7efcd40c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcdb7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd4154730 con 0x7efcd40c4c40 2023-08-27T11:29:22.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcdb7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd4154520 con 0x7efcd40c81c0 2023-08-27T11:29:22.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcdb7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd4154a10 con 0x7efcd4151a40 2023-08-27T11:29:22.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcd40c81c0 0x7efcd40c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7efcd40c81c0 0x7efcd40c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42712/0 (socket says 172.21.15.43:42712) 2023-08-27T11:29:22.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 -- 172.21.15.43:0/1197408977 learned_addr learned my addr 172.21.15.43:0/1197408977 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:22.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd959b700 1 --2- 172.21.15.43:0/1197408977 >> v2:172.21.15.57:3300/0 conn(0x7efcd4151a40 0x7efcd40c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 -- 172.21.15.43:0/1197408977 >> v2:172.21.15.57:3300/0 conn(0x7efcd4151a40 msgr2=0x7efcd40c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:22.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 --2- 172.21.15.43:0/1197408977 >> v2:172.21.15.57:3300/0 conn(0x7efcd4151a40 0x7efcd40c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 -- 172.21.15.43:0/1197408977 >> v1:172.21.15.57:6789/0 conn(0x7efcd40c4c40 legacy=0x7efcd406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.412+0000 7efcd8d9a700 1 -- 172.21.15.43:0/1197408977 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4154cf0 con 0x7efcd40c81c0 2023-08-27T11:29:22.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efcd8d9a700 1 --2- 172.21.15.43:0/1197408977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd40c81c0 0x7efcd40c4700 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efcd40a9630 tx=0x7efcc4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3600b3d7f83c3f21 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:22.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efccbfff700 1 -- 172.21.15.43:0/1197408977 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400b870 con 0x7efcd40c81c0 2023-08-27T11:29:22.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efccbfff700 1 -- 172.21.15.43:0/1197408977 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc400b9d0 con 0x7efcd40c81c0 2023-08-27T11:29:22.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efccbfff700 1 -- 172.21.15.43:0/1197408977 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc400bd60 con 0x7efcd40c81c0 2023-08-27T11:29:22.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1197408977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd40c81c0 msgr2=0x7efcd40c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.413+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1197408977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd40c81c0 0x7efcd40c4700 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efcd40a9630 tx=0x7efcc4009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1197408977 shutdown_connections 2023-08-27T11:29:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1197408977 >> v2:172.21.15.57:3300/0 conn(0x7efcd4151a40 0x7efcd40c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1197408977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd40c81c0 0x7efcd40c4700 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1197408977 >> 172.21.15.43:0/1197408977 conn(0x7efcd40ab890 msgr2=0x7efcd40abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:22.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1197408977 shutdown_connections 2023-08-27T11:29:22.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.414+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1197408977 wait complete. 2023-08-27T11:29:22.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.415+0000 7efcdb7ff700 1 Processor -- start 2023-08-27T11:29:22.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.415+0000 7efcdb7ff700 1 -- start start 2023-08-27T11:29:22.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcd40c4c40 0x7efcd4150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcd40c81c0 0x7efcd40c3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c30e0 con 0x7efcd4151a40 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c0e50 con 0x7efcd40c4c40 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.416+0000 7efcdb7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c1440 con 0x7efcd40c81c0 2023-08-27T11:29:22.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42716/0 (socket says 172.21.15.43:42716) 2023-08-27T11:29:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 -- 172.21.15.43:0/1142930002 learned_addr learned my addr 172.21.15.43:0/1142930002 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd959b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcd40c4c40 0x7efcd4150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd8d9a700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcd40c81c0 0x7efcd40c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 -- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcd40c81c0 msgr2=0x7efcd40c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcd40c81c0 0x7efcd40c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 -- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcd40c4c40 msgr2=0x7efcd4150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcd40c4c40 0x7efcd4150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 -- 172.21.15.43:0/1142930002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009550 con 0x7efcd4151a40 2023-08-27T11:29:22.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.417+0000 7efcd9d9c700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efccc00cc50 tx=0x7efccc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.418+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc003c00 con 0x7efcd4151a40 2023-08-27T11:29:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.418+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc003d60 con 0x7efcd4151a40 2023-08-27T11:29:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.418+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc00aab0 con 0x7efcd4151a40 2023-08-27T11:29:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.418+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd414b3c0 con 0x7efcd4151a40 2023-08-27T11:29:22.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.418+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd40c1130 con 0x7efcd4151a40 2023-08-27T11:29:22.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.419+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd414b220 con 0x7efcd4151a40 2023-08-27T11:29:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.420+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efccc00ac10 con 0x7efcd4151a40 2023-08-27T11:29:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.421+0000 7efcc9ffb700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 0x7efcb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.421+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efccc0886b0 con 0x7efcd4151a40 2023-08-27T11:29:22.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.421+0000 7efcd959b700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 0x7efcb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.422+0000 7efcd959b700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 0x7efcb806c5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006b20 tx=0x7efcd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:22.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.426+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efcd414b220 con 0x7efcd4151a40 2023-08-27T11:29:22.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:22.633+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efcd414b220 con 0x7efcd4151a40 2023-08-27T11:29:23.149 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.148+0000 7efcc9ffb700 1 -- 172.21.15.43:0/1142930002 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v134) v1 ==== 184+0+0 (secure 0 0 0) 0x7efcd414b220 con 0x7efcd4151a40 2023-08-27T11:29:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.151+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 msgr2=0x7efcb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.151+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 0x7efcb806c5a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006b20 tx=0x7efcd0008040 comp rx=0 tx=0).stop 2023-08-27T11:29:23.153 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 msgr2=0x7efcd40bf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efccc00cc50 tx=0x7efccc00cf60 comp rx=0 tx=0).stop 2023-08-27T11:29:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 shutdown_connections 2023-08-27T11:29:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7efcb806a0e0 0x7efcb806c5a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7efcd4151a40 0x7efcd40bf3d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcd40c4c40 0x7efcd4150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 --2- 172.21.15.43:0/1142930002 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcd40c81c0 0x7efcd40c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 >> 172.21.15.43:0/1142930002 conn(0x7efcd40ab890 msgr2=0x7efcd40ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 shutdown_connections 2023-08-27T11:29:23.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.152+0000 7efcdb7ff700 1 -- 172.21.15.43:0/1142930002 wait complete. 2023-08-27T11:29:23.156 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_metadata' removed 2023-08-27T11:29:23.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-08-27T11:29:23.389 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.388+0000 7f6ad49ff700 1 Processor -- start 2023-08-27T11:29:23.390 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.388+0000 7f6ad49ff700 1 -- start start 2023-08-27T11:29:23.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.389+0000 7f6ad49ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 0x7f6ad014e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ad49ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6ad00c50f0 0x7f6ad00c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ad49ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad0152140 con 0x7f6ad00a5090 2023-08-27T11:29:23.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ad49ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad01515c0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ad49ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01518a0 con 0x7f6ad00a77d0 2023-08-27T11:29:23.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6ad00c50f0 0x7f6ad00c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6ad00c50f0 0x7f6ad00c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42726/0 (socket says 172.21.15.43:42726) 2023-08-27T11:29:23.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 -- 172.21.15.43:0/710273980 learned_addr learned my addr 172.21.15.43:0/710273980 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:23.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ace59c700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 0x7f6ad014e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 -- 172.21.15.43:0/710273980 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 msgr2=0x7f6ad014e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:23.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 0x7f6ad014e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 -- 172.21.15.43:0/710273980 >> v1:172.21.15.57:6789/0 conn(0x7f6ad00a5090 legacy=0x7f6ad014e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:23.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6aced9d700 1 -- 172.21.15.43:0/710273980 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0151b80 con 0x7f6ad00c50f0 2023-08-27T11:29:23.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.390+0000 7f6ace59c700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 0x7f6ad014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:23.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6aced9d700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad00c3b60 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009e50 tx=0x7f6ac800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d455acce3835097c server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:23.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6acdd9b700 1 -- 172.21.15.43:0/710273980 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800e070 con 0x7f6ad00c50f0 2023-08-27T11:29:23.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6acdd9b700 1 -- 172.21.15.43:0/710273980 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800b9c0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6acdd9b700 1 -- 172.21.15.43:0/710273980 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800bd70 con 0x7f6ad00c50f0 2023-08-27T11:29:23.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 -- 172.21.15.43:0/710273980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 msgr2=0x7f6ad00c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:23.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad00c3b60 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009e50 tx=0x7f6ac800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:23.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 -- 172.21.15.43:0/710273980 shutdown_connections 2023-08-27T11:29:23.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad00c3b60 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/710273980 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a77d0 0x7f6ad014e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.391+0000 7f6ad49ff700 1 -- 172.21.15.43:0/710273980 >> 172.21.15.43:0/710273980 conn(0x7f6ad00c2400 msgr2=0x7f6ad00c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:23.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.392+0000 7f6ad49ff700 1 -- 172.21.15.43:0/710273980 shutdown_connections 2023-08-27T11:29:23.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.392+0000 7f6ad49ff700 1 -- 172.21.15.43:0/710273980 wait complete. 2023-08-27T11:29:23.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.393+0000 7f6ad49ff700 1 Processor -- start 2023-08-27T11:29:23.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.393+0000 7f6ad49ff700 1 -- start start 2023-08-27T11:29:23.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a5090 0x7f6ad00a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 0x7f6ad0072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad0147b20 con 0x7f6ad00c50f0 2023-08-27T11:29:23.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad0150ff0 con 0x7f6ad00a77d0 2023-08-27T11:29:23.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.394+0000 7f6ad49ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01ed7f0 con 0x7f6ad00a5090 2023-08-27T11:29:23.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42738/0 (socket says 172.21.15.43:42738) 2023-08-27T11:29:23.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 -- 172.21.15.43:0/1560408821 learned_addr learned my addr 172.21.15.43:0/1560408821 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:23.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6ace59c700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a5090 0x7f6ad00a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6ac7fff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 0x7f6ad0072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 -- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a5090 msgr2=0x7f6ad00a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:23.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a5090 0x7f6ad00a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 -- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 msgr2=0x7f6ad0072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:23.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 0x7f6ad0072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:23.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 -- 172.21.15.43:0/1560408821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8009b30 con 0x7f6ad00c50f0 2023-08-27T11:29:23.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6ac7fff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 0x7f6ad0072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:23.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6aced9d700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006dd90 tx=0x7f6ac8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:23.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.395+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac80048b0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.396+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80092e0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.396+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac801b670 con 0x7f6ad00c50f0 2023-08-27T11:29:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.396+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad014c8d0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.396+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad01ea7e0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.397+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad004ee70 con 0x7f6ad00c50f0 2023-08-27T11:29:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.398+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ac801b7d0 con 0x7f6ad00c50f0 2023-08-27T11:29:23.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.399+0000 7f6ac6ffd700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 0x7f6ab006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:23.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.399+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5884+0+0 (secure 0 0 0) 0x7f6ac8089e10 con 0x7f6ad00c50f0 2023-08-27T11:29:23.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.399+0000 7f6ace59c700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 0x7f6ab006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:23.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.400+0000 7f6ace59c700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 0x7f6ab006c5a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006fd0 tx=0x7f6ac0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:23.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.404+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ac808d030 con 0x7f6ad00c50f0 2023-08-27T11:29:23.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:23.615+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ad0072690 con 0x7f6ad00c50f0 2023-08-27T11:29:24.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.159+0000 7f6ac6ffd700 1 -- 172.21.15.43:0/1560408821 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v135) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6ac80555a0 con 0x7f6ad00c50f0 2023-08-27T11:29:24.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 msgr2=0x7f6ab006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 0x7f6ab006c5a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0006fd0 tx=0x7f6ac0008040 comp rx=0 tx=0).stop 2023-08-27T11:29:24.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 msgr2=0x7f6ad01ec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6ad006dd90 tx=0x7f6ac8004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 shutdown_connections 2023-08-27T11:29:24.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ab006a0e0 0x7f6ab006c5a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6ad00c50f0 0x7f6ad01ec8e0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6ad00a5090 0x7f6ad00a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 --2- 172.21.15.43:0/1560408821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ad00a77d0 0x7f6ad0072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.162+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 >> 172.21.15.43:0/1560408821 conn(0x7f6ad00c2400 msgr2=0x7f6ad014e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:24.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.163+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 shutdown_connections 2023-08-27T11:29:24.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.163+0000 7f6ad49ff700 1 -- 172.21.15.43:0/1560408821 wait complete. 2023-08-27T11:29:24.166 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs2_data' removed 2023-08-27T11:29:24.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-27T11:29:24.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.391+0000 7f46373ff700 1 Processor -- start 2023-08-27T11:29:24.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.391+0000 7f46373ff700 1 -- start start 2023-08-27T11:29:24.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f46373ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f46373ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 0x7f46300c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f46373ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463006c4e0 con 0x7f463006ad70 2023-08-27T11:29:24.394 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f46373ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4630155370 con 0x7f46300c4630 2023-08-27T11:29:24.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f46373ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4630151e70 con 0x7f4630151a90 2023-08-27T11:29:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f463519b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f463519b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:55422/0 (socket says 172.21.15.43:55422) 2023-08-27T11:29:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f463499a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 0x7f46300c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f463519b700 1 -- 172.21.15.43:0/2393368974 learned_addr learned my addr 172.21.15.43:0/2393368974 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:24.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.393+0000 7f463599c700 1 --1- 172.21.15.43:0/2393368974 >> v1:172.21.15.57:6789/0 conn(0x7f463006ad70 0x7f463006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:53180/0 (socket says 172.21.15.43:53180) 2023-08-27T11:29:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f4627fff700 1 -- 172.21.15.43:0/2393368974 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929015190 0 0) 0x7f463006c4e0 con 0x7f463006ad70 2023-08-27T11:29:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f4627fff700 1 -- 172.21.15.43:0/2393368974 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c0035b0 con 0x7f463006ad70 2023-08-27T11:29:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463519b700 1 -- 172.21.15.43:0/2393368974 >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 msgr2=0x7f46300c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463519b700 1 --2- 172.21.15.43:0/2393368974 >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 0x7f46300c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463519b700 1 -- 172.21.15.43:0/2393368974 >> v1:172.21.15.57:6789/0 conn(0x7f463006ad70 legacy=0x7f463006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463519b700 1 -- 172.21.15.43:0/2393368974 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630154480 con 0x7f4630151a90 2023-08-27T11:29:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463499a700 1 --2- 172.21.15.43:0/2393368974 >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 0x7f46300c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f463519b700 1 --2- 172.21.15.43:0/2393368974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=338380eb2efc3d11 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f4627fff700 1 -- 172.21.15.43:0/2393368974 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011830 con 0x7f4630151a90 2023-08-27T11:29:24.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f4627fff700 1 -- 172.21.15.43:0/2393368974 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c011990 con 0x7f4630151a90 2023-08-27T11:29:24.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.394+0000 7f4627fff700 1 -- 172.21.15.43:0/2393368974 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c011d20 con 0x7f4630151a90 2023-08-27T11:29:24.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 -- 172.21.15.43:0/2393368974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 msgr2=0x7f46300c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 --2- 172.21.15.43:0/2393368974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:24.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 -- 172.21.15.43:0/2393368974 shutdown_connections 2023-08-27T11:29:24.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 --2- 172.21.15.43:0/2393368974 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4630151a90 0x7f46300c7bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 --2- 172.21.15.43:0/2393368974 >> v2:172.21.15.57:3300/0 conn(0x7f46300c4630 0x7f46300c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 -- 172.21.15.43:0/2393368974 >> 172.21.15.43:0/2393368974 conn(0x7f46300ab820 msgr2=0x7f46300abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:24.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 -- 172.21.15.43:0/2393368974 shutdown_connections 2023-08-27T11:29:24.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.395+0000 7f46373ff700 1 -- 172.21.15.43:0/2393368974 wait complete. 2023-08-27T11:29:24.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.397+0000 7f46373ff700 1 Processor -- start 2023-08-27T11:29:24.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.397+0000 7f46373ff700 1 -- start start 2023-08-27T11:29:24.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f463006ad70 0x7f46300aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4630151a90 0x7f46300c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630157370 con 0x7f46300c4630 2023-08-27T11:29:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630155ed0 con 0x7f4630151a90 2023-08-27T11:29:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f46373ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46301ea380 con 0x7f463006ad70 2023-08-27T11:29:24.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f463499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f463499a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42750/0 (socket says 172.21.15.43:42750) 2023-08-27T11:29:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f463499a700 1 -- 172.21.15.43:0/2474742106 learned_addr learned my addr 172.21.15.43:0/2474742106 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f463519b700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f463006ad70 0x7f46300aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.398+0000 7f463599c700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4630151a90 0x7f46300c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 -- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f463006ad70 msgr2=0x7f46300aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f463006ad70 0x7f46300aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 -- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4630151a90 msgr2=0x7f46300c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4630151a90 0x7f46300c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 -- 172.21.15.43:0/2474742106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200094a0 con 0x7f46300c4630 2023-08-27T11:29:24.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f463499a700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f462000ebe0 tx=0x7f462000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000c850 con 0x7f46300c4630 2023-08-27T11:29:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462000c9b0 con 0x7f46300c4630 2023-08-27T11:29:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c009550 con 0x7f46300c4630 2023-08-27T11:29:24.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000cd40 con 0x7f46300c4630 2023-08-27T11:29:24.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.399+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4630155b60 con 0x7f46300c4630 2023-08-27T11:29:24.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.400+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46301ecdd0 con 0x7f46300c4630 2023-08-27T11:29:24.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.401+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4620013470 con 0x7f46300c4630 2023-08-27T11:29:24.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.402+0000 7f4625ffb700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 0x7f461406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.402+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f46200883e0 con 0x7f46300c4630 2023-08-27T11:29:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.402+0000 7f463519b700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 0x7f461406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.403+0000 7f463519b700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 0x7f461406c5a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f462c009c40 tx=0x7f462c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.407+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4620053d10 con 0x7f46300c4630 2023-08-27T11:29:24.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.621+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4630154730 con 0x7f46300c4630 2023-08-27T11:29:24.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.625+0000 7f4625ffb700 1 -- 172.21.15.43:0/2474742106 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f462000cea0 con 0x7f46300c4630 2023-08-27T11:29:24.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 msgr2=0x7f461406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 0x7f461406c5a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f462c009c40 tx=0x7f462c008030 comp rx=0 tx=0).stop 2023-08-27T11:29:24.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 msgr2=0x7f46300c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f462000ebe0 tx=0x7f462000eef0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 shutdown_connections 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f461406a0e0 0x7f461406c5a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4630151a90 0x7f46300c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f463006ad70 0x7f46300aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 --2- 172.21.15.43:0/2474742106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f46300c4630 0x7f46300c8a50 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 >> 172.21.15.43:0/2474742106 conn(0x7f46300ab820 msgr2=0x7f463014d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:24.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.627+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 shutdown_connections 2023-08-27T11:29:24.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.628+0000 7f46373ff700 1 -- 172.21.15.43:0/2474742106 wait complete. 2023-08-27T11:29:24.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.c mds_join_fs 2023-08-27T11:29:24.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.849+0000 7ff5e47ff700 1 Processor -- start 2023-08-27T11:29:24.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.850+0000 7ff5e47ff700 1 -- start start 2023-08-27T11:29:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e47ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5dc0c4630 0x7ff5dc0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.852 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5dc06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e47ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc0c82c0 con 0x7ff5dc151b20 2023-08-27T11:29:24.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e47ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc151f00 con 0x7ff5dc0c4630 2023-08-27T11:29:24.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc06c450 con 0x7ff5dc06ad70 2023-08-27T11:29:24.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e259b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff5dc151b20 0x7ff5dc0c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42082/0 (socket says 172.21.15.43:42082) 2023-08-27T11:29:24.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e259b700 1 -- 172.21.15.43:0/2058873689 learned_addr learned my addr 172.21.15.43:0/2058873689 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:24.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750034011 0 0) 0x7ff5dc0c82c0 con 0x7ff5dc151b20 2023-08-27T11:29:24.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/2058873689 >> v2:172.21.15.57:3300/0 conn(0x7ff5dc0c4630 0x7ff5dc0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c80035b0 con 0x7ff5dc151b20 2023-08-27T11:29:24.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.851+0000 7ff5e2d9c700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5dc06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3372171352 0 0) 0x7ff5c80035b0 con 0x7ff5dc151b20 2023-08-27T11:29:24.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 msgr2=0x7ff5dc06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:24.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5dc06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 >> v2:172.21.15.57:3300/0 conn(0x7ff5dc0c4630 msgr2=0x7ff5dc0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 --2- 172.21.15.43:0/2058873689 >> v2:172.21.15.57:3300/0 conn(0x7ff5dc0c4630 0x7ff5dc0c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc154760 con 0x7ff5dc151b20 2023-08-27T11:29:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7ff5d8001670 con 0x7ff5dc151b20 2023-08-27T11:29:24.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 >> v1:172.21.15.43:6789/0 conn(0x7ff5dc151b20 legacy=0x7ff5dc0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8003a00 0x7ff5c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5c8004850 0x7ff5c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc06c450 con 0x7ff5c8004850 2023-08-27T11:29:24.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c800ba10 con 0x7ff5c8003a00 2023-08-27T11:29:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c800bba0 con 0x7ff5dc06ad70 2023-08-27T11:29:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5c8004850 0x7ff5c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e259b700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8003a00 0x7ff5c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.852+0000 7ff5e2d9c700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 -- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 msgr2=0x7ff5c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:24.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc06ad70 0x7ff5c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 -- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8003a00 msgr2=0x7ff5c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:24.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8003a00 0x7ff5c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 -- 172.21.15.43:0/2058873689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c80035b0 con 0x7ff5c8004850 2023-08-27T11:29:24.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5c8004850 0x7ff5c8004cd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009b70 tx=0x7ff5c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fb59c6519ae82a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc005a20 con 0x7ff5c8004850 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc005b80 con 0x7ff5c8004850 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e1599700 1 -- 172.21.15.43:0/2058873689 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc00e6c0 con 0x7ff5c8004850 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e47ff700 1 -- 172.21.15.43:0/2058873689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5c8004850 msgr2=0x7ff5c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.853+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/2058873689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5c8004850 0x7ff5c8004cd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009b70 tx=0x7ff5c8005880 comp rx=0 tx=0).stop 2023-08-27T11:29:24.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.854+0000 7ff5e2d9c700 1 -- 172.21.15.43:0/2058873689 reap_dead start 2023-08-27T11:29:24.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.854+0000 7ff5e47ff700 1 -- 172.21.15.43:0/2058873689 shutdown_connections 2023-08-27T11:29:24.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.854+0000 7ff5e47ff700 1 -- 172.21.15.43:0/2058873689 >> 172.21.15.43:0/2058873689 conn(0x7ff5dc0ab820 msgr2=0x7ff5dc0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:24.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.854+0000 7ff5e47ff700 1 -- 172.21.15.43:0/2058873689 shutdown_connections 2023-08-27T11:29:24.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.854+0000 7ff5e47ff700 1 -- 172.21.15.43:0/2058873689 wait complete. 2023-08-27T11:29:24.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.855+0000 7ff5e47ff700 1 Processor -- start 2023-08-27T11:29:24.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 -- start start 2023-08-27T11:29:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 0x7ff5dc0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc14dbd0 0x7ff5dc142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc143940 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc1574c0 con 0x7ff5c8004850 2023-08-27T11:29:24.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.856+0000 7ff5e47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc1e9e90 con 0x7ff5dc14dbd0 2023-08-27T11:29:24.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42764/0 (socket says 172.21.15.43:42764) 2023-08-27T11:29:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 -- 172.21.15.43:0/4013444370 learned_addr learned my addr 172.21.15.43:0/4013444370 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e1d9a700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc14dbd0 0x7ff5dc142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e259b700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 0x7ff5dc0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 -- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc14dbd0 msgr2=0x7ff5dc142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc14dbd0 0x7ff5dc142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 -- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 msgr2=0x7ff5dc0aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 0x7ff5dc0aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:24.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 -- 172.21.15.43:0/4013444370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc1ea130 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e259b700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 0x7ff5dc0aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.857+0000 7ff5e2d9c700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0cadb0 tx=0x7ff5d40114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.858+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d400e070 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.858+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4003c30 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.858+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4003de0 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.858+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc156e70 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.858+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc0aad90 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.859+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc154d20 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.860+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff5d40119b0 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.860+0000 7ff5d2ffd700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 0x7ff5c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:24.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.861+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7ff5d4088790 con 0x7ff5dc14d4f0 2023-08-27T11:29:24.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.861+0000 7ff5e259b700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 0x7ff5c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:24.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.861+0000 7ff5e259b700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 0x7ff5c006c5a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8000c00 tx=0x7ff5d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:24.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:24.865+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff5d40540c0 con 0x7ff5dc14d4f0 2023-08-27T11:29:25.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.087+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"} v 0) v1 -- 0x7ff5dc04ee70 con 0x7ff5dc14d4f0 2023-08-27T11:29:25.092 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.091+0000 7ff5d2ffd700 1 -- 172.21.15.43:0/4013444370 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.c", "name": "mds_join_fs"}]=0 v47) v1 ==== 96+0+0 (secure 0 0 0) 0x7ff5d4014350 con 0x7ff5dc14d4f0 2023-08-27T11:29:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 msgr2=0x7ff5c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 0x7ff5c006c5a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8000c00 tx=0x7ff5d8009040 comp rx=0 tx=0).stop 2023-08-27T11:29:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 msgr2=0x7ff5dc143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.095 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0cadb0 tx=0x7ff5d40114b0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 shutdown_connections 2023-08-27T11:29:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff5c006a0e0 0x7ff5c006c5a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff5dc14d4f0 0x7ff5dc143400 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5c8004850 0x7ff5dc0aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.096 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 --2- 172.21.15.43:0/4013444370 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5dc14dbd0 0x7ff5dc142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.093+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 >> 172.21.15.43:0/4013444370 conn(0x7ff5dc0ab820 msgr2=0x7ff5dc06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.094+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 shutdown_connections 2023-08-27T11:29:25.097 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.094+0000 7ff5e47ff700 1 -- 172.21.15.43:0/4013444370 wait complete. 2023-08-27T11:29:25.113 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds.a mds_join_fs 2023-08-27T11:29:25.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.316+0000 7fa1b19ff700 1 Processor -- start 2023-08-27T11:29:25.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.316+0000 7fa1b19ff700 1 -- start start 2023-08-27T11:29:25.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1b19ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1b19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 0x7fa1ac06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1b19ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ac06c4e0 con 0x7fa1ac0c4630 2023-08-27T11:29:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1b19ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ac155370 con 0x7fa1ac151a90 2023-08-27T11:29:25.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1b19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac151e70 con 0x7fa1ac0c4a90 2023-08-27T11:29:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42766/0 (socket says 172.21.15.43:42766) 2023-08-27T11:29:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 -- 172.21.15.43:0/2445005249 learned_addr learned my addr 172.21.15.43:0/2445005249 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:25.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1ab7fe700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 0x7fa1ac06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 -- 172.21.15.43:0/2445005249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 msgr2=0x7fa1ac06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:25.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 0x7fa1ac06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 -- 172.21.15.43:0/2445005249 >> v1:172.21.15.43:6789/0 conn(0x7fa1ac0c4630 legacy=0x7fa1ac06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aaffd700 1 -- 172.21.15.43:0/2445005249 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac154480 con 0x7fa1ac151a90 2023-08-27T11:29:25.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1aa7fc700 1 -- 172.21.15.43:0/2445005249 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085846863 0 0) 0x7fa1ac06c4e0 con 0x7fa1ac0c4630 2023-08-27T11:29:25.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.318+0000 7fa1ab7fe700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 0x7fa1ac06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:25.326 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1aaffd700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0098f0 tx=0x7fa19c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a238dabbfce475 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1aa7fc700 1 -- 172.21.15.43:0/2445005249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00b8a0 con 0x7fa1ac151a90 2023-08-27T11:29:25.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1aa7fc700 1 -- 172.21.15.43:0/2445005249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c00ba00 con 0x7fa1ac151a90 2023-08-27T11:29:25.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1aa7fc700 1 -- 172.21.15.43:0/2445005249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00bd90 con 0x7fa1ac151a90 2023-08-27T11:29:25.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1b19ff700 1 -- 172.21.15.43:0/2445005249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 msgr2=0x7fa1ac0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.330 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.319+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0098f0 tx=0x7fa19c009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:25.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 -- 172.21.15.43:0/2445005249 shutdown_connections 2023-08-27T11:29:25.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4a90 0x7fa1ac06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/2445005249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0c7bb0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.331 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 -- 172.21.15.43:0/2445005249 >> 172.21.15.43:0/2445005249 conn(0x7fa1ac0ab820 msgr2=0x7fa1ac0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 -- 172.21.15.43:0/2445005249 shutdown_connections 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.320+0000 7fa1b19ff700 1 -- 172.21.15.43:0/2445005249 wait complete. 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.321+0000 7fa1b19ff700 1 Processor -- start 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 -- start start 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4630 0x7fa1ac152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.332 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1ac0c4a90 0x7fa1ac0bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac0ab370 con 0x7fa1ac151a90 2023-08-27T11:29:25.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac1531d0 con 0x7fa1ac0c4a90 2023-08-27T11:29:25.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.322+0000 7fa1b19ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac156da0 con 0x7fa1ac0c4630 2023-08-27T11:29:25.333 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42772/0 (socket says 172.21.15.43:42772) 2023-08-27T11:29:25.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 -- 172.21.15.43:0/1395768145 learned_addr learned my addr 172.21.15.43:0/1395768145 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:25.334 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1aaffd700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4630 0x7fa1ac152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1a3fff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1ac0c4a90 0x7fa1ac0bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 -- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4630 msgr2=0x7fa1ac152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4630 0x7fa1ac152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.335 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 -- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1ac0c4a90 msgr2=0x7fa1ac0bbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1ac0c4a90 0x7fa1ac0bbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.323+0000 7fa1ab7fe700 1 -- 172.21.15.43:0/1395768145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c009550 con 0x7fa1ac151a90 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1ab7fe700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400cf20 tx=0x7fa1a400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400ad60 con 0x7fa1ac151a90 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a4015440 con 0x7fa1ac151a90 2023-08-27T11:29:25.336 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40157f0 con 0x7fa1ac151a90 2023-08-27T11:29:25.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac0bc7b0 con 0x7fa1ac151a90 2023-08-27T11:29:25.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.324+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac153400 con 0x7fa1ac151a90 2023-08-27T11:29:25.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.325+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac04ee70 con 0x7fa1ac151a90 2023-08-27T11:29:25.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.326+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa1a400d430 con 0x7fa1ac151a90 2023-08-27T11:29:25.337 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.327+0000 7fa1a8ff9700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 0x7fa18c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.327+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fa1a40887a0 con 0x7fa1ac151a90 2023-08-27T11:29:25.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.327+0000 7fa1aaffd700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 0x7fa18c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.338 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.328+0000 7fa1aaffd700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 0x7fa18c06c5a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa19c014040 tx=0x7fa19c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.339 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.332+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa1a40540d0 con 0x7fa1ac151a90 2023-08-27T11:29:25.542 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.541+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"} v 0) v1 -- 0x7fa1ac156ee0 con 0x7fa1ac151a90 2023-08-27T11:29:25.546 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.545+0000 7fa1a8ff9700 1 -- 172.21.15.43:0/1395768145 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds.a", "name": "mds_join_fs"}]=0 v48) v1 ==== 96+0+0 (secure 0 0 0) 0x7fa1a40576f0 con 0x7fa1ac151a90 2023-08-27T11:29:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 msgr2=0x7fa18c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.549 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 0x7fa18c06c5a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa19c014040 tx=0x7fa19c008030 comp rx=0 tx=0).stop 2023-08-27T11:29:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 msgr2=0x7fa1ac0bc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400cf20 tx=0x7fa1a400cf50 comp rx=0 tx=0).stop 2023-08-27T11:29:25.550 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 shutdown_connections 2023-08-27T11:29:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa18c06a0e0 0x7fa18c06c5a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa1ac151a90 0x7fa1ac0bc270 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.551 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa1ac0c4630 0x7fa1ac152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 --2- 172.21.15.43:0/1395768145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1ac0c4a90 0x7fa1ac0bbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 >> 172.21.15.43:0/1395768145 conn(0x7fa1ac0ab820 msgr2=0x7fa1ac149b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:25.552 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 shutdown_connections 2023-08-27T11:29:25.553 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.548+0000 7fa1b19ff700 1 -- 172.21.15.43:0/1395768145 wait complete. 2023-08-27T11:29:25.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla' 2023-08-27T11:29:25.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.767+0000 7f782f3ff700 1 Processor -- start 2023-08-27T11:29:25.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.768+0000 7f782f3ff700 1 -- start start 2023-08-27T11:29:25.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 0x7f78280c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782f3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 0x7f782806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782f3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782806c4e0 con 0x7f78280c4630 2023-08-27T11:29:25.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782f3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7828155370 con 0x7f78280c4a90 2023-08-27T11:29:25.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7828151e70 con 0x7f7828151a90 2023-08-27T11:29:25.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782c99a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f78280c4630 0x7f782806ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42102/0 (socket says 172.21.15.43:42102) 2023-08-27T11:29:25.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782c99a700 1 -- 172.21.15.43:0/718337962 learned_addr learned my addr 172.21.15.43:0/718337962 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:25.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782d99c700 1 --2- 172.21.15.43:0/718337962 >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 0x7f782806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f782d19b700 1 --2- 172.21.15.43:0/718337962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 0x7f78280c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.769+0000 7f781ffff700 1 -- 172.21.15.43:0/718337962 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546217299 0 0) 0x7f782806c4e0 con 0x7f78280c4630 2023-08-27T11:29:25.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f781ffff700 1 -- 172.21.15.43:0/718337962 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78140035b0 con 0x7f78280c4630 2023-08-27T11:29:25.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d19b700 1 -- 172.21.15.43:0/718337962 >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 msgr2=0x7f782806b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:25.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d19b700 1 --2- 172.21.15.43:0/718337962 >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 0x7f782806b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d19b700 1 -- 172.21.15.43:0/718337962 >> v1:172.21.15.43:6789/0 conn(0x7f78280c4630 legacy=0x7f782806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d19b700 1 -- 172.21.15.43:0/718337962 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828154480 con 0x7f7828151a90 2023-08-27T11:29:25.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d99c700 1 --2- 172.21.15.43:0/718337962 >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 0x7f782806b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:25.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f782d19b700 1 --2- 172.21.15.43:0/718337962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 0x7f78280c7bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7824009840 tx=0x7f7824009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55678ffc2e9f32b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f781ffff700 1 -- 172.21.15.43:0/718337962 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824011830 con 0x7f7828151a90 2023-08-27T11:29:25.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f781ffff700 1 -- 172.21.15.43:0/718337962 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824011990 con 0x7f7828151a90 2023-08-27T11:29:25.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.770+0000 7f781ffff700 1 -- 172.21.15.43:0/718337962 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824011d20 con 0x7f7828151a90 2023-08-27T11:29:25.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 -- 172.21.15.43:0/718337962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 msgr2=0x7f78280c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 --2- 172.21.15.43:0/718337962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 0x7f78280c7bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7824009840 tx=0x7f7824009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:25.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 -- 172.21.15.43:0/718337962 shutdown_connections 2023-08-27T11:29:25.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 --2- 172.21.15.43:0/718337962 >> v2:172.21.15.57:3300/0 conn(0x7f78280c4a90 0x7f782806b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 --2- 172.21.15.43:0/718337962 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7828151a90 0x7f78280c7bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 -- 172.21.15.43:0/718337962 >> 172.21.15.43:0/718337962 conn(0x7f78280ab820 msgr2=0x7f78280abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 -- 172.21.15.43:0/718337962 shutdown_connections 2023-08-27T11:29:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.771+0000 7f782f3ff700 1 -- 172.21.15.43:0/718337962 wait complete. 2023-08-27T11:29:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.773+0000 7f782f3ff700 1 Processor -- start 2023-08-27T11:29:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.773+0000 7f782f3ff700 1 -- start start 2023-08-27T11:29:25.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78280c4630 0x7f78280c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828151a90 0x7f78281523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78280bdbb0 con 0x7f78280c4a90 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782814fd30 con 0x7f7828151a90 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782f3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78281ea8c0 con 0x7f78280c4630 2023-08-27T11:29:25.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782c99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782c99a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42776/0 (socket says 172.21.15.43:42776) 2023-08-27T11:29:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782c99a700 1 -- 172.21.15.43:0/3148915861 learned_addr learned my addr 172.21.15.43:0/3148915861 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782d19b700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78280c4630 0x7f78280c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.774+0000 7f782d99c700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828151a90 0x7f78281523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 -- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78280c4630 msgr2=0x7f78280c0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78280c4630 0x7f78280c0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 -- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828151a90 msgr2=0x7f78281523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828151a90 0x7f78281523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 -- 172.21.15.43:0/3148915861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820009a70 con 0x7f78280c4a90 2023-08-27T11:29:25.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782c99a700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f781800c730 tx=0x7f781800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818005d70 con 0x7f78280c4a90 2023-08-27T11:29:25.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78180070d0 con 0x7f78280c4a90 2023-08-27T11:29:25.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818007460 con 0x7f78280c4a90 2023-08-27T11:29:25.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240094a0 con 0x7f78280c4a90 2023-08-27T11:29:25.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.775+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782814ff30 con 0x7f78280c4a90 2023-08-27T11:29:25.784 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.776+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782804ee70 con 0x7f78280c4a90 2023-08-27T11:29:25.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.777+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f78180075c0 con 0x7f78280c4a90 2023-08-27T11:29:25.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.779+0000 7f781dffb700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 0x7f780c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:25.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.779+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7818087870 con 0x7f78280c4a90 2023-08-27T11:29:25.785 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.779+0000 7f782d19b700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 0x7f780c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:25.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.780+0000 7f782d19b700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 0x7f780c06c5a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7824000c00 tx=0x7f7824008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:25.786 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:25.783+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7818053110 con 0x7f78280c4a90 2023-08-27T11:29:26.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.071+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla"]} v 0) v1 -- 0x7f782806c130 con 0x7f78280c4a90 2023-08-27T11:29:26.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.166+0000 7f781dffb700 1 -- 172.21.15.43:0/3148915861 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_failover.TestClusterAffinity.test_join_fs_vanilla"]}]=0 v390) v1 ==== 146+0+0 (secure 0 0 0) 0x7f7818056730 con 0x7f78280c4a90 2023-08-27T11:29:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 msgr2=0x7f780c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 0x7f780c06c5a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7824000c00 tx=0x7f7824008030 comp rx=0 tx=0).stop 2023-08-27T11:29:26.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 msgr2=0x7f78280c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f781800c730 tx=0x7f781800ca40 comp rx=0 tx=0).stop 2023-08-27T11:29:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 shutdown_connections 2023-08-27T11:29:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f780c06a0e0 0x7f780c06c5a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7828151a90 0x7f78281523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78280c4630 0x7f78280c0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 --2- 172.21.15.43:0/3148915861 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f78280c4a90 0x7f78280c88d0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 >> 172.21.15.43:0/3148915861 conn(0x7f78280ab820 msgr2=0x7f7828150980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 shutdown_connections 2023-08-27T11:29:26.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.169+0000 7f782f3ff700 1 -- 172.21.15.43:0/3148915861 wait complete. 2023-08-27T11:29:26.189 INFO:tasks.cephfs_test_runner:That a vanilla standby is preferred over others with mds_join_fs set to another fs. ... ok 2023-08-27T11:29:26.189 INFO:tasks.cephfs_test_runner:Starting test: test_down (tasks.cephfs.test_failover.TestClusterResize) That down setting toggles and sets max_mds appropriately. 2023-08-27T11:29:26.190 INFO:tasks.cephfs_test_runner:test_down (tasks.cephfs.test_failover.TestClusterResize) 2023-08-27T11:29:26.190 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_failover.TestClusterResize.test_down' 2023-08-27T11:29:26.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.392+0000 7f02ab3ff700 1 Processor -- start 2023-08-27T11:29:26.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.392+0000 7f02ab3ff700 1 -- start start 2023-08-27T11:29:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 0x7f02a40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02a40c4630 0x7f02a40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02a406ad70 0x7f02a406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.395 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a406c4e0 con 0x7f02a40c4630 2023-08-27T11:29:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a4155370 con 0x7f02a406ad70 2023-08-27T11:29:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02ab3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4151e70 con 0x7f02a4151a90 2023-08-27T11:29:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02a899a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02a40c4630 0x7f02a40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02a899a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f02a40c4630 0x7f02a40c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42786/0 (socket says 172.21.15.43:42786) 2023-08-27T11:29:26.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02a899a700 1 -- 172.21.15.43:0/3262672694 learned_addr learned my addr 172.21.15.43:0/3262672694 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02a999c700 1 --2- 172.21.15.43:0/3262672694 >> v2:172.21.15.57:3300/0 conn(0x7f02a406ad70 0x7f02a406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.393+0000 7f02a919b700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 0x7f02a40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 -- 172.21.15.43:0/3262672694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 msgr2=0x7f02a40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 0x7f02a40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 -- 172.21.15.43:0/3262672694 >> v2:172.21.15.57:3300/0 conn(0x7f02a406ad70 msgr2=0x7f02a406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:26.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 --2- 172.21.15.43:0/3262672694 >> v2:172.21.15.57:3300/0 conn(0x7f02a406ad70 0x7f02a406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 -- 172.21.15.43:0/3262672694 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4154480 con 0x7f02a40c4630 2023-08-27T11:29:26.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a919b700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 0x7f02a40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:26.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f02a899a700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a40c4630 0x7f02a40c4a90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f02a40bd700 tx=0x7f0294009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c397a3e9230d13 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f029bfff700 1 -- 172.21.15.43:0/3262672694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011830 con 0x7f02a40c4630 2023-08-27T11:29:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f029bfff700 1 -- 172.21.15.43:0/3262672694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294011990 con 0x7f02a40c4630 2023-08-27T11:29:26.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.394+0000 7f029bfff700 1 -- 172.21.15.43:0/3262672694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294011d20 con 0x7f02a40c4630 2023-08-27T11:29:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 -- 172.21.15.43:0/3262672694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a40c4630 msgr2=0x7f02a40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a40c4630 0x7f02a40c4a90 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f02a40bd700 tx=0x7f0294009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 -- 172.21.15.43:0/3262672694 shutdown_connections 2023-08-27T11:29:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/3262672694 >> v2:172.21.15.57:3300/0 conn(0x7f02a406ad70 0x7f02a406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a4151a90 0x7f02a40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/3262672694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a40c4630 0x7f02a40c4a90 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 -- 172.21.15.43:0/3262672694 >> 172.21.15.43:0/3262672694 conn(0x7f02a40ab820 msgr2=0x7f02a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 -- 172.21.15.43:0/3262672694 shutdown_connections 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.395+0000 7f02ab3ff700 1 -- 172.21.15.43:0/3262672694 wait complete. 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.397+0000 7f02ab3ff700 1 Processor -- start 2023-08-27T11:29:26.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.397+0000 7f02ab3ff700 1 -- start start 2023-08-27T11:29:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 0x7f02a41557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a40c4630 0x7f02a4146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40ab1c0 con 0x7f02a4151a90 2023-08-27T11:29:26.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4158030 con 0x7f02a406ad70 2023-08-27T11:29:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02ab3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40ab410 con 0x7f02a40c4630 2023-08-27T11:29:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42792/0 (socket says 172.21.15.43:42792) 2023-08-27T11:29:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 -- 172.21.15.43:0/1884566792 learned_addr learned my addr 172.21.15.43:0/1884566792 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:26.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a919b700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 0x7f02a41557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a899a700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a40c4630 0x7f02a4146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 -- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a40c4630 msgr2=0x7f02a4146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a40c4630 0x7f02a4146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 -- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 msgr2=0x7f02a41557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:26.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 0x7f02a41557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a999c700 1 -- 172.21.15.43:0/1884566792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009550 con 0x7f02a4151a90 2023-08-27T11:29:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.398+0000 7f02a919b700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 0x7f02a41557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f02a999c700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f029c00eed0 tx=0x7f029c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c010040 con 0x7f02a4151a90 2023-08-27T11:29:26.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c00bd30 con 0x7f02a4151a90 2023-08-27T11:29:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a40aaf10 con 0x7f02a4151a90 2023-08-27T11:29:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029c009ea0 con 0x7f02a4151a90 2023-08-27T11:29:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.399+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a4155d20 con 0x7f02a4151a90 2023-08-27T11:29:26.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.400+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4072450 con 0x7f02a4151a90 2023-08-27T11:29:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.401+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f029c014640 con 0x7f02a4151a90 2023-08-27T11:29:26.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.402+0000 7f0299ffb700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 0x7f028806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.402+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f029c088ae0 con 0x7f02a4151a90 2023-08-27T11:29:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.402+0000 7f02a919b700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 0x7f028806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.403+0000 7f02a919b700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 0x7f028806c5a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009820 tx=0x7f02a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:26.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.407+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f029c054380 con 0x7f02a4151a90 2023-08-27T11:29:26.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:26.697+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterResize.test_down"]} v 0) v1 -- 0x7f02a40ab5d0 con 0x7f02a4151a90 2023-08-27T11:29:27.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.173+0000 7f0299ffb700 1 -- 172.21.15.43:0/1884566792 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_failover.TestClusterResize.test_down"]}]=0 v391) v1 ==== 136+0+0 (secure 0 0 0) 0x7f029c0579a0 con 0x7f02a4151a90 2023-08-27T11:29:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 msgr2=0x7f028806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 0x7f028806c5a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009820 tx=0x7f02a0008040 comp rx=0 tx=0).stop 2023-08-27T11:29:27.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 msgr2=0x7f02a4157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f029c00eed0 tx=0x7f029c00b390 comp rx=0 tx=0).stop 2023-08-27T11:29:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 shutdown_connections 2023-08-27T11:29:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f028806a0e0 0x7f028806c5a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f02a4151a90 0x7f02a4157340 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a406ad70 0x7f02a41557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.176+0000 7f02ab3ff700 1 --2- 172.21.15.43:0/1884566792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f02a40c4630 0x7f02a4146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.177+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 >> 172.21.15.43:0/1884566792 conn(0x7f02a40ab820 msgr2=0x7f02a406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.177+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 shutdown_connections 2023-08-27T11:29:27.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.177+0000 7f02ab3ff700 1 -- 172.21.15.43:0/1884566792 wait complete. 2023-08-27T11:29:27.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:27.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.401+0000 7f979c9ff700 1 Processor -- start 2023-08-27T11:29:27.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.401+0000 7f979c9ff700 1 -- start start 2023-08-27T11:29:27.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f97980c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979c9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f979806ad70 0x7f979806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979c9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979806c4e0 con 0x7f9798151a90 2023-08-27T11:29:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979c9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9798155370 con 0x7f979806ad70 2023-08-27T11:29:27.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c82c0 con 0x7f97980c4630 2023-08-27T11:29:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979659c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9798151a90 0x7f97980c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42110/0 (socket says 172.21.15.43:42110) 2023-08-27T11:29:27.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.402+0000 7f979659c700 1 -- 172.21.15.43:0/2361551063 learned_addr learned my addr 172.21.15.43:0/2361551063 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:27.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f9796d9d700 1 --2- 172.21.15.43:0/2361551063 >> v2:172.21.15.57:3300/0 conn(0x7f979806ad70 0x7f979806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062417309 0 0) 0x7f979806c4e0 con 0x7f9798151a90 2023-08-27T11:29:27.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97800035b0 con 0x7f9798151a90 2023-08-27T11:29:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f9795d9b700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f97980c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260002594 0 0) 0x7f97800035b0 con 0x7f9798151a90 2023-08-27T11:29:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 msgr2=0x7f97980c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:27.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f97980c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 >> v2:172.21.15.57:3300/0 conn(0x7f979806ad70 msgr2=0x7f979806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 --2- 172.21.15.43:0/2361551063 >> v2:172.21.15.57:3300/0 conn(0x7f979806ad70 0x7f979806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798151e70 con 0x7f9798151a90 2023-08-27T11:29:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f9788001670 con 0x7f9798151a90 2023-08-27T11:29:27.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 >> v1:172.21.15.43:6789/0 conn(0x7f9798151a90 legacy=0x7f97980c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9780003a00 0x7f9780003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9780004850 0x7f9780004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f9780005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798155370 con 0x7f9780004850 2023-08-27T11:29:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c82c0 con 0x7f9780003a00 2023-08-27T11:29:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.403+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978000ba10 con 0x7f97980c4630 2023-08-27T11:29:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9780004850 0x7f9780004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f979659c700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9780003a00 0x7f9780003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9796d9d700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f9780005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 -- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 msgr2=0x7f9780005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f9780005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 -- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9780003a00 msgr2=0x7f9780003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:27.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9780003a00 0x7f9780003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 -- 172.21.15.43:0/2361551063 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800035b0 con 0x7f9780004850 2023-08-27T11:29:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9796d9d700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97980c4630 0x7f9780005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f979659c700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9780003a00 0x7f9780003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.404+0000 7f9795d9b700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9780004850 0x7f9780004cd0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f978c009b90 tx=0x7f9780005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8b657ff33c3902 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00e6c0 con 0x7f9780004850 2023-08-27T11:29:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c00e820 con 0x7f9780004850 2023-08-27T11:29:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979559a700 1 -- 172.21.15.43:0/2361551063 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00eb90 con 0x7f9780004850 2023-08-27T11:29:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 -- 172.21.15.43:0/2361551063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9780004850 msgr2=0x7f9780004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 --2- 172.21.15.43:0/2361551063 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f9780004850 0x7f9780004cd0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f978c009b90 tx=0x7f9780005880 comp rx=0 tx=0).stop 2023-08-27T11:29:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f9796d9d700 1 -- 172.21.15.43:0/2361551063 reap_dead start 2023-08-27T11:29:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 -- 172.21.15.43:0/2361551063 shutdown_connections 2023-08-27T11:29:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 -- 172.21.15.43:0/2361551063 >> 172.21.15.43:0/2361551063 conn(0x7f97980ab820 msgr2=0x7f97980abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 -- 172.21.15.43:0/2361551063 shutdown_connections 2023-08-27T11:29:27.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.405+0000 7f979c9ff700 1 -- 172.21.15.43:0/2361551063 wait complete. 2023-08-27T11:29:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.407+0000 7f979c9ff700 1 Processor -- start 2023-08-27T11:29:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.407+0000 7f979c9ff700 1 -- start start 2023-08-27T11:29:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 0x7f9798150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97980a9610 0x7f97981ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97981ed100 con 0x7f97981eda60 2023-08-27T11:29:27.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979814cbf0 con 0x7f97980a9610 2023-08-27T11:29:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979c9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97981ecdb0 con 0x7f9780004850 2023-08-27T11:29:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f9796d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f9796d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42804/0 (socket says 172.21.15.43:42804) 2023-08-27T11:29:27.421 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f9796d9d700 1 -- 172.21.15.43:0/3252598529 learned_addr learned my addr 172.21.15.43:0/3252598529 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f979659c700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 0x7f9798150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.408+0000 7f9795d9b700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97980a9610 0x7f97981ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 -- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 msgr2=0x7f9798150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.422 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 0x7f9798150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 -- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97980a9610 msgr2=0x7f97981ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97980a9610 0x7f97981ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 -- 172.21.15.43:0/3252598529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979814dcb0 con 0x7f97981eda60 2023-08-27T11:29:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f979659c700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 0x7f9798150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:27.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9796d9d700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f97980ac390 tx=0x7f97900104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000e050 con 0x7f97981eda60 2023-08-27T11:29:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979000f040 con 0x7f97981eda60 2023-08-27T11:29:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790010e50 con 0x7f97981eda60 2023-08-27T11:29:27.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979814df90 con 0x7f97981eda60 2023-08-27T11:29:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.409+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798150ac0 con 0x7f97981eda60 2023-08-27T11:29:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.411+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97981ed240 con 0x7f97981eda60 2023-08-27T11:29:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.411+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9790015440 con 0x7f97981eda60 2023-08-27T11:29:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.412+0000 7f9786ffd700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 0x7f977806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.425 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.412+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f97900888c0 con 0x7f97981eda60 2023-08-27T11:29:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.412+0000 7f979659c700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 0x7f977806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.413+0000 7f979659c700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 0x7f977806c5a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9788001eb0 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.416+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f97981ed240 con 0x7f97981eda60 2023-08-27T11:29:27.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.630+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97981ed240 con 0x7f97981eda60 2023-08-27T11:29:27.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.631+0000 7f9786ffd700 1 -- 172.21.15.43:0/3252598529 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14920 (secure 0 0 0) 0x7f97981ed240 con 0x7f97981eda60 2023-08-27T11:29:27.632 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:27.632 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":135,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:24.147245+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.43:6836/1923359880":"2023-08-28T11:29:21.132967+0000","172.21.15.43:6837/1923359880":"2023-08-28T11:29:21.132967+0000","172.21.15.57:6834/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6832/3257371578":"2023-08-28T11:29:12.933398+0000","172.21.15.57:6835/2179580288":"2023-08-28T11:29:00.535646+0000","172.21.15.57:6833/2179580288":"2023-08-28T11:29:00.535646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:27.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 msgr2=0x7f977806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 0x7f977806c5a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9788001eb0 tx=0x7f9788009040 comp rx=0 tx=0).stop 2023-08-27T11:29:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 msgr2=0x7f97980a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f97980ac390 tx=0x7f97900104a0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 shutdown_connections 2023-08-27T11:29:27.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f977806a0e0 0x7f977806c5a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97981eda60 0x7f97980a9db0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9780004850 0x7f9798150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 --2- 172.21.15.43:0/3252598529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97980a9610 0x7f97981ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 >> 172.21.15.43:0/3252598529 conn(0x7f97980ab820 msgr2=0x7f979814f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:27.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 shutdown_connections 2023-08-27T11:29:27.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.633+0000 7f979c9ff700 1 -- 172.21.15.43:0/3252598529 wait complete. 2023-08-27T11:29:27.652 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:29:27.653 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:29:27.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.855+0000 7f4257fff700 1 Processor -- start 2023-08-27T11:29:27.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.855+0000 7f4257fff700 1 -- start start 2023-08-27T11:29:27.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f4257fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4250151fc0 0x7f4250158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f4257fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f42500708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f4257fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4250157af0 con 0x7f42500c0020 2023-08-27T11:29:27.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f4257fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4250071e10 con 0x7f4250151fc0 2023-08-27T11:29:27.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f4257fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4250158a80 con 0x7f4250071f70 2023-08-27T11:29:27.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4250151fc0 0x7f4250158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4250151fc0 0x7f4250158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42820/0 (socket says 172.21.15.43:42820) 2023-08-27T11:29:27.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 -- 172.21.15.43:0/2675166394 learned_addr learned my addr 172.21.15.43:0/2675166394 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:27.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425659c700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f42500708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 -- 172.21.15.43:0/2675166394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 msgr2=0x7f42500708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:27.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f42500708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 -- 172.21.15.43:0/2675166394 >> v1:172.21.15.57:6789/0 conn(0x7f42500c0020 legacy=0x7f42501518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425559a700 1 -- 172.21.15.43:0/2675166394 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500a6040 con 0x7f4250151fc0 2023-08-27T11:29:27.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.857+0000 7f425659c700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f42500708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:27.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.858+0000 7f425559a700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4250151fc0 0x7f4250158540 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f42400098f0 tx=0x7f4240009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b59a8e8c95c793f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.858+0000 7f4254d99700 1 -- 172.21.15.43:0/2675166394 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000b8a0 con 0x7f4250151fc0 2023-08-27T11:29:27.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.858+0000 7f4254d99700 1 -- 172.21.15.43:0/2675166394 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000ba00 con 0x7f4250151fc0 2023-08-27T11:29:27.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.858+0000 7f4254d99700 1 -- 172.21.15.43:0/2675166394 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000bd90 con 0x7f4250151fc0 2023-08-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 -- 172.21.15.43:0/2675166394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4250151fc0 msgr2=0x7f4250158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4250151fc0 0x7f4250158540 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f42400098f0 tx=0x7f4240009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 -- 172.21.15.43:0/2675166394 shutdown_connections 2023-08-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f42500708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 --2- 172.21.15.43:0/2675166394 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4250151fc0 0x7f4250158540 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 -- 172.21.15.43:0/2675166394 >> 172.21.15.43:0/2675166394 conn(0x7f42500c6a40 msgr2=0x7f42500c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:27.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 -- 172.21.15.43:0/2675166394 shutdown_connections 2023-08-27T11:29:27.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.859+0000 7f4257fff700 1 -- 172.21.15.43:0/2675166394 wait complete. 2023-08-27T11:29:27.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.860+0000 7f4257fff700 1 Processor -- start 2023-08-27T11:29:27.867 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.861+0000 7f4257fff700 1 -- start start 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f425014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 0x7f42501ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4250154e40 con 0x7f42500c0020 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500c2fe0 con 0x7f4250151fc0 2023-08-27T11:29:27.868 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4257fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4250154530 con 0x7f4250071f70 2023-08-27T11:29:27.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42824/0 (socket says 172.21.15.43:42824) 2023-08-27T11:29:27.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 -- 172.21.15.43:0/1042003507 learned_addr learned my addr 172.21.15.43:0/1042003507 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:27.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4255d9b700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f425014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.869 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 -- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 msgr2=0x7f425014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f425014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 -- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 msgr2=0x7f42501ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:27.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425659c700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 0x7f42501ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 0x7f42501ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:27.870 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425559a700 1 -- 172.21.15.43:0/1042003507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009550 con 0x7f42500c0020 2023-08-27T11:29:27.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f4255d9b700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f425014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:27.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.862+0000 7f425659c700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 0x7f42501ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:27.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f425559a700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f4240013000 tx=0x7f4240004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240004400 con 0x7f42500c0020 2023-08-27T11:29:27.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424001f070 con 0x7f42500c0020 2023-08-27T11:29:27.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425014e6e0 con 0x7f42500c0020 2023-08-27T11:29:27.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400038c0 con 0x7f42500c0020 2023-08-27T11:29:27.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.863+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4250154780 con 0x7f42500c0020 2023-08-27T11:29:27.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.864+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42500c4af0 con 0x7f42500c0020 2023-08-27T11:29:27.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.865+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4240021030 con 0x7f42500c0020 2023-08-27T11:29:27.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.866+0000 7f42467fc700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 0x7f423406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:27.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.866+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f4240089790 con 0x7f42500c0020 2023-08-27T11:29:27.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.866+0000 7f4255d9b700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 0x7f423406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:27.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.867+0000 7f4255d9b700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 0x7f423406c5a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f424c000f60 tx=0x7f424c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:27.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:27.870+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f42400550c0 con 0x7f42500c0020 2023-08-27T11:29:28.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.082+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4250154f80 con 0x7f42500c0020 2023-08-27T11:29:28.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.083+0000 7f42467fc700 1 -- 172.21.15.43:0/1042003507 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4250154f80 con 0x7f42500c0020 2023-08-27T11:29:28.084 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:29:28.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 msgr2=0x7f423406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 0x7f423406c5a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f424c000f60 tx=0x7f424c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 msgr2=0x7f42501527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f4240013000 tx=0x7f4240004750 comp rx=0 tx=0).stop 2023-08-27T11:29:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 shutdown_connections 2023-08-27T11:29:28.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f423406a0e0 0x7f423406c5a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4250151fc0 0x7f42501ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4250071f70 0x7f425014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 --2- 172.21.15.43:0/1042003507 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f42500c0020 0x7f42501527e0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 >> 172.21.15.43:0/1042003507 conn(0x7f42500c6a40 msgr2=0x7f42500c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 shutdown_connections 2023-08-27T11:29:28.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.085+0000 7f4257fff700 1 -- 172.21.15.43:0/1042003507 wait complete. 2023-08-27T11:29:28.104 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:29:28.308 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.307+0000 7f1bc59ff700 1 Processor -- start 2023-08-27T11:29:28.309 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.308+0000 7f1bc59ff700 1 -- start start 2023-08-27T11:29:28.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bc59ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1bc00c5230 0x7f1bc006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bc59ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1bc0155880 0x7f1bc0155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bc59ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc01561a0 con 0x7f1bc006c5e0 2023-08-27T11:29:28.311 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bc59ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc0152290 con 0x7f1bc0155880 2023-08-27T11:29:28.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bc59ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc006d7a0 con 0x7f1bc00c5230 2023-08-27T11:29:28.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bbf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1bc0155880 0x7f1bc0155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bbf7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1bc0155880 0x7f1bc0155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42832/0 (socket says 172.21.15.43:42832) 2023-08-27T11:29:28.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bbf7fe700 1 -- 172.21.15.43:0/3662807200 learned_addr learned my addr 172.21.15.43:0/3662807200 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:28.312 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.309+0000 7f1bbeffd700 1 --2- 172.21.15.43:0/3662807200 >> v2:172.21.15.57:3300/0 conn(0x7f1bc00c5230 0x7f1bc006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbf7fe700 1 -- 172.21.15.43:0/3662807200 >> v2:172.21.15.57:3300/0 conn(0x7f1bc00c5230 msgr2=0x7f1bc006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:28.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbf7fe700 1 --2- 172.21.15.43:0/3662807200 >> v2:172.21.15.57:3300/0 conn(0x7f1bc00c5230 0x7f1bc006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbf7fe700 1 -- 172.21.15.43:0/3662807200 >> v1:172.21.15.57:6789/0 conn(0x7f1bc006c5e0 legacy=0x7f1bc00aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbf7fe700 1 -- 172.21.15.43:0/3662807200 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0152550 con 0x7f1bc0155880 2023-08-27T11:29:28.313 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbf7fe700 1 --2- 172.21.15.43:0/3662807200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc0155880 0x7f1bc0155c60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1bc006ced0 tx=0x7f1bb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb81d547a3ae4c57 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbdffb700 1 -- 172.21.15.43:0/3662807200 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800e070 con 0x7f1bc0155880 2023-08-27T11:29:28.316 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbdffb700 1 -- 172.21.15.43:0/3662807200 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800b910 con 0x7f1bc0155880 2023-08-27T11:29:28.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.310+0000 7f1bbdffb700 1 -- 172.21.15.43:0/3662807200 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800bcc0 con 0x7f1bc0155880 2023-08-27T11:29:28.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 -- 172.21.15.43:0/3662807200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc0155880 msgr2=0x7f1bc0155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/3662807200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc0155880 0x7f1bc0155c60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1bc006ced0 tx=0x7f1bb800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:28.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 -- 172.21.15.43:0/3662807200 shutdown_connections 2023-08-27T11:29:28.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/3662807200 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc0155880 0x7f1bc0155c60 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/3662807200 >> v2:172.21.15.57:3300/0 conn(0x7f1bc00c5230 0x7f1bc006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 -- 172.21.15.43:0/3662807200 >> 172.21.15.43:0/3662807200 conn(0x7f1bc00c5b10 msgr2=0x7f1bc00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:28.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 -- 172.21.15.43:0/3662807200 shutdown_connections 2023-08-27T11:29:28.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.311+0000 7f1bc59ff700 1 -- 172.21.15.43:0/3662807200 wait complete. 2023-08-27T11:29:28.318 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.312+0000 7f1bc59ff700 1 Processor -- start 2023-08-27T11:29:28.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 -- start start 2023-08-27T11:29:28.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1bc006c5e0 0x7f1bc014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bc0155880 0x7f1bc00717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.319 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc014da80 con 0x7f1bc00c5230 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0151c00 con 0x7f1bc0155880 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.313+0000 7f1bc59ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01e9ff0 con 0x7f1bc006c5e0 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42848/0 (socket says 172.21.15.43:42848) 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 -- 172.21.15.43:0/2539676369 learned_addr learned my addr 172.21.15.43:0/2539676369 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:28.320 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbf7fe700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bc0155880 0x7f1bc00717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbeffd700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1bc006c5e0 0x7f1bc014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 -- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1bc006c5e0 msgr2=0x7f1bc014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1bc006c5e0 0x7f1bc014efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.321 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 -- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bc0155880 msgr2=0x7f1bc00717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bc0155880 0x7f1bc00717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.314+0000 7f1bbe7fc700 1 -- 172.21.15.43:0/2539676369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb8009b30 con 0x7f1bc00c5230 2023-08-27T11:29:28.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1bbe7fc700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c4e0 tx=0x7f1bb400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40052d0 con 0x7f1bc00c5230 2023-08-27T11:29:28.322 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4005430 con 0x7f1bc00c5230 2023-08-27T11:29:28.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40038c0 con 0x7f1bc00c5230 2023-08-27T11:29:28.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc01ea2d0 con 0x7f1bc00c5230 2023-08-27T11:29:28.323 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.315+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0151e50 con 0x7f1bc00c5230 2023-08-27T11:29:28.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.316+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc014dea0 con 0x7f1bc00c5230 2023-08-27T11:29:28.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.317+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1bb4003a20 con 0x7f1bc00c5230 2023-08-27T11:29:28.324 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.318+0000 7f1ba7fff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 0x7f1bac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.318+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f1bb4087690 con 0x7f1bc00c5230 2023-08-27T11:29:28.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.318+0000 7f1bbeffd700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 0x7f1bac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.319+0000 7f1bbeffd700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 0x7f1bac06c5a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009be0 tx=0x7f1bb0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.325 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.322+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1bc014dea0 con 0x7f1bc00c5230 2023-08-27T11:29:28.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.530+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bc014dea0 con 0x7f1bc00c5230 2023-08-27T11:29:28.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.530+0000 7f1ba7fff700 1 -- 172.21.15.43:0/2539676369 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v135) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bc014dea0 con 0x7f1bc00c5230 2023-08-27T11:29:28.532 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:29:28.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 msgr2=0x7f1bac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 0x7f1bac06c5a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009be0 tx=0x7f1bb0009210 comp rx=0 tx=0).stop 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 msgr2=0x7f1bc0150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c4e0 tx=0x7f1bb400c7f0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 shutdown_connections 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f1bac06a0e0 0x7f1bac06c5a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bc0155880 0x7f1bc00717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1bc006c5e0 0x7f1bc014efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 --2- 172.21.15.43:0/2539676369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1bc00c5230 0x7f1bc0150ce0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 >> 172.21.15.43:0/2539676369 conn(0x7f1bc00c5b10 msgr2=0x7f1bc00aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:28.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 shutdown_connections 2023-08-27T11:29:28.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.533+0000 7f1bc59ff700 1 -- 172.21.15.43:0/2539676369 wait complete. 2023-08-27T11:29:28.552 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-27T11:29:28.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.756+0000 7f45f51ff700 1 Processor -- start 2023-08-27T11:29:28.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.756+0000 7f45f51ff700 1 -- start start 2023-08-27T11:29:28.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.757+0000 7f45f51ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45f014e780 0x7f45f01512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45f51ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014eb60 0x7f45f00c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45f51ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f00c03e0 con 0x7f45f00c5150 2023-08-27T11:29:28.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45f51ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f0151900 con 0x7f45f014e780 2023-08-27T11:29:28.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45f51ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0151be0 con 0x7f45f014eb60 2023-08-27T11:29:28.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45f014e780 0x7f45f01512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f45f014e780 0x7f45f01512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42862/0 (socket says 172.21.15.43:42862) 2023-08-27T11:29:28.761 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 -- 172.21.15.43:0/4256594848 learned_addr learned my addr 172.21.15.43:0/4256594848 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:28.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45e7fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f45f00c5150 0x7f45f006a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42122/0 (socket says 172.21.15.43:42122) 2023-08-27T11:29:28.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45ef59e700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014eb60 0x7f45f00c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 -- 172.21.15.43:0/4256594848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014eb60 msgr2=0x7f45f00c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:28.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014eb60 0x7f45f00c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 -- 172.21.15.43:0/4256594848 >> v1:172.21.15.43:6789/0 conn(0x7f45f00c5150 legacy=0x7f45f006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45eed9d700 1 -- 172.21.15.43:0/4256594848 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f0151ec0 con 0x7f45f014e780 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.758+0000 7f45ee59c700 1 -- 172.21.15.43:0/4256594848 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289743388 0 0) 0x7f45f00c03e0 con 0x7f45f00c5150 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45eed9d700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014e780 0x7f45f01512b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f45e000bb90 tx=0x7f45e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa78a1ba21e1878 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45ee59c700 1 -- 172.21.15.43:0/4256594848 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000dd50 con 0x7f45f014e780 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45ee59c700 1 -- 172.21.15.43:0/4256594848 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e0010470 con 0x7f45f014e780 2023-08-27T11:29:28.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45ee59c700 1 -- 172.21.15.43:0/4256594848 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0010800 con 0x7f45f014e780 2023-08-27T11:29:28.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45f51ff700 1 -- 172.21.15.43:0/4256594848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014e780 msgr2=0x7f45f01512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45f51ff700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014e780 0x7f45f01512b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f45e000bb90 tx=0x7f45e000bea0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.759+0000 7f45f51ff700 1 -- 172.21.15.43:0/4256594848 shutdown_connections 2023-08-27T11:29:28.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.760+0000 7f45f51ff700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014eb60 0x7f45f00c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.760+0000 7f45f51ff700 1 --2- 172.21.15.43:0/4256594848 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014e780 0x7f45f01512b0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.760+0000 7f45f51ff700 1 -- 172.21.15.43:0/4256594848 >> 172.21.15.43:0/4256594848 conn(0x7f45f00c5b10 msgr2=0x7f45f00c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:28.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.760+0000 7f45f51ff700 1 -- 172.21.15.43:0/4256594848 shutdown_connections 2023-08-27T11:29:28.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.760+0000 7f45f51ff700 1 -- 172.21.15.43:0/4256594848 wait complete. 2023-08-27T11:29:28.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.761+0000 7f45f51ff700 1 Processor -- start 2023-08-27T11:29:28.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 -- start start 2023-08-27T11:29:28.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45f00c5150 0x7f45f00c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014e780 0x7f45f0070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f006fe00 con 0x7f45f014eb60 2023-08-27T11:29:28.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00aaaf0 con 0x7f45f00c5150 2023-08-27T11:29:28.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.762+0000 7f45f51ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00bf350 con 0x7f45f014e780 2023-08-27T11:29:28.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42878/0 (socket says 172.21.15.43:42878) 2023-08-27T11:29:28.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 -- 172.21.15.43:0/3597908268 learned_addr learned my addr 172.21.15.43:0/3597908268 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:28.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45eed9d700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45f00c5150 0x7f45f00c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45e7fff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014e780 0x7f45f0070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 -- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014e780 msgr2=0x7f45f0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014e780 0x7f45f0070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 -- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45f00c5150 msgr2=0x7f45f00c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45f00c5150 0x7f45f00c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 -- 172.21.15.43:0/3597908268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e000b7f0 con 0x7f45f014eb60 2023-08-27T11:29:28.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.763+0000 7f45ef59e700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f45e8007e60 tx=0x7f45e800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.764+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800ede0 con 0x7f45f014eb60 2023-08-27T11:29:28.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.764+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8014420 con 0x7f45f014eb60 2023-08-27T11:29:28.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.764+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00bf630 con 0x7f45f014eb60 2023-08-27T11:29:28.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.764+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80147d0 con 0x7f45f014eb60 2023-08-27T11:29:28.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.764+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f00bfbf0 con 0x7f45f014eb60 2023-08-27T11:29:28.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.765+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0074680 con 0x7f45f014eb60 2023-08-27T11:29:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.766+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45e8014930 con 0x7f45f014eb60 2023-08-27T11:29:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.767+0000 7f45e77fe700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 0x7f45d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.767+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f45e80889c0 con 0x7f45f014eb60 2023-08-27T11:29:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.767+0000 7f45eed9d700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 0x7f45d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:28.774 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.767+0000 7f45eed9d700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 0x7f45d006c5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000c00 tx=0x7f45e001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:28.775 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.771+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f45e80542f0 con 0x7f45f014eb60 2023-08-27T11:29:28.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.982+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f45f004ee70 con 0x7f45f014eb60 2023-08-27T11:29:28.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.987+0000 7f45e77fe700 1 -- 172.21.15.43:0/3597908268 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v49)=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45e8057910 con 0x7f45f014eb60 2023-08-27T11:29:28.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 msgr2=0x7f45d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 0x7f45d006c5a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f45e0000c00 tx=0x7f45e001c040 comp rx=0 tx=0).stop 2023-08-27T11:29:28.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 msgr2=0x7f45f00714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:28.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f45e8007e60 tx=0x7f45e800e3c0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 shutdown_connections 2023-08-27T11:29:28.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f45d006a0e0 0x7f45d006c5a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f45f014eb60 0x7f45f00714c0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45f00c5150 0x7f45f00c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 --2- 172.21.15.43:0/3597908268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f45f014e780 0x7f45f0070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:28.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 >> 172.21.15.43:0/3597908268 conn(0x7f45f00c5b10 msgr2=0x7f45f014dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:28.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 shutdown_connections 2023-08-27T11:29:28.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:28.989+0000 7f45f51ff700 1 -- 172.21.15.43:0/3597908268 wait complete. 2023-08-27T11:29:29.009 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:29:29.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:29:29.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:29:29.213 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:29:29.214 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:29:29.214 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:29:29.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:29:29.258 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:29:29.259 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:29:29.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:29:29.303 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-08-27T11:29:29.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:29.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.503+0000 7f0d389ff700 1 Processor -- start 2023-08-27T11:29:29.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.503+0000 7f0d389ff700 1 -- start start 2023-08-27T11:29:29.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.504+0000 7f0d389ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d340c51a0 0x7f0d3406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.504+0000 7f0d389ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.504+0000 7f0d389ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3406d700 con 0x7f0d340ab040 2023-08-27T11:29:29.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.504+0000 7f0d389ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d341530b0 con 0x7f0d340c51a0 2023-08-27T11:29:29.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.504+0000 7f0d389ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3414c860 con 0x7f0d3406ca60 2023-08-27T11:29:29.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d340c51a0 0x7f0d3406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0d340c51a0 0x7f0d3406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58596/0 (socket says 172.21.15.43:58596) 2023-08-27T11:29:29.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 -- 172.21.15.43:0/162265705 learned_addr learned my addr 172.21.15.43:0/162265705 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:29.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d31d9b700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 -- 172.21.15.43:0/162265705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 msgr2=0x7f0d340aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:29.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 -- 172.21.15.43:0/162265705 >> v1:172.21.15.57:6789/0 conn(0x7f0d340ab040 legacy=0x7f0d34155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:29.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 -- 172.21.15.43:0/162265705 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34152430 con 0x7f0d340c51a0 2023-08-27T11:29:29.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d31d9b700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:29.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.505+0000 7f0d3259c700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340c51a0 0x7f0d3406d1c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009920 tx=0x7f0d24009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff82d707d018cb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:29.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d3159a700 1 -- 172.21.15.43:0/162265705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004230 con 0x7f0d340c51a0 2023-08-27T11:29:29.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d3159a700 1 -- 172.21.15.43:0/162265705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24004390 con 0x7f0d340c51a0 2023-08-27T11:29:29.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d3159a700 1 -- 172.21.15.43:0/162265705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24009e70 con 0x7f0d340c51a0 2023-08-27T11:29:29.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 -- 172.21.15.43:0/162265705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340c51a0 msgr2=0x7f0d3406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:29.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340c51a0 0x7f0d3406d1c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009920 tx=0x7f0d24009c30 comp rx=0 tx=0).stop 2023-08-27T11:29:29.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 -- 172.21.15.43:0/162265705 shutdown_connections 2023-08-27T11:29:29.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340c51a0 0x7f0d3406d1c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 --2- 172.21.15.43:0/162265705 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 -- 172.21.15.43:0/162265705 >> 172.21.15.43:0/162265705 conn(0x7f0d3406aa50 msgr2=0x7f0d340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:29.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 -- 172.21.15.43:0/162265705 shutdown_connections 2023-08-27T11:29:29.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.506+0000 7f0d389ff700 1 -- 172.21.15.43:0/162265705 wait complete. 2023-08-27T11:29:29.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.509+0000 7f0d389ff700 1 Processor -- start 2023-08-27T11:29:29.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.509+0000 7f0d389ff700 1 -- start start 2023-08-27T11:29:29.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d340c51a0 0x7f0d340aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340bcc10 con 0x7f0d340ab040 2023-08-27T11:29:29.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340a82d0 con 0x7f0d340c51a0 2023-08-27T11:29:29.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d389ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340bd8e0 con 0x7f0d3406ca60 2023-08-27T11:29:29.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.510+0000 7f0d31d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d3259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58606/0 (socket says 172.21.15.43:58606) 2023-08-27T11:29:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 -- 172.21.15.43:0/1566062564 learned_addr learned my addr 172.21.15.43:0/1566062564 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d32d9d700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d340c51a0 0x7f0d340aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 -- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 msgr2=0x7f0d340a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 -- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d340c51a0 msgr2=0x7f0d340aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d340c51a0 0x7f0d340aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 -- 172.21.15.43:0/1566062564 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009550 con 0x7f0d340ab040 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d31d9b700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c750 tx=0x7f0d2800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:29.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28011800 con 0x7f0d340ab040 2023-08-27T11:29:29.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d28011960 con 0x7f0d340ab040 2023-08-27T11:29:29.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.511+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28011cd0 con 0x7f0d340ab040 2023-08-27T11:29:29.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.512+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340a9020 con 0x7f0d340ab040 2023-08-27T11:29:29.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.512+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340a95e0 con 0x7f0d340ab040 2023-08-27T11:29:29.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.513+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3404ee70 con 0x7f0d340ab040 2023-08-27T11:29:29.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.514+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d28021350 con 0x7f0d340ab040 2023-08-27T11:29:29.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.515+0000 7f0d22ffd700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 0x7f0d1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:29.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.515+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0d28088140 con 0x7f0d340ab040 2023-08-27T11:29:29.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.515+0000 7f0d3259c700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 0x7f0d1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:29.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.515+0000 7f0d3259c700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 0x7f0d1406c5a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009130 tx=0x7f0d24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:29.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.519+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d28057500 con 0x7f0d340ab040 2023-08-27T11:29:29.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.771+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d340ba760 con 0x7f0d340ab040 2023-08-27T11:29:29.773 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.771+0000 7f0d22ffd700 1 -- 172.21.15.43:0/1566062564 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+3701 (secure 0 0 0) 0x7f0d2801ee90 con 0x7f0d340ab040 2023-08-27T11:29:29.773 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:29.773 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":144,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":9,"addr":"172.21.15.43:6835/1663361937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":1663361937},{"type":"v1","addr":"172.21.15.43:6835","nonce":1663361937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":144},{"gid":7888,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3253544091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3253544091},{"type":"v1","addr":"172.21.15.57:6835","nonce":3253544091}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":138},{"gid":8014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2299425020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2299425020},{"type":"v1","addr":"172.21.15.57:6834","nonce":2299425020}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":142},{"gid":8661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/569558215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6836","nonce":569558215},{"type":"v1","addr":"172.21.15.43:6837","nonce":569558215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":144}],"filesystems":[]} 2023-08-27T11:29:29.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 msgr2=0x7f0d1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:29.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 0x7f0d1406c5a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009130 tx=0x7f0d24008030 comp rx=0 tx=0).stop 2023-08-27T11:29:29.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 msgr2=0x7f0d34155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:29.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c750 tx=0x7f0d2800ca60 comp rx=0 tx=0).stop 2023-08-27T11:29:29.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 shutdown_connections 2023-08-27T11:29:29.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0d1406a0e0 0x7f0d1406c5a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d340c51a0 0x7f0d340aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d3406ca60 0x7f0d340a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 --2- 172.21.15.43:0/1566062564 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0d340ab040 0x7f0d34155030 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:29.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 >> 172.21.15.43:0/1566062564 conn(0x7f0d3406aa50 msgr2=0x7f0d340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:29.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 shutdown_connections 2023-08-27T11:29:29.778 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:29.774+0000 7f0d389ff700 1 -- 172.21.15.43:0/1566062564 wait complete. 2023-08-27T11:29:29.778 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 144 2023-08-27T11:29:29.794 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-27T11:29:29.794 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-27T11:29:29.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-27T11:29:29.795 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:29:29.795 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-27T11:29:29.795 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-27T11:29:29.796 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-27T11:29:29.796 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:29:29.796 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-27T11:29:29.797 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-27T11:29:29.797 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-27T11:29:29.797 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:29:29.797 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-27T11:29:29.798 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-27T11:29:29.798 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-27T11:29:29.798 INFO:teuthology.orchestra.run:waiting for 300 2023-08-27T11:29:29.808 INFO:tasks.ceph.mds.a:Stopped 2023-08-27T11:29:29.809 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-27T11:29:29.810 INFO:tasks.ceph.mds.c:Stopped 2023-08-27T11:29:29.810 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-27T11:29:29.814 INFO:tasks.ceph.mds.b:Stopped 2023-08-27T11:29:29.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-27T11:29:29.815 INFO:tasks.ceph.mds.d:Stopped 2023-08-27T11:29:29.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-27T11:29:29.854 INFO:tasks.ceph.mds.a:Started 2023-08-27T11:29:29.854 DEBUG:teuthology.parallel:result is None 2023-08-27T11:29:29.856 INFO:tasks.ceph.mds.c:Started 2023-08-27T11:29:29.857 DEBUG:teuthology.parallel:result is None 2023-08-27T11:29:29.858 INFO:tasks.ceph.mds.b:Started 2023-08-27T11:29:29.859 DEBUG:teuthology.parallel:result is None 2023-08-27T11:29:29.861 INFO:tasks.ceph.mds.d:Started 2023-08-27T11:29:29.862 DEBUG:teuthology.parallel:result is None 2023-08-27T11:29:29.862 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-27T11:29:30.009 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2023-08-27T11:29:30.010 INFO:tasks.ceph.mds.c.smithi043.stdout:starting mds.c at 2023-08-27T11:29:30.015 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:29:30.015 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:29:30.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.072+0000 7f7d1a1ff700 1 Processor -- start 2023-08-27T11:29:30.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.072+0000 7f7d1a1ff700 1 -- start start 2023-08-27T11:29:30.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d1a1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d140c15e0 0x7f7d1415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:30.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d1a1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140c5ae0 con 0x7f7d140c51a0 2023-08-27T11:29:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d1a1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d140c1190 con 0x7f7d14151910 2023-08-27T11:29:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d1a1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d14072900 con 0x7f7d140c15e0 2023-08-27T11:29:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d12ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7d140c51a0 0x7f7d140c5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36556/0 (socket says 172.21.15.43:36556) 2023-08-27T11:29:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d12ffd700 1 -- 172.21.15.43:0/1584356649 learned_addr learned my addr 172.21.15.43:0/1584356649 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:30.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.073+0000 7f7d13fff700 1 --2- 172.21.15.43:0/1584356649 >> v2:172.21.15.57:3300/0 conn(0x7f7d140c15e0 0x7f7d1415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:30.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d127fc700 1 -- 172.21.15.43:0/1584356649 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509050528 0 0) 0x7f7d140c5ae0 con 0x7f7d140c51a0 2023-08-27T11:29:30.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d127fc700 1 -- 172.21.15.43:0/1584356649 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cfc0035b0 con 0x7f7d140c51a0 2023-08-27T11:29:30.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d13fff700 1 -- 172.21.15.43:0/1584356649 >> v1:172.21.15.57:6789/0 conn(0x7f7d14151910 legacy=0x7f7d14157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:30.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d13fff700 1 -- 172.21.15.43:0/1584356649 >> v1:172.21.15.43:6789/0 conn(0x7f7d140c51a0 legacy=0x7f7d140c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:30.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d13fff700 1 -- 172.21.15.43:0/1584356649 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d140c6c00 con 0x7f7d140c15e0 2023-08-27T11:29:30.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d13fff700 1 --2- 172.21.15.43:0/1584356649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d1415fda0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009d90 tx=0x7f7d0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba13271b96cbf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:30.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d127fc700 1 -- 172.21.15.43:0/1584356649 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00e070 con 0x7f7d140c15e0 2023-08-27T11:29:30.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d127fc700 1 -- 172.21.15.43:0/1584356649 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c00bb20 con 0x7f7d140c15e0 2023-08-27T11:29:30.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.074+0000 7f7d127fc700 1 -- 172.21.15.43:0/1584356649 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c012430 con 0x7f7d140c15e0 2023-08-27T11:29:30.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/1584356649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 msgr2=0x7f7d1415fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:30.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/1584356649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d1415fda0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c009d90 tx=0x7f7d0c00b330 comp rx=0 tx=0).stop 2023-08-27T11:29:30.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/1584356649 shutdown_connections 2023-08-27T11:29:30.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/1584356649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d1415fda0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:30.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/1584356649 >> 172.21.15.43:0/1584356649 conn(0x7f7d140a9740 msgr2=0x7f7d140a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:30.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/1584356649 shutdown_connections 2023-08-27T11:29:30.080 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.075+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/1584356649 wait complete. 2023-08-27T11:29:30.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.077+0000 7f7d1a1ff700 1 Processor -- start 2023-08-27T11:29:30.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.078+0000 7f7d1a1ff700 1 -- start start 2023-08-27T11:29:30.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d140aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:30.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d140c51a0 0x7f7d14154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:30.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:30.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406d640 con 0x7f7d14151910 2023-08-27T11:29:30.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141515a0 con 0x7f7d140c15e0 2023-08-27T11:29:30.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d1a1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140ad090 con 0x7f7d140c51a0 2023-08-27T11:29:30.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:30.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58676/0 (socket says 172.21.15.43:58676) 2023-08-27T11:29:30.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 -- 172.21.15.43:0/2931379927 learned_addr learned my addr 172.21.15.43:0/2931379927 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:30.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d137fe700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d140aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:30.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d12ffd700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d140c51a0 0x7f7d14154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 -- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d140c51a0 msgr2=0x7f7d14154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d140c51a0 0x7f7d14154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 -- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 msgr2=0x7f7d140aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d140aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:30.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.079+0000 7f7d13fff700 1 -- 172.21.15.43:0/2931379927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c009a70 con 0x7f7d14151910 2023-08-27T11:29:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7d13fff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c013000 tx=0x7f7d0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c012430 con 0x7f7d14151910 2023-08-27T11:29:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0c020070 con 0x7f7d14151910 2023-08-27T11:29:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004280 con 0x7f7d14151910 2023-08-27T11:29:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d140ab1d0 con 0x7f7d14151910 2023-08-27T11:29:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.080+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d140ab790 con 0x7f7d14151910 2023-08-27T11:29:30.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.081+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1404ee70 con 0x7f7d14151910 2023-08-27T11:29:30.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.082+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7d0c0043e0 con 0x7f7d14151910 2023-08-27T11:29:30.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.083+0000 7f7cfbfff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 0x7f7d0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:30.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.083+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7d0c022070 con 0x7f7d14151910 2023-08-27T11:29:30.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.083+0000 7f7d137fe700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 0x7f7d0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:30.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.084+0000 7f7d137fe700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 0x7f7d0006c5a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7d04007fd0 tx=0x7f7d04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:30.089 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.088+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7d0c055840 con 0x7f7d14151910 2023-08-27T11:29:30.317 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:30.316+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7d140a7490 con 0x7f7d14151910 2023-08-27T11:29:31.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.228+0000 7f7cfbfff700 1 -- 172.21.15.43:0/2931379927 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7d0c02c080 con 0x7f7d14151910 2023-08-27T11:29:31.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.231+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 msgr2=0x7f7d0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.231+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 0x7f7d0006c5a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7d04007fd0 tx=0x7f7d04009040 comp rx=0 tx=0).stop 2023-08-27T11:29:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.231+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 msgr2=0x7f7d14155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.231+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c013000 tx=0x7f7d0c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 shutdown_connections 2023-08-27T11:29:31.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7d0006a0e0 0x7f7d0006c5a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7d14151910 0x7f7d14155050 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d140c15e0 0x7f7d140aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 --2- 172.21.15.43:0/2931379927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d140c51a0 0x7f7d14154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 >> 172.21.15.43:0/2931379927 conn(0x7f7d140a9740 msgr2=0x7f7d141501d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:31.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 shutdown_connections 2023-08-27T11:29:31.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.232+0000 7f7d1a1ff700 1 -- 172.21.15.43:0/2931379927 wait complete. 2023-08-27T11:29:31.236 INFO:teuthology.orchestra.run.smithi043.stderr: removed all blocklist entries 2023-08-27T11:29:31.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-27T11:29:31.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.462+0000 7f86493ff700 1 Processor -- start 2023-08-27T11:29:31.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.462+0000 7f86493ff700 1 -- start start 2023-08-27T11:29:31.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86493ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f86440c51a0 0x7f864406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86493ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864406d700 con 0x7f864406ca60 2023-08-27T11:29:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86493ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8644152430 con 0x7f8644155910 2023-08-27T11:29:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86493ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86441530b0 con 0x7f86440c51a0 2023-08-27T11:29:31.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86427fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f864406ca60 0x7f86440aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36558/0 (socket says 172.21.15.43:36558) 2023-08-27T11:29:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f86427fc700 1 -- 172.21.15.43:0/950745283 learned_addr learned my addr 172.21.15.43:0/950745283 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.463+0000 7f8642ffd700 1 --2- 172.21.15.43:0/950745283 >> v2:172.21.15.57:3300/0 conn(0x7f86440c51a0 0x7f864406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514716236 0 0) 0x7f864406d700 con 0x7f864406ca60 2023-08-27T11:29:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f862c0035b0 con 0x7f864406ca60 2023-08-27T11:29:31.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373335920 0 0) 0x7f862c0035b0 con 0x7f864406ca60 2023-08-27T11:29:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 >> v2:172.21.15.57:3300/0 conn(0x7f86440c51a0 msgr2=0x7f864406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 --2- 172.21.15.43:0/950745283 >> v2:172.21.15.57:3300/0 conn(0x7f86440c51a0 0x7f864406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 >> v1:172.21.15.57:6789/0 conn(0x7f8644155910 legacy=0x7f8644155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8644152710 con 0x7f864406ca60 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f8638001670 con 0x7f864406ca60 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8642ffd700 1 --2- 172.21.15.43:0/950745283 >> v2:172.21.15.57:3300/0 conn(0x7f86440c51a0 0x7f864406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 >> v1:172.21.15.43:6789/0 conn(0x7f864406ca60 legacy=0x7f86440aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f862c003a00 0x7f862c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862c004850 0x7f862c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f862c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441530b0 con 0x7f862c005210 2023-08-27T11:29:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c00c1b0 con 0x7f862c003a00 2023-08-27T11:29:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c00c370 con 0x7f862c004850 2023-08-27T11:29:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f86437fe700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f862c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.464+0000 7f8642ffd700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f862c003a00 0x7f862c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86427fc700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862c004850 0x7f862c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 -- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862c004850 msgr2=0x7f862c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f862c004850 0x7f862c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 -- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f862c003a00 msgr2=0x7f862c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:31.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f862c003a00 0x7f862c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 -- 172.21.15.43:0/950745283 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c0035b0 con 0x7f862c005210 2023-08-27T11:29:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 -- 172.21.15.43:0/950745283 reap_dead start 2023-08-27T11:29:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f86437fe700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f862c00ba10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c190 tx=0x7f862c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19acce1cd96cc75f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c001db0 con 0x7f862c005210 2023-08-27T11:29:31.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c00ccd0 con 0x7f862c005210 2023-08-27T11:29:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.465+0000 7f8641ffb700 1 -- 172.21.15.43:0/950745283 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c003c40 con 0x7f862c005210 2023-08-27T11:29:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 -- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 msgr2=0x7f862c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f862c00ba10 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f863c00c190 tx=0x7f862c005880 comp rx=0 tx=0).stop 2023-08-27T11:29:31.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 -- 172.21.15.43:0/950745283 shutdown_connections 2023-08-27T11:29:31.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 --2- 172.21.15.43:0/950745283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f862c00ba10 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 -- 172.21.15.43:0/950745283 >> 172.21.15.43:0/950745283 conn(0x7f864406aa50 msgr2=0x7f86440c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 -- 172.21.15.43:0/950745283 shutdown_connections 2023-08-27T11:29:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.466+0000 7f86493ff700 1 -- 172.21.15.43:0/950745283 wait complete. 2023-08-27T11:29:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.468+0000 7f86493ff700 1 Processor -- start 2023-08-27T11:29:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.468+0000 7f86493ff700 1 -- start start 2023-08-27T11:29:31.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86440bc8e0 0x7f86440bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86440a7e70 0x7f86441eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441eaa80 con 0x7f862c005210 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86441ea4c0 con 0x7f86440a7e70 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86493ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441ea7a0 con 0x7f86440bc8e0 2023-08-27T11:29:31.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58700/0 (socket says 172.21.15.43:58700) 2023-08-27T11:29:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 -- 172.21.15.43:0/2428842084 learned_addr learned my addr 172.21.15.43:0/2428842084 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86437fe700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86440a7e70 0x7f86441eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f86427fc700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86440bc8e0 0x7f86440bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 -- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86440bc8e0 msgr2=0x7f86440bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86440bc8e0 0x7f86440bbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 -- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86440a7e70 msgr2=0x7f86441eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86440a7e70 0x7f86441eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.469+0000 7f8642ffd700 1 -- 172.21.15.43:0/2428842084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440a6650 con 0x7f862c005210 2023-08-27T11:29:31.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f8642ffd700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8634011ca0 tx=0x7f863400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:31.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400fb30 con 0x7f862c005210 2023-08-27T11:29:31.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863400fc90 con 0x7f862c005210 2023-08-27T11:29:31.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634004020 con 0x7f862c005210 2023-08-27T11:29:31.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440a6930 con 0x7f862c005210 2023-08-27T11:29:31.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.470+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86440bc090 con 0x7f862c005210 2023-08-27T11:29:31.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.471+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86440a64b0 con 0x7f862c005210 2023-08-27T11:29:31.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.472+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8634004180 con 0x7f862c005210 2023-08-27T11:29:31.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.473+0000 7f862b7fe700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 0x7f863006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:31.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.473+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f86340887f0 con 0x7f862c005210 2023-08-27T11:29:31.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.473+0000 7f86427fc700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 0x7f863006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:31.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.474+0000 7f86427fc700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 0x7f863006c5a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8638007cd0 tx=0x7f8638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:31.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.477+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f86440a64b0 con 0x7f862c005210 2023-08-27T11:29:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.767+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f86440a6f80 con 0x7f862c005210 2023-08-27T11:29:31.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.768+0000 7f862b7fe700 1 -- 172.21.15.43:0/2428842084 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+4724 (secure 0 0 0) 0x7f8634057cb0 con 0x7f862c005210 2023-08-27T11:29:31.770 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:31.770 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:29:31.770 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_dump": [ 2023-08-27T11:29:31.770 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.770 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.a", 2023-08-27T11:29:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkKk0OKRAAKo+8cgR4njeSSBgyJGdikw==", 2023-08-27T11:29:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:29:31.771 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:29:31.772 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.772 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.772 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.772 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.772 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.b", 2023-08-27T11:29:31.773 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkCiDABhAAzzrD6I+oI+P6mORYMJRV8w==", 2023-08-27T11:29:31.773 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:29:31.773 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.c", 2023-08-27T11:29:31.774 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk1fikNRAAGisWQdnyo63JwateGXphfg==", 2023-08-27T11:29:31.775 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:29:31.775 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:29:31.775 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mds.d", 2023-08-27T11:29:31.776 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkGJNzExAAQUZMqG4AnBZdFO4MiJRgNA==", 2023-08-27T11:29:31.777 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.777 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.777 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:29:31.777 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:29:31.777 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.778 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.778 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.778 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.778 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.0", 2023-08-27T11:29:31.778 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDKMetkRotpIhAAmnUXxQpAk3Z9r7rgxpVbig==", 2023-08-27T11:29:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.779 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.780 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.780 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.780 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.1", 2023-08-27T11:29:31.780 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDNMetklKloKhAA2aznWACjEejk7S1Rr8NbGw==", 2023-08-27T11:29:31.780 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.781 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.781 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.781 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.782 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.782 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.782 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.782 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.2", 2023-08-27T11:29:31.782 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDQMetkX3l2MhAAkr8EWCNhPDlFjD93/aiG3w==", 2023-08-27T11:29:31.783 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.783 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.783 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.783 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.783 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.784 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.784 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.784 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.3", 2023-08-27T11:29:31.784 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDTMetkWCC1ORAAi54Z18mnfoCX2JG+DzLnuQ==", 2023-08-27T11:29:31.784 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.785 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.785 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.785 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.785 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.785 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.786 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.786 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.4", 2023-08-27T11:29:31.786 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDdMetkE4/jLxAAcfAGf0k50DFkmdhV0kzH8Q==", 2023-08-27T11:29:31.786 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.786 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.787 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.787 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.787 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.787 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.787 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.788 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.5", 2023-08-27T11:29:31.788 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDgMetkP8WROBAA7S/4nhe34Y0Azo62bzV0wA==", 2023-08-27T11:29:31.788 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.788 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.789 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.789 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.789 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.789 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.789 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.790 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.6", 2023-08-27T11:29:31.790 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDkMetkpY4uBRAAZ8+ulq5p+pRZlT/kTPnjDw==", 2023-08-27T11:29:31.790 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.790 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.790 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.791 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.791 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.791 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.791 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.791 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "osd.7", 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDnMetk7Zx1DRAAEQOQvH6GzxOC4FrEkBYxFg==", 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow profile osd", 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile osd", 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.792 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.793 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.793 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.793 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.0", 2023-08-27T11:29:31.793 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw==", 2023-08-27T11:29:31.793 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.794 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow r", 2023-08-27T11:29:31.794 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-27T11:29:31.794 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.794 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.795 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.795 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.1", 2023-08-27T11:29:31.795 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDIMetkoLsoKRAA+ulTRFgwGw0mg8cu3qxL2g==", 2023-08-27T11:29:31.795 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.795 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow", 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow r", 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow rw", 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow rwx" 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.796 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.797 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "client.admin", 2023-08-27T11:29:31.797 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDGMetkFmQYKxAAqH5tS6aMjV1Gp5Z5NUkc/A==", 2023-08-27T11:29:31.797 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:29:31.797 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": "allow *", 2023-08-27T11:29:31.798 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow *", 2023-08-27T11:29:31.798 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.798 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.798 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.799 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.799 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.x", 2023-08-27T11:29:31.799 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetk8lymIBAAR545VAUhZdW7uhw+hRzu7A==", 2023-08-27T11:29:31.799 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.799 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:29:31.800 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:29:31.800 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.800 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.800 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:31.800 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: "entity": "mgr.y", 2023-08-27T11:29:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "AQDHMetkIiYRGBAA+KpPlyAW8CofpJn9P+PK+w==", 2023-08-27T11:29:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: "caps": { 2023-08-27T11:29:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: "mds": "allow *", 2023-08-27T11:29:31.801 INFO:teuthology.orchestra.run.smithi043.stdout: "mon": "allow profile mgr", 2023-08-27T11:29:31.802 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": "allow *" 2023-08-27T11:29:31.802 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.802 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:31.802 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2023-08-27T11:29:31.802 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:29:31.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 msgr2=0x7f863006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.804 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 0x7f863006c5a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8638007cd0 tx=0x7f8638009040 comp rx=0 tx=0).stop 2023-08-27T11:29:31.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 msgr2=0x7f86440a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:31.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8634011ca0 tx=0x7f863400f520 comp rx=0 tx=0).stop 2023-08-27T11:29:31.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 shutdown_connections 2023-08-27T11:29:31.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f863006a0e0 0x7f863006c5a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f86440a7e70 0x7f86441eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f862c005210 0x7f86440a7130 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 --2- 172.21.15.43:0/2428842084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f86440bc8e0 0x7f86440bbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:31.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.770+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 >> 172.21.15.43:0/2428842084 conn(0x7f864406aa50 msgr2=0x7f8644153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:31.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.771+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 shutdown_connections 2023-08-27T11:29:31.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:31.771+0000 7f86493ff700 1 -- 172.21.15.43:0/2428842084 wait complete. 2023-08-27T11:29:31.807 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:32.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.008+0000 7f2716bff700 1 Processor -- start 2023-08-27T11:29:32.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.008+0000 7f2716bff700 1 -- start start 2023-08-27T11:29:32.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.009+0000 7f2716bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27100c4630 0x7f27100c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.009+0000 7f2716bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271006c4e0 con 0x7f271006ad70 2023-08-27T11:29:32.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.009+0000 7f2716bff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2710155370 con 0x7f2710151a90 2023-08-27T11:29:32.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.009+0000 7f2716bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100c82c0 con 0x7f27100c4630 2023-08-27T11:29:32.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.009+0000 7f271519c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f271006ad70 0x7f271006b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36568/0 (socket says 172.21.15.43:36568) 2023-08-27T11:29:32.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f271519c700 1 -- 172.21.15.43:0/2758487979 learned_addr learned my addr 172.21.15.43:0/2758487979 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:32.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270ffff700 1 --2- 172.21.15.43:0/2758487979 >> v2:172.21.15.57:3300/0 conn(0x7f27100c4630 0x7f27100c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549056239 0 0) 0x7f271006c4e0 con 0x7f271006ad70 2023-08-27T11:29:32.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27000035b0 con 0x7f271006ad70 2023-08-27T11:29:32.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700148141 0 0) 0x7f27000035b0 con 0x7f271006ad70 2023-08-27T11:29:32.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270ffff700 1 -- 172.21.15.43:0/2758487979 >> v1:172.21.15.57:6789/0 conn(0x7f2710151a90 legacy=0x7f27100c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270ffff700 1 -- 172.21.15.43:0/2758487979 >> v1:172.21.15.43:6789/0 conn(0x7f271006ad70 legacy=0x7f271006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.010+0000 7f270ffff700 1 -- 172.21.15.43:0/2758487979 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710151e70 con 0x7f27100c4630 2023-08-27T11:29:32.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f270ffff700 1 --2- 172.21.15.43:0/2758487979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4630 0x7f27100c4a90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009840 tx=0x7f26fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36061c48be78bab server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080019f0 con 0x7f27100c4630 2023-08-27T11:29:32.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc004030 con 0x7f27100c4630 2023-08-27T11:29:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f270f7fe700 1 -- 172.21.15.43:0/2758487979 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0043a0 con 0x7f27100c4630 2023-08-27T11:29:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f2716bff700 1 -- 172.21.15.43:0/2758487979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4630 msgr2=0x7f27100c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.011+0000 7f2716bff700 1 --2- 172.21.15.43:0/2758487979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4630 0x7f27100c4a90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009840 tx=0x7f26fc009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.012+0000 7f2716bff700 1 -- 172.21.15.43:0/2758487979 shutdown_connections 2023-08-27T11:29:32.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.012+0000 7f2716bff700 1 --2- 172.21.15.43:0/2758487979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27100c4630 0x7f27100c4a90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.012+0000 7f2716bff700 1 -- 172.21.15.43:0/2758487979 >> 172.21.15.43:0/2758487979 conn(0x7f27100ab820 msgr2=0x7f27100abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:32.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.012+0000 7f2716bff700 1 -- 172.21.15.43:0/2758487979 shutdown_connections 2023-08-27T11:29:32.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.012+0000 7f2716bff700 1 -- 172.21.15.43:0/2758487979 wait complete. 2023-08-27T11:29:32.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.013+0000 7f2716bff700 1 Processor -- start 2023-08-27T11:29:32.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.013+0000 7f2716bff700 1 -- start start 2023-08-27T11:29:32.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006ad70 0x7f271014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2710151a90 0x7f2710149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101463e0 con 0x7f27100c4630 2023-08-27T11:29:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27101445c0 con 0x7f2710151a90 2023-08-27T11:29:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.014+0000 7f2716bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27101465f0 con 0x7f271006ad70 2023-08-27T11:29:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58706/0 (socket says 172.21.15.43:58706) 2023-08-27T11:29:32.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 -- 172.21.15.43:0/211695660 learned_addr learned my addr 172.21.15.43:0/211695660 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f271519c700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2710151a90 0x7f2710149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f271499b700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006ad70 0x7f271014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 -- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006ad70 msgr2=0x7f271014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006ad70 0x7f271014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 -- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2710151a90 msgr2=0x7f2710149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2710151a90 0x7f2710149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 -- 172.21.15.43:0/211695660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0094a0 con 0x7f27100c4630 2023-08-27T11:29:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.015+0000 7f270ffff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0090b0 tx=0x7f26fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.016+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc003ea0 con 0x7f27100c4630 2023-08-27T11:29:32.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.016+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc01f070 con 0x7f27100c4630 2023-08-27T11:29:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.016+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27101ed750 con 0x7f27100c4630 2023-08-27T11:29:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.016+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc011870 con 0x7f27100c4630 2023-08-27T11:29:32.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.016+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2710146bf0 con 0x7f27100c4630 2023-08-27T11:29:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.017+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27101ed990 con 0x7f27100c4630 2023-08-27T11:29:32.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.018+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f26fc0119d0 con 0x7f27100c4630 2023-08-27T11:29:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.019+0000 7f270d7fa700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.019+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f26fc021070 con 0x7f27100c4630 2023-08-27T11:29:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.019+0000 7f271499b700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.020+0000 7f271499b700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2704001800 tx=0x7f2704009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.023+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f26fc055a80 con 0x7f27100c4630 2023-08-27T11:29:32.237 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.236+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2710154a10 con 0x7f27100c4630 2023-08-27T11:29:32.238 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.237+0000 7f270d7fa700 1 -- 172.21.15.43:0/211695660 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f26fc006cc0 con 0x7f27100c4630 2023-08-27T11:29:32.238 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:32.239 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":140,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:31.222029+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 msgr2=0x7f26f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2704001800 tx=0x7f2704009040 comp rx=0 tx=0).stop 2023-08-27T11:29:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 msgr2=0x7f2710153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0090b0 tx=0x7f26fc004750 comp rx=0 tx=0).stop 2023-08-27T11:29:32.241 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 shutdown_connections 2023-08-27T11:29:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f26f406a0e0 0x7f26f406c5a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2710151a90 0x7f2710149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f271006ad70 0x7f271014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 --2- 172.21.15.43:0/211695660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f27100c4630 0x7f2710153df0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.242 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.239+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 >> 172.21.15.43:0/211695660 conn(0x7f27100ab820 msgr2=0x7f27100c8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.240+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 shutdown_connections 2023-08-27T11:29:32.243 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.240+0000 7f2716bff700 1 -- 172.21.15.43:0/211695660 wait complete. 2023-08-27T11:29:32.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:29:32.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:29:32.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.463+0000 7f82affff700 1 Processor -- start 2023-08-27T11:29:32.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.464+0000 7f82affff700 1 -- start start 2023-08-27T11:29:32.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82affff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f82b00c14c0 0x7f82b00c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82affff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0151e20 con 0x7f82b0151a40 2023-08-27T11:29:32.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82affff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0157a90 con 0x7f82b00c48c0 2023-08-27T11:29:32.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82affff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b0157d70 con 0x7f82b00c14c0 2023-08-27T11:29:32.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82aeffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f82b0151a40 0x7f82b00a6d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36584/0 (socket says 172.21.15.43:36584) 2023-08-27T11:29:32.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82aeffd700 1 -- 172.21.15.43:0/1362585385 learned_addr learned my addr 172.21.15.43:0/1362585385 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:32.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.465+0000 7f82a7fff700 1 --2- 172.21.15.43:0/1362585385 >> v2:172.21.15.57:3300/0 conn(0x7f82b00c14c0 0x7f82b00c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464749992 0 0) 0x7f82b0151e20 con 0x7f82b0151a40 2023-08-27T11:29:32.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f829c0035b0 con 0x7f82b0151a40 2023-08-27T11:29:32.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989613962 0 0) 0x7f82b0157a90 con 0x7f82b00c48c0 2023-08-27T11:29:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b0151e20 con 0x7f82b00c48c0 2023-08-27T11:29:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 452578950 0 0) 0x7f829c0035b0 con 0x7f82b0151a40 2023-08-27T11:29:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82a7fff700 1 -- 172.21.15.43:0/1362585385 >> v1:172.21.15.57:6789/0 conn(0x7f82b00c48c0 legacy=0x7f82b0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82a7fff700 1 -- 172.21.15.43:0/1362585385 >> v1:172.21.15.43:6789/0 conn(0x7f82b0151a40 legacy=0x7f82b00a6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82a7fff700 1 -- 172.21.15.43:0/1362585385 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0158050 con 0x7f82b00c14c0 2023-08-27T11:29:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.466+0000 7f82a7fff700 1 --2- 172.21.15.43:0/1362585385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b00c14c0 0x7f82b00c4380 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8298009840 tx=0x7f8298009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7997a70cc053b5ba server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0001670 con 0x7f82b00c14c0 2023-08-27T11:29:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298004030 con 0x7f82b00c14c0 2023-08-27T11:29:32.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82ae7fc700 1 -- 172.21.15.43:0/1362585385 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980043c0 con 0x7f82b00c14c0 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 -- 172.21.15.43:0/1362585385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b00c14c0 msgr2=0x7f82b00c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 --2- 172.21.15.43:0/1362585385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b00c14c0 0x7f82b00c4380 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8298009840 tx=0x7f8298009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 -- 172.21.15.43:0/1362585385 shutdown_connections 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 --2- 172.21.15.43:0/1362585385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b00c14c0 0x7f82b00c4380 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 -- 172.21.15.43:0/1362585385 >> 172.21.15.43:0/1362585385 conn(0x7f82b00a9660 msgr2=0x7f82b00a9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:32.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 -- 172.21.15.43:0/1362585385 shutdown_connections 2023-08-27T11:29:32.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.467+0000 7f82affff700 1 -- 172.21.15.43:0/1362585385 wait complete. 2023-08-27T11:29:32.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.469+0000 7f82affff700 1 Processor -- start 2023-08-27T11:29:32.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.469+0000 7f82affff700 1 -- start start 2023-08-27T11:29:32.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82b00c48c0 0x7f82b00ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b0151a40 0x7f82b01ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00ab250 con 0x7f82b00c14c0 2023-08-27T11:29:32.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c60b0 con 0x7f82b0151a40 2023-08-27T11:29:32.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82affff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00c6390 con 0x7f82b00c48c0 2023-08-27T11:29:32.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82aeffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58708/0 (socket says 172.21.15.43:58708) 2023-08-27T11:29:32.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.470+0000 7f82aeffd700 1 -- 172.21.15.43:0/672459689 learned_addr learned my addr 172.21.15.43:0/672459689 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:32.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82a7fff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82b00c48c0 0x7f82b00ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82af7fe700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b0151a40 0x7f82b01ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 -- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82b00c48c0 msgr2=0x7f82b00ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82b00c48c0 0x7f82b00ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 -- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b0151a40 msgr2=0x7f82b01ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b0151a40 0x7f82b01ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 -- 172.21.15.43:0/672459689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980094a0 con 0x7f82b00c14c0 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82aeffd700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c520 tx=0x7f82a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004c80 con 0x7f82b00c14c0 2023-08-27T11:29:32.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0004de0 con 0x7f82b00c14c0 2023-08-27T11:29:32.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0007310 con 0x7f82b00c14c0 2023-08-27T11:29:32.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b00c6670 con 0x7f82b00c14c0 2023-08-27T11:29:32.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.471+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00c6950 con 0x7f82b00c14c0 2023-08-27T11:29:32.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.472+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b00aaa30 con 0x7f82b00c14c0 2023-08-27T11:29:32.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.473+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f82a0007470 con 0x7f82b00c14c0 2023-08-27T11:29:32.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.474+0000 7f82a77fe700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 0x7f829006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.474+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f82a0087ff0 con 0x7f82b00c14c0 2023-08-27T11:29:32.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.474+0000 7f82a7fff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 0x7f829006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.475+0000 7f82a7fff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 0x7f829006c5a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f82b00c1900 tx=0x7f8298008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.479+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f82a00ba990 con 0x7f82b00c14c0 2023-08-27T11:29:32.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.689+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f82b00679e0 con 0x7f82b00c14c0 2023-08-27T11:29:32.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.690+0000 7f82a77fe700 1 -- 172.21.15.43:0/672459689 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v140) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82b00aaa30 con 0x7f82b00c14c0 2023-08-27T11:29:32.692 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:29:32.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 msgr2=0x7f829006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 0x7f829006c5a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f82b00c1900 tx=0x7f8298008030 comp rx=0 tx=0).stop 2023-08-27T11:29:32.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 msgr2=0x7f82b00aad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.694 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c520 tx=0x7f82a000c8e0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 shutdown_connections 2023-08-27T11:29:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f829006a0e0 0x7f829006c5a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.697 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82b0151a40 0x7f82b01ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f82b00c14c0 0x7f82b00aad10 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 --2- 172.21.15.43:0/672459689 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f82b00c48c0 0x7f82b00ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.692+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 >> 172.21.15.43:0/672459689 conn(0x7f82b00a9660 msgr2=0x7f82b00c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.693+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 shutdown_connections 2023-08-27T11:29:32.698 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.693+0000 7f82affff700 1 -- 172.21.15.43:0/672459689 wait complete. 2023-08-27T11:29:32.712 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:29:32.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.915+0000 7fde707ff700 1 Processor -- start 2023-08-27T11:29:32.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.915+0000 7fde707ff700 1 -- start start 2023-08-27T11:29:32.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.916+0000 7fde707ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde680c7c00 0x7fde680c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.916+0000 7fde707ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde6806a8e0 0x7fde6806ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.916+0000 7fde707ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde68154660 con 0x7fde68151d20 2023-08-27T11:29:32.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.916+0000 7fde707ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde680c5750 con 0x7fde6806a8e0 2023-08-27T11:29:32.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.916+0000 7fde707ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde68154940 con 0x7fde680c7c00 2023-08-27T11:29:32.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde6806a8e0 0x7fde6806ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fde6806a8e0 0x7fde6806ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58718/0 (socket says 172.21.15.43:58718) 2023-08-27T11:29:32.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6e59b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fde68151d20 0x7fde680ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36596/0 (socket says 172.21.15.43:36596) 2023-08-27T11:29:32.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 -- 172.21.15.43:0/622792998 learned_addr learned my addr 172.21.15.43:0/622792998 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:32.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6dd9a700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde680c7c00 0x7fde680c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 -- 172.21.15.43:0/622792998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde680c7c00 msgr2=0x7fde680c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:32.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde680c7c00 0x7fde680c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 -- 172.21.15.43:0/622792998 >> v1:172.21.15.43:6789/0 conn(0x7fde68151d20 legacy=0x7fde680ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.917+0000 7fde6ed9c700 1 -- 172.21.15.43:0/622792998 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68154c20 con 0x7fde6806a8e0 2023-08-27T11:29:32.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde6ed9c700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde6806a8e0 0x7fde6806ad50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fde60009e50 tx=0x7fde6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3181d907c1c31c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde6d599700 1 -- 172.21.15.43:0/622792998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000e070 con 0x7fde6806a8e0 2023-08-27T11:29:32.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde6d599700 1 -- 172.21.15.43:0/622792998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000b9c0 con 0x7fde6806a8e0 2023-08-27T11:29:32.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde6d599700 1 -- 172.21.15.43:0/622792998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000bd70 con 0x7fde6806a8e0 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 -- 172.21.15.43:0/622792998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde6806a8e0 msgr2=0x7fde6806ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde6806a8e0 0x7fde6806ad50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fde60009e50 tx=0x7fde6000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 -- 172.21.15.43:0/622792998 shutdown_connections 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde6806a8e0 0x7fde6806ad50 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 --2- 172.21.15.43:0/622792998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde680c7c00 0x7fde680c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.918+0000 7fde707ff700 1 -- 172.21.15.43:0/622792998 >> 172.21.15.43:0/622792998 conn(0x7fde680c9d00 msgr2=0x7fde680ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:32.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.919+0000 7fde707ff700 1 -- 172.21.15.43:0/622792998 shutdown_connections 2023-08-27T11:29:32.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.919+0000 7fde707ff700 1 -- 172.21.15.43:0/622792998 wait complete. 2023-08-27T11:29:32.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.920+0000 7fde707ff700 1 Processor -- start 2023-08-27T11:29:32.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.920+0000 7fde707ff700 1 -- start start 2023-08-27T11:29:32.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 0x7fde6814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 0x7fde681ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde681ead80 con 0x7fde68151d20 2023-08-27T11:29:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde681edd80 con 0x7fde680c7c00 2023-08-27T11:29:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.921+0000 7fde707ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6814e5a0 con 0x7fde6806a8e0 2023-08-27T11:29:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58720/0 (socket says 172.21.15.43:58720) 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 -- 172.21.15.43:0/2358213102 learned_addr learned my addr 172.21.15.43:0/2358213102 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6e59b700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 0x7fde6814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6dd9a700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 0x7fde681ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 -- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 msgr2=0x7fde6814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 0x7fde6814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 -- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 msgr2=0x7fde681ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 0x7fde681ed840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 -- 172.21.15.43:0/2358213102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60009b30 con 0x7fde68151d20 2023-08-27T11:29:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6e59b700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 0x7fde6814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6dd9a700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 0x7fde681ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:32.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde6ed9c700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fde6000b370 tx=0x7fde60004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde600092e0 con 0x7fde68151d20 2023-08-27T11:29:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde600099b0 con 0x7fde68151d20 2023-08-27T11:29:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6001c660 con 0x7fde68151d20 2023-08-27T11:29:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.922+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6814e880 con 0x7fde68151d20 2023-08-27T11:29:32.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.923+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde681eb2b0 con 0x7fde68151d20 2023-08-27T11:29:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.924+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6804ee70 con 0x7fde68151d20 2023-08-27T11:29:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.924+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fde6001c7c0 con 0x7fde68151d20 2023-08-27T11:29:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.925+0000 7fde5effd700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 0x7fde4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.925+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde60089c50 con 0x7fde68151d20 2023-08-27T11:29:32.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.926+0000 7fde6e59b700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 0x7fde4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:32.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.926+0000 7fde6e59b700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 0x7fde4c06c5a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fde64000f60 tx=0x7fde64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:32.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:32.930+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fde60055680 con 0x7fde68151d20 2023-08-27T11:29:33.139 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.138+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde680ac650 con 0x7fde68151d20 2023-08-27T11:29:33.140 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.139+0000 7fde5effd700 1 -- 172.21.15.43:0/2358213102 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde60058ca0 con 0x7fde68151d20 2023-08-27T11:29:33.140 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:29:33.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 msgr2=0x7fde4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.142 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 0x7fde4c06c5a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fde64000f60 tx=0x7fde64009040 comp rx=0 tx=0).stop 2023-08-27T11:29:33.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 msgr2=0x7fde680aa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fde6000b370 tx=0x7fde60004b20 comp rx=0 tx=0).stop 2023-08-27T11:29:33.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 shutdown_connections 2023-08-27T11:29:33.143 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fde4c06a0e0 0x7fde4c06c5a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fde68151d20 0x7fde680aa920 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde6806a8e0 0x7fde6814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 --2- 172.21.15.43:0/2358213102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde680c7c00 0x7fde681ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 >> 172.21.15.43:0/2358213102 conn(0x7fde680c9d00 msgr2=0x7fde680c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 shutdown_connections 2023-08-27T11:29:33.144 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.141+0000 7fde707ff700 1 -- 172.21.15.43:0/2358213102 wait complete. 2023-08-27T11:29:33.161 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-27T11:29:33.363 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.362+0000 7f94397ff700 1 Processor -- start 2023-08-27T11:29:33.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.362+0000 7f94397ff700 1 -- start start 2023-08-27T11:29:33.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.363+0000 7f94397ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f943406ca60 0x7f943406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94397ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943406d700 con 0x7f9434155910 2023-08-27T11:29:33.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94397ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9434152430 con 0x7f94340c51a0 2023-08-27T11:29:33.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94397ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94341530b0 con 0x7f943406ca60 2023-08-27T11:29:33.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94327fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f943406ca60 0x7f943406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94337fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f9434155910 0x7f9434155d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36598/0 (socket says 172.21.15.43:36598) 2023-08-27T11:29:33.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94337fe700 1 -- 172.21.15.43:0/3000018784 learned_addr learned my addr 172.21.15.43:0/3000018784 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:33.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f9431ffb700 1 -- 172.21.15.43:0/3000018784 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093240614 0 0) 0x7f943406d700 con 0x7f9434155910 2023-08-27T11:29:33.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f9431ffb700 1 -- 172.21.15.43:0/3000018784 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f941c0035b0 con 0x7f9434155910 2023-08-27T11:29:33.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94327fc700 1 -- 172.21.15.43:0/3000018784 >> v1:172.21.15.57:6789/0 conn(0x7f94340c51a0 legacy=0x7f94340aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94327fc700 1 -- 172.21.15.43:0/3000018784 >> v1:172.21.15.43:6789/0 conn(0x7f9434155910 legacy=0x7f9434155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.364+0000 7f94327fc700 1 -- 172.21.15.43:0/3000018784 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434152710 con 0x7f943406ca60 2023-08-27T11:29:33.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94327fc700 1 --2- 172.21.15.43:0/3000018784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f943406d1c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9428009840 tx=0x7f9428009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4827e512c5c1ff75 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f9431ffb700 1 -- 172.21.15.43:0/3000018784 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428011830 con 0x7f943406ca60 2023-08-27T11:29:33.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f9431ffb700 1 -- 172.21.15.43:0/3000018784 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428011990 con 0x7f943406ca60 2023-08-27T11:29:33.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f9431ffb700 1 -- 172.21.15.43:0/3000018784 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428011d20 con 0x7f943406ca60 2023-08-27T11:29:33.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94397ff700 1 -- 172.21.15.43:0/3000018784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 msgr2=0x7f943406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94397ff700 1 --2- 172.21.15.43:0/3000018784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f943406d1c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9428009840 tx=0x7f9428009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:33.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94397ff700 1 -- 172.21.15.43:0/3000018784 shutdown_connections 2023-08-27T11:29:33.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94397ff700 1 --2- 172.21.15.43:0/3000018784 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f943406d1c0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.365+0000 7f94397ff700 1 -- 172.21.15.43:0/3000018784 >> 172.21.15.43:0/3000018784 conn(0x7f943406aa50 msgr2=0x7f94340c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:33.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.366+0000 7f94397ff700 1 -- 172.21.15.43:0/3000018784 shutdown_connections 2023-08-27T11:29:33.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.366+0000 7f94397ff700 1 -- 172.21.15.43:0/3000018784 wait complete. 2023-08-27T11:29:33.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.367+0000 7f94397ff700 1 Processor -- start 2023-08-27T11:29:33.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.367+0000 7f94397ff700 1 -- start start 2023-08-27T11:29:33.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94340c51a0 0x7f94340bba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 0x7f94340a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.373 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943414a8e0 con 0x7f943406ca60 2023-08-27T11:29:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943414fde0 con 0x7f9434155910 2023-08-27T11:29:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f94397ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94341ecdf0 con 0x7f94340c51a0 2023-08-27T11:29:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f9432ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f9432ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58726/0 (socket says 172.21.15.43:58726) 2023-08-27T11:29:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.368+0000 7f9432ffd700 1 -- 172.21.15.43:0/101493637 learned_addr learned my addr 172.21.15.43:0/101493637 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f94337fe700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 0x7f94340a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f94327fc700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94340c51a0 0x7f94340bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 -- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94340c51a0 msgr2=0x7f94340bba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94340c51a0 0x7f94340bba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 -- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 msgr2=0x7f94340a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 0x7f94340a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 -- 172.21.15.43:0/101493637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280094a0 con 0x7f943406ca60 2023-08-27T11:29:33.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f94337fe700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 0x7f94340a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:33.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f9432ffd700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f942400c4e0 tx=0x7f942400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.376 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240052d0 con 0x7f943406ca60 2023-08-27T11:29:33.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9424005430 con 0x7f943406ca60 2023-08-27T11:29:33.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94341ed0d0 con 0x7f943406ca60 2023-08-27T11:29:33.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.369+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94240038c0 con 0x7f943406ca60 2023-08-27T11:29:33.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.370+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94340bbf60 con 0x7f943406ca60 2023-08-27T11:29:33.377 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.371+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94341ed5f0 con 0x7f943406ca60 2023-08-27T11:29:33.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.372+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9424003a20 con 0x7f943406ca60 2023-08-27T11:29:33.378 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.372+0000 7f941b7fe700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 0x7f942006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.373+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9424087650 con 0x7f943406ca60 2023-08-27T11:29:33.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.373+0000 7f94327fc700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 0x7f942006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.373+0000 7f94327fc700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 0x7f942006c5a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f94280090b0 tx=0x7f9428008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.379 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.377+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9424053120 con 0x7f943406ca60 2023-08-27T11:29:33.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.589+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f943404ee70 con 0x7f943406ca60 2023-08-27T11:29:33.590 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.589+0000 7f941b7fe700 1 -- 172.21.15.43:0/101493637 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9424056740 con 0x7f943406ca60 2023-08-27T11:29:33.591 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:33.591 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2023-08-27T11:29:33.591 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:33.592 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2023-08-27T11:29:33.592 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2023-08-27T11:29:33.592 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2023-08-27T11:29:33.592 INFO:teuthology.orchestra.run.smithi043.stdout: { 2023-08-27T11:29:33.592 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2023-08-27T11:29:33.593 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2023-08-27T11:29:33.593 INFO:teuthology.orchestra.run.smithi043.stdout: } 2023-08-27T11:29:33.593 INFO:teuthology.orchestra.run.smithi043.stdout:] 2023-08-27T11:29:33.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 msgr2=0x7f942006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 0x7f942006c5a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f94280090b0 tx=0x7f9428008030 comp rx=0 tx=0).stop 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 msgr2=0x7f94341ed8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f942400c4e0 tx=0x7f942400c8a0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 shutdown_connections 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f942006a0e0 0x7f942006c5a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9434155910 0x7f94340a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943406ca60 0x7f94341ed8d0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 --2- 172.21.15.43:0/101493637 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f94340c51a0 0x7f94340bba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 >> 172.21.15.43:0/101493637 conn(0x7f943406aa50 msgr2=0x7f9434153920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:33.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 shutdown_connections 2023-08-27T11:29:33.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.592+0000 7f94397ff700 1 -- 172.21.15.43:0/101493637 wait complete. 2023-08-27T11:29:33.611 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-27T11:29:33.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-27T11:29:33.818 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.817+0000 7f6371fff700 1 Processor -- start 2023-08-27T11:29:33.819 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.817+0000 7f6371fff700 1 -- start start 2023-08-27T11:29:33.821 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f6371fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f6371fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c154730 con 0x7f636c06b780 2023-08-27T11:29:33.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f6371fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c154a10 con 0x7f636c151a40 2023-08-27T11:29:33.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f6371fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c154520 con 0x7f636c0c4700 2023-08-27T11:29:33.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f636bfff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f636c06b780 0x7f636c06bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36608/0 (socket says 172.21.15.43:36608) 2023-08-27T11:29:33.822 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f636bfff700 1 -- 172.21.15.43:0/664322422 learned_addr learned my addr 172.21.15.43:0/664322422 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:33.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.818+0000 7f6363fff700 1 --2- 172.21.15.43:0/664322422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277361214 0 0) 0x7f636c154730 con 0x7f636c06b780 2023-08-27T11:29:33.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63580035b0 con 0x7f636c06b780 2023-08-27T11:29:33.823 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488275747 0 0) 0x7f636c154a10 con 0x7f636c151a40 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f636c154730 con 0x7f636c151a40 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f6363fff700 1 -- 172.21.15.43:0/664322422 >> v1:172.21.15.57:6789/0 conn(0x7f636c151a40 legacy=0x7f636c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f6363fff700 1 -- 172.21.15.43:0/664322422 >> v1:172.21.15.43:6789/0 conn(0x7f636c06b780 legacy=0x7f636c06bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f6363fff700 1 -- 172.21.15.43:0/664322422 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c154cf0 con 0x7f636c0c4700 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.819+0000 7f6363fff700 1 --2- 172.21.15.43:0/664322422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c0c4b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f6354009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241c828307076b35 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.824 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354011830 con 0x7f636c0c4700 2023-08-27T11:29:33.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6354011990 con 0x7f636c0c4700 2023-08-27T11:29:33.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f636affd700 1 -- 172.21.15.43:0/664322422 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354011d20 con 0x7f636c0c4700 2023-08-27T11:29:33.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 -- 172.21.15.43:0/664322422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 msgr2=0x7f636c0c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 --2- 172.21.15.43:0/664322422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c0c4b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f6354009b80 comp rx=0 tx=0).stop 2023-08-27T11:29:33.825 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 -- 172.21.15.43:0/664322422 shutdown_connections 2023-08-27T11:29:33.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 --2- 172.21.15.43:0/664322422 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c0c4b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 -- 172.21.15.43:0/664322422 >> 172.21.15.43:0/664322422 conn(0x7f636c0ab890 msgr2=0x7f636c0abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:33.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 -- 172.21.15.43:0/664322422 shutdown_connections 2023-08-27T11:29:33.826 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.820+0000 7f6371fff700 1 -- 172.21.15.43:0/664322422 wait complete. 2023-08-27T11:29:33.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.822+0000 7f6371fff700 1 Processor -- start 2023-08-27T11:29:33.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.822+0000 7f6371fff700 1 -- start start 2023-08-27T11:29:33.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 0x7f636c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.829 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c0bd1a0 con 0x7f636c151a40 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c149010 con 0x7f636c06b780 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f6371fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c1512f0 con 0x7f636c0c4700 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f636bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f636bfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58740/0 (socket says 172.21.15.43:58740) 2023-08-27T11:29:33.830 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f636bfff700 1 -- 172.21.15.43:0/2492458887 learned_addr learned my addr 172.21.15.43:0/2492458887 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:33.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.823+0000 7f636b7fe700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 0x7f636c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6363fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 -- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 msgr2=0x7f636c148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.831 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 -- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 msgr2=0x7f636c1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 0x7f636c1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 -- 172.21.15.43:0/2492458887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540094a0 con 0x7f636c151a40 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636b7fe700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 0x7f636c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f636bfff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f636400cbd0 tx=0x7f636400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636400ab10 con 0x7f636c151a40 2023-08-27T11:29:33.832 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636400ac70 con 0x7f636c151a40 2023-08-27T11:29:33.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364012400 con 0x7f636c151a40 2023-08-27T11:29:33.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c14b4c0 con 0x7f636c151a40 2023-08-27T11:29:33.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.824+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c150430 con 0x7f636c151a40 2023-08-27T11:29:33.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.825+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c1505c0 con 0x7f636c151a40 2023-08-27T11:29:33.833 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.826+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f636401b3b0 con 0x7f636c151a40 2023-08-27T11:29:33.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.827+0000 7f6368ff9700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 0x7f634c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:33.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.827+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6364087ee0 con 0x7f636c151a40 2023-08-27T11:29:33.834 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.828+0000 7f636b7fe700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 0x7f634c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:33.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.828+0000 7f636b7fe700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 0x7f634c06c5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f635c0011e0 tx=0x7f635c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:33.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:33.832+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6364057310 con 0x7f636c151a40 2023-08-27T11:29:34.040 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.039+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f636c14b4c0 con 0x7f636c151a40 2023-08-27T11:29:34.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.229+0000 7f6368ff9700 1 -- 172.21.15.43:0/2492458887 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) v1 ==== 138+0+0 (secure 0 0 0) 0x7f636c14b4c0 con 0x7f636c151a40 2023-08-27T11:29:34.233 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 msgr2=0x7f634c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 0x7f634c06c5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f635c0011e0 tx=0x7f635c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 msgr2=0x7f636c14af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f636400cbd0 tx=0x7f636400cf90 comp rx=0 tx=0).stop 2023-08-27T11:29:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 shutdown_connections 2023-08-27T11:29:34.234 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f634c06a110 0x7f634c06c5d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f636c151a40 0x7f636c14af80 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f636c06b780 0x7f636c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 --2- 172.21.15.43:0/2492458887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f636c0c4700 0x7f636c148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 >> 172.21.15.43:0/2492458887 conn(0x7f636c0ab890 msgr2=0x7f636c152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:34.235 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 shutdown_connections 2023-08-27T11:29:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.232+0000 7f6371fff700 1 -- 172.21.15.43:0/2492458887 wait complete. 2023-08-27T11:29:34.236 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2023-08-27T11:29:34.256 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-27T11:29:34.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.465+0000 7f5fdf7ff700 1 Processor -- start 2023-08-27T11:29:34.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.465+0000 7f5fdf7ff700 1 -- start start 2023-08-27T11:29:34.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.466+0000 7f5fdf7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fd814e860 0x7f5fd80c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.466+0000 7f5fdf7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd8151e10 0x7f5fd81551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.466+0000 7f5fdf7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd8154d30 con 0x7f5fd80c2120 2023-08-27T11:29:34.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.466+0000 7f5fdf7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd80a8c00 con 0x7f5fd814e860 2023-08-27T11:29:34.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.466+0000 7f5fdf7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80c5430 con 0x7f5fd8151e10 2023-08-27T11:29:34.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fd814e860 0x7f5fd80c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fd814e860 0x7f5fd80c02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:56192/0 (socket says 172.21.15.43:56192) 2023-08-27T11:29:34.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 -- 172.21.15.43:0/3452249192 learned_addr learned my addr 172.21.15.43:0/3452249192 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:34.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdcd9a700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd8151e10 0x7f5fd81551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 -- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd8151e10 msgr2=0x7f5fd81551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:34.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd8151e10 0x7f5fd81551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 -- 172.21.15.43:0/3452249192 >> v1:172.21.15.57:6789/0 conn(0x7f5fd80c2120 legacy=0x7f5fd80c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.467+0000 7f5fdd59b700 1 -- 172.21.15.43:0/3452249192 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd80c4e70 con 0x7f5fd814e860 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fdd59b700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd814e860 0x7f5fd80c02c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098f0 tx=0x7f5fd4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232a003ba8432b11 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fcffff700 1 -- 172.21.15.43:0/3452249192 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400f8a0 con 0x7f5fd814e860 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fcffff700 1 -- 172.21.15.43:0/3452249192 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd400fa00 con 0x7f5fd814e860 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fcffff700 1 -- 172.21.15.43:0/3452249192 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400fd90 con 0x7f5fd814e860 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd814e860 msgr2=0x7f5fd80c02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.468+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd814e860 0x7f5fd80c02c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098f0 tx=0x7f5fd4009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:34.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/3452249192 shutdown_connections 2023-08-27T11:29:34.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd814e860 0x7f5fd80c02c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/3452249192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd8151e10 0x7f5fd81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/3452249192 >> 172.21.15.43:0/3452249192 conn(0x7f5fd806a310 msgr2=0x7f5fd806a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:34.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/3452249192 shutdown_connections 2023-08-27T11:29:34.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.469+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/3452249192 wait complete. 2023-08-27T11:29:34.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.470+0000 7f5fdf7ff700 1 Processor -- start 2023-08-27T11:29:34.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.470+0000 7f5fdf7ff700 1 -- start start 2023-08-27T11:29:34.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd80c2120 0x7f5fd8150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd814e860 0x7f5fd80bef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80719e0 con 0x7f5fd8151e10 2023-08-27T11:29:34.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8070d80 con 0x7f5fd80c2120 2023-08-27T11:29:34.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.471+0000 7f5fdf7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd806f900 con 0x7f5fd814e860 2023-08-27T11:29:34.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58742/0 (socket says 172.21.15.43:58742) 2023-08-27T11:29:34.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 -- 172.21.15.43:0/1518366690 learned_addr learned my addr 172.21.15.43:0/1518366690 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:34.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fdd59b700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd80c2120 0x7f5fd8150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fdcd9a700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd814e860 0x7f5fd80bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 -- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd814e860 msgr2=0x7f5fd80bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd814e860 0x7f5fd80bef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 -- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd80c2120 msgr2=0x7f5fd8150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd80c2120 0x7f5fd8150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 -- 172.21.15.43:0/1518366690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4009550 con 0x7f5fd8151e10 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.472+0000 7f5fddd9c700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000cc50 tx=0x7f5fd000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.473+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003c00 con 0x7f5fd8151e10 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.473+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0003d60 con 0x7f5fd8151e10 2023-08-27T11:29:34.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.473+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000aab0 con 0x7f5fd8151e10 2023-08-27T11:29:34.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.473+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd8071320 con 0x7f5fd8151e10 2023-08-27T11:29:34.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.473+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd81546e0 con 0x7f5fd8151e10 2023-08-27T11:29:34.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.474+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd8071180 con 0x7f5fd8151e10 2023-08-27T11:29:34.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.475+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5fd000ac10 con 0x7f5fd8151e10 2023-08-27T11:29:34.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.476+0000 7f5fcdffb700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 0x7f5fbc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:34.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.476+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5fd0088330 con 0x7f5fd8151e10 2023-08-27T11:29:34.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.476+0000 7f5fdd59b700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 0x7f5fbc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:34.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.477+0000 7f5fdd59b700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 0x7f5fbc06c5a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009c40 tx=0x7f5fd401b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:34.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.481+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5fd8071180 con 0x7f5fd8151e10 2023-08-27T11:29:34.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:34.691+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5fd8071b20 con 0x7f5fd8151e10 2023-08-27T11:29:35.240 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.239+0000 7f5fcdffb700 1 -- 172.21.15.43:0/1518366690 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5fd8071b20 con 0x7f5fd8151e10 2023-08-27T11:29:35.245 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 msgr2=0x7f5fbc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 0x7f5fbc06c5a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009c40 tx=0x7f5fd401b040 comp rx=0 tx=0).stop 2023-08-27T11:29:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 msgr2=0x7f5fd80bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000cc50 tx=0x7f5fd000cf60 comp rx=0 tx=0).stop 2023-08-27T11:29:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 shutdown_connections 2023-08-27T11:29:35.246 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5fbc06a0e0 0x7f5fbc06c5a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5fd8151e10 0x7f5fd80bf450 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fd80c2120 0x7f5fd8150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 --2- 172.21.15.43:0/1518366690 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fd814e860 0x7f5fd80bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.247 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.244+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 >> 172.21.15.43:0/1518366690 conn(0x7f5fd806a310 msgr2=0x7f5fd80c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.245+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 shutdown_connections 2023-08-27T11:29:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.246+0000 7f5fdf7ff700 1 -- 172.21.15.43:0/1518366690 wait complete. 2023-08-27T11:29:35.253 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2023-08-27T11:29:35.279 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-27T11:29:35.486 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.485+0000 7fb39d7ff700 1 Processor -- start 2023-08-27T11:29:35.487 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.485+0000 7fb39d7ff700 1 -- start start 2023-08-27T11:29:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.486+0000 7fb39d7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb3980c9690 0x7fb39815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.486+0000 7fb39d7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3980c80c0 con 0x7fb3980c49f0 2023-08-27T11:29:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.486+0000 7fb39d7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3981552c0 con 0x7fb3980ac410 2023-08-27T11:29:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.486+0000 7fb39d7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3981555a0 con 0x7fb3980c9690 2023-08-27T11:29:35.488 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb396ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb3980c49f0 0x7fb398151790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36614/0 (socket says 172.21.15.43:36614) 2023-08-27T11:29:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb396ffd700 1 -- 172.21.15.43:0/2447984411 learned_addr learned my addr 172.21.15.43:0/2447984411 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:35.489 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3977fe700 1 --2- 172.21.15.43:0/2447984411 >> v2:172.21.15.57:3300/0 conn(0x7fb3980c9690 0x7fb39815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3967fc700 1 -- 172.21.15.43:0/2447984411 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893527760 0 0) 0x7fb3980c80c0 con 0x7fb3980c49f0 2023-08-27T11:29:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3967fc700 1 -- 172.21.15.43:0/2447984411 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3840035b0 con 0x7fb3980c49f0 2023-08-27T11:29:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3977fe700 1 -- 172.21.15.43:0/2447984411 >> v1:172.21.15.57:6789/0 conn(0x7fb3980ac410 legacy=0x7fb3980c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.491 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3977fe700 1 -- 172.21.15.43:0/2447984411 >> v1:172.21.15.43:6789/0 conn(0x7fb3980c49f0 legacy=0x7fb398151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.487+0000 7fb3977fe700 1 -- 172.21.15.43:0/2447984411 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3980c8360 con 0x7fb3980c9690 2023-08-27T11:29:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb3977fe700 1 --2- 172.21.15.43:0/2447984411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39815fef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb390009d90 tx=0x7fb39000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57f89fc1a7d9463 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb3967fc700 1 -- 172.21.15.43:0/2447984411 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39000e070 con 0x7fb3980c9690 2023-08-27T11:29:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb3967fc700 1 -- 172.21.15.43:0/2447984411 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39000bb20 con 0x7fb3980c9690 2023-08-27T11:29:35.492 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb3967fc700 1 -- 172.21.15.43:0/2447984411 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb390012430 con 0x7fb3980c9690 2023-08-27T11:29:35.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2447984411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 msgr2=0x7fb39815fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.488+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2447984411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39815fef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb390009d90 tx=0x7fb39000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:35.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.489+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2447984411 shutdown_connections 2023-08-27T11:29:35.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.489+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2447984411 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39815fef0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.489+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2447984411 >> 172.21.15.43:0/2447984411 conn(0x7fb3980ab8f0 msgr2=0x7fb3980abd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:35.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.489+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2447984411 shutdown_connections 2023-08-27T11:29:35.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.489+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2447984411 wait complete. 2023-08-27T11:29:35.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.490+0000 7fb39d7ff700 1 Processor -- start 2023-08-27T11:29:35.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.490+0000 7fb39d7ff700 1 -- start start 2023-08-27T11:29:35.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 0x7fb398153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:35.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:35.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:35.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980ade70 con 0x7fb3980c49f0 2023-08-27T11:29:35.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980ae300 con 0x7fb3980c9690 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb39d7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39814aa00 con 0x7fb3980ac410 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.491+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58744/0 (socket says 172.21.15.43:58744) 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 -- 172.21.15.43:0/2722995976 learned_addr learned my addr 172.21.15.43:0/2722995976 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb3977fe700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:35.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb396ffd700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 0x7fb398153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:35.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 -- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 msgr2=0x7fb398153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 0x7fb398153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 -- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 msgr2=0x7fb39814a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:35.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39814a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:35.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 -- 172.21.15.43:0/2722995976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390009a70 con 0x7fb3980c49f0 2023-08-27T11:29:35.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb3977fe700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:35.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb396ffd700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 0x7fb398153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:35.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38ffff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c4e0 tx=0x7fb38000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:35.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.492+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800052d0 con 0x7fb3980c49f0 2023-08-27T11:29:35.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.493+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb380005430 con 0x7fb3980c49f0 2023-08-27T11:29:35.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.493+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb398156c90 con 0x7fb3980c49f0 2023-08-27T11:29:35.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.493+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3800038c0 con 0x7fb3980c49f0 2023-08-27T11:29:35.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.493+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3980ad8b0 con 0x7fb3980c49f0 2023-08-27T11:29:35.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.494+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39804ee70 con 0x7fb3980c49f0 2023-08-27T11:29:35.501 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.495+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb380003a20 con 0x7fb3980c49f0 2023-08-27T11:29:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.496+0000 7fb38f7fe700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 0x7fb37806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:35.502 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.496+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fb380087a20 con 0x7fb3980c49f0 2023-08-27T11:29:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.496+0000 7fb396ffd700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 0x7fb37806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.497+0000 7fb396ffd700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 0x7fb37806c5d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb3880011e0 tx=0x7fb388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:35.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.501+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb3800530d0 con 0x7fb3980c49f0 2023-08-27T11:29:35.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:35.756+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb3980aa460 con 0x7fb3980c49f0 2023-08-27T11:29:36.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.262+0000 7fb38f7fe700 1 -- 172.21.15.43:0/2722995976 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v147) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb3800566f0 con 0x7fb3980c49f0 2023-08-27T11:29:36.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.268+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 msgr2=0x7fb37806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.268+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 0x7fb37806c5d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb3880011e0 tx=0x7fb388009040 comp rx=0 tx=0).stop 2023-08-27T11:29:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.268+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 msgr2=0x7fb398149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.268+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb38000c4e0 tx=0x7fb38000c8a0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 shutdown_connections 2023-08-27T11:29:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb37806a110 0x7fb37806c5d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb3980c9690 0x7fb39814a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3980ac410 0x7fb398153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 --2- 172.21.15.43:0/2722995976 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb3980c49f0 0x7fb398149f80 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.269+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 >> 172.21.15.43:0/2722995976 conn(0x7fb3980ab8f0 msgr2=0x7fb3980c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:36.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.271+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 shutdown_connections 2023-08-27T11:29:36.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.272+0000 7fb39d7ff700 1 -- 172.21.15.43:0/2722995976 wait complete. 2023-08-27T11:29:36.284 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 23 and data pool 24 2023-08-27T11:29:36.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:36.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.510+0000 7fcfba7ff700 1 Processor -- start 2023-08-27T11:29:36.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.510+0000 7fcfba7ff700 1 -- start start 2023-08-27T11:29:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.511+0000 7fcfba7ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfb4151a90 0x7fcfb40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.511+0000 7fcfba7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfba7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb406c4e0 con 0x7fcfb40c4630 2023-08-27T11:29:36.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfba7ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb4155370 con 0x7fcfb4151a90 2023-08-27T11:29:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfba7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4151e70 con 0x7fcfb40c4a90 2023-08-27T11:29:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfb4151a90 0x7fcfb40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fcfb4151a90 0x7fcfb40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58746/0 (socket says 172.21.15.43:58746) 2023-08-27T11:29:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 -- 172.21.15.43:0/420801596 learned_addr learned my addr 172.21.15.43:0/420801596 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:36.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb37fe700 1 --1- 172.21.15.43:0/420801596 >> v1:172.21.15.43:6789/0 conn(0x7fcfb40c4630 0x7fcfb406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36616/0 (socket says 172.21.15.43:36616) 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb8d9c700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 -- 172.21.15.43:0/420801596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 msgr2=0x7fcfb406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 -- 172.21.15.43:0/420801596 >> v1:172.21.15.43:6789/0 conn(0x7fcfb40c4630 legacy=0x7fcfb406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 -- 172.21.15.43:0/420801596 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4154480 con 0x7fcfb4151a90 2023-08-27T11:29:36.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/420801596 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351936172 0 0) 0x7fcfb406c4e0 con 0x7fcfb40c4630 2023-08-27T11:29:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.512+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c7bb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40098f0 tx=0x7fcfa4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bf9298f9660de2 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/420801596 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400b8a0 con 0x7fcfb4151a90 2023-08-27T11:29:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/420801596 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400ba00 con 0x7fcfb4151a90 2023-08-27T11:29:36.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfb2ffd700 1 -- 172.21.15.43:0/420801596 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400bd90 con 0x7fcfb4151a90 2023-08-27T11:29:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 -- 172.21.15.43:0/420801596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb4151a90 msgr2=0x7fcfb40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c7bb0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40098f0 tx=0x7fcfa4009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:36.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 -- 172.21.15.43:0/420801596 shutdown_connections 2023-08-27T11:29:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/420801596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c7bb0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 -- 172.21.15.43:0/420801596 >> 172.21.15.43:0/420801596 conn(0x7fcfb40ab820 msgr2=0x7fcfb40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 -- 172.21.15.43:0/420801596 shutdown_connections 2023-08-27T11:29:36.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.513+0000 7fcfba7ff700 1 -- 172.21.15.43:0/420801596 wait complete. 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.515+0000 7fcfba7ff700 1 Processor -- start 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.515+0000 7fcfba7ff700 1 -- start start 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40be440 con 0x7fcfb40c4630 2023-08-27T11:29:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40ab630 con 0x7fcfb4151a90 2023-08-27T11:29:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.516+0000 7fcfba7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41ea5b0 con 0x7fcfb40c4a90 2023-08-27T11:29:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58756/0 (socket says 172.21.15.43:58756) 2023-08-27T11:29:36.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 -- 172.21.15.43:0/31253539 learned_addr learned my addr 172.21.15.43:0/31253539 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb8d9c700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 -- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 msgr2=0x7fcfb40c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb40c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 -- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb4151a90 msgr2=0x7fcfb40c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 -- 172.21.15.43:0/31253539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4009550 con 0x7fcfb40c4630 2023-08-27T11:29:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb3fff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009130 tx=0x7fcfa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.517+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40036a0 con 0x7fcfb40c4630 2023-08-27T11:29:36.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.518+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa401e070 con 0x7fcfb40c4630 2023-08-27T11:29:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.518+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40c7900 con 0x7fcfb40c4630 2023-08-27T11:29:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.518+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4003a20 con 0x7fcfb40c4630 2023-08-27T11:29:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.518+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb40c9390 con 0x7fcfb40c4630 2023-08-27T11:29:36.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.519+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40c7e20 con 0x7fcfb40c4630 2023-08-27T11:29:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.520+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcfa4003b80 con 0x7fcfb40c4630 2023-08-27T11:29:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.521+0000 7fcfb0ff9700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 0x7fcfa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.521+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfa4020070 con 0x7fcfb40c4630 2023-08-27T11:29:36.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.521+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 0x7fcfa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.522+0000 7fcfb37fe700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 0x7fcfa006c5a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcfb414c670 tx=0x7fcfa8007be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.526+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcfa4055130 con 0x7fcfb40c4630 2023-08-27T11:29:36.739 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.738+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb404ee70 con 0x7fcfb40c4630 2023-08-27T11:29:36.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.739+0000 7fcfb0ff9700 1 -- 172.21.15.43:0/31253539 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18188 (secure 0 0 0) 0x7fcfa4058750 con 0x7fcfb40c4630 2023-08-27T11:29:36.741 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:36.741 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":143,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:35.758122+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:36.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.741+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 msgr2=0x7fcfa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.741+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 0x7fcfa006c5a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcfb414c670 tx=0x7fcfa8007be0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.741+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 msgr2=0x7fcfb4152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.741+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009130 tx=0x7fcfa4004750 comp rx=0 tx=0).stop 2023-08-27T11:29:36.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 shutdown_connections 2023-08-27T11:29:36.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcfa006a0e0 0x7fcfa006c5a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcfb4151a90 0x7fcfb40c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcfb40c4630 0x7fcfb4152280 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 --2- 172.21.15.43:0/31253539 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcfb40c4a90 0x7fcfb40c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 >> 172.21.15.43:0/31253539 conn(0x7fcfb40ab820 msgr2=0x7fcfb40c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:36.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 shutdown_connections 2023-08-27T11:29:36.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.742+0000 7fcfba7ff700 1 -- 172.21.15.43:0/31253539 wait complete. 2023-08-27T11:29:36.762 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:36.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.963+0000 7fe95adff700 1 Processor -- start 2023-08-27T11:29:36.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.963+0000 7fe95adff700 1 -- start start 2023-08-27T11:29:36.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe954151a90 0x7fe9540c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 0x7fe9540c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe95406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95406c4e0 con 0x7fe954151a90 2023-08-27T11:29:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe954155370 con 0x7fe9540c4630 2023-08-27T11:29:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe95adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe954151e70 con 0x7fe95406ad70 2023-08-27T11:29:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe958b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe954151a90 0x7fe9540c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe958b9b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe954151a90 0x7fe9540c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58758/0 (socket says 172.21.15.43:58758) 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.964+0000 7fe958b9b700 1 -- 172.21.15.43:0/473892793 learned_addr learned my addr 172.21.15.43:0/473892793 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe95939c700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe95406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 -- 172.21.15.43:0/473892793 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 msgr2=0x7fe95406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe953fff700 1 --2- 172.21.15.43:0/473892793 >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 0x7fe9540c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe95406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 -- 172.21.15.43:0/473892793 >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 msgr2=0x7fe9540c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 --2- 172.21.15.43:0/473892793 >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 0x7fe9540c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 -- 172.21.15.43:0/473892793 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954154480 con 0x7fe954151a90 2023-08-27T11:29:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe95939c700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe95406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe953fff700 1 --2- 172.21.15.43:0/473892793 >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 0x7fe9540c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:36.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe958b9b700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540c7bb0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe9540c7740 tx=0x7fe948009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc8b6c3458d3e0b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe9537fe700 1 -- 172.21.15.43:0/473892793 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94800b870 con 0x7fe954151a90 2023-08-27T11:29:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe9537fe700 1 -- 172.21.15.43:0/473892793 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94800b9d0 con 0x7fe954151a90 2023-08-27T11:29:36.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.965+0000 7fe9537fe700 1 -- 172.21.15.43:0/473892793 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94800bd60 con 0x7fe954151a90 2023-08-27T11:29:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 -- 172.21.15.43:0/473892793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 msgr2=0x7fe9540c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540c7bb0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe9540c7740 tx=0x7fe948009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 -- 172.21.15.43:0/473892793 shutdown_connections 2023-08-27T11:29:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe95406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 --2- 172.21.15.43:0/473892793 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540c7bb0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 --2- 172.21.15.43:0/473892793 >> v2:172.21.15.57:3300/0 conn(0x7fe9540c4630 0x7fe9540c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 -- 172.21.15.43:0/473892793 >> 172.21.15.43:0/473892793 conn(0x7fe9540ab820 msgr2=0x7fe9540abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 -- 172.21.15.43:0/473892793 shutdown_connections 2023-08-27T11:29:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.966+0000 7fe95adff700 1 -- 172.21.15.43:0/473892793 wait complete. 2023-08-27T11:29:36.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.968+0000 7fe95adff700 1 Processor -- start 2023-08-27T11:29:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.968+0000 7fe95adff700 1 -- start start 2023-08-27T11:29:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.968+0000 7fe95adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe9540c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540c4630 0x7fe9541ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9540c13c0 con 0x7fe954151a90 2023-08-27T11:29:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541e96d0 con 0x7fe9540c4630 2023-08-27T11:29:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541e9970 con 0x7fe95406ad70 2023-08-27T11:29:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58760/0 (socket says 172.21.15.43:58760) 2023-08-27T11:29:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 -- 172.21.15.43:0/4261930342 learned_addr learned my addr 172.21.15.43:0/4261930342 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe958b9b700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe9540c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe953fff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540c4630 0x7fe9541ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 -- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 msgr2=0x7fe9540c24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe9540c24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 -- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540c4630 msgr2=0x7fe9541ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:36.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540c4630 0x7fe9541ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:36.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.969+0000 7fe95939c700 1 -- 172.21.15.43:0/4261930342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948009550 con 0x7fe954151a90 2023-08-27T11:29:36.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe95939c700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00cef0 tx=0x7fe94c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00ad00 con 0x7fe954151a90 2023-08-27T11:29:36.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c00ae60 con 0x7fe954151a90 2023-08-27T11:29:36.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c015680 con 0x7fe954151a90 2023-08-27T11:29:36.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9541edb40 con 0x7fe954151a90 2023-08-27T11:29:36.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.970+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95414d160 con 0x7fe954151a90 2023-08-27T11:29:36.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.971+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9541e9b00 con 0x7fe954151a90 2023-08-27T11:29:36.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.972+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe94c00d430 con 0x7fe954151a90 2023-08-27T11:29:36.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.973+0000 7fe9517fa700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 0x7fe93806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:36.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.973+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe94c088a80 con 0x7fe954151a90 2023-08-27T11:29:36.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.974+0000 7fe958b9b700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 0x7fe93806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:36.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.974+0000 7fe958b9b700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 0x7fe93806c5a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe948014040 tx=0x7fe948008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:36.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:36.978+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe94c0540d0 con 0x7fe954151a90 2023-08-27T11:29:37.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.190+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe954154cf0 con 0x7fe954151a90 2023-08-27T11:29:37.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.192+0000 7fe9517fa700 1 -- 172.21.15.43:0/4261930342 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18188 (secure 0 0 0) 0x7fe94c01a090 con 0x7fe954151a90 2023-08-27T11:29:37.193 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:37.194 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":143,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:35.758122+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 msgr2=0x7fe93806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 0x7fe93806c5a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe948014040 tx=0x7fe948008030 comp rx=0 tx=0).stop 2023-08-27T11:29:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 msgr2=0x7fe9540aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:37.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00cef0 tx=0x7fe94c00cf20 comp rx=0 tx=0).stop 2023-08-27T11:29:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 shutdown_connections 2023-08-27T11:29:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fe93806a0e0 0x7fe93806c5a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe954151a90 0x7fe9540aada0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe95406ad70 0x7fe9540c24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 --2- 172.21.15.43:0/4261930342 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe9540c4630 0x7fe9541ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 >> 172.21.15.43:0/4261930342 conn(0x7fe9540ab820 msgr2=0x7fe95406b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:37.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 shutdown_connections 2023-08-27T11:29:37.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.194+0000 7fe95adff700 1 -- 172.21.15.43:0/4261930342 wait complete. 2023-08-27T11:29:37.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-27T11:29:37.423 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.422+0000 7fb33adff700 1 Processor -- start 2023-08-27T11:29:37.424 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.422+0000 7fb33adff700 1 -- start start 2023-08-27T11:29:37.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb33406ea60 0x7fb33406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb33406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb334155960 0x7fb334155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.426 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340c5ce0 con 0x7fb334155960 2023-08-27T11:29:37.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3340c6070 con 0x7fb33406ea60 2023-08-27T11:29:37.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3340c22c0 con 0x7fb3340c4f90 2023-08-27T11:29:37.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb334155960 0x7fb334155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb334155960 0x7fb334155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58772/0 (socket says 172.21.15.43:58772) 2023-08-27T11:29:37.427 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 -- 172.21.15.43:0/3542693619 learned_addr learned my addr 172.21.15.43:0/3542693619 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:37.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb333fff700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb33406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb338b9b700 1 --2- 172.21.15.43:0/3542693619 >> v2:172.21.15.57:3300/0 conn(0x7fb33406ea60 0x7fb33406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 -- 172.21.15.43:0/3542693619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 msgr2=0x7fb33406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:37.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb33406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.428 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 -- 172.21.15.43:0/3542693619 >> v2:172.21.15.57:3300/0 conn(0x7fb33406ea60 msgr2=0x7fb33406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:37.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 --2- 172.21.15.43:0/3542693619 >> v2:172.21.15.57:3300/0 conn(0x7fb33406ea60 0x7fb33406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.424+0000 7fb33939c700 1 -- 172.21.15.43:0/3542693619 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340c25a0 con 0x7fb334155960 2023-08-27T11:29:37.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb33939c700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb334155db0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb3340a9780 tx=0x7fb32c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf7477a53121f24 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:37.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb3337fe700 1 -- 172.21.15.43:0/3542693619 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00e070 con 0x7fb334155960 2023-08-27T11:29:37.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb3337fe700 1 -- 172.21.15.43:0/3542693619 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c00b9c0 con 0x7fb334155960 2023-08-27T11:29:37.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb3337fe700 1 -- 172.21.15.43:0/3542693619 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00bd70 con 0x7fb334155960 2023-08-27T11:29:37.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb33adff700 1 -- 172.21.15.43:0/3542693619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 msgr2=0x7fb334155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:37.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.425+0000 7fb33adff700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb334155db0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fb3340a9780 tx=0x7fb32c00b330 comp rx=0 tx=0).stop 2023-08-27T11:29:37.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 -- 172.21.15.43:0/3542693619 shutdown_connections 2023-08-27T11:29:37.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb334155db0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 --2- 172.21.15.43:0/3542693619 >> v2:172.21.15.57:3300/0 conn(0x7fb33406ea60 0x7fb33406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 --2- 172.21.15.43:0/3542693619 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb33406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 -- 172.21.15.43:0/3542693619 >> 172.21.15.43:0/3542693619 conn(0x7fb3340c6a40 msgr2=0x7fb3340c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:37.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 -- 172.21.15.43:0/3542693619 shutdown_connections 2023-08-27T11:29:37.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.426+0000 7fb33adff700 1 -- 172.21.15.43:0/3542693619 wait complete. 2023-08-27T11:29:37.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.427+0000 7fb33adff700 1 Processor -- start 2023-08-27T11:29:37.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.427+0000 7fb33adff700 1 -- start start 2023-08-27T11:29:37.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb33406ea60 0x7fb33409ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb3341529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb334152ee0 con 0x7fb334155960 2023-08-27T11:29:37.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3341ecc30 con 0x7fb33406ea60 2023-08-27T11:29:37.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.428+0000 7fb33adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3341ece80 con 0x7fb3340c4f90 2023-08-27T11:29:37.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58784/0 (socket says 172.21.15.43:58784) 2023-08-27T11:29:37.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 -- 172.21.15.43:0/334937277 learned_addr learned my addr 172.21.15.43:0/334937277 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:37.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb338b9b700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb33406ea60 0x7fb33409ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.436 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb333fff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb3341529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 -- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 msgr2=0x7fb3341529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:37.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb3341529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 -- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb33406ea60 msgr2=0x7fb33409ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:37.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb33406ea60 0x7fb33409ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:37.437 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 -- 172.21.15.43:0/334937277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009b30 con 0x7fb334155960 2023-08-27T11:29:37.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb33939c700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb33406efc0 tx=0x7fb32c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:37.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.429+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0099b0 con 0x7fb334155960 2023-08-27T11:29:37.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.430+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c004250 con 0x7fb334155960 2023-08-27T11:29:37.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.430+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c004600 con 0x7fb334155960 2023-08-27T11:29:37.438 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.430+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3341ed160 con 0x7fb334155960 2023-08-27T11:29:37.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.430+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3341ed720 con 0x7fb334155960 2023-08-27T11:29:37.439 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.431+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3340c5460 con 0x7fb334155960 2023-08-27T11:29:37.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.432+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb32c004760 con 0x7fb334155960 2023-08-27T11:29:37.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.433+0000 7fb3317fa700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 0x7fb31806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:37.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.433+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb32c0898f0 con 0x7fb334155960 2023-08-27T11:29:37.440 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.433+0000 7fb338b9b700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 0x7fb31806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:37.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.434+0000 7fb338b9b700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 0x7fb31806c5d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb328006b20 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:37.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.437+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb32c054fd0 con 0x7fb334155960 2023-08-27T11:29:37.696 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:37.695+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb33404ee70 con 0x7fb334155960 2023-08-27T11:29:38.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.270+0000 7fb3317fa700 1 -- 172.21.15.43:0/334937277 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v150) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb32c0585f0 con 0x7fb334155960 2023-08-27T11:29:38.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.273+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 msgr2=0x7fb31806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.273+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 0x7fb31806c5d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb328006b20 tx=0x7fb328008040 comp rx=0 tx=0).stop 2023-08-27T11:29:38.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.273+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 msgr2=0x7fb3340aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.275 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.273+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fb33406efc0 tx=0x7fb32c004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.273+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 shutdown_connections 2023-08-27T11:29:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fb31806a110 0x7fb31806c5d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb334155960 0x7fb3340aa800 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb33406ea60 0x7fb33409ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.276 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 --2- 172.21.15.43:0/334937277 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb3340c4f90 0x7fb3341529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 >> 172.21.15.43:0/334937277 conn(0x7fb3340c6a40 msgr2=0x7fb33406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 shutdown_connections 2023-08-27T11:29:38.277 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.274+0000 7fb33adff700 1 -- 172.21.15.43:0/334937277 wait complete. 2023-08-27T11:29:38.296 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-27T11:29:38.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-27T11:29:38.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.505+0000 7f7fad9ff700 1 Processor -- start 2023-08-27T11:29:38.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.506+0000 7f7fad9ff700 1 -- start start 2023-08-27T11:29:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.507+0000 7f7fad9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7fa814e780 0x7f7fa81512b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.507+0000 7f7fad9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa80c0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.507+0000 7f7fad9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa80c03e0 con 0x7f7fa80c5150 2023-08-27T11:29:38.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.507+0000 7f7fad9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa8151900 con 0x7f7fa814e780 2023-08-27T11:29:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.507+0000 7f7fad9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa8151be0 con 0x7f7fa814eb60 2023-08-27T11:29:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f7fa814e780 0x7f7fa81512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f7fa80c5150 0x7f7fa806a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:36628/0 (socket says 172.21.15.43:36628) 2023-08-27T11:29:38.511 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa67fc700 1 -- 172.21.15.43:0/3036097221 learned_addr learned my addr 172.21.15.43:0/3036097221 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa77fe700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa80c0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 -- 172.21.15.43:0/3036097221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 msgr2=0x7f7fa80c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa80c0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 -- 172.21.15.43:0/3036097221 >> v1:172.21.15.43:6789/0 conn(0x7f7fa80c5150 legacy=0x7f7fa806a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 -- 172.21.15.43:0/3036097221 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8151ec0 con 0x7f7fa814e780 2023-08-27T11:29:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.508+0000 7f7fa6ffd700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa81512b0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c6ca78b913e306 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fa5ffb700 1 -- 172.21.15.43:0/3036097221 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011830 con 0x7f7fa814e780 2023-08-27T11:29:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fa5ffb700 1 -- 172.21.15.43:0/3036097221 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98011990 con 0x7f7fa814e780 2023-08-27T11:29:38.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fa5ffb700 1 -- 172.21.15.43:0/3036097221 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98011d20 con 0x7f7fa814e780 2023-08-27T11:29:38.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3036097221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 msgr2=0x7f7fa81512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa81512b0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009840 tx=0x7f7f98009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:38.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3036097221 shutdown_connections 2023-08-27T11:29:38.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa80c0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3036097221 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa81512b0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3036097221 >> 172.21.15.43:0/3036097221 conn(0x7f7fa80c5b10 msgr2=0x7f7fa80c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:38.517 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3036097221 shutdown_connections 2023-08-27T11:29:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.509+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3036097221 wait complete. 2023-08-27T11:29:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.511+0000 7f7fad9ff700 1 Processor -- start 2023-08-27T11:29:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.511+0000 7f7fad9ff700 1 -- start start 2023-08-27T11:29:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fa80c5150 0x7f7fa8143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa8145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c3d40 con 0x7f7fa814e780 2023-08-27T11:29:38.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa814a6d0 con 0x7f7fa80c5150 2023-08-27T11:29:38.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fad9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80c3710 con 0x7f7fa814eb60 2023-08-27T11:29:38.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fa67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fa67fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58804/0 (socket says 172.21.15.43:58804) 2023-08-27T11:29:38.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fa67fc700 1 -- 172.21.15.43:0/3387637113 learned_addr learned my addr 172.21.15.43:0/3387637113 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:38.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fa77fe700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa8145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.512+0000 7f7fa6ffd700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fa80c5150 0x7f7fa8143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 -- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 msgr2=0x7f7fa8145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa8145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 -- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fa80c5150 msgr2=0x7f7fa8143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:38.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fa80c5150 0x7f7fa8143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:38.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 -- 172.21.15.43:0/3387637113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f980094a0 con 0x7f7fa814e780 2023-08-27T11:29:38.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fa67fc700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c4b0 tx=0x7f7f9c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:38.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c005d70 con 0x7f7fa814e780 2023-08-27T11:29:38.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00ce80 con 0x7f7fa814e780 2023-08-27T11:29:38.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0072d0 con 0x7f7fa814e780 2023-08-27T11:29:38.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.513+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa8141880 con 0x7f7fa814e780 2023-08-27T11:29:38.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.514+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80c39d0 con 0x7f7fa814e780 2023-08-27T11:29:38.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.515+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa80c3ef0 con 0x7f7fa814e780 2023-08-27T11:29:38.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.515+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f9c007430 con 0x7f7fa814e780 2023-08-27T11:29:38.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.516+0000 7f7f8ffff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 0x7f7f9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:38.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.516+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f9c087730 con 0x7f7fa814e780 2023-08-27T11:29:38.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.516+0000 7f7fa6ffd700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 0x7f7f9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:38.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.517+0000 7f7fa6ffd700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 0x7f7f9406c5a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7f98000c00 tx=0x7f7f98008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:38.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.521+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7fa80c3ef0 con 0x7f7fa814e780 2023-08-27T11:29:38.782 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:38.781+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7fa804ee70 con 0x7f7fa814e780 2023-08-27T11:29:39.281 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.280+0000 7f7f8ffff700 1 -- 172.21.15.43:0/3387637113 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v151) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f9c052ec0 con 0x7f7fa814e780 2023-08-27T11:29:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 msgr2=0x7f7f9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 0x7f7f9406c5a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7f98000c00 tx=0x7f7f98008030 comp rx=0 tx=0).stop 2023-08-27T11:29:39.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 msgr2=0x7f7fa8144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c4b0 tx=0x7f7f9c00c7c0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 shutdown_connections 2023-08-27T11:29:39.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f7f9406a0e0 0x7f7f9406c5a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.285 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7fa814eb60 0x7f7fa8145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7fa80c5150 0x7f7fa8143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 --2- 172.21.15.43:0/3387637113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f7fa814e780 0x7f7fa8144f20 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 >> 172.21.15.43:0/3387637113 conn(0x7f7fa80c5b10 msgr2=0x7f7fa80c0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:39.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 shutdown_connections 2023-08-27T11:29:39.286 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.283+0000 7f7fad9ff700 1 -- 172.21.15.43:0/3387637113 wait complete. 2023-08-27T11:29:39.304 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-27T11:29:39.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:39.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.508+0000 7f3dec3ff700 1 Processor -- start 2023-08-27T11:29:39.510 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.508+0000 7f3dec3ff700 1 -- start start 2023-08-27T11:29:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3de4151a90 0x7f3de40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3de406ad70 0x7f3de406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.512 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de406c4e0 con 0x7f3de4151a90 2023-08-27T11:29:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de4155370 con 0x7f3de406ad70 2023-08-27T11:29:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dec3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4151e70 con 0x7f3de40c4630 2023-08-27T11:29:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dea19b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3de4151a90 0x7f3de40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.513 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.510+0000 7f3dea19b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3de4151a90 0x7f3de40c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35918/0 (socket says 172.21.15.43:35918) 2023-08-27T11:29:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 -- 172.21.15.43:0/3123679286 learned_addr learned my addr 172.21.15.43:0/3123679286 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3de999a700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea99c700 1 --2- 172.21.15.43:0/3123679286 >> v2:172.21.15.57:3300/0 conn(0x7f3de406ad70 0x7f3de406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 -- 172.21.15.43:0/3123679286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 msgr2=0x7f3de40c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:39.514 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de40c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 -- 172.21.15.43:0/3123679286 >> v2:172.21.15.57:3300/0 conn(0x7f3de406ad70 msgr2=0x7f3de406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 --2- 172.21.15.43:0/3123679286 >> v2:172.21.15.57:3300/0 conn(0x7f3de406ad70 0x7f3de406b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 -- 172.21.15.43:0/3123679286 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4154480 con 0x7f3de4151a90 2023-08-27T11:29:39.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3de999a700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:39.518 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3dea19b700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de4151a90 0x7f3de40c7bb0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f3de40bd700 tx=0x7f3de0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a5d0d673cc7542 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:39.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3de9199700 1 -- 172.21.15.43:0/3123679286 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000b870 con 0x7f3de4151a90 2023-08-27T11:29:39.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.511+0000 7f3de9199700 1 -- 172.21.15.43:0/3123679286 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000b9d0 con 0x7f3de4151a90 2023-08-27T11:29:39.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3de9199700 1 -- 172.21.15.43:0/3123679286 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000bd60 con 0x7f3de4151a90 2023-08-27T11:29:39.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 -- 172.21.15.43:0/3123679286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de4151a90 msgr2=0x7f3de40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de4151a90 0x7f3de40c7bb0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f3de40bd700 tx=0x7f3de0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 -- 172.21.15.43:0/3123679286 shutdown_connections 2023-08-27T11:29:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/3123679286 >> v2:172.21.15.57:3300/0 conn(0x7f3de406ad70 0x7f3de406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de4151a90 0x7f3de40c7bb0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/3123679286 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de40c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 -- 172.21.15.43:0/3123679286 >> 172.21.15.43:0/3123679286 conn(0x7f3de40ab820 msgr2=0x7f3de40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:39.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 -- 172.21.15.43:0/3123679286 shutdown_connections 2023-08-27T11:29:39.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.512+0000 7f3dec3ff700 1 -- 172.21.15.43:0/3123679286 wait complete. 2023-08-27T11:29:39.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.514+0000 7f3dec3ff700 1 Processor -- start 2023-08-27T11:29:39.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.514+0000 7f3dec3ff700 1 -- start start 2023-08-27T11:29:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de41e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 0x7f3de4146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41e75a0 con 0x7f3de406ad70 2023-08-27T11:29:39.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4147570 con 0x7f3de4151a90 2023-08-27T11:29:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dec3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40c0d80 con 0x7f3de40c4630 2023-08-27T11:29:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35920/0 (socket says 172.21.15.43:35920) 2023-08-27T11:29:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 -- 172.21.15.43:0/616625806 learned_addr learned my addr 172.21.15.43:0/616625806 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:39.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 -- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 msgr2=0x7f3de41e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de41e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea19b700 1 -- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 msgr2=0x7f3de4146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.515+0000 7f3dea99c700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 0x7f3de4146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dea19b700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 0x7f3de4146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dea19b700 1 -- 172.21.15.43:0/616625806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0009550 con 0x7f3de406ad70 2023-08-27T11:29:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dea99c700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 0x7f3de4146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dea19b700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f3de0014040 tx=0x7f3de0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0004520 con 0x7f3de406ad70 2023-08-27T11:29:39.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de001e070 con 0x7f3de406ad70 2023-08-27T11:29:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de414e710 con 0x7f3de406ad70 2023-08-27T11:29:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00038c0 con 0x7f3de406ad70 2023-08-27T11:29:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.516+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de40c7860 con 0x7f3de406ad70 2023-08-27T11:29:39.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.517+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de40c7a80 con 0x7f3de406ad70 2023-08-27T11:29:39.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.518+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3de0003a20 con 0x7f3de406ad70 2023-08-27T11:29:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.519+0000 7f3ddaffd700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 0x7f3dc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.519+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3de0020070 con 0x7f3de406ad70 2023-08-27T11:29:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.519+0000 7f3de999a700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 0x7f3dc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.520+0000 7f3de999a700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 0x7f3dc806c5a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3de40c3b30 tx=0x7f3dd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:39.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.524+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3de00551f0 con 0x7f3de406ad70 2023-08-27T11:29:39.776 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.775+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3de404ee70 con 0x7f3de406ad70 2023-08-27T11:29:39.777 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.775+0000 7f3ddaffd700 1 -- 172.21.15.43:0/616625806 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+4885 (secure 0 0 0) 0x7f3de0015090 con 0x7f3de406ad70 2023-08-27T11:29:39.777 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:39.777 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":151,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:39.269853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 msgr2=0x7f3dc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 0x7f3dc806c5a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f3de40c3b30 tx=0x7f3dd4008040 comp rx=0 tx=0).stop 2023-08-27T11:29:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 msgr2=0x7f3de4148fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f3de0014040 tx=0x7f3de0004750 comp rx=0 tx=0).stop 2023-08-27T11:29:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 shutdown_connections 2023-08-27T11:29:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f3dc806a0e0 0x7f3dc806c5a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.780 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3de4151a90 0x7f3de4146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3de406ad70 0x7f3de4148fe0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 --2- 172.21.15.43:0/616625806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3de40c4630 0x7f3de41e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 >> 172.21.15.43:0/616625806 conn(0x7f3de40ab820 msgr2=0x7f3de414b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 shutdown_connections 2023-08-27T11:29:39.781 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.778+0000 7f3dec3ff700 1 -- 172.21.15.43:0/616625806 wait complete. 2023-08-27T11:29:39.782 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 151 2023-08-27T11:29:39.797 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:29:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.997+0000 7fef1c1ff700 1 Processor -- start 2023-08-27T11:29:39.999 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.998+0000 7fef1c1ff700 1 -- start start 2023-08-27T11:29:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1c1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef140c51a0 0x7fef1406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1c1ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fef1406ca60 0x7fef140aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1c1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1406d700 con 0x7fef140ab040 2023-08-27T11:29:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1c1ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef141530b0 con 0x7fef1406ca60 2023-08-27T11:29:40.001 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1c1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1414c860 con 0x7fef140c51a0 2023-08-27T11:29:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1979a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fef1406ca60 0x7fef140aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1979a700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fef1406ca60 0x7fef140aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35934/0 (socket says 172.21.15.43:35934) 2023-08-27T11:29:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef1979a700 1 -- 172.21.15.43:0/3176966239 learned_addr learned my addr 172.21.15.43:0/3176966239 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:39.999+0000 7fef19f9b700 1 --2- 172.21.15.43:0/3176966239 >> v2:172.21.15.57:3300/0 conn(0x7fef140c51a0 0x7fef1406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.002 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef1979a700 1 -- 172.21.15.43:0/3176966239 >> v2:172.21.15.57:3300/0 conn(0x7fef140c51a0 msgr2=0x7fef1406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef1979a700 1 --2- 172.21.15.43:0/3176966239 >> v2:172.21.15.57:3300/0 conn(0x7fef140c51a0 0x7fef1406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef1979a700 1 -- 172.21.15.43:0/3176966239 >> v1:172.21.15.57:6789/0 conn(0x7fef140ab040 legacy=0x7fef14155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef1979a700 1 -- 172.21.15.43:0/3176966239 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14152430 con 0x7fef1406ca60 2023-08-27T11:29:40.003 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef1979a700 1 --2- 172.21.15.43:0/3176966239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef1406ca60 0x7fef140aab00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fef1406db90 tx=0x7fef04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6de5ae644cd54f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef18f99700 1 -- 172.21.15.43:0/3176966239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04011830 con 0x7fef1406ca60 2023-08-27T11:29:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef18f99700 1 -- 172.21.15.43:0/3176966239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04011990 con 0x7fef1406ca60 2023-08-27T11:29:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.000+0000 7fef18f99700 1 -- 172.21.15.43:0/3176966239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04011d20 con 0x7fef1406ca60 2023-08-27T11:29:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 -- 172.21.15.43:0/3176966239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef1406ca60 msgr2=0x7fef140aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.005 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/3176966239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef1406ca60 0x7fef140aab00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fef1406db90 tx=0x7fef04009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 -- 172.21.15.43:0/3176966239 shutdown_connections 2023-08-27T11:29:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/3176966239 >> v2:172.21.15.57:3300/0 conn(0x7fef140c51a0 0x7fef1406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/3176966239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef1406ca60 0x7fef140aab00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 -- 172.21.15.43:0/3176966239 >> 172.21.15.43:0/3176966239 conn(0x7fef1406aa50 msgr2=0x7fef140c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:40.006 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 -- 172.21.15.43:0/3176966239 shutdown_connections 2023-08-27T11:29:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.001+0000 7fef1c1ff700 1 -- 172.21.15.43:0/3176966239 wait complete. 2023-08-27T11:29:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.003+0000 7fef1c1ff700 1 Processor -- start 2023-08-27T11:29:40.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.003+0000 7fef1c1ff700 1 -- start start 2023-08-27T11:29:40.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.004+0000 7fef1c1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef1406ca60 0x7fef1414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1c1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef140ab040 0x7fef1414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1c1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1c1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140a5ed0 con 0x7fef140c51a0 2023-08-27T11:29:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1c1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef141eb2e0 con 0x7fef140ab040 2023-08-27T11:29:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1c1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef141eb810 con 0x7fef1406ca60 2023-08-27T11:29:40.010 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35942/0 (socket says 172.21.15.43:35942) 2023-08-27T11:29:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 -- 172.21.15.43:0/2814662572 learned_addr learned my addr 172.21.15.43:0/2814662572 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef19f9b700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef1406ca60 0x7fef1414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1979a700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef140ab040 0x7fef1414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 -- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef1406ca60 msgr2=0x7fef1414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef1406ca60 0x7fef1414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 -- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef140ab040 msgr2=0x7fef1414d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef140ab040 0x7fef1414d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.005+0000 7fef1a79c700 1 -- 172.21.15.43:0/2814662572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04009550 con 0x7fef140c51a0 2023-08-27T11:29:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef1a79c700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00cc80 tx=0x7fef0c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c003c00 con 0x7fef140c51a0 2023-08-27T11:29:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c003d60 con 0x7fef140c51a0 2023-08-27T11:29:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00aaa0 con 0x7fef140c51a0 2023-08-27T11:29:40.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef140a5900 con 0x7fef140c51a0 2023-08-27T11:29:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.006+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef140a5590 con 0x7fef140c51a0 2023-08-27T11:29:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.007+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1404ee70 con 0x7fef140c51a0 2023-08-27T11:29:40.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.008+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fef0c00ac00 con 0x7fef140c51a0 2023-08-27T11:29:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.009+0000 7fef0a7fc700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 0x7feef806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.009+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef0c088530 con 0x7fef140c51a0 2023-08-27T11:29:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.009+0000 7fef19f9b700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 0x7feef806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.015 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.010+0000 7fef19f9b700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 0x7feef806c5a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fef10009b40 tx=0x7fef10009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.013+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fef0c053c10 con 0x7fef140c51a0 2023-08-27T11:29:40.226 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.225+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef1406c840 con 0x7fef140c51a0 2023-08-27T11:29:40.227 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.226+0000 7fef0a7fc700 1 -- 172.21.15.43:0/2814662572 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18175 (secure 0 0 0) 0x7fef0c057230 con 0x7fef140c51a0 2023-08-27T11:29:40.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:40.228 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":144,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:37.239615+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:29:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.228+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 msgr2=0x7feef806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.228+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 0x7feef806c5a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fef10009b40 tx=0x7fef10009210 comp rx=0 tx=0).stop 2023-08-27T11:29:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.228+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 msgr2=0x7fef140a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.230 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.228+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00cc80 tx=0x7fef0c00cf90 comp rx=0 tx=0).stop 2023-08-27T11:29:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 shutdown_connections 2023-08-27T11:29:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7feef806a0e0 0x7feef806c5a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fef140c51a0 0x7fef140a72c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.231 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef1406ca60 0x7fef1414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 --2- 172.21.15.43:0/2814662572 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef140ab040 0x7fef1414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 >> 172.21.15.43:0/2814662572 conn(0x7fef1406aa50 msgr2=0x7fef140baec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 shutdown_connections 2023-08-27T11:29:40.232 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.229+0000 7fef1c1ff700 1 -- 172.21.15.43:0/2814662572 wait complete. 2023-08-27T11:29:40.248 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-27T11:29:40.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:29:40.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.451+0000 7fd8193ff700 1 Processor -- start 2023-08-27T11:29:40.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.451+0000 7fd8193ff700 1 -- start start 2023-08-27T11:29:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.452+0000 7fd8193ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd814151910 0x7fd814157a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.452+0000 7fd8193ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140c5ae0 con 0x7fd8140c15e0 2023-08-27T11:29:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd8193ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140c1190 con 0x7fd8140c51a0 2023-08-27T11:29:40.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd8193ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd814072900 con 0x7fd814151910 2023-08-27T11:29:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd8137fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd8140c15e0 0x7fd81415ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42354/0 (socket says 172.21.15.43:42354) 2023-08-27T11:29:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd8137fe700 1 -- 172.21.15.43:0/3580279640 learned_addr learned my addr 172.21.15.43:0/3580279640 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:40.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd812ffd700 1 --2- 172.21.15.43:0/3580279640 >> v2:172.21.15.57:3300/0 conn(0x7fd814151910 0x7fd814157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645007157 0 0) 0x7fd8140c5ae0 con 0x7fd8140c15e0 2023-08-27T11:29:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc0035b0 con 0x7fd8140c15e0 2023-08-27T11:29:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124698300 0 0) 0x7fd8140c1190 con 0x7fd8140c51a0 2023-08-27T11:29:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8140c5ae0 con 0x7fd8140c51a0 2023-08-27T11:29:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd812ffd700 1 -- 172.21.15.43:0/3580279640 >> v1:172.21.15.57:6789/0 conn(0x7fd8140c51a0 legacy=0x7fd8140c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd812ffd700 1 -- 172.21.15.43:0/3580279640 >> v1:172.21.15.43:6789/0 conn(0x7fd8140c15e0 legacy=0x7fd81415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.453+0000 7fd812ffd700 1 -- 172.21.15.43:0/3580279640 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140c6c00 con 0x7fd814151910 2023-08-27T11:29:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd812ffd700 1 --2- 172.21.15.43:0/3580279640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd814151910 0x7fd814157a00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd804009840 tx=0x7fd804009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db28201f620cd8e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804011830 con 0x7fd814151910 2023-08-27T11:29:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804011990 con 0x7fd814151910 2023-08-27T11:29:40.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd811ffb700 1 -- 172.21.15.43:0/3580279640 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804011d20 con 0x7fd814151910 2023-08-27T11:29:40.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd8193ff700 1 -- 172.21.15.43:0/3580279640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd814151910 msgr2=0x7fd814157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.454+0000 7fd8193ff700 1 --2- 172.21.15.43:0/3580279640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd814151910 0x7fd814157a00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd804009840 tx=0x7fd804009b50 comp rx=0 tx=0).stop 2023-08-27T11:29:40.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.455+0000 7fd8193ff700 1 -- 172.21.15.43:0/3580279640 shutdown_connections 2023-08-27T11:29:40.464 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.455+0000 7fd8193ff700 1 --2- 172.21.15.43:0/3580279640 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd814151910 0x7fd814157a00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.455+0000 7fd8193ff700 1 -- 172.21.15.43:0/3580279640 >> 172.21.15.43:0/3580279640 conn(0x7fd8140a9740 msgr2=0x7fd8140a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:40.465 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.455+0000 7fd8193ff700 1 -- 172.21.15.43:0/3580279640 shutdown_connections 2023-08-27T11:29:40.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.455+0000 7fd8193ff700 1 -- 172.21.15.43:0/3580279640 wait complete. 2023-08-27T11:29:40.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.456+0000 7fd8193ff700 1 Processor -- start 2023-08-27T11:29:40.466 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.456+0000 7fd8193ff700 1 -- start start 2023-08-27T11:29:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8140c51a0 0x7fd81414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.467 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd814151910 0x7fd8141ed250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140aaf20 con 0x7fd8140c15e0 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140ab410 con 0x7fd8140c51a0 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.457+0000 7fd8193ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8141ecd70 con 0x7fd814151910 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35958/0 (socket says 172.21.15.43:35958) 2023-08-27T11:29:40.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 -- 172.21.15.43:0/948242785 learned_addr learned my addr 172.21.15.43:0/948242785 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd8127fc700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8140c51a0 0x7fd81414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd8137fe700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd814151910 0x7fd8141ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 -- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd814151910 msgr2=0x7fd8141ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd814151910 0x7fd8141ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 -- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8140c51a0 msgr2=0x7fd81414c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8140c51a0 0x7fd81414c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.458+0000 7fd812ffd700 1 -- 172.21.15.43:0/948242785 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040094a0 con 0x7fd8140c15e0 2023-08-27T11:29:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd812ffd700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd8040090b0 tx=0x7fd804004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80401a6e0 con 0x7fd8140c15e0 2023-08-27T11:29:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80401a840 con 0x7fd8140c15e0 2023-08-27T11:29:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80401abb0 con 0x7fd8140c15e0 2023-08-27T11:29:40.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8141ea4a0 con 0x7fd8140c15e0 2023-08-27T11:29:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.459+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81414cd50 con 0x7fd8140c15e0 2023-08-27T11:29:40.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.460+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81404ee70 con 0x7fd8140c15e0 2023-08-27T11:29:40.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.461+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd804022070 con 0x7fd8140c15e0 2023-08-27T11:29:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.462+0000 7fd7fb7fe700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 0x7fd80006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.462+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd804089010 con 0x7fd8140c15e0 2023-08-27T11:29:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.462+0000 7fd8127fc700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 0x7fd80006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.463+0000 7fd8127fc700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 0x7fd80006c5a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd8141506e0 tx=0x7fd808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.466+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd804054840 con 0x7fd8140c15e0 2023-08-27T11:29:40.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.672+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd814072340 con 0x7fd80006a0e0 2023-08-27T11:29:40.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.683+0000 7fd7fb7fe700 1 -- 172.21.15.43:0/948242785 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306507 (secure 0 0 0) 0x7fd808001cb0 con 0x7fd80006a0e0 2023-08-27T11:29:40.688 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:40.690 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 msgr2=0x7fd80006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 0x7fd80006c5a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd8141506e0 tx=0x7fd808009040 comp rx=0 tx=0).stop 2023-08-27T11:29:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 msgr2=0x7fd814157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd8040090b0 tx=0x7fd804004750 comp rx=0 tx=0).stop 2023-08-27T11:29:40.691 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 shutdown_connections 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fd80006a0e0 0x7fd80006c5a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd814151910 0x7fd8141ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd8140c15e0 0x7fd814157fe0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 --2- 172.21.15.43:0/948242785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd8140c51a0 0x7fd81414c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 >> 172.21.15.43:0/948242785 conn(0x7fd8140a9740 msgr2=0x7fd8140a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:40.692 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 shutdown_connections 2023-08-27T11:29:40.693 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.687+0000 7fd8193ff700 1 -- 172.21.15.43:0/948242785 wait complete. 2023-08-27T11:29:40.693 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:29:40.707 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-08-27T11:29:40.397527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251960,"kb_used_data":15000,"kb_used_omap":13,"kb_used_meta":236850,"kb_avail":754722760,"statfs":{"total":773094113280,"available":772836106240,"internally_reserved":0,"allocated":15360000,"data_stored":7903208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":242534488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251112+0000","last_change":"2023-08-27T11:29:35.251112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251112+0000","last_undegraded":"2023-08-27T11:29:35.251112+0000","last_fullsized":"2023-08-27T11:29:35.251112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255173+0000","last_change":"2023-08-27T11:29:35.255173+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255173+0000","last_undegraded":"2023-08-27T11:29:35.255173+0000","last_fullsized":"2023-08-27T11:29:35.255173+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250843+0000","last_change":"2023-08-27T11:29:35.250843+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250843+0000","last_undegraded":"2023-08-27T11:29:35.250843+0000","last_fullsized":"2023-08-27T11:29:35.250843+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250770+0000","last_change":"2023-08-27T11:29:35.250770+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250770+0000","last_undegraded":"2023-08-27T11:29:35.250770+0000","last_fullsized":"2023-08-27T11:29:35.250770+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250310+0000","last_change":"2023-08-27T11:29:35.250310+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250310+0000","last_undegraded":"2023-08-27T11:29:35.250310+0000","last_fullsized":"2023-08-27T11:29:35.250310+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255834+0000","last_change":"2023-08-27T11:29:35.255834+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255834+0000","last_undegraded":"2023-08-27T11:29:35.255834+0000","last_fullsized":"2023-08-27T11:29:35.255834+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249800+0000","last_change":"2023-08-27T11:29:35.249800+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249800+0000","last_undegraded":"2023-08-27T11:29:35.249800+0000","last_fullsized":"2023-08-27T11:29:35.249800+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250724+0000","last_change":"2023-08-27T11:29:35.250724+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250724+0000","last_undegraded":"2023-08-27T11:29:35.250724+0000","last_fullsized":"2023-08-27T11:29:35.250724+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252253+0000","last_change":"2023-08-27T11:29:35.252253+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252253+0000","last_undegraded":"2023-08-27T11:29:35.252253+0000","last_fullsized":"2023-08-27T11:29:35.252253+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252722+0000","last_change":"2023-08-27T11:29:35.252722+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252722+0000","last_undegraded":"2023-08-27T11:29:35.252722+0000","last_fullsized":"2023-08-27T11:29:35.252722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258661+0000","last_change":"2023-08-27T11:29:35.258661+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258661+0000","last_undegraded":"2023-08-27T11:29:35.258661+0000","last_fullsized":"2023-08-27T11:29:35.258661+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254702+0000","last_change":"2023-08-27T11:29:35.254702+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254702+0000","last_undegraded":"2023-08-27T11:29:35.254702+0000","last_fullsized":"2023-08-27T11:29:35.254702+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244694+0000","last_change":"2023-08-27T11:29:35.244694+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244694+0000","last_undegraded":"2023-08-27T11:29:35.244694+0000","last_fullsized":"2023-08-27T11:29:35.244694+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250569+0000","last_change":"2023-08-27T11:29:35.250569+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250569+0000","last_undegraded":"2023-08-27T11:29:35.250569+0000","last_fullsized":"2023-08-27T11:29:35.250569+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260356+0000","last_change":"2023-08-27T11:29:35.260356+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260356+0000","last_undegraded":"2023-08-27T11:29:35.260356+0000","last_fullsized":"2023-08-27T11:29:35.260356+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250804+0000","last_change":"2023-08-27T11:29:35.250804+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250804+0000","last_undegraded":"2023-08-27T11:29:35.250804+0000","last_fullsized":"2023-08-27T11:29:35.250804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251802+0000","last_change":"2023-08-27T11:29:35.251802+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251802+0000","last_undegraded":"2023-08-27T11:29:35.251802+0000","last_fullsized":"2023-08-27T11:29:35.251802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254211+0000","last_change":"2023-08-27T11:29:35.254211+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254211+0000","last_undegraded":"2023-08-27T11:29:35.254211+0000","last_fullsized":"2023-08-27T11:29:35.254211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259615+0000","last_change":"2023-08-27T11:29:35.259615+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259615+0000","last_undegraded":"2023-08-27T11:29:35.259615+0000","last_fullsized":"2023-08-27T11:29:35.259615+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244622+0000","last_change":"2023-08-27T11:29:35.244622+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244622+0000","last_undegraded":"2023-08-27T11:29:35.244622+0000","last_fullsized":"2023-08-27T11:29:35.244622+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243368+0000","last_change":"2023-08-27T11:29:35.243368+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243368+0000","last_undegraded":"2023-08-27T11:29:35.243368+0000","last_fullsized":"2023-08-27T11:29:35.243368+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255112+0000","last_change":"2023-08-27T11:29:35.255112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255112+0000","last_undegraded":"2023-08-27T11:29:35.255112+0000","last_fullsized":"2023-08-27T11:29:35.255112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251271+0000","last_change":"2023-08-27T11:29:35.251271+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251271+0000","last_undegraded":"2023-08-27T11:29:35.251271+0000","last_fullsized":"2023-08-27T11:29:35.251271+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250275+0000","last_change":"2023-08-27T11:29:35.250275+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250275+0000","last_undegraded":"2023-08-27T11:29:35.250275+0000","last_fullsized":"2023-08-27T11:29:35.250275+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244503+0000","last_change":"2023-08-27T11:29:35.244503+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244503+0000","last_undegraded":"2023-08-27T11:29:35.244503+0000","last_fullsized":"2023-08-27T11:29:35.244503+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.247261+0000","last_change":"2023-08-27T11:29:35.247261+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.247261+0000","last_undegraded":"2023-08-27T11:29:35.247261+0000","last_fullsized":"2023-08-27T11:29:35.247261+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256450+0000","last_change":"2023-08-27T11:29:35.256450+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256450+0000","last_undegraded":"2023-08-27T11:29:35.256450+0000","last_fullsized":"2023-08-27T11:29:35.256450+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245026+0000","last_change":"2023-08-27T11:29:35.245026+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245026+0000","last_undegraded":"2023-08-27T11:29:35.245026+0000","last_fullsized":"2023-08-27T11:29:35.245026+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257649+0000","last_change":"2023-08-27T11:29:35.257649+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257649+0000","last_undegraded":"2023-08-27T11:29:35.257649+0000","last_fullsized":"2023-08-27T11:29:35.257649+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254000+0000","last_change":"2023-08-27T11:29:35.254000+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254000+0000","last_undegraded":"2023-08-27T11:29:35.254000+0000","last_fullsized":"2023-08-27T11:29:35.254000+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259828+0000","last_change":"2023-08-27T11:29:35.259828+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259828+0000","last_undegraded":"2023-08-27T11:29:35.259828+0000","last_fullsized":"2023-08-27T11:29:35.259828+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253331+0000","last_change":"2023-08-27T11:29:35.253331+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253331+0000","last_undegraded":"2023-08-27T11:29:35.253331+0000","last_fullsized":"2023-08-27T11:29:35.253331+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257612+0000","last_change":"2023-08-27T11:29:35.257612+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257612+0000","last_undegraded":"2023-08-27T11:29:35.257612+0000","last_fullsized":"2023-08-27T11:29:35.257612+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.265746+0000","last_change":"2023-08-27T11:29:35.262477+0000","last_active":"2023-08-27T11:29:35.265746+0000","last_peered":"2023-08-27T11:29:35.265746+0000","last_clean":"2023-08-27T11:29:35.265746+0000","last_became_active":"2023-08-27T11:29:35.262122+0000","last_became_peered":"2023-08-27T11:29:35.262122+0000","last_unstale":"2023-08-27T11:29:35.265746+0000","last_undegraded":"2023-08-27T11:29:35.265746+0000","last_fullsized":"2023-08-27T11:29:35.265746+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:45:01.498491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242830+0000","last_change":"2023-08-27T11:29:35.242830+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242830+0000","last_undegraded":"2023-08-27T11:29:35.242830+0000","last_fullsized":"2023-08-27T11:29:35.242830+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266823+0000","last_change":"2023-08-27T11:29:35.261806+0000","last_active":"2023-08-27T11:29:35.266823+0000","last_peered":"2023-08-27T11:29:35.266823+0000","last_clean":"2023-08-27T11:29:35.266823+0000","last_became_active":"2023-08-27T11:29:35.261521+0000","last_became_peered":"2023-08-27T11:29:35.261521+0000","last_unstale":"2023-08-27T11:29:35.266823+0000","last_undegraded":"2023-08-27T11:29:35.266823+0000","last_fullsized":"2023-08-27T11:29:35.266823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:38.230227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250127+0000","last_change":"2023-08-27T11:29:35.250127+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250127+0000","last_undegraded":"2023-08-27T11:29:35.250127+0000","last_fullsized":"2023-08-27T11:29:35.250127+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275158+0000","last_change":"2023-08-27T11:29:35.270214+0000","last_active":"2023-08-27T11:29:35.275158+0000","last_peered":"2023-08-27T11:29:35.275158+0000","last_clean":"2023-08-27T11:29:35.275158+0000","last_became_active":"2023-08-27T11:29:35.269755+0000","last_became_peered":"2023-08-27T11:29:35.269755+0000","last_unstale":"2023-08-27T11:29:35.275158+0000","last_undegraded":"2023-08-27T11:29:35.275158+0000","last_fullsized":"2023-08-27T11:29:35.275158+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:38.942747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257233+0000","last_change":"2023-08-27T11:29:35.257233+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257233+0000","last_undegraded":"2023-08-27T11:29:35.257233+0000","last_fullsized":"2023-08-27T11:29:35.257233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268491+0000","last_change":"2023-08-27T11:29:35.262484+0000","last_active":"2023-08-27T11:29:35.268491+0000","last_peered":"2023-08-27T11:29:35.268491+0000","last_clean":"2023-08-27T11:29:35.268491+0000","last_became_active":"2023-08-27T11:29:35.262188+0000","last_became_peered":"2023-08-27T11:29:35.262188+0000","last_unstale":"2023-08-27T11:29:35.268491+0000","last_undegraded":"2023-08-27T11:29:35.268491+0000","last_fullsized":"2023-08-27T11:29:35.268491+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:48.393606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253359+0000","last_change":"2023-08-27T11:29:35.253359+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253359+0000","last_undegraded":"2023-08-27T11:29:35.253359+0000","last_fullsized":"2023-08-27T11:29:35.253359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268126+0000","last_change":"2023-08-27T11:29:35.265293+0000","last_active":"2023-08-27T11:29:35.268126+0000","last_peered":"2023-08-27T11:29:35.268126+0000","last_clean":"2023-08-27T11:29:35.268126+0000","last_became_active":"2023-08-27T11:29:35.265025+0000","last_became_peered":"2023-08-27T11:29:35.265025+0000","last_unstale":"2023-08-27T11:29:35.268126+0000","last_undegraded":"2023-08-27T11:29:35.268126+0000","last_fullsized":"2023-08-27T11:29:35.268126+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:16:10.071504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242686+0000","last_change":"2023-08-27T11:29:35.242686+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242686+0000","last_undegraded":"2023-08-27T11:29:35.242686+0000","last_fullsized":"2023-08-27T11:29:35.242686+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266667+0000","last_change":"2023-08-27T11:29:35.257372+0000","last_active":"2023-08-27T11:29:35.266667+0000","last_peered":"2023-08-27T11:29:35.266667+0000","last_clean":"2023-08-27T11:29:35.266667+0000","last_became_active":"2023-08-27T11:29:35.257071+0000","last_became_peered":"2023-08-27T11:29:35.257071+0000","last_unstale":"2023-08-27T11:29:35.266667+0000","last_undegraded":"2023-08-27T11:29:35.266667+0000","last_fullsized":"2023-08-27T11:29:35.266667+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:11:16.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242490+0000","last_change":"2023-08-27T11:29:35.242490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242490+0000","last_undegraded":"2023-08-27T11:29:35.242490+0000","last_fullsized":"2023-08-27T11:29:35.242490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260364+0000","last_change":"2023-08-27T11:29:35.258285+0000","last_active":"2023-08-27T11:29:35.260364+0000","last_peered":"2023-08-27T11:29:35.260364+0000","last_clean":"2023-08-27T11:29:35.260364+0000","last_became_active":"2023-08-27T11:29:35.257980+0000","last_became_peered":"2023-08-27T11:29:35.257980+0000","last_unstale":"2023-08-27T11:29:35.260364+0000","last_undegraded":"2023-08-27T11:29:35.260364+0000","last_fullsized":"2023-08-27T11:29:35.260364+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:07:50.064967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250559+0000","last_change":"2023-08-27T11:29:35.250559+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250559+0000","last_undegraded":"2023-08-27T11:29:35.250559+0000","last_fullsized":"2023-08-27T11:29:35.250559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268633+0000","last_change":"2023-08-27T11:29:35.266493+0000","last_active":"2023-08-27T11:29:35.268633+0000","last_peered":"2023-08-27T11:29:35.268633+0000","last_clean":"2023-08-27T11:29:35.268633+0000","last_became_active":"2023-08-27T11:29:35.266215+0000","last_became_peered":"2023-08-27T11:29:35.266215+0000","last_unstale":"2023-08-27T11:29:35.268633+0000","last_undegraded":"2023-08-27T11:29:35.268633+0000","last_fullsized":"2023-08-27T11:29:35.268633+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:22:13.365450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249967+0000","last_change":"2023-08-27T11:29:35.249967+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249967+0000","last_undegraded":"2023-08-27T11:29:35.249967+0000","last_fullsized":"2023-08-27T11:29:35.249967+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268314+0000","last_change":"2023-08-27T11:29:35.264052+0000","last_active":"2023-08-27T11:29:35.268314+0000","last_peered":"2023-08-27T11:29:35.268314+0000","last_clean":"2023-08-27T11:29:35.268314+0000","last_became_active":"2023-08-27T11:29:35.263557+0000","last_became_peered":"2023-08-27T11:29:35.263557+0000","last_unstale":"2023-08-27T11:29:35.268314+0000","last_undegraded":"2023-08-27T11:29:35.268314+0000","last_fullsized":"2023-08-27T11:29:35.268314+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:43.308222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254079+0000","last_change":"2023-08-27T11:29:35.254079+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254079+0000","last_undegraded":"2023-08-27T11:29:35.254079+0000","last_fullsized":"2023-08-27T11:29:35.254079+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260130+0000","last_change":"2023-08-27T11:29:35.258078+0000","last_active":"2023-08-27T11:29:35.260130+0000","last_peered":"2023-08-27T11:29:35.260130+0000","last_clean":"2023-08-27T11:29:35.260130+0000","last_became_active":"2023-08-27T11:29:35.257736+0000","last_became_peered":"2023-08-27T11:29:35.257736+0000","last_unstale":"2023-08-27T11:29:35.260130+0000","last_undegraded":"2023-08-27T11:29:35.260130+0000","last_fullsized":"2023-08-27T11:29:35.260130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:09.478998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260634+0000","last_change":"2023-08-27T11:29:35.260634+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260634+0000","last_undegraded":"2023-08-27T11:29:35.260634+0000","last_fullsized":"2023-08-27T11:29:35.260634+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268003+0000","last_change":"2023-08-27T11:29:35.262578+0000","last_active":"2023-08-27T11:29:35.268003+0000","last_peered":"2023-08-27T11:29:35.268003+0000","last_clean":"2023-08-27T11:29:35.268003+0000","last_became_active":"2023-08-27T11:29:35.262279+0000","last_became_peered":"2023-08-27T11:29:35.262279+0000","last_unstale":"2023-08-27T11:29:35.268003+0000","last_undegraded":"2023-08-27T11:29:35.268003+0000","last_fullsized":"2023-08-27T11:29:35.268003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:25:54.336653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257723+0000","last_change":"2023-08-27T11:29:35.257723+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257723+0000","last_undegraded":"2023-08-27T11:29:35.257723+0000","last_fullsized":"2023-08-27T11:29:35.257723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268614+0000","last_change":"2023-08-27T11:29:35.265840+0000","last_active":"2023-08-27T11:29:35.268614+0000","last_peered":"2023-08-27T11:29:35.268614+0000","last_clean":"2023-08-27T11:29:35.268614+0000","last_became_active":"2023-08-27T11:29:35.265577+0000","last_became_peered":"2023-08-27T11:29:35.265577+0000","last_unstale":"2023-08-27T11:29:35.268614+0000","last_undegraded":"2023-08-27T11:29:35.268614+0000","last_fullsized":"2023-08-27T11:29:35.268614+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:14.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243924+0000","last_change":"2023-08-27T11:29:35.243924+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243924+0000","last_undegraded":"2023-08-27T11:29:35.243924+0000","last_fullsized":"2023-08-27T11:29:35.243924+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268579+0000","last_change":"2023-08-27T11:29:35.265779+0000","last_active":"2023-08-27T11:29:35.268579+0000","last_peered":"2023-08-27T11:29:35.268579+0000","last_clean":"2023-08-27T11:29:35.268579+0000","last_became_active":"2023-08-27T11:29:35.265505+0000","last_became_peered":"2023-08-27T11:29:35.265505+0000","last_unstale":"2023-08-27T11:29:35.268579+0000","last_undegraded":"2023-08-27T11:29:35.268579+0000","last_fullsized":"2023-08-27T11:29:35.268579+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:06.317232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249968+0000","last_change":"2023-08-27T11:29:35.249968+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249968+0000","last_undegraded":"2023-08-27T11:29:35.249968+0000","last_fullsized":"2023-08-27T11:29:35.249968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275120+0000","last_change":"2023-08-27T11:29:35.270172+0000","last_active":"2023-08-27T11:29:35.275120+0000","last_peered":"2023-08-27T11:29:35.275120+0000","last_clean":"2023-08-27T11:29:35.275120+0000","last_became_active":"2023-08-27T11:29:35.269864+0000","last_became_peered":"2023-08-27T11:29:35.269864+0000","last_unstale":"2023-08-27T11:29:35.275120+0000","last_undegraded":"2023-08-27T11:29:35.275120+0000","last_fullsized":"2023-08-27T11:29:35.275120+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:37.027357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253857+0000","last_change":"2023-08-27T11:29:35.253857+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253857+0000","last_undegraded":"2023-08-27T11:29:35.253857+0000","last_fullsized":"2023-08-27T11:29:35.253857+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268478+0000","last_change":"2023-08-27T11:29:35.263997+0000","last_active":"2023-08-27T11:29:35.268478+0000","last_peered":"2023-08-27T11:29:35.268478+0000","last_clean":"2023-08-27T11:29:35.268478+0000","last_became_active":"2023-08-27T11:29:35.263703+0000","last_became_peered":"2023-08-27T11:29:35.263703+0000","last_unstale":"2023-08-27T11:29:35.268478+0000","last_undegraded":"2023-08-27T11:29:35.268478+0000","last_fullsized":"2023-08-27T11:29:35.268478+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:26.998585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254051+0000","last_change":"2023-08-27T11:29:35.254051+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254051+0000","last_undegraded":"2023-08-27T11:29:35.254051+0000","last_fullsized":"2023-08-27T11:29:35.254051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275351+0000","last_change":"2023-08-27T11:29:35.274174+0000","last_active":"2023-08-27T11:29:35.275351+0000","last_peered":"2023-08-27T11:29:35.275351+0000","last_clean":"2023-08-27T11:29:35.275351+0000","last_became_active":"2023-08-27T11:29:35.273836+0000","last_became_peered":"2023-08-27T11:29:35.273836+0000","last_unstale":"2023-08-27T11:29:35.275351+0000","last_undegraded":"2023-08-27T11:29:35.275351+0000","last_fullsized":"2023-08-27T11:29:35.275351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:35.543780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257554+0000","last_change":"2023-08-27T11:29:35.257554+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257554+0000","last_undegraded":"2023-08-27T11:29:35.257554+0000","last_fullsized":"2023-08-27T11:29:35.257554+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268042+0000","last_change":"2023-08-27T11:29:35.265229+0000","last_active":"2023-08-27T11:29:35.268042+0000","last_peered":"2023-08-27T11:29:35.268042+0000","last_clean":"2023-08-27T11:29:35.268042+0000","last_became_active":"2023-08-27T11:29:35.264883+0000","last_became_peered":"2023-08-27T11:29:35.264883+0000","last_unstale":"2023-08-27T11:29:35.268042+0000","last_undegraded":"2023-08-27T11:29:35.268042+0000","last_fullsized":"2023-08-27T11:29:35.268042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:24:43.794265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249282+0000","last_change":"2023-08-27T11:29:35.249282+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249282+0000","last_undegraded":"2023-08-27T11:29:35.249282+0000","last_fullsized":"2023-08-27T11:29:35.249282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264149+0000","last_change":"2023-08-27T11:29:35.258902+0000","last_active":"2023-08-27T11:29:35.264149+0000","last_peered":"2023-08-27T11:29:35.264149+0000","last_clean":"2023-08-27T11:29:35.264149+0000","last_became_active":"2023-08-27T11:29:35.258622+0000","last_became_peered":"2023-08-27T11:29:35.258622+0000","last_unstale":"2023-08-27T11:29:35.264149+0000","last_undegraded":"2023-08-27T11:29:35.264149+0000","last_fullsized":"2023-08-27T11:29:35.264149+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:57.769261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244907+0000","last_change":"2023-08-27T11:29:35.244907+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244907+0000","last_undegraded":"2023-08-27T11:29:35.244907+0000","last_fullsized":"2023-08-27T11:29:35.244907+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268351+0000","last_change":"2023-08-27T11:29:35.265730+0000","last_active":"2023-08-27T11:29:35.268351+0000","last_peered":"2023-08-27T11:29:35.268351+0000","last_clean":"2023-08-27T11:29:35.268351+0000","last_became_active":"2023-08-27T11:29:35.265470+0000","last_became_peered":"2023-08-27T11:29:35.265470+0000","last_unstale":"2023-08-27T11:29:35.268351+0000","last_undegraded":"2023-08-27T11:29:35.268351+0000","last_fullsized":"2023-08-27T11:29:35.268351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:08.044907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250335+0000","last_change":"2023-08-27T11:29:35.250335+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250335+0000","last_undegraded":"2023-08-27T11:29:35.250335+0000","last_fullsized":"2023-08-27T11:29:35.250335+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266417+0000","last_change":"2023-08-27T11:29:35.258653+0000","last_active":"2023-08-27T11:29:35.266417+0000","last_peered":"2023-08-27T11:29:35.266417+0000","last_clean":"2023-08-27T11:29:35.266417+0000","last_became_active":"2023-08-27T11:29:35.258374+0000","last_became_peered":"2023-08-27T11:29:35.258374+0000","last_unstale":"2023-08-27T11:29:35.266417+0000","last_undegraded":"2023-08-27T11:29:35.266417+0000","last_fullsized":"2023-08-27T11:29:35.266417+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:02.909752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250168+0000","last_change":"2023-08-27T11:29:35.250168+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250168+0000","last_undegraded":"2023-08-27T11:29:35.250168+0000","last_fullsized":"2023-08-27T11:29:35.250168+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.269405+0000","last_change":"2023-08-27T11:29:35.264235+0000","last_active":"2023-08-27T11:29:35.269405+0000","last_peered":"2023-08-27T11:29:35.269405+0000","last_clean":"2023-08-27T11:29:35.269405+0000","last_became_active":"2023-08-27T11:29:35.263872+0000","last_became_peered":"2023-08-27T11:29:35.263872+0000","last_unstale":"2023-08-27T11:29:35.269405+0000","last_undegraded":"2023-08-27T11:29:35.269405+0000","last_fullsized":"2023-08-27T11:29:35.269405+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:27:35.857421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256005+0000","last_change":"2023-08-27T11:29:35.256005+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256005+0000","last_undegraded":"2023-08-27T11:29:35.256005+0000","last_fullsized":"2023-08-27T11:29:35.256005+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.257055+0000","last_change":"2023-08-27T11:29:35.251383+0000","last_active":"2023-08-27T11:29:35.257055+0000","last_peered":"2023-08-27T11:29:35.257055+0000","last_clean":"2023-08-27T11:29:35.257055+0000","last_became_active":"2023-08-27T11:29:35.251115+0000","last_became_peered":"2023-08-27T11:29:35.251115+0000","last_unstale":"2023-08-27T11:29:35.257055+0000","last_undegraded":"2023-08-27T11:29:35.257055+0000","last_fullsized":"2023-08-27T11:29:35.257055+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:17.263129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244565+0000","last_change":"2023-08-27T11:29:35.244565+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244565+0000","last_undegraded":"2023-08-27T11:29:35.244565+0000","last_fullsized":"2023-08-27T11:29:35.244565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275095+0000","last_change":"2023-08-27T11:29:35.270115+0000","last_active":"2023-08-27T11:29:35.275095+0000","last_peered":"2023-08-27T11:29:35.275095+0000","last_clean":"2023-08-27T11:29:35.275095+0000","last_became_active":"2023-08-27T11:29:35.269746+0000","last_became_peered":"2023-08-27T11:29:35.269746+0000","last_unstale":"2023-08-27T11:29:35.275095+0000","last_undegraded":"2023-08-27T11:29:35.275095+0000","last_fullsized":"2023-08-27T11:29:35.275095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:16.896770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242754+0000","last_change":"2023-08-27T11:29:35.242754+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242754+0000","last_undegraded":"2023-08-27T11:29:35.242754+0000","last_fullsized":"2023-08-27T11:29:35.242754+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268214+0000","last_change":"2023-08-27T11:29:35.265870+0000","last_active":"2023-08-27T11:29:35.268214+0000","last_peered":"2023-08-27T11:29:35.268214+0000","last_clean":"2023-08-27T11:29:35.268214+0000","last_became_active":"2023-08-27T11:29:35.265559+0000","last_became_peered":"2023-08-27T11:29:35.265559+0000","last_unstale":"2023-08-27T11:29:35.268214+0000","last_undegraded":"2023-08-27T11:29:35.268214+0000","last_fullsized":"2023-08-27T11:29:35.268214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:54.608604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260132+0000","last_change":"2023-08-27T11:29:35.260132+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260132+0000","last_undegraded":"2023-08-27T11:29:35.260132+0000","last_fullsized":"2023-08-27T11:29:35.260132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275125+0000","last_change":"2023-08-27T11:29:35.270153+0000","last_active":"2023-08-27T11:29:35.275125+0000","last_peered":"2023-08-27T11:29:35.275125+0000","last_clean":"2023-08-27T11:29:35.275125+0000","last_became_active":"2023-08-27T11:29:35.269729+0000","last_became_peered":"2023-08-27T11:29:35.269729+0000","last_unstale":"2023-08-27T11:29:35.275125+0000","last_undegraded":"2023-08-27T11:29:35.275125+0000","last_fullsized":"2023-08-27T11:29:35.275125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:28:30.296677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261488+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:29:35.261488+0000","last_peered":"2023-08-27T11:29:35.261488+0000","last_clean":"2023-08-27T11:29:35.261488+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:29:35.261488+0000","last_undegraded":"2023-08-27T11:29:35.261488+0000","last_fullsized":"2023-08-27T11:29:35.261488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:42.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245480+0000","last_change":"2023-08-27T11:29:35.245480+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245480+0000","last_undegraded":"2023-08-27T11:29:35.245480+0000","last_fullsized":"2023-08-27T11:29:35.245480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268133+0000","last_change":"2023-08-27T11:29:35.264586+0000","last_active":"2023-08-27T11:29:35.268133+0000","last_peered":"2023-08-27T11:29:35.268133+0000","last_clean":"2023-08-27T11:29:35.268133+0000","last_became_active":"2023-08-27T11:29:35.264251+0000","last_became_peered":"2023-08-27T11:29:35.264251+0000","last_unstale":"2023-08-27T11:29:35.268133+0000","last_undegraded":"2023-08-27T11:29:35.268133+0000","last_fullsized":"2023-08-27T11:29:35.268133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:18.324361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261770+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:29:35.261770+0000","last_peered":"2023-08-27T11:29:35.261770+0000","last_clean":"2023-08-27T11:29:35.261770+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:29:35.261770+0000","last_undegraded":"2023-08-27T11:29:35.261770+0000","last_fullsized":"2023-08-27T11:29:35.261770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:47:16.395720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258040+0000","last_change":"2023-08-27T11:29:35.258040+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258040+0000","last_undegraded":"2023-08-27T11:29:35.258040+0000","last_fullsized":"2023-08-27T11:29:35.258040+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264524+0000","last_change":"2023-08-27T11:29:35.259916+0000","last_active":"2023-08-27T11:29:35.264524+0000","last_peered":"2023-08-27T11:29:35.264524+0000","last_clean":"2023-08-27T11:29:35.264524+0000","last_became_active":"2023-08-27T11:29:35.259653+0000","last_became_peered":"2023-08-27T11:29:35.259653+0000","last_unstale":"2023-08-27T11:29:35.264524+0000","last_undegraded":"2023-08-27T11:29:35.264524+0000","last_fullsized":"2023-08-27T11:29:35.264524+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:38.101644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260681+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:29:35.260681+0000","last_peered":"2023-08-27T11:29:35.260681+0000","last_clean":"2023-08-27T11:29:35.260681+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:29:35.260681+0000","last_undegraded":"2023-08-27T11:29:35.260681+0000","last_fullsized":"2023-08-27T11:29:35.260681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:19.428666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254010+0000","last_change":"2023-08-27T11:29:35.254010+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254010+0000","last_undegraded":"2023-08-27T11:29:35.254010+0000","last_fullsized":"2023-08-27T11:29:35.254010+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264170+0000","last_change":"2023-08-27T11:29:35.258960+0000","last_active":"2023-08-27T11:29:35.264170+0000","last_peered":"2023-08-27T11:29:35.264170+0000","last_clean":"2023-08-27T11:29:35.264170+0000","last_became_active":"2023-08-27T11:29:35.258657+0000","last_became_peered":"2023-08-27T11:29:35.258657+0000","last_unstale":"2023-08-27T11:29:35.264170+0000","last_undegraded":"2023-08-27T11:29:35.264170+0000","last_fullsized":"2023-08-27T11:29:35.264170+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:16.004617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259265+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:29:35.259265+0000","last_peered":"2023-08-27T11:29:35.259265+0000","last_clean":"2023-08-27T11:29:35.259265+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:29:35.259265+0000","last_undegraded":"2023-08-27T11:29:35.259265+0000","last_fullsized":"2023-08-27T11:29:35.259265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:32:34.180054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242485+0000","last_change":"2023-08-27T11:29:35.242485+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242485+0000","last_undegraded":"2023-08-27T11:29:35.242485+0000","last_fullsized":"2023-08-27T11:29:35.242485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264531+0000","last_change":"2023-08-27T11:29:35.259131+0000","last_active":"2023-08-27T11:29:35.264531+0000","last_peered":"2023-08-27T11:29:35.264531+0000","last_clean":"2023-08-27T11:29:35.264531+0000","last_became_active":"2023-08-27T11:29:35.258823+0000","last_became_peered":"2023-08-27T11:29:35.258823+0000","last_unstale":"2023-08-27T11:29:35.264531+0000","last_undegraded":"2023-08-27T11:29:35.264531+0000","last_fullsized":"2023-08-27T11:29:35.264531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:08:27.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.258928+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:29:35.258928+0000","last_peered":"2023-08-27T11:29:35.258928+0000","last_clean":"2023-08-27T11:29:35.258928+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:29:35.258928+0000","last_undegraded":"2023-08-27T11:29:35.258928+0000","last_fullsized":"2023-08-27T11:29:35.258928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:42.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243223+0000","last_change":"2023-08-27T11:29:35.243223+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243223+0000","last_undegraded":"2023-08-27T11:29:35.243223+0000","last_fullsized":"2023-08-27T11:29:35.243223+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.271708+0000","last_change":"2023-08-27T11:29:35.270703+0000","last_active":"2023-08-27T11:29:35.271708+0000","last_peered":"2023-08-27T11:29:35.271708+0000","last_clean":"2023-08-27T11:29:35.271708+0000","last_became_active":"2023-08-27T11:29:35.270171+0000","last_became_peered":"2023-08-27T11:29:35.270171+0000","last_unstale":"2023-08-27T11:29:35.271708+0000","last_undegraded":"2023-08-27T11:29:35.271708+0000","last_fullsized":"2023-08-27T11:29:35.271708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:59.217922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":374,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259135+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:29:35.259135+0000","last_peered":"2023-08-27T11:29:35.259135+0000","last_clean":"2023-08-27T11:29:35.259135+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:29:35.259135+0000","last_undegraded":"2023-08-27T11:29:35.259135+0000","last_fullsized":"2023-08-27T11:29:35.259135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:47.731712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":236,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250963+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:29:35.250963+0000","last_peered":"2023-08-27T11:29:35.250963+0000","last_clean":"2023-08-27T11:29:35.250963+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:29:35.250963+0000","last_undegraded":"2023-08-27T11:29:35.250963+0000","last_fullsized":"2023-08-27T11:29:35.250963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:00.624913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252336+0000","last_change":"2023-08-27T11:29:35.252336+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252336+0000","last_undegraded":"2023-08-27T11:29:35.252336+0000","last_fullsized":"2023-08-27T11:29:35.252336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266886+0000","last_change":"2023-08-27T11:29:35.262815+0000","last_active":"2023-08-27T11:29:35.266886+0000","last_peered":"2023-08-27T11:29:35.266886+0000","last_clean":"2023-08-27T11:29:35.266886+0000","last_became_active":"2023-08-27T11:29:35.262500+0000","last_became_peered":"2023-08-27T11:29:35.262500+0000","last_unstale":"2023-08-27T11:29:35.266886+0000","last_undegraded":"2023-08-27T11:29:35.266886+0000","last_fullsized":"2023-08-27T11:29:35.266886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:47:20.213316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.245285+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:29:35.245285+0000","last_peered":"2023-08-27T11:29:35.245285+0000","last_clean":"2023-08-27T11:29:35.245285+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:29:35.245285+0000","last_undegraded":"2023-08-27T11:29:35.245285+0000","last_fullsized":"2023-08-27T11:29:35.245285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:56:28.822910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253490+0000","last_change":"2023-08-27T11:29:35.253490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253490+0000","last_undegraded":"2023-08-27T11:29:35.253490+0000","last_fullsized":"2023-08-27T11:29:35.253490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268560+0000","last_change":"2023-08-27T11:29:35.265167+0000","last_active":"2023-08-27T11:29:35.268560+0000","last_peered":"2023-08-27T11:29:35.268560+0000","last_clean":"2023-08-27T11:29:35.268560+0000","last_became_active":"2023-08-27T11:29:35.264787+0000","last_became_peered":"2023-08-27T11:29:35.264787+0000","last_unstale":"2023-08-27T11:29:35.268560+0000","last_undegraded":"2023-08-27T11:29:35.268560+0000","last_fullsized":"2023-08-27T11:29:35.268560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:45:02.383758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250446+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:29:35.250446+0000","last_peered":"2023-08-27T11:29:35.250446+0000","last_clean":"2023-08-27T11:29:35.250446+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:29:35.250446+0000","last_undegraded":"2023-08-27T11:29:35.250446+0000","last_fullsized":"2023-08-27T11:29:35.250446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:18.107852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.439}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.435},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.438},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.38}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.503}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.85599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.878},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.83499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.878},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":1.605}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":1.663}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":1.714},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":1.5609999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":1.099}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28752,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343088,"statfs":{"total":96636764160,"available":96607322112,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.878},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.746},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":1.028},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.98199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":1.0940000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":1.145},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:29:40.714 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:29:40.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.947+0000 7f0b181ff700 1 Processor -- start 2023-08-27T11:29:40.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.947+0000 7f0b181ff700 1 -- start start 2023-08-27T11:29:40.950 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b181ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b100c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b181ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b10154740 0x7f0b100c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b181ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10154d00 con 0x7f0b1014e960 2023-08-27T11:29:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b181ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100baf30 con 0x7f0b10154740 2023-08-27T11:29:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b181ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10154fe0 con 0x7f0b100c50d0 2023-08-27T11:29:40.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b10154740 0x7f0b100c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b10154740 0x7f0b100c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35968/0 (socket says 172.21.15.43:35968) 2023-08-27T11:29:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 -- 172.21.15.43:0/758527081 learned_addr learned my addr 172.21.15.43:0/758527081 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1579a700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b100c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 -- 172.21.15.43:0/758527081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 msgr2=0x7f0b100c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:40.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b100c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 -- 172.21.15.43:0/758527081 >> v1:172.21.15.57:6789/0 conn(0x7f0b1014e960 legacy=0x7f0b100a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.949+0000 7f0b1679c700 1 -- 172.21.15.43:0/758527081 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b101552c0 con 0x7f0b10154740 2023-08-27T11:29:40.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b1679c700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b10154740 0x7f0b100c4200 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0c2c3c142ae236 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b14f99700 1 -- 172.21.15.43:0/758527081 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800e070 con 0x7f0b10154740 2023-08-27T11:29:40.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b14f99700 1 -- 172.21.15.43:0/758527081 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0800b9c0 con 0x7f0b10154740 2023-08-27T11:29:40.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b14f99700 1 -- 172.21.15.43:0/758527081 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800bd70 con 0x7f0b10154740 2023-08-27T11:29:40.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b181ff700 1 -- 172.21.15.43:0/758527081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b10154740 msgr2=0x7f0b100c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.950+0000 7f0b181ff700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b10154740 0x7f0b100c4200 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009e50 tx=0x7f0b0800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:40.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 -- 172.21.15.43:0/758527081 shutdown_connections 2023-08-27T11:29:40.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b10154740 0x7f0b100c4200 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 --2- 172.21.15.43:0/758527081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b100c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 -- 172.21.15.43:0/758527081 >> 172.21.15.43:0/758527081 conn(0x7f0b1006aa50 msgr2=0x7f0b100c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:40.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 -- 172.21.15.43:0/758527081 shutdown_connections 2023-08-27T11:29:40.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.951+0000 7f0b181ff700 1 -- 172.21.15.43:0/758527081 wait complete. 2023-08-27T11:29:40.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.952+0000 7f0b181ff700 1 Processor -- start 2023-08-27T11:29:40.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.952+0000 7f0b181ff700 1 -- start start 2023-08-27T11:29:40.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b1014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b10154740 0x7f0b100a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10151780 con 0x7f0b1014e960 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100a6e10 con 0x7f0b10154740 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.953+0000 7f0b181ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10151ef0 con 0x7f0b100c50d0 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35980/0 (socket says 172.21.15.43:35980) 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 -- 172.21.15.43:0/1834355958 learned_addr learned my addr 172.21.15.43:0/1834355958 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:40.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b15f9b700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b1014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1679c700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b10154740 0x7f0b100a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 -- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 msgr2=0x7f0b1014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b1014ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 -- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b10154740 msgr2=0x7f0b100a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b10154740 0x7f0b100a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:40.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 -- 172.21.15.43:0/1834355958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009b30 con 0x7f0b1014e960 2023-08-27T11:29:40.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.954+0000 7f0b1579a700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000e7e0 tx=0x7f0b0000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.955+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000c070 con 0x7f0b1014e960 2023-08-27T11:29:40.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.955+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b00013610 con 0x7f0b1014e960 2023-08-27T11:29:40.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.955+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00013980 con 0x7f0b1014e960 2023-08-27T11:29:40.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.955+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100a45c0 con 0x7f0b1014e960 2023-08-27T11:29:40.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.955+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b10149320 con 0x7f0b1014e960 2023-08-27T11:29:40.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.956+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b100bb390 con 0x7f0b1014e960 2023-08-27T11:29:40.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.957+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b00013ae0 con 0x7f0b1014e960 2023-08-27T11:29:40.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.958+0000 7f0b067fc700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 0x7f0af406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:40.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.958+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b00088350 con 0x7f0b1014e960 2023-08-27T11:29:40.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.958+0000 7f0b15f9b700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 0x7f0af406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:40.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.958+0000 7f0b15f9b700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 0x7f0af406c5a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0b10154560 tx=0x7f0b0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:40.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:40.962+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b000539b0 con 0x7f0b1014e960 2023-08-27T11:29:41.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.165+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b100c37a0 con 0x7f0af406a0e0 2023-08-27T11:29:41.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.175+0000 7f0b067fc700 1 -- 172.21.15.43:0/1834355958 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306507 (secure 0 0 0) 0x7f0b0c001580 con 0x7f0af406a0e0 2023-08-27T11:29:41.180 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.179+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 msgr2=0x7f0af406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.179+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 0x7f0af406c5a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0b10154560 tx=0x7f0b0c009040 comp rx=0 tx=0).stop 2023-08-27T11:29:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.179+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 msgr2=0x7f0b100a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.179+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000e7e0 tx=0x7f0b0000eaf0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 shutdown_connections 2023-08-27T11:29:41.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0af406a0e0 0x7f0af406c5a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b10154740 0x7f0b100a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b100c50d0 0x7f0b1014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 --2- 172.21.15.43:0/1834355958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b1014e960 0x7f0b100a6390 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 >> 172.21.15.43:0/1834355958 conn(0x7f0b1006aa50 msgr2=0x7f0b10153210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:41.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 shutdown_connections 2023-08-27T11:29:41.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.180+0000 7f0b181ff700 1 -- 172.21.15.43:0/1834355958 wait complete. 2023-08-27T11:29:41.185 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:29:41.199 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-08-27T11:29:40.397527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251960,"kb_used_data":15000,"kb_used_omap":13,"kb_used_meta":236850,"kb_avail":754722760,"statfs":{"total":773094113280,"available":772836106240,"internally_reserved":0,"allocated":15360000,"data_stored":7903208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":242534488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251112+0000","last_change":"2023-08-27T11:29:35.251112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251112+0000","last_undegraded":"2023-08-27T11:29:35.251112+0000","last_fullsized":"2023-08-27T11:29:35.251112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255173+0000","last_change":"2023-08-27T11:29:35.255173+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255173+0000","last_undegraded":"2023-08-27T11:29:35.255173+0000","last_fullsized":"2023-08-27T11:29:35.255173+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250843+0000","last_change":"2023-08-27T11:29:35.250843+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250843+0000","last_undegraded":"2023-08-27T11:29:35.250843+0000","last_fullsized":"2023-08-27T11:29:35.250843+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250770+0000","last_change":"2023-08-27T11:29:35.250770+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250770+0000","last_undegraded":"2023-08-27T11:29:35.250770+0000","last_fullsized":"2023-08-27T11:29:35.250770+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250310+0000","last_change":"2023-08-27T11:29:35.250310+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250310+0000","last_undegraded":"2023-08-27T11:29:35.250310+0000","last_fullsized":"2023-08-27T11:29:35.250310+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255834+0000","last_change":"2023-08-27T11:29:35.255834+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255834+0000","last_undegraded":"2023-08-27T11:29:35.255834+0000","last_fullsized":"2023-08-27T11:29:35.255834+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249800+0000","last_change":"2023-08-27T11:29:35.249800+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249800+0000","last_undegraded":"2023-08-27T11:29:35.249800+0000","last_fullsized":"2023-08-27T11:29:35.249800+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250724+0000","last_change":"2023-08-27T11:29:35.250724+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250724+0000","last_undegraded":"2023-08-27T11:29:35.250724+0000","last_fullsized":"2023-08-27T11:29:35.250724+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252253+0000","last_change":"2023-08-27T11:29:35.252253+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252253+0000","last_undegraded":"2023-08-27T11:29:35.252253+0000","last_fullsized":"2023-08-27T11:29:35.252253+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252722+0000","last_change":"2023-08-27T11:29:35.252722+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252722+0000","last_undegraded":"2023-08-27T11:29:35.252722+0000","last_fullsized":"2023-08-27T11:29:35.252722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258661+0000","last_change":"2023-08-27T11:29:35.258661+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258661+0000","last_undegraded":"2023-08-27T11:29:35.258661+0000","last_fullsized":"2023-08-27T11:29:35.258661+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254702+0000","last_change":"2023-08-27T11:29:35.254702+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254702+0000","last_undegraded":"2023-08-27T11:29:35.254702+0000","last_fullsized":"2023-08-27T11:29:35.254702+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244694+0000","last_change":"2023-08-27T11:29:35.244694+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244694+0000","last_undegraded":"2023-08-27T11:29:35.244694+0000","last_fullsized":"2023-08-27T11:29:35.244694+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250569+0000","last_change":"2023-08-27T11:29:35.250569+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250569+0000","last_undegraded":"2023-08-27T11:29:35.250569+0000","last_fullsized":"2023-08-27T11:29:35.250569+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260356+0000","last_change":"2023-08-27T11:29:35.260356+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260356+0000","last_undegraded":"2023-08-27T11:29:35.260356+0000","last_fullsized":"2023-08-27T11:29:35.260356+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250804+0000","last_change":"2023-08-27T11:29:35.250804+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250804+0000","last_undegraded":"2023-08-27T11:29:35.250804+0000","last_fullsized":"2023-08-27T11:29:35.250804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251802+0000","last_change":"2023-08-27T11:29:35.251802+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251802+0000","last_undegraded":"2023-08-27T11:29:35.251802+0000","last_fullsized":"2023-08-27T11:29:35.251802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254211+0000","last_change":"2023-08-27T11:29:35.254211+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254211+0000","last_undegraded":"2023-08-27T11:29:35.254211+0000","last_fullsized":"2023-08-27T11:29:35.254211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259615+0000","last_change":"2023-08-27T11:29:35.259615+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259615+0000","last_undegraded":"2023-08-27T11:29:35.259615+0000","last_fullsized":"2023-08-27T11:29:35.259615+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244622+0000","last_change":"2023-08-27T11:29:35.244622+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244622+0000","last_undegraded":"2023-08-27T11:29:35.244622+0000","last_fullsized":"2023-08-27T11:29:35.244622+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243368+0000","last_change":"2023-08-27T11:29:35.243368+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243368+0000","last_undegraded":"2023-08-27T11:29:35.243368+0000","last_fullsized":"2023-08-27T11:29:35.243368+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255112+0000","last_change":"2023-08-27T11:29:35.255112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255112+0000","last_undegraded":"2023-08-27T11:29:35.255112+0000","last_fullsized":"2023-08-27T11:29:35.255112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251271+0000","last_change":"2023-08-27T11:29:35.251271+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251271+0000","last_undegraded":"2023-08-27T11:29:35.251271+0000","last_fullsized":"2023-08-27T11:29:35.251271+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250275+0000","last_change":"2023-08-27T11:29:35.250275+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250275+0000","last_undegraded":"2023-08-27T11:29:35.250275+0000","last_fullsized":"2023-08-27T11:29:35.250275+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244503+0000","last_change":"2023-08-27T11:29:35.244503+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244503+0000","last_undegraded":"2023-08-27T11:29:35.244503+0000","last_fullsized":"2023-08-27T11:29:35.244503+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.247261+0000","last_change":"2023-08-27T11:29:35.247261+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.247261+0000","last_undegraded":"2023-08-27T11:29:35.247261+0000","last_fullsized":"2023-08-27T11:29:35.247261+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256450+0000","last_change":"2023-08-27T11:29:35.256450+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256450+0000","last_undegraded":"2023-08-27T11:29:35.256450+0000","last_fullsized":"2023-08-27T11:29:35.256450+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245026+0000","last_change":"2023-08-27T11:29:35.245026+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245026+0000","last_undegraded":"2023-08-27T11:29:35.245026+0000","last_fullsized":"2023-08-27T11:29:35.245026+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257649+0000","last_change":"2023-08-27T11:29:35.257649+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257649+0000","last_undegraded":"2023-08-27T11:29:35.257649+0000","last_fullsized":"2023-08-27T11:29:35.257649+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254000+0000","last_change":"2023-08-27T11:29:35.254000+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254000+0000","last_undegraded":"2023-08-27T11:29:35.254000+0000","last_fullsized":"2023-08-27T11:29:35.254000+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259828+0000","last_change":"2023-08-27T11:29:35.259828+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259828+0000","last_undegraded":"2023-08-27T11:29:35.259828+0000","last_fullsized":"2023-08-27T11:29:35.259828+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253331+0000","last_change":"2023-08-27T11:29:35.253331+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253331+0000","last_undegraded":"2023-08-27T11:29:35.253331+0000","last_fullsized":"2023-08-27T11:29:35.253331+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257612+0000","last_change":"2023-08-27T11:29:35.257612+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257612+0000","last_undegraded":"2023-08-27T11:29:35.257612+0000","last_fullsized":"2023-08-27T11:29:35.257612+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.265746+0000","last_change":"2023-08-27T11:29:35.262477+0000","last_active":"2023-08-27T11:29:35.265746+0000","last_peered":"2023-08-27T11:29:35.265746+0000","last_clean":"2023-08-27T11:29:35.265746+0000","last_became_active":"2023-08-27T11:29:35.262122+0000","last_became_peered":"2023-08-27T11:29:35.262122+0000","last_unstale":"2023-08-27T11:29:35.265746+0000","last_undegraded":"2023-08-27T11:29:35.265746+0000","last_fullsized":"2023-08-27T11:29:35.265746+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:45:01.498491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242830+0000","last_change":"2023-08-27T11:29:35.242830+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242830+0000","last_undegraded":"2023-08-27T11:29:35.242830+0000","last_fullsized":"2023-08-27T11:29:35.242830+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266823+0000","last_change":"2023-08-27T11:29:35.261806+0000","last_active":"2023-08-27T11:29:35.266823+0000","last_peered":"2023-08-27T11:29:35.266823+0000","last_clean":"2023-08-27T11:29:35.266823+0000","last_became_active":"2023-08-27T11:29:35.261521+0000","last_became_peered":"2023-08-27T11:29:35.261521+0000","last_unstale":"2023-08-27T11:29:35.266823+0000","last_undegraded":"2023-08-27T11:29:35.266823+0000","last_fullsized":"2023-08-27T11:29:35.266823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:38.230227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250127+0000","last_change":"2023-08-27T11:29:35.250127+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250127+0000","last_undegraded":"2023-08-27T11:29:35.250127+0000","last_fullsized":"2023-08-27T11:29:35.250127+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275158+0000","last_change":"2023-08-27T11:29:35.270214+0000","last_active":"2023-08-27T11:29:35.275158+0000","last_peered":"2023-08-27T11:29:35.275158+0000","last_clean":"2023-08-27T11:29:35.275158+0000","last_became_active":"2023-08-27T11:29:35.269755+0000","last_became_peered":"2023-08-27T11:29:35.269755+0000","last_unstale":"2023-08-27T11:29:35.275158+0000","last_undegraded":"2023-08-27T11:29:35.275158+0000","last_fullsized":"2023-08-27T11:29:35.275158+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:38.942747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257233+0000","last_change":"2023-08-27T11:29:35.257233+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257233+0000","last_undegraded":"2023-08-27T11:29:35.257233+0000","last_fullsized":"2023-08-27T11:29:35.257233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268491+0000","last_change":"2023-08-27T11:29:35.262484+0000","last_active":"2023-08-27T11:29:35.268491+0000","last_peered":"2023-08-27T11:29:35.268491+0000","last_clean":"2023-08-27T11:29:35.268491+0000","last_became_active":"2023-08-27T11:29:35.262188+0000","last_became_peered":"2023-08-27T11:29:35.262188+0000","last_unstale":"2023-08-27T11:29:35.268491+0000","last_undegraded":"2023-08-27T11:29:35.268491+0000","last_fullsized":"2023-08-27T11:29:35.268491+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:48.393606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253359+0000","last_change":"2023-08-27T11:29:35.253359+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253359+0000","last_undegraded":"2023-08-27T11:29:35.253359+0000","last_fullsized":"2023-08-27T11:29:35.253359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268126+0000","last_change":"2023-08-27T11:29:35.265293+0000","last_active":"2023-08-27T11:29:35.268126+0000","last_peered":"2023-08-27T11:29:35.268126+0000","last_clean":"2023-08-27T11:29:35.268126+0000","last_became_active":"2023-08-27T11:29:35.265025+0000","last_became_peered":"2023-08-27T11:29:35.265025+0000","last_unstale":"2023-08-27T11:29:35.268126+0000","last_undegraded":"2023-08-27T11:29:35.268126+0000","last_fullsized":"2023-08-27T11:29:35.268126+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:16:10.071504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242686+0000","last_change":"2023-08-27T11:29:35.242686+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242686+0000","last_undegraded":"2023-08-27T11:29:35.242686+0000","last_fullsized":"2023-08-27T11:29:35.242686+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266667+0000","last_change":"2023-08-27T11:29:35.257372+0000","last_active":"2023-08-27T11:29:35.266667+0000","last_peered":"2023-08-27T11:29:35.266667+0000","last_clean":"2023-08-27T11:29:35.266667+0000","last_became_active":"2023-08-27T11:29:35.257071+0000","last_became_peered":"2023-08-27T11:29:35.257071+0000","last_unstale":"2023-08-27T11:29:35.266667+0000","last_undegraded":"2023-08-27T11:29:35.266667+0000","last_fullsized":"2023-08-27T11:29:35.266667+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:11:16.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242490+0000","last_change":"2023-08-27T11:29:35.242490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242490+0000","last_undegraded":"2023-08-27T11:29:35.242490+0000","last_fullsized":"2023-08-27T11:29:35.242490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260364+0000","last_change":"2023-08-27T11:29:35.258285+0000","last_active":"2023-08-27T11:29:35.260364+0000","last_peered":"2023-08-27T11:29:35.260364+0000","last_clean":"2023-08-27T11:29:35.260364+0000","last_became_active":"2023-08-27T11:29:35.257980+0000","last_became_peered":"2023-08-27T11:29:35.257980+0000","last_unstale":"2023-08-27T11:29:35.260364+0000","last_undegraded":"2023-08-27T11:29:35.260364+0000","last_fullsized":"2023-08-27T11:29:35.260364+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:07:50.064967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250559+0000","last_change":"2023-08-27T11:29:35.250559+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250559+0000","last_undegraded":"2023-08-27T11:29:35.250559+0000","last_fullsized":"2023-08-27T11:29:35.250559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268633+0000","last_change":"2023-08-27T11:29:35.266493+0000","last_active":"2023-08-27T11:29:35.268633+0000","last_peered":"2023-08-27T11:29:35.268633+0000","last_clean":"2023-08-27T11:29:35.268633+0000","last_became_active":"2023-08-27T11:29:35.266215+0000","last_became_peered":"2023-08-27T11:29:35.266215+0000","last_unstale":"2023-08-27T11:29:35.268633+0000","last_undegraded":"2023-08-27T11:29:35.268633+0000","last_fullsized":"2023-08-27T11:29:35.268633+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:22:13.365450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249967+0000","last_change":"2023-08-27T11:29:35.249967+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249967+0000","last_undegraded":"2023-08-27T11:29:35.249967+0000","last_fullsized":"2023-08-27T11:29:35.249967+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268314+0000","last_change":"2023-08-27T11:29:35.264052+0000","last_active":"2023-08-27T11:29:35.268314+0000","last_peered":"2023-08-27T11:29:35.268314+0000","last_clean":"2023-08-27T11:29:35.268314+0000","last_became_active":"2023-08-27T11:29:35.263557+0000","last_became_peered":"2023-08-27T11:29:35.263557+0000","last_unstale":"2023-08-27T11:29:35.268314+0000","last_undegraded":"2023-08-27T11:29:35.268314+0000","last_fullsized":"2023-08-27T11:29:35.268314+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:43.308222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254079+0000","last_change":"2023-08-27T11:29:35.254079+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254079+0000","last_undegraded":"2023-08-27T11:29:35.254079+0000","last_fullsized":"2023-08-27T11:29:35.254079+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260130+0000","last_change":"2023-08-27T11:29:35.258078+0000","last_active":"2023-08-27T11:29:35.260130+0000","last_peered":"2023-08-27T11:29:35.260130+0000","last_clean":"2023-08-27T11:29:35.260130+0000","last_became_active":"2023-08-27T11:29:35.257736+0000","last_became_peered":"2023-08-27T11:29:35.257736+0000","last_unstale":"2023-08-27T11:29:35.260130+0000","last_undegraded":"2023-08-27T11:29:35.260130+0000","last_fullsized":"2023-08-27T11:29:35.260130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:09.478998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260634+0000","last_change":"2023-08-27T11:29:35.260634+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260634+0000","last_undegraded":"2023-08-27T11:29:35.260634+0000","last_fullsized":"2023-08-27T11:29:35.260634+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268003+0000","last_change":"2023-08-27T11:29:35.262578+0000","last_active":"2023-08-27T11:29:35.268003+0000","last_peered":"2023-08-27T11:29:35.268003+0000","last_clean":"2023-08-27T11:29:35.268003+0000","last_became_active":"2023-08-27T11:29:35.262279+0000","last_became_peered":"2023-08-27T11:29:35.262279+0000","last_unstale":"2023-08-27T11:29:35.268003+0000","last_undegraded":"2023-08-27T11:29:35.268003+0000","last_fullsized":"2023-08-27T11:29:35.268003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:25:54.336653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257723+0000","last_change":"2023-08-27T11:29:35.257723+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257723+0000","last_undegraded":"2023-08-27T11:29:35.257723+0000","last_fullsized":"2023-08-27T11:29:35.257723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268614+0000","last_change":"2023-08-27T11:29:35.265840+0000","last_active":"2023-08-27T11:29:35.268614+0000","last_peered":"2023-08-27T11:29:35.268614+0000","last_clean":"2023-08-27T11:29:35.268614+0000","last_became_active":"2023-08-27T11:29:35.265577+0000","last_became_peered":"2023-08-27T11:29:35.265577+0000","last_unstale":"2023-08-27T11:29:35.268614+0000","last_undegraded":"2023-08-27T11:29:35.268614+0000","last_fullsized":"2023-08-27T11:29:35.268614+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:14.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243924+0000","last_change":"2023-08-27T11:29:35.243924+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243924+0000","last_undegraded":"2023-08-27T11:29:35.243924+0000","last_fullsized":"2023-08-27T11:29:35.243924+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268579+0000","last_change":"2023-08-27T11:29:35.265779+0000","last_active":"2023-08-27T11:29:35.268579+0000","last_peered":"2023-08-27T11:29:35.268579+0000","last_clean":"2023-08-27T11:29:35.268579+0000","last_became_active":"2023-08-27T11:29:35.265505+0000","last_became_peered":"2023-08-27T11:29:35.265505+0000","last_unstale":"2023-08-27T11:29:35.268579+0000","last_undegraded":"2023-08-27T11:29:35.268579+0000","last_fullsized":"2023-08-27T11:29:35.268579+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:06.317232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249968+0000","last_change":"2023-08-27T11:29:35.249968+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249968+0000","last_undegraded":"2023-08-27T11:29:35.249968+0000","last_fullsized":"2023-08-27T11:29:35.249968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275120+0000","last_change":"2023-08-27T11:29:35.270172+0000","last_active":"2023-08-27T11:29:35.275120+0000","last_peered":"2023-08-27T11:29:35.275120+0000","last_clean":"2023-08-27T11:29:35.275120+0000","last_became_active":"2023-08-27T11:29:35.269864+0000","last_became_peered":"2023-08-27T11:29:35.269864+0000","last_unstale":"2023-08-27T11:29:35.275120+0000","last_undegraded":"2023-08-27T11:29:35.275120+0000","last_fullsized":"2023-08-27T11:29:35.275120+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:37.027357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253857+0000","last_change":"2023-08-27T11:29:35.253857+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253857+0000","last_undegraded":"2023-08-27T11:29:35.253857+0000","last_fullsized":"2023-08-27T11:29:35.253857+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268478+0000","last_change":"2023-08-27T11:29:35.263997+0000","last_active":"2023-08-27T11:29:35.268478+0000","last_peered":"2023-08-27T11:29:35.268478+0000","last_clean":"2023-08-27T11:29:35.268478+0000","last_became_active":"2023-08-27T11:29:35.263703+0000","last_became_peered":"2023-08-27T11:29:35.263703+0000","last_unstale":"2023-08-27T11:29:35.268478+0000","last_undegraded":"2023-08-27T11:29:35.268478+0000","last_fullsized":"2023-08-27T11:29:35.268478+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:26.998585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254051+0000","last_change":"2023-08-27T11:29:35.254051+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254051+0000","last_undegraded":"2023-08-27T11:29:35.254051+0000","last_fullsized":"2023-08-27T11:29:35.254051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275351+0000","last_change":"2023-08-27T11:29:35.274174+0000","last_active":"2023-08-27T11:29:35.275351+0000","last_peered":"2023-08-27T11:29:35.275351+0000","last_clean":"2023-08-27T11:29:35.275351+0000","last_became_active":"2023-08-27T11:29:35.273836+0000","last_became_peered":"2023-08-27T11:29:35.273836+0000","last_unstale":"2023-08-27T11:29:35.275351+0000","last_undegraded":"2023-08-27T11:29:35.275351+0000","last_fullsized":"2023-08-27T11:29:35.275351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:35.543780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257554+0000","last_change":"2023-08-27T11:29:35.257554+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257554+0000","last_undegraded":"2023-08-27T11:29:35.257554+0000","last_fullsized":"2023-08-27T11:29:35.257554+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268042+0000","last_change":"2023-08-27T11:29:35.265229+0000","last_active":"2023-08-27T11:29:35.268042+0000","last_peered":"2023-08-27T11:29:35.268042+0000","last_clean":"2023-08-27T11:29:35.268042+0000","last_became_active":"2023-08-27T11:29:35.264883+0000","last_became_peered":"2023-08-27T11:29:35.264883+0000","last_unstale":"2023-08-27T11:29:35.268042+0000","last_undegraded":"2023-08-27T11:29:35.268042+0000","last_fullsized":"2023-08-27T11:29:35.268042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:24:43.794265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249282+0000","last_change":"2023-08-27T11:29:35.249282+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249282+0000","last_undegraded":"2023-08-27T11:29:35.249282+0000","last_fullsized":"2023-08-27T11:29:35.249282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264149+0000","last_change":"2023-08-27T11:29:35.258902+0000","last_active":"2023-08-27T11:29:35.264149+0000","last_peered":"2023-08-27T11:29:35.264149+0000","last_clean":"2023-08-27T11:29:35.264149+0000","last_became_active":"2023-08-27T11:29:35.258622+0000","last_became_peered":"2023-08-27T11:29:35.258622+0000","last_unstale":"2023-08-27T11:29:35.264149+0000","last_undegraded":"2023-08-27T11:29:35.264149+0000","last_fullsized":"2023-08-27T11:29:35.264149+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:57.769261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244907+0000","last_change":"2023-08-27T11:29:35.244907+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244907+0000","last_undegraded":"2023-08-27T11:29:35.244907+0000","last_fullsized":"2023-08-27T11:29:35.244907+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268351+0000","last_change":"2023-08-27T11:29:35.265730+0000","last_active":"2023-08-27T11:29:35.268351+0000","last_peered":"2023-08-27T11:29:35.268351+0000","last_clean":"2023-08-27T11:29:35.268351+0000","last_became_active":"2023-08-27T11:29:35.265470+0000","last_became_peered":"2023-08-27T11:29:35.265470+0000","last_unstale":"2023-08-27T11:29:35.268351+0000","last_undegraded":"2023-08-27T11:29:35.268351+0000","last_fullsized":"2023-08-27T11:29:35.268351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:08.044907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250335+0000","last_change":"2023-08-27T11:29:35.250335+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250335+0000","last_undegraded":"2023-08-27T11:29:35.250335+0000","last_fullsized":"2023-08-27T11:29:35.250335+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266417+0000","last_change":"2023-08-27T11:29:35.258653+0000","last_active":"2023-08-27T11:29:35.266417+0000","last_peered":"2023-08-27T11:29:35.266417+0000","last_clean":"2023-08-27T11:29:35.266417+0000","last_became_active":"2023-08-27T11:29:35.258374+0000","last_became_peered":"2023-08-27T11:29:35.258374+0000","last_unstale":"2023-08-27T11:29:35.266417+0000","last_undegraded":"2023-08-27T11:29:35.266417+0000","last_fullsized":"2023-08-27T11:29:35.266417+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:02.909752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250168+0000","last_change":"2023-08-27T11:29:35.250168+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250168+0000","last_undegraded":"2023-08-27T11:29:35.250168+0000","last_fullsized":"2023-08-27T11:29:35.250168+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.269405+0000","last_change":"2023-08-27T11:29:35.264235+0000","last_active":"2023-08-27T11:29:35.269405+0000","last_peered":"2023-08-27T11:29:35.269405+0000","last_clean":"2023-08-27T11:29:35.269405+0000","last_became_active":"2023-08-27T11:29:35.263872+0000","last_became_peered":"2023-08-27T11:29:35.263872+0000","last_unstale":"2023-08-27T11:29:35.269405+0000","last_undegraded":"2023-08-27T11:29:35.269405+0000","last_fullsized":"2023-08-27T11:29:35.269405+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:27:35.857421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256005+0000","last_change":"2023-08-27T11:29:35.256005+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256005+0000","last_undegraded":"2023-08-27T11:29:35.256005+0000","last_fullsized":"2023-08-27T11:29:35.256005+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.257055+0000","last_change":"2023-08-27T11:29:35.251383+0000","last_active":"2023-08-27T11:29:35.257055+0000","last_peered":"2023-08-27T11:29:35.257055+0000","last_clean":"2023-08-27T11:29:35.257055+0000","last_became_active":"2023-08-27T11:29:35.251115+0000","last_became_peered":"2023-08-27T11:29:35.251115+0000","last_unstale":"2023-08-27T11:29:35.257055+0000","last_undegraded":"2023-08-27T11:29:35.257055+0000","last_fullsized":"2023-08-27T11:29:35.257055+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:17.263129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244565+0000","last_change":"2023-08-27T11:29:35.244565+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244565+0000","last_undegraded":"2023-08-27T11:29:35.244565+0000","last_fullsized":"2023-08-27T11:29:35.244565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275095+0000","last_change":"2023-08-27T11:29:35.270115+0000","last_active":"2023-08-27T11:29:35.275095+0000","last_peered":"2023-08-27T11:29:35.275095+0000","last_clean":"2023-08-27T11:29:35.275095+0000","last_became_active":"2023-08-27T11:29:35.269746+0000","last_became_peered":"2023-08-27T11:29:35.269746+0000","last_unstale":"2023-08-27T11:29:35.275095+0000","last_undegraded":"2023-08-27T11:29:35.275095+0000","last_fullsized":"2023-08-27T11:29:35.275095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:16.896770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242754+0000","last_change":"2023-08-27T11:29:35.242754+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242754+0000","last_undegraded":"2023-08-27T11:29:35.242754+0000","last_fullsized":"2023-08-27T11:29:35.242754+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268214+0000","last_change":"2023-08-27T11:29:35.265870+0000","last_active":"2023-08-27T11:29:35.268214+0000","last_peered":"2023-08-27T11:29:35.268214+0000","last_clean":"2023-08-27T11:29:35.268214+0000","last_became_active":"2023-08-27T11:29:35.265559+0000","last_became_peered":"2023-08-27T11:29:35.265559+0000","last_unstale":"2023-08-27T11:29:35.268214+0000","last_undegraded":"2023-08-27T11:29:35.268214+0000","last_fullsized":"2023-08-27T11:29:35.268214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:54.608604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260132+0000","last_change":"2023-08-27T11:29:35.260132+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260132+0000","last_undegraded":"2023-08-27T11:29:35.260132+0000","last_fullsized":"2023-08-27T11:29:35.260132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275125+0000","last_change":"2023-08-27T11:29:35.270153+0000","last_active":"2023-08-27T11:29:35.275125+0000","last_peered":"2023-08-27T11:29:35.275125+0000","last_clean":"2023-08-27T11:29:35.275125+0000","last_became_active":"2023-08-27T11:29:35.269729+0000","last_became_peered":"2023-08-27T11:29:35.269729+0000","last_unstale":"2023-08-27T11:29:35.275125+0000","last_undegraded":"2023-08-27T11:29:35.275125+0000","last_fullsized":"2023-08-27T11:29:35.275125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:28:30.296677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261488+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:29:35.261488+0000","last_peered":"2023-08-27T11:29:35.261488+0000","last_clean":"2023-08-27T11:29:35.261488+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:29:35.261488+0000","last_undegraded":"2023-08-27T11:29:35.261488+0000","last_fullsized":"2023-08-27T11:29:35.261488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:42.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245480+0000","last_change":"2023-08-27T11:29:35.245480+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245480+0000","last_undegraded":"2023-08-27T11:29:35.245480+0000","last_fullsized":"2023-08-27T11:29:35.245480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268133+0000","last_change":"2023-08-27T11:29:35.264586+0000","last_active":"2023-08-27T11:29:35.268133+0000","last_peered":"2023-08-27T11:29:35.268133+0000","last_clean":"2023-08-27T11:29:35.268133+0000","last_became_active":"2023-08-27T11:29:35.264251+0000","last_became_peered":"2023-08-27T11:29:35.264251+0000","last_unstale":"2023-08-27T11:29:35.268133+0000","last_undegraded":"2023-08-27T11:29:35.268133+0000","last_fullsized":"2023-08-27T11:29:35.268133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:18.324361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261770+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:29:35.261770+0000","last_peered":"2023-08-27T11:29:35.261770+0000","last_clean":"2023-08-27T11:29:35.261770+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:29:35.261770+0000","last_undegraded":"2023-08-27T11:29:35.261770+0000","last_fullsized":"2023-08-27T11:29:35.261770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:47:16.395720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258040+0000","last_change":"2023-08-27T11:29:35.258040+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258040+0000","last_undegraded":"2023-08-27T11:29:35.258040+0000","last_fullsized":"2023-08-27T11:29:35.258040+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264524+0000","last_change":"2023-08-27T11:29:35.259916+0000","last_active":"2023-08-27T11:29:35.264524+0000","last_peered":"2023-08-27T11:29:35.264524+0000","last_clean":"2023-08-27T11:29:35.264524+0000","last_became_active":"2023-08-27T11:29:35.259653+0000","last_became_peered":"2023-08-27T11:29:35.259653+0000","last_unstale":"2023-08-27T11:29:35.264524+0000","last_undegraded":"2023-08-27T11:29:35.264524+0000","last_fullsized":"2023-08-27T11:29:35.264524+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:38.101644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260681+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:29:35.260681+0000","last_peered":"2023-08-27T11:29:35.260681+0000","last_clean":"2023-08-27T11:29:35.260681+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:29:35.260681+0000","last_undegraded":"2023-08-27T11:29:35.260681+0000","last_fullsized":"2023-08-27T11:29:35.260681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:19.428666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254010+0000","last_change":"2023-08-27T11:29:35.254010+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254010+0000","last_undegraded":"2023-08-27T11:29:35.254010+0000","last_fullsized":"2023-08-27T11:29:35.254010+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264170+0000","last_change":"2023-08-27T11:29:35.258960+0000","last_active":"2023-08-27T11:29:35.264170+0000","last_peered":"2023-08-27T11:29:35.264170+0000","last_clean":"2023-08-27T11:29:35.264170+0000","last_became_active":"2023-08-27T11:29:35.258657+0000","last_became_peered":"2023-08-27T11:29:35.258657+0000","last_unstale":"2023-08-27T11:29:35.264170+0000","last_undegraded":"2023-08-27T11:29:35.264170+0000","last_fullsized":"2023-08-27T11:29:35.264170+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:16.004617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259265+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:29:35.259265+0000","last_peered":"2023-08-27T11:29:35.259265+0000","last_clean":"2023-08-27T11:29:35.259265+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:29:35.259265+0000","last_undegraded":"2023-08-27T11:29:35.259265+0000","last_fullsized":"2023-08-27T11:29:35.259265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:32:34.180054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242485+0000","last_change":"2023-08-27T11:29:35.242485+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242485+0000","last_undegraded":"2023-08-27T11:29:35.242485+0000","last_fullsized":"2023-08-27T11:29:35.242485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264531+0000","last_change":"2023-08-27T11:29:35.259131+0000","last_active":"2023-08-27T11:29:35.264531+0000","last_peered":"2023-08-27T11:29:35.264531+0000","last_clean":"2023-08-27T11:29:35.264531+0000","last_became_active":"2023-08-27T11:29:35.258823+0000","last_became_peered":"2023-08-27T11:29:35.258823+0000","last_unstale":"2023-08-27T11:29:35.264531+0000","last_undegraded":"2023-08-27T11:29:35.264531+0000","last_fullsized":"2023-08-27T11:29:35.264531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:08:27.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.258928+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:29:35.258928+0000","last_peered":"2023-08-27T11:29:35.258928+0000","last_clean":"2023-08-27T11:29:35.258928+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:29:35.258928+0000","last_undegraded":"2023-08-27T11:29:35.258928+0000","last_fullsized":"2023-08-27T11:29:35.258928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:42.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243223+0000","last_change":"2023-08-27T11:29:35.243223+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243223+0000","last_undegraded":"2023-08-27T11:29:35.243223+0000","last_fullsized":"2023-08-27T11:29:35.243223+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.271708+0000","last_change":"2023-08-27T11:29:35.270703+0000","last_active":"2023-08-27T11:29:35.271708+0000","last_peered":"2023-08-27T11:29:35.271708+0000","last_clean":"2023-08-27T11:29:35.271708+0000","last_became_active":"2023-08-27T11:29:35.270171+0000","last_became_peered":"2023-08-27T11:29:35.270171+0000","last_unstale":"2023-08-27T11:29:35.271708+0000","last_undegraded":"2023-08-27T11:29:35.271708+0000","last_fullsized":"2023-08-27T11:29:35.271708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:59.217922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":374,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259135+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:29:35.259135+0000","last_peered":"2023-08-27T11:29:35.259135+0000","last_clean":"2023-08-27T11:29:35.259135+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:29:35.259135+0000","last_undegraded":"2023-08-27T11:29:35.259135+0000","last_fullsized":"2023-08-27T11:29:35.259135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:47.731712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":236,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250963+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:29:35.250963+0000","last_peered":"2023-08-27T11:29:35.250963+0000","last_clean":"2023-08-27T11:29:35.250963+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:29:35.250963+0000","last_undegraded":"2023-08-27T11:29:35.250963+0000","last_fullsized":"2023-08-27T11:29:35.250963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:00.624913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252336+0000","last_change":"2023-08-27T11:29:35.252336+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252336+0000","last_undegraded":"2023-08-27T11:29:35.252336+0000","last_fullsized":"2023-08-27T11:29:35.252336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266886+0000","last_change":"2023-08-27T11:29:35.262815+0000","last_active":"2023-08-27T11:29:35.266886+0000","last_peered":"2023-08-27T11:29:35.266886+0000","last_clean":"2023-08-27T11:29:35.266886+0000","last_became_active":"2023-08-27T11:29:35.262500+0000","last_became_peered":"2023-08-27T11:29:35.262500+0000","last_unstale":"2023-08-27T11:29:35.266886+0000","last_undegraded":"2023-08-27T11:29:35.266886+0000","last_fullsized":"2023-08-27T11:29:35.266886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:47:20.213316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.245285+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:29:35.245285+0000","last_peered":"2023-08-27T11:29:35.245285+0000","last_clean":"2023-08-27T11:29:35.245285+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:29:35.245285+0000","last_undegraded":"2023-08-27T11:29:35.245285+0000","last_fullsized":"2023-08-27T11:29:35.245285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:56:28.822910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253490+0000","last_change":"2023-08-27T11:29:35.253490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253490+0000","last_undegraded":"2023-08-27T11:29:35.253490+0000","last_fullsized":"2023-08-27T11:29:35.253490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268560+0000","last_change":"2023-08-27T11:29:35.265167+0000","last_active":"2023-08-27T11:29:35.268560+0000","last_peered":"2023-08-27T11:29:35.268560+0000","last_clean":"2023-08-27T11:29:35.268560+0000","last_became_active":"2023-08-27T11:29:35.264787+0000","last_became_peered":"2023-08-27T11:29:35.264787+0000","last_unstale":"2023-08-27T11:29:35.268560+0000","last_undegraded":"2023-08-27T11:29:35.268560+0000","last_fullsized":"2023-08-27T11:29:35.268560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:45:02.383758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250446+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:29:35.250446+0000","last_peered":"2023-08-27T11:29:35.250446+0000","last_clean":"2023-08-27T11:29:35.250446+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:29:35.250446+0000","last_undegraded":"2023-08-27T11:29:35.250446+0000","last_fullsized":"2023-08-27T11:29:35.250446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:18.107852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.439}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.435},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.438},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.38}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.503}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.85599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.878},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.83499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.878},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":1.605}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":1.663}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":1.714},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":1.5609999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":1.099}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28752,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343088,"statfs":{"total":96636764160,"available":96607322112,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.878},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.746},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":1.028},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.98199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":1.0940000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":1.145},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:29:41.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:29:41.213 INFO:tasks.ceph.mds.d.smithi057.stderr:2023-08-27T11:29:41.212+0000 7f41b1df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:29:41.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.440+0000 7f4a05bff700 1 Processor -- start 2023-08-27T11:29:41.441 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.440+0000 7f4a05bff700 1 -- start start 2023-08-27T11:29:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f4a05bff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a000c4630 0x7f4a000c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f4a05bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a0006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f4a05bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0006c4e0 con 0x7f4a00151a90 2023-08-27T11:29:41.443 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f4a05bff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a00155370 con 0x7f4a000c4630 2023-08-27T11:29:41.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f4a05bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000c82c0 con 0x7f4a0006ad70 2023-08-27T11:29:41.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f49feffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a000c4630 0x7f4a000c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f49feffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f4a000c4630 0x7f4a000c4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35984/0 (socket says 172.21.15.43:35984) 2023-08-27T11:29:41.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f49ff7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4a00151a90 0x7f4a000c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42368/0 (socket says 172.21.15.43:42368) 2023-08-27T11:29:41.444 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.441+0000 7f49feffd700 1 -- 172.21.15.43:0/3873229430 learned_addr learned my addr 172.21.15.43:0/3873229430 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:41.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49fffff700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a0006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49feffd700 1 -- 172.21.15.43:0/3873229430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 msgr2=0x7f4a0006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:41.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49feffd700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a0006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49feffd700 1 -- 172.21.15.43:0/3873229430 >> v1:172.21.15.43:6789/0 conn(0x7f4a00151a90 legacy=0x7f4a000c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.445 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49fe7fc700 1 -- 172.21.15.43:0/3873229430 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847000844 0 0) 0x7f4a0006c4e0 con 0x7f4a00151a90 2023-08-27T11:29:41.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49feffd700 1 -- 172.21.15.43:0/3873229430 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a00151e70 con 0x7f4a000c4630 2023-08-27T11:29:41.446 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49feffd700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a000c4a90 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f49f40098f0 tx=0x7f49f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4258097a3a86e73 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49fe7fc700 1 -- 172.21.15.43:0/3873229430 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400b8a0 con 0x7f4a000c4630 2023-08-27T11:29:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49fe7fc700 1 -- 172.21.15.43:0/3873229430 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400ba00 con 0x7f4a000c4630 2023-08-27T11:29:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.442+0000 7f49fe7fc700 1 -- 172.21.15.43:0/3873229430 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400bd90 con 0x7f4a000c4630 2023-08-27T11:29:41.449 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 -- 172.21.15.43:0/3873229430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 msgr2=0x7f4a000c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a000c4a90 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f49f40098f0 tx=0x7f49f4009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 -- 172.21.15.43:0/3873229430 shutdown_connections 2023-08-27T11:29:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a0006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 --2- 172.21.15.43:0/3873229430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a000c4a90 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.450 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 -- 172.21.15.43:0/3873229430 >> 172.21.15.43:0/3873229430 conn(0x7f4a000ab820 msgr2=0x7f4a000abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 -- 172.21.15.43:0/3873229430 shutdown_connections 2023-08-27T11:29:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.443+0000 7f4a05bff700 1 -- 172.21.15.43:0/3873229430 wait complete. 2023-08-27T11:29:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.445+0000 7f4a05bff700 1 Processor -- start 2023-08-27T11:29:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.445+0000 7f4a05bff700 1 -- start start 2023-08-27T11:29:41.451 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a00148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 0x7f4a00146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0014de50 con 0x7f4a000c4630 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0014d560 con 0x7f4a00151a90 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f4a05bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0014a300 con 0x7f4a0006ad70 2023-08-27T11:29:41.452 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:35992/0 (socket says 172.21.15.43:35992) 2023-08-27T11:29:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 -- 172.21.15.43:0/2841488158 learned_addr learned my addr 172.21.15.43:0/2841488158 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49fffff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 0x7f4a00146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49ff7fe700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a00148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.453 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 -- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 msgr2=0x7f4a00148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a00148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 -- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 msgr2=0x7f4a00146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 0x7f4a00146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49feffd700 1 -- 172.21.15.43:0/2841488158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f4009550 con 0x7f4a000c4630 2023-08-27T11:29:41.454 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.446+0000 7f49fffff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 0x7f4a00146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f49feffd700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009c40 tx=0x7f49f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f4004380 con 0x7f4a000c4630 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f401f070 con 0x7f4a000c4630 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a00154090 con 0x7f4a000c4630 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40036a0 con 0x7f4a000c4630 2023-08-27T11:29:41.455 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.447+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0014da70 con 0x7f4a000c4630 2023-08-27T11:29:41.456 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.448+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a00154a20 con 0x7f4a000c4630 2023-08-27T11:29:41.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.449+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49f4021030 con 0x7f4a000c4630 2023-08-27T11:29:41.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.450+0000 7f49e7fff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 0x7f49ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.450+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49f4089ad0 con 0x7f4a000c4630 2023-08-27T11:29:41.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.450+0000 7f49ff7fe700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 0x7f49ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.450+0000 7f49ff7fe700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 0x7f49ec06c5a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f49f0000f60 tx=0x7f49f0007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.458 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.454+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4a00154a20 con 0x7f4a000c4630 2023-08-27T11:29:41.661 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.660+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a00154760 con 0x7f49ec06a0e0 2023-08-27T11:29:41.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.671+0000 7f49e7fff700 1 -- 172.21.15.43:0/2841488158 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306507 (secure 0 0 0) 0x7f49f0012380 con 0x7f49ec06a0e0 2023-08-27T11:29:41.675 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:41.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 msgr2=0x7f49ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 0x7f49ec06c5a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f49f0000f60 tx=0x7f49f0007c90 comp rx=0 tx=0).stop 2023-08-27T11:29:41.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 msgr2=0x7f4a00146310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009c40 tx=0x7f49f4004750 comp rx=0 tx=0).stop 2023-08-27T11:29:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 shutdown_connections 2023-08-27T11:29:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49ec06a0e0 0x7f49ec06c5a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a00151a90 0x7f4a00146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a0006ad70 0x7f4a00148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 --2- 172.21.15.43:0/2841488158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f4a000c4630 0x7f4a00146310 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 >> 172.21.15.43:0/2841488158 conn(0x7f4a000ab820 msgr2=0x7f4a0014ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 shutdown_connections 2023-08-27T11:29:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.675+0000 7f4a05bff700 1 -- 172.21.15.43:0/2841488158 wait complete. 2023-08-27T11:29:41.680 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:29:41.695 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2023-08-27T11:29:40.397527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251960,"kb_used_data":15000,"kb_used_omap":13,"kb_used_meta":236850,"kb_avail":754722760,"statfs":{"total":773094113280,"available":772836106240,"internally_reserved":0,"allocated":15360000,"data_stored":7903208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":242534488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251112+0000","last_change":"2023-08-27T11:29:35.251112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251112+0000","last_undegraded":"2023-08-27T11:29:35.251112+0000","last_fullsized":"2023-08-27T11:29:35.251112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255173+0000","last_change":"2023-08-27T11:29:35.255173+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255173+0000","last_undegraded":"2023-08-27T11:29:35.255173+0000","last_fullsized":"2023-08-27T11:29:35.255173+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250843+0000","last_change":"2023-08-27T11:29:35.250843+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250843+0000","last_undegraded":"2023-08-27T11:29:35.250843+0000","last_fullsized":"2023-08-27T11:29:35.250843+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250770+0000","last_change":"2023-08-27T11:29:35.250770+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250770+0000","last_undegraded":"2023-08-27T11:29:35.250770+0000","last_fullsized":"2023-08-27T11:29:35.250770+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250310+0000","last_change":"2023-08-27T11:29:35.250310+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250310+0000","last_undegraded":"2023-08-27T11:29:35.250310+0000","last_fullsized":"2023-08-27T11:29:35.250310+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255834+0000","last_change":"2023-08-27T11:29:35.255834+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255834+0000","last_undegraded":"2023-08-27T11:29:35.255834+0000","last_fullsized":"2023-08-27T11:29:35.255834+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249800+0000","last_change":"2023-08-27T11:29:35.249800+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249800+0000","last_undegraded":"2023-08-27T11:29:35.249800+0000","last_fullsized":"2023-08-27T11:29:35.249800+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250724+0000","last_change":"2023-08-27T11:29:35.250724+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250724+0000","last_undegraded":"2023-08-27T11:29:35.250724+0000","last_fullsized":"2023-08-27T11:29:35.250724+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252253+0000","last_change":"2023-08-27T11:29:35.252253+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252253+0000","last_undegraded":"2023-08-27T11:29:35.252253+0000","last_fullsized":"2023-08-27T11:29:35.252253+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252722+0000","last_change":"2023-08-27T11:29:35.252722+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252722+0000","last_undegraded":"2023-08-27T11:29:35.252722+0000","last_fullsized":"2023-08-27T11:29:35.252722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258661+0000","last_change":"2023-08-27T11:29:35.258661+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258661+0000","last_undegraded":"2023-08-27T11:29:35.258661+0000","last_fullsized":"2023-08-27T11:29:35.258661+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254702+0000","last_change":"2023-08-27T11:29:35.254702+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254702+0000","last_undegraded":"2023-08-27T11:29:35.254702+0000","last_fullsized":"2023-08-27T11:29:35.254702+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244694+0000","last_change":"2023-08-27T11:29:35.244694+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244694+0000","last_undegraded":"2023-08-27T11:29:35.244694+0000","last_fullsized":"2023-08-27T11:29:35.244694+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250569+0000","last_change":"2023-08-27T11:29:35.250569+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250569+0000","last_undegraded":"2023-08-27T11:29:35.250569+0000","last_fullsized":"2023-08-27T11:29:35.250569+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260356+0000","last_change":"2023-08-27T11:29:35.260356+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260356+0000","last_undegraded":"2023-08-27T11:29:35.260356+0000","last_fullsized":"2023-08-27T11:29:35.260356+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250804+0000","last_change":"2023-08-27T11:29:35.250804+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250804+0000","last_undegraded":"2023-08-27T11:29:35.250804+0000","last_fullsized":"2023-08-27T11:29:35.250804+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251802+0000","last_change":"2023-08-27T11:29:35.251802+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251802+0000","last_undegraded":"2023-08-27T11:29:35.251802+0000","last_fullsized":"2023-08-27T11:29:35.251802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254211+0000","last_change":"2023-08-27T11:29:35.254211+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254211+0000","last_undegraded":"2023-08-27T11:29:35.254211+0000","last_fullsized":"2023-08-27T11:29:35.254211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259615+0000","last_change":"2023-08-27T11:29:35.259615+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259615+0000","last_undegraded":"2023-08-27T11:29:35.259615+0000","last_fullsized":"2023-08-27T11:29:35.259615+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244622+0000","last_change":"2023-08-27T11:29:35.244622+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244622+0000","last_undegraded":"2023-08-27T11:29:35.244622+0000","last_fullsized":"2023-08-27T11:29:35.244622+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243368+0000","last_change":"2023-08-27T11:29:35.243368+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243368+0000","last_undegraded":"2023-08-27T11:29:35.243368+0000","last_fullsized":"2023-08-27T11:29:35.243368+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.255112+0000","last_change":"2023-08-27T11:29:35.255112+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.255112+0000","last_undegraded":"2023-08-27T11:29:35.255112+0000","last_fullsized":"2023-08-27T11:29:35.255112+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.251271+0000","last_change":"2023-08-27T11:29:35.251271+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.251271+0000","last_undegraded":"2023-08-27T11:29:35.251271+0000","last_fullsized":"2023-08-27T11:29:35.251271+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250275+0000","last_change":"2023-08-27T11:29:35.250275+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250275+0000","last_undegraded":"2023-08-27T11:29:35.250275+0000","last_fullsized":"2023-08-27T11:29:35.250275+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244503+0000","last_change":"2023-08-27T11:29:35.244503+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244503+0000","last_undegraded":"2023-08-27T11:29:35.244503+0000","last_fullsized":"2023-08-27T11:29:35.244503+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.247261+0000","last_change":"2023-08-27T11:29:35.247261+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.247261+0000","last_undegraded":"2023-08-27T11:29:35.247261+0000","last_fullsized":"2023-08-27T11:29:35.247261+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256450+0000","last_change":"2023-08-27T11:29:35.256450+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256450+0000","last_undegraded":"2023-08-27T11:29:35.256450+0000","last_fullsized":"2023-08-27T11:29:35.256450+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245026+0000","last_change":"2023-08-27T11:29:35.245026+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245026+0000","last_undegraded":"2023-08-27T11:29:35.245026+0000","last_fullsized":"2023-08-27T11:29:35.245026+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257649+0000","last_change":"2023-08-27T11:29:35.257649+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257649+0000","last_undegraded":"2023-08-27T11:29:35.257649+0000","last_fullsized":"2023-08-27T11:29:35.257649+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254000+0000","last_change":"2023-08-27T11:29:35.254000+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254000+0000","last_undegraded":"2023-08-27T11:29:35.254000+0000","last_fullsized":"2023-08-27T11:29:35.254000+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.259828+0000","last_change":"2023-08-27T11:29:35.259828+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.259828+0000","last_undegraded":"2023-08-27T11:29:35.259828+0000","last_fullsized":"2023-08-27T11:29:35.259828+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253331+0000","last_change":"2023-08-27T11:29:35.253331+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253331+0000","last_undegraded":"2023-08-27T11:29:35.253331+0000","last_fullsized":"2023-08-27T11:29:35.253331+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257612+0000","last_change":"2023-08-27T11:29:35.257612+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257612+0000","last_undegraded":"2023-08-27T11:29:35.257612+0000","last_fullsized":"2023-08-27T11:29:35.257612+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.265746+0000","last_change":"2023-08-27T11:29:35.262477+0000","last_active":"2023-08-27T11:29:35.265746+0000","last_peered":"2023-08-27T11:29:35.265746+0000","last_clean":"2023-08-27T11:29:35.265746+0000","last_became_active":"2023-08-27T11:29:35.262122+0000","last_became_peered":"2023-08-27T11:29:35.262122+0000","last_unstale":"2023-08-27T11:29:35.265746+0000","last_undegraded":"2023-08-27T11:29:35.265746+0000","last_fullsized":"2023-08-27T11:29:35.265746+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:45:01.498491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242830+0000","last_change":"2023-08-27T11:29:35.242830+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242830+0000","last_undegraded":"2023-08-27T11:29:35.242830+0000","last_fullsized":"2023-08-27T11:29:35.242830+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266823+0000","last_change":"2023-08-27T11:29:35.261806+0000","last_active":"2023-08-27T11:29:35.266823+0000","last_peered":"2023-08-27T11:29:35.266823+0000","last_clean":"2023-08-27T11:29:35.266823+0000","last_became_active":"2023-08-27T11:29:35.261521+0000","last_became_peered":"2023-08-27T11:29:35.261521+0000","last_unstale":"2023-08-27T11:29:35.266823+0000","last_undegraded":"2023-08-27T11:29:35.266823+0000","last_fullsized":"2023-08-27T11:29:35.266823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:38.230227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250127+0000","last_change":"2023-08-27T11:29:35.250127+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250127+0000","last_undegraded":"2023-08-27T11:29:35.250127+0000","last_fullsized":"2023-08-27T11:29:35.250127+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275158+0000","last_change":"2023-08-27T11:29:35.270214+0000","last_active":"2023-08-27T11:29:35.275158+0000","last_peered":"2023-08-27T11:29:35.275158+0000","last_clean":"2023-08-27T11:29:35.275158+0000","last_became_active":"2023-08-27T11:29:35.269755+0000","last_became_peered":"2023-08-27T11:29:35.269755+0000","last_unstale":"2023-08-27T11:29:35.275158+0000","last_undegraded":"2023-08-27T11:29:35.275158+0000","last_fullsized":"2023-08-27T11:29:35.275158+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:38.942747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257233+0000","last_change":"2023-08-27T11:29:35.257233+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257233+0000","last_undegraded":"2023-08-27T11:29:35.257233+0000","last_fullsized":"2023-08-27T11:29:35.257233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268491+0000","last_change":"2023-08-27T11:29:35.262484+0000","last_active":"2023-08-27T11:29:35.268491+0000","last_peered":"2023-08-27T11:29:35.268491+0000","last_clean":"2023-08-27T11:29:35.268491+0000","last_became_active":"2023-08-27T11:29:35.262188+0000","last_became_peered":"2023-08-27T11:29:35.262188+0000","last_unstale":"2023-08-27T11:29:35.268491+0000","last_undegraded":"2023-08-27T11:29:35.268491+0000","last_fullsized":"2023-08-27T11:29:35.268491+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:09:48.393606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253359+0000","last_change":"2023-08-27T11:29:35.253359+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253359+0000","last_undegraded":"2023-08-27T11:29:35.253359+0000","last_fullsized":"2023-08-27T11:29:35.253359+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268126+0000","last_change":"2023-08-27T11:29:35.265293+0000","last_active":"2023-08-27T11:29:35.268126+0000","last_peered":"2023-08-27T11:29:35.268126+0000","last_clean":"2023-08-27T11:29:35.268126+0000","last_became_active":"2023-08-27T11:29:35.265025+0000","last_became_peered":"2023-08-27T11:29:35.265025+0000","last_unstale":"2023-08-27T11:29:35.268126+0000","last_undegraded":"2023-08-27T11:29:35.268126+0000","last_fullsized":"2023-08-27T11:29:35.268126+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:16:10.071504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242686+0000","last_change":"2023-08-27T11:29:35.242686+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242686+0000","last_undegraded":"2023-08-27T11:29:35.242686+0000","last_fullsized":"2023-08-27T11:29:35.242686+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266667+0000","last_change":"2023-08-27T11:29:35.257372+0000","last_active":"2023-08-27T11:29:35.266667+0000","last_peered":"2023-08-27T11:29:35.266667+0000","last_clean":"2023-08-27T11:29:35.266667+0000","last_became_active":"2023-08-27T11:29:35.257071+0000","last_became_peered":"2023-08-27T11:29:35.257071+0000","last_unstale":"2023-08-27T11:29:35.266667+0000","last_undegraded":"2023-08-27T11:29:35.266667+0000","last_fullsized":"2023-08-27T11:29:35.266667+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:11:16.883838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242490+0000","last_change":"2023-08-27T11:29:35.242490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242490+0000","last_undegraded":"2023-08-27T11:29:35.242490+0000","last_fullsized":"2023-08-27T11:29:35.242490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260364+0000","last_change":"2023-08-27T11:29:35.258285+0000","last_active":"2023-08-27T11:29:35.260364+0000","last_peered":"2023-08-27T11:29:35.260364+0000","last_clean":"2023-08-27T11:29:35.260364+0000","last_became_active":"2023-08-27T11:29:35.257980+0000","last_became_peered":"2023-08-27T11:29:35.257980+0000","last_unstale":"2023-08-27T11:29:35.260364+0000","last_undegraded":"2023-08-27T11:29:35.260364+0000","last_fullsized":"2023-08-27T11:29:35.260364+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:07:50.064967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250559+0000","last_change":"2023-08-27T11:29:35.250559+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250559+0000","last_undegraded":"2023-08-27T11:29:35.250559+0000","last_fullsized":"2023-08-27T11:29:35.250559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268633+0000","last_change":"2023-08-27T11:29:35.266493+0000","last_active":"2023-08-27T11:29:35.268633+0000","last_peered":"2023-08-27T11:29:35.268633+0000","last_clean":"2023-08-27T11:29:35.268633+0000","last_became_active":"2023-08-27T11:29:35.266215+0000","last_became_peered":"2023-08-27T11:29:35.266215+0000","last_unstale":"2023-08-27T11:29:35.268633+0000","last_undegraded":"2023-08-27T11:29:35.268633+0000","last_fullsized":"2023-08-27T11:29:35.268633+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:22:13.365450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249967+0000","last_change":"2023-08-27T11:29:35.249967+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249967+0000","last_undegraded":"2023-08-27T11:29:35.249967+0000","last_fullsized":"2023-08-27T11:29:35.249967+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268314+0000","last_change":"2023-08-27T11:29:35.264052+0000","last_active":"2023-08-27T11:29:35.268314+0000","last_peered":"2023-08-27T11:29:35.268314+0000","last_clean":"2023-08-27T11:29:35.268314+0000","last_became_active":"2023-08-27T11:29:35.263557+0000","last_became_peered":"2023-08-27T11:29:35.263557+0000","last_unstale":"2023-08-27T11:29:35.268314+0000","last_undegraded":"2023-08-27T11:29:35.268314+0000","last_fullsized":"2023-08-27T11:29:35.268314+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:43.308222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254079+0000","last_change":"2023-08-27T11:29:35.254079+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254079+0000","last_undegraded":"2023-08-27T11:29:35.254079+0000","last_fullsized":"2023-08-27T11:29:35.254079+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260130+0000","last_change":"2023-08-27T11:29:35.258078+0000","last_active":"2023-08-27T11:29:35.260130+0000","last_peered":"2023-08-27T11:29:35.260130+0000","last_clean":"2023-08-27T11:29:35.260130+0000","last_became_active":"2023-08-27T11:29:35.257736+0000","last_became_peered":"2023-08-27T11:29:35.257736+0000","last_unstale":"2023-08-27T11:29:35.260130+0000","last_undegraded":"2023-08-27T11:29:35.260130+0000","last_fullsized":"2023-08-27T11:29:35.260130+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:50:09.478998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260634+0000","last_change":"2023-08-27T11:29:35.260634+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260634+0000","last_undegraded":"2023-08-27T11:29:35.260634+0000","last_fullsized":"2023-08-27T11:29:35.260634+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268003+0000","last_change":"2023-08-27T11:29:35.262578+0000","last_active":"2023-08-27T11:29:35.268003+0000","last_peered":"2023-08-27T11:29:35.268003+0000","last_clean":"2023-08-27T11:29:35.268003+0000","last_became_active":"2023-08-27T11:29:35.262279+0000","last_became_peered":"2023-08-27T11:29:35.262279+0000","last_unstale":"2023-08-27T11:29:35.268003+0000","last_undegraded":"2023-08-27T11:29:35.268003+0000","last_fullsized":"2023-08-27T11:29:35.268003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:25:54.336653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257723+0000","last_change":"2023-08-27T11:29:35.257723+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257723+0000","last_undegraded":"2023-08-27T11:29:35.257723+0000","last_fullsized":"2023-08-27T11:29:35.257723+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268614+0000","last_change":"2023-08-27T11:29:35.265840+0000","last_active":"2023-08-27T11:29:35.268614+0000","last_peered":"2023-08-27T11:29:35.268614+0000","last_clean":"2023-08-27T11:29:35.268614+0000","last_became_active":"2023-08-27T11:29:35.265577+0000","last_became_peered":"2023-08-27T11:29:35.265577+0000","last_unstale":"2023-08-27T11:29:35.268614+0000","last_undegraded":"2023-08-27T11:29:35.268614+0000","last_fullsized":"2023-08-27T11:29:35.268614+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:14.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243924+0000","last_change":"2023-08-27T11:29:35.243924+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243924+0000","last_undegraded":"2023-08-27T11:29:35.243924+0000","last_fullsized":"2023-08-27T11:29:35.243924+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268579+0000","last_change":"2023-08-27T11:29:35.265779+0000","last_active":"2023-08-27T11:29:35.268579+0000","last_peered":"2023-08-27T11:29:35.268579+0000","last_clean":"2023-08-27T11:29:35.268579+0000","last_became_active":"2023-08-27T11:29:35.265505+0000","last_became_peered":"2023-08-27T11:29:35.265505+0000","last_unstale":"2023-08-27T11:29:35.268579+0000","last_undegraded":"2023-08-27T11:29:35.268579+0000","last_fullsized":"2023-08-27T11:29:35.268579+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:14:06.317232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249968+0000","last_change":"2023-08-27T11:29:35.249968+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249968+0000","last_undegraded":"2023-08-27T11:29:35.249968+0000","last_fullsized":"2023-08-27T11:29:35.249968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275120+0000","last_change":"2023-08-27T11:29:35.270172+0000","last_active":"2023-08-27T11:29:35.275120+0000","last_peered":"2023-08-27T11:29:35.275120+0000","last_clean":"2023-08-27T11:29:35.275120+0000","last_became_active":"2023-08-27T11:29:35.269864+0000","last_became_peered":"2023-08-27T11:29:35.269864+0000","last_unstale":"2023-08-27T11:29:35.275120+0000","last_undegraded":"2023-08-27T11:29:35.275120+0000","last_fullsized":"2023-08-27T11:29:35.275120+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:37.027357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253857+0000","last_change":"2023-08-27T11:29:35.253857+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253857+0000","last_undegraded":"2023-08-27T11:29:35.253857+0000","last_fullsized":"2023-08-27T11:29:35.253857+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268478+0000","last_change":"2023-08-27T11:29:35.263997+0000","last_active":"2023-08-27T11:29:35.268478+0000","last_peered":"2023-08-27T11:29:35.268478+0000","last_clean":"2023-08-27T11:29:35.268478+0000","last_became_active":"2023-08-27T11:29:35.263703+0000","last_became_peered":"2023-08-27T11:29:35.263703+0000","last_unstale":"2023-08-27T11:29:35.268478+0000","last_undegraded":"2023-08-27T11:29:35.268478+0000","last_fullsized":"2023-08-27T11:29:35.268478+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:26.998585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254051+0000","last_change":"2023-08-27T11:29:35.254051+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254051+0000","last_undegraded":"2023-08-27T11:29:35.254051+0000","last_fullsized":"2023-08-27T11:29:35.254051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275351+0000","last_change":"2023-08-27T11:29:35.274174+0000","last_active":"2023-08-27T11:29:35.275351+0000","last_peered":"2023-08-27T11:29:35.275351+0000","last_clean":"2023-08-27T11:29:35.275351+0000","last_became_active":"2023-08-27T11:29:35.273836+0000","last_became_peered":"2023-08-27T11:29:35.273836+0000","last_unstale":"2023-08-27T11:29:35.275351+0000","last_undegraded":"2023-08-27T11:29:35.275351+0000","last_fullsized":"2023-08-27T11:29:35.275351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:35.543780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.257554+0000","last_change":"2023-08-27T11:29:35.257554+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.257554+0000","last_undegraded":"2023-08-27T11:29:35.257554+0000","last_fullsized":"2023-08-27T11:29:35.257554+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268042+0000","last_change":"2023-08-27T11:29:35.265229+0000","last_active":"2023-08-27T11:29:35.268042+0000","last_peered":"2023-08-27T11:29:35.268042+0000","last_clean":"2023-08-27T11:29:35.268042+0000","last_became_active":"2023-08-27T11:29:35.264883+0000","last_became_peered":"2023-08-27T11:29:35.264883+0000","last_unstale":"2023-08-27T11:29:35.268042+0000","last_undegraded":"2023-08-27T11:29:35.268042+0000","last_fullsized":"2023-08-27T11:29:35.268042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:24:43.794265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.249282+0000","last_change":"2023-08-27T11:29:35.249282+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.249282+0000","last_undegraded":"2023-08-27T11:29:35.249282+0000","last_fullsized":"2023-08-27T11:29:35.249282+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264149+0000","last_change":"2023-08-27T11:29:35.258902+0000","last_active":"2023-08-27T11:29:35.264149+0000","last_peered":"2023-08-27T11:29:35.264149+0000","last_clean":"2023-08-27T11:29:35.264149+0000","last_became_active":"2023-08-27T11:29:35.258622+0000","last_became_peered":"2023-08-27T11:29:35.258622+0000","last_unstale":"2023-08-27T11:29:35.264149+0000","last_undegraded":"2023-08-27T11:29:35.264149+0000","last_fullsized":"2023-08-27T11:29:35.264149+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:57.769261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244907+0000","last_change":"2023-08-27T11:29:35.244907+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244907+0000","last_undegraded":"2023-08-27T11:29:35.244907+0000","last_fullsized":"2023-08-27T11:29:35.244907+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268351+0000","last_change":"2023-08-27T11:29:35.265730+0000","last_active":"2023-08-27T11:29:35.268351+0000","last_peered":"2023-08-27T11:29:35.268351+0000","last_clean":"2023-08-27T11:29:35.268351+0000","last_became_active":"2023-08-27T11:29:35.265470+0000","last_became_peered":"2023-08-27T11:29:35.265470+0000","last_unstale":"2023-08-27T11:29:35.268351+0000","last_undegraded":"2023-08-27T11:29:35.268351+0000","last_fullsized":"2023-08-27T11:29:35.268351+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:08.044907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250335+0000","last_change":"2023-08-27T11:29:35.250335+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250335+0000","last_undegraded":"2023-08-27T11:29:35.250335+0000","last_fullsized":"2023-08-27T11:29:35.250335+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266417+0000","last_change":"2023-08-27T11:29:35.258653+0000","last_active":"2023-08-27T11:29:35.266417+0000","last_peered":"2023-08-27T11:29:35.266417+0000","last_clean":"2023-08-27T11:29:35.266417+0000","last_became_active":"2023-08-27T11:29:35.258374+0000","last_became_peered":"2023-08-27T11:29:35.258374+0000","last_unstale":"2023-08-27T11:29:35.266417+0000","last_undegraded":"2023-08-27T11:29:35.266417+0000","last_fullsized":"2023-08-27T11:29:35.266417+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:02.909752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.250168+0000","last_change":"2023-08-27T11:29:35.250168+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.250168+0000","last_undegraded":"2023-08-27T11:29:35.250168+0000","last_fullsized":"2023-08-27T11:29:35.250168+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.269405+0000","last_change":"2023-08-27T11:29:35.264235+0000","last_active":"2023-08-27T11:29:35.269405+0000","last_peered":"2023-08-27T11:29:35.269405+0000","last_clean":"2023-08-27T11:29:35.269405+0000","last_became_active":"2023-08-27T11:29:35.263872+0000","last_became_peered":"2023-08-27T11:29:35.263872+0000","last_unstale":"2023-08-27T11:29:35.269405+0000","last_undegraded":"2023-08-27T11:29:35.269405+0000","last_fullsized":"2023-08-27T11:29:35.269405+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:27:35.857421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.256005+0000","last_change":"2023-08-27T11:29:35.256005+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.256005+0000","last_undegraded":"2023-08-27T11:29:35.256005+0000","last_fullsized":"2023-08-27T11:29:35.256005+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.257055+0000","last_change":"2023-08-27T11:29:35.251383+0000","last_active":"2023-08-27T11:29:35.257055+0000","last_peered":"2023-08-27T11:29:35.257055+0000","last_clean":"2023-08-27T11:29:35.257055+0000","last_became_active":"2023-08-27T11:29:35.251115+0000","last_became_peered":"2023-08-27T11:29:35.251115+0000","last_unstale":"2023-08-27T11:29:35.257055+0000","last_undegraded":"2023-08-27T11:29:35.257055+0000","last_fullsized":"2023-08-27T11:29:35.257055+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:17.263129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.244565+0000","last_change":"2023-08-27T11:29:35.244565+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.244565+0000","last_undegraded":"2023-08-27T11:29:35.244565+0000","last_fullsized":"2023-08-27T11:29:35.244565+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275095+0000","last_change":"2023-08-27T11:29:35.270115+0000","last_active":"2023-08-27T11:29:35.275095+0000","last_peered":"2023-08-27T11:29:35.275095+0000","last_clean":"2023-08-27T11:29:35.275095+0000","last_became_active":"2023-08-27T11:29:35.269746+0000","last_became_peered":"2023-08-27T11:29:35.269746+0000","last_unstale":"2023-08-27T11:29:35.275095+0000","last_undegraded":"2023-08-27T11:29:35.275095+0000","last_fullsized":"2023-08-27T11:29:35.275095+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:16.896770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242754+0000","last_change":"2023-08-27T11:29:35.242754+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242754+0000","last_undegraded":"2023-08-27T11:29:35.242754+0000","last_fullsized":"2023-08-27T11:29:35.242754+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268214+0000","last_change":"2023-08-27T11:29:35.265870+0000","last_active":"2023-08-27T11:29:35.268214+0000","last_peered":"2023-08-27T11:29:35.268214+0000","last_clean":"2023-08-27T11:29:35.268214+0000","last_became_active":"2023-08-27T11:29:35.265559+0000","last_became_peered":"2023-08-27T11:29:35.265559+0000","last_unstale":"2023-08-27T11:29:35.268214+0000","last_undegraded":"2023-08-27T11:29:35.268214+0000","last_fullsized":"2023-08-27T11:29:35.268214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:41:54.608604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.260132+0000","last_change":"2023-08-27T11:29:35.260132+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.260132+0000","last_undegraded":"2023-08-27T11:29:35.260132+0000","last_fullsized":"2023-08-27T11:29:35.260132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.275125+0000","last_change":"2023-08-27T11:29:35.270153+0000","last_active":"2023-08-27T11:29:35.275125+0000","last_peered":"2023-08-27T11:29:35.275125+0000","last_clean":"2023-08-27T11:29:35.275125+0000","last_became_active":"2023-08-27T11:29:35.269729+0000","last_became_peered":"2023-08-27T11:29:35.269729+0000","last_unstale":"2023-08-27T11:29:35.275125+0000","last_undegraded":"2023-08-27T11:29:35.275125+0000","last_fullsized":"2023-08-27T11:29:35.275125+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:28:30.296677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261488+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:29:35.261488+0000","last_peered":"2023-08-27T11:29:35.261488+0000","last_clean":"2023-08-27T11:29:35.261488+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:29:35.261488+0000","last_undegraded":"2023-08-27T11:29:35.261488+0000","last_fullsized":"2023-08-27T11:29:35.261488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:07:42.147516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.245480+0000","last_change":"2023-08-27T11:29:35.245480+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.245480+0000","last_undegraded":"2023-08-27T11:29:35.245480+0000","last_fullsized":"2023-08-27T11:29:35.245480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268133+0000","last_change":"2023-08-27T11:29:35.264586+0000","last_active":"2023-08-27T11:29:35.268133+0000","last_peered":"2023-08-27T11:29:35.268133+0000","last_clean":"2023-08-27T11:29:35.268133+0000","last_became_active":"2023-08-27T11:29:35.264251+0000","last_became_peered":"2023-08-27T11:29:35.264251+0000","last_unstale":"2023-08-27T11:29:35.268133+0000","last_undegraded":"2023-08-27T11:29:35.268133+0000","last_fullsized":"2023-08-27T11:29:35.268133+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:18.324361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":240,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.261770+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:29:35.261770+0000","last_peered":"2023-08-27T11:29:35.261770+0000","last_clean":"2023-08-27T11:29:35.261770+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:29:35.261770+0000","last_undegraded":"2023-08-27T11:29:35.261770+0000","last_fullsized":"2023-08-27T11:29:35.261770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:47:16.395720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.258040+0000","last_change":"2023-08-27T11:29:35.258040+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.258040+0000","last_undegraded":"2023-08-27T11:29:35.258040+0000","last_fullsized":"2023-08-27T11:29:35.258040+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264524+0000","last_change":"2023-08-27T11:29:35.259916+0000","last_active":"2023-08-27T11:29:35.264524+0000","last_peered":"2023-08-27T11:29:35.264524+0000","last_clean":"2023-08-27T11:29:35.264524+0000","last_became_active":"2023-08-27T11:29:35.259653+0000","last_became_peered":"2023-08-27T11:29:35.259653+0000","last_unstale":"2023-08-27T11:29:35.264524+0000","last_undegraded":"2023-08-27T11:29:35.264524+0000","last_fullsized":"2023-08-27T11:29:35.264524+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:38.101644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.260681+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:29:35.260681+0000","last_peered":"2023-08-27T11:29:35.260681+0000","last_clean":"2023-08-27T11:29:35.260681+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:29:35.260681+0000","last_undegraded":"2023-08-27T11:29:35.260681+0000","last_fullsized":"2023-08-27T11:29:35.260681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:32:19.428666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.254010+0000","last_change":"2023-08-27T11:29:35.254010+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.254010+0000","last_undegraded":"2023-08-27T11:29:35.254010+0000","last_fullsized":"2023-08-27T11:29:35.254010+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264170+0000","last_change":"2023-08-27T11:29:35.258960+0000","last_active":"2023-08-27T11:29:35.264170+0000","last_peered":"2023-08-27T11:29:35.264170+0000","last_clean":"2023-08-27T11:29:35.264170+0000","last_became_active":"2023-08-27T11:29:35.258657+0000","last_became_peered":"2023-08-27T11:29:35.258657+0000","last_unstale":"2023-08-27T11:29:35.264170+0000","last_undegraded":"2023-08-27T11:29:35.264170+0000","last_fullsized":"2023-08-27T11:29:35.264170+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:16.004617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259265+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:29:35.259265+0000","last_peered":"2023-08-27T11:29:35.259265+0000","last_clean":"2023-08-27T11:29:35.259265+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:29:35.259265+0000","last_undegraded":"2023-08-27T11:29:35.259265+0000","last_fullsized":"2023-08-27T11:29:35.259265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:32:34.180054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.242485+0000","last_change":"2023-08-27T11:29:35.242485+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.242485+0000","last_undegraded":"2023-08-27T11:29:35.242485+0000","last_fullsized":"2023-08-27T11:29:35.242485+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.264531+0000","last_change":"2023-08-27T11:29:35.259131+0000","last_active":"2023-08-27T11:29:35.264531+0000","last_peered":"2023-08-27T11:29:35.264531+0000","last_clean":"2023-08-27T11:29:35.264531+0000","last_became_active":"2023-08-27T11:29:35.258823+0000","last_became_peered":"2023-08-27T11:29:35.258823+0000","last_unstale":"2023-08-27T11:29:35.264531+0000","last_undegraded":"2023-08-27T11:29:35.264531+0000","last_fullsized":"2023-08-27T11:29:35.264531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:08:27.481500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.258928+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:29:35.258928+0000","last_peered":"2023-08-27T11:29:35.258928+0000","last_clean":"2023-08-27T11:29:35.258928+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:29:35.258928+0000","last_undegraded":"2023-08-27T11:29:35.258928+0000","last_fullsized":"2023-08-27T11:29:35.258928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:03:42.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.243223+0000","last_change":"2023-08-27T11:29:35.243223+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.243223+0000","last_undegraded":"2023-08-27T11:29:35.243223+0000","last_fullsized":"2023-08-27T11:29:35.243223+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.271708+0000","last_change":"2023-08-27T11:29:35.270703+0000","last_active":"2023-08-27T11:29:35.271708+0000","last_peered":"2023-08-27T11:29:35.271708+0000","last_clean":"2023-08-27T11:29:35.271708+0000","last_became_active":"2023-08-27T11:29:35.270171+0000","last_became_peered":"2023-08-27T11:29:35.270171+0000","last_unstale":"2023-08-27T11:29:35.271708+0000","last_undegraded":"2023-08-27T11:29:35.271708+0000","last_fullsized":"2023-08-27T11:29:35.271708+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:31:59.217922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":374,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.259135+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:29:35.259135+0000","last_peered":"2023-08-27T11:29:35.259135+0000","last_clean":"2023-08-27T11:29:35.259135+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:29:35.259135+0000","last_undegraded":"2023-08-27T11:29:35.259135+0000","last_fullsized":"2023-08-27T11:29:35.259135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:55:47.731712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":236,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250963+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:29:35.250963+0000","last_peered":"2023-08-27T11:29:35.250963+0000","last_clean":"2023-08-27T11:29:35.250963+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:29:35.250963+0000","last_undegraded":"2023-08-27T11:29:35.250963+0000","last_fullsized":"2023-08-27T11:29:35.250963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:34:00.624913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.252336+0000","last_change":"2023-08-27T11:29:35.252336+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.252336+0000","last_undegraded":"2023-08-27T11:29:35.252336+0000","last_fullsized":"2023-08-27T11:29:35.252336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.266886+0000","last_change":"2023-08-27T11:29:35.262815+0000","last_active":"2023-08-27T11:29:35.266886+0000","last_peered":"2023-08-27T11:29:35.266886+0000","last_clean":"2023-08-27T11:29:35.266886+0000","last_became_active":"2023-08-27T11:29:35.262500+0000","last_became_peered":"2023-08-27T11:29:35.262500+0000","last_unstale":"2023-08-27T11:29:35.266886+0000","last_undegraded":"2023-08-27T11:29:35.266886+0000","last_fullsized":"2023-08-27T11:29:35.266886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:47:20.213316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.245285+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:29:35.245285+0000","last_peered":"2023-08-27T11:29:35.245285+0000","last_clean":"2023-08-27T11:29:35.245285+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:29:35.245285+0000","last_undegraded":"2023-08-27T11:29:35.245285+0000","last_fullsized":"2023-08-27T11:29:35.245285+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:56:28.822910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-08-27T11:29:35.253490+0000","last_change":"2023-08-27T11:29:35.253490+0000","last_active":"2023-08-27T11:29:35.229654+0000","last_peered":"2023-08-27T11:29:35.229654+0000","last_clean":"2023-08-27T11:29:35.229654+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-27T11:29:35.253490+0000","last_undegraded":"2023-08-27T11:29:35.253490+0000","last_fullsized":"2023-08-27T11:29:35.253490+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.268560+0000","last_change":"2023-08-27T11:29:35.265167+0000","last_active":"2023-08-27T11:29:35.268560+0000","last_peered":"2023-08-27T11:29:35.268560+0000","last_clean":"2023-08-27T11:29:35.268560+0000","last_became_active":"2023-08-27T11:29:35.264787+0000","last_became_peered":"2023-08-27T11:29:35.264787+0000","last_unstale":"2023-08-27T11:29:35.268560+0000","last_undegraded":"2023-08-27T11:29:35.268560+0000","last_fullsized":"2023-08-27T11:29:35.268560+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:45:02.383758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":252,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-08-27T11:29:35.250446+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:29:35.250446+0000","last_peered":"2023-08-27T11:29:35.250446+0000","last_clean":"2023-08-27T11:29:35.250446+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:29:35.250446+0000","last_undegraded":"2023-08-27T11:29:35.250446+0000","last_fullsized":"2023-08-27T11:29:35.250446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:58:18.107852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.439}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574936,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.435},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2367488,"data_stored":1431170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.438},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.38}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.503}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":0.85599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574935,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.878},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.81699999999999995}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.91900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":1.4570000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.83499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.878},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":1.605}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":1.663}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":1.714},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":1.5609999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574935,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":1.099}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28752,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343088,"statfs":{"total":96636764160,"available":96607322112,"internally_reserved":0,"allocated":1773568,"data_stored":840802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.878},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28748,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343092,"statfs":{"total":96636764160,"available":96607326208,"internally_reserved":0,"allocated":1769472,"data_stored":839816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.746},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.879},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.95499999999999996}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":1.028},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.98199999999999998}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":1.0940000000000001}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":1.145},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1259999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:29:41.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-08-27T11:29:41.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.251112+0000', 'last_change': '2023-08-27T11:29:35.251112+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.251112+0000', 'last_undegraded': '2023-08-27T11:29:35.251112+0000', 'last_fullsized': '2023-08-27T11:29:35.251112+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-08-27T11:29:41.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.255173+0000', 'last_change': '2023-08-27T11:29:35.255173+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.255173+0000', 'last_undegraded': '2023-08-27T11:29:35.255173+0000', 'last_fullsized': '2023-08-27T11:29:35.255173+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-08-27T11:29:41.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250843+0000', 'last_change': '2023-08-27T11:29:35.250843+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250843+0000', 'last_undegraded': '2023-08-27T11:29:35.250843+0000', 'last_fullsized': '2023-08-27T11:29:35.250843+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-08-27T11:29:41.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250770+0000', 'last_change': '2023-08-27T11:29:35.250770+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250770+0000', 'last_undegraded': '2023-08-27T11:29:35.250770+0000', 'last_fullsized': '2023-08-27T11:29:35.250770+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-08-27T11:29:41.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250310+0000', 'last_change': '2023-08-27T11:29:35.250310+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250310+0000', 'last_undegraded': '2023-08-27T11:29:35.250310+0000', 'last_fullsized': '2023-08-27T11:29:35.250310+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-08-27T11:29:41.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.255834+0000', 'last_change': '2023-08-27T11:29:35.255834+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.255834+0000', 'last_undegraded': '2023-08-27T11:29:35.255834+0000', 'last_fullsized': '2023-08-27T11:29:35.255834+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-08-27T11:29:41.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.249800+0000', 'last_change': '2023-08-27T11:29:35.249800+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.249800+0000', 'last_undegraded': '2023-08-27T11:29:35.249800+0000', 'last_fullsized': '2023-08-27T11:29:35.249800+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-08-27T11:29:41.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250724+0000', 'last_change': '2023-08-27T11:29:35.250724+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250724+0000', 'last_undegraded': '2023-08-27T11:29:35.250724+0000', 'last_fullsized': '2023-08-27T11:29:35.250724+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-08-27T11:29:41.707 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.252253+0000', 'last_change': '2023-08-27T11:29:35.252253+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.252253+0000', 'last_undegraded': '2023-08-27T11:29:35.252253+0000', 'last_fullsized': '2023-08-27T11:29:35.252253+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.707 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-08-27T11:29:41.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.252722+0000', 'last_change': '2023-08-27T11:29:35.252722+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.252722+0000', 'last_undegraded': '2023-08-27T11:29:35.252722+0000', 'last_fullsized': '2023-08-27T11:29:35.252722+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.708 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-08-27T11:29:41.708 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.258661+0000', 'last_change': '2023-08-27T11:29:35.258661+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.258661+0000', 'last_undegraded': '2023-08-27T11:29:35.258661+0000', 'last_fullsized': '2023-08-27T11:29:35.258661+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.709 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-08-27T11:29:41.709 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254702+0000', 'last_change': '2023-08-27T11:29:35.254702+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254702+0000', 'last_undegraded': '2023-08-27T11:29:35.254702+0000', 'last_fullsized': '2023-08-27T11:29:35.254702+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-08-27T11:29:41.710 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.244694+0000', 'last_change': '2023-08-27T11:29:35.244694+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.244694+0000', 'last_undegraded': '2023-08-27T11:29:35.244694+0000', 'last_fullsized': '2023-08-27T11:29:35.244694+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.710 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-08-27T11:29:41.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250569+0000', 'last_change': '2023-08-27T11:29:35.250569+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250569+0000', 'last_undegraded': '2023-08-27T11:29:35.250569+0000', 'last_fullsized': '2023-08-27T11:29:35.250569+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-08-27T11:29:41.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.260356+0000', 'last_change': '2023-08-27T11:29:35.260356+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.260356+0000', 'last_undegraded': '2023-08-27T11:29:35.260356+0000', 'last_fullsized': '2023-08-27T11:29:35.260356+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-08-27T11:29:41.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250804+0000', 'last_change': '2023-08-27T11:29:35.250804+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250804+0000', 'last_undegraded': '2023-08-27T11:29:35.250804+0000', 'last_fullsized': '2023-08-27T11:29:35.250804+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-08-27T11:29:41.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.251802+0000', 'last_change': '2023-08-27T11:29:35.251802+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.251802+0000', 'last_undegraded': '2023-08-27T11:29:35.251802+0000', 'last_fullsized': '2023-08-27T11:29:35.251802+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-08-27T11:29:41.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254211+0000', 'last_change': '2023-08-27T11:29:35.254211+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254211+0000', 'last_undegraded': '2023-08-27T11:29:35.254211+0000', 'last_fullsized': '2023-08-27T11:29:35.254211+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:29:41.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-08-27T11:29:41.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.259615+0000', 'last_change': '2023-08-27T11:29:35.259615+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.259615+0000', 'last_undegraded': '2023-08-27T11:29:35.259615+0000', 'last_fullsized': '2023-08-27T11:29:35.259615+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-08-27T11:29:41.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.244622+0000', 'last_change': '2023-08-27T11:29:35.244622+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.244622+0000', 'last_undegraded': '2023-08-27T11:29:35.244622+0000', 'last_fullsized': '2023-08-27T11:29:35.244622+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-08-27T11:29:41.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.243368+0000', 'last_change': '2023-08-27T11:29:35.243368+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.243368+0000', 'last_undegraded': '2023-08-27T11:29:35.243368+0000', 'last_fullsized': '2023-08-27T11:29:35.243368+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-08-27T11:29:41.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.255112+0000', 'last_change': '2023-08-27T11:29:35.255112+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.255112+0000', 'last_undegraded': '2023-08-27T11:29:35.255112+0000', 'last_fullsized': '2023-08-27T11:29:35.255112+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-08-27T11:29:41.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.251271+0000', 'last_change': '2023-08-27T11:29:35.251271+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.251271+0000', 'last_undegraded': '2023-08-27T11:29:35.251271+0000', 'last_fullsized': '2023-08-27T11:29:35.251271+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-08-27T11:29:41.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250275+0000', 'last_change': '2023-08-27T11:29:35.250275+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250275+0000', 'last_undegraded': '2023-08-27T11:29:35.250275+0000', 'last_fullsized': '2023-08-27T11:29:35.250275+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-08-27T11:29:41.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.244503+0000', 'last_change': '2023-08-27T11:29:35.244503+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.244503+0000', 'last_undegraded': '2023-08-27T11:29:35.244503+0000', 'last_fullsized': '2023-08-27T11:29:35.244503+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-08-27T11:29:41.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.247261+0000', 'last_change': '2023-08-27T11:29:35.247261+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.247261+0000', 'last_undegraded': '2023-08-27T11:29:35.247261+0000', 'last_fullsized': '2023-08-27T11:29:35.247261+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-08-27T11:29:41.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.256450+0000', 'last_change': '2023-08-27T11:29:35.256450+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.256450+0000', 'last_undegraded': '2023-08-27T11:29:35.256450+0000', 'last_fullsized': '2023-08-27T11:29:35.256450+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-08-27T11:29:41.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.245026+0000', 'last_change': '2023-08-27T11:29:35.245026+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.245026+0000', 'last_undegraded': '2023-08-27T11:29:35.245026+0000', 'last_fullsized': '2023-08-27T11:29:35.245026+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-08-27T11:29:41.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.257649+0000', 'last_change': '2023-08-27T11:29:35.257649+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.257649+0000', 'last_undegraded': '2023-08-27T11:29:35.257649+0000', 'last_fullsized': '2023-08-27T11:29:35.257649+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-08-27T11:29:41.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254000+0000', 'last_change': '2023-08-27T11:29:35.254000+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254000+0000', 'last_undegraded': '2023-08-27T11:29:35.254000+0000', 'last_fullsized': '2023-08-27T11:29:35.254000+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:29:41.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-08-27T11:29:41.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.259828+0000', 'last_change': '2023-08-27T11:29:35.259828+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.259828+0000', 'last_undegraded': '2023-08-27T11:29:35.259828+0000', 'last_fullsized': '2023-08-27T11:29:35.259828+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-08-27T11:29:41.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.253331+0000', 'last_change': '2023-08-27T11:29:35.253331+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.253331+0000', 'last_undegraded': '2023-08-27T11:29:35.253331+0000', 'last_fullsized': '2023-08-27T11:29:35.253331+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:29:41.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-08-27T11:29:41.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.257612+0000', 'last_change': '2023-08-27T11:29:35.257612+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.257612+0000', 'last_undegraded': '2023-08-27T11:29:35.257612+0000', 'last_fullsized': '2023-08-27T11:29:35.257612+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-08-27T11:29:41.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.242830+0000', 'last_change': '2023-08-27T11:29:35.242830+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.242830+0000', 'last_undegraded': '2023-08-27T11:29:35.242830+0000', 'last_fullsized': '2023-08-27T11:29:35.242830+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-08-27T11:29:41.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250127+0000', 'last_change': '2023-08-27T11:29:35.250127+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250127+0000', 'last_undegraded': '2023-08-27T11:29:35.250127+0000', 'last_fullsized': '2023-08-27T11:29:35.250127+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-08-27T11:29:41.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.257233+0000', 'last_change': '2023-08-27T11:29:35.257233+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.257233+0000', 'last_undegraded': '2023-08-27T11:29:35.257233+0000', 'last_fullsized': '2023-08-27T11:29:35.257233+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-08-27T11:29:41.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.253359+0000', 'last_change': '2023-08-27T11:29:35.253359+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.253359+0000', 'last_undegraded': '2023-08-27T11:29:35.253359+0000', 'last_fullsized': '2023-08-27T11:29:35.253359+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-08-27T11:29:41.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.242686+0000', 'last_change': '2023-08-27T11:29:35.242686+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.242686+0000', 'last_undegraded': '2023-08-27T11:29:35.242686+0000', 'last_fullsized': '2023-08-27T11:29:35.242686+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-08-27T11:29:41.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.242490+0000', 'last_change': '2023-08-27T11:29:35.242490+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.242490+0000', 'last_undegraded': '2023-08-27T11:29:35.242490+0000', 'last_fullsized': '2023-08-27T11:29:35.242490+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-08-27T11:29:41.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250559+0000', 'last_change': '2023-08-27T11:29:35.250559+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250559+0000', 'last_undegraded': '2023-08-27T11:29:35.250559+0000', 'last_fullsized': '2023-08-27T11:29:35.250559+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-08-27T11:29:41.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.249967+0000', 'last_change': '2023-08-27T11:29:35.249967+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.249967+0000', 'last_undegraded': '2023-08-27T11:29:35.249967+0000', 'last_fullsized': '2023-08-27T11:29:35.249967+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-08-27T11:29:41.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254079+0000', 'last_change': '2023-08-27T11:29:35.254079+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254079+0000', 'last_undegraded': '2023-08-27T11:29:35.254079+0000', 'last_fullsized': '2023-08-27T11:29:35.254079+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:29:41.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-08-27T11:29:41.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.260634+0000', 'last_change': '2023-08-27T11:29:35.260634+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.260634+0000', 'last_undegraded': '2023-08-27T11:29:35.260634+0000', 'last_fullsized': '2023-08-27T11:29:35.260634+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-08-27T11:29:41.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.257723+0000', 'last_change': '2023-08-27T11:29:35.257723+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.257723+0000', 'last_undegraded': '2023-08-27T11:29:35.257723+0000', 'last_fullsized': '2023-08-27T11:29:35.257723+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-08-27T11:29:41.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.243924+0000', 'last_change': '2023-08-27T11:29:35.243924+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.243924+0000', 'last_undegraded': '2023-08-27T11:29:35.243924+0000', 'last_fullsized': '2023-08-27T11:29:35.243924+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-08-27T11:29:41.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.249968+0000', 'last_change': '2023-08-27T11:29:35.249968+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.249968+0000', 'last_undegraded': '2023-08-27T11:29:35.249968+0000', 'last_fullsized': '2023-08-27T11:29:35.249968+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-08-27T11:29:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.253857+0000', 'last_change': '2023-08-27T11:29:35.253857+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.253857+0000', 'last_undegraded': '2023-08-27T11:29:35.253857+0000', 'last_fullsized': '2023-08-27T11:29:35.253857+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-27T11:29:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-08-27T11:29:41.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254051+0000', 'last_change': '2023-08-27T11:29:35.254051+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254051+0000', 'last_undegraded': '2023-08-27T11:29:35.254051+0000', 'last_fullsized': '2023-08-27T11:29:35.254051+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-08-27T11:29:41.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.257554+0000', 'last_change': '2023-08-27T11:29:35.257554+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.257554+0000', 'last_undegraded': '2023-08-27T11:29:35.257554+0000', 'last_fullsized': '2023-08-27T11:29:35.257554+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-08-27T11:29:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.249282+0000', 'last_change': '2023-08-27T11:29:35.249282+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.249282+0000', 'last_undegraded': '2023-08-27T11:29:35.249282+0000', 'last_fullsized': '2023-08-27T11:29:35.249282+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-08-27T11:29:41.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.244907+0000', 'last_change': '2023-08-27T11:29:35.244907+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.244907+0000', 'last_undegraded': '2023-08-27T11:29:35.244907+0000', 'last_fullsized': '2023-08-27T11:29:35.244907+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-08-27T11:29:41.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250335+0000', 'last_change': '2023-08-27T11:29:35.250335+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250335+0000', 'last_undegraded': '2023-08-27T11:29:35.250335+0000', 'last_fullsized': '2023-08-27T11:29:35.250335+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-08-27T11:29:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.250168+0000', 'last_change': '2023-08-27T11:29:35.250168+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.250168+0000', 'last_undegraded': '2023-08-27T11:29:35.250168+0000', 'last_fullsized': '2023-08-27T11:29:35.250168+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-27T11:29:41.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-08-27T11:29:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.256005+0000', 'last_change': '2023-08-27T11:29:35.256005+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.256005+0000', 'last_undegraded': '2023-08-27T11:29:35.256005+0000', 'last_fullsized': '2023-08-27T11:29:35.256005+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-08-27T11:29:41.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.244565+0000', 'last_change': '2023-08-27T11:29:35.244565+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.244565+0000', 'last_undegraded': '2023-08-27T11:29:35.244565+0000', 'last_fullsized': '2023-08-27T11:29:35.244565+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-08-27T11:29:41.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.242754+0000', 'last_change': '2023-08-27T11:29:35.242754+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.242754+0000', 'last_undegraded': '2023-08-27T11:29:35.242754+0000', 'last_fullsized': '2023-08-27T11:29:35.242754+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-08-27T11:29:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.260132+0000', 'last_change': '2023-08-27T11:29:35.260132+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.260132+0000', 'last_undegraded': '2023-08-27T11:29:35.260132+0000', 'last_fullsized': '2023-08-27T11:29:35.260132+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-27T11:29:41.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-08-27T11:29:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.245480+0000', 'last_change': '2023-08-27T11:29:35.245480+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.245480+0000', 'last_undegraded': '2023-08-27T11:29:35.245480+0000', 'last_fullsized': '2023-08-27T11:29:35.245480+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-08-27T11:29:41.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.258040+0000', 'last_change': '2023-08-27T11:29:35.258040+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.258040+0000', 'last_undegraded': '2023-08-27T11:29:35.258040+0000', 'last_fullsized': '2023-08-27T11:29:35.258040+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-08-27T11:29:41.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.254010+0000', 'last_change': '2023-08-27T11:29:35.254010+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.254010+0000', 'last_undegraded': '2023-08-27T11:29:35.254010+0000', 'last_fullsized': '2023-08-27T11:29:35.254010+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-27T11:29:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-08-27T11:29:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.242485+0000', 'last_change': '2023-08-27T11:29:35.242485+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.242485+0000', 'last_undegraded': '2023-08-27T11:29:35.242485+0000', 'last_fullsized': '2023-08-27T11:29:35.242485+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-27T11:29:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-08-27T11:29:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.243223+0000', 'last_change': '2023-08-27T11:29:35.243223+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.243223+0000', 'last_undegraded': '2023-08-27T11:29:35.243223+0000', 'last_fullsized': '2023-08-27T11:29:35.243223+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-27T11:29:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-08-27T11:29:41.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.252336+0000', 'last_change': '2023-08-27T11:29:35.252336+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.252336+0000', 'last_undegraded': '2023-08-27T11:29:35.252336+0000', 'last_fullsized': '2023-08-27T11:29:35.252336+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-27T11:29:41.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-08-27T11:29:41.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-08-27T11:29:35.253490+0000', 'last_change': '2023-08-27T11:29:35.253490+0000', 'last_active': '2023-08-27T11:29:35.229654+0000', 'last_peered': '2023-08-27T11:29:35.229654+0000', 'last_clean': '2023-08-27T11:29:35.229654+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-27T11:29:35.253490+0000', 'last_undegraded': '2023-08-27T11:29:35.253490+0000', 'last_fullsized': '2023-08-27T11:29:35.253490+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'last_clean_scrub_stamp': '2023-08-27T11:29:35.229654+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-27T11:29:41.749 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-27T11:29:41.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:29:41.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:29:41.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.952+0000 7f307adff700 1 Processor -- start 2023-08-27T11:29:41.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.952+0000 7f307adff700 1 -- start start 2023-08-27T11:29:41.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.953+0000 7f307adff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3074151330 0x7f30741543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f307adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 0x7f307415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f307adff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3074154d90 con 0x7f307414df90 2023-08-27T11:29:41.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f307adff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3074153f70 con 0x7f3074151330 2023-08-27T11:29:41.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f307adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307406c5c0 con 0x7f3074154900 2023-08-27T11:29:41.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f3078b9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f307414df90 0x7f30740c3ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42376/0 (socket says 172.21.15.43:42376) 2023-08-27T11:29:41.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f3078b9b700 1 -- 172.21.15.43:0/771413443 learned_addr learned my addr 172.21.15.43:0/771413443 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:41.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f3073fff700 1 --2- 172.21.15.43:0/771413443 >> v2:172.21.15.57:3300/0 conn(0x7f3074151330 0x7f30741543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f307939c700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 0x7f307415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f30737fe700 1 -- 172.21.15.43:0/771413443 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871282495 0 0) 0x7f3074154d90 con 0x7f307414df90 2023-08-27T11:29:41.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f30737fe700 1 -- 172.21.15.43:0/771413443 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30640035b0 con 0x7f307414df90 2023-08-27T11:29:41.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.954+0000 7f3073fff700 1 -- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 msgr2=0x7f307415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:41.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f3073fff700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 0x7f307415b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f3073fff700 1 -- 172.21.15.43:0/771413443 >> v1:172.21.15.43:6789/0 conn(0x7f307414df90 legacy=0x7f30740c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f3073fff700 1 -- 172.21.15.43:0/771413443 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307406c8a0 con 0x7f3074151330 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f307939c700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 0x7f307415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f3073fff700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074151330 0x7f30741543c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f306000a9e0 tx=0x7f306000acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71814f947b1bbb19 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f30737fe700 1 -- 172.21.15.43:0/771413443 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000cb70 con 0x7f3074151330 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f30737fe700 1 -- 172.21.15.43:0/771413443 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000ccd0 con 0x7f3074151330 2023-08-27T11:29:41.960 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.955+0000 7f30737fe700 1 -- 172.21.15.43:0/771413443 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060018620 con 0x7f3074151330 2023-08-27T11:29:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 -- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074151330 msgr2=0x7f30741543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074151330 0x7f30741543c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f306000a9e0 tx=0x7f306000acf0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 -- 172.21.15.43:0/771413443 shutdown_connections 2023-08-27T11:29:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3074154900 0x7f307415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 --2- 172.21.15.43:0/771413443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074151330 0x7f30741543c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 -- 172.21.15.43:0/771413443 >> 172.21.15.43:0/771413443 conn(0x7f30740c2320 msgr2=0x7f30740c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:41.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 -- 172.21.15.43:0/771413443 shutdown_connections 2023-08-27T11:29:41.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.956+0000 7f307adff700 1 -- 172.21.15.43:0/771413443 wait complete. 2023-08-27T11:29:41.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.957+0000 7f307adff700 1 Processor -- start 2023-08-27T11:29:41.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.958+0000 7f307adff700 1 -- start start 2023-08-27T11:29:41.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.958+0000 7f307adff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f307414df90 0x7f30741ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307adff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307adff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 0x7f30740a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307adff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30741ea630 con 0x7f3074151330 2023-08-27T11:29:41.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307adff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740a4c80 con 0x7f3074154900 2023-08-27T11:29:41.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307adff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30740bf2f0 con 0x7f307414df90 2023-08-27T11:29:41.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f3073fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f3073fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36008/0 (socket says 172.21.15.43:36008) 2023-08-27T11:29:41.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f3073fff700 1 -- 172.21.15.43:0/3457369153 learned_addr learned my addr 172.21.15.43:0/3457369153 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:41.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 0x7f30740a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f3078b9b700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f307414df90 0x7f30741ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 -- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f307414df90 msgr2=0x7f30741ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f307414df90 0x7f30741ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 -- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 msgr2=0x7f30740c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f307939c700 1 -- 172.21.15.43:0/3457369153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c009a70 con 0x7f3074154900 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.959+0000 7f3073fff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f307939c700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 0x7f30740a3570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f306c00efc0 tx=0x7f306c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c009e80 con 0x7f3074154900 2023-08-27T11:29:41.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00f040 con 0x7f3074154900 2023-08-27T11:29:41.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00ccd0 con 0x7f3074154900 2023-08-27T11:29:41.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306000a640 con 0x7f3074154900 2023-08-27T11:29:41.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.960+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30740a49a0 con 0x7f3074154900 2023-08-27T11:29:41.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.961+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30740674e0 con 0x7f3074154900 2023-08-27T11:29:41.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.962+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f306c014480 con 0x7f3074154900 2023-08-27T11:29:41.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.963+0000 7f30717fa700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 0x7f305806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:41.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.963+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f306c088a30 con 0x7f3074154900 2023-08-27T11:29:41.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.964+0000 7f3078b9b700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 0x7f305806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:41.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.964+0000 7f3078b9b700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 0x7f305806c5a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3068007fd0 tx=0x7f3068007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:41.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:41.968+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f306c054110 con 0x7f3074154900 2023-08-27T11:29:42.265 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.264+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f307404ee70 con 0x7f3074154900 2023-08-27T11:29:42.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.265+0000 7f30717fa700 1 -- 172.21.15.43:0/3457369153 <== mon.1 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1458 (secure 0 0 0) 0x7f306c057730 con 0x7f3074154900 2023-08-27T11:29:42.266 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:42.267 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":439,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1693135354,"num_in_osds":8,"osd_in_since":1693135346,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":258007040,"bytes_avail":772836106240,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":151,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":8772}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-08-27T11:27:30.371471+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-27T11:29:42.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 msgr2=0x7f305806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 0x7f305806c5a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3068007fd0 tx=0x7f3068007dc0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 msgr2=0x7f30740a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 0x7f30740a3570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f306c00efc0 tx=0x7f306c00c3a0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 shutdown_connections 2023-08-27T11:29:42.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f305806a0e0 0x7f305806c5a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3074154900 0x7f30740a3570 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f307414df90 0x7f30741ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 --2- 172.21.15.43:0/3457369153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3074151330 0x7f30740c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.267+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 >> 172.21.15.43:0/3457369153 conn(0x7f30740c2320 msgr2=0x7f307414cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:42.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.268+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 shutdown_connections 2023-08-27T11:29:42.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.268+0000 7f307adff700 1 -- 172.21.15.43:0/3457369153 wait complete. 2023-08-27T11:29:42.287 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-27T11:29:42.287 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:29:42.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.488+0000 7fec147ff700 1 Processor -- start 2023-08-27T11:29:42.490 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.488+0000 7fec147ff700 1 -- start start 2023-08-27T11:29:42.493 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.489+0000 7fec147ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec0c151a90 0x7fec0c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.489+0000 7fec147ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c0c4a90 0x7fec0c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.494 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.489+0000 7fec147ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c06c4e0 con 0x7fec0c0c4630 2023-08-27T11:29:42.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.489+0000 7fec147ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c155370 con 0x7fec0c151a90 2023-08-27T11:29:42.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.489+0000 7fec147ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c151e70 con 0x7fec0c0c4a90 2023-08-27T11:29:42.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec0c151a90 0x7fec0c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.495 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec0c151a90 0x7fec0c0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:48150/0 (socket says 172.21.15.43:48150) 2023-08-27T11:29:42.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec12d9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c0c4a90 0x7fec0c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 -- 172.21.15.43:0/3820808658 learned_addr learned my addr 172.21.15.43:0/3820808658 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:42.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 -- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c0c4a90 msgr2=0x7fec0c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:42.496 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 --2- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c0c4a90 0x7fec0c06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 -- 172.21.15.43:0/3820808658 >> v1:172.21.15.57:6789/0 conn(0x7fec0c0c4630 legacy=0x7fec0c06ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.490+0000 7fec1259b700 1 -- 172.21.15.43:0/3820808658 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c154480 con 0x7fec0c151a90 2023-08-27T11:29:42.497 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec1259b700 1 --2- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c151a90 0x7fec0c0c7bb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec080098f0 tx=0x7fec08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f1dc887dc3a42f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:42.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec11599700 1 -- 172.21.15.43:0/3820808658 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08011830 con 0x7fec0c151a90 2023-08-27T11:29:42.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec11599700 1 -- 172.21.15.43:0/3820808658 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec08011990 con 0x7fec0c151a90 2023-08-27T11:29:42.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec11599700 1 -- 172.21.15.43:0/3820808658 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08011d20 con 0x7fec0c151a90 2023-08-27T11:29:42.498 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec147ff700 1 -- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c151a90 msgr2=0x7fec0c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.491+0000 7fec147ff700 1 --2- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c151a90 0x7fec0c0c7bb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec080098f0 tx=0x7fec08009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:42.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 -- 172.21.15.43:0/3820808658 shutdown_connections 2023-08-27T11:29:42.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 --2- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c0c4a90 0x7fec0c06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.499 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 --2- 172.21.15.43:0/3820808658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c151a90 0x7fec0c0c7bb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 -- 172.21.15.43:0/3820808658 >> 172.21.15.43:0/3820808658 conn(0x7fec0c0ab820 msgr2=0x7fec0c0abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:42.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 -- 172.21.15.43:0/3820808658 shutdown_connections 2023-08-27T11:29:42.500 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.492+0000 7fec147ff700 1 -- 172.21.15.43:0/3820808658 wait complete. 2023-08-27T11:29:42.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.493+0000 7fec147ff700 1 Processor -- start 2023-08-27T11:29:42.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.493+0000 7fec147ff700 1 -- start start 2023-08-27T11:29:42.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c0c4630 0x7fec0c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.503 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c151a90 0x7fec0c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0ab550 con 0x7fec0c0c4a90 2023-08-27T11:29:42.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c1ea1f0 con 0x7fec0c0c4630 2023-08-27T11:29:42.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.494+0000 7fec147ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0aa5d0 con 0x7fec0c151a90 2023-08-27T11:29:42.504 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36014/0 (socket says 172.21.15.43:36014) 2023-08-27T11:29:42.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec1259b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c0c4630 0x7fec0c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 -- 172.21.15.43:0/3468794835 learned_addr learned my addr 172.21.15.43:0/3468794835 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:42.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec12d9c700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c151a90 0x7fec0c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.505 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 -- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c151a90 msgr2=0x7fec0c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c151a90 0x7fec0c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 -- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c0c4630 msgr2=0x7fec0c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c0c4630 0x7fec0c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 -- 172.21.15.43:0/3468794835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08009550 con 0x7fec0c0c4a90 2023-08-27T11:29:42.506 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.495+0000 7fec11d9a700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:42.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.496+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0052d0 con 0x7fec0c0c4a90 2023-08-27T11:29:42.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.496+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc005430 con 0x7fec0c0c4a90 2023-08-27T11:29:42.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.496+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0038c0 con 0x7fec0c0c4a90 2023-08-27T11:29:42.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.496+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c1ea490 con 0x7fec0c0c4a90 2023-08-27T11:29:42.507 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.496+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c0a97a0 con 0x7fec0c0c4a90 2023-08-27T11:29:42.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.497+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c0c8a30 con 0x7fec0c0c4a90 2023-08-27T11:29:42.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.498+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7febfc003a20 con 0x7fec0c0c4a90 2023-08-27T11:29:42.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.499+0000 7fec02ffd700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 0x7febf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:42.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.499+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febfc0878e0 con 0x7fec0c0c4a90 2023-08-27T11:29:42.508 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.499+0000 7fec1259b700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 0x7febf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:42.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.499+0000 7fec1259b700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 0x7febf006c5a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fec08014040 tx=0x7fec08008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:42.509 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.503+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7febfc052fc0 con 0x7fec0c0c4a90 2023-08-27T11:29:42.708 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.707+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec0c153f30 con 0x7febf006a0e0 2023-08-27T11:29:42.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.717+0000 7fec02ffd700 1 -- 172.21.15.43:0/3468794835 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311928 (secure 0 0 0) 0x7fec0c153f30 con 0x7febf006a0e0 2023-08-27T11:29:42.723 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 msgr2=0x7febf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 0x7febf006c5a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fec08014040 tx=0x7fec08008030 comp rx=0 tx=0).stop 2023-08-27T11:29:42.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 msgr2=0x7fec0c146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c7f0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 shutdown_connections 2023-08-27T11:29:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7febf006a0e0 0x7febf006c5a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec0c151a90 0x7fec0c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec0c0c4630 0x7fec0c143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 --2- 172.21.15.43:0/3468794835 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fec0c0c4a90 0x7fec0c146270 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 >> 172.21.15.43:0/3468794835 conn(0x7fec0c0ab820 msgr2=0x7fec0c14d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 shutdown_connections 2023-08-27T11:29:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:42.722+0000 7fec147ff700 1 -- 172.21.15.43:0/3468794835 wait complete. 2023-08-27T11:29:42.727 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:29:42.741 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2023-08-27T11:29:42.397928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256496,"kb_used_data":15352,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754718224,"statfs":{"total":773094113280,"available":772831461376,"internally_reserved":0,"allocated":15720448,"data_stored":8071236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.160084"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246003+0000","last_change":"2023-08-27T11:29:36.271036+0000","last_active":"2023-08-27T11:29:37.246003+0000","last_peered":"2023-08-27T11:29:37.246003+0000","last_clean":"2023-08-27T11:29:37.246003+0000","last_became_active":"2023-08-27T11:29:36.270685+0000","last_became_peered":"2023-08-27T11:29:36.270685+0000","last_unstale":"2023-08-27T11:29:37.246003+0000","last_undegraded":"2023-08-27T11:29:37.246003+0000","last_fullsized":"2023-08-27T11:29:37.246003+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:29:58.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544950+0000","last_change":"2023-08-27T11:29:36.281273+0000","last_active":"2023-08-27T11:29:37.544950+0000","last_peered":"2023-08-27T11:29:37.544950+0000","last_clean":"2023-08-27T11:29:37.544950+0000","last_became_active":"2023-08-27T11:29:36.280995+0000","last_became_peered":"2023-08-27T11:29:36.280995+0000","last_unstale":"2023-08-27T11:29:37.544950+0000","last_undegraded":"2023-08-27T11:29:37.544950+0000","last_fullsized":"2023-08-27T11:29:37.544950+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:33:47.451397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245938+0000","last_change":"2023-08-27T11:29:36.260703+0000","last_active":"2023-08-27T11:29:37.245938+0000","last_peered":"2023-08-27T11:29:37.245938+0000","last_clean":"2023-08-27T11:29:37.245938+0000","last_became_active":"2023-08-27T11:29:36.260402+0000","last_became_peered":"2023-08-27T11:29:36.260402+0000","last_unstale":"2023-08-27T11:29:37.245938+0000","last_undegraded":"2023-08-27T11:29:37.245938+0000","last_fullsized":"2023-08-27T11:29:37.245938+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:16:11.085496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246094+0000","last_change":"2023-08-27T11:29:36.270027+0000","last_active":"2023-08-27T11:29:37.246094+0000","last_peered":"2023-08-27T11:29:37.246094+0000","last_clean":"2023-08-27T11:29:37.246094+0000","last_became_active":"2023-08-27T11:29:36.269710+0000","last_became_peered":"2023-08-27T11:29:36.269710+0000","last_unstale":"2023-08-27T11:29:37.246094+0000","last_undegraded":"2023-08-27T11:29:37.246094+0000","last_fullsized":"2023-08-27T11:29:37.246094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:49.816897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544422+0000","last_change":"2023-08-27T11:29:36.272543+0000","last_active":"2023-08-27T11:29:37.544422+0000","last_peered":"2023-08-27T11:29:37.544422+0000","last_clean":"2023-08-27T11:29:37.544422+0000","last_became_active":"2023-08-27T11:29:36.272256+0000","last_became_peered":"2023-08-27T11:29:36.272256+0000","last_unstale":"2023-08-27T11:29:37.544422+0000","last_undegraded":"2023-08-27T11:29:37.544422+0000","last_fullsized":"2023-08-27T11:29:37.544422+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:28:31.310669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544322+0000","last_change":"2023-08-27T11:29:36.277115+0000","last_active":"2023-08-27T11:29:37.544322+0000","last_peered":"2023-08-27T11:29:37.544322+0000","last_clean":"2023-08-27T11:29:37.544322+0000","last_became_active":"2023-08-27T11:29:36.276788+0000","last_became_peered":"2023-08-27T11:29:36.276788+0000","last_unstale":"2023-08-27T11:29:37.544322+0000","last_undegraded":"2023-08-27T11:29:37.544322+0000","last_fullsized":"2023-08-27T11:29:37.544322+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:15:06.186621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245050+0000","last_change":"2023-08-27T11:29:36.255721+0000","last_active":"2023-08-27T11:29:37.245050+0000","last_peered":"2023-08-27T11:29:37.245050+0000","last_clean":"2023-08-27T11:29:37.245050+0000","last_became_active":"2023-08-27T11:29:36.255402+0000","last_became_peered":"2023-08-27T11:29:36.255402+0000","last_unstale":"2023-08-27T11:29:37.245050+0000","last_undegraded":"2023-08-27T11:29:37.245050+0000","last_fullsized":"2023-08-27T11:29:37.245050+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:18.615835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244878+0000","last_change":"2023-08-27T11:29:36.272088+0000","last_active":"2023-08-27T11:29:37.244878+0000","last_peered":"2023-08-27T11:29:37.244878+0000","last_clean":"2023-08-27T11:29:37.244878+0000","last_became_active":"2023-08-27T11:29:36.271775+0000","last_became_peered":"2023-08-27T11:29:36.271775+0000","last_unstale":"2023-08-27T11:29:37.244878+0000","last_undegraded":"2023-08-27T11:29:37.244878+0000","last_fullsized":"2023-08-27T11:29:37.244878+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:56.048405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245442+0000","last_change":"2023-08-27T11:29:36.278044+0000","last_active":"2023-08-27T11:29:37.245442+0000","last_peered":"2023-08-27T11:29:37.245442+0000","last_clean":"2023-08-27T11:29:37.245442+0000","last_became_active":"2023-08-27T11:29:36.277754+0000","last_became_peered":"2023-08-27T11:29:36.277754+0000","last_unstale":"2023-08-27T11:29:37.245442+0000","last_undegraded":"2023-08-27T11:29:37.245442+0000","last_fullsized":"2023-08-27T11:29:37.245442+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:47:21.227308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245412+0000","last_change":"2023-08-27T11:29:36.272722+0000","last_active":"2023-08-27T11:29:37.245412+0000","last_peered":"2023-08-27T11:29:37.245412+0000","last_clean":"2023-08-27T11:29:37.245412+0000","last_became_active":"2023-08-27T11:29:36.272452+0000","last_became_peered":"2023-08-27T11:29:36.272452+0000","last_unstale":"2023-08-27T11:29:37.245412+0000","last_undegraded":"2023-08-27T11:29:37.245412+0000","last_fullsized":"2023-08-27T11:29:37.245412+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.145821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545674+0000","last_change":"2023-08-27T11:29:36.277273+0000","last_active":"2023-08-27T11:29:37.545674+0000","last_peered":"2023-08-27T11:29:37.545674+0000","last_clean":"2023-08-27T11:29:37.545674+0000","last_became_active":"2023-08-27T11:29:36.276569+0000","last_became_peered":"2023-08-27T11:29:36.276569+0000","last_unstale":"2023-08-27T11:29:37.545674+0000","last_undegraded":"2023-08-27T11:29:37.545674+0000","last_fullsized":"2023-08-27T11:29:37.545674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:54.604957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544742+0000","last_change":"2023-08-27T11:29:36.285173+0000","last_active":"2023-08-27T11:29:37.544742+0000","last_peered":"2023-08-27T11:29:37.544742+0000","last_clean":"2023-08-27T11:29:37.544742+0000","last_became_active":"2023-08-27T11:29:36.284821+0000","last_became_peered":"2023-08-27T11:29:36.284821+0000","last_unstale":"2023-08-27T11:29:37.544742+0000","last_undegraded":"2023-08-27T11:29:37.544742+0000","last_fullsized":"2023-08-27T11:29:37.544742+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:07:23.062356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543936+0000","last_change":"2023-08-27T11:29:36.285618+0000","last_active":"2023-08-27T11:29:37.543936+0000","last_peered":"2023-08-27T11:29:37.543936+0000","last_clean":"2023-08-27T11:29:37.543936+0000","last_became_active":"2023-08-27T11:29:36.285136+0000","last_became_peered":"2023-08-27T11:29:36.285136+0000","last_unstale":"2023-08-27T11:29:37.543936+0000","last_undegraded":"2023-08-27T11:29:37.543936+0000","last_fullsized":"2023-08-27T11:29:37.543936+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:49.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543935+0000","last_change":"2023-08-27T11:29:36.269247+0000","last_active":"2023-08-27T11:29:37.543935+0000","last_peered":"2023-08-27T11:29:37.543935+0000","last_clean":"2023-08-27T11:29:37.543935+0000","last_became_active":"2023-08-27T11:29:36.268602+0000","last_became_peered":"2023-08-27T11:29:36.268602+0000","last_unstale":"2023-08-27T11:29:37.543935+0000","last_undegraded":"2023-08-27T11:29:37.543935+0000","last_fullsized":"2023-08-27T11:29:37.543935+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:22:52.630824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544652+0000","last_change":"2023-08-27T11:29:36.281090+0000","last_active":"2023-08-27T11:29:37.544652+0000","last_peered":"2023-08-27T11:29:37.544652+0000","last_clean":"2023-08-27T11:29:37.544652+0000","last_became_active":"2023-08-27T11:29:36.280794+0000","last_became_peered":"2023-08-27T11:29:36.280794+0000","last_unstale":"2023-08-27T11:29:37.544652+0000","last_undegraded":"2023-08-27T11:29:37.544652+0000","last_fullsized":"2023-08-27T11:29:37.544652+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:39:09.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245714+0000","last_change":"2023-08-27T11:29:36.268611+0000","last_active":"2023-08-27T11:29:37.245714+0000","last_peered":"2023-08-27T11:29:37.245714+0000","last_clean":"2023-08-27T11:29:37.245714+0000","last_became_active":"2023-08-27T11:29:36.268249+0000","last_became_peered":"2023-08-27T11:29:36.268249+0000","last_unstale":"2023-08-27T11:29:37.245714+0000","last_undegraded":"2023-08-27T11:29:37.245714+0000","last_fullsized":"2023-08-27T11:29:37.245714+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:04:58.754334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245296+0000","last_change":"2023-08-27T11:29:36.274706+0000","last_active":"2023-08-27T11:29:37.245296+0000","last_peered":"2023-08-27T11:29:37.245296+0000","last_clean":"2023-08-27T11:29:37.245296+0000","last_became_active":"2023-08-27T11:29:36.274289+0000","last_became_peered":"2023-08-27T11:29:36.274289+0000","last_unstale":"2023-08-27T11:29:37.245296+0000","last_undegraded":"2023-08-27T11:29:37.245296+0000","last_fullsized":"2023-08-27T11:29:37.245296+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:44.322214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244760+0000","last_change":"2023-08-27T11:29:36.257746+0000","last_active":"2023-08-27T11:29:37.244760+0000","last_peered":"2023-08-27T11:29:37.244760+0000","last_clean":"2023-08-27T11:29:37.244760+0000","last_became_active":"2023-08-27T11:29:36.257453+0000","last_became_peered":"2023-08-27T11:29:36.257453+0000","last_unstale":"2023-08-27T11:29:37.244760+0000","last_undegraded":"2023-08-27T11:29:37.244760+0000","last_fullsized":"2023-08-27T11:29:37.244760+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:17.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545500+0000","last_change":"2023-08-27T11:29:36.277471+0000","last_active":"2023-08-27T11:29:37.545500+0000","last_peered":"2023-08-27T11:29:37.545500+0000","last_clean":"2023-08-27T11:29:37.545500+0000","last_became_active":"2023-08-27T11:29:36.276982+0000","last_became_peered":"2023-08-27T11:29:36.276982+0000","last_unstale":"2023-08-27T11:29:37.545500+0000","last_undegraded":"2023-08-27T11:29:37.545500+0000","last_fullsized":"2023-08-27T11:29:37.545500+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.673340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544829+0000","last_change":"2023-08-27T11:29:36.267100+0000","last_active":"2023-08-27T11:29:37.544829+0000","last_peered":"2023-08-27T11:29:37.544829+0000","last_clean":"2023-08-27T11:29:37.544829+0000","last_became_active":"2023-08-27T11:29:36.266763+0000","last_became_peered":"2023-08-27T11:29:36.266763+0000","last_unstale":"2023-08-27T11:29:37.544829+0000","last_undegraded":"2023-08-27T11:29:37.544829+0000","last_fullsized":"2023-08-27T11:29:37.544829+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:13.105818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544101+0000","last_change":"2023-08-27T11:29:36.272910+0000","last_active":"2023-08-27T11:29:37.544101+0000","last_peered":"2023-08-27T11:29:37.544101+0000","last_clean":"2023-08-27T11:29:37.544101+0000","last_became_active":"2023-08-27T11:29:36.272642+0000","last_became_peered":"2023-08-27T11:29:36.272642+0000","last_unstale":"2023-08-27T11:29:37.544101+0000","last_undegraded":"2023-08-27T11:29:37.544101+0000","last_fullsized":"2023-08-27T11:29:37.544101+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:45:21.414040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544488+0000","last_change":"2023-08-27T11:29:36.284534+0000","last_active":"2023-08-27T11:29:37.544488+0000","last_peered":"2023-08-27T11:29:37.544488+0000","last_clean":"2023-08-27T11:29:37.544488+0000","last_became_active":"2023-08-27T11:29:36.284251+0000","last_became_peered":"2023-08-27T11:29:36.284251+0000","last_unstale":"2023-08-27T11:29:37.544488+0000","last_undegraded":"2023-08-27T11:29:37.544488+0000","last_fullsized":"2023-08-27T11:29:37.544488+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:40.975596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544213+0000","last_change":"2023-08-27T11:29:36.270840+0000","last_active":"2023-08-27T11:29:37.544213+0000","last_peered":"2023-08-27T11:29:37.544213+0000","last_clean":"2023-08-27T11:29:37.544213+0000","last_became_active":"2023-08-27T11:29:36.270536+0000","last_became_peered":"2023-08-27T11:29:36.270536+0000","last_unstale":"2023-08-27T11:29:37.544213+0000","last_undegraded":"2023-08-27T11:29:37.544213+0000","last_fullsized":"2023-08-27T11:29:37.544213+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:39.956738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245782+0000","last_change":"2023-08-27T11:29:36.260778+0000","last_active":"2023-08-27T11:29:37.245782+0000","last_peered":"2023-08-27T11:29:37.245782+0000","last_clean":"2023-08-27T11:29:37.245782+0000","last_became_active":"2023-08-27T11:29:36.260449+0000","last_became_peered":"2023-08-27T11:29:36.260449+0000","last_unstale":"2023-08-27T11:29:37.245782+0000","last_undegraded":"2023-08-27T11:29:37.245782+0000","last_fullsized":"2023-08-27T11:29:37.245782+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:24:11.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544736+0000","last_change":"2023-08-27T11:29:36.275389+0000","last_active":"2023-08-27T11:29:37.544736+0000","last_peered":"2023-08-27T11:29:37.544736+0000","last_clean":"2023-08-27T11:29:37.544736+0000","last_became_active":"2023-08-27T11:29:36.274781+0000","last_became_peered":"2023-08-27T11:29:36.274781+0000","last_unstale":"2023-08-27T11:29:37.544736+0000","last_undegraded":"2023-08-27T11:29:37.544736+0000","last_fullsized":"2023-08-27T11:29:37.544736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:29:23.044627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545114+0000","last_change":"2023-08-27T11:29:36.271931+0000","last_active":"2023-08-27T11:29:37.545114+0000","last_peered":"2023-08-27T11:29:37.545114+0000","last_clean":"2023-08-27T11:29:37.545114+0000","last_became_active":"2023-08-27T11:29:36.271657+0000","last_became_peered":"2023-08-27T11:29:36.271657+0000","last_unstale":"2023-08-27T11:29:37.545114+0000","last_undegraded":"2023-08-27T11:29:37.545114+0000","last_fullsized":"2023-08-27T11:29:37.545114+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:44.639540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544828+0000","last_change":"2023-08-27T11:29:36.285122+0000","last_active":"2023-08-27T11:29:37.544828+0000","last_peered":"2023-08-27T11:29:37.544828+0000","last_clean":"2023-08-27T11:29:37.544828+0000","last_became_active":"2023-08-27T11:29:36.284807+0000","last_became_peered":"2023-08-27T11:29:36.284807+0000","last_unstale":"2023-08-27T11:29:37.544828+0000","last_undegraded":"2023-08-27T11:29:37.544828+0000","last_fullsized":"2023-08-27T11:29:37.544828+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:35:23.536618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544333+0000","last_change":"2023-08-27T11:29:36.273988+0000","last_active":"2023-08-27T11:29:37.544333+0000","last_peered":"2023-08-27T11:29:37.544333+0000","last_clean":"2023-08-27T11:29:37.544333+0000","last_became_active":"2023-08-27T11:29:36.272630+0000","last_became_peered":"2023-08-27T11:29:36.272630+0000","last_unstale":"2023-08-27T11:29:37.544333+0000","last_undegraded":"2023-08-27T11:29:37.544333+0000","last_fullsized":"2023-08-27T11:29:37.544333+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:25.873275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544507+0000","last_change":"2023-08-27T11:29:36.279435+0000","last_active":"2023-08-27T11:29:37.544507+0000","last_peered":"2023-08-27T11:29:37.544507+0000","last_clean":"2023-08-27T11:29:37.544507+0000","last_became_active":"2023-08-27T11:29:36.279142+0000","last_became_peered":"2023-08-27T11:29:36.279142+0000","last_unstale":"2023-08-27T11:29:37.544507+0000","last_undegraded":"2023-08-27T11:29:37.544507+0000","last_fullsized":"2023-08-27T11:29:37.544507+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:34:12.240728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244705+0000","last_change":"2023-08-27T11:29:36.268446+0000","last_active":"2023-08-27T11:29:37.244705+0000","last_peered":"2023-08-27T11:29:37.244705+0000","last_clean":"2023-08-27T11:29:37.244705+0000","last_became_active":"2023-08-27T11:29:36.268127+0000","last_became_peered":"2023-08-27T11:29:36.268127+0000","last_unstale":"2023-08-27T11:29:37.244705+0000","last_undegraded":"2023-08-27T11:29:37.244705+0000","last_fullsized":"2023-08-27T11:29:37.244705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.145821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544810+0000","last_change":"2023-08-27T11:29:36.274117+0000","last_active":"2023-08-27T11:29:37.544810+0000","last_peered":"2023-08-27T11:29:37.544810+0000","last_clean":"2023-08-27T11:29:37.544810+0000","last_became_active":"2023-08-27T11:29:36.273624+0000","last_became_peered":"2023-08-27T11:29:36.273624+0000","last_unstale":"2023-08-27T11:29:37.544810+0000","last_undegraded":"2023-08-27T11:29:37.544810+0000","last_fullsized":"2023-08-27T11:29:37.544810+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:42.889869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244196+0000","last_change":"2023-08-27T11:29:36.286136+0000","last_active":"2023-08-27T11:29:37.244196+0000","last_peered":"2023-08-27T11:29:37.244196+0000","last_clean":"2023-08-27T11:29:37.244196+0000","last_became_active":"2023-08-27T11:29:36.285845+0000","last_became_peered":"2023-08-27T11:29:36.285845+0000","last_unstale":"2023-08-27T11:29:37.244196+0000","last_undegraded":"2023-08-27T11:29:37.244196+0000","last_fullsized":"2023-08-27T11:29:37.244196+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:58.783253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544260+0000","last_change":"2023-08-27T11:29:36.282967+0000","last_active":"2023-08-27T11:29:37.544260+0000","last_peered":"2023-08-27T11:29:37.544260+0000","last_clean":"2023-08-27T11:29:37.544260+0000","last_became_active":"2023-08-27T11:29:36.282712+0000","last_became_peered":"2023-08-27T11:29:36.282712+0000","last_unstale":"2023-08-27T11:29:37.544260+0000","last_undegraded":"2023-08-27T11:29:37.544260+0000","last_fullsized":"2023-08-27T11:29:37.544260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:30:51.922965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"143'4","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246552+0000","last_change":"2023-08-27T11:29:35.262477+0000","last_active":"2023-08-27T11:29:37.246552+0000","last_peered":"2023-08-27T11:29:37.246552+0000","last_clean":"2023-08-27T11:29:37.246552+0000","last_became_active":"2023-08-27T11:29:35.262122+0000","last_became_peered":"2023-08-27T11:29:35.262122+0000","last_unstale":"2023-08-27T11:29:37.246552+0000","last_undegraded":"2023-08-27T11:29:37.246552+0000","last_fullsized":"2023-08-27T11:29:37.246552+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:14.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543682+0000","last_change":"2023-08-27T11:29:36.254123+0000","last_active":"2023-08-27T11:29:37.543682+0000","last_peered":"2023-08-27T11:29:37.543682+0000","last_clean":"2023-08-27T11:29:37.543682+0000","last_became_active":"2023-08-27T11:29:36.253801+0000","last_became_peered":"2023-08-27T11:29:36.253801+0000","last_unstale":"2023-08-27T11:29:37.543682+0000","last_undegraded":"2023-08-27T11:29:37.543682+0000","last_fullsized":"2023-08-27T11:29:37.543682+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:50:03.444967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544902+0000","last_change":"2023-08-27T11:29:35.261806+0000","last_active":"2023-08-27T11:29:37.544902+0000","last_peered":"2023-08-27T11:29:37.544902+0000","last_clean":"2023-08-27T11:29:37.544902+0000","last_became_active":"2023-08-27T11:29:35.261521+0000","last_became_peered":"2023-08-27T11:29:35.261521+0000","last_unstale":"2023-08-27T11:29:37.544902+0000","last_undegraded":"2023-08-27T11:29:37.544902+0000","last_fullsized":"2023-08-27T11:29:37.544902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:54:45.905680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544095+0000","last_change":"2023-08-27T11:29:36.268952+0000","last_active":"2023-08-27T11:29:37.544095+0000","last_peered":"2023-08-27T11:29:37.544095+0000","last_clean":"2023-08-27T11:29:37.544095+0000","last_became_active":"2023-08-27T11:29:36.268239+0000","last_became_peered":"2023-08-27T11:29:36.268239+0000","last_unstale":"2023-08-27T11:29:37.544095+0000","last_undegraded":"2023-08-27T11:29:37.544095+0000","last_fullsized":"2023-08-27T11:29:37.544095+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:33.645023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545667+0000","last_change":"2023-08-27T11:29:35.270214+0000","last_active":"2023-08-27T11:29:37.545667+0000","last_peered":"2023-08-27T11:29:37.545667+0000","last_clean":"2023-08-27T11:29:37.545667+0000","last_became_active":"2023-08-27T11:29:35.269755+0000","last_became_peered":"2023-08-27T11:29:35.269755+0000","last_unstale":"2023-08-27T11:29:37.545667+0000","last_undegraded":"2023-08-27T11:29:37.545667+0000","last_fullsized":"2023-08-27T11:29:37.545667+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:04:57.740342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544566+0000","last_change":"2023-08-27T11:29:36.282763+0000","last_active":"2023-08-27T11:29:37.544566+0000","last_peered":"2023-08-27T11:29:37.544566+0000","last_clean":"2023-08-27T11:29:37.544566+0000","last_became_active":"2023-08-27T11:29:36.282463+0000","last_became_peered":"2023-08-27T11:29:36.282463+0000","last_unstale":"2023-08-27T11:29:37.544566+0000","last_undegraded":"2023-08-27T11:29:37.544566+0000","last_fullsized":"2023-08-27T11:29:37.544566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:21:42.702305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544960+0000","last_change":"2023-08-27T11:29:35.262484+0000","last_active":"2023-08-27T11:29:37.544960+0000","last_peered":"2023-08-27T11:29:37.544960+0000","last_clean":"2023-08-27T11:29:37.544960+0000","last_became_active":"2023-08-27T11:29:35.262188+0000","last_became_peered":"2023-08-27T11:29:35.262188+0000","last_unstale":"2023-08-27T11:29:37.544960+0000","last_undegraded":"2023-08-27T11:29:37.544960+0000","last_fullsized":"2023-08-27T11:29:37.544960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:08.647038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245271+0000","last_change":"2023-08-27T11:29:36.271908+0000","last_active":"2023-08-27T11:29:37.245271+0000","last_peered":"2023-08-27T11:29:37.245271+0000","last_clean":"2023-08-27T11:29:37.245271+0000","last_became_active":"2023-08-27T11:29:36.271609+0000","last_became_peered":"2023-08-27T11:29:36.271609+0000","last_unstale":"2023-08-27T11:29:37.245271+0000","last_undegraded":"2023-08-27T11:29:37.245271+0000","last_fullsized":"2023-08-27T11:29:37.245271+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:09.058899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245049+0000","last_change":"2023-08-27T11:29:35.265293+0000","last_active":"2023-08-27T11:29:37.245049+0000","last_peered":"2023-08-27T11:29:37.245049+0000","last_clean":"2023-08-27T11:29:37.245049+0000","last_became_active":"2023-08-27T11:29:35.265025+0000","last_became_peered":"2023-08-27T11:29:35.265025+0000","last_unstale":"2023-08-27T11:29:37.245049+0000","last_undegraded":"2023-08-27T11:29:37.245049+0000","last_fullsized":"2023-08-27T11:29:37.245049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:02.763330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545108+0000","last_change":"2023-08-27T11:29:36.249395+0000","last_active":"2023-08-27T11:29:37.545108+0000","last_peered":"2023-08-27T11:29:37.545108+0000","last_clean":"2023-08-27T11:29:37.545108+0000","last_became_active":"2023-08-27T11:29:36.249028+0000","last_became_peered":"2023-08-27T11:29:36.249028+0000","last_unstale":"2023-08-27T11:29:37.545108+0000","last_undegraded":"2023-08-27T11:29:37.545108+0000","last_fullsized":"2023-08-27T11:29:37.545108+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:14:20.363739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544240+0000","last_change":"2023-08-27T11:29:35.257372+0000","last_active":"2023-08-27T11:29:37.544240+0000","last_peered":"2023-08-27T11:29:37.544240+0000","last_clean":"2023-08-27T11:29:37.544240+0000","last_became_active":"2023-08-27T11:29:35.257071+0000","last_became_peered":"2023-08-27T11:29:35.257071+0000","last_unstale":"2023-08-27T11:29:37.544240+0000","last_undegraded":"2023-08-27T11:29:37.544240+0000","last_fullsized":"2023-08-27T11:29:37.544240+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:54.704143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545166+0000","last_change":"2023-08-27T11:29:36.253855+0000","last_active":"2023-08-27T11:29:37.545166+0000","last_peered":"2023-08-27T11:29:37.545166+0000","last_clean":"2023-08-27T11:29:37.545166+0000","last_became_active":"2023-08-27T11:29:36.253460+0000","last_became_peered":"2023-08-27T11:29:36.253460+0000","last_unstale":"2023-08-27T11:29:37.545166+0000","last_undegraded":"2023-08-27T11:29:37.545166+0000","last_fullsized":"2023-08-27T11:29:37.545166+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:43.825512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544658+0000","last_change":"2023-08-27T11:29:35.258285+0000","last_active":"2023-08-27T11:29:37.544658+0000","last_peered":"2023-08-27T11:29:37.544658+0000","last_clean":"2023-08-27T11:29:37.544658+0000","last_became_active":"2023-08-27T11:29:35.257980+0000","last_became_peered":"2023-08-27T11:29:35.257980+0000","last_unstale":"2023-08-27T11:29:37.544658+0000","last_undegraded":"2023-08-27T11:29:37.544658+0000","last_fullsized":"2023-08-27T11:29:37.544658+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:37:44.403437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246506+0000","last_change":"2023-08-27T11:29:36.275852+0000","last_active":"2023-08-27T11:29:37.246506+0000","last_peered":"2023-08-27T11:29:37.246506+0000","last_clean":"2023-08-27T11:29:37.246506+0000","last_became_active":"2023-08-27T11:29:36.275560+0000","last_became_peered":"2023-08-27T11:29:36.275560+0000","last_unstale":"2023-08-27T11:29:37.246506+0000","last_undegraded":"2023-08-27T11:29:37.246506+0000","last_fullsized":"2023-08-27T11:29:37.246506+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:40:59.947824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244862+0000","last_change":"2023-08-27T11:29:35.266493+0000","last_active":"2023-08-27T11:29:37.244862+0000","last_peered":"2023-08-27T11:29:37.244862+0000","last_clean":"2023-08-27T11:29:37.244862+0000","last_became_active":"2023-08-27T11:29:35.266215+0000","last_became_peered":"2023-08-27T11:29:35.266215+0000","last_unstale":"2023-08-27T11:29:37.244862+0000","last_undegraded":"2023-08-27T11:29:37.244862+0000","last_fullsized":"2023-08-27T11:29:37.244862+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:54:14.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245043+0000","last_change":"2023-08-27T11:29:36.256017+0000","last_active":"2023-08-27T11:29:37.245043+0000","last_peered":"2023-08-27T11:29:37.245043+0000","last_clean":"2023-08-27T11:29:37.245043+0000","last_became_active":"2023-08-27T11:29:36.255684+0000","last_became_peered":"2023-08-27T11:29:36.255684+0000","last_unstale":"2023-08-27T11:29:37.245043+0000","last_undegraded":"2023-08-27T11:29:37.245043+0000","last_fullsized":"2023-08-27T11:29:37.245043+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:18.277121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544869+0000","last_change":"2023-08-27T11:29:35.264052+0000","last_active":"2023-08-27T11:29:37.544869+0000","last_peered":"2023-08-27T11:29:37.544869+0000","last_clean":"2023-08-27T11:29:37.544869+0000","last_became_active":"2023-08-27T11:29:35.263557+0000","last_became_peered":"2023-08-27T11:29:35.263557+0000","last_unstale":"2023-08-27T11:29:37.544869+0000","last_undegraded":"2023-08-27T11:29:37.544869+0000","last_fullsized":"2023-08-27T11:29:37.544869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:59:29.209210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244380+0000","last_change":"2023-08-27T11:29:36.275748+0000","last_active":"2023-08-27T11:29:37.244380+0000","last_peered":"2023-08-27T11:29:37.244380+0000","last_clean":"2023-08-27T11:29:37.244380+0000","last_became_active":"2023-08-27T11:29:36.275141+0000","last_became_peered":"2023-08-27T11:29:36.275141+0000","last_unstale":"2023-08-27T11:29:37.244380+0000","last_undegraded":"2023-08-27T11:29:37.244380+0000","last_fullsized":"2023-08-27T11:29:37.244380+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:44.322214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245220+0000","last_change":"2023-08-27T11:29:35.258078+0000","last_active":"2023-08-27T11:29:37.245220+0000","last_peered":"2023-08-27T11:29:37.245220+0000","last_clean":"2023-08-27T11:29:37.245220+0000","last_became_active":"2023-08-27T11:29:35.257736+0000","last_became_peered":"2023-08-27T11:29:35.257736+0000","last_unstale":"2023-08-27T11:29:37.245220+0000","last_undegraded":"2023-08-27T11:29:37.245220+0000","last_fullsized":"2023-08-27T11:29:37.245220+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:32.189066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545241+0000","last_change":"2023-08-27T11:29:36.279337+0000","last_active":"2023-08-27T11:29:37.545241+0000","last_peered":"2023-08-27T11:29:37.545241+0000","last_clean":"2023-08-27T11:29:37.545241+0000","last_became_active":"2023-08-27T11:29:36.279039+0000","last_became_peered":"2023-08-27T11:29:36.279039+0000","last_unstale":"2023-08-27T11:29:37.545241+0000","last_undegraded":"2023-08-27T11:29:37.545241+0000","last_fullsized":"2023-08-27T11:29:37.545241+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:03.779415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544339+0000","last_change":"2023-08-27T11:29:35.262578+0000","last_active":"2023-08-27T11:29:37.544339+0000","last_peered":"2023-08-27T11:29:37.544339+0000","last_clean":"2023-08-27T11:29:37.544339+0000","last_became_active":"2023-08-27T11:29:35.262279+0000","last_became_peered":"2023-08-27T11:29:35.262279+0000","last_unstale":"2023-08-27T11:29:37.544339+0000","last_undegraded":"2023-08-27T11:29:37.544339+0000","last_fullsized":"2023-08-27T11:29:37.544339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:16.896770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545233+0000","last_change":"2023-08-27T11:29:36.276188+0000","last_active":"2023-08-27T11:29:37.545233+0000","last_peered":"2023-08-27T11:29:37.545233+0000","last_clean":"2023-08-27T11:29:37.545233+0000","last_became_active":"2023-08-27T11:29:36.275855+0000","last_became_peered":"2023-08-27T11:29:36.275855+0000","last_unstale":"2023-08-27T11:29:37.545233+0000","last_undegraded":"2023-08-27T11:29:37.545233+0000","last_fullsized":"2023-08-27T11:29:37.545233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:11.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245402+0000","last_change":"2023-08-27T11:29:35.265840+0000","last_active":"2023-08-27T11:29:37.245402+0000","last_peered":"2023-08-27T11:29:37.245402+0000","last_clean":"2023-08-27T11:29:37.245402+0000","last_became_active":"2023-08-27T11:29:35.265577+0000","last_became_peered":"2023-08-27T11:29:35.265577+0000","last_unstale":"2023-08-27T11:29:37.245402+0000","last_undegraded":"2023-08-27T11:29:37.245402+0000","last_fullsized":"2023-08-27T11:29:37.245402+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:38.101644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544126+0000","last_change":"2023-08-27T11:29:36.272988+0000","last_active":"2023-08-27T11:29:37.544126+0000","last_peered":"2023-08-27T11:29:37.544126+0000","last_clean":"2023-08-27T11:29:37.544126+0000","last_became_active":"2023-08-27T11:29:36.272224+0000","last_became_peered":"2023-08-27T11:29:36.272224+0000","last_unstale":"2023-08-27T11:29:37.544126+0000","last_undegraded":"2023-08-27T11:29:37.544126+0000","last_fullsized":"2023-08-27T11:29:37.544126+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:21.987293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544662+0000","last_change":"2023-08-27T11:29:35.265779+0000","last_active":"2023-08-27T11:29:37.544662+0000","last_peered":"2023-08-27T11:29:37.544662+0000","last_clean":"2023-08-27T11:29:37.544662+0000","last_became_active":"2023-08-27T11:29:35.265505+0000","last_became_peered":"2023-08-27T11:29:35.265505+0000","last_unstale":"2023-08-27T11:29:37.544662+0000","last_undegraded":"2023-08-27T11:29:37.544662+0000","last_fullsized":"2023-08-27T11:29:37.544662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:17.737585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544187+0000","last_change":"2023-08-27T11:29:36.265305+0000","last_active":"2023-08-27T11:29:37.544187+0000","last_peered":"2023-08-27T11:29:37.544187+0000","last_clean":"2023-08-27T11:29:37.544187+0000","last_became_active":"2023-08-27T11:29:36.264918+0000","last_became_peered":"2023-08-27T11:29:36.264918+0000","last_unstale":"2023-08-27T11:29:37.544187+0000","last_undegraded":"2023-08-27T11:29:37.544187+0000","last_fullsized":"2023-08-27T11:29:37.544187+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:45.384846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545202+0000","last_change":"2023-08-27T11:29:35.270172+0000","last_active":"2023-08-27T11:29:37.545202+0000","last_peered":"2023-08-27T11:29:37.545202+0000","last_clean":"2023-08-27T11:29:37.545202+0000","last_became_active":"2023-08-27T11:29:35.269864+0000","last_became_peered":"2023-08-27T11:29:35.269864+0000","last_unstale":"2023-08-27T11:29:37.545202+0000","last_undegraded":"2023-08-27T11:29:37.545202+0000","last_fullsized":"2023-08-27T11:29:37.545202+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:12.494489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544773+0000","last_change":"2023-08-27T11:29:36.267513+0000","last_active":"2023-08-27T11:29:37.544773+0000","last_peered":"2023-08-27T11:29:37.544773+0000","last_clean":"2023-08-27T11:29:37.544773+0000","last_became_active":"2023-08-27T11:29:36.267201+0000","last_became_peered":"2023-08-27T11:29:36.267201+0000","last_unstale":"2023-08-27T11:29:37.544773+0000","last_undegraded":"2023-08-27T11:29:37.544773+0000","last_fullsized":"2023-08-27T11:29:37.544773+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:35.325213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544794+0000","last_change":"2023-08-27T11:29:35.263997+0000","last_active":"2023-08-27T11:29:37.544794+0000","last_peered":"2023-08-27T11:29:37.544794+0000","last_clean":"2023-08-27T11:29:37.544794+0000","last_became_active":"2023-08-27T11:29:35.263703+0000","last_became_peered":"2023-08-27T11:29:35.263703+0000","last_unstale":"2023-08-27T11:29:37.544794+0000","last_undegraded":"2023-08-27T11:29:37.544794+0000","last_fullsized":"2023-08-27T11:29:37.544794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:38:46.872831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544843+0000","last_change":"2023-08-27T11:29:36.283508+0000","last_active":"2023-08-27T11:29:37.544843+0000","last_peered":"2023-08-27T11:29:37.544843+0000","last_clean":"2023-08-27T11:29:37.544843+0000","last_became_active":"2023-08-27T11:29:36.283214+0000","last_became_peered":"2023-08-27T11:29:36.283214+0000","last_unstale":"2023-08-27T11:29:37.544843+0000","last_undegraded":"2023-08-27T11:29:37.544843+0000","last_fullsized":"2023-08-27T11:29:37.544843+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:37.013902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544452+0000","last_change":"2023-08-27T11:29:35.274174+0000","last_active":"2023-08-27T11:29:37.544452+0000","last_peered":"2023-08-27T11:29:37.544452+0000","last_clean":"2023-08-27T11:29:37.544452+0000","last_became_active":"2023-08-27T11:29:35.273836+0000","last_became_peered":"2023-08-27T11:29:35.273836+0000","last_unstale":"2023-08-27T11:29:37.544452+0000","last_undegraded":"2023-08-27T11:29:37.544452+0000","last_fullsized":"2023-08-27T11:29:37.544452+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:19:40.360176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544185+0000","last_change":"2023-08-27T11:29:36.274338+0000","last_active":"2023-08-27T11:29:37.544185+0000","last_peered":"2023-08-27T11:29:37.544185+0000","last_clean":"2023-08-27T11:29:37.544185+0000","last_became_active":"2023-08-27T11:29:36.274056+0000","last_became_peered":"2023-08-27T11:29:36.274056+0000","last_unstale":"2023-08-27T11:29:37.544185+0000","last_undegraded":"2023-08-27T11:29:37.544185+0000","last_fullsized":"2023-08-27T11:29:37.544185+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:49:33.563878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544846+0000","last_change":"2023-08-27T11:29:35.265229+0000","last_active":"2023-08-27T11:29:37.544846+0000","last_peered":"2023-08-27T11:29:37.544846+0000","last_clean":"2023-08-27T11:29:37.544846+0000","last_became_active":"2023-08-27T11:29:35.264883+0000","last_became_peered":"2023-08-27T11:29:35.264883+0000","last_unstale":"2023-08-27T11:29:37.544846+0000","last_undegraded":"2023-08-27T11:29:37.544846+0000","last_fullsized":"2023-08-27T11:29:37.544846+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:19.695513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245223+0000","last_change":"2023-08-27T11:29:36.255819+0000","last_active":"2023-08-27T11:29:37.245223+0000","last_peered":"2023-08-27T11:29:37.245223+0000","last_clean":"2023-08-27T11:29:37.245223+0000","last_became_active":"2023-08-27T11:29:36.255499+0000","last_became_peered":"2023-08-27T11:29:36.255499+0000","last_unstale":"2023-08-27T11:29:37.245223+0000","last_undegraded":"2023-08-27T11:29:37.245223+0000","last_fullsized":"2023-08-27T11:29:37.245223+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:39.127334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"144'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544545+0000","last_change":"2023-08-27T11:29:35.258902+0000","last_active":"2023-08-27T11:29:37.544545+0000","last_peered":"2023-08-27T11:29:37.544545+0000","last_clean":"2023-08-27T11:29:37.544545+0000","last_became_active":"2023-08-27T11:29:35.258622+0000","last_became_peered":"2023-08-27T11:29:35.258622+0000","last_unstale":"2023-08-27T11:29:37.544545+0000","last_undegraded":"2023-08-27T11:29:37.544545+0000","last_fullsized":"2023-08-27T11:29:37.544545+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:26:06.648238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544581+0000","last_change":"2023-08-27T11:29:36.253802+0000","last_active":"2023-08-27T11:29:37.544581+0000","last_peered":"2023-08-27T11:29:37.544581+0000","last_clean":"2023-08-27T11:29:37.544581+0000","last_became_active":"2023-08-27T11:29:36.253472+0000","last_became_peered":"2023-08-27T11:29:36.253472+0000","last_unstale":"2023-08-27T11:29:37.544581+0000","last_undegraded":"2023-08-27T11:29:37.544581+0000","last_fullsized":"2023-08-27T11:29:37.544581+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:42.098755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544582+0000","last_change":"2023-08-27T11:29:35.265730+0000","last_active":"2023-08-27T11:29:37.544582+0000","last_peered":"2023-08-27T11:29:37.544582+0000","last_clean":"2023-08-27T11:29:37.544582+0000","last_became_active":"2023-08-27T11:29:35.265470+0000","last_became_peered":"2023-08-27T11:29:35.265470+0000","last_unstale":"2023-08-27T11:29:37.544582+0000","last_undegraded":"2023-08-27T11:29:37.544582+0000","last_fullsized":"2023-08-27T11:29:37.544582+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:49.229163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245182+0000","last_change":"2023-08-27T11:29:36.256338+0000","last_active":"2023-08-27T11:29:37.245182+0000","last_peered":"2023-08-27T11:29:37.245182+0000","last_clean":"2023-08-27T11:29:37.245182+0000","last_became_active":"2023-08-27T11:29:36.255374+0000","last_became_peered":"2023-08-27T11:29:36.255374+0000","last_unstale":"2023-08-27T11:29:37.245182+0000","last_undegraded":"2023-08-27T11:29:37.245182+0000","last_fullsized":"2023-08-27T11:29:37.245182+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:19.668623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544986+0000","last_change":"2023-08-27T11:29:35.258653+0000","last_active":"2023-08-27T11:29:37.544986+0000","last_peered":"2023-08-27T11:29:37.544986+0000","last_clean":"2023-08-27T11:29:37.544986+0000","last_became_active":"2023-08-27T11:29:35.258374+0000","last_became_peered":"2023-08-27T11:29:35.258374+0000","last_unstale":"2023-08-27T11:29:37.544986+0000","last_undegraded":"2023-08-27T11:29:37.544986+0000","last_fullsized":"2023-08-27T11:29:37.544986+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:59.412904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246213+0000","last_change":"2023-08-27T11:29:36.269389+0000","last_active":"2023-08-27T11:29:37.246213+0000","last_peered":"2023-08-27T11:29:37.246213+0000","last_clean":"2023-08-27T11:29:37.246213+0000","last_became_active":"2023-08-27T11:29:36.269045+0000","last_became_peered":"2023-08-27T11:29:36.269045+0000","last_unstale":"2023-08-27T11:29:37.246213+0000","last_undegraded":"2023-08-27T11:29:37.246213+0000","last_fullsized":"2023-08-27T11:29:37.246213+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:22:14.379442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245991+0000","last_change":"2023-08-27T11:29:35.264235+0000","last_active":"2023-08-27T11:29:37.245991+0000","last_peered":"2023-08-27T11:29:37.245991+0000","last_clean":"2023-08-27T11:29:37.245991+0000","last_became_active":"2023-08-27T11:29:35.263872+0000","last_became_peered":"2023-08-27T11:29:35.263872+0000","last_unstale":"2023-08-27T11:29:37.245991+0000","last_undegraded":"2023-08-27T11:29:37.245991+0000","last_fullsized":"2023-08-27T11:29:37.245991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:30:37.112867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545026+0000","last_change":"2023-08-27T11:29:36.282957+0000","last_active":"2023-08-27T11:29:37.545026+0000","last_peered":"2023-08-27T11:29:37.545026+0000","last_clean":"2023-08-27T11:29:37.545026+0000","last_became_active":"2023-08-27T11:29:36.282640+0000","last_became_peered":"2023-08-27T11:29:36.282640+0000","last_unstale":"2023-08-27T11:29:37.545026+0000","last_undegraded":"2023-08-27T11:29:37.545026+0000","last_fullsized":"2023-08-27T11:29:37.545026+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:05.634180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544113+0000","last_change":"2023-08-27T11:29:35.251383+0000","last_active":"2023-08-27T11:29:37.544113+0000","last_peered":"2023-08-27T11:29:37.544113+0000","last_clean":"2023-08-27T11:29:37.544113+0000","last_became_active":"2023-08-27T11:29:35.251115+0000","last_became_peered":"2023-08-27T11:29:35.251115+0000","last_unstale":"2023-08-27T11:29:37.544113+0000","last_undegraded":"2023-08-27T11:29:37.544113+0000","last_fullsized":"2023-08-27T11:29:37.544113+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:45.478442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544258+0000","last_change":"2023-08-27T11:29:36.273580+0000","last_active":"2023-08-27T11:29:37.544258+0000","last_peered":"2023-08-27T11:29:37.544258+0000","last_clean":"2023-08-27T11:29:37.544258+0000","last_became_active":"2023-08-27T11:29:36.273311+0000","last_became_peered":"2023-08-27T11:29:36.273311+0000","last_unstale":"2023-08-27T11:29:37.544258+0000","last_undegraded":"2023-08-27T11:29:37.544258+0000","last_fullsized":"2023-08-27T11:29:37.544258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:01:10.046012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545123+0000","last_change":"2023-08-27T11:29:35.270115+0000","last_active":"2023-08-27T11:29:37.545123+0000","last_peered":"2023-08-27T11:29:37.545123+0000","last_clean":"2023-08-27T11:29:37.545123+0000","last_became_active":"2023-08-27T11:29:35.269746+0000","last_became_peered":"2023-08-27T11:29:35.269746+0000","last_unstale":"2023-08-27T11:29:37.545123+0000","last_undegraded":"2023-08-27T11:29:37.545123+0000","last_fullsized":"2023-08-27T11:29:37.545123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:45.364274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545323+0000","last_change":"2023-08-27T11:29:36.267604+0000","last_active":"2023-08-27T11:29:37.545323+0000","last_peered":"2023-08-27T11:29:37.545323+0000","last_clean":"2023-08-27T11:29:37.545323+0000","last_became_active":"2023-08-27T11:29:36.267275+0000","last_became_peered":"2023-08-27T11:29:36.267275+0000","last_unstale":"2023-08-27T11:29:37.545323+0000","last_undegraded":"2023-08-27T11:29:37.545323+0000","last_fullsized":"2023-08-27T11:29:37.545323+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:13.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543774+0000","last_change":"2023-08-27T11:29:35.265870+0000","last_active":"2023-08-27T11:29:37.543774+0000","last_peered":"2023-08-27T11:29:37.543774+0000","last_clean":"2023-08-27T11:29:37.543774+0000","last_became_active":"2023-08-27T11:29:35.265559+0000","last_became_peered":"2023-08-27T11:29:35.265559+0000","last_unstale":"2023-08-27T11:29:37.543774+0000","last_undegraded":"2023-08-27T11:29:37.543774+0000","last_fullsized":"2023-08-27T11:29:37.543774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:31.641297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545663+0000","last_change":"2023-08-27T11:29:36.281395+0000","last_active":"2023-08-27T11:29:37.545663+0000","last_peered":"2023-08-27T11:29:37.545663+0000","last_clean":"2023-08-27T11:29:37.545663+0000","last_became_active":"2023-08-27T11:29:36.281110+0000","last_became_peered":"2023-08-27T11:29:36.281110+0000","last_unstale":"2023-08-27T11:29:37.545663+0000","last_undegraded":"2023-08-27T11:29:37.545663+0000","last_fullsized":"2023-08-27T11:29:37.545663+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:08.506498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545086+0000","last_change":"2023-08-27T11:29:35.270153+0000","last_active":"2023-08-27T11:29:37.545086+0000","last_peered":"2023-08-27T11:29:37.545086+0000","last_clean":"2023-08-27T11:29:37.545086+0000","last_became_active":"2023-08-27T11:29:35.269729+0000","last_became_peered":"2023-08-27T11:29:35.269729+0000","last_unstale":"2023-08-27T11:29:37.545086+0000","last_undegraded":"2023-08-27T11:29:37.545086+0000","last_fullsized":"2023-08-27T11:29:37.545086+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:54.078543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":244,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244738+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:29:37.244738+0000","last_peered":"2023-08-27T11:29:37.244738+0000","last_clean":"2023-08-27T11:29:37.244738+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:29:37.244738+0000","last_undegraded":"2023-08-27T11:29:37.244738+0000","last_fullsized":"2023-08-27T11:29:37.244738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:21.904397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545252+0000","last_change":"2023-08-27T11:29:36.273951+0000","last_active":"2023-08-27T11:29:37.545252+0000","last_peered":"2023-08-27T11:29:37.545252+0000","last_clean":"2023-08-27T11:29:37.545252+0000","last_became_active":"2023-08-27T11:29:36.273633+0000","last_became_peered":"2023-08-27T11:29:36.273633+0000","last_unstale":"2023-08-27T11:29:37.545252+0000","last_undegraded":"2023-08-27T11:29:37.545252+0000","last_fullsized":"2023-08-27T11:29:37.545252+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:00:29.071970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"143'8","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245048+0000","last_change":"2023-08-27T11:29:35.264586+0000","last_active":"2023-08-27T11:29:37.245048+0000","last_peered":"2023-08-27T11:29:37.245048+0000","last_clean":"2023-08-27T11:29:37.245048+0000","last_became_active":"2023-08-27T11:29:35.264251+0000","last_became_peered":"2023-08-27T11:29:35.264251+0000","last_unstale":"2023-08-27T11:29:37.245048+0000","last_undegraded":"2023-08-27T11:29:37.245048+0000","last_fullsized":"2023-08-27T11:29:37.245048+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:09:16.544974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":244,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244905+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:29:37.244905+0000","last_peered":"2023-08-27T11:29:37.244905+0000","last_clean":"2023-08-27T11:29:37.244905+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:29:37.244905+0000","last_undegraded":"2023-08-27T11:29:37.244905+0000","last_fullsized":"2023-08-27T11:29:37.244905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:23.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544183+0000","last_change":"2023-08-27T11:29:36.283395+0000","last_active":"2023-08-27T11:29:37.544183+0000","last_peered":"2023-08-27T11:29:37.544183+0000","last_clean":"2023-08-27T11:29:37.544183+0000","last_became_active":"2023-08-27T11:29:36.283095+0000","last_became_peered":"2023-08-27T11:29:36.283095+0000","last_unstale":"2023-08-27T11:29:37.544183+0000","last_undegraded":"2023-08-27T11:29:37.544183+0000","last_fullsized":"2023-08-27T11:29:37.544183+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:27.733150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544816+0000","last_change":"2023-08-27T11:29:35.259916+0000","last_active":"2023-08-27T11:29:37.544816+0000","last_peered":"2023-08-27T11:29:37.544816+0000","last_clean":"2023-08-27T11:29:37.544816+0000","last_became_active":"2023-08-27T11:29:35.259653+0000","last_became_peered":"2023-08-27T11:29:35.259653+0000","last_unstale":"2023-08-27T11:29:37.544816+0000","last_undegraded":"2023-08-27T11:29:37.544816+0000","last_fullsized":"2023-08-27T11:29:37.544816+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:46.917630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":256,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545237+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:29:37.545237+0000","last_peered":"2023-08-27T11:29:37.545237+0000","last_clean":"2023-08-27T11:29:37.545237+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:29:37.545237+0000","last_undegraded":"2023-08-27T11:29:37.545237+0000","last_fullsized":"2023-08-27T11:29:37.545237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:02:53.195257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544230+0000","last_change":"2023-08-27T11:29:36.277995+0000","last_active":"2023-08-27T11:29:37.544230+0000","last_peered":"2023-08-27T11:29:37.544230+0000","last_clean":"2023-08-27T11:29:37.544230+0000","last_became_active":"2023-08-27T11:29:36.277710+0000","last_became_peered":"2023-08-27T11:29:36.277710+0000","last_unstale":"2023-08-27T11:29:37.544230+0000","last_undegraded":"2023-08-27T11:29:37.544230+0000","last_fullsized":"2023-08-27T11:29:37.544230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:50.489378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544386+0000","last_change":"2023-08-27T11:29:35.258960+0000","last_active":"2023-08-27T11:29:37.544386+0000","last_peered":"2023-08-27T11:29:37.544386+0000","last_clean":"2023-08-27T11:29:37.544386+0000","last_became_active":"2023-08-27T11:29:35.258657+0000","last_became_peered":"2023-08-27T11:29:35.258657+0000","last_unstale":"2023-08-27T11:29:37.544386+0000","last_undegraded":"2023-08-27T11:29:37.544386+0000","last_fullsized":"2023-08-27T11:29:37.544386+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:01.948187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544640+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:29:37.544640+0000","last_peered":"2023-08-27T11:29:37.544640+0000","last_clean":"2023-08-27T11:29:37.544640+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:29:37.544640+0000","last_undegraded":"2023-08-27T11:29:37.544640+0000","last_fullsized":"2023-08-27T11:29:37.544640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:48.725373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544829+0000","last_change":"2023-08-27T11:29:36.267154+0000","last_active":"2023-08-27T11:29:37.544829+0000","last_peered":"2023-08-27T11:29:37.544829+0000","last_clean":"2023-08-27T11:29:37.544829+0000","last_became_active":"2023-08-27T11:29:36.266871+0000","last_became_peered":"2023-08-27T11:29:36.266871+0000","last_unstale":"2023-08-27T11:29:37.544829+0000","last_undegraded":"2023-08-27T11:29:37.544829+0000","last_fullsized":"2023-08-27T11:29:37.544829+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:50.936583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"143'6","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544270+0000","last_change":"2023-08-27T11:29:35.259131+0000","last_active":"2023-08-27T11:29:37.544270+0000","last_peered":"2023-08-27T11:29:37.544270+0000","last_clean":"2023-08-27T11:29:37.544270+0000","last_became_active":"2023-08-27T11:29:35.258823+0000","last_became_peered":"2023-08-27T11:29:35.258823+0000","last_unstale":"2023-08-27T11:29:37.544270+0000","last_undegraded":"2023-08-27T11:29:37.544270+0000","last_fullsized":"2023-08-27T11:29:37.544270+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:30.929146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544472+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:29:37.544472+0000","last_peered":"2023-08-27T11:29:37.544472+0000","last_clean":"2023-08-27T11:29:37.544472+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:29:37.544472+0000","last_undegraded":"2023-08-27T11:29:37.544472+0000","last_fullsized":"2023-08-27T11:29:37.544472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:21.645597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543992+0000","last_change":"2023-08-27T11:29:36.256097+0000","last_active":"2023-08-27T11:29:37.543992+0000","last_peered":"2023-08-27T11:29:37.543992+0000","last_clean":"2023-08-27T11:29:37.543992+0000","last_became_active":"2023-08-27T11:29:36.255773+0000","last_became_peered":"2023-08-27T11:29:36.255773+0000","last_unstale":"2023-08-27T11:29:37.543992+0000","last_undegraded":"2023-08-27T11:29:37.543992+0000","last_fullsized":"2023-08-27T11:29:37.543992+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:28.721456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"143'3","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246062+0000","last_change":"2023-08-27T11:29:35.270703+0000","last_active":"2023-08-27T11:29:37.246062+0000","last_peered":"2023-08-27T11:29:37.246062+0000","last_clean":"2023-08-27T11:29:37.246062+0000","last_became_active":"2023-08-27T11:29:35.270171+0000","last_became_peered":"2023-08-27T11:29:35.270171+0000","last_unstale":"2023-08-27T11:29:37.246062+0000","last_undegraded":"2023-08-27T11:29:37.246062+0000","last_fullsized":"2023-08-27T11:29:37.246062+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:55.784051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":378,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544516+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:29:37.544516+0000","last_peered":"2023-08-27T11:29:37.544516+0000","last_clean":"2023-08-27T11:29:37.544516+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:29:37.544516+0000","last_undegraded":"2023-08-27T11:29:37.544516+0000","last_fullsized":"2023-08-27T11:29:37.544516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:45:43.449867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":240,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245354+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:29:37.245354+0000","last_peered":"2023-08-27T11:29:37.245354+0000","last_clean":"2023-08-27T11:29:37.245354+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:29:37.245354+0000","last_undegraded":"2023-08-27T11:29:37.245354+0000","last_fullsized":"2023-08-27T11:29:37.245354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:59.460342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245315+0000","last_change":"2023-08-27T11:29:36.267365+0000","last_active":"2023-08-27T11:29:37.245315+0000","last_peered":"2023-08-27T11:29:37.245315+0000","last_clean":"2023-08-27T11:29:37.245315+0000","last_became_active":"2023-08-27T11:29:36.267023+0000","last_became_peered":"2023-08-27T11:29:36.267023+0000","last_unstale":"2023-08-27T11:29:37.245315+0000","last_undegraded":"2023-08-27T11:29:37.245315+0000","last_fullsized":"2023-08-27T11:29:37.245315+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:08:28.495492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544100+0000","last_change":"2023-08-27T11:29:35.262815+0000","last_active":"2023-08-27T11:29:37.544100+0000","last_peered":"2023-08-27T11:29:37.544100+0000","last_clean":"2023-08-27T11:29:37.544100+0000","last_became_active":"2023-08-27T11:29:35.262500+0000","last_became_peered":"2023-08-27T11:29:35.262500+0000","last_unstale":"2023-08-27T11:29:37.544100+0000","last_undegraded":"2023-08-27T11:29:37.544100+0000","last_fullsized":"2023-08-27T11:29:37.544100+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:21.836566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544393+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:29:37.544393+0000","last_peered":"2023-08-27T11:29:37.544393+0000","last_clean":"2023-08-27T11:29:37.544393+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:29:37.544393+0000","last_undegraded":"2023-08-27T11:29:37.544393+0000","last_fullsized":"2023-08-27T11:29:37.544393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:18.617860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244558+0000","last_change":"2023-08-27T11:29:36.278631+0000","last_active":"2023-08-27T11:29:37.244558+0000","last_peered":"2023-08-27T11:29:37.244558+0000","last_clean":"2023-08-27T11:29:37.244558+0000","last_became_active":"2023-08-27T11:29:36.278352+0000","last_became_peered":"2023-08-27T11:29:36.278352+0000","last_unstale":"2023-08-27T11:29:37.244558+0000","last_undegraded":"2023-08-27T11:29:37.244558+0000","last_fullsized":"2023-08-27T11:29:37.244558+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:39.115636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544601+0000","last_change":"2023-08-27T11:29:35.265167+0000","last_active":"2023-08-27T11:29:37.544601+0000","last_peered":"2023-08-27T11:29:37.544601+0000","last_clean":"2023-08-27T11:29:37.544601+0000","last_became_active":"2023-08-27T11:29:35.264787+0000","last_became_peered":"2023-08-27T11:29:35.264787+0000","last_unstale":"2023-08-27T11:29:37.544601+0000","last_undegraded":"2023-08-27T11:29:37.544601+0000","last_fullsized":"2023-08-27T11:29:37.544601+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:37.027357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":256,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246221+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:29:37.246221+0000","last_peered":"2023-08-27T11:29:37.246221+0000","last_clean":"2023-08-27T11:29:37.246221+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:29:37.246221+0000","last_undegraded":"2023-08-27T11:29:37.246221+0000","last_fullsized":"2023-08-27T11:29:37.246221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:20.015442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33532,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338308,"statfs":{"total":96636764160,"available":96602427392,"internally_reserved":0,"allocated":2404352,"data_stored":1451571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.58299999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.623},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":1806336,"data_stored":860217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.443},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.751}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":2416640,"data_stored":1453183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":1.105}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":1.048},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.89300000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":1.006}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1814528,"data_stored":860321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.443},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.501},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.621},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1810432,"data_stored":861203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":0.435},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1826816,"data_stored":862433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":1.099}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":861967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.878},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":1814528,"data_stored":860341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.628},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":0.754},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:29:45.749 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-27T11:29:45.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.961+0000 7f21e83ff700 1 Processor -- start 2023-08-27T11:29:45.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.961+0000 7f21e83ff700 1 -- start start 2023-08-27T11:29:45.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e83ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f21e00c4630 0x7f21e00c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e83ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e006c4e0 con 0x7f21e0151a90 2023-08-27T11:29:45.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e83ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e0155370 con 0x7f21e006ad70 2023-08-27T11:29:45.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e83ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e00c82c0 con 0x7f21e00c4630 2023-08-27T11:29:45.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e619b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f21e0151a90 0x7f21e00c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42382/0 (socket says 172.21.15.43:42382) 2023-08-27T11:29:45.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.962+0000 7f21e619b700 1 -- 172.21.15.43:0/2361557494 learned_addr learned my addr 172.21.15.43:0/2361557494 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:45.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e599a700 1 --2- 172.21.15.43:0/2361557494 >> v2:172.21.15.57:3300/0 conn(0x7f21e00c4630 0x7f21e00c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248932422 0 0) 0x7f21e006c4e0 con 0x7f21e0151a90 2023-08-27T11:29:45.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21cc0035b0 con 0x7f21e0151a90 2023-08-27T11:29:45.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1827309553 0 0) 0x7f21cc0035b0 con 0x7f21e0151a90 2023-08-27T11:29:45.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 >> v2:172.21.15.57:3300/0 conn(0x7f21e00c4630 msgr2=0x7f21e00c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:45.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 --2- 172.21.15.43:0/2361557494 >> v2:172.21.15.57:3300/0 conn(0x7f21e00c4630 0x7f21e00c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 >> v1:172.21.15.57:6789/0 conn(0x7f21e006ad70 legacy=0x7f21e006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:45.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e0151e70 con 0x7f21e0151a90 2023-08-27T11:29:45.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f21dc001670 con 0x7f21e0151a90 2023-08-27T11:29:45.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 >> v1:172.21.15.43:6789/0 conn(0x7f21e0151a90 legacy=0x7f21e00c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:45.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21cc003a50 0x7f21cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 0x7f21cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc005260 0x7f21cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c82c0 con 0x7f21cc004850 2023-08-27T11:29:45.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc00c1b0 con 0x7f21cc003a50 2023-08-27T11:29:45.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc00c370 con 0x7f21cc005260 2023-08-27T11:29:45.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.963+0000 7f21e599a700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 0x7f21cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e619b700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21cc003a50 0x7f21cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e699c700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc005260 0x7f21cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 -- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc005260 msgr2=0x7f21cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:45.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc005260 0x7f21cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 -- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21cc003a50 msgr2=0x7f21cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:45.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21cc003a50 0x7f21cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 -- 172.21.15.43:0/2361557494 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc0035b0 con 0x7f21cc004850 2023-08-27T11:29:45.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e699c700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc005260 0x7f21cc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:45.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e699c700 1 -- 172.21.15.43:0/2361557494 reap_dead start 2023-08-27T11:29:45.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e599a700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 0x7f21cc004cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009b30 tx=0x7f21cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7b67d021cf88e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:45.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000e6c0 con 0x7f21cc004850 2023-08-27T11:29:45.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d000e820 con 0x7f21cc004850 2023-08-27T11:29:45.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.964+0000 7f21e5199700 1 -- 172.21.15.43:0/2361557494 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d000ebb0 con 0x7f21cc004850 2023-08-27T11:29:45.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 -- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 msgr2=0x7f21cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:45.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 0x7f21cc004cd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009b30 tx=0x7f21cc005880 comp rx=0 tx=0).stop 2023-08-27T11:29:45.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 -- 172.21.15.43:0/2361557494 shutdown_connections 2023-08-27T11:29:45.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 --2- 172.21.15.43:0/2361557494 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21cc004850 0x7f21cc004cd0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 -- 172.21.15.43:0/2361557494 >> 172.21.15.43:0/2361557494 conn(0x7f21e00ab820 msgr2=0x7f21e00abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:45.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 -- 172.21.15.43:0/2361557494 shutdown_connections 2023-08-27T11:29:45.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.965+0000 7f21e83ff700 1 -- 172.21.15.43:0/2361557494 wait complete. 2023-08-27T11:29:45.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.967+0000 7f21e83ff700 1 Processor -- start 2023-08-27T11:29:45.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.967+0000 7f21e83ff700 1 -- start start 2023-08-27T11:29:45.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 0x7f21e014dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 0x7f21e01ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0146fb0 con 0x7f21e00aa790 2023-08-27T11:29:45.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e01ed4a0 con 0x7f21e01522f0 2023-08-27T11:29:45.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e83ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0146cd0 con 0x7f21cc004850 2023-08-27T11:29:45.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e699c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36044/0 (socket says 172.21.15.43:36044) 2023-08-27T11:29:45.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.968+0000 7f21e699c700 1 -- 172.21.15.43:0/3156980664 learned_addr learned my addr 172.21.15.43:0/3156980664 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:45.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e619b700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 0x7f21e014dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e599a700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 0x7f21e01ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 -- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 msgr2=0x7f21e014dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:45.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 0x7f21e014dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 -- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 msgr2=0x7f21e01ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:45.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 0x7f21e01ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:45.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 -- 172.21.15.43:0/3156980664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e01ed0c0 con 0x7f21e00aa790 2023-08-27T11:29:45.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e619b700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 0x7f21e014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:45.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e599a700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 0x7f21e01ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:45.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e699c700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f21e00bd730 tx=0x7f21d800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:45.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8003c10 con 0x7f21e00aa790 2023-08-27T11:29:45.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d8003d70 con 0x7f21e00aa790 2023-08-27T11:29:45.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e01ede00 con 0x7f21e00aa790 2023-08-27T11:29:45.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8005310 con 0x7f21e00aa790 2023-08-27T11:29:45.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.969+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e0152de0 con 0x7f21e00aa790 2023-08-27T11:29:45.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.970+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e01ecf20 con 0x7f21e00aa790 2023-08-27T11:29:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.971+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f21d8005470 con 0x7f21e00aa790 2023-08-27T11:29:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.973+0000 7f21d6ffd700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 0x7f21c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.973+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21d8088450 con 0x7f21e00aa790 2023-08-27T11:29:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.973+0000 7f21e619b700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 0x7f21c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:45.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.973+0000 7f21e619b700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 0x7f21c406c5a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f21dc007cf0 tx=0x7f21dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:45.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:45.977+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f21e01ecf20 con 0x7f21e00aa790 2023-08-27T11:29:46.182 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.181+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 --> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21e0154760 con 0x7f21c406a0e0 2023-08-27T11:29:46.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.192+0000 7f21d6ffd700 1 -- 172.21.15.43:0/3156980664 <== mgr.4107 v2:172.21.15.43:6832/2364062298 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311928 (secure 0 0 0) 0x7f21dc001620 con 0x7f21c406a0e0 2023-08-27T11:29:46.197 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:46.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.196+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 msgr2=0x7f21c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.196+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 0x7f21c406c5a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f21dc007cf0 tx=0x7f21dc009040 comp rx=0 tx=0).stop 2023-08-27T11:29:46.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.196+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 msgr2=0x7f21e00aac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.196+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f21e00bd730 tx=0x7f21d800ee00 comp rx=0 tx=0).stop 2023-08-27T11:29:46.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 shutdown_connections 2023-08-27T11:29:46.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f21c406a0e0 0x7f21c406c5a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f21e00aa790 0x7f21e00aac10 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21cc004850 0x7f21e014dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 --2- 172.21.15.43:0/3156980664 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21e01522f0 0x7f21e01ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 >> 172.21.15.43:0/3156980664 conn(0x7f21e00ab820 msgr2=0x7f21e014b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:46.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 shutdown_connections 2023-08-27T11:29:46.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.197+0000 7f21e83ff700 1 -- 172.21.15.43:0/3156980664 wait complete. 2023-08-27T11:29:46.202 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2023-08-27T11:29:46.216 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2023-08-27T11:29:44.398544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":256496,"kb_used_data":15352,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754718224,"statfs":{"total":773094113280,"available":772831461376,"internally_reserved":0,"allocated":15720448,"data_stored":8071236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.158198"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246003+0000","last_change":"2023-08-27T11:29:36.271036+0000","last_active":"2023-08-27T11:29:37.246003+0000","last_peered":"2023-08-27T11:29:37.246003+0000","last_clean":"2023-08-27T11:29:37.246003+0000","last_became_active":"2023-08-27T11:29:36.270685+0000","last_became_peered":"2023-08-27T11:29:36.270685+0000","last_unstale":"2023-08-27T11:29:37.246003+0000","last_undegraded":"2023-08-27T11:29:37.246003+0000","last_fullsized":"2023-08-27T11:29:37.246003+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:29:58.849873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544950+0000","last_change":"2023-08-27T11:29:36.281273+0000","last_active":"2023-08-27T11:29:37.544950+0000","last_peered":"2023-08-27T11:29:37.544950+0000","last_clean":"2023-08-27T11:29:37.544950+0000","last_became_active":"2023-08-27T11:29:36.280995+0000","last_became_peered":"2023-08-27T11:29:36.280995+0000","last_unstale":"2023-08-27T11:29:37.544950+0000","last_undegraded":"2023-08-27T11:29:37.544950+0000","last_fullsized":"2023-08-27T11:29:37.544950+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:33:47.451397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245938+0000","last_change":"2023-08-27T11:29:36.260703+0000","last_active":"2023-08-27T11:29:37.245938+0000","last_peered":"2023-08-27T11:29:37.245938+0000","last_clean":"2023-08-27T11:29:37.245938+0000","last_became_active":"2023-08-27T11:29:36.260402+0000","last_became_peered":"2023-08-27T11:29:36.260402+0000","last_unstale":"2023-08-27T11:29:37.245938+0000","last_undegraded":"2023-08-27T11:29:37.245938+0000","last_fullsized":"2023-08-27T11:29:37.245938+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:16:11.085496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246094+0000","last_change":"2023-08-27T11:29:36.270027+0000","last_active":"2023-08-27T11:29:37.246094+0000","last_peered":"2023-08-27T11:29:37.246094+0000","last_clean":"2023-08-27T11:29:37.246094+0000","last_became_active":"2023-08-27T11:29:36.269710+0000","last_became_peered":"2023-08-27T11:29:36.269710+0000","last_unstale":"2023-08-27T11:29:37.246094+0000","last_undegraded":"2023-08-27T11:29:37.246094+0000","last_fullsized":"2023-08-27T11:29:37.246094+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:55:49.816897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544422+0000","last_change":"2023-08-27T11:29:36.272543+0000","last_active":"2023-08-27T11:29:37.544422+0000","last_peered":"2023-08-27T11:29:37.544422+0000","last_clean":"2023-08-27T11:29:37.544422+0000","last_became_active":"2023-08-27T11:29:36.272256+0000","last_became_peered":"2023-08-27T11:29:36.272256+0000","last_unstale":"2023-08-27T11:29:37.544422+0000","last_undegraded":"2023-08-27T11:29:37.544422+0000","last_fullsized":"2023-08-27T11:29:37.544422+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:28:31.310669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544322+0000","last_change":"2023-08-27T11:29:36.277115+0000","last_active":"2023-08-27T11:29:37.544322+0000","last_peered":"2023-08-27T11:29:37.544322+0000","last_clean":"2023-08-27T11:29:37.544322+0000","last_became_active":"2023-08-27T11:29:36.276788+0000","last_became_peered":"2023-08-27T11:29:36.276788+0000","last_unstale":"2023-08-27T11:29:37.544322+0000","last_undegraded":"2023-08-27T11:29:37.544322+0000","last_fullsized":"2023-08-27T11:29:37.544322+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:15:06.186621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245050+0000","last_change":"2023-08-27T11:29:36.255721+0000","last_active":"2023-08-27T11:29:37.245050+0000","last_peered":"2023-08-27T11:29:37.245050+0000","last_clean":"2023-08-27T11:29:37.245050+0000","last_became_active":"2023-08-27T11:29:36.255402+0000","last_became_peered":"2023-08-27T11:29:36.255402+0000","last_unstale":"2023-08-27T11:29:37.245050+0000","last_undegraded":"2023-08-27T11:29:37.245050+0000","last_fullsized":"2023-08-27T11:29:37.245050+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:55:18.615835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244878+0000","last_change":"2023-08-27T11:29:36.272088+0000","last_active":"2023-08-27T11:29:37.244878+0000","last_peered":"2023-08-27T11:29:37.244878+0000","last_clean":"2023-08-27T11:29:37.244878+0000","last_became_active":"2023-08-27T11:29:36.271775+0000","last_became_peered":"2023-08-27T11:29:36.271775+0000","last_unstale":"2023-08-27T11:29:37.244878+0000","last_undegraded":"2023-08-27T11:29:37.244878+0000","last_fullsized":"2023-08-27T11:29:37.244878+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:56.048405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245442+0000","last_change":"2023-08-27T11:29:36.278044+0000","last_active":"2023-08-27T11:29:37.245442+0000","last_peered":"2023-08-27T11:29:37.245442+0000","last_clean":"2023-08-27T11:29:37.245442+0000","last_became_active":"2023-08-27T11:29:36.277754+0000","last_became_peered":"2023-08-27T11:29:36.277754+0000","last_unstale":"2023-08-27T11:29:37.245442+0000","last_undegraded":"2023-08-27T11:29:37.245442+0000","last_fullsized":"2023-08-27T11:29:37.245442+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:47:21.227308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245412+0000","last_change":"2023-08-27T11:29:36.272722+0000","last_active":"2023-08-27T11:29:37.245412+0000","last_peered":"2023-08-27T11:29:37.245412+0000","last_clean":"2023-08-27T11:29:37.245412+0000","last_became_active":"2023-08-27T11:29:36.272452+0000","last_became_peered":"2023-08-27T11:29:36.272452+0000","last_unstale":"2023-08-27T11:29:37.245412+0000","last_undegraded":"2023-08-27T11:29:37.245412+0000","last_fullsized":"2023-08-27T11:29:37.245412+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.145821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545674+0000","last_change":"2023-08-27T11:29:36.277273+0000","last_active":"2023-08-27T11:29:37.545674+0000","last_peered":"2023-08-27T11:29:37.545674+0000","last_clean":"2023-08-27T11:29:37.545674+0000","last_became_active":"2023-08-27T11:29:36.276569+0000","last_became_peered":"2023-08-27T11:29:36.276569+0000","last_unstale":"2023-08-27T11:29:37.545674+0000","last_undegraded":"2023-08-27T11:29:37.545674+0000","last_fullsized":"2023-08-27T11:29:37.545674+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:20:54.604957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544742+0000","last_change":"2023-08-27T11:29:36.285173+0000","last_active":"2023-08-27T11:29:37.544742+0000","last_peered":"2023-08-27T11:29:37.544742+0000","last_clean":"2023-08-27T11:29:37.544742+0000","last_became_active":"2023-08-27T11:29:36.284821+0000","last_became_peered":"2023-08-27T11:29:36.284821+0000","last_unstale":"2023-08-27T11:29:37.544742+0000","last_undegraded":"2023-08-27T11:29:37.544742+0000","last_fullsized":"2023-08-27T11:29:37.544742+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:07:23.062356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543936+0000","last_change":"2023-08-27T11:29:36.285618+0000","last_active":"2023-08-27T11:29:37.543936+0000","last_peered":"2023-08-27T11:29:37.543936+0000","last_clean":"2023-08-27T11:29:37.543936+0000","last_became_active":"2023-08-27T11:29:36.285136+0000","last_became_peered":"2023-08-27T11:29:36.285136+0000","last_unstale":"2023-08-27T11:29:37.543936+0000","last_undegraded":"2023-08-27T11:29:37.543936+0000","last_fullsized":"2023-08-27T11:29:37.543936+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:21:49.021333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543935+0000","last_change":"2023-08-27T11:29:36.269247+0000","last_active":"2023-08-27T11:29:37.543935+0000","last_peered":"2023-08-27T11:29:37.543935+0000","last_clean":"2023-08-27T11:29:37.543935+0000","last_became_active":"2023-08-27T11:29:36.268602+0000","last_became_peered":"2023-08-27T11:29:36.268602+0000","last_unstale":"2023-08-27T11:29:37.543935+0000","last_undegraded":"2023-08-27T11:29:37.543935+0000","last_fullsized":"2023-08-27T11:29:37.543935+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:22:52.630824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544652+0000","last_change":"2023-08-27T11:29:36.281090+0000","last_active":"2023-08-27T11:29:37.544652+0000","last_peered":"2023-08-27T11:29:37.544652+0000","last_clean":"2023-08-27T11:29:37.544652+0000","last_became_active":"2023-08-27T11:29:36.280794+0000","last_became_peered":"2023-08-27T11:29:36.280794+0000","last_unstale":"2023-08-27T11:29:37.544652+0000","last_undegraded":"2023-08-27T11:29:37.544652+0000","last_fullsized":"2023-08-27T11:29:37.544652+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:39:09.389050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245714+0000","last_change":"2023-08-27T11:29:36.268611+0000","last_active":"2023-08-27T11:29:37.245714+0000","last_peered":"2023-08-27T11:29:37.245714+0000","last_clean":"2023-08-27T11:29:37.245714+0000","last_became_active":"2023-08-27T11:29:36.268249+0000","last_became_peered":"2023-08-27T11:29:36.268249+0000","last_unstale":"2023-08-27T11:29:37.245714+0000","last_undegraded":"2023-08-27T11:29:37.245714+0000","last_fullsized":"2023-08-27T11:29:37.245714+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:04:58.754334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245296+0000","last_change":"2023-08-27T11:29:36.274706+0000","last_active":"2023-08-27T11:29:37.245296+0000","last_peered":"2023-08-27T11:29:37.245296+0000","last_clean":"2023-08-27T11:29:37.245296+0000","last_became_active":"2023-08-27T11:29:36.274289+0000","last_became_peered":"2023-08-27T11:29:36.274289+0000","last_unstale":"2023-08-27T11:29:37.245296+0000","last_undegraded":"2023-08-27T11:29:37.245296+0000","last_fullsized":"2023-08-27T11:29:37.245296+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:44.322214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244760+0000","last_change":"2023-08-27T11:29:36.257746+0000","last_active":"2023-08-27T11:29:37.244760+0000","last_peered":"2023-08-27T11:29:37.244760+0000","last_clean":"2023-08-27T11:29:37.244760+0000","last_became_active":"2023-08-27T11:29:36.257453+0000","last_became_peered":"2023-08-27T11:29:36.257453+0000","last_unstale":"2023-08-27T11:29:37.244760+0000","last_undegraded":"2023-08-27T11:29:37.244760+0000","last_fullsized":"2023-08-27T11:29:37.244760+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:02:17.018609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545500+0000","last_change":"2023-08-27T11:29:36.277471+0000","last_active":"2023-08-27T11:29:37.545500+0000","last_peered":"2023-08-27T11:29:37.545500+0000","last_clean":"2023-08-27T11:29:37.545500+0000","last_became_active":"2023-08-27T11:29:36.276982+0000","last_became_peered":"2023-08-27T11:29:36.276982+0000","last_unstale":"2023-08-27T11:29:37.545500+0000","last_undegraded":"2023-08-27T11:29:37.545500+0000","last_fullsized":"2023-08-27T11:29:37.545500+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:06:02.673340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544829+0000","last_change":"2023-08-27T11:29:36.267100+0000","last_active":"2023-08-27T11:29:37.544829+0000","last_peered":"2023-08-27T11:29:37.544829+0000","last_clean":"2023-08-27T11:29:37.544829+0000","last_became_active":"2023-08-27T11:29:36.266763+0000","last_became_peered":"2023-08-27T11:29:36.266763+0000","last_unstale":"2023-08-27T11:29:37.544829+0000","last_undegraded":"2023-08-27T11:29:37.544829+0000","last_fullsized":"2023-08-27T11:29:37.544829+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:13.105818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544101+0000","last_change":"2023-08-27T11:29:36.272910+0000","last_active":"2023-08-27T11:29:37.544101+0000","last_peered":"2023-08-27T11:29:37.544101+0000","last_clean":"2023-08-27T11:29:37.544101+0000","last_became_active":"2023-08-27T11:29:36.272642+0000","last_became_peered":"2023-08-27T11:29:36.272642+0000","last_unstale":"2023-08-27T11:29:37.544101+0000","last_undegraded":"2023-08-27T11:29:37.544101+0000","last_fullsized":"2023-08-27T11:29:37.544101+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:45:21.414040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544488+0000","last_change":"2023-08-27T11:29:36.284534+0000","last_active":"2023-08-27T11:29:37.544488+0000","last_peered":"2023-08-27T11:29:37.544488+0000","last_clean":"2023-08-27T11:29:37.544488+0000","last_became_active":"2023-08-27T11:29:36.284251+0000","last_became_peered":"2023-08-27T11:29:36.284251+0000","last_unstale":"2023-08-27T11:29:37.544488+0000","last_undegraded":"2023-08-27T11:29:37.544488+0000","last_fullsized":"2023-08-27T11:29:37.544488+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:31:40.975596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544213+0000","last_change":"2023-08-27T11:29:36.270840+0000","last_active":"2023-08-27T11:29:37.544213+0000","last_peered":"2023-08-27T11:29:37.544213+0000","last_clean":"2023-08-27T11:29:37.544213+0000","last_became_active":"2023-08-27T11:29:36.270536+0000","last_became_peered":"2023-08-27T11:29:36.270536+0000","last_unstale":"2023-08-27T11:29:37.544213+0000","last_undegraded":"2023-08-27T11:29:37.544213+0000","last_fullsized":"2023-08-27T11:29:37.544213+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:26:39.956738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245782+0000","last_change":"2023-08-27T11:29:36.260778+0000","last_active":"2023-08-27T11:29:37.245782+0000","last_peered":"2023-08-27T11:29:37.245782+0000","last_clean":"2023-08-27T11:29:37.245782+0000","last_became_active":"2023-08-27T11:29:36.260449+0000","last_became_peered":"2023-08-27T11:29:36.260449+0000","last_unstale":"2023-08-27T11:29:37.245782+0000","last_undegraded":"2023-08-27T11:29:37.245782+0000","last_fullsized":"2023-08-27T11:29:37.245782+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:24:11.318193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544736+0000","last_change":"2023-08-27T11:29:36.275389+0000","last_active":"2023-08-27T11:29:37.544736+0000","last_peered":"2023-08-27T11:29:37.544736+0000","last_clean":"2023-08-27T11:29:37.544736+0000","last_became_active":"2023-08-27T11:29:36.274781+0000","last_became_peered":"2023-08-27T11:29:36.274781+0000","last_unstale":"2023-08-27T11:29:37.544736+0000","last_undegraded":"2023-08-27T11:29:37.544736+0000","last_fullsized":"2023-08-27T11:29:37.544736+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:29:23.044627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545114+0000","last_change":"2023-08-27T11:29:36.271931+0000","last_active":"2023-08-27T11:29:37.545114+0000","last_peered":"2023-08-27T11:29:37.545114+0000","last_clean":"2023-08-27T11:29:37.545114+0000","last_became_active":"2023-08-27T11:29:36.271657+0000","last_became_peered":"2023-08-27T11:29:36.271657+0000","last_unstale":"2023-08-27T11:29:37.545114+0000","last_undegraded":"2023-08-27T11:29:37.545114+0000","last_fullsized":"2023-08-27T11:29:37.545114+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:52:44.639540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544828+0000","last_change":"2023-08-27T11:29:36.285122+0000","last_active":"2023-08-27T11:29:37.544828+0000","last_peered":"2023-08-27T11:29:37.544828+0000","last_clean":"2023-08-27T11:29:37.544828+0000","last_became_active":"2023-08-27T11:29:36.284807+0000","last_became_peered":"2023-08-27T11:29:36.284807+0000","last_unstale":"2023-08-27T11:29:37.544828+0000","last_undegraded":"2023-08-27T11:29:37.544828+0000","last_fullsized":"2023-08-27T11:29:37.544828+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:35:23.536618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544333+0000","last_change":"2023-08-27T11:29:36.273988+0000","last_active":"2023-08-27T11:29:37.544333+0000","last_peered":"2023-08-27T11:29:37.544333+0000","last_clean":"2023-08-27T11:29:37.544333+0000","last_became_active":"2023-08-27T11:29:36.272630+0000","last_became_peered":"2023-08-27T11:29:36.272630+0000","last_unstale":"2023-08-27T11:29:37.544333+0000","last_undegraded":"2023-08-27T11:29:37.544333+0000","last_fullsized":"2023-08-27T11:29:37.544333+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:53:25.873275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544507+0000","last_change":"2023-08-27T11:29:36.279435+0000","last_active":"2023-08-27T11:29:37.544507+0000","last_peered":"2023-08-27T11:29:37.544507+0000","last_clean":"2023-08-27T11:29:37.544507+0000","last_became_active":"2023-08-27T11:29:36.279142+0000","last_became_peered":"2023-08-27T11:29:36.279142+0000","last_unstale":"2023-08-27T11:29:37.544507+0000","last_undegraded":"2023-08-27T11:29:37.544507+0000","last_fullsized":"2023-08-27T11:29:37.544507+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:34:12.240728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244705+0000","last_change":"2023-08-27T11:29:36.268446+0000","last_active":"2023-08-27T11:29:37.244705+0000","last_peered":"2023-08-27T11:29:37.244705+0000","last_clean":"2023-08-27T11:29:37.244705+0000","last_became_active":"2023-08-27T11:29:36.268127+0000","last_became_peered":"2023-08-27T11:29:36.268127+0000","last_unstale":"2023-08-27T11:29:37.244705+0000","last_undegraded":"2023-08-27T11:29:37.244705+0000","last_fullsized":"2023-08-27T11:29:37.244705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:03:28.145821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544810+0000","last_change":"2023-08-27T11:29:36.274117+0000","last_active":"2023-08-27T11:29:37.544810+0000","last_peered":"2023-08-27T11:29:37.544810+0000","last_clean":"2023-08-27T11:29:37.544810+0000","last_became_active":"2023-08-27T11:29:36.273624+0000","last_became_peered":"2023-08-27T11:29:36.273624+0000","last_unstale":"2023-08-27T11:29:37.544810+0000","last_undegraded":"2023-08-27T11:29:37.544810+0000","last_fullsized":"2023-08-27T11:29:37.544810+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:45:42.889869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244196+0000","last_change":"2023-08-27T11:29:36.286136+0000","last_active":"2023-08-27T11:29:37.244196+0000","last_peered":"2023-08-27T11:29:37.244196+0000","last_clean":"2023-08-27T11:29:37.244196+0000","last_became_active":"2023-08-27T11:29:36.285845+0000","last_became_peered":"2023-08-27T11:29:36.285845+0000","last_unstale":"2023-08-27T11:29:37.244196+0000","last_undegraded":"2023-08-27T11:29:37.244196+0000","last_fullsized":"2023-08-27T11:29:37.244196+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:06:58.783253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544260+0000","last_change":"2023-08-27T11:29:36.282967+0000","last_active":"2023-08-27T11:29:37.544260+0000","last_peered":"2023-08-27T11:29:37.544260+0000","last_clean":"2023-08-27T11:29:37.544260+0000","last_became_active":"2023-08-27T11:29:36.282712+0000","last_became_peered":"2023-08-27T11:29:36.282712+0000","last_unstale":"2023-08-27T11:29:37.544260+0000","last_undegraded":"2023-08-27T11:29:37.544260+0000","last_fullsized":"2023-08-27T11:29:37.544260+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:30:51.922965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"143'4","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246552+0000","last_change":"2023-08-27T11:29:35.262477+0000","last_active":"2023-08-27T11:29:37.246552+0000","last_peered":"2023-08-27T11:29:37.246552+0000","last_clean":"2023-08-27T11:29:37.246552+0000","last_became_active":"2023-08-27T11:29:35.262122+0000","last_became_peered":"2023-08-27T11:29:35.262122+0000","last_unstale":"2023-08-27T11:29:37.246552+0000","last_undegraded":"2023-08-27T11:29:37.246552+0000","last_fullsized":"2023-08-27T11:29:37.246552+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:33:14.721794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543682+0000","last_change":"2023-08-27T11:29:36.254123+0000","last_active":"2023-08-27T11:29:37.543682+0000","last_peered":"2023-08-27T11:29:37.543682+0000","last_clean":"2023-08-27T11:29:37.543682+0000","last_became_active":"2023-08-27T11:29:36.253801+0000","last_became_peered":"2023-08-27T11:29:36.253801+0000","last_unstale":"2023-08-27T11:29:37.543682+0000","last_undegraded":"2023-08-27T11:29:37.543682+0000","last_fullsized":"2023-08-27T11:29:37.543682+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:50:03.444967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544902+0000","last_change":"2023-08-27T11:29:35.261806+0000","last_active":"2023-08-27T11:29:37.544902+0000","last_peered":"2023-08-27T11:29:37.544902+0000","last_clean":"2023-08-27T11:29:37.544902+0000","last_became_active":"2023-08-27T11:29:35.261521+0000","last_became_peered":"2023-08-27T11:29:35.261521+0000","last_unstale":"2023-08-27T11:29:37.544902+0000","last_undegraded":"2023-08-27T11:29:37.544902+0000","last_fullsized":"2023-08-27T11:29:37.544902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:54:45.905680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544095+0000","last_change":"2023-08-27T11:29:36.268952+0000","last_active":"2023-08-27T11:29:37.544095+0000","last_peered":"2023-08-27T11:29:37.544095+0000","last_clean":"2023-08-27T11:29:37.544095+0000","last_became_active":"2023-08-27T11:29:36.268239+0000","last_became_peered":"2023-08-27T11:29:36.268239+0000","last_unstale":"2023-08-27T11:29:37.544095+0000","last_undegraded":"2023-08-27T11:29:37.544095+0000","last_fullsized":"2023-08-27T11:29:37.544095+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:08:33.645023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545667+0000","last_change":"2023-08-27T11:29:35.270214+0000","last_active":"2023-08-27T11:29:37.545667+0000","last_peered":"2023-08-27T11:29:37.545667+0000","last_clean":"2023-08-27T11:29:37.545667+0000","last_became_active":"2023-08-27T11:29:35.269755+0000","last_became_peered":"2023-08-27T11:29:35.269755+0000","last_unstale":"2023-08-27T11:29:37.545667+0000","last_undegraded":"2023-08-27T11:29:37.545667+0000","last_fullsized":"2023-08-27T11:29:37.545667+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:04:57.740342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544566+0000","last_change":"2023-08-27T11:29:36.282763+0000","last_active":"2023-08-27T11:29:37.544566+0000","last_peered":"2023-08-27T11:29:37.544566+0000","last_clean":"2023-08-27T11:29:37.544566+0000","last_became_active":"2023-08-27T11:29:36.282463+0000","last_became_peered":"2023-08-27T11:29:36.282463+0000","last_unstale":"2023-08-27T11:29:37.544566+0000","last_undegraded":"2023-08-27T11:29:37.544566+0000","last_fullsized":"2023-08-27T11:29:37.544566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:21:42.702305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544960+0000","last_change":"2023-08-27T11:29:35.262484+0000","last_active":"2023-08-27T11:29:37.544960+0000","last_peered":"2023-08-27T11:29:37.544960+0000","last_clean":"2023-08-27T11:29:37.544960+0000","last_became_active":"2023-08-27T11:29:35.262188+0000","last_became_peered":"2023-08-27T11:29:35.262188+0000","last_unstale":"2023-08-27T11:29:37.544960+0000","last_undegraded":"2023-08-27T11:29:37.544960+0000","last_fullsized":"2023-08-27T11:29:37.544960+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:59:08.647038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245271+0000","last_change":"2023-08-27T11:29:36.271908+0000","last_active":"2023-08-27T11:29:37.245271+0000","last_peered":"2023-08-27T11:29:37.245271+0000","last_clean":"2023-08-27T11:29:37.245271+0000","last_became_active":"2023-08-27T11:29:36.271609+0000","last_became_peered":"2023-08-27T11:29:36.271609+0000","last_unstale":"2023-08-27T11:29:37.245271+0000","last_undegraded":"2023-08-27T11:29:37.245271+0000","last_fullsized":"2023-08-27T11:29:37.245271+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T23:08:09.058899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245049+0000","last_change":"2023-08-27T11:29:35.265293+0000","last_active":"2023-08-27T11:29:37.245049+0000","last_peered":"2023-08-27T11:29:37.245049+0000","last_clean":"2023-08-27T11:29:37.245049+0000","last_became_active":"2023-08-27T11:29:35.265025+0000","last_became_peered":"2023-08-27T11:29:35.265025+0000","last_unstale":"2023-08-27T11:29:37.245049+0000","last_undegraded":"2023-08-27T11:29:37.245049+0000","last_fullsized":"2023-08-27T11:29:37.245049+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:57:02.763330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545108+0000","last_change":"2023-08-27T11:29:36.249395+0000","last_active":"2023-08-27T11:29:37.545108+0000","last_peered":"2023-08-27T11:29:37.545108+0000","last_clean":"2023-08-27T11:29:37.545108+0000","last_became_active":"2023-08-27T11:29:36.249028+0000","last_became_peered":"2023-08-27T11:29:36.249028+0000","last_unstale":"2023-08-27T11:29:37.545108+0000","last_undegraded":"2023-08-27T11:29:37.545108+0000","last_fullsized":"2023-08-27T11:29:37.545108+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:14:20.363739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544240+0000","last_change":"2023-08-27T11:29:35.257372+0000","last_active":"2023-08-27T11:29:37.544240+0000","last_peered":"2023-08-27T11:29:37.544240+0000","last_clean":"2023-08-27T11:29:37.544240+0000","last_became_active":"2023-08-27T11:29:35.257071+0000","last_became_peered":"2023-08-27T11:29:35.257071+0000","last_unstale":"2023-08-27T11:29:37.544240+0000","last_undegraded":"2023-08-27T11:29:37.544240+0000","last_fullsized":"2023-08-27T11:29:37.544240+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:06:54.704143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545166+0000","last_change":"2023-08-27T11:29:36.253855+0000","last_active":"2023-08-27T11:29:37.545166+0000","last_peered":"2023-08-27T11:29:37.545166+0000","last_clean":"2023-08-27T11:29:37.545166+0000","last_became_active":"2023-08-27T11:29:36.253460+0000","last_became_peered":"2023-08-27T11:29:36.253460+0000","last_unstale":"2023-08-27T11:29:37.545166+0000","last_undegraded":"2023-08-27T11:29:37.545166+0000","last_fullsized":"2023-08-27T11:29:37.545166+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:20:43.825512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544658+0000","last_change":"2023-08-27T11:29:35.258285+0000","last_active":"2023-08-27T11:29:37.544658+0000","last_peered":"2023-08-27T11:29:37.544658+0000","last_clean":"2023-08-27T11:29:37.544658+0000","last_became_active":"2023-08-27T11:29:35.257980+0000","last_became_peered":"2023-08-27T11:29:35.257980+0000","last_unstale":"2023-08-27T11:29:37.544658+0000","last_undegraded":"2023-08-27T11:29:37.544658+0000","last_fullsized":"2023-08-27T11:29:37.544658+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:37:44.403437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246506+0000","last_change":"2023-08-27T11:29:36.275852+0000","last_active":"2023-08-27T11:29:37.246506+0000","last_peered":"2023-08-27T11:29:37.246506+0000","last_clean":"2023-08-27T11:29:37.246506+0000","last_became_active":"2023-08-27T11:29:36.275560+0000","last_became_peered":"2023-08-27T11:29:36.275560+0000","last_unstale":"2023-08-27T11:29:37.246506+0000","last_undegraded":"2023-08-27T11:29:37.246506+0000","last_fullsized":"2023-08-27T11:29:37.246506+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:40:59.947824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244862+0000","last_change":"2023-08-27T11:29:35.266493+0000","last_active":"2023-08-27T11:29:37.244862+0000","last_peered":"2023-08-27T11:29:37.244862+0000","last_clean":"2023-08-27T11:29:37.244862+0000","last_became_active":"2023-08-27T11:29:35.266215+0000","last_became_peered":"2023-08-27T11:29:35.266215+0000","last_unstale":"2023-08-27T11:29:37.244862+0000","last_undegraded":"2023-08-27T11:29:37.244862+0000","last_fullsized":"2023-08-27T11:29:37.244862+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:54:14.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245043+0000","last_change":"2023-08-27T11:29:36.256017+0000","last_active":"2023-08-27T11:29:37.245043+0000","last_peered":"2023-08-27T11:29:37.245043+0000","last_clean":"2023-08-27T11:29:37.245043+0000","last_became_active":"2023-08-27T11:29:36.255684+0000","last_became_peered":"2023-08-27T11:29:36.255684+0000","last_unstale":"2023-08-27T11:29:37.245043+0000","last_undegraded":"2023-08-27T11:29:37.245043+0000","last_fullsized":"2023-08-27T11:29:37.245043+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:03:18.277121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544869+0000","last_change":"2023-08-27T11:29:35.264052+0000","last_active":"2023-08-27T11:29:37.544869+0000","last_peered":"2023-08-27T11:29:37.544869+0000","last_clean":"2023-08-27T11:29:37.544869+0000","last_became_active":"2023-08-27T11:29:35.263557+0000","last_became_peered":"2023-08-27T11:29:35.263557+0000","last_unstale":"2023-08-27T11:29:37.544869+0000","last_undegraded":"2023-08-27T11:29:37.544869+0000","last_fullsized":"2023-08-27T11:29:37.544869+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:59:29.209210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244380+0000","last_change":"2023-08-27T11:29:36.275748+0000","last_active":"2023-08-27T11:29:37.244380+0000","last_peered":"2023-08-27T11:29:37.244380+0000","last_clean":"2023-08-27T11:29:37.244380+0000","last_became_active":"2023-08-27T11:29:36.275141+0000","last_became_peered":"2023-08-27T11:29:36.275141+0000","last_unstale":"2023-08-27T11:29:37.244380+0000","last_undegraded":"2023-08-27T11:29:37.244380+0000","last_fullsized":"2023-08-27T11:29:37.244380+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:28:44.322214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245220+0000","last_change":"2023-08-27T11:29:35.258078+0000","last_active":"2023-08-27T11:29:37.245220+0000","last_peered":"2023-08-27T11:29:37.245220+0000","last_clean":"2023-08-27T11:29:37.245220+0000","last_became_active":"2023-08-27T11:29:35.257736+0000","last_became_peered":"2023-08-27T11:29:35.257736+0000","last_unstale":"2023-08-27T11:29:37.245220+0000","last_undegraded":"2023-08-27T11:29:37.245220+0000","last_fullsized":"2023-08-27T11:29:37.245220+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:21:32.189066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545241+0000","last_change":"2023-08-27T11:29:36.279337+0000","last_active":"2023-08-27T11:29:37.545241+0000","last_peered":"2023-08-27T11:29:37.545241+0000","last_clean":"2023-08-27T11:29:37.545241+0000","last_became_active":"2023-08-27T11:29:36.279039+0000","last_became_peered":"2023-08-27T11:29:36.279039+0000","last_unstale":"2023-08-27T11:29:37.545241+0000","last_undegraded":"2023-08-27T11:29:37.545241+0000","last_fullsized":"2023-08-27T11:29:37.545241+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:02:03.779415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544339+0000","last_change":"2023-08-27T11:29:35.262578+0000","last_active":"2023-08-27T11:29:37.544339+0000","last_peered":"2023-08-27T11:29:37.544339+0000","last_clean":"2023-08-27T11:29:37.544339+0000","last_became_active":"2023-08-27T11:29:35.262279+0000","last_became_peered":"2023-08-27T11:29:35.262279+0000","last_unstale":"2023-08-27T11:29:37.544339+0000","last_undegraded":"2023-08-27T11:29:37.544339+0000","last_fullsized":"2023-08-27T11:29:37.544339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:01:16.896770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545233+0000","last_change":"2023-08-27T11:29:36.276188+0000","last_active":"2023-08-27T11:29:37.545233+0000","last_peered":"2023-08-27T11:29:37.545233+0000","last_clean":"2023-08-27T11:29:37.545233+0000","last_became_active":"2023-08-27T11:29:36.275855+0000","last_became_peered":"2023-08-27T11:29:36.275855+0000","last_unstale":"2023-08-27T11:29:37.545233+0000","last_undegraded":"2023-08-27T11:29:37.545233+0000","last_fullsized":"2023-08-27T11:29:37.545233+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:49:11.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245402+0000","last_change":"2023-08-27T11:29:35.265840+0000","last_active":"2023-08-27T11:29:37.245402+0000","last_peered":"2023-08-27T11:29:37.245402+0000","last_clean":"2023-08-27T11:29:37.245402+0000","last_became_active":"2023-08-27T11:29:35.265577+0000","last_became_peered":"2023-08-27T11:29:35.265577+0000","last_unstale":"2023-08-27T11:29:37.245402+0000","last_undegraded":"2023-08-27T11:29:37.245402+0000","last_fullsized":"2023-08-27T11:29:37.245402+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:38.101644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544126+0000","last_change":"2023-08-27T11:29:36.272988+0000","last_active":"2023-08-27T11:29:37.544126+0000","last_peered":"2023-08-27T11:29:37.544126+0000","last_clean":"2023-08-27T11:29:37.544126+0000","last_became_active":"2023-08-27T11:29:36.272224+0000","last_became_peered":"2023-08-27T11:29:36.272224+0000","last_unstale":"2023-08-27T11:29:37.544126+0000","last_undegraded":"2023-08-27T11:29:37.544126+0000","last_fullsized":"2023-08-27T11:29:37.544126+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:55:21.987293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544662+0000","last_change":"2023-08-27T11:29:35.265779+0000","last_active":"2023-08-27T11:29:37.544662+0000","last_peered":"2023-08-27T11:29:37.544662+0000","last_clean":"2023-08-27T11:29:37.544662+0000","last_became_active":"2023-08-27T11:29:35.265505+0000","last_became_peered":"2023-08-27T11:29:35.265505+0000","last_unstale":"2023-08-27T11:29:37.544662+0000","last_undegraded":"2023-08-27T11:29:37.544662+0000","last_fullsized":"2023-08-27T11:29:37.544662+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:39:17.737585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544187+0000","last_change":"2023-08-27T11:29:36.265305+0000","last_active":"2023-08-27T11:29:37.544187+0000","last_peered":"2023-08-27T11:29:37.544187+0000","last_clean":"2023-08-27T11:29:37.544187+0000","last_became_active":"2023-08-27T11:29:36.264918+0000","last_became_peered":"2023-08-27T11:29:36.264918+0000","last_unstale":"2023-08-27T11:29:37.544187+0000","last_undegraded":"2023-08-27T11:29:37.544187+0000","last_fullsized":"2023-08-27T11:29:37.544187+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:25:45.384846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545202+0000","last_change":"2023-08-27T11:29:35.270172+0000","last_active":"2023-08-27T11:29:37.545202+0000","last_peered":"2023-08-27T11:29:37.545202+0000","last_clean":"2023-08-27T11:29:37.545202+0000","last_became_active":"2023-08-27T11:29:35.269864+0000","last_became_peered":"2023-08-27T11:29:35.269864+0000","last_unstale":"2023-08-27T11:29:37.545202+0000","last_undegraded":"2023-08-27T11:29:37.545202+0000","last_fullsized":"2023-08-27T11:29:37.545202+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:10:12.494489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544773+0000","last_change":"2023-08-27T11:29:36.267513+0000","last_active":"2023-08-27T11:29:37.544773+0000","last_peered":"2023-08-27T11:29:37.544773+0000","last_clean":"2023-08-27T11:29:37.544773+0000","last_became_active":"2023-08-27T11:29:36.267201+0000","last_became_peered":"2023-08-27T11:29:36.267201+0000","last_unstale":"2023-08-27T11:29:37.544773+0000","last_undegraded":"2023-08-27T11:29:37.544773+0000","last_fullsized":"2023-08-27T11:29:37.544773+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:54:35.325213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544794+0000","last_change":"2023-08-27T11:29:35.263997+0000","last_active":"2023-08-27T11:29:37.544794+0000","last_peered":"2023-08-27T11:29:37.544794+0000","last_clean":"2023-08-27T11:29:37.544794+0000","last_became_active":"2023-08-27T11:29:35.263703+0000","last_became_peered":"2023-08-27T11:29:35.263703+0000","last_unstale":"2023-08-27T11:29:37.544794+0000","last_undegraded":"2023-08-27T11:29:37.544794+0000","last_fullsized":"2023-08-27T11:29:37.544794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:38:46.872831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544843+0000","last_change":"2023-08-27T11:29:36.283508+0000","last_active":"2023-08-27T11:29:37.544843+0000","last_peered":"2023-08-27T11:29:37.544843+0000","last_clean":"2023-08-27T11:29:37.544843+0000","last_became_active":"2023-08-27T11:29:36.283214+0000","last_became_peered":"2023-08-27T11:29:36.283214+0000","last_unstale":"2023-08-27T11:29:37.544843+0000","last_undegraded":"2023-08-27T11:29:37.544843+0000","last_fullsized":"2023-08-27T11:29:37.544843+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:00:37.013902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544452+0000","last_change":"2023-08-27T11:29:35.274174+0000","last_active":"2023-08-27T11:29:37.544452+0000","last_peered":"2023-08-27T11:29:37.544452+0000","last_clean":"2023-08-27T11:29:37.544452+0000","last_became_active":"2023-08-27T11:29:35.273836+0000","last_became_peered":"2023-08-27T11:29:35.273836+0000","last_unstale":"2023-08-27T11:29:37.544452+0000","last_undegraded":"2023-08-27T11:29:37.544452+0000","last_fullsized":"2023-08-27T11:29:37.544452+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:19:40.360176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544185+0000","last_change":"2023-08-27T11:29:36.274338+0000","last_active":"2023-08-27T11:29:37.544185+0000","last_peered":"2023-08-27T11:29:37.544185+0000","last_clean":"2023-08-27T11:29:37.544185+0000","last_became_active":"2023-08-27T11:29:36.274056+0000","last_became_peered":"2023-08-27T11:29:36.274056+0000","last_unstale":"2023-08-27T11:29:37.544185+0000","last_undegraded":"2023-08-27T11:29:37.544185+0000","last_fullsized":"2023-08-27T11:29:37.544185+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:49:33.563878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544846+0000","last_change":"2023-08-27T11:29:35.265229+0000","last_active":"2023-08-27T11:29:37.544846+0000","last_peered":"2023-08-27T11:29:37.544846+0000","last_clean":"2023-08-27T11:29:37.544846+0000","last_became_active":"2023-08-27T11:29:35.264883+0000","last_became_peered":"2023-08-27T11:29:35.264883+0000","last_unstale":"2023-08-27T11:29:37.544846+0000","last_undegraded":"2023-08-27T11:29:37.544846+0000","last_fullsized":"2023-08-27T11:29:37.544846+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:36:19.695513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245223+0000","last_change":"2023-08-27T11:29:36.255819+0000","last_active":"2023-08-27T11:29:37.245223+0000","last_peered":"2023-08-27T11:29:37.245223+0000","last_clean":"2023-08-27T11:29:37.245223+0000","last_became_active":"2023-08-27T11:29:36.255499+0000","last_became_peered":"2023-08-27T11:29:36.255499+0000","last_unstale":"2023-08-27T11:29:37.245223+0000","last_undegraded":"2023-08-27T11:29:37.245223+0000","last_fullsized":"2023-08-27T11:29:37.245223+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:10:39.127334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"144'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544545+0000","last_change":"2023-08-27T11:29:35.258902+0000","last_active":"2023-08-27T11:29:37.544545+0000","last_peered":"2023-08-27T11:29:37.544545+0000","last_clean":"2023-08-27T11:29:37.544545+0000","last_became_active":"2023-08-27T11:29:35.258622+0000","last_became_peered":"2023-08-27T11:29:35.258622+0000","last_unstale":"2023-08-27T11:29:37.544545+0000","last_undegraded":"2023-08-27T11:29:37.544545+0000","last_fullsized":"2023-08-27T11:29:37.544545+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T19:26:06.648238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544581+0000","last_change":"2023-08-27T11:29:36.253802+0000","last_active":"2023-08-27T11:29:37.544581+0000","last_peered":"2023-08-27T11:29:37.544581+0000","last_clean":"2023-08-27T11:29:37.544581+0000","last_became_active":"2023-08-27T11:29:36.253472+0000","last_became_peered":"2023-08-27T11:29:36.253472+0000","last_unstale":"2023-08-27T11:29:37.544581+0000","last_undegraded":"2023-08-27T11:29:37.544581+0000","last_fullsized":"2023-08-27T11:29:37.544581+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:10:42.098755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544582+0000","last_change":"2023-08-27T11:29:35.265730+0000","last_active":"2023-08-27T11:29:37.544582+0000","last_peered":"2023-08-27T11:29:37.544582+0000","last_clean":"2023-08-27T11:29:37.544582+0000","last_became_active":"2023-08-27T11:29:35.265470+0000","last_became_peered":"2023-08-27T11:29:35.265470+0000","last_unstale":"2023-08-27T11:29:37.544582+0000","last_undegraded":"2023-08-27T11:29:37.544582+0000","last_fullsized":"2023-08-27T11:29:37.544582+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:49.229163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245182+0000","last_change":"2023-08-27T11:29:36.256338+0000","last_active":"2023-08-27T11:29:37.245182+0000","last_peered":"2023-08-27T11:29:37.245182+0000","last_clean":"2023-08-27T11:29:37.245182+0000","last_became_active":"2023-08-27T11:29:36.255374+0000","last_became_peered":"2023-08-27T11:29:36.255374+0000","last_unstale":"2023-08-27T11:29:37.245182+0000","last_undegraded":"2023-08-27T11:29:37.245182+0000","last_fullsized":"2023-08-27T11:29:37.245182+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:19:19.668623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544986+0000","last_change":"2023-08-27T11:29:35.258653+0000","last_active":"2023-08-27T11:29:37.544986+0000","last_peered":"2023-08-27T11:29:37.544986+0000","last_clean":"2023-08-27T11:29:37.544986+0000","last_became_active":"2023-08-27T11:29:35.258374+0000","last_became_peered":"2023-08-27T11:29:35.258374+0000","last_unstale":"2023-08-27T11:29:37.544986+0000","last_undegraded":"2023-08-27T11:29:37.544986+0000","last_fullsized":"2023-08-27T11:29:37.544986+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:39:59.412904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246213+0000","last_change":"2023-08-27T11:29:36.269389+0000","last_active":"2023-08-27T11:29:37.246213+0000","last_peered":"2023-08-27T11:29:37.246213+0000","last_clean":"2023-08-27T11:29:37.246213+0000","last_became_active":"2023-08-27T11:29:36.269045+0000","last_became_peered":"2023-08-27T11:29:36.269045+0000","last_unstale":"2023-08-27T11:29:37.246213+0000","last_undegraded":"2023-08-27T11:29:37.246213+0000","last_fullsized":"2023-08-27T11:29:37.246213+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:22:14.379442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245991+0000","last_change":"2023-08-27T11:29:35.264235+0000","last_active":"2023-08-27T11:29:37.245991+0000","last_peered":"2023-08-27T11:29:37.245991+0000","last_clean":"2023-08-27T11:29:37.245991+0000","last_became_active":"2023-08-27T11:29:35.263872+0000","last_became_peered":"2023-08-27T11:29:35.263872+0000","last_unstale":"2023-08-27T11:29:37.245991+0000","last_undegraded":"2023-08-27T11:29:37.245991+0000","last_fullsized":"2023-08-27T11:29:37.245991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:30:37.112867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545026+0000","last_change":"2023-08-27T11:29:36.282957+0000","last_active":"2023-08-27T11:29:37.545026+0000","last_peered":"2023-08-27T11:29:37.545026+0000","last_clean":"2023-08-27T11:29:37.545026+0000","last_became_active":"2023-08-27T11:29:36.282640+0000","last_became_peered":"2023-08-27T11:29:36.282640+0000","last_unstale":"2023-08-27T11:29:37.545026+0000","last_undegraded":"2023-08-27T11:29:37.545026+0000","last_fullsized":"2023-08-27T11:29:37.545026+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:46:05.634180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544113+0000","last_change":"2023-08-27T11:29:35.251383+0000","last_active":"2023-08-27T11:29:37.544113+0000","last_peered":"2023-08-27T11:29:37.544113+0000","last_clean":"2023-08-27T11:29:37.544113+0000","last_became_active":"2023-08-27T11:29:35.251115+0000","last_became_peered":"2023-08-27T11:29:35.251115+0000","last_unstale":"2023-08-27T11:29:37.544113+0000","last_undegraded":"2023-08-27T11:29:37.544113+0000","last_fullsized":"2023-08-27T11:29:37.544113+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:23:45.478442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544258+0000","last_change":"2023-08-27T11:29:36.273580+0000","last_active":"2023-08-27T11:29:37.544258+0000","last_peered":"2023-08-27T11:29:37.544258+0000","last_clean":"2023-08-27T11:29:37.544258+0000","last_became_active":"2023-08-27T11:29:36.273311+0000","last_became_peered":"2023-08-27T11:29:36.273311+0000","last_unstale":"2023-08-27T11:29:37.544258+0000","last_undegraded":"2023-08-27T11:29:37.544258+0000","last_fullsized":"2023-08-27T11:29:37.544258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:01:10.046012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545123+0000","last_change":"2023-08-27T11:29:35.270115+0000","last_active":"2023-08-27T11:29:37.545123+0000","last_peered":"2023-08-27T11:29:37.545123+0000","last_clean":"2023-08-27T11:29:37.545123+0000","last_became_active":"2023-08-27T11:29:35.269746+0000","last_became_peered":"2023-08-27T11:29:35.269746+0000","last_unstale":"2023-08-27T11:29:37.545123+0000","last_undegraded":"2023-08-27T11:29:37.545123+0000","last_fullsized":"2023-08-27T11:29:37.545123+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:08:45.364274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545323+0000","last_change":"2023-08-27T11:29:36.267604+0000","last_active":"2023-08-27T11:29:37.545323+0000","last_peered":"2023-08-27T11:29:37.545323+0000","last_clean":"2023-08-27T11:29:37.545323+0000","last_became_active":"2023-08-27T11:29:36.267275+0000","last_became_peered":"2023-08-27T11:29:36.267275+0000","last_unstale":"2023-08-27T11:29:37.545323+0000","last_undegraded":"2023-08-27T11:29:37.545323+0000","last_fullsized":"2023-08-27T11:29:37.545323+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:18:13.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543774+0000","last_change":"2023-08-27T11:29:35.265870+0000","last_active":"2023-08-27T11:29:37.543774+0000","last_peered":"2023-08-27T11:29:37.543774+0000","last_clean":"2023-08-27T11:29:37.543774+0000","last_became_active":"2023-08-27T11:29:35.265559+0000","last_became_peered":"2023-08-27T11:29:35.265559+0000","last_unstale":"2023-08-27T11:29:37.543774+0000","last_undegraded":"2023-08-27T11:29:37.543774+0000","last_fullsized":"2023-08-27T11:29:37.543774+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T18:31:31.641297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545663+0000","last_change":"2023-08-27T11:29:36.281395+0000","last_active":"2023-08-27T11:29:37.545663+0000","last_peered":"2023-08-27T11:29:37.545663+0000","last_clean":"2023-08-27T11:29:37.545663+0000","last_became_active":"2023-08-27T11:29:36.281110+0000","last_became_peered":"2023-08-27T11:29:36.281110+0000","last_unstale":"2023-08-27T11:29:37.545663+0000","last_undegraded":"2023-08-27T11:29:37.545663+0000","last_fullsized":"2023-08-27T11:29:37.545663+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T11:59:08.506498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545086+0000","last_change":"2023-08-27T11:29:35.270153+0000","last_active":"2023-08-27T11:29:37.545086+0000","last_peered":"2023-08-27T11:29:37.545086+0000","last_clean":"2023-08-27T11:29:37.545086+0000","last_became_active":"2023-08-27T11:29:35.269729+0000","last_became_peered":"2023-08-27T11:29:35.269729+0000","last_unstale":"2023-08-27T11:29:37.545086+0000","last_undegraded":"2023-08-27T11:29:37.545086+0000","last_fullsized":"2023-08-27T11:29:37.545086+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:07:54.078543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":244,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244738+0000","last_change":"2023-08-27T11:22:36.922013+0000","last_active":"2023-08-27T11:29:37.244738+0000","last_peered":"2023-08-27T11:29:37.244738+0000","last_clean":"2023-08-27T11:29:37.244738+0000","last_became_active":"2023-08-27T11:22:36.921710+0000","last_became_peered":"2023-08-27T11:22:36.921710+0000","last_unstale":"2023-08-27T11:29:37.244738+0000","last_undegraded":"2023-08-27T11:29:37.244738+0000","last_fullsized":"2023-08-27T11:29:37.244738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:40:21.904397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545252+0000","last_change":"2023-08-27T11:29:36.273951+0000","last_active":"2023-08-27T11:29:37.545252+0000","last_peered":"2023-08-27T11:29:37.545252+0000","last_clean":"2023-08-27T11:29:37.545252+0000","last_became_active":"2023-08-27T11:29:36.273633+0000","last_became_peered":"2023-08-27T11:29:36.273633+0000","last_unstale":"2023-08-27T11:29:37.545252+0000","last_undegraded":"2023-08-27T11:29:37.545252+0000","last_fullsized":"2023-08-27T11:29:37.545252+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:00:29.071970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"143'8","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245048+0000","last_change":"2023-08-27T11:29:35.264586+0000","last_active":"2023-08-27T11:29:37.245048+0000","last_peered":"2023-08-27T11:29:37.245048+0000","last_clean":"2023-08-27T11:29:37.245048+0000","last_became_active":"2023-08-27T11:29:35.264251+0000","last_became_peered":"2023-08-27T11:29:35.264251+0000","last_unstale":"2023-08-27T11:29:37.245048+0000","last_undegraded":"2023-08-27T11:29:37.245048+0000","last_fullsized":"2023-08-27T11:29:37.245048+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:09:16.544974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":244,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244905+0000","last_change":"2023-08-27T11:22:36.922286+0000","last_active":"2023-08-27T11:29:37.244905+0000","last_peered":"2023-08-27T11:29:37.244905+0000","last_clean":"2023-08-27T11:29:37.244905+0000","last_became_active":"2023-08-27T11:22:36.921910+0000","last_became_peered":"2023-08-27T11:22:36.921910+0000","last_unstale":"2023-08-27T11:29:37.244905+0000","last_undegraded":"2023-08-27T11:29:37.244905+0000","last_fullsized":"2023-08-27T11:29:37.244905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:55:23.187739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544183+0000","last_change":"2023-08-27T11:29:36.283395+0000","last_active":"2023-08-27T11:29:37.544183+0000","last_peered":"2023-08-27T11:29:37.544183+0000","last_clean":"2023-08-27T11:29:37.544183+0000","last_became_active":"2023-08-27T11:29:36.283095+0000","last_became_peered":"2023-08-27T11:29:36.283095+0000","last_unstale":"2023-08-27T11:29:37.544183+0000","last_undegraded":"2023-08-27T11:29:37.544183+0000","last_fullsized":"2023-08-27T11:29:37.544183+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:14:27.733150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544816+0000","last_change":"2023-08-27T11:29:35.259916+0000","last_active":"2023-08-27T11:29:37.544816+0000","last_peered":"2023-08-27T11:29:37.544816+0000","last_clean":"2023-08-27T11:29:37.544816+0000","last_became_active":"2023-08-27T11:29:35.259653+0000","last_became_peered":"2023-08-27T11:29:35.259653+0000","last_unstale":"2023-08-27T11:29:37.544816+0000","last_undegraded":"2023-08-27T11:29:37.544816+0000","last_fullsized":"2023-08-27T11:29:37.544816+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:15:46.917630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":256,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.545237+0000","last_change":"2023-08-27T11:22:36.924693+0000","last_active":"2023-08-27T11:29:37.545237+0000","last_peered":"2023-08-27T11:29:37.545237+0000","last_clean":"2023-08-27T11:29:37.545237+0000","last_became_active":"2023-08-27T11:22:36.924338+0000","last_became_peered":"2023-08-27T11:22:36.924338+0000","last_unstale":"2023-08-27T11:29:37.545237+0000","last_undegraded":"2023-08-27T11:29:37.545237+0000","last_fullsized":"2023-08-27T11:29:37.545237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:02:53.195257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544230+0000","last_change":"2023-08-27T11:29:36.277995+0000","last_active":"2023-08-27T11:29:37.544230+0000","last_peered":"2023-08-27T11:29:37.544230+0000","last_clean":"2023-08-27T11:29:37.544230+0000","last_became_active":"2023-08-27T11:29:36.277710+0000","last_became_peered":"2023-08-27T11:29:36.277710+0000","last_unstale":"2023-08-27T11:29:37.544230+0000","last_undegraded":"2023-08-27T11:29:37.544230+0000","last_fullsized":"2023-08-27T11:29:37.544230+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:24:50.489378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544386+0000","last_change":"2023-08-27T11:29:35.258960+0000","last_active":"2023-08-27T11:29:37.544386+0000","last_peered":"2023-08-27T11:29:37.544386+0000","last_clean":"2023-08-27T11:29:37.544386+0000","last_became_active":"2023-08-27T11:29:35.258657+0000","last_became_peered":"2023-08-27T11:29:35.258657+0000","last_unstale":"2023-08-27T11:29:37.544386+0000","last_undegraded":"2023-08-27T11:29:37.544386+0000","last_fullsized":"2023-08-27T11:29:37.544386+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T21:35:01.948187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544640+0000","last_change":"2023-08-27T11:22:36.925764+0000","last_active":"2023-08-27T11:29:37.544640+0000","last_peered":"2023-08-27T11:29:37.544640+0000","last_clean":"2023-08-27T11:29:37.544640+0000","last_became_active":"2023-08-27T11:22:36.925401+0000","last_became_peered":"2023-08-27T11:22:36.925401+0000","last_unstale":"2023-08-27T11:29:37.544640+0000","last_undegraded":"2023-08-27T11:29:37.544640+0000","last_fullsized":"2023-08-27T11:29:37.544640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:26:48.725373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544829+0000","last_change":"2023-08-27T11:29:36.267154+0000","last_active":"2023-08-27T11:29:37.544829+0000","last_peered":"2023-08-27T11:29:37.544829+0000","last_clean":"2023-08-27T11:29:37.544829+0000","last_became_active":"2023-08-27T11:29:36.266871+0000","last_became_peered":"2023-08-27T11:29:36.266871+0000","last_unstale":"2023-08-27T11:29:37.544829+0000","last_undegraded":"2023-08-27T11:29:37.544829+0000","last_fullsized":"2023-08-27T11:29:37.544829+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T20:07:50.936583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"143'6","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544270+0000","last_change":"2023-08-27T11:29:35.259131+0000","last_active":"2023-08-27T11:29:37.544270+0000","last_peered":"2023-08-27T11:29:37.544270+0000","last_clean":"2023-08-27T11:29:37.544270+0000","last_became_active":"2023-08-27T11:29:35.258823+0000","last_became_peered":"2023-08-27T11:29:35.258823+0000","last_unstale":"2023-08-27T11:29:37.544270+0000","last_undegraded":"2023-08-27T11:29:37.544270+0000","last_fullsized":"2023-08-27T11:29:37.544270+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:59:30.929146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544472+0000","last_change":"2023-08-27T11:22:36.927629+0000","last_active":"2023-08-27T11:29:37.544472+0000","last_peered":"2023-08-27T11:29:37.544472+0000","last_clean":"2023-08-27T11:29:37.544472+0000","last_became_active":"2023-08-27T11:22:36.927189+0000","last_became_peered":"2023-08-27T11:22:36.927189+0000","last_unstale":"2023-08-27T11:29:37.544472+0000","last_undegraded":"2023-08-27T11:29:37.544472+0000","last_fullsized":"2023-08-27T11:29:37.544472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T16:25:21.645597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.543992+0000","last_change":"2023-08-27T11:29:36.256097+0000","last_active":"2023-08-27T11:29:37.543992+0000","last_peered":"2023-08-27T11:29:37.543992+0000","last_clean":"2023-08-27T11:29:37.543992+0000","last_became_active":"2023-08-27T11:29:36.255773+0000","last_became_peered":"2023-08-27T11:29:36.255773+0000","last_unstale":"2023-08-27T11:29:37.543992+0000","last_undegraded":"2023-08-27T11:29:37.543992+0000","last_fullsized":"2023-08-27T11:29:37.543992+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:16:28.721456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"143'3","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246062+0000","last_change":"2023-08-27T11:29:35.270703+0000","last_active":"2023-08-27T11:29:37.246062+0000","last_peered":"2023-08-27T11:29:37.246062+0000","last_clean":"2023-08-27T11:29:37.246062+0000","last_became_active":"2023-08-27T11:29:35.270171+0000","last_became_peered":"2023-08-27T11:29:35.270171+0000","last_unstale":"2023-08-27T11:29:37.246062+0000","last_undegraded":"2023-08-27T11:29:37.246062+0000","last_fullsized":"2023-08-27T11:29:37.246062+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T22:30:55.784051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":378,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544516+0000","last_change":"2023-08-27T11:22:37.924275+0000","last_active":"2023-08-27T11:29:37.544516+0000","last_peered":"2023-08-27T11:29:37.544516+0000","last_clean":"2023-08-27T11:29:37.544516+0000","last_became_active":"2023-08-27T11:22:37.923085+0000","last_became_peered":"2023-08-27T11:22:37.923085+0000","last_unstale":"2023-08-27T11:29:37.544516+0000","last_undegraded":"2023-08-27T11:29:37.544516+0000","last_fullsized":"2023-08-27T11:29:37.544516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:36.910085+0000","last_clean_scrub_stamp":"2023-08-27T11:22:36.910085+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T12:45:43.449867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":240,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245354+0000","last_change":"2023-08-27T11:22:36.927914+0000","last_active":"2023-08-27T11:29:37.245354+0000","last_peered":"2023-08-27T11:29:37.245354+0000","last_clean":"2023-08-27T11:29:37.245354+0000","last_became_active":"2023-08-27T11:22:36.927545+0000","last_became_peered":"2023-08-27T11:22:36.927545+0000","last_unstale":"2023-08-27T11:29:37.245354+0000","last_undegraded":"2023-08-27T11:29:37.245354+0000","last_fullsized":"2023-08-27T11:29:37.245354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:59:59.460342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.245315+0000","last_change":"2023-08-27T11:29:36.267365+0000","last_active":"2023-08-27T11:29:37.245315+0000","last_peered":"2023-08-27T11:29:37.245315+0000","last_clean":"2023-08-27T11:29:37.245315+0000","last_became_active":"2023-08-27T11:29:36.267023+0000","last_became_peered":"2023-08-27T11:29:36.267023+0000","last_unstale":"2023-08-27T11:29:37.245315+0000","last_undegraded":"2023-08-27T11:29:37.245315+0000","last_fullsized":"2023-08-27T11:29:37.245315+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:08:28.495492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544100+0000","last_change":"2023-08-27T11:29:35.262815+0000","last_active":"2023-08-27T11:29:37.544100+0000","last_peered":"2023-08-27T11:29:37.544100+0000","last_clean":"2023-08-27T11:29:37.544100+0000","last_became_active":"2023-08-27T11:29:35.262500+0000","last_became_peered":"2023-08-27T11:29:35.262500+0000","last_unstale":"2023-08-27T11:29:37.544100+0000","last_undegraded":"2023-08-27T11:29:37.544100+0000","last_fullsized":"2023-08-27T11:29:37.544100+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T15:00:21.836566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544393+0000","last_change":"2023-08-27T11:22:36.926237+0000","last_active":"2023-08-27T11:29:37.544393+0000","last_peered":"2023-08-27T11:29:37.544393+0000","last_clean":"2023-08-27T11:29:37.544393+0000","last_became_active":"2023-08-27T11:22:36.925854+0000","last_became_peered":"2023-08-27T11:22:36.925854+0000","last_unstale":"2023-08-27T11:29:37.544393+0000","last_undegraded":"2023-08-27T11:29:37.544393+0000","last_fullsized":"2023-08-27T11:29:37.544393+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:10:18.617860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.244558+0000","last_change":"2023-08-27T11:29:36.278631+0000","last_active":"2023-08-27T11:29:37.244558+0000","last_peered":"2023-08-27T11:29:37.244558+0000","last_clean":"2023-08-27T11:29:37.244558+0000","last_became_active":"2023-08-27T11:29:36.278352+0000","last_became_peered":"2023-08-27T11:29:36.278352+0000","last_unstale":"2023-08-27T11:29:37.244558+0000","last_undegraded":"2023-08-27T11:29:37.244558+0000","last_fullsized":"2023-08-27T11:29:37.244558+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:35.229654+0000","last_clean_scrub_stamp":"2023-08-27T11:29:35.229654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T13:27:39.115636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.544601+0000","last_change":"2023-08-27T11:29:35.265167+0000","last_active":"2023-08-27T11:29:37.544601+0000","last_peered":"2023-08-27T11:29:37.544601+0000","last_clean":"2023-08-27T11:29:37.544601+0000","last_became_active":"2023-08-27T11:29:35.264787+0000","last_became_peered":"2023-08-27T11:29:35.264787+0000","last_unstale":"2023-08-27T11:29:37.544601+0000","last_undegraded":"2023-08-27T11:29:37.544601+0000","last_fullsized":"2023-08-27T11:29:37.544601+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:29:34.215663+0000","last_clean_scrub_stamp":"2023-08-27T11:29:34.215663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T17:54:37.027357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":256,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-08-27T11:29:37.246221+0000","last_change":"2023-08-27T11:22:37.314001+0000","last_active":"2023-08-27T11:29:37.246221+0000","last_peered":"2023-08-27T11:29:37.246221+0000","last_clean":"2023-08-27T11:29:37.246221+0000","last_became_active":"2023-08-27T11:22:37.313655+0000","last_became_peered":"2023-08-27T11:22:37.313655+0000","last_unstale":"2023-08-27T11:29:37.246221+0000","last_undegraded":"2023-08-27T11:29:37.246221+0000","last_fullsized":"2023-08-27T11:29:37.246221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-27T11:22:35.906743+0000","last_clean_scrub_stamp":"2023-08-27T11:22:35.906743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-28T14:00:20.015442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574936,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33532,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338308,"statfs":{"total":96636764160,"available":96602427392,"internally_reserved":0,"allocated":2404352,"data_stored":1451571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63600000000000001,"15min":0.59399999999999997},"min":{"1min":0.42499999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.85799999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.41999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.069,"15min":1.069},"last":0.58299999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.51000000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.86899999999999999,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.66200000000000003},"min":{"1min":0.51700000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83299999999999996,"5min":0.878,"15min":0.878},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.44,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88400000000000001,"5min":1.0449999999999999,"15min":1.173},"last":0.623},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.66500000000000004},"min":{"1min":0.49399999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98199999999999998,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.69099999999999995},"min":{"1min":0.53900000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":1.149,"15min":1.149},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.78600000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96899999999999997,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.46899999999999997,"5min":0.45000000000000001,"15min":0.44500000000000001},"max":{"1min":0.88,"5min":1.2649999999999999,"15min":1.2809999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88700000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.41699999999999998},"max":{"1min":1.004,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.53300000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.4139999999999999,"15min":1.7849999999999999},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Aug 27 11:28:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.82399999999999995,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0129999999999999,"5min":1.133,"15min":1.8440000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96799999999999997,"5min":1.2070000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574937,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":1806336,"data_stored":860217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65700000000000003,"15min":0.85799999999999998},"min":{"1min":0.36899999999999999,"5min":0.311,"15min":0.311},"max":{"1min":1.042,"5min":1.042,"15min":8.5419999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90900000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.59799999999999998}]},{"osd":1,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68700000000000006,"15min":0.76500000000000001},"min":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.97999999999999998,"15min":3.472},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.92500000000000004},"min":{"1min":0.45700000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.91400000000000003,"5min":0.98799999999999999,"15min":8.5920000000000005},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66200000000000003,"15min":0.77100000000000002},"min":{"1min":0.504,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88400000000000001,"5min":0.93500000000000005,"15min":4.5039999999999996},"last":0.443},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.82099999999999995},"min":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.96699999999999997,"5min":1.038,"15min":3.6179999999999999},"last":0.751}]},{"osd":3,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72499999999999998,"15min":0.93400000000000005},"min":{"1min":0.55300000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.997,"5min":1.044,"15min":7.4850000000000003},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.83399999999999996},"min":{"1min":0.52100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.94599999999999995,"5min":0.96199999999999997,"15min":4.6550000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.72099999999999997,"15min":0.75},"min":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95099999999999996,"5min":1.1100000000000001,"15min":1.234},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73599999999999999,"15min":0.79300000000000004},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.41299999999999998},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.3480000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":0.84199999999999997,"5min":1.0349999999999999,"15min":1.135},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.80300000000000005,"15min":0.83999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97799999999999998,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80500000000000005,"15min":0.873},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.99399999999999999,"5min":1.111,"15min":1.1759999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.85599999999999998},"min":{"1min":0.58599999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0189999999999999,"5min":1.073,"15min":1.27},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33544,"kb_used_data":2360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338296,"statfs":{"total":96636764160,"available":96602415104,"internally_reserved":0,"allocated":2416640,"data_stored":1453183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.40899999999999997},"min":{"1min":0.27200000000000002,"5min":0.26200000000000001,"15min":0.23999999999999999},"max":{"1min":0.61599999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.495,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.30499999999999999,"15min":0.253},"max":{"1min":0.755,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46800000000000003,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27200000000000002},"max":{"1min":0.64900000000000002,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.33500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69399999999999995,"5min":2.734,"15min":2.734},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78400000000000003,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.52100000000000002},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.879,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.747,"15min":0.76500000000000001},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.435},"max":{"1min":1.0760000000000001,"5min":3.101,"15min":3.101},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77500000000000002,"15min":0.80200000000000005},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95399999999999996,"5min":3.359,"15min":3.359},"last":1.105}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.749,"15min":0.77900000000000003},"min":{"1min":0.54500000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0369999999999999,"5min":1.23,"15min":1.5249999999999999},"last":1.048},{"interface":"front","average":{"1min":0.755,"5min":0.78100000000000003,"15min":0.78300000000000003},"min":{"1min":0.63,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97899999999999998,"5min":2.6800000000000002,"15min":2.6800000000000002},"last":0.89300000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.97799999999999998,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.79500000000000004}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.96799999999999997,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.63,"5min":0.55300000000000005,"15min":0.53900000000000003},"max":{"1min":1.0449999999999999,"5min":5.8410000000000002,"15min":5.8410000000000002},"last":1.006}]}]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1814528,"data_stored":860321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.29699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.443},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.51600000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79900000000000004,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.32000000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48399999999999999,"15min":0.5},"min":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.51400000000000001},"min":{"1min":0.41399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.57999999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.43099999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70199999999999996,"15min":0.70799999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.355},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.746},"min":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.4370000000000001},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78200000000000003,"15min":0.748},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.3959999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73999999999999999,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.329},"last":0.501},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.73699999999999999,"15min":0.79100000000000004},"min":{"1min":0.63500000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.5629999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Aug 27 11:28:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.57099999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.621},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78300000000000003,"15min":0.79900000000000004},"min":{"1min":0.60099999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.288},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1810432,"data_stored":861203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41199999999999998,"15min":0.498},"min":{"1min":0.27300000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.74099999999999999,"15min":1.5840000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46500000000000002,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":2.1459999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":0.80900000000000005,"15min":1.7030000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.55800000000000005},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":2.1099999999999999},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.55900000000000005},"min":{"1min":0.374,"5min":0.307,"15min":0.307},"max":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":1.8480000000000001},"last":0.435},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.9610000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.751,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95299999999999996,"5min":1.1459999999999999,"15min":1.669},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.749,"15min":0.78500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91200000000000003,"5min":1.25,"15min":1.994},"last":0.81100000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.746,"15min":0.80800000000000005},"min":{"1min":0.51500000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.95199999999999996,"5min":1.2110000000000001,"15min":2.036},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73799999999999999,"15min":0.79700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92500000000000004,"5min":1.0009999999999999,"15min":1.26},"last":0.89100000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.752,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90400000000000003,"5min":1.1279999999999999,"15min":1.321},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.76100000000000001,"15min":0.83299999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0429999999999999,"5min":1.1160000000000001,"15min":1.627},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Aug 27 11:28:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76300000000000001,"15min":0.84199999999999997},"min":{"1min":0.58199999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.93700000000000006,"5min":1.1579999999999999,"15min":2.073},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78100000000000003,"15min":0.85099999999999998},"min":{"1min":0.59599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.95299999999999996,"5min":1.171,"15min":1.323},"last":0.78200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1826816,"data_stored":862433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40999999999999998,"15min":0.58199999999999996},"min":{"1min":0.28999999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.58899999999999997,"5min":0.75600000000000001,"15min":5.4249999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.46999999999999997,"15min":0.51900000000000002},"min":{"1min":0.32800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.83799999999999997,"15min":2.2080000000000002},"last":0.65800000000000003}]},{"osd":1,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45500000000000002,"15min":1.083},"min":{"1min":0.313,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.629,"5min":0.71099999999999997,"15min":18.928000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.65700000000000003},"min":{"1min":0.39700000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":5.5380000000000003},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53100000000000003,"15min":0.57299999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35999999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":1.5329999999999999},"last":0.63},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.68700000000000006},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":5.5700000000000003},"last":0.64400000000000002}]},{"osd":4,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72799999999999998,"15min":0.88500000000000001},"min":{"1min":0.52800000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0049999999999999,"5min":1.1140000000000001,"15min":4.9390000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.745,"15min":0.79900000000000004},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.5029999999999999},"last":1.099}]},{"osd":5,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74199999999999999,"15min":0.81200000000000006},"min":{"1min":0.55400000000000005,"5min":0.52100000000000002,"15min":0.47699999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.429},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.752,"15min":0.94999999999999996},"min":{"1min":0.57799999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.98899999999999999,"5min":1.073,"15min":5.5039999999999996},"last":1.0720000000000001}]},{"osd":6,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76200000000000001,"15min":0.93700000000000006},"min":{"1min":0.55700000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":5.4699999999999998},"last":1.036},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.754,"15min":0.92800000000000005},"min":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":5.0389999999999997},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Aug 27 11:28:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77800000000000002,"15min":0.94399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":5},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78300000000000003,"15min":0.81799999999999995},"min":{"1min":0.57299999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.4710000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":861967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66600000000000004,"15min":0.62},"min":{"1min":0.42099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":1.161,"15min":1.161},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69599999999999995,"15min":0.66200000000000003},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.83499999999999996}]},{"osd":1,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.47699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":0.878},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.43099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68500000000000005,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98199999999999998,"5min":1.173,"15min":1.173},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91400000000000003}]},{"osd":3,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70599999999999996,"15min":0.68899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46400000000000002},"max":{"1min":1.0309999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.54400000000000004,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0269999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.877,"5min":1.25,"15min":1.25},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.74099999999999999,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.98899999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.48499999999999999,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.85699999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81699999999999995,"15min":0.80900000000000005},"min":{"1min":0.58799999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94699999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Sun Aug 27 11:28:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.80400000000000005},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0129999999999999,"5min":1.232,"15min":1.232},"last":0.71199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28792,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343048,"statfs":{"total":96636764160,"available":96607281152,"internally_reserved":0,"allocated":1814528,"data_stored":860341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67900000000000005,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.105,"15min":1.105},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68400000000000005,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.92100000000000004,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71499999999999997,"15min":0.66300000000000003},"min":{"1min":0.48099999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.91700000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72899999999999998,"15min":0.69499999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.0669999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.628},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0169999999999999,"5min":1.034,"15min":1.1120000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77300000000000002,"15min":0.74099999999999999},"min":{"1min":0.59999999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.71599999999999997},"min":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.46300000000000002},"max":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69499999999999995,"15min":0.72199999999999998},"min":{"1min":0.48499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.98399999999999999,"5min":1.0109999999999999,"15min":1.744},"last":0.754},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0249999999999999,"5min":1.282,"15min":1.282},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.56200000000000006,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2849999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.65500000000000003,"5min":0.443,"15min":0.443},"max":{"1min":1.099,"5min":1.2230000000000001,"15min":1.663},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Aug 27 11:28:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82999999999999996,"15min":0.83599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1259999999999999,"5min":1.411,"15min":1.411},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.84699999999999998,"15min":0.82299999999999995},"min":{"1min":0.68200000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-27T11:29:46.225 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-27T11:29:46.226 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-27T11:29:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.467+0000 7f5209fff700 1 Processor -- start 2023-08-27T11:29:46.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.467+0000 7f5209fff700 1 -- start start 2023-08-27T11:29:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5209fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f520406a790 0x7f52040c4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5209fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 0x7f520415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5209fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040ac7e0 con 0x7f5204151d20 2023-08-27T11:29:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5209fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040c86a0 con 0x7f520406a790 2023-08-27T11:29:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5209fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5204155030 con 0x7f52040c4c50 2023-08-27T11:29:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f51fbfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f520406a790 0x7f52040c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:46.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f51fbfff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f520406a790 0x7f52040c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36054/0 (socket says 172.21.15.43:36054) 2023-08-27T11:29:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f51fbfff700 1 -- 172.21.15.43:0/2762139829 learned_addr learned my addr 172.21.15.43:0/2762139829 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f5203fff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 0x7f520415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f51fbfff700 1 -- 172.21.15.43:0/2762139829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 msgr2=0x7f520415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.468+0000 7f51fbfff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 0x7f520415ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f51fbfff700 1 -- 172.21.15.43:0/2762139829 >> v1:172.21.15.57:6789/0 conn(0x7f5204151d20 legacy=0x7f52040c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:46.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f51fbfff700 1 -- 172.21.15.43:0/2762139829 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040c99f0 con 0x7f520406a790 2023-08-27T11:29:46.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f5203fff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 0x7f520415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:46.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f51fbfff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c4710 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009920 tx=0x7f51ec009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdfde4a7d79c2a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:46.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f5202ffd700 1 -- 172.21.15.43:0/2762139829 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec004230 con 0x7f520406a790 2023-08-27T11:29:46.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f5202ffd700 1 -- 172.21.15.43:0/2762139829 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec004390 con 0x7f520406a790 2023-08-27T11:29:46.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.469+0000 7f5202ffd700 1 -- 172.21.15.43:0/2762139829 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec009e70 con 0x7f520406a790 2023-08-27T11:29:46.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 -- 172.21.15.43:0/2762139829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 msgr2=0x7f52040c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c4710 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009920 tx=0x7f51ec009c30 comp rx=0 tx=0).stop 2023-08-27T11:29:46.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 -- 172.21.15.43:0/2762139829 shutdown_connections 2023-08-27T11:29:46.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52040c4c50 0x7f520415ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 --2- 172.21.15.43:0/2762139829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c4710 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 -- 172.21.15.43:0/2762139829 >> 172.21.15.43:0/2762139829 conn(0x7f52040ab880 msgr2=0x7f52040abc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:46.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 -- 172.21.15.43:0/2762139829 shutdown_connections 2023-08-27T11:29:46.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.470+0000 7f5209fff700 1 -- 172.21.15.43:0/2762139829 wait complete. 2023-08-27T11:29:46.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.472+0000 7f5209fff700 1 Processor -- start 2023-08-27T11:29:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.472+0000 7f5209fff700 1 -- start start 2023-08-27T11:29:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52040c4c50 0x7f52040bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5204151d20 0x7f52040a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040bf730 con 0x7f520406a790 2023-08-27T11:29:46.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5204157ea0 con 0x7f52040c4c50 2023-08-27T11:29:46.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f5209fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52041573f0 con 0x7f5204151d20 2023-08-27T11:29:46.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:46.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36068/0 (socket says 172.21.15.43:36068) 2023-08-27T11:29:46.480 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 -- 172.21.15.43:0/274062814 learned_addr learned my addr 172.21.15.43:0/274062814 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:46.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 -- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5204151d20 msgr2=0x7f52040a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5204151d20 0x7f52040a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 -- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52040c4c50 msgr2=0x7f52040bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52040c4c50 0x7f52040bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.481 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.473+0000 7f52037fe700 1 -- 172.21.15.43:0/274062814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec009550 con 0x7f520406a790 2023-08-27T11:29:46.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f52037fe700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f51f400b4a0 tx=0x7f51f400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:46.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011830 con 0x7f520406a790 2023-08-27T11:29:46.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4011990 con 0x7f520406a790 2023-08-27T11:29:46.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040c0a80 con 0x7f520406a790 2023-08-27T11:29:46.482 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f4011d40 con 0x7f520406a790 2023-08-27T11:29:46.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.474+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041578e0 con 0x7f520406a790 2023-08-27T11:29:46.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.475+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5204074680 con 0x7f520406a790 2023-08-27T11:29:46.483 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.476+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f51f401a400 con 0x7f520406a790 2023-08-27T11:29:46.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.477+0000 7f5200ff9700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 0x7f51e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:46.484 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.477+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51f4088390 con 0x7f520406a790 2023-08-27T11:29:46.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.477+0000 7f51fbfff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 0x7f51e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:46.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.478+0000 7f51fbfff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 0x7f51e406c5a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f52040c4a70 tx=0x7f51ec010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:46.485 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.481+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f51f40539e0 con 0x7f520406a790 2023-08-27T11:29:46.779 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.777+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f52040c5f90 con 0x7f520406a790 2023-08-27T11:29:46.783 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.782+0000 7f5200ff9700 1 -- 172.21.15.43:0/274062814 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+147 (secure 0 0 0) 0x7f51f4057000 con 0x7f520406a790 2023-08-27T11:29:46.784 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2023-08-27T11:29:46.784 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQDIMetkMCfUHhAAzICqbeoy9zyu0M+PlR87Lw== 2023-08-27T11:29:46.784 INFO:teuthology.orchestra.run.smithi043.stdout: caps mds = "allow" 2023-08-27T11:29:46.784 INFO:teuthology.orchestra.run.smithi043.stdout: caps mon = "allow r" 2023-08-27T11:29:46.785 INFO:teuthology.orchestra.run.smithi043.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-27T11:29:46.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 msgr2=0x7f51e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.787 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 0x7f51e406c5a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f52040c4a70 tx=0x7f51ec010000 comp rx=0 tx=0).stop 2023-08-27T11:29:46.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 msgr2=0x7f52040c0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:46.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f51f400b4a0 tx=0x7f51f400b860 comp rx=0 tx=0).stop 2023-08-27T11:29:46.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 shutdown_connections 2023-08-27T11:29:46.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f51e406a0e0 0x7f51e406c5a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.788 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5204151d20 0x7f52040a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f520406a790 0x7f52040c0540 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 --2- 172.21.15.43:0/274062814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52040c4c50 0x7f52040bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:46.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 >> 172.21.15.43:0/274062814 conn(0x7f52040ab880 msgr2=0x7f520406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:46.789 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 shutdown_connections 2023-08-27T11:29:46.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:46.785+0000 7f5209fff700 1 -- 172.21.15.43:0/274062814 wait complete. 2023-08-27T11:29:46.790 INFO:teuthology.orchestra.run.smithi043.stderr:updated caps for client.0 2023-08-27T11:29:46.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:47.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.005+0000 7f0be3dff700 1 Processor -- start 2023-08-27T11:29:47.007 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.006+0000 7f0be3dff700 1 -- start start 2023-08-27T11:29:47.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be3dff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0bdc06d1c0 0x7f0bdc156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be3dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc152430 con 0x7f0bdc06ca60 2023-08-27T11:29:47.008 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be3dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc152710 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be3dff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc1530b0 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be139a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0bdc06ca60 0x7f0bdc155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42396/0 (socket says 172.21.15.43:42396) 2023-08-27T11:29:47.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be139a700 1 -- 172.21.15.43:0/2680224897 learned_addr learned my addr 172.21.15.43:0/2680224897 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:47.009 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be239c700 1 --2- 172.21.15.43:0/2680224897 >> v2:172.21.15.43:3300/0 conn(0x7f0bdc06d1c0 0x7f0bdc156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.007+0000 7f0be0b99700 1 -- 172.21.15.43:0/2680224897 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550067760 0 0) 0x7f0bdc152430 con 0x7f0bdc06ca60 2023-08-27T11:29:47.011 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be0b99700 1 -- 172.21.15.43:0/2680224897 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc80035b0 con 0x7f0bdc06ca60 2023-08-27T11:29:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be239c700 1 -- 172.21.15.43:0/2680224897 >> v1:172.21.15.57:6789/0 conn(0x7f0bdc0c51a0 legacy=0x7f0bdc0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be239c700 1 -- 172.21.15.43:0/2680224897 >> v1:172.21.15.43:6789/0 conn(0x7f0bdc06ca60 legacy=0x7f0bdc155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be239c700 1 -- 172.21.15.43:0/2680224897 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc1529f0 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be239c700 1 --2- 172.21.15.43:0/2680224897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc06d1c0 0x7f0bdc156020 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009d90 tx=0x7f0bd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f69b9f36ec5335 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.012 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be0b99700 1 -- 172.21.15.43:0/2680224897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400e070 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be0b99700 1 -- 172.21.15.43:0/2680224897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400bb20 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.008+0000 7f0be0b99700 1 -- 172.21.15.43:0/2680224897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4012430 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 -- 172.21.15.43:0/2680224897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc06d1c0 msgr2=0x7f0bdc156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.013 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 --2- 172.21.15.43:0/2680224897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc06d1c0 0x7f0bdc156020 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009d90 tx=0x7f0bd400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 -- 172.21.15.43:0/2680224897 shutdown_connections 2023-08-27T11:29:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 --2- 172.21.15.43:0/2680224897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc06d1c0 0x7f0bdc156020 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 -- 172.21.15.43:0/2680224897 >> 172.21.15.43:0/2680224897 conn(0x7f0bdc06aa50 msgr2=0x7f0bdc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 -- 172.21.15.43:0/2680224897 shutdown_connections 2023-08-27T11:29:47.014 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.009+0000 7f0be3dff700 1 -- 172.21.15.43:0/2680224897 wait complete. 2023-08-27T11:29:47.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.011+0000 7f0be3dff700 1 Processor -- start 2023-08-27T11:29:47.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.011+0000 7f0be3dff700 1 -- start start 2023-08-27T11:29:47.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.012+0000 7f0be3dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc06ca60 0x7f0bdc0bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be3dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bdc06d1c0 0x7f0bdc0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be3dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be3dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc071e60 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be3dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1ebd20 con 0x7f0bdc06ca60 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be3dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0bf470 con 0x7f0bdc06d1c0 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36084/0 (socket says 172.21.15.43:36084) 2023-08-27T11:29:47.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 -- 172.21.15.43:0/4170856408 learned_addr learned my addr 172.21.15.43:0/4170856408 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be1b9b700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc06ca60 0x7f0bdc0bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be139a700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bdc06d1c0 0x7f0bdc0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 -- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bdc06d1c0 msgr2=0x7f0bdc0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bdc06d1c0 0x7f0bdc0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 -- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc06ca60 msgr2=0x7f0bdc0bef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc06ca60 0x7f0bdc0bef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.013+0000 7f0be239c700 1 -- 172.21.15.43:0/4170856408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009a70 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0be239c700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc06de40 tx=0x7f0bd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4012430 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4020070 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4004280 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc0a5460 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.014+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc148820 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.015+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc04ee70 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.016+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0bd40043e0 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.017+0000 7f0bd27fc700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 0x7f0bc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.017+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bd4022070 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.017+0000 7f0be1b9b700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 0x7f0bc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.018+0000 7f0be1b9b700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 0x7f0bc006c5a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007fd0 tx=0x7f0bd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.021+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0bd4055850 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.277+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bdc0bfbd0 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.278 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.277+0000 7f0bd27fc700 1 -- 172.21.15.43:0/4170856408 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 151 v151) v1 ==== 95+0+4885 (secure 0 0 0) 0x7f0bd4058e70 con 0x7f0bdc0c51a0 2023-08-27T11:29:47.279 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:47.279 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":151,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":151,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:39.269853+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:active","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:47.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 msgr2=0x7f0bc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 0x7f0bc006c5a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8007fd0 tx=0x7f0bd8009040 comp rx=0 tx=0).stop 2023-08-27T11:29:47.282 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 msgr2=0x7f0bdc1e7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc06de40 tx=0x7f0bd4004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 shutdown_connections 2023-08-27T11:29:47.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0bc006a0e0 0x7f0bc006c5a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0bdc0c51a0 0x7f0bdc1e7c10 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.283 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0bdc06ca60 0x7f0bdc0bef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 --2- 172.21.15.43:0/4170856408 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0bdc06d1c0 0x7f0bdc0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 >> 172.21.15.43:0/4170856408 conn(0x7f0bdc06aa50 msgr2=0x7f0bdc14bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 shutdown_connections 2023-08-27T11:29:47.284 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.280+0000 7f0be3dff700 1 -- 172.21.15.43:0/4170856408 wait complete. 2023-08-27T11:29:47.285 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 151 2023-08-27T11:29:47.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 151, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:39.269853+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:47.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:29:47.703 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-27T11:29:47.910 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.909+0000 7f8c099ff700 1 Processor -- start 2023-08-27T11:29:47.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.909+0000 7f8c099ff700 1 -- start start 2023-08-27T11:29:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.910+0000 7f8c099ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c04151a90 0x7f8c040c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.910+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c0406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.910+0000 7f8c099ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c0406c4e0 con 0x7f8c040c4630 2023-08-27T11:29:47.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.910+0000 7f8c099ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c04155370 con 0x7f8c04151a90 2023-08-27T11:29:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.910+0000 7f8c099ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04151e70 con 0x7f8c040c4a90 2023-08-27T11:29:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c04151a90 0x7f8c040c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c04151a90 0x7f8c040c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36090/0 (socket says 172.21.15.43:36090) 2023-08-27T11:29:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 -- 172.21.15.43:0/485637123 learned_addr learned my addr 172.21.15.43:0/485637123 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c037fe700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c0406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 -- 172.21.15.43:0/485637123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 msgr2=0x7f8c0406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c0406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 -- 172.21.15.43:0/485637123 >> v1:172.21.15.57:6789/0 conn(0x7f8c040c4630 legacy=0x7f8c0406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.911+0000 7f8c02ffd700 1 -- 172.21.15.43:0/485637123 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04154480 con 0x7f8c04151a90 2023-08-27T11:29:47.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c04151a90 0x7f8c040c7bb0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098f0 tx=0x7f8bf4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8348dc72bbe0a2ce server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c01ffb700 1 -- 172.21.15.43:0/485637123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4011830 con 0x7f8c04151a90 2023-08-27T11:29:47.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c01ffb700 1 -- 172.21.15.43:0/485637123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4011990 con 0x7f8c04151a90 2023-08-27T11:29:47.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c01ffb700 1 -- 172.21.15.43:0/485637123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4011d20 con 0x7f8c04151a90 2023-08-27T11:29:47.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 -- 172.21.15.43:0/485637123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c04151a90 msgr2=0x7f8c040c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c04151a90 0x7f8c040c7bb0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40098f0 tx=0x7f8bf4009c00 comp rx=0 tx=0).stop 2023-08-27T11:29:47.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 -- 172.21.15.43:0/485637123 shutdown_connections 2023-08-27T11:29:47.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c0406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.919 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 --2- 172.21.15.43:0/485637123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c04151a90 0x7f8c040c7bb0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 -- 172.21.15.43:0/485637123 >> 172.21.15.43:0/485637123 conn(0x7f8c040ab820 msgr2=0x7f8c040abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.912+0000 7f8c099ff700 1 -- 172.21.15.43:0/485637123 shutdown_connections 2023-08-27T11:29:47.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.913+0000 7f8c099ff700 1 -- 172.21.15.43:0/485637123 wait complete. 2023-08-27T11:29:47.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.914+0000 7f8c099ff700 1 Processor -- start 2023-08-27T11:29:47.920 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.914+0000 7f8c099ff700 1 -- start start 2023-08-27T11:29:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c04148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04151a90 0x7f8c040c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c9a40 con 0x7f8c040c4630 2023-08-27T11:29:47.921 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041ea730 con 0x7f8c04151a90 2023-08-27T11:29:47.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c099ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041eaa10 con 0x7f8c040c4a90 2023-08-27T11:29:47.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36108/0 (socket says 172.21.15.43:36108) 2023-08-27T11:29:47.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 -- 172.21.15.43:0/4233581032 learned_addr learned my addr 172.21.15.43:0/4233581032 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.922 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c027fc700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c04148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 -- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 msgr2=0x7f8c04148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c04148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 -- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04151a90 msgr2=0x7f8c040c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04151a90 0x7f8c040c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.923 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c02ffd700 1 -- 172.21.15.43:0/4233581032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4009550 con 0x7f8c040c4630 2023-08-27T11:29:47.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.916+0000 7f8c027fc700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c04148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:47.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009c40 tx=0x7f8bf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8bebfff700 1 -- 172.21.15.43:0/4233581032 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40036a0 con 0x7f8c040c4630 2023-08-27T11:29:47.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8bebfff700 1 -- 172.21.15.43:0/4233581032 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf401e070 con 0x7f8c040c4630 2023-08-27T11:29:47.924 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040c93f0 con 0x7f8c040c4630 2023-08-27T11:29:47.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8bebfff700 1 -- 172.21.15.43:0/4233581032 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003a60 con 0x7f8c040c4630 2023-08-27T11:29:47.925 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.917+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c041491b0 con 0x7f8c040c4630 2023-08-27T11:29:47.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.919+0000 7f8bebfff700 1 -- 172.21.15.43:0/4233581032 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8bf4003bc0 con 0x7f8c040c4630 2023-08-27T11:29:47.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.920+0000 7f8bebfff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.920+0000 7f8bebfff700 1 -- 172.21.15.43:0/4233581032 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf4089470 con 0x7f8c040c4630 2023-08-27T11:29:47.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.920+0000 7f8c027fc700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.921+0000 7f8c027fc700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8c040c0af0 tx=0x7f8bf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.922+0000 7f8c1d420b80 1 Processor -- start 2023-08-27T11:29:47.929 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.923+0000 7f8c1d420b80 1 -- start start 2023-08-27T11:29:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325b4fe0 0x5620325d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x56203250c730 con 0x5620325af2e0 2023-08-27T11:29:47.930 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x56203250a050 con 0x5620325aef00 2023-08-27T11:29:47.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562032505940 con 0x5620325b4fe0 2023-08-27T11:29:47.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36122/0 (socket says 172.21.15.43:36122) 2023-08-27T11:29:47.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 -- 172.21.15.43:0/1300985153 learned_addr learned my addr 172.21.15.43:0/1300985153 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c027fc700 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325b4fe0 0x5620325d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 -- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325b4fe0 msgr2=0x5620325d22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325b4fe0 0x5620325d22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 -- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 msgr2=0x5620325d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.924+0000 7f8c037fe700 1 -- 172.21.15.43:0/1300985153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620323855e0 con 0x5620325af2e0 2023-08-27T11:29:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8c037fe700 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e270 tx=0x7f8bfc00e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7f090adc5c518 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8be97fa700 1 -- 172.21.15.43:0/1300985153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc014480 con 0x5620325af2e0 2023-08-27T11:29:47.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8be97fa700 1 -- 172.21.15.43:0/1300985153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00f040 con 0x5620325af2e0 2023-08-27T11:29:47.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8be97fa700 1 -- 172.21.15.43:0/1300985153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc014820 con 0x5620325af2e0 2023-08-27T11:29:47.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8c1d420b80 1 -- 172.21.15.43:0/1300985153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 msgr2=0x5620325e7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.925+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e270 tx=0x7f8bfc00e580 comp rx=0 tx=0).stop 2023-08-27T11:29:47.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 -- 172.21.15.43:0/1300985153 shutdown_connections 2023-08-27T11:29:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325e7500 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/1300985153 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325b4fe0 0x5620325d22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 -- 172.21.15.43:0/1300985153 >> 172.21.15.43:0/1300985153 conn(0x562032511c30 msgr2=0x5620325b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.935 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 -- 172.21.15.43:0/1300985153 shutdown_connections 2023-08-27T11:29:47.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 -- 172.21.15.43:0/1300985153 wait complete. 2023-08-27T11:29:47.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.926+0000 7f8c1d420b80 1 -- start start 2023-08-27T11:29:47.936 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.927+0000 7f8c1d420b80 1 Processor -- start 2023-08-27T11:29:47.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325edc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620326028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620324a3b60 con 0x5620325af2e0 2023-08-27T11:29:47.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620324a3860 con 0x5620325aef00 2023-08-27T11:29:47.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620323878d0 con 0x5620325eef80 2023-08-27T11:29:47.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c1d420b80 10 client.0 _ll_register_callbacks cb 0x5620324a1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:29:47.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36124/0 (socket says 172.21.15.43:36124) 2023-08-27T11:29:47.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 -- 172.21.15.43:0/2512314634 learned_addr learned my addr 172.21.15.43:0/2512314634 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.941 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c037fe700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620326028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 -- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 msgr2=0x5620326028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620326028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 -- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 msgr2=0x5620325edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325edc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.928+0000 7f8c027fc700 1 -- 172.21.15.43:0/2512314634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc009da0 con 0x5620325af2e0 2023-08-27T11:29:47.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8c027fc700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8014cc0 tx=0x7f8bf8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18312700252ae21d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8be27fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:29:47.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8024070 con 0x5620325af2e0 2023-08-27T11:29:47.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620325a64f0 con 0x5620325af2e0 2023-08-27T11:29:47.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf8012af0 con 0x5620325af2e0 2023-08-27T11:29:47.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bf8014500 con 0x5620325af2e0 2023-08-27T11:29:47.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8c1d420b80 10 client.8934 fetch_fsmap learned FSMap version 151 2023-08-27T11:29:47.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.929+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) v3 -- 0x56203251d750 con 0x5620325af2e0 2023-08-27T11:29:47.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5620325a64f0 con 0x5620325af2e0 2023-08-27T11:29:47.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 151) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8bf8027020 con 0x5620325af2e0 2023-08-27T11:29:47.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 10 client.8934 fetch_fsmap finished waiting for FSMap version 151 2023-08-27T11:29:47.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 10 client.8934 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:29:47.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 20 client.8934 populate_metadata read hostname 'smithi043' 2023-08-27T11:29:47.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325d05a0 0x5620325d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 4 client.8934 mds_command: new command op to 8772 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 --> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620324fe920 con 0x5620325d05a0 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.930+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325d05a0 0x5620325d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.931+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325d05a0 0x5620325d0980 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e435d94b05c5ece7 server_cookie=6b68eb003c96a46b in_seq=0 out_seq=0 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.931+0000 7f8be27fc700 10 client.8934 ms_handle_connect on v2:172.21.15.57:6833/3676894007 2023-08-27T11:29:47.946 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8be27fc700 1 -- 172.21.15.43:0/2512314634 <== mds.0 v2:172.21.15.57:6833/3676894007 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5620324fe920 con 0x5620325d05a0 2023-08-27T11:29:47.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8be27fc700 10 client.8934 handle_command_reply: tid=0 2023-08-27T11:29:47.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 client.8934 shutdown 2023-08-27T11:29:47.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 msgr2=0x5620325d69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8014cc0 tx=0x7f8bf8000ed0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.947 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 shutdown_connections 2023-08-27T11:29:47.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620326028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325d05a0 0x5620325d0980 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/2512314634 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d69f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.948 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8be27fc700 0 client.8934 ms_handle_reset on v2:172.21.15.57:6833/3676894007 2023-08-27T11:29:47.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 >> 172.21.15.43:0/2512314634 conn(0x562032511c30 msgr2=0x5620325acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 shutdown_connections 2023-08-27T11:29:47.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.932+0000 7f8c1d420b80 1 -- 172.21.15.43:0/2512314634 wait complete. 2023-08-27T11:29:47.949 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.933+0000 7f8c1d420b80 20 client.8934 trim_cache size 0 max 16384 2023-08-27T11:29:47.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.951+0000 7f8c1d420b80 1 Processor -- start 2023-08-27T11:29:47.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 -- start start 2023-08-27T11:29:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325af2e0 0x5620325d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620325d7350 con 0x5620325eef80 2023-08-27T11:29:47.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620325f08d0 con 0x5620325aef00 2023-08-27T11:29:47.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.952+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620325ed6c0 con 0x5620325af2e0 2023-08-27T11:29:47.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36134/0 (socket says 172.21.15.43:36134) 2023-08-27T11:29:47.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 -- 172.21.15.43:0/455376086 learned_addr learned my addr 172.21.15.43:0/455376086 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c027fc700 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325af2e0 0x5620325d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 -- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325af2e0 msgr2=0x5620325d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325af2e0 0x5620325d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 -- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 msgr2=0x5620325d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 -- 172.21.15.43:0/455376086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620325afb60 con 0x5620325eef80 2023-08-27T11:29:47.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.953+0000 7f8c037fe700 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e5c0 tx=0x7f8bfc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301b4e36e0eb758b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8be9ffb700 1 -- 172.21.15.43:0/455376086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc023070 con 0x5620325eef80 2023-08-27T11:29:47.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8be9ffb700 1 -- 172.21.15.43:0/455376086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc007000 con 0x5620325eef80 2023-08-27T11:29:47.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8be9ffb700 1 -- 172.21.15.43:0/455376086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003a20 con 0x5620325eef80 2023-08-27T11:29:47.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 -- 172.21.15.43:0/455376086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 msgr2=0x5620325e51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc00e5c0 tx=0x7f8bfc013000 comp rx=0 tx=0).stop 2023-08-27T11:29:47.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 -- 172.21.15.43:0/455376086 shutdown_connections 2023-08-27T11:29:47.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325eef80 0x5620325e51d0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x5620325d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/455376086 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325af2e0 0x5620325d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 -- 172.21.15.43:0/455376086 >> 172.21.15.43:0/455376086 conn(0x562032511c30 msgr2=0x5620325aa450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.954+0000 7f8c1d420b80 1 -- 172.21.15.43:0/455376086 shutdown_connections 2023-08-27T11:29:47.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.955+0000 7f8c1d420b80 1 -- 172.21.15.43:0/455376086 wait complete. 2023-08-27T11:29:47.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.955+0000 7f8c1d420b80 1 -- start start 2023-08-27T11:29:47.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.955+0000 7f8c1d420b80 1 Processor -- start 2023-08-27T11:29:47.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x56203260c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620325ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620325efac0 con 0x5620325af2e0 2023-08-27T11:29:47.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x562032611ae0 con 0x5620325aef00 2023-08-27T11:29:47.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.956+0000 7f8c1d420b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x562032654a10 con 0x5620325eef80 2023-08-27T11:29:47.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c1d420b80 10 client.0 _ll_register_callbacks cb 0x5620324a1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:29:47.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x56203260c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36138/0 (socket says 172.21.15.43:36138) 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x56203260c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:48236/0 (socket says 172.21.15.43:48236) 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 -- 172.21.15.43:0/3560420957 learned_addr learned my addr 172.21.15.43:0/3560420957 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c037fe700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620325ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 -- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 msgr2=0x5620325ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620325ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 -- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 msgr2=0x56203260c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x56203260c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.957+0000 7f8c027fc700 1 -- 172.21.15.43:0/3560420957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620323855e0 con 0x5620325af2e0 2023-08-27T11:29:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.958+0000 7f8c027fc700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8014fd0 tx=0x7f8bf8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1916b20fddae0403 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.958+0000 7f8be27fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:29:47.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8024070 con 0x5620325af2e0 2023-08-27T11:29:47.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8bfc00f040 con 0x5620325af2e0 2023-08-27T11:29:47.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf8020420 con 0x5620325af2e0 2023-08-27T11:29:47.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=151) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bf80205e0 con 0x5620325af2e0 2023-08-27T11:29:47.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8c1d420b80 10 client.8940 fetch_fsmap learned FSMap version 151 2023-08-27T11:29:47.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=151,monmap=2+}) v3 -- 0x562032331d90 con 0x5620325af2e0 2023-08-27T11:29:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00f040 con 0x5620325af2e0 2023-08-27T11:29:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.959+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 151) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8bf8014cf0 con 0x5620325af2e0 2023-08-27T11:29:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 10 client.8940 fetch_fsmap finished waiting for FSMap version 151 2023-08-27T11:29:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 10 client.8940 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-27T11:29:47.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 20 client.8940 populate_metadata read hostname 'smithi043' 2023-08-27T11:29:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325adc70 0x5620325ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 4 client.8940 mds_command: new command op to 8772 tid=0[{"prefix": "status"}] 2023-08-27T11:29:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 --> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5620324bf000 con 0x5620325adc70 2023-08-27T11:29:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.960+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325adc70 0x5620325ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:47.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325adc70 0x5620325ae050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6ce80e3e3c9794 server_cookie=49c73469c3687545 in_seq=0 out_seq=0 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8be27fc700 10 client.8940 ms_handle_connect on v2:172.21.15.57:6833/3676894007 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8be27fc700 1 -- 172.21.15.43:0/3560420957 <== mds.0 v2:172.21.15.57:6833/3676894007 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5620324bf000 con 0x5620325adc70 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8be27fc700 10 client.8940 handle_command_reply: tid=0 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 client.8940 shutdown 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 msgr2=0x5620325d8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8014fd0 tx=0x7f8bf8012000 comp rx=0 tx=0).stop 2023-08-27T11:29:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 shutdown_connections 2023-08-27T11:29:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5620325eef80 0x5620325ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:6833/3676894007,v1:172.21.15.57:6835/3676894007] conn(0x5620325adc70 0x5620325ae050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5620325aef00 0x56203260c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 --2- 172.21.15.43:0/3560420957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5620325af2e0 0x5620325d8410 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8be27fc700 0 client.8940 ms_handle_reset on v2:172.21.15.57:6833/3676894007 2023-08-27T11:29:47.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 >> 172.21.15.43:0/3560420957 conn(0x562032511c30 msgr2=0x5620325acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 shutdown_connections 2023-08-27T11:29:47.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.961+0000 7f8c1d420b80 1 -- 172.21.15.43:0/3560420957 wait complete. 2023-08-27T11:29:47.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c1d420b80 20 client.8940 trim_cache size 0 max 16384 2023-08-27T11:29:47.976 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:29:47.976 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:29:47.976 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:29:47.976 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 8772, 2023-08-27T11:29:47.977 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:29:47.977 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:29:47.977 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:29:47.977 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 11.701390912999999, 2023-08-27T11:29:47.977 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 151, 2023-08-27T11:29:47.978 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 144, 2023-08-27T11:29:47.978 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 144, 2023-08-27T11:29:47.978 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 17.942655142 2023-08-27T11:29:47.978 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:29:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 msgr2=0x7f8bf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8c040c0af0 tx=0x7f8bf8009040 comp rx=0 tx=0).stop 2023-08-27T11:29:47.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 msgr2=0x7f8c040a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4009c40 tx=0x7f8bf4004750 comp rx=0 tx=0).stop 2023-08-27T11:29:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 shutdown_connections 2023-08-27T11:29:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04151a90 0x7f8c040c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c040c4630 0x7f8c040a9d30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 --2- 172.21.15.43:0/4233581032 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c040c4a90 0x7f8c04148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.962+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 >> 172.21.15.43:0/4233581032 conn(0x7f8c040ab820 msgr2=0x7f8c041507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.963+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 shutdown_connections 2023-08-27T11:29:47.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:47.963+0000 7f8c099ff700 1 -- 172.21.15.43:0/4233581032 wait complete. 2023-08-27T11:29:47.982 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs down true 2023-08-27T11:29:48.187 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.186+0000 7f0b273ff700 1 Processor -- start 2023-08-27T11:29:48.188 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.186+0000 7f0b273ff700 1 -- start start 2023-08-27T11:29:48.190 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b273ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b200c5230 0x7f0b2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b273ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b20155880 0x7f0b20155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b273ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b201561a0 con 0x7f0b2006c5e0 2023-08-27T11:29:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b273ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b20152290 con 0x7f0b20155880 2023-08-27T11:29:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b273ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2006d7a0 con 0x7f0b200c5230 2023-08-27T11:29:48.191 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b2599c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0b20155880 0x7f0b20155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b2499a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0b2006c5e0 0x7f0b200aac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42408/0 (socket says 172.21.15.43:42408) 2023-08-27T11:29:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b2499a700 1 -- 172.21.15.43:0/3195946933 learned_addr learned my addr 172.21.15.43:0/3195946933 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.187+0000 7f0b2519b700 1 --2- 172.21.15.43:0/3195946933 >> v2:172.21.15.57:3300/0 conn(0x7f0b200c5230 0x7f0b2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.192 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b2599c700 1 -- 172.21.15.43:0/3195946933 >> v2:172.21.15.57:3300/0 conn(0x7f0b200c5230 msgr2=0x7f0b2006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b2599c700 1 --2- 172.21.15.43:0/3195946933 >> v2:172.21.15.57:3300/0 conn(0x7f0b200c5230 0x7f0b2006d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b2599c700 1 -- 172.21.15.43:0/3195946933 >> v1:172.21.15.43:6789/0 conn(0x7f0b2006c5e0 legacy=0x7f0b200aac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b2599c700 1 -- 172.21.15.43:0/3195946933 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20152550 con 0x7f0b20155880 2023-08-27T11:29:48.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b2599c700 1 --2- 172.21.15.43:0/3195946933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b20155880 0x7f0b20155c60 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006ced0 tx=0x7f0b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b777a5c6426d4843 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b17fff700 1 -- 172.21.15.43:0/3195946933 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800e070 con 0x7f0b20155880 2023-08-27T11:29:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b17fff700 1 -- 172.21.15.43:0/3195946933 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800bb20 con 0x7f0b20155880 2023-08-27T11:29:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.188+0000 7f0b17fff700 1 -- 172.21.15.43:0/3195946933 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18012430 con 0x7f0b20155880 2023-08-27T11:29:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 -- 172.21.15.43:0/3195946933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b20155880 msgr2=0x7f0b20155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3195946933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b20155880 0x7f0b20155c60 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006ced0 tx=0x7f0b1800b330 comp rx=0 tx=0).stop 2023-08-27T11:29:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 -- 172.21.15.43:0/3195946933 shutdown_connections 2023-08-27T11:29:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3195946933 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b20155880 0x7f0b20155c60 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3195946933 >> v2:172.21.15.57:3300/0 conn(0x7f0b200c5230 0x7f0b2006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 -- 172.21.15.43:0/3195946933 >> 172.21.15.43:0/3195946933 conn(0x7f0b200c5b10 msgr2=0x7f0b200c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:48.195 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 -- 172.21.15.43:0/3195946933 shutdown_connections 2023-08-27T11:29:48.196 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.189+0000 7f0b273ff700 1 -- 172.21.15.43:0/3195946933 wait complete. 2023-08-27T11:29:48.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.191+0000 7f0b273ff700 1 Processor -- start 2023-08-27T11:29:48.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.191+0000 7f0b273ff700 1 -- start start 2023-08-27T11:29:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b200c5230 0x7f0b20146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 0x7f0b20147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200bb830 con 0x7f0b2006c5e0 2023-08-27T11:29:48.199 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20147640 con 0x7f0b20155880 2023-08-27T11:29:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b273ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20151d70 con 0x7f0b200c5230 2023-08-27T11:29:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:36146/0 (socket says 172.21.15.43:36146) 2023-08-27T11:29:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 -- 172.21.15.43:0/3208472296 learned_addr learned my addr 172.21.15.43:0/3208472296 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:48.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2599c700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 0x7f0b20147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2499a700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b200c5230 0x7f0b20146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 -- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b200c5230 msgr2=0x7f0b20146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b200c5230 0x7f0b20146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 -- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 msgr2=0x7f0b20147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 0x7f0b20147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2519b700 1 -- 172.21.15.43:0/3208472296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b18009a70 con 0x7f0b2006c5e0 2023-08-27T11:29:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.192+0000 7f0b2599c700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 0x7f0b20147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b2519b700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00e9b0 tx=0x7f0b1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c009710 con 0x7f0b2006c5e0 2023-08-27T11:29:48.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00c850 con 0x7f0b2006c5e0 2023-08-27T11:29:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b200717f0 con 0x7f0b2006c5e0 2023-08-27T11:29:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00cbc0 con 0x7f0b2006c5e0 2023-08-27T11:29:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.193+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200726a0 con 0x7f0b2006c5e0 2023-08-27T11:29:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.194+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2004ee70 con 0x7f0b2006c5e0 2023-08-27T11:29:48.203 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.195+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b1c00cd20 con 0x7f0b2006c5e0 2023-08-27T11:29:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.196+0000 7f0b15ffb700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 0x7f0b0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.196+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b1c088650 con 0x7f0b2006c5e0 2023-08-27T11:29:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.196+0000 7f0b2499a700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 0x7f0b0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:48.204 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.197+0000 7f0b2499a700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 0x7f0b0406c5a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0b20149b40 tx=0x7f0b10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:48.205 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.201+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0b1c057860 con 0x7f0b2006c5e0 2023-08-27T11:29:48.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.456+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "down", "val": "true"} v 0) v1 -- 0x7f0b2006ca80 con 0x7f0b2006c5e0 2023-08-27T11:29:48.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.970+0000 7f0b15ffb700 1 -- 172.21.15.43:0/3208472296 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "down", "val": "true"}]=0 cephfs marked down. v152) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0b1c0573f0 con 0x7f0b2006c5e0 2023-08-27T11:29:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 msgr2=0x7f0b0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 0x7f0b0406c5a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0b20149b40 tx=0x7f0b10009040 comp rx=0 tx=0).stop 2023-08-27T11:29:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 msgr2=0x7f0b200bab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:48.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00e9b0 tx=0x7f0b1c00ed70 comp rx=0 tx=0).stop 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 shutdown_connections 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0b0406a0e0 0x7f0b0406c5a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b20155880 0x7f0b20147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0b2006c5e0 0x7f0b200bab20 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 --2- 172.21.15.43:0/3208472296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0b200c5230 0x7f0b20146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:48.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 >> 172.21.15.43:0/3208472296 conn(0x7f0b200c5b10 msgr2=0x7f0b200aac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:48.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 shutdown_connections 2023-08-27T11:29:48.977 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:48.973+0000 7f0b273ff700 1 -- 172.21.15.43:0/3208472296 wait complete. 2023-08-27T11:29:48.977 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked down. 2023-08-27T11:29:48.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.201+0000 7fc31dbff700 1 Processor -- start 2023-08-27T11:29:49.202 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.201+0000 7fc31dbff700 1 -- start start 2023-08-27T11:29:49.206 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc31dbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc31806a310 0x7fc31806a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc31dbff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3180c6820 con 0x7fc31806e360 2023-08-27T11:29:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc31dbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3180c4a50 con 0x7fc318158190 2023-08-27T11:29:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc31dbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3180c23a0 con 0x7fc31806a310 2023-08-27T11:29:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc316ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc31806e360 0x7fc318157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38576/0 (socket says 172.21.15.43:38576) 2023-08-27T11:29:49.207 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.202+0000 7fc316ffd700 1 -- 172.21.15.43:0/787757045 learned_addr learned my addr 172.21.15.43:0/787757045 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3177fe700 1 --2- 172.21.15.43:0/787757045 >> v2:172.21.15.57:3300/0 conn(0x7fc31806a310 0x7fc31806a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68106154 0 0) 0x7fc3180c6820 con 0x7fc31806e360 2023-08-27T11:29:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3000035b0 con 0x7fc31806e360 2023-08-27T11:29:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534462440 0 0) 0x7fc3180c4a50 con 0x7fc318158190 2023-08-27T11:29:49.208 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3180c6820 con 0x7fc318158190 2023-08-27T11:29:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3613290863 0 0) 0x7fc3000035b0 con 0x7fc31806e360 2023-08-27T11:29:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 >> v2:172.21.15.57:3300/0 conn(0x7fc31806a310 msgr2=0x7fc31806a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 --2- 172.21.15.43:0/787757045 >> v2:172.21.15.57:3300/0 conn(0x7fc31806a310 0x7fc31806a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 >> v1:172.21.15.57:6789/0 conn(0x7fc318158190 legacy=0x7fc31815ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.209 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180c4d30 con 0x7fc31806e360 2023-08-27T11:29:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fc30c001670 con 0x7fc31806e360 2023-08-27T11:29:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 >> v1:172.21.15.43:6789/0 conn(0x7fc31806e360 legacy=0x7fc318157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 0x7fc300003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.210 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c0e0 con 0x7fc300003be0 2023-08-27T11:29:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c220 con 0x7fc300005210 2023-08-27T11:29:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c3e0 con 0x7fc300004850 2023-08-27T11:29:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.203+0000 7fc3177fe700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 0x7fc300003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.211 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc317fff700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc316ffd700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 -- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300004850 msgr2=0x7fc300004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300004850 0x7fc300004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 -- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc300005210 msgr2=0x7fc30000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:49.212 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc300005210 0x7fc30000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 -- 172.21.15.43:0/787757045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000035b0 con 0x7fc300003be0 2023-08-27T11:29:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc317fff700 1 -- 172.21.15.43:0/787757045 reap_dead start 2023-08-27T11:29:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3177fe700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 0x7fc300003fe0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc308009b60 tx=0x7fc300005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ad724b9da06294 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800e6c0 con 0x7fc300003be0 2023-08-27T11:29:49.213 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800e820 con 0x7fc300003be0 2023-08-27T11:29:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.204+0000 7fc3167fc700 1 -- 172.21.15.43:0/787757045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800eb90 con 0x7fc300003be0 2023-08-27T11:29:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 -- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 msgr2=0x7fc300003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 0x7fc300003fe0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc308009b60 tx=0x7fc300005880 comp rx=0 tx=0).stop 2023-08-27T11:29:49.214 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 -- 172.21.15.43:0/787757045 shutdown_connections 2023-08-27T11:29:49.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 --2- 172.21.15.43:0/787757045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc300003be0 0x7fc300003fe0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 -- 172.21.15.43:0/787757045 >> 172.21.15.43:0/787757045 conn(0x7fc3180a85e0 msgr2=0x7fc3180a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:49.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 -- 172.21.15.43:0/787757045 shutdown_connections 2023-08-27T11:29:49.215 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.205+0000 7fc31dbff700 1 -- 172.21.15.43:0/787757045 wait complete. 2023-08-27T11:29:49.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.207+0000 7fc31dbff700 1 Processor -- start 2023-08-27T11:29:49.218 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.207+0000 7fc31dbff700 1 -- start start 2023-08-27T11:29:49.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 0x7fc318150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3181537b0 0x7fc3180ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318155b40 con 0x7fc3180abf10 2023-08-27T11:29:49.219 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318153f40 con 0x7fc3181537b0 2023-08-27T11:29:49.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc31dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc318155580 con 0x7fc300003be0 2023-08-27T11:29:49.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47772/0 (socket says 172.21.15.43:47772) 2023-08-27T11:29:49.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 -- 172.21.15.43:0/520934593 learned_addr learned my addr 172.21.15.43:0/520934593 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:49.220 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc316ffd700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3181537b0 0x7fc3180ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc3177fe700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 0x7fc318150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 -- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 msgr2=0x7fc318150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 0x7fc318150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.221 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 -- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3181537b0 msgr2=0x7fc3180ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3181537b0 0x7fc3180ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc317fff700 1 -- 172.21.15.43:0/520934593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318155860 con 0x7fc3180abf10 2023-08-27T11:29:49.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.208+0000 7fc3177fe700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 0x7fc318150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:49.222 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc317fff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc31806b030 tx=0x7fc31000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:49.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310003c10 con 0x7fc3180abf10 2023-08-27T11:29:49.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310003d70 con 0x7fc3180abf10 2023-08-27T11:29:49.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000db70 con 0x7fc3180abf10 2023-08-27T11:29:49.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3181ed8e0 con 0x7fc3180abf10 2023-08-27T11:29:49.223 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.209+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3181508c0 con 0x7fc3180abf10 2023-08-27T11:29:49.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.210+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3181ed740 con 0x7fc3180abf10 2023-08-27T11:29:49.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.211+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc31000dcd0 con 0x7fc3180abf10 2023-08-27T11:29:49.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.212+0000 7fc2fffff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 0x7fc30406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:49.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.212+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3100887c0 con 0x7fc3180abf10 2023-08-27T11:29:49.224 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.212+0000 7fc3177fe700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 0x7fc30406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:49.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.213+0000 7fc3177fe700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 0x7fc30406c5a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc3080090b0 tx=0x7fc308008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:49.225 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.216+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc3181ed740 con 0x7fc3180abf10 2023-08-27T11:29:49.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.473+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3181ed740 con 0x7fc3180abf10 2023-08-27T11:29:49.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.473+0000 7fc2fffff700 1 -- 172.21.15.43:0/520934593 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7fc3181ed740 con 0x7fc3180abf10 2023-08-27T11:29:49.475 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:49.475 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:49.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 msgr2=0x7fc30406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 0x7fc30406c5a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc3080090b0 tx=0x7fc308008030 comp rx=0 tx=0).stop 2023-08-27T11:29:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 msgr2=0x7fc3181e9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc31806b030 tx=0x7fc31000d430 comp rx=0 tx=0).stop 2023-08-27T11:29:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 shutdown_connections 2023-08-27T11:29:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc30406a0e0 0x7fc30406c5a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc3180abf10 0x7fc3181e9ad0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc300003be0 0x7fc318150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 --2- 172.21.15.43:0/520934593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc3181537b0 0x7fc3180ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 >> 172.21.15.43:0/520934593 conn(0x7fc3180a85e0 msgr2=0x7fc3180c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 shutdown_connections 2023-08-27T11:29:49.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:49.476+0000 7fc31dbff700 1 -- 172.21.15.43:0/520934593 wait complete. 2023-08-27T11:29:49.480 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:49.901 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:49.901 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:29:50.903 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:51.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.152+0000 7f04877ff700 1 Processor -- start 2023-08-27T11:29:51.154 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.153+0000 7f04877ff700 1 -- start start 2023-08-27T11:29:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0480151a90 0x7f04800c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 0x7f048006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048006c4e0 con 0x7f0480151a90 2023-08-27T11:29:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0480155370 con 0x7f048006ad70 2023-08-27T11:29:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f04877ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0480151e70 con 0x7f04800c4630 2023-08-27T11:29:51.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0480151a90 0x7f04800c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0480151a90 0x7f04800c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47778/0 (socket says 172.21.15.43:47778) 2023-08-27T11:29:51.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 -- 172.21.15.43:0/156891919 learned_addr learned my addr 172.21.15.43:0/156891919 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:51.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f0484d9a700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f0485d9c700 1 --2- 172.21.15.43:0/156891919 >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 0x7f048006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 -- 172.21.15.43:0/156891919 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 msgr2=0x7f04800c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:51.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 -- 172.21.15.43:0/156891919 >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 msgr2=0x7f048006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:51.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 --2- 172.21.15.43:0/156891919 >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 0x7f048006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.154+0000 7f048559b700 1 -- 172.21.15.43:0/156891919 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480154480 con 0x7f0480151a90 2023-08-27T11:29:51.159 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.155+0000 7f0485d9c700 1 --2- 172.21.15.43:0/156891919 >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 0x7f048006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:51.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.155+0000 7f048559b700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0480151a90 0x7f04800c7bb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f04800bd700 tx=0x7f047c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a2d2c03eedfe3 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:51.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.155+0000 7f0477fff700 1 -- 172.21.15.43:0/156891919 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c00b870 con 0x7f0480151a90 2023-08-27T11:29:51.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.155+0000 7f0477fff700 1 -- 172.21.15.43:0/156891919 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c00b9d0 con 0x7f0480151a90 2023-08-27T11:29:51.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.155+0000 7f0477fff700 1 -- 172.21.15.43:0/156891919 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c00bd60 con 0x7f0480151a90 2023-08-27T11:29:51.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 -- 172.21.15.43:0/156891919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0480151a90 msgr2=0x7f04800c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0480151a90 0x7f04800c7bb0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f04800bd700 tx=0x7f047c009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 -- 172.21.15.43:0/156891919 shutdown_connections 2023-08-27T11:29:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 --2- 172.21.15.43:0/156891919 >> v2:172.21.15.57:3300/0 conn(0x7f048006ad70 0x7f048006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0480151a90 0x7f04800c7bb0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 --2- 172.21.15.43:0/156891919 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 -- 172.21.15.43:0/156891919 >> 172.21.15.43:0/156891919 conn(0x7f04800ab820 msgr2=0x7f04800abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 -- 172.21.15.43:0/156891919 shutdown_connections 2023-08-27T11:29:51.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.156+0000 7f04877ff700 1 -- 172.21.15.43:0/156891919 wait complete. 2023-08-27T11:29:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.157+0000 7f04877ff700 1 Processor -- start 2023-08-27T11:29:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 -- start start 2023-08-27T11:29:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 0x7f0480152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04800c7960 con 0x7f048006ad70 2023-08-27T11:29:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04801562b0 con 0x7f0480151a90 2023-08-27T11:29:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.158+0000 7f04877ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04800ab4a0 con 0x7f04800c4630 2023-08-27T11:29:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47786/0 (socket says 172.21.15.43:47786) 2023-08-27T11:29:51.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 -- 172.21.15.43:0/3141808714 learned_addr learned my addr 172.21.15.43:0/3141808714 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:51.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f0484d9a700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f0485d9c700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 0x7f0480152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 -- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 msgr2=0x7f04800aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:51.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 -- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 msgr2=0x7f0480152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 0x7f0480152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 -- 172.21.15.43:0/3141808714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c009550 con 0x7f048006ad70 2023-08-27T11:29:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f0484d9a700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:51.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f0485d9c700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 0x7f0480152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:29:51.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.159+0000 7f048559b700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f047c000c00 tx=0x7f047c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:51.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.160+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c004520 con 0x7f048006ad70 2023-08-27T11:29:51.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.160+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c01e070 con 0x7f048006ad70 2023-08-27T11:29:51.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.160+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c0038c0 con 0x7f048006ad70 2023-08-27T11:29:51.170 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.160+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04800c7e20 con 0x7f048006ad70 2023-08-27T11:29:51.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.160+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04801ea2f0 con 0x7f048006ad70 2023-08-27T11:29:51.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.161+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048004ee70 con 0x7f048006ad70 2023-08-27T11:29:51.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.162+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f047c003a20 con 0x7f048006ad70 2023-08-27T11:29:51.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.162+0000 7f0475ffb700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 0x7f046406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:51.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.163+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f047c020070 con 0x7f048006ad70 2023-08-27T11:29:51.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.163+0000 7f0484d9a700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 0x7f046406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:51.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.163+0000 7f0484d9a700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 0x7f046406c5d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f04800c9b10 tx=0x7f0470008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:51.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.167+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f047c0551c0 con 0x7f048006ad70 2023-08-27T11:29:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.428+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f048006c130 con 0x7f048006ad70 2023-08-27T11:29:51.430 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.429+0000 7f0475ffb700 1 -- 172.21.15.43:0/3141808714 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f047c015090 con 0x7f048006ad70 2023-08-27T11:29:51.431 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:51.431 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:51.432 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 msgr2=0x7f046406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 0x7f046406c5d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f04800c9b10 tx=0x7f0470008040 comp rx=0 tx=0).stop 2023-08-27T11:29:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 msgr2=0x7f04801584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f047c000c00 tx=0x7f047c004750 comp rx=0 tx=0).stop 2023-08-27T11:29:51.433 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 shutdown_connections 2023-08-27T11:29:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f046406a110 0x7f046406c5d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0480151a90 0x7f0480152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f048006ad70 0x7f04801584b0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 --2- 172.21.15.43:0/3141808714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f04800c4630 0x7f04800aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:51.434 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 >> 172.21.15.43:0/3141808714 conn(0x7f04800ab820 msgr2=0x7f048014b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.431+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 shutdown_connections 2023-08-27T11:29:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:51.432+0000 7f04877ff700 1 -- 172.21.15.43:0/3141808714 wait complete. 2023-08-27T11:29:51.435 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:51.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:51.853 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:29:52.854 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:53.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.069+0000 7f8add9ff700 1 Processor -- start 2023-08-27T11:29:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.069+0000 7f8add9ff700 1 -- start start 2023-08-27T11:29:53.071 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.070+0000 7f8add9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.070+0000 7f8add9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ad8155910 0x7f8ad8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.070+0000 7f8add9ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad806d700 con 0x7f8ad806ca60 2023-08-27T11:29:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.070+0000 7f8add9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad81530b0 con 0x7f8ad8155910 2023-08-27T11:29:53.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.070+0000 7f8add9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad814c860 con 0x7f8ad80c51a0 2023-08-27T11:29:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ad8155910 0x7f8ad8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad67fc700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8ad806ca60 0x7f8ad80aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38588/0 (socket says 172.21.15.43:38588) 2023-08-27T11:29:53.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad67fc700 1 -- 172.21.15.43:0/2311604635 learned_addr learned my addr 172.21.15.43:0/2311604635 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:53.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad6ffd700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 -- 172.21.15.43:0/2311604635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 msgr2=0x7f8ad806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:53.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 -- 172.21.15.43:0/2311604635 >> v1:172.21.15.43:6789/0 conn(0x7f8ad806ca60 legacy=0x7f8ad80aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 -- 172.21.15.43:0/2311604635 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8152430 con 0x7f8ad8155910 2023-08-27T11:29:53.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad5ffb700 1 -- 172.21.15.43:0/2311604635 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730389945 0 0) 0x7f8ad806d700 con 0x7f8ad806ca60 2023-08-27T11:29:53.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad6ffd700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:29:53.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.071+0000 7f8ad77fe700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad8155da0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009dc0 tx=0x7f8ad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f579094764c01319 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:53.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8ad5ffb700 1 -- 172.21.15.43:0/2311604635 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000e070 con 0x7f8ad8155910 2023-08-27T11:29:53.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8ad5ffb700 1 -- 172.21.15.43:0/2311604635 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000bb90 con 0x7f8ad8155910 2023-08-27T11:29:53.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8ad5ffb700 1 -- 172.21.15.43:0/2311604635 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0012430 con 0x7f8ad8155910 2023-08-27T11:29:53.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 -- 172.21.15.43:0/2311604635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 msgr2=0x7f8ad8155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad8155da0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009dc0 tx=0x7f8ad000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:53.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 -- 172.21.15.43:0/2311604635 shutdown_connections 2023-08-27T11:29:53.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad8155da0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 --2- 172.21.15.43:0/2311604635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 -- 172.21.15.43:0/2311604635 >> 172.21.15.43:0/2311604635 conn(0x7f8ad806aa50 msgr2=0x7f8ad80c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:53.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 -- 172.21.15.43:0/2311604635 shutdown_connections 2023-08-27T11:29:53.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.072+0000 7f8add9ff700 1 -- 172.21.15.43:0/2311604635 wait complete. 2023-08-27T11:29:53.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.074+0000 7f8add9ff700 1 Processor -- start 2023-08-27T11:29:53.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.074+0000 7f8add9ff700 1 -- start start 2023-08-27T11:29:53.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ad806ca60 0x7f8ad80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad80bc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.082 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad8072610 con 0x7f8ad8155910 2023-08-27T11:29:53.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a5e50 con 0x7f8ad806ca60 2023-08-27T11:29:53.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8add9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad80a8130 con 0x7f8ad80c51a0 2023-08-27T11:29:53.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8ad77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.083 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8ad77fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47800/0 (socket says 172.21.15.43:47800) 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8ad77fe700 1 -- 172.21.15.43:0/3259184756 learned_addr learned my addr 172.21.15.43:0/3259184756 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8ad67fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad80bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.075+0000 7f8ad6ffd700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ad806ca60 0x7f8ad80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 -- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 msgr2=0x7f8ad80bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad80bc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.084 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 -- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ad806ca60 msgr2=0x7f8ad80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ad806ca60 0x7f8ad80720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 -- 172.21.15.43:0/3259184756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0009a70 con 0x7f8ad8155910 2023-08-27T11:29:53.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8ad77fe700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0014040 tx=0x7f8ad0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:53.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0012430 con 0x7f8ad8155910 2023-08-27T11:29:53.085 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad0020070 con 0x7f8ad8155910 2023-08-27T11:29:53.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad80a76c0 con 0x7f8ad8155910 2023-08-27T11:29:53.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.076+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0004280 con 0x7f8ad8155910 2023-08-27T11:29:53.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.077+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad80a6380 con 0x7f8ad8155910 2023-08-27T11:29:53.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.077+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad80a82e0 con 0x7f8ad8155910 2023-08-27T11:29:53.086 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.079+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8ad00043e0 con 0x7f8ad8155910 2023-08-27T11:29:53.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.079+0000 7f8abffff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 0x7f8ac406c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:53.087 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.080+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ad0022070 con 0x7f8ad8155910 2023-08-27T11:29:53.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.080+0000 7f8ad6ffd700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 0x7f8ac406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:53.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.080+0000 7f8ad6ffd700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 0x7f8ac406c570 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006fd0 tx=0x7f8ac8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:53.088 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.084+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8ad80a82e0 con 0x7f8ad8155910 2023-08-27T11:29:53.341 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.340+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ad80a82a0 con 0x7f8ad8155910 2023-08-27T11:29:53.342 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.340+0000 7f8abffff700 1 -- 172.21.15.43:0/3259184756 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f8ad0056230 con 0x7f8ad8155910 2023-08-27T11:29:53.342 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:53.342 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:53.344 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 msgr2=0x7f8ac406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 0x7f8ac406c570 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8006fd0 tx=0x7f8ac8008040 comp rx=0 tx=0).stop 2023-08-27T11:29:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 msgr2=0x7f8ad80a9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0014040 tx=0x7f8ad0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 shutdown_connections 2023-08-27T11:29:53.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8ac406a0b0 0x7f8ac406c570 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad8155910 0x7f8ad80a9630 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8ad806ca60 0x7f8ad80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 --2- 172.21.15.43:0/3259184756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8ad80c51a0 0x7f8ad80bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 >> 172.21.15.43:0/3259184756 conn(0x7f8ad806aa50 msgr2=0x7f8ad80aab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 shutdown_connections 2023-08-27T11:29:53.346 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:53.343+0000 7f8add9ff700 1 -- 172.21.15.43:0/3259184756 wait complete. 2023-08-27T11:29:53.347 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:53.765 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:53.766 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:29:54.767 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:54.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.977+0000 7f8e50bff700 1 Processor -- start 2023-08-27T11:29:54.978 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.977+0000 7f8e50bff700 1 -- start start 2023-08-27T11:29:54.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.978+0000 7f8e50bff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 0x7f8e4c06ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.978+0000 7f8e50bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 0x7f8e4c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e50bff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0c1750 con 0x7f8e4c154da0 2023-08-27T11:29:54.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e50bff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c2820 con 0x7f8e4c14e380 2023-08-27T11:29:54.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e50bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c158910 con 0x7f8e4c06dff0 2023-08-27T11:29:54.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e43fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8e4c154da0 0x7f8e4c158200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38602/0 (socket says 172.21.15.43:38602) 2023-08-27T11:29:54.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e43fff700 1 -- 172.21.15.43:0/1909564096 learned_addr learned my addr 172.21.15.43:0/1909564096 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:54.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e4a59c700 1 --2- 172.21.15.43:0/1909564096 >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 0x7f8e4c06ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e4ad9d700 1 --2- 172.21.15.43:0/1909564096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 0x7f8e4c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e49d9b700 1 -- 172.21.15.43:0/1909564096 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096289077 0 0) 0x7f8e4c0c1750 con 0x7f8e4c154da0 2023-08-27T11:29:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.979+0000 7f8e49d9b700 1 -- 172.21.15.43:0/1909564096 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e380035b0 con 0x7f8e4c154da0 2023-08-27T11:29:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4ad9d700 1 -- 172.21.15.43:0/1909564096 >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 msgr2=0x7f8e4c06ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4ad9d700 1 --2- 172.21.15.43:0/1909564096 >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 0x7f8e4c06ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4ad9d700 1 -- 172.21.15.43:0/1909564096 >> v1:172.21.15.43:6789/0 conn(0x7f8e4c154da0 legacy=0x7f8e4c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:54.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4ad9d700 1 -- 172.21.15.43:0/1909564096 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0c1a30 con 0x7f8e4c06dff0 2023-08-27T11:29:54.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4a59c700 1 --2- 172.21.15.43:0/1909564096 >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 0x7f8e4c06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e4ad9d700 1 --2- 172.21.15.43:0/1909564096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 0x7f8e4c06e4a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009d90 tx=0x7f8e4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=474710bbf81c5a0e server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e49d9b700 1 -- 172.21.15.43:0/1909564096 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400e070 con 0x7f8e4c06dff0 2023-08-27T11:29:54.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e49d9b700 1 -- 172.21.15.43:0/1909564096 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4400bb20 con 0x7f8e4c06dff0 2023-08-27T11:29:54.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.980+0000 7f8e49d9b700 1 -- 172.21.15.43:0/1909564096 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400be90 con 0x7f8e4c06dff0 2023-08-27T11:29:54.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 -- 172.21.15.43:0/1909564096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 msgr2=0x7f8e4c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:54.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1909564096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 0x7f8e4c06e4a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009d90 tx=0x7f8e4400b330 comp rx=0 tx=0).stop 2023-08-27T11:29:54.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 -- 172.21.15.43:0/1909564096 shutdown_connections 2023-08-27T11:29:54.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1909564096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c06dff0 0x7f8e4c06e4a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1909564096 >> v2:172.21.15.57:3300/0 conn(0x7f8e4c14e380 0x7f8e4c06ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 -- 172.21.15.43:0/1909564096 >> 172.21.15.43:0/1909564096 conn(0x7f8e4c0c2c30 msgr2=0x7f8e4c0c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 -- 172.21.15.43:0/1909564096 shutdown_connections 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.981+0000 7f8e50bff700 1 -- 172.21.15.43:0/1909564096 wait complete. 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.983+0000 7f8e50bff700 1 Processor -- start 2023-08-27T11:29:54.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.983+0000 7f8e50bff700 1 -- start start 2023-08-27T11:29:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c14e380 0x7f8e4c146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4c154da0 0x7f8e4c146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1ed630 con 0x7f8e4c06dff0 2023-08-27T11:29:54.990 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14d050 con 0x7f8e4c154da0 2023-08-27T11:29:54.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e50bff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14d250 con 0x7f8e4c14e380 2023-08-27T11:29:54.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47808/0 (socket says 172.21.15.43:47808) 2023-08-27T11:29:54.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 -- 172.21.15.43:0/1596292014 learned_addr learned my addr 172.21.15.43:0/1596292014 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:54.991 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4ad9d700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4c154da0 0x7f8e4c146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e43fff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c14e380 0x7f8e4c146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 -- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c14e380 msgr2=0x7f8e4c146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:54.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c14e380 0x7f8e4c146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:54.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 -- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4c154da0 msgr2=0x7f8e4c146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:54.992 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4c154da0 0x7f8e4c146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:54.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.985+0000 7f8e4a59c700 1 -- 172.21.15.43:0/1596292014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094a0 con 0x7f8e4c06dff0 2023-08-27T11:29:54.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e4a59c700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebe0 tx=0x7f8e3c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:54.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00c850 con 0x7f8e4c06dff0 2023-08-27T11:29:54.993 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00c9b0 con 0x7f8e4c06dff0 2023-08-27T11:29:54.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e44009a70 con 0x7f8e4c06dff0 2023-08-27T11:29:54.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00cd40 con 0x7f8e4c06dff0 2023-08-27T11:29:54.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.986+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c14d5e0 con 0x7f8e4c06dff0 2023-08-27T11:29:54.994 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.987+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c155850 con 0x7f8e4c06dff0 2023-08-27T11:29:54.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.990+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e3c013470 con 0x7f8e4c06dff0 2023-08-27T11:29:54.995 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.991+0000 7f8e42ffd700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 0x7f8e2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:54.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.991+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e3c088e20 con 0x7f8e4c06dff0 2023-08-27T11:29:54.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.991+0000 7f8e43fff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 0x7f8e2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:54.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.992+0000 7f8e43fff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 0x7f8e2c06c5a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:54.996 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:54.994+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e3c0544f0 con 0x7f8e4c06dff0 2023-08-27T11:29:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.250+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e4c0c1ce0 con 0x7f8e4c06dff0 2023-08-27T11:29:55.251 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.250+0000 7f8e42ffd700 1 -- 172.21.15.43:0/1596292014 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f8e3c00cea0 con 0x7f8e4c06dff0 2023-08-27T11:29:55.252 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:55.252 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:55.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.252+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 msgr2=0x7f8e2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:55.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.252+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 0x7f8e2c06c5a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8e34007fd0 tx=0x7f8e34009040 comp rx=0 tx=0).stop 2023-08-27T11:29:55.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.252+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 msgr2=0x7f8e4c14e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:55.254 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.252+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00ebe0 tx=0x7f8e3c00eef0 comp rx=0 tx=0).stop 2023-08-27T11:29:55.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 shutdown_connections 2023-08-27T11:29:55.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8e2c06a0e0 0x7f8e2c06c5a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:55.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e4c154da0 0x7f8e4c146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:55.255 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8e4c06dff0 0x7f8e4c14e9a0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:55.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 --2- 172.21.15.43:0/1596292014 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4c14e380 0x7f8e4c146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:55.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 >> 172.21.15.43:0/1596292014 conn(0x7f8e4c0c2c30 msgr2=0x7f8e4c158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:55.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 shutdown_connections 2023-08-27T11:29:55.256 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:55.253+0000 7f8e50bff700 1 -- 172.21.15.43:0/1596292014 wait complete. 2023-08-27T11:29:55.257 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:55.674 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:55.675 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:29:56.676 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:56.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.888+0000 7f6ee15ff700 1 Processor -- start 2023-08-27T11:29:56.890 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.889+0000 7f6ee15ff700 1 -- start start 2023-08-27T11:29:56.891 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6ee15ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6edc14e960 0x7f6edc0a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6ee15ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6ee15ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc154d00 con 0x7f6edc0c50d0 2023-08-27T11:29:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6ee15ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc0baf30 con 0x7f6edc0a79c0 2023-08-27T11:29:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6ee15ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc154fe0 con 0x7f6edc14e960 2023-08-27T11:29:56.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6eda7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6eda7fc700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47810/0 (socket says 172.21.15.43:47810) 2023-08-27T11:29:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6eda7fc700 1 -- 172.21.15.43:0/2075470270 learned_addr learned my addr 172.21.15.43:0/2075470270 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6edb7fe700 1 --1- 172.21.15.43:0/2075470270 >> v1:172.21.15.43:6789/0 conn(0x7f6edc0c50d0 0x7f6edc0c4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38614/0 (socket says 172.21.15.43:38614) 2023-08-27T11:29:56.893 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.890+0000 7f6edaffd700 1 --2- 172.21.15.43:0/2075470270 >> v2:172.21.15.57:3300/0 conn(0x7f6edc14e960 0x7f6edc0a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6eda7fc700 1 -- 172.21.15.43:0/2075470270 >> v2:172.21.15.57:3300/0 conn(0x7f6edc14e960 msgr2=0x7f6edc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:29:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6eda7fc700 1 --2- 172.21.15.43:0/2075470270 >> v2:172.21.15.57:3300/0 conn(0x7f6edc14e960 0x7f6edc0a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6eda7fc700 1 -- 172.21.15.43:0/2075470270 >> v1:172.21.15.43:6789/0 conn(0x7f6edc0c50d0 legacy=0x7f6edc0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6eda7fc700 1 -- 172.21.15.43:0/2075470270 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc1552c0 con 0x7f6edc0a79c0 2023-08-27T11:29:56.894 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6ed9ffb700 1 -- 172.21.15.43:0/2075470270 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036058791 0 0) 0x7f6edc154d00 con 0x7f6edc0c50d0 2023-08-27T11:29:56.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6eda7fc700 1 --2- 172.21.15.43:0/2075470270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f6edc06da20 tx=0x7f6ed0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9512ababa572866 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:56.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6ed9ffb700 1 -- 172.21.15.43:0/2075470270 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000b870 con 0x7f6edc0a79c0 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6ed9ffb700 1 -- 172.21.15.43:0/2075470270 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000b9d0 con 0x7f6edc0a79c0 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.891+0000 7f6ed9ffb700 1 -- 172.21.15.43:0/2075470270 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000bd60 con 0x7f6edc0a79c0 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 -- 172.21.15.43:0/2075470270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc0a79c0 msgr2=0x7f6edc0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/2075470270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f6edc06da20 tx=0x7f6ed0009bd0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 -- 172.21.15.43:0/2075470270 shutdown_connections 2023-08-27T11:29:56.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/2075470270 >> v2:172.21.15.57:3300/0 conn(0x7f6edc14e960 0x7f6edc0a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/2075470270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0c3cc0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 -- 172.21.15.43:0/2075470270 >> 172.21.15.43:0/2075470270 conn(0x7f6edc06aa50 msgr2=0x7f6edc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:56.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 -- 172.21.15.43:0/2075470270 shutdown_connections 2023-08-27T11:29:56.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.892+0000 7f6ee15ff700 1 -- 172.21.15.43:0/2075470270 wait complete. 2023-08-27T11:29:56.899 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.894+0000 7f6ee15ff700 1 Processor -- start 2023-08-27T11:29:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.894+0000 7f6ee15ff700 1 -- start start 2023-08-27T11:29:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 0x7f6edc145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.900 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0a8a20 con 0x7f6edc14e960 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0ab670 con 0x7f6edc0a79c0 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6ee15ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc151f90 con 0x7f6edc0c50d0 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6eda7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 0x7f6edc145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6edb7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47814/0 (socket says 172.21.15.43:47814) 2023-08-27T11:29:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6edaffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.43:47562/0 (socket says 172.21.15.43:47562) 2023-08-27T11:29:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.895+0000 7f6edaffd700 1 -- 172.21.15.43:0/3863827999 learned_addr learned my addr 172.21.15.43:0/3863827999 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 -- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 msgr2=0x7f6edc145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 0x7f6edc145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 -- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 msgr2=0x7f6edc0aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 -- 172.21.15.43:0/3863827999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009550 con 0x7f6edc14e960 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edaffd700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6eda7fc700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 0x7f6edc145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6edb7fe700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cbe0 tx=0x7f6ed400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:56.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed400aa40 con 0x7f6edc14e960 2023-08-27T11:29:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed400abc0 con 0x7f6edc14e960 2023-08-27T11:29:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40070d0 con 0x7f6edc14e960 2023-08-27T11:29:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0ab910 con 0x7f6edc14e960 2023-08-27T11:29:56.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.896+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc151380 con 0x7f6edc14e960 2023-08-27T11:29:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.897+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc0bb390 con 0x7f6edc14e960 2023-08-27T11:29:56.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.898+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ed4007230 con 0x7f6edc14e960 2023-08-27T11:29:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.899+0000 7f6ec37fe700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 0x7f6ec806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.899+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ed4087e90 con 0x7f6edc14e960 2023-08-27T11:29:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.899+0000 7f6edaffd700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 0x7f6ec806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.900+0000 7f6edaffd700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 0x7f6ec806c5a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc007ee0 tx=0x7f6ecc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:56.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:56.904+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6ed4053570 con 0x7f6edc14e960 2023-08-27T11:29:57.157 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.156+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6edc0a87f0 con 0x7f6edc14e960 2023-08-27T11:29:57.158 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.157+0000 7f6ec37fe700 1 -- 172.21.15.43:0/3863827999 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f6edc0a87f0 con 0x7f6edc14e960 2023-08-27T11:29:57.158 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:57.158 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:57.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 msgr2=0x7f6ec806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:57.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 0x7f6ec806c5a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc007ee0 tx=0x7f6ecc008040 comp rx=0 tx=0).stop 2023-08-27T11:29:57.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 msgr2=0x7f6edc150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:57.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400cbe0 tx=0x7f6ed400cef0 comp rx=0 tx=0).stop 2023-08-27T11:29:57.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 shutdown_connections 2023-08-27T11:29:57.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6ec806a0e0 0x7f6ec806c5a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6edc14e960 0x7f6edc150e40 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6edc0a79c0 0x7f6edc0aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 --2- 172.21.15.43:0/3863827999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6edc0c50d0 0x7f6edc145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 >> 172.21.15.43:0/3863827999 conn(0x7f6edc06aa50 msgr2=0x7f6edc0a62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 shutdown_connections 2023-08-27T11:29:57.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:57.159+0000 7f6ee15ff700 1 -- 172.21.15.43:0/3863827999 wait complete. 2023-08-27T11:29:57.163 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:57.581 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:57.581 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:29:58.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:29:58.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.794+0000 7fc6805ff700 1 Processor -- start 2023-08-27T11:29:58.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.794+0000 7fc6805ff700 1 -- start start 2023-08-27T11:29:58.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.795+0000 7fc6805ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc67806d1c0 0x7fc678156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.795+0000 7fc6805ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc678152430 con 0x7fc67806ca60 2023-08-27T11:29:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.795+0000 7fc6805ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc678152710 con 0x7fc6780c51a0 2023-08-27T11:29:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.795+0000 7fc6805ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6781530b0 con 0x7fc67806d1c0 2023-08-27T11:29:58.797 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.795+0000 7fc67db9a700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc67806ca60 0x7fc678155910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38626/0 (socket says 172.21.15.43:38626) 2023-08-27T11:29:58.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67db9a700 1 -- 172.21.15.43:0/1261599003 learned_addr learned my addr 172.21.15.43:0/1261599003 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:29:58.798 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67eb9c700 1 --2- 172.21.15.43:0/1261599003 >> v2:172.21.15.57:3300/0 conn(0x7fc67806d1c0 0x7fc678156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:58.799 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67d399700 1 -- 172.21.15.43:0/1261599003 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709669549 0 0) 0x7fc678152430 con 0x7fc67806ca60 2023-08-27T11:29:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67d399700 1 -- 172.21.15.43:0/1261599003 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6640035b0 con 0x7fc67806ca60 2023-08-27T11:29:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67eb9c700 1 -- 172.21.15.43:0/1261599003 >> v1:172.21.15.57:6789/0 conn(0x7fc6780c51a0 legacy=0x7fc6780aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67eb9c700 1 -- 172.21.15.43:0/1261599003 >> v1:172.21.15.43:6789/0 conn(0x7fc67806ca60 legacy=0x7fc678155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:58.800 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.796+0000 7fc67eb9c700 1 -- 172.21.15.43:0/1261599003 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6781529f0 con 0x7fc67806d1c0 2023-08-27T11:29:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc67eb9c700 1 --2- 172.21.15.43:0/1261599003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc678156020 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc670009d90 tx=0x7fc67000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b020f6c3c94df8 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc67d399700 1 -- 172.21.15.43:0/1261599003 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000e070 con 0x7fc67806d1c0 2023-08-27T11:29:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc67d399700 1 -- 172.21.15.43:0/1261599003 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67000bb20 con 0x7fc67806d1c0 2023-08-27T11:29:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc67d399700 1 -- 172.21.15.43:0/1261599003 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670012430 con 0x7fc67806d1c0 2023-08-27T11:29:58.801 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 -- 172.21.15.43:0/1261599003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 msgr2=0x7fc678156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 --2- 172.21.15.43:0/1261599003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc678156020 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc670009d90 tx=0x7fc67000b330 comp rx=0 tx=0).stop 2023-08-27T11:29:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 -- 172.21.15.43:0/1261599003 shutdown_connections 2023-08-27T11:29:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 --2- 172.21.15.43:0/1261599003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc678156020 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 -- 172.21.15.43:0/1261599003 >> 172.21.15.43:0/1261599003 conn(0x7fc67806aa50 msgr2=0x7fc6780c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:58.802 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.797+0000 7fc6805ff700 1 -- 172.21.15.43:0/1261599003 shutdown_connections 2023-08-27T11:29:58.803 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.798+0000 7fc6805ff700 1 -- 172.21.15.43:0/1261599003 wait complete. 2023-08-27T11:29:58.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.799+0000 7fc6805ff700 1 Processor -- start 2023-08-27T11:29:58.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.799+0000 7fc6805ff700 1 -- start start 2023-08-27T11:29:58.805 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc67806ca60 0x7fc6781e9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc6780c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc678151500 con 0x7fc6780c51a0 2023-08-27T11:29:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6781506a0 con 0x7fc67806d1c0 2023-08-27T11:29:58.806 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc6805ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6781511b0 con 0x7fc67806ca60 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.800+0000 7fc67eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:47830/0 (socket says 172.21.15.43:47830) 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 -- 172.21.15.43:0/2906948904 learned_addr learned my addr 172.21.15.43:0/2906948904 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67db9a700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc6780c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67e39b700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc67806ca60 0x7fc6781e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:58.807 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 -- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc67806ca60 msgr2=0x7fc6781e9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc67806ca60 0x7fc6781e9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 -- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 msgr2=0x7fc6780c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc6780c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 -- 172.21.15.43:0/2906948904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc670009a70 con 0x7fc6780c51a0 2023-08-27T11:29:58.808 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.801+0000 7fc67eb9c700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc67000b680 tx=0x7fc670004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:58.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.802+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670012430 con 0x7fc6780c51a0 2023-08-27T11:29:58.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.802+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc670020070 con 0x7fc6780c51a0 2023-08-27T11:29:58.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.802+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6781e9bb0 con 0x7fc6780c51a0 2023-08-27T11:29:58.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.802+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc670004280 con 0x7fc6780c51a0 2023-08-27T11:29:58.809 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.802+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6781ea130 con 0x7fc6780c51a0 2023-08-27T11:29:58.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.803+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67804ee70 con 0x7fc6780c51a0 2023-08-27T11:29:58.810 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.804+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6700043e0 con 0x7fc6780c51a0 2023-08-27T11:29:58.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.805+0000 7fc66effd700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 0x7fc65c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:29:58.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.805+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc670022070 con 0x7fc6780c51a0 2023-08-27T11:29:58.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.805+0000 7fc67e39b700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 0x7fc65c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:29:58.811 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.806+0000 7fc67e39b700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 0x7fc65c06c5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc674000f60 tx=0x7fc674009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:29:58.812 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:58.810+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc670055990 con 0x7fc6780c51a0 2023-08-27T11:29:59.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.063+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc67806c840 con 0x7fc6780c51a0 2023-08-27T11:29:59.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.064+0000 7fc66effd700 1 -- 172.21.15.43:0/2906948904 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7fc670058fb0 con 0x7fc6780c51a0 2023-08-27T11:29:59.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:29:59.066 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:29:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 msgr2=0x7fc65c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 0x7fc65c06c5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc674000f60 tx=0x7fc674009040 comp rx=0 tx=0).stop 2023-08-27T11:29:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 msgr2=0x7fc678151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:29:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fc67000b680 tx=0x7fc670004ad0 comp rx=0 tx=0).stop 2023-08-27T11:29:59.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 shutdown_connections 2023-08-27T11:29:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fc65c06a0e0 0x7fc65c06c5a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6780c51a0 0x7fc678151920 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc67806ca60 0x7fc6781e9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 --2- 172.21.15.43:0/2906948904 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc67806d1c0 0x7fc6780c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:29:59.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.066+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 >> 172.21.15.43:0/2906948904 conn(0x7fc67806aa50 msgr2=0x7fc67814bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:29:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.067+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 shutdown_connections 2023-08-27T11:29:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:29:59.067+0000 7fc6805ff700 1 -- 172.21.15.43:0/2906948904 wait complete. 2023-08-27T11:29:59.070 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:29:59.489 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:29:59.490 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:30:00.491 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:00.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.713+0000 7f57e39ff700 1 Processor -- start 2023-08-27T11:30:00.715 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.714+0000 7f57e39ff700 1 -- start start 2023-08-27T11:30:00.717 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e39ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57dc06ca60 0x7f57dc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e39ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc06d700 con 0x7f57dc0c51a0 2023-08-27T11:30:00.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e39ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc1530b0 con 0x7f57dc06ca60 2023-08-27T11:30:00.718 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc14c860 con 0x7f57dc155910 2023-08-27T11:30:00.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e179b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f57dc0c51a0 0x7f57dc0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42092/0 (socket says 172.21.15.43:42092) 2023-08-27T11:30:00.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e179b700 1 -- 172.21.15.43:0/500961756 learned_addr learned my addr 172.21.15.43:0/500961756 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:00.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e1f9c700 1 --2- 172.21.15.43:0/500961756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.719 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57e0f9a700 1 --2- 172.21.15.43:0/500961756 >> v2:172.21.15.57:3300/0 conn(0x7f57dc06ca60 0x7f57dc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.715+0000 7f57d3fff700 1 -- 172.21.15.43:0/500961756 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698116450 0 0) 0x7f57dc06d700 con 0x7f57dc0c51a0 2023-08-27T11:30:00.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57d3fff700 1 -- 172.21.15.43:0/500961756 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c80035b0 con 0x7f57dc0c51a0 2023-08-27T11:30:00.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57e1f9c700 1 -- 172.21.15.43:0/500961756 >> v2:172.21.15.57:3300/0 conn(0x7f57dc06ca60 msgr2=0x7f57dc06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:00.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57e1f9c700 1 --2- 172.21.15.43:0/500961756 >> v2:172.21.15.57:3300/0 conn(0x7f57dc06ca60 0x7f57dc06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.720 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57e1f9c700 1 -- 172.21.15.43:0/500961756 >> v1:172.21.15.43:6789/0 conn(0x7f57dc0c51a0 legacy=0x7f57dc0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57e1f9c700 1 -- 172.21.15.43:0/500961756 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc152430 con 0x7f57dc155910 2023-08-27T11:30:00.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57e1f9c700 1 --2- 172.21.15.43:0/500961756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc155d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009d90 tx=0x7f57d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b08773d05780232 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:00.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57d3fff700 1 -- 172.21.15.43:0/500961756 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400e070 con 0x7f57dc155910 2023-08-27T11:30:00.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.716+0000 7f57d3fff700 1 -- 172.21.15.43:0/500961756 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d400bb20 con 0x7f57dc155910 2023-08-27T11:30:00.721 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57d3fff700 1 -- 172.21.15.43:0/500961756 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4012430 con 0x7f57dc155910 2023-08-27T11:30:00.724 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 -- 172.21.15.43:0/500961756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 msgr2=0x7f57dc155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 --2- 172.21.15.43:0/500961756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc155d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57d4009d90 tx=0x7f57d400b330 comp rx=0 tx=0).stop 2023-08-27T11:30:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 -- 172.21.15.43:0/500961756 shutdown_connections 2023-08-27T11:30:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 --2- 172.21.15.43:0/500961756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc155d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 --2- 172.21.15.43:0/500961756 >> v2:172.21.15.57:3300/0 conn(0x7f57dc06ca60 0x7f57dc06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.725 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 -- 172.21.15.43:0/500961756 >> 172.21.15.43:0/500961756 conn(0x7f57dc06aa50 msgr2=0x7f57dc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 -- 172.21.15.43:0/500961756 shutdown_connections 2023-08-27T11:30:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.717+0000 7f57e39ff700 1 -- 172.21.15.43:0/500961756 wait complete. 2023-08-27T11:30:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.719+0000 7f57e39ff700 1 Processor -- start 2023-08-27T11:30:00.726 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.719+0000 7f57e39ff700 1 -- start start 2023-08-27T11:30:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 0x7f57dc0a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc0a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0aa2d0 con 0x7f57dc06ca60 2023-08-27T11:30:00.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c4d30 con 0x7f57dc0c51a0 2023-08-27T11:30:00.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e39ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0a93c0 con 0x7f57dc155910 2023-08-27T11:30:00.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e179b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58770/0 (socket says 172.21.15.43:58770) 2023-08-27T11:30:00.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.720+0000 7f57e179b700 1 -- 172.21.15.43:0/631713028 learned_addr learned my addr 172.21.15.43:0/631713028 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e0f9a700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 0x7f57dc0a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e1f9c700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc0a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 -- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 msgr2=0x7f57dc0a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc0a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.729 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 -- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 msgr2=0x7f57dc0a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 0x7f57dc0a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 -- 172.21.15.43:0/631713028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4009a70 con 0x7f57dc06ca60 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e1f9c700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc0a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e0f9a700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 0x7f57dc0a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e179b700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c730 tx=0x7f57d800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:00.730 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8005d70 con 0x7f57dc06ca60 2023-08-27T11:30:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80070d0 con 0x7f57dc06ca60 2023-08-27T11:30:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8007440 con 0x7f57dc06ca60 2023-08-27T11:30:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0a7ce0 con 0x7f57dc06ca60 2023-08-27T11:30:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.721+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0a7f50 con 0x7f57dc06ca60 2023-08-27T11:30:00.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.722+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc0a96a0 con 0x7f57dc06ca60 2023-08-27T11:30:00.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.723+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f57d80075a0 con 0x7f57dc06ca60 2023-08-27T11:30:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.724+0000 7f57d1ffb700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 0x7f57c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.724+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57d8087a60 con 0x7f57dc06ca60 2023-08-27T11:30:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.725+0000 7f57e0f9a700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 0x7f57c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.725+0000 7f57e0f9a700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 0x7f57c006c5a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f57dc155600 tx=0x7f57cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:00.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.729+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f57d8053160 con 0x7f57dc06ca60 2023-08-27T11:30:00.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.982+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57dc1529c0 con 0x7f57dc06ca60 2023-08-27T11:30:00.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.983+0000 7f57d1ffb700 1 -- 172.21.15.43:0/631713028 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f57d8056780 con 0x7f57dc06ca60 2023-08-27T11:30:00.984 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:00.984 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":153,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:29:48.971377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[0],"up":{"mds_0":8772},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8772":{"gid":8772,"name":"d","rank":0,"incarnation":147,"state":"up:stopping","state_seq":3,"addr":"172.21.15.57:6835/3676894007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3676894007},{"type":"v1","addr":"172.21.15.57:6835","nonce":3676894007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:00.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 msgr2=0x7f57c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 0x7f57c006c5a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f57dc155600 tx=0x7f57cc008040 comp rx=0 tx=0).stop 2023-08-27T11:30:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 msgr2=0x7f57dc0a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f57d800c730 tx=0x7f57d800caf0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 shutdown_connections 2023-08-27T11:30:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f57c006a0e0 0x7f57c006c5a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.987 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57dc155910 0x7f57dc0a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f57dc06ca60 0x7f57dc0a5ea0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 --2- 172.21.15.43:0/631713028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57dc0c51a0 0x7f57dc0a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 >> 172.21.15.43:0/631713028 conn(0x7f57dc06aa50 msgr2=0x7f57dc0c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 shutdown_connections 2023-08-27T11:30:00.988 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:00.985+0000 7f57e39ff700 1 -- 172.21.15.43:0/631713028 wait complete. 2023-08-27T11:30:00.989 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 153 2023-08-27T11:30:01.008 INFO:tasks.ceph.mds.d.smithi057.stderr: -652> 2023-08-27T11:29:41.212+0000 7f41b1df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:30:01.053 INFO:tasks.ceph.mds.d.smithi057.stdout:starting mds.d at 2023-08-27T11:30:01.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:29:48.971377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [0], 'up': {'mds_0': 8772}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8772': {'gid': 8772, 'name': 'd', 'rank': 0, 'incarnation': 147, 'state': 'up:stopping', 'state_seq': 3, 'addr': '172.21.15.57:6835/3676894007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6833', 'nonce': 3676894007}, {'type': 'v1', 'addr': '172.21.15.57:6835', 'nonce': 3676894007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:30:01.408 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8772:up:stopping 2023-08-27T11:30:02.410 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:02.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.621+0000 7fac4e9ff700 1 Processor -- start 2023-08-27T11:30:02.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.622+0000 7fac4e9ff700 1 -- start start 2023-08-27T11:30:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fac48151a90 0x7fac480c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 0x7fac480c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac4806ad70 0x7fac4806b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4806c4e0 con 0x7fac48151a90 2023-08-27T11:30:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac48155370 con 0x7fac480c4630 2023-08-27T11:30:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac4e9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac48151e70 con 0x7fac4806ad70 2023-08-27T11:30:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fac48151a90 0x7fac480c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fac48151a90 0x7fac480c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58774/0 (socket says 172.21.15.43:58774) 2023-08-27T11:30:02.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 -- 172.21.15.43:0/4266639115 learned_addr learned my addr 172.21.15.43:0/4266639115 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:02.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 -- 172.21.15.43:0/4266639115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac4806ad70 msgr2=0x7fac4806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:02.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 --2- 172.21.15.43:0/4266639115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac4806ad70 0x7fac4806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac47fff700 1 -- 172.21.15.43:0/4266639115 >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 msgr2=0x7fac480c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.623+0000 7fac477fe700 1 --2- 172.21.15.43:0/4266639115 >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 0x7fac480c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac47fff700 1 --2- 172.21.15.43:0/4266639115 >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 0x7fac480c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac47fff700 1 -- 172.21.15.43:0/4266639115 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48154480 con 0x7fac48151a90 2023-08-27T11:30:02.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac477fe700 1 --2- 172.21.15.43:0/4266639115 >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 0x7fac480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac47fff700 1 --2- 172.21.15.43:0/4266639115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac48151a90 0x7fac480c7bb0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fac480c7740 tx=0x7fac38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2286bdfdee2c4a7d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac46ffd700 1 -- 172.21.15.43:0/4266639115 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800b870 con 0x7fac48151a90 2023-08-27T11:30:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac46ffd700 1 -- 172.21.15.43:0/4266639115 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3800b9d0 con 0x7fac48151a90 2023-08-27T11:30:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.624+0000 7fac46ffd700 1 -- 172.21.15.43:0/4266639115 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800bd60 con 0x7fac48151a90 2023-08-27T11:30:02.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4266639115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac48151a90 msgr2=0x7fac480c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:02.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4266639115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac48151a90 0x7fac480c7bb0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fac480c7740 tx=0x7fac38009bd0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4266639115 shutdown_connections 2023-08-27T11:30:02.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4266639115 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac4806ad70 0x7fac4806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4266639115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac48151a90 0x7fac480c7bb0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4266639115 >> v2:172.21.15.57:3300/0 conn(0x7fac480c4630 0x7fac480c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4266639115 >> 172.21.15.43:0/4266639115 conn(0x7fac480ab820 msgr2=0x7fac480abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:02.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4266639115 shutdown_connections 2023-08-27T11:30:02.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.625+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4266639115 wait complete. 2023-08-27T11:30:02.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.627+0000 7fac4e9ff700 1 Processor -- start 2023-08-27T11:30:02.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.627+0000 7fac4e9ff700 1 -- start start 2023-08-27T11:30:02.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 0x7fac481ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac48151a90 0x7fac4814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481564a0 con 0x7fac4806ad70 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac480aaf90 con 0x7fac480c4630 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4e9ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac481eaad0 con 0x7fac48151a90 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58786/0 (socket says 172.21.15.43:58786) 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 -- 172.21.15.43:0/4011172788 learned_addr learned my addr 172.21.15.43:0/4011172788 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:02.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac477fe700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 0x7fac481ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac4cf9c700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac48151a90 0x7fac4814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 -- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac48151a90 msgr2=0x7fac4814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:02.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac48151a90 0x7fac4814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 -- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 msgr2=0x7fac481ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:02.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 0x7fac481ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac47fff700 1 -- 172.21.15.43:0/4011172788 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009550 con 0x7fac4806ad70 2023-08-27T11:30:02.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.629+0000 7fac477fe700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 0x7fac481ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:02.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac47fff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fac38014040 tx=0x7fac38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:02.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38004520 con 0x7fac4806ad70 2023-08-27T11:30:02.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3801e070 con 0x7fac4806ad70 2023-08-27T11:30:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380038e0 con 0x7fac4806ad70 2023-08-27T11:30:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac480ab200 con 0x7fac4806ad70 2023-08-27T11:30:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.630+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac480a96b0 con 0x7fac4806ad70 2023-08-27T11:30:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.631+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4804ee70 con 0x7fac4806ad70 2023-08-27T11:30:02.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.632+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac38003a40 con 0x7fac4806ad70 2023-08-27T11:30:02.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.633+0000 7fac44ff9700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 0x7fac3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:02.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.633+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac38020070 con 0x7fac4806ad70 2023-08-27T11:30:02.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.633+0000 7fac477fe700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 0x7fac3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:02.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.634+0000 7fac477fe700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 0x7fac3406c5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fac480caab0 tx=0x7fac3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:02.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.637+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fac38055360 con 0x7fac4806ad70 2023-08-27T11:30:02.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.890+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac4814e200 con 0x7fac4806ad70 2023-08-27T11:30:02.892 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.890+0000 7fac44ff9700 1 -- 172.21.15.43:0/4011172788 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) v1 ==== 95+0+4875 (secure 0 0 0) 0x7fac38015090 con 0x7fac4806ad70 2023-08-27T11:30:02.893 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:02.893 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":155,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:00.996595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[0],"info":{},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:02.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 msgr2=0x7fac3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:02.895 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 0x7fac3406c5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fac480caab0 tx=0x7fac3c008040 comp rx=0 tx=0).stop 2023-08-27T11:30:02.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 msgr2=0x7fac481572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:02.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fac38014040 tx=0x7fac38004750 comp rx=0 tx=0).stop 2023-08-27T11:30:02.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 shutdown_connections 2023-08-27T11:30:02.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fac3406a0e0 0x7fac3406c5a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.896 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fac48151a90 0x7fac4814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fac4806ad70 0x7fac481572a0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 --2- 172.21.15.43:0/4011172788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fac480c4630 0x7fac481ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:02.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 >> 172.21.15.43:0/4011172788 conn(0x7fac480ab820 msgr2=0x7fac480c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:02.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 shutdown_connections 2023-08-27T11:30:02.897 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:02.893+0000 7fac4e9ff700 1 -- 172.21.15.43:0/4011172788 wait complete. 2023-08-27T11:30:02.898 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 155 2023-08-27T11:30:03.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 154, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:30:00.996595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 0, 'in': [], 'up': {}, 'failed': [], 'damaged': [], 'stopped': [0], 'info': {}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:30:03.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/0 2023-08-27T11:30:03.317 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:03.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.519+0000 7f53a91ff700 1 Processor -- start 2023-08-27T11:30:03.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.519+0000 7f53a91ff700 1 -- start start 2023-08-27T11:30:03.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.520+0000 7f53a91ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 0x7f53a40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:03.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a91ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a406c4e0 con 0x7f53a40c4a90 2023-08-27T11:30:03.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a91ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a4155370 con 0x7f53a40c4630 2023-08-27T11:30:03.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a91ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a4151e70 con 0x7f53a4151a90 2023-08-27T11:30:03.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a359e700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f53a40c4a90 0x7f53a406b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42104/0 (socket says 172.21.15.43:42104) 2023-08-27T11:30:03.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a359e700 1 -- 172.21.15.43:0/2145012692 learned_addr learned my addr 172.21.15.43:0/2145012692 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:03.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/2145012692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 0x7f53a40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:03.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542845417 0 0) 0x7f53a406c4e0 con 0x7f53a40c4a90 2023-08-27T11:30:03.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f538c0035b0 con 0x7f53a40c4a90 2023-08-27T11:30:03.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827156276 0 0) 0x7f53a4155370 con 0x7f53a40c4630 2023-08-27T11:30:03.526 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.521+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a406c4e0 con 0x7f53a40c4630 2023-08-27T11:30:03.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a2d9d700 1 -- 172.21.15.43:0/2145012692 >> v1:172.21.15.57:6789/0 conn(0x7f53a40c4630 legacy=0x7f53a406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a2d9d700 1 -- 172.21.15.43:0/2145012692 >> v1:172.21.15.43:6789/0 conn(0x7f53a40c4a90 legacy=0x7f53a406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a2d9d700 1 -- 172.21.15.43:0/2145012692 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4154480 con 0x7f53a4151a90 2023-08-27T11:30:03.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/2145012692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 0x7f53a40c7bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f5394009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6f4e5f4149f42a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:03.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011830 con 0x7f53a4151a90 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5394011990 con 0x7f53a4151a90 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.522+0000 7f53a1d9b700 1 -- 172.21.15.43:0/2145012692 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5394011d00 con 0x7f53a4151a90 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 -- 172.21.15.43:0/2145012692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 msgr2=0x7f53a40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 --2- 172.21.15.43:0/2145012692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 0x7f53a40c7bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5394009870 tx=0x7f5394009b80 comp rx=0 tx=0).stop 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 -- 172.21.15.43:0/2145012692 shutdown_connections 2023-08-27T11:30:03.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 --2- 172.21.15.43:0/2145012692 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a4151a90 0x7f53a40c7bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 -- 172.21.15.43:0/2145012692 >> 172.21.15.43:0/2145012692 conn(0x7f53a40ab820 msgr2=0x7f53a40abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:03.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 -- 172.21.15.43:0/2145012692 shutdown_connections 2023-08-27T11:30:03.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.523+0000 7f53a91ff700 1 -- 172.21.15.43:0/2145012692 wait complete. 2023-08-27T11:30:03.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.525+0000 7f53a91ff700 1 Processor -- start 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.525+0000 7f53a91ff700 1 -- start start 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 0x7f53a40bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a4151a90 0x7f53a41ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a41ed1f0 con 0x7f53a40c4a90 2023-08-27T11:30:03.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c8750 con 0x7f53a4151a90 2023-08-27T11:30:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a91ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a40c7880 con 0x7f53a40c4630 2023-08-27T11:30:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58794/0 (socket says 172.21.15.43:58794) 2023-08-27T11:30:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a259c700 1 -- 172.21.15.43:0/4261208018 learned_addr learned my addr 172.21.15.43:0/4261208018 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:03.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 0x7f53a40bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:03.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a359e700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a4151a90 0x7f53a41ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:03.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.526+0000 7f53a259c700 1 -- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 msgr2=0x7f53a40bcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a259c700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 0x7f53a40bcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a259c700 1 -- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a4151a90 msgr2=0x7f53a41ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a259c700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a4151a90 0x7f53a41ed610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a259c700 1 -- 172.21.15.43:0/4261208018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940094a0 con 0x7f53a40c4a90 2023-08-27T11:30:03.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 0x7f53a40bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:03.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a259c700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f539800c520 tx=0x7f539800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:03.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980052d0 con 0x7f53a40c4a90 2023-08-27T11:30:03.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5398005430 con 0x7f53a40c4a90 2023-08-27T11:30:03.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a40c8370 con 0x7f53a40c4a90 2023-08-27T11:30:03.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53980038c0 con 0x7f53a40c4a90 2023-08-27T11:30:03.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.527+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a40c7db0 con 0x7f53a40c4a90 2023-08-27T11:30:03.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.528+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a41ecf50 con 0x7f53a40c4a90 2023-08-27T11:30:03.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.529+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5398003a20 con 0x7f53a40c4a90 2023-08-27T11:30:03.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.530+0000 7f538b7fe700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 0x7f539006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:03.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.530+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5398087b90 con 0x7f53a40c4a90 2023-08-27T11:30:03.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.530+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 0x7f539006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:03.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.531+0000 7f53a2d9d700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 0x7f539006c5a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f53940090b0 tx=0x7f5394008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:03.538 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.535+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f53a41ecf50 con 0x7f53a40c4a90 2023-08-27T11:30:03.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.788+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53a41ecf50 con 0x7f53a40c4a90 2023-08-27T11:30:03.790 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.788+0000 7f538b7fe700 1 -- 172.21.15.43:0/4261208018 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) v1 ==== 95+0+4875 (secure 0 0 0) 0x7f53a41ecf50 con 0x7f53a40c4a90 2023-08-27T11:30:03.791 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:03.791 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":155,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146},{"gid":8769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":154,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:00.996595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":0,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[0],"info":{},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:03.793 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 msgr2=0x7f539006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 0x7f539006c5a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f53940090b0 tx=0x7f5394008030 comp rx=0 tx=0).stop 2023-08-27T11:30:03.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 msgr2=0x7f53a4148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:03.794 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f539800c520 tx=0x7f539800c8e0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 shutdown_connections 2023-08-27T11:30:03.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f539006a0e0 0x7f539006c5a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53a4151a90 0x7f53a41ed610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.795 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f53a40c4630 0x7f53a40bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 --2- 172.21.15.43:0/4261208018 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f53a40c4a90 0x7f53a4148d60 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:03.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 >> 172.21.15.43:0/4261208018 conn(0x7f53a40ab820 msgr2=0x7f53a406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:03.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 shutdown_connections 2023-08-27T11:30:03.796 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:03.791+0000 7f53a91ff700 1 -- 172.21.15.43:0/4261208018 wait complete. 2023-08-27T11:30:03.797 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 155 2023-08-27T11:30:03.812 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs down false 2023-08-27T11:30:04.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.013+0000 7f97f29ff700 1 Processor -- start 2023-08-27T11:30:04.016 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.013+0000 7f97f29ff700 1 -- start start 2023-08-27T11:30:04.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97f29ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f97ec0c7c00 0x7f97ec0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:04.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97f29ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec154660 con 0x7f97ec06a8e0 2023-08-27T11:30:04.017 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97f29ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec154940 con 0x7f97ec151d20 2023-08-27T11:30:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97f29ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0c5750 con 0x7f97ec0c7c00 2023-08-27T11:30:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97ebfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97ec151d20 0x7f97ec0ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:41818/0 (socket says 172.21.15.43:41818) 2023-08-27T11:30:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97f0f9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f97ec06a8e0 0x7f97ec06acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42118/0 (socket says 172.21.15.43:42118) 2023-08-27T11:30:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97ebfff700 1 -- 172.21.15.43:0/1000539901 learned_addr learned my addr 172.21.15.43:0/1000539901 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:04.018 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.015+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1000539901 >> v2:172.21.15.43:3300/0 conn(0x7f97ec0c7c00 0x7f97ec0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.016+0000 7f97eb7fe700 1 -- 172.21.15.43:0/1000539901 >> v1:172.21.15.57:6789/0 conn(0x7f97ec151d20 legacy=0x7f97ec0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:04.019 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.016+0000 7f97eb7fe700 1 -- 172.21.15.43:0/1000539901 >> v1:172.21.15.43:6789/0 conn(0x7f97ec06a8e0 legacy=0x7f97ec06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.016+0000 7f97eb7fe700 1 -- 172.21.15.43:0/1000539901 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec154c20 con 0x7f97ec0c7c00 2023-08-27T11:30:04.020 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.016+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1000539901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec0c7c00 0x7f97ec0c8110 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f97ec152140 tx=0x7f97e0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb99694afb74a68 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:04.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.018+0000 7f97eaffd700 1 -- 172.21.15.43:0/1000539901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0004020 con 0x7f97ec0c7c00 2023-08-27T11:30:04.021 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.018+0000 7f97eaffd700 1 -- 172.21.15.43:0/1000539901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e0004180 con 0x7f97ec0c7c00 2023-08-27T11:30:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.018+0000 7f97eaffd700 1 -- 172.21.15.43:0/1000539901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0004530 con 0x7f97ec0c7c00 2023-08-27T11:30:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 -- 172.21.15.43:0/1000539901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec0c7c00 msgr2=0x7f97ec0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1000539901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec0c7c00 0x7f97ec0c8110 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f97ec152140 tx=0x7f97e0009b20 comp rx=0 tx=0).stop 2023-08-27T11:30:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 -- 172.21.15.43:0/1000539901 shutdown_connections 2023-08-27T11:30:04.022 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1000539901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec0c7c00 0x7f97ec0c8110 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 -- 172.21.15.43:0/1000539901 >> 172.21.15.43:0/1000539901 conn(0x7f97ec0c9d00 msgr2=0x7f97ec0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 -- 172.21.15.43:0/1000539901 shutdown_connections 2023-08-27T11:30:04.023 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.019+0000 7f97f29ff700 1 -- 172.21.15.43:0/1000539901 wait complete. 2023-08-27T11:30:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.021+0000 7f97f29ff700 1 Processor -- start 2023-08-27T11:30:04.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.021+0000 7f97f29ff700 1 -- start start 2023-08-27T11:30:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 0x7f97ec156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97ec151d20 0x7f97ec0bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0c2b20 con 0x7f97ec06a8e0 2023-08-27T11:30:04.025 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1ea510 con 0x7f97ec0c7c00 2023-08-27T11:30:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97f29ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1ea7f0 con 0x7f97ec151d20 2023-08-27T11:30:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58806/0 (socket says 172.21.15.43:58806) 2023-08-27T11:30:04.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.022+0000 7f97ebfff700 1 -- 172.21.15.43:0/1616799648 learned_addr learned my addr 172.21.15.43:0/1616799648 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:04.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 0x7f97ec156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 -- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97ec151d20 msgr2=0x7f97ec0bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97ec151d20 0x7f97ec0bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 -- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 msgr2=0x7f97ec156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:04.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 0x7f97ec156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:04.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 -- 172.21.15.43:0/1616799648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00094a0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 0x7f97ec156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:04.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97ebfff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c480 tx=0x7f97dc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:04.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc005d70 con 0x7f97ec06a8e0 2023-08-27T11:30:04.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc0070d0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc007440 con 0x7f97ec06a8e0 2023-08-27T11:30:04.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0c2d70 con 0x7f97ec06a8e0 2023-08-27T11:30:04.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.023+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec157050 con 0x7f97ec06a8e0 2023-08-27T11:30:04.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.024+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec1556f0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.025+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f97dc0075a0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.027+0000 7f97e8ff9700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 0x7f97d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:04.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.027+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97dc0879d0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.027+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 0x7f97d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:04.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.028+0000 7f97eb7fe700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 0x7f97d806c5a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f97ec152140 tx=0x7f97e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:04.033 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.031+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f97ec1556f0 con 0x7f97ec06a8e0 2023-08-27T11:30:04.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:04.289+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "down", "val": "false"} v 0) v1 -- 0x7f97ec1556f0 con 0x7f97ec06a8e0 2023-08-27T11:30:05.018 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:30:05.016+0000 7ff3ca7f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:30:05.026 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.024+0000 7f97e8ff9700 1 -- 172.21.15.43:0/1616799648 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "down", "val": "false"}]=0 cephfs marked up, max_mds = 1 v156) v1 ==== 135+0+0 (secure 0 0 0) 0x7f97ec1556f0 con 0x7f97ec06a8e0 2023-08-27T11:30:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 msgr2=0x7f97d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 0x7f97d806c5a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f97ec152140 tx=0x7f97e0008030 comp rx=0 tx=0).stop 2023-08-27T11:30:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 msgr2=0x7f97ec1586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.030 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c480 tx=0x7f97dc00c840 comp rx=0 tx=0).stop 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 shutdown_connections 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f97d806a0e0 0x7f97d806c5a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97ec151d20 0x7f97ec0bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f97ec06a8e0 0x7f97ec1586f0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 --2- 172.21.15.43:0/1616799648 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97ec0c7c00 0x7f97ec156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.031 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.027+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 >> 172.21.15.43:0/1616799648 conn(0x7f97ec0c9d00 msgr2=0x7f97ec1523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.028+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 shutdown_connections 2023-08-27T11:30:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.028+0000 7f97f29ff700 1 -- 172.21.15.43:0/1616799648 wait complete. 2023-08-27T11:30:05.032 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked up, max_mds = 1 2023-08-27T11:30:05.052 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:05.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.256+0000 7f49e27ff700 1 Processor -- start 2023-08-27T11:30:05.258 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.256+0000 7f49e27ff700 1 -- start start 2023-08-27T11:30:05.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49e27ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.260 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49e27ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc154740 0x7f49dc0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49e27ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc154d00 con 0x7f49dc14e960 2023-08-27T11:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49e27ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc0baf30 con 0x7f49dc0c50d0 2023-08-27T11:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49e27ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc154fe0 con 0x7f49dc154740 2023-08-27T11:30:05.261 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49db7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49db7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58816/0 (socket says 172.21.15.43:58816) 2023-08-27T11:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.257+0000 7f49db7fe700 1 -- 172.21.15.43:0/2635396459 learned_addr learned my addr 172.21.15.43:0/2635396459 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49e0d9c700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc154740 0x7f49dc0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49db7fe700 1 -- 172.21.15.43:0/2635396459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc154740 msgr2=0x7f49dc0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:05.262 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49db7fe700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc154740 0x7f49dc0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49db7fe700 1 -- 172.21.15.43:0/2635396459 >> v1:172.21.15.57:6789/0 conn(0x7f49dc14e960 legacy=0x7f49dc0a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49db7fe700 1 -- 172.21.15.43:0/2635396459 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc1552c0 con 0x7f49dc0c50d0 2023-08-27T11:30:05.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49db7fe700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f49d00098f0 tx=0x7f49d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f98b9c4296dbb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49daffd700 1 -- 172.21.15.43:0/2635396459 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000b8a0 con 0x7f49dc0c50d0 2023-08-27T11:30:05.263 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49daffd700 1 -- 172.21.15.43:0/2635396459 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000ba00 con 0x7f49dc0c50d0 2023-08-27T11:30:05.264 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.258+0000 7f49daffd700 1 -- 172.21.15.43:0/2635396459 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000bd90 con 0x7f49dc0c50d0 2023-08-27T11:30:05.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 -- 172.21.15.43:0/2635396459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0c50d0 msgr2=0x7f49dc0c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f49d00098f0 tx=0x7f49d0009c00 comp rx=0 tx=0).stop 2023-08-27T11:30:05.266 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 -- 172.21.15.43:0/2635396459 shutdown_connections 2023-08-27T11:30:05.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc154740 0x7f49dc0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 --2- 172.21.15.43:0/2635396459 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc0c50d0 0x7f49dc0c3cc0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 -- 172.21.15.43:0/2635396459 >> 172.21.15.43:0/2635396459 conn(0x7f49dc06aa50 msgr2=0x7f49dc0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:05.267 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 -- 172.21.15.43:0/2635396459 shutdown_connections 2023-08-27T11:30:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.259+0000 7f49e27ff700 1 -- 172.21.15.43:0/2635396459 wait complete. 2023-08-27T11:30:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.261+0000 7f49e27ff700 1 Processor -- start 2023-08-27T11:30:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.261+0000 7f49e27ff700 1 -- start start 2023-08-27T11:30:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc0c50d0 0x7f49dc0c0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.268 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc14e960 0x7f49dc0aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc1edb40 con 0x7f49dc154740 2023-08-27T11:30:05.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc152040 con 0x7f49dc14e960 2023-08-27T11:30:05.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e27ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0a44f0 con 0x7f49dc0c50d0 2023-08-27T11:30:05.269 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58822/0 (socket says 172.21.15.43:58822) 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 -- 172.21.15.43:0/1049049556 learned_addr learned my addr 172.21.15.43:0/1049049556 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49dbfff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc0c50d0 0x7f49dc0c0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49db7fe700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc14e960 0x7f49dc0aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 -- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc0c50d0 msgr2=0x7f49dc0c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.270 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc0c50d0 0x7f49dc0c0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 -- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc14e960 msgr2=0x7f49dc0aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc14e960 0x7f49dc0aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.262+0000 7f49e0d9c700 1 -- 172.21.15.43:0/1049049556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009550 con 0x7f49dc154740 2023-08-27T11:30:05.271 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49e0d9c700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f49d4007e40 tx=0x7f49d400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d400eea0 con 0x7f49dc154740 2023-08-27T11:30:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4014420 con 0x7f49dc154740 2023-08-27T11:30:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40147b0 con 0x7f49dc154740 2023-08-27T11:30:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc0a47d0 con 0x7f49dc154740 2023-08-27T11:30:05.272 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.263+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc0c08d0 con 0x7f49dc154740 2023-08-27T11:30:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.264+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc0bb390 con 0x7f49dc154740 2023-08-27T11:30:05.273 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.265+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49d4014910 con 0x7f49dc154740 2023-08-27T11:30:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.266+0000 7f49d8ff9700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 0x7f49c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.266+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49d4088da0 con 0x7f49dc154740 2023-08-27T11:30:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.266+0000 7f49dbfff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 0x7f49c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.267+0000 7f49dbfff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 0x7f49c806c5a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f49cc000f60 tx=0x7f49cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.274 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.270+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f49d4054480 con 0x7f49dc154740 2023-08-27T11:30:05.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.529+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49dc0aa4f0 con 0x7f49dc154740 2023-08-27T11:30:05.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.529+0000 7f49d8ff9700 1 -- 172.21.15.43:0/1049049556 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f49dc0aa4f0 con 0x7f49dc154740 2023-08-27T11:30:05.532 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:05.532 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":157,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:05.026435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:starting","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:05.534 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 msgr2=0x7f49c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 0x7f49c806c5a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f49cc000f60 tx=0x7f49cc009040 comp rx=0 tx=0).stop 2023-08-27T11:30:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 msgr2=0x7f49dc0aad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.535 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f49d4007e40 tx=0x7f49d400e3c0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 shutdown_connections 2023-08-27T11:30:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f49c806a0e0 0x7f49c806c5a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f49dc154740 0x7f49dc0aad10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49dc0c50d0 0x7f49dc0c0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.536 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 --2- 172.21.15.43:0/1049049556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49dc14e960 0x7f49dc0aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 >> 172.21.15.43:0/1049049556 conn(0x7f49dc06aa50 msgr2=0x7f49dc0c3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 shutdown_connections 2023-08-27T11:30:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.532+0000 7f49e27ff700 1 -- 172.21.15.43:0/1049049556 wait complete. 2023-08-27T11:30:05.537 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 157 2023-08-27T11:30:05.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.751+0000 7f9440fff700 1 Processor -- start 2023-08-27T11:30:05.754 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.752+0000 7f9440fff700 1 -- start start 2023-08-27T11:30:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9440fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f943c0c51a0 0x7f943c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9440fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.756 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9440fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943c06d700 con 0x7f943c06ca60 2023-08-27T11:30:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9440fff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c1530b0 con 0x7f943c0c51a0 2023-08-27T11:30:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9440fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c14c860 con 0x7f943c155910 2023-08-27T11:30:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f943c0c51a0 0x7f943c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.757 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9433fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f943c06ca60 0x7f943c0aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42128/0 (socket says 172.21.15.43:42128) 2023-08-27T11:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9433fff700 1 -- 172.21.15.43:0/2620589914 learned_addr learned my addr 172.21.15.43:0/2620589914 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943ad9d700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 -- 172.21.15.43:0/2620589914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 msgr2=0x7f943c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.758 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 -- 172.21.15.43:0/2620589914 >> v1:172.21.15.43:6789/0 conn(0x7f943c06ca60 legacy=0x7f943c0aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 -- 172.21.15.43:0/2620589914 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c152430 con 0x7f943c0c51a0 2023-08-27T11:30:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943ad9d700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9439d9b700 1 -- 172.21.15.43:0/2620589914 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623633275 0 0) 0x7f943c06d700 con 0x7f943c06ca60 2023-08-27T11:30:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f943a59c700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c06d1c0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f942c009870 tx=0x7f942c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e39eaa1bfd0d49d server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.759 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9439d9b700 1 -- 172.21.15.43:0/2620589914 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011830 con 0x7f943c0c51a0 2023-08-27T11:30:05.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9439d9b700 1 -- 172.21.15.43:0/2620589914 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c011990 con 0x7f943c0c51a0 2023-08-27T11:30:05.760 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.754+0000 7f9439d9b700 1 -- 172.21.15.43:0/2620589914 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011d20 con 0x7f943c0c51a0 2023-08-27T11:30:05.762 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 -- 172.21.15.43:0/2620589914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 msgr2=0x7f943c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c06d1c0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f942c009870 tx=0x7f942c009b80 comp rx=0 tx=0).stop 2023-08-27T11:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 -- 172.21.15.43:0/2620589914 shutdown_connections 2023-08-27T11:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 --2- 172.21.15.43:0/2620589914 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c06d1c0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.763 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 -- 172.21.15.43:0/2620589914 >> 172.21.15.43:0/2620589914 conn(0x7f943c06aa50 msgr2=0x7f943c0c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 -- 172.21.15.43:0/2620589914 shutdown_connections 2023-08-27T11:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.755+0000 7f9440fff700 1 -- 172.21.15.43:0/2620589914 wait complete. 2023-08-27T11:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.756+0000 7f9440fff700 1 Processor -- start 2023-08-27T11:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 -- start start 2023-08-27T11:30:05.764 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 0x7f943c14a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c0bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0a9300 con 0x7f943c0c51a0 2023-08-27T11:30:05.765 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0a95e0 con 0x7f943c06ca60 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.757+0000 7f9440fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0a98c0 con 0x7f943c155910 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58836/0 (socket says 172.21.15.43:58836) 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 -- 172.21.15.43:0/2714809840 learned_addr learned my addr 172.21.15.43:0/2714809840 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f943a59c700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 0x7f943c14a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.766 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f943ad9d700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c0bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 -- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 msgr2=0x7f943c0bddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c0bddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 -- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 msgr2=0x7f943c14a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:05.767 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 0x7f943c14a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 -- 172.21.15.43:0/2714809840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c0094a0 con 0x7f943c0c51a0 2023-08-27T11:30:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f943a59c700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 0x7f943c14a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.758+0000 7f9433fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f94240011e0 tx=0x7f942400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.768 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.759+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424004c80 con 0x7f943c0c51a0 2023-08-27T11:30:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.759+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9424004de0 con 0x7f943c0c51a0 2023-08-27T11:30:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.759+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424007310 con 0x7f943c0c51a0 2023-08-27T11:30:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.759+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0bd310 con 0x7f943c0c51a0 2023-08-27T11:30:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.759+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0bd8d0 con 0x7f943c0c51a0 2023-08-27T11:30:05.769 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.760+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0beb00 con 0x7f943c0c51a0 2023-08-27T11:30:05.770 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.761+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9424007470 con 0x7f943c0c51a0 2023-08-27T11:30:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.762+0000 7f9432ffd700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 0x7f941c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.762+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9424088290 con 0x7f943c0c51a0 2023-08-27T11:30:05.771 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.762+0000 7f943a59c700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 0x7f941c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.763+0000 7f943a59c700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 0x7f941c06c5a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:05.772 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:05.766+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f943c0beb00 con 0x7f943c0c51a0 2023-08-27T11:30:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.022+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f943c0beb00 con 0x7f943c0c51a0 2023-08-27T11:30:06.024 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.022+0000 7f9432ffd700 1 -- 172.21.15.43:0/2714809840 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 157 v157) v1 ==== 95+0+4887 (secure 0 0 0) 0x7f943c0beb00 con 0x7f943c0c51a0 2023-08-27T11:30:06.025 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:06.025 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":157,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":157,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:05.026435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:starting","state_seq":1,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 msgr2=0x7f941c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 0x7f941c06c5a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f942c000c00 tx=0x7f942c008030 comp rx=0 tx=0).stop 2023-08-27T11:30:06.027 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 msgr2=0x7f943c14fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:06.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f94240011e0 tx=0x7f942400ca30 comp rx=0 tx=0).stop 2023-08-27T11:30:06.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 shutdown_connections 2023-08-27T11:30:06.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f941c06a0e0 0x7f941c06c5a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:06.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f943c155910 0x7f943c0bddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:06.028 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f943c06ca60 0x7f943c14a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:06.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 --2- 172.21.15.43:0/2714809840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f943c0c51a0 0x7f943c14fb60 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:06.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 >> 172.21.15.43:0/2714809840 conn(0x7f943c06aa50 msgr2=0x7f943c14bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:06.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 shutdown_connections 2023-08-27T11:30:06.029 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:06.025+0000 7f9440fff700 1 -- 172.21.15.43:0/2714809840 wait complete. 2023-08-27T11:30:06.030 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 157 2023-08-27T11:30:06.214 INFO:tasks.ceph.mds.b.smithi057.stderr:2023-08-27T11:30:06.213+0000 7f8ebb1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:30:06.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 157, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:30:05.026435+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8769}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8769': {'gid': 8769, 'name': 'b', 'rank': 0, 'incarnation': 157, 'state': 'up:starting', 'state_seq': 1, 'addr': '172.21.15.57:6834/2448327345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2448327345}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2448327345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:30:06.450 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8769:up:starting 2023-08-27T11:30:07.451 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:07.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.664+0000 7ff68a3ff700 1 Processor -- start 2023-08-27T11:30:07.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.664+0000 7ff68a3ff700 1 -- start start 2023-08-27T11:30:07.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 0x7ff6840a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 0x7ff6840c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff6840c50d0 0x7ff6840c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6840baf30 con 0x7ff6840c50d0 2023-08-27T11:30:07.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff684154d00 con 0x7ff68414e960 2023-08-27T11:30:07.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff684154fe0 con 0x7ff6840a79c0 2023-08-27T11:30:07.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68899c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff6840c50d0 0x7ff6840c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68899c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff6840c50d0 0x7ff6840c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58850/0 (socket says 172.21.15.43:58850) 2023-08-27T11:30:07.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.665+0000 7ff68899c700 1 -- 172.21.15.43:0/3485332098 learned_addr learned my addr 172.21.15.43:0/3485332098 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:07.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff683fff700 1 --2- 172.21.15.43:0/3485332098 >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 0x7ff6840a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 0x7ff6840c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 -- 172.21.15.43:0/3485332098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 msgr2=0x7ff6840c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:07.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 0x7ff6840c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 -- 172.21.15.43:0/3485332098 >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 msgr2=0x7ff6840a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:07.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 --2- 172.21.15.43:0/3485332098 >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 0x7ff6840a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 -- 172.21.15.43:0/3485332098 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6841552c0 con 0x7ff6840c50d0 2023-08-27T11:30:07.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 0x7ff6840c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:07.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff683fff700 1 --2- 172.21.15.43:0/3485332098 >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 0x7ff6840a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:07.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff68899c700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840c50d0 0x7ff6840c4200 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7ff68406da20 tx=0x7ff67c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d5308b09798b56 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:07.671 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff682ffd700 1 -- 172.21.15.43:0/3485332098 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00e070 con 0x7ff6840c50d0 2023-08-27T11:30:07.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff682ffd700 1 -- 172.21.15.43:0/3485332098 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00b9c0 con 0x7ff6840c50d0 2023-08-27T11:30:07.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.666+0000 7ff682ffd700 1 -- 172.21.15.43:0/3485332098 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00bd70 con 0x7ff6840c50d0 2023-08-27T11:30:07.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3485332098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840c50d0 msgr2=0x7ff6840c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:07.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840c50d0 0x7ff6840c4200 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7ff68406da20 tx=0x7ff67c00b330 comp rx=0 tx=0).stop 2023-08-27T11:30:07.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3485332098 shutdown_connections 2023-08-27T11:30:07.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840c50d0 0x7ff6840c4200 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3485332098 >> v2:172.21.15.57:3300/0 conn(0x7ff68414e960 0x7ff6840a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3485332098 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff6840a79c0 0x7ff6840c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3485332098 >> 172.21.15.43:0/3485332098 conn(0x7ff68406aa50 msgr2=0x7ff6840c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:07.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3485332098 shutdown_connections 2023-08-27T11:30:07.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.667+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3485332098 wait complete. 2023-08-27T11:30:07.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.669+0000 7ff68a3ff700 1 Processor -- start 2023-08-27T11:30:07.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.669+0000 7ff68a3ff700 1 -- start start 2023-08-27T11:30:07.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 0x7ff68413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff68414e960 0x7ff68414cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.679 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6841ea2f0 con 0x7ff6840a79c0 2023-08-27T11:30:07.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684145140 con 0x7ff6840c50d0 2023-08-27T11:30:07.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff68a3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68414e1c0 con 0x7ff68414e960 2023-08-27T11:30:07.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58854/0 (socket says 172.21.15.43:58854) 2023-08-27T11:30:07.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 -- 172.21.15.43:0/3434181034 learned_addr learned my addr 172.21.15.43:0/3434181034 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:07.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 -- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff68414e960 msgr2=0x7ff68414cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:07.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 0x7ff68413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff68414e960 0x7ff68414cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 -- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 msgr2=0x7ff68413d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:07.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 0x7ff68413d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.683 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff683fff700 1 -- 172.21.15.43:0/3434181034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c009b30 con 0x7ff6840a79c0 2023-08-27T11:30:07.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.670+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 0x7ff68413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:07.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff683fff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c7f0 tx=0x7ff67400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:07.684 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674011800 con 0x7ff6840a79c0 2023-08-27T11:30:07.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff674011960 con 0x7ff6840a79c0 2023-08-27T11:30:07.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6841e9c70 con 0x7ff6840a79c0 2023-08-27T11:30:07.685 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674011d10 con 0x7ff6840a79c0 2023-08-27T11:30:07.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.671+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6841e9f10 con 0x7ff6840a79c0 2023-08-27T11:30:07.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.672+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6840bb390 con 0x7ff6840a79c0 2023-08-27T11:30:07.686 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.673+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff674018360 con 0x7ff6840a79c0 2023-08-27T11:30:07.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.674+0000 7ff680ff9700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 0x7ff67006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:07.687 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.674+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff674088520 con 0x7ff6840a79c0 2023-08-27T11:30:07.688 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.674+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 0x7ff67006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:07.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.675+0000 7ff6837fe700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 0x7ff67006c5a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff6841470f0 tx=0x7ff678008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:07.689 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.678+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff674057690 con 0x7ff6840a79c0 2023-08-27T11:30:07.939 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.938+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6841ea430 con 0x7ff6840a79c0 2023-08-27T11:30:07.940 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.939+0000 7ff680ff9700 1 -- 172.21.15.43:0/3434181034 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7ff6841ea430 con 0x7ff6840a79c0 2023-08-27T11:30:07.940 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:07.940 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:07.942 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 msgr2=0x7ff67006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:07.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 0x7ff67006c5a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff6841470f0 tx=0x7ff678008040 comp rx=0 tx=0).stop 2023-08-27T11:30:07.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 msgr2=0x7ff6841ea710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:07.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7ff67400c7f0 tx=0x7ff67400cbb0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 shutdown_connections 2023-08-27T11:30:07.943 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ff67006a0e0 0x7ff67006c5a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff68414e960 0x7ff68414cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff6840a79c0 0x7ff6841ea710 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 --2- 172.21.15.43:0/3434181034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff6840c50d0 0x7ff68413d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 >> 172.21.15.43:0/3434181034 conn(0x7ff68406aa50 msgr2=0x7ff6840c2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:07.944 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 shutdown_connections 2023-08-27T11:30:07.945 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:07.941+0000 7ff68a3ff700 1 -- 172.21.15.43:0/3434181034 wait complete. 2023-08-27T11:30:07.945 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:08.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 158, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-27T11:29:35.758447+0000', 'modified': '2023-08-27T11:30:06.032189+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8769}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8769': {'gid': 8769, 'name': 'b', 'rank': 0, 'incarnation': 157, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.57:6834/2448327345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6832', 'nonce': 2448327345}, {'type': 'v1', 'addr': '172.21.15.57:6834', 'nonce': 2448327345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-27T11:30:08.364 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-27T11:30:08.365 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-27T11:30:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.572+0000 7f8025dff700 1 Processor -- start 2023-08-27T11:30:08.573 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.572+0000 7f8025dff700 1 -- start start 2023-08-27T11:30:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f8025dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80200c4630 0x7f80200c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f8025dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802006c4e0 con 0x7f8020151a90 2023-08-27T11:30:08.574 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f8025dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8020155370 con 0x7f802006ad70 2023-08-27T11:30:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f8025dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80200c82c0 con 0x7f80200c4630 2023-08-27T11:30:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f801f7fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8020151a90 0x7f80200c7bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42142/0 (socket says 172.21.15.43:42142) 2023-08-27T11:30:08.575 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f801f7fe700 1 -- 172.21.15.43:0/3051906830 learned_addr learned my addr 172.21.15.43:0/3051906830 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.573+0000 7f801effd700 1 --2- 172.21.15.43:0/3051906830 >> v2:172.21.15.57:3300/0 conn(0x7f80200c4630 0x7f80200c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596594561 0 0) 0x7f802006c4e0 con 0x7f8020151a90 2023-08-27T11:30:08.578 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080035b0 con 0x7f8020151a90 2023-08-27T11:30:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413632436 0 0) 0x7f8020155370 con 0x7f802006ad70 2023-08-27T11:30:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802006c4e0 con 0x7f802006ad70 2023-08-27T11:30:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123771499 0 0) 0x7f80080035b0 con 0x7f8020151a90 2023-08-27T11:30:08.579 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 >> v2:172.21.15.57:3300/0 conn(0x7f80200c4630 msgr2=0x7f80200c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 --2- 172.21.15.43:0/3051906830 >> v2:172.21.15.57:3300/0 conn(0x7f80200c4630 0x7f80200c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 >> v1:172.21.15.57:6789/0 conn(0x7f802006ad70 legacy=0x7f802006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020151e70 con 0x7f8020151a90 2023-08-27T11:30:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f8010001670 con 0x7f8020151a90 2023-08-27T11:30:08.580 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 >> v1:172.21.15.43:6789/0 conn(0x7f8020151a90 legacy=0x7f80200c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8008003be0 0x7f8008003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008004850 0x7f8008004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 0x7f800800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c82c0 con 0x7f8008005260 2023-08-27T11:30:08.581 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800800c190 con 0x7f8008004850 2023-08-27T11:30:08.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.574+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800800c350 con 0x7f8008003be0 2023-08-27T11:30:08.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 0x7f800800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801effd700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008004850 0x7f8008004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.582 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801f7fe700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8008003be0 0x7f8008003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 -- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8008003be0 msgr2=0x7f8008003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8008003be0 0x7f8008003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 -- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008004850 msgr2=0x7f8008004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.583 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008004850 0x7f8008004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 -- 172.21.15.43:0/3051906830 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080035b0 con 0x7f8008005260 2023-08-27T11:30:08.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 -- 172.21.15.43:0/3051906830 reap_dead start 2023-08-27T11:30:08.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801ffff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 0x7f800800ba10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f801800c2f0 tx=0x7f8008005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c624673c675ce713 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.575+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018001f30 con 0x7f8008005260 2023-08-27T11:30:08.584 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8018003a00 con 0x7f8008005260 2023-08-27T11:30:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f801e7fc700 1 -- 172.21.15.43:0/3051906830 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018003db0 con 0x7f8008005260 2023-08-27T11:30:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 -- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 msgr2=0x7f800800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 0x7f800800ba10 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f801800c2f0 tx=0x7f8008005880 comp rx=0 tx=0).stop 2023-08-27T11:30:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 -- 172.21.15.43:0/3051906830 shutdown_connections 2023-08-27T11:30:08.585 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 --2- 172.21.15.43:0/3051906830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8008005260 0x7f800800ba10 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 -- 172.21.15.43:0/3051906830 >> 172.21.15.43:0/3051906830 conn(0x7f80200ab820 msgr2=0x7f80200abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 -- 172.21.15.43:0/3051906830 shutdown_connections 2023-08-27T11:30:08.586 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.576+0000 7f8025dff700 1 -- 172.21.15.43:0/3051906830 wait complete. 2023-08-27T11:30:08.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.578+0000 7f8025dff700 1 Processor -- start 2023-08-27T11:30:08.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.578+0000 7f8025dff700 1 -- start start 2023-08-27T11:30:08.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 0x7f80201e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.591 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f802014d960 0x7f80201ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802014b8e0 con 0x7f80201585c0 2023-08-27T11:30:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80201e7790 con 0x7f8008005260 2023-08-27T11:30:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f8025dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80200c3b90 con 0x7f802014d960 2023-08-27T11:30:08.592 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f801effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f801effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58858/0 (socket says 172.21.15.43:58858) 2023-08-27T11:30:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f801effd700 1 -- 172.21.15.43:0/4142625038 learned_addr learned my addr 172.21.15.43:0/4142625038 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.579+0000 7f801f7fe700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 0x7f80201e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.593 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 -- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f802014d960 msgr2=0x7f80201ea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f802014d960 0x7f80201ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 -- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 msgr2=0x7f80201e7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 0x7f80201e7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 -- 172.21.15.43:0/4142625038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8020155d30 con 0x7f80201585c0 2023-08-27T11:30:08.594 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801f7fe700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 0x7f80201e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f801effd700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f80140119d0 tx=0x7f8014011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f8007fff700 1 -- 172.21.15.43:0/4142625038 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400f940 con 0x7f80201585c0 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f8007fff700 1 -- 172.21.15.43:0/4142625038 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801400faa0 con 0x7f80201585c0 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f8007fff700 1 -- 172.21.15.43:0/4142625038 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400fe30 con 0x7f80201585c0 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80200c35d0 con 0x7f80201585c0 2023-08-27T11:30:08.595 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.580+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80201e9c10 con 0x7f80201585c0 2023-08-27T11:30:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.582+0000 7f8007fff700 1 -- 172.21.15.43:0/4142625038 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8014014440 con 0x7f80201585c0 2023-08-27T11:30:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.584+0000 7f8007fff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.584+0000 7f8007fff700 1 -- 172.21.15.43:0/4142625038 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8014088d30 con 0x7f80201585c0 2023-08-27T11:30:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.584+0000 7f801f7fe700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.596 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.585+0000 7f801f7fe700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 0x7f800c06c5a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80100011e0 tx=0x7f8010009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.586+0000 7f803980db80 1 Processor -- start 2023-08-27T11:30:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.586+0000 7f803980db80 1 -- start start 2023-08-27T11:30:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf8efe0 0x560bdafac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.597 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdaee6730 con 0x560bdaf88f00 2023-08-27T11:30:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdaee4050 con 0x560bdaf892e0 2023-08-27T11:30:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.587+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bdaedf940 con 0x560bdaf8efe0 2023-08-27T11:30:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.598 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58870/0 (socket says 172.21.15.43:58870) 2023-08-27T11:30:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 -- 172.21.15.43:0/3281138285 learned_addr learned my addr 172.21.15.43:0/3281138285 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801ffff700 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801effd700 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf8efe0 0x560bdafac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 -- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf8efe0 msgr2=0x560bdafac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.599 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf8efe0 0x560bdafac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 -- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 msgr2=0x560bdafc1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 -- 172.21.15.43:0/3281138285 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bdad5f5e0 con 0x560bdaf88f00 2023-08-27T11:30:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.588+0000 7f801f7fe700 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f8010004f70 tx=0x7f8010007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4bb6fab688c90a server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.600 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f80057fa700 1 -- 172.21.15.43:0/3281138285 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010022620 con 0x560bdaf88f00 2023-08-27T11:30:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f80057fa700 1 -- 172.21.15.43:0/3281138285 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010022780 con 0x560bdaf88f00 2023-08-27T11:30:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f80057fa700 1 -- 172.21.15.43:0/3281138285 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010022af0 con 0x560bdaf88f00 2023-08-27T11:30:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 -- 172.21.15.43:0/3281138285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 msgr2=0x560bdafabd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f8010004f70 tx=0x7f8010007f90 comp rx=0 tx=0).stop 2023-08-27T11:30:08.601 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 -- 172.21.15.43:0/3281138285 shutdown_connections 2023-08-27T11:30:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf88f00 0x560bdafabd70 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 --2- 172.21.15.43:0/3281138285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf8efe0 0x560bdafac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 -- 172.21.15.43:0/3281138285 >> 172.21.15.43:0/3281138285 conn(0x560bdaeebc30 msgr2=0x560bdaf8b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.602 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 -- 172.21.15.43:0/3281138285 shutdown_connections 2023-08-27T11:30:08.603 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.589+0000 7f803980db80 1 -- 172.21.15.43:0/3281138285 wait complete. 2023-08-27T11:30:08.608 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.590+0000 7f803980db80 1 -- start start 2023-08-27T11:30:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.591+0000 7f803980db80 1 Processor -- start 2023-08-27T11:30:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf86f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdae7db60 con 0x560bdafc65d0 2023-08-27T11:30:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdae7d860 con 0x560bdaf892e0 2023-08-27T11:30:08.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bdad618d0 con 0x560bdaf88f00 2023-08-27T11:30:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.592+0000 7f803980db80 10 client.0 _ll_register_callbacks cb 0x560bdae7b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:30:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58886/0 (socket says 172.21.15.43:58886) 2023-08-27T11:30:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 -- 172.21.15.43:0/1582841045 learned_addr learned my addr 172.21.15.43:0/1582841045 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801effd700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801f7fe700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf86f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 -- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 msgr2=0x560bdaf86f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf86f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 -- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 msgr2=0x560bdafc5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 -- 172.21.15.43:0/1582841045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801000f040 con 0x560bdafc65d0 2023-08-27T11:30:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f801ffff700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f80200c3ef0 tx=0x7f8018001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4697bb6a0e997f server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.613 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f7ffe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:30:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.593+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800cea0 con 0x560bdafc65d0 2023-08-27T11:30:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bdaf804f0 con 0x560bdafc65d0 2023-08-27T11:30:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8018005840 con 0x560bdafc65d0 2023-08-27T11:30:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=158) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8018003b70 con 0x560bdafc65d0 2023-08-27T11:30:08.614 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 10 client.9054 fetch_fsmap learned FSMap version 158 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=158,monmap=2+}) v3 -- 0x560bdaef7750 con 0x560bdafc65d0 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560bdaf804f0 con 0x560bdafc65d0 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 158) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f801801a070 con 0x560bdafc65d0 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 10 client.9054 fetch_fsmap finished waiting for FSMap version 158 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 10 client.9054 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:30:08.615 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 20 client.9054 populate_metadata read hostname 'smithi043' 2023-08-27T11:30:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdafd8f80 0x560bdafd9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 4 client.9054 mds_command: new command op to 8769 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-27T11:30:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.594+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 --> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bdaed8920 con 0x560bdafd8f80 2023-08-27T11:30:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.595+0000 7f801f7fe700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdafd8f80 0x560bdafd9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.616 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.595+0000 7f801f7fe700 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdafd8f80 0x560bdafd9360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c96baeaa54b812 server_cookie=1d3b13562df93a24 in_seq=0 out_seq=0 2023-08-27T11:30:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.595+0000 7f7ffe7fc700 10 client.9054 ms_handle_connect on v2:172.21.15.57:6832/2448327345 2023-08-27T11:30:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/1582841045 <== mds.0 v2:172.21.15.57:6832/2448327345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560bdaed8920 con 0x560bdafd8f80 2023-08-27T11:30:08.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f7ffe7fc700 10 client.9054 handle_command_reply: tid=0 2023-08-27T11:30:08.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 client.9054 shutdown 2023-08-27T11:30:08.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 msgr2=0x560bdafaa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f80200c3ef0 tx=0x7f8018001650 comp rx=0 tx=0).stop 2023-08-27T11:30:08.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 shutdown_connections 2023-08-27T11:30:08.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafaa860 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf86f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdafd8f80 0x560bdafd9360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 --2- 172.21.15.43:0/1582841045 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 >> 172.21.15.43:0/1582841045 conn(0x560bdaeebc30 msgr2=0x560bdafc6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.596+0000 7f7ffe7fc700 0 client.9054 ms_handle_reset on v2:172.21.15.57:6832/2448327345 2023-08-27T11:30:08.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.597+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 shutdown_connections 2023-08-27T11:30:08.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.597+0000 7f803980db80 1 -- 172.21.15.43:0/1582841045 wait complete. 2023-08-27T11:30:08.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.597+0000 7f803980db80 20 client.9054 trim_cache size 0 max 16384 2023-08-27T11:30:08.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.615+0000 7f803980db80 1 Processor -- start 2023-08-27T11:30:08.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.616+0000 7f803980db80 1 -- start start 2023-08-27T11:30:08.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf8bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdaf86e10 con 0x560bdafc65d0 2023-08-27T11:30:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdafcdc40 con 0x560bdaf892e0 2023-08-27T11:30:08.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bdafc7970 con 0x560bdaf88f00 2023-08-27T11:30:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58902/0 (socket says 172.21.15.43:58902) 2023-08-27T11:30:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 -- 172.21.15.43:0/3128171257 learned_addr learned my addr 172.21.15.43:0/3128171257 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801f7fe700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf8bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801effd700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 -- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 msgr2=0x560bdaf8bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf8bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 -- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 msgr2=0x560bdafc3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801ffff700 1 -- 172.21.15.43:0/3128171257 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bdafc5050 con 0x560bdafc65d0 2023-08-27T11:30:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.617+0000 7f801effd700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f801ffff700 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8018002230 tx=0x7f801801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb09a767e1a1a8b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f8005ffb700 1 -- 172.21.15.43:0/3128171257 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018034070 con 0x560bdafc65d0 2023-08-27T11:30:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f8005ffb700 1 -- 172.21.15.43:0/3128171257 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801800cea0 con 0x560bdafc65d0 2023-08-27T11:30:08.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f8005ffb700 1 -- 172.21.15.43:0/3128171257 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018003b70 con 0x560bdafc65d0 2023-08-27T11:30:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 -- 172.21.15.43:0/3128171257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 msgr2=0x560bdafc4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8018002230 tx=0x7f801801a000 comp rx=0 tx=0).stop 2023-08-27T11:30:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 -- 172.21.15.43:0/3128171257 shutdown_connections 2023-08-27T11:30:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdafc65d0 0x560bdafc4500 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdaf8bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 --2- 172.21.15.43:0/3128171257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdaf892e0 0x560bdafc3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 -- 172.21.15.43:0/3128171257 >> 172.21.15.43:0/3128171257 conn(0x560bdaeebc30 msgr2=0x560bdafc5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 -- 172.21.15.43:0/3128171257 shutdown_connections 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.618+0000 7f803980db80 1 -- 172.21.15.43:0/3128171257 wait complete. 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.619+0000 7f803980db80 1 -- start start 2023-08-27T11:30:08.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.619+0000 7f803980db80 1 Processor -- start 2023-08-27T11:30:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdafafa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdafc65d0 0x560bdafa9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdb034780 con 0x560bdaf892e0 2023-08-27T11:30:08.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bdafdb910 con 0x560bdafc65d0 2023-08-27T11:30:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bdafdbb60 con 0x560bdaf88f00 2023-08-27T11:30:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f803980db80 10 client.0 _ll_register_callbacks cb 0x560bdae7b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-27T11:30:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f801effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f801effd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:58914/0 (socket says 172.21.15.43:58914) 2023-08-27T11:30:08.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.620+0000 7f801effd700 1 -- 172.21.15.43:0/2458143829 learned_addr learned my addr 172.21.15.43:0/2458143829 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801f7fe700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdafafa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801ffff700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdafc65d0 0x560bdafa9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 -- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 msgr2=0x560bdafafa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdafafa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 -- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdafc65d0 msgr2=0x560bdafa9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdafc65d0 0x560bdafa9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 -- 172.21.15.43:0/2458143829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bdaef7750 con 0x560bdaf892e0 2023-08-27T11:30:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f801effd700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f80140870f0 tx=0x7f801405bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce8e657e932f2ed server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f7ffe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.43:3300/0 2023-08-27T11:30:08.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801405f950 con 0x560bdaf892e0 2023-08-27T11:30:08.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8010022780 con 0x560bdaf892e0 2023-08-27T11:30:08.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mon.0 v2:172.21.15.43:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f801405fab0 con 0x560bdaf892e0 2023-08-27T11:30:08.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.621+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_get_version_reply(handle=1 version=158) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8014076300 con 0x560bdaf892e0 2023-08-27T11:30:08.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 10 client.9060 fetch_fsmap learned FSMap version 158 2023-08-27T11:30:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,fsmap=158,monmap=2+}) v3 -- 0x560bdad0bd90 con 0x560bdaf892e0 2023-08-27T11:30:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mon.0 v2:172.21.15.43:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010022780 con 0x560bdaf892e0 2023-08-27T11:30:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mon.0 v2:172.21.15.43:3300/0 5 ==== fsmap(e 158) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8014076020 con 0x560bdaf892e0 2023-08-27T11:30:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 10 client.9060 fetch_fsmap finished waiting for FSMap version 158 2023-08-27T11:30:08.637 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 10 client.9060 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-27T11:30:08.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 20 client.9060 populate_metadata read hostname 'smithi043' 2023-08-27T11:30:08.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdaf8d8c0 0x560bdb030e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 4 client.9060 mds_command: new command op to 8769 tid=0[{"prefix": "status"}] 2023-08-27T11:30:08.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 --> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560bdae99000 con 0x560bdaf8d8c0 2023-08-27T11:30:08.638 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.622+0000 7f801f7fe700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdaf8d8c0 0x560bdb030e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.623+0000 7f801f7fe700 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdaf8d8c0 0x560bdb030e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa123470fa1bb74e server_cookie=159192e7ba455fa in_seq=0 out_seq=0 2023-08-27T11:30:08.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.623+0000 7f7ffe7fc700 10 client.9060 ms_handle_connect on v2:172.21.15.57:6832/2448327345 2023-08-27T11:30:08.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.623+0000 7f7ffe7fc700 1 -- 172.21.15.43:0/2458143829 <== mds.0 v2:172.21.15.57:6832/2448327345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560bdae99000 con 0x560bdaf8d8c0 2023-08-27T11:30:08.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.623+0000 7f7ffe7fc700 10 client.9060 handle_command_reply: tid=0 2023-08-27T11:30:08.639 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.623+0000 7f803980db80 1 client.9060 shutdown 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 msgr2=0x560bdafad520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f80140870f0 tx=0x7f801405bfb0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 shutdown_connections 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:6832/2448327345,v1:172.21.15.57:6834/2448327345] conn(0x560bdaf8d8c0 0x560bdb030e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560bdafc65d0 0x560bdafa9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.640 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x560bdaf88f00 0x560bdafafa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 --2- 172.21.15.43:0/2458143829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560bdaf892e0 0x560bdafad520 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f7ffe7fc700 0 client.9060 ms_handle_reset on v2:172.21.15.57:6832/2448327345 2023-08-27T11:30:08.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 >> 172.21.15.43:0/2458143829 conn(0x560bdaeebc30 msgr2=0x560bdafdc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.641 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 shutdown_connections 2023-08-27T11:30:08.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 1 -- 172.21.15.43:0/2458143829 wait complete. 2023-08-27T11:30:08.642 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.624+0000 7f803980db80 20 client.9060 trim_cache size 0 max 16384 2023-08-27T11:30:08.642 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2023-08-27T11:30:08.643 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "c8d00e24-104f-4e9c-b4f0-07b3a6bec064", 2023-08-27T11:30:08.643 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2023-08-27T11:30:08.643 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 8769, 2023-08-27T11:30:08.643 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2023-08-27T11:30:08.643 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 3.591375024, 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 158, 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 144, 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 144, 2023-08-27T11:30:08.644 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 38.605396415000001 2023-08-27T11:30:08.645 INFO:teuthology.orchestra.run.smithi043.stdout:} 2023-08-27T11:30:08.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 msgr2=0x7f800c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.646 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 0x7f800c06c5a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80100011e0 tx=0x7f8010009040 comp rx=0 tx=0).stop 2023-08-27T11:30:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 msgr2=0x7f802014d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f80140119d0 tx=0x7f8014011d90 comp rx=0 tx=0).stop 2023-08-27T11:30:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 shutdown_connections 2023-08-27T11:30:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f800c06a0e0 0x7f800c06c5a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.647 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f802014d960 0x7f80201ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8008005260 0x7f80201e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 --2- 172.21.15.43:0/4142625038 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f80201585c0 0x7f802014d420 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 >> 172.21.15.43:0/4142625038 conn(0x7f80200ab820 msgr2=0x7f80200ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 shutdown_connections 2023-08-27T11:30:08.648 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.625+0000 7f8025dff700 1 -- 172.21.15.43:0/4142625038 wait complete. 2023-08-27T11:30:08.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:08.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.848+0000 7f96089ff700 1 Processor -- start 2023-08-27T11:30:08.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.848+0000 7f96089ff700 1 -- start start 2023-08-27T11:30:08.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f96089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 0x7f960406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f96089ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9604155910 0x7f9604155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f96089ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960406d700 con 0x7f96040c51a0 2023-08-27T11:30:08.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f96089ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96041530b0 con 0x7f9604155910 2023-08-27T11:30:08.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f96089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960414c860 con 0x7f960406ca60 2023-08-27T11:30:08.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f95fbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 0x7f960406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f960259c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f96040c51a0 0x7f96040aab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.43:51836/0 (socket says 172.21.15.43:51836) 2023-08-27T11:30:08.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f95fbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 0x7f960406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.43:58026/0 (socket says 172.21.15.43:58026) 2023-08-27T11:30:08.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f960259c700 1 -- 172.21.15.43:0/4089956614 learned_addr learned my addr 172.21.15.43:0/4089956614 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.850+0000 7f9602d9d700 1 --2- 172.21.15.43:0/4089956614 >> v2:172.21.15.57:3300/0 conn(0x7f9604155910 0x7f9604155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9601d9b700 1 -- 172.21.15.43:0/4089956614 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721890774 0 0) 0x7f960406d700 con 0x7f96040c51a0 2023-08-27T11:30:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9602d9d700 1 -- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 msgr2=0x7f960406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9602d9d700 1 --2- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 0x7f960406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9602d9d700 1 -- 172.21.15.43:0/4089956614 >> v1:172.21.15.57:6789/0 conn(0x7f96040c51a0 legacy=0x7f96040aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9602d9d700 1 -- 172.21.15.43:0/4089956614 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604152430 con 0x7f9604155910 2023-08-27T11:30:08.861 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9602d9d700 1 --2- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f9604155da0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009dc0 tx=0x7f95fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a5fd2cca89232f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9601d9b700 1 -- 172.21.15.43:0/4089956614 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00e070 con 0x7f9604155910 2023-08-27T11:30:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9601d9b700 1 -- 172.21.15.43:0/4089956614 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00bae0 con 0x7f9604155910 2023-08-27T11:30:08.862 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.851+0000 7f9601d9b700 1 -- 172.21.15.43:0/4089956614 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00be90 con 0x7f9604155910 2023-08-27T11:30:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 -- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 msgr2=0x7f9604155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 --2- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f9604155da0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009dc0 tx=0x7f95fc00b330 comp rx=0 tx=0).stop 2023-08-27T11:30:08.863 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 -- 172.21.15.43:0/4089956614 shutdown_connections 2023-08-27T11:30:08.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 --2- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f9604155da0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.864 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 --2- 172.21.15.43:0/4089956614 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f960406ca60 0x7f960406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 -- 172.21.15.43:0/4089956614 >> 172.21.15.43:0/4089956614 conn(0x7f960406aa50 msgr2=0x7f96040c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:08.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 -- 172.21.15.43:0/4089956614 shutdown_connections 2023-08-27T11:30:08.865 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.852+0000 7f96089ff700 1 -- 172.21.15.43:0/4089956614 wait complete. 2023-08-27T11:30:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.854+0000 7f96089ff700 1 Processor -- start 2023-08-27T11:30:08.866 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.854+0000 7f96089ff700 1 -- start start 2023-08-27T11:30:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 0x7f96040bb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.871 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f96040a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040a65e0 con 0x7f960406ca60 2023-08-27T11:30:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040be800 con 0x7f9604155910 2023-08-27T11:30:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f96089ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604148e40 con 0x7f96040c51a0 2023-08-27T11:30:08.872 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41916/0 (socket says 172.21.15.43:41916) 2023-08-27T11:30:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 -- 172.21.15.43:0/1232583684 learned_addr learned my addr 172.21.15.43:0/1232583684 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f9602d9d700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f96040a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f95fbfff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 0x7f96040bb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.873 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 -- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 msgr2=0x7f96040bb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 0x7f96040bb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 -- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 msgr2=0x7f96040a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f96040a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f960259c700 1 -- 172.21.15.43:0/1232583684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc009a70 con 0x7f960406ca60 2023-08-27T11:30:08.874 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f95fbfff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 0x7f96040bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.855+0000 7f9602d9d700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f96040a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f960259c700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f95f40011e0 tx=0x7f95f400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4004c80 con 0x7f960406ca60 2023-08-27T11:30:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4004e00 con 0x7f960406ca60 2023-08-27T11:30:08.875 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604149160 con 0x7f960406ca60 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4007310 con 0x7f960406ca60 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.856+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96041e7e70 con 0x7f960406ca60 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.857+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96041e79f0 con 0x7f960406ca60 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.858+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95f4007470 con 0x7f960406ca60 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.859+0000 7f95faffd700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 0x7f95e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:08.876 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.859+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95f4088320 con 0x7f960406ca60 2023-08-27T11:30:08.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.859+0000 7f95fbfff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 0x7f95e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:08.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.860+0000 7f95fbfff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 0x7f95e406c5a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96040c5830 tx=0x7f95ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:08.877 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:08.864+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96041e79f0 con 0x7f960406ca60 2023-08-27T11:30:09.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.119+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96041e79f0 con 0x7f960406ca60 2023-08-27T11:30:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.120+0000 7f95faffd700 1 -- 172.21.15.43:0/1232583684 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f96041e79f0 con 0x7f960406ca60 2023-08-27T11:30:09.122 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:09.122 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:09.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 msgr2=0x7f95e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 0x7f95e406c5a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96040c5830 tx=0x7f95ec008040 comp rx=0 tx=0).stop 2023-08-27T11:30:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 msgr2=0x7f9604148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f95f40011e0 tx=0x7f95f400cae0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 shutdown_connections 2023-08-27T11:30:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f95e406a0e0 0x7f95e406c5a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9604155910 0x7f96040a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f960406ca60 0x7f9604148900 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 --2- 172.21.15.43:0/1232583684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f96040c51a0 0x7f96040bb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 >> 172.21.15.43:0/1232583684 conn(0x7f960406aa50 msgr2=0x7f96041517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:09.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 shutdown_connections 2023-08-27T11:30:09.125 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.122+0000 7f96089ff700 1 -- 172.21.15.43:0/1232583684 wait complete. 2023-08-27T11:30:09.126 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:09.142 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-27T11:30:09.142 DEBUG:teuthology.orchestra.run.smithi043:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:30:09.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-27T11:30:09.364 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-27T11:30:09.364 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2023-08-27T11:30:09.365 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:30:09.409 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-08-27T11:30:09.410 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-08-27T11:30:09.410 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-27T11:30:09.456 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348692k,nr_inodes=4087173,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-08-27T11:30:09.457 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:09.658 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.657+0000 7f463e1ff700 1 Processor -- start 2023-08-27T11:30:09.659 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.657+0000 7f463e1ff700 1 -- start start 2023-08-27T11:30:09.663 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.658+0000 7f463e1ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f46380c51a0 0x7f463806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.658+0000 7f463e1ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463806d700 con 0x7f4638155910 2023-08-27T11:30:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.658+0000 7f463e1ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4638152430 con 0x7f463806ca60 2023-08-27T11:30:09.664 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.658+0000 7f463e1ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46381530b0 con 0x7f46380c51a0 2023-08-27T11:30:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f4637fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f4638155910 0x7f4638155d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33586/0 (socket says 172.21.15.43:33586) 2023-08-27T11:30:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f4637fff700 1 -- 172.21.15.43:0/2437388564 learned_addr learned my addr 172.21.15.43:0/2437388564 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:09.665 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46377fe700 1 --2- 172.21.15.43:0/2437388564 >> v2:172.21.15.57:3300/0 conn(0x7f46380c51a0 0x7f463806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270229673 0 0) 0x7f463806d700 con 0x7f4638155910 2023-08-27T11:30:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46200035b0 con 0x7f4638155910 2023-08-27T11:30:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872092686 0 0) 0x7f4638152430 con 0x7f463806ca60 2023-08-27T11:30:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463806d700 con 0x7f463806ca60 2023-08-27T11:30:09.666 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46377fe700 1 -- 172.21.15.43:0/2437388564 >> v1:172.21.15.57:6789/0 conn(0x7f463806ca60 legacy=0x7f46380aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46377fe700 1 -- 172.21.15.43:0/2437388564 >> v1:172.21.15.43:6789/0 conn(0x7f4638155910 legacy=0x7f4638155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.659+0000 7f46377fe700 1 -- 172.21.15.43:0/2437388564 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638152710 con 0x7f46380c51a0 2023-08-27T11:30:09.667 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f46377fe700 1 --2- 172.21.15.43:0/2437388564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46380c51a0 0x7f463806d1c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4628009840 tx=0x7f4628009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b772862b21c592ca server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628011830 con 0x7f46380c51a0 2023-08-27T11:30:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4628011990 con 0x7f46380c51a0 2023-08-27T11:30:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f46367fc700 1 -- 172.21.15.43:0/2437388564 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628011d20 con 0x7f46380c51a0 2023-08-27T11:30:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f463e1ff700 1 -- 172.21.15.43:0/2437388564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46380c51a0 msgr2=0x7f463806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.668 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f463e1ff700 1 --2- 172.21.15.43:0/2437388564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46380c51a0 0x7f463806d1c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4628009840 tx=0x7f4628009b50 comp rx=0 tx=0).stop 2023-08-27T11:30:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f463e1ff700 1 -- 172.21.15.43:0/2437388564 shutdown_connections 2023-08-27T11:30:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f463e1ff700 1 --2- 172.21.15.43:0/2437388564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46380c51a0 0x7f463806d1c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.660+0000 7f463e1ff700 1 -- 172.21.15.43:0/2437388564 >> 172.21.15.43:0/2437388564 conn(0x7f463806aa50 msgr2=0x7f46380c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.661+0000 7f463e1ff700 1 -- 172.21.15.43:0/2437388564 shutdown_connections 2023-08-27T11:30:09.669 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.661+0000 7f463e1ff700 1 -- 172.21.15.43:0/2437388564 wait complete. 2023-08-27T11:30:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.662+0000 7f463e1ff700 1 Processor -- start 2023-08-27T11:30:09.670 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.662+0000 7f463e1ff700 1 -- start start 2023-08-27T11:30:09.672 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:09.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46380c51a0 0x7f46380bba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:09.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4638155910 0x7f463814bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:09.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381ed510 con 0x7f463806ca60 2023-08-27T11:30:09.673 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381eda40 con 0x7f4638155910 2023-08-27T11:30:09.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.663+0000 7f463e1ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380a9f50 con 0x7f46380c51a0 2023-08-27T11:30:09.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:09.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41920/0 (socket says 172.21.15.43:41920) 2023-08-27T11:30:09.674 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 -- 172.21.15.43:0/1512899498 learned_addr learned my addr 172.21.15.43:0/1512899498 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f4636ffd700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46380c51a0 0x7f46380bba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f4637fff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4638155910 0x7f463814bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 -- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46380c51a0 msgr2=0x7f46380bba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46380c51a0 0x7f46380bba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.675 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 -- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4638155910 msgr2=0x7f463814bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4638155910 0x7f463814bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 -- 172.21.15.43:0/1512899498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280094a0 con 0x7f463806ca60 2023-08-27T11:30:09.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.664+0000 7f46377fe700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f463806de40 tx=0x7f4628004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.665+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462801aa70 con 0x7f463806ca60 2023-08-27T11:30:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.665+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462801abd0 con 0x7f463806ca60 2023-08-27T11:30:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.665+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46381ed760 con 0x7f463806ca60 2023-08-27T11:30:09.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.665+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280243f0 con 0x7f463806ca60 2023-08-27T11:30:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.665+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380a9be0 con 0x7f463806ca60 2023-08-27T11:30:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.666+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463814c840 con 0x7f463806ca60 2023-08-27T11:30:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.667+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4628024550 con 0x7f463806ca60 2023-08-27T11:30:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.668+0000 7f461ffff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 0x7f462406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:09.678 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.668+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4628089cb0 con 0x7f463806ca60 2023-08-27T11:30:09.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.668+0000 7f4636ffd700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 0x7f462406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:09.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.669+0000 7f4636ffd700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 0x7f462406c5a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f46380a9760 tx=0x7f462c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:09.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.673+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f463814c840 con 0x7f463806ca60 2023-08-27T11:30:09.927 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.926+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f463814c840 con 0x7f463806ca60 2023-08-27T11:30:09.928 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.926+0000 7f461ffff700 1 -- 172.21.15.43:0/1512899498 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f463814c840 con 0x7f463806ca60 2023-08-27T11:30:09.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:09.928 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:09.931 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 msgr2=0x7f462406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 0x7f462406c5a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f46380a9760 tx=0x7f462c009040 comp rx=0 tx=0).stop 2023-08-27T11:30:09.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 msgr2=0x7f46380aa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:09.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f463806de40 tx=0x7f4628004750 comp rx=0 tx=0).stop 2023-08-27T11:30:09.932 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 shutdown_connections 2023-08-27T11:30:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f462406a0e0 0x7f462406c5a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4638155910 0x7f463814bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f463806ca60 0x7f46380aa3b0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.933 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 --2- 172.21.15.43:0/1512899498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f46380c51a0 0x7f46380bba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 >> 172.21.15.43:0/1512899498 conn(0x7f463806aa50 msgr2=0x7f46381df720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 shutdown_connections 2023-08-27T11:30:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:09.929+0000 7f463e1ff700 1 -- 172.21.15.43:0/1512899498 wait complete. 2023-08-27T11:30:09.934 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:09.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:30:10.155 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.154+0000 7fa664dff700 1 Processor -- start 2023-08-27T11:30:10.156 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.154+0000 7fa664dff700 1 -- start start 2023-08-27T11:30:10.160 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.155+0000 7fa664dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa66014e0d0 0x7fa6600c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.155+0000 7fa664dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 0x7fa6600bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa664dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600c17f0 con 0x7fa6600c45c0 2023-08-27T11:30:10.161 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa664dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600c21a0 con 0x7fa66014e0d0 2023-08-27T11:30:10.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa664dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600bc210 con 0x7fa6600c4c40 2023-08-27T11:30:10.162 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65ed9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa6600c45c0 0x7fa6600bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33594/0 (socket says 172.21.15.43:33594) 2023-08-27T11:30:10.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65ed9d700 1 -- 172.21.15.43:0/2722010601 learned_addr learned my addr 172.21.15.43:0/2722010601 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:10.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65e59c700 1 --2- 172.21.15.43:0/2722010601 >> v2:172.21.15.57:3300/0 conn(0x7fa66014e0d0 0x7fa6600c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.163 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 0x7fa6600bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.164 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134700046 0 0) 0x7fa6600c17f0 con 0x7fa6600c45c0 2023-08-27T11:30:10.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.156+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6480035b0 con 0x7fa6600c45c0 2023-08-27T11:30:10.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65e59c700 1 -- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 msgr2=0x7fa6600bb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:10.165 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704703321 0 0) 0x7fa6480035b0 con 0x7fa6600c45c0 2023-08-27T11:30:10.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65e59c700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 0x7fa6600bb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65e59c700 1 -- 172.21.15.43:0/2722010601 >> v1:172.21.15.43:6789/0 conn(0x7fa6600c45c0 legacy=0x7fa6600bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65e59c700 1 -- 172.21.15.43:0/2722010601 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600c0900 con 0x7fa66014e0d0 2023-08-27T11:30:10.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 0x7fa6600bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:30:10.166 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65e59c700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66014e0d0 0x7fa6600c4080 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa65000aa10 tx=0x7fa65000ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9162e2f7a0f06fc server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6580019f0 con 0x7fa66014e0d0 2023-08-27T11:30:10.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65000aeb0 con 0x7fa66014e0d0 2023-08-27T11:30:10.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.157+0000 7fa65d59a700 1 -- 172.21.15.43:0/2722010601 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650004230 con 0x7fa66014e0d0 2023-08-27T11:30:10.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 -- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66014e0d0 msgr2=0x7fa6600c4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.167 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66014e0d0 0x7fa6600c4080 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa65000aa10 tx=0x7fa65000ad20 comp rx=0 tx=0).stop 2023-08-27T11:30:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 -- 172.21.15.43:0/2722010601 shutdown_connections 2023-08-27T11:30:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa66014e0d0 0x7fa6600c4080 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 --2- 172.21.15.43:0/2722010601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa6600c4c40 0x7fa6600bb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 -- 172.21.15.43:0/2722010601 >> 172.21.15.43:0/2722010601 conn(0x7fa66006aa50 msgr2=0x7fa6600c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:10.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 -- 172.21.15.43:0/2722010601 shutdown_connections 2023-08-27T11:30:10.169 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.158+0000 7fa664dff700 1 -- 172.21.15.43:0/2722010601 wait complete. 2023-08-27T11:30:10.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.160+0000 7fa664dff700 1 Processor -- start 2023-08-27T11:30:10.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.160+0000 7fa664dff700 1 -- start start 2023-08-27T11:30:10.172 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 0x7fa660152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa66014e0d0 0x7fa66006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6601457d0 con 0x7fa6600c45c0 2023-08-27T11:30:10.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa660153270 con 0x7fa6600c4c40 2023-08-27T11:30:10.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa664dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600be780 con 0x7fa66014e0d0 2023-08-27T11:30:10.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa65e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa65e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41924/0 (socket says 172.21.15.43:41924) 2023-08-27T11:30:10.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.161+0000 7fa65e59c700 1 -- 172.21.15.43:0/1927718296 learned_addr learned my addr 172.21.15.43:0/1927718296 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:10.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 -- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa66014e0d0 msgr2=0x7fa66006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa66014e0d0 0x7fa66006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 0x7fa660152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 -- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 msgr2=0x7fa660152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 0x7fa660152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 -- 172.21.15.43:0/1927718296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540094a0 con 0x7fa6600c45c0 2023-08-27T11:30:10.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 0x7fa660152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-27T11:30:10.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa65e59c700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a1c0 tx=0x7fa650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65001d070 con 0x7fa6600c45c0 2023-08-27T11:30:10.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6500036a0 con 0x7fa6600c45c0 2023-08-27T11:30:10.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650003a50 con 0x7fa6600c45c0 2023-08-27T11:30:10.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65000a640 con 0x7fa6600c45c0 2023-08-27T11:30:10.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.162+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660154dd0 con 0x7fa6600c45c0 2023-08-27T11:30:10.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.163+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6600a52d0 con 0x7fa6600c45c0 2023-08-27T11:30:10.177 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.164+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa650003bb0 con 0x7fa6600c45c0 2023-08-27T11:30:10.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.165+0000 7fa64effd700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 0x7fa64006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.165+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa650089460 con 0x7fa6600c45c0 2023-08-27T11:30:10.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.166+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 0x7fa64006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.178 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.166+0000 7fa65dd9b700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 0x7fa64006c5d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c50a0 tx=0x7fa654008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.170+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa650054c60 con 0x7fa6600c45c0 2023-08-27T11:30:10.380 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.379+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa66004ee70 con 0x7fa6600c45c0 2023-08-27T11:30:10.381 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.380+0000 7fa64effd700 1 -- 172.21.15.43:0/1927718296 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18175 (secure 0 0 0) 0x7fa650003e60 con 0x7fa6600c45c0 2023-08-27T11:30:10.382 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:10.382 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":144,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:37.239615+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:30:10.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 msgr2=0x7fa64006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 0x7fa64006c5d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c50a0 tx=0x7fa654008040 comp rx=0 tx=0).stop 2023-08-27T11:30:10.384 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 msgr2=0x7fa6600bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa65000a1c0 tx=0x7fa650004750 comp rx=0 tx=0).stop 2023-08-27T11:30:10.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 shutdown_connections 2023-08-27T11:30:10.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fa64006a110 0x7fa64006c5d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa66014e0d0 0x7fa66006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.385 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa6600c45c0 0x7fa6600bf600 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 --2- 172.21.15.43:0/1927718296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa6600c4c40 0x7fa660152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 >> 172.21.15.43:0/1927718296 conn(0x7fa66006aa50 msgr2=0x7fa6600c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:10.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 shutdown_connections 2023-08-27T11:30:10.386 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.383+0000 7fa664dff700 1 -- 172.21.15.43:0/1927718296 wait complete. 2023-08-27T11:30:10.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-08-27T11:22:35.906634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-08-27T11:22:36.376930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-27T11:29:34.081909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-27T11:29:34.733420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-27T11:30:10.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-27T11:30:10.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.608+0000 7fcf79fff700 1 Processor -- start 2023-08-27T11:30:10.609 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.608+0000 7fcf79fff700 1 -- start start 2023-08-27T11:30:10.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf79fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf740c7c00 0x7fcf740c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf79fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf74154660 con 0x7fcf74151d20 2023-08-27T11:30:10.610 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf79fff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf74154940 con 0x7fcf7406a8e0 2023-08-27T11:30:10.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf79fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740c5750 con 0x7fcf740c7c00 2023-08-27T11:30:10.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf737fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fcf74151d20 0x7fcf740ab780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33606/0 (socket says 172.21.15.43:33606) 2023-08-27T11:30:10.611 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf737fe700 1 -- 172.21.15.43:0/1812563609 learned_addr learned my addr 172.21.15.43:0/1812563609 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:10.612 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> v2:172.21.15.57:3300/0 conn(0x7fcf740c7c00 0x7fcf740c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.620 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665027319 0 0) 0x7fcf74154660 con 0x7fcf74151d20 2023-08-27T11:30:10.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.609+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf5c0035b0 con 0x7fcf74151d20 2023-08-27T11:30:10.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.1 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642725419 0 0) 0x7fcf74154940 con 0x7fcf7406a8e0 2023-08-27T11:30:10.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf74154660 con 0x7fcf7406a8e0 2023-08-27T11:30:10.621 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1848482154 0 0) 0x7fcf5c0035b0 con 0x7fcf74151d20 2023-08-27T11:30:10.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 >> v2:172.21.15.57:3300/0 conn(0x7fcf740c7c00 msgr2=0x7fcf740c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:10.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 --2- 172.21.15.43:0/1812563609 >> v2:172.21.15.57:3300/0 conn(0x7fcf740c7c00 0x7fcf740c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 >> v1:172.21.15.57:6789/0 conn(0x7fcf7406a8e0 legacy=0x7fcf7406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74154c20 con 0x7fcf74151d20 2023-08-27T11:30:10.622 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7fcf64001670 con 0x7fcf74151d20 2023-08-27T11:30:10.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> v2:172.21.15.57:3300/0 conn(0x7fcf740c7c00 0x7fcf740c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-27T11:30:10.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 >> v1:172.21.15.43:6789/0 conn(0x7fcf74151d20 legacy=0x7fcf740ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5c003c00 0x7fcf5c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 0x7fcf5c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c005280 0x7fcf5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c00c1b0 con 0x7fcf5c004850 2023-08-27T11:30:10.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c00c320 con 0x7fcf5c003c00 2023-08-27T11:30:10.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c00c4e0 con 0x7fcf5c005280 2023-08-27T11:30:10.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 0x7fcf5c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf73fff700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c005280 0x7fcf5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.610+0000 7fcf737fe700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5c003c00 0x7fcf5c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 -- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c005280 msgr2=0x7fcf5c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:10.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c005280 0x7fcf5c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 -- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5c003c00 msgr2=0x7fcf5c004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:10.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5c003c00 0x7fcf5c004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 -- 172.21.15.43:0/1812563609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0035b0 con 0x7fcf5c004850 2023-08-27T11:30:10.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf73fff700 1 -- 172.21.15.43:0/1812563609 reap_dead start 2023-08-27T11:30:10.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf737fe700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf5c003c00 0x7fcf5c004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:10.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 0x7fcf5c004cd0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009d30 tx=0x7fcf5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a82ee92aa231e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68009e80 con 0x7fcf5c004850 2023-08-27T11:30:10.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6800e9a0 con 0x7fcf5c004850 2023-08-27T11:30:10.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.611+0000 7fcf727fc700 1 -- 172.21.15.43:0/1812563609 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800ed10 con 0x7fcf5c004850 2023-08-27T11:30:10.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 -- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 msgr2=0x7fcf5c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 0x7fcf5c004cd0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009d30 tx=0x7fcf5c005880 comp rx=0 tx=0).stop 2023-08-27T11:30:10.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 -- 172.21.15.43:0/1812563609 shutdown_connections 2023-08-27T11:30:10.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 --2- 172.21.15.43:0/1812563609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf5c004850 0x7fcf5c004cd0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 -- 172.21.15.43:0/1812563609 >> 172.21.15.43:0/1812563609 conn(0x7fcf740c9d00 msgr2=0x7fcf740ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:10.628 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 -- 172.21.15.43:0/1812563609 shutdown_connections 2023-08-27T11:30:10.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.612+0000 7fcf79fff700 1 -- 172.21.15.43:0/1812563609 wait complete. 2023-08-27T11:30:10.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.614+0000 7fcf79fff700 1 Processor -- start 2023-08-27T11:30:10.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.614+0000 7fcf79fff700 1 -- start start 2023-08-27T11:30:10.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c004850 0x7fcf741ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.629 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf740ab450 0x7fcf740aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741ea7d0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740c3d70 con 0x7fcf740ab450 2023-08-27T11:30:10.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf79fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74148b40 con 0x7fcf5c004850 2023-08-27T11:30:10.630 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41952/0 (socket says 172.21.15.43:41952) 2023-08-27T11:30:10.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 -- 172.21.15.43:0/304985500 learned_addr learned my addr 172.21.15.43:0/304985500 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:10.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf737fe700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c004850 0x7fcf741ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf72ffd700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf740ab450 0x7fcf740aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.631 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 -- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c004850 msgr2=0x7fcf741ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c004850 0x7fcf741ea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 -- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf740ab450 msgr2=0x7fcf740aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.632 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf740ab450 0x7fcf740aa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.615+0000 7fcf73fff700 1 -- 172.21.15.43:0/304985500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7414c060 con 0x7fcf740bf9d0 2023-08-27T11:30:10.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf73fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fcf740c7790 tx=0x7fcf6c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c003c60 con 0x7fcf740bf9d0 2023-08-27T11:30:10.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c003de0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.633 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7414db60 con 0x7fcf740bf9d0 2023-08-27T11:30:10.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00daf0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.616+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7414c2d0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.617+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7404ee70 con 0x7fcf740bf9d0 2023-08-27T11:30:10.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.618+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf6c00dc50 con 0x7fcf740bf9d0 2023-08-27T11:30:10.634 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.619+0000 7fcf5bfff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 0x7fcf6006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:10.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.619+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf6c088640 con 0x7fcf740bf9d0 2023-08-27T11:30:10.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.619+0000 7fcf737fe700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 0x7fcf6006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:10.635 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.620+0000 7fcf737fe700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 0x7fcf6006c5d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000ff0 tx=0x7fcf64007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:10.636 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.623+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf6c053dd0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.835 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.834+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf740ac650 con 0x7fcf740bf9d0 2023-08-27T11:30:10.836 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.835+0000 7fcf5bfff700 1 -- 172.21.15.43:0/304985500 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf6c0573f0 con 0x7fcf740bf9d0 2023-08-27T11:30:10.836 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2023-08-27T11:30:10.838 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 msgr2=0x7fcf6006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 0x7fcf6006c5d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcf64000ff0 tx=0x7fcf64007040 comp rx=0 tx=0).stop 2023-08-27T11:30:10.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 msgr2=0x7fcf740bfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:10.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fcf740c7790 tx=0x7fcf6c00d430 comp rx=0 tx=0).stop 2023-08-27T11:30:10.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 shutdown_connections 2023-08-27T11:30:10.839 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fcf6006a110 0x7fcf6006c5d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fcf740bf9d0 0x7fcf740bfe80 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf5c004850 0x7fcf741ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 --2- 172.21.15.43:0/304985500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf740ab450 0x7fcf740aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:10.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 >> 172.21.15.43:0/304985500 conn(0x7fcf740c9d00 msgr2=0x7fcf7406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:10.840 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 shutdown_connections 2023-08-27T11:30:10.841 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:10.837+0000 7fcf79fff700 1 -- 172.21.15.43:0/304985500 wait complete. 2023-08-27T11:30:10.857 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-27T11:30:11.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.061+0000 7f219d7ff700 1 Processor -- start 2023-08-27T11:30:11.062 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.061+0000 7f219d7ff700 1 -- start start 2023-08-27T11:30:11.063 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f219d7ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f21980c7c00 0x7f21980c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f219d7ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198154660 con 0x7f219806a8e0 2023-08-27T11:30:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f219d7ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2198154940 con 0x7f2198151d20 2023-08-27T11:30:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f219d7ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980c5750 con 0x7f21980c7c00 2023-08-27T11:30:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f21977fe700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f219806a8e0 0x7f219806acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33612/0 (socket says 172.21.15.43:33612) 2023-08-27T11:30:11.064 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.062+0000 7f21977fe700 1 -- 172.21.15.43:0/3532451454 learned_addr learned my addr 172.21.15.43:0/3532451454 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:11.065 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f21967fc700 1 --2- 172.21.15.43:0/3532451454 >> v2:172.21.15.57:3300/0 conn(0x7f21980c7c00 0x7f21980c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f2195ffb700 1 -- 172.21.15.43:0/3532451454 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693174181 0 0) 0x7f2198154660 con 0x7f219806a8e0 2023-08-27T11:30:11.066 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f2195ffb700 1 -- 172.21.15.43:0/3532451454 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21800035b0 con 0x7f219806a8e0 2023-08-27T11:30:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f21967fc700 1 -- 172.21.15.43:0/3532451454 >> v1:172.21.15.57:6789/0 conn(0x7f2198151d20 legacy=0x7f21980ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f21967fc700 1 -- 172.21.15.43:0/3532451454 >> v1:172.21.15.43:6789/0 conn(0x7f219806a8e0 legacy=0x7f219806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f21967fc700 1 -- 172.21.15.43:0/3532451454 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198154c20 con 0x7f21980c7c00 2023-08-27T11:30:11.067 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.063+0000 7f21967fc700 1 --2- 172.21.15.43:0/3532451454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21980c7c00 0x7f21980c8110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2198152140 tx=0x7f218c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5a764b08b25534 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f2195ffb700 1 -- 172.21.15.43:0/3532451454 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c004020 con 0x7f21980c7c00 2023-08-27T11:30:11.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f2195ffb700 1 -- 172.21.15.43:0/3532451454 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c004180 con 0x7f21980c7c00 2023-08-27T11:30:11.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f2195ffb700 1 -- 172.21.15.43:0/3532451454 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c004530 con 0x7f21980c7c00 2023-08-27T11:30:11.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 -- 172.21.15.43:0/3532451454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21980c7c00 msgr2=0x7f21980c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.068 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3532451454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21980c7c00 0x7f21980c8110 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f2198152140 tx=0x7f218c009b20 comp rx=0 tx=0).stop 2023-08-27T11:30:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 -- 172.21.15.43:0/3532451454 shutdown_connections 2023-08-27T11:30:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3532451454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f21980c7c00 0x7f21980c8110 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 -- 172.21.15.43:0/3532451454 >> 172.21.15.43:0/3532451454 conn(0x7f21980c9d00 msgr2=0x7f21980ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 -- 172.21.15.43:0/3532451454 shutdown_connections 2023-08-27T11:30:11.069 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.065+0000 7f219d7ff700 1 -- 172.21.15.43:0/3532451454 wait complete. 2023-08-27T11:30:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.067+0000 7f219d7ff700 1 Processor -- start 2023-08-27T11:30:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.067+0000 7f219d7ff700 1 -- start start 2023-08-27T11:30:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21980c7c00 0x7f219814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.072 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2198151d20 0x7f21981483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c3cf0 con 0x7f219806a8e0 2023-08-27T11:30:11.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c2960 con 0x7f2198151d20 2023-08-27T11:30:11.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f219d7ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980c1720 con 0x7f21980c7c00 2023-08-27T11:30:11.073 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f2196ffd700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41966/0 (socket says 172.21.15.43:41966) 2023-08-27T11:30:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.068+0000 7f2196ffd700 1 -- 172.21.15.43:0/3278719948 learned_addr learned my addr 172.21.15.43:0/3278719948 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f21977fe700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2198151d20 0x7f21981483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f21967fc700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21980c7c00 0x7f219814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.074 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 -- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21980c7c00 msgr2=0x7f219814c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21980c7c00 0x7f219814c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 -- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2198151d20 msgr2=0x7f21981483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2198151d20 0x7f21981483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 -- 172.21.15.43:0/3278719948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c0094a0 con 0x7f219806a8e0 2023-08-27T11:30:11.075 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f2196ffd700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f218800c480 tx=0x7f218800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880052d0 con 0x7f219806a8e0 2023-08-27T11:30:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2188005430 con 0x7f219806a8e0 2023-08-27T11:30:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21880038c0 con 0x7f219806a8e0 2023-08-27T11:30:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219814e5c0 con 0x7f219806a8e0 2023-08-27T11:30:11.076 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.069+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21980c2680 con 0x7f219806a8e0 2023-08-27T11:30:11.077 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.070+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219804ee70 con 0x7f219806a8e0 2023-08-27T11:30:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.071+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2188003a20 con 0x7f219806a8e0 2023-08-27T11:30:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.073+0000 7f217f7fe700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 0x7f218406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.073+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21880879f0 con 0x7f219806a8e0 2023-08-27T11:30:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.073+0000 7f21967fc700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 0x7f218406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.078 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.074+0000 7f21967fc700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 0x7f218406c5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f218c0090b0 tx=0x7f218c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.079 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.077+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f21880530d0 con 0x7f219806a8e0 2023-08-27T11:30:11.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.287+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f219814b930 con 0x7f219806a8e0 2023-08-27T11:30:11.288 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.287+0000 7f217f7fe700 1 -- 172.21.15.43:0/3278719948 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2188017020 con 0x7f219806a8e0 2023-08-27T11:30:11.289 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2023-08-27T11:30:11.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 msgr2=0x7f218406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.291 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 0x7f218406c5a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f218c0090b0 tx=0x7f218c008030 comp rx=0 tx=0).stop 2023-08-27T11:30:11.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 msgr2=0x7f21980c1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f218800c480 tx=0x7f218800c840 comp rx=0 tx=0).stop 2023-08-27T11:30:11.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 shutdown_connections 2023-08-27T11:30:11.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f218406a0e0 0x7f218406c5a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.292 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2198151d20 0x7f21981483d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f219806a8e0 0x7f21980c1be0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 --2- 172.21.15.43:0/3278719948 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f21980c7c00 0x7f219814c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 >> 172.21.15.43:0/3278719948 conn(0x7f21980c9d00 msgr2=0x7f21980ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:11.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 shutdown_connections 2023-08-27T11:30:11.293 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.290+0000 7f219d7ff700 1 -- 172.21.15.43:0/3278719948 wait complete. 2023-08-27T11:30:11.309 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-27T11:30:11.515 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.513+0000 7fdb213ff700 1 Processor -- start 2023-08-27T11:30:11.516 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.514+0000 7fdb213ff700 1 -- start start 2023-08-27T11:30:11.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c151d20 0x7fdb1c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.519 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb1c0c7c00 0x7fdb1c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c0c5750 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c154660 con 0x7fdb1c0c7c00 2023-08-27T11:30:11.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb213ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c154940 con 0x7fdb1c151d20 2023-08-27T11:30:11.520 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb1b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb1b7fe700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41982/0 (socket says 172.21.15.43:41982) 2023-08-27T11:30:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3189599684 learned_addr learned my addr 172.21.15.43:0/3189599684 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb1affd700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c151d20 0x7fdb1c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.515+0000 7fdb13fff700 1 --2- 172.21.15.43:0/3189599684 >> v2:172.21.15.57:3300/0 conn(0x7fdb1c0c7c00 0x7fdb1c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.521 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3189599684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c151d20 msgr2=0x7fdb1c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c151d20 0x7fdb1c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3189599684 >> v2:172.21.15.57:3300/0 conn(0x7fdb1c0c7c00 msgr2=0x7fdb1c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3189599684 >> v2:172.21.15.57:3300/0 conn(0x7fdb1c0c7c00 0x7fdb1c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3189599684 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c154c20 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0c77f0 tx=0x7fdb1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96edd74b5615c29 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.522 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1a7fc700 1 -- 172.21.15.43:0/3189599684 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400e070 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1a7fc700 1 -- 172.21.15.43:0/3189599684 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400b910 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.516+0000 7fdb1a7fc700 1 -- 172.21.15.43:0/3189599684 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bcc0 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 -- 172.21.15.43:0/3189599684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c0abcc0 msgr2=0x7fdb1c06a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0c77f0 tx=0x7fdb1400b330 comp rx=0 tx=0).stop 2023-08-27T11:30:11.523 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 -- 172.21.15.43:0/3189599684 shutdown_connections 2023-08-27T11:30:11.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c06a8e0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3189599684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c151d20 0x7fdb1c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3189599684 >> v2:172.21.15.57:3300/0 conn(0x7fdb1c0c7c00 0x7fdb1c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 -- 172.21.15.43:0/3189599684 >> 172.21.15.43:0/3189599684 conn(0x7fdb1c0c9d00 msgr2=0x7fdb1c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:11.524 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 -- 172.21.15.43:0/3189599684 shutdown_connections 2023-08-27T11:30:11.525 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.517+0000 7fdb213ff700 1 -- 172.21.15.43:0/3189599684 wait complete. 2023-08-27T11:30:11.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.519+0000 7fdb213ff700 1 Processor -- start 2023-08-27T11:30:11.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.520+0000 7fdb213ff700 1 -- start start 2023-08-27T11:30:11.527 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c0aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c0c7c00 0x7fdb1c14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c14ef20 con 0x7fdb1c151d20 2023-08-27T11:30:11.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c157eb0 con 0x7fdb1c0abcc0 2023-08-27T11:30:11.528 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb213ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c158190 con 0x7fdb1c0c7c00 2023-08-27T11:30:11.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:41996/0 (socket says 172.21.15.43:41996) 2023-08-27T11:30:11.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3463373407 learned_addr learned my addr 172.21.15.43:0/3463373407 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:11.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb13fff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c0c7c00 0x7fdb1c14cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.529 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.521+0000 7fdb1affd700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c0aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c0c7c00 msgr2=0x7fdb1c14cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c0c7c00 0x7fdb1c14cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb1c0abcc0 msgr2=0x7fdb1c0aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c0aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.530 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 -- 172.21.15.43:0/3463373407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009b30 con 0x7fdb1c151d20 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb1b7fe700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400b370 tx=0x7fdb14004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140099b0 con 0x7fdb1c151d20 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14003e80 con 0x7fdb1c151d20 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14004470 con 0x7fdb1c151d20 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c158470 con 0x7fdb1c151d20 2023-08-27T11:30:11.531 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.522+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c0aae60 con 0x7fdb1c151d20 2023-08-27T11:30:11.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.523+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c14bfc0 con 0x7fdb1c151d20 2023-08-27T11:30:11.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.524+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb140045d0 con 0x7fdb1c151d20 2023-08-27T11:30:11.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.525+0000 7fdb137fe700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 0x7fdafc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.525+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb140898e0 con 0x7fdb1c151d20 2023-08-27T11:30:11.532 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.526+0000 7fdb1affd700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 0x7fdafc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.526+0000 7fdb1affd700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 0x7fdafc06c5a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009b40 tx=0x7fdb0c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.533 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.530+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb14054fc0 con 0x7fdb1c151d20 2023-08-27T11:30:11.740 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.739+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb1c04ee70 con 0x7fdb1c151d20 2023-08-27T11:30:11.741 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.740+0000 7fdb137fe700 1 -- 172.21.15.43:0/3463373407 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb140200a0 con 0x7fdb1c151d20 2023-08-27T11:30:11.741 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2023-08-27T11:30:11.743 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 msgr2=0x7fdafc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 0x7fdafc06c5a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009b40 tx=0x7fdb0c009210 comp rx=0 tx=0).stop 2023-08-27T11:30:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 msgr2=0x7fdb1c14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400b370 tx=0x7fdb14004b20 comp rx=0 tx=0).stop 2023-08-27T11:30:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 shutdown_connections 2023-08-27T11:30:11.744 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7fdafc06a0e0 0x7fdafc06c5a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdb1c151d20 0x7fdb1c14c1c0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb1c0abcc0 0x7fdb1c0aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 --2- 172.21.15.43:0/3463373407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb1c0c7c00 0x7fdb1c14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 >> 172.21.15.43:0/3463373407 conn(0x7fdb1c0c9d00 msgr2=0x7fdb1c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:11.745 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 shutdown_connections 2023-08-27T11:30:11.746 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.742+0000 7fdb213ff700 1 -- 172.21.15.43:0/3463373407 wait complete. 2023-08-27T11:30:11.761 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-27T11:30:11.859 DEBUG:teuthology.orchestra.run.smithi043:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:30:11.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-27T11:30:11.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.968+0000 7f0cf47ff700 1 Processor -- start 2023-08-27T11:30:11.969 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.968+0000 7f0cf47ff700 1 -- start start 2023-08-27T11:30:11.970 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf47ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0cec151d20 0x7f0cec0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf47ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec154660 con 0x7f0cec0abcc0 2023-08-27T11:30:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf47ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0c5750 con 0x7f0cec151d20 2023-08-27T11:30:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec154940 con 0x7f0cec0c7c00 2023-08-27T11:30:11.971 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf259b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0cec151d20 0x7f0cec0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf259b700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0cec151d20 0x7f0cec0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42006/0 (socket says 172.21.15.43:42006) 2023-08-27T11:30:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.969+0000 7f0cf259b700 1 -- 172.21.15.43:0/3014299123 learned_addr learned my addr 172.21.15.43:0/3014299123 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:11.972 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf1d9a700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.973 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf259b700 1 -- 172.21.15.43:0/3014299123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 msgr2=0x7f0cec0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:11.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf259b700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf259b700 1 -- 172.21.15.43:0/3014299123 >> v1:172.21.15.57:6789/0 conn(0x7f0cec0abcc0 legacy=0x7f0cec06a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf259b700 1 -- 172.21.15.43:0/3014299123 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec154c20 con 0x7f0cec151d20 2023-08-27T11:30:11.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf259b700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec151d20 0x7f0cec0c8110 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80098f0 tx=0x7f0ce8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9a00005285031b server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.974 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.970+0000 7f0cf1599700 1 -- 172.21.15.43:0/3014299123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800b8a0 con 0x7f0cec151d20 2023-08-27T11:30:11.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf1599700 1 -- 172.21.15.43:0/3014299123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800ba00 con 0x7f0cec151d20 2023-08-27T11:30:11.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf1599700 1 -- 172.21.15.43:0/3014299123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800bd90 con 0x7f0cec151d20 2023-08-27T11:30:11.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 -- 172.21.15.43:0/3014299123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec151d20 msgr2=0x7f0cec0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec151d20 0x7f0cec0c8110 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80098f0 tx=0x7f0ce8009c00 comp rx=0 tx=0).stop 2023-08-27T11:30:11.975 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 -- 172.21.15.43:0/3014299123 shutdown_connections 2023-08-27T11:30:11.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec151d20 0x7f0cec0c8110 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/3014299123 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 -- 172.21.15.43:0/3014299123 >> 172.21.15.43:0/3014299123 conn(0x7f0cec0c9d00 msgr2=0x7f0cec0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:11.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 -- 172.21.15.43:0/3014299123 shutdown_connections 2023-08-27T11:30:11.976 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.971+0000 7f0cf47ff700 1 -- 172.21.15.43:0/3014299123 wait complete. 2023-08-27T11:30:11.979 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.973+0000 7f0cf47ff700 1 Processor -- start 2023-08-27T11:30:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.973+0000 7f0cf47ff700 1 -- start start 2023-08-27T11:30:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 0x7f0cec1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.980 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c3c10 con 0x7f0cec0abcc0 2023-08-27T11:30:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1ea720 con 0x7f0cec151d20 2023-08-27T11:30:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf47ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0aacb0 con 0x7f0cec0c7c00 2023-08-27T11:30:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf259b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf259b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42012/0 (socket says 172.21.15.43:42012) 2023-08-27T11:30:11.981 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf259b700 1 -- 172.21.15.43:0/2787500462 learned_addr learned my addr 172.21.15.43:0/2787500462 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf1d9a700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.974+0000 7f0cf2d9c700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 0x7f0cec1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 -- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 msgr2=0x7f0cec158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.982 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 -- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 msgr2=0x7f0cec1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 0x7f0cec1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 -- 172.21.15.43:0/2787500462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8009550 con 0x7f0cec0abcc0 2023-08-27T11:30:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf2d9c700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 0x7f0cec1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf259b700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009c40 tx=0x7f0ce8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.983 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8004590 con 0x7f0cec0abcc0 2023-08-27T11:30:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce801e070 con 0x7f0cec0abcc0 2023-08-27T11:30:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0aaf90 con 0x7f0cec0abcc0 2023-08-27T11:30:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80038e0 con 0x7f0cec0abcc0 2023-08-27T11:30:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.975+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec1ecdd0 con 0x7f0cec0abcc0 2023-08-27T11:30:11.984 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.976+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec04ee70 con 0x7f0cec0abcc0 2023-08-27T11:30:11.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.977+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ce8003a40 con 0x7f0cec0abcc0 2023-08-27T11:30:11.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.978+0000 7f0ce2ffd700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 0x7f0cd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:11.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.978+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0ce8020070 con 0x7f0cec0abcc0 2023-08-27T11:30:11.985 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.979+0000 7f0cf1d9a700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 0x7f0cd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:11.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.979+0000 7f0cf1d9a700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 0x7f0cd006c5a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0cec150e90 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:11.986 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:11.983+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ce8055070 con 0x7f0cec0abcc0 2023-08-27T11:30:12.193 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.193+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cec0ac650 con 0x7f0cec0abcc0 2023-08-27T11:30:12.194 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.193+0000 7f0ce2ffd700 1 -- 172.21.15.43:0/2787500462 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ce802ee80 con 0x7f0cec0abcc0 2023-08-27T11:30:12.195 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2023-08-27T11:30:12.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.195+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 msgr2=0x7f0cd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.195+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 0x7f0cd006c5a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0cec150e90 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2023-08-27T11:30:12.197 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.195+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 msgr2=0x7f0cec153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.195+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009c40 tx=0x7f0ce8004750 comp rx=0 tx=0).stop 2023-08-27T11:30:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 shutdown_connections 2023-08-27T11:30:12.198 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f0cd006a0e0 0x7f0cd006c5a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cec151d20 0x7f0cec1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0cec0abcc0 0x7f0cec153680 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 --2- 172.21.15.43:0/2787500462 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0cec0c7c00 0x7f0cec158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.200 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 >> 172.21.15.43:0/2787500462 conn(0x7f0cec0c9d00 msgr2=0x7f0cec06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 shutdown_connections 2023-08-27T11:30:12.201 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.196+0000 7f0cf47ff700 1 -- 172.21.15.43:0/2787500462 wait complete. 2023-08-27T11:30:12.215 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.456+0000 7f33fa5ff700 1 Processor -- start 2023-08-27T11:30:12.457 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.456+0000 7f33fa5ff700 1 -- start start 2023-08-27T11:30:12.459 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33fa5ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f33f414e380 0x7f33f406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33fa5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f4154da0 0x7f33f4158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33fa5ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40c1750 con 0x7f33f406dff0 2023-08-27T11:30:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33fa5ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40c2820 con 0x7f33f414e380 2023-08-27T11:30:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33fa5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40c1a30 con 0x7f33f4154da0 2023-08-27T11:30:12.460 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33f3fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f33f414e380 0x7f33f406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.457+0000 7f33f8b9c700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f33f406dff0 0x7f33f40bf540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33618/0 (socket says 172.21.15.43:33618) 2023-08-27T11:30:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f8b9c700 1 -- 172.21.15.43:0/3687120770 learned_addr learned my addr 172.21.15.43:0/3687120770 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f37fe700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f4154da0 0x7f33f4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.461 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f2ffd700 1 -- 172.21.15.43:0/3687120770 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593060966 0 0) 0x7f33f40c1750 con 0x7f33f406dff0 2023-08-27T11:30:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f2ffd700 1 -- 172.21.15.43:0/3687120770 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33dc0035b0 con 0x7f33f406dff0 2023-08-27T11:30:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f3fff700 1 -- 172.21.15.43:0/3687120770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f4154da0 msgr2=0x7f33f4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f3fff700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f4154da0 0x7f33f4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f3fff700 1 -- 172.21.15.43:0/3687120770 >> v1:172.21.15.43:6789/0 conn(0x7f33f406dff0 legacy=0x7f33f40bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.462 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f3fff700 1 -- 172.21.15.43:0/3687120770 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40c1d10 con 0x7f33f414e380 2023-08-27T11:30:12.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.458+0000 7f33f3fff700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f406ad80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009840 tx=0x7f33e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c070c0db5724e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33f2ffd700 1 -- 172.21.15.43:0/3687120770 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011830 con 0x7f33f414e380 2023-08-27T11:30:12.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33f2ffd700 1 -- 172.21.15.43:0/3687120770 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4011990 con 0x7f33f414e380 2023-08-27T11:30:12.463 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33f2ffd700 1 -- 172.21.15.43:0/3687120770 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4011d20 con 0x7f33f414e380 2023-08-27T11:30:12.468 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 -- 172.21.15.43:0/3687120770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 msgr2=0x7f33f406ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f406ad80 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009840 tx=0x7f33e4009b50 comp rx=0 tx=0).stop 2023-08-27T11:30:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 -- 172.21.15.43:0/3687120770 shutdown_connections 2023-08-27T11:30:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f406ad80 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/3687120770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f4154da0 0x7f33f4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.469 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 -- 172.21.15.43:0/3687120770 >> 172.21.15.43:0/3687120770 conn(0x7f33f40c2c30 msgr2=0x7f33f40c3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 -- 172.21.15.43:0/3687120770 shutdown_connections 2023-08-27T11:30:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.459+0000 7f33fa5ff700 1 -- 172.21.15.43:0/3687120770 wait complete. 2023-08-27T11:30:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.461+0000 7f33fa5ff700 1 Processor -- start 2023-08-27T11:30:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.461+0000 7f33fa5ff700 1 -- start start 2023-08-27T11:30:12.470 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f406dff0 0x7f33f41ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 0x7f33f41e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41e9520 con 0x7f33f414e380 2023-08-27T11:30:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41523d0 con 0x7f33f4154da0 2023-08-27T11:30:12.471 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33fa5ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4151e10 con 0x7f33f406dff0 2023-08-27T11:30:12.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.472 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42026/0 (socket says 172.21.15.43:42026) 2023-08-27T11:30:12.473 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33f37fe700 1 -- 172.21.15.43:0/784750042 learned_addr learned my addr 172.21.15.43:0/784750042 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:12.474 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33f3fff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f406dff0 0x7f33f41ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.462+0000 7f33f8b9c700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 0x7f33f41e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 -- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f406dff0 msgr2=0x7f33f41ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f406dff0 0x7f33f41ecaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 -- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 msgr2=0x7f33f41e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.475 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 0x7f33f41e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 -- 172.21.15.43:0/784750042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40094a0 con 0x7f33f414e380 2023-08-27T11:30:12.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f8b9c700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 0x7f33f41e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:12.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f37fe700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f33e800e8a0 tx=0x7f33e800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.476 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8009590 con 0x7f33f414e380 2023-08-27T11:30:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8013680 con 0x7f33f414e380 2023-08-27T11:30:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80139f0 con 0x7f33f414e380 2023-08-27T11:30:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f41520f0 con 0x7f33f414e380 2023-08-27T11:30:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.463+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f4145230 con 0x7f33f414e380 2023-08-27T11:30:12.477 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.464+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f41e9970 con 0x7f33f414e380 2023-08-27T11:30:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.465+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33e8013b50 con 0x7f33f414e380 2023-08-27T11:30:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.466+0000 7f33f0ff9700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 0x7f33e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.466+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33e80884d0 con 0x7f33f414e380 2023-08-27T11:30:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.466+0000 7f33f3fff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 0x7f33e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.478 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.467+0000 7f33f3fff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 0x7f33e006c5a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000c00 tx=0x7f33e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.479 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.470+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33f41e9970 con 0x7f33f414e380 2023-08-27T11:30:12.727 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.726+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33f41e9970 con 0x7f33f414e380 2023-08-27T11:30:12.728 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.727+0000 7f33f0ff9700 1 -- 172.21.15.43:0/784750042 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f33f41e9970 con 0x7f33f414e380 2023-08-27T11:30:12.728 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:12.729 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:12.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 msgr2=0x7f33e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 0x7f33e006c5a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000c00 tx=0x7f33e4008030 comp rx=0 tx=0).stop 2023-08-27T11:30:12.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 msgr2=0x7f33f4144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.731 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f33e800e8a0 tx=0x7f33e800ebb0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 shutdown_connections 2023-08-27T11:30:12.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f33e006a0e0 0x7f33e006c5a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f4154da0 0x7f33f41e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f406dff0 0x7f33f41ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.732 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 --2- 172.21.15.43:0/784750042 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f33f414e380 0x7f33f4144cf0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.729+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 >> 172.21.15.43:0/784750042 conn(0x7f33f40c2c30 msgr2=0x7f33f4070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:12.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.730+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 shutdown_connections 2023-08-27T11:30:12.733 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.730+0000 7f33fa5ff700 1 -- 172.21.15.43:0/784750042 wait complete. 2023-08-27T11:30:12.733 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:12.749 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:30:12.951 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.950+0000 7f36ba3ff700 1 Processor -- start 2023-08-27T11:30:12.952 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.951+0000 7f36ba3ff700 1 -- start start 2023-08-27T11:30:12.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36ba3ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36b406e360 0x7f36b406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.953 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36ba3ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40c6820 con 0x7f36b406a310 2023-08-27T11:30:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36ba3ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40c4a50 con 0x7f36b4158190 2023-08-27T11:30:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36ba3ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40c23a0 con 0x7f36b406e360 2023-08-27T11:30:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36b3fff700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f36b406a310 0x7f36b4157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33630/0 (socket says 172.21.15.43:33630) 2023-08-27T11:30:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36b3fff700 1 -- 172.21.15.43:0/2115669331 learned_addr learned my addr 172.21.15.43:0/2115669331 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:12.954 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36b37fe700 1 --2- 172.21.15.43:0/2115669331 >> v2:172.21.15.57:3300/0 conn(0x7f36b406e360 0x7f36b406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.952+0000 7f36b2ffd700 1 -- 172.21.15.43:0/2115669331 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473598846 0 0) 0x7f36b40c6820 con 0x7f36b406a310 2023-08-27T11:30:12.955 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b2ffd700 1 -- 172.21.15.43:0/2115669331 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369c0035b0 con 0x7f36b406a310 2023-08-27T11:30:12.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b37fe700 1 -- 172.21.15.43:0/2115669331 >> v1:172.21.15.57:6789/0 conn(0x7f36b4158190 legacy=0x7f36b415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.956 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b37fe700 1 -- 172.21.15.43:0/2115669331 >> v1:172.21.15.43:6789/0 conn(0x7f36b406a310 legacy=0x7f36b4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b37fe700 1 -- 172.21.15.43:0/2115669331 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40c4d30 con 0x7f36b406e360 2023-08-27T11:30:12.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b37fe700 1 --2- 172.21.15.43:0/2115669331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406e360 0x7f36b406a6f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009840 tx=0x7f36a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61c2da0a77e7d169 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b2ffd700 1 -- 172.21.15.43:0/2115669331 <== mon.1 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011830 con 0x7f36b406e360 2023-08-27T11:30:12.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b2ffd700 1 -- 172.21.15.43:0/2115669331 <== mon.1 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a8011990 con 0x7f36b406e360 2023-08-27T11:30:12.957 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.953+0000 7f36b2ffd700 1 -- 172.21.15.43:0/2115669331 <== mon.1 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8011d20 con 0x7f36b406e360 2023-08-27T11:30:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 -- 172.21.15.43:0/2115669331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406e360 msgr2=0x7f36b406a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/2115669331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406e360 0x7f36b406a6f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f36a8009840 tx=0x7f36a8009b50 comp rx=0 tx=0).stop 2023-08-27T11:30:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 -- 172.21.15.43:0/2115669331 shutdown_connections 2023-08-27T11:30:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/2115669331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406e360 0x7f36b406a6f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.958 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 -- 172.21.15.43:0/2115669331 >> 172.21.15.43:0/2115669331 conn(0x7f36b40a85e0 msgr2=0x7f36b40a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:12.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 -- 172.21.15.43:0/2115669331 shutdown_connections 2023-08-27T11:30:12.959 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.954+0000 7f36ba3ff700 1 -- 172.21.15.43:0/2115669331 wait complete. 2023-08-27T11:30:12.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.956+0000 7f36ba3ff700 1 Processor -- start 2023-08-27T11:30:12.961 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.956+0000 7f36ba3ff700 1 -- start start 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406a310 0x7f36b4153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36b406e360 0x7f36b414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c0cc0 con 0x7f36b4158190 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40acbd0 con 0x7f36b406a310 2023-08-27T11:30:12.962 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36ba3ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40bdf80 con 0x7f36b406e360 2023-08-27T11:30:12.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36b899c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36b899c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42032/0 (socket says 172.21.15.43:42032) 2023-08-27T11:30:12.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.957+0000 7f36b899c700 1 -- 172.21.15.43:0/3064136731 learned_addr learned my addr 172.21.15.43:0/3064136731 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:12.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b37fe700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36b406e360 0x7f36b414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.963 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b3fff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406a310 0x7f36b4153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 -- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36b406e360 msgr2=0x7f36b414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36b406e360 0x7f36b414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 -- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406a310 msgr2=0x7f36b4153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:12.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406a310 0x7f36b4153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:12.964 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 -- 172.21.15.43:0/3064136731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80094a0 con 0x7f36b4158190 2023-08-27T11:30:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b899c700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00cb50 tx=0x7f36ac00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003c00 con 0x7f36b4158190 2023-08-27T11:30:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac003d60 con 0x7f36b4158190 2023-08-27T11:30:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b40ac370 con 0x7f36b4158190 2023-08-27T11:30:12.965 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.958+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00aa20 con 0x7f36b4158190 2023-08-27T11:30:12.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.959+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40ac8f0 con 0x7f36b4158190 2023-08-27T11:30:12.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.960+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b404ee70 con 0x7f36b4158190 2023-08-27T11:30:12.966 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.960+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f36ac00ab80 con 0x7f36b4158190 2023-08-27T11:30:12.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.961+0000 7f36b0ff9700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 0x7f36a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:12.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.961+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36ac088540 con 0x7f36b4158190 2023-08-27T11:30:12.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.962+0000 7f36b3fff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 0x7f36a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:12.967 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.962+0000 7f36b3fff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 0x7f36a006c5a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007fd0 tx=0x7f36a4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:12.968 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:12.966+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f36ac053c20 con 0x7f36b4158190 2023-08-27T11:30:13.179 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.178+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36b40c4fe0 con 0x7f36b4158190 2023-08-27T11:30:13.180 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.179+0000 7f36b0ff9700 1 -- 172.21.15.43:0/3064136731 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18175 (secure 0 0 0) 0x7f36ac057240 con 0x7f36b4158190 2023-08-27T11:30:13.180 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:13.181 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":144,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:37.239615+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:30:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 msgr2=0x7f36a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 0x7f36a006c5a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f36a4007fd0 tx=0x7f36a4007dc0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 msgr2=0x7f36b41e99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00cb50 tx=0x7f36ac00ce60 comp rx=0 tx=0).stop 2023-08-27T11:30:13.183 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 shutdown_connections 2023-08-27T11:30:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f36a006a0e0 0x7f36a006c5a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f36b4158190 0x7f36b41e99e0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36b406a310 0x7f36b4153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 --2- 172.21.15.43:0/3064136731 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36b406e360 0x7f36b414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.184 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 >> 172.21.15.43:0/3064136731 conn(0x7f36b40a85e0 msgr2=0x7f36b40bcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.181+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 shutdown_connections 2023-08-27T11:30:13.185 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.182+0000 7f36ba3ff700 1 -- 172.21.15.43:0/3064136731 wait complete. 2023-08-27T11:30:13.201 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-27T11:30:13.202 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:13.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.402+0000 7f8c099ff700 1 Processor -- start 2023-08-27T11:30:13.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.402+0000 7f8c099ff700 1 -- start start 2023-08-27T11:30:13.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c099ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8c0406e360 0x7f8c0406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c099ff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040c6820 con 0x7f8c0406a310 2023-08-27T11:30:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c099ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040c4a50 con 0x7f8c04158190 2023-08-27T11:30:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c099ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040c23a0 con 0x7f8c0406e360 2023-08-27T11:30:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c02ffd700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8c0406a310 0x7f8c04157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33634/0 (socket says 172.21.15.43:33634) 2023-08-27T11:30:13.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.403+0000 7f8c02ffd700 1 -- 172.21.15.43:0/3744027901 learned_addr learned my addr 172.21.15.43:0/3744027901 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:13.406 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c027fc700 1 --2- 172.21.15.43:0/3744027901 >> v2:172.21.15.43:3300/0 conn(0x7f8c0406e360 0x7f8c0406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c01ffb700 1 -- 172.21.15.43:0/3744027901 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573674268 0 0) 0x7f8c040c6820 con 0x7f8c0406a310 2023-08-27T11:30:13.407 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c01ffb700 1 -- 172.21.15.43:0/3744027901 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bec0035b0 con 0x7f8c0406a310 2023-08-27T11:30:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c027fc700 1 -- 172.21.15.43:0/3744027901 >> v1:172.21.15.57:6789/0 conn(0x7f8c04158190 legacy=0x7f8c0415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c027fc700 1 -- 172.21.15.43:0/3744027901 >> v1:172.21.15.43:6789/0 conn(0x7f8c0406a310 legacy=0x7f8c04157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c027fc700 1 -- 172.21.15.43:0/3744027901 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040c4d30 con 0x7f8c0406e360 2023-08-27T11:30:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.404+0000 7f8c027fc700 1 --2- 172.21.15.43:0/3744027901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c0406a6f0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc6f13708f297bf server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.408 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c01ffb700 1 -- 172.21.15.43:0/3744027901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011830 con 0x7f8c0406e360 2023-08-27T11:30:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c01ffb700 1 -- 172.21.15.43:0/3744027901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011990 con 0x7f8c0406e360 2023-08-27T11:30:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c01ffb700 1 -- 172.21.15.43:0/3744027901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011d20 con 0x7f8c0406e360 2023-08-27T11:30:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 -- 172.21.15.43:0/3744027901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 msgr2=0x7f8c0406a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 --2- 172.21.15.43:0/3744027901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c0406a6f0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).stop 2023-08-27T11:30:13.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 -- 172.21.15.43:0/3744027901 shutdown_connections 2023-08-27T11:30:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 --2- 172.21.15.43:0/3744027901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c0406a6f0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 -- 172.21.15.43:0/3744027901 >> 172.21.15.43:0/3744027901 conn(0x7f8c040a85e0 msgr2=0x7f8c040a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 -- 172.21.15.43:0/3744027901 shutdown_connections 2023-08-27T11:30:13.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.405+0000 7f8c099ff700 1 -- 172.21.15.43:0/3744027901 wait complete. 2023-08-27T11:30:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.407+0000 7f8c099ff700 1 Processor -- start 2023-08-27T11:30:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.407+0000 7f8c099ff700 1 -- start start 2023-08-27T11:30:13.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c0406a310 0x7f8c041ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04158190 0x7f8c040bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04157000 con 0x7f8c0406e360 2023-08-27T11:30:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040c6ab0 con 0x7f8c04158190 2023-08-27T11:30:13.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c099ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041ea810 con 0x7f8c0406a310 2023-08-27T11:30:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42046/0 (socket says 172.21.15.43:42046) 2023-08-27T11:30:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c027fc700 1 -- 172.21.15.43:0/24805354 learned_addr learned my addr 172.21.15.43:0/24805354 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c0406a310 0x7f8c041ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.408+0000 7f8c037fe700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04158190 0x7f8c040bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 -- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c0406a310 msgr2=0x7f8c041ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c0406a310 0x7f8c041ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 -- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04158190 msgr2=0x7f8c040bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04158190 0x7f8c040bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 -- 172.21.15.43:0/24805354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80094a0 con 0x7f8c0406e360 2023-08-27T11:30:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c027fc700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80036a0 con 0x7f8c0406e360 2023-08-27T11:30:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf801f070 con 0x7f8c0406e360 2023-08-27T11:30:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8003a60 con 0x7f8c0406e360 2023-08-27T11:30:13.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c041577c0 con 0x7f8c0406e360 2023-08-27T11:30:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.409+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040c0c00 con 0x7f8c0406e360 2023-08-27T11:30:13.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.411+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c040c4ff0 con 0x7f8c0406e360 2023-08-27T11:30:13.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.412+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8bf8003bc0 con 0x7f8c0406e360 2023-08-27T11:30:13.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.413+0000 7f8bebfff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.413+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bf8021070 con 0x7f8c0406e360 2023-08-27T11:30:13.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.413+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.414+0000 7f8c02ffd700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007fd0 tx=0x7f8bf4007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.418+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8c040c4ff0 con 0x7f8c0406e360 2023-08-27T11:30:13.676 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.675+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c040c4ff0 con 0x7f8c0406e360 2023-08-27T11:30:13.677 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.676+0000 7f8bebfff700 1 -- 172.21.15.43:0/24805354 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f8c040c4ff0 con 0x7f8c0406e360 2023-08-27T11:30:13.678 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:13.678 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 msgr2=0x7f8bf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4007fd0 tx=0x7f8bf4007dc0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 msgr2=0x7f8c040ab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.680 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).stop 2023-08-27T11:30:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 shutdown_connections 2023-08-27T11:30:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f8bf006a0e0 0x7f8bf006c5a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c04158190 0x7f8c040bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.681 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8c0406a310 0x7f8c041ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 --2- 172.21.15.43:0/24805354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8c0406e360 0x7f8c040ab680 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.678+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 >> 172.21.15.43:0/24805354 conn(0x7f8c040a85e0 msgr2=0x7f8c040c2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.679+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 shutdown_connections 2023-08-27T11:30:13.682 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.679+0000 7f8c099ff700 1 -- 172.21.15.43:0/24805354 wait complete. 2023-08-27T11:30:13.683 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:13.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-27T11:30:13.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.897+0000 7f09951ff700 1 Processor -- start 2023-08-27T11:30:13.898 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.897+0000 7f09951ff700 1 -- start start 2023-08-27T11:30:13.901 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f099014e960 0x7f09900a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09900c50d0 0x7f09900c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900baf30 con 0x7f09900c50d0 2023-08-27T11:30:13.902 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0990154d00 con 0x7f099014e960 2023-08-27T11:30:13.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f09951ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0990154fe0 con 0x7f09900a79c0 2023-08-27T11:30:13.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.898+0000 7f098f59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09900c50d0 0x7f09900c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09900c50d0 0x7f09900c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42060/0 (socket says 172.21.15.43:42060) 2023-08-27T11:30:13.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 -- 172.21.15.43:0/3142133055 learned_addr learned my addr 172.21.15.43:0/3142133055 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:13.903 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098ed9d700 1 --2- 172.21.15.43:0/3142133055 >> v2:172.21.15.57:3300/0 conn(0x7f099014e960 0x7f09900a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098e59c700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 -- 172.21.15.43:0/3142133055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 msgr2=0x7f09900c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.904 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 -- 172.21.15.43:0/3142133055 >> v2:172.21.15.57:3300/0 conn(0x7f099014e960 msgr2=0x7f09900a7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 --2- 172.21.15.43:0/3142133055 >> v2:172.21.15.57:3300/0 conn(0x7f099014e960 0x7f09900a7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 -- 172.21.15.43:0/3142133055 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09901552c0 con 0x7f09900c50d0 2023-08-27T11:30:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098f59e700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900c4200 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f099006da20 tx=0x7f098800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af427f67b077086 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.905 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.899+0000 7f098dd9b700 1 -- 172.21.15.43:0/3142133055 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800e070 con 0x7f09900c50d0 2023-08-27T11:30:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f098dd9b700 1 -- 172.21.15.43:0/3142133055 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800b910 con 0x7f09900c50d0 2023-08-27T11:30:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f098dd9b700 1 -- 172.21.15.43:0/3142133055 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800bcc0 con 0x7f09900c50d0 2023-08-27T11:30:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 -- 172.21.15.43:0/3142133055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 msgr2=0x7f09900c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.906 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900c4200 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f099006da20 tx=0x7f098800b330 comp rx=0 tx=0).stop 2023-08-27T11:30:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 -- 172.21.15.43:0/3142133055 shutdown_connections 2023-08-27T11:30:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900c4200 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 --2- 172.21.15.43:0/3142133055 >> v2:172.21.15.57:3300/0 conn(0x7f099014e960 0x7f09900a7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 --2- 172.21.15.43:0/3142133055 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.907 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 -- 172.21.15.43:0/3142133055 >> 172.21.15.43:0/3142133055 conn(0x7f099006aa50 msgr2=0x7f09900c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 -- 172.21.15.43:0/3142133055 shutdown_connections 2023-08-27T11:30:13.908 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.900+0000 7f09951ff700 1 -- 172.21.15.43:0/3142133055 wait complete. 2023-08-27T11:30:13.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.902+0000 7f09951ff700 1 Processor -- start 2023-08-27T11:30:13.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.902+0000 7f09951ff700 1 -- start start 2023-08-27T11:30:13.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.911 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099014e960 0x7f09900a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900a7380 con 0x7f09900c50d0 2023-08-27T11:30:13.912 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09901e9ae0 con 0x7f099014e960 2023-08-27T11:30:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f09951ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09901e9dc0 con 0x7f09900a79c0 2023-08-27T11:30:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f098e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f098e59c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42070/0 (socket says 172.21.15.43:42070) 2023-08-27T11:30:13.913 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.903+0000 7f098e59c700 1 -- 172.21.15.43:0/1493591756 learned_addr learned my addr 172.21.15.43:0/1493591756 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098ed9d700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098f59e700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099014e960 0x7f09900a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 -- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 msgr2=0x7f09900aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.914 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 -- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099014e960 msgr2=0x7f09900a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099014e960 0x7f09900a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 -- 172.21.15.43:0/1493591756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009b30 con 0x7f09900c50d0 2023-08-27T11:30:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f098e59c700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f098400e930 tx=0x7f098400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.915 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984013680 con 0x7f09900c50d0 2023-08-27T11:30:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09840137e0 con 0x7f09900c50d0 2023-08-27T11:30:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09901ea0a0 con 0x7f09900c50d0 2023-08-27T11:30:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.904+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0984013b70 con 0x7f09900c50d0 2023-08-27T11:30:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.905+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09900ab170 con 0x7f09900c50d0 2023-08-27T11:30:13.916 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.905+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09900bb390 con 0x7f09900c50d0 2023-08-27T11:30:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.906+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0984013cd0 con 0x7f09900c50d0 2023-08-27T11:30:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.907+0000 7f09777fe700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.907+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0984088430 con 0x7f09900c50d0 2023-08-27T11:30:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.908+0000 7f098ed9d700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:13.917 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.908+0000 7f098ed9d700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0980009b40 tx=0x7f0980009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:13.918 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:13.912+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0984053bb0 con 0x7f09900c50d0 2023-08-27T11:30:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.167+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09900a53d0 con 0x7f09900c50d0 2023-08-27T11:30:14.168 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.167+0000 7f09777fe700 1 -- 172.21.15.43:0/1493591756 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 158 v158) v1 ==== 95+0+4886 (secure 0 0 0) 0x7f09900a53d0 con 0x7f09900c50d0 2023-08-27T11:30:14.169 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:14.169 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":158,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8173,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6836/4244794622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6834","nonce":4244794622},{"type":"v1","addr":"172.21.15.43:6836","nonce":4244794622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":145},{"gid":8395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/3570937171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6833","nonce":3570937171},{"type":"v1","addr":"172.21.15.57:6835","nonce":3570937171}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":155},{"gid":8766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6837/1306724488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6835","nonce":1306724488},{"type":"v1","addr":"172.21.15.43:6837","nonce":1306724488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":158,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-27T11:29:35.758447+0000","modified":"2023-08-27T11:30:06.032189+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8769":{"gid":8769,"name":"b","rank":0,"incarnation":157,"state":"up:active","state_seq":10,"addr":"172.21.15.57:6834/2448327345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":2448327345},{"type":"v1","addr":"172.21.15.57:6834","nonce":2448327345}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-27T11:30:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.169+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 msgr2=0x7f097c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.171 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.169+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0980009b40 tx=0x7f0980009210 comp rx=0 tx=0).stop 2023-08-27T11:30:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.169+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 msgr2=0x7f09900a56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.169+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f098400e930 tx=0x7f098400ec40 comp rx=0 tx=0).stop 2023-08-27T11:30:14.173 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 shutdown_connections 2023-08-27T11:30:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f097c06a0e0 0x7f097c06c5a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.174 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099014e960 0x7f09900a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09900a79c0 0x7f09900aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 --2- 172.21.15.43:0/1493591756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09900c50d0 0x7f09900a56b0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.175 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 >> 172.21.15.43:0/1493591756 conn(0x7f099006aa50 msgr2=0x7f0990152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 shutdown_connections 2023-08-27T11:30:14.176 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.170+0000 7f09951ff700 1 -- 172.21.15.43:0/1493591756 wait complete. 2023-08-27T11:30:14.177 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 158 2023-08-27T11:30:14.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-27T11:30:14.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.390+0000 7f6b18dff700 1 Processor -- start 2023-08-27T11:30:14.391 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.390+0000 7f6b18dff700 1 -- start start 2023-08-27T11:30:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b18dff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b140c4630 0x7f6b140c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b18dff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1406c4e0 con 0x7f6b1406ad70 2023-08-27T11:30:14.392 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b18dff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b14155370 con 0x7f6b14151a90 2023-08-27T11:30:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b18dff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b140c82c0 con 0x7f6b140c4630 2023-08-27T11:30:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b12d9d700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6b1406ad70 0x7f6b1406b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33636/0 (socket says 172.21.15.43:33636) 2023-08-27T11:30:14.393 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.391+0000 7f6b12d9d700 1 -- 172.21.15.43:0/1634869039 learned_addr learned my addr 172.21.15.43:0/1634869039 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:14.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b0bfff700 1 --2- 172.21.15.43:0/1634869039 >> v2:172.21.15.57:3300/0 conn(0x7f6b140c4630 0x7f6b140c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988401508 0 0) 0x7f6b1406c4e0 con 0x7f6b1406ad70 2023-08-27T11:30:14.396 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b000035b0 con 0x7f6b1406ad70 2023-08-27T11:30:14.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1695782731 0 0) 0x7f6b000035b0 con 0x7f6b1406ad70 2023-08-27T11:30:14.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 >> v2:172.21.15.57:3300/0 conn(0x7f6b140c4630 msgr2=0x7f6b140c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:14.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 --2- 172.21.15.43:0/1634869039 >> v2:172.21.15.57:3300/0 conn(0x7f6b140c4630 0x7f6b140c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 >> v1:172.21.15.57:6789/0 conn(0x7f6b14151a90 legacy=0x7f6b140c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.397 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 --> v1:172.21.15.43:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14151e70 con 0x7f6b1406ad70 2023-08-27T11:30:14.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v1:172.21.15.43:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1443529017 0 0) 0x7f6b0c0019f0 con 0x7f6b1406ad70 2023-08-27T11:30:14.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 >> v1:172.21.15.43:6789/0 conn(0x7f6b1406ad70 legacy=0x7f6b1406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 0x7f6b00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.398 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00004850 0x7f6b00004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b00005260 0x7f6b0000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140c82c0 con 0x7f6b00003a50 2023-08-27T11:30:14.399 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000c1b0 con 0x7f6b00005260 2023-08-27T11:30:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000c370 con 0x7f6b00004850 2023-08-27T11:30:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.392+0000 7f6b1259c700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 0x7f6b00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.400 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b0bfff700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00004850 0x7f6b00004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b12d9d700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b00005260 0x7f6b0000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 -- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00004850 msgr2=0x7f6b00004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:14.401 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00004850 0x7f6b00004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 -- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b00005260 msgr2=0x7f6b0000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:14.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b00005260 0x7f6b0000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.402 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b12d9d700 1 -- 172.21.15.43:0/1634869039 reap_dead start 2023-08-27T11:30:14.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 -- 172.21.15.43:0/1634869039 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000035b0 con 0x7f6b00003a50 2023-08-27T11:30:14.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b1259c700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 0x7f6b00003e70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f6b04007fd0 tx=0x7f6b00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb915b7219ef8cd server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040052d0 con 0x7f6b00003a50 2023-08-27T11:30:14.403 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04005450 con 0x7f6b00003a50 2023-08-27T11:30:14.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.393+0000 7f6b11d9b700 1 -- 172.21.15.43:0/1634869039 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040038c0 con 0x7f6b00003a50 2023-08-27T11:30:14.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 -- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 msgr2=0x7f6b00003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 0x7f6b00003e70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f6b04007fd0 tx=0x7f6b00005880 comp rx=0 tx=0).stop 2023-08-27T11:30:14.404 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 -- 172.21.15.43:0/1634869039 shutdown_connections 2023-08-27T11:30:14.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 --2- 172.21.15.43:0/1634869039 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b00003a50 0x7f6b00003e70 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 -- 172.21.15.43:0/1634869039 >> 172.21.15.43:0/1634869039 conn(0x7f6b140ab820 msgr2=0x7f6b140abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:14.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 -- 172.21.15.43:0/1634869039 shutdown_connections 2023-08-27T11:30:14.405 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.394+0000 7f6b18dff700 1 -- 172.21.15.43:0/1634869039 wait complete. 2023-08-27T11:30:14.409 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.396+0000 7f6b18dff700 1 Processor -- start 2023-08-27T11:30:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.396+0000 7f6b18dff700 1 -- start start 2023-08-27T11:30:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00003a50 0x7f6b141559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.410 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b140bcd40 0x7f6b14149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b14156c00 con 0x7f6b1414e020 2023-08-27T11:30:14.411 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141e95c0 con 0x7f6b140bcd40 2023-08-27T11:30:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b18dff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b141e97d0 con 0x7f6b00003a50 2023-08-27T11:30:14.412 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b12d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b12d9d700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42074/0 (socket says 172.21.15.43:42074) 2023-08-27T11:30:14.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b12d9d700 1 -- 172.21.15.43:0/3063701998 learned_addr learned my addr 172.21.15.43:0/3063701998 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:14.413 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b1259c700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00003a50 0x7f6b141559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.397+0000 7f6b0bfff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b140bcd40 0x7f6b14149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 -- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00003a50 msgr2=0x7f6b141559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.414 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00003a50 0x7f6b141559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 -- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b140bcd40 msgr2=0x7f6b14149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b140bcd40 0x7f6b14149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.415 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 -- 172.21.15.43:0/3063701998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b141e9a70 con 0x7f6b1414e020 2023-08-27T11:30:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b12d9d700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f6b140c3ef0 tx=0x7f6b0c00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c001250 con 0x7f6b1414e020 2023-08-27T11:30:14.416 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00aba0 con 0x7f6b1414e020 2023-08-27T11:30:14.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b141e9d50 con 0x7f6b1414e020 2023-08-27T11:30:14.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0133f0 con 0x7f6b1414e020 2023-08-27T11:30:14.417 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.398+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b141ea310 con 0x7f6b1414e020 2023-08-27T11:30:14.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.399+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1404ee70 con 0x7f6b1414e020 2023-08-27T11:30:14.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.400+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b0c013550 con 0x7f6b1414e020 2023-08-27T11:30:14.418 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.401+0000 7f6b0affd700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 0x7f6af406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.401+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b0c088bd0 con 0x7f6b1414e020 2023-08-27T11:30:14.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.401+0000 7f6b1259c700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 0x7f6af406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.419 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.402+0000 7f6b1259c700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 0x7f6af406c5a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005040 tx=0x7f6b04009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.420 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.406+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b0c0542b0 con 0x7f6b1414e020 2023-08-27T11:30:14.618 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.617+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b1406c130 con 0x7f6b1414e020 2023-08-27T11:30:14.619 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.618+0000 7f6b0affd700 1 -- 172.21.15.43:0/3063701998 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18175 (secure 0 0 0) 0x7f6b0c0578d0 con 0x7f6b1414e020 2023-08-27T11:30:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-08-27T11:30:14.620 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":144,"fsid":"c8d00e24-104f-4e9c-b4f0-07b3a6bec064","created":"2023-08-27T11:22:23.063887+0000","modified":"2023-08-27T11:29:37.239615+0000","last_up_change":"2023-08-27T11:22:34.862571+0000","last_in_change":"2023-08-27T11:22:26.665533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-08-27T11:22:35.906634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-08-27T11:22:36.376930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-27T11:29:34.081909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-27T11:29:34.733420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"466034ad-5a2f-424b-bcd4-61eae789d16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6801","nonce":1854749393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6803","nonce":1854749393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6807","nonce":1854749393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":1854749393},{"type":"v1","addr":"172.21.15.43:6805","nonce":1854749393}]},"public_addr":"172.21.15.43:6801/1854749393","cluster_addr":"172.21.15.43:6803/1854749393","heartbeat_back_addr":"172.21.15.43:6807/1854749393","heartbeat_front_addr":"172.21.15.43:6805/1854749393","state":["exists","up"]},{"osd":1,"uuid":"d69f5a34-2fbe-46df-a360-8a2b61d89873","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6808","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6809","nonce":2369916833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6810","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6811","nonce":2369916833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6814","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6815","nonce":2369916833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6812","nonce":2369916833},{"type":"v1","addr":"172.21.15.43:6813","nonce":2369916833}]},"public_addr":"172.21.15.43:6809/2369916833","cluster_addr":"172.21.15.43:6811/2369916833","heartbeat_back_addr":"172.21.15.43:6815/2369916833","heartbeat_front_addr":"172.21.15.43:6813/2369916833","state":["exists","up"]},{"osd":2,"uuid":"ae349b3a-0b81-43e1-aec9-35388a5be28b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6816","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6817","nonce":513400440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6818","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6820","nonce":513400440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6829","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6831","nonce":513400440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6823","nonce":513400440},{"type":"v1","addr":"172.21.15.43:6826","nonce":513400440}]},"public_addr":"172.21.15.43:6817/513400440","cluster_addr":"172.21.15.43:6820/513400440","heartbeat_back_addr":"172.21.15.43:6831/513400440","heartbeat_front_addr":"172.21.15.43:6826/513400440","state":["exists","up"]},{"osd":3,"uuid":"702c4b2b-6ace-4df9-80d0-ce832acfcf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6819","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6821","nonce":1647660877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6822","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6824","nonce":1647660877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6828","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6830","nonce":1647660877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6825","nonce":1647660877},{"type":"v1","addr":"172.21.15.43:6827","nonce":1647660877}]},"public_addr":"172.21.15.43:6821/1647660877","cluster_addr":"172.21.15.43:6824/1647660877","heartbeat_back_addr":"172.21.15.43:6830/1647660877","heartbeat_front_addr":"172.21.15.43:6827/1647660877","state":["exists","up"]},{"osd":4,"uuid":"64a32ef9-c07f-43c8-8b95-8b8aadf93ab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6801","nonce":3346818821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6805","nonce":3346818821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6811","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6813","nonce":3346818821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":3346818821},{"type":"v1","addr":"172.21.15.57:6809","nonce":3346818821}]},"public_addr":"172.21.15.57:6801/3346818821","cluster_addr":"172.21.15.57:6805/3346818821","heartbeat_back_addr":"172.21.15.57:6813/3346818821","heartbeat_front_addr":"172.21.15.57:6809/3346818821","state":["exists","up"]},{"osd":5,"uuid":"83bf2d3c-0d97-4dd9-bb47-eb7e642d8b2b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6817","nonce":638765256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6819","nonce":638765256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6823","nonce":638765256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":638765256},{"type":"v1","addr":"172.21.15.57:6821","nonce":638765256}]},"public_addr":"172.21.15.57:6817/638765256","cluster_addr":"172.21.15.57:6819/638765256","heartbeat_back_addr":"172.21.15.57:6823/638765256","heartbeat_front_addr":"172.21.15.57:6821/638765256","state":["exists","up"]},{"osd":6,"uuid":"cb6ae1d8-c1cd-4208-9c6e-bd8c6f2adc8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6804","nonce":2206759897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6808","nonce":2206759897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6815","nonce":2206759897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":2206759897},{"type":"v1","addr":"172.21.15.57:6812","nonce":2206759897}]},"public_addr":"172.21.15.57:6804/2206759897","cluster_addr":"172.21.15.57:6808/2206759897","heartbeat_back_addr":"172.21.15.57:6815/2206759897","heartbeat_front_addr":"172.21.15.57:6812/2206759897","state":["exists","up"]},{"osd":7,"uuid":"04163af4-2000-4db5-ab19-c6c00e55174f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6825","nonce":1288318472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6827","nonce":1288318472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6831","nonce":1288318472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":1288318472},{"type":"v1","addr":"172.21.15.57:6829","nonce":1288318472}]},"public_addr":"172.21.15.57:6825/1288318472","cluster_addr":"172.21.15.57:6827/1288318472","heartbeat_back_addr":"172.21.15.57:6831/1288318472","heartbeat_front_addr":"172.21.15.57:6829/1288318472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.230554+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.260600+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.299497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.971799+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:31.993413+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.071255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.269293+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-27T11:22:32.085103+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-27T11:30:14.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 msgr2=0x7f6af406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.623 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 0x7f6af406c5a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005040 tx=0x7f6b04009030 comp rx=0 tx=0).stop 2023-08-27T11:30:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 msgr2=0x7f6b1414a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.624 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f6b140c3ef0 tx=0x7f6b0c00a510 comp rx=0 tx=0).stop 2023-08-27T11:30:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 shutdown_connections 2023-08-27T11:30:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f6af406a0e0 0x7f6af406c5a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.625 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b1414e020 0x7f6b1414a490 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6b00003a50 0x7f6b141559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 --2- 172.21.15.43:0/3063701998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b140bcd40 0x7f6b14149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.626 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.620+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 >> 172.21.15.43:0/3063701998 conn(0x7f6b140ab820 msgr2=0x7f6b1406b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.621+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 shutdown_connections 2023-08-27T11:30:14.627 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.621+0000 7f6b18dff700 1 -- 172.21.15.43:0/3063701998 wait complete. 2023-08-27T11:30:14.640 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-27T11:30:14.842 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.841+0000 7f5e27fff700 1 Processor -- start 2023-08-27T11:30:14.843 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.841+0000 7f5e27fff700 1 -- start start 2023-08-27T11:30:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 0x7f5e2006a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e27fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5e20158190 0x7f5e2015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e27fff700 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e200c6820 con 0x7f5e2006a310 2023-08-27T11:30:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e27fff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200c23a0 con 0x7f5e20158190 2023-08-27T11:30:14.844 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e27fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201548c0 con 0x7f5e2006e360 2023-08-27T11:30:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e25d9b700 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5e2006a310 0x7f5e20157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:33650/0 (socket says 172.21.15.43:33650) 2023-08-27T11:30:14.845 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e25d9b700 1 -- 172.21.15.43:0/4126979303 learned_addr learned my addr 172.21.15.43:0/4126979303 (peer_addr_for_me v1:172.21.15.43:0/0) 2023-08-27T11:30:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e2559a700 1 --2- 172.21.15.43:0/4126979303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 0x7f5e2006a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e2659c700 1 --2- 172.21.15.43:0/4126979303 >> v2:172.21.15.57:3300/0 conn(0x7f5e20158190 0x7f5e2015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152383996 0 0) 0x7f5e200c6820 con 0x7f5e2006a310 2023-08-27T11:30:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.843+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c0035b0 con 0x7f5e2006a310 2023-08-27T11:30:14.847 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 <== mon.0 v1:172.21.15.43:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958074345 0 0) 0x7f5e0c0035b0 con 0x7f5e2006a310 2023-08-27T11:30:14.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e2559a700 1 -- 172.21.15.43:0/4126979303 >> v2:172.21.15.57:3300/0 conn(0x7f5e20158190 msgr2=0x7f5e2015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:14.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e2559a700 1 --2- 172.21.15.43:0/4126979303 >> v2:172.21.15.57:3300/0 conn(0x7f5e20158190 0x7f5e2015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e2559a700 1 -- 172.21.15.43:0/4126979303 >> v1:172.21.15.43:6789/0 conn(0x7f5e2006a310 legacy=0x7f5e20157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e2559a700 1 -- 172.21.15.43:0/4126979303 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200c4a50 con 0x7f5e2006e360 2023-08-27T11:30:14.848 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e2559a700 1 --2- 172.21.15.43:0/4126979303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 0x7f5e2006a6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009840 tx=0x7f5e10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab42a7909d061e21 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 <== mon.2 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011830 con 0x7f5e2006e360 2023-08-27T11:30:14.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 <== mon.2 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e10011990 con 0x7f5e2006e360 2023-08-27T11:30:14.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.844+0000 7f5e24d99700 1 -- 172.21.15.43:0/4126979303 <== mon.2 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10011d20 con 0x7f5e2006e360 2023-08-27T11:30:14.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 -- 172.21.15.43:0/4126979303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 msgr2=0x7f5e2006a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.849 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 --2- 172.21.15.43:0/4126979303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 0x7f5e2006a6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009840 tx=0x7f5e10009b50 comp rx=0 tx=0).stop 2023-08-27T11:30:14.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 -- 172.21.15.43:0/4126979303 shutdown_connections 2023-08-27T11:30:14.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 --2- 172.21.15.43:0/4126979303 >> v2:172.21.15.57:3300/0 conn(0x7f5e20158190 0x7f5e2015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 --2- 172.21.15.43:0/4126979303 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e2006e360 0x7f5e2006a6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 -- 172.21.15.43:0/4126979303 >> 172.21.15.43:0/4126979303 conn(0x7f5e200a85e0 msgr2=0x7f5e200a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:14.850 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 -- 172.21.15.43:0/4126979303 shutdown_connections 2023-08-27T11:30:14.851 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.845+0000 7f5e27fff700 1 -- 172.21.15.43:0/4126979303 wait complete. 2023-08-27T11:30:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.847+0000 7f5e27fff700 1 Processor -- start 2023-08-27T11:30:14.853 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.847+0000 7f5e27fff700 1 -- start start 2023-08-27T11:30:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 0x7f5e200ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.854 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e20158190 0x7f5e200a7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2014cd70 con 0x7f5e2006a310 2023-08-27T11:30:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201edbf0 con 0x7f5e2006e360 2023-08-27T11:30:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e27fff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200c0d40 con 0x7f5e20158190 2023-08-27T11:30:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.855 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42084/0 (socket says 172.21.15.43:42084) 2023-08-27T11:30:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 -- 172.21.15.43:0/3583576180 learned_addr learned my addr 172.21.15.43:0/3583576180 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e2659c700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e20158190 0x7f5e200a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e2559a700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 0x7f5e200ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 -- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e20158190 msgr2=0x7f5e200a7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.856 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e20158190 0x7f5e200a7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 -- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 msgr2=0x7f5e200ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 0x7f5e200ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e25d9b700 1 -- 172.21.15.43:0/3583576180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e100094a0 con 0x7f5e2006a310 2023-08-27T11:30:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.848+0000 7f5e2559a700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 0x7f5e200ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:14.857 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e25d9b700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c7b0 tx=0x7f5e1c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c005d70 con 0x7f5e2006a310 2023-08-27T11:30:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0070d0 con 0x7f5e2006a310 2023-08-27T11:30:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e201ed350 con 0x7f5e2006a310 2023-08-27T11:30:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c007460 con 0x7f5e2006a310 2023-08-27T11:30:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.849+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e201ed910 con 0x7f5e2006a310 2023-08-27T11:30:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.850+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2004ee70 con 0x7f5e2006a310 2023-08-27T11:30:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.851+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5e1c0075c0 con 0x7f5e2006a310 2023-08-27T11:30:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.852+0000 7f5e167fc700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 0x7f5e0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:14.859 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.852+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e1c087b10 con 0x7f5e2006a310 2023-08-27T11:30:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.853+0000 7f5e2559a700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 0x7f5e0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.853+0000 7f5e2559a700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 0x7f5e0406c5a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e2006e7a0 tx=0x7f5e1001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:14.860 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:14.857+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5e1c0531f0 con 0x7f5e2006a310 2023-08-27T11:30:15.113 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.112+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e200c52c0 con 0x7f5e2006a310 2023-08-27T11:30:15.113 INFO:tasks.ceph.mon.a.smithi043.stderr:2023-08-27T11:30:15.112+0000 7ff3c7ff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-27T11:30:15.117 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.116+0000 7f5e167fc700 1 -- 172.21.15.43:0/3583576180 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v159) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e1c017090 con 0x7f5e2006a310 2023-08-27T11:30:15.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 msgr2=0x7f5e0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 0x7f5e0406c5a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e2006e7a0 tx=0x7f5e1001c040 comp rx=0 tx=0).stop 2023-08-27T11:30:15.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 msgr2=0x7f5e201eccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00c7b0 tx=0x7f5e1c00cac0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.121 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 shutdown_connections 2023-08-27T11:30:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5e0406a0e0 0x7f5e0406c5a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5e20158190 0x7f5e200a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5e2006a310 0x7f5e201eccc0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 --2- 172.21.15.43:0/3583576180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5e2006e360 0x7f5e200ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.119+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 >> 172.21.15.43:0/3583576180 conn(0x7f5e200a85e0 msgr2=0x7f5e200a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.120+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 shutdown_connections 2023-08-27T11:30:15.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.120+0000 7f5e27fff700 1 -- 172.21.15.43:0/3583576180 wait complete. 2023-08-27T11:30:15.123 INFO:tasks.ceph.mds.b.smithi057.stderr: -279> 2023-08-27T11:30:06.213+0000 7f8ebb1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-27T11:30:15.124 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-27T11:30:15.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-27T11:30:15.168 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2023-08-27T11:30:15.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.344+0000 7f5ae01ff700 1 Processor -- start 2023-08-27T11:30:15.345 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.344+0000 7f5ae01ff700 1 -- start start 2023-08-27T11:30:15.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ae01ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 0x7f5ad80c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.347 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ae01ff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ad80c4ae0 0x7f5ad806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ae01ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad806c450 con 0x7f5ad80c4630 2023-08-27T11:30:15.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ae01ff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad8151f00 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ae01ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80c4ef0 con 0x7f5ad8151b20 2023-08-27T11:30:15.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ade79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ad80c4ae0 0x7f5ad806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.348 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ade79c700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5ad80c4ae0 0x7f5ad806b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42098/0 (socket says 172.21.15.43:42098) 2023-08-27T11:30:15.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.345+0000 7f5ade79c700 1 -- 172.21.15.43:0/1106462635 learned_addr learned my addr 172.21.15.43:0/1106462635 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:15.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5addf9b700 1 --2- 172.21.15.43:0/1106462635 >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 0x7f5ad80c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5ade79c700 1 -- 172.21.15.43:0/1106462635 >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 msgr2=0x7f5ad80c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:15.349 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5ade79c700 1 --2- 172.21.15.43:0/1106462635 >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 0x7f5ad80c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5ade79c700 1 -- 172.21.15.43:0/1106462635 >> v1:172.21.15.57:6789/0 conn(0x7f5ad80c4630 legacy=0x7f5ad806ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5ade79c700 1 -- 172.21.15.43:0/1106462635 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8154760 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5addf9b700 1 --2- 172.21.15.43:0/1106462635 >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 0x7f5ad80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-27T11:30:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5ade79c700 1 --2- 172.21.15.43:0/1106462635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad80c4ae0 0x7f5ad806b480 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ac360 tx=0x7f5ad000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9230b7493014bfb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:15.350 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5adcf99700 1 -- 172.21.15.43:0/1106462635 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e070 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5adcf99700 1 -- 172.21.15.43:0/1106462635 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000b9c0 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.351 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.346+0000 7f5adcf99700 1 -- 172.21.15.43:0/1106462635 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000bd70 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.353 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 -- 172.21.15.43:0/1106462635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad80c4ae0 msgr2=0x7f5ad806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/1106462635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad80c4ae0 0x7f5ad806b480 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ac360 tx=0x7f5ad000b330 comp rx=0 tx=0).stop 2023-08-27T11:30:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 -- 172.21.15.43:0/1106462635 shutdown_connections 2023-08-27T11:30:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/1106462635 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad80c4ae0 0x7f5ad806b480 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/1106462635 >> v2:172.21.15.57:3300/0 conn(0x7f5ad8151b20 0x7f5ad80c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 -- 172.21.15.43:0/1106462635 >> 172.21.15.43:0/1106462635 conn(0x7f5ad80ab820 msgr2=0x7f5ad80abc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 -- 172.21.15.43:0/1106462635 shutdown_connections 2023-08-27T11:30:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.347+0000 7f5ae01ff700 1 -- 172.21.15.43:0/1106462635 wait complete. 2023-08-27T11:30:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.349+0000 7f5ae01ff700 1 Processor -- start 2023-08-27T11:30:15.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.349+0000 7f5ae01ff700 1 -- start start 2023-08-27T11:30:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80c4630 0x7f5ad81ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80c4ae0 0x7f5ad8144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c1a00 con 0x7f5ad8151b20 2023-08-27T11:30:15.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad81ea5a0 con 0x7f5ad80c4630 2023-08-27T11:30:15.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ae01ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8152820 con 0x7f5ad80c4ae0 2023-08-27T11:30:15.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ade79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ade79c700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42108/0 (socket says 172.21.15.43:42108) 2023-08-27T11:30:15.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5ade79c700 1 -- 172.21.15.43:0/2705587223 learned_addr learned my addr 172.21.15.43:0/2705587223 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:15.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5addf9b700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80c4630 0x7f5ad81ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.350+0000 7f5add79a700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80c4ae0 0x7f5ad8144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 -- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80c4ae0 msgr2=0x7f5ad8144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80c4ae0 0x7f5ad8144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 -- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80c4630 msgr2=0x7f5ad81ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80c4630 0x7f5ad81ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 -- 172.21.15.43:0/2705587223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0009b30 con 0x7f5ad8151b20 2023-08-27T11:30:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ade79c700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ac6e0 tx=0x7f5ad0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:15.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0004880 con 0x7f5ad8151b20 2023-08-27T11:30:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00099b0 con 0x7f5ad8151b20 2023-08-27T11:30:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad001c680 con 0x7f5ad8151b20 2023-08-27T11:30:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad814dd40 con 0x7f5ad8151b20 2023-08-27T11:30:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.351+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad80ab650 con 0x7f5ad8151b20 2023-08-27T11:30:15.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.352+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad804ee70 con 0x7f5ad8151b20 2023-08-27T11:30:15.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.353+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ad001c7e0 con 0x7f5ad8151b20 2023-08-27T11:30:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.354+0000 7f5ace7fc700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 0x7f5abc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.354+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f5ad0089ec0 con 0x7f5ad8151b20 2023-08-27T11:30:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.354+0000 7f5addf9b700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 0x7f5abc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.355+0000 7f5addf9b700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 0x7f5abc06c5a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006f10 tx=0x7f5ad4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:15.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.359+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ad0055540 con 0x7f5ad8151b20 2023-08-27T11:30:15.617 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:15.616+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ad8152280 con 0x7f5ad8151b20 2023-08-27T11:30:16.119 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.117+0000 7f5ace7fc700 1 -- 172.21.15.43:0/2705587223 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v160) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ad0058b60 con 0x7f5ad8151b20 2023-08-27T11:30:16.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.120+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 msgr2=0x7f5abc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.120+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 0x7f5abc06c5a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006f10 tx=0x7f5ad4008040 comp rx=0 tx=0).stop 2023-08-27T11:30:16.122 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.120+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 msgr2=0x7f5ad80aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.120+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80ac6e0 tx=0x7f5ad0004ad0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 shutdown_connections 2023-08-27T11:30:16.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7f5abc06a0e0 0x7f5abc06c5a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5ad8151b20 0x7f5ad80aa8d0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.123 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ad80c4630 0x7f5ad81ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 --2- 172.21.15.43:0/2705587223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ad80c4ae0 0x7f5ad8144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 >> 172.21.15.43:0/2705587223 conn(0x7f5ad80ab820 msgr2=0x7f5ad814eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:16.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 shutdown_connections 2023-08-27T11:30:16.124 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.121+0000 7f5ae01ff700 1 -- 172.21.15.43:0/2705587223 wait complete. 2023-08-27T11:30:16.143 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-27T11:30:16.354 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.353+0000 7ffb7dbff700 1 Processor -- start 2023-08-27T11:30:16.355 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.353+0000 7ffb7dbff700 1 -- start start 2023-08-27T11:30:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb7dbff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb780a77d0 0x7ffb7814e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb7dbff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffb780c50f0 0x7ffb780c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.356 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb7dbff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb78152140 con 0x7ffb780a5090 2023-08-27T11:30:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb7dbff700 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb781515c0 con 0x7ffb780c50f0 2023-08-27T11:30:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb7dbff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb781518a0 con 0x7ffb780a77d0 2023-08-27T11:30:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb77fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffb780c50f0 0x7ffb780c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.357 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb77fff700 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ffb780c50f0 0x7ffb780c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42110/0 (socket says 172.21.15.43:42110) 2023-08-27T11:30:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb77fff700 1 -- 172.21.15.43:0/2136115152 learned_addr learned my addr 172.21.15.43:0/2136115152 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:16.358 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.355+0000 7ffb777fe700 1 --2- 172.21.15.43:0/2136115152 >> v2:172.21.15.57:3300/0 conn(0x7ffb780a77d0 0x7ffb7814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb77fff700 1 -- 172.21.15.43:0/2136115152 >> v2:172.21.15.57:3300/0 conn(0x7ffb780a77d0 msgr2=0x7ffb7814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-27T11:30:16.359 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb77fff700 1 --2- 172.21.15.43:0/2136115152 >> v2:172.21.15.57:3300/0 conn(0x7ffb780a77d0 0x7ffb7814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb77fff700 1 -- 172.21.15.43:0/2136115152 >> v1:172.21.15.57:6789/0 conn(0x7ffb780a5090 legacy=0x7ffb7814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb77fff700 1 -- 172.21.15.43:0/2136115152 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb78151b80 con 0x7ffb780c50f0 2023-08-27T11:30:16.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb77fff700 1 --2- 172.21.15.43:0/2136115152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb780c3b60 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ffb780c3360 tx=0x7ffb7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1492c5990d8abffb server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:16.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb767fc700 1 -- 172.21.15.43:0/2136115152 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000e070 con 0x7ffb780c50f0 2023-08-27T11:30:16.360 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb767fc700 1 -- 172.21.15.43:0/2136115152 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000b8d0 con 0x7ffb780c50f0 2023-08-27T11:30:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.356+0000 7ffb767fc700 1 -- 172.21.15.43:0/2136115152 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000bc80 con 0x7ffb780c50f0 2023-08-27T11:30:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 -- 172.21.15.43:0/2136115152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 msgr2=0x7ffb780c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 --2- 172.21.15.43:0/2136115152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb780c3b60 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7ffb780c3360 tx=0x7ffb7000b330 comp rx=0 tx=0).stop 2023-08-27T11:30:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 -- 172.21.15.43:0/2136115152 shutdown_connections 2023-08-27T11:30:16.361 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 --2- 172.21.15.43:0/2136115152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb780c3b60 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 --2- 172.21.15.43:0/2136115152 >> v2:172.21.15.57:3300/0 conn(0x7ffb780a77d0 0x7ffb7814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 -- 172.21.15.43:0/2136115152 >> 172.21.15.43:0/2136115152 conn(0x7ffb780c2400 msgr2=0x7ffb780c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-27T11:30:16.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 -- 172.21.15.43:0/2136115152 shutdown_connections 2023-08-27T11:30:16.362 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.357+0000 7ffb7dbff700 1 -- 172.21.15.43:0/2136115152 wait complete. 2023-08-27T11:30:16.364 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.359+0000 7ffb7dbff700 1 Processor -- start 2023-08-27T11:30:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.359+0000 7ffb7dbff700 1 -- start start 2023-08-27T11:30:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.360+0000 7ffb7dbff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb780a5090 0x7ffb780a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb7dbff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb780a77d0 0x7ffb7813b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.365 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb7dbff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb7814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb7dbff700 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78150dd0 con 0x7ffb780c50f0 2023-08-27T11:30:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb7dbff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78150af0 con 0x7ffb780a77d0 2023-08-27T11:30:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb7dbff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7814c760 con 0x7ffb780a5090 2023-08-27T11:30:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb7814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.366 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb7814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:42112/0 (socket says 172.21.15.43:42112) 2023-08-27T11:30:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb777fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb780a5090 0x7ffb780a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 -- 172.21.15.43:0/557876465 learned_addr learned my addr 172.21.15.43:0/557876465 (peer_addr_for_me v2:172.21.15.43:0/0) 2023-08-27T11:30:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb76ffd700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb780a77d0 0x7ffb7813b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 -- 172.21.15.43:0/557876465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb780a5090 msgr2=0x7ffb780a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.367 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb780a5090 0x7ffb780a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 -- 172.21.15.43:0/557876465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb780a77d0 msgr2=0x7ffb7813b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-27T11:30:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb780a77d0 0x7ffb7813b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-27T11:30:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.361+0000 7ffb77fff700 1 -- 172.21.15.43:0/557876465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70009b30 con 0x7ffb780c50f0 2023-08-27T11:30:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb77fff700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ffb780c50f0 0x7ffb7814d520 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ffb7806dd90 tx=0x7ffb70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:16.368 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70004800 con 0x7ffb780c50f0 2023-08-27T11:30:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb700092e0 con 0x7ffb780c50f0 2023-08-27T11:30:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb7dbff700 1 -- 172.21.15.43:0/557876465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7814ca40 con 0x7ffb780c50f0 2023-08-27T11:30:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7001b670 con 0x7ffb780c50f0 2023-08-27T11:30:16.369 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.362+0000 7ffb7dbff700 1 -- 172.21.15.43:0/557876465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7814d000 con 0x7ffb780c50f0 2023-08-27T11:30:16.370 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.363+0000 7ffb7dbff700 1 -- 172.21.15.43:0/557876465 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7804ee70 con 0x7ffb780c50f0 2023-08-27T11:30:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.364+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffb7001b7d0 con 0x7ffb780c50f0 2023-08-27T11:30:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.365+0000 7ffb5ffff700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffb6406a0e0 0x7ffb6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-27T11:30:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.365+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6148+0+0 (secure 0 0 0) 0x7ffb70089ae0 con 0x7ffb780c50f0 2023-08-27T11:30:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.365+0000 7ffb777fe700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffb6406a0e0 0x7ffb6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-27T11:30:16.371 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.366+0000 7ffb777fe700 1 --2- 172.21.15.43:0/557876465 >> [v2:172.21.15.43:6832/2364062298,v1:172.21.15.43:6833/2364062298] conn(0x7ffb6406a0e0 0x7ffb6406c5a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009be0 tx=0x7ffb68009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-27T11:30:16.372 INFO:teuthology.orchestra.run.smithi043.stderr:2023-08-27T11:30:16.369+0000 7ffb5ffff700 1 -- 172.21.15.43:0/557876465 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffb70055160 con 0x7ffb780c50f0